-- Logs begin at Fri 2022-09-30 08:51:18 UTC, end at Fri 2022-09-30 11:26:15 UTC. -- Sep 30 09:25:48.360810 n-d-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Sep 30 09:25:48.367972 n-d-master-1 devstack@keystone.service[82067]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 30 09:25:48.374879 n-d-master-1 devstack@keystone.service[82067]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 30 09:25:48 2022] *** Sep 30 09:25:48.374879 n-d-master-1 devstack@keystone.service[82067]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 30 09:25:48.374879 n-d-master-1 devstack@keystone.service[82067]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 30 09:25:48.374879 n-d-master-1 devstack@keystone.service[82067]: nodename: n-d-master-1 Sep 30 09:25:48.374879 n-d-master-1 devstack@keystone.service[82067]: machine: x86_64 Sep 30 09:25:48.374879 n-d-master-1 devstack@keystone.service[82067]: clock source: unix Sep 30 09:25:48.374879 n-d-master-1 devstack@keystone.service[82067]: pcre jit disabled Sep 30 09:25:48.374879 n-d-master-1 devstack@keystone.service[82067]: detected number of CPU cores: 4 Sep 30 09:25:48.374879 n-d-master-1 devstack@keystone.service[82067]: current working directory: / Sep 30 09:25:48.374879 n-d-master-1 devstack@keystone.service[82067]: detected binary path: /usr/bin/uwsgi-core Sep 30 09:25:48.374879 n-d-master-1 devstack@keystone.service[82067]: your processes number limit is 47680 Sep 30 09:25:48.374879 n-d-master-1 devstack@keystone.service[82067]: your memory page size is 4096 bytes Sep 30 09:25:48.374879 n-d-master-1 devstack@keystone.service[82067]: detected max file descriptor number: 2048 Sep 30 09:25:48.374879 n-d-master-1 devstack@keystone.service[82067]: lock engine: pthread robust mutexes Sep 30 09:25:48.374879 n-d-master-1 devstack@keystone.service[82067]: thunder lock: enabled Sep 30 09:25:48.374879 n-d-master-1 devstack@keystone.service[82067]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 30 09:25:48.374879 n-d-master-1 devstack@keystone.service[82067]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 30 09:25:48.412107 n-d-master-1 devstack@keystone.service[82067]: Python main interpreter initialized at 0x563f4fd9f9c0 Sep 30 09:25:48.412107 n-d-master-1 devstack@keystone.service[82067]: python threads support enabled Sep 30 09:25:48.412107 n-d-master-1 devstack@keystone.service[82067]: your server socket listen backlog is limited to 100 connections Sep 30 09:25:48.412107 n-d-master-1 devstack@keystone.service[82067]: your mercy for graceful operations on workers is 90 seconds Sep 30 09:25:48.412493 n-d-master-1 devstack@keystone.service[82067]: mapped 403077 bytes (393 KB) for 2 cores Sep 30 09:25:48.412575 n-d-master-1 devstack@keystone.service[82067]: *** Operational MODE: preforking *** Sep 30 09:25:48.412828 n-d-master-1 devstack@keystone.service[82067]: *** uWSGI is running in multiple interpreter mode *** Sep 30 09:25:48.412828 n-d-master-1 devstack@keystone.service[82067]: spawned uWSGI master process (pid: 82067) Sep 30 09:25:48.413030 n-d-master-1 systemd[1]: Started Devstack devstack@keystone.service. Sep 30 09:25:48.420647 n-d-master-1 devstack@keystone.service[82067]: spawned uWSGI worker 1 (pid: 82079, cores: 1) Sep 30 09:25:48.420647 n-d-master-1 devstack@keystone.service[82067]: spawned uWSGI worker 2 (pid: 82080, cores: 1) Sep 30 09:25:48.420647 n-d-master-1 devstack@keystone.service[82067]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 30 09:25:52.695556 n-d-master-1 devstack@keystone.service[82079]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 09:25:52.695556 n-d-master-1 devstack@keystone.service[82079]: from cryptography.utils import int_from_bytes Sep 30 09:25:52.696359 n-d-master-1 devstack@keystone.service[82079]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 09:25:52.696359 n-d-master-1 devstack@keystone.service[82079]: from cryptography.utils import int_from_bytes Sep 30 09:25:52.700969 n-d-master-1 devstack@keystone.service[82080]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 09:25:52.700969 n-d-master-1 devstack@keystone.service[82080]: from cryptography.utils import int_from_bytes Sep 30 09:25:52.701446 n-d-master-1 devstack@keystone.service[82080]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 09:25:52.701446 n-d-master-1 devstack@keystone.service[82080]: from cryptography.utils import int_from_bytes Sep 30 09:25:52.753888 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 30 09:25:52.754085 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 30 09:25:52.754261 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] command line args: [] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 30 09:25:52.754528 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 30 09:25:52.754706 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ================================================================================ {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 30 09:25:52.754957 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] admin_token = **** {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.755201 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] config_dir = [] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.755386 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.755515 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 30 09:25:52.755596 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] config_source = [] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.755708 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 30 09:25:52.755793 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] debug = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.755899 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] command line args: [] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 30 09:25:52.755983 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.756160 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 30 09:25:52.756286 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.756363 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ================================================================================ {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 30 09:25:52.756436 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.756571 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] admin_token = **** {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.756698 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.756842 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] config_dir = [] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.756936 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.757042 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.757126 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] list_limit = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.757194 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] config_source = [] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.757315 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] log_config_append = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.757428 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] debug = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.757532 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.757639 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.757761 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] log_dir = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.757870 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.757966 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] log_file = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.758060 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.758160 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.758290 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.758412 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.758526 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.758602 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.758721 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] list_limit = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.758802 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.758884 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] log_config_append = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.758962 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.759040 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.759162 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.759245 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] log_dir = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.759245 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] log_file = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.759388 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.759547 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.760202 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.760392 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.760506 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.760647 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.760768 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.760896 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.761003 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.761081 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.761237 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.761374 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.761478 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.761556 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.761718 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.761802 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.761947 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.762032 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.762178 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.762407 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.762483 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.762635 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] publish_errors = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.762719 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.762862 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.762942 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.763089 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.763167 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.763265 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.763391 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.763506 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.763737 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.763855 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.763968 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] standard_threads = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.764047 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] publish_errors = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.764196 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.764295 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.764426 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.764503 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.764580 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.764715 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.764802 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] use_journal = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.764883 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.764960 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] use_json = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.765082 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.765166 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] use_stderr = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.765264 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] use_syslog = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.765341 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] standard_threads = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.765509 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.765588 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.765729 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.765808 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.765913 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.765995 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.766082 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] use_journal = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.766205 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.766283 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] use_json = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.766405 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] use_stderr = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.766487 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.766579 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] use_syslog = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.766664 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.766803 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:25:52.766887 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.767052 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.767135 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.767286 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.767375 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.767538 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.767616 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.767771 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.767848 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.768017 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.768106 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.768252 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.768335 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.768494 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.768570 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.768746 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.768837 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.768987 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.769064 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.769230 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.769309 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.769461 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.769557 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.769688 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.769767 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.769932 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.770011 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.770164 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.770249 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.770392 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.770474 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.770634 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.770710 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.770867 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.771026 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.771102 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.771172 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.771348 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.771425 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.771575 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.771655 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.771801 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.771878 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.772026 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.772105 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.772256 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.772343 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.772499 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.772586 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.772770 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.772854 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.772997 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.773075 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.773219 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.773295 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.773446 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.773524 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.773677 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.773757 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.773909 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.773991 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.774148 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.774229 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.774372 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.774449 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.774596 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.774671 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.774831 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.774914 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.775057 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.775136 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.775328 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.775405 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.775572 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.775650 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.775801 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.775880 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.776032 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.776109 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.776259 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.776342 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.776491 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.776566 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.776719 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.776799 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.776946 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.777030 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.777170 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.777249 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.777401 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.777477 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.777641 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.777718 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.777869 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.777946 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.778100 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.778183 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.778325 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.778401 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.778553 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.778631 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.778781 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.778864 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.779012 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.779088 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.779236 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.779313 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.779469 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.779578 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.779698 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.779784 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.779926 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.780003 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.780152 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.780237 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.780378 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.780454 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.780641 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.780734 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.780867 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.780944 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.781097 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.781183 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.781329 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.781417 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.781553 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.781630 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.781808 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.781888 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.782037 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.782124 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.782263 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.782341 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.782495 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.782574 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.782724 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.782815 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.782954 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.783032 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.783198 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.783282 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.783435 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.783526 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.783669 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.783747 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.783900 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.783978 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.784128 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.784214 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.784356 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.784434 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.784591 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.784688 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.784844 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.784934 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.785074 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.785184 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.785289 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.785385 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.785520 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.785633 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.785763 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.785866 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.785994 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.786076 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.786224 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.786314 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.786452 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.786530 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.786682 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.786800 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.786910 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.786997 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.787141 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.787218 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.787374 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.787455 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.787607 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.787763 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.787839 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.787955 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.788030 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.788146 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.788259 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.788347 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.788489 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.788569 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.788738 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.788817 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.788971 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.789051 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.789180 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.789259 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.789408 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.789486 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.789632 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.789750 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.789863 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.789944 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.790087 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.790191 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.790320 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.790429 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.790550 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.790660 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] auth.external = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.790913 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.790998 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.791210 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.791317 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.791485 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.791575 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.791739 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] auth.password = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.791818 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.791970 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] auth.token = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.792051 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.792197 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] auth.external = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.792274 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.792424 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.792506 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.792679 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.792758 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.792908 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.792987 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.793153 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.793231 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] auth.password = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.793385 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] auth.token = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.793501 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.793616 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.793694 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.793844 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.793923 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] credential.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.794085 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.794164 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.794312 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.794390 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.794553 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.794633 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.794796 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.794874 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.795022 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.795101 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.795251 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] credential.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.795331 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.795494 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.795572 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.795741 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.795819 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.795973 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.796052 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.796211 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.796289 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.796451 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.796574 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.796726 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.796806 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.796940 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.797019 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.797188 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.797268 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.797420 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.797501 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.797667 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.797747 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] federation.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.797903 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.797980 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.798149 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.798229 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.798393 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.798474 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.798623 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.798703 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.798870 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.798951 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.799098 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] federation.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.799176 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.799332 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.799411 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.799567 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.799647 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.799808 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.799885 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.800035 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.800122 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.800277 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.800355 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.800507 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.800584 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.800773 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.800863 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.801006 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.801127 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.801238 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.801316 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.801470 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.801624 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.801701 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.801772 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.801927 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.802006 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.802161 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.802246 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.802400 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.802478 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.802632 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.802711 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.802861 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.802946 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.803090 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.803169 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.803315 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.803392 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.803550 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.803637 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.803790 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.803868 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.804033 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.804112 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.804258 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.804343 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.804486 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.804576 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.804737 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.804817 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.804974 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.805065 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.805215 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.805294 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.805451 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.805528 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.805685 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.805774 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.805914 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.805995 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.806146 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.806224 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.806902 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.806997 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.807142 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.807338 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.807578 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.807655 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.807727 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.807809 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.807884 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.808017 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.808097 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.808251 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.808329 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.808491 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.808578 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.808753 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.808836 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.808997 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.809074 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.809223 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.809302 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.809448 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.809526 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.809683 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.809762 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.809915 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.809994 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.810148 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.810227 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.810383 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.810462 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.810608 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.810687 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.810843 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.810923 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.811070 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.811157 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.811298 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.811376 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.811525 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.811604 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.811757 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.811843 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.811990 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.812070 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.812221 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.812334 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.812453 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.812583 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.812822 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.812902 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.813054 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.813145 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.813285 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.813371 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.813530 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.813610 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.813759 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.813836 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.813992 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.814078 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.814223 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.814308 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.814454 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.814533 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.814680 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.814766 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.814907 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.814985 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.815140 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.815219 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.815371 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.815457 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.815606 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.815683 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.815834 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.815914 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.816079 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.816166 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.816306 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.816384 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.816532 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.816629 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.816789 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.816879 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.817019 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.817099 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.817248 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.817325 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.817471 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.817557 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.817712 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.817790 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.817946 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.818024 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.818178 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.818266 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.818411 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.818491 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.818646 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.818724 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.818872 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.818960 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.819113 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.819192 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.819345 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.819424 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.819577 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.819663 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.819804 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.819883 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.820034 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.820113 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.820262 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.820349 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.820498 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.820578 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.820753 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.820832 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.820992 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.821082 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.821216 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.821355 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.821432 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.821504 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.821673 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.821760 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] resource.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.821903 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.822541 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.822661 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.822849 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.822924 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.823006 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.823124 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.823278 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.823364 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.823531 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.823610 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.823768 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.823849 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] resource.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.824012 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.824092 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.824249 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.824329 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.824479 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.824558 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.824731 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] role.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.824811 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.824977 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] role.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.825057 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.825214 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.825291 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.825433 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.825513 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.825666 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.825753 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.825901 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.825980 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.826137 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] role.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.826216 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.826377 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.826463 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] role.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.826601 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.826679 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.826846 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.826925 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.827088 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.827174 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.827318 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.827398 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.827556 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.827634 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.827797 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.827883 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.828036 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.828113 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.828274 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.828632 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.828801 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.828966 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.829048 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.829201 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.829280 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.829447 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.829527 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.829693 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.829774 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.829935 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.830013 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.830178 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.830321 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.830411 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.830554 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.830633 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.830798 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.830877 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.831042 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.831123 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.831285 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.831364 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.831529 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.831608 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.831754 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.831833 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.832001 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.832080 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.832249 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.832334 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.832479 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.832558 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.832730 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.832811 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.832957 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.833036 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.833184 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.833264 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.833416 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] token.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.833495 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.833649 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.833727 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.833892 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.833971 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.834123 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.834201 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.834351 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.834429 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.834578 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.834657 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.834808 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] token.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.834887 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.835039 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.835118 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.835280 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.835360 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.835507 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.835584 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.835747 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.835824 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.835983 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.836064 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.836211 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.836288 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.836450 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.836527 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.836707 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.836788 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.836949 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.837028 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.837181 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.837271 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.837413 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.837501 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.837726 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.connection = **** {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.837809 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.837993 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.838072 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.838265 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.838396 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.838479 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.838638 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.838727 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.838883 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.838966 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.839117 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.839196 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.connection = **** {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.839354 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.839436 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.839588 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.839668 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.839822 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.839902 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.840065 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.840153 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.840298 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.840378 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.840531 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.840626 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.840786 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.840874 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.841015 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.841093 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.841252 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.841329 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.841481 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.841559 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.841713 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.841791 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.841939 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.842017 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.842171 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.842250 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.842324 n-d-master-1 devstack@keystone.service[82080]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 30 09:25:52.842403 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.842623 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.842847 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.843079 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.843307 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:25:52.843473 n-d-master-1 devstack@keystone.service[82079]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 30 09:25:52.872016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:52.872245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:52.872470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:52.872619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:52.872866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:52.873093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:52.880858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:52.881253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:52.909012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:52.909241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:52.909478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:52.909707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:52.963073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:52.963243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.011751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.011957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.012051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.012191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.167551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.167742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.167819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.167900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.168002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.168084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.168160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.168234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.168373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.168460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.168585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.168699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.191560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.191804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.191903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.191999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.192122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.192207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.192350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.192434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.192574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.192683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.192824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.192908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.193041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.193253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.204211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.204439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.217106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.217222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.217303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.217379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.217494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.217579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.217720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.217804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.217937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.218022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.218151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.218234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.218363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.218455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 09:25:53.235326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.235531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 30 09:25:53.235685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.235868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.235952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 30 09:25:53.236066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 30 09:25:53.236217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.236338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.236421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 30 09:25:53.236611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.236707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.236890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.236984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.237145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.237227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.237447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.247198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.247472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.247562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.247747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.247831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.248014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.248097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.248297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.254905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.255207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.257786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.258071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.258153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.258360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.258443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.258641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.258747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.258918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.259000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.259166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.259251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.259434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.259577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.259728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.259799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.260005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.260096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.260273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.260353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.260544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.260650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.260835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.282972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.283386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.284415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.284720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.284870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.285153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.289325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.289611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.289779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.289901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.290064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.290349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.296784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.297065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.297506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.297790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.302606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.302903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.303191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.303362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.303478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.303662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.303745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.303953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.304036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.304240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.304322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.304517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.304618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.304819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.305099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.305372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.320375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.320674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.321553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.321835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.324570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.325918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.327788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.328083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.329469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.329764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.332514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.333950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.335624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.337079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.338852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.339144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.339425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.339708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.339995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.340280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.340370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.340583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.340894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.341179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.341455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.341743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.356502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.356818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.357082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.357338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.357954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.358243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.358513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.358779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.364054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.365554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.365680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.367079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.367164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.367352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.368579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.368954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.370697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.370979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.371256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.371539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.371917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.372292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.372575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.372887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.373175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.373562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.382877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.383161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.383441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.383719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.384119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.384382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.384745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.384843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.385105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.385385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.385665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.386041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.386321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.386609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.399942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.401959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.402835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.404877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.405724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.407168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.407710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.408618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.408912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.409171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.409314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.410611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.410902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.411287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.415554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.417582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.418167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.419624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.420424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.420845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.421132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.421407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.422512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.422905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.423195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.423471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.429079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.429374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.429653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.431210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.431558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.431909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.436480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.436785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.437064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.437338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.437609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.437889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.438159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.438431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.438663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 09:25:53.438746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.438947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.439030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.439228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.439321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.439491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.439573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.439760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.439842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.440024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.440105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.440296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.440566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.440873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.441147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.441419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.441688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.441993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.442255 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 09:25:53.474356 n-d-master-1 devstack@keystone.service[82079]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563f4fd9f9c0 pid: 82079 (default app) Sep 30 09:25:53.476944 n-d-master-1 devstack@keystone.service[82080]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563f4fd9f9c0 pid: 82080 (default app) Sep 30 09:25:53.477522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92c840-fd51-443f-bc92-cdbf7d8f8ac8 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:25:53.477805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92c840-fd51-443f-bc92-cdbf7d8f8ac8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:25:53.478073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92c840-fd51-443f-bc92-cdbf7d8f8ac8 None None] PATH_INFO: `/v3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:25:53.482242 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Fri Sep 30 09:25:53 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:00.283684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b168bfb-9eaf-4cad-9a49-a1e1b7b0861f None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:00.284183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b168bfb-9eaf-4cad-9a49-a1e1b7b0861f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:00.284289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b168bfb-9eaf-4cad-9a49-a1e1b7b0861f None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:00.288427 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:00.294336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad2717-6930-4333-8b32-c3ec486ef277 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:00.294780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad2717-6930-4333-8b32-c3ec486ef277 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:00.294914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad2717-6930-4333-8b32-c3ec486ef277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:00.364469 n-d-master-1 devstack@keystone.service[82079]: INFO dbcounter [None req-5bad2717-6930-4333-8b32-c3ec486ef277 None None] Registered counter for database keystone Sep 30 09:26:00.383461 n-d-master-1 devstack@keystone.service[82079]: DEBUG oslo_db.sqlalchemy.engines [None req-5bad2717-6930-4333-8b32-c3ec486ef277 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82079) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 09:26:00.390195 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writer thread running {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 09:26:00.573922 n-d-master-1 devstack@keystone.service[82079]: DEBUG passlib.handlers.bcrypt [None req-5bad2717-6930-4333-8b32-c3ec486ef277 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82079) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 30 09:26:00.574220 n-d-master-1 devstack@keystone.service[82079]: DEBUG passlib.handlers.bcrypt [None req-5bad2717-6930-4333-8b32-c3ec486ef277 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82079) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 30 09:26:00.632518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5bad2717-6930-4333-8b32-c3ec486ef277 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:00.634128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5bad2717-6930-4333-8b32-c3ec486ef277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:00.765461 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 30 09:26:01.295315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b168bfb-9eaf-4cad-9a49-a1e1b7b0861f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:01.364146 n-d-master-1 devstack@keystone.service[82080]: INFO dbcounter [None req-4b168bfb-9eaf-4cad-9a49-a1e1b7b0861f None None] Registered counter for database keystone Sep 30 09:26:01.385889 n-d-master-1 devstack@keystone.service[82080]: DEBUG oslo_db.sqlalchemy.engines [None req-4b168bfb-9eaf-4cad-9a49-a1e1b7b0861f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 09:26:01.391993 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writer thread running {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 09:26:01.515231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b168bfb-9eaf-4cad-9a49-a1e1b7b0861f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:01.519492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49950a-e0cf-4f95-b59b-6320bf677a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:01.520119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49950a-e0cf-4f95-b59b-6320bf677a0f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:01.520398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49950a-e0cf-4f95-b59b-6320bf677a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:01.520697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49950a-e0cf-4f95-b59b-6320bf677a0f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:01.529023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49950a-e0cf-4f95-b59b-6320bf677a0f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:01.581372 n-d-master-1 devstack@keystone.service[82080]: WARNING keystone.common.rbac_enforcer.enforcer [None req-aa49950a-e0cf-4f95-b59b-6320bf677a0f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 30 09:26:01.581657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49950a-e0cf-4f95-b59b-6320bf677a0f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:01.591924 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Sep 30 09:26:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:26:01.597856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad2717-6930-4333-8b32-c3ec486ef277 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:01.614153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad2717-6930-4333-8b32-c3ec486ef277 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:01.618583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdddf1a-3bdd-4f75-9272-91c25705c94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:01.619698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdddf1a-3bdd-4f75-9272-91c25705c94e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:01.619975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdddf1a-3bdd-4f75-9272-91c25705c94e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:01.620245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdddf1a-3bdd-4f75-9272-91c25705c94e admin admin] PATH_INFO: `/v3/projects/2ffba943875a42809c70ac5c9bd54394` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:01.621841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdddf1a-3bdd-4f75-9272-91c25705c94e admin admin] RBAC: Authorizing `identity:get_project(project_id=2ffba943875a42809c70ac5c9bd54394)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:01.674527 n-d-master-1 devstack@keystone.service[82079]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fbdddf1a-3bdd-4f75-9272-91c25705c94e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 30 09:26:01.674865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdddf1a-3bdd-4f75-9272-91c25705c94e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:01.679295 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Sep 30 09:26:01 2022] GET /identity/v3/projects/2ffba943875a42809c70ac5c9bd54394 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:03.803107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90cfc4-d372-4cd0-bd5b-1b5f09d3dc60 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:03.803632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90cfc4-d372-4cd0-bd5b-1b5f09d3dc60 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:03.803632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90cfc4-d372-4cd0-bd5b-1b5f09d3dc60 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:03.807692 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:03.813043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b235795-8d81-49b4-a957-fb5972d5d925 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:03.813448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b235795-8d81-49b4-a957-fb5972d5d925 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:03.813588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b235795-8d81-49b4-a957-fb5972d5d925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:03.833985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8b235795-8d81-49b4-a957-fb5972d5d925 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:03.835493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8b235795-8d81-49b4-a957-fb5972d5d925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:03.844261 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 30 09:26:04.110307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90cfc4-d372-4cd0-bd5b-1b5f09d3dc60 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:04.122951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90cfc4-d372-4cd0-bd5b-1b5f09d3dc60 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:04.127074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010092a-6c7b-4ae9-97d6-6e4198115ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:04.127663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010092a-6c7b-4ae9-97d6-6e4198115ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:04.127938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010092a-6c7b-4ae9-97d6-6e4198115ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:04.128204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010092a-6c7b-4ae9-97d6-6e4198115ad3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:04.136351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010092a-6c7b-4ae9-97d6-6e4198115ad3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:04.138116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010092a-6c7b-4ae9-97d6-6e4198115ad3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:04.147000 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Sep 30 09:26:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:26:04.152937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b235795-8d81-49b4-a957-fb5972d5d925 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:04.162134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b235795-8d81-49b4-a957-fb5972d5d925 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:04.166672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2432683-d1d4-48aa-8ed8-6204342fd98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:04.167275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2432683-d1d4-48aa-8ed8-6204342fd98a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:04.167553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2432683-d1d4-48aa-8ed8-6204342fd98a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:04.167822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2432683-d1d4-48aa-8ed8-6204342fd98a admin admin] PATH_INFO: `/v3/users/f35bc6b4a2c94914bd986ad019ecb5c6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:04.169153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2432683-d1d4-48aa-8ed8-6204342fd98a admin admin] RBAC: Authorizing `identity:get_user(user_id=f35bc6b4a2c94914bd986ad019ecb5c6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:04.170944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2432683-d1d4-48aa-8ed8-6204342fd98a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:04.172421 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Sep 30 09:26:04 2022] GET /identity/v3/users/f35bc6b4a2c94914bd986ad019ecb5c6 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:06.387265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4510e-a39d-4df3-b4b2-a3e085ceeacd None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:06.387813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4510e-a39d-4df3-b4b2-a3e085ceeacd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:06.387813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4510e-a39d-4df3-b4b2-a3e085ceeacd None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:06.389145 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:06.394427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee198a64-d799-4558-b944-9da98fb34442 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:06.394815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee198a64-d799-4558-b944-9da98fb34442 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:06.394975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee198a64-d799-4558-b944-9da98fb34442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:06.410095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be255bc-441a-447a-a878-63cd496f9497 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:06.410375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be255bc-441a-447a-a878-63cd496f9497 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:06.410647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be255bc-441a-447a-a878-63cd496f9497 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:06.411925 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:06.413655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ee198a64-d799-4558-b944-9da98fb34442 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:06.414849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ee198a64-d799-4558-b944-9da98fb34442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:06.417406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd174c5-cc6d-4889-ba75-e517a974e765 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:06.417682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd174c5-cc6d-4889-ba75-e517a974e765 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:06.417947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd174c5-cc6d-4889-ba75-e517a974e765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:06.458666 n-d-master-1 devstack@keystone.service[82080]: DEBUG passlib.handlers.bcrypt [None req-cbd174c5-cc6d-4889-ba75-e517a974e765 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82080) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 30 09:26:06.459060 n-d-master-1 devstack@keystone.service[82080]: DEBUG passlib.handlers.bcrypt [None req-cbd174c5-cc6d-4889-ba75-e517a974e765 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82080) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 30 09:26:06.497256 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:26:06.508241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cbd174c5-cc6d-4889-ba75-e517a974e765 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:06.510503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cbd174c5-cc6d-4889-ba75-e517a974e765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:06.609242 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:26:06.765722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee198a64-d799-4558-b944-9da98fb34442 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:06.791913 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:06.873260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee198a64-d799-4558-b944-9da98fb34442 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:06.887342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd174c5-cc6d-4889-ba75-e517a974e765 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:06.907301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4cec7-846f-4304-acdf-33894f80f834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:06.907933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4cec7-846f-4304-acdf-33894f80f834 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:06.908212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4cec7-846f-4304-acdf-33894f80f834 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:06.908484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4cec7-846f-4304-acdf-33894f80f834 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:06.922725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4cec7-846f-4304-acdf-33894f80f834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:06.931111 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-6cd4cec7-846f-4304-acdf-33894f80f834 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:06.931111 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:06.931111 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:06.931111 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:06.931111 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:06.931111 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:06.931111 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:06.931111 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:06.931111 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:06.931111 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:06.931111 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:06.931111 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:06.931111 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:06.931111 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:06.931111 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:06.931111 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:06.932161 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:06.932161 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:06.932161 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:06.932161 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:06.932161 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:06.932161 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:06.932161 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:06.932161 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:06.932161 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:06.932161 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:06.932161 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:06.932161 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:06.932161 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:06.932161 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:06.932161 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:06.932161 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:06.933248 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:06.933248 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:06.933248 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:06.933248 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:06.933248 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:06.933248 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:06.933248 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:06.933248 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:06.933248 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:06.933248 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:06.933248 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:06.933248 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:26:06.933248 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:06.938313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4cec7-846f-4304-acdf-33894f80f834 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:06.989395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd174c5-cc6d-4889-ba75-e517a974e765 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:06.991638 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:07.023020 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:07.026973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b53772-4f82-47d4-adc5-b222fff7a454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:07.027840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b53772-4f82-47d4-adc5-b222fff7a454 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:07.028118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b53772-4f82-47d4-adc5-b222fff7a454 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:07.028388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b53772-4f82-47d4-adc5-b222fff7a454 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:07.041721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4cec7-846f-4304-acdf-33894f80f834 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:07.076299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b755f1b-b00d-48a0-85d8-bdf03b0dbfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:07.076947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b755f1b-b00d-48a0-85d8-bdf03b0dbfc5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:07.077251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b755f1b-b00d-48a0-85d8-bdf03b0dbfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:07.077659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b755f1b-b00d-48a0-85d8-bdf03b0dbfc5 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:07.078386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b755f1b-b00d-48a0-85d8-bdf03b0dbfc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:07.078770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b755f1b-b00d-48a0-85d8-bdf03b0dbfc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:07.080403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b755f1b-b00d-48a0-85d8-bdf03b0dbfc5 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:07.092781 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:07.096464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b53772-4f82-47d4-adc5-b222fff7a454 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:07.098295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b53772-4f82-47d4-adc5-b222fff7a454 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:07.098662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b755f1b-b00d-48a0-85d8-bdf03b0dbfc5 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:07.195498 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 09:26:07.196410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b755f1b-b00d-48a0-85d8-bdf03b0dbfc5 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:07.201141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b53772-4f82-47d4-adc5-b222fff7a454 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:07.204588 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:07.231182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5fada-be57-4eb7-90ba-ccfc99bf2a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:07.231801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5fada-be57-4eb7-90ba-ccfc99bf2a1f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:07.232079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5fada-be57-4eb7-90ba-ccfc99bf2a1f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:07.232353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5fada-be57-4eb7-90ba-ccfc99bf2a1f None admin] PATH_INFO: `/v3/users/f35bc6b4a2c94914bd986ad019ecb5c6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:07.233507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5fada-be57-4eb7-90ba-ccfc99bf2a1f None admin] RBAC: Authorizing `identity:get_user(user_id=f35bc6b4a2c94914bd986ad019ecb5c6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:07.234945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5fada-be57-4eb7-90ba-ccfc99bf2a1f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:07.236469 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:07 2022] GET /identity/v3/users/f35bc6b4a2c94914bd986ad019ecb5c6 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:07.241933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5fada-be57-4eb7-90ba-ccfc99bf2a1f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:07.256340 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:07.300136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b53772-4f82-47d4-adc5-b222fff7a454 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:07.335651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e98bde2-d6f8-436b-a2df-9ca6db32e0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:07.336502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98bde2-d6f8-436b-a2df-9ca6db32e0fd None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:07.336817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98bde2-d6f8-436b-a2df-9ca6db32e0fd None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:07.337097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98bde2-d6f8-436b-a2df-9ca6db32e0fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:07.355493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5fada-be57-4eb7-90ba-ccfc99bf2a1f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:07.358822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e98bde2-d6f8-436b-a2df-9ca6db32e0fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:07.360311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e98bde2-d6f8-436b-a2df-9ca6db32e0fd None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:07.378687 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-6e98bde2-d6f8-436b-a2df-9ca6db32e0fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:07.378687 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:07.378687 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:07.378687 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:07.378687 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:07.378687 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:07.378687 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:07.378687 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:07.378687 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:07.378687 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:07.378687 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:07.378687 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:07.378687 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:07.378687 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:07.378687 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:07.378687 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:07.379665 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:07.379665 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:07.379665 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:07.379665 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:07.379665 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:07.379665 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:07.379665 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:07.379665 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:07.379665 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:07.379665 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:07.379665 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:07.379665 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:07.379665 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:07.379665 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:07.379665 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:07.379665 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:07.379665 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:07.380484 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:07.380484 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:07.380484 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:26:07.380484 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:07.386615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e98bde2-d6f8-436b-a2df-9ca6db32e0fd None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:07.390959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d33525-fd1a-438e-aafd-61cf74890e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:07.391588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d33525-fd1a-438e-aafd-61cf74890e6d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:07.391867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d33525-fd1a-438e-aafd-61cf74890e6d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:07.392138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d33525-fd1a-438e-aafd-61cf74890e6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:07.393270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d33525-fd1a-438e-aafd-61cf74890e6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:07.394705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d33525-fd1a-438e-aafd-61cf74890e6d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:07.396303 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:07.402738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d33525-fd1a-438e-aafd-61cf74890e6d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:07.449653 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:07.491565 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:07.502194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e98bde2-d6f8-436b-a2df-9ca6db32e0fd None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:07.516416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d33525-fd1a-438e-aafd-61cf74890e6d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:07.539387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee049ddd-8ad5-4c91-b461-1fc8091641d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:07.539986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee049ddd-8ad5-4c91-b461-1fc8091641d8 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:07.540261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee049ddd-8ad5-4c91-b461-1fc8091641d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:07.540532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee049ddd-8ad5-4c91-b461-1fc8091641d8 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:07.541276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee049ddd-8ad5-4c91-b461-1fc8091641d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:07.541668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee049ddd-8ad5-4c91-b461-1fc8091641d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:07.543234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee049ddd-8ad5-4c91-b461-1fc8091641d8 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:07.554620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fba36-456f-4baf-82c2-432c7e859211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:07.555223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fba36-456f-4baf-82c2-432c7e859211 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:07.555522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fba36-456f-4baf-82c2-432c7e859211 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:07.555783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fba36-456f-4baf-82c2-432c7e859211 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:07.556508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6fba36-456f-4baf-82c2-432c7e859211 None admin] RBAC: Adding query filter params (role.id=f06b5fed717d4b03a5083dd847274296, scope.domain.id=default, user.id=f35bc6b4a2c94914bd986ad019ecb5c6) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:07.557256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6fba36-456f-4baf-82c2-432c7e859211 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:07.558794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6fba36-456f-4baf-82c2-432c7e859211 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:07.563306 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:07.565676 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 11/21] 10.222.0.16 () {56 vars in 1322 bytes} [Fri Sep 30 09:26:07 2022] GET /identity/v3/role_assignments?user.id=f35bc6b4a2c94914bd986ad019ecb5c6&scope.domain.id=default&role.id=f06b5fed717d4b03a5083dd847274296 => generated 233 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:10.158525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d3a57-18d7-4f44-98cc-8c823f48521c None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:10.159049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d3a57-18d7-4f44-98cc-8c823f48521c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:10.159049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d3a57-18d7-4f44-98cc-8c823f48521c None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:10.160814 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 11/22] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:10.174536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42407664-1c19-4e32-b457-ac22c344f650 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:10.175022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42407664-1c19-4e32-b457-ac22c344f650 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:10.175022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42407664-1c19-4e32-b457-ac22c344f650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:10.201650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-42407664-1c19-4e32-b457-ac22c344f650 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:10.202874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-42407664-1c19-4e32-b457-ac22c344f650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:10.284989 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 12/23] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:10.427217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ca5a9-a925-4fb2-990c-5f9ed3cbdbbd None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:10.427509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ca5a9-a925-4fb2-990c-5f9ed3cbdbbd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:10.427682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ca5a9-a925-4fb2-990c-5f9ed3cbdbbd None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:10.429052 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:10.434712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931195d-6121-4246-a251-e100fbaad067 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:10.435007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931195d-6121-4246-a251-e100fbaad067 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:10.435285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931195d-6121-4246-a251-e100fbaad067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:10.458136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1931195d-6121-4246-a251-e100fbaad067 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:10.459327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1931195d-6121-4246-a251-e100fbaad067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:10.551737 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 13/25] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:10.649145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51055f-789c-48e4-b743-d1b8a718b8e3 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:10.649455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51055f-789c-48e4-b743-d1b8a718b8e3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:10.649695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51055f-789c-48e4-b743-d1b8a718b8e3 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:10.651216 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 13/26] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:10.661707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91b13f-ab8a-40f2-b0dd-32cbab0d7b54 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:10.661994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91b13f-ab8a-40f2-b0dd-32cbab0d7b54 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:10.662275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91b13f-ab8a-40f2-b0dd-32cbab0d7b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:10.675385 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:10.691963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0d91b13f-ab8a-40f2-b0dd-32cbab0d7b54 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:10.693120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0d91b13f-ab8a-40f2-b0dd-32cbab0d7b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:10.728795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51055f-789c-48e4-b743-d1b8a718b8e3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:10.809949 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 14/27] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:10.845520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51055f-789c-48e4-b743-d1b8a718b8e3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:10.876949 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:10.880296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa9ba2-9748-4436-863d-5b460588dd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:10.881014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa9ba2-9748-4436-863d-5b460588dd00 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:10.883087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa9ba2-9748-4436-863d-5b460588dd00 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:10.883087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa9ba2-9748-4436-863d-5b460588dd00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:10.894055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa9ba2-9748-4436-863d-5b460588dd00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:10.900059 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-16aa9ba2-9748-4436-863d-5b460588dd00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:10.900059 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:10.900059 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:10.900059 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:10.900059 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:10.900059 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:10.900059 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:10.900059 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:10.900059 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:10.900059 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:10.900059 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:10.900059 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:10.900059 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:10.900059 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:10.900059 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:10.900059 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:10.901502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:10.901502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:10.901502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:10.901502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:10.901502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:10.901502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:10.901502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:10.901502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:10.901502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:10.901502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:10.901502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:10.901502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:10.901502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:10.901502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:10.901502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:10.901502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:10.902255 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:10.902255 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:10.902255 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:10.902255 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:10.902255 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:10.902255 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:10.902255 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:10.902255 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:10.902255 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:10.902255 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:10.902255 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:10.902255 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:26:10.902255 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 14/28] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:10.907761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91b13f-ab8a-40f2-b0dd-32cbab0d7b54 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:11.055284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91b13f-ab8a-40f2-b0dd-32cbab0d7b54 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:11.094928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba0619-60f7-4158-b47b-bfd1d4368500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:11.095529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba0619-60f7-4158-b47b-bfd1d4368500 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:11.095802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba0619-60f7-4158-b47b-bfd1d4368500 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:11.096069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba0619-60f7-4158-b47b-bfd1d4368500 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:11.096757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba0619-60f7-4158-b47b-bfd1d4368500 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:11.097060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba0619-60f7-4158-b47b-bfd1d4368500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:11.098424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba0619-60f7-4158-b47b-bfd1d4368500 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:11.106563 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 15/29] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:11.107854 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:11.112276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa9ba2-9748-4436-863d-5b460588dd00 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:11.145230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba0619-60f7-4158-b47b-bfd1d4368500 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:11.263121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa9ba2-9748-4436-863d-5b460588dd00 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:11.276143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba0619-60f7-4158-b47b-bfd1d4368500 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:11.300248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdf2c1-a21e-4386-bb6a-d76b0192edf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:11.301310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdf2c1-a21e-4386-bb6a-d76b0192edf4 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:11.301786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdf2c1-a21e-4386-bb6a-d76b0192edf4 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:11.302273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdf2c1-a21e-4386-bb6a-d76b0192edf4 None admin] PATH_INFO: `/v3/users/f35bc6b4a2c94914bd986ad019ecb5c6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:11.303991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdf2c1-a21e-4386-bb6a-d76b0192edf4 None admin] RBAC: Authorizing `identity:get_user(user_id=f35bc6b4a2c94914bd986ad019ecb5c6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:11.305784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdf2c1-a21e-4386-bb6a-d76b0192edf4 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:11.307912 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 15/30] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:11 2022] GET /identity/v3/users/f35bc6b4a2c94914bd986ad019ecb5c6 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:11.308981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdf2c1-a21e-4386-bb6a-d76b0192edf4 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:11.319854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf054c3e-2731-4cfd-be8b-6bafd2ee2f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:11.320804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf054c3e-2731-4cfd-be8b-6bafd2ee2f04 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:11.321332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf054c3e-2731-4cfd-be8b-6bafd2ee2f04 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:11.321797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf054c3e-2731-4cfd-be8b-6bafd2ee2f04 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:11.323212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf054c3e-2731-4cfd-be8b-6bafd2ee2f04 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:11.325053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf054c3e-2731-4cfd-be8b-6bafd2ee2f04 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:11.365049 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:11.422401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdf2c1-a21e-4386-bb6a-d76b0192edf4 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:11.457983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ef600-f6a8-4f98-ac0f-97d9992a83b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:11.458609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ef600-f6a8-4f98-ac0f-97d9992a83b7 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:11.458884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ef600-f6a8-4f98-ac0f-97d9992a83b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:11.459160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ef600-f6a8-4f98-ac0f-97d9992a83b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:11.466858 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 16/31] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Sep 30 09:26:11 2022] POST /identity/v3/roles => generated 225 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:26:11.472663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ef600-f6a8-4f98-ac0f-97d9992a83b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:11.472663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ef600-f6a8-4f98-ac0f-97d9992a83b7 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:11.474945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4b5d8-1a6e-4c15-ace1-3bacc9320acd None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:11.475444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4b5d8-1a6e-4c15-ace1-3bacc9320acd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:11.475912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4b5d8-1a6e-4c15-ace1-3bacc9320acd None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:11.477452 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 17/32] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:11.481793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4b5d8-1a6e-4c15-ace1-3bacc9320acd None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:11.487379 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-fd1ef600-f6a8-4f98-ac0f-97d9992a83b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:11.487379 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:11.487379 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:11.487379 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:11.487379 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:11.487379 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:11.487379 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:11.487379 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:11.487379 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:11.487379 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:11.487379 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:11.487379 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:11.487379 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:26:11.487379 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:26:11.487379 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:26:11.487379 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:26:11.488286 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:11.488286 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:11.488286 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:11.488286 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:11.488286 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:11.488286 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:11.488286 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:11.488286 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:11.488286 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:11.488286 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:11.488286 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:11.488286 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:11.488286 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:11.488286 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:11.488286 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:11.488286 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:11.488286 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:26:11.489892 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:26:11.489892 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:26:11.489892 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:26:11.489892 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 16/33] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:11.495087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ef600-f6a8-4f98-ac0f-97d9992a83b7 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:11.601090 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:11.623899 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:11.630314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ef600-f6a8-4f98-ac0f-97d9992a83b7 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:11.670224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a1817-636e-4b98-92b2-83e278402122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:11.671140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a1817-636e-4b98-92b2-83e278402122 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:11.671633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a1817-636e-4b98-92b2-83e278402122 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:11.671999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a1817-636e-4b98-92b2-83e278402122 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:11.672801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a1817-636e-4b98-92b2-83e278402122 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:11.673200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a1817-636e-4b98-92b2-83e278402122 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:11.674668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a1817-636e-4b98-92b2-83e278402122 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:11.685429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4b5d8-1a6e-4c15-ace1-3bacc9320acd None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:11.690976 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 17/34] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:11.692433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c8110-67e8-4da8-b4a6-a6570a17814c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:11.698174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c8110-67e8-4da8-b4a6-a6570a17814c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:11.698174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c8110-67e8-4da8-b4a6-a6570a17814c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:11.721177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e22c8110-67e8-4da8-b4a6-a6570a17814c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:11.723094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e22c8110-67e8-4da8-b4a6-a6570a17814c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:11.760422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adebb7-b73e-44b1-b353-a8f232e533a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:11.761190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adebb7-b73e-44b1-b353-a8f232e533a3 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:11.761478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adebb7-b73e-44b1-b353-a8f232e533a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:11.761761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adebb7-b73e-44b1-b353-a8f232e533a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:11.765790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adebb7-b73e-44b1-b353-a8f232e533a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:11.767521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adebb7-b73e-44b1-b353-a8f232e533a3 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:11.769780 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 18/35] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:11.770610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adebb7-b73e-44b1-b353-a8f232e533a3 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:11.815645 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 18/36] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:11.817521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c8110-67e8-4da8-b4a6-a6570a17814c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:11.959028 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:11.977659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c8110-67e8-4da8-b4a6-a6570a17814c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:12.016855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653baed-a78b-4800-a6a4-813e39bda2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:12.017533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653baed-a78b-4800-a6a4-813e39bda2ed None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.017809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653baed-a78b-4800-a6a4-813e39bda2ed None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.018080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653baed-a78b-4800-a6a4-813e39bda2ed None admin] PATH_INFO: `/v3/domains/default/users/f35bc6b4a2c94914bd986ad019ecb5c6/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.020982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653baed-a78b-4800-a6a4-813e39bda2ed None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f35bc6b4a2c94914bd986ad019ecb5c6, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:12.022437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653baed-a78b-4800-a6a4-813e39bda2ed None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:12.057638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adebb7-b73e-44b1-b353-a8f232e533a3 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:12.082699 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:12.094951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d76c0-1eb8-4250-a9d6-0264f42479ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:12.095561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d76c0-1eb8-4250-a9d6-0264f42479ff None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.095868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d76c0-1eb8-4250-a9d6-0264f42479ff None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.096112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d76c0-1eb8-4250-a9d6-0264f42479ff None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.096788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d76c0-1eb8-4250-a9d6-0264f42479ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:12.098219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d76c0-1eb8-4250-a9d6-0264f42479ff None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:12.127924 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 19/37] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Sep 30 09:26:11 2022] POST /identity/v3/projects => generated 301 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:12.129168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10ba16-f23d-4a38-a593-eb9a6c74c840 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.129548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10ba16-f23d-4a38-a593-eb9a6c74c840 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.129823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10ba16-f23d-4a38-a593-eb9a6c74c840 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.131216 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 20/38] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:12.132096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfef82-7c8a-4bee-bf41-adf43c632183 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.132373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfef82-7c8a-4bee-bf41-adf43c632183 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.132722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfef82-7c8a-4bee-bf41-adf43c632183 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.138810 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 21/39] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:12.138810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfef82-7c8a-4bee-bf41-adf43c632183 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:12.145686 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 19/40] 10.222.0.16 () {58 vars in 1361 bytes} [Fri Sep 30 09:26:11 2022] PUT /identity/v3/domains/default/users/f35bc6b4a2c94914bd986ad019ecb5c6/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:26:12.147182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cf792-6110-4b1a-a6d7-2070cc3e7743 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.147479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cf792-6110-4b1a-a6d7-2070cc3e7743 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.147759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cf792-6110-4b1a-a6d7-2070cc3e7743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.171093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-555cf792-6110-4b1a-a6d7-2070cc3e7743 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:12.172853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-555cf792-6110-4b1a-a6d7-2070cc3e7743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:12.273356 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 20/41] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:12.274650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c46976-38a9-4c69-b518-64d632efc68a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.274937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c46976-38a9-4c69-b518-64d632efc68a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.275214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c46976-38a9-4c69-b518-64d632efc68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.297300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a2c46976-38a9-4c69-b518-64d632efc68a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:12.298901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a2c46976-38a9-4c69-b518-64d632efc68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:12.318867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfef82-7c8a-4bee-bf41-adf43c632183 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:12.395462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3987153-34c5-4b1f-8534-e545087be57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:12.396082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3987153-34c5-4b1f-8534-e545087be57b None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.396363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3987153-34c5-4b1f-8534-e545087be57b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.396726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3987153-34c5-4b1f-8534-e545087be57b None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.397405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3987153-34c5-4b1f-8534-e545087be57b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:12.398849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3987153-34c5-4b1f-8534-e545087be57b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:12.401500 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 21/42] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:12.415032 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 22/43] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Sep 30 09:26:12 2022] POST /identity/v3/roles => generated 219 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:12.590125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c46976-38a9-4c69-b518-64d632efc68a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:12.599039 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:12.695888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3987153-34c5-4b1f-8534-e545087be57b None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:12.705723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c46976-38a9-4c69-b518-64d632efc68a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:12.732953 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:12.743602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e815eb1-15af-412a-86e8-c4274b2efe11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:12.744267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e815eb1-15af-412a-86e8-c4274b2efe11 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.744672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e815eb1-15af-412a-86e8-c4274b2efe11 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.744956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e815eb1-15af-412a-86e8-c4274b2efe11 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.745631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e815eb1-15af-412a-86e8-c4274b2efe11 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:12.747203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e815eb1-15af-412a-86e8-c4274b2efe11 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:12.768271 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Sep 30 09:26:12 2022] POST /identity/v3/roles => generated 223 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:12.816776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3987153-34c5-4b1f-8534-e545087be57b None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:12.856360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d81a6-3460-488a-987c-4477fedc6874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:12.856954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d81a6-3460-488a-987c-4477fedc6874 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:12.857231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d81a6-3460-488a-987c-4477fedc6874 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:12.857499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d81a6-3460-488a-987c-4477fedc6874 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:12.858659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d81a6-3460-488a-987c-4477fedc6874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:12.860134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d81a6-3460-488a-987c-4477fedc6874 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:12.862049 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 23/45] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:12.867622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e815eb1-15af-412a-86e8-c4274b2efe11 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:12.941847 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:12.981553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e815eb1-15af-412a-86e8-c4274b2efe11 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:13.018830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2a493-7f19-47a8-9eb2-f464d727036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:13.019445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2a493-7f19-47a8-9eb2-f464d727036c None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:13.019724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2a493-7f19-47a8-9eb2-f464d727036c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:13.019995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2a493-7f19-47a8-9eb2-f464d727036c None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:13.020663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2a493-7f19-47a8-9eb2-f464d727036c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:13.022143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2a493-7f19-47a8-9eb2-f464d727036c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:13.050987 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Sep 30 09:26:12 2022] POST /identity/v3/projects => generated 312 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:14.469099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d62b92-232d-4e6a-bb78-c26bb8e9da9a None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:14.469649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d62b92-232d-4e6a-bb78-c26bb8e9da9a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:14.469649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d62b92-232d-4e6a-bb78-c26bb8e9da9a None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:14.470981 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 24/47] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:14.476204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dceb0e-ce9f-44c0-a474-40c60f442742 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:14.476649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dceb0e-ce9f-44c0-a474-40c60f442742 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:14.476796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dceb0e-ce9f-44c0-a474-40c60f442742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:14.495855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-51dceb0e-ce9f-44c0-a474-40c60f442742 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:14.497091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-51dceb0e-ce9f-44c0-a474-40c60f442742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:14.566768 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 24/48] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:14.832056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d62b92-232d-4e6a-bb78-c26bb8e9da9a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:14.952441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d62b92-232d-4e6a-bb78-c26bb8e9da9a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:14.955029 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:14.987271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79e8c6-ebb7-4b43-bfed-174c8eecf0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:14.987888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79e8c6-ebb7-4b43-bfed-174c8eecf0a2 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:14.988166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79e8c6-ebb7-4b43-bfed-174c8eecf0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:14.988434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79e8c6-ebb7-4b43-bfed-174c8eecf0a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:14.998364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79e8c6-ebb7-4b43-bfed-174c8eecf0a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:15.003127 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-6d79e8c6-ebb7-4b43-bfed-174c8eecf0a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:15.003127 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:15.003127 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:15.003127 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:15.003127 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:15.003127 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:15.003127 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:15.003127 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:15.003127 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:15.003127 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:15.003127 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:15.003127 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:15.003127 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:15.003127 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:15.003127 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:15.003127 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:15.003950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:15.003950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:15.003950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:15.003950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:15.003950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:15.003950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:15.003950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:15.003950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:15.003950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:15.003950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:15.003950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:15.003950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:15.003950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:15.003950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:15.003950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:15.003950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:15.004742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:15.004742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:15.004742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:15.004742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:15.004742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:15.004742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:15.004742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:15.004742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:15.004742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:15.004742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:15.004742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:15.004742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:26:15.004742 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 25/49] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:15.010548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dceb0e-ce9f-44c0-a474-40c60f442742 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:15.057373 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:15.113199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dceb0e-ce9f-44c0-a474-40c60f442742 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:15.146732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bed40a-29b0-407c-9792-80c5f95104b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:15.147338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bed40a-29b0-407c-9792-80c5f95104b4 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:15.147617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bed40a-29b0-407c-9792-80c5f95104b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:15.147891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bed40a-29b0-407c-9792-80c5f95104b4 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:15.148557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bed40a-29b0-407c-9792-80c5f95104b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:15.148901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bed40a-29b0-407c-9792-80c5f95104b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:15.150272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bed40a-29b0-407c-9792-80c5f95104b4 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:15.162771 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 25/50] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:15.169229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79e8c6-ebb7-4b43-bfed-174c8eecf0a2 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:15.198077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ad549-c612-4c4b-b662-47677cc33c55 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:15.198356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ad549-c612-4c4b-b662-47677cc33c55 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:15.198628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ad549-c612-4c4b-b662-47677cc33c55 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:15.199980 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 26/51] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:15.205401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370abb2-fc5a-4828-b1a1-c707892a3932 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:15.205680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370abb2-fc5a-4828-b1a1-c707892a3932 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:15.205951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370abb2-fc5a-4828-b1a1-c707892a3932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:15.223731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0370abb2-fc5a-4828-b1a1-c707892a3932 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:15.224956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0370abb2-fc5a-4828-b1a1-c707892a3932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:15.272086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79e8c6-ebb7-4b43-bfed-174c8eecf0a2 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:15.290777 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 27/52] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:26:15.305487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac4059-2239-4949-a4b0-6b2d9e57e339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:15.306114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac4059-2239-4949-a4b0-6b2d9e57e339 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:15.306395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac4059-2239-4949-a4b0-6b2d9e57e339 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:15.307161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac4059-2239-4949-a4b0-6b2d9e57e339 None admin] PATH_INFO: `/v3/users/f35bc6b4a2c94914bd986ad019ecb5c6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:15.308360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac4059-2239-4949-a4b0-6b2d9e57e339 None admin] RBAC: Authorizing `identity:get_user(user_id=f35bc6b4a2c94914bd986ad019ecb5c6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:15.309838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac4059-2239-4949-a4b0-6b2d9e57e339 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:15.311387 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:15 2022] GET /identity/v3/users/f35bc6b4a2c94914bd986ad019ecb5c6 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:15.316822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370abb2-fc5a-4828-b1a1-c707892a3932 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:15.461553 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:15.519024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370abb2-fc5a-4828-b1a1-c707892a3932 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:15.552651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726755e8-5188-46b8-a3c4-7b6f65f19a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:15.553280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726755e8-5188-46b8-a3c4-7b6f65f19a36 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:15.553557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726755e8-5188-46b8-a3c4-7b6f65f19a36 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:15.553827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726755e8-5188-46b8-a3c4-7b6f65f19a36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:15.554915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726755e8-5188-46b8-a3c4-7b6f65f19a36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:15.556357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726755e8-5188-46b8-a3c4-7b6f65f19a36 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:15.558921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac4059-2239-4949-a4b0-6b2d9e57e339 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:15.559366 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 28/54] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:15.564467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726755e8-5188-46b8-a3c4-7b6f65f19a36 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:15.591534 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:15.660127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac4059-2239-4949-a4b0-6b2d9e57e339 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:15.661235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726755e8-5188-46b8-a3c4-7b6f65f19a36 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:15.670270 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:15.693950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4e0ab-5e15-4353-ac75-7e927814dc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:15.694455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c5666-f8a0-4e59-88e5-7e8bcf56e949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:15.694573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4e0ab-5e15-4353-ac75-7e927814dc1d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:15.694844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4e0ab-5e15-4353-ac75-7e927814dc1d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:15.695041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c5666-f8a0-4e59-88e5-7e8bcf56e949 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:15.695146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4e0ab-5e15-4353-ac75-7e927814dc1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:15.695316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c5666-f8a0-4e59-88e5-7e8bcf56e949 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:15.695584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c5666-f8a0-4e59-88e5-7e8bcf56e949 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:15.696201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4e0ab-5e15-4353-ac75-7e927814dc1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:15.696302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c5666-f8a0-4e59-88e5-7e8bcf56e949 None admin] RBAC: Adding query filter params (role.id=f06b5fed717d4b03a5083dd847274296, scope.domain.id=default, user.id=f35bc6b4a2c94914bd986ad019ecb5c6) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:15.696589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c5666-f8a0-4e59-88e5-7e8bcf56e949 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:15.698190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4e0ab-5e15-4353-ac75-7e927814dc1d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:15.698515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c5666-f8a0-4e59-88e5-7e8bcf56e949 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:15.699738 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:15.705474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4e0ab-5e15-4353-ac75-7e927814dc1d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:15.716778 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 29/56] 10.222.0.16 () {56 vars in 1322 bytes} [Fri Sep 30 09:26:15 2022] GET /identity/v3/role_assignments?user.id=f35bc6b4a2c94914bd986ad019ecb5c6&scope.domain.id=default&role.id=f06b5fed717d4b03a5083dd847274296 => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:15.810141 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:15.813575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4e0ab-5e15-4353-ac75-7e927814dc1d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:15.849980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6eb93-5473-4e24-bc09-36feacb6b395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:15.850592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6eb93-5473-4e24-bc09-36feacb6b395 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:15.850868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6eb93-5473-4e24-bc09-36feacb6b395 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:15.851135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6eb93-5473-4e24-bc09-36feacb6b395 None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:15.851793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6eb93-5473-4e24-bc09-36feacb6b395 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:15.853299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6eb93-5473-4e24-bc09-36feacb6b395 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:15.881368 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 28/57] 10.222.0.16 () {60 vars in 1140 bytes} [Fri Sep 30 09:26:15 2022] POST /identity/v3/projects => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:26:18.035396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabfd21-da54-4394-9c48-920eee8d8809 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:18.035900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabfd21-da54-4394-9c48-920eee8d8809 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:18.035983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabfd21-da54-4394-9c48-920eee8d8809 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:18.037307 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 30/58] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:18.043208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acac15f-eb53-4736-928f-79ab71abf0af None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:18.043599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acac15f-eb53-4736-928f-79ab71abf0af None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:18.043767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acac15f-eb53-4736-928f-79ab71abf0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:18.062671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3acac15f-eb53-4736-928f-79ab71abf0af None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:18.064177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3acac15f-eb53-4736-928f-79ab71abf0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:18.128209 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 29/59] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:18.410030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabfd21-da54-4394-9c48-920eee8d8809 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:18.508681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabfd21-da54-4394-9c48-920eee8d8809 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:18.543729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb242a64-cd9f-4c8f-9d23-52e829d2fc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:18.544341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb242a64-cd9f-4c8f-9d23-52e829d2fc65 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:18.544638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb242a64-cd9f-4c8f-9d23-52e829d2fc65 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:18.544915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb242a64-cd9f-4c8f-9d23-52e829d2fc65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:18.546015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb242a64-cd9f-4c8f-9d23-52e829d2fc65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:18.547429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb242a64-cd9f-4c8f-9d23-52e829d2fc65 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:18.548995 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 31/60] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:18.554503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acac15f-eb53-4736-928f-79ab71abf0af None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:18.634436 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:18.654848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acac15f-eb53-4736-928f-79ab71abf0af None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:18.687976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff7b8b-c51f-482d-a23f-85db557dc3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:18.688521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff7b8b-c51f-482d-a23f-85db557dc3b8 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:18.688834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff7b8b-c51f-482d-a23f-85db557dc3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:18.689120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff7b8b-c51f-482d-a23f-85db557dc3b8 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:18.689760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff7b8b-c51f-482d-a23f-85db557dc3b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:18.691201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff7b8b-c51f-482d-a23f-85db557dc3b8 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:18.718264 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 30/61] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Sep 30 09:26:18 2022] POST /identity/v3/users => generated 275 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:21.772809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05a217-2e07-4b47-9530-9318fcc7319e None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:21.773653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05a217-2e07-4b47-9530-9318fcc7319e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:21.774068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05a217-2e07-4b47-9530-9318fcc7319e None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:21.775816 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 32/62] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:21.781419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e319eb-e015-4162-9f98-5fd94253aad7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:21.782155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e319eb-e015-4162-9f98-5fd94253aad7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:21.782575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e319eb-e015-4162-9f98-5fd94253aad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:21.808049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-52e319eb-e015-4162-9f98-5fd94253aad7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:21.809575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-52e319eb-e015-4162-9f98-5fd94253aad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:21.898608 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 31/63] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:22.105331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81962d7-8b26-429f-9bc2-a375142f9aaf None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:22.105979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81962d7-8b26-429f-9bc2-a375142f9aaf None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:22.106480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81962d7-8b26-429f-9bc2-a375142f9aaf None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:22.108030 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 33/64] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:22.113589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3d256-a81b-4797-b436-3395dd51daf9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:22.114161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3d256-a81b-4797-b436-3395dd51daf9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:22.114632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3d256-a81b-4797-b436-3395dd51daf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:22.136837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-64a3d256-a81b-4797-b436-3395dd51daf9 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:22.138638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-64a3d256-a81b-4797-b436-3395dd51daf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:22.235064 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:22.241866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983e688-bc3f-4eda-bd29-4f0a6fdb095b None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:22.242366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983e688-bc3f-4eda-bd29-4f0a6fdb095b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:22.242741 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 32/65] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:22.243069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983e688-bc3f-4eda-bd29-4f0a6fdb095b None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:22.245393 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 34/66] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:22.258226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd96e0-2051-40e0-aa0d-310a8920a5d7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:22.258515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd96e0-2051-40e0-aa0d-310a8920a5d7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:22.258786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd96e0-2051-40e0-aa0d-310a8920a5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:22.293615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f9dd96e0-2051-40e0-aa0d-310a8920a5d7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:22.294817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f9dd96e0-2051-40e0-aa0d-310a8920a5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:22.308353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983e688-bc3f-4eda-bd29-4f0a6fdb095b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:22.367972 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 33/67] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:22.390286 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:22.470501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983e688-bc3f-4eda-bd29-4f0a6fdb095b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:22.521856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e4c89-b028-434a-b0a9-3ba17c4ab887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:22.522513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e4c89-b028-434a-b0a9-3ba17c4ab887 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:22.522798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e4c89-b028-434a-b0a9-3ba17c4ab887 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:22.523073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e4c89-b028-434a-b0a9-3ba17c4ab887 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:22.541489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e4c89-b028-434a-b0a9-3ba17c4ab887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:22.546584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-b02e4c89-b028-434a-b0a9-3ba17c4ab887 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:22.546584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:22.546584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:22.546584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:22.546584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:22.546584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:22.546584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:22.546584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:22.546584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:22.546584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:22.546584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:22.546584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:22.546584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:22.546584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:22.546584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:22.546584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:22.547679 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:22.547679 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:22.547679 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:22.547679 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:22.547679 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:22.547679 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:22.547679 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:22.547679 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:22.547679 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:22.547679 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:22.547679 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:22.547679 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:22.547679 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:22.547679 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:22.547679 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:22.547679 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:22.548725 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:22.548725 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:22.548725 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:22.548725 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:22.548725 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:22.548725 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:22.548725 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:22.548725 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:22.548725 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:22.548725 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:22.548725 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:22.548725 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:26:22.548725 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 35/68] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:22.555468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd96e0-2051-40e0-aa0d-310a8920a5d7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:22.566308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e4c89-b028-434a-b0a9-3ba17c4ab887 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:22.704362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd96e0-2051-40e0-aa0d-310a8920a5d7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:22.710229 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:22.715349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e4c89-b028-434a-b0a9-3ba17c4ab887 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:22.735692 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:22.745571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06944c0-2370-4ff5-9373-2b67d80a57ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:22.746573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06944c0-2370-4ff5-9373-2b67d80a57ba None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:22.747055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06944c0-2370-4ff5-9373-2b67d80a57ba None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:22.747538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06944c0-2370-4ff5-9373-2b67d80a57ba None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:22.748475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06944c0-2370-4ff5-9373-2b67d80a57ba None admin] RBAC: Adding query filter params (name=member) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:22.749104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06944c0-2370-4ff5-9373-2b67d80a57ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:22.750804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06944c0-2370-4ff5-9373-2b67d80a57ba None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:22.758111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468ef8c-df11-4ff5-b37f-02650823154c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:22.758895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468ef8c-df11-4ff5-b37f-02650823154c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:22.759173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468ef8c-df11-4ff5-b37f-02650823154c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:22.759445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468ef8c-df11-4ff5-b37f-02650823154c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:22.766297 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:26:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:22.766297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb05412-4c17-4f4e-bf30-e1ee50e3715f None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:22.766530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb05412-4c17-4f4e-bf30-e1ee50e3715f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:22.767004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb05412-4c17-4f4e-bf30-e1ee50e3715f None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:22.768491 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 35/70] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:22.769068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb05412-4c17-4f4e-bf30-e1ee50e3715f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:22.771794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468ef8c-df11-4ff5-b37f-02650823154c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:22.777421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-1468ef8c-df11-4ff5-b37f-02650823154c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:22.777421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:22.777421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:22.777421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:22.777421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:22.777421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:22.777421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:22.777421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:22.777421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:22.777421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:22.777421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:22.777421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:22.777421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:22.777421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:22.777421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:22.777421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:22.778817 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:22.778817 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:22.778817 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:22.778817 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:22.778817 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:22.778817 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:22.778817 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:22.778817 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:22.778817 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:22.778817 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:22.778817 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:22.778817 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:22.778817 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:22.778817 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:22.778817 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:22.778817 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:22.779584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:22.779584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:22.779584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:22.779584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:22.779584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:22.779584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:22.779584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:22.779584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:22.779584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:22.779584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:22.779584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:22.779584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:26:22.779584 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:22.779584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468ef8c-df11-4ff5-b37f-02650823154c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:22.888476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468ef8c-df11-4ff5-b37f-02650823154c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:22.889325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb05412-4c17-4f4e-bf30-e1ee50e3715f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:22.927385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba2c51-0fc0-4895-acdf-3d91bc6c04c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:22.927571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe2a7c-53ed-4375-98ff-468bd1b6e9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:22.928206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe2a7c-53ed-4375-98ff-468bd1b6e9d3 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:22.928484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe2a7c-53ed-4375-98ff-468bd1b6e9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:22.928769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba2c51-0fc0-4895-acdf-3d91bc6c04c2 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:22.928875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe2a7c-53ed-4375-98ff-468bd1b6e9d3 None admin] PATH_INFO: `/v3/users/695734af4ebc4c5fbebc32816bddfa23` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:22.929281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba2c51-0fc0-4895-acdf-3d91bc6c04c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:22.929555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba2c51-0fc0-4895-acdf-3d91bc6c04c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:22.940973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba2c51-0fc0-4895-acdf-3d91bc6c04c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:22.944689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe2a7c-53ed-4375-98ff-468bd1b6e9d3 None admin] RBAC: Authorizing `identity:get_user(user_id=695734af4ebc4c5fbebc32816bddfa23)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:22.946139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe2a7c-53ed-4375-98ff-468bd1b6e9d3 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:22.946352 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-eaba2c51-0fc0-4895-acdf-3d91bc6c04c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:26:22.946352 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:22.946352 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:22.946352 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:22.946352 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:22.946352 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:22.946352 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:22.946352 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:22.946352 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:22.946352 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:22.946352 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:22.946352 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:22.946352 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:22.946352 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:22.946352 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:22.946352 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:22.947207 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:22.947207 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:22.947207 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:22.947207 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:22.947207 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:22.947207 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:22.947207 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:22.947207 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:22.947207 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:22.947207 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:22.947207 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:22.947207 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:22.947207 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:22.947207 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:22.947207 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:22.947207 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:22.948771 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:22.948771 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:22.948771 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:22.948771 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:22.948771 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:22.948771 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:22.948771 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:22.948771 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:22.948771 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:22.948771 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:22.948771 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:26:22.948771 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:26:22.948771 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 36/72] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Sep 30 09:26:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:22.949378 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 37/73] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:22 2022] GET /identity/v3/users/695734af4ebc4c5fbebc32816bddfa23 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:22.949378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe2a7c-53ed-4375-98ff-468bd1b6e9d3 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:22.950821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6357517-8026-496f-9eae-5ac82751448c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:22.950821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6357517-8026-496f-9eae-5ac82751448c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:22.950821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6357517-8026-496f-9eae-5ac82751448c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:22.969323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f6357517-8026-496f-9eae-5ac82751448c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:22.970531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f6357517-8026-496f-9eae-5ac82751448c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:22.978583 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:23.016140 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:23.036813 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 37/74] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:23.037741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6357517-8026-496f-9eae-5ac82751448c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:23.071786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe2a7c-53ed-4375-98ff-468bd1b6e9d3 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:23.107909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133798a0-a1a3-4c6b-86bf-d618d87b910a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:23.108516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133798a0-a1a3-4c6b-86bf-d618d87b910a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:23.108835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133798a0-a1a3-4c6b-86bf-d618d87b910a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:23.109112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133798a0-a1a3-4c6b-86bf-d618d87b910a None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:23.109780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133798a0-a1a3-4c6b-86bf-d618d87b910a None admin] RBAC: Adding query filter params (name=admin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:23.110086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133798a0-a1a3-4c6b-86bf-d618d87b910a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:23.111457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133798a0-a1a3-4c6b-86bf-d618d87b910a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:23.120621 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 38/75] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:23.121628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133798a0-a1a3-4c6b-86bf-d618d87b910a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:23.153545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6357517-8026-496f-9eae-5ac82751448c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:23.188642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0276728-dd9f-4555-9d7c-6da2b6deb626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:23.189281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0276728-dd9f-4555-9d7c-6da2b6deb626 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:23.189558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0276728-dd9f-4555-9d7c-6da2b6deb626 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:23.189817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0276728-dd9f-4555-9d7c-6da2b6deb626 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:23.209058 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:23.229926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133798a0-a1a3-4c6b-86bf-d618d87b910a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:23.246936 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:23.264530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c4e0c-7887-4517-9ef7-7579d653c8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:23.265165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c4e0c-7887-4517-9ef7-7579d653c8b4 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:23.265448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c4e0c-7887-4517-9ef7-7579d653c8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:23.265873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c4e0c-7887-4517-9ef7-7579d653c8b4 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:23.266532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c4e0c-7887-4517-9ef7-7579d653c8b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:23.267368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c4e0c-7887-4517-9ef7-7579d653c8b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:23.268906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0276728-dd9f-4555-9d7c-6da2b6deb626 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:23.269069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c4e0c-7887-4517-9ef7-7579d653c8b4 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:23.270381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0276728-dd9f-4555-9d7c-6da2b6deb626 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:23.281872 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 39/76] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:23.281872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57552e1e-ad6c-4aff-8463-5389d4cad677 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:23.281872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57552e1e-ad6c-4aff-8463-5389d4cad677 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:23.281872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57552e1e-ad6c-4aff-8463-5389d4cad677 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:23.281872 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 40/77] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:23.281872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57552e1e-ad6c-4aff-8463-5389d4cad677 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:23.380884 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 38/78] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:26:23.381912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4ce16-7dab-45aa-991f-18a986877ff6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:23.382206 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4ce16-7dab-45aa-991f-18a986877ff6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:23.382477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4ce16-7dab-45aa-991f-18a986877ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:23.388879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57552e1e-ad6c-4aff-8463-5389d4cad677 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:23.400225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0fa4ce16-7dab-45aa-991f-18a986877ff6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:23.401470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0fa4ce16-7dab-45aa-991f-18a986877ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:23.422662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47048a3e-85dc-4d7f-b756-26cedcbb8513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:23.423286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47048a3e-85dc-4d7f-b756-26cedcbb8513 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:23.423570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47048a3e-85dc-4d7f-b756-26cedcbb8513 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:23.423841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47048a3e-85dc-4d7f-b756-26cedcbb8513 None admin] PATH_INFO: `/v3/users/f35bc6b4a2c94914bd986ad019ecb5c6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:23.425025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47048a3e-85dc-4d7f-b756-26cedcbb8513 None admin] RBAC: Authorizing `identity:get_user(user_id=f35bc6b4a2c94914bd986ad019ecb5c6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:23.426465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47048a3e-85dc-4d7f-b756-26cedcbb8513 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:23.428035 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 41/79] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:23 2022] GET /identity/v3/users/f35bc6b4a2c94914bd986ad019ecb5c6 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:23.428825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47048a3e-85dc-4d7f-b756-26cedcbb8513 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:23.445408 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:23.469570 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 39/80] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:23.470414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4ce16-7dab-45aa-991f-18a986877ff6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:23.485446 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:23.538785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47048a3e-85dc-4d7f-b756-26cedcbb8513 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:23.575436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4ce16-7dab-45aa-991f-18a986877ff6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:23.576423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb301102-3d68-4424-866f-7cbc5cf92016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:23.577084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb301102-3d68-4424-866f-7cbc5cf92016 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:23.577366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb301102-3d68-4424-866f-7cbc5cf92016 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:23.577636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb301102-3d68-4424-866f-7cbc5cf92016 None admin] PATH_INFO: `/v3/users/695734af4ebc4c5fbebc32816bddfa23` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:23.578799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb301102-3d68-4424-866f-7cbc5cf92016 None admin] RBAC: Authorizing `identity:get_user(user_id=695734af4ebc4c5fbebc32816bddfa23)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:23.580463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb301102-3d68-4424-866f-7cbc5cf92016 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:23.586634 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 42/81] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:23 2022] GET /identity/v3/users/695734af4ebc4c5fbebc32816bddfa23 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:23.586634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb301102-3d68-4424-866f-7cbc5cf92016 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:23.615782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d2aff-01f6-431d-a6dd-6ea8a9364f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:23.616431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d2aff-01f6-431d-a6dd-6ea8a9364f2f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:23.616829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d2aff-01f6-431d-a6dd-6ea8a9364f2f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:23.617007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d2aff-01f6-431d-a6dd-6ea8a9364f2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:23.637360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d2aff-01f6-431d-a6dd-6ea8a9364f2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:23.642572 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-869d2aff-01f6-431d-a6dd-6ea8a9364f2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:23.642572 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:23.642572 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:23.642572 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:23.642572 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:23.642572 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:23.642572 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:23.642572 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:23.642572 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:23.642572 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:23.642572 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:23.642572 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:23.642572 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:23.642572 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:23.642572 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:23.642572 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:23.643411 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:23.643411 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:23.643411 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:23.643411 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:23.643411 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:23.643411 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:23.643411 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:23.643411 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:23.643411 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:23.643411 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:23.643411 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:23.643411 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:23.643411 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:23.643411 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:23.643411 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:23.643411 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:23.644236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:23.644236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:23.644236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:23.644236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:23.644236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:23.644236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:23.644236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:23.644236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:23.644236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:23.644236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:23.644236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:23.644236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:26:23.644236 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 40/82] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:23.644962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d2aff-01f6-431d-a6dd-6ea8a9364f2f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:23.678257 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:23.702970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb301102-3d68-4424-866f-7cbc5cf92016 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:23.723905 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:23.740519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11252d42-f9c2-4811-a029-aba5a99844a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:23.741094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11252d42-f9c2-4811-a029-aba5a99844a6 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:23.741375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11252d42-f9c2-4811-a029-aba5a99844a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:23.741648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11252d42-f9c2-4811-a029-aba5a99844a6 None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:23.742781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11252d42-f9c2-4811-a029-aba5a99844a6 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d26f75111496bae034056bc6ed395)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:23.744489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11252d42-f9c2-4811-a029-aba5a99844a6 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:23.746323 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 43/83] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:23 2022] GET /identity/v3/projects/ee1d26f75111496bae034056bc6ed395 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:23.747083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11252d42-f9c2-4811-a029-aba5a99844a6 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:23.758121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d2aff-01f6-431d-a6dd-6ea8a9364f2f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:23.791950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5520f0-9cea-48dd-8b98-b7c447ad8c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:23.792742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5520f0-9cea-48dd-8b98-b7c447ad8c3a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:23.793027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5520f0-9cea-48dd-8b98-b7c447ad8c3a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:23.793299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5520f0-9cea-48dd-8b98-b7c447ad8c3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:23.848313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11252d42-f9c2-4811-a029-aba5a99844a6 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:23.858732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5520f0-9cea-48dd-8b98-b7c447ad8c3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:23.860205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5520f0-9cea-48dd-8b98-b7c447ad8c3a None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:23.881141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421960e-25c9-488b-846e-d429fa96aa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:23.881736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421960e-25c9-488b-846e-d429fa96aa22 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:23.882019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421960e-25c9-488b-846e-d429fa96aa22 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:23.882294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421960e-25c9-488b-846e-d429fa96aa22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:23.897738 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:23.931489 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:23.952260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421960e-25c9-488b-846e-d429fa96aa22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:23.953725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421960e-25c9-488b-846e-d429fa96aa22 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:23.963404 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 41/84] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:26:23.964235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5520f0-9cea-48dd-8b98-b7c447ad8c3a None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:24.054436 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 44/85] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:26:24.055281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421960e-25c9-488b-846e-d429fa96aa22 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:24.064865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5520f0-9cea-48dd-8b98-b7c447ad8c3a None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:24.099116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30689927-d027-4d3a-ba0e-ea1df222d4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:24.099717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30689927-d027-4d3a-ba0e-ea1df222d4af None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:24.099992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30689927-d027-4d3a-ba0e-ea1df222d4af None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:24.100262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30689927-d027-4d3a-ba0e-ea1df222d4af None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:24.100956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30689927-d027-4d3a-ba0e-ea1df222d4af None admin] RBAC: Adding query filter params (name=member) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:24.101257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30689927-d027-4d3a-ba0e-ea1df222d4af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:24.102436 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:24.102635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30689927-d027-4d3a-ba0e-ea1df222d4af None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:24.111196 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 42/86] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:26:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:24.111822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30689927-d027-4d3a-ba0e-ea1df222d4af None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:24.141662 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:24.158051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421960e-25c9-488b-846e-d429fa96aa22 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:24.191736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040d92e-534c-4f40-aa92-d3353ba820aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:24.192355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040d92e-534c-4f40-aa92-d3353ba820aa None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:24.192668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040d92e-534c-4f40-aa92-d3353ba820aa None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:24.192942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040d92e-534c-4f40-aa92-d3353ba820aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:24.194038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040d92e-534c-4f40-aa92-d3353ba820aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:24.195473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040d92e-534c-4f40-aa92-d3353ba820aa None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:24.197094 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 45/87] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:24.198349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040d92e-534c-4f40-aa92-d3353ba820aa None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:24.211388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30689927-d027-4d3a-ba0e-ea1df222d4af None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:24.244000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbf1a1-63f6-4c1d-b3c7-ce3364567cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:24.245411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbf1a1-63f6-4c1d-b3c7-ce3364567cc5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:24.245691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbf1a1-63f6-4c1d-b3c7-ce3364567cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:24.245961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbf1a1-63f6-4c1d-b3c7-ce3364567cc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:24.246679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbf1a1-63f6-4c1d-b3c7-ce3364567cc5 None admin] RBAC: Adding query filter params (role.id=f642af7fc1fd472d8f4a4d6f34548ba2, scope.project.id=ee1d26f75111496bae034056bc6ed395, user.id=695734af4ebc4c5fbebc32816bddfa23) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:24.246980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbf1a1-63f6-4c1d-b3c7-ce3364567cc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:24.248419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbf1a1-63f6-4c1d-b3c7-ce3364567cc5 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:24.253790 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 43/88] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:24 2022] GET /identity/v3/role_assignments?user.id=695734af4ebc4c5fbebc32816bddfa23&scope.project.id=ee1d26f75111496bae034056bc6ed395&role.id=f642af7fc1fd472d8f4a4d6f34548ba2 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:24.254563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbf1a1-63f6-4c1d-b3c7-ce3364567cc5 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:24.302006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040d92e-534c-4f40-aa92-d3353ba820aa None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:24.319563 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:24.345974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef89fe-ce06-4ac8-8db5-8ab30730d0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:24.346612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef89fe-ce06-4ac8-8db5-8ab30730d0f3 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:24.346908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef89fe-ce06-4ac8-8db5-8ab30730d0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:24.347157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef89fe-ce06-4ac8-8db5-8ab30730d0f3 None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:24.348566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef89fe-ce06-4ac8-8db5-8ab30730d0f3 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d26f75111496bae034056bc6ed395)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:24.350016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef89fe-ce06-4ac8-8db5-8ab30730d0f3 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:24.351928 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 46/89] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:24 2022] GET /identity/v3/projects/ee1d26f75111496bae034056bc6ed395 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:24.358150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef89fe-ce06-4ac8-8db5-8ab30730d0f3 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:24.386253 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:24.394665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbf1a1-63f6-4c1d-b3c7-ce3364567cc5 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:24.430082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d70f9-cd6d-4746-b35d-44ff70007d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:24.430709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d70f9-cd6d-4746-b35d-44ff70007d57 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:24.431014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d70f9-cd6d-4746-b35d-44ff70007d57 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:24.431272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d70f9-cd6d-4746-b35d-44ff70007d57 None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:24.433699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d70f9-cd6d-4746-b35d-44ff70007d57 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d26f75111496bae034056bc6ed395)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:24.435616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d70f9-cd6d-4746-b35d-44ff70007d57 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:24.436830 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 44/90] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:24 2022] GET /identity/v3/projects/ee1d26f75111496bae034056bc6ed395 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:24.437495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d70f9-cd6d-4746-b35d-44ff70007d57 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:24.474526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef89fe-ce06-4ac8-8db5-8ab30730d0f3 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:24.511566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c624f-8ddb-4113-9ffb-4d7b492e466e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:24.512204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c624f-8ddb-4113-9ffb-4d7b492e466e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:24.512480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c624f-8ddb-4113-9ffb-4d7b492e466e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:24.512778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c624f-8ddb-4113-9ffb-4d7b492e466e None admin] PATH_INFO: `/v3/users/695734af4ebc4c5fbebc32816bddfa23` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:24.513927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c624f-8ddb-4113-9ffb-4d7b492e466e None admin] RBAC: Authorizing `identity:get_user(user_id=695734af4ebc4c5fbebc32816bddfa23)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:24.515403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c624f-8ddb-4113-9ffb-4d7b492e466e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:24.522055 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 47/91] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:24 2022] GET /identity/v3/users/695734af4ebc4c5fbebc32816bddfa23 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:24.522055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c624f-8ddb-4113-9ffb-4d7b492e466e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:24.541853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d70f9-cd6d-4746-b35d-44ff70007d57 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:24.577221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31badd6f-8858-4023-8f96-f408dda942ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:24.577746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31badd6f-8858-4023-8f96-f408dda942ac None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:24.578027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31badd6f-8858-4023-8f96-f408dda942ac None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:24.578298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31badd6f-8858-4023-8f96-f408dda942ac None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:24.578948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31badd6f-8858-4023-8f96-f408dda942ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:24.579074 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:24.581031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31badd6f-8858-4023-8f96-f408dda942ac None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:24.604820 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 45/92] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Sep 30 09:26:24 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:24.605860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31badd6f-8858-4023-8f96-f408dda942ac None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:24.643901 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:24.649805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c624f-8ddb-4113-9ffb-4d7b492e466e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:24.698931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c59f1-b318-44a8-8ccc-e9e6a36b809b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:24.699941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c59f1-b318-44a8-8ccc-e9e6a36b809b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:24.700433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c59f1-b318-44a8-8ccc-e9e6a36b809b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:24.700915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c59f1-b318-44a8-8ccc-e9e6a36b809b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:24.701858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c59f1-b318-44a8-8ccc-e9e6a36b809b None admin] RBAC: Adding query filter params (role.id=f06b5fed717d4b03a5083dd847274296, scope.project.id=ee1d26f75111496bae034056bc6ed395, user.id=f35bc6b4a2c94914bd986ad019ecb5c6) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:24.702441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c59f1-b318-44a8-8ccc-e9e6a36b809b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:24.704131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c59f1-b318-44a8-8ccc-e9e6a36b809b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:24.712954 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 48/93] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:24 2022] GET /identity/v3/role_assignments?user.id=f35bc6b4a2c94914bd986ad019ecb5c6&scope.project.id=ee1d26f75111496bae034056bc6ed395&role.id=f06b5fed717d4b03a5083dd847274296 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:24.714548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c59f1-b318-44a8-8ccc-e9e6a36b809b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:24.808305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31badd6f-8858-4023-8f96-f408dda942ac None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:24.862314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a5681-cdee-4954-8b05-be9905ad9533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:24.862883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a5681-cdee-4954-8b05-be9905ad9533 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:24.863165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a5681-cdee-4954-8b05-be9905ad9533 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:24.863440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a5681-cdee-4954-8b05-be9905ad9533 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:24.865138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a5681-cdee-4954-8b05-be9905ad9533 None admin] RBAC: Adding query filter params (role.id=27410223fa7d4717a71ac6753c80420b, scope.project.id=ee1d26f75111496bae034056bc6ed395, user.id=695734af4ebc4c5fbebc32816bddfa23) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:24.865460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a5681-cdee-4954-8b05-be9905ad9533 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:24.866930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a5681-cdee-4954-8b05-be9905ad9533 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:24.874125 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 46/94] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:24 2022] GET /identity/v3/role_assignments?user.id=695734af4ebc4c5fbebc32816bddfa23&scope.project.id=ee1d26f75111496bae034056bc6ed395&role.id=27410223fa7d4717a71ac6753c80420b => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:24.893395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c59f1-b318-44a8-8ccc-e9e6a36b809b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:24.912326 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:24.938482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc44ecc-646c-4979-8ee2-ccbf0b65ed89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:24.939104 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc44ecc-646c-4979-8ee2-ccbf0b65ed89 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:24.939383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc44ecc-646c-4979-8ee2-ccbf0b65ed89 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:24.939658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc44ecc-646c-4979-8ee2-ccbf0b65ed89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:25.030357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc44ecc-646c-4979-8ee2-ccbf0b65ed89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:25.032055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc44ecc-646c-4979-8ee2-ccbf0b65ed89 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:25.143194 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 49/95] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:26:25.148799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a5681-cdee-4954-8b05-be9905ad9533 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:25.248919 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:25.273509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a5681-cdee-4954-8b05-be9905ad9533 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:25.315377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d798cc-a986-4223-9f07-014e927b7d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:25.316019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d798cc-a986-4223-9f07-014e927b7d8c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:25.316298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d798cc-a986-4223-9f07-014e927b7d8c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:25.316570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d798cc-a986-4223-9f07-014e927b7d8c None admin] PATH_INFO: `/v3/projects/e519a871faf74584853c304a8e793bb6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:25.317728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d798cc-a986-4223-9f07-014e927b7d8c None admin] RBAC: Authorizing `identity:get_project(project_id=e519a871faf74584853c304a8e793bb6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:25.319158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d798cc-a986-4223-9f07-014e927b7d8c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:25.321784 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 47/96] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:25 2022] GET /identity/v3/projects/e519a871faf74584853c304a8e793bb6 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:25.328179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc44ecc-646c-4979-8ee2-ccbf0b65ed89 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:25.348895 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:25.460902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc44ecc-646c-4979-8ee2-ccbf0b65ed89 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:25.503307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ac447-cb50-47cb-b8b5-82f0a3c88d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:25.503923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ac447-cb50-47cb-b8b5-82f0a3c88d3a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:25.504203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ac447-cb50-47cb-b8b5-82f0a3c88d3a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:25.504473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ac447-cb50-47cb-b8b5-82f0a3c88d3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:25.505289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ac447-cb50-47cb-b8b5-82f0a3c88d3a None admin] RBAC: Adding query filter params (role.id=f642af7fc1fd472d8f4a4d6f34548ba2, scope.project.id=e519a871faf74584853c304a8e793bb6, user.id=695734af4ebc4c5fbebc32816bddfa23) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:25.505599 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ac447-cb50-47cb-b8b5-82f0a3c88d3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:25.507040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ac447-cb50-47cb-b8b5-82f0a3c88d3a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:25.517109 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 50/97] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:25 2022] GET /identity/v3/role_assignments?user.id=695734af4ebc4c5fbebc32816bddfa23&scope.project.id=e519a871faf74584853c304a8e793bb6&role.id=f642af7fc1fd472d8f4a4d6f34548ba2 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:27.018393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f24d93-ccb0-4045-9599-9cf871194a07 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:27.018888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f24d93-ccb0-4045-9599-9cf871194a07 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:27.018960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f24d93-ccb0-4045-9599-9cf871194a07 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:27.020263 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 48/98] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:27.036034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d444a2f-3e25-45be-8f5d-49e1d4cdd497 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:27.036510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d444a2f-3e25-45be-8f5d-49e1d4cdd497 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:27.036585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d444a2f-3e25-45be-8f5d-49e1d4cdd497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:27.059930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8d444a2f-3e25-45be-8f5d-49e1d4cdd497 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:27.061153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8d444a2f-3e25-45be-8f5d-49e1d4cdd497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:27.150848 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 51/99] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:27.708194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f24d93-ccb0-4045-9599-9cf871194a07 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:27.820385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f24d93-ccb0-4045-9599-9cf871194a07 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:27.862053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6becea7-dc01-4677-a950-af6899b13866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:27.862682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6becea7-dc01-4677-a950-af6899b13866 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:27.862959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6becea7-dc01-4677-a950-af6899b13866 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:27.863225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6becea7-dc01-4677-a950-af6899b13866 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:27.874500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438642c-2cd5-43e5-955f-7f2cbad2bae1 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:27.874772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438642c-2cd5-43e5-955f-7f2cbad2bae1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:27.875041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438642c-2cd5-43e5-955f-7f2cbad2bae1 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:27.876510 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 52/100] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:27.881756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38dc8f-9cb5-41e4-94fd-e8f8fdefcbe3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:27.882033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38dc8f-9cb5-41e4-94fd-e8f8fdefcbe3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:27.882300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38dc8f-9cb5-41e4-94fd-e8f8fdefcbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:27.892845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6becea7-dc01-4677-a950-af6899b13866 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:27.897667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-a6becea7-dc01-4677-a950-af6899b13866 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:27.897667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:27.897667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:27.897667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:27.897667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:27.897667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:27.897667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:27.897667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:27.897667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:27.897667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:27.897667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:27.897667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:27.897667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:27.897667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:27.897667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:27.897667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:27.898518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:27.898518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:27.898518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:27.898518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:27.898518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:27.898518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:27.898518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:27.898518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:27.898518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:27.898518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:27.898518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:27.898518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:27.898518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:27.898518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:27.898518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:27.898518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:27.899259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:27.899259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:27.899259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:27.899259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:27.899259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:27.899259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:27.899259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:27.899259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:27.899259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:27.899259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:27.899259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:27.899259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:26:27.899259 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 49/101] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:27.908809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6becea7-dc01-4677-a950-af6899b13866 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:27.913374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7c38dc8f-9cb5-41e4-94fd-e8f8fdefcbe3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:27.914556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7c38dc8f-9cb5-41e4-94fd-e8f8fdefcbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:27.917504 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:27.952725 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:28.102031 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 53/102] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:26:28.141001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d4dad-48b6-4a04-88db-01613e1f5652 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:28.141309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d4dad-48b6-4a04-88db-01613e1f5652 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:28.141564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d4dad-48b6-4a04-88db-01613e1f5652 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:28.142976 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 54/103] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:28.147829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc5989-aecc-436c-9ebd-b4e5ad9ac125 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:28.148118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc5989-aecc-436c-9ebd-b4e5ad9ac125 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:28.148393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc5989-aecc-436c-9ebd-b4e5ad9ac125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:28.163328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6becea7-dc01-4677-a950-af6899b13866 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:28.167436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-44cc5989-aecc-436c-9ebd-b4e5ad9ac125 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:28.168704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-44cc5989-aecc-436c-9ebd-b4e5ad9ac125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:28.228504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c014f-c9ec-4b92-bfc3-d7c2b9f8b5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:28.229291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c014f-c9ec-4b92-bfc3-d7c2b9f8b5b9 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:28.229641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c014f-c9ec-4b92-bfc3-d7c2b9f8b5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:28.230708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c014f-c9ec-4b92-bfc3-d7c2b9f8b5b9 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:28.231390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c014f-c9ec-4b92-bfc3-d7c2b9f8b5b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:28.232776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c014f-c9ec-4b92-bfc3-d7c2b9f8b5b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:28.234173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c014f-c9ec-4b92-bfc3-d7c2b9f8b5b9 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:28.252647 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 50/104] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:26:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:28.253728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804df8f-3856-413b-8b7e-a84116ac672d None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:28.254014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804df8f-3856-413b-8b7e-a84116ac672d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:28.254290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804df8f-3856-413b-8b7e-a84116ac672d None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:28.255495 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 51/105] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:28.262596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b73321-f425-4e80-9d3a-349f16327867 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:28.262933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b73321-f425-4e80-9d3a-349f16327867 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:28.263220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b73321-f425-4e80-9d3a-349f16327867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:28.291209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-85b73321-f425-4e80-9d3a-349f16327867 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:28.292683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-85b73321-f425-4e80-9d3a-349f16327867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:28.294041 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 55/106] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:28.294929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc5989-aecc-436c-9ebd-b4e5ad9ac125 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:28.373535 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:28.437524 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 52/107] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:26:28.438596 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc5989-aecc-436c-9ebd-b4e5ad9ac125 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:28.471349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b73321-f425-4e80-9d3a-349f16327867 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:28.476904 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:28.501018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb95f4-cbf1-405f-acb2-4eeefd4e51f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:28.502049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb95f4-cbf1-405f-acb2-4eeefd4e51f5 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:28.502722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb95f4-cbf1-405f-acb2-4eeefd4e51f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:28.504501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb95f4-cbf1-405f-acb2-4eeefd4e51f5 None admin] PATH_INFO: `/v3/users/695734af4ebc4c5fbebc32816bddfa23` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:28.506957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb95f4-cbf1-405f-acb2-4eeefd4e51f5 None admin] RBAC: Authorizing `identity:get_user(user_id=695734af4ebc4c5fbebc32816bddfa23)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:28.508651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb95f4-cbf1-405f-acb2-4eeefd4e51f5 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:28.514834 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 56/108] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:28 2022] GET /identity/v3/users/695734af4ebc4c5fbebc32816bddfa23 => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:28.526317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb95f4-cbf1-405f-acb2-4eeefd4e51f5 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:28.653887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb95f4-cbf1-405f-acb2-4eeefd4e51f5 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:28.691213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c5bad-9ccc-49d9-b273-5f049d9e3853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:28.691436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b73321-f425-4e80-9d3a-349f16327867 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:28.692323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c5bad-9ccc-49d9-b273-5f049d9e3853 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:28.692837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c5bad-9ccc-49d9-b273-5f049d9e3853 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:28.693322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c5bad-9ccc-49d9-b273-5f049d9e3853 None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:28.694658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c5bad-9ccc-49d9-b273-5f049d9e3853 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d26f75111496bae034056bc6ed395)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:28.696295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c5bad-9ccc-49d9-b273-5f049d9e3853 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:28.699292 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 57/109] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:28 2022] GET /identity/v3/projects/ee1d26f75111496bae034056bc6ed395 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:28.700665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9461835-a20c-4525-bb25-179c1f50b02a None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:28.701154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9461835-a20c-4525-bb25-179c1f50b02a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:28.701624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9461835-a20c-4525-bb25-179c1f50b02a None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:28.703007 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 58/110] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:28.703881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9461835-a20c-4525-bb25-179c1f50b02a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:28.712174 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:28.733420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f88a9-b7ac-4df5-9e10-89905a7f6ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:28.734481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f88a9-b7ac-4df5-9e10-89905a7f6ddd None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:28.734957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f88a9-b7ac-4df5-9e10-89905a7f6ddd None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:28.735501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f88a9-b7ac-4df5-9e10-89905a7f6ddd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:28.748789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f88a9-b7ac-4df5-9e10-89905a7f6ddd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:28.755072 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-e66f88a9-b7ac-4df5-9e10-89905a7f6ddd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:28.755072 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:28.755072 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:28.755072 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:28.755072 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:28.755072 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:28.755072 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:28.755072 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:28.755072 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:28.755072 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:28.755072 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:28.755072 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:28.755072 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:28.755072 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:28.755072 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:28.755072 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:28.756022 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:28.756022 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:28.756022 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:28.756022 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:28.756022 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:28.756022 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:28.756022 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:28.756022 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:28.756022 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:28.756022 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:28.756022 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:28.756022 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:28.756022 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:28.756022 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:28.756022 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:28.756022 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:28.756798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:28.756798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:28.756798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:28.756798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:28.756798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:28.756798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:28.756798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:28.756798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:28.756798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:28.756798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:28.756798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:28.756798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:26:28.759093 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 53/111] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:28.760715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f88a9-b7ac-4df5-9e10-89905a7f6ddd None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:28.835128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9461835-a20c-4525-bb25-179c1f50b02a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:28.844473 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:28.874616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69955892-6e26-4cd8-883e-09d3acf97b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:28.875243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69955892-6e26-4cd8-883e-09d3acf97b6b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:28.875518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69955892-6e26-4cd8-883e-09d3acf97b6b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:28.875789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69955892-6e26-4cd8-883e-09d3acf97b6b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:28.887831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69955892-6e26-4cd8-883e-09d3acf97b6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:28.893383 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-69955892-6e26-4cd8-883e-09d3acf97b6b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:26:28.893383 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:28.893383 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:28.893383 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:28.893383 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:28.893383 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:28.893383 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:28.893383 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:28.893383 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:28.893383 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:28.893383 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:28.893383 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:28.893383 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:28.893383 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:28.893383 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:28.893383 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:28.894242 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:28.894242 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:28.894242 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:28.894242 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:28.894242 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:28.894242 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:28.894242 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:28.894242 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:28.894242 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:28.894242 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:28.894242 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:28.894242 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:28.894242 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:28.894242 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:28.894242 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:28.894242 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:28.897491 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:28.897491 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:28.897491 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:28.897491 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:28.897491 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:28.897491 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:28.897491 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:28.897491 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:28.897491 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:28.897491 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:28.897491 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:26:28.897491 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:26:28.898082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f88a9-b7ac-4df5-9e10-89905a7f6ddd None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:28.898155 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 59/112] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Sep 30 09:26:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:28.898155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5a3c9-29a3-4ee3-8989-fd6a6a512973 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:28.898155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5a3c9-29a3-4ee3-8989-fd6a6a512973 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:28.898155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5a3c9-29a3-4ee3-8989-fd6a6a512973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:28.915963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d1a5a3c9-29a3-4ee3-8989-fd6a6a512973 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:28.917325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d1a5a3c9-29a3-4ee3-8989-fd6a6a512973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:28.938049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f56a14-4616-49fd-86e4-83f02c26828e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:28.939132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f56a14-4616-49fd-86e4-83f02c26828e None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:28.939549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f56a14-4616-49fd-86e4-83f02c26828e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:28.939994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f56a14-4616-49fd-86e4-83f02c26828e None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395/users/695734af4ebc4c5fbebc32816bddfa23/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:28.946794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f56a14-4616-49fd-86e4-83f02c26828e None admin] RBAC: Authorizing `identity:create_grant(project_id=ee1d26f75111496bae034056bc6ed395, user_id=695734af4ebc4c5fbebc32816bddfa23, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:28.949057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f56a14-4616-49fd-86e4-83f02c26828e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:28.967601 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 54/113] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:26:28 2022] PUT /identity/v3/projects/ee1d26f75111496bae034056bc6ed395/users/695734af4ebc4c5fbebc32816bddfa23/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:26:28.968474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f56a14-4616-49fd-86e4-83f02c26828e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:29.003620 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:29.015584 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 60/114] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:29.016912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5a3c9-29a3-4ee3-8989-fd6a6a512973 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:29.089674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f56a14-4616-49fd-86e4-83f02c26828e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:29.119672 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:29.137054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc5d41-3e17-489d-9f7a-a2975f7d611a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:29.137920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc5d41-3e17-489d-9f7a-a2975f7d611a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:29.138330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc5d41-3e17-489d-9f7a-a2975f7d611a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:29.138738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc5d41-3e17-489d-9f7a-a2975f7d611a None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:29.139672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc5d41-3e17-489d-9f7a-a2975f7d611a None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:29.140188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc5d41-3e17-489d-9f7a-a2975f7d611a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:29.141925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc5d41-3e17-489d-9f7a-a2975f7d611a None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:29.143480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5a3c9-29a3-4ee3-8989-fd6a6a512973 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:29.153734 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 55/115] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:29.155606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc5d41-3e17-489d-9f7a-a2975f7d611a None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:29.180638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99219ca7-115e-4e4e-a73b-2cfe43257617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:29.181337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99219ca7-115e-4e4e-a73b-2cfe43257617 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:29.181790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99219ca7-115e-4e4e-a73b-2cfe43257617 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:29.182814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99219ca7-115e-4e4e-a73b-2cfe43257617 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:29.185081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99219ca7-115e-4e4e-a73b-2cfe43257617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:29.187256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99219ca7-115e-4e4e-a73b-2cfe43257617 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:29.189515 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 61/116] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:29.195349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705799eb-c52f-4d30-8989-2b3a55b80f83 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:29.195758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705799eb-c52f-4d30-8989-2b3a55b80f83 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:29.196128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705799eb-c52f-4d30-8989-2b3a55b80f83 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:29.197741 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 62/117] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:29.198859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705799eb-c52f-4d30-8989-2b3a55b80f83 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:29.276972 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:29.286517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc5d41-3e17-489d-9f7a-a2975f7d611a None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:29.327574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f047acb-5544-4195-836e-d6903550ea25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:29.328275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f047acb-5544-4195-836e-d6903550ea25 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:29.328636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f047acb-5544-4195-836e-d6903550ea25 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:29.328905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f047acb-5544-4195-836e-d6903550ea25 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:29.329622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f047acb-5544-4195-836e-d6903550ea25 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:29.329929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f047acb-5544-4195-836e-d6903550ea25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:29.331560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f047acb-5544-4195-836e-d6903550ea25 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:29.332539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705799eb-c52f-4d30-8989-2b3a55b80f83 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:29.340706 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 56/118] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:29.341664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f047acb-5544-4195-836e-d6903550ea25 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:29.374763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335e4ca-a204-4dab-bfb9-a95bc3f6721a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:29.375390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335e4ca-a204-4dab-bfb9-a95bc3f6721a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:29.375666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335e4ca-a204-4dab-bfb9-a95bc3f6721a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:29.375938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335e4ca-a204-4dab-bfb9-a95bc3f6721a None admin] PATH_INFO: `/v3/users/f35bc6b4a2c94914bd986ad019ecb5c6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:29.377080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335e4ca-a204-4dab-bfb9-a95bc3f6721a None admin] RBAC: Authorizing `identity:get_user(user_id=f35bc6b4a2c94914bd986ad019ecb5c6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:29.378501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335e4ca-a204-4dab-bfb9-a95bc3f6721a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:29.380069 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 63/119] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:29 2022] GET /identity/v3/users/f35bc6b4a2c94914bd986ad019ecb5c6 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:29.381259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52e4dc-e49e-4d54-910a-a1e838011184 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:29.381596 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52e4dc-e49e-4d54-910a-a1e838011184 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:29.381871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52e4dc-e49e-4d54-910a-a1e838011184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:29.400137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1b52e4dc-e49e-4d54-910a-a1e838011184 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:29.400341 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:29.401575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1b52e4dc-e49e-4d54-910a-a1e838011184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:29.456430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f047acb-5544-4195-836e-d6903550ea25 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:29.474470 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 64/120] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:29.484825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52e4dc-e49e-4d54-910a-a1e838011184 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:29.500419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02d686-7030-4715-8cdb-a2e45b1aa8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:29.501196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02d686-7030-4715-8cdb-a2e45b1aa8b6 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:29.501546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02d686-7030-4715-8cdb-a2e45b1aa8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:29.501942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02d686-7030-4715-8cdb-a2e45b1aa8b6 None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:29.502738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02d686-7030-4715-8cdb-a2e45b1aa8b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:29.504336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02d686-7030-4715-8cdb-a2e45b1aa8b6 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:29.540840 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 57/121] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Sep 30 09:26:29 2022] POST /identity/v3/projects => generated 302 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:29.545642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02d686-7030-4715-8cdb-a2e45b1aa8b6 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:29.577287 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:29.656895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52e4dc-e49e-4d54-910a-a1e838011184 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:29.713565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c2aef-345f-4b75-b3e7-b7af3108b312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:29.714233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c2aef-345f-4b75-b3e7-b7af3108b312 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:29.714513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c2aef-345f-4b75-b3e7-b7af3108b312 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:29.714787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c2aef-345f-4b75-b3e7-b7af3108b312 None admin] PATH_INFO: `/v3/users/695734af4ebc4c5fbebc32816bddfa23` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:29.717075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c2aef-345f-4b75-b3e7-b7af3108b312 None admin] RBAC: Authorizing `identity:get_user(user_id=695734af4ebc4c5fbebc32816bddfa23)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:29.719752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c2aef-345f-4b75-b3e7-b7af3108b312 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:29.721637 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 65/122] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:29 2022] GET /identity/v3/users/695734af4ebc4c5fbebc32816bddfa23 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:29.725604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c2aef-345f-4b75-b3e7-b7af3108b312 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:29.751745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02d686-7030-4715-8cdb-a2e45b1aa8b6 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:29.755767 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:29.800575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01474a28-d5f2-45c0-9944-2caa7e0b75ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:29.801255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01474a28-d5f2-45c0-9944-2caa7e0b75ea None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:29.801532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01474a28-d5f2-45c0-9944-2caa7e0b75ea None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:29.801803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01474a28-d5f2-45c0-9944-2caa7e0b75ea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:29.814159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01474a28-d5f2-45c0-9944-2caa7e0b75ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:29.818914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-01474a28-d5f2-45c0-9944-2caa7e0b75ea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:26:29.818914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:29.818914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:29.818914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:29.818914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:29.818914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:29.818914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:29.818914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:29.818914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:29.818914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:29.818914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:29.818914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:29.818914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:29.818914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:29.818914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:29.818914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:29.819929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:29.819929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:29.819929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:29.819929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:29.819929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:29.819929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:29.819929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:29.819929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:29.819929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:29.819929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:29.819929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:29.819929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:29.819929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:29.819929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:29.819929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:29.819929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:29.821016 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:29.821016 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:29.821016 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:29.821016 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:29.821016 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:29.821016 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:29.821016 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:29.821016 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:29.821016 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:29.821016 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:29.821016 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:26:29.821016 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:26:29.821016 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 58/123] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:29.821757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01474a28-d5f2-45c0-9944-2caa7e0b75ea None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:29.904372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c2aef-345f-4b75-b3e7-b7af3108b312 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:29.933954 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:29.942600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3f838-fd4b-4ec2-8a1d-e475288aff79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:29.943226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3f838-fd4b-4ec2-8a1d-e475288aff79 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:29.943502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3f838-fd4b-4ec2-8a1d-e475288aff79 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:29.943772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3f838-fd4b-4ec2-8a1d-e475288aff79 None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:29.944937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3f838-fd4b-4ec2-8a1d-e475288aff79 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d26f75111496bae034056bc6ed395)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:29.946550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3f838-fd4b-4ec2-8a1d-e475288aff79 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:29.949138 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 66/124] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:29 2022] GET /identity/v3/projects/ee1d26f75111496bae034056bc6ed395 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:29.950012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3f838-fd4b-4ec2-8a1d-e475288aff79 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:29.964311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01474a28-d5f2-45c0-9944-2caa7e0b75ea None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:30.002808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694dc851-1b5a-459e-88cd-fda1433bc2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:30.003510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694dc851-1b5a-459e-88cd-fda1433bc2d8 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:30.003793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694dc851-1b5a-459e-88cd-fda1433bc2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:30.004059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694dc851-1b5a-459e-88cd-fda1433bc2d8 None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:30.009389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694dc851-1b5a-459e-88cd-fda1433bc2d8 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d26f75111496bae034056bc6ed395)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:30.011480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694dc851-1b5a-459e-88cd-fda1433bc2d8 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:30.013298 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 59/125] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:29 2022] GET /identity/v3/projects/ee1d26f75111496bae034056bc6ed395 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:30.014209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694dc851-1b5a-459e-88cd-fda1433bc2d8 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:30.049064 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:30.084362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3f838-fd4b-4ec2-8a1d-e475288aff79 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:30.123225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a7898-3a25-42c4-9458-a024e1a30a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:30.123817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a7898-3a25-42c4-9458-a024e1a30a53 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:30.124101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a7898-3a25-42c4-9458-a024e1a30a53 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:30.124372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a7898-3a25-42c4-9458-a024e1a30a53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:30.136193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a7898-3a25-42c4-9458-a024e1a30a53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:30.141438 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-ff8a7898-3a25-42c4-9458-a024e1a30a53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:30.141438 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:30.141438 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:30.141438 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:30.141438 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:30.141438 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:30.141438 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:30.141438 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:30.141438 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:30.141438 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:30.141438 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:30.141438 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:30.141438 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:30.141438 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:30.141438 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:30.141438 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:30.142475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:30.142475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:30.142475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:30.142475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:30.142475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:30.142475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:30.142475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:30.142475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:30.142475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:30.142475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:30.142475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:30.142475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:30.142475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:30.142475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:30.142475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:30.142475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:30.143389 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:30.143389 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:30.143389 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:30.143389 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:30.143389 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:30.143389 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:30.143389 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:30.143389 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:30.143389 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:30.143389 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:30.143389 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:30.143389 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:26:30.143389 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 67/126] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:30.143389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a7898-3a25-42c4-9458-a024e1a30a53 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:30.146223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694dc851-1b5a-459e-88cd-fda1433bc2d8 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:30.189965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddf35b-1237-4803-8a1f-1c3a9a605173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:30.190582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddf35b-1237-4803-8a1f-1c3a9a605173 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:30.190862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddf35b-1237-4803-8a1f-1c3a9a605173 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:30.191128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddf35b-1237-4803-8a1f-1c3a9a605173 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:30.192134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ddf35b-1237-4803-8a1f-1c3a9a605173 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:30.192461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ddf35b-1237-4803-8a1f-1c3a9a605173 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:30.194213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ddf35b-1237-4803-8a1f-1c3a9a605173 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:30.206105 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 60/127] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:26:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:30.207158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddf35b-1237-4803-8a1f-1c3a9a605173 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:30.207944 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:30.262226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a7898-3a25-42c4-9458-a024e1a30a53 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:30.299400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b918279-8591-4b16-803d-09d217fd185c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:30.300042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b918279-8591-4b16-803d-09d217fd185c None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:30.300421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b918279-8591-4b16-803d-09d217fd185c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:30.300835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b918279-8591-4b16-803d-09d217fd185c None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395/users/f35bc6b4a2c94914bd986ad019ecb5c6/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:30.303005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b918279-8591-4b16-803d-09d217fd185c None admin] RBAC: Authorizing `identity:create_grant(project_id=ee1d26f75111496bae034056bc6ed395, user_id=f35bc6b4a2c94914bd986ad019ecb5c6, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:30.305468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b918279-8591-4b16-803d-09d217fd185c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:30.324866 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 68/128] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:26:30 2022] PUT /identity/v3/projects/ee1d26f75111496bae034056bc6ed395/users/f35bc6b4a2c94914bd986ad019ecb5c6/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:26:30.326378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b918279-8591-4b16-803d-09d217fd185c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:30.328506 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:30.340803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddf35b-1237-4803-8a1f-1c3a9a605173 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:30.381221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b6790-390a-42c9-9d62-5a5358148fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:30.382374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b6790-390a-42c9-9d62-5a5358148fe6 None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:30.382888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b6790-390a-42c9-9d62-5a5358148fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:30.383307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b6790-390a-42c9-9d62-5a5358148fe6 None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395/users/695734af4ebc4c5fbebc32816bddfa23/roles/27410223fa7d4717a71ac6753c80420b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:30.386923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b6790-390a-42c9-9d62-5a5358148fe6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee1d26f75111496bae034056bc6ed395, user_id=695734af4ebc4c5fbebc32816bddfa23, role_id=27410223fa7d4717a71ac6753c80420b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:30.388636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b6790-390a-42c9-9d62-5a5358148fe6 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:30.415059 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 61/129] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:26:30 2022] PUT /identity/v3/projects/ee1d26f75111496bae034056bc6ed395/users/695734af4ebc4c5fbebc32816bddfa23/roles/27410223fa7d4717a71ac6753c80420b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:26:30.420999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b6790-390a-42c9-9d62-5a5358148fe6 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:30.477076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b918279-8591-4b16-803d-09d217fd185c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:30.501805 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:30.529652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e2f23-dac5-4fc8-86a8-0f3c991256ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:30.530800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e2f23-dac5-4fc8-86a8-0f3c991256ba None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:30.531238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e2f23-dac5-4fc8-86a8-0f3c991256ba None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:30.531642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e2f23-dac5-4fc8-86a8-0f3c991256ba None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:30.532750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e2f23-dac5-4fc8-86a8-0f3c991256ba None admin] RBAC: Adding query filter params (name=member) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:30.533214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e2f23-dac5-4fc8-86a8-0f3c991256ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:30.535813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e2f23-dac5-4fc8-86a8-0f3c991256ba None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:30.547232 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 69/130] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:26:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:30.553492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e2f23-dac5-4fc8-86a8-0f3c991256ba None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:30.630853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b6790-390a-42c9-9d62-5a5358148fe6 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:30.670509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e2f23-dac5-4fc8-86a8-0f3c991256ba None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:30.708741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89614888-edcd-4511-8a9f-fee5bfa10a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:30.710208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89614888-edcd-4511-8a9f-fee5bfa10a98 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:30.711085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89614888-edcd-4511-8a9f-fee5bfa10a98 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:30.711867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89614888-edcd-4511-8a9f-fee5bfa10a98 None admin] PATH_INFO: `/v3/users/6b8800a04b8e4b06894439aca530c7c0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:30.713762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7a1d8-eb0e-43df-9d37-4d04fa0f2312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:30.714599 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7a1d8-eb0e-43df-9d37-4d04fa0f2312 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:30.715250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7a1d8-eb0e-43df-9d37-4d04fa0f2312 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:30.716909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7a1d8-eb0e-43df-9d37-4d04fa0f2312 None admin] PATH_INFO: `/v3/users/695734af4ebc4c5fbebc32816bddfa23` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:30.719155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7a1d8-eb0e-43df-9d37-4d04fa0f2312 None admin] RBAC: Authorizing `identity:get_user(user_id=695734af4ebc4c5fbebc32816bddfa23)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:30.720883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7a1d8-eb0e-43df-9d37-4d04fa0f2312 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:30.727749 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 70/131] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:30 2022] GET /identity/v3/users/695734af4ebc4c5fbebc32816bddfa23 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:30.729424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7a1d8-eb0e-43df-9d37-4d04fa0f2312 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:30.749926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89614888-edcd-4511-8a9f-fee5bfa10a98 None admin] RBAC: Authorizing `identity:get_user(user_id=6b8800a04b8e4b06894439aca530c7c0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:30.751718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89614888-edcd-4511-8a9f-fee5bfa10a98 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:30.753660 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 62/132] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:30 2022] GET /identity/v3/users/6b8800a04b8e4b06894439aca530c7c0 => generated 289 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:30.759147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89614888-edcd-4511-8a9f-fee5bfa10a98 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:30.777647 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:30.827967 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:30.928458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7a1d8-eb0e-43df-9d37-4d04fa0f2312 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:30.966750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b830ba-1c68-41f0-a998-5c82743a008a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:30.967621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b830ba-1c68-41f0-a998-5c82743a008a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:30.967900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b830ba-1c68-41f0-a998-5c82743a008a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:30.968169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b830ba-1c68-41f0-a998-5c82743a008a None admin] PATH_INFO: `/v3/projects/e519a871faf74584853c304a8e793bb6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:30.969304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b830ba-1c68-41f0-a998-5c82743a008a None admin] RBAC: Authorizing `identity:get_project(project_id=e519a871faf74584853c304a8e793bb6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:30.970313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89614888-edcd-4511-8a9f-fee5bfa10a98 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:30.970719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b830ba-1c68-41f0-a998-5c82743a008a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:30.972863 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 71/133] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:30 2022] GET /identity/v3/projects/e519a871faf74584853c304a8e793bb6 => generated 312 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:30.979371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b830ba-1c68-41f0-a998-5c82743a008a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:31.057417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b2888-f1c9-46dd-bdcd-7ff5b9d1ac5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:31.058131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b2888-f1c9-46dd-bdcd-7ff5b9d1ac5e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:31.058408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b2888-f1c9-46dd-bdcd-7ff5b9d1ac5e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:31.058673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b2888-f1c9-46dd-bdcd-7ff5b9d1ac5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:31.087122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b830ba-1c68-41f0-a998-5c82743a008a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:31.119936 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:31.154491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec993ce6-b5a2-49b0-891b-6838fd8077d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:31.155306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec993ce6-b5a2-49b0-891b-6838fd8077d9 None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:31.155429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec993ce6-b5a2-49b0-891b-6838fd8077d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:31.155686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec993ce6-b5a2-49b0-891b-6838fd8077d9 None admin] PATH_INFO: `/v3/projects/e519a871faf74584853c304a8e793bb6/users/695734af4ebc4c5fbebc32816bddfa23/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:31.162043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec993ce6-b5a2-49b0-891b-6838fd8077d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e519a871faf74584853c304a8e793bb6, user_id=695734af4ebc4c5fbebc32816bddfa23, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:31.163824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec993ce6-b5a2-49b0-891b-6838fd8077d9 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:31.199358 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 72/134] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:26:30 2022] PUT /identity/v3/projects/e519a871faf74584853c304a8e793bb6/users/695734af4ebc4c5fbebc32816bddfa23/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:26:31.199567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b2888-f1c9-46dd-bdcd-7ff5b9d1ac5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:31.201363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b2888-f1c9-46dd-bdcd-7ff5b9d1ac5e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:31.221933 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:31.332164 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 63/135] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 09:26:31.339481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec993ce6-b5a2-49b0-891b-6838fd8077d9 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:31.489031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec993ce6-b5a2-49b0-891b-6838fd8077d9 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:31.535062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa53424-8b15-43db-a9cc-b4009e403aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:31.536101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53424-8b15-43db-a9cc-b4009e403aaf None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:31.536589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53424-8b15-43db-a9cc-b4009e403aaf None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:31.537101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53424-8b15-43db-a9cc-b4009e403aaf None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:31.538700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa53424-8b15-43db-a9cc-b4009e403aaf None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d26f75111496bae034056bc6ed395)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:31.540404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa53424-8b15-43db-a9cc-b4009e403aaf None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:31.542401 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 73/136] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:31 2022] GET /identity/v3/projects/ee1d26f75111496bae034056bc6ed395 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:31.548489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b2888-f1c9-46dd-bdcd-7ff5b9d1ac5e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:31.676287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b2888-f1c9-46dd-bdcd-7ff5b9d1ac5e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:31.686255 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:31.712438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7b56d-27ae-440a-99d8-3d8fc8f2815e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:31.713633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7b56d-27ae-440a-99d8-3d8fc8f2815e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:31.713925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7b56d-27ae-440a-99d8-3d8fc8f2815e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:31.714461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7b56d-27ae-440a-99d8-3d8fc8f2815e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:31.715210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7b56d-27ae-440a-99d8-3d8fc8f2815e None admin] RBAC: Adding query filter params (role.id=81bbb9ae78e14fd6918fa33de9da8bc4, scope.project.id=ee1d26f75111496bae034056bc6ed395, user.id=6b8800a04b8e4b06894439aca530c7c0) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:31.715527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7b56d-27ae-440a-99d8-3d8fc8f2815e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:31.717004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7b56d-27ae-440a-99d8-3d8fc8f2815e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:31.722842 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 64/137] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:31 2022] GET /identity/v3/role_assignments?user.id=6b8800a04b8e4b06894439aca530c7c0&scope.project.id=ee1d26f75111496bae034056bc6ed395&role.id=81bbb9ae78e14fd6918fa33de9da8bc4 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:31.872631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd31ca-5f51-44ba-9765-9442f3267d32 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:31.872989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd31ca-5f51-44ba-9765-9442f3267d32 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:31.873207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd31ca-5f51-44ba-9765-9442f3267d32 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:31.874744 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 74/138] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:31.880455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ac5a3-abf3-4ac2-a8ca-7ef0479cf900 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:31.880762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ac5a3-abf3-4ac2-a8ca-7ef0479cf900 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:31.881045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ac5a3-abf3-4ac2-a8ca-7ef0479cf900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:31.905829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-180ac5a3-abf3-4ac2-a8ca-7ef0479cf900 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:31.907036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-180ac5a3-abf3-4ac2-a8ca-7ef0479cf900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:32.005924 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 65/139] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:32.523809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd31ca-5f51-44ba-9765-9442f3267d32 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:32.578068 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:32.645341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd31ca-5f51-44ba-9765-9442f3267d32 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:32.686738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8fd43-6ec0-4843-8bd1-69065d73a9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:32.687373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8fd43-6ec0-4843-8bd1-69065d73a9a5 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:32.687650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8fd43-6ec0-4843-8bd1-69065d73a9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:32.687923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8fd43-6ec0-4843-8bd1-69065d73a9a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:32.698678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8fd43-6ec0-4843-8bd1-69065d73a9a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:32.703928 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-a2a8fd43-6ec0-4843-8bd1-69065d73a9a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:32.703928 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:32.703928 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:32.703928 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:32.703928 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:32.703928 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:32.703928 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:32.703928 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:32.703928 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:32.703928 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:32.703928 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:32.703928 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:32.703928 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:32.703928 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:32.703928 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:32.703928 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:32.704794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:32.704794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:32.704794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:32.704794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:32.704794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:32.704794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:32.704794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:32.704794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:32.704794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:32.704794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:32.704794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:32.704794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:32.704794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:32.704794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:32.704794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:32.704794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:32.705800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:32.705800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:32.705800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:32.705800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:32.705800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:32.705800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:32.705800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:32.705800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:32.705800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:32.705800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:32.705800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:32.705800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:26:32.705800 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 75/140] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:32.712381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ac5a3-abf3-4ac2-a8ca-7ef0479cf900 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:32.830033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ac5a3-abf3-4ac2-a8ca-7ef0479cf900 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:32.831763 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:32.877809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593fc06-09b6-4a18-938a-9f4068f8abbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:32.878610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593fc06-09b6-4a18-938a-9f4068f8abbb None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:32.878890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593fc06-09b6-4a18-938a-9f4068f8abbb None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:32.879162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593fc06-09b6-4a18-938a-9f4068f8abbb None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:32.879843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593fc06-09b6-4a18-938a-9f4068f8abbb None admin] RBAC: Adding query filter params (name=member) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:32.880146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593fc06-09b6-4a18-938a-9f4068f8abbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:32.881576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593fc06-09b6-4a18-938a-9f4068f8abbb None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:32.891550 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 66/141] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:26:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:32.897304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8fd43-6ec0-4843-8bd1-69065d73a9a5 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:33.037250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8fd43-6ec0-4843-8bd1-69065d73a9a5 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:33.038774 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:33.059180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a14e52-7ec4-4041-b3cb-a7822f0c3291 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:33.059470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a14e52-7ec4-4041-b3cb-a7822f0c3291 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:33.059806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a14e52-7ec4-4041-b3cb-a7822f0c3291 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:33.061172 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 67/142] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:33.077668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8515eed-6647-4f51-9faa-74e5c976fdc5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:33.077976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8515eed-6647-4f51-9faa-74e5c976fdc5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:33.078229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8515eed-6647-4f51-9faa-74e5c976fdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:33.079091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d91c67-787f-48e9-8cdd-4ca139ad77a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:33.079723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d91c67-787f-48e9-8cdd-4ca139ad77a4 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:33.079998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d91c67-787f-48e9-8cdd-4ca139ad77a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:33.080572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d91c67-787f-48e9-8cdd-4ca139ad77a4 None admin] PATH_INFO: `/v3/users/695734af4ebc4c5fbebc32816bddfa23` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:33.081727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d91c67-787f-48e9-8cdd-4ca139ad77a4 None admin] RBAC: Authorizing `identity:get_user(user_id=695734af4ebc4c5fbebc32816bddfa23)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:33.083160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d91c67-787f-48e9-8cdd-4ca139ad77a4 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:33.084966 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 76/143] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:32 2022] GET /identity/v3/users/695734af4ebc4c5fbebc32816bddfa23 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:33.093988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d91c67-787f-48e9-8cdd-4ca139ad77a4 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:33.111479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c8515eed-6647-4f51-9faa-74e5c976fdc5 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:33.112744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c8515eed-6647-4f51-9faa-74e5c976fdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:33.232031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d91c67-787f-48e9-8cdd-4ca139ad77a4 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:33.257933 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 68/144] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:33.293337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58294ed-f62c-4e22-8b6c-80e39bc0c9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:33.293957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58294ed-f62c-4e22-8b6c-80e39bc0c9bc None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:33.294237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58294ed-f62c-4e22-8b6c-80e39bc0c9bc None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:33.294507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58294ed-f62c-4e22-8b6c-80e39bc0c9bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:33.342285 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:33.371420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58294ed-f62c-4e22-8b6c-80e39bc0c9bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:33.372901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58294ed-f62c-4e22-8b6c-80e39bc0c9bc None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:33.476566 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 77/145] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 09:26:33.482783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8515eed-6647-4f51-9faa-74e5c976fdc5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:33.584712 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:33.595882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8515eed-6647-4f51-9faa-74e5c976fdc5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:33.616321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58294ed-f62c-4e22-8b6c-80e39bc0c9bc None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:33.656385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72553bf-eb8a-4980-8479-f1dfb3b69516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:33.657056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72553bf-eb8a-4980-8479-f1dfb3b69516 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:33.657338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72553bf-eb8a-4980-8479-f1dfb3b69516 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:33.657612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72553bf-eb8a-4980-8479-f1dfb3b69516 None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:33.658935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72553bf-eb8a-4980-8479-f1dfb3b69516 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d26f75111496bae034056bc6ed395)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:33.660370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72553bf-eb8a-4980-8479-f1dfb3b69516 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:33.664161 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 69/146] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:33 2022] GET /identity/v3/projects/ee1d26f75111496bae034056bc6ed395 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:33.669680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72553bf-eb8a-4980-8479-f1dfb3b69516 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:33.777308 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:33.780724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72553bf-eb8a-4980-8479-f1dfb3b69516 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:33.835562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58294ed-f62c-4e22-8b6c-80e39bc0c9bc None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:33.849721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f471d2a-80d5-45b9-843c-2d4e0b1849a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:33.850276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f471d2a-80d5-45b9-843c-2d4e0b1849a0 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:33.850555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f471d2a-80d5-45b9-843c-2d4e0b1849a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:33.850824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f471d2a-80d5-45b9-843c-2d4e0b1849a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:33.851561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f471d2a-80d5-45b9-843c-2d4e0b1849a0 None admin] RBAC: Adding query filter params (role.id=f642af7fc1fd472d8f4a4d6f34548ba2, scope.project.id=ee1d26f75111496bae034056bc6ed395, user.id=695734af4ebc4c5fbebc32816bddfa23) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:33.851866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f471d2a-80d5-45b9-843c-2d4e0b1849a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:33.853339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f471d2a-80d5-45b9-843c-2d4e0b1849a0 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:33.864260 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 70/147] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:33 2022] GET /identity/v3/role_assignments?user.id=695734af4ebc4c5fbebc32816bddfa23&scope.project.id=ee1d26f75111496bae034056bc6ed395&role.id=f642af7fc1fd472d8f4a4d6f34548ba2 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:33.892021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ca61a-f2e0-4ecb-b2ab-9607e6c659f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:33.892712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ca61a-f2e0-4ecb-b2ab-9607e6c659f0 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:33.893045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ca61a-f2e0-4ecb-b2ab-9607e6c659f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:33.893324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ca61a-f2e0-4ecb-b2ab-9607e6c659f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:33.894597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ca61a-f2e0-4ecb-b2ab-9607e6c659f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:33.896209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ca61a-f2e0-4ecb-b2ab-9607e6c659f0 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:33.898182 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 78/148] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:33.904530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f471d2a-80d5-45b9-843c-2d4e0b1849a0 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:33.968986 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:34.098996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f471d2a-80d5-45b9-843c-2d4e0b1849a0 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:34.144150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf548c4-f1f3-4eeb-a9f4-2e2d95b18eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:34.144782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf548c4-f1f3-4eeb-a9f4-2e2d95b18eba None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:34.145060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf548c4-f1f3-4eeb-a9f4-2e2d95b18eba None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:34.145327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf548c4-f1f3-4eeb-a9f4-2e2d95b18eba None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:34.145986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf548c4-f1f3-4eeb-a9f4-2e2d95b18eba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:34.147424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf548c4-f1f3-4eeb-a9f4-2e2d95b18eba None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:34.167301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb815acc-2875-4a9a-9695-9d696274ec26 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:34.167615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb815acc-2875-4a9a-9695-9d696274ec26 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:34.167853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb815acc-2875-4a9a-9695-9d696274ec26 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:34.169627 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 79/149] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:34.173135 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 71/150] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Sep 30 09:26:33 2022] POST /identity/v3/users => generated 283 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:34.178110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030c3fa-ad4c-4171-aa17-020415cc7b87 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:34.178439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030c3fa-ad4c-4171-aa17-020415cc7b87 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:34.178757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030c3fa-ad4c-4171-aa17-020415cc7b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:34.184913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ee0bd-ad2c-4608-a564-fccd90662770 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:34.185525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ee0bd-ad2c-4608-a564-fccd90662770 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:34.186005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ee0bd-ad2c-4608-a564-fccd90662770 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:34.187644 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 72/151] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:34.193407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa32e3-c058-49a3-9bc7-4a172a19e5e1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:34.193937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa32e3-c058-49a3-9bc7-4a172a19e5e1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:34.194422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa32e3-c058-49a3-9bc7-4a172a19e5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:34.200592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d030c3fa-ad4c-4171-aa17-020415cc7b87 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:34.201897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d030c3fa-ad4c-4171-aa17-020415cc7b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:34.215825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-91fa32e3-c058-49a3-9bc7-4a172a19e5e1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:34.217381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-91fa32e3-c058-49a3-9bc7-4a172a19e5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:34.291585 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 80/152] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:26:34.298928 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 73/153] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:26:34.601224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030c3fa-ad4c-4171-aa17-020415cc7b87 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:34.616236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab28ed-7c7e-4027-a6d8-ebc7cd8b13b3 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:34.616514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab28ed-7c7e-4027-a6d8-ebc7cd8b13b3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:34.616959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab28ed-7c7e-4027-a6d8-ebc7cd8b13b3 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:34.619267 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 74/154] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:34.624488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c160ea-0893-4d6b-924d-e1bd26902dd1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:34.625323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c160ea-0893-4d6b-924d-e1bd26902dd1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:34.625599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c160ea-0893-4d6b-924d-e1bd26902dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:34.654811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c0c160ea-0893-4d6b-924d-e1bd26902dd1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:34.656026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c0c160ea-0893-4d6b-924d-e1bd26902dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:34.665534 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:34.688409 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:34.728692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030c3fa-ad4c-4171-aa17-020415cc7b87 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:34.734077 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 75/155] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:26:34.735271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c160ea-0893-4d6b-924d-e1bd26902dd1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:34.767925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16383b3-1745-4bfe-b89b-45030824a860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:34.768559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16383b3-1745-4bfe-b89b-45030824a860 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:34.769113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16383b3-1745-4bfe-b89b-45030824a860 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:34.769667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16383b3-1745-4bfe-b89b-45030824a860 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:34.787499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16383b3-1745-4bfe-b89b-45030824a860 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:34.793033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-a16383b3-1745-4bfe-b89b-45030824a860 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:26:34.793033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:34.793033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:34.793033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:34.793033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:34.793033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:34.793033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:34.793033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:34.793033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:34.793033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:34.793033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:34.793033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:34.793033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:34.793033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:34.793033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:34.793033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:34.794120 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:34.794120 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:34.794120 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:34.794120 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:34.794120 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:34.794120 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:34.794120 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:34.794120 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:34.794120 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:34.794120 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:34.794120 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:34.794120 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:34.794120 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:34.794120 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:34.794120 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:34.794120 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:34.795071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:34.795071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:34.795071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:34.795071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:34.795071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:34.795071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:34.795071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:34.795071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:34.795071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:34.795071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:34.795071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:26:34.795071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:26:34.797330 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 81/156] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Sep 30 09:26:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:34.803743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16383b3-1745-4bfe-b89b-45030824a860 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:34.878256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c160ea-0893-4d6b-924d-e1bd26902dd1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:34.935429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ea2c5-b2fd-4e48-9790-61cf53375e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:34.936587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ea2c5-b2fd-4e48-9790-61cf53375e2a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:34.937270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ea2c5-b2fd-4e48-9790-61cf53375e2a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:34.937752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ea2c5-b2fd-4e48-9790-61cf53375e2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:34.954640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ea2c5-b2fd-4e48-9790-61cf53375e2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:34.959782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-858ea2c5-b2fd-4e48-9790-61cf53375e2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:34.959782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:34.959782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:34.959782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:34.959782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:34.959782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:34.959782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:34.959782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:34.959782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:34.959782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:34.959782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:34.959782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:34.959782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:34.959782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:34.959782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:34.959782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:34.960893 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:34.960893 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:34.960893 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:34.960893 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:34.960893 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:34.960893 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:34.960893 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:34.960893 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:34.960893 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:34.960893 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:34.960893 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:34.960893 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:34.960893 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:34.960893 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:34.960893 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:34.960893 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:34.961770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:34.961770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:34.961770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:34.961770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:34.961770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:34.961770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:34.961770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:34.961770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:34.961770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:34.961770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:34.961770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:34.961770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:26:34.961770 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 76/157] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:34.968799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1d77b-d9d2-4114-9d53-0657714d0ef6 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:34.969168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1d77b-d9d2-4114-9d53-0657714d0ef6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:34.969330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1d77b-d9d2-4114-9d53-0657714d0ef6 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:34.970772 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 77/158] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:34.977048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad8d4d-dab9-4cd1-a621-18e861ccb29f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:34.977333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad8d4d-dab9-4cd1-a621-18e861ccb29f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:34.977607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad8d4d-dab9-4cd1-a621-18e861ccb29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:34.978510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16383b3-1745-4bfe-b89b-45030824a860 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:34.985662 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:34.998600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-faad8d4d-dab9-4cd1-a621-18e861ccb29f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:34.999793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-faad8d4d-dab9-4cd1-a621-18e861ccb29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:35.014671 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:35.032117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe248a53-8f51-448c-a1a6-6c4f1073c22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:35.032783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe248a53-8f51-448c-a1a6-6c4f1073c22b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:35.033070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe248a53-8f51-448c-a1a6-6c4f1073c22b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:35.033362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe248a53-8f51-448c-a1a6-6c4f1073c22b None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:35.034021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe248a53-8f51-448c-a1a6-6c4f1073c22b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:35.034325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe248a53-8f51-448c-a1a6-6c4f1073c22b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:35.035699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe248a53-8f51-448c-a1a6-6c4f1073c22b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:35.048674 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 82/159] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:35.048674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe248a53-8f51-448c-a1a6-6c4f1073c22b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:35.104631 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 78/160] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:35.106110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad8d4d-dab9-4cd1-a621-18e861ccb29f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:35.178128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe248a53-8f51-448c-a1a6-6c4f1073c22b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:35.230881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f33268-214d-4d4e-a608-a0ccbe60647c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:35.231862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f33268-214d-4d4e-a608-a0ccbe60647c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:35.232905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f33268-214d-4d4e-a608-a0ccbe60647c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:35.233398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f33268-214d-4d4e-a608-a0ccbe60647c None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:35.234555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f33268-214d-4d4e-a608-a0ccbe60647c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:35.235321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f33268-214d-4d4e-a608-a0ccbe60647c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:35.237569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f33268-214d-4d4e-a608-a0ccbe60647c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:35.251719 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 83/161] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:35.252292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad8d4d-dab9-4cd1-a621-18e861ccb29f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:35.253013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f33268-214d-4d4e-a608-a0ccbe60647c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:35.306405 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:35.311510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a98bd3-b858-46c0-b798-e35872dd5b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:35.312173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a98bd3-b858-46c0-b798-e35872dd5b1d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:35.312555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a98bd3-b858-46c0-b798-e35872dd5b1d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:35.312964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a98bd3-b858-46c0-b798-e35872dd5b1d None admin] PATH_INFO: `/v3/users/695734af4ebc4c5fbebc32816bddfa23` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:35.314679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a98bd3-b858-46c0-b798-e35872dd5b1d None admin] RBAC: Authorizing `identity:get_user(user_id=695734af4ebc4c5fbebc32816bddfa23)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:35.316002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a98bd3-b858-46c0-b798-e35872dd5b1d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:35.317829 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 79/162] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:35 2022] GET /identity/v3/users/695734af4ebc4c5fbebc32816bddfa23 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:35.318672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a98bd3-b858-46c0-b798-e35872dd5b1d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:35.320923 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:35.379634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f33268-214d-4d4e-a608-a0ccbe60647c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:35.424142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670f65e-c913-4c71-b464-94291348ca80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:35.424818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670f65e-c913-4c71-b464-94291348ca80 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:35.425103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670f65e-c913-4c71-b464-94291348ca80 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:35.426058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670f65e-c913-4c71-b464-94291348ca80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:35.439856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a98bd3-b858-46c0-b798-e35872dd5b1d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:35.443284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670f65e-c913-4c71-b464-94291348ca80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:35.449030 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-d670f65e-c913-4c71-b464-94291348ca80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:35.449030 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:35.449030 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:35.449030 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:35.449030 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:35.449030 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:35.449030 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:35.449030 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:35.449030 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:35.449030 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:35.449030 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:35.449030 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:35.449030 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:35.449030 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:35.449030 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:35.449030 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:35.449937 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:35.449937 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:35.449937 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:35.449937 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:35.449937 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:35.449937 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:35.449937 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:35.449937 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:35.449937 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:35.449937 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:35.449937 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:35.449937 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:35.449937 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:35.449937 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:35.449937 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:35.449937 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:35.451122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:35.451122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:35.451122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:35.451122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:35.451122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:35.451122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:35.451122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:35.451122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:35.451122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:35.451122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:35.451122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:35.451122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:26:35.451122 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 84/163] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:35.451122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670f65e-c913-4c71-b464-94291348ca80 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:35.487433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e1c95-3bdb-4df1-aedf-2b702fa3428d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:35.488389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e1c95-3bdb-4df1-aedf-2b702fa3428d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:35.489641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e1c95-3bdb-4df1-aedf-2b702fa3428d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:35.489921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e1c95-3bdb-4df1-aedf-2b702fa3428d None admin] PATH_INFO: `/v3/users/f35bc6b4a2c94914bd986ad019ecb5c6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:35.491055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e1c95-3bdb-4df1-aedf-2b702fa3428d None admin] RBAC: Authorizing `identity:get_user(user_id=f35bc6b4a2c94914bd986ad019ecb5c6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:35.492559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e1c95-3bdb-4df1-aedf-2b702fa3428d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:35.495819 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 80/164] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:35 2022] GET /identity/v3/users/f35bc6b4a2c94914bd986ad019ecb5c6 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:35.496421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e1c95-3bdb-4df1-aedf-2b702fa3428d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:35.570100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670f65e-c913-4c71-b464-94291348ca80 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:35.579506 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:35.586409 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:35.621615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb3af2-4e98-4180-8591-5d79634581ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:35.622553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb3af2-4e98-4180-8591-5d79634581ee None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:35.623164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb3af2-4e98-4180-8591-5d79634581ee None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:35.624692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb3af2-4e98-4180-8591-5d79634581ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:35.644694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e1c95-3bdb-4df1-aedf-2b702fa3428d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:35.693982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f61d58-a9c2-4d11-8885-8d60f0d5b349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:35.694903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f61d58-a9c2-4d11-8885-8d60f0d5b349 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:35.695355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f61d58-a9c2-4d11-8885-8d60f0d5b349 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:35.695857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f61d58-a9c2-4d11-8885-8d60f0d5b349 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:35.720236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f61d58-a9c2-4d11-8885-8d60f0d5b349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:35.731146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-e1f61d58-a9c2-4d11-8885-8d60f0d5b349 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:26:35.731146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:35.731146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:35.731146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:35.731146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:35.731146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:35.731146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:35.731146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:35.731146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:35.731146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:35.731146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:35.731146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:35.731146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:35.731146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:35.731146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:35.731146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:35.732075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:35.732075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:35.732075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:35.732075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:35.732075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:35.732075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:35.732075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:35.732075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:35.732075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:35.732075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:35.732075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:35.732075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:35.732075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:35.732075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:35.732075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:35.732075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:35.732922 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:35.732922 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:35.732922 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:35.732922 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:35.732922 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:35.732922 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:35.732922 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:35.732922 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:35.732922 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:35.732922 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:35.732922 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:26:35.732922 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:26:35.734871 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 81/165] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:35.735836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f61d58-a9c2-4d11-8885-8d60f0d5b349 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:35.766203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb3af2-4e98-4180-8591-5d79634581ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:35.769792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb3af2-4e98-4180-8591-5d79634581ee None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:35.890918 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 85/166] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:26:35.892007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb3af2-4e98-4180-8591-5d79634581ee None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:35.906390 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:35.938448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f61d58-a9c2-4d11-8885-8d60f0d5b349 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:36.001645 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:36.004801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb3af2-4e98-4180-8591-5d79634581ee None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:36.016078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fe544-5166-4196-8175-9e60827aa775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:36.016741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fe544-5166-4196-8175-9e60827aa775 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:36.017035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fe544-5166-4196-8175-9e60827aa775 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:36.017308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fe544-5166-4196-8175-9e60827aa775 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:36.017983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fe544-5166-4196-8175-9e60827aa775 None admin] RBAC: Adding query filter params (name=member) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:36.018288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fe544-5166-4196-8175-9e60827aa775 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:36.026099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fe544-5166-4196-8175-9e60827aa775 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:36.039319 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 82/167] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:26:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:36.040690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fe544-5166-4196-8175-9e60827aa775 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:36.046822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c527720-a4a9-4010-9c67-d6cdd8458a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:36.047430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c527720-a4a9-4010-9c67-d6cdd8458a9e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:36.047700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c527720-a4a9-4010-9c67-d6cdd8458a9e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:36.047965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c527720-a4a9-4010-9c67-d6cdd8458a9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:36.179487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c527720-a4a9-4010-9c67-d6cdd8458a9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:36.181006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c527720-a4a9-4010-9c67-d6cdd8458a9e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:36.201806 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:36.247595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fe544-5166-4196-8175-9e60827aa775 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:36.294354 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 86/168] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:26:36.295153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c527720-a4a9-4010-9c67-d6cdd8458a9e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:36.333311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4db14-4c97-463f-8bca-fbbdf9b4e234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:36.333934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4db14-4c97-463f-8bca-fbbdf9b4e234 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:36.334220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4db14-4c97-463f-8bca-fbbdf9b4e234 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:36.334495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4db14-4c97-463f-8bca-fbbdf9b4e234 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:36.335174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4db14-4c97-463f-8bca-fbbdf9b4e234 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:36.335477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4db14-4c97-463f-8bca-fbbdf9b4e234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:36.336881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4db14-4c97-463f-8bca-fbbdf9b4e234 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:36.355815 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 83/169] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:26:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:36.356700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4db14-4c97-463f-8bca-fbbdf9b4e234 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:36.401695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c527720-a4a9-4010-9c67-d6cdd8458a9e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:36.416942 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:36.438725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507428a-7bb9-479f-bf46-6389fe159219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:36.439355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507428a-7bb9-479f-bf46-6389fe159219 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:36.439628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507428a-7bb9-479f-bf46-6389fe159219 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:36.439897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507428a-7bb9-479f-bf46-6389fe159219 None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:36.445311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507428a-7bb9-479f-bf46-6389fe159219 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d26f75111496bae034056bc6ed395)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:36.446744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507428a-7bb9-479f-bf46-6389fe159219 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:36.448991 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 87/170] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:36 2022] GET /identity/v3/projects/ee1d26f75111496bae034056bc6ed395 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:36.449570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507428a-7bb9-479f-bf46-6389fe159219 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:36.476971 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:36.583110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507428a-7bb9-479f-bf46-6389fe159219 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:36.586497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4db14-4c97-463f-8bca-fbbdf9b4e234 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:36.621073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ca451-714e-442d-ae85-141e37b4671f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:36.622050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ca451-714e-442d-ae85-141e37b4671f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:36.622333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ca451-714e-442d-ae85-141e37b4671f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:36.622624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ca451-714e-442d-ae85-141e37b4671f None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:36.623992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ca451-714e-442d-ae85-141e37b4671f None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d26f75111496bae034056bc6ed395)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:36.625446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ca451-714e-442d-ae85-141e37b4671f None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:36.627686 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 88/171] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:36 2022] GET /identity/v3/projects/ee1d26f75111496bae034056bc6ed395 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:36.633352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ca451-714e-442d-ae85-141e37b4671f None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:36.691665 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:36.700171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4141079-f3b6-403c-9e47-16f9afa26928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:36.700891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4141079-f3b6-403c-9e47-16f9afa26928 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:36.701224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4141079-f3b6-403c-9e47-16f9afa26928 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:36.701498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4141079-f3b6-403c-9e47-16f9afa26928 None admin] PATH_INFO: `/v3/users/695734af4ebc4c5fbebc32816bddfa23` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:36.705724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4141079-f3b6-403c-9e47-16f9afa26928 None admin] RBAC: Authorizing `identity:get_user(user_id=695734af4ebc4c5fbebc32816bddfa23)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:36.707196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4141079-f3b6-403c-9e47-16f9afa26928 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:36.708877 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 84/172] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:36 2022] GET /identity/v3/users/695734af4ebc4c5fbebc32816bddfa23 => generated 275 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:36.709702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4141079-f3b6-403c-9e47-16f9afa26928 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:36.746172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ca451-714e-442d-ae85-141e37b4671f None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:36.782897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62adbc9-9d48-4e8f-ba4c-1154d8bd84be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:36.783953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62adbc9-9d48-4e8f-ba4c-1154d8bd84be None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:36.784237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62adbc9-9d48-4e8f-ba4c-1154d8bd84be None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:36.784505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62adbc9-9d48-4e8f-ba4c-1154d8bd84be None admin] PATH_INFO: `/v3/users/6b8800a04b8e4b06894439aca530c7c0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:36.785676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62adbc9-9d48-4e8f-ba4c-1154d8bd84be None admin] RBAC: Authorizing `identity:get_user(user_id=6b8800a04b8e4b06894439aca530c7c0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:36.787088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62adbc9-9d48-4e8f-ba4c-1154d8bd84be None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:36.789059 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 89/173] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:36 2022] GET /identity/v3/users/6b8800a04b8e4b06894439aca530c7c0 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:36.790241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62adbc9-9d48-4e8f-ba4c-1154d8bd84be None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:36.902727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62adbc9-9d48-4e8f-ba4c-1154d8bd84be None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:36.947782 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:36.972997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb43519-0457-4f0f-848f-250d7b36883e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:36.973600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb43519-0457-4f0f-848f-250d7b36883e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:36.973873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb43519-0457-4f0f-848f-250d7b36883e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:36.974139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb43519-0457-4f0f-848f-250d7b36883e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:36.974868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb43519-0457-4f0f-848f-250d7b36883e None admin] RBAC: Adding query filter params (role.id=f06b5fed717d4b03a5083dd847274296, scope.project.id=ee1d26f75111496bae034056bc6ed395, user.id=f35bc6b4a2c94914bd986ad019ecb5c6) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:36.975172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb43519-0457-4f0f-848f-250d7b36883e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:36.976613 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb43519-0457-4f0f-848f-250d7b36883e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:36.986691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4141079-f3b6-403c-9e47-16f9afa26928 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:36.998978 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 90/174] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:36 2022] GET /identity/v3/role_assignments?user.id=f35bc6b4a2c94914bd986ad019ecb5c6&scope.project.id=ee1d26f75111496bae034056bc6ed395&role.id=f06b5fed717d4b03a5083dd847274296 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:36.999929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb43519-0457-4f0f-848f-250d7b36883e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:37.049361 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:37.104584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c81c27-6dae-424b-bcb4-77d6953ea18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:37.105617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c81c27-6dae-424b-bcb4-77d6953ea18e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:37.106093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c81c27-6dae-424b-bcb4-77d6953ea18e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:37.106641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c81c27-6dae-424b-bcb4-77d6953ea18e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:37.107581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c81c27-6dae-424b-bcb4-77d6953ea18e None admin] RBAC: Adding query filter params (role.id=27410223fa7d4717a71ac6753c80420b, scope.project.id=ee1d26f75111496bae034056bc6ed395, user.id=695734af4ebc4c5fbebc32816bddfa23) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:37.108092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c81c27-6dae-424b-bcb4-77d6953ea18e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:37.118186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c81c27-6dae-424b-bcb4-77d6953ea18e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:37.135827 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 85/175] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:36 2022] GET /identity/v3/role_assignments?user.id=695734af4ebc4c5fbebc32816bddfa23&scope.project.id=ee1d26f75111496bae034056bc6ed395&role.id=27410223fa7d4717a71ac6753c80420b => generated 608 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:37.137155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c81c27-6dae-424b-bcb4-77d6953ea18e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:37.192053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb43519-0457-4f0f-848f-250d7b36883e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:37.284650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bfb8e-8988-4ef3-a529-3ff797265111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:37.286170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bfb8e-8988-4ef3-a529-3ff797265111 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:37.288542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bfb8e-8988-4ef3-a529-3ff797265111 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:37.289092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bfb8e-8988-4ef3-a529-3ff797265111 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:37.339439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c81c27-6dae-424b-bcb4-77d6953ea18e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:37.396983 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:37.418283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb6cb6-0524-4ae3-909c-165ad1309243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:37.418932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb6cb6-0524-4ae3-909c-165ad1309243 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:37.419230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb6cb6-0524-4ae3-909c-165ad1309243 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:37.419473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb6cb6-0524-4ae3-909c-165ad1309243 None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:37.423278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bfb8e-8988-4ef3-a529-3ff797265111 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:37.425133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bfb8e-8988-4ef3-a529-3ff797265111 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:37.425460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb6cb6-0524-4ae3-909c-165ad1309243 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d26f75111496bae034056bc6ed395)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:37.426920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb6cb6-0524-4ae3-909c-165ad1309243 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:37.428644 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 86/176] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:37 2022] GET /identity/v3/projects/ee1d26f75111496bae034056bc6ed395 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:37.429875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a9aea-7c90-4499-934d-b3376309fbb9 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:37.430159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a9aea-7c90-4499-934d-b3376309fbb9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:37.430426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a9aea-7c90-4499-934d-b3376309fbb9 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:37.431664 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 87/177] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:37.437627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d362090-ba97-4a0a-905d-78d9a4c6f322 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:37.437949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d362090-ba97-4a0a-905d-78d9a4c6f322 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:37.438167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d362090-ba97-4a0a-905d-78d9a4c6f322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:37.477798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7d362090-ba97-4a0a-905d-78d9a4c6f322 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:37.479676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7d362090-ba97-4a0a-905d-78d9a4c6f322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:37.556327 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:37.564538 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 91/178] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:26:37.570058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bfb8e-8988-4ef3-a529-3ff797265111 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:37.594521 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 88/179] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:26:37.595783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d362090-ba97-4a0a-905d-78d9a4c6f322 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:37.688466 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:37.716188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bfb8e-8988-4ef3-a529-3ff797265111 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:37.729608 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d362090-ba97-4a0a-905d-78d9a4c6f322 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:37.761390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478ed10-dcc9-4c5e-bd56-f223a6a5a046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:37.762445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478ed10-dcc9-4c5e-bd56-f223a6a5a046 None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:37.763062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478ed10-dcc9-4c5e-bd56-f223a6a5a046 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:37.763614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478ed10-dcc9-4c5e-bd56-f223a6a5a046 None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395/users/6b8800a04b8e4b06894439aca530c7c0/roles/81bbb9ae78e14fd6918fa33de9da8bc4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:37.766552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478ed10-dcc9-4c5e-bd56-f223a6a5a046 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee1d26f75111496bae034056bc6ed395, user_id=6b8800a04b8e4b06894439aca530c7c0, role_id=81bbb9ae78e14fd6918fa33de9da8bc4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:37.768783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478ed10-dcc9-4c5e-bd56-f223a6a5a046 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:37.781482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280e97d-3dd2-478c-8440-8239433a4426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:37.782485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280e97d-3dd2-478c-8440-8239433a4426 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:37.782960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280e97d-3dd2-478c-8440-8239433a4426 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:37.783474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280e97d-3dd2-478c-8440-8239433a4426 None admin] PATH_INFO: `/v3/projects/e519a871faf74584853c304a8e793bb6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:37.790917 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 92/180] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:26:37 2022] PUT /identity/v3/projects/ee1d26f75111496bae034056bc6ed395/users/6b8800a04b8e4b06894439aca530c7c0/roles/81bbb9ae78e14fd6918fa33de9da8bc4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:26:37.792839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280e97d-3dd2-478c-8440-8239433a4426 None admin] RBAC: Authorizing `identity:get_project(project_id=e519a871faf74584853c304a8e793bb6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:37.794499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280e97d-3dd2-478c-8440-8239433a4426 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:37.796450 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 89/181] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:37 2022] GET /identity/v3/projects/e519a871faf74584853c304a8e793bb6 => generated 312 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:37.802748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478ed10-dcc9-4c5e-bd56-f223a6a5a046 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:37.960665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478ed10-dcc9-4c5e-bd56-f223a6a5a046 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:38.016642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0186c84-1ecd-4a31-84be-ccfbba54e5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:38.017247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0186c84-1ecd-4a31-84be-ccfbba54e5e0 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:38.017525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0186c84-1ecd-4a31-84be-ccfbba54e5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:38.017793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0186c84-1ecd-4a31-84be-ccfbba54e5e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:38.018532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0186c84-1ecd-4a31-84be-ccfbba54e5e0 None admin] RBAC: Adding query filter params (role.id=f642af7fc1fd472d8f4a4d6f34548ba2, scope.project.id=e519a871faf74584853c304a8e793bb6, user.id=695734af4ebc4c5fbebc32816bddfa23) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:38.018837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0186c84-1ecd-4a31-84be-ccfbba54e5e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:38.020280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0186c84-1ecd-4a31-84be-ccfbba54e5e0 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:38.032056 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 93/182] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:37 2022] GET /identity/v3/role_assignments?user.id=695734af4ebc4c5fbebc32816bddfa23&scope.project.id=e519a871faf74584853c304a8e793bb6&role.id=f642af7fc1fd472d8f4a4d6f34548ba2 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:38.055585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb9b68-6907-44e8-9952-a3580f51d3c2 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:38.056126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb9b68-6907-44e8-9952-a3580f51d3c2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:38.056126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb9b68-6907-44e8-9952-a3580f51d3c2 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:38.057614 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 90/183] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:38.063312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a475764-69e5-4164-91af-0b3743c14aad None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:38.063631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a475764-69e5-4164-91af-0b3743c14aad None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:38.063855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a475764-69e5-4164-91af-0b3743c14aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:38.072121 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:38.085572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1a475764-69e5-4164-91af-0b3743c14aad None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:38.089269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1a475764-69e5-4164-91af-0b3743c14aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:38.112866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66f2b1-5b7f-4029-bf96-0471c2e35ecb None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:38.113197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66f2b1-5b7f-4029-bf96-0471c2e35ecb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:38.113415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66f2b1-5b7f-4029-bf96-0471c2e35ecb None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:38.114952 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 91/184] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:38.120799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209c5e5-7d3c-42d8-b44f-a2c493128f2c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:38.121088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209c5e5-7d3c-42d8-b44f-a2c493128f2c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:38.121375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209c5e5-7d3c-42d8-b44f-a2c493128f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:38.141703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2209c5e5-7d3c-42d8-b44f-a2c493128f2c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:38.143401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2209c5e5-7d3c-42d8-b44f-a2c493128f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:38.181352 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 94/185] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:38.183013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a475764-69e5-4164-91af-0b3743c14aad None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:38.207535 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:38.237404 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 92/186] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:26:38.304594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a475764-69e5-4164-91af-0b3743c14aad None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:38.349245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940d35f-39ba-4b4d-9e41-0d5cb78f3b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:38.349887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940d35f-39ba-4b4d-9e41-0d5cb78f3b66 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:38.350171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940d35f-39ba-4b4d-9e41-0d5cb78f3b66 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:38.350482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940d35f-39ba-4b4d-9e41-0d5cb78f3b66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:38.352396 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:38.365132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940d35f-39ba-4b4d-9e41-0d5cb78f3b66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:38.370671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-c940d35f-39ba-4b4d-9e41-0d5cb78f3b66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:38.370671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:38.370671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:38.370671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:38.370671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:38.370671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:38.370671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:38.370671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:38.370671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:38.370671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:38.370671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:38.370671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:38.370671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:38.370671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:38.370671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:38.370671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:38.371525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:38.371525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:38.371525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:38.371525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:38.371525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:38.371525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:38.371525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:38.371525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:38.371525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:38.371525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:38.371525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:38.371525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:38.371525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:38.371525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:38.371525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:38.371525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:38.372924 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:38.372924 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:38.372924 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:38.372924 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:38.372924 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:38.372924 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:38.372924 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:38.372924 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:38.372924 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:38.372924 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:38.372924 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:38.372924 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:26:38.372924 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 95/187] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:38.377797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209c5e5-7d3c-42d8-b44f-a2c493128f2c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:38.486950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209c5e5-7d3c-42d8-b44f-a2c493128f2c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:38.524908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940d35f-39ba-4b4d-9e41-0d5cb78f3b66 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:38.529932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a8e77-9460-45bb-9d43-8c0bfad46c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:38.529932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a8e77-9460-45bb-9d43-8c0bfad46c65 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:38.529932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a8e77-9460-45bb-9d43-8c0bfad46c65 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:38.529932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a8e77-9460-45bb-9d43-8c0bfad46c65 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:38.530274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a8e77-9460-45bb-9d43-8c0bfad46c65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:38.530274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a8e77-9460-45bb-9d43-8c0bfad46c65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:38.530274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a8e77-9460-45bb-9d43-8c0bfad46c65 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:38.539625 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 93/188] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:38.540535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a8e77-9460-45bb-9d43-8c0bfad46c65 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:38.593048 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:38.650054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940d35f-39ba-4b4d-9e41-0d5cb78f3b66 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:38.661333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a8e77-9460-45bb-9d43-8c0bfad46c65 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:38.687105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab465a9-773f-49f0-b8ed-289c2e73d657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:38.687730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab465a9-773f-49f0-b8ed-289c2e73d657 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:38.688004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab465a9-773f-49f0-b8ed-289c2e73d657 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:38.688272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab465a9-773f-49f0-b8ed-289c2e73d657 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:38.699395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6535759-9a33-4a99-bf4a-f2e58c10e5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:38.699793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab465a9-773f-49f0-b8ed-289c2e73d657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:38.700023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6535759-9a33-4a99-bf4a-f2e58c10e5ad None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:38.700298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6535759-9a33-4a99-bf4a-f2e58c10e5ad None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:38.700567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6535759-9a33-4a99-bf4a-f2e58c10e5ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:38.701691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6535759-9a33-4a99-bf4a-f2e58c10e5ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:38.703118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6535759-9a33-4a99-bf4a-f2e58c10e5ad None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:38.704840 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-cab465a9-773f-49f0-b8ed-289c2e73d657 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:26:38.704840 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:38.704840 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:38.704840 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:38.704840 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:38.704840 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:38.704840 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:38.704840 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:38.704840 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:38.704840 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:38.704840 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:38.704840 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:38.704840 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:38.704840 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:38.704840 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:38.704840 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:38.705962 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:38.705962 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:38.705962 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:38.705962 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:38.705962 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:38.705962 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:38.705962 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:38.705962 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:38.705962 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:38.705962 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:38.705962 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:38.705962 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:38.705962 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:38.705962 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:38.705962 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:38.705962 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:38.706720 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:38.706720 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:38.706720 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:38.706720 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:38.706720 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:38.706720 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:38.706720 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:38.706720 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:38.706720 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:38.706720 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:38.706720 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:26:38.706720 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:26:38.707316 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 94/189] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:38.707316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6535759-9a33-4a99-bf4a-f2e58c10e5ad None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:38.709737 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 96/190] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Sep 30 09:26:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:38.714168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab465a9-773f-49f0-b8ed-289c2e73d657 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:38.774428 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:38.816063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6535759-9a33-4a99-bf4a-f2e58c10e5ad None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:38.822687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab465a9-773f-49f0-b8ed-289c2e73d657 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:38.827486 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:38.853077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368e872-4c94-4726-8094-823ddf7d5ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:38.854236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368e872-4c94-4726-8094-823ddf7d5ea8 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:38.854510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368e872-4c94-4726-8094-823ddf7d5ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:38.854779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368e872-4c94-4726-8094-823ddf7d5ea8 None admin] PATH_INFO: `/v3/users/6a600073d0d547eb9eeef427f461de12` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:38.859073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b516fb5-1afc-4259-862b-c3d730b70368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:38.859674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b516fb5-1afc-4259-862b-c3d730b70368 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:38.859948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b516fb5-1afc-4259-862b-c3d730b70368 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:38.860214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b516fb5-1afc-4259-862b-c3d730b70368 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:38.860882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b516fb5-1afc-4259-862b-c3d730b70368 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:38.862297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b516fb5-1afc-4259-862b-c3d730b70368 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:38.868415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368e872-4c94-4726-8094-823ddf7d5ea8 None admin] RBAC: Authorizing `identity:get_user(user_id=6a600073d0d547eb9eeef427f461de12)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:38.870180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368e872-4c94-4726-8094-823ddf7d5ea8 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:38.871789 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 95/191] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:38 2022] GET /identity/v3/users/6a600073d0d547eb9eeef427f461de12 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:38.873814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368e872-4c94-4726-8094-823ddf7d5ea8 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:38.901078 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 97/192] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Sep 30 09:26:38 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:38.901078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b516fb5-1afc-4259-862b-c3d730b70368 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:39.018899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368e872-4c94-4726-8094-823ddf7d5ea8 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:39.042543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b516fb5-1afc-4259-862b-c3d730b70368 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:39.057656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5247881-15ad-4885-9625-d7b9623e93a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:39.058338 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:39.058437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5247881-15ad-4885-9625-d7b9623e93a1 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:39.058920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5247881-15ad-4885-9625-d7b9623e93a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:39.058920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5247881-15ad-4885-9625-d7b9623e93a1 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:39.059488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5247881-15ad-4885-9625-d7b9623e93a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:39.059845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5247881-15ad-4885-9625-d7b9623e93a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:39.061254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5247881-15ad-4885-9625-d7b9623e93a1 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:39.070491 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 96/193] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:39.077082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5247881-15ad-4885-9625-d7b9623e93a1 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:39.092942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8fdef-4561-4c48-ba1a-216af3d5acdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:39.093563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8fdef-4561-4c48-ba1a-216af3d5acdf None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:39.093845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8fdef-4561-4c48-ba1a-216af3d5acdf None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:39.096966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8fdef-4561-4c48-ba1a-216af3d5acdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:39.115192 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:39.185467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8fdef-4561-4c48-ba1a-216af3d5acdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:39.186945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8fdef-4561-4c48-ba1a-216af3d5acdf None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:39.202173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5247881-15ad-4885-9625-d7b9623e93a1 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:39.240713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401e1ff-09fe-48f5-aea9-8f5134ce3c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:39.241729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401e1ff-09fe-48f5-aea9-8f5134ce3c19 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:39.242204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401e1ff-09fe-48f5-aea9-8f5134ce3c19 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:39.242680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401e1ff-09fe-48f5-aea9-8f5134ce3c19 None admin] PATH_INFO: `/v3/users/6a600073d0d547eb9eeef427f461de12` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:39.244088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401e1ff-09fe-48f5-aea9-8f5134ce3c19 None admin] RBAC: Authorizing `identity:get_user(user_id=6a600073d0d547eb9eeef427f461de12)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:39.246267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401e1ff-09fe-48f5-aea9-8f5134ce3c19 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:39.248152 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 97/194] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:39 2022] GET /identity/v3/users/6a600073d0d547eb9eeef427f461de12 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:39.253747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401e1ff-09fe-48f5-aea9-8f5134ce3c19 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:39.311858 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 98/195] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:26:39.317688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8fdef-4561-4c48-ba1a-216af3d5acdf None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:39.337088 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:39.414244 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:39.420090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401e1ff-09fe-48f5-aea9-8f5134ce3c19 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:39.464121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd5a89-133d-4422-849f-46008ccc7421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:39.465196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd5a89-133d-4422-849f-46008ccc7421 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:39.465676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd5a89-133d-4422-849f-46008ccc7421 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:39.466186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd5a89-133d-4422-849f-46008ccc7421 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:39.488125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8fdef-4561-4c48-ba1a-216af3d5acdf None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:39.563858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae141dce-8c34-445d-82b4-02077ee9534a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:39.564909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae141dce-8c34-445d-82b4-02077ee9534a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:39.565383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae141dce-8c34-445d-82b4-02077ee9534a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:39.565843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae141dce-8c34-445d-82b4-02077ee9534a None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:39.567616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae141dce-8c34-445d-82b4-02077ee9534a None admin] RBAC: Authorizing `identity:get_project(project_id=22150ed8c7364fe3b686c6a086484995)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:39.569282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae141dce-8c34-445d-82b4-02077ee9534a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:39.573961 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 99/196] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:39 2022] GET /identity/v3/projects/22150ed8c7364fe3b686c6a086484995 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:39.581964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae141dce-8c34-445d-82b4-02077ee9534a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:39.593938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd5a89-133d-4422-849f-46008ccc7421 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:39.595718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd5a89-133d-4422-849f-46008ccc7421 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:39.736725 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:39.743720 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 98/197] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:26:39.748415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd5a89-133d-4422-849f-46008ccc7421 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:39.758200 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:39.805285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae141dce-8c34-445d-82b4-02077ee9534a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:39.856500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730a960-1766-430e-bfac-2befa765741b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:39.857980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730a960-1766-430e-bfac-2befa765741b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:39.858506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730a960-1766-430e-bfac-2befa765741b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:39.858988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730a960-1766-430e-bfac-2befa765741b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:39.859961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730a960-1766-430e-bfac-2befa765741b None admin] RBAC: Adding query filter params (role.id=f06b5fed717d4b03a5083dd847274296, scope.project.id=22150ed8c7364fe3b686c6a086484995, user.id=6a600073d0d547eb9eeef427f461de12) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:39.860471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730a960-1766-430e-bfac-2befa765741b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:39.862100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730a960-1766-430e-bfac-2befa765741b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:39.869017 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 100/198] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:39 2022] GET /identity/v3/role_assignments?user.id=6a600073d0d547eb9eeef427f461de12&scope.project.id=22150ed8c7364fe3b686c6a086484995&role.id=f06b5fed717d4b03a5083dd847274296 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:39.952633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd5a89-133d-4422-849f-46008ccc7421 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:40.003711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40416fa-e1e3-47fe-9d17-3ff46c4f0af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:40.004366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40416fa-e1e3-47fe-9d17-3ff46c4f0af2 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:40.004663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40416fa-e1e3-47fe-9d17-3ff46c4f0af2 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:40.004939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40416fa-e1e3-47fe-9d17-3ff46c4f0af2 None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:40.006099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40416fa-e1e3-47fe-9d17-3ff46c4f0af2 None admin] RBAC: Authorizing `identity:get_project(project_id=22150ed8c7364fe3b686c6a086484995)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:40.007564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40416fa-e1e3-47fe-9d17-3ff46c4f0af2 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:40.009259 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 99/199] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:39 2022] GET /identity/v3/projects/22150ed8c7364fe3b686c6a086484995 => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:40.016228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730a960-1766-430e-bfac-2befa765741b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:40.144219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730a960-1766-430e-bfac-2befa765741b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:40.197654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f828931-c4ea-4afb-bb6e-9837e689fa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:40.198729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f828931-c4ea-4afb-bb6e-9837e689fa2f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:40.199197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f828931-c4ea-4afb-bb6e-9837e689fa2f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:40.199662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f828931-c4ea-4afb-bb6e-9837e689fa2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:40.200575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f828931-c4ea-4afb-bb6e-9837e689fa2f None admin] RBAC: Adding query filter params (role.id=27410223fa7d4717a71ac6753c80420b, scope.project.id=22150ed8c7364fe3b686c6a086484995, user.id=6a600073d0d547eb9eeef427f461de12) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:40.201096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f828931-c4ea-4afb-bb6e-9837e689fa2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:40.202725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f828931-c4ea-4afb-bb6e-9837e689fa2f None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:40.214491 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 101/200] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:40 2022] GET /identity/v3/role_assignments?user.id=6a600073d0d547eb9eeef427f461de12&scope.project.id=22150ed8c7364fe3b686c6a086484995&role.id=27410223fa7d4717a71ac6753c80420b => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:40.375421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69468f1e-bcf7-48a6-ac1b-842ea40c05c2 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:40.375902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69468f1e-bcf7-48a6-ac1b-842ea40c05c2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:40.375902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69468f1e-bcf7-48a6-ac1b-842ea40c05c2 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:40.377630 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 100/201] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:40.388343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c5412-2c5e-4bf2-95d2-09b680e0da0c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:40.388651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c5412-2c5e-4bf2-95d2-09b680e0da0c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:40.388981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c5412-2c5e-4bf2-95d2-09b680e0da0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:40.408229 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:40.419145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-af4c5412-2c5e-4bf2-95d2-09b680e0da0c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:40.420328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-af4c5412-2c5e-4bf2-95d2-09b680e0da0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:40.508404 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 102/202] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:40.782469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69468f1e-bcf7-48a6-ac1b-842ea40c05c2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:40.868079 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:40.923312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69468f1e-bcf7-48a6-ac1b-842ea40c05c2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:40.978461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf8f56-dab0-4eb0-aa98-3cd50c447a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:40.979972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf8f56-dab0-4eb0-aa98-3cd50c447a3f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:40.980387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf8f56-dab0-4eb0-aa98-3cd50c447a3f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:40.980683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf8f56-dab0-4eb0-aa98-3cd50c447a3f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:40.993526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf8f56-dab0-4eb0-aa98-3cd50c447a3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:40.998671 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-7baf8f56-dab0-4eb0-aa98-3cd50c447a3f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:26:40.998671 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:40.998671 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:40.998671 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:40.998671 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:40.998671 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:40.998671 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:40.998671 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:40.998671 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:40.998671 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:40.998671 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:40.998671 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:40.998671 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:40.998671 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:40.998671 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:40.998671 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:40.999528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:40.999528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:40.999528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:40.999528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:40.999528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:40.999528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:40.999528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:40.999528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:40.999528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:40.999528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:40.999528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:40.999528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:40.999528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:40.999528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:40.999528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:40.999528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:41.000310 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:41.000310 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:41.000310 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:41.000310 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:41.000310 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:41.000310 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:41.000310 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:41.000310 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:41.000310 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:41.000310 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:41.000310 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:26:41.000310 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:26:41.000310 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 101/203] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:41.006438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c5412-2c5e-4bf2-95d2-09b680e0da0c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:41.130387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c5412-2c5e-4bf2-95d2-09b680e0da0c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:41.171449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd043f-42ce-4d76-b54a-702c08546588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:41.172041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd043f-42ce-4d76-b54a-702c08546588 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:41.172314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd043f-42ce-4d76-b54a-702c08546588 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:41.172580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd043f-42ce-4d76-b54a-702c08546588 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:41.173684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd043f-42ce-4d76-b54a-702c08546588 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:41.173988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd043f-42ce-4d76-b54a-702c08546588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:41.175333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd043f-42ce-4d76-b54a-702c08546588 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:41.189784 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:41.190873 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 103/204] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:26:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:41.195714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf8f56-dab0-4eb0-aa98-3cd50c447a3f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:41.342736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf8f56-dab0-4eb0-aa98-3cd50c447a3f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:41.378334 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:41.391239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafe76a-dcea-440d-8739-59cb0c9eca70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:41.391797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafe76a-dcea-440d-8739-59cb0c9eca70 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:41.392076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafe76a-dcea-440d-8739-59cb0c9eca70 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:41.392346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafe76a-dcea-440d-8739-59cb0c9eca70 None admin] PATH_INFO: `/v3/users/6b8800a04b8e4b06894439aca530c7c0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:41.393515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafe76a-dcea-440d-8739-59cb0c9eca70 None admin] RBAC: Authorizing `identity:get_user(user_id=6b8800a04b8e4b06894439aca530c7c0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:41.394951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafe76a-dcea-440d-8739-59cb0c9eca70 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:41.396695 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 102/205] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:41 2022] GET /identity/v3/users/6b8800a04b8e4b06894439aca530c7c0 => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:41.402731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd043f-42ce-4d76-b54a-702c08546588 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:41.564412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd043f-42ce-4d76-b54a-702c08546588 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:41.613314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6d4ed-123b-4229-b7e8-034274ed88f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:41.613939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6d4ed-123b-4229-b7e8-034274ed88f8 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:41.614219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6d4ed-123b-4229-b7e8-034274ed88f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:41.614491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6d4ed-123b-4229-b7e8-034274ed88f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:41.692954 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:41.696052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6d4ed-123b-4229-b7e8-034274ed88f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:41.697606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6d4ed-123b-4229-b7e8-034274ed88f8 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:41.831196 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 104/206] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:26:41.836810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafe76a-dcea-440d-8739-59cb0c9eca70 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:41.875031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c4de1-5a8b-41c9-9533-379444139d08 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:41.875332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c4de1-5a8b-41c9-9533-379444139d08 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:41.875593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c4de1-5a8b-41c9-9533-379444139d08 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:41.876988 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 105/207] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:41.887831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f965a-c578-4714-92fd-cb952fa81ef3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:41.888410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f965a-c578-4714-92fd-cb952fa81ef3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:41.888968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f965a-c578-4714-92fd-cb952fa81ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:41.909481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-174f965a-c578-4714-92fd-cb952fa81ef3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:41.911051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-174f965a-c578-4714-92fd-cb952fa81ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:41.992622 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 106/208] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:26:42.028709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafe76a-dcea-440d-8739-59cb0c9eca70 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:42.066891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6cb9d-71c8-4aa6-b6e0-82f5844675b4 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:42.067821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6cb9d-71c8-4aa6-b6e0-82f5844675b4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:42.068295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6cb9d-71c8-4aa6-b6e0-82f5844675b4 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:42.069918 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 107/209] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:42.072637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d173042-97a7-4860-a111-526bbad75d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:42.072637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d173042-97a7-4860-a111-526bbad75d52 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:42.072637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d173042-97a7-4860-a111-526bbad75d52 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:42.072637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d173042-97a7-4860-a111-526bbad75d52 None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:42.072949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d173042-97a7-4860-a111-526bbad75d52 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d26f75111496bae034056bc6ed395)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:42.074067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d173042-97a7-4860-a111-526bbad75d52 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:42.075681 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 103/210] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:41 2022] GET /identity/v3/projects/ee1d26f75111496bae034056bc6ed395 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:42.076347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15ad13-3291-4872-9115-2c503f7244c6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:42.076867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15ad13-3291-4872-9115-2c503f7244c6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:42.077384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15ad13-3291-4872-9115-2c503f7244c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:42.086441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d173042-97a7-4860-a111-526bbad75d52 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:42.109215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fa15ad13-3291-4872-9115-2c503f7244c6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:42.111432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fa15ad13-3291-4872-9115-2c503f7244c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:42.152539 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:42.191456 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:42.237009 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 108/211] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:26:42.261384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d173042-97a7-4860-a111-526bbad75d52 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:42.309306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acdc3b-cbab-477d-a4ef-21a418e07695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:42.309920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acdc3b-cbab-477d-a4ef-21a418e07695 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:42.310204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acdc3b-cbab-477d-a4ef-21a418e07695 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:42.310480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acdc3b-cbab-477d-a4ef-21a418e07695 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:42.311216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57acdc3b-cbab-477d-a4ef-21a418e07695 None admin] RBAC: Adding query filter params (role.id=81bbb9ae78e14fd6918fa33de9da8bc4, scope.project.id=ee1d26f75111496bae034056bc6ed395, user.id=6b8800a04b8e4b06894439aca530c7c0) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:42.311526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57acdc3b-cbab-477d-a4ef-21a418e07695 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:42.312994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57acdc3b-cbab-477d-a4ef-21a418e07695 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:42.319469 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 104/212] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:42 2022] GET /identity/v3/role_assignments?user.id=6b8800a04b8e4b06894439aca530c7c0&scope.project.id=ee1d26f75111496bae034056bc6ed395&role.id=81bbb9ae78e14fd6918fa33de9da8bc4 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:42.363489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15ad13-3291-4872-9115-2c503f7244c6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:42.506685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15ad13-3291-4872-9115-2c503f7244c6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:42.553673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acb311-09d0-4d93-b6d7-32116f64a3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:42.554668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acb311-09d0-4d93-b6d7-32116f64a3ed None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:42.555145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acb311-09d0-4d93-b6d7-32116f64a3ed None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:42.555629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acb311-09d0-4d93-b6d7-32116f64a3ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:42.575285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59acb311-09d0-4d93-b6d7-32116f64a3ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:42.580420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-59acb311-09d0-4d93-b6d7-32116f64a3ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:42.580420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:42.580420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:42.580420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:42.580420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:42.580420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:42.580420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:42.580420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:42.580420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:42.580420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:42.580420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:42.580420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:42.580420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:42.580420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:42.580420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:42.580420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:42.581606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:42.581606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:42.581606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:42.581606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:42.581606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:42.581606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:42.581606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:42.581606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:42.581606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:42.581606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:42.581606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:42.581606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:42.581606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:42.581606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:42.581606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:42.581606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:42.582399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:42.582399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:42.582399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:42.582399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:42.582399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:42.582399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:42.582399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:42.582399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:42.582399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:42.582399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:42.582399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:42.582399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:26:42.585933 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 109/213] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:42.592590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acdc3b-cbab-477d-a4ef-21a418e07695 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:42.623504 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acb311-09d0-4d93-b6d7-32116f64a3ed None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:42.670433 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:42.725805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acdc3b-cbab-477d-a4ef-21a418e07695 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:42.765760 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:42.780376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce5da4-54bb-4e33-bc6d-a96fb931172e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:42.781087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce5da4-54bb-4e33-bc6d-a96fb931172e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:42.781363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce5da4-54bb-4e33-bc6d-a96fb931172e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:42.781631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce5da4-54bb-4e33-bc6d-a96fb931172e None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:42.782307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce5da4-54bb-4e33-bc6d-a96fb931172e None admin] RBAC: Adding query filter params (name=member) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:42.782610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce5da4-54bb-4e33-bc6d-a96fb931172e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:42.784000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce5da4-54bb-4e33-bc6d-a96fb931172e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:42.784629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acb311-09d0-4d93-b6d7-32116f64a3ed None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:42.794988 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 105/214] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:26:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:42.796273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518dfdf-6e68-4f1a-b136-a7e09c0b2525 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:42.796802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518dfdf-6e68-4f1a-b136-a7e09c0b2525 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:42.796995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518dfdf-6e68-4f1a-b136-a7e09c0b2525 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:42.802027 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 106/215] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:42.803441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518dfdf-6e68-4f1a-b136-a7e09c0b2525 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:42.821453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ad943-7e92-442f-9a3a-3eb6b5f00d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:42.822028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ad943-7e92-442f-9a3a-3eb6b5f00d2b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:42.823526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ad943-7e92-442f-9a3a-3eb6b5f00d2b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:42.823526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ad943-7e92-442f-9a3a-3eb6b5f00d2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:42.825336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ad943-7e92-442f-9a3a-3eb6b5f00d2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:42.827220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ad943-7e92-442f-9a3a-3eb6b5f00d2b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:42.828821 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 110/216] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:42.829927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09762cf-b0d8-45a6-b14b-ac338c460cff None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:42.830205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09762cf-b0d8-45a6-b14b-ac338c460cff None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:42.830734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09762cf-b0d8-45a6-b14b-ac338c460cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:42.850094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b09762cf-b0d8-45a6-b14b-ac338c460cff None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:42.851254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b09762cf-b0d8-45a6-b14b-ac338c460cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:42.921886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518dfdf-6e68-4f1a-b136-a7e09c0b2525 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:42.939181 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 111/217] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:42.941600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09762cf-b0d8-45a6-b14b-ac338c460cff None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:42.966358 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:42.980189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3cefa-c916-4f10-ad7c-462e5cd52b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:42.981458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3cefa-c916-4f10-ad7c-462e5cd52b9a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:42.982169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3cefa-c916-4f10-ad7c-462e5cd52b9a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:42.983046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3cefa-c916-4f10-ad7c-462e5cd52b9a None admin] PATH_INFO: `/v3/users/f61ace8456f244b1b05fb00524101d6d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:43.006402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3cefa-c916-4f10-ad7c-462e5cd52b9a None admin] RBAC: Authorizing `identity:get_user(user_id=f61ace8456f244b1b05fb00524101d6d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:43.012531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3cefa-c916-4f10-ad7c-462e5cd52b9a None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:43.020462 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 107/218] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:42 2022] GET /identity/v3/users/f61ace8456f244b1b05fb00524101d6d => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:43.021953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3cefa-c916-4f10-ad7c-462e5cd52b9a None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:43.063930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09762cf-b0d8-45a6-b14b-ac338c460cff None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:43.078609 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:43.100052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcbce9-a9c3-44e9-8751-35aa02d4faba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:43.100681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcbce9-a9c3-44e9-8751-35aa02d4faba None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:43.100951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcbce9-a9c3-44e9-8751-35aa02d4faba None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:43.101220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcbce9-a9c3-44e9-8751-35aa02d4faba None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:43.101854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bcbce9-a9c3-44e9-8751-35aa02d4faba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:43.103307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bcbce9-a9c3-44e9-8751-35aa02d4faba None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:43.126660 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 112/219] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Sep 30 09:26:42 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:43.127914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c07984-6d13-4909-9254-f5d4a576a117 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:43.128197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c07984-6d13-4909-9254-f5d4a576a117 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:43.128466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c07984-6d13-4909-9254-f5d4a576a117 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:43.129890 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 113/220] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:43.135986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e6a11-c967-4a1a-ba48-cd7696ca9bf7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:43.136306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e6a11-c967-4a1a-ba48-cd7696ca9bf7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:43.136527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e6a11-c967-4a1a-ba48-cd7696ca9bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:43.143052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3cefa-c916-4f10-ad7c-462e5cd52b9a None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:43.157732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-506e6a11-c967-4a1a-ba48-cd7696ca9bf7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:43.158583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-506e6a11-c967-4a1a-ba48-cd7696ca9bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:43.196289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a9ee5-fa15-4409-b0d7-32a04043a96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:43.197329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a9ee5-fa15-4409-b0d7-32a04043a96b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:43.198114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a9ee5-fa15-4409-b0d7-32a04043a96b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:43.198690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a9ee5-fa15-4409-b0d7-32a04043a96b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:43.243729 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 114/221] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:43.248829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e6a11-c967-4a1a-ba48-cd7696ca9bf7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:43.251492 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:43.290251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a9ee5-fa15-4409-b0d7-32a04043a96b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:43.293920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a9ee5-fa15-4409-b0d7-32a04043a96b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:43.351414 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:43.365540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e6a11-c967-4a1a-ba48-cd7696ca9bf7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:43.405489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b376197-e5df-4b6a-946f-c79f6952b085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:43.406441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b376197-e5df-4b6a-946f-c79f6952b085 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:43.406887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b376197-e5df-4b6a-946f-c79f6952b085 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:43.407296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b376197-e5df-4b6a-946f-c79f6952b085 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:43.419161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b376197-e5df-4b6a-946f-c79f6952b085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:43.420780 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 108/222] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:26:43.423945 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-8b376197-e5df-4b6a-946f-c79f6952b085 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:43.423945 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:43.423945 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:43.423945 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:43.423945 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:43.423945 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:43.423945 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:43.423945 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:43.423945 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:43.423945 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:43.423945 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:43.423945 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:43.423945 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:43.423945 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:43.423945 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:43.423945 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:43.424885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:43.424885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:43.424885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:43.424885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:43.424885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:43.424885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:43.424885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:43.424885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:43.424885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:43.424885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:43.424885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:43.424885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:43.424885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:43.424885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:43.424885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:43.424885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:43.428047 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:43.428047 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:43.428047 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:43.428047 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:43.428047 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:43.428047 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:43.428047 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:43.428047 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:43.428047 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:43.428047 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:43.428047 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:43.428047 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:26:43.428047 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 115/223] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:43.429800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a9ee5-fa15-4409-b0d7-32a04043a96b None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:43.431375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b376197-e5df-4b6a-946f-c79f6952b085 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:43.512366 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:43.560771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a9ee5-fa15-4409-b0d7-32a04043a96b None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:43.567706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b376197-e5df-4b6a-946f-c79f6952b085 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:43.601301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c9409-b9ab-486f-90c5-cfd8b7158dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:43.601993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c9409-b9ab-486f-90c5-cfd8b7158dc9 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:43.602224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c9409-b9ab-486f-90c5-cfd8b7158dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:43.602614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c9409-b9ab-486f-90c5-cfd8b7158dc9 None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:43.603798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c9409-b9ab-486f-90c5-cfd8b7158dc9 None admin] RBAC: Authorizing `identity:get_project(project_id=22150ed8c7364fe3b686c6a086484995)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:43.605281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c9409-b9ab-486f-90c5-cfd8b7158dc9 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:43.606600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1959bd-c970-4d47-b8df-60bb3918aa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:43.607297 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 109/224] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:43 2022] GET /identity/v3/projects/22150ed8c7364fe3b686c6a086484995 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:43.607409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1959bd-c970-4d47-b8df-60bb3918aa3e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:43.607746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1959bd-c970-4d47-b8df-60bb3918aa3e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:43.608066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c9409-b9ab-486f-90c5-cfd8b7158dc9 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:43.608185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1959bd-c970-4d47-b8df-60bb3918aa3e None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:43.608980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1959bd-c970-4d47-b8df-60bb3918aa3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:43.609378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1959bd-c970-4d47-b8df-60bb3918aa3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:43.610834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1959bd-c970-4d47-b8df-60bb3918aa3e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:43.620589 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 116/225] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:43.621402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1959bd-c970-4d47-b8df-60bb3918aa3e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:43.627253 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:43.718118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c9409-b9ab-486f-90c5-cfd8b7158dc9 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:43.757371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1959bd-c970-4d47-b8df-60bb3918aa3e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:43.758002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8669d0-a70f-41fc-82bf-99c3a81058e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:43.758690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8669d0-a70f-41fc-82bf-99c3a81058e4 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:43.759054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8669d0-a70f-41fc-82bf-99c3a81058e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:43.759515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8669d0-a70f-41fc-82bf-99c3a81058e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:43.787597 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8669d0-a70f-41fc-82bf-99c3a81058e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:43.795624 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:43.800124 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-3d8669d0-a70f-41fc-82bf-99c3a81058e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:26:43.800124 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:43.800124 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:43.800124 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:43.800124 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:43.800124 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:43.800124 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:43.800124 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:43.800124 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:43.800124 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:43.800124 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:43.800124 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:43.800124 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:43.800124 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:43.800124 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:43.800124 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:43.801347 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:43.801347 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:43.801347 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:43.801347 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:43.801347 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:43.801347 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:43.801347 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:43.801347 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:43.801347 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:43.801347 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:43.801347 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:43.801347 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:43.801347 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:43.801347 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:43.801347 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:43.801347 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:43.802300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:43.802300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:43.802300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:43.802300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:43.802300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:43.802300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:43.802300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:43.802300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:43.802300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:43.802300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:43.802300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:26:43.802300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:26:43.808666 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 110/226] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Sep 30 09:26:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:43.808666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8669d0-a70f-41fc-82bf-99c3a81058e4 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:43.818452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760b140-a9b8-404d-a7e4-39580a10787d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:43.819330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760b140-a9b8-404d-a7e4-39580a10787d None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:43.819770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760b140-a9b8-404d-a7e4-39580a10787d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:43.820194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760b140-a9b8-404d-a7e4-39580a10787d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:43.821085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760b140-a9b8-404d-a7e4-39580a10787d None admin] RBAC: Adding query filter params (role.id=f642af7fc1fd472d8f4a4d6f34548ba2, scope.project.id=22150ed8c7364fe3b686c6a086484995, user.id=f61ace8456f244b1b05fb00524101d6d) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:43.821526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760b140-a9b8-404d-a7e4-39580a10787d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:43.823685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760b140-a9b8-404d-a7e4-39580a10787d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:43.830494 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 117/227] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:43 2022] GET /identity/v3/role_assignments?user.id=f61ace8456f244b1b05fb00524101d6d&scope.project.id=22150ed8c7364fe3b686c6a086484995&role.id=f642af7fc1fd472d8f4a4d6f34548ba2 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:43.831700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760b140-a9b8-404d-a7e4-39580a10787d None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:44.019773 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:44.024864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760b140-a9b8-404d-a7e4-39580a10787d None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:44.065383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8669d0-a70f-41fc-82bf-99c3a81058e4 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:44.072369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af47f15-8ec2-4686-8025-d1b6b0a217f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:44.073303 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af47f15-8ec2-4686-8025-d1b6b0a217f8 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:44.073771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af47f15-8ec2-4686-8025-d1b6b0a217f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:44.074247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af47f15-8ec2-4686-8025-d1b6b0a217f8 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:44.075628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af47f15-8ec2-4686-8025-d1b6b0a217f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:44.076124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af47f15-8ec2-4686-8025-d1b6b0a217f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:44.078088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af47f15-8ec2-4686-8025-d1b6b0a217f8 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:44.089551 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 118/228] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:44.095806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af47f15-8ec2-4686-8025-d1b6b0a217f8 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:44.125634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fc23e-342d-4aa3-8131-f13f626e1ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:44.128452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fc23e-342d-4aa3-8131-f13f626e1ff6 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:44.128835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fc23e-342d-4aa3-8131-f13f626e1ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:44.129191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fc23e-342d-4aa3-8131-f13f626e1ff6 None admin] PATH_INFO: `/v3/users/6a600073d0d547eb9eeef427f461de12` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:44.131564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009fc23e-342d-4aa3-8131-f13f626e1ff6 None admin] RBAC: Authorizing `identity:get_user(user_id=6a600073d0d547eb9eeef427f461de12)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:44.137406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009fc23e-342d-4aa3-8131-f13f626e1ff6 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:44.139092 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 111/229] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:43 2022] GET /identity/v3/users/6a600073d0d547eb9eeef427f461de12 => generated 283 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:44.144701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fc23e-342d-4aa3-8131-f13f626e1ff6 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:44.155660 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:44.214870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af47f15-8ec2-4686-8025-d1b6b0a217f8 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:44.253045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ed56b-0b0d-426d-a235-f2a6f73881f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:44.254109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ed56b-0b0d-426d-a235-f2a6f73881f5 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:44.254601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ed56b-0b0d-426d-a235-f2a6f73881f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:44.255060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ed56b-0b0d-426d-a235-f2a6f73881f5 None admin] PATH_INFO: `/v3/users/6a600073d0d547eb9eeef427f461de12` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:44.256384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ed56b-0b0d-426d-a235-f2a6f73881f5 None admin] RBAC: Authorizing `identity:get_user(user_id=6a600073d0d547eb9eeef427f461de12)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:44.258909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ed56b-0b0d-426d-a235-f2a6f73881f5 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:44.262062 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 119/230] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:44 2022] GET /identity/v3/users/6a600073d0d547eb9eeef427f461de12 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:44.267558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ed56b-0b0d-426d-a235-f2a6f73881f5 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:44.415908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fc23e-342d-4aa3-8131-f13f626e1ff6 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:44.481684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e700c-1e88-4b00-acf3-036b87faf6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:44.482701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e700c-1e88-4b00-acf3-036b87faf6b9 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:44.483171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e700c-1e88-4b00-acf3-036b87faf6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:44.483631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e700c-1e88-4b00-acf3-036b87faf6b9 None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:44.485216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e700c-1e88-4b00-acf3-036b87faf6b9 None admin] RBAC: Authorizing `identity:get_project(project_id=22150ed8c7364fe3b686c6a086484995)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:44.486890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e700c-1e88-4b00-acf3-036b87faf6b9 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:44.488759 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 112/231] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:44 2022] GET /identity/v3/projects/22150ed8c7364fe3b686c6a086484995 => generated 302 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:44.497460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e700c-1e88-4b00-acf3-036b87faf6b9 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:44.522582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ed56b-0b0d-426d-a235-f2a6f73881f5 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:44.537189 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:44.582145 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:44.661059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e700c-1e88-4b00-acf3-036b87faf6b9 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:44.665288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595a83d-c73d-4d67-a960-c0532d3d3fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:44.665939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595a83d-c73d-4d67-a960-c0532d3d3fa5 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:44.666266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595a83d-c73d-4d67-a960-c0532d3d3fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:44.666536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595a83d-c73d-4d67-a960-c0532d3d3fa5 None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:44.673306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595a83d-c73d-4d67-a960-c0532d3d3fa5 None admin] RBAC: Authorizing `identity:get_project(project_id=22150ed8c7364fe3b686c6a086484995)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:44.674754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595a83d-c73d-4d67-a960-c0532d3d3fa5 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:44.676773 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 120/232] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:44 2022] GET /identity/v3/projects/22150ed8c7364fe3b686c6a086484995 => generated 302 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:44.692118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595a83d-c73d-4d67-a960-c0532d3d3fa5 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:44.702668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cd54a-f515-41f4-8320-21a113046e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:44.703327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cd54a-f515-41f4-8320-21a113046e9e None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:44.703603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cd54a-f515-41f4-8320-21a113046e9e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:44.703871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cd54a-f515-41f4-8320-21a113046e9e None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995/users/6a600073d0d547eb9eeef427f461de12/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:44.706018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7cd54a-f515-41f4-8320-21a113046e9e None admin] RBAC: Authorizing `identity:create_grant(project_id=22150ed8c7364fe3b686c6a086484995, user_id=6a600073d0d547eb9eeef427f461de12, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:44.707441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7cd54a-f515-41f4-8320-21a113046e9e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:44.723819 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 113/233] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:26:44 2022] PUT /identity/v3/projects/22150ed8c7364fe3b686c6a086484995/users/6a600073d0d547eb9eeef427f461de12/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:26:44.825210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595a83d-c73d-4d67-a960-c0532d3d3fa5 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:44.868189 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fe439-0454-4326-9d65-c32f302dc2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:44.868950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fe439-0454-4326-9d65-c32f302dc2f1 None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:44.869279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fe439-0454-4326-9d65-c32f302dc2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:44.869557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fe439-0454-4326-9d65-c32f302dc2f1 None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995/users/6a600073d0d547eb9eeef427f461de12/roles/27410223fa7d4717a71ac6753c80420b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:44.874507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fe439-0454-4326-9d65-c32f302dc2f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=22150ed8c7364fe3b686c6a086484995, user_id=6a600073d0d547eb9eeef427f461de12, role_id=27410223fa7d4717a71ac6753c80420b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:44.875982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fe439-0454-4326-9d65-c32f302dc2f1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:44.907519 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 121/234] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:26:44 2022] PUT /identity/v3/projects/22150ed8c7364fe3b686c6a086484995/users/6a600073d0d547eb9eeef427f461de12/roles/27410223fa7d4717a71ac6753c80420b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:26:45.968381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353b8a0-a662-4dd6-9093-0d0362af5775 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:45.968921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353b8a0-a662-4dd6-9093-0d0362af5775 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:45.969183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353b8a0-a662-4dd6-9093-0d0362af5775 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:45.970776 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 114/235] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:45.976120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cf255-1986-4b8b-a012-4748b98fbacd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:45.976623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cf255-1986-4b8b-a012-4748b98fbacd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:45.976898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cf255-1986-4b8b-a012-4748b98fbacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:45.994792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc32a1-9fe4-4dca-8acf-b993a3372098 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:45.995286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc32a1-9fe4-4dca-8acf-b993a3372098 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:45.995631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc32a1-9fe4-4dca-8acf-b993a3372098 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:45.997785 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 115/236] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:46.003727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d944257-8c75-420c-b77e-ba3b8a8043aa None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:46.004214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d944257-8c75-420c-b77e-ba3b8a8043aa None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:46.004752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d944257-8c75-420c-b77e-ba3b8a8043aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:46.013458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ff5cf255-1986-4b8b-a012-4748b98fbacd None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:46.014661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ff5cf255-1986-4b8b-a012-4748b98fbacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:46.036972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3d944257-8c75-420c-b77e-ba3b8a8043aa None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:46.038777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3d944257-8c75-420c-b77e-ba3b8a8043aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:46.102040 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:46.153843 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 122/237] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:46.167960 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 116/238] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:26:46.168465 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:46.530452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cf255-1986-4b8b-a012-4748b98fbacd None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:46.560857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff14392-1286-40e0-8623-94c82c0df69d None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:46.561172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff14392-1286-40e0-8623-94c82c0df69d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:46.561402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff14392-1286-40e0-8623-94c82c0df69d None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:46.562904 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 117/239] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:46.565044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff14392-1286-40e0-8623-94c82c0df69d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:46.642584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cf255-1986-4b8b-a012-4748b98fbacd None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:46.679426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13103e-fecd-44a3-a522-17e99056b9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:46.680055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13103e-fecd-44a3-a522-17e99056b9f2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:46.680434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13103e-fecd-44a3-a522-17e99056b9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:46.680741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13103e-fecd-44a3-a522-17e99056b9f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:46.689683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff14392-1286-40e0-8623-94c82c0df69d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:46.691837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13103e-fecd-44a3-a522-17e99056b9f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:46.696814 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-7d13103e-fecd-44a3-a522-17e99056b9f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:26:46.696814 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:46.696814 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:46.696814 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:46.696814 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:46.696814 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:46.696814 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:46.696814 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:46.696814 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:46.696814 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:46.696814 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:46.696814 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:46.696814 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:46.696814 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:46.696814 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:46.696814 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:46.698214 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:46.698214 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:46.698214 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:46.698214 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:46.698214 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:46.698214 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:46.698214 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:46.698214 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:46.698214 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:46.698214 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:46.698214 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:46.698214 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:46.698214 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:46.698214 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:46.698214 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:46.698214 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:46.698992 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:46.698992 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:46.698992 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:46.698992 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:46.698992 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:46.698992 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:46.698992 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:46.698992 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:46.698992 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:46.698992 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:46.698992 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:26:46.698992 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:26:46.698992 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 123/240] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:46.700548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d723d8f-70a5-4a2a-947d-402480157c1a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:46.704649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d723d8f-70a5-4a2a-947d-402480157c1a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:46.704950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d723d8f-70a5-4a2a-947d-402480157c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:46.724839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0d723d8f-70a5-4a2a-947d-402480157c1a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:46.726420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0d723d8f-70a5-4a2a-947d-402480157c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:46.732737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cd89e-ffe1-4733-a40c-0a9dc2def809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:46.733441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cd89e-ffe1-4733-a40c-0a9dc2def809 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:46.733899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cd89e-ffe1-4733-a40c-0a9dc2def809 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:46.734178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cd89e-ffe1-4733-a40c-0a9dc2def809 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:46.735290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5cd89e-ffe1-4733-a40c-0a9dc2def809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:46.737047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5cd89e-ffe1-4733-a40c-0a9dc2def809 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:46.738735 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 118/241] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:46.739488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cd89e-ffe1-4733-a40c-0a9dc2def809 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:46.760665 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:46.812838 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 124/242] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:46.813988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d723d8f-70a5-4a2a-947d-402480157c1a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:46.825776 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:46.893611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cd89e-ffe1-4733-a40c-0a9dc2def809 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:46.966527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6478bf4-bd44-4204-935c-91e39ad2a9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:46.967136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6478bf4-bd44-4204-935c-91e39ad2a9d3 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:46.967411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6478bf4-bd44-4204-935c-91e39ad2a9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:46.967679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6478bf4-bd44-4204-935c-91e39ad2a9d3 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:46.968349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6478bf4-bd44-4204-935c-91e39ad2a9d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:46.970207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d723d8f-70a5-4a2a-947d-402480157c1a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:46.971870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6478bf4-bd44-4204-935c-91e39ad2a9d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:46.973289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6478bf4-bd44-4204-935c-91e39ad2a9d3 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:46.990047 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 119/243] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:26:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:46.997828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6478bf4-bd44-4204-935c-91e39ad2a9d3 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:47.039679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5592f4-3eb1-4551-88df-5f92f19a9fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:47.040366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5592f4-3eb1-4551-88df-5f92f19a9fd2 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:47.040626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5592f4-3eb1-4551-88df-5f92f19a9fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:47.040910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5592f4-3eb1-4551-88df-5f92f19a9fd2 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:47.044467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5592f4-3eb1-4551-88df-5f92f19a9fd2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:47.047358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5592f4-3eb1-4551-88df-5f92f19a9fd2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:47.096670 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 125/244] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Sep 30 09:26:46 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:47.125425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5592f4-3eb1-4551-88df-5f92f19a9fd2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:47.177437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6478bf4-bd44-4204-935c-91e39ad2a9d3 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:47.194516 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:47.226615 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:47.235884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db53a8-8cfc-415f-8db7-bbe3465ea93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:47.236531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db53a8-8cfc-415f-8db7-bbe3465ea93c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:47.236892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db53a8-8cfc-415f-8db7-bbe3465ea93c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:47.237165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db53a8-8cfc-415f-8db7-bbe3465ea93c None admin] PATH_INFO: `/v3/users/b33266371b8546a399f5c574f59e0a45` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:47.255467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db53a8-8cfc-415f-8db7-bbe3465ea93c None admin] RBAC: Authorizing `identity:get_user(user_id=b33266371b8546a399f5c574f59e0a45)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:47.257133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db53a8-8cfc-415f-8db7-bbe3465ea93c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:47.258864 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 120/245] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:46 2022] GET /identity/v3/users/b33266371b8546a399f5c574f59e0a45 => generated 297 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:47.264753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db53a8-8cfc-415f-8db7-bbe3465ea93c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:47.343003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5592f4-3eb1-4551-88df-5f92f19a9fd2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:47.386733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21511cb6-2b2b-4cd3-a0da-3abd347b4b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:47.387359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21511cb6-2b2b-4cd3-a0da-3abd347b4b48 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:47.387619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21511cb6-2b2b-4cd3-a0da-3abd347b4b48 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:47.387884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21511cb6-2b2b-4cd3-a0da-3abd347b4b48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:47.400403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21511cb6-2b2b-4cd3-a0da-3abd347b4b48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:47.406509 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-21511cb6-2b2b-4cd3-a0da-3abd347b4b48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:47.406509 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:47.406509 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:47.406509 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:47.406509 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:47.406509 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:47.406509 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:47.406509 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:47.406509 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:47.406509 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:47.406509 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:47.406509 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:47.406509 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:47.406509 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:47.406509 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:47.406509 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:47.407474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:47.407474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:47.407474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:47.407474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:47.407474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:47.407474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:47.407474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:47.407474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:47.407474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:47.407474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:47.407474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:47.407474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:47.407474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:47.407474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:47.407474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:47.407474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:47.409903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:47.409903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:47.409903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:47.409903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:47.409903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:47.409903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:47.409903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:47.409903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:47.409903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:47.409903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:47.409903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:47.409903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:26:47.409903 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 126/246] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:47.411422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db53a8-8cfc-415f-8db7-bbe3465ea93c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:47.416634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21511cb6-2b2b-4cd3-a0da-3abd347b4b48 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:47.454560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f87bb-478f-4ac6-bdad-3035e4976054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:47.455169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f87bb-478f-4ac6-bdad-3035e4976054 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:47.455441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f87bb-478f-4ac6-bdad-3035e4976054 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:47.455956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f87bb-478f-4ac6-bdad-3035e4976054 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:47.530014 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:47.532115 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:47.548194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f87bb-478f-4ac6-bdad-3035e4976054 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:47.549750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f87bb-478f-4ac6-bdad-3035e4976054 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:47.558797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21511cb6-2b2b-4cd3-a0da-3abd347b4b48 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:47.606920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c19272-ea2b-4c6c-8b86-5ec92c70b52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:47.607549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c19272-ea2b-4c6c-8b86-5ec92c70b52c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:47.607824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c19272-ea2b-4c6c-8b86-5ec92c70b52c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:47.608089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c19272-ea2b-4c6c-8b86-5ec92c70b52c None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:47.609095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c19272-ea2b-4c6c-8b86-5ec92c70b52c None admin] RBAC: Adding query filter params (name=member) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:47.609403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c19272-ea2b-4c6c-8b86-5ec92c70b52c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:47.611312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c19272-ea2b-4c6c-8b86-5ec92c70b52c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:47.622818 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 127/247] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:26:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:47.623875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3f86b-d01d-4883-94b1-7b9496c65865 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:47.624153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3f86b-d01d-4883-94b1-7b9496c65865 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:47.624423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3f86b-d01d-4883-94b1-7b9496c65865 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:47.625770 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 128/248] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:47.631010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3f86b-d01d-4883-94b1-7b9496c65865 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:47.691214 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 121/249] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 09:26:47.692806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6bc76-7363-4188-96e8-49342c4b8028 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:47.693285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6bc76-7363-4188-96e8-49342c4b8028 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:47.693747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6bc76-7363-4188-96e8-49342c4b8028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:47.716749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bdc6bc76-7363-4188-96e8-49342c4b8028 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:47.718236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bdc6bc76-7363-4188-96e8-49342c4b8028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:47.765614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3f86b-d01d-4883-94b1-7b9496c65865 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:47.798872 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 122/250] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:47.799969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32df388-afe0-4e64-95ac-44101dbcde62 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:47.804695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32df388-afe0-4e64-95ac-44101dbcde62 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:47.805103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32df388-afe0-4e64-95ac-44101dbcde62 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:47.806413 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 123/251] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:47.807458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32df388-afe0-4e64-95ac-44101dbcde62 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:47.815888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4902a-8cec-4bce-9327-f7d0102cc2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:47.816524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4902a-8cec-4bce-9327-f7d0102cc2f1 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:47.816826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4902a-8cec-4bce-9327-f7d0102cc2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:47.817098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4902a-8cec-4bce-9327-f7d0102cc2f1 None admin] PATH_INFO: `/v3/users/f61ace8456f244b1b05fb00524101d6d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:47.819023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4902a-8cec-4bce-9327-f7d0102cc2f1 None admin] RBAC: Authorizing `identity:get_user(user_id=f61ace8456f244b1b05fb00524101d6d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:47.820470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4902a-8cec-4bce-9327-f7d0102cc2f1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:47.822405 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 129/252] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:47 2022] GET /identity/v3/users/f61ace8456f244b1b05fb00524101d6d => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:47.824102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd79aa7-0f3b-4819-b216-ccf5da9190c8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:47.824386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd79aa7-0f3b-4819-b216-ccf5da9190c8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:47.828849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd79aa7-0f3b-4819-b216-ccf5da9190c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:47.852973 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:47.853156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2fd79aa7-0f3b-4819-b216-ccf5da9190c8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:47.857722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2fd79aa7-0f3b-4819-b216-ccf5da9190c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:47.876986 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:47.986108 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 130/253] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:47.987400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd79aa7-0f3b-4819-b216-ccf5da9190c8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:48.022950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32df388-afe0-4e64-95ac-44101dbcde62 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:48.112401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd19ac-fd39-4891-b286-12db951d9573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:48.113057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd19ac-fd39-4891-b286-12db951d9573 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:48.113333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd19ac-fd39-4891-b286-12db951d9573 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:48.113603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd19ac-fd39-4891-b286-12db951d9573 None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:48.117603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd19ac-fd39-4891-b286-12db951d9573 None admin] RBAC: Authorizing `identity:get_project(project_id=22150ed8c7364fe3b686c6a086484995)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:48.118821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd19ac-fd39-4891-b286-12db951d9573 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:48.121434 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 124/254] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:47 2022] GET /identity/v3/projects/22150ed8c7364fe3b686c6a086484995 => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:48.122249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd19ac-fd39-4891-b286-12db951d9573 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:48.188018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd79aa7-0f3b-4819-b216-ccf5da9190c8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:48.251844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a9db2-75e4-4a40-b625-bdfec2c9cc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:48.254271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a9db2-75e4-4a40-b625-bdfec2c9cc8e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:48.254729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a9db2-75e4-4a40-b625-bdfec2c9cc8e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:48.260000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a9db2-75e4-4a40-b625-bdfec2c9cc8e None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:48.261340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a9db2-75e4-4a40-b625-bdfec2c9cc8e None admin] RBAC: Authorizing `identity:get_project(project_id=22150ed8c7364fe3b686c6a086484995)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:48.262970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a9db2-75e4-4a40-b625-bdfec2c9cc8e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:48.264847 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 131/255] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:47 2022] GET /identity/v3/projects/22150ed8c7364fe3b686c6a086484995 => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:48.267673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a9db2-75e4-4a40-b625-bdfec2c9cc8e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:48.288942 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:48.289791 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:48.313135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd19ac-fd39-4891-b286-12db951d9573 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:48.359069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b332460-4289-4a1a-9c58-84e954bfe3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:48.359700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b332460-4289-4a1a-9c58-84e954bfe3f5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:48.359981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b332460-4289-4a1a-9c58-84e954bfe3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:48.360254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b332460-4289-4a1a-9c58-84e954bfe3f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:48.373087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b332460-4289-4a1a-9c58-84e954bfe3f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:48.378553 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-2b332460-4289-4a1a-9c58-84e954bfe3f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:48.378553 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:48.378553 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:48.378553 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:48.378553 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:48.378553 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:48.378553 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:48.378553 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:48.378553 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:48.378553 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:48.378553 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:48.378553 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:48.378553 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:48.378553 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:48.378553 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:48.378553 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:48.379416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:48.379416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:48.379416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:48.379416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:48.379416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:48.379416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:48.379416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:48.379416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:48.379416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:48.379416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:48.379416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:48.379416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:48.379416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:48.379416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:48.379416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:48.379416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:48.380201 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:48.380201 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:48.380201 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:48.380201 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:48.380201 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:48.380201 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:48.380201 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:48.380201 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:48.380201 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:48.380201 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:48.380201 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:26:48.380201 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:26:48.380201 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 125/256] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:26:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:48.385604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b332460-4289-4a1a-9c58-84e954bfe3f5 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:48.417839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a9db2-75e4-4a40-b625-bdfec2c9cc8e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:48.459606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e45f6-6d96-481f-97f9-7d21087630aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:48.460581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e45f6-6d96-481f-97f9-7d21087630aa None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:48.461095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e45f6-6d96-481f-97f9-7d21087630aa None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:48.461554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e45f6-6d96-481f-97f9-7d21087630aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:48.462486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e45f6-6d96-481f-97f9-7d21087630aa None admin] RBAC: Adding query filter params (role.id=81bbb9ae78e14fd6918fa33de9da8bc4, scope.project.id=22150ed8c7364fe3b686c6a086484995, user.id=b33266371b8546a399f5c574f59e0a45) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:48.463499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e45f6-6d96-481f-97f9-7d21087630aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:48.465148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e45f6-6d96-481f-97f9-7d21087630aa None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:48.472118 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 132/257] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:48 2022] GET /identity/v3/role_assignments?user.id=b33266371b8546a399f5c574f59e0a45&scope.project.id=22150ed8c7364fe3b686c6a086484995&role.id=81bbb9ae78e14fd6918fa33de9da8bc4 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:48.473240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e45f6-6d96-481f-97f9-7d21087630aa None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:48.507581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b332460-4289-4a1a-9c58-84e954bfe3f5 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:48.551175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec6774-313f-4a71-a315-7bf4dca85230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:48.552018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec6774-313f-4a71-a315-7bf4dca85230 None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:48.552492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec6774-313f-4a71-a315-7bf4dca85230 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:48.552970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec6774-313f-4a71-a315-7bf4dca85230 None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995/users/f61ace8456f244b1b05fb00524101d6d/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:48.555215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec6774-313f-4a71-a315-7bf4dca85230 None admin] RBAC: Authorizing `identity:create_grant(project_id=22150ed8c7364fe3b686c6a086484995, user_id=f61ace8456f244b1b05fb00524101d6d, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:48.558256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec6774-313f-4a71-a315-7bf4dca85230 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:48.571101 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:48.592696 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 126/258] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:26:48 2022] PUT /identity/v3/projects/22150ed8c7364fe3b686c6a086484995/users/f61ace8456f244b1b05fb00524101d6d/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:26:48.592696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec6774-313f-4a71-a315-7bf4dca85230 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:48.614977 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:48.629116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e45f6-6d96-481f-97f9-7d21087630aa None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:48.737508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ea170-c752-467a-8ab7-29681847e274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:48.738174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ea170-c752-467a-8ab7-29681847e274 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:48.738457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ea170-c752-467a-8ab7-29681847e274 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:48.738731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ea170-c752-467a-8ab7-29681847e274 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:48.770496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ea170-c752-467a-8ab7-29681847e274 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:48.781445 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-9f3ea170-c752-467a-8ab7-29681847e274 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:26:48.781445 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:48.781445 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:48.781445 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:48.781445 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:48.781445 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:48.781445 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:48.781445 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:48.781445 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:48.781445 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:48.781445 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:48.781445 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:48.781445 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:48.781445 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:48.781445 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:48.781445 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:48.782393 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:48.782393 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:48.782393 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:48.782393 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:48.782393 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:48.782393 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:48.782393 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:48.782393 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:48.782393 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:48.782393 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:48.782393 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:48.782393 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:48.782393 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:48.782393 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:48.782393 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:48.782393 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:48.783265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:48.783265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:48.783265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:48.783265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:48.783265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:48.783265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:48.783265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:48.783265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:48.783265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:48.783265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:48.783265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:26:48.783265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:26:48.783265 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 133/259] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Sep 30 09:26:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:48.789274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ea170-c752-467a-8ab7-29681847e274 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:48.795303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec6774-313f-4a71-a315-7bf4dca85230 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:48.832201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef7445-be3e-4fb9-8b4a-370781439e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:48.833304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef7445-be3e-4fb9-8b4a-370781439e4f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:48.833774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef7445-be3e-4fb9-8b4a-370781439e4f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:48.834237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef7445-be3e-4fb9-8b4a-370781439e4f None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:48.835088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef7445-be3e-4fb9-8b4a-370781439e4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:48.835589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef7445-be3e-4fb9-8b4a-370781439e4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:48.838271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef7445-be3e-4fb9-8b4a-370781439e4f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:48.848254 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 127/260] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:48.854770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef7445-be3e-4fb9-8b4a-370781439e4f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:48.914031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ea170-c752-467a-8ab7-29681847e274 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:48.928993 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:48.962620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef7445-be3e-4fb9-8b4a-370781439e4f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:48.993320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a23d9-197b-49c1-ac41-de23235f3bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:48.993946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a23d9-197b-49c1-ac41-de23235f3bbd None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:48.994885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a23d9-197b-49c1-ac41-de23235f3bbd None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:48.995271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a23d9-197b-49c1-ac41-de23235f3bbd None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:48.996057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a23d9-197b-49c1-ac41-de23235f3bbd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:48.996540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a23d9-197b-49c1-ac41-de23235f3bbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:49.000294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdcfda-94aa-4682-bbee-6f908432f60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:49.000731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a23d9-197b-49c1-ac41-de23235f3bbd None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:49.001419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdcfda-94aa-4682-bbee-6f908432f60a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:49.001888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdcfda-94aa-4682-bbee-6f908432f60a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:49.002346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdcfda-94aa-4682-bbee-6f908432f60a None admin] PATH_INFO: `/v3/users/6a600073d0d547eb9eeef427f461de12` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:49.003381 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:49.003929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdcfda-94aa-4682-bbee-6f908432f60a None admin] RBAC: Authorizing `identity:get_user(user_id=6a600073d0d547eb9eeef427f461de12)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:49.005739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdcfda-94aa-4682-bbee-6f908432f60a None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:49.007979 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 128/261] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:48 2022] GET /identity/v3/users/6a600073d0d547eb9eeef427f461de12 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:49.014193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdcfda-94aa-4682-bbee-6f908432f60a None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:49.022583 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 134/262] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:26:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:49.033613 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a23d9-197b-49c1-ac41-de23235f3bbd None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:49.151645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdcfda-94aa-4682-bbee-6f908432f60a None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:49.180086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a23d9-197b-49c1-ac41-de23235f3bbd None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:49.245993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21e947-974d-4104-93d7-22efcc5417c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:49.246742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21e947-974d-4104-93d7-22efcc5417c3 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:49.246899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21e947-974d-4104-93d7-22efcc5417c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:49.247164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21e947-974d-4104-93d7-22efcc5417c3 None admin] PATH_INFO: `/v3/users/6a600073d0d547eb9eeef427f461de12` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:49.249279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0307e5e-325a-46d5-85b5-f529ce7bb822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:49.249894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0307e5e-325a-46d5-85b5-f529ce7bb822 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:49.250170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0307e5e-325a-46d5-85b5-f529ce7bb822 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:49.250437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0307e5e-325a-46d5-85b5-f529ce7bb822 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:49.252989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21e947-974d-4104-93d7-22efcc5417c3 None admin] RBAC: Authorizing `identity:get_user(user_id=6a600073d0d547eb9eeef427f461de12)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:49.254512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21e947-974d-4104-93d7-22efcc5417c3 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:49.256482 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 135/263] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:49 2022] GET /identity/v3/users/6a600073d0d547eb9eeef427f461de12 => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:49.257588 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:49.261718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21e947-974d-4104-93d7-22efcc5417c3 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:49.383755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0307e5e-325a-46d5-85b5-f529ce7bb822 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:49.385693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0307e5e-325a-46d5-85b5-f529ce7bb822 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:49.388227 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:49.470718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21e947-974d-4104-93d7-22efcc5417c3 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:49.549239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c3a5b-6115-4ce0-8dfc-31235328c679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:49.549856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c3a5b-6115-4ce0-8dfc-31235328c679 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:49.550155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c3a5b-6115-4ce0-8dfc-31235328c679 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:49.550418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c3a5b-6115-4ce0-8dfc-31235328c679 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:49.560154 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 129/264] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:26:49.566061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0307e5e-325a-46d5-85b5-f529ce7bb822 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:49.637816 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:49.718684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c3a5b-6115-4ce0-8dfc-31235328c679 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:49.720146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c3a5b-6115-4ce0-8dfc-31235328c679 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:49.753353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0307e5e-325a-46d5-85b5-f529ce7bb822 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:49.825589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62b0bf-5b5e-42cd-ae19-d62c80366645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:49.826253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62b0bf-5b5e-42cd-ae19-d62c80366645 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:49.826533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62b0bf-5b5e-42cd-ae19-d62c80366645 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:49.826803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62b0bf-5b5e-42cd-ae19-d62c80366645 None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:49.828000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62b0bf-5b5e-42cd-ae19-d62c80366645 None admin] RBAC: Authorizing `identity:get_project(project_id=22150ed8c7364fe3b686c6a086484995)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:49.832622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62b0bf-5b5e-42cd-ae19-d62c80366645 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:49.832622 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 130/265] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:49 2022] GET /identity/v3/projects/22150ed8c7364fe3b686c6a086484995 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:49.838018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62b0bf-5b5e-42cd-ae19-d62c80366645 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:49.898055 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:49.994008 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 136/266] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 733 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:26:49.997275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62b0bf-5b5e-42cd-ae19-d62c80366645 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:50.000979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c3a5b-6115-4ce0-8dfc-31235328c679 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:50.003576 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:50.075007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a37c0-8ff3-44a4-ac55-9b894c6e0d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:50.076050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a37c0-8ff3-44a4-ac55-9b894c6e0d6f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:50.082012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a37c0-8ff3-44a4-ac55-9b894c6e0d6f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:50.082615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a37c0-8ff3-44a4-ac55-9b894c6e0d6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:50.083642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a37c0-8ff3-44a4-ac55-9b894c6e0d6f None admin] RBAC: Adding query filter params (role.id=f06b5fed717d4b03a5083dd847274296, scope.project.id=22150ed8c7364fe3b686c6a086484995, user.id=6a600073d0d547eb9eeef427f461de12) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:50.084177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a37c0-8ff3-44a4-ac55-9b894c6e0d6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:50.085926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a37c0-8ff3-44a4-ac55-9b894c6e0d6f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:50.102364 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 131/267] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:49 2022] GET /identity/v3/role_assignments?user.id=6a600073d0d547eb9eeef427f461de12&scope.project.id=22150ed8c7364fe3b686c6a086484995&role.id=f06b5fed717d4b03a5083dd847274296 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:50.208643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c3a5b-6115-4ce0-8dfc-31235328c679 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:50.267485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76904d3a-bb5d-487e-8cf6-c4a2d51abcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:50.268138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76904d3a-bb5d-487e-8cf6-c4a2d51abcf6 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:50.268399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76904d3a-bb5d-487e-8cf6-c4a2d51abcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:50.268697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76904d3a-bb5d-487e-8cf6-c4a2d51abcf6 None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:50.269848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76904d3a-bb5d-487e-8cf6-c4a2d51abcf6 None admin] RBAC: Authorizing `identity:get_project(project_id=22150ed8c7364fe3b686c6a086484995)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:50.271292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76904d3a-bb5d-487e-8cf6-c4a2d51abcf6 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:50.273204 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 137/268] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:50 2022] GET /identity/v3/projects/22150ed8c7364fe3b686c6a086484995 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:50.280863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a37c0-8ff3-44a4-ac55-9b894c6e0d6f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:50.365604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702581c0-3b55-4470-a0fa-4f930864bee3 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:50.365920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702581c0-3b55-4470-a0fa-4f930864bee3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:50.366156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702581c0-3b55-4470-a0fa-4f930864bee3 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:50.367796 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 138/269] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:50.381704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14865d52-e523-43de-b021-7e32e5637d92 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:50.382109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14865d52-e523-43de-b021-7e32e5637d92 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:50.382278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14865d52-e523-43de-b021-7e32e5637d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:50.425678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-14865d52-e523-43de-b021-7e32e5637d92 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:50.426903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-14865d52-e523-43de-b021-7e32e5637d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:50.448670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a37c0-8ff3-44a4-ac55-9b894c6e0d6f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:50.497934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc739b34-c14c-4f95-8602-88317defb088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:50.498855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc739b34-c14c-4f95-8602-88317defb088 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:50.499491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc739b34-c14c-4f95-8602-88317defb088 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:50.500762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc739b34-c14c-4f95-8602-88317defb088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:50.501827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc739b34-c14c-4f95-8602-88317defb088 None admin] RBAC: Adding query filter params (role.id=27410223fa7d4717a71ac6753c80420b, scope.project.id=22150ed8c7364fe3b686c6a086484995, user.id=6a600073d0d547eb9eeef427f461de12) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:50.503051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc739b34-c14c-4f95-8602-88317defb088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:50.504919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc739b34-c14c-4f95-8602-88317defb088 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:50.506568 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:50.519516 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 132/270] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:50 2022] GET /identity/v3/role_assignments?user.id=6a600073d0d547eb9eeef427f461de12&scope.project.id=22150ed8c7364fe3b686c6a086484995&role.id=27410223fa7d4717a71ac6753c80420b => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:50.584421 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 139/271] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:50.605118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac489d21-c5a3-463c-abe6-6edffb867a77 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:50.605732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac489d21-c5a3-463c-abe6-6edffb867a77 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:50.606231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac489d21-c5a3-463c-abe6-6edffb867a77 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:50.607786 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 133/272] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:50.613725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d9c52-6ac2-4774-abe3-caaa325f7ff2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:50.614015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d9c52-6ac2-4774-abe3-caaa325f7ff2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:50.614268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d9c52-6ac2-4774-abe3-caaa325f7ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:50.634241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ef2d9c52-6ac2-4774-abe3-caaa325f7ff2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:50.635769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ef2d9c52-6ac2-4774-abe3-caaa325f7ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:50.719981 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 140/273] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:50.940455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac489d21-c5a3-463c-abe6-6edffb867a77 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:50.981492 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:51.014790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d9c52-6ac2-4774-abe3-caaa325f7ff2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:51.085756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac489d21-c5a3-463c-abe6-6edffb867a77 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:51.116667 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:51.126986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d9c52-6ac2-4774-abe3-caaa325f7ff2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:51.129776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71700b-e92c-40c7-b348-689d7d66295c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:51.130580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71700b-e92c-40c7-b348-689d7d66295c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:51.131026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71700b-e92c-40c7-b348-689d7d66295c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:51.131533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71700b-e92c-40c7-b348-689d7d66295c None admin] PATH_INFO: `/v3/roles/member` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:51.143624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71700b-e92c-40c7-b348-689d7d66295c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:51.149045 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-fa71700b-e92c-40c7-b348-689d7d66295c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:51.149045 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:51.149045 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:51.149045 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:51.149045 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:51.149045 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:51.149045 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:51.149045 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:51.149045 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:51.149045 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:51.149045 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:51.149045 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:51.149045 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:51.149045 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:51.149045 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:51.149045 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:51.150107 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:51.150107 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:51.150107 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:51.150107 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:51.150107 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:51.150107 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:51.150107 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:51.150107 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:51.150107 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:51.150107 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:51.150107 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:51.150107 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:51.150107 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:51.150107 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:51.150107 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:51.150107 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:51.151341 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:51.151341 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:51.151341 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:51.151341 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:51.151341 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:51.151341 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:51.151341 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:51.151341 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:51.151341 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:51.151341 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:51.151341 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:51.151341 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:26:51.153725 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 134/274] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:51.159664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71700b-e92c-40c7-b348-689d7d66295c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:51.162785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca239e-f4c5-4fb2-83c8-1434c3ebf5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:51.163485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca239e-f4c5-4fb2-83c8-1434c3ebf5ba None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:51.163827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca239e-f4c5-4fb2-83c8-1434c3ebf5ba None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:51.164158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca239e-f4c5-4fb2-83c8-1434c3ebf5ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:51.165325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca239e-f4c5-4fb2-83c8-1434c3ebf5ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:51.167359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca239e-f4c5-4fb2-83c8-1434c3ebf5ba None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:51.169305 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 141/275] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:51.174591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca239e-f4c5-4fb2-83c8-1434c3ebf5ba None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:51.272905 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:51.281077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71700b-e92c-40c7-b348-689d7d66295c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:51.292289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca239e-f4c5-4fb2-83c8-1434c3ebf5ba None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:51.318079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c69157-74a0-415c-bf70-8332623a497e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:51.318918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c69157-74a0-415c-bf70-8332623a497e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:51.319408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c69157-74a0-415c-bf70-8332623a497e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:51.319817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c69157-74a0-415c-bf70-8332623a497e None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:51.320637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c69157-74a0-415c-bf70-8332623a497e None admin] RBAC: Adding query filter params (name=member) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:51.321079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c69157-74a0-415c-bf70-8332623a497e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:51.323102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c69157-74a0-415c-bf70-8332623a497e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:51.337501 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 135/276] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:26:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:51.338867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b689e-9944-499b-8dd0-499c37563535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:51.339259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b689e-9944-499b-8dd0-499c37563535 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:51.339526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b689e-9944-499b-8dd0-499c37563535 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:51.340569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c69157-74a0-415c-bf70-8332623a497e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:51.341162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b689e-9944-499b-8dd0-499c37563535 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:51.341841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b689e-9944-499b-8dd0-499c37563535 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:51.343246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b689e-9944-499b-8dd0-499c37563535 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:51.370542 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 142/277] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Sep 30 09:26:51 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:26:51.471479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c69157-74a0-415c-bf70-8332623a497e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:51.520923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae7fe7-c8d4-45dd-93b9-8da786447a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:51.521566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae7fe7-c8d4-45dd-93b9-8da786447a8f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:51.521839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae7fe7-c8d4-45dd-93b9-8da786447a8f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:51.522103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae7fe7-c8d4-45dd-93b9-8da786447a8f None admin] PATH_INFO: `/v3/users/17607e47542c4f5192a7d8e291130214` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:51.538940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae7fe7-c8d4-45dd-93b9-8da786447a8f None admin] RBAC: Authorizing `identity:get_user(user_id=17607e47542c4f5192a7d8e291130214)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:51.540720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae7fe7-c8d4-45dd-93b9-8da786447a8f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:51.543267 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 136/278] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:51 2022] GET /identity/v3/users/17607e47542c4f5192a7d8e291130214 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:51.553898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b689e-9944-499b-8dd0-499c37563535 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:51.585221 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:51.612911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0105d-9b0f-4477-aec2-bf50ce23dab3 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:51.613207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0105d-9b0f-4477-aec2-bf50ce23dab3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:51.613744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0105d-9b0f-4477-aec2-bf50ce23dab3 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:51.614726 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 137/279] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:51.620456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a53d05-f75a-4f9f-a5a3-fa52329a7430 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:51.620880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a53d05-f75a-4f9f-a5a3-fa52329a7430 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:51.621150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a53d05-f75a-4f9f-a5a3-fa52329a7430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:51.640488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-56a53d05-f75a-4f9f-a5a3-fa52329a7430 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:51.641701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-56a53d05-f75a-4f9f-a5a3-fa52329a7430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:51.651435 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:51.679844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b689e-9944-499b-8dd0-499c37563535 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:51.724839 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 138/280] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:26:51.725017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7b32c-fca2-4183-9ce3-c99077c10a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:51.725017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7b32c-fca2-4183-9ce3-c99077c10a3c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:51.725169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7b32c-fca2-4183-9ce3-c99077c10a3c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:51.725496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7b32c-fca2-4183-9ce3-c99077c10a3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:51.725592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067de24-1437-46ad-9629-082304c69e75 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:51.725779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067de24-1437-46ad-9629-082304c69e75 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:51.726052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067de24-1437-46ad-9629-082304c69e75 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:51.726228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7b32c-fca2-4183-9ce3-c99077c10a3c None admin] RBAC: Adding query filter params (role.id=f642af7fc1fd472d8f4a4d6f34548ba2, user.id=17607e47542c4f5192a7d8e291130214, scope.system=all) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:51.726561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7b32c-fca2-4183-9ce3-c99077c10a3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:51.727439 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 139/281] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:51.727993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7b32c-fca2-4183-9ce3-c99077c10a3c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:51.734990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388ebe3-2927-4703-a412-7b0c0614fb30 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:51.734990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388ebe3-2927-4703-a412-7b0c0614fb30 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:51.734990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388ebe3-2927-4703-a412-7b0c0614fb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:51.735295 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 143/282] 10.222.0.16 () {56 vars in 1308 bytes} [Fri Sep 30 09:26:51 2022] GET /identity/v3/role_assignments?user.id=17607e47542c4f5192a7d8e291130214&scope.system=all&role.id=f642af7fc1fd472d8f4a4d6f34548ba2 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:51.753512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6388ebe3-2927-4703-a412-7b0c0614fb30 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:51.754730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6388ebe3-2927-4703-a412-7b0c0614fb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:51.843888 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 140/283] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:52.016727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7b32c-fca2-4183-9ce3-c99077c10a3c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:52.126659 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:52.132068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388ebe3-2927-4703-a412-7b0c0614fb30 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:52.156673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7b32c-fca2-4183-9ce3-c99077c10a3c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:52.210030 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:52.221043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9943cb-5ca6-47df-984e-72bb68a7b0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:52.221678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9943cb-5ca6-47df-984e-72bb68a7b0bf None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:52.221954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9943cb-5ca6-47df-984e-72bb68a7b0bf None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:52.222453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9943cb-5ca6-47df-984e-72bb68a7b0bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:52.233708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9943cb-5ca6-47df-984e-72bb68a7b0bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:52.240899 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-4d9943cb-5ca6-47df-984e-72bb68a7b0bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:26:52.240899 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:52.240899 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:52.240899 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:52.240899 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:52.240899 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:52.240899 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:52.240899 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:52.240899 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:52.240899 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:52.240899 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:52.240899 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:52.240899 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:52.240899 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:52.240899 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:52.240899 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:52.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:52.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:52.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:52.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:52.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:52.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:52.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:52.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:52.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:52.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:52.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:52.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:52.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:52.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:52.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:52.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:52.242595 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:52.242595 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:52.242595 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:52.242595 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:52.242595 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:52.242595 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:52.242595 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:52.242595 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:52.242595 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:52.242595 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:52.242595 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:26:52.242595 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:26:52.242595 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 144/284] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:52.248632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9943cb-5ca6-47df-984e-72bb68a7b0bf None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:52.254386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388ebe3-2927-4703-a412-7b0c0614fb30 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:52.316625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612e752-1948-45a6-b479-bca21ae6397e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:52.318239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612e752-1948-45a6-b479-bca21ae6397e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:52.319269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612e752-1948-45a6-b479-bca21ae6397e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:52.319887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612e752-1948-45a6-b479-bca21ae6397e None admin] PATH_INFO: `/v3/roles/member` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:52.342567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612e752-1948-45a6-b479-bca21ae6397e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:52.350870 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-a612e752-1948-45a6-b479-bca21ae6397e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:52.350870 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:52.350870 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:52.350870 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:52.350870 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:52.350870 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:52.350870 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:52.350870 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:52.350870 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:52.350870 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:52.350870 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:52.350870 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:52.350870 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:52.350870 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:52.350870 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:52.350870 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:52.351731 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:52.351731 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:52.351731 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:52.351731 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:52.351731 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:52.351731 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:52.351731 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:52.351731 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:52.351731 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:52.351731 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:52.351731 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:52.351731 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:52.351731 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:52.351731 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:52.351731 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:52.351731 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:52.352500 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:52.352500 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:52.352500 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:52.352500 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:52.352500 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:52.352500 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:52.352500 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:52.352500 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:52.352500 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:52.352500 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:52.352500 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:52.352500 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:26:52.355715 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 141/285] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:52.362897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612e752-1948-45a6-b479-bca21ae6397e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:52.475426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9943cb-5ca6-47df-984e-72bb68a7b0bf None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:52.526402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791670fa-b7f1-426d-abf7-56cdc97ec178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:52.526794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791670fa-b7f1-426d-abf7-56cdc97ec178 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:52.527584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791670fa-b7f1-426d-abf7-56cdc97ec178 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:52.527584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791670fa-b7f1-426d-abf7-56cdc97ec178 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:52.528017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791670fa-b7f1-426d-abf7-56cdc97ec178 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:52.528325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791670fa-b7f1-426d-abf7-56cdc97ec178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:52.529729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791670fa-b7f1-426d-abf7-56cdc97ec178 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:52.533758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612e752-1948-45a6-b479-bca21ae6397e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:52.551588 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 145/286] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:26:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:52.557387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791670fa-b7f1-426d-abf7-56cdc97ec178 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:52.561298 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:52.595307 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:52.599284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3bee1-b7af-422a-8f19-5bcf77d39eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:52.599904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3bee1-b7af-422a-8f19-5bcf77d39eaa None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:52.600183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3bee1-b7af-422a-8f19-5bcf77d39eaa None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:52.600460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3bee1-b7af-422a-8f19-5bcf77d39eaa None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:52.601163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3bee1-b7af-422a-8f19-5bcf77d39eaa None admin] RBAC: Adding query filter params (name=member) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:52.601470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3bee1-b7af-422a-8f19-5bcf77d39eaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:52.602849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3bee1-b7af-422a-8f19-5bcf77d39eaa None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:52.620715 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 142/287] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:26:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:52.626566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3bee1-b7af-422a-8f19-5bcf77d39eaa None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:52.747917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791670fa-b7f1-426d-abf7-56cdc97ec178 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:52.790199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3bee1-b7af-422a-8f19-5bcf77d39eaa None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:52.825073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8494af9-4215-4bce-8345-c792b35cc486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:52.825710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8494af9-4215-4bce-8345-c792b35cc486 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:52.825993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8494af9-4215-4bce-8345-c792b35cc486 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:52.826270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8494af9-4215-4bce-8345-c792b35cc486 None admin] PATH_INFO: `/v3/users/b33266371b8546a399f5c574f59e0a45` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:52.828236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee899ee8-8037-4a02-93cb-53dfd6fe1c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:52.829236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee899ee8-8037-4a02-93cb-53dfd6fe1c86 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:52.829714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee899ee8-8037-4a02-93cb-53dfd6fe1c86 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:52.830211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee899ee8-8037-4a02-93cb-53dfd6fe1c86 None admin] PATH_INFO: `/v3/users/f61ace8456f244b1b05fb00524101d6d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:52.831783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee899ee8-8037-4a02-93cb-53dfd6fe1c86 None admin] RBAC: Authorizing `identity:get_user(user_id=f61ace8456f244b1b05fb00524101d6d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:52.833279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8494af9-4215-4bce-8345-c792b35cc486 None admin] RBAC: Authorizing `identity:get_user(user_id=b33266371b8546a399f5c574f59e0a45)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:52.833683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee899ee8-8037-4a02-93cb-53dfd6fe1c86 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:52.834716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8494af9-4215-4bce-8345-c792b35cc486 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:52.835777 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 143/288] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:52 2022] GET /identity/v3/users/f61ace8456f244b1b05fb00524101d6d => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:52.840734 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 146/289] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:52 2022] GET /identity/v3/users/b33266371b8546a399f5c574f59e0a45 => generated 297 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:52.841954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee899ee8-8037-4a02-93cb-53dfd6fe1c86 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:52.857463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8494af9-4215-4bce-8345-c792b35cc486 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:52.923215 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:52.966429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee899ee8-8037-4a02-93cb-53dfd6fe1c86 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:53.001385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c30238-4fe0-4fce-9af6-949f5b576397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:53.002389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c30238-4fe0-4fce-9af6-949f5b576397 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:53.002877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c30238-4fe0-4fce-9af6-949f5b576397 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:53.003346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c30238-4fe0-4fce-9af6-949f5b576397 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:53.070337 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:53.075900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c30238-4fe0-4fce-9af6-949f5b576397 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:53.077650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c30238-4fe0-4fce-9af6-949f5b576397 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:53.117352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8494af9-4215-4bce-8345-c792b35cc486 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:53.146088 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:53.174253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570eec2-43fa-4fb1-b8ae-3dcaee247ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:53.174918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570eec2-43fa-4fb1-b8ae-3dcaee247ffb None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:53.175486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570eec2-43fa-4fb1-b8ae-3dcaee247ffb None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:53.175761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570eec2-43fa-4fb1-b8ae-3dcaee247ffb None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:53.177492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570eec2-43fa-4fb1-b8ae-3dcaee247ffb None admin] RBAC: Authorizing `identity:get_project(project_id=22150ed8c7364fe3b686c6a086484995)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:53.179700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570eec2-43fa-4fb1-b8ae-3dcaee247ffb None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:53.186795 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 147/290] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:52 2022] GET /identity/v3/projects/22150ed8c7364fe3b686c6a086484995 => generated 302 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:53.194458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570eec2-43fa-4fb1-b8ae-3dcaee247ffb None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:53.196519 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 144/291] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 09:26:53.209650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c30238-4fe0-4fce-9af6-949f5b576397 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:53.341376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570eec2-43fa-4fb1-b8ae-3dcaee247ffb None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:53.407733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c30238-4fe0-4fce-9af6-949f5b576397 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:53.411950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1411a72-9172-434a-8fd6-c94f7252a597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:53.412630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1411a72-9172-434a-8fd6-c94f7252a597 None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:53.412910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1411a72-9172-434a-8fd6-c94f7252a597 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:53.413181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1411a72-9172-434a-8fd6-c94f7252a597 None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995/users/b33266371b8546a399f5c574f59e0a45/roles/81bbb9ae78e14fd6918fa33de9da8bc4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:53.421088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1411a72-9172-434a-8fd6-c94f7252a597 None admin] RBAC: Authorizing `identity:create_grant(project_id=22150ed8c7364fe3b686c6a086484995, user_id=b33266371b8546a399f5c574f59e0a45, role_id=81bbb9ae78e14fd6918fa33de9da8bc4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:53.422499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1411a72-9172-434a-8fd6-c94f7252a597 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:53.440914 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:53.443239 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 148/292] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:26:53 2022] PUT /identity/v3/projects/22150ed8c7364fe3b686c6a086484995/users/b33266371b8546a399f5c574f59e0a45/roles/81bbb9ae78e14fd6918fa33de9da8bc4 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:26:53.467627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc110dba-e879-4063-a2ba-3d510fb0ba94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:53.468274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc110dba-e879-4063-a2ba-3d510fb0ba94 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:53.468554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc110dba-e879-4063-a2ba-3d510fb0ba94 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:53.468895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc110dba-e879-4063-a2ba-3d510fb0ba94 None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:53.470071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc110dba-e879-4063-a2ba-3d510fb0ba94 None admin] RBAC: Authorizing `identity:get_project(project_id=22150ed8c7364fe3b686c6a086484995)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:53.471510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc110dba-e879-4063-a2ba-3d510fb0ba94 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:53.473558 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 145/293] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:53 2022] GET /identity/v3/projects/22150ed8c7364fe3b686c6a086484995 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:53.479846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1411a72-9172-434a-8fd6-c94f7252a597 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:53.593789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1411a72-9172-434a-8fd6-c94f7252a597 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:53.630525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccabdf-e13f-4e9a-a9c4-11e868ae4f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:53.631147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccabdf-e13f-4e9a-a9c4-11e868ae4f97 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:53.631426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccabdf-e13f-4e9a-a9c4-11e868ae4f97 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:53.631699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccabdf-e13f-4e9a-a9c4-11e868ae4f97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:53.632432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccabdf-e13f-4e9a-a9c4-11e868ae4f97 None admin] RBAC: Adding query filter params (role.id=f642af7fc1fd472d8f4a4d6f34548ba2, scope.project.id=22150ed8c7364fe3b686c6a086484995, user.id=f61ace8456f244b1b05fb00524101d6d) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:53.632771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccabdf-e13f-4e9a-a9c4-11e868ae4f97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:53.634209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccabdf-e13f-4e9a-a9c4-11e868ae4f97 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:53.641426 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 149/294] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:53 2022] GET /identity/v3/role_assignments?user.id=f61ace8456f244b1b05fb00524101d6d&scope.project.id=22150ed8c7364fe3b686c6a086484995&role.id=f642af7fc1fd472d8f4a4d6f34548ba2 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:54.191114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e9733-4398-4ac3-9bf0-4be416bb5a36 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:54.191450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e9733-4398-4ac3-9bf0-4be416bb5a36 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:54.191644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e9733-4398-4ac3-9bf0-4be416bb5a36 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:54.193245 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 146/295] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:54.201416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919eede-c6a8-4c4c-9a41-5d13155e951c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:54.201703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919eede-c6a8-4c4c-9a41-5d13155e951c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:54.201968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919eede-c6a8-4c4c-9a41-5d13155e951c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:54.222945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3919eede-c6a8-4c4c-9a41-5d13155e951c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:54.224128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3919eede-c6a8-4c4c-9a41-5d13155e951c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:54.248294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b683a90-5beb-4553-b360-94167854ff35 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:54.248669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b683a90-5beb-4553-b360-94167854ff35 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:54.248879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b683a90-5beb-4553-b360-94167854ff35 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:54.250626 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 147/296] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:54.256094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1dbf1-68ff-4292-8f39-a77c927fcb6b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:54.256739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1dbf1-68ff-4292-8f39-a77c927fcb6b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:54.257205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1dbf1-68ff-4292-8f39-a77c927fcb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:54.277846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-54f1dbf1-68ff-4292-8f39-a77c927fcb6b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:54.279473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-54f1dbf1-68ff-4292-8f39-a77c927fcb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:54.311042 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:54.312834 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:54.324101 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 150/297] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:26:54.364857 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 148/298] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:54.368645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f8b8f-1470-4c18-828c-6380ff8b090c None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:54.368645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f8b8f-1470-4c18-828c-6380ff8b090c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:54.368645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f8b8f-1470-4c18-828c-6380ff8b090c None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:54.368645 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 151/299] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:26:54.373349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4e8ef-73f1-4433-b24a-4643df4dbee6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:54.373797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4e8ef-73f1-4433-b24a-4643df4dbee6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:54.374203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4e8ef-73f1-4433-b24a-4643df4dbee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:54.392754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5ae4e8ef-73f1-4433-b24a-4643df4dbee6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:54.394128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5ae4e8ef-73f1-4433-b24a-4643df4dbee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:54.462416 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 149/300] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:54.605100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f8b8f-1470-4c18-828c-6380ff8b090c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:54.655949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4e8ef-73f1-4433-b24a-4643df4dbee6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:54.732047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f8b8f-1470-4c18-828c-6380ff8b090c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:54.756451 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:54.767599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4e8ef-73f1-4433-b24a-4643df4dbee6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:54.767949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c18a8-ac9e-464b-bc83-c30448a1dd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:54.768567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c18a8-ac9e-464b-bc83-c30448a1dd37 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:54.768903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c18a8-ac9e-464b-bc83-c30448a1dd37 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:54.769178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c18a8-ac9e-464b-bc83-c30448a1dd37 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:54.779823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c18a8-ac9e-464b-bc83-c30448a1dd37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:54.784565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-fc7c18a8-ac9e-464b-bc83-c30448a1dd37 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:26:54.784565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:54.784565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:54.784565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:54.784565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:54.784565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:54.784565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:54.784565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:54.784565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:54.784565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:54.784565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:54.784565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:54.784565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:54.784565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:54.784565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:54.784565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:54.785447 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:54.785447 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:54.785447 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:54.785447 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:54.785447 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:54.785447 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:54.785447 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:54.785447 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:54.785447 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:54.785447 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:54.785447 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:54.785447 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:54.785447 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:54.785447 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:54.785447 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:54.785447 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:54.787073 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:54.787073 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:54.787073 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:54.787073 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:54.787073 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:54.787073 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:54.787073 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:54.787073 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:54.787073 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:54.787073 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:54.787073 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:26:54.787073 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:26:54.787073 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 152/301] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:54.787073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c18a8-ac9e-464b-bc83-c30448a1dd37 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:54.809472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb63b0b-9b81-440f-b7e0-31cf549382e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:54.810106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb63b0b-9b81-440f-b7e0-31cf549382e8 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:54.810383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb63b0b-9b81-440f-b7e0-31cf549382e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:54.810652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb63b0b-9b81-440f-b7e0-31cf549382e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:54.820680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb63b0b-9b81-440f-b7e0-31cf549382e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:54.826270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-adb63b0b-9b81-440f-b7e0-31cf549382e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:54.826270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:54.826270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:54.826270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:54.826270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:54.826270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:54.826270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:54.826270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:54.826270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:54.826270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:54.826270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:54.826270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:54.826270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:54.826270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:54.826270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:54.826270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:54.827128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:54.827128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:54.827128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:54.827128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:54.827128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:54.827128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:54.827128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:54.827128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:54.827128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:54.827128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:54.827128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:54.827128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:54.827128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:54.827128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:54.827128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:54.827128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:54.827924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:54.827924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:54.827924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:54.827924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:54.827924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:54.827924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:54.827924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:54.827924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:54.827924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:54.827924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:54.827924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:54.827924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:26:54.832437 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 150/302] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:54.833283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb63b0b-9b81-440f-b7e0-31cf549382e8 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:54.847320 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:54.905044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c18a8-ac9e-464b-bc83-c30448a1dd37 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:54.940018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed0479-2f91-47be-8037-2990d61f63a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:54.940662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed0479-2f91-47be-8037-2990d61f63a8 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:54.940938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed0479-2f91-47be-8037-2990d61f63a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:54.941336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed0479-2f91-47be-8037-2990d61f63a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:54.942606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed0479-2f91-47be-8037-2990d61f63a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:54.944293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed0479-2f91-47be-8037-2990d61f63a8 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:54.945915 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 153/303] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:54.946916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed0479-2f91-47be-8037-2990d61f63a8 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:54.949705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb63b0b-9b81-440f-b7e0-31cf549382e8 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:54.987068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc7b61-5d0b-4801-a265-0f392374643f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:54.987992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc7b61-5d0b-4801-a265-0f392374643f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:54.988526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc7b61-5d0b-4801-a265-0f392374643f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:54.989003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc7b61-5d0b-4801-a265-0f392374643f None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:54.989877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc7b61-5d0b-4801-a265-0f392374643f None admin] RBAC: Adding query filter params (name=reader) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:54.990428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc7b61-5d0b-4801-a265-0f392374643f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:54.992149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc7b61-5d0b-4801-a265-0f392374643f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:55.001606 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 151/304] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:26:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:55.002627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc7b61-5d0b-4801-a265-0f392374643f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:55.019392 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:55.060732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed0479-2f91-47be-8037-2990d61f63a8 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:55.081220 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:55.095949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ee7c4-d128-4714-838a-45cd99df71d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:55.096548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ee7c4-d128-4714-838a-45cd99df71d8 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:55.096854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ee7c4-d128-4714-838a-45cd99df71d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:55.097126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ee7c4-d128-4714-838a-45cd99df71d8 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:55.097785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ee7c4-d128-4714-838a-45cd99df71d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:55.098083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ee7c4-d128-4714-838a-45cd99df71d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:55.099447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ee7c4-d128-4714-838a-45cd99df71d8 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:55.108452 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 154/305] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:26:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:55.109764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ee7c4-d128-4714-838a-45cd99df71d8 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:55.124078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc7b61-5d0b-4801-a265-0f392374643f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:55.157643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73b34f-9baa-441d-869f-c004c061ad9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:55.158243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73b34f-9baa-441d-869f-c004c061ad9b None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:55.158522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73b34f-9baa-441d-869f-c004c061ad9b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:55.158794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73b34f-9baa-441d-869f-c004c061ad9b None admin] PATH_INFO: `/v3/groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:55.159411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73b34f-9baa-441d-869f-c004c061ad9b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:55.160852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73b34f-9baa-441d-869f-c004c061ad9b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:55.177711 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 152/306] 10.222.0.16 () {60 vars in 1134 bytes} [Fri Sep 30 09:26:55 2022] POST /identity/v3/groups => generated 229 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:55.178513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73b34f-9baa-441d-869f-c004c061ad9b None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:55.228287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ee7c4-d128-4714-838a-45cd99df71d8 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:55.276491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c2f51-f97f-4645-8e39-a91a6cd3abdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:55.277902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c2f51-f97f-4645-8e39-a91a6cd3abdf None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:55.278390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c2f51-f97f-4645-8e39-a91a6cd3abdf None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:55.278891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c2f51-f97f-4645-8e39-a91a6cd3abdf None admin] PATH_INFO: `/v3/users/3e9de345ece04a75a7aaa5ba044dcb53` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:55.292585 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:55.297876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c2f51-f97f-4645-8e39-a91a6cd3abdf None admin] RBAC: Authorizing `identity:get_user(user_id=3e9de345ece04a75a7aaa5ba044dcb53)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:55.299767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c2f51-f97f-4645-8e39-a91a6cd3abdf None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:55.309134 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 155/307] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:55 2022] GET /identity/v3/users/3e9de345ece04a75a7aaa5ba044dcb53 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:55.311707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c2f51-f97f-4645-8e39-a91a6cd3abdf None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:55.338462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73b34f-9baa-441d-869f-c004c061ad9b None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:55.368679 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:55.383769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0ac4c-cb6b-495e-91ed-97b03e998b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:55.384391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0ac4c-cb6b-495e-91ed-97b03e998b21 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:55.385207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0ac4c-cb6b-495e-91ed-97b03e998b21 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:55.385475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0ac4c-cb6b-495e-91ed-97b03e998b21 None admin] PATH_INFO: `/v3/users/17607e47542c4f5192a7d8e291130214` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:55.387883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0ac4c-cb6b-495e-91ed-97b03e998b21 None admin] RBAC: Authorizing `identity:get_user(user_id=17607e47542c4f5192a7d8e291130214)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:55.389329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0ac4c-cb6b-495e-91ed-97b03e998b21 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:55.391289 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 153/308] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:55 2022] GET /identity/v3/users/17607e47542c4f5192a7d8e291130214 => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:55.397497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0ac4c-cb6b-495e-91ed-97b03e998b21 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:55.452828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c2f51-f97f-4645-8e39-a91a6cd3abdf None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:55.493580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caea1c1-bf33-428b-98c4-6ade296112f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:55.494218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caea1c1-bf33-428b-98c4-6ade296112f6 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:55.494496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caea1c1-bf33-428b-98c4-6ade296112f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:55.494763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caea1c1-bf33-428b-98c4-6ade296112f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:55.495484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caea1c1-bf33-428b-98c4-6ade296112f6 None admin] RBAC: Adding query filter params (role.id=81bbb9ae78e14fd6918fa33de9da8bc4, user.id=3e9de345ece04a75a7aaa5ba044dcb53, scope.system=all) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:55.496058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caea1c1-bf33-428b-98c4-6ade296112f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:55.498295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caea1c1-bf33-428b-98c4-6ade296112f6 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:55.504136 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 156/309] 10.222.0.16 () {56 vars in 1308 bytes} [Fri Sep 30 09:26:55 2022] GET /identity/v3/role_assignments?user.id=3e9de345ece04a75a7aaa5ba044dcb53&scope.system=all&role.id=81bbb9ae78e14fd6918fa33de9da8bc4 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:55.520953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0ac4c-cb6b-495e-91ed-97b03e998b21 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:55.562144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b34b9-f7cd-4b4b-b745-4b45448ac394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:55.562720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b34b9-f7cd-4b4b-b745-4b45448ac394 None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:55.562995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b34b9-f7cd-4b4b-b745-4b45448ac394 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:55.563264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b34b9-f7cd-4b4b-b745-4b45448ac394 None admin] PATH_INFO: `/v3/system/users/17607e47542c4f5192a7d8e291130214/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:55.564930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b34b9-f7cd-4b4b-b745-4b45448ac394 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=17607e47542c4f5192a7d8e291130214, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:55.566429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b34b9-f7cd-4b4b-b745-4b45448ac394 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:55.581556 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 154/310] 10.222.0.16 () {58 vars in 1334 bytes} [Fri Sep 30 09:26:55 2022] PUT /identity/v3/system/users/17607e47542c4f5192a7d8e291130214/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:26:56.010446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b11401-f21e-4135-8aec-5a0ff7890311 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:56.010967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b11401-f21e-4135-8aec-5a0ff7890311 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:56.010967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b11401-f21e-4135-8aec-5a0ff7890311 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:56.012549 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 157/311] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:56.018137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbeedad-9ebd-4b04-aca8-6869a6113d6f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:56.018427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbeedad-9ebd-4b04-aca8-6869a6113d6f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:56.018699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbeedad-9ebd-4b04-aca8-6869a6113d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:56.027874 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:56.038915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2bbeedad-9ebd-4b04-aca8-6869a6113d6f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:56.041676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2bbeedad-9ebd-4b04-aca8-6869a6113d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:56.113209 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 155/312] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:56.385842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b11401-f21e-4135-8aec-5a0ff7890311 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:56.495528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b11401-f21e-4135-8aec-5a0ff7890311 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:56.497896 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:56.533627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d40ce8-c379-4aef-b741-9ebb7854e4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:56.534261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d40ce8-c379-4aef-b741-9ebb7854e4d5 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:56.534534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d40ce8-c379-4aef-b741-9ebb7854e4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:56.534803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d40ce8-c379-4aef-b741-9ebb7854e4d5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:56.545912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d40ce8-c379-4aef-b741-9ebb7854e4d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:56.550845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-46d40ce8-c379-4aef-b741-9ebb7854e4d5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:26:56.550845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:56.550845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:56.550845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:56.550845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:56.550845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:56.550845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:56.550845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:56.550845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:56.550845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:56.550845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:56.550845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:56.550845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:56.550845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:56.550845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:56.550845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:56.551719 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:56.551719 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:56.551719 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:56.551719 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:56.551719 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:56.551719 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:56.551719 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:56.551719 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:56.551719 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:56.551719 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:56.551719 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:56.551719 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:56.551719 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:56.551719 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:56.551719 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:56.551719 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:56.552506 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:56.552506 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:56.552506 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:56.552506 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:56.552506 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:56.552506 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:56.552506 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:56.552506 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:56.552506 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:56.552506 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:56.552506 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:26:56.552506 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:26:56.557108 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 158/313] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:56.558828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbeedad-9ebd-4b04-aca8-6869a6113d6f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:56.663841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbeedad-9ebd-4b04-aca8-6869a6113d6f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:56.699855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043f60d-188b-40f6-a427-2ed436c1c70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:56.700457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043f60d-188b-40f6-a427-2ed436c1c70c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:56.700767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043f60d-188b-40f6-a427-2ed436c1c70c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:56.701039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043f60d-188b-40f6-a427-2ed436c1c70c None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:56.701701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043f60d-188b-40f6-a427-2ed436c1c70c None admin] RBAC: Adding query filter params (name=reader) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:56.702005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043f60d-188b-40f6-a427-2ed436c1c70c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:56.703362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043f60d-188b-40f6-a427-2ed436c1c70c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:56.704741 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:56.712418 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 156/314] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:26:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:56.719265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d40ce8-c379-4aef-b741-9ebb7854e4d5 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:56.823290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d40ce8-c379-4aef-b741-9ebb7854e4d5 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:56.857931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d3565-ff29-4773-8c68-3d8134953760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:56.858558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d3565-ff29-4773-8c68-3d8134953760 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:56.858835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d3565-ff29-4773-8c68-3d8134953760 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:56.859105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d3565-ff29-4773-8c68-3d8134953760 None admin] PATH_INFO: `/v3/users/b33266371b8546a399f5c574f59e0a45` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:56.860252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d3565-ff29-4773-8c68-3d8134953760 None admin] RBAC: Authorizing `identity:get_user(user_id=b33266371b8546a399f5c574f59e0a45)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:56.861775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d3565-ff29-4773-8c68-3d8134953760 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:56.863743 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 159/315] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:56 2022] GET /identity/v3/users/b33266371b8546a399f5c574f59e0a45 => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:56.869850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043f60d-188b-40f6-a427-2ed436c1c70c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:56.995518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043f60d-188b-40f6-a427-2ed436c1c70c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:57.031983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322b4bf-f43c-428e-9380-02712460d2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:57.032611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322b4bf-f43c-428e-9380-02712460d2de None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:57.032900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322b4bf-f43c-428e-9380-02712460d2de None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:57.033167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322b4bf-f43c-428e-9380-02712460d2de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:57.101987 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:57.105525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322b4bf-f43c-428e-9380-02712460d2de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:57.107004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322b4bf-f43c-428e-9380-02712460d2de None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:57.208962 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 157/316] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:26:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:26:57.215128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d3565-ff29-4773-8c68-3d8134953760 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:57.248922 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:57.326557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d3565-ff29-4773-8c68-3d8134953760 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:57.362067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff548dc-3ffd-4651-a0b4-174ba7be0122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:57.362701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff548dc-3ffd-4651-a0b4-174ba7be0122 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:57.362983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff548dc-3ffd-4651-a0b4-174ba7be0122 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:57.363258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff548dc-3ffd-4651-a0b4-174ba7be0122 None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:57.364427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff548dc-3ffd-4651-a0b4-174ba7be0122 None admin] RBAC: Authorizing `identity:get_project(project_id=22150ed8c7364fe3b686c6a086484995)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:57.365989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff548dc-3ffd-4651-a0b4-174ba7be0122 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:57.367897 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 160/317] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:26:57 2022] GET /identity/v3/projects/22150ed8c7364fe3b686c6a086484995 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:57.374601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322b4bf-f43c-428e-9380-02712460d2de None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:57.481544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322b4bf-f43c-428e-9380-02712460d2de None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:57.484836 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:57.517825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df89c6-c1aa-45d1-958c-91809c0765af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:57.518439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df89c6-c1aa-45d1-958c-91809c0765af None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:57.518704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df89c6-c1aa-45d1-958c-91809c0765af None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:57.518968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df89c6-c1aa-45d1-958c-91809c0765af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:57.519697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df89c6-c1aa-45d1-958c-91809c0765af None admin] RBAC: Adding query filter params (role.id=81bbb9ae78e14fd6918fa33de9da8bc4, scope.project.id=22150ed8c7364fe3b686c6a086484995, user.id=b33266371b8546a399f5c574f59e0a45) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:57.519999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df89c6-c1aa-45d1-958c-91809c0765af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:57.521442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df89c6-c1aa-45d1-958c-91809c0765af None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:57.532715 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 158/318] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:26:57 2022] GET /identity/v3/role_assignments?user.id=b33266371b8546a399f5c574f59e0a45&scope.project.id=22150ed8c7364fe3b686c6a086484995&role.id=81bbb9ae78e14fd6918fa33de9da8bc4 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:57.542068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea35e66-8199-46b6-ae02-898cd139ef78 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:57.542397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea35e66-8199-46b6-ae02-898cd139ef78 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:57.542598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea35e66-8199-46b6-ae02-898cd139ef78 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:57.544092 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 161/319] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:57.550551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f915f-ac8a-4514-b825-5470bac26711 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:57.550863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f915f-ac8a-4514-b825-5470bac26711 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:57.551092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f915f-ac8a-4514-b825-5470bac26711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:57.571861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-863f915f-ac8a-4514-b825-5470bac26711 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:57.573349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-863f915f-ac8a-4514-b825-5470bac26711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:57.655001 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 159/320] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:57.708991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9110d-852a-4f56-8568-080a2874a1f2 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:57.709333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9110d-852a-4f56-8568-080a2874a1f2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:57.709519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9110d-852a-4f56-8568-080a2874a1f2 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:57.711127 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 162/321] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:57.717864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53311d-9f73-4ac6-85e8-723072314512 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:57.718146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53311d-9f73-4ac6-85e8-723072314512 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:57.718405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53311d-9f73-4ac6-85e8-723072314512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:57.738101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1a53311d-9f73-4ac6-85e8-723072314512 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:57.739198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1a53311d-9f73-4ac6-85e8-723072314512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:57.807064 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 160/322] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:26:57.929505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9110d-852a-4f56-8568-080a2874a1f2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:57.977767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd4566-0b40-4430-89ea-43eca853b201 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:57.978063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd4566-0b40-4430-89ea-43eca853b201 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:57.978346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd4566-0b40-4430-89ea-43eca853b201 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:57.979856 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 161/323] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:26:57.985061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684ecd1-f652-44c1-b43a-26b6b961fcca None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:57.985351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684ecd1-f652-44c1-b43a-26b6b961fcca None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:57.985627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684ecd1-f652-44c1-b43a-26b6b961fcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:58.004742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1684ecd1-f652-44c1-b43a-26b6b961fcca None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:26:58.005904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1684ecd1-f652-44c1-b43a-26b6b961fcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:26:58.023973 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:58.039346 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:58.045087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9110d-852a-4f56-8568-080a2874a1f2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:58.081795 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 162/324] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:26:58.082625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684ecd1-f652-44c1-b43a-26b6b961fcca None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:58.085436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e439d4b-93d3-46a8-b108-419cdd9569ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:58.086130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e439d4b-93d3-46a8-b108-419cdd9569ea None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:58.086409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e439d4b-93d3-46a8-b108-419cdd9569ea None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:58.086674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e439d4b-93d3-46a8-b108-419cdd9569ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:58.087822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e439d4b-93d3-46a8-b108-419cdd9569ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:58.089255 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e439d4b-93d3-46a8-b108-419cdd9569ea None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:58.093074 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 163/325] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:26:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:26:58.096962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e439d4b-93d3-46a8-b108-419cdd9569ea None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:58.188665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684ecd1-f652-44c1-b43a-26b6b961fcca None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:58.204433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e439d4b-93d3-46a8-b108-419cdd9569ea None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:58.223554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1e915-6f53-44a2-af5b-c34a850dd0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:58.224169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1e915-6f53-44a2-af5b-c34a850dd0aa None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:58.224442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1e915-6f53-44a2-af5b-c34a850dd0aa None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:58.224735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1e915-6f53-44a2-af5b-c34a850dd0aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:58.234743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1e915-6f53-44a2-af5b-c34a850dd0aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:58.239552 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-d2e1e915-6f53-44a2-af5b-c34a850dd0aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:26:58.239552 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:58.239552 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:58.239552 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:58.239552 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:58.239552 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:58.239552 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:58.239552 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:58.239552 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:58.239552 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:58.239552 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:58.239552 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:58.239552 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:58.239552 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:58.239552 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:58.239552 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:58.240414 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:58.240414 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:58.240414 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:58.240414 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:58.240414 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:58.240414 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:58.240414 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:58.240414 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:58.240414 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:58.240414 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:58.240414 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:58.240414 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:58.240414 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:58.240414 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:58.240414 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:58.240414 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:58.241534 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:58.241534 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:58.241534 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:58.241534 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:58.241534 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:58.241534 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:58.241534 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:58.241534 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:58.241534 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:58.241534 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:58.241534 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:26:58.241534 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:26:58.242126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e533476-9a99-4478-83d3-280db2a1f2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:58.242126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e533476-9a99-4478-83d3-280db2a1f2d2 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:58.242126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e533476-9a99-4478-83d3-280db2a1f2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:58.242647 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 163/326] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:26:58.244757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e533476-9a99-4478-83d3-280db2a1f2d2 None admin] PATH_INFO: `/v3/groups` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:58.245431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e533476-9a99-4478-83d3-280db2a1f2d2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:58.246911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e533476-9a99-4478-83d3-280db2a1f2d2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:58.247052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1e915-6f53-44a2-af5b-c34a850dd0aa None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:58.259663 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:58.265122 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 164/327] 10.222.0.16 () {60 vars in 1134 bytes} [Fri Sep 30 09:26:58 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:26:58.357829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1e915-6f53-44a2-af5b-c34a850dd0aa None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:58.359983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e533476-9a99-4478-83d3-280db2a1f2d2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:58.393006 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:58.396205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43050471-f38b-4fa4-acc7-3061a224a2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:58.396858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43050471-f38b-4fa4-acc7-3061a224a2d3 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:58.397144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43050471-f38b-4fa4-acc7-3061a224a2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:58.397418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43050471-f38b-4fa4-acc7-3061a224a2d3 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:58.398110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43050471-f38b-4fa4-acc7-3061a224a2d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:58.398498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43050471-f38b-4fa4-acc7-3061a224a2d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:58.399808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43050471-f38b-4fa4-acc7-3061a224a2d3 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:58.411722 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 164/328] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:26:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:58.418338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43050471-f38b-4fa4-acc7-3061a224a2d3 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:58.480004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e533476-9a99-4478-83d3-280db2a1f2d2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:58.501455 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:58.517413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad447cd-b10f-46d0-8247-5391f3af48d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:58.518367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad447cd-b10f-46d0-8247-5391f3af48d0 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:58.518798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad447cd-b10f-46d0-8247-5391f3af48d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:58.519077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad447cd-b10f-46d0-8247-5391f3af48d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:58.531667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad447cd-b10f-46d0-8247-5391f3af48d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:26:58.537055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-aad447cd-b10f-46d0-8247-5391f3af48d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:58.537055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:26:58.537055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:26:58.537055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:26:58.537055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:26:58.537055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:26:58.537055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:26:58.537055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:26:58.537055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:26:58.537055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:26:58.537055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:26:58.537055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:26:58.537055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:26:58.537055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:26:58.537055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:26:58.537055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:26:58.538034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:26:58.538034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:26:58.538034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:26:58.538034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:26:58.538034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:26:58.538034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:26:58.538034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:26:58.538034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:26:58.538034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:26:58.538034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:26:58.538034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:26:58.538034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:26:58.538034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:26:58.538034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:26:58.538034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:26:58.538034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:26:58.538823 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:26:58.538823 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:26:58.538823 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:26:58.538823 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:26:58.538823 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:26:58.538823 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:26:58.538823 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:26:58.538823 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:26:58.538823 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:26:58.538823 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:26:58.538823 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:26:58.538823 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:26:58.538823 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 165/329] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:26:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:26:58.544087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43050471-f38b-4fa4-acc7-3061a224a2d3 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:58.544789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad447cd-b10f-46d0-8247-5391f3af48d0 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:58.593963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296190f-17fc-4b61-8d8f-91308acd83fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:58.594657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296190f-17fc-4b61-8d8f-91308acd83fd None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:58.594860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296190f-17fc-4b61-8d8f-91308acd83fd None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:58.595132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296190f-17fc-4b61-8d8f-91308acd83fd None admin] PATH_INFO: `/v3/users/3e9de345ece04a75a7aaa5ba044dcb53` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:58.598075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296190f-17fc-4b61-8d8f-91308acd83fd None admin] RBAC: Authorizing `identity:get_user(user_id=3e9de345ece04a75a7aaa5ba044dcb53)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:58.598601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296190f-17fc-4b61-8d8f-91308acd83fd None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:58.600380 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 165/330] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:58 2022] GET /identity/v3/users/3e9de345ece04a75a7aaa5ba044dcb53 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:58.606535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296190f-17fc-4b61-8d8f-91308acd83fd None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:58.671303 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:58.688753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad447cd-b10f-46d0-8247-5391f3af48d0 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:58.741264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f953a-5f45-4514-b0e7-8166b9eadcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:58.741874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f953a-5f45-4514-b0e7-8166b9eadcd2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:58.742153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f953a-5f45-4514-b0e7-8166b9eadcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:58.742422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f953a-5f45-4514-b0e7-8166b9eadcd2 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:58.743152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f953a-5f45-4514-b0e7-8166b9eadcd2 None admin] RBAC: Adding query filter params (name=member) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:58.743457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f953a-5f45-4514-b0e7-8166b9eadcd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:58.745025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f953a-5f45-4514-b0e7-8166b9eadcd2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:58.745791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296190f-17fc-4b61-8d8f-91308acd83fd None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:58.758488 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 166/331] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:26:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:58.765678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f953a-5f45-4514-b0e7-8166b9eadcd2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:58.789129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f50bb-7bdf-48d0-a5f2-b1ecb6b04d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:58.790093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f50bb-7bdf-48d0-a5f2-b1ecb6b04d1c None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:58.790581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f50bb-7bdf-48d0-a5f2-b1ecb6b04d1c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:58.791656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f50bb-7bdf-48d0-a5f2-b1ecb6b04d1c None admin] PATH_INFO: `/v3/system/users/3e9de345ece04a75a7aaa5ba044dcb53/roles/81bbb9ae78e14fd6918fa33de9da8bc4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:58.793543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f50bb-7bdf-48d0-a5f2-b1ecb6b04d1c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3e9de345ece04a75a7aaa5ba044dcb53, role_id=81bbb9ae78e14fd6918fa33de9da8bc4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:58.795139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f50bb-7bdf-48d0-a5f2-b1ecb6b04d1c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:58.808831 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 166/332] 10.222.0.16 () {58 vars in 1334 bytes} [Fri Sep 30 09:26:58 2022] PUT /identity/v3/system/users/3e9de345ece04a75a7aaa5ba044dcb53/roles/81bbb9ae78e14fd6918fa33de9da8bc4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:26:58.895955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f953a-5f45-4514-b0e7-8166b9eadcd2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:58.946884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34d79d-0488-4592-8fac-b7dcd53b102d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:58.947891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34d79d-0488-4592-8fac-b7dcd53b102d None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:58.948345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34d79d-0488-4592-8fac-b7dcd53b102d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:58.948815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34d79d-0488-4592-8fac-b7dcd53b102d None admin] PATH_INFO: `/v3/users/17607e47542c4f5192a7d8e291130214` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:58.950240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34d79d-0488-4592-8fac-b7dcd53b102d None admin] RBAC: Authorizing `identity:get_user(user_id=17607e47542c4f5192a7d8e291130214)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:58.951995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34d79d-0488-4592-8fac-b7dcd53b102d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:58.954108 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 167/333] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:26:58 2022] GET /identity/v3/users/17607e47542c4f5192a7d8e291130214 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:26:58.960632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f50bb-7bdf-48d0-a5f2-b1ecb6b04d1c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:26:58.966378 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:26:59.080231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f50bb-7bdf-48d0-a5f2-b1ecb6b04d1c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:26:59.121882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e2ee5-5d24-4375-aaf6-24c686d370dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:26:59.122490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e2ee5-5d24-4375-aaf6-24c686d370dd None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:26:59.122827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e2ee5-5d24-4375-aaf6-24c686d370dd None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:26:59.123097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e2ee5-5d24-4375-aaf6-24c686d370dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:26:59.123849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e2ee5-5d24-4375-aaf6-24c686d370dd None admin] RBAC: Adding query filter params (role.id=f642af7fc1fd472d8f4a4d6f34548ba2, user.id=17607e47542c4f5192a7d8e291130214, scope.system=all) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:26:59.124154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e2ee5-5d24-4375-aaf6-24c686d370dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:26:59.125635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e2ee5-5d24-4375-aaf6-24c686d370dd None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:26:59.138994 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 167/334] 10.222.0.16 () {56 vars in 1308 bytes} [Fri Sep 30 09:26:58 2022] GET /identity/v3/role_assignments?user.id=17607e47542c4f5192a7d8e291130214&scope.system=all&role.id=f642af7fc1fd472d8f4a4d6f34548ba2 => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:00.761707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566d6f1-9f24-4960-ad87-2ec447471008 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:00.762696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566d6f1-9f24-4960-ad87-2ec447471008 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:00.763196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566d6f1-9f24-4960-ad87-2ec447471008 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:00.765056 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 168/335] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:00.770107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b175e7-1fec-4833-956d-f2ed518102c5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:00.770918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b175e7-1fec-4833-956d-f2ed518102c5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:00.771387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b175e7-1fec-4833-956d-f2ed518102c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:00.797633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-80b175e7-1fec-4833-956d-f2ed518102c5 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:00.799305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-80b175e7-1fec-4833-956d-f2ed518102c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:00.867582 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:00.882966 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 168/336] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:01.199277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22382e80-19f8-46c9-ae05-925edda2e3c5 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:01.199470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22382e80-19f8-46c9-ae05-925edda2e3c5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:01.199732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22382e80-19f8-46c9-ae05-925edda2e3c5 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:01.201366 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 169/337] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:01.207017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f4e39-14fe-4e81-9331-8ebb35d1d978 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:01.207298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f4e39-14fe-4e81-9331-8ebb35d1d978 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:01.207569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f4e39-14fe-4e81-9331-8ebb35d1d978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:01.237664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-698f4e39-14fe-4e81-9331-8ebb35d1d978 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:01.238886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-698f4e39-14fe-4e81-9331-8ebb35d1d978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:01.326928 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 169/338] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:01.381241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22382e80-19f8-46c9-ae05-925edda2e3c5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:01.402295 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:01.499083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22382e80-19f8-46c9-ae05-925edda2e3c5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:01.540269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9028f8a-9281-4e62-aa2a-5d7fb5d48022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:01.541870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9028f8a-9281-4e62-aa2a-5d7fb5d48022 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:01.542194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9028f8a-9281-4e62-aa2a-5d7fb5d48022 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:01.542556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9028f8a-9281-4e62-aa2a-5d7fb5d48022 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:01.555537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9028f8a-9281-4e62-aa2a-5d7fb5d48022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:01.561197 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-d9028f8a-9281-4e62-aa2a-5d7fb5d48022 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:27:01.561197 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:01.561197 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:01.561197 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:01.561197 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:01.561197 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:01.561197 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:01.561197 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:01.561197 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:01.561197 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:01.561197 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:01.561197 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:01.561197 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:01.561197 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:01.561197 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:01.561197 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:01.562122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:01.562122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:01.562122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:01.562122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:01.562122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:01.562122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:01.562122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:01.562122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:01.562122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:01.562122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:01.562122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:01.562122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:01.562122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:01.562122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:01.562122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:01.562122 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:01.562907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:01.562907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:01.562907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:01.562907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:01.562907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:01.562907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:01.562907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:01.562907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:01.562907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:01.562907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:01.562907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:27:01.562907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:01.562907 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 170/339] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:01.568364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f4e39-14fe-4e81-9331-8ebb35d1d978 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:01.689434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f4e39-14fe-4e81-9331-8ebb35d1d978 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:01.714775 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:01.729229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae061674-42fc-47fb-84b2-9ddffb6c9bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:01.729967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae061674-42fc-47fb-84b2-9ddffb6c9bc5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:01.730242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae061674-42fc-47fb-84b2-9ddffb6c9bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:01.730506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae061674-42fc-47fb-84b2-9ddffb6c9bc5 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:01.731178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae061674-42fc-47fb-84b2-9ddffb6c9bc5 None admin] RBAC: Adding query filter params (name=member) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:01.731473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae061674-42fc-47fb-84b2-9ddffb6c9bc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:01.732856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae061674-42fc-47fb-84b2-9ddffb6c9bc5 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:01.745067 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 170/340] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:27:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:01.750910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9028f8a-9281-4e62-aa2a-5d7fb5d48022 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:01.755443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae061674-42fc-47fb-84b2-9ddffb6c9bc5 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:01.914544 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:01.937157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae061674-42fc-47fb-84b2-9ddffb6c9bc5 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:01.975188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9028f8a-9281-4e62-aa2a-5d7fb5d48022 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:02.003507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4956f35-b7b4-4fdb-a5a5-169a3fc9834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:02.004204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4956f35-b7b4-4fdb-a5a5-169a3fc9834b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:02.004484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4956f35-b7b4-4fdb-a5a5-169a3fc9834b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:02.004792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4956f35-b7b4-4fdb-a5a5-169a3fc9834b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:02.024418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4956f35-b7b4-4fdb-a5a5-169a3fc9834b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:02.031587 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-e4956f35-b7b4-4fdb-a5a5-169a3fc9834b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:27:02.031587 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:02.031587 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:02.031587 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:02.031587 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:02.031587 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:02.031587 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:02.031587 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:02.031587 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:02.031587 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:02.031587 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:02.031587 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:02.031587 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:02.031587 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:02.031587 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:02.031587 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:02.032784 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:02.032784 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:02.032784 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:02.032784 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:02.032784 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:02.032784 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:02.032784 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:02.032784 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:02.032784 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:02.032784 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:02.032784 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:02.032784 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:02.032784 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:02.032784 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:02.032784 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:02.032784 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:02.033593 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:02.033593 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:02.033593 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:02.033593 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:02.033593 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:02.033593 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:02.033593 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:02.033593 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:02.033593 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:02.033593 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:02.033593 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:27:02.033593 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:02.035867 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 171/341] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Sep 30 09:27:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:02.042928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4956f35-b7b4-4fdb-a5a5-169a3fc9834b None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:02.045847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174ff0b-f623-45b6-9e69-ef024534c78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:02.046735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174ff0b-f623-45b6-9e69-ef024534c78a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:02.047264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174ff0b-f623-45b6-9e69-ef024534c78a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:02.047542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174ff0b-f623-45b6-9e69-ef024534c78a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:02.124996 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:02.162875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174ff0b-f623-45b6-9e69-ef024534c78a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:02.164422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174ff0b-f623-45b6-9e69-ef024534c78a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:02.190923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4956f35-b7b4-4fdb-a5a5-169a3fc9834b None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:02.231700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2ff65-2b93-4195-a366-c01d3edc7dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:02.232713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2ff65-2b93-4195-a366-c01d3edc7dc8 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:02.233353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2ff65-2b93-4195-a366-c01d3edc7dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:02.233860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2ff65-2b93-4195-a366-c01d3edc7dc8 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:02.234754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2ff65-2b93-4195-a366-c01d3edc7dc8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:02.235254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2ff65-2b93-4195-a366-c01d3edc7dc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:02.236826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2ff65-2b93-4195-a366-c01d3edc7dc8 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:02.251207 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 172/342] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:02.253790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c609dc-8909-491c-8447-1ec053e26d8f None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:02.254509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c609dc-8909-491c-8447-1ec053e26d8f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:02.255207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c609dc-8909-491c-8447-1ec053e26d8f None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:02.257115 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:02.257355 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 173/343] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:02.259318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714700e-5d0d-4a81-aebe-cf2f9a6664bc None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:02.260492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714700e-5d0d-4a81-aebe-cf2f9a6664bc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:02.261156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714700e-5d0d-4a81-aebe-cf2f9a6664bc None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:02.262602 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 174/344] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:02.263531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714700e-5d0d-4a81-aebe-cf2f9a6664bc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:02.285698 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 171/345] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:27:02.287144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9810ed2-6a00-4288-86d3-8cc7ebd6fd5f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:02.287563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9810ed2-6a00-4288-86d3-8cc7ebd6fd5f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:02.287944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9810ed2-6a00-4288-86d3-8cc7ebd6fd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:02.311519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d9810ed2-6a00-4288-86d3-8cc7ebd6fd5f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:02.316290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d9810ed2-6a00-4288-86d3-8cc7ebd6fd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:02.397873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714700e-5d0d-4a81-aebe-cf2f9a6664bc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:02.406067 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 172/346] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:02.408703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faaa49-126d-48c1-b930-6b77f2672a5d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:02.408703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faaa49-126d-48c1-b930-6b77f2672a5d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:02.408703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faaa49-126d-48c1-b930-6b77f2672a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:02.409456 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:02.433199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-84faaa49-126d-48c1-b930-6b77f2672a5d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:02.434745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-84faaa49-126d-48c1-b930-6b77f2672a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:02.455901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eca8a3-e19c-4a23-b2a0-48448b65f984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:02.457138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eca8a3-e19c-4a23-b2a0-48448b65f984 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:02.457762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eca8a3-e19c-4a23-b2a0-48448b65f984 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:02.459101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eca8a3-e19c-4a23-b2a0-48448b65f984 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:02.552986 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 173/347] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:02.554469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84faaa49-126d-48c1-b930-6b77f2672a5d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:02.608022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eca8a3-e19c-4a23-b2a0-48448b65f984 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:02.609977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eca8a3-e19c-4a23-b2a0-48448b65f984 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:02.613296 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:02.741948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84faaa49-126d-48c1-b930-6b77f2672a5d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:02.787137 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 175/348] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:27:02.796931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eca8a3-e19c-4a23-b2a0-48448b65f984 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:02.810783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6b29b-fcb5-4295-bcec-995c36b8a2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:02.811447 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:02.812976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6b29b-fcb5-4295-bcec-995c36b8a2c0 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:02.813455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6b29b-fcb5-4295-bcec-995c36b8a2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:02.813934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6b29b-fcb5-4295-bcec-995c36b8a2c0 None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:02.820847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6b29b-fcb5-4295-bcec-995c36b8a2c0 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d26f75111496bae034056bc6ed395)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:02.822862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6b29b-fcb5-4295-bcec-995c36b8a2c0 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:02.824801 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 174/349] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:02 2022] GET /identity/v3/projects/ee1d26f75111496bae034056bc6ed395 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:02.825812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6b29b-fcb5-4295-bcec-995c36b8a2c0 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:02.971292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eca8a3-e19c-4a23-b2a0-48448b65f984 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:03.044171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6b29b-fcb5-4295-bcec-995c36b8a2c0 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:03.045514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa736d54-49d2-4cb0-9bea-bf82d6bf94de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:03.046429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa736d54-49d2-4cb0-9bea-bf82d6bf94de None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:03.046922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa736d54-49d2-4cb0-9bea-bf82d6bf94de None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:03.047385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa736d54-49d2-4cb0-9bea-bf82d6bf94de None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:03.049305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa736d54-49d2-4cb0-9bea-bf82d6bf94de None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d26f75111496bae034056bc6ed395)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:03.050951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa736d54-49d2-4cb0-9bea-bf82d6bf94de None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:03.053434 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:03.057856 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 176/350] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:02 2022] GET /identity/v3/projects/ee1d26f75111496bae034056bc6ed395 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:03.058948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa736d54-49d2-4cb0-9bea-bf82d6bf94de None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:03.098903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e9751-05f9-4933-9178-87a9fd892699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:03.099888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e9751-05f9-4933-9178-87a9fd892699 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:03.100308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e9751-05f9-4933-9178-87a9fd892699 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:03.100777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e9751-05f9-4933-9178-87a9fd892699 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:03.121054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e9751-05f9-4933-9178-87a9fd892699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:03.126189 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-525e9751-05f9-4933-9178-87a9fd892699 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:27:03.126189 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:03.126189 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:03.126189 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:03.126189 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:03.126189 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:03.126189 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:03.126189 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:03.126189 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:03.126189 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:03.126189 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:03.126189 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:03.126189 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:03.126189 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:03.126189 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:03.126189 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:03.127292 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:03.127292 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:03.127292 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:03.127292 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:03.127292 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:03.127292 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:03.127292 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:03.127292 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:03.127292 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:03.127292 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:03.127292 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:03.127292 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:03.127292 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:03.127292 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:03.127292 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:03.127292 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:03.128118 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:03.128118 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:03.128118 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:03.128118 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:03.128118 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:03.128118 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:03.128118 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:03.128118 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:03.128118 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:03.128118 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:03.128118 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:27:03.128118 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:03.128118 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 175/351] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:03.129475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e9751-05f9-4933-9178-87a9fd892699 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:03.182308 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:03.219919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa736d54-49d2-4cb0-9bea-bf82d6bf94de None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:03.262731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2c1e1-52ab-4ef5-a8e8-40e5571cb705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:03.263595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2c1e1-52ab-4ef5-a8e8-40e5571cb705 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:03.264010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2c1e1-52ab-4ef5-a8e8-40e5571cb705 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:03.264144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e9751-05f9-4933-9178-87a9fd892699 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:03.264537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2c1e1-52ab-4ef5-a8e8-40e5571cb705 None admin] PATH_INFO: `/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:03.272388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2c1e1-52ab-4ef5-a8e8-40e5571cb705 None admin] RBAC: Authorizing `identity:get_group(group_id=dc6a69c1b2c84b519486bb9b211a29b3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:03.273868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2c1e1-52ab-4ef5-a8e8-40e5571cb705 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:03.276057 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 177/352] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Sep 30 09:27:03 2022] GET /identity/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:03.277908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2c1e1-52ab-4ef5-a8e8-40e5571cb705 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:03.316542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16679ec2-ee55-48b9-bb91-d3ac0b48802a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:03.317358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16679ec2-ee55-48b9-bb91-d3ac0b48802a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:03.317945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16679ec2-ee55-48b9-bb91-d3ac0b48802a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:03.318381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16679ec2-ee55-48b9-bb91-d3ac0b48802a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:03.333601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16679ec2-ee55-48b9-bb91-d3ac0b48802a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:03.340846 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-16679ec2-ee55-48b9-bb91-d3ac0b48802a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:27:03.340846 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:03.340846 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:03.340846 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:03.340846 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:03.340846 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:03.340846 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:03.340846 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:03.340846 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:03.340846 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:03.340846 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:03.340846 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:03.340846 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:03.340846 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:03.340846 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:03.340846 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:03.342155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:03.342155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:03.342155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:03.342155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:03.342155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:03.342155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:03.342155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:03.342155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:03.342155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:03.342155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:03.342155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:03.342155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:03.342155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:03.342155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:03.342155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:03.342155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:03.342969 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:03.342969 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:03.342969 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:03.342969 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:03.342969 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:03.342969 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:03.342969 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:03.342969 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:03.342969 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:03.342969 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:03.342969 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 09:27:03.342969 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:03.342969 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 176/353] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:03.342969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16679ec2-ee55-48b9-bb91-d3ac0b48802a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:03.374393 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:03.416625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2c1e1-52ab-4ef5-a8e8-40e5571cb705 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:03.468227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242f3c8-8863-4664-840c-9e5b26185c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:03.470551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242f3c8-8863-4664-840c-9e5b26185c5e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:03.470551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242f3c8-8863-4664-840c-9e5b26185c5e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:03.470551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242f3c8-8863-4664-840c-9e5b26185c5e None admin] PATH_INFO: `/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:03.471390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242f3c8-8863-4664-840c-9e5b26185c5e None admin] RBAC: Authorizing `identity:get_group(group_id=dc6a69c1b2c84b519486bb9b211a29b3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:03.473374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242f3c8-8863-4664-840c-9e5b26185c5e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:03.475405 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 178/354] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Sep 30 09:27:03 2022] GET /identity/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:03.476852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17910fbe-db3e-4837-9b7d-0621fde47278 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:03.477275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17910fbe-db3e-4837-9b7d-0621fde47278 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:03.477662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17910fbe-db3e-4837-9b7d-0621fde47278 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:03.478892 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 179/355] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:03.479581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17910fbe-db3e-4837-9b7d-0621fde47278 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:03.485449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16679ec2-ee55-48b9-bb91-d3ac0b48802a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:03.490842 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:03.528860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce56a9b-cb5c-444b-8a46-03ff85d96630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:03.529480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce56a9b-cb5c-444b-8a46-03ff85d96630 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:03.529762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce56a9b-cb5c-444b-8a46-03ff85d96630 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:03.530032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce56a9b-cb5c-444b-8a46-03ff85d96630 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:03.530706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce56a9b-cb5c-444b-8a46-03ff85d96630 None admin] RBAC: Adding query filter params (name=member) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:03.531009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce56a9b-cb5c-444b-8a46-03ff85d96630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:03.532378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce56a9b-cb5c-444b-8a46-03ff85d96630 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:03.542864 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 177/356] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:27:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:03.543635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce56a9b-cb5c-444b-8a46-03ff85d96630 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:03.611870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17910fbe-db3e-4837-9b7d-0621fde47278 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:03.649921 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:03.660465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c159153-ae47-4677-9f8e-e104734b30c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:03.661258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c159153-ae47-4677-9f8e-e104734b30c8 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:03.661534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c159153-ae47-4677-9f8e-e104734b30c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:03.662095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c159153-ae47-4677-9f8e-e104734b30c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:03.662842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c159153-ae47-4677-9f8e-e104734b30c8 None admin] RBAC: Adding query filter params (group.id=dc6a69c1b2c84b519486bb9b211a29b3, role.id=f642af7fc1fd472d8f4a4d6f34548ba2, scope.project.id=ee1d26f75111496bae034056bc6ed395) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:03.663148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c159153-ae47-4677-9f8e-e104734b30c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:03.664530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce56a9b-cb5c-444b-8a46-03ff85d96630 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:03.664678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c159153-ae47-4677-9f8e-e104734b30c8 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:03.671379 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 180/357] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Sep 30 09:27:03 2022] GET /identity/v3/role_assignments?group.id=dc6a69c1b2c84b519486bb9b211a29b3&scope.project.id=ee1d26f75111496bae034056bc6ed395&role.id=f642af7fc1fd472d8f4a4d6f34548ba2 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:03.672188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c159153-ae47-4677-9f8e-e104734b30c8 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:03.711043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4cd62-1f5a-4de1-a83f-dad4c7c717c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:03.711941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4cd62-1f5a-4de1-a83f-dad4c7c717c4 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:03.712375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4cd62-1f5a-4de1-a83f-dad4c7c717c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:03.712804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4cd62-1f5a-4de1-a83f-dad4c7c717c4 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:03.714000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4cd62-1f5a-4de1-a83f-dad4c7c717c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:03.714299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4cd62-1f5a-4de1-a83f-dad4c7c717c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:03.715738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4cd62-1f5a-4de1-a83f-dad4c7c717c4 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:03.729243 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 178/358] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:27:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:03.729243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13069226-a191-42b2-8215-e86b40ff0d82 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:03.729243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13069226-a191-42b2-8215-e86b40ff0d82 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:03.729243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13069226-a191-42b2-8215-e86b40ff0d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:03.749361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-13069226-a191-42b2-8215-e86b40ff0d82 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:03.750579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-13069226-a191-42b2-8215-e86b40ff0d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:03.781580 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:03.826662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c159153-ae47-4677-9f8e-e104734b30c8 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:03.848749 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 179/359] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:03.850094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13069226-a191-42b2-8215-e86b40ff0d82 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:03.879706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bac6a8-be62-473e-aa32-b4c6488c720b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:03.880315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bac6a8-be62-473e-aa32-b4c6488c720b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:03.880590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bac6a8-be62-473e-aa32-b4c6488c720b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:03.880888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bac6a8-be62-473e-aa32-b4c6488c720b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:03.881615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bac6a8-be62-473e-aa32-b4c6488c720b None admin] RBAC: Adding query filter params (group.id=dc6a69c1b2c84b519486bb9b211a29b3, role.id=27410223fa7d4717a71ac6753c80420b, scope.project.id=ee1d26f75111496bae034056bc6ed395) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:03.881917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bac6a8-be62-473e-aa32-b4c6488c720b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:03.883335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bac6a8-be62-473e-aa32-b4c6488c720b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:03.890626 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 181/360] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Sep 30 09:27:03 2022] GET /identity/v3/role_assignments?group.id=dc6a69c1b2c84b519486bb9b211a29b3&scope.project.id=ee1d26f75111496bae034056bc6ed395&role.id=27410223fa7d4717a71ac6753c80420b => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:03.891843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506cba8-e144-4daf-a27b-fa88bfdb636e None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:03.892119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506cba8-e144-4daf-a27b-fa88bfdb636e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:03.892386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506cba8-e144-4daf-a27b-fa88bfdb636e None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:03.894280 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 182/361] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:03.894806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506cba8-e144-4daf-a27b-fa88bfdb636e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:03.988286 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:04.038202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13069226-a191-42b2-8215-e86b40ff0d82 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:04.099019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506cba8-e144-4daf-a27b-fa88bfdb636e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:04.126430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d06d3-14ad-48e3-92db-d704706b019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:04.127084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d06d3-14ad-48e3-92db-d704706b019e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:04.127326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d06d3-14ad-48e3-92db-d704706b019e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:04.127596 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d06d3-14ad-48e3-92db-d704706b019e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:04.163727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8d462-0a9a-443e-9614-503741f2edee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:04.164388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8d462-0a9a-443e-9614-503741f2edee None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:04.164709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8d462-0a9a-443e-9614-503741f2edee None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:04.164984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8d462-0a9a-443e-9614-503741f2edee None admin] PATH_INFO: `/v3/users/3e9de345ece04a75a7aaa5ba044dcb53` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:04.166459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8d462-0a9a-443e-9614-503741f2edee None admin] RBAC: Authorizing `identity:get_user(user_id=3e9de345ece04a75a7aaa5ba044dcb53)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:04.167848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8d462-0a9a-443e-9614-503741f2edee None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:04.169497 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 183/362] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:27:03 2022] GET /identity/v3/users/3e9de345ece04a75a7aaa5ba044dcb53 => generated 293 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:04.172649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b40c1-ec80-4b84-98cd-1583c349c4b7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:04.172649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b40c1-ec80-4b84-98cd-1583c349c4b7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:04.172649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b40c1-ec80-4b84-98cd-1583c349c4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:04.177508 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:04.197165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-480b40c1-ec80-4b84-98cd-1583c349c4b7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:04.198427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-480b40c1-ec80-4b84-98cd-1583c349c4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:04.221580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d06d3-14ad-48e3-92db-d704706b019e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:04.223402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d06d3-14ad-48e3-92db-d704706b019e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:04.271652 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 184/363] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:04.272646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b40c1-ec80-4b84-98cd-1583c349c4b7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:04.313768 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:04.340113 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 180/364] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:27:04.341426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d06d3-14ad-48e3-92db-d704706b019e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:04.394930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b40c1-ec80-4b84-98cd-1583c349c4b7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:04.448539 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:04.454980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4e6c9-bb20-4462-89be-bfdb1bdf600c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:04.455604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4e6c9-bb20-4462-89be-bfdb1bdf600c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:04.455886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4e6c9-bb20-4462-89be-bfdb1bdf600c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:04.456414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4e6c9-bb20-4462-89be-bfdb1bdf600c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:04.457183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4e6c9-bb20-4462-89be-bfdb1bdf600c None admin] RBAC: Adding query filter params (role.id=81bbb9ae78e14fd6918fa33de9da8bc4, user.id=3e9de345ece04a75a7aaa5ba044dcb53, scope.system=all) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:04.457496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4e6c9-bb20-4462-89be-bfdb1bdf600c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:04.461171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4e6c9-bb20-4462-89be-bfdb1bdf600c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:04.484461 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 185/365] 10.222.0.16 () {56 vars in 1308 bytes} [Fri Sep 30 09:27:04 2022] GET /identity/v3/role_assignments?user.id=3e9de345ece04a75a7aaa5ba044dcb53&scope.system=all&role.id=81bbb9ae78e14fd6918fa33de9da8bc4 => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:04.486657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4e6c9-bb20-4462-89be-bfdb1bdf600c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:04.506845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d06d3-14ad-48e3-92db-d704706b019e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:04.574094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32863d0-96ad-484c-bf07-819b344cae57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:04.575265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32863d0-96ad-484c-bf07-819b344cae57 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:04.575744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32863d0-96ad-484c-bf07-819b344cae57 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:04.576208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32863d0-96ad-484c-bf07-819b344cae57 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:04.597335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32863d0-96ad-484c-bf07-819b344cae57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:04.602915 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-c32863d0-96ad-484c-bf07-819b344cae57 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:27:04.602915 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:04.602915 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:04.602915 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:04.602915 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:04.602915 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:04.602915 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:04.602915 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:04.602915 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:04.602915 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:04.602915 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:04.602915 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:04.602915 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:04.602915 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:04.602915 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:04.602915 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:04.604414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:04.604414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:04.604414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:04.604414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:04.604414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:04.604414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:04.604414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:04.604414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:04.604414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:04.604414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:04.604414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:04.604414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:04.604414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:04.604414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:04.604414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:04.604414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:04.605247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:04.605247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:04.605247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:04.605247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:04.605247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:04.605247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:04.605247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:04.605247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:04.605247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:04.605247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:04.605247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:27:04.605247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:04.607878 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 181/366] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Sep 30 09:27:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:04.614343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32863d0-96ad-484c-bf07-819b344cae57 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:04.671911 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:04.687033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4e6c9-bb20-4462-89be-bfdb1bdf600c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:04.741401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca56c5a-62d0-4ed8-b302-a495eaef290e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:04.741975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca56c5a-62d0-4ed8-b302-a495eaef290e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:04.742256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca56c5a-62d0-4ed8-b302-a495eaef290e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:04.742602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca56c5a-62d0-4ed8-b302-a495eaef290e None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:04.743833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca56c5a-62d0-4ed8-b302-a495eaef290e None admin] RBAC: Authorizing `identity:get_project(project_id=22150ed8c7364fe3b686c6a086484995)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:04.746934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca56c5a-62d0-4ed8-b302-a495eaef290e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:04.749717 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 186/367] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:04 2022] GET /identity/v3/projects/22150ed8c7364fe3b686c6a086484995 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:04.750639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca56c5a-62d0-4ed8-b302-a495eaef290e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:04.765887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32863d0-96ad-484c-bf07-819b344cae57 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:04.818015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b170a06-7797-4327-8fba-dbe4d45e8f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:04.818643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b170a06-7797-4327-8fba-dbe4d45e8f97 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:04.818929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b170a06-7797-4327-8fba-dbe4d45e8f97 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:04.819274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b170a06-7797-4327-8fba-dbe4d45e8f97 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:04.820021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b170a06-7797-4327-8fba-dbe4d45e8f97 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:04.821929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b170a06-7797-4327-8fba-dbe4d45e8f97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:04.824987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b170a06-7797-4327-8fba-dbe4d45e8f97 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:04.846996 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 182/368] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:04.847848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b170a06-7797-4327-8fba-dbe4d45e8f97 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:04.848559 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:04.908381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca56c5a-62d0-4ed8-b302-a495eaef290e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:04.959270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c58d90-ea5c-47cc-9b79-cf084404530d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:04.960502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c58d90-ea5c-47cc-9b79-cf084404530d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:04.960818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c58d90-ea5c-47cc-9b79-cf084404530d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:04.961091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c58d90-ea5c-47cc-9b79-cf084404530d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:04.976757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c58d90-ea5c-47cc-9b79-cf084404530d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:04.985458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-23c58d90-ea5c-47cc-9b79-cf084404530d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:04.985458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:04.985458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:04.985458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:04.985458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:04.985458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:04.985458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:04.985458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:04.985458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:04.985458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:04.985458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:04.985458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:04.985458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:04.985458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:04.985458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:04.985458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:04.986355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:04.986355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:04.986355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:04.986355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:04.986355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:04.986355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:04.986355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:04.986355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:04.986355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:04.986355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:04.986355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:04.986355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:04.986355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:04.986355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:04.986355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:04.986355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:04.987135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:04.987135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:04.987135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:04.987135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:04.987135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:04.987135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:04.987135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:04.987135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:04.987135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:04.987135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:04.987135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:04.987135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:04.987732 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 187/369] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:27:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:04.988819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c58d90-ea5c-47cc-9b79-cf084404530d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:04.993505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b170a06-7797-4327-8fba-dbe4d45e8f97 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:04.995793 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:05.039709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a39fcd-cbce-49a4-9f43-b11bc863cebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:05.040505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a39fcd-cbce-49a4-9f43-b11bc863cebe None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:05.041487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a39fcd-cbce-49a4-9f43-b11bc863cebe None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:05.041852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a39fcd-cbce-49a4-9f43-b11bc863cebe None admin] PATH_INFO: `/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:05.043222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a39fcd-cbce-49a4-9f43-b11bc863cebe None admin] RBAC: Authorizing `identity:get_group(group_id=dc6a69c1b2c84b519486bb9b211a29b3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:05.044965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a39fcd-cbce-49a4-9f43-b11bc863cebe None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:05.047103 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 183/370] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Sep 30 09:27:04 2022] GET /identity/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:05.047965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a39fcd-cbce-49a4-9f43-b11bc863cebe None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:05.121181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c58d90-ea5c-47cc-9b79-cf084404530d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:05.142809 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:05.168262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869e3b0-6953-4dff-8dbe-205a471b9ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:05.168917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869e3b0-6953-4dff-8dbe-205a471b9ff1 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:05.169357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869e3b0-6953-4dff-8dbe-205a471b9ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:05.169612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869e3b0-6953-4dff-8dbe-205a471b9ff1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:05.184447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a39fcd-cbce-49a4-9f43-b11bc863cebe None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:05.235297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83000d-c28d-4518-90d0-c1761b3123dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:05.235900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83000d-c28d-4518-90d0-c1761b3123dc None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:05.236179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83000d-c28d-4518-90d0-c1761b3123dc None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:05.236449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83000d-c28d-4518-90d0-c1761b3123dc None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:05.237144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83000d-c28d-4518-90d0-c1761b3123dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:05.237509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83000d-c28d-4518-90d0-c1761b3123dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:05.239183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83000d-c28d-4518-90d0-c1761b3123dc None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:05.251795 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 184/371] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:05.252787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83000d-c28d-4518-90d0-c1761b3123dc None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:05.267649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869e3b0-6953-4dff-8dbe-205a471b9ff1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:05.271590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869e3b0-6953-4dff-8dbe-205a471b9ff1 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:05.296202 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:05.382984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83000d-c28d-4518-90d0-c1761b3123dc None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:05.405596 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 188/372] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:27:05.406728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869e3b0-6953-4dff-8dbe-205a471b9ff1 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:05.430219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04259f-bec3-46b8-a6b4-6b8048be4e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:05.430858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04259f-bec3-46b8-a6b4-6b8048be4e3c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:05.431489 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:05.432746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04259f-bec3-46b8-a6b4-6b8048be4e3c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:05.433147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04259f-bec3-46b8-a6b4-6b8048be4e3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:05.433878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04259f-bec3-46b8-a6b4-6b8048be4e3c None admin] RBAC: Adding query filter params (group.id=dc6a69c1b2c84b519486bb9b211a29b3, role.id=f642af7fc1fd472d8f4a4d6f34548ba2, scope.project.id=22150ed8c7364fe3b686c6a086484995) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:05.434186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04259f-bec3-46b8-a6b4-6b8048be4e3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:05.435618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04259f-bec3-46b8-a6b4-6b8048be4e3c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:05.442862 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 185/373] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Sep 30 09:27:05 2022] GET /identity/v3/role_assignments?group.id=dc6a69c1b2c84b519486bb9b211a29b3&scope.project.id=22150ed8c7364fe3b686c6a086484995&role.id=f642af7fc1fd472d8f4a4d6f34548ba2 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:05.443558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04259f-bec3-46b8-a6b4-6b8048be4e3c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:05.560735 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:05.569634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04259f-bec3-46b8-a6b4-6b8048be4e3c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:05.613027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a195e79-496d-493d-b653-1fb8eb230b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:05.613669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a195e79-496d-493d-b653-1fb8eb230b50 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:05.613947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a195e79-496d-493d-b653-1fb8eb230b50 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:05.614221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a195e79-496d-493d-b653-1fb8eb230b50 None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:05.615433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a195e79-496d-493d-b653-1fb8eb230b50 None admin] RBAC: Authorizing `identity:get_project(project_id=22150ed8c7364fe3b686c6a086484995)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:05.616932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a195e79-496d-493d-b653-1fb8eb230b50 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:05.619372 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 186/374] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:05 2022] GET /identity/v3/projects/22150ed8c7364fe3b686c6a086484995 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:05.625701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a195e79-496d-493d-b653-1fb8eb230b50 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:05.679437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869e3b0-6953-4dff-8dbe-205a471b9ff1 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:05.740280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a195e79-496d-493d-b653-1fb8eb230b50 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:05.757902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea11a0c-c681-4522-80ea-683c82db9e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:05.758525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea11a0c-c681-4522-80ea-683c82db9e98 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:05.758805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea11a0c-c681-4522-80ea-683c82db9e98 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:05.759079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea11a0c-c681-4522-80ea-683c82db9e98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:05.777600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf22f15-87fa-4421-89f9-7c8729b2e622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:05.778235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf22f15-87fa-4421-89f9-7c8729b2e622 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:05.778513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf22f15-87fa-4421-89f9-7c8729b2e622 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:05.778786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf22f15-87fa-4421-89f9-7c8729b2e622 None admin] PATH_INFO: `/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:05.779916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf22f15-87fa-4421-89f9-7c8729b2e622 None admin] RBAC: Authorizing `identity:get_group(group_id=dc6a69c1b2c84b519486bb9b211a29b3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:05.781501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf22f15-87fa-4421-89f9-7c8729b2e622 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:05.783425 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 187/375] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Sep 30 09:27:05 2022] GET /identity/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:05.790222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf22f15-87fa-4421-89f9-7c8729b2e622 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:05.852845 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:05.903378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea11a0c-c681-4522-80ea-683c82db9e98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:05.904367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf22f15-87fa-4421-89f9-7c8729b2e622 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:05.904941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea11a0c-c681-4522-80ea-683c82db9e98 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:05.938504 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:05.944349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e277f-3539-4dc8-8391-c59265fd2b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:05.944984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e277f-3539-4dc8-8391-c59265fd2b63 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:05.945261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e277f-3539-4dc8-8391-c59265fd2b63 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:05.945528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e277f-3539-4dc8-8391-c59265fd2b63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:05.946263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e277f-3539-4dc8-8391-c59265fd2b63 None admin] RBAC: Adding query filter params (group.id=dc6a69c1b2c84b519486bb9b211a29b3, role.id=27410223fa7d4717a71ac6753c80420b, scope.project.id=22150ed8c7364fe3b686c6a086484995) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:05.946558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e277f-3539-4dc8-8391-c59265fd2b63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:05.948528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e277f-3539-4dc8-8391-c59265fd2b63 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:05.954544 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 188/376] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Sep 30 09:27:05 2022] GET /identity/v3/role_assignments?group.id=dc6a69c1b2c84b519486bb9b211a29b3&scope.project.id=22150ed8c7364fe3b686c6a086484995&role.id=27410223fa7d4717a71ac6753c80420b => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:06.083193 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 189/377] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:27:06.091388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e277f-3539-4dc8-8391-c59265fd2b63 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:06.226565 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:06.233203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e277f-3539-4dc8-8391-c59265fd2b63 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:06.271623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07ca58-85d2-4f6c-bae4-1b84c7301357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:06.272260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07ca58-85d2-4f6c-bae4-1b84c7301357 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:06.272915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07ca58-85d2-4f6c-bae4-1b84c7301357 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:06.273190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07ca58-85d2-4f6c-bae4-1b84c7301357 None admin] PATH_INFO: `/v3/projects/2ffba943875a42809c70ac5c9bd54394` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:06.274324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07ca58-85d2-4f6c-bae4-1b84c7301357 None admin] RBAC: Authorizing `identity:get_project(project_id=2ffba943875a42809c70ac5c9bd54394)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:06.276369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07ca58-85d2-4f6c-bae4-1b84c7301357 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:06.278305 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 189/378] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:06 2022] GET /identity/v3/projects/2ffba943875a42809c70ac5c9bd54394 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:06.283996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea11a0c-c681-4522-80ea-683c82db9e98 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:06.402968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea11a0c-c681-4522-80ea-683c82db9e98 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:06.429965 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:06.450496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7088d-a5a6-454d-9157-6cb6db0e556d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:06.451149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7088d-a5a6-454d-9157-6cb6db0e556d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:06.451425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7088d-a5a6-454d-9157-6cb6db0e556d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:06.451694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7088d-a5a6-454d-9157-6cb6db0e556d None admin] PATH_INFO: `/v3/groups/0f56e9769ab842ce8a70d0f67176b6c3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:06.462047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7088d-a5a6-454d-9157-6cb6db0e556d None admin] RBAC: Authorizing `identity:get_group(group_id=0f56e9769ab842ce8a70d0f67176b6c3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:06.463614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7088d-a5a6-454d-9157-6cb6db0e556d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:06.465621 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 190/379] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Sep 30 09:27:06 2022] GET /identity/v3/groups/0f56e9769ab842ce8a70d0f67176b6c3 => generated 229 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:06.471416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07ca58-85d2-4f6c-bae4-1b84c7301357 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:06.558059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869fbf9-9aef-470a-bd2f-ea9e62955656 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:06.558749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869fbf9-9aef-470a-bd2f-ea9e62955656 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:06.559324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869fbf9-9aef-470a-bd2f-ea9e62955656 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:06.561196 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 191/380] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:06.566925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e252f-560b-4801-b254-73eef7877e6f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:06.567497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e252f-560b-4801-b254-73eef7877e6f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:06.567968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e252f-560b-4801-b254-73eef7877e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:06.603717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4e3e252f-560b-4801-b254-73eef7877e6f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:06.604923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07ca58-85d2-4f6c-bae4-1b84c7301357 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:06.605596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4e3e252f-560b-4801-b254-73eef7877e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:06.644777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc6c45-3249-4504-9dc8-205126a524e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:06.645676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc6c45-3249-4504-9dc8-205126a524e6 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:06.646121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc6c45-3249-4504-9dc8-205126a524e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:06.646542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc6c45-3249-4504-9dc8-205126a524e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:06.647437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc6c45-3249-4504-9dc8-205126a524e6 None admin] RBAC: Adding query filter params (group.id=0f56e9769ab842ce8a70d0f67176b6c3, role.id=f06b5fed717d4b03a5083dd847274296, scope.project.id=2ffba943875a42809c70ac5c9bd54394) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:06.647895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc6c45-3249-4504-9dc8-205126a524e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:06.649655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc6c45-3249-4504-9dc8-205126a524e6 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:06.659008 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 190/381] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Sep 30 09:27:06 2022] GET /identity/v3/role_assignments?group.id=0f56e9769ab842ce8a70d0f67176b6c3&scope.project.id=2ffba943875a42809c70ac5c9bd54394&role.id=f06b5fed717d4b03a5083dd847274296 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:06.723665 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 192/382] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:06.906247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba6e20-c432-47f0-9743-f74841faab61 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:06.906882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba6e20-c432-47f0-9743-f74841faab61 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:06.907371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba6e20-c432-47f0-9743-f74841faab61 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:06.909225 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 191/383] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:06.921725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3dfc8-e983-4b20-bc8b-20e944f04024 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:06.921725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3dfc8-e983-4b20-bc8b-20e944f04024 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:06.921725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3dfc8-e983-4b20-bc8b-20e944f04024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:06.949616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-21d3dfc8-e983-4b20-bc8b-20e944f04024 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:06.950829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-21d3dfc8-e983-4b20-bc8b-20e944f04024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:07.042164 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 193/384] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:07.130089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba6e20-c432-47f0-9743-f74841faab61 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:07.169095 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:07.260809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba6e20-c432-47f0-9743-f74841faab61 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:07.304231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d489b-360e-48b1-8818-bc3bf9217337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:07.305271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d489b-360e-48b1-8818-bc3bf9217337 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:07.305790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d489b-360e-48b1-8818-bc3bf9217337 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:07.306268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d489b-360e-48b1-8818-bc3bf9217337 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:07.321986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d489b-360e-48b1-8818-bc3bf9217337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:07.328161 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-b17d489b-360e-48b1-8818-bc3bf9217337 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:27:07.328161 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:07.328161 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:07.328161 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:07.328161 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:07.328161 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:07.328161 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:07.328161 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:07.328161 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:07.328161 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:07.328161 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:07.328161 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:07.328161 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:07.328161 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:07.328161 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:07.328161 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:07.329172 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:07.329172 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:07.329172 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:07.329172 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:07.329172 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:07.329172 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:07.329172 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:07.329172 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:07.329172 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:07.329172 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:07.329172 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:07.329172 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:07.329172 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:07.329172 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:07.329172 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:07.329172 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:07.329987 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:07.329987 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:07.329987 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:07.329987 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:07.329987 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:07.329987 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:07.329987 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:07.329987 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:07.329987 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:07.329987 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:07.329987 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:27:07.329987 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:07.333012 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 192/385] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:07.340562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3dfc8-e983-4b20-bc8b-20e944f04024 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:07.350168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d489b-360e-48b1-8818-bc3bf9217337 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:07.418878 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:07.463561 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:07.486372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d489b-360e-48b1-8818-bc3bf9217337 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:07.516262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3dfc8-e983-4b20-bc8b-20e944f04024 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:07.528629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8b8bd-6d66-4a3f-9c00-caf852eff422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:07.529359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8b8bd-6d66-4a3f-9c00-caf852eff422 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:07.529688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8b8bd-6d66-4a3f-9c00-caf852eff422 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:07.529959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8b8bd-6d66-4a3f-9c00-caf852eff422 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:07.543955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8b8bd-6d66-4a3f-9c00-caf852eff422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:07.549167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-6eb8b8bd-6d66-4a3f-9c00-caf852eff422 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:27:07.549167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:07.549167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:07.549167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:07.549167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:07.549167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:07.549167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:07.549167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:07.549167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:07.549167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:07.549167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:07.549167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:07.549167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:07.549167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:07.549167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:07.549167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:07.550041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:07.550041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:07.550041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:07.550041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:07.550041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:07.550041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:07.550041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:07.550041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:07.550041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:07.550041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:07.550041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:07.550041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:07.550041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:07.550041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:07.550041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:07.550041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:07.550804 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:07.550804 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:07.550804 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:07.550804 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:07.550804 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:07.550804 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:07.550804 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:07.550804 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:07.550804 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:07.550804 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:07.550804 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:27:07.550804 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:07.550804 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 193/386] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Sep 30 09:27:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:27:07.556483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8b8bd-6d66-4a3f-9c00-caf852eff422 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:07.570840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35e417-f81d-4583-8f2d-6d56f8e4db50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:07.571661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35e417-f81d-4583-8f2d-6d56f8e4db50 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:07.572668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35e417-f81d-4583-8f2d-6d56f8e4db50 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:07.573135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35e417-f81d-4583-8f2d-6d56f8e4db50 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:07.573932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35e417-f81d-4583-8f2d-6d56f8e4db50 None admin] RBAC: Adding query filter params (name=member) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:07.574425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35e417-f81d-4583-8f2d-6d56f8e4db50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:07.575912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35e417-f81d-4583-8f2d-6d56f8e4db50 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:07.587306 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 194/387] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:27:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:07.600179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35e417-f81d-4583-8f2d-6d56f8e4db50 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:07.736012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8b8bd-6d66-4a3f-9c00-caf852eff422 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:07.785632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35e417-f81d-4583-8f2d-6d56f8e4db50 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:07.793142 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:07.803290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca469906-7b60-49c1-97c6-cc3ccb08998d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:07.804199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca469906-7b60-49c1-97c6-cc3ccb08998d None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:07.804660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca469906-7b60-49c1-97c6-cc3ccb08998d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:07.805069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca469906-7b60-49c1-97c6-cc3ccb08998d None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:07.805877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca469906-7b60-49c1-97c6-cc3ccb08998d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:07.806367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca469906-7b60-49c1-97c6-cc3ccb08998d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:07.809559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca469906-7b60-49c1-97c6-cc3ccb08998d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:07.820628 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 194/388] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:07.827087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca469906-7b60-49c1-97c6-cc3ccb08998d None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:07.845911 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:07.866956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f395273-0767-4032-96f8-4333dbf79978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:07.867593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f395273-0767-4032-96f8-4333dbf79978 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:07.867865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f395273-0767-4032-96f8-4333dbf79978 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:07.871592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f395273-0767-4032-96f8-4333dbf79978 None admin] PATH_INFO: `/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:07.872810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f395273-0767-4032-96f8-4333dbf79978 None admin] RBAC: Authorizing `identity:get_group(group_id=dc6a69c1b2c84b519486bb9b211a29b3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:07.874255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f395273-0767-4032-96f8-4333dbf79978 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:07.875831 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 195/389] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Sep 30 09:27:07 2022] GET /identity/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3 => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:07.881741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f395273-0767-4032-96f8-4333dbf79978 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:08.009695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca469906-7b60-49c1-97c6-cc3ccb08998d None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:08.058179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63bef6-5821-419e-a0ef-13f233ae240a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:08.058807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63bef6-5821-419e-a0ef-13f233ae240a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:08.059084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63bef6-5821-419e-a0ef-13f233ae240a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:08.059353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63bef6-5821-419e-a0ef-13f233ae240a None admin] PATH_INFO: `/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:08.061103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63bef6-5821-419e-a0ef-13f233ae240a None admin] RBAC: Authorizing `identity:get_group(group_id=dc6a69c1b2c84b519486bb9b211a29b3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:08.062522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63bef6-5821-419e-a0ef-13f233ae240a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:08.064094 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 195/390] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Sep 30 09:27:07 2022] GET /identity/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:08.070071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63bef6-5821-419e-a0ef-13f233ae240a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:08.073031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f395273-0767-4032-96f8-4333dbf79978 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:08.141890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bab77-1b9f-4df0-a635-f6a5960a8c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:08.142887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bab77-1b9f-4df0-a635-f6a5960a8c99 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:08.143375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bab77-1b9f-4df0-a635-f6a5960a8c99 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:08.144041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bab77-1b9f-4df0-a635-f6a5960a8c99 None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:08.146522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bab77-1b9f-4df0-a635-f6a5960a8c99 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d26f75111496bae034056bc6ed395)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:08.149253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bab77-1b9f-4df0-a635-f6a5960a8c99 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:08.153022 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 196/391] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:07 2022] GET /identity/v3/projects/ee1d26f75111496bae034056bc6ed395 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:08.158767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bab77-1b9f-4df0-a635-f6a5960a8c99 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:08.216887 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:08.223647 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:08.255676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63bef6-5821-419e-a0ef-13f233ae240a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:08.322843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75573822-0370-45f0-98ce-bbd96ad0d10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:08.323611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75573822-0370-45f0-98ce-bbd96ad0d10f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:08.323611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75573822-0370-45f0-98ce-bbd96ad0d10f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:08.323929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75573822-0370-45f0-98ce-bbd96ad0d10f None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:08.325130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75573822-0370-45f0-98ce-bbd96ad0d10f None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d26f75111496bae034056bc6ed395)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:08.326548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75573822-0370-45f0-98ce-bbd96ad0d10f None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:08.329369 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 196/392] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:08 2022] GET /identity/v3/projects/ee1d26f75111496bae034056bc6ed395 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:08.338692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bab77-1b9f-4df0-a635-f6a5960a8c99 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:08.342669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75573822-0370-45f0-98ce-bbd96ad0d10f None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:08.403689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b82d3d-26f9-4a1a-ab70-c75587da2385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:08.404354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b82d3d-26f9-4a1a-ab70-c75587da2385 None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:08.404642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b82d3d-26f9-4a1a-ab70-c75587da2385 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:08.404962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b82d3d-26f9-4a1a-ab70-c75587da2385 None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395/groups/dc6a69c1b2c84b519486bb9b211a29b3/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:08.410916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b82d3d-26f9-4a1a-ab70-c75587da2385 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee1d26f75111496bae034056bc6ed395, group_id=dc6a69c1b2c84b519486bb9b211a29b3, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:08.412334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b82d3d-26f9-4a1a-ab70-c75587da2385 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:08.434135 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 197/393] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Sep 30 09:27:08 2022] PUT /identity/v3/projects/ee1d26f75111496bae034056bc6ed395/groups/dc6a69c1b2c84b519486bb9b211a29b3/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:27:08.492857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75573822-0370-45f0-98ce-bbd96ad0d10f None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:08.537132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf7304-0788-4591-b8f9-932a75e2de11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:08.537810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf7304-0788-4591-b8f9-932a75e2de11 None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:08.538092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf7304-0788-4591-b8f9-932a75e2de11 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:08.538362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf7304-0788-4591-b8f9-932a75e2de11 None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395/groups/dc6a69c1b2c84b519486bb9b211a29b3/roles/27410223fa7d4717a71ac6753c80420b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:08.542889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf7304-0788-4591-b8f9-932a75e2de11 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee1d26f75111496bae034056bc6ed395, group_id=dc6a69c1b2c84b519486bb9b211a29b3, role_id=27410223fa7d4717a71ac6753c80420b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:08.544354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf7304-0788-4591-b8f9-932a75e2de11 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:08.563767 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 197/394] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Sep 30 09:27:08 2022] PUT /identity/v3/projects/ee1d26f75111496bae034056bc6ed395/groups/dc6a69c1b2c84b519486bb9b211a29b3/roles/27410223fa7d4717a71ac6753c80420b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:27:08.663467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fa970-c5f1-4d99-b7f3-e74bc5b8fa3b None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:08.664136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fa970-c5f1-4d99-b7f3-e74bc5b8fa3b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:08.664683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fa970-c5f1-4d99-b7f3-e74bc5b8fa3b None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:08.666899 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 198/395] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:08.673137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2cdb9-8c57-4966-b5b1-9b6e13176e5e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:08.673455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2cdb9-8c57-4966-b5b1-9b6e13176e5e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:08.673691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2cdb9-8c57-4966-b5b1-9b6e13176e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:08.691442 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:08.701821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fce2cdb9-8c57-4966-b5b1-9b6e13176e5e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:08.703051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fce2cdb9-8c57-4966-b5b1-9b6e13176e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:08.784167 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 198/396] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:08.973591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723653d-f33c-4509-8527-32e0257e2833 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:08.974231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723653d-f33c-4509-8527-32e0257e2833 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:08.974705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723653d-f33c-4509-8527-32e0257e2833 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:08.976229 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 199/397] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:08.981736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c22214-dcb8-48a6-9f1f-5ab4117fc5e9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:08.982025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c22214-dcb8-48a6-9f1f-5ab4117fc5e9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:08.982291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c22214-dcb8-48a6-9f1f-5ab4117fc5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:09.008908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-91c22214-dcb8-48a6-9f1f-5ab4117fc5e9 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:09.010622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-91c22214-dcb8-48a6-9f1f-5ab4117fc5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:09.103422 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 199/398] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:09.173702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723653d-f33c-4509-8527-32e0257e2833 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:09.309243 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:09.314871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723653d-f33c-4509-8527-32e0257e2833 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:09.360766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9753021-b298-471e-9cef-f3aa3e2addcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:09.361401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9753021-b298-471e-9cef-f3aa3e2addcc None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:09.361677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9753021-b298-471e-9cef-f3aa3e2addcc None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:09.361944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9753021-b298-471e-9cef-f3aa3e2addcc None admin] PATH_INFO: `/v3/roles/member` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:09.377491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9753021-b298-471e-9cef-f3aa3e2addcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:09.382317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-e9753021-b298-471e-9cef-f3aa3e2addcc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:27:09.382317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:09.382317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:09.382317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:09.382317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:09.382317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:09.382317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:09.382317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:09.382317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:09.382317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:09.382317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:09.382317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:09.382317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:09.382317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:09.382317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:09.382317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:09.383213 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:09.383213 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:09.383213 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:09.383213 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:09.383213 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:09.383213 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:09.383213 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:09.383213 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:09.383213 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:09.383213 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:09.383213 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:09.383213 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:09.383213 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:09.383213 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:09.383213 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:09.383213 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:09.383984 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:09.383984 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:09.383984 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:09.383984 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:09.383984 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:09.383984 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:09.383984 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:09.383984 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:09.383984 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:09.383984 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:09.383984 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:27:09.383984 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:09.383984 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 200/399] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:09.391660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c22214-dcb8-48a6-9f1f-5ab4117fc5e9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:09.397244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9c6cc-bde3-423d-b4e5-82f2fbc2497b None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:09.397530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9c6cc-bde3-423d-b4e5-82f2fbc2497b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:09.397806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9c6cc-bde3-423d-b4e5-82f2fbc2497b None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:09.399154 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 201/400] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:27:09.404685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f80686-4c57-400c-b1ba-144c4f5b3118 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:09.405590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f80686-4c57-400c-b1ba-144c4f5b3118 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:09.406008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f80686-4c57-400c-b1ba-144c4f5b3118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:09.440056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-10f80686-4c57-400c-b1ba-144c4f5b3118 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:09.441879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-10f80686-4c57-400c-b1ba-144c4f5b3118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:09.488419 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:09.531793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c22214-dcb8-48a6-9f1f-5ab4117fc5e9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:09.532211 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 202/401] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:27:09.533109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f80686-4c57-400c-b1ba-144c4f5b3118 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:09.573306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bda4f4-4075-4c8b-a725-e108715c18a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:09.574299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bda4f4-4075-4c8b-a725-e108715c18a9 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:09.574825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bda4f4-4075-4c8b-a725-e108715c18a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:09.575351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bda4f4-4075-4c8b-a725-e108715c18a9 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:09.576203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bda4f4-4075-4c8b-a725-e108715c18a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:09.576740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bda4f4-4075-4c8b-a725-e108715c18a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:09.578346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bda4f4-4075-4c8b-a725-e108715c18a9 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:09.588370 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 200/402] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:27:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:09.594179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bda4f4-4075-4c8b-a725-e108715c18a9 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:09.662030 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:09.678147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f80686-4c57-400c-b1ba-144c4f5b3118 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:09.721463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d999b7-53e7-4ae8-897e-a33a496ba1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:09.722251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d999b7-53e7-4ae8-897e-a33a496ba1af None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:09.722602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d999b7-53e7-4ae8-897e-a33a496ba1af None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:09.722948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d999b7-53e7-4ae8-897e-a33a496ba1af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:09.737485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d999b7-53e7-4ae8-897e-a33a496ba1af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:09.745259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-63d999b7-53e7-4ae8-897e-a33a496ba1af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:27:09.745259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:09.745259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:09.745259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:09.745259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:09.745259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:09.745259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:09.745259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:09.745259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:09.745259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:09.745259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:09.745259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:09.745259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:09.745259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:09.745259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:09.745259 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:09.746168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:09.746168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:09.746168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:09.746168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:09.746168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:09.746168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:09.746168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:09.746168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:09.746168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:09.746168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:09.746168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:09.746168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:09.746168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:09.746168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:09.746168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:09.746168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:09.746939 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:09.746939 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:09.746939 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:09.746939 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:09.746939 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:09.746939 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:09.746939 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:09.746939 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:09.746939 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:09.746939 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:09.746939 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:27:09.746939 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:09.747524 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 203/403] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Sep 30 09:27:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:09.753449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d999b7-53e7-4ae8-897e-a33a496ba1af None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:09.888855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bda4f4-4075-4c8b-a725-e108715c18a9 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:09.897259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d999b7-53e7-4ae8-897e-a33a496ba1af None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:09.957235 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:09.975194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ebcd6-37aa-4fe1-bad2-26283fed2a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:09.975737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ebcd6-37aa-4fe1-bad2-26283fed2a6c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:09.976017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ebcd6-37aa-4fe1-bad2-26283fed2a6c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:09.976287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ebcd6-37aa-4fe1-bad2-26283fed2a6c None admin] PATH_INFO: `/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:09.977513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ebcd6-37aa-4fe1-bad2-26283fed2a6c None admin] RBAC: Authorizing `identity:get_group(group_id=dc6a69c1b2c84b519486bb9b211a29b3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:09.977987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75718771-eb86-434a-b34a-0ff9b77ce8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:09.979544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75718771-eb86-434a-b34a-0ff9b77ce8e3 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:09.979694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ebcd6-37aa-4fe1-bad2-26283fed2a6c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:09.980463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75718771-eb86-434a-b34a-0ff9b77ce8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:09.981212 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 201/404] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Sep 30 09:27:09 2022] GET /identity/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3 => generated 226 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:09.981547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75718771-eb86-434a-b34a-0ff9b77ce8e3 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:09.981956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ebcd6-37aa-4fe1-bad2-26283fed2a6c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:09.982841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75718771-eb86-434a-b34a-0ff9b77ce8e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:09.983348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75718771-eb86-434a-b34a-0ff9b77ce8e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:09.984960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75718771-eb86-434a-b34a-0ff9b77ce8e3 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:09.996649 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 204/405] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:09.997992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75718771-eb86-434a-b34a-0ff9b77ce8e3 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:10.017953 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:10.107582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ebcd6-37aa-4fe1-bad2-26283fed2a6c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:10.126354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75718771-eb86-434a-b34a-0ff9b77ce8e3 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:10.155887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634de2fa-40d3-4261-836c-7e2bc0720f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:10.156562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634de2fa-40d3-4261-836c-7e2bc0720f45 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:10.156869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634de2fa-40d3-4261-836c-7e2bc0720f45 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:10.157141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634de2fa-40d3-4261-836c-7e2bc0720f45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:10.167076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bcf31-0078-4278-a492-8394f2c23859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:10.168048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bcf31-0078-4278-a492-8394f2c23859 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:10.168418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bcf31-0078-4278-a492-8394f2c23859 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:10.168814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bcf31-0078-4278-a492-8394f2c23859 None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:10.169027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634de2fa-40d3-4261-836c-7e2bc0720f45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:10.170155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598bcf31-0078-4278-a492-8394f2c23859 None admin] RBAC: Authorizing `identity:get_project(project_id=22150ed8c7364fe3b686c6a086484995)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:10.171728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598bcf31-0078-4278-a492-8394f2c23859 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:10.173538 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 205/406] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:09 2022] GET /identity/v3/projects/22150ed8c7364fe3b686c6a086484995 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:10.174466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bcf31-0078-4278-a492-8394f2c23859 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:10.175421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-634de2fa-40d3-4261-836c-7e2bc0720f45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:10.175421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:10.175421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:10.175421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:10.175421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:10.175421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:10.175421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:10.175421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:10.175421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:10.175421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:10.175421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:10.175421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:10.175421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:10.175421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:10.175421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:10.175421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:10.176408 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:10.176408 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:10.176408 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:10.176408 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:10.176408 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:10.176408 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:10.176408 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:10.176408 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:10.176408 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:10.176408 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:10.176408 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:10.176408 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:10.176408 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:10.176408 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:10.176408 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:10.176408 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:10.177218 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:10.177218 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:10.177218 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:10.177218 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:10.177218 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:10.177218 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:10.177218 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:10.177218 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:10.177218 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:10.177218 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:10.177218 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:10.177218 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:10.179456 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 202/407] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:27:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:10.188275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634de2fa-40d3-4261-836c-7e2bc0720f45 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:10.253864 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:10.283893 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:10.309793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bcf31-0078-4278-a492-8394f2c23859 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:10.312895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634de2fa-40d3-4261-836c-7e2bc0720f45 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:10.350721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090893f-c8d5-4460-ae8f-13b0f3a85276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:10.351611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090893f-c8d5-4460-ae8f-13b0f3a85276 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:10.351903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090893f-c8d5-4460-ae8f-13b0f3a85276 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:10.352171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090893f-c8d5-4460-ae8f-13b0f3a85276 None admin] PATH_INFO: `/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:10.354389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090893f-c8d5-4460-ae8f-13b0f3a85276 None admin] RBAC: Authorizing `identity:get_group(group_id=dc6a69c1b2c84b519486bb9b211a29b3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:10.355927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090893f-c8d5-4460-ae8f-13b0f3a85276 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:10.356741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd24e78-f2c1-4992-8696-34e7ae9eb2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:10.357537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd24e78-f2c1-4992-8696-34e7ae9eb2dc None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:10.357968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd24e78-f2c1-4992-8696-34e7ae9eb2dc None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:10.358391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd24e78-f2c1-4992-8696-34e7ae9eb2dc None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:10.359299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd24e78-f2c1-4992-8696-34e7ae9eb2dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:10.359780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd24e78-f2c1-4992-8696-34e7ae9eb2dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:10.361285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd24e78-f2c1-4992-8696-34e7ae9eb2dc None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:10.362212 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 206/408] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Sep 30 09:27:10 2022] GET /identity/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:10.363159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090893f-c8d5-4460-ae8f-13b0f3a85276 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:10.378468 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 203/409] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:10.379611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd24e78-f2c1-4992-8696-34e7ae9eb2dc None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:10.489751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd24e78-f2c1-4992-8696-34e7ae9eb2dc None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:10.505035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090893f-c8d5-4460-ae8f-13b0f3a85276 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:10.514183 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:10.538213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3508f4-89e6-4214-a62f-dcb8203c3db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:10.539290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3508f4-89e6-4214-a62f-dcb8203c3db1 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:10.539805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3508f4-89e6-4214-a62f-dcb8203c3db1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:10.540217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3508f4-89e6-4214-a62f-dcb8203c3db1 None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:10.541825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3508f4-89e6-4214-a62f-dcb8203c3db1 None admin] RBAC: Authorizing `identity:get_project(project_id=22150ed8c7364fe3b686c6a086484995)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:10.543594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3508f4-89e6-4214-a62f-dcb8203c3db1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:10.545626 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 204/410] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:10 2022] GET /identity/v3/projects/22150ed8c7364fe3b686c6a086484995 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:10.545740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae0280-0b6d-4f24-af35-57c62894eb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:10.546485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae0280-0b6d-4f24-af35-57c62894eb34 None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:10.547060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae0280-0b6d-4f24-af35-57c62894eb34 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:10.547592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae0280-0b6d-4f24-af35-57c62894eb34 None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995/groups/dc6a69c1b2c84b519486bb9b211a29b3/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:10.549705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae0280-0b6d-4f24-af35-57c62894eb34 None admin] RBAC: Authorizing `identity:create_grant(project_id=22150ed8c7364fe3b686c6a086484995, group_id=dc6a69c1b2c84b519486bb9b211a29b3, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:10.551178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3508f4-89e6-4214-a62f-dcb8203c3db1 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:10.551553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae0280-0b6d-4f24-af35-57c62894eb34 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:10.575877 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 207/411] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Sep 30 09:27:10 2022] PUT /identity/v3/projects/22150ed8c7364fe3b686c6a086484995/groups/dc6a69c1b2c84b519486bb9b211a29b3/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:27:10.575877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae0280-0b6d-4f24-af35-57c62894eb34 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:10.589578 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:10.786577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3508f4-89e6-4214-a62f-dcb8203c3db1 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:10.788019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae0280-0b6d-4f24-af35-57c62894eb34 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:10.837885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac763dd-8f97-4959-a0f7-00d2b2a7e438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:10.839058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac763dd-8f97-4959-a0f7-00d2b2a7e438 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:10.839477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac763dd-8f97-4959-a0f7-00d2b2a7e438 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:10.839885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac763dd-8f97-4959-a0f7-00d2b2a7e438 None admin] PATH_INFO: `/v3/groups/0f56e9769ab842ce8a70d0f67176b6c3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:10.840250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e73be-a46b-48ca-991b-230d12ba011a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:10.841247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e73be-a46b-48ca-991b-230d12ba011a None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:10.841375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac763dd-8f97-4959-a0f7-00d2b2a7e438 None admin] RBAC: Authorizing `identity:get_group(group_id=0f56e9769ab842ce8a70d0f67176b6c3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:10.841851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e73be-a46b-48ca-991b-230d12ba011a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:10.842323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e73be-a46b-48ca-991b-230d12ba011a None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995/groups/dc6a69c1b2c84b519486bb9b211a29b3/roles/27410223fa7d4717a71ac6753c80420b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:10.842885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac763dd-8f97-4959-a0f7-00d2b2a7e438 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:10.844720 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 205/412] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Sep 30 09:27:10 2022] GET /identity/v3/groups/0f56e9769ab842ce8a70d0f67176b6c3 => generated 229 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:10.845890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e73be-a46b-48ca-991b-230d12ba011a None admin] RBAC: Authorizing `identity:create_grant(project_id=22150ed8c7364fe3b686c6a086484995, group_id=dc6a69c1b2c84b519486bb9b211a29b3, role_id=27410223fa7d4717a71ac6753c80420b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:10.847559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e73be-a46b-48ca-991b-230d12ba011a None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:10.851212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac763dd-8f97-4959-a0f7-00d2b2a7e438 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:10.871266 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 208/413] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Sep 30 09:27:10 2022] PUT /identity/v3/projects/22150ed8c7364fe3b686c6a086484995/groups/dc6a69c1b2c84b519486bb9b211a29b3/roles/27410223fa7d4717a71ac6753c80420b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:27:10.958464 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:11.030687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac763dd-8f97-4959-a0f7-00d2b2a7e438 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:11.082641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c17304-b89c-4ade-bf66-2c6b027e2077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:11.083507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c17304-b89c-4ade-bf66-2c6b027e2077 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:11.083927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c17304-b89c-4ade-bf66-2c6b027e2077 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:11.084354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c17304-b89c-4ade-bf66-2c6b027e2077 None admin] PATH_INFO: `/v3/projects/2ffba943875a42809c70ac5c9bd54394` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:11.085702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c17304-b89c-4ade-bf66-2c6b027e2077 None admin] RBAC: Authorizing `identity:get_project(project_id=2ffba943875a42809c70ac5c9bd54394)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:11.087280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c17304-b89c-4ade-bf66-2c6b027e2077 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:11.094068 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 206/414] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:10 2022] GET /identity/v3/projects/2ffba943875a42809c70ac5c9bd54394 => generated 344 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:11.101687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e73be-a46b-48ca-991b-230d12ba011a None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:11.184465 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:11.223481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e73be-a46b-48ca-991b-230d12ba011a None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:11.263429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14732b9f-ace0-41ae-8d03-87232384917b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:11.264089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14732b9f-ace0-41ae-8d03-87232384917b None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:11.264363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14732b9f-ace0-41ae-8d03-87232384917b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:11.264650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14732b9f-ace0-41ae-8d03-87232384917b None admin] PATH_INFO: `/v3/projects/2ffba943875a42809c70ac5c9bd54394/groups/0f56e9769ab842ce8a70d0f67176b6c3/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:11.266596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14732b9f-ace0-41ae-8d03-87232384917b None admin] RBAC: Authorizing `identity:create_grant(project_id=2ffba943875a42809c70ac5c9bd54394, group_id=0f56e9769ab842ce8a70d0f67176b6c3, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:11.268095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14732b9f-ace0-41ae-8d03-87232384917b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:11.269724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e488d-4860-4678-bc57-3e4341d5e801 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:11.270004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e488d-4860-4678-bc57-3e4341d5e801 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:11.270267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e488d-4860-4678-bc57-3e4341d5e801 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:11.271833 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 207/415] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:27:11.279690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3fd87-23bf-4787-a597-cf4f691135b9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:11.280090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3fd87-23bf-4787-a597-cf4f691135b9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:11.280634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3fd87-23bf-4787-a597-cf4f691135b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:11.300099 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 209/416] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Sep 30 09:27:11 2022] PUT /identity/v3/projects/2ffba943875a42809c70ac5c9bd54394/groups/0f56e9769ab842ce8a70d0f67176b6c3/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:27:11.303328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c5d3fd87-23bf-4787-a597-cf4f691135b9 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:11.310334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c5d3fd87-23bf-4787-a597-cf4f691135b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:11.340760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98548ab5-28ed-4bac-94e6-665b821a25d8 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:11.341047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98548ab5-28ed-4bac-94e6-665b821a25d8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:11.341223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98548ab5-28ed-4bac-94e6-665b821a25d8 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:11.342866 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 210/417] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:11.350567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881781c-330d-421c-917c-f7d9aef81b31 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:11.350873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881781c-330d-421c-917c-f7d9aef81b31 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:11.351112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881781c-330d-421c-917c-f7d9aef81b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:11.389745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d881781c-330d-421c-917c-f7d9aef81b31 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:11.390991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d881781c-330d-421c-917c-f7d9aef81b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:11.402999 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 208/418] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:27:11.477890 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 211/419] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:11.719514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3fd87-23bf-4787-a597-cf4f691135b9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:11.790410 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:11.815023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881781c-330d-421c-917c-f7d9aef81b31 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:11.876203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3fd87-23bf-4787-a597-cf4f691135b9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:11.884936 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:11.937718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881781c-330d-421c-917c-f7d9aef81b31 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:11.959917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db24fc-6d07-48fd-b9f0-0d43d4311a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:11.960545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db24fc-6d07-48fd-b9f0-0d43d4311a4e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:11.960845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db24fc-6d07-48fd-b9f0-0d43d4311a4e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:11.961109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db24fc-6d07-48fd-b9f0-0d43d4311a4e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:11.981668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db24fc-6d07-48fd-b9f0-0d43d4311a4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:11.987535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-b6db24fc-6d07-48fd-b9f0-0d43d4311a4e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:27:11.987535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:11.987535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:11.987535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:11.987535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:11.987535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:11.987535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:11.987535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:11.987535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:11.987535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:11.987535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:11.987535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:11.987535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:11.987535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:11.987535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:11.987535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:11.988414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:11.988414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:11.988414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:11.988414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:11.988414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:11.988414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:11.988414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:11.988414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:11.988414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:11.988414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:11.988414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:11.988414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:11.988414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:11.988414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:11.988414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:11.988414 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:11.989229 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:11.989229 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:11.989229 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:11.989229 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:11.989229 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:11.989229 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:11.989229 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:11.989229 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:11.989229 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:11.989229 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:11.989229 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:27:11.989229 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:11.989818 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 209/420] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Sep 30 09:27:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:11.998630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db24fc-6d07-48fd-b9f0-0d43d4311a4e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:12.005390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b4f7a-7993-48a2-9e80-42fdb7a46a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:12.006013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b4f7a-7993-48a2-9e80-42fdb7a46a17 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:12.006286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b4f7a-7993-48a2-9e80-42fdb7a46a17 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:12.006552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b4f7a-7993-48a2-9e80-42fdb7a46a17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:12.026887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b4f7a-7993-48a2-9e80-42fdb7a46a17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:12.031860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-b22b4f7a-7993-48a2-9e80-42fdb7a46a17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:27:12.031860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:12.031860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:12.031860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:12.031860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:12.031860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:12.031860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:12.031860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:12.031860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:12.031860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:12.031860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:12.031860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:12.031860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:12.031860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:12.031860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:12.031860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:12.034026 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:12.034026 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:12.034026 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:12.034026 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:12.034026 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:12.034026 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:12.034026 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:12.034026 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:12.034026 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:12.034026 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:12.034026 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:12.034026 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:12.034026 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:12.034026 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:12.034026 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:12.034026 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:12.035983 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:12.035983 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:12.035983 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:12.035983 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:12.035983 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:12.035983 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:12.035983 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:12.035983 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:12.035983 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:12.035983 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:12.035983 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:27:12.035983 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:12.035983 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 212/421] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:12.042057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b4f7a-7993-48a2-9e80-42fdb7a46a17 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:12.169733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db24fc-6d07-48fd-b9f0-0d43d4311a4e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:12.197418 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:12.210485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b4f7a-7993-48a2-9e80-42fdb7a46a17 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:12.231286 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:12.246459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be1787-9e94-4dc6-a8fd-e65f87e78c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:12.247067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be1787-9e94-4dc6-a8fd-e65f87e78c27 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:12.247338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be1787-9e94-4dc6-a8fd-e65f87e78c27 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:12.247604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be1787-9e94-4dc6-a8fd-e65f87e78c27 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:12.248268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be1787-9e94-4dc6-a8fd-e65f87e78c27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:12.248563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be1787-9e94-4dc6-a8fd-e65f87e78c27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:12.249944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be1787-9e94-4dc6-a8fd-e65f87e78c27 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:12.251348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0db574-2438-420c-b01d-e55e33a1a341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:12.251956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0db574-2438-420c-b01d-e55e33a1a341 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:12.252336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0db574-2438-420c-b01d-e55e33a1a341 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:12.252638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0db574-2438-420c-b01d-e55e33a1a341 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:12.253583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0db574-2438-420c-b01d-e55e33a1a341 None admin] RBAC: Adding query filter params (name=member) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:12.253888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0db574-2438-420c-b01d-e55e33a1a341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:12.256668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0db574-2438-420c-b01d-e55e33a1a341 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:12.267573 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 210/423] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:12.270947 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 213/423] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:27:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:12.272201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be1787-9e94-4dc6-a8fd-e65f87e78c27 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:12.276577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0db574-2438-420c-b01d-e55e33a1a341 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:12.405202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be1787-9e94-4dc6-a8fd-e65f87e78c27 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:12.472330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4295490-5fcc-4f79-8b02-7e59a1c258af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:12.473817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4295490-5fcc-4f79-8b02-7e59a1c258af None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:12.474455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4295490-5fcc-4f79-8b02-7e59a1c258af None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:12.476416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0db574-2438-420c-b01d-e55e33a1a341 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:12.476933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4295490-5fcc-4f79-8b02-7e59a1c258af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:12.525607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f839bde-0335-4761-bf27-6859113af173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:12.526512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f839bde-0335-4761-bf27-6859113af173 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:12.527118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f839bde-0335-4761-bf27-6859113af173 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:12.527568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f839bde-0335-4761-bf27-6859113af173 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:12.584780 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:12.606065 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:12.631827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4295490-5fcc-4f79-8b02-7e59a1c258af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:12.633643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4295490-5fcc-4f79-8b02-7e59a1c258af None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:12.669400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f839bde-0335-4761-bf27-6859113af173 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:12.670914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f839bde-0335-4761-bf27-6859113af173 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:12.747230 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 211/424] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:27:12.749127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4295490-5fcc-4f79-8b02-7e59a1c258af None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:12.874555 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:12.929258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4295490-5fcc-4f79-8b02-7e59a1c258af None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:12.929364 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 214/425] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:27:12.930953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f839bde-0335-4761-bf27-6859113af173 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:12.989891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442c775-b7ff-4207-b28f-6986faa2745a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:12.990526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442c775-b7ff-4207-b28f-6986faa2745a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:12.990802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442c775-b7ff-4207-b28f-6986faa2745a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:12.991073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442c775-b7ff-4207-b28f-6986faa2745a None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:12.999736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442c775-b7ff-4207-b28f-6986faa2745a None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d26f75111496bae034056bc6ed395)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:13.001226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442c775-b7ff-4207-b28f-6986faa2745a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:13.003097 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 212/426] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:12 2022] GET /identity/v3/projects/ee1d26f75111496bae034056bc6ed395 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:13.008655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442c775-b7ff-4207-b28f-6986faa2745a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:13.101746 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:13.142016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f839bde-0335-4761-bf27-6859113af173 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:13.177872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442c775-b7ff-4207-b28f-6986faa2745a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:13.222425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ef9c7-7822-43aa-a772-2d8721611c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:13.223060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ef9c7-7822-43aa-a772-2d8721611c73 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:13.223342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ef9c7-7822-43aa-a772-2d8721611c73 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:13.223611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ef9c7-7822-43aa-a772-2d8721611c73 None admin] PATH_INFO: `/v3/projects/ee1d26f75111496bae034056bc6ed395` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:13.225261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ef9c7-7822-43aa-a772-2d8721611c73 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d26f75111496bae034056bc6ed395)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:13.226694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ef9c7-7822-43aa-a772-2d8721611c73 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:13.232859 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 215/427] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:12 2022] GET /identity/v3/projects/ee1d26f75111496bae034056bc6ed395 => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:13.235012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ef9c7-7822-43aa-a772-2d8721611c73 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:13.248144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d198b-f35e-4ee3-b2f9-a43054a3bffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:13.248797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d198b-f35e-4ee3-b2f9-a43054a3bffc None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:13.249077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d198b-f35e-4ee3-b2f9-a43054a3bffc None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:13.249346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d198b-f35e-4ee3-b2f9-a43054a3bffc None admin] PATH_INFO: `/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:13.250584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d198b-f35e-4ee3-b2f9-a43054a3bffc None admin] RBAC: Authorizing `identity:get_group(group_id=dc6a69c1b2c84b519486bb9b211a29b3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:13.252081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d198b-f35e-4ee3-b2f9-a43054a3bffc None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:13.260697 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 213/428] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Sep 30 09:27:13 2022] GET /identity/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3 => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:13.265546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d198b-f35e-4ee3-b2f9-a43054a3bffc None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:13.293054 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:13.374294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ef9c7-7822-43aa-a772-2d8721611c73 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:13.402550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d198b-f35e-4ee3-b2f9-a43054a3bffc None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:13.416979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2c417-f8e4-40de-b070-cd2ae07211ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:13.417955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2c417-f8e4-40de-b070-cd2ae07211ed None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:13.417955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2c417-f8e4-40de-b070-cd2ae07211ed None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:13.418289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2c417-f8e4-40de-b070-cd2ae07211ed None admin] PATH_INFO: `/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:13.419501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2c417-f8e4-40de-b070-cd2ae07211ed None admin] RBAC: Authorizing `identity:get_group(group_id=dc6a69c1b2c84b519486bb9b211a29b3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:13.421116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2c417-f8e4-40de-b070-cd2ae07211ed None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:13.422975 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 216/429] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Sep 30 09:27:13 2022] GET /identity/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:13.424173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b47ab-597b-43b0-86e5-e78fb5d27081 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:13.424524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b47ab-597b-43b0-86e5-e78fb5d27081 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:13.424909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b47ab-597b-43b0-86e5-e78fb5d27081 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:13.430607 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 217/430] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:13.431508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b47ab-597b-43b0-86e5-e78fb5d27081 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:13.450653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263e0ca-3a16-46e5-b36e-fc6927b126e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:13.451523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263e0ca-3a16-46e5-b36e-fc6927b126e3 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:13.451978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263e0ca-3a16-46e5-b36e-fc6927b126e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:13.452754 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:13.453187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263e0ca-3a16-46e5-b36e-fc6927b126e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:13.454809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263e0ca-3a16-46e5-b36e-fc6927b126e3 None admin] RBAC: Adding query filter params (group.id=dc6a69c1b2c84b519486bb9b211a29b3, role.id=f642af7fc1fd472d8f4a4d6f34548ba2, scope.project.id=ee1d26f75111496bae034056bc6ed395) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:13.455457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263e0ca-3a16-46e5-b36e-fc6927b126e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:13.457805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263e0ca-3a16-46e5-b36e-fc6927b126e3 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:13.471886 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 214/431] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Sep 30 09:27:13 2022] GET /identity/v3/role_assignments?group.id=dc6a69c1b2c84b519486bb9b211a29b3&scope.project.id=ee1d26f75111496bae034056bc6ed395&role.id=f642af7fc1fd472d8f4a4d6f34548ba2 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:13.474639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94aa8c0-7c29-4d7e-909a-5da4b783be1e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:13.475138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94aa8c0-7c29-4d7e-909a-5da4b783be1e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:13.475608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94aa8c0-7c29-4d7e-909a-5da4b783be1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:13.498138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d94aa8c0-7c29-4d7e-909a-5da4b783be1e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:13.499782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d94aa8c0-7c29-4d7e-909a-5da4b783be1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:13.587994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b47ab-597b-43b0-86e5-e78fb5d27081 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:13.597068 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 215/432] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:13.599260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db23e32-440d-4173-8e57-749fbb05fbf3 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:13.599728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db23e32-440d-4173-8e57-749fbb05fbf3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:13.600550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db23e32-440d-4173-8e57-749fbb05fbf3 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:13.602767 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 216/433] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:13.608530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a041d1-70c0-47ad-99ef-bc61b9013da3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:13.608844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a041d1-70c0-47ad-99ef-bc61b9013da3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:13.609104 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a041d1-70c0-47ad-99ef-bc61b9013da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:13.616571 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:13.629895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277f326-fda6-4e2b-8694-34a82f87c313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:13.630914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277f326-fda6-4e2b-8694-34a82f87c313 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:13.631130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-27a041d1-70c0-47ad-99ef-bc61b9013da3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:13.631588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277f326-fda6-4e2b-8694-34a82f87c313 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:13.632033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277f326-fda6-4e2b-8694-34a82f87c313 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:13.632333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-27a041d1-70c0-47ad-99ef-bc61b9013da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:13.633212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277f326-fda6-4e2b-8694-34a82f87c313 None admin] RBAC: Adding query filter params (group.id=dc6a69c1b2c84b519486bb9b211a29b3, role.id=27410223fa7d4717a71ac6753c80420b, scope.project.id=ee1d26f75111496bae034056bc6ed395) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:13.633759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277f326-fda6-4e2b-8694-34a82f87c313 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:13.636467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277f326-fda6-4e2b-8694-34a82f87c313 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:13.643286 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 218/434] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Sep 30 09:27:13 2022] GET /identity/v3/role_assignments?group.id=dc6a69c1b2c84b519486bb9b211a29b3&scope.project.id=ee1d26f75111496bae034056bc6ed395&role.id=27410223fa7d4717a71ac6753c80420b => generated 611 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:13.711746 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 217/435] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:27:13.895308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277f326-fda6-4e2b-8694-34a82f87c313 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:13.994136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a041d1-70c0-47ad-99ef-bc61b9013da3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:14.004651 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:14.031774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277f326-fda6-4e2b-8694-34a82f87c313 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:14.075895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5230453-0cce-4fb8-8823-574827fa6622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:14.075895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5230453-0cce-4fb8-8823-574827fa6622 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:14.075895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5230453-0cce-4fb8-8823-574827fa6622 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:14.075895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5230453-0cce-4fb8-8823-574827fa6622 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:14.091426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5230453-0cce-4fb8-8823-574827fa6622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:14.096800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-f5230453-0cce-4fb8-8823-574827fa6622 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:27:14.096800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:14.096800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:14.096800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:14.096800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:14.096800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:14.096800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:14.096800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:14.096800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:14.096800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:14.096800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:14.096800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:14.096800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:14.096800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:14.096800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:14.096800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:14.097765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:14.097765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:14.097765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:14.097765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:14.097765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:14.097765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:14.097765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:14.097765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:14.097765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:14.097765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:14.097765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:14.097765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:14.097765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:14.097765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:14.097765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:14.097765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:14.098548 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:14.098548 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:14.098548 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:14.098548 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:14.098548 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:14.098548 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:14.098548 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:14.098548 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:14.098548 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:14.098548 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:14.098548 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 09:27:14.098548 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:14.098548 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 219/436] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:14.099212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd58bf-9ff2-47ef-8f94-2ed1352ca146 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:14.099421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd58bf-9ff2-47ef-8f94-2ed1352ca146 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:14.099872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd58bf-9ff2-47ef-8f94-2ed1352ca146 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:14.100939 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 220/437] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:14.105850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd58bf-9ff2-47ef-8f94-2ed1352ca146 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:14.126947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a041d1-70c0-47ad-99ef-bc61b9013da3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:14.170619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6791f-a733-42a8-9e52-37b01b525e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:14.171675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6791f-a733-42a8-9e52-37b01b525e49 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:14.172089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6791f-a733-42a8-9e52-37b01b525e49 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:14.172361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6791f-a733-42a8-9e52-37b01b525e49 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:14.175952 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:14.191815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6791f-a733-42a8-9e52-37b01b525e49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:14.199204 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-27a6791f-a733-42a8-9e52-37b01b525e49 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:27:14.199204 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:14.199204 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:14.199204 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:14.199204 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:14.199204 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:14.199204 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:14.199204 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:14.199204 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:14.199204 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:14.199204 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:14.199204 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:14.199204 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:14.199204 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:14.199204 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:14.199204 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:14.200833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:14.200833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:14.200833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:14.200833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:14.200833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:14.200833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:14.200833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:14.200833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:14.200833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:14.200833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:14.200833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:14.200833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:14.200833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:14.200833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:14.200833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:14.200833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:14.201615 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:14.201615 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:14.201615 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:14.201615 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:14.201615 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:14.201615 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:14.201615 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:14.201615 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:14.201615 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:14.201615 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:14.201615 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:27:14.201615 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:14.201615 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 218/438] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Sep 30 09:27:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:27:14.202263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b149d3-4e0c-4e33-bb52-55657f0425ce None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:14.202328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b149d3-4e0c-4e33-bb52-55657f0425ce None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:14.204632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b149d3-4e0c-4e33-bb52-55657f0425ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:14.222386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-09b149d3-4e0c-4e33-bb52-55657f0425ce None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:14.223357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-09b149d3-4e0c-4e33-bb52-55657f0425ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:14.236694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd58bf-9ff2-47ef-8f94-2ed1352ca146 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:14.278545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7b857-83d5-4af3-a02f-85533029892d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:14.279068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7b857-83d5-4af3-a02f-85533029892d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:14.279341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7b857-83d5-4af3-a02f-85533029892d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:14.279613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7b857-83d5-4af3-a02f-85533029892d None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:14.280269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7b857-83d5-4af3-a02f-85533029892d None admin] RBAC: Adding query filter params (name=member) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:14.280569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7b857-83d5-4af3-a02f-85533029892d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:14.282863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7b857-83d5-4af3-a02f-85533029892d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:14.293173 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 221/439] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:27:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:14.294177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7b857-83d5-4af3-a02f-85533029892d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:14.297034 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:14.317095 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 219/440] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:14.317786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b149d3-4e0c-4e33-bb52-55657f0425ce None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:14.402967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7b857-83d5-4af3-a02f-85533029892d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:14.435686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b149d3-4e0c-4e33-bb52-55657f0425ce None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:14.438853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39901b-e9a4-4d1a-b8f3-13a5bc35c55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:14.439471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39901b-e9a4-4d1a-b8f3-13a5bc35c55d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:14.439750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39901b-e9a4-4d1a-b8f3-13a5bc35c55d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:14.440018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39901b-e9a4-4d1a-b8f3-13a5bc35c55d None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:14.440723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39901b-e9a4-4d1a-b8f3-13a5bc35c55d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:14.441029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39901b-e9a4-4d1a-b8f3-13a5bc35c55d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:14.442777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39901b-e9a4-4d1a-b8f3-13a5bc35c55d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:14.452535 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 222/441] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:14.458372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39901b-e9a4-4d1a-b8f3-13a5bc35c55d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:14.460137 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:14.474083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99080a20-31f4-4444-b9d9-403017f2e887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:14.474694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99080a20-31f4-4444-b9d9-403017f2e887 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:14.474969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99080a20-31f4-4444-b9d9-403017f2e887 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:14.475233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99080a20-31f4-4444-b9d9-403017f2e887 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:14.530404 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:14.548374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99080a20-31f4-4444-b9d9-403017f2e887 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:14.549871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99080a20-31f4-4444-b9d9-403017f2e887 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:14.570818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39901b-e9a4-4d1a-b8f3-13a5bc35c55d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:14.607708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6af23-0aa8-4d1f-abf3-01f9efc0637e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:14.608311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6af23-0aa8-4d1f-abf3-01f9efc0637e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:14.608589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6af23-0aa8-4d1f-abf3-01f9efc0637e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:14.608955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6af23-0aa8-4d1f-abf3-01f9efc0637e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:14.651656 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 220/442] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:27:14.652493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99080a20-31f4-4444-b9d9-403017f2e887 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:14.675448 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:14.682768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6af23-0aa8-4d1f-abf3-01f9efc0637e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:14.684226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6af23-0aa8-4d1f-abf3-01f9efc0637e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:14.742786 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:14.750319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99080a20-31f4-4444-b9d9-403017f2e887 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:14.781307 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 223/443] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 09:27:14.782066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6af23-0aa8-4d1f-abf3-01f9efc0637e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:14.787623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71152977-e148-49f7-abf9-ea1f504f20d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:14.788242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71152977-e148-49f7-abf9-ea1f504f20d6 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:14.788514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71152977-e148-49f7-abf9-ea1f504f20d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:14.788830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71152977-e148-49f7-abf9-ea1f504f20d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:14.800112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71152977-e148-49f7-abf9-ea1f504f20d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:14.805269 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-71152977-e148-49f7-abf9-ea1f504f20d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:14.805269 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:14.805269 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:14.805269 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:14.805269 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:14.805269 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:14.805269 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:14.805269 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:14.805269 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:14.805269 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:14.805269 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:14.805269 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:14.805269 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:14.805269 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:14.805269 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:14.805269 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:14.806699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:14.806699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:14.806699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:14.806699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:14.806699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:14.806699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:14.806699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:14.806699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:14.806699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:14.806699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:14.806699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:14.806699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:14.806699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:14.806699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:14.806699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:14.806699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:14.807488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:14.807488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:14.807488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:14.807488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:14.807488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:14.807488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:14.807488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:14.807488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:14.807488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:14.807488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:14.807488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:14.807488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:14.807488 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 221/444] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:27:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:14.808131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71152977-e148-49f7-abf9-ea1f504f20d6 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:14.885385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6af23-0aa8-4d1f-abf3-01f9efc0637e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:14.891299 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:14.908113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71152977-e148-49f7-abf9-ea1f504f20d6 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:14.921214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02b3bb-fa51-40a3-8c00-945d13c068fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:14.921848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02b3bb-fa51-40a3-8c00-945d13c068fa None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:14.922127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02b3bb-fa51-40a3-8c00-945d13c068fa None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:14.922402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02b3bb-fa51-40a3-8c00-945d13c068fa None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:14.923508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02b3bb-fa51-40a3-8c00-945d13c068fa None admin] RBAC: Authorizing `identity:get_project(project_id=22150ed8c7364fe3b686c6a086484995)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:14.924976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02b3bb-fa51-40a3-8c00-945d13c068fa None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:14.926587 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 224/445] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:14 2022] GET /identity/v3/projects/22150ed8c7364fe3b686c6a086484995 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:14.927339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02b3bb-fa51-40a3-8c00-945d13c068fa None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:14.948087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb1ee8-4045-42df-a69b-27b0cce3d3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:14.948739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb1ee8-4045-42df-a69b-27b0cce3d3f2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:14.949018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb1ee8-4045-42df-a69b-27b0cce3d3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:14.949285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb1ee8-4045-42df-a69b-27b0cce3d3f2 None admin] PATH_INFO: `/v3/projects/22150ed8c7364fe3b686c6a086484995` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:14.950403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb1ee8-4045-42df-a69b-27b0cce3d3f2 None admin] RBAC: Authorizing `identity:get_project(project_id=22150ed8c7364fe3b686c6a086484995)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:14.951824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb1ee8-4045-42df-a69b-27b0cce3d3f2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:14.953457 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 222/446] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:14 2022] GET /identity/v3/projects/22150ed8c7364fe3b686c6a086484995 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:14.954207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb1ee8-4045-42df-a69b-27b0cce3d3f2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:14.965709 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:15.033506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02b3bb-fa51-40a3-8c00-945d13c068fa None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:15.061414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb1ee8-4045-42df-a69b-27b0cce3d3f2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:15.066684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f1476-149a-465b-8b3d-6615915a2ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:15.067285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f1476-149a-465b-8b3d-6615915a2ac4 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:15.067561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f1476-149a-465b-8b3d-6615915a2ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:15.067832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f1476-149a-465b-8b3d-6615915a2ac4 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:15.068486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f1476-149a-465b-8b3d-6615915a2ac4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:15.068817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f1476-149a-465b-8b3d-6615915a2ac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:15.070183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f1476-149a-465b-8b3d-6615915a2ac4 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:15.078282 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 225/447] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:15.079359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f1476-149a-465b-8b3d-6615915a2ac4 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:15.100093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ceb07c-6c72-4968-82d8-07ef2c2451d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:15.100748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ceb07c-6c72-4968-82d8-07ef2c2451d2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:15.101025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ceb07c-6c72-4968-82d8-07ef2c2451d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:15.101293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ceb07c-6c72-4968-82d8-07ef2c2451d2 None admin] PATH_INFO: `/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:15.102427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ceb07c-6c72-4968-82d8-07ef2c2451d2 None admin] RBAC: Authorizing `identity:get_group(group_id=dc6a69c1b2c84b519486bb9b211a29b3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:15.104857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ceb07c-6c72-4968-82d8-07ef2c2451d2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:15.106421 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 223/448] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Sep 30 09:27:14 2022] GET /identity/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:15.107171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ceb07c-6c72-4968-82d8-07ef2c2451d2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:15.133998 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:15.180499 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:15.188223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f1476-149a-465b-8b3d-6615915a2ac4 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:15.212955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ceb07c-6c72-4968-82d8-07ef2c2451d2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:15.220802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771a78c-f76a-41f6-a964-6e740fd1661e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:15.221412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771a78c-f76a-41f6-a964-6e740fd1661e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:15.221687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771a78c-f76a-41f6-a964-6e740fd1661e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:15.221954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771a78c-f76a-41f6-a964-6e740fd1661e None admin] PATH_INFO: `/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:15.223049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771a78c-f76a-41f6-a964-6e740fd1661e None admin] RBAC: Authorizing `identity:get_group(group_id=dc6a69c1b2c84b519486bb9b211a29b3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:15.224453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771a78c-f76a-41f6-a964-6e740fd1661e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:15.226019 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 226/449] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Sep 30 09:27:15 2022] GET /identity/v3/groups/dc6a69c1b2c84b519486bb9b211a29b3 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:15.226764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771a78c-f76a-41f6-a964-6e740fd1661e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:15.247066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9983a33-00a1-4fe3-97db-a34e460b26fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:15.247659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9983a33-00a1-4fe3-97db-a34e460b26fa None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:15.247934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9983a33-00a1-4fe3-97db-a34e460b26fa None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:15.248203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9983a33-00a1-4fe3-97db-a34e460b26fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:15.320339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9983a33-00a1-4fe3-97db-a34e460b26fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:15.321752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9983a33-00a1-4fe3-97db-a34e460b26fa None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:15.327999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771a78c-f76a-41f6-a964-6e740fd1661e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:15.344233 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:15.362224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c67ac-fdc1-41ae-b18a-7cc1df7a9bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:15.362831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c67ac-fdc1-41ae-b18a-7cc1df7a9bb9 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:15.363109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c67ac-fdc1-41ae-b18a-7cc1df7a9bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:15.363380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c67ac-fdc1-41ae-b18a-7cc1df7a9bb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:15.364100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c67ac-fdc1-41ae-b18a-7cc1df7a9bb9 None admin] RBAC: Adding query filter params (group.id=dc6a69c1b2c84b519486bb9b211a29b3, role.id=f642af7fc1fd472d8f4a4d6f34548ba2, scope.project.id=22150ed8c7364fe3b686c6a086484995) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:15.364414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c67ac-fdc1-41ae-b18a-7cc1df7a9bb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:15.365855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c67ac-fdc1-41ae-b18a-7cc1df7a9bb9 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:15.371969 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 227/450] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Sep 30 09:27:15 2022] GET /identity/v3/role_assignments?group.id=dc6a69c1b2c84b519486bb9b211a29b3&scope.project.id=22150ed8c7364fe3b686c6a086484995&role.id=f642af7fc1fd472d8f4a4d6f34548ba2 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:15.372660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c67ac-fdc1-41ae-b18a-7cc1df7a9bb9 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:15.403551 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:15.446062 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 224/451] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:27:15.447514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9983a33-00a1-4fe3-97db-a34e460b26fa None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:15.487978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c67ac-fdc1-41ae-b18a-7cc1df7a9bb9 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:15.523470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192fbf0-3535-422a-afb7-d843ab282e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:15.524431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192fbf0-3535-422a-afb7-d843ab282e02 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:15.525461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192fbf0-3535-422a-afb7-d843ab282e02 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:15.525749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192fbf0-3535-422a-afb7-d843ab282e02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:15.526525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192fbf0-3535-422a-afb7-d843ab282e02 None admin] RBAC: Adding query filter params (group.id=dc6a69c1b2c84b519486bb9b211a29b3, role.id=27410223fa7d4717a71ac6753c80420b, scope.project.id=22150ed8c7364fe3b686c6a086484995) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:15.526831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192fbf0-3535-422a-afb7-d843ab282e02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:15.528286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192fbf0-3535-422a-afb7-d843ab282e02 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:15.535174 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 228/452] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Sep 30 09:27:15 2022] GET /identity/v3/role_assignments?group.id=dc6a69c1b2c84b519486bb9b211a29b3&scope.project.id=22150ed8c7364fe3b686c6a086484995&role.id=27410223fa7d4717a71ac6753c80420b => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:15.573605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9983a33-00a1-4fe3-97db-a34e460b26fa None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:15.597774 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:15.615397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da885582-d79d-4cd9-876a-e40660510e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:15.616040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da885582-d79d-4cd9-876a-e40660510e48 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:15.616316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da885582-d79d-4cd9-876a-e40660510e48 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:15.616583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da885582-d79d-4cd9-876a-e40660510e48 None admin] PATH_INFO: `/v3/projects/2ffba943875a42809c70ac5c9bd54394` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:15.617917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da885582-d79d-4cd9-876a-e40660510e48 None admin] RBAC: Authorizing `identity:get_project(project_id=2ffba943875a42809c70ac5c9bd54394)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:15.619541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da885582-d79d-4cd9-876a-e40660510e48 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:15.621474 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 225/453] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:27:15 2022] GET /identity/v3/projects/2ffba943875a42809c70ac5c9bd54394 => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:15.629957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192fbf0-3535-422a-afb7-d843ab282e02 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:15.741082 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:15.752502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192fbf0-3535-422a-afb7-d843ab282e02 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:15.788382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6f676-fe0f-4f4a-991a-89881fd5ab54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:15.789039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6f676-fe0f-4f4a-991a-89881fd5ab54 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:15.789315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6f676-fe0f-4f4a-991a-89881fd5ab54 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:15.789586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6f676-fe0f-4f4a-991a-89881fd5ab54 None admin] PATH_INFO: `/v3/groups/0f56e9769ab842ce8a70d0f67176b6c3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:15.791238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6f676-fe0f-4f4a-991a-89881fd5ab54 None admin] RBAC: Authorizing `identity:get_group(group_id=0f56e9769ab842ce8a70d0f67176b6c3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:15.792710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6f676-fe0f-4f4a-991a-89881fd5ab54 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:15.794262 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 229/454] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Sep 30 09:27:15 2022] GET /identity/v3/groups/0f56e9769ab842ce8a70d0f67176b6c3 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:15.800131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da885582-d79d-4cd9-876a-e40660510e48 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:15.903496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da885582-d79d-4cd9-876a-e40660510e48 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:15.939753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39727637-c9bf-48f9-bebc-15565f06afa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:15.940343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39727637-c9bf-48f9-bebc-15565f06afa6 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:15.940630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39727637-c9bf-48f9-bebc-15565f06afa6 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:15.940907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39727637-c9bf-48f9-bebc-15565f06afa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:15.941629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39727637-c9bf-48f9-bebc-15565f06afa6 None admin] RBAC: Adding query filter params (group.id=0f56e9769ab842ce8a70d0f67176b6c3, role.id=f06b5fed717d4b03a5083dd847274296, scope.project.id=2ffba943875a42809c70ac5c9bd54394) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:15.941931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39727637-c9bf-48f9-bebc-15565f06afa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:15.943337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39727637-c9bf-48f9-bebc-15565f06afa6 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:15.949620 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 226/455] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Sep 30 09:27:15 2022] GET /identity/v3/role_assignments?group.id=0f56e9769ab842ce8a70d0f67176b6c3&scope.project.id=2ffba943875a42809c70ac5c9bd54394&role.id=f06b5fed717d4b03a5083dd847274296 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:18.787211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af01f3-93db-417a-9948-74716f26efc8 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:18.787788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af01f3-93db-417a-9948-74716f26efc8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:18.787788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af01f3-93db-417a-9948-74716f26efc8 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:18.789415 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 230/456] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:18.796787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c679b2-24ec-4dc1-a860-4db7cd8f1762 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:18.797412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c679b2-24ec-4dc1-a860-4db7cd8f1762 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:18.797620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c679b2-24ec-4dc1-a860-4db7cd8f1762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:18.826229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f8c679b2-24ec-4dc1-a860-4db7cd8f1762 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:18.827416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f8c679b2-24ec-4dc1-a860-4db7cd8f1762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:18.844984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a2240-fcb5-4c41-8124-f4ddfda51810 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:18.845280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a2240-fcb5-4c41-8124-f4ddfda51810 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:18.845525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a2240-fcb5-4c41-8124-f4ddfda51810 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:18.847091 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 231/457] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:18.848098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a832c5-aced-403e-b698-8de48a4c2338 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:18.848377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a832c5-aced-403e-b698-8de48a4c2338 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:18.848667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a832c5-aced-403e-b698-8de48a4c2338 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:18.849941 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 232/458] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:18.855468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e298223-f4ed-4266-8df7-e9b7dc0bcf4a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:18.855754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e298223-f4ed-4266-8df7-e9b7dc0bcf4a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:18.856029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e298223-f4ed-4266-8df7-e9b7dc0bcf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:18.874753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1e298223-f4ed-4266-8df7-e9b7dc0bcf4a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:18.875930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1e298223-f4ed-4266-8df7-e9b7dc0bcf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:18.890158 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:18.914439 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 227/459] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:18.916353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7616de-ea2d-4c3b-b667-bb97e9b84162 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:18.916668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7616de-ea2d-4c3b-b667-bb97e9b84162 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:18.916945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7616de-ea2d-4c3b-b667-bb97e9b84162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:18.935627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9b7616de-ea2d-4c3b-b667-bb97e9b84162 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:18.937048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9b7616de-ea2d-4c3b-b667-bb97e9b84162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:19.017686 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 228/460] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:19.022115 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 233/461] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:27:19.326111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7616de-ea2d-4c3b-b667-bb97e9b84162 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:19.334181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e298223-f4ed-4266-8df7-e9b7dc0bcf4a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:19.426556 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:19.436796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7616de-ea2d-4c3b-b667-bb97e9b84162 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:19.440009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e298223-f4ed-4266-8df7-e9b7dc0bcf4a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:19.449975 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:19.472519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c73ed8-4c05-41d2-8e48-41455b6342e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:19.473171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c73ed8-4c05-41d2-8e48-41455b6342e6 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:19.473450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c73ed8-4c05-41d2-8e48-41455b6342e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:19.473712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c73ed8-4c05-41d2-8e48-41455b6342e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:19.476204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1644e-c016-4245-91e6-5cc63ac9c04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:19.477301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1644e-c016-4245-91e6-5cc63ac9c04c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:19.477778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1644e-c016-4245-91e6-5cc63ac9c04c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:19.478841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1644e-c016-4245-91e6-5cc63ac9c04c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:19.485606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c73ed8-4c05-41d2-8e48-41455b6342e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:19.487721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c73ed8-4c05-41d2-8e48-41455b6342e6 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:19.495045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1644e-c016-4245-91e6-5cc63ac9c04c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:19.497538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1644e-c016-4245-91e6-5cc63ac9c04c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:19.507421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-89c73ed8-4c05-41d2-8e48-41455b6342e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:19.507421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:19.507421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:19.507421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:19.507421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:19.507421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:19.507421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:19.507421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:19.507421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:19.507421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:19.507421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:19.507421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:19.507421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:19.507421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:19.507421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:19.507421 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:19.508386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:19.508386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:19.508386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:19.508386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:19.508386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:19.508386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:19.508386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:19.508386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:19.508386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:19.508386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:19.508386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:19.508386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:19.508386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:19.508386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:19.508386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:19.508386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:19.508386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:19.510025 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:19.510025 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:19.510025 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:19.510025 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 229/462] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:19.510819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c73ed8-4c05-41d2-8e48-41455b6342e6 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:19.520530 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-87d1644e-c016-4245-91e6-5cc63ac9c04c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:19.520530 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:19.520530 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:19.520530 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:19.520530 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:19.520530 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:19.520530 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:19.520530 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:19.520530 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:19.520530 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:19.520530 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:19.520530 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:19.520530 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:19.520530 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:19.520530 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:19.520530 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:19.521535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:19.521535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:19.521535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:19.521535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:19.521535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:19.521535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:19.521535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:19.521535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:19.521535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:19.521535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:19.521535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:19.521535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:19.521535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:19.521535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:19.521535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:19.521535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:19.521535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:19.522362 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:19.522362 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:19.522362 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:19.522519 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 234/463] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:27:19.526905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c146b95-cd24-4cc9-80ba-12cd23f5c475 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:19.526905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c146b95-cd24-4cc9-80ba-12cd23f5c475 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:19.526905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c146b95-cd24-4cc9-80ba-12cd23f5c475 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:19.526905 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 235/464] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:19.528020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c146b95-cd24-4cc9-80ba-12cd23f5c475 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:19.615565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c73ed8-4c05-41d2-8e48-41455b6342e6 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:19.638645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c146b95-cd24-4cc9-80ba-12cd23f5c475 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:19.651029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834f4ea-d37e-4acd-a576-05e1254ee015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:19.651638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834f4ea-d37e-4acd-a576-05e1254ee015 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:19.651914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834f4ea-d37e-4acd-a576-05e1254ee015 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:19.652182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834f4ea-d37e-4acd-a576-05e1254ee015 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:19.663151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834f4ea-d37e-4acd-a576-05e1254ee015 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:19.664572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834f4ea-d37e-4acd-a576-05e1254ee015 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:19.673837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be515a-af4a-49fb-990c-e2ae853f975b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:19.674461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be515a-af4a-49fb-990c-e2ae853f975b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:19.674734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be515a-af4a-49fb-990c-e2ae853f975b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:19.674982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be515a-af4a-49fb-990c-e2ae853f975b None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:19.675619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be515a-af4a-49fb-990c-e2ae853f975b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:19.675923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be515a-af4a-49fb-990c-e2ae853f975b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:19.677301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be515a-af4a-49fb-990c-e2ae853f975b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:19.679565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-1834f4ea-d37e-4acd-a576-05e1254ee015 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:19.679565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:19.679565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:19.679565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:19.679565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:19.679565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:19.679565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:19.679565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:19.679565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:19.679565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:19.679565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:19.679565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:19.679565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:19.679565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:19.679565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:19.679565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:19.680407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:19.680407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:19.680407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:19.680407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:19.680407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:19.680407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:19.680407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:19.680407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:19.680407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:19.680407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:19.680407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:19.680407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:19.680407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:19.680407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:19.680407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:19.680407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:19.680407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:19.687248 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:19.687248 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:19.687248 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:19.687248 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 230/465] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:19.687248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834f4ea-d37e-4acd-a576-05e1254ee015 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:19.699896 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:19.704802 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 236/466] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:19.706001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb524b5-a13f-4450-8ae9-482671f2639a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:19.706278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb524b5-a13f-4450-8ae9-482671f2639a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:19.706795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb524b5-a13f-4450-8ae9-482671f2639a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:19.711131 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:19.727490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ffb524b5-a13f-4450-8ae9-482671f2639a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:19.728854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ffb524b5-a13f-4450-8ae9-482671f2639a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:19.798975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834f4ea-d37e-4acd-a576-05e1254ee015 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:19.801866 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 237/467] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:19.802585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb524b5-a13f-4450-8ae9-482671f2639a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:19.842399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bbd17-2e9e-47fe-afc9-710b729cf341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:19.843338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bbd17-2e9e-47fe-afc9-710b729cf341 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:19.843875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bbd17-2e9e-47fe-afc9-710b729cf341 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:19.844336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bbd17-2e9e-47fe-afc9-710b729cf341 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:19.845452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bbd17-2e9e-47fe-afc9-710b729cf341 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:19.846247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bbd17-2e9e-47fe-afc9-710b729cf341 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:19.848036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bbd17-2e9e-47fe-afc9-710b729cf341 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:19.861834 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 231/468] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:19.863029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bbd17-2e9e-47fe-afc9-710b729cf341 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:19.935043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb524b5-a13f-4450-8ae9-482671f2639a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:19.957984 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:19.978058 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:19.984305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bbd17-2e9e-47fe-afc9-710b729cf341 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:19.988422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f7653-d388-4965-ad27-3d6fe14e7690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:19.989249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f7653-d388-4965-ad27-3d6fe14e7690 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:19.989697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f7653-d388-4965-ad27-3d6fe14e7690 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:19.990134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f7653-d388-4965-ad27-3d6fe14e7690 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:19.990958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f7653-d388-4965-ad27-3d6fe14e7690 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:19.991423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f7653-d388-4965-ad27-3d6fe14e7690 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:19.993645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f7653-d388-4965-ad27-3d6fe14e7690 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:20.014494 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 238/469] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:20.014494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f7653-d388-4965-ad27-3d6fe14e7690 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:20.024544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0bed8-197f-4bcc-9d24-656e6964a6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:20.026165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0bed8-197f-4bcc-9d24-656e6964a6d0 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:20.026646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0bed8-197f-4bcc-9d24-656e6964a6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:20.027164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0bed8-197f-4bcc-9d24-656e6964a6d0 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:20.027906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0bed8-197f-4bcc-9d24-656e6964a6d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:20.029578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0bed8-197f-4bcc-9d24-656e6964a6d0 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:20.056678 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 232/470] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Sep 30 09:27:19 2022] POST /identity/v3/users => generated 246 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:27:20.057708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0bed8-197f-4bcc-9d24-656e6964a6d0 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:20.169001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f7653-d388-4965-ad27-3d6fe14e7690 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:20.201351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0bed8-197f-4bcc-9d24-656e6964a6d0 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:20.205438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00254f-eb34-4dd3-b5a1-b0f7981d1167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:20.206059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00254f-eb34-4dd3-b5a1-b0f7981d1167 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:20.206327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00254f-eb34-4dd3-b5a1-b0f7981d1167 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:20.206846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00254f-eb34-4dd3-b5a1-b0f7981d1167 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:20.207512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00254f-eb34-4dd3-b5a1-b0f7981d1167 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:20.209038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00254f-eb34-4dd3-b5a1-b0f7981d1167 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:20.234642 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 239/471] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Sep 30 09:27:20 2022] POST /identity/v3/users => generated 248 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:27:20.235887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00254f-eb34-4dd3-b5a1-b0f7981d1167 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:20.247719 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:20.250316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd431a8-d2da-4ed8-9d52-ae305eb380c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:20.251173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd431a8-d2da-4ed8-9d52-ae305eb380c8 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:20.252877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd431a8-d2da-4ed8-9d52-ae305eb380c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:20.253435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd431a8-d2da-4ed8-9d52-ae305eb380c8 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:20.254693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd431a8-d2da-4ed8-9d52-ae305eb380c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:20.256475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd431a8-d2da-4ed8-9d52-ae305eb380c8 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:20.283321 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 233/472] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Sep 30 09:27:20 2022] POST /identity/v3/users => generated 248 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:27:20.284587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d040f5-2062-4e36-881e-56d1c83229a7 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:20.289282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d040f5-2062-4e36-881e-56d1c83229a7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:20.291045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d040f5-2062-4e36-881e-56d1c83229a7 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:20.296992 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 234/473] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:20 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:20.303085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f8c4a-e509-4391-93f5-eac20b98b620 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:20.303369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f8c4a-e509-4391-93f5-eac20b98b620 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:20.303639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f8c4a-e509-4391-93f5-eac20b98b620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:20.305259 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:20.332431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dd7f8c4a-e509-4391-93f5-eac20b98b620 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:20.333729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dd7f8c4a-e509-4391-93f5-eac20b98b620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:20.389691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00254f-eb34-4dd3-b5a1-b0f7981d1167 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:20.416588 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 235/474] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:27:20.441188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78e065-9838-4620-8df4-19615cbafbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:20.441849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78e065-9838-4620-8df4-19615cbafbcf None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:20.442124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78e065-9838-4620-8df4-19615cbafbcf None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:20.442396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78e065-9838-4620-8df4-19615cbafbcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:20.460644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78e065-9838-4620-8df4-19615cbafbcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:20.462053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78e065-9838-4620-8df4-19615cbafbcf None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:20.479355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-df78e065-9838-4620-8df4-19615cbafbcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:20.479355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:20.479355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:20.479355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:20.479355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:20.479355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:20.479355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:20.479355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:20.479355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:20.479355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:20.479355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:20.479355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:20.479355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:20.479355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:20.479355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:20.479355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:20.480317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:20.480317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:20.480317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:20.480317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:20.480317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:20.480317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:20.480317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:20.480317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:20.480317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:20.480317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:20.480317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:20.480317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:20.480317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:20.480317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:20.480317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:20.480317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:20.480317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:20.481161 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:20.481161 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:20.481161 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:20.482707 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 240/475] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:20.488447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f8c4a-e509-4391-93f5-eac20b98b620 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:20.596763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f8c4a-e509-4391-93f5-eac20b98b620 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:20.615675 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:20.633808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14309171-1619-48e5-bf7b-0418aeb2bb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:20.634767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14309171-1619-48e5-bf7b-0418aeb2bb32 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:20.635302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14309171-1619-48e5-bf7b-0418aeb2bb32 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:20.635762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14309171-1619-48e5-bf7b-0418aeb2bb32 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:20.636591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14309171-1619-48e5-bf7b-0418aeb2bb32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:20.637135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14309171-1619-48e5-bf7b-0418aeb2bb32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:20.638677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14309171-1619-48e5-bf7b-0418aeb2bb32 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:20.651688 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 236/476] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:20.656833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78e065-9838-4620-8df4-19615cbafbcf None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:20.711649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14309171-1619-48e5-bf7b-0418aeb2bb32 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:20.761096 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:20.765777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78e065-9838-4620-8df4-19615cbafbcf None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:20.807401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c89f31-d0e0-4977-823d-9f72939b2f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:20.808028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c89f31-d0e0-4977-823d-9f72939b2f7d None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:20.808267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c89f31-d0e0-4977-823d-9f72939b2f7d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:20.808533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c89f31-d0e0-4977-823d-9f72939b2f7d None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:20.809234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c89f31-d0e0-4977-823d-9f72939b2f7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:20.810662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c89f31-d0e0-4977-823d-9f72939b2f7d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:20.840147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14309171-1619-48e5-bf7b-0418aeb2bb32 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:20.855626 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 241/477] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Sep 30 09:27:20 2022] POST /identity/v3/users => generated 249 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:27:20.888017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567bd78-7626-4fba-a46b-34e3ae933a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:20.889130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567bd78-7626-4fba-a46b-34e3ae933a9c None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:20.889628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567bd78-7626-4fba-a46b-34e3ae933a9c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:20.890097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567bd78-7626-4fba-a46b-34e3ae933a9c None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:20.890966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567bd78-7626-4fba-a46b-34e3ae933a9c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:20.892565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567bd78-7626-4fba-a46b-34e3ae933a9c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:20.929588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.sql.core [None req-8567bd78-7626-4fba-a46b-34e3ae933a9c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 30 09:27:20.929588 n-d-master-1 devstack@keystone.service[82080]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 30 09:27:20.929588 n-d-master-1 devstack@keystone.service[82080]: [parameters: {'id': '4321f4209ea0475eba57cd05d163dbaf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 30 09:27:20.929588 n-d-master-1 devstack@keystone.service[82080]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82080) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 30 09:27:20.957575 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-8567bd78-7626-4fba-a46b-34e3ae933a9c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 30 09:27:20.957575 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:20.957575 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 09:27:20.957575 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 09:27:20.957575 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 09:27:20.957575 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 09:27:20.957575 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 09:27:20.957575 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 09:27:20.957575 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 09:27:20.957575 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application conn.query(q) Sep 30 09:27:20.957575 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 09:27:20.957575 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 09:27:20.957575 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 09:27:20.957575 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application result.read() Sep 30 09:27:20.957575 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 09:27:20.958527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 09:27:20.958527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 09:27:20.958527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 09:27:20.958527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 09:27:20.958527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 09:27:20.958527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 09:27:20.958527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 09:27:20.958527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 30 09:27:20.958527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:20.958527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 30 09:27:20.958527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:20.958527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:20.958527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 30 09:27:20.958527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 30 09:27:20.958527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 30 09:27:20.958527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return ref.to_dict() Sep 30 09:27:20.958527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 09:27:20.958527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application next(self.gen) Sep 30 09:27:20.959472 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 30 09:27:20.959472 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application yield resource Sep 30 09:27:20.959472 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 09:27:20.959472 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application next(self.gen) Sep 30 09:27:20.959472 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 30 09:27:20.959472 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.session.rollback() Sep 30 09:27:20.959472 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 30 09:27:20.959472 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.force_reraise() Sep 30 09:27:20.959472 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 30 09:27:20.959472 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise self.value Sep 30 09:27:20.959472 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 30 09:27:20.959472 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 30 09:27:20.959472 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 30 09:27:20.959472 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application session.commit() Sep 30 09:27:20.959472 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 30 09:27:20.959472 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 30 09:27:20.959472 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 30 09:27:20.960347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._prepare_impl() Sep 30 09:27:20.960347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 30 09:27:20.960347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.session.flush() Sep 30 09:27:20.960347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 30 09:27:20.960347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._flush(objects) Sep 30 09:27:20.960347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 30 09:27:20.960347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 30 09:27:20.960347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 30 09:27:20.960347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application compat.raise_( Sep 30 09:27:20.960347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 09:27:20.960347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception Sep 30 09:27:20.960347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 30 09:27:20.960347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application flush_context.execute() Sep 30 09:27:20.960347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 30 09:27:20.960347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rec.execute(self) Sep 30 09:27:20.960347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 30 09:27:20.960347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 30 09:27:20.961256 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 30 09:27:20.961256 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 30 09:27:20.961256 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 30 09:27:20.961256 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 30 09:27:20.961256 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 30 09:27:20.961256 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 30 09:27:20.961256 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 30 09:27:20.961256 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 30 09:27:20.961256 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 30 09:27:20.961256 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 30 09:27:20.961256 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 30 09:27:20.961256 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 30 09:27:20.961256 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 30 09:27:20.961256 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 30 09:27:20.961256 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 09:27:20.961256 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception Sep 30 09:27:20.962124 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 09:27:20.962124 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 09:27:20.962124 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 09:27:20.962124 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 09:27:20.962124 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 09:27:20.962124 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 09:27:20.962124 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 09:27:20.962124 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application conn.query(q) Sep 30 09:27:20.962124 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 09:27:20.962124 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 09:27:20.962124 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 09:27:20.962124 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application result.read() Sep 30 09:27:20.962124 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 09:27:20.962124 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 09:27:20.962124 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 09:27:20.962124 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 09:27:20.963076 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 09:27:20.963076 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 09:27:20.963076 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 09:27:20.963076 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 09:27:20.963076 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 30 09:27:20.963076 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 30 09:27:20.963076 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [parameters: {'id': '4321f4209ea0475eba57cd05d163dbaf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 30 09:27:20.963076 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 30 09:27:20.963076 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:20.963076 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:27:20.963076 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:20.963076 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:20.963076 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:20.963076 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:20.963076 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:20.963076 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:20.963894 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:20.963894 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:20.963894 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:20.963894 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:20.963894 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:20.963894 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:20.963894 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 30 09:27:20.963894 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 30 09:27:20.963894 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:20.963894 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:20.963894 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 30 09:27:20.963894 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 30 09:27:20.963894 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 30 09:27:20.963894 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 30 09:27:20.963894 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 30 09:27:20.963894 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:20.972237 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 237/478] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Sep 30 09:27:20 2022] POST /identity/v3/roles => generated 144 bytes in 261 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:27:20.978753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c89f31-d0e0-4977-823d-9f72939b2f7d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:21.123897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c89f31-d0e0-4977-823d-9f72939b2f7d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:21.172830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2e020-662d-4bc3-84ed-4a56c0bfae3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:21.173780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2e020-662d-4bc3-84ed-4a56c0bfae3d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:21.174610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2e020-662d-4bc3-84ed-4a56c0bfae3d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:21.175021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2e020-662d-4bc3-84ed-4a56c0bfae3d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:21.187160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2e020-662d-4bc3-84ed-4a56c0bfae3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:21.192823 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-9ba2e020-662d-4bc3-84ed-4a56c0bfae3d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:27:21.192823 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:21.192823 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:21.192823 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:21.192823 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:21.192823 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:21.192823 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:21.192823 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:21.192823 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:21.192823 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:21.192823 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:21.192823 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:21.192823 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:21.192823 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:21.192823 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:21.192823 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:21.193857 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:21.193857 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:21.193857 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:21.193857 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:21.193857 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:21.193857 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:21.193857 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:21.193857 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:21.193857 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:21.193857 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:21.193857 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:21.193857 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:21.193857 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:21.193857 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:21.193857 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:21.193857 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:21.194838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:21.194838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:21.194838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:21.194838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:21.194838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:21.194838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:21.194838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:21.194838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:21.194838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:21.194838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:21.194838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 09:27:21.194838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:21.197090 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 242/479] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Sep 30 09:27:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:21.203100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567bd78-7626-4fba-a46b-34e3ae933a9c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:21.266915 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:21.356020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567bd78-7626-4fba-a46b-34e3ae933a9c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:21.402659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147a945-9fe1-48cf-bea8-8689de9b0d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:21.403607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147a945-9fe1-48cf-bea8-8689de9b0d86 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:21.404074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147a945-9fe1-48cf-bea8-8689de9b0d86 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:21.404550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147a945-9fe1-48cf-bea8-8689de9b0d86 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:21.405488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147a945-9fe1-48cf-bea8-8689de9b0d86 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:21.405998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147a945-9fe1-48cf-bea8-8689de9b0d86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:21.407552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147a945-9fe1-48cf-bea8-8689de9b0d86 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:21.420934 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 238/480] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:22.858390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507af0f9-dcfe-480c-bdc8-3566cea67f67 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:22.858952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507af0f9-dcfe-480c-bdc8-3566cea67f67 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:22.858952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507af0f9-dcfe-480c-bdc8-3566cea67f67 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:22.860369 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 243/481] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:22.873489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183bd04-3326-4b85-bf71-c3b323cd4fd3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:22.874003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183bd04-3326-4b85-bf71-c3b323cd4fd3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:22.874003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183bd04-3326-4b85-bf71-c3b323cd4fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:22.896098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1183bd04-3326-4b85-bf71-c3b323cd4fd3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:22.897296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1183bd04-3326-4b85-bf71-c3b323cd4fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:22.979615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf778464-be38-4d5e-8bc8-9862e71666ba None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:22.979931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf778464-be38-4d5e-8bc8-9862e71666ba None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:22.980193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf778464-be38-4d5e-8bc8-9862e71666ba None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:22.981711 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 244/482] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:22.986888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929716f0-f234-432e-89b7-d536dbfe8ece None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:22.987174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929716f0-f234-432e-89b7-d536dbfe8ece None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:22.987447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929716f0-f234-432e-89b7-d536dbfe8ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:23.006171 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 239/483] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:23.010193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-929716f0-f234-432e-89b7-d536dbfe8ece None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:23.011571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-929716f0-f234-432e-89b7-d536dbfe8ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:23.034905 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:23.120457 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 245/484] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:23.280779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d13f5-37f5-4b19-83da-5bb4cefe5da0 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:23.281164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d13f5-37f5-4b19-83da-5bb4cefe5da0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:23.281348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d13f5-37f5-4b19-83da-5bb4cefe5da0 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:23.282905 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 240/485] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:23.287981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9e633-0eb4-44a2-8780-821164fd8086 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:23.288480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9e633-0eb4-44a2-8780-821164fd8086 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:23.288975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9e633-0eb4-44a2-8780-821164fd8086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:23.314701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0fd9e633-0eb4-44a2-8780-821164fd8086 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:23.316197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0fd9e633-0eb4-44a2-8780-821164fd8086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:23.390400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d13f5-37f5-4b19-83da-5bb4cefe5da0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:23.407402 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 246/486] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:23.460969 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:23.550424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d13f5-37f5-4b19-83da-5bb4cefe5da0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:23.563054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9e633-0eb4-44a2-8780-821164fd8086 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:23.593867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f41f80-0eac-4942-8288-6b35e6c17a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:23.594484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f41f80-0eac-4942-8288-6b35e6c17a0b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:23.594753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f41f80-0eac-4942-8288-6b35e6c17a0b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:23.595021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f41f80-0eac-4942-8288-6b35e6c17a0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:23.617939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f41f80-0eac-4942-8288-6b35e6c17a0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:23.626031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-56f41f80-0eac-4942-8288-6b35e6c17a0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:23.626031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:23.626031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:23.626031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:23.626031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:23.626031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:23.626031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:23.626031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:23.626031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:23.626031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:23.626031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:23.626031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:23.626031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:23.626031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:23.626031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:23.626031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:23.626918 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:23.626918 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:23.626918 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:23.626918 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:23.626918 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:23.626918 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:23.626918 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:23.626918 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:23.626918 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:23.626918 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:23.626918 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:23.626918 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:23.626918 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:23.626918 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:23.626918 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:23.626918 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:23.627732 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:23.627732 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:23.627732 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:23.627732 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:23.627732 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:23.627732 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:23.627732 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:23.627732 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:23.627732 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:23.627732 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:23.627732 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:23.627732 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:23.636843 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 241/487] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:27:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:27:23.642350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f41f80-0eac-4942-8288-6b35e6c17a0b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:23.698449 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:23.728899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9e633-0eb4-44a2-8780-821164fd8086 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:23.752452 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:23.760909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f41f80-0eac-4942-8288-6b35e6c17a0b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:23.763094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347cfe2-7dfa-475c-a5a2-76e86fba2085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:23.763723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347cfe2-7dfa-475c-a5a2-76e86fba2085 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:23.764006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347cfe2-7dfa-475c-a5a2-76e86fba2085 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:23.764280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347cfe2-7dfa-475c-a5a2-76e86fba2085 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:23.777238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347cfe2-7dfa-475c-a5a2-76e86fba2085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:23.784554 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-9347cfe2-7dfa-475c-a5a2-76e86fba2085 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:23.784554 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:23.784554 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:23.784554 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:23.784554 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:23.784554 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:23.784554 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:23.784554 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:23.784554 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:23.784554 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:23.784554 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:23.784554 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:23.784554 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:23.784554 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:23.784554 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:23.784554 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:23.785512 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:23.785512 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:23.785512 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:23.785512 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:23.785512 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:23.785512 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:23.785512 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:23.785512 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:23.785512 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:23.785512 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:23.785512 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:23.785512 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:23.785512 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:23.785512 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:23.785512 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:23.785512 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:23.786319 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:23.786319 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:23.786319 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:23.786319 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:23.786319 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:23.786319 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:23.786319 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:23.786319 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:23.786319 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:23.786319 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:23.786319 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:23.786319 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:23.786319 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 247/488] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:27:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:23.787477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7e1d7-a9c1-4488-8462-b86d8887e4b1 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:23.787716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7e1d7-a9c1-4488-8462-b86d8887e4b1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:23.787989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7e1d7-a9c1-4488-8462-b86d8887e4b1 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:23.789411 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 248/489] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:23.790010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7e1d7-a9c1-4488-8462-b86d8887e4b1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:23.804309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367f881-6721-49ff-9467-c42aa69a5a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:23.805277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367f881-6721-49ff-9467-c42aa69a5a04 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:23.805559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367f881-6721-49ff-9467-c42aa69a5a04 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:23.805830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367f881-6721-49ff-9467-c42aa69a5a04 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:23.806850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367f881-6721-49ff-9467-c42aa69a5a04 None admin] RBAC: Adding query filter params (name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:23.807154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367f881-6721-49ff-9467-c42aa69a5a04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:23.808518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367f881-6721-49ff-9467-c42aa69a5a04 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:23.817366 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 242/490] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Sep 30 09:27:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:23.821932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367f881-6721-49ff-9467-c42aa69a5a04 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:23.899406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7e1d7-a9c1-4488-8462-b86d8887e4b1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:23.936708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefd8a1-516c-4962-afa5-38db2c8f47e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:23.937330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefd8a1-516c-4962-afa5-38db2c8f47e4 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:23.937604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefd8a1-516c-4962-afa5-38db2c8f47e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:23.937877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefd8a1-516c-4962-afa5-38db2c8f47e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:23.938178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367f881-6721-49ff-9467-c42aa69a5a04 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:23.940211 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:23.950453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefd8a1-516c-4962-afa5-38db2c8f47e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:23.955236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-4fefd8a1-516c-4962-afa5-38db2c8f47e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:23.955236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:23.955236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:23.955236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:23.955236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:23.955236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:23.955236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:23.955236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:23.955236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:23.955236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:23.955236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:23.955236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:23.955236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:23.955236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:23.955236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:23.955236 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:23.956282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:23.956282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:23.956282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:23.956282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:23.956282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:23.956282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:23.956282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:23.956282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:23.956282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:23.956282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:23.956282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:23.956282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:23.956282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:23.956282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:23.956282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:23.956282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:23.957370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:23.957370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:23.957370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:23.957370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:23.957370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:23.957370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:23.957370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:23.957370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:23.957370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:23.957370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:23.957370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:23.957370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:23.957370 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 249/491] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:27:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:23.958167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ffeaa-c7d4-42bd-bede-d54921e00557 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:23.958448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ffeaa-c7d4-42bd-bede-d54921e00557 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:23.958719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ffeaa-c7d4-42bd-bede-d54921e00557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:23.977653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c02ffeaa-c7d4-42bd-bede-d54921e00557 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:23.979439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c02ffeaa-c7d4-42bd-bede-d54921e00557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:23.983402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16dce65-ca7c-40cf-8d67-46ed17b33339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:23.984004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dce65-ca7c-40cf-8d67-46ed17b33339 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:23.984282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dce65-ca7c-40cf-8d67-46ed17b33339 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:23.984552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dce65-ca7c-40cf-8d67-46ed17b33339 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:23.985236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16dce65-ca7c-40cf-8d67-46ed17b33339 None admin] RBAC: Adding query filter params (name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:23.985530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16dce65-ca7c-40cf-8d67-46ed17b33339 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:23.986878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16dce65-ca7c-40cf-8d67-46ed17b33339 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:23.996028 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 243/492] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Sep 30 09:27:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:23.997882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16dce65-ca7c-40cf-8d67-46ed17b33339 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:24.021491 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:24.050407 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 250/493] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:24.051304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ffeaa-c7d4-42bd-bede-d54921e00557 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:24.128941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16dce65-ca7c-40cf-8d67-46ed17b33339 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:24.163213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ffeaa-c7d4-42bd-bede-d54921e00557 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:24.167903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ad1fc-253a-4174-ae95-19a063978409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:24.168226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ad1fc-253a-4174-ae95-19a063978409 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:24.168552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ad1fc-253a-4174-ae95-19a063978409 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:24.168858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ad1fc-253a-4174-ae95-19a063978409 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:24.180166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ad1fc-253a-4174-ae95-19a063978409 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:24.181709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ad1fc-253a-4174-ae95-19a063978409 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:24.195308 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:24.197611 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-431ad1fc-253a-4174-ae95-19a063978409 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:24.197611 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:24.197611 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:24.197611 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:24.197611 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:24.197611 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:24.197611 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:24.197611 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:24.197611 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:24.197611 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:24.197611 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:24.197611 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:24.197611 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:24.197611 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:24.197611 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:24.197611 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:24.199144 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:24.199144 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:24.199144 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:24.199144 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:24.199144 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:24.199144 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:24.199144 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:24.199144 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:24.199144 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:24.199144 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:24.199144 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:24.199144 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:24.199144 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:24.199144 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:24.199144 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:24.199144 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:24.199144 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:24.200450 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:24.200450 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:24.200450 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:24.205211 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 244/494] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:24.206220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ad1fc-253a-4174-ae95-19a063978409 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:24.216337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0cd31-dee6-4bd3-a070-e2c662632050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:24.217242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0cd31-dee6-4bd3-a070-e2c662632050 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:24.218645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0cd31-dee6-4bd3-a070-e2c662632050 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:24.219074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0cd31-dee6-4bd3-a070-e2c662632050 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:24.219926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0cd31-dee6-4bd3-a070-e2c662632050 None admin] RBAC: Adding query filter params (name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:24.220811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0cd31-dee6-4bd3-a070-e2c662632050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:24.223802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0cd31-dee6-4bd3-a070-e2c662632050 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:24.237641 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 251/495] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Sep 30 09:27:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:24.238944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0cd31-dee6-4bd3-a070-e2c662632050 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:24.301692 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:24.342084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ad1fc-253a-4174-ae95-19a063978409 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:24.351964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0cd31-dee6-4bd3-a070-e2c662632050 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:24.375271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb210f1-66a6-4009-801f-75f6bd1b8a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:24.375894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb210f1-66a6-4009-801f-75f6bd1b8a5f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:24.376177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb210f1-66a6-4009-801f-75f6bd1b8a5f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:24.376450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb210f1-66a6-4009-801f-75f6bd1b8a5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:24.384945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4346b-bbc0-4430-8d64-922a385fbb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:24.385589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4346b-bbc0-4430-8d64-922a385fbb6f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:24.385864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4346b-bbc0-4430-8d64-922a385fbb6f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:24.386125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4346b-bbc0-4430-8d64-922a385fbb6f None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:24.386749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4346b-bbc0-4430-8d64-922a385fbb6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:24.387039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4346b-bbc0-4430-8d64-922a385fbb6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:24.387786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb210f1-66a6-4009-801f-75f6bd1b8a5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:24.388391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4346b-bbc0-4430-8d64-922a385fbb6f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:24.389237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb210f1-66a6-4009-801f-75f6bd1b8a5f None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:24.401056 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 252/496] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:24.401859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4346b-bbc0-4430-8d64-922a385fbb6f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:24.403155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-1eb210f1-66a6-4009-801f-75f6bd1b8a5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:24.403155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:24.403155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:24.403155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:24.403155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:24.403155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:24.403155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:24.403155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:24.403155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:24.403155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:24.403155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:24.403155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:24.403155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:24.403155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:24.403155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:24.403155 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:24.404009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:24.404009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:24.404009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:24.404009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:24.404009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:24.404009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:24.404009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:24.404009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:24.404009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:24.404009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:24.404009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:24.404009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:24.404009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:24.404009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:24.404009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:24.404009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:24.404009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:24.404892 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:24.404892 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:24.404892 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:24.404892 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 245/497] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:24.405520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb210f1-66a6-4009-801f-75f6bd1b8a5f None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:24.450294 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:24.502106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4346b-bbc0-4430-8d64-922a385fbb6f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:24.507963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb210f1-66a6-4009-801f-75f6bd1b8a5f None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:24.530592 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:24.536307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa06608-51a3-4917-9e04-7dd9b14bd9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:24.536971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa06608-51a3-4917-9e04-7dd9b14bd9a4 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:24.537251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa06608-51a3-4917-9e04-7dd9b14bd9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:24.537532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa06608-51a3-4917-9e04-7dd9b14bd9a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:24.542508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d19e7-6116-438b-b9dd-c117e155229f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:24.543115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d19e7-6116-438b-b9dd-c117e155229f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:24.543388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d19e7-6116-438b-b9dd-c117e155229f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:24.543651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d19e7-6116-438b-b9dd-c117e155229f None admin] PATH_INFO: `/v3/roles/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:24.547560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa06608-51a3-4917-9e04-7dd9b14bd9a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:24.549027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa06608-51a3-4917-9e04-7dd9b14bd9a4 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:24.554225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d19e7-6116-438b-b9dd-c117e155229f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:24.559887 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-922d19e7-6116-438b-b9dd-c117e155229f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:24.559887 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:24.559887 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:24.559887 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:24.559887 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:24.559887 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:24.559887 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:24.559887 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:24.559887 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:24.559887 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:24.559887 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:24.559887 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:24.559887 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:24.559887 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:24.559887 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:24.559887 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:24.560807 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:24.560807 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:24.560807 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:24.560807 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:24.560807 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:24.560807 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:24.560807 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:24.560807 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:24.560807 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:24.560807 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:24.560807 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:24.560807 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:24.560807 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:24.560807 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:24.560807 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:24.560807 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:24.561600 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:24.561600 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:24.561600 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:24.561600 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:24.561600 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:24.561600 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:24.561600 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:24.561600 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:24.561600 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:24.561600 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:24.561600 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:24.561600 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:24.561600 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 246/498] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:27:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:24.562247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bda93-5706-47e0-ac2a-a567a05b63fa None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:24.562628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bda93-5706-47e0-ac2a-a567a05b63fa None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:24.562714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bda93-5706-47e0-ac2a-a567a05b63fa None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:24.563838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-1aa06608-51a3-4917-9e04-7dd9b14bd9a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:24.563838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:24.563838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:24.563838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:24.563838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:24.563838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:24.563838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:24.563838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:24.563838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:24.563838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:24.563838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:24.563838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:24.563838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:24.563838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:24.563838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:24.563838 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:24.564704 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:24.564704 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:24.564704 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:24.564704 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:24.564704 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:24.564704 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:24.564704 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:24.564704 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:24.564704 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:24.564704 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:24.564704 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:24.564704 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:24.564704 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:24.564704 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:24.564704 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:24.564704 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:24.564704 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:24.565531 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:24.565531 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:24.565531 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:24.565892 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 253/499] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:24.566802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa06608-51a3-4917-9e04-7dd9b14bd9a4 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:24.568036 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 247/500] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:24.568813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bda93-5706-47e0-ac2a-a567a05b63fa None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:24.670522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bda93-5706-47e0-ac2a-a567a05b63fa None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:24.672368 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:24.676719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa06608-51a3-4917-9e04-7dd9b14bd9a4 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:24.703397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0632e7e-c72f-497f-8f12-75e9860b7b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:24.703919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0632e7e-c72f-497f-8f12-75e9860b7b04 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:24.704190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0632e7e-c72f-497f-8f12-75e9860b7b04 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:24.704463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0632e7e-c72f-497f-8f12-75e9860b7b04 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:24.705115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0632e7e-c72f-497f-8f12-75e9860b7b04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:24.705423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0632e7e-c72f-497f-8f12-75e9860b7b04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:24.707003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0632e7e-c72f-497f-8f12-75e9860b7b04 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:24.712846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c463e06-bbbb-4e11-8284-28224694c93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:24.713491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c463e06-bbbb-4e11-8284-28224694c93c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:24.713772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c463e06-bbbb-4e11-8284-28224694c93c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:24.714045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c463e06-bbbb-4e11-8284-28224694c93c None admin] PATH_INFO: `/v3/users/nova` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:24.718933 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 248/501] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:24.719767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0632e7e-c72f-497f-8f12-75e9860b7b04 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:24.721377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c463e06-bbbb-4e11-8284-28224694c93c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:24.722796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c463e06-bbbb-4e11-8284-28224694c93c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:24.735295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-0c463e06-bbbb-4e11-8284-28224694c93c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:27:24.735295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:24.735295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:24.735295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:24.735295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:24.735295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:24.735295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:24.735295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:24.735295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:24.735295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:24.735295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:24.735295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:24.735295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:27:24.735295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:27:24.735295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:27:24.735295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:27:24.736370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:24.736370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:24.736370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:27:24.736370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:24.736370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:27:24.736370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:24.736370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:24.736370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:24.736370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:24.736370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:24.736370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:24.736370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:24.736370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:24.736370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:24.736370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:24.736370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:24.736370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:24.736370 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:24.737563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:24.737563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:24.737563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:27:24.737563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:27:24.737563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:27:24.737563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:27:24.737563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:27:24.737563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:27:24.737563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:27:24.737563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:24.737563 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 254/502] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Sep 30 09:27:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:24.738227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad005cfa-f2c9-4794-a53b-562db9820d17 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:24.738227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad005cfa-f2c9-4794-a53b-562db9820d17 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:24.738351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad005cfa-f2c9-4794-a53b-562db9820d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:24.756580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ad005cfa-f2c9-4794-a53b-562db9820d17 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:24.757801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ad005cfa-f2c9-4794-a53b-562db9820d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:24.768105 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:24.823439 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 255/503] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:24.823941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0632e7e-c72f-497f-8f12-75e9860b7b04 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:24.824251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad005cfa-f2c9-4794-a53b-562db9820d17 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:24.867892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7c535-5e2c-47b7-b35f-a69b5a2db991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:24.869560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7c535-5e2c-47b7-b35f-a69b5a2db991 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:24.870098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7c535-5e2c-47b7-b35f-a69b5a2db991 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:24.870564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7c535-5e2c-47b7-b35f-a69b5a2db991 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:24.871614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7c535-5e2c-47b7-b35f-a69b5a2db991 None admin] RBAC: Adding query filter params (name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:24.872240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7c535-5e2c-47b7-b35f-a69b5a2db991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:24.874011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7c535-5e2c-47b7-b35f-a69b5a2db991 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:24.888850 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 249/504] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Sep 30 09:27:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:24.888850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7c535-5e2c-47b7-b35f-a69b5a2db991 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:24.913939 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:24.935801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad005cfa-f2c9-4794-a53b-562db9820d17 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:24.972704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efd5ad-cb31-4422-a792-ae4441a04e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:24.973273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efd5ad-cb31-4422-a792-ae4441a04e0e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:24.973548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efd5ad-cb31-4422-a792-ae4441a04e0e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:24.973812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efd5ad-cb31-4422-a792-ae4441a04e0e None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:24.974491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7efd5ad-cb31-4422-a792-ae4441a04e0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:24.974790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7efd5ad-cb31-4422-a792-ae4441a04e0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:24.976292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7efd5ad-cb31-4422-a792-ae4441a04e0e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:24.990467 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 256/505] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:24.991283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efd5ad-cb31-4422-a792-ae4441a04e0e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:25.005723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7c535-5e2c-47b7-b35f-a69b5a2db991 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:25.008067 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:25.043521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22424cff-9017-42a4-9cec-26ca6ad8402d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:25.044151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22424cff-9017-42a4-9cec-26ca6ad8402d None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:25.044428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22424cff-9017-42a4-9cec-26ca6ad8402d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:25.044725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22424cff-9017-42a4-9cec-26ca6ad8402d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:25.052910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22424cff-9017-42a4-9cec-26ca6ad8402d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:25.054479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22424cff-9017-42a4-9cec-26ca6ad8402d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:25.067012 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-22424cff-9017-42a4-9cec-26ca6ad8402d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:27:25.067012 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:25.067012 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:25.067012 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:25.067012 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:25.067012 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:25.067012 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:25.067012 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:25.067012 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:25.067012 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:25.067012 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:25.067012 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:25.067012 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:27:25.067012 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:27:25.067012 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:27:25.067012 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:27:25.067903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:25.067903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:25.067903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:27:25.067903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:25.067903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:27:25.067903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:25.067903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:25.067903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:25.067903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:25.067903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:25.067903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:25.067903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:25.067903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:25.067903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:25.067903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:25.067903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:25.067903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:25.067903 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:25.068816 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:25.068816 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:25.068816 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:27:25.068816 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:27:25.068816 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:27:25.068816 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:27:25.068816 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:27:25.068816 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:27:25.068816 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:27:25.068816 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:25.068816 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 250/506] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:25.069419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22424cff-9017-42a4-9cec-26ca6ad8402d None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:25.106199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efd5ad-cb31-4422-a792-ae4441a04e0e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:25.138889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6767323-c996-4129-9b52-49a24f6ff132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:25.139481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6767323-c996-4129-9b52-49a24f6ff132 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:25.139757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6767323-c996-4129-9b52-49a24f6ff132 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:25.140022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6767323-c996-4129-9b52-49a24f6ff132 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:25.140768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6767323-c996-4129-9b52-49a24f6ff132 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:25.141071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6767323-c996-4129-9b52-49a24f6ff132 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:25.142502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6767323-c996-4129-9b52-49a24f6ff132 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:25.174346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22424cff-9017-42a4-9cec-26ca6ad8402d None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:25.178903 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 257/507] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Sep 30 09:27:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:25.179729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6767323-c996-4129-9b52-49a24f6ff132 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:25.189454 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:25.211893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacd350-95cd-4c74-9016-d428966ae4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:25.213094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacd350-95cd-4c74-9016-d428966ae4a4 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:25.213370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacd350-95cd-4c74-9016-d428966ae4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:25.213636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacd350-95cd-4c74-9016-d428966ae4a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:25.225023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacd350-95cd-4c74-9016-d428966ae4a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:25.226391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacd350-95cd-4c74-9016-d428966ae4a4 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:25.240769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-1bacd350-95cd-4c74-9016-d428966ae4a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:25.240769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:25.240769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:25.240769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:25.240769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:25.240769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:25.240769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:25.240769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:25.240769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:25.240769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:25.240769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:25.240769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:25.240769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:25.240769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:25.240769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:25.240769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:25.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:25.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:25.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:25.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:25.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:25.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:25.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:25.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:25.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:25.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:25.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:25.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:25.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:25.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:25.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:25.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:25.241802 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:25.242820 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:25.242820 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:25.242820 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:25.242820 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 251/508] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:25.242820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacd350-95cd-4c74-9016-d428966ae4a4 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:25.261050 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:25.282325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6767323-c996-4129-9b52-49a24f6ff132 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:25.316015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3794d-6bf0-4a99-9e96-f8edcd5c50ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:25.316666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3794d-6bf0-4a99-9e96-f8edcd5c50ec None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:25.316948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3794d-6bf0-4a99-9e96-f8edcd5c50ec None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:25.317220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3794d-6bf0-4a99-9e96-f8edcd5c50ec None admin] PATH_INFO: `/v3/users/glance` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:25.324230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3794d-6bf0-4a99-9e96-f8edcd5c50ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:25.325728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3794d-6bf0-4a99-9e96-f8edcd5c50ec None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:25.337993 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-49c3794d-6bf0-4a99-9e96-f8edcd5c50ec None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 30 09:27:25.337993 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:25.337993 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:25.337993 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:25.337993 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:25.337993 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:25.337993 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:25.337993 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:25.337993 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:25.337993 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:25.337993 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:25.337993 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:25.337993 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:27:25.337993 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:27:25.337993 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:27:25.337993 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:27:25.339036 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:25.339036 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:25.339036 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:27:25.339036 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:25.339036 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:27:25.339036 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:25.339036 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:25.339036 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:25.339036 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:25.339036 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:25.339036 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:25.339036 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:25.339036 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:25.339036 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:25.339036 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:25.339036 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:25.339036 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:25.339036 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:25.339971 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:25.339971 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:25.339971 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:27:25.339971 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:27:25.339971 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:27:25.339971 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:27:25.339971 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:27:25.339971 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:27:25.339971 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 30 09:27:25.339971 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:25.339971 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 258/509] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:25.340519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3794d-6bf0-4a99-9e96-f8edcd5c50ec None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:25.340871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacd350-95cd-4c74-9016-d428966ae4a4 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:25.375133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860d369-3f61-4df8-9171-d257b615c49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:25.375727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860d369-3f61-4df8-9171-d257b615c49e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:25.376006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860d369-3f61-4df8-9171-d257b615c49e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:25.376279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860d369-3f61-4df8-9171-d257b615c49e None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:25.377033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860d369-3f61-4df8-9171-d257b615c49e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:25.377338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860d369-3f61-4df8-9171-d257b615c49e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:25.378752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860d369-3f61-4df8-9171-d257b615c49e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:25.407653 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:25.415467 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 252/510] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Sep 30 09:27:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:25.416297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860d369-3f61-4df8-9171-d257b615c49e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:25.444483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3794d-6bf0-4a99-9e96-f8edcd5c50ec None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:25.478458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301706d9-1ef1-43a2-99e7-6d3965e74d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:25.479010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301706d9-1ef1-43a2-99e7-6d3965e74d97 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:25.479285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301706d9-1ef1-43a2-99e7-6d3965e74d97 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:25.479554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301706d9-1ef1-43a2-99e7-6d3965e74d97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:25.489853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301706d9-1ef1-43a2-99e7-6d3965e74d97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:25.490496 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:25.491310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301706d9-1ef1-43a2-99e7-6d3965e74d97 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:25.505542 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-301706d9-1ef1-43a2-99e7-6d3965e74d97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:25.505542 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:25.505542 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:25.505542 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:25.505542 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:25.505542 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:25.505542 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:25.505542 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:25.505542 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:25.505542 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:25.505542 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:25.505542 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:25.505542 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:25.505542 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:25.505542 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:25.505542 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:25.506655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:25.506655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:25.506655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:25.506655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:25.506655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:25.506655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:25.506655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:25.506655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:25.506655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:25.506655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:25.506655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:25.506655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:25.506655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:25.506655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:25.506655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:25.506655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:25.506655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:25.507516 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:25.507516 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:25.507516 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:25.507516 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 259/511] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:25.507516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301706d9-1ef1-43a2-99e7-6d3965e74d97 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:25.518321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860d369-3f61-4df8-9171-d257b615c49e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:25.553126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af7bf5-108a-4146-a63c-3cab196e11f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:25.553727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af7bf5-108a-4146-a63c-3cab196e11f5 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:25.554005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af7bf5-108a-4146-a63c-3cab196e11f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:25.554275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af7bf5-108a-4146-a63c-3cab196e11f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:25.609626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301706d9-1ef1-43a2-99e7-6d3965e74d97 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:25.620241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af7bf5-108a-4146-a63c-3cab196e11f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:25.621707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af7bf5-108a-4146-a63c-3cab196e11f5 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:25.626962 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:25.643851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113e1b4-1429-4053-b5b8-540082806e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:25.644442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113e1b4-1429-4053-b5b8-540082806e39 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:25.644756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113e1b4-1429-4053-b5b8-540082806e39 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:25.645020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113e1b4-1429-4053-b5b8-540082806e39 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:25.645644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113e1b4-1429-4053-b5b8-540082806e39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:25.645939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113e1b4-1429-4053-b5b8-540082806e39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:25.647280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113e1b4-1429-4053-b5b8-540082806e39 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:25.658891 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 260/512] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:25.659738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113e1b4-1429-4053-b5b8-540082806e39 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:25.693832 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:25.720233 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 253/513] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:27:25.721088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af7bf5-108a-4146-a63c-3cab196e11f5 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:25.757747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113e1b4-1429-4053-b5b8-540082806e39 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:25.790454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f3fc4-23d5-440d-9a7c-6da6e729a1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:25.791111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f3fc4-23d5-440d-9a7c-6da6e729a1f9 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:25.791386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f3fc4-23d5-440d-9a7c-6da6e729a1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:25.791653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f3fc4-23d5-440d-9a7c-6da6e729a1f9 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:25.792373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f3fc4-23d5-440d-9a7c-6da6e729a1f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:25.792753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f3fc4-23d5-440d-9a7c-6da6e729a1f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:25.794222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f3fc4-23d5-440d-9a7c-6da6e729a1f9 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:25.811890 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 261/514] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Sep 30 09:27:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:25.812892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f3fc4-23d5-440d-9a7c-6da6e729a1f9 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:25.818288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af7bf5-108a-4146-a63c-3cab196e11f5 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:25.846489 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:25.852427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00d3fd-3069-4c40-a3a3-71b6585ac683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:25.853653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00d3fd-3069-4c40-a3a3-71b6585ac683 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:25.853947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00d3fd-3069-4c40-a3a3-71b6585ac683 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:25.854187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00d3fd-3069-4c40-a3a3-71b6585ac683 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:25.896436 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:25.919977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f3fc4-23d5-440d-9a7c-6da6e729a1f9 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:25.924589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00d3fd-3069-4c40-a3a3-71b6585ac683 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:25.926059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00d3fd-3069-4c40-a3a3-71b6585ac683 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:25.954565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0679fe9-98b0-4337-bd2d-74893c046ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:25.955170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0679fe9-98b0-4337-bd2d-74893c046ab2 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:25.955451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0679fe9-98b0-4337-bd2d-74893c046ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:25.955719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0679fe9-98b0-4337-bd2d-74893c046ab2 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:25.956362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0679fe9-98b0-4337-bd2d-74893c046ab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:25.956957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0679fe9-98b0-4337-bd2d-74893c046ab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:25.958304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0679fe9-98b0-4337-bd2d-74893c046ab2 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:25.970137 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 262/515] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:25.970931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0679fe9-98b0-4337-bd2d-74893c046ab2 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:26.025112 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 254/516] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:27:26.026000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00d3fd-3069-4c40-a3a3-71b6585ac683 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:26.070708 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:26.077728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0679fe9-98b0-4337-bd2d-74893c046ab2 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:26.097896 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:26.112541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238362f-185a-46e1-bd05-777bc420eca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:26.113191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238362f-185a-46e1-bd05-777bc420eca3 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:26.113470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238362f-185a-46e1-bd05-777bc420eca3 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:26.113737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238362f-185a-46e1-bd05-777bc420eca3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:26.121149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238362f-185a-46e1-bd05-777bc420eca3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:26.122613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238362f-185a-46e1-bd05-777bc420eca3 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:26.123119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00d3fd-3069-4c40-a3a3-71b6585ac683 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:26.133484 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-7238362f-185a-46e1-bd05-777bc420eca3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 09:27:26.133484 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:26.133484 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:26.133484 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:26.133484 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:26.133484 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:26.133484 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:26.133484 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:26.133484 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:26.133484 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:26.133484 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:26.133484 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:26.133484 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:27:26.133484 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:27:26.133484 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:27:26.133484 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:27:26.135014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:26.135014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:26.135014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:27:26.135014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:26.135014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:27:26.135014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:26.135014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:26.135014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:26.135014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:26.135014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:26.135014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:26.135014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:26.135014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:26.135014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:26.135014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:26.135014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:26.135014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:26.135014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:26.135896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:26.135896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:26.135896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:27:26.135896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:27:26.135896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:27:26.135896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:27:26.135896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:27:26.135896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:27:26.135896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 09:27:26.135896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:26.135896 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 263/517] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:27:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:26.135896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238362f-185a-46e1-bd05-777bc420eca3 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:26.160490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb9e9c-a0ff-40f6-8f1e-c74e24784043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:26.161347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb9e9c-a0ff-40f6-8f1e-c74e24784043 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:26.161625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb9e9c-a0ff-40f6-8f1e-c74e24784043 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:26.161894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb9e9c-a0ff-40f6-8f1e-c74e24784043 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:26.172124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb9e9c-a0ff-40f6-8f1e-c74e24784043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:26.173635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb9e9c-a0ff-40f6-8f1e-c74e24784043 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:26.188551 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-5acb9e9c-a0ff-40f6-8f1e-c74e24784043 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:26.188551 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:26.188551 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:26.188551 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:26.188551 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:26.188551 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:26.188551 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:26.188551 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:26.188551 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:26.188551 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:26.188551 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:26.188551 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:26.188551 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:26.188551 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:26.188551 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:26.188551 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:26.189689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:26.189689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:26.189689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:26.189689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:26.189689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:26.189689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:26.189689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:26.189689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:26.189689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:26.189689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:26.189689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:26.189689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:26.189689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:26.189689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:26.189689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:26.189689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:26.189689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:26.190524 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:26.190524 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:26.190524 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:26.190524 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 255/518] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:26.190524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb9e9c-a0ff-40f6-8f1e-c74e24784043 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:26.235527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238362f-185a-46e1-bd05-777bc420eca3 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:26.270880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f6ac3-6c51-4b75-bc50-aaf79628bbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:26.271477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f6ac3-6c51-4b75-bc50-aaf79628bbb7 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:26.271749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f6ac3-6c51-4b75-bc50-aaf79628bbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:26.272012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f6ac3-6c51-4b75-bc50-aaf79628bbb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:26.295324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb9e9c-a0ff-40f6-8f1e-c74e24784043 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:26.298047 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:26.321360 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:26.330443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bdb6b-d32f-48f6-9ecb-3a96bc67099c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:26.331033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bdb6b-d32f-48f6-9ecb-3a96bc67099c None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:26.331307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bdb6b-d32f-48f6-9ecb-3a96bc67099c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:26.331827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bdb6b-d32f-48f6-9ecb-3a96bc67099c None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:26.332458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5bdb6b-d32f-48f6-9ecb-3a96bc67099c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:26.333895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5bdb6b-d32f-48f6-9ecb-3a96bc67099c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:26.341039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f6ac3-6c51-4b75-bc50-aaf79628bbb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:26.342479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f6ac3-6c51-4b75-bc50-aaf79628bbb7 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:26.354873 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 256/519] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Sep 30 09:27:26 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:27:26.355686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bdb6b-d32f-48f6-9ecb-3a96bc67099c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:26.460356 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 264/520] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:27:26.461467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f6ac3-6c51-4b75-bc50-aaf79628bbb7 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:26.493813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bdb6b-d32f-48f6-9ecb-3a96bc67099c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:26.525488 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:26.536650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e9d23-6358-4b4f-bb57-b335aaefc4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:26.537162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e9d23-6358-4b4f-bb57-b335aaefc4c8 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:26.537459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e9d23-6358-4b4f-bb57-b335aaefc4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:26.538477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e9d23-6358-4b4f-bb57-b335aaefc4c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:26.555621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e9d23-6358-4b4f-bb57-b335aaefc4c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:26.558785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e9d23-6358-4b4f-bb57-b335aaefc4c8 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:26.577942 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-3b5e9d23-6358-4b4f-bb57-b335aaefc4c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:26.577942 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:26.577942 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:26.577942 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:26.577942 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:26.577942 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:26.577942 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:26.577942 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:26.577942 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:26.577942 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:26.577942 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:26.577942 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:26.577942 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:26.577942 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:26.577942 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:26.577942 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:26.578880 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:26.578880 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:26.578880 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:26.578880 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:26.578880 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:26.578880 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:26.578880 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:26.578880 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:26.578880 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:26.578880 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:26.578880 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:26.578880 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:26.578880 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:26.578880 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:26.578880 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:26.578880 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:26.578880 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:26.580127 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:26.580127 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:26.580127 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:26.580127 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 257/521] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:26.580337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f6ac3-6c51-4b75-bc50-aaf79628bbb7 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:26.580416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e9d23-6358-4b4f-bb57-b335aaefc4c8 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:26.614516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610994d-5362-4dea-b104-34052716326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:26.615115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610994d-5362-4dea-b104-34052716326f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:26.615392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610994d-5362-4dea-b104-34052716326f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:26.615659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610994d-5362-4dea-b104-34052716326f None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:26.616380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610994d-5362-4dea-b104-34052716326f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:26.616707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610994d-5362-4dea-b104-34052716326f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:26.618134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610994d-5362-4dea-b104-34052716326f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:26.623483 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:26.637215 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 265/522] 10.222.0.16 () {56 vars in 1139 bytes} [Fri Sep 30 09:27:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:26.638035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610994d-5362-4dea-b104-34052716326f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:26.706802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e9d23-6358-4b4f-bb57-b335aaefc4c8 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:26.741168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610994d-5362-4dea-b104-34052716326f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:26.747611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fc929-1de0-40c3-97ec-57e7281ed6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:26.748217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fc929-1de0-40c3-97ec-57e7281ed6c3 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:26.748530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fc929-1de0-40c3-97ec-57e7281ed6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:26.748794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fc929-1de0-40c3-97ec-57e7281ed6c3 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:26.749890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fc929-1de0-40c3-97ec-57e7281ed6c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:26.750198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fc929-1de0-40c3-97ec-57e7281ed6c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:26.751901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fc929-1de0-40c3-97ec-57e7281ed6c3 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:26.755632 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:26.765804 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 258/523] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:26.769727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fc929-1de0-40c3-97ec-57e7281ed6c3 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:26.777836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bb1a8-8812-427f-9a6b-26ba6dbc66fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:26.778451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bb1a8-8812-427f-9a6b-26ba6dbc66fd None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:26.778726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bb1a8-8812-427f-9a6b-26ba6dbc66fd None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:26.778990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bb1a8-8812-427f-9a6b-26ba6dbc66fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:26.790037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718bb1a8-8812-427f-9a6b-26ba6dbc66fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:26.791499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718bb1a8-8812-427f-9a6b-26ba6dbc66fd None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:26.807740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-718bb1a8-8812-427f-9a6b-26ba6dbc66fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:26.807740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:26.807740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:26.807740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:26.807740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:26.807740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:26.807740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:26.807740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:26.807740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:26.807740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:26.807740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:26.807740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:26.807740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:26.807740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:26.807740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:26.807740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:26.808694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:26.808694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:26.808694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:26.808694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:26.808694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:26.808694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:26.808694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:26.808694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:26.808694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:26.808694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:26.808694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:26.808694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:26.808694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:26.808694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:26.808694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:26.808694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:26.808694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:26.814248 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:26.814248 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:26.814248 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:26.814248 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 266/524] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:26.814248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bb1a8-8812-427f-9a6b-26ba6dbc66fd None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:26.875962 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:26.884617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fc929-1de0-40c3-97ec-57e7281ed6c3 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:26.919225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bb1a8-8812-427f-9a6b-26ba6dbc66fd None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:26.928537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257e4ab-bb64-41a9-a3ba-b56c3680a77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:26.932810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257e4ab-bb64-41a9-a3ba-b56c3680a77a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:26.933125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257e4ab-bb64-41a9-a3ba-b56c3680a77a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:26.933566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257e4ab-bb64-41a9-a3ba-b56c3680a77a None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:26.934353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257e4ab-bb64-41a9-a3ba-b56c3680a77a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:26.934661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257e4ab-bb64-41a9-a3ba-b56c3680a77a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:26.936655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257e4ab-bb64-41a9-a3ba-b56c3680a77a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:26.954747 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 259/525] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:26.954747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257e4ab-bb64-41a9-a3ba-b56c3680a77a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:26.964688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4923aee-f37e-4c65-b5e5-5ff23167fdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:26.965648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4923aee-f37e-4c65-b5e5-5ff23167fdc1 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:26.965925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4923aee-f37e-4c65-b5e5-5ff23167fdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:26.966192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4923aee-f37e-4c65-b5e5-5ff23167fdc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:27.002555 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:27.042988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4923aee-f37e-4c65-b5e5-5ff23167fdc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:27.044420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4923aee-f37e-4c65-b5e5-5ff23167fdc1 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:27.063644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257e4ab-bb64-41a9-a3ba-b56c3680a77a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:27.099781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8ca18-6f14-4372-8a4f-481db83f5ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:27.100402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8ca18-6f14-4372-8a4f-481db83f5ae0 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:27.100716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8ca18-6f14-4372-8a4f-481db83f5ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:27.100977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8ca18-6f14-4372-8a4f-481db83f5ae0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:27.107927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8ca18-6f14-4372-8a4f-481db83f5ae0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:27.109381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8ca18-6f14-4372-8a4f-481db83f5ae0 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:27.121695 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-a4f8ca18-6f14-4372-8a4f-481db83f5ae0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:27.121695 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:27.121695 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:27.121695 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:27.121695 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:27.121695 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:27.121695 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:27.121695 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:27.121695 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:27.121695 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:27.121695 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:27.121695 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:27.121695 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:27:27.121695 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:27:27.121695 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:27:27.122652 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:27:27.122652 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:27.122652 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:27.122652 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:27.122652 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:27.122652 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:27.122652 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:27.122652 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:27.122652 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:27.122652 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:27.122652 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:27.122652 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:27.122652 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:27.122652 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:27.122652 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:27.122652 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:27.122652 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:27.123525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:27:27.123525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:27:27.123525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:27:27.123525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:27:27.123525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:27:27.123525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:27:27.123525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:27.123525 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:27.123525 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 260/526] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:27.123525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8ca18-6f14-4372-8a4f-481db83f5ae0 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:27.141013 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:27.155198 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 267/527] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:27:27.160188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4923aee-f37e-4c65-b5e5-5ff23167fdc1 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:27.233960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8ca18-6f14-4372-8a4f-481db83f5ae0 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:27.244452 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:27.271486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661573a-5ea8-4a6a-98f6-2cd7c63aefa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:27.272100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661573a-5ea8-4a6a-98f6-2cd7c63aefa2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:27.272376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661573a-5ea8-4a6a-98f6-2cd7c63aefa2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:27.272866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661573a-5ea8-4a6a-98f6-2cd7c63aefa2 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:27.273925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661573a-5ea8-4a6a-98f6-2cd7c63aefa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:27.274308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661573a-5ea8-4a6a-98f6-2cd7c63aefa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:27.276248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661573a-5ea8-4a6a-98f6-2cd7c63aefa2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:27.282864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4923aee-f37e-4c65-b5e5-5ff23167fdc1 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:27.293797 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 261/528] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:27.293797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661573a-5ea8-4a6a-98f6-2cd7c63aefa2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:27.325284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d2256-d4d4-4e5a-94bf-e789f11a9e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:27.326129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d2256-d4d4-4e5a-94bf-e789f11a9e64 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:27.326586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d2256-d4d4-4e5a-94bf-e789f11a9e64 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:27.326851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d2256-d4d4-4e5a-94bf-e789f11a9e64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:27.333871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d2256-d4d4-4e5a-94bf-e789f11a9e64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:27.335287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d2256-d4d4-4e5a-94bf-e789f11a9e64 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:27.348192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-0d7d2256-d4d4-4e5a-94bf-e789f11a9e64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:27.348192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:27.348192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:27.348192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:27.348192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:27.348192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:27.348192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:27.348192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:27.348192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:27.348192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:27.348192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:27.348192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:27.348192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:27:27.348192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:27:27.348192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:27:27.349270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:27:27.349270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:27.349270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:27.349270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:27.349270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:27.349270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:27.349270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:27.349270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:27.349270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:27.349270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:27.349270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:27.349270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:27.349270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:27.349270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:27.349270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:27.349270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:27.349270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:27.350295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:27:27.350295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:27:27.350295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:27:27.350295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:27:27.350295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:27:27.350295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:27:27.350295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:27.350295 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:27.350295 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 268/529] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:27.350760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d2256-d4d4-4e5a-94bf-e789f11a9e64 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:27.379674 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:27.406831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661573a-5ea8-4a6a-98f6-2cd7c63aefa2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:27.445271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884bcd4-a19e-4118-a4f7-f24eb4009135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:27.445864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884bcd4-a19e-4118-a4f7-f24eb4009135 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:27.446137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884bcd4-a19e-4118-a4f7-f24eb4009135 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:27.446403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884bcd4-a19e-4118-a4f7-f24eb4009135 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:27.447990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884bcd4-a19e-4118-a4f7-f24eb4009135 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:27.448291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884bcd4-a19e-4118-a4f7-f24eb4009135 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:27.449730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884bcd4-a19e-4118-a4f7-f24eb4009135 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:27.461482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d2256-d4d4-4e5a-94bf-e789f11a9e64 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:27.472146 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 262/530] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:27:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:27.472146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884bcd4-a19e-4118-a4f7-f24eb4009135 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:27.492468 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:27.503601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a710fa-b1f8-4079-84f7-1ba36a0820f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:27.504217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a710fa-b1f8-4079-84f7-1ba36a0820f5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:27.504494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a710fa-b1f8-4079-84f7-1ba36a0820f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:27.504922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a710fa-b1f8-4079-84f7-1ba36a0820f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:27.516418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a710fa-b1f8-4079-84f7-1ba36a0820f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:27.517890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a710fa-b1f8-4079-84f7-1ba36a0820f5 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:27.531934 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-43a710fa-b1f8-4079-84f7-1ba36a0820f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:27.531934 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:27.531934 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:27.531934 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:27.531934 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:27.531934 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:27.531934 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:27.531934 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:27.531934 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:27.531934 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:27.531934 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:27.531934 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:27.531934 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:27.531934 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:27.531934 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:27.531934 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:27.538337 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:27.538337 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:27.538337 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:27.538337 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:27.538337 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:27.538337 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:27.538337 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:27.538337 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:27.538337 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:27.538337 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:27.538337 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:27.538337 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:27.538337 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:27.538337 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:27.538337 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:27.538337 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:27.538337 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:27.539392 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:27.539392 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:27.539392 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:27.539392 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 269/531] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:27.539392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a710fa-b1f8-4079-84f7-1ba36a0820f5 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:27.592677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884bcd4-a19e-4118-a4f7-f24eb4009135 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:27.630377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ddc09-cbb8-40b4-8088-e8ee48ed4662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:27.630998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ddc09-cbb8-40b4-8088-e8ee48ed4662 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:27.631274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ddc09-cbb8-40b4-8088-e8ee48ed4662 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:27.631547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ddc09-cbb8-40b4-8088-e8ee48ed4662 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:27.633954 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:27.640131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ddc09-cbb8-40b4-8088-e8ee48ed4662 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:27.642461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ddc09-cbb8-40b4-8088-e8ee48ed4662 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:27.645101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a710fa-b1f8-4079-84f7-1ba36a0820f5 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:27.653708 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-656ddc09-cbb8-40b4-8088-e8ee48ed4662 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:27.653708 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:27.653708 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:27.653708 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:27.653708 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:27.653708 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:27.653708 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:27.653708 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:27.653708 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:27.653708 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:27.653708 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:27.653708 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:27.653708 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:27:27.653708 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:27:27.653708 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:27:27.654715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:27:27.654715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:27.654715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:27.654715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:27.654715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:27.654715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:27.654715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:27.654715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:27.654715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:27.654715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:27.654715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:27.654715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:27.654715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:27.654715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:27.654715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:27.654715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:27.654715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:27.655575 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:27:27.655575 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:27:27.655575 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:27:27.655575 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:27:27.655575 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:27:27.655575 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:27:27.655575 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:27.655575 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:27.655575 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 263/532] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:27.656052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ddc09-cbb8-40b4-8088-e8ee48ed4662 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:27.687966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ed0e6-2b3d-487c-a2e0-2d410926d084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:27.688849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ed0e6-2b3d-487c-a2e0-2d410926d084 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:27.689287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ed0e6-2b3d-487c-a2e0-2d410926d084 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:27.689803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ed0e6-2b3d-487c-a2e0-2d410926d084 None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:27.690736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ed0e6-2b3d-487c-a2e0-2d410926d084 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:27.691180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ed0e6-2b3d-487c-a2e0-2d410926d084 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:27.692781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ed0e6-2b3d-487c-a2e0-2d410926d084 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:27.713297 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 270/533] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:27:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:27.714292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ed0e6-2b3d-487c-a2e0-2d410926d084 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:27.754391 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:27.769236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ddc09-cbb8-40b4-8088-e8ee48ed4662 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:27.808945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a77eb1-bfb1-4045-9c5c-60bb8bbe06a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:27.809955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a77eb1-bfb1-4045-9c5c-60bb8bbe06a5 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:27.810505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a77eb1-bfb1-4045-9c5c-60bb8bbe06a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:27.810781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a77eb1-bfb1-4045-9c5c-60bb8bbe06a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:27.811608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a77eb1-bfb1-4045-9c5c-60bb8bbe06a5 None admin] RBAC: Adding query filter params (role.id=4089b59a020f44b98fad2a34b61fd573, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=aa607111024540d1a09b01dfd1e5e8cd) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:27.812018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a77eb1-bfb1-4045-9c5c-60bb8bbe06a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:27.813477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a77eb1-bfb1-4045-9c5c-60bb8bbe06a5 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:27.814911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ed0e6-2b3d-487c-a2e0-2d410926d084 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:27.828779 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 264/534] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:27:27 2022] GET /identity/v3/role_assignments?user.id=aa607111024540d1a09b01dfd1e5e8cd&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=4089b59a020f44b98fad2a34b61fd573 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:27.828779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a77eb1-bfb1-4045-9c5c-60bb8bbe06a5 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:27.856034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616502f-d1cd-4724-9bf8-3edbd87194e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:27.856702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616502f-d1cd-4724-9bf8-3edbd87194e3 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:27.857043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616502f-d1cd-4724-9bf8-3edbd87194e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:27.857373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616502f-d1cd-4724-9bf8-3edbd87194e3 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:27.858103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616502f-d1cd-4724-9bf8-3edbd87194e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:27.858516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616502f-d1cd-4724-9bf8-3edbd87194e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:27.860042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616502f-d1cd-4724-9bf8-3edbd87194e3 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:27.877677 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 271/535] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:27.878825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616502f-d1cd-4724-9bf8-3edbd87194e3 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:27.910453 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:27.971400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a77eb1-bfb1-4045-9c5c-60bb8bbe06a5 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:28.016311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84dc88-cb74-4117-a9a3-3387ce22492d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:28.016577 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:28.018003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84dc88-cb74-4117-a9a3-3387ce22492d None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:28.018314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84dc88-cb74-4117-a9a3-3387ce22492d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:28.018661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84dc88-cb74-4117-a9a3-3387ce22492d None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:28.019519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84dc88-cb74-4117-a9a3-3387ce22492d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:28.019746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84dc88-cb74-4117-a9a3-3387ce22492d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:28.020789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616502f-d1cd-4724-9bf8-3edbd87194e3 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:28.021277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84dc88-cb74-4117-a9a3-3387ce22492d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:28.038076 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 265/536] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:27:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:28.039300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84dc88-cb74-4117-a9a3-3387ce22492d None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:28.069367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac2334-d105-4112-a09a-d96ac6c4f764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:28.070019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac2334-d105-4112-a09a-d96ac6c4f764 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:28.070295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac2334-d105-4112-a09a-d96ac6c4f764 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:28.070559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac2334-d105-4112-a09a-d96ac6c4f764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:28.071647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac2334-d105-4112-a09a-d96ac6c4f764 None admin] RBAC: Adding query filter params (role.id=4089b59a020f44b98fad2a34b61fd573, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=947a48b06bb74f068b70e8c17a8da422) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:28.071955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac2334-d105-4112-a09a-d96ac6c4f764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:28.074426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac2334-d105-4112-a09a-d96ac6c4f764 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:28.082765 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 272/537] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:27:27 2022] GET /identity/v3/role_assignments?user.id=947a48b06bb74f068b70e8c17a8da422&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=4089b59a020f44b98fad2a34b61fd573 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:28.084367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac2334-d105-4112-a09a-d96ac6c4f764 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:28.250061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac2334-d105-4112-a09a-d96ac6c4f764 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:28.255014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84dc88-cb74-4117-a9a3-3387ce22492d None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:28.292742 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:28.324834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567706f-416b-47e1-89f0-0555be2bc0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:28.327126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567706f-416b-47e1-89f0-0555be2bc0ac None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:28.327407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567706f-416b-47e1-89f0-0555be2bc0ac None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:28.327682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567706f-416b-47e1-89f0-0555be2bc0ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:28.328426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567706f-416b-47e1-89f0-0555be2bc0ac None admin] RBAC: Adding query filter params (role.id=4089b59a020f44b98fad2a34b61fd573, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=ebc6604430ba4e2283994e5cb8ef18d3) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:28.328765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567706f-416b-47e1-89f0-0555be2bc0ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:28.330870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ef42b-f9b2-4724-828d-b2a279f06549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:28.331801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ef42b-f9b2-4724-828d-b2a279f06549 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:28.332076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ef42b-f9b2-4724-828d-b2a279f06549 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:28.332343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ef42b-f9b2-4724-828d-b2a279f06549 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:28.332961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567706f-416b-47e1-89f0-0555be2bc0ac None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:28.341828 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 273/538] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:27:28 2022] GET /identity/v3/role_assignments?user.id=ebc6604430ba4e2283994e5cb8ef18d3&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=4089b59a020f44b98fad2a34b61fd573 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:28.348051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ef42b-f9b2-4724-828d-b2a279f06549 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:28.351015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ef42b-f9b2-4724-828d-b2a279f06549 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:28.365116 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-d14ef42b-f9b2-4724-828d-b2a279f06549 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:28.365116 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:28.365116 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:28.365116 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:28.365116 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:28.365116 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:28.365116 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:28.365116 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:28.365116 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:28.365116 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:28.365116 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:28.365116 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:28.365116 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:27:28.365116 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:27:28.365116 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:27:28.366034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:27:28.366034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:28.366034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:28.366034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:28.366034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:28.366034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:28.366034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:28.366034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:28.366034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:28.366034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:28.366034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:28.366034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:28.366034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:28.366034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:28.366034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:28.366034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:28.366034 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:28.366856 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:27:28.366856 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:27:28.366856 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:27:28.366856 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:27:28.366856 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:27:28.366856 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:27:28.366856 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:28.366856 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:28.370364 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 266/539] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:28.377213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567706f-416b-47e1-89f0-0555be2bc0ac None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:28.427590 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:28.540306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567706f-416b-47e1-89f0-0555be2bc0ac None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:28.577885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e601fe-41c2-4a3f-b099-a4b179491a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:28.578492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e601fe-41c2-4a3f-b099-a4b179491a31 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:28.578774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e601fe-41c2-4a3f-b099-a4b179491a31 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:28.579044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e601fe-41c2-4a3f-b099-a4b179491a31 None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:28.579741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e601fe-41c2-4a3f-b099-a4b179491a31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:28.580044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e601fe-41c2-4a3f-b099-a4b179491a31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:28.581776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e601fe-41c2-4a3f-b099-a4b179491a31 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:28.596266 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 274/540] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:27:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:28.601845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ef42b-f9b2-4724-828d-b2a279f06549 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:28.608750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425a4cb-75a5-4ee8-9d1a-1900ea9cb669 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:28.609120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425a4cb-75a5-4ee8-9d1a-1900ea9cb669 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:28.609466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425a4cb-75a5-4ee8-9d1a-1900ea9cb669 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:28.611175 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 275/541] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:28.629734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c19aac-da78-4bcd-992e-7e4a8bd37a50 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:28.630095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c19aac-da78-4bcd-992e-7e4a8bd37a50 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:28.630435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c19aac-da78-4bcd-992e-7e4a8bd37a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:28.657819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-34c19aac-da78-4bcd-992e-7e4a8bd37a50 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:28.660532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-34c19aac-da78-4bcd-992e-7e4a8bd37a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:28.780632 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 276/542] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:27:28.798667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ef42b-f9b2-4724-828d-b2a279f06549 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:28.847889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c142da-e5a5-4133-973c-aebc6ae20682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:28.848657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c142da-e5a5-4133-973c-aebc6ae20682 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:28.849005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c142da-e5a5-4133-973c-aebc6ae20682 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:28.849346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c142da-e5a5-4133-973c-aebc6ae20682 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:28.850191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c142da-e5a5-4133-973c-aebc6ae20682 None admin] RBAC: Adding query filter params (role.id=4089b59a020f44b98fad2a34b61fd573, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=a9b0fd833b134a089433cd2985caba80) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:28.850568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c142da-e5a5-4133-973c-aebc6ae20682 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:28.852043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c142da-e5a5-4133-973c-aebc6ae20682 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:28.861067 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 267/543] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:27:28 2022] GET /identity/v3/role_assignments?user.id=a9b0fd833b134a089433cd2985caba80&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=4089b59a020f44b98fad2a34b61fd573 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:29.123460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c19aac-da78-4bcd-992e-7e4a8bd37a50 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:29.142498 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:29.236310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c19aac-da78-4bcd-992e-7e4a8bd37a50 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:29.275896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a88b7-c377-4269-afca-7b1eb6bd1142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:29.276541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a88b7-c377-4269-afca-7b1eb6bd1142 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:29.276850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a88b7-c377-4269-afca-7b1eb6bd1142 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:29.277123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a88b7-c377-4269-afca-7b1eb6bd1142 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:29.288136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a88b7-c377-4269-afca-7b1eb6bd1142 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:29.294177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-470a88b7-c377-4269-afca-7b1eb6bd1142 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:29.294177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:29.294177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:29.294177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:29.294177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:29.294177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:29.294177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:29.294177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:29.294177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:29.294177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:29.294177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:29.294177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:29.294177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:29.294177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:29.294177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:29.294177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:29.295062 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:29.295062 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:29.295062 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:29.295062 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:29.295062 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:29.295062 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:29.295062 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:29.295062 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:29.295062 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:29.295062 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:29.295062 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:29.295062 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:29.295062 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:29.295062 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:29.295062 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:29.295062 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:29.296229 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:29.296229 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:29.296229 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:29.296229 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:29.296229 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:29.296229 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:29.296229 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:29.296229 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:29.296229 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:29.296229 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:29.296229 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:29.296229 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:29.296229 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 277/544] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:27:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:29.301314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c142da-e5a5-4133-973c-aebc6ae20682 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:29.361804 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:29.432969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c142da-e5a5-4133-973c-aebc6ae20682 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:29.479842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35940bbe-5651-49eb-981a-ee1245c125b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:29.480451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35940bbe-5651-49eb-981a-ee1245c125b3 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:29.480754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35940bbe-5651-49eb-981a-ee1245c125b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:29.481023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35940bbe-5651-49eb-981a-ee1245c125b3 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:29.481691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35940bbe-5651-49eb-981a-ee1245c125b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:29.481991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35940bbe-5651-49eb-981a-ee1245c125b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:29.483351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35940bbe-5651-49eb-981a-ee1245c125b3 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:29.496661 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 268/545] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Sep 30 09:27:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:29.501875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a88b7-c377-4269-afca-7b1eb6bd1142 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:29.601344 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:29.627387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a88b7-c377-4269-afca-7b1eb6bd1142 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:29.667868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432254b-ea41-44f5-8554-8f96ecc07372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:29.668500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432254b-ea41-44f5-8554-8f96ecc07372 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:29.668810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432254b-ea41-44f5-8554-8f96ecc07372 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:29.669083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432254b-ea41-44f5-8554-8f96ecc07372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:29.682585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432254b-ea41-44f5-8554-8f96ecc07372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:29.684947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432254b-ea41-44f5-8554-8f96ecc07372 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:29.701439 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-8432254b-ea41-44f5-8554-8f96ecc07372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:29.701439 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:29.701439 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:29.701439 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:29.701439 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:29.701439 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:29.701439 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:29.701439 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:29.701439 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:29.701439 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:29.701439 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:29.701439 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:29.701439 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:29.701439 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:29.701439 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:29.701439 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:29.702351 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:29.702351 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:29.702351 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:29.702351 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:29.702351 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:29.702351 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:29.702351 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:29.702351 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:29.702351 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:29.702351 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:29.702351 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:29.702351 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:29.702351 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:29.702351 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:29.702351 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:29.702351 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:29.702351 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:29.703598 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:29.703598 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:29.703598 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:29.703598 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 278/546] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:29.708668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35940bbe-5651-49eb-981a-ee1245c125b3 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:29.837029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35940bbe-5651-49eb-981a-ee1245c125b3 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:29.843378 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:29.886048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62bf33-4917-4c68-af7a-92de929c4313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:29.886774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62bf33-4917-4c68-af7a-92de929c4313 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:29.887057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62bf33-4917-4c68-af7a-92de929c4313 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:29.887332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62bf33-4917-4c68-af7a-92de929c4313 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:29.887982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62bf33-4917-4c68-af7a-92de929c4313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:29.888339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62bf33-4917-4c68-af7a-92de929c4313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:29.889745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62bf33-4917-4c68-af7a-92de929c4313 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:29.909990 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 269/547] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:29.917232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432254b-ea41-44f5-8554-8f96ecc07372 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:30.027837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432254b-ea41-44f5-8554-8f96ecc07372 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:30.055388 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:30.064317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4274f-fa6a-465a-8e8e-bd504bf1d11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:30.065218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4274f-fa6a-465a-8e8e-bd504bf1d11c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:30.065830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4274f-fa6a-465a-8e8e-bd504bf1d11c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:30.066100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4274f-fa6a-465a-8e8e-bd504bf1d11c None admin] PATH_INFO: `/v3/users/swift` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:30.074311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4274f-fa6a-465a-8e8e-bd504bf1d11c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:30.075737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4274f-fa6a-465a-8e8e-bd504bf1d11c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:30.088128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-59d4274f-fa6a-465a-8e8e-bd504bf1d11c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:27:30.088128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:30.088128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:30.088128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:30.088128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:30.088128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:30.088128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:30.088128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:30.088128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:30.088128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:30.088128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:30.088128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:30.088128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:27:30.088128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:27:30.088128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:27:30.088128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:27:30.089558 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:30.089558 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:30.089558 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:27:30.089558 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:30.089558 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:27:30.089558 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:30.089558 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:30.089558 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:30.089558 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:30.089558 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:30.089558 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:30.089558 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:30.089558 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:30.089558 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:30.089558 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:30.089558 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:30.089558 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:30.089558 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:30.090614 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:30.090614 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:30.090614 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:27:30.090614 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:27:30.090614 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:27:30.090614 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:27:30.090614 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:27:30.090614 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:27:30.090614 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:27:30.090614 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:30.090614 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 279/548] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:27:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:30.095190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62bf33-4917-4c68-af7a-92de929c4313 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:30.223345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62bf33-4917-4c68-af7a-92de929c4313 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:30.260587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a7a22-5433-4ea3-8dc1-e01c378fccaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:30.261217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a7a22-5433-4ea3-8dc1-e01c378fccaa None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:30.261492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a7a22-5433-4ea3-8dc1-e01c378fccaa None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:30.261758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a7a22-5433-4ea3-8dc1-e01c378fccaa None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:30.262535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a7a22-5433-4ea3-8dc1-e01c378fccaa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:30.262831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a7a22-5433-4ea3-8dc1-e01c378fccaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:30.264328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a7a22-5433-4ea3-8dc1-e01c378fccaa None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:30.283876 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 270/549] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Sep 30 09:27:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:30.289392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4274f-fa6a-465a-8e8e-bd504bf1d11c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:30.422473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4274f-fa6a-465a-8e8e-bd504bf1d11c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:30.464994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00ab23-935e-4b14-b3b1-7c62f02405d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:30.465923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00ab23-935e-4b14-b3b1-7c62f02405d7 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:30.466375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00ab23-935e-4b14-b3b1-7c62f02405d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:30.466812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00ab23-935e-4b14-b3b1-7c62f02405d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:30.544731 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:30.558911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00ab23-935e-4b14-b3b1-7c62f02405d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:30.560650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00ab23-935e-4b14-b3b1-7c62f02405d7 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:30.685844 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 280/550] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:27:30.691458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a7a22-5433-4ea3-8dc1-e01c378fccaa None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:30.737283 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:30.848991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a7a22-5433-4ea3-8dc1-e01c378fccaa None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:30.856473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bab21e-5a64-4633-a784-803a3f47cad6 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:30.856805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bab21e-5a64-4633-a784-803a3f47cad6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:30.857136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bab21e-5a64-4633-a784-803a3f47cad6 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:30.858470 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 281/551] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:30.870840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93e8bc-6e50-4a08-9d16-720973ab51c3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:30.871096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93e8bc-6e50-4a08-9d16-720973ab51c3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:30.871357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93e8bc-6e50-4a08-9d16-720973ab51c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:30.889522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3dc5cf-1271-4b7f-b56b-353add7bed46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:30.890156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dc5cf-1271-4b7f-b56b-353add7bed46 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:30.890432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dc5cf-1271-4b7f-b56b-353add7bed46 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:30.890705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dc5cf-1271-4b7f-b56b-353add7bed46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:30.901821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fe93e8bc-6e50-4a08-9d16-720973ab51c3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:30.903324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fe93e8bc-6e50-4a08-9d16-720973ab51c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:30.904537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3dc5cf-1271-4b7f-b56b-353add7bed46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:30.906004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3dc5cf-1271-4b7f-b56b-353add7bed46 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:30.921707 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-0e3dc5cf-1271-4b7f-b56b-353add7bed46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:30.921707 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:30.921707 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:30.921707 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:30.921707 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:30.921707 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:30.921707 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:30.921707 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:30.921707 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:30.921707 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:30.921707 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:30.921707 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:30.921707 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:30.921707 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:30.921707 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:30.921707 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:30.922721 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:30.922721 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:30.922721 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:30.922721 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:30.922721 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:30.922721 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:30.922721 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:30.922721 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:30.922721 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:30.922721 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:30.922721 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:30.922721 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:30.922721 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:30.922721 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:30.922721 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:30.922721 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:30.922721 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:30.923587 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:30.923587 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:30.923587 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:30.923587 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 271/552] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:30.924453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7e1fc-bbd6-4949-a389-bd5fb2372bf3 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:30.924760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7e1fc-bbd6-4949-a389-bd5fb2372bf3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:30.925033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7e1fc-bbd6-4949-a389-bd5fb2372bf3 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:30.926529 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 272/553] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:30.928643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7e1fc-bbd6-4949-a389-bd5fb2372bf3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:31.020807 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 282/554] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:27:31.020807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bff587-1ac4-4d6a-9071-e71d1a49d7e7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:31.020807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bff587-1ac4-4d6a-9071-e71d1a49d7e7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:31.020807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bff587-1ac4-4d6a-9071-e71d1a49d7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:31.036560 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:31.059706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-49bff587-1ac4-4d6a-9071-e71d1a49d7e7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:31.060784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-49bff587-1ac4-4d6a-9071-e71d1a49d7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:31.086833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7e1fc-bbd6-4949-a389-bd5fb2372bf3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:31.091004 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:31.126598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f766f-46c0-4e2d-a040-1f777b61c112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:31.127531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f766f-46c0-4e2d-a040-1f777b61c112 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:31.128404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f766f-46c0-4e2d-a040-1f777b61c112 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:31.128910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f766f-46c0-4e2d-a040-1f777b61c112 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:31.129814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f766f-46c0-4e2d-a040-1f777b61c112 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:31.130631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f766f-46c0-4e2d-a040-1f777b61c112 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:31.132787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f766f-46c0-4e2d-a040-1f777b61c112 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:31.153991 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 273/555] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:31.154263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21614b-784c-429e-89bd-ec0b2fe45406 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:31.154342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21614b-784c-429e-89bd-ec0b2fe45406 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:31.154738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21614b-784c-429e-89bd-ec0b2fe45406 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:31.156730 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 274/556] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:31.157938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21614b-784c-429e-89bd-ec0b2fe45406 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:31.167792 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 283/557] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:31.176736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed4b5d-d027-4c44-9bda-309686a136f1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:31.176736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed4b5d-d027-4c44-9bda-309686a136f1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:31.176736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed4b5d-d027-4c44-9bda-309686a136f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:31.199435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-74ed4b5d-d027-4c44-9bda-309686a136f1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:31.202131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-74ed4b5d-d027-4c44-9bda-309686a136f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:31.333415 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 284/558] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:31.341696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed4b5d-d027-4c44-9bda-309686a136f1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:31.371251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21614b-784c-429e-89bd-ec0b2fe45406 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:31.440864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdecd60-d618-4d43-b1e6-ad4900107c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:31.441882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdecd60-d618-4d43-b1e6-ad4900107c12 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:31.442363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdecd60-d618-4d43-b1e6-ad4900107c12 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:31.442840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdecd60-d618-4d43-b1e6-ad4900107c12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:31.445552 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:31.454904 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:31.460044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdecd60-d618-4d43-b1e6-ad4900107c12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:31.461573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdecd60-d618-4d43-b1e6-ad4900107c12 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:31.478382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed4b5d-d027-4c44-9bda-309686a136f1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:31.483031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-0fdecd60-d618-4d43-b1e6-ad4900107c12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:31.483031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:31.483031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:31.483031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:31.483031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:31.483031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:31.483031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:31.483031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:31.483031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:31.483031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:31.483031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:31.483031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:31.483031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:27:31.483031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:27:31.483031 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:27:31.483871 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:27:31.483871 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:31.483871 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:31.483871 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:31.483871 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:31.483871 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:31.483871 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:31.483871 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:31.483871 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:31.483871 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:31.483871 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:31.483871 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:31.483871 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:31.483871 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:31.483871 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:31.483871 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:31.483871 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:31.484744 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:27:31.484744 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:27:31.484744 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:27:31.484744 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:27:31.484744 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:27:31.484744 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:27:31.484744 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:31.484744 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:31.488331 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 275/559] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:31.493234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdecd60-d618-4d43-b1e6-ad4900107c12 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:31.527104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e33f28-1839-470a-b61a-0b681f8029fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:31.528140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e33f28-1839-470a-b61a-0b681f8029fb None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:31.528987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e33f28-1839-470a-b61a-0b681f8029fb None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:31.529481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e33f28-1839-470a-b61a-0b681f8029fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:31.541835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e33f28-1839-470a-b61a-0b681f8029fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:31.547135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-77e33f28-1839-470a-b61a-0b681f8029fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:31.547135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:31.547135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:31.547135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:31.547135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:31.547135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:31.547135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:31.547135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:31.547135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:31.547135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:31.547135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:31.547135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:31.547135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:31.547135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:31.547135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:31.547135 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:31.548233 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:31.548233 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:31.548233 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:31.548233 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:31.548233 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:31.548233 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:31.548233 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:31.548233 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:31.548233 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:31.548233 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:31.548233 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:31.548233 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:31.548233 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:31.548233 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:31.548233 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:31.548233 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:31.549281 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:31.549281 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:31.549281 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:31.549281 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:31.549281 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:31.549281 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:31.549281 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:31.549281 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:31.549281 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:31.549281 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:31.549281 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:31.549281 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:31.556389 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 285/560] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:27:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:31.557398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e33f28-1839-470a-b61a-0b681f8029fb None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:31.620299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdecd60-d618-4d43-b1e6-ad4900107c12 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:31.672021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e33f28-1839-470a-b61a-0b681f8029fb None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:31.672883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36412ff2-d507-4bb1-a839-c57dc8a7ac2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:31.673943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36412ff2-d507-4bb1-a839-c57dc8a7ac2d None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:31.675273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36412ff2-d507-4bb1-a839-c57dc8a7ac2d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:31.675731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36412ff2-d507-4bb1-a839-c57dc8a7ac2d None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:31.676643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36412ff2-d507-4bb1-a839-c57dc8a7ac2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:31.677130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36412ff2-d507-4bb1-a839-c57dc8a7ac2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:31.678723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36412ff2-d507-4bb1-a839-c57dc8a7ac2d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:31.694281 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 276/561] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:27:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:31.696145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36412ff2-d507-4bb1-a839-c57dc8a7ac2d None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:31.713404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694d3d0-1d30-484c-9daf-657343384314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:31.714262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694d3d0-1d30-484c-9daf-657343384314 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:31.714822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694d3d0-1d30-484c-9daf-657343384314 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:31.714822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694d3d0-1d30-484c-9daf-657343384314 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:31.722353 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:31.726533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694d3d0-1d30-484c-9daf-657343384314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:31.732128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-e694d3d0-1d30-484c-9daf-657343384314 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:31.732128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:31.732128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:31.732128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:31.732128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:31.732128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:31.732128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:31.732128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:31.732128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:31.732128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:31.732128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:31.732128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:31.732128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:31.732128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:31.732128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:31.732128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:31.733167 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:31.733167 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:31.733167 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:31.733167 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:31.733167 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:31.733167 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:31.733167 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:31.733167 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:31.733167 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:31.733167 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:31.733167 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:31.733167 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:31.733167 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:31.733167 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:31.733167 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:31.733167 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:31.733998 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:31.733998 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:31.733998 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:31.733998 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:31.733998 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:31.733998 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:31.733998 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:31.733998 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:31.733998 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:31.733998 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:31.733998 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:31.733998 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:31.733998 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 286/562] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:27:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:31.733998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694d3d0-1d30-484c-9daf-657343384314 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:31.758388 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:31.802931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36412ff2-d507-4bb1-a839-c57dc8a7ac2d None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:31.830129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694d3d0-1d30-484c-9daf-657343384314 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:31.835411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0187ab-f237-4a9d-b154-9eab459976e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:31.836005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0187ab-f237-4a9d-b154-9eab459976e2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:31.836280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0187ab-f237-4a9d-b154-9eab459976e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:31.836549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0187ab-f237-4a9d-b154-9eab459976e2 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:31.837895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0187ab-f237-4a9d-b154-9eab459976e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:31.838333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0187ab-f237-4a9d-b154-9eab459976e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:31.839670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0187ab-f237-4a9d-b154-9eab459976e2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:31.847278 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 277/563] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Sep 30 09:27:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:31.848044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0187ab-f237-4a9d-b154-9eab459976e2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:31.864499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed6c71-8256-4614-9999-6c0ef6086865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:31.865140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed6c71-8256-4614-9999-6c0ef6086865 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:31.865420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed6c71-8256-4614-9999-6c0ef6086865 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:31.865685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed6c71-8256-4614-9999-6c0ef6086865 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:31.875974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed6c71-8256-4614-9999-6c0ef6086865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:31.880574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-85ed6c71-8256-4614-9999-6c0ef6086865 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:31.880574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:31.880574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:31.880574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:31.880574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:31.880574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:31.880574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:31.880574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:31.880574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:31.880574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:31.880574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:31.880574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:31.880574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:31.880574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:31.880574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:31.880574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:31.881628 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:31.881628 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:31.881628 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:31.881628 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:31.881628 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:31.881628 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:31.881628 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:31.881628 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:31.881628 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:31.881628 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:31.881628 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:31.881628 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:31.881628 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:31.881628 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:31.881628 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:31.881628 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:31.885808 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:31.885808 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:31.885808 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:31.885808 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:31.885808 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:31.885808 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:31.885808 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:31.885808 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:31.885808 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:31.885808 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:31.885808 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:31.885808 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:31.885808 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 287/564] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:27:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:31.885808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aeb532-b194-4d60-8985-8c41a45314d8 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:31.886567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aeb532-b194-4d60-8985-8c41a45314d8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:31.886567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aeb532-b194-4d60-8985-8c41a45314d8 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:31.886567 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 288/565] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:31.886567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aeb532-b194-4d60-8985-8c41a45314d8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:31.949507 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:31.956240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0187ab-f237-4a9d-b154-9eab459976e2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:31.972465 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:31.990043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c1041-b2eb-4ead-953b-57da6c77cd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:31.990640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c1041-b2eb-4ead-953b-57da6c77cd86 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:31.990915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c1041-b2eb-4ead-953b-57da6c77cd86 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:31.991184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c1041-b2eb-4ead-953b-57da6c77cd86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:31.991894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c1041-b2eb-4ead-953b-57da6c77cd86 None admin] RBAC: Adding query filter params (role.id=4089b59a020f44b98fad2a34b61fd573, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=963c491a2d2e409b8b45e4fb6aff41c3) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:31.992115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aeb532-b194-4d60-8985-8c41a45314d8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:31.992211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c1041-b2eb-4ead-953b-57da6c77cd86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:31.994309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c1041-b2eb-4ead-953b-57da6c77cd86 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:31.999471 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 278/566] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:27:31 2022] GET /identity/v3/role_assignments?user.id=963c491a2d2e409b8b45e4fb6aff41c3&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=4089b59a020f44b98fad2a34b61fd573 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:32.000231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c1041-b2eb-4ead-953b-57da6c77cd86 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:32.029310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969d555-3d31-407f-b604-c0e67007ab6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:32.029924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969d555-3d31-407f-b604-c0e67007ab6c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:32.030200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969d555-3d31-407f-b604-c0e67007ab6c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:32.030466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969d555-3d31-407f-b604-c0e67007ab6c None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:32.031144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969d555-3d31-407f-b604-c0e67007ab6c None admin] RBAC: Adding query filter params (name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:32.031447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969d555-3d31-407f-b604-c0e67007ab6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:32.032878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969d555-3d31-407f-b604-c0e67007ab6c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:32.046759 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 289/567] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Sep 30 09:27:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:32.046759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969d555-3d31-407f-b604-c0e67007ab6c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:32.140408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c1041-b2eb-4ead-953b-57da6c77cd86 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:32.155315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969d555-3d31-407f-b604-c0e67007ab6c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:32.178160 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:32.181167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338210d4-d968-47e3-8636-a55c887f65c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:32.181942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338210d4-d968-47e3-8636-a55c887f65c5 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:32.182563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338210d4-d968-47e3-8636-a55c887f65c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:32.182829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338210d4-d968-47e3-8636-a55c887f65c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:32.193925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b66398-04da-4eb1-974a-5b64d2b5c1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:32.194525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b66398-04da-4eb1-974a-5b64d2b5c1f9 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:32.194644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338210d4-d968-47e3-8636-a55c887f65c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:32.194830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b66398-04da-4eb1-974a-5b64d2b5c1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:32.195069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b66398-04da-4eb1-974a-5b64d2b5c1f9 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:32.195731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b66398-04da-4eb1-974a-5b64d2b5c1f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:32.195929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338210d4-d968-47e3-8636-a55c887f65c5 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:32.196034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b66398-04da-4eb1-974a-5b64d2b5c1f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:32.197970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b66398-04da-4eb1-974a-5b64d2b5c1f9 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:32.206117 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 290/568] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Sep 30 09:27:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:32.207455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa97b29-9767-4eaf-beb2-244a2ea6375d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:32.207819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa97b29-9767-4eaf-beb2-244a2ea6375d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:32.207996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa97b29-9767-4eaf-beb2-244a2ea6375d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:32.218106 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-338210d4-d968-47e3-8636-a55c887f65c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:32.218106 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:32.218106 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:32.218106 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:32.218106 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:32.218106 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:32.218106 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:32.218106 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:32.218106 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:32.218106 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:32.218106 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:32.218106 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:32.218106 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:32.218106 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:32.218106 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:32.218106 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:32.219022 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:32.219022 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:32.219022 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:32.219022 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:32.219022 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:32.219022 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:32.219022 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:32.219022 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:32.219022 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:32.219022 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:32.219022 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:32.219022 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:32.219022 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:32.219022 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:32.219022 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:32.219022 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:32.219022 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:32.224757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:32.224757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:32.224757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:32.224757 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 279/569] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:32.224757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338210d4-d968-47e3-8636-a55c887f65c5 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:32.226003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8aa97b29-9767-4eaf-beb2-244a2ea6375d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:32.227592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8aa97b29-9767-4eaf-beb2-244a2ea6375d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:32.260725 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:32.300482 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 291/570] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:32.301383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa97b29-9767-4eaf-beb2-244a2ea6375d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:32.356085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338210d4-d968-47e3-8636-a55c887f65c5 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:32.402443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140391e-56d7-481b-9f36-88e9cbcb35e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:32.403696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140391e-56d7-481b-9f36-88e9cbcb35e5 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:32.404194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140391e-56d7-481b-9f36-88e9cbcb35e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:32.404934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140391e-56d7-481b-9f36-88e9cbcb35e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:32.420376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140391e-56d7-481b-9f36-88e9cbcb35e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:32.422783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140391e-56d7-481b-9f36-88e9cbcb35e5 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:32.423722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa97b29-9767-4eaf-beb2-244a2ea6375d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:32.437706 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:32.443348 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-d140391e-56d7-481b-9f36-88e9cbcb35e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:32.443348 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:32.443348 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:32.443348 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:32.443348 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:32.443348 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:32.443348 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:32.443348 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:32.443348 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:32.443348 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:32.443348 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:32.443348 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:32.443348 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:32.443348 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:32.443348 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:32.443348 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:32.444287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:32.444287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:32.444287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:32.444287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:32.444287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:32.444287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:32.444287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:32.444287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:32.444287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:32.444287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:32.444287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:32.444287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:32.444287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:32.444287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:32.444287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:32.444287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:32.444287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:32.445213 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:32.445213 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:32.445213 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:32.449383 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 280/571] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:32.450674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140391e-56d7-481b-9f36-88e9cbcb35e5 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:32.473696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41d554-e610-43c7-9589-dace0d4f5e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:32.474254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41d554-e610-43c7-9589-dace0d4f5e0a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:32.474537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41d554-e610-43c7-9589-dace0d4f5e0a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:32.474810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41d554-e610-43c7-9589-dace0d4f5e0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:32.488863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41d554-e610-43c7-9589-dace0d4f5e0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:32.490714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41d554-e610-43c7-9589-dace0d4f5e0a None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:32.512650 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-8f41d554-e610-43c7-9589-dace0d4f5e0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:32.512650 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:32.512650 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:32.512650 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:32.512650 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:32.512650 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:32.512650 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:32.512650 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:32.512650 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:32.512650 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:32.512650 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:32.512650 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:32.512650 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:32.512650 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:32.512650 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:32.512650 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:32.513653 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:32.513653 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:32.513653 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:32.513653 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:32.513653 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:32.513653 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:32.513653 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:32.513653 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:32.513653 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:32.513653 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:32.513653 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:32.513653 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:32.513653 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:32.513653 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:32.513653 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:32.513653 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:32.513653 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:32.514547 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:32.514547 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:32.514547 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:32.516684 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 292/572] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:32.517726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41d554-e610-43c7-9589-dace0d4f5e0a None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:32.558858 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:32.575654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140391e-56d7-481b-9f36-88e9cbcb35e5 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:32.612171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39314df5-8316-4c40-8c9c-521bec385711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:32.612804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39314df5-8316-4c40-8c9c-521bec385711 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:32.613084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39314df5-8316-4c40-8c9c-521bec385711 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:32.613356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39314df5-8316-4c40-8c9c-521bec385711 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:32.613989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39314df5-8316-4c40-8c9c-521bec385711 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:32.614290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39314df5-8316-4c40-8c9c-521bec385711 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:32.615656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39314df5-8316-4c40-8c9c-521bec385711 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:32.627597 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41d554-e610-43c7-9589-dace0d4f5e0a None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:32.632054 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 281/573] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:32.632054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39314df5-8316-4c40-8c9c-521bec385711 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:32.674251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dae521-104d-4c7a-aa93-7df48f6215d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:32.674856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dae521-104d-4c7a-aa93-7df48f6215d4 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:32.675131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dae521-104d-4c7a-aa93-7df48f6215d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:32.675398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dae521-104d-4c7a-aa93-7df48f6215d4 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:32.676124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dae521-104d-4c7a-aa93-7df48f6215d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:32.676329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dae521-104d-4c7a-aa93-7df48f6215d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:32.677734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dae521-104d-4c7a-aa93-7df48f6215d4 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:32.690347 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 293/574] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:32.690918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dae521-104d-4c7a-aa93-7df48f6215d4 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:32.720074 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:32.759434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39314df5-8316-4c40-8c9c-521bec385711 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:32.797366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a090cd7-69db-4485-90af-e811ba7744e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:32.798039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a090cd7-69db-4485-90af-e811ba7744e4 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:32.798315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a090cd7-69db-4485-90af-e811ba7744e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:32.798592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a090cd7-69db-4485-90af-e811ba7744e4 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:32.799273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a090cd7-69db-4485-90af-e811ba7744e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:32.799573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a090cd7-69db-4485-90af-e811ba7744e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:32.800576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dae521-104d-4c7a-aa93-7df48f6215d4 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:32.800995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a090cd7-69db-4485-90af-e811ba7744e4 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:32.818363 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 282/575] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:32.819225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a090cd7-69db-4485-90af-e811ba7744e4 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:32.824653 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:32.834136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa81d85-c431-4a82-9f87-da2d5e1b52c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:32.834754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa81d85-c431-4a82-9f87-da2d5e1b52c4 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:32.835025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa81d85-c431-4a82-9f87-da2d5e1b52c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:32.835288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa81d85-c431-4a82-9f87-da2d5e1b52c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:32.845571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa81d85-c431-4a82-9f87-da2d5e1b52c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:32.850192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-cfa81d85-c431-4a82-9f87-da2d5e1b52c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:32.850192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:32.850192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:32.850192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:32.850192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:32.850192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:32.850192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:32.850192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:32.850192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:32.850192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:32.850192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:32.850192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:32.850192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:32.850192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:32.850192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:32.850192 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:32.851330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:32.851330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:32.851330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:32.851330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:32.851330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:32.851330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:32.851330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:32.851330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:32.851330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:32.851330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:32.851330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:32.851330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:32.851330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:32.851330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:32.851330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:32.851330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:32.852502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:32.852502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:32.852502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:32.852502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:32.852502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:32.852502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:32.852502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:32.852502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:32.852502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:32.852502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:32.852502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:32.852502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:32.852502 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 294/576] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:27:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:32.857243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa81d85-c431-4a82-9f87-da2d5e1b52c4 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:32.936999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a090cd7-69db-4485-90af-e811ba7744e4 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:32.952574 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:32.973565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e2f50-8b34-40a9-b32f-9087a68ffd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:32.974193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e2f50-8b34-40a9-b32f-9087a68ffd33 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:32.974464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e2f50-8b34-40a9-b32f-9087a68ffd33 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:32.974630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa81d85-c431-4a82-9f87-da2d5e1b52c4 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:32.974777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e2f50-8b34-40a9-b32f-9087a68ffd33 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:32.983764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e2f50-8b34-40a9-b32f-9087a68ffd33 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:32.985231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e2f50-8b34-40a9-b32f-9087a68ffd33 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:32.997842 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-492e2f50-8b34-40a9-b32f-9087a68ffd33 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:27:32.997842 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:32.997842 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:32.997842 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:32.997842 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:32.997842 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:32.997842 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:32.997842 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:32.997842 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:32.997842 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:32.997842 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:32.997842 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:32.997842 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:27:32.997842 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:27:32.997842 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:27:32.997842 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:27:32.999406 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:32.999406 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:32.999406 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:27:32.999406 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:32.999406 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:27:32.999406 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:32.999406 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:32.999406 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:32.999406 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:32.999406 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:32.999406 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:32.999406 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:32.999406 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:32.999406 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:32.999406 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:32.999406 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:32.999406 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:32.999406 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:33.001565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:33.001565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:33.001565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:27:33.001565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:27:33.001565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:27:33.001565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:27:33.001565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:27:33.001565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:27:33.001565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:27:33.001565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:33.001565 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 283/577] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:33.001565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e2f50-8b34-40a9-b32f-9087a68ffd33 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:33.026104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a1a43-f603-4e4d-ba04-65477dce13b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:33.027264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a1a43-f603-4e4d-ba04-65477dce13b8 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:33.027875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a1a43-f603-4e4d-ba04-65477dce13b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:33.028477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a1a43-f603-4e4d-ba04-65477dce13b8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:33.037893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a1a43-f603-4e4d-ba04-65477dce13b8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:33.040423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a1a43-f603-4e4d-ba04-65477dce13b8 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:33.052355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-517a1a43-f603-4e4d-ba04-65477dce13b8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:27:33.052355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:33.052355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:33.052355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:33.052355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:33.052355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:33.052355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:33.052355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:33.052355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:33.052355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:33.052355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:33.052355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:33.052355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:27:33.052355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:27:33.052355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:27:33.052355 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:27:33.053504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:33.053504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:33.053504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:27:33.053504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:33.053504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:27:33.053504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:33.053504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:33.053504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:33.053504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:33.053504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:33.053504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:33.053504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:33.053504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:33.053504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:33.053504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:33.053504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:33.053504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:33.053504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:33.054634 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:33.054634 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:33.054634 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:27:33.054634 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:27:33.054634 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:27:33.054634 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:27:33.054634 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:27:33.054634 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:27:33.054634 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:27:33.054634 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:33.056416 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 295/578] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Sep 30 09:27:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:33.057339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a1a43-f603-4e4d-ba04-65477dce13b8 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:33.066954 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:33.110168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e2f50-8b34-40a9-b32f-9087a68ffd33 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:33.145723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35afdeb-cc8d-436c-a44d-7c24edd5406c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:33.146343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35afdeb-cc8d-436c-a44d-7c24edd5406c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:33.146622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35afdeb-cc8d-436c-a44d-7c24edd5406c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:33.146894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35afdeb-cc8d-436c-a44d-7c24edd5406c None admin] PATH_INFO: `/v3/users/glance` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:33.155938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35afdeb-cc8d-436c-a44d-7c24edd5406c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:33.157394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35afdeb-cc8d-436c-a44d-7c24edd5406c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:33.168180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a1a43-f603-4e4d-ba04-65477dce13b8 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:33.168442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-e35afdeb-cc8d-436c-a44d-7c24edd5406c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 30 09:27:33.168442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:33.168442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:33.168442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:33.168442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:33.168442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:33.168442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:33.168442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:33.168442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:33.168442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:33.168442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:33.168442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:33.168442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:27:33.168442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:27:33.168442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:27:33.168442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:27:33.169557 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:33.169557 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:33.169557 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:27:33.169557 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:33.169557 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:27:33.169557 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:33.169557 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:33.169557 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:33.169557 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:33.169557 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:33.169557 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:33.169557 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:33.169557 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:33.169557 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:33.169557 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:33.169557 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:33.169557 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:33.169557 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:33.170520 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:33.170520 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:33.170520 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:27:33.170520 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:27:33.170520 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:27:33.170520 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:27:33.170520 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:27:33.170520 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:27:33.170520 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 30 09:27:33.170520 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:33.170520 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 284/579] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:33.170520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35afdeb-cc8d-436c-a44d-7c24edd5406c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:33.218726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a904b1-7bd6-4718-b38e-150e3ca015fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:33.219479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a904b1-7bd6-4718-b38e-150e3ca015fe None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:33.219758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a904b1-7bd6-4718-b38e-150e3ca015fe None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:33.220029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a904b1-7bd6-4718-b38e-150e3ca015fe None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:33.220711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a904b1-7bd6-4718-b38e-150e3ca015fe None admin] RBAC: Adding query filter params (name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:33.221012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a904b1-7bd6-4718-b38e-150e3ca015fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:33.222369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a904b1-7bd6-4718-b38e-150e3ca015fe None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:33.232045 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 296/580] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Sep 30 09:27:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:33.232984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a904b1-7bd6-4718-b38e-150e3ca015fe None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:33.242190 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:33.282481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35afdeb-cc8d-436c-a44d-7c24edd5406c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:33.308157 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:33.325196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04706339-6302-4882-9ca9-40694faac024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:33.325832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04706339-6302-4882-9ca9-40694faac024 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:33.326967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04706339-6302-4882-9ca9-40694faac024 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:33.327338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04706339-6302-4882-9ca9-40694faac024 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:33.328831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04706339-6302-4882-9ca9-40694faac024 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:33.329146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04706339-6302-4882-9ca9-40694faac024 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:33.330778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04706339-6302-4882-9ca9-40694faac024 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:33.339400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a904b1-7bd6-4718-b38e-150e3ca015fe None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:33.350914 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 285/581] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Sep 30 09:27:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:33.351713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04706339-6302-4882-9ca9-40694faac024 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:33.381235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4fe68-edd9-4190-9c7a-4d2579a4ac13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:33.381827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4fe68-edd9-4190-9c7a-4d2579a4ac13 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:33.382113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4fe68-edd9-4190-9c7a-4d2579a4ac13 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:33.382363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4fe68-edd9-4190-9c7a-4d2579a4ac13 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:33.383076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4fe68-edd9-4190-9c7a-4d2579a4ac13 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:33.383372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4fe68-edd9-4190-9c7a-4d2579a4ac13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:33.385580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4fe68-edd9-4190-9c7a-4d2579a4ac13 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:33.403125 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 297/582] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Sep 30 09:27:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:33.403944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4fe68-edd9-4190-9c7a-4d2579a4ac13 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:33.465800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04706339-6302-4882-9ca9-40694faac024 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:33.467213 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:33.506125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715594e-b6a7-4d0f-b956-8a8fa76b0892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:33.506726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715594e-b6a7-4d0f-b956-8a8fa76b0892 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:33.507046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715594e-b6a7-4d0f-b956-8a8fa76b0892 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:33.507291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715594e-b6a7-4d0f-b956-8a8fa76b0892 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:33.507962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715594e-b6a7-4d0f-b956-8a8fa76b0892 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:33.508258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715594e-b6a7-4d0f-b956-8a8fa76b0892 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:33.509682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4fe68-edd9-4190-9c7a-4d2579a4ac13 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:33.510214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715594e-b6a7-4d0f-b956-8a8fa76b0892 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:33.528625 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 286/583] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Sep 30 09:27:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:33.529440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715594e-b6a7-4d0f-b956-8a8fa76b0892 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:33.552230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2d18a-c842-4ebd-8e08-f029a3a33921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:33.552995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2d18a-c842-4ebd-8e08-f029a3a33921 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:33.553275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2d18a-c842-4ebd-8e08-f029a3a33921 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:33.553547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2d18a-c842-4ebd-8e08-f029a3a33921 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:33.564223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2d18a-c842-4ebd-8e08-f029a3a33921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:33.565835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2d18a-c842-4ebd-8e08-f029a3a33921 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:33.576670 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:33.580897 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-edf2d18a-c842-4ebd-8e08-f029a3a33921 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:33.580897 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:33.580897 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:33.580897 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:33.580897 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:33.580897 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:33.580897 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:33.580897 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:33.580897 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:33.580897 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:33.580897 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:33.580897 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:33.580897 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:33.580897 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:33.580897 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:33.580897 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:33.582085 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:33.582085 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:33.582085 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:33.582085 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:33.582085 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:33.582085 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:33.582085 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:33.582085 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:33.582085 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:33.582085 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:33.582085 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:33.582085 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:33.582085 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:33.582085 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:33.582085 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:33.582085 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:33.582085 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:33.582980 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:33.582980 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:33.582980 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:33.582980 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 298/584] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:33.582980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2d18a-c842-4ebd-8e08-f029a3a33921 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:33.643459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715594e-b6a7-4d0f-b956-8a8fa76b0892 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:33.682029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b93d4d-eb60-4c7e-8181-3f360d0e3c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:33.682669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b93d4d-eb60-4c7e-8181-3f360d0e3c56 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:33.682945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b93d4d-eb60-4c7e-8181-3f360d0e3c56 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:33.683208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b93d4d-eb60-4c7e-8181-3f360d0e3c56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:33.689107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2d18a-c842-4ebd-8e08-f029a3a33921 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:33.693876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b93d4d-eb60-4c7e-8181-3f360d0e3c56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:33.695296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b93d4d-eb60-4c7e-8181-3f360d0e3c56 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:33.706491 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:33.711398 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-65b93d4d-eb60-4c7e-8181-3f360d0e3c56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:33.711398 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:33.711398 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:33.711398 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:33.711398 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:33.711398 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:33.711398 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:33.711398 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:33.711398 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:33.711398 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:33.711398 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:33.711398 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:33.711398 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:33.711398 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:33.711398 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:33.711398 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:33.713168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:33.713168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:33.713168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:33.713168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:33.713168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:33.713168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:33.713168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:33.713168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:33.713168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:33.713168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:33.713168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:33.713168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:33.713168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:33.713168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:33.713168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:33.713168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:33.713168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:33.714154 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:33.714154 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:33.714154 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:33.714154 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 287/585] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:33.714385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b93d4d-eb60-4c7e-8181-3f360d0e3c56 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:33.730960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18178eef-d0e1-4a91-bfb4-f2f6152b92e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:33.731575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18178eef-d0e1-4a91-bfb4-f2f6152b92e6 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:33.731903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18178eef-d0e1-4a91-bfb4-f2f6152b92e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:33.732186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18178eef-d0e1-4a91-bfb4-f2f6152b92e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:33.743026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18178eef-d0e1-4a91-bfb4-f2f6152b92e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:33.745283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18178eef-d0e1-4a91-bfb4-f2f6152b92e6 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:33.760450 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-18178eef-d0e1-4a91-bfb4-f2f6152b92e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:33.760450 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:33.760450 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:33.760450 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:33.760450 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:33.760450 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:33.760450 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:33.760450 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:33.760450 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:33.760450 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:33.760450 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:33.760450 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:33.760450 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:33.760450 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:33.760450 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:33.760450 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:33.761501 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:33.761501 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:33.761501 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:33.761501 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:33.761501 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:33.761501 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:33.761501 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:33.761501 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:33.761501 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:33.761501 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:33.761501 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:33.761501 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:33.761501 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:33.761501 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:33.761501 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:33.761501 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:33.761501 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:33.762359 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:33.762359 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:33.762359 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:33.766249 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 299/586] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:33.766807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18178eef-d0e1-4a91-bfb4-f2f6152b92e6 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:33.815456 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:33.826178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b93d4d-eb60-4c7e-8181-3f360d0e3c56 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:33.862293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6421a-a8c5-4857-939c-b96bf16fb42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:33.862910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6421a-a8c5-4857-939c-b96bf16fb42f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:33.863182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6421a-a8c5-4857-939c-b96bf16fb42f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:33.863453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6421a-a8c5-4857-939c-b96bf16fb42f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:33.873949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18178eef-d0e1-4a91-bfb4-f2f6152b92e6 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:33.875259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6421a-a8c5-4857-939c-b96bf16fb42f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:33.877668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6421a-a8c5-4857-939c-b96bf16fb42f None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:33.893757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-4cf6421a-a8c5-4857-939c-b96bf16fb42f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:33.893757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:33.893757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:33.893757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:33.893757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:33.893757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:33.893757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:33.893757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:33.893757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:33.893757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:33.893757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:33.893757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:33.893757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:33.893757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:33.893757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:33.893757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:33.894715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:33.894715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:33.894715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:33.894715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:33.894715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:33.894715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:33.894715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:33.894715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:33.894715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:33.894715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:33.894715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:33.894715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:33.894715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:33.894715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:33.894715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:33.894715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:33.894715 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:33.901017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:33.901017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:33.901017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:33.901017 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 288/587] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:33.901017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6421a-a8c5-4857-939c-b96bf16fb42f None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:33.921384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0c02c-e728-432a-8233-6595373b399f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:33.921991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0c02c-e728-432a-8233-6595373b399f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:33.922271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0c02c-e728-432a-8233-6595373b399f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:33.922540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0c02c-e728-432a-8233-6595373b399f None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:33.923179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0c02c-e728-432a-8233-6595373b399f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:33.923479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0c02c-e728-432a-8233-6595373b399f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:33.924885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0c02c-e728-432a-8233-6595373b399f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:33.941731 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 300/588] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:33.941731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0c02c-e728-432a-8233-6595373b399f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:33.968141 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:34.010478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6421a-a8c5-4857-939c-b96bf16fb42f None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:34.041451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0c02c-e728-432a-8233-6595373b399f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:34.046871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a1926-8dbb-404f-ae2f-65144646c53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:34.047580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a1926-8dbb-404f-ae2f-65144646c53d None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:34.047958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a1926-8dbb-404f-ae2f-65144646c53d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:34.048330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a1926-8dbb-404f-ae2f-65144646c53d None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:34.049102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a1926-8dbb-404f-ae2f-65144646c53d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:34.049530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a1926-8dbb-404f-ae2f-65144646c53d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:34.050965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a1926-8dbb-404f-ae2f-65144646c53d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:34.069003 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 289/589] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:34.069003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a1926-8dbb-404f-ae2f-65144646c53d None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:34.071643 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:34.086336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16022a-9650-4f77-b5ea-43ee3bdf8e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:34.087642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16022a-9650-4f77-b5ea-43ee3bdf8e8c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:34.088021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16022a-9650-4f77-b5ea-43ee3bdf8e8c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:34.088561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16022a-9650-4f77-b5ea-43ee3bdf8e8c None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:34.089407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16022a-9650-4f77-b5ea-43ee3bdf8e8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:34.089810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16022a-9650-4f77-b5ea-43ee3bdf8e8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:34.091370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16022a-9650-4f77-b5ea-43ee3bdf8e8c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:34.104195 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 301/590] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:34.105094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16022a-9650-4f77-b5ea-43ee3bdf8e8c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:34.180460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a1926-8dbb-404f-ae2f-65144646c53d None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:34.197700 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:34.210958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16022a-9650-4f77-b5ea-43ee3bdf8e8c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:34.215710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42178e5f-897c-4ef6-b65b-c5111d1176d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:34.216307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42178e5f-897c-4ef6-b65b-c5111d1176d1 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:34.216583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42178e5f-897c-4ef6-b65b-c5111d1176d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:34.216884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42178e5f-897c-4ef6-b65b-c5111d1176d1 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:34.217518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42178e5f-897c-4ef6-b65b-c5111d1176d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:34.217817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42178e5f-897c-4ef6-b65b-c5111d1176d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:34.219162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42178e5f-897c-4ef6-b65b-c5111d1176d1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:34.230997 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 290/591] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:34.231852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42178e5f-897c-4ef6-b65b-c5111d1176d1 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:34.245853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadc542-85ce-43ab-a50d-078ab6072c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:34.246629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadc542-85ce-43ab-a50d-078ab6072c88 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:34.246905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadc542-85ce-43ab-a50d-078ab6072c88 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:34.247178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadc542-85ce-43ab-a50d-078ab6072c88 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:34.254923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadc542-85ce-43ab-a50d-078ab6072c88 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:34.256343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadc542-85ce-43ab-a50d-078ab6072c88 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:34.267494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-3cadc542-85ce-43ab-a50d-078ab6072c88 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 09:27:34.267494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:34.267494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:34.267494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:34.267494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:34.267494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:34.267494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:34.267494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:34.267494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:34.267494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:34.267494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:34.267494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:34.267494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:27:34.267494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:27:34.267494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:27:34.267494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:27:34.268588 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:34.268588 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:34.268588 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:27:34.268588 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:34.268588 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:27:34.268588 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:34.268588 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:34.268588 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:34.268588 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:34.268588 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:34.268588 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:34.268588 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:34.268588 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:34.268588 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:34.268588 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:34.268588 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:34.268588 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:34.268588 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:34.269723 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:34.269723 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:34.269723 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:27:34.269723 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:27:34.269723 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:27:34.269723 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:27:34.269723 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:27:34.269723 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:27:34.269723 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 09:27:34.269723 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:34.269723 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 302/592] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:27:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:34.269723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadc542-85ce-43ab-a50d-078ab6072c88 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:34.297076 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:34.334376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42178e5f-897c-4ef6-b65b-c5111d1176d1 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:34.377868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadc542-85ce-43ab-a50d-078ab6072c88 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:34.383734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a16b0d-6250-4f58-8f2c-11d90e8b7172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:34.384902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a16b0d-6250-4f58-8f2c-11d90e8b7172 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:34.385180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a16b0d-6250-4f58-8f2c-11d90e8b7172 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:34.385451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a16b0d-6250-4f58-8f2c-11d90e8b7172 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:34.395448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a16b0d-6250-4f58-8f2c-11d90e8b7172 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:34.396985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a16b0d-6250-4f58-8f2c-11d90e8b7172 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:34.409042 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-26a16b0d-6250-4f58-8f2c-11d90e8b7172 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:34.409042 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:34.409042 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:34.409042 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:34.409042 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:34.409042 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:34.409042 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:34.409042 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:34.409042 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:34.409042 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:34.409042 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:34.409042 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:34.409042 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:27:34.409042 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:27:34.409042 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:27:34.410117 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:27:34.410117 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:34.410117 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:34.410117 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:34.410117 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:34.410117 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:34.410117 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:34.410117 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:34.410117 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:34.410117 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:34.410117 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:34.410117 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:34.410117 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:34.410117 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:34.410117 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:34.410117 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:34.410117 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:34.411182 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:27:34.411182 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:27:34.411182 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:27:34.411182 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:27:34.411182 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:27:34.411182 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:27:34.411182 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:34.411182 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:34.411182 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 291/593] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:34.411750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967647c-87f9-43db-8b7a-3d13ac35c6e2 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:34.411750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967647c-87f9-43db-8b7a-3d13ac35c6e2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:34.411750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967647c-87f9-43db-8b7a-3d13ac35c6e2 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:34.413142 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 292/594] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:34.416747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967647c-87f9-43db-8b7a-3d13ac35c6e2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:34.418839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b40ed0-f648-4565-abf1-baf472badd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:34.419599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b40ed0-f648-4565-abf1-baf472badd1b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:34.420014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b40ed0-f648-4565-abf1-baf472badd1b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:34.420419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b40ed0-f648-4565-abf1-baf472badd1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:34.429869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b40ed0-f648-4565-abf1-baf472badd1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:34.431317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b40ed0-f648-4565-abf1-baf472badd1b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:34.442499 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-57b40ed0-f648-4565-abf1-baf472badd1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:34.442499 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:34.442499 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:34.442499 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:34.442499 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:34.442499 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:34.442499 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:34.442499 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:34.442499 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:34.442499 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:34.442499 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:34.442499 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:34.442499 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:27:34.442499 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:27:34.442499 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:27:34.443509 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:27:34.443509 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:34.443509 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:34.443509 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:34.443509 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:34.443509 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:34.443509 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:34.443509 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:34.443509 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:34.443509 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:34.443509 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:34.443509 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:34.443509 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:34.443509 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:34.443509 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:34.443509 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:34.443509 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:34.444568 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:27:34.444568 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:27:34.444568 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:27:34.444568 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:27:34.444568 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:27:34.444568 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:27:34.444568 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:34.444568 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:34.444568 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 303/595] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:34.444568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b40ed0-f648-4565-abf1-baf472badd1b None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:34.457306 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:34.521362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967647c-87f9-43db-8b7a-3d13ac35c6e2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:34.545258 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:34.545727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b40ed0-f648-4565-abf1-baf472badd1b None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:34.557073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc134f-2605-4c46-ad61-642776dec6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:34.557687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc134f-2605-4c46-ad61-642776dec6fd None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:34.558021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc134f-2605-4c46-ad61-642776dec6fd None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:34.558296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc134f-2605-4c46-ad61-642776dec6fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:34.564911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc134f-2605-4c46-ad61-642776dec6fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:34.566337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc134f-2605-4c46-ad61-642776dec6fd None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:34.579663 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-14fc134f-2605-4c46-ad61-642776dec6fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:34.579663 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:34.579663 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:34.579663 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:34.579663 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:34.579663 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:34.579663 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:34.579663 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:34.579663 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:34.579663 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:34.579663 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:34.579663 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:34.579663 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:27:34.579663 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:27:34.579663 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:27:34.580738 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:27:34.580738 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:34.580738 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:34.580738 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:34.580738 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:34.580738 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:34.580738 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:34.580738 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:34.580738 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:34.580738 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:34.580738 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:34.580738 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:34.580738 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:34.580738 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:34.580738 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:34.580738 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:34.580738 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:34.582174 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:27:34.582174 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:27:34.582174 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:27:34.582174 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:27:34.582174 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:27:34.582174 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:27:34.582174 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:34.582174 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:34.582717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0091c-7cd5-4ff4-8719-97276619559b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:34.582717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0091c-7cd5-4ff4-8719-97276619559b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:34.582717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0091c-7cd5-4ff4-8719-97276619559b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:34.582717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0091c-7cd5-4ff4-8719-97276619559b None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:34.583032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0091c-7cd5-4ff4-8719-97276619559b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:34.583032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0091c-7cd5-4ff4-8719-97276619559b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:34.584277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0091c-7cd5-4ff4-8719-97276619559b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:34.584793 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 293/596] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:34.585875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc134f-2605-4c46-ad61-642776dec6fd None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:34.601355 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 304/597] 10.222.0.16 () {56 vars in 1139 bytes} [Fri Sep 30 09:27:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:34.602541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eb940-71a7-47c2-b15e-5b90f1648d79 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:34.603378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eb940-71a7-47c2-b15e-5b90f1648d79 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:34.603647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eb940-71a7-47c2-b15e-5b90f1648d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:34.620999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-229eb940-71a7-47c2-b15e-5b90f1648d79 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:34.622170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-229eb940-71a7-47c2-b15e-5b90f1648d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:34.679472 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:34.684512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc134f-2605-4c46-ad61-642776dec6fd None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:34.687294 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 305/598] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:34.688158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229eb940-71a7-47c2-b15e-5b90f1648d79 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:34.727164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc71c15-2b56-46da-a47d-9e5bca362a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:34.728285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc71c15-2b56-46da-a47d-9e5bca362a7b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:34.728406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc71c15-2b56-46da-a47d-9e5bca362a7b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:34.728740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc71c15-2b56-46da-a47d-9e5bca362a7b None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:34.729499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc71c15-2b56-46da-a47d-9e5bca362a7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:34.729931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc71c15-2b56-46da-a47d-9e5bca362a7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:34.731879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc71c15-2b56-46da-a47d-9e5bca362a7b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:34.745932 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 294/599] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:27:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:34.751158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc71c15-2b56-46da-a47d-9e5bca362a7b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:34.799006 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:34.802528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229eb940-71a7-47c2-b15e-5b90f1648d79 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:34.839801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83dab72-91f6-4062-9aa4-2a8f94947486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:34.840408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dab72-91f6-4062-9aa4-2a8f94947486 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:34.840780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dab72-91f6-4062-9aa4-2a8f94947486 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:34.841118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dab72-91f6-4062-9aa4-2a8f94947486 None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:34.841868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83dab72-91f6-4062-9aa4-2a8f94947486 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:34.842264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83dab72-91f6-4062-9aa4-2a8f94947486 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:34.843721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83dab72-91f6-4062-9aa4-2a8f94947486 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:34.859768 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 306/600] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:27:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:34.859768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83dab72-91f6-4062-9aa4-2a8f94947486 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:34.862429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc71c15-2b56-46da-a47d-9e5bca362a7b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:34.899599 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d0816-f88b-4c81-94a6-dad520c453b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:34.900695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d0816-f88b-4c81-94a6-dad520c453b9 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:34.901040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d0816-f88b-4c81-94a6-dad520c453b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:34.901667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d0816-f88b-4c81-94a6-dad520c453b9 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:34.902438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d0816-f88b-4c81-94a6-dad520c453b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:34.902814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d0816-f88b-4c81-94a6-dad520c453b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:34.904279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d0816-f88b-4c81-94a6-dad520c453b9 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:34.922676 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 295/601] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:27:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:34.922676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d0816-f88b-4c81-94a6-dad520c453b9 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:34.923457 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:34.971008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83dab72-91f6-4062-9aa4-2a8f94947486 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:35.003734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf10544-3518-48c7-87e7-7c165ac5d59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:35.004348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf10544-3518-48c7-87e7-7c165ac5d59f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:35.004647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf10544-3518-48c7-87e7-7c165ac5d59f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:35.004918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf10544-3518-48c7-87e7-7c165ac5d59f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:35.015058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf10544-3518-48c7-87e7-7c165ac5d59f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:35.016470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf10544-3518-48c7-87e7-7c165ac5d59f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:35.029187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d0816-f88b-4c81-94a6-dad520c453b9 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:35.030578 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-eaf10544-3518-48c7-87e7-7c165ac5d59f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:35.030578 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:35.030578 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:35.030578 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:35.030578 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:35.030578 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:35.030578 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:35.030578 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:35.030578 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:35.030578 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:35.030578 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:35.030578 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:35.030578 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:35.030578 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:35.030578 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:35.030578 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:35.031590 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:35.031590 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:35.031590 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:35.031590 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:35.031590 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:35.031590 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:35.031590 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:35.031590 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:35.031590 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:35.031590 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:35.031590 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:35.031590 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:35.031590 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:35.031590 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:35.031590 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:35.031590 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:35.031590 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:35.033162 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:35.033162 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:35.033162 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:35.033434 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:35.033513 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 307/602] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:35.033513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf10544-3518-48c7-87e7-7c165ac5d59f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:35.073773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4afde-5da4-4f37-8b9c-f77d241b7524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:35.074440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4afde-5da4-4f37-8b9c-f77d241b7524 None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:35.074718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4afde-5da4-4f37-8b9c-f77d241b7524 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:35.074990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4afde-5da4-4f37-8b9c-f77d241b7524 None admin] PATH_INFO: `/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/947a48b06bb74f068b70e8c17a8da422/roles/4089b59a020f44b98fad2a34b61fd573` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:35.090805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4afde-5da4-4f37-8b9c-f77d241b7524 None admin] RBAC: Authorizing `identity:create_grant(project_id=1fbc72b5e3b84c8fb74d8d4952a26e76, user_id=947a48b06bb74f068b70e8c17a8da422, role_id=4089b59a020f44b98fad2a34b61fd573)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:35.092153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4afde-5da4-4f37-8b9c-f77d241b7524 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:35.105749 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 296/603] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:27:34 2022] PUT /identity/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/947a48b06bb74f068b70e8c17a8da422/roles/4089b59a020f44b98fad2a34b61fd573 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:27:35.106513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4afde-5da4-4f37-8b9c-f77d241b7524 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:35.160717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf10544-3518-48c7-87e7-7c165ac5d59f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:35.171561 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:35.202611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5d795-65ae-4f15-b75e-1b7e6b751f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:35.203833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5d795-65ae-4f15-b75e-1b7e6b751f0e None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:35.204331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5d795-65ae-4f15-b75e-1b7e6b751f0e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:35.204745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5d795-65ae-4f15-b75e-1b7e6b751f0e None admin] PATH_INFO: `/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/aa607111024540d1a09b01dfd1e5e8cd/roles/4089b59a020f44b98fad2a34b61fd573` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:35.222535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5d795-65ae-4f15-b75e-1b7e6b751f0e None admin] RBAC: Authorizing `identity:create_grant(project_id=1fbc72b5e3b84c8fb74d8d4952a26e76, user_id=aa607111024540d1a09b01dfd1e5e8cd, role_id=4089b59a020f44b98fad2a34b61fd573)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:35.224161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5d795-65ae-4f15-b75e-1b7e6b751f0e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:35.225721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4afde-5da4-4f37-8b9c-f77d241b7524 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:35.241086 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 308/604] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:27:35 2022] PUT /identity/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/aa607111024540d1a09b01dfd1e5e8cd/roles/4089b59a020f44b98fad2a34b61fd573 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:27:35.242117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5d795-65ae-4f15-b75e-1b7e6b751f0e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:35.288181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4d931-240f-4cff-900d-6440a905d6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:35.288904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4d931-240f-4cff-900d-6440a905d6dc None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:35.289179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4d931-240f-4cff-900d-6440a905d6dc None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:35.289447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4d931-240f-4cff-900d-6440a905d6dc None admin] PATH_INFO: `/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/ebc6604430ba4e2283994e5cb8ef18d3/roles/4089b59a020f44b98fad2a34b61fd573` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:35.307912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4d931-240f-4cff-900d-6440a905d6dc None admin] RBAC: Authorizing `identity:create_grant(project_id=1fbc72b5e3b84c8fb74d8d4952a26e76, user_id=ebc6604430ba4e2283994e5cb8ef18d3, role_id=4089b59a020f44b98fad2a34b61fd573)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:35.309426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4d931-240f-4cff-900d-6440a905d6dc None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:35.327618 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 297/605] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:27:35 2022] PUT /identity/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/ebc6604430ba4e2283994e5cb8ef18d3/roles/4089b59a020f44b98fad2a34b61fd573 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:27:35.328548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4d931-240f-4cff-900d-6440a905d6dc None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:35.334177 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:35.390972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5d795-65ae-4f15-b75e-1b7e6b751f0e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:35.443729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43e260-09df-4d5e-93b6-9646f6c1f4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:35.444371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43e260-09df-4d5e-93b6-9646f6c1f4b2 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:35.444677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43e260-09df-4d5e-93b6-9646f6c1f4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:35.444950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43e260-09df-4d5e-93b6-9646f6c1f4b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:35.459540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43e260-09df-4d5e-93b6-9646f6c1f4b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:35.465425 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-bb43e260-09df-4d5e-93b6-9646f6c1f4b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:35.465425 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:35.465425 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:35.465425 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:35.465425 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:35.465425 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:35.465425 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:35.465425 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:35.465425 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:35.465425 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:35.465425 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:35.465425 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:35.465425 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:35.465425 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:35.465425 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:35.465425 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:35.466422 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:35.466422 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:35.466422 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:35.466422 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:35.466422 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:35.466422 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:35.466422 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:35.466422 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:35.466422 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:35.466422 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:35.466422 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:35.466422 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:35.466422 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:35.466422 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:35.466422 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:35.466422 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:35.467667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:35.467667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:35.467667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:35.467667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:35.467667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:35.467667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:35.467667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:35.467667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:35.467667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:35.467667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:35.467667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:35.467667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:35.467667 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 309/606] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:27:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:35.478186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43e260-09df-4d5e-93b6-9646f6c1f4b2 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:35.479765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4d931-240f-4cff-900d-6440a905d6dc None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:35.508554 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:35.540225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400724ae-aee0-479e-b054-878407e84729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:35.541114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400724ae-aee0-479e-b054-878407e84729 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:35.541483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400724ae-aee0-479e-b054-878407e84729 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:35.541752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400724ae-aee0-479e-b054-878407e84729 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:35.542408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400724ae-aee0-479e-b054-878407e84729 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:35.542706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400724ae-aee0-479e-b054-878407e84729 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:35.544858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400724ae-aee0-479e-b054-878407e84729 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:35.561356 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 298/607] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:35.567818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400724ae-aee0-479e-b054-878407e84729 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:35.629236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43e260-09df-4d5e-93b6-9646f6c1f4b2 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:35.645443 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:35.683994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d643ad1-3d40-4ad2-8559-8b2817be1141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:35.685025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d643ad1-3d40-4ad2-8559-8b2817be1141 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:35.685302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d643ad1-3d40-4ad2-8559-8b2817be1141 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:35.685569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d643ad1-3d40-4ad2-8559-8b2817be1141 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:35.686235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d643ad1-3d40-4ad2-8559-8b2817be1141 None admin] RBAC: Adding query filter params (name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:35.686535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d643ad1-3d40-4ad2-8559-8b2817be1141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:35.688207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d643ad1-3d40-4ad2-8559-8b2817be1141 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:35.698468 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 310/608] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Sep 30 09:27:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:35.702870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400724ae-aee0-479e-b054-878407e84729 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:35.704000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d643ad1-3d40-4ad2-8559-8b2817be1141 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:35.773691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4a56d-b80c-4aa2-95e7-136d88502dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:35.775069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4a56d-b80c-4aa2-95e7-136d88502dbc None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:35.775432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4a56d-b80c-4aa2-95e7-136d88502dbc None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:35.775702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4a56d-b80c-4aa2-95e7-136d88502dbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:35.791539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4a56d-b80c-4aa2-95e7-136d88502dbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:35.797780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4a56d-b80c-4aa2-95e7-136d88502dbc None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:35.813943 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-a8e4a56d-b80c-4aa2-95e7-136d88502dbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:35.813943 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:35.813943 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:35.813943 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:35.813943 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:35.813943 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:35.813943 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:35.813943 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:35.813943 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:35.813943 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:35.813943 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:35.813943 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:35.813943 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:27:35.813943 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:27:35.813943 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:27:35.814917 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:27:35.814917 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:35.814917 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:35.814917 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:35.814917 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:35.814917 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:35.814917 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:35.814917 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:35.814917 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:35.814917 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:35.814917 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:35.814917 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:35.814917 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:35.814917 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:35.814917 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:35.814917 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:35.814917 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:35.815845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:27:35.815845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:27:35.815845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:27:35.815845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:27:35.815845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:27:35.815845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:27:35.815845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:35.815845 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:35.815845 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 299/609] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:27:35.822919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4a56d-b80c-4aa2-95e7-136d88502dbc None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:35.844688 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:35.878575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d643ad1-3d40-4ad2-8559-8b2817be1141 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:35.942215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adddecf-d80f-4bbd-bb4a-03602f7991c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:35.942840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adddecf-d80f-4bbd-bb4a-03602f7991c8 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:35.943113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adddecf-d80f-4bbd-bb4a-03602f7991c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:35.943378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adddecf-d80f-4bbd-bb4a-03602f7991c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:35.967101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adddecf-d80f-4bbd-bb4a-03602f7991c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:35.968564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adddecf-d80f-4bbd-bb4a-03602f7991c8 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:35.986078 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-3adddecf-d80f-4bbd-bb4a-03602f7991c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:35.986078 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:35.986078 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:35.986078 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:35.986078 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:35.986078 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:35.986078 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:35.986078 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:35.986078 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:35.986078 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:35.986078 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:35.986078 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:35.986078 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:35.986078 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:35.986078 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:35.986078 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:35.987090 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:35.987090 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:35.987090 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:35.987090 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:35.987090 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:35.987090 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:35.987090 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:35.987090 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:35.987090 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:35.987090 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:35.987090 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:35.987090 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:35.987090 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:35.987090 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:35.987090 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:35.987090 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:35.987090 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:35.988003 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:35.988003 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:35.988003 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:35.988003 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 311/610] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:35.995085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adddecf-d80f-4bbd-bb4a-03602f7991c8 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:36.027982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4a56d-b80c-4aa2-95e7-136d88502dbc None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:36.075359 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:36.090082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee578dd-1585-47c5-88de-f6c44a516ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:36.090699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee578dd-1585-47c5-88de-f6c44a516ba5 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:36.090980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee578dd-1585-47c5-88de-f6c44a516ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:36.091223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee578dd-1585-47c5-88de-f6c44a516ba5 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:36.091922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee578dd-1585-47c5-88de-f6c44a516ba5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:36.092228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee578dd-1585-47c5-88de-f6c44a516ba5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:36.093690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee578dd-1585-47c5-88de-f6c44a516ba5 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:36.108045 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 300/611] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:27:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:36.113660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee578dd-1585-47c5-88de-f6c44a516ba5 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:36.226876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adddecf-d80f-4bbd-bb4a-03602f7991c8 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:36.270014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee578dd-1585-47c5-88de-f6c44a516ba5 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:36.310361 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:36.316831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f0152-03a7-44b5-86e7-9c729ae948a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:36.318077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f0152-03a7-44b5-86e7-9c729ae948a8 None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:36.318559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f0152-03a7-44b5-86e7-9c729ae948a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:36.319045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f0152-03a7-44b5-86e7-9c729ae948a8 None admin] PATH_INFO: `/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/a9b0fd833b134a089433cd2985caba80/roles/4089b59a020f44b98fad2a34b61fd573` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:36.328852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc9710-a84f-4070-8662-4322a53aa68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:36.329477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc9710-a84f-4070-8662-4322a53aa68c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:36.329757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc9710-a84f-4070-8662-4322a53aa68c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:36.330028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc9710-a84f-4070-8662-4322a53aa68c None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:36.330682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc9710-a84f-4070-8662-4322a53aa68c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:36.330987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc9710-a84f-4070-8662-4322a53aa68c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:36.332948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc9710-a84f-4070-8662-4322a53aa68c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:36.347053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f0152-03a7-44b5-86e7-9c729ae948a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=1fbc72b5e3b84c8fb74d8d4952a26e76, user_id=a9b0fd833b134a089433cd2985caba80, role_id=4089b59a020f44b98fad2a34b61fd573)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:36.348954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f0152-03a7-44b5-86e7-9c729ae948a8 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:36.360828 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 312/612] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:36.366675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc9710-a84f-4070-8662-4322a53aa68c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:36.382474 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 301/613] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:27:36 2022] PUT /identity/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/a9b0fd833b134a089433cd2985caba80/roles/4089b59a020f44b98fad2a34b61fd573 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:27:36.488443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc9710-a84f-4070-8662-4322a53aa68c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:36.532398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40963fe4-5513-4ea8-baad-934c022ae351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:36.533472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40963fe4-5513-4ea8-baad-934c022ae351 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:36.535284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40963fe4-5513-4ea8-baad-934c022ae351 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:36.535284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40963fe4-5513-4ea8-baad-934c022ae351 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:36.543053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40963fe4-5513-4ea8-baad-934c022ae351 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:36.544581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40963fe4-5513-4ea8-baad-934c022ae351 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:36.562872 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-40963fe4-5513-4ea8-baad-934c022ae351 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:27:36.562872 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:36.562872 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:36.562872 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:36.562872 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:36.562872 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:36.562872 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:36.562872 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:36.562872 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:36.562872 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:36.562872 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:36.562872 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:36.562872 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:27:36.562872 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:27:36.562872 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:27:36.562872 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:27:36.563927 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:36.563927 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:36.563927 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:27:36.563927 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:36.563927 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:27:36.563927 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:36.563927 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:36.563927 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:36.563927 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:36.563927 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:36.563927 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:36.563927 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:36.563927 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:36.563927 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:36.563927 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:36.563927 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:36.563927 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:36.563927 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:36.564959 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:36.564959 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:36.564959 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:27:36.564959 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:27:36.564959 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:27:36.564959 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:27:36.564959 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:27:36.564959 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:27:36.564959 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:27:36.564959 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:36.564959 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 313/614] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:27:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:36.571877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f0152-03a7-44b5-86e7-9c729ae948a8 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:36.615715 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:36.700481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f0152-03a7-44b5-86e7-9c729ae948a8 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:36.738775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c070895-b9b0-4845-b6fb-6f0bd06bf5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:36.739728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c070895-b9b0-4845-b6fb-6f0bd06bf5ed None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:36.740219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c070895-b9b0-4845-b6fb-6f0bd06bf5ed None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:36.740725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c070895-b9b0-4845-b6fb-6f0bd06bf5ed None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:36.741674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c070895-b9b0-4845-b6fb-6f0bd06bf5ed None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:36.742210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c070895-b9b0-4845-b6fb-6f0bd06bf5ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:36.744425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c070895-b9b0-4845-b6fb-6f0bd06bf5ed None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:36.764968 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 302/615] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Sep 30 09:27:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:36.773643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40963fe4-5513-4ea8-baad-934c022ae351 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:36.835295 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:36.900645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40963fe4-5513-4ea8-baad-934c022ae351 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:36.957599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24baa5c2-a20c-4a35-b2cb-15bc419716b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:36.958592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24baa5c2-a20c-4a35-b2cb-15bc419716b5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:36.959099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24baa5c2-a20c-4a35-b2cb-15bc419716b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:36.959583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24baa5c2-a20c-4a35-b2cb-15bc419716b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:36.976169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24baa5c2-a20c-4a35-b2cb-15bc419716b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:36.978357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24baa5c2-a20c-4a35-b2cb-15bc419716b5 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:36.993734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-24baa5c2-a20c-4a35-b2cb-15bc419716b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:36.993734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:36.993734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:36.993734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:36.993734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:36.993734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:36.993734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:36.993734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:36.993734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:36.993734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:36.993734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:36.993734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:36.993734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:36.993734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:36.993734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:36.993734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:36.995220 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:36.995220 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:36.995220 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:36.995220 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:36.995220 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:36.995220 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:36.995220 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:36.995220 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:36.995220 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:36.995220 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:36.995220 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:36.995220 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:36.995220 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:36.995220 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:36.995220 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:36.995220 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:36.995220 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:36.996104 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:36.996104 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:36.996104 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:36.998184 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 314/616] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:37.004354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c070895-b9b0-4845-b6fb-6f0bd06bf5ed None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:37.131853 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:37.146310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c070895-b9b0-4845-b6fb-6f0bd06bf5ed None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:37.190191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a90700-4646-4372-93ac-c9e53b990a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:37.191164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a90700-4646-4372-93ac-c9e53b990a98 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:37.191654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a90700-4646-4372-93ac-c9e53b990a98 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:37.192118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a90700-4646-4372-93ac-c9e53b990a98 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:37.192983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a90700-4646-4372-93ac-c9e53b990a98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:37.193505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a90700-4646-4372-93ac-c9e53b990a98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:37.195052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a90700-4646-4372-93ac-c9e53b990a98 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:37.211482 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 303/617] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:37.220825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24baa5c2-a20c-4a35-b2cb-15bc419716b5 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:37.349358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24baa5c2-a20c-4a35-b2cb-15bc419716b5 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:37.357732 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:37.396586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d63189-92a7-4eec-a8e5-abfcaabdcc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:37.397322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d63189-92a7-4eec-a8e5-abfcaabdcc48 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:37.397601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d63189-92a7-4eec-a8e5-abfcaabdcc48 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:37.397858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d63189-92a7-4eec-a8e5-abfcaabdcc48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:37.410506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d63189-92a7-4eec-a8e5-abfcaabdcc48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:37.411946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d63189-92a7-4eec-a8e5-abfcaabdcc48 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:37.425398 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-e9d63189-92a7-4eec-a8e5-abfcaabdcc48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:37.425398 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:37.425398 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:37.425398 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:37.425398 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:37.425398 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:37.425398 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:37.425398 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:37.425398 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:37.425398 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:37.425398 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:37.425398 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:37.425398 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:27:37.425398 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:27:37.425398 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:27:37.426473 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:27:37.426473 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:37.426473 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:37.426473 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:37.426473 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:37.426473 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:37.426473 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:37.426473 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:37.426473 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:37.426473 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:37.426473 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:37.426473 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:37.426473 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:37.426473 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:37.426473 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:37.426473 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:37.426473 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:37.427354 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:27:37.427354 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:27:37.427354 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:27:37.427354 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:27:37.427354 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:27:37.427354 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:27:37.427354 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:37.427354 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:37.427354 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 315/618] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:37.432668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a90700-4646-4372-93ac-c9e53b990a98 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:37.563353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a90700-4646-4372-93ac-c9e53b990a98 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:37.607894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8fe25-a445-4909-8de1-988ab3bcdd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:37.608417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8fe25-a445-4909-8de1-988ab3bcdd1c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:37.608714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8fe25-a445-4909-8de1-988ab3bcdd1c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:37.608987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8fe25-a445-4909-8de1-988ab3bcdd1c None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:37.609675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8fe25-a445-4909-8de1-988ab3bcdd1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:37.609976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8fe25-a445-4909-8de1-988ab3bcdd1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:37.611376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8fe25-a445-4909-8de1-988ab3bcdd1c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:37.626246 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 304/619] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:27:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:37.631739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d63189-92a7-4eec-a8e5-abfcaabdcc48 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:37.759973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d63189-92a7-4eec-a8e5-abfcaabdcc48 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:37.798657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0383a72-5594-4d27-a7f1-4ee3c64e59f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:37.799452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0383a72-5594-4d27-a7f1-4ee3c64e59f7 None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:37.799655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0383a72-5594-4d27-a7f1-4ee3c64e59f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:37.799925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0383a72-5594-4d27-a7f1-4ee3c64e59f7 None admin] PATH_INFO: `/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/963c491a2d2e409b8b45e4fb6aff41c3/roles/4089b59a020f44b98fad2a34b61fd573` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:37.816745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0383a72-5594-4d27-a7f1-4ee3c64e59f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1fbc72b5e3b84c8fb74d8d4952a26e76, user_id=963c491a2d2e409b8b45e4fb6aff41c3, role_id=4089b59a020f44b98fad2a34b61fd573)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:37.818228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0383a72-5594-4d27-a7f1-4ee3c64e59f7 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:37.834318 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 316/620] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:27:37 2022] PUT /identity/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/963c491a2d2e409b8b45e4fb6aff41c3/roles/4089b59a020f44b98fad2a34b61fd573 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:27:37.949458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da720c-2d6d-4fa9-94c7-48360c570f45 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:37.949784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da720c-2d6d-4fa9-94c7-48360c570f45 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:37.950054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da720c-2d6d-4fa9-94c7-48360c570f45 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:37.951831 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 305/621] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:37.961520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c57d9f-fa5a-46b0-afcd-ce24ce14b206 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:37.962407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c57d9f-fa5a-46b0-afcd-ce24ce14b206 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:37.962669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c57d9f-fa5a-46b0-afcd-ce24ce14b206 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:37.963208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18c88c-8ea1-45ab-a6ce-6dd461d1d804 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:37.963493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18c88c-8ea1-45ab-a6ce-6dd461d1d804 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:37.963760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18c88c-8ea1-45ab-a6ce-6dd461d1d804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:37.964284 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 317/622] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:37.972636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a203f-a799-41fa-bdc9-ff718d71c26e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:37.972636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a203f-a799-41fa-bdc9-ff718d71c26e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:37.972636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a203f-a799-41fa-bdc9-ff718d71c26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:37.997349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7c18c88c-8ea1-45ab-a6ce-6dd461d1d804 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:38.000153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7c18c88c-8ea1-45ab-a6ce-6dd461d1d804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:38.012454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5d6a203f-a799-41fa-bdc9-ff718d71c26e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:38.015672 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:38.015839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5d6a203f-a799-41fa-bdc9-ff718d71c26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:38.034269 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:38.118690 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 306/623] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:27:38.129452 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 318/624] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:38.179980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325a6b6-58b8-425f-b8a7-2a812947d2c1 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:38.180480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325a6b6-58b8-425f-b8a7-2a812947d2c1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:38.180480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325a6b6-58b8-425f-b8a7-2a812947d2c1 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:38.182577 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 307/625] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:38.187575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19a5be-d67d-4664-8c08-db3005e3adfe None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:38.187912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19a5be-d67d-4664-8c08-db3005e3adfe None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:38.188190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19a5be-d67d-4664-8c08-db3005e3adfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:38.213669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7c19a5be-d67d-4664-8c08-db3005e3adfe None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:38.214873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7c19a5be-d67d-4664-8c08-db3005e3adfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:38.301120 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 319/626] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:38.418274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325a6b6-58b8-425f-b8a7-2a812947d2c1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:38.428999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19a5be-d67d-4664-8c08-db3005e3adfe None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:38.563155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325a6b6-58b8-425f-b8a7-2a812947d2c1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:38.575524 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:38.621060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19a5be-d67d-4664-8c08-db3005e3adfe None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:38.632975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498f8b6-51db-4359-8ffe-5e5b7c7b695b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:38.633608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498f8b6-51db-4359-8ffe-5e5b7c7b695b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:38.633984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498f8b6-51db-4359-8ffe-5e5b7c7b695b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:38.634247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498f8b6-51db-4359-8ffe-5e5b7c7b695b None admin] PATH_INFO: `/v3/roles/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:38.646031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498f8b6-51db-4359-8ffe-5e5b7c7b695b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:38.652097 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-7498f8b6-51db-4359-8ffe-5e5b7c7b695b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:38.652097 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:38.652097 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:38.652097 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:38.652097 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:38.652097 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:38.652097 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:38.652097 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:38.652097 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:38.652097 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:38.652097 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:38.652097 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:38.652097 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:38.652097 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:38.652097 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:38.652097 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:38.653057 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:38.653057 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:38.653057 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:38.653057 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:38.653057 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:38.653057 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:38.653057 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:38.653057 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:38.653057 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:38.653057 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:38.653057 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:38.653057 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:38.653057 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:38.653057 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:38.653057 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:38.653057 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:38.653907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:38.653907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:38.653907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:38.653907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:38.653907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:38.653907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:38.653907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:38.653907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:38.653907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:38.653907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:38.653907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:38.653907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:38.656758 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 308/627] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:27:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:38.657930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498f8b6-51db-4359-8ffe-5e5b7c7b695b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:38.661620 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:38.664562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98789c-a91f-43e0-b2c7-2cb31e1c95ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:38.665924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98789c-a91f-43e0-b2c7-2cb31e1c95ae None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:38.666246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98789c-a91f-43e0-b2c7-2cb31e1c95ae None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:38.666516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98789c-a91f-43e0-b2c7-2cb31e1c95ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:38.681452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98789c-a91f-43e0-b2c7-2cb31e1c95ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:38.687382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-7f98789c-a91f-43e0-b2c7-2cb31e1c95ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:38.687382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:38.687382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:38.687382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:38.687382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:38.687382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:38.687382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:38.687382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:38.687382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:38.687382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:38.687382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:38.687382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:38.687382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:38.687382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:38.687382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:38.687382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:38.688308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:38.688308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:38.688308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:38.688308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:38.688308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:38.688308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:38.688308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:38.688308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:38.688308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:38.688308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:38.688308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:38.688308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:38.688308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:38.688308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:38.688308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:38.688308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:38.689177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:38.689177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:38.689177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:38.689177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:38.689177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:38.689177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:38.689177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:38.689177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:38.689177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:38.689177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:38.689177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:38.689177 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:38.689177 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 320/628] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:27:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:38.689867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98789c-a91f-43e0-b2c7-2cb31e1c95ae None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:38.785776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498f8b6-51db-4359-8ffe-5e5b7c7b695b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:38.825966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98789c-a91f-43e0-b2c7-2cb31e1c95ae None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:38.829961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaff14e-ba53-4283-b617-97aeb3ed494a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:38.830597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaff14e-ba53-4283-b617-97aeb3ed494a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:38.830872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaff14e-ba53-4283-b617-97aeb3ed494a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:38.831139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaff14e-ba53-4283-b617-97aeb3ed494a None admin] PATH_INFO: `/v3/roles/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:38.843567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaff14e-ba53-4283-b617-97aeb3ed494a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:38.848821 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-eeaff14e-ba53-4283-b617-97aeb3ed494a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:38.848821 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:38.848821 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:38.848821 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:38.848821 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:38.848821 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:38.848821 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:38.848821 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:38.848821 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:38.848821 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:38.848821 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:38.848821 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:38.848821 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:38.848821 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:38.848821 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:38.848821 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:38.849755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:38.849755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:38.849755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:38.849755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:38.849755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:38.849755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:38.849755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:38.849755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:38.849755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:38.849755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:38.849755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:38.849755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:38.849755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:38.849755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:38.849755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:38.849755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:38.850668 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:38.850668 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:38.850668 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:38.850668 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:38.850668 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:38.850668 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:38.850668 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:38.850668 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:38.850668 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:38.850668 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:38.850668 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:38.850668 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:38.855599 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 309/629] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:27:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:38.856485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaff14e-ba53-4283-b617-97aeb3ed494a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:38.874904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e943d-d2b2-4e6c-bc2d-758e5f790143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:38.876190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e943d-d2b2-4e6c-bc2d-758e5f790143 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:38.876749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e943d-d2b2-4e6c-bc2d-758e5f790143 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:38.877502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e943d-d2b2-4e6c-bc2d-758e5f790143 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:38.878797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e943d-d2b2-4e6c-bc2d-758e5f790143 None admin] RBAC: Adding query filter params (name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:38.879313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e943d-d2b2-4e6c-bc2d-758e5f790143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:38.881510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e943d-d2b2-4e6c-bc2d-758e5f790143 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:38.884290 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:38.897742 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 321/630] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Sep 30 09:27:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:38.898926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e943d-d2b2-4e6c-bc2d-758e5f790143 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:38.934601 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:38.979174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaff14e-ba53-4283-b617-97aeb3ed494a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:39.019736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd18244-5966-422f-aadc-136a93f2e070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:39.020340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd18244-5966-422f-aadc-136a93f2e070 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:39.020633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd18244-5966-422f-aadc-136a93f2e070 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:39.020928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd18244-5966-422f-aadc-136a93f2e070 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:39.021587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd18244-5966-422f-aadc-136a93f2e070 None admin] RBAC: Adding query filter params (name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:39.021889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd18244-5966-422f-aadc-136a93f2e070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:39.023388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd18244-5966-422f-aadc-136a93f2e070 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:39.040576 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 310/631] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Sep 30 09:27:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:39.041068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e943d-d2b2-4e6c-bc2d-758e5f790143 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:39.042091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd18244-5966-422f-aadc-136a93f2e070 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:39.075562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba0794-ac24-4351-8c52-bd6036b45018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:39.076239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba0794-ac24-4351-8c52-bd6036b45018 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:39.076456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba0794-ac24-4351-8c52-bd6036b45018 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:39.076767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba0794-ac24-4351-8c52-bd6036b45018 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:39.077424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba0794-ac24-4351-8c52-bd6036b45018 None admin] RBAC: Adding query filter params (name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:39.077720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba0794-ac24-4351-8c52-bd6036b45018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:39.079094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba0794-ac24-4351-8c52-bd6036b45018 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:39.092659 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 322/632] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Sep 30 09:27:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:39.093528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba0794-ac24-4351-8c52-bd6036b45018 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:39.152222 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:39.162063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd18244-5966-422f-aadc-136a93f2e070 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:39.194616 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:39.206210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba0794-ac24-4351-8c52-bd6036b45018 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:39.213665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3372275-8ba5-42b3-b0da-a26910374a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:39.214312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3372275-8ba5-42b3-b0da-a26910374a61 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:39.214637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3372275-8ba5-42b3-b0da-a26910374a61 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:39.216547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3372275-8ba5-42b3-b0da-a26910374a61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:39.233261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3372275-8ba5-42b3-b0da-a26910374a61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:39.235208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3372275-8ba5-42b3-b0da-a26910374a61 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:39.252170 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-a3372275-8ba5-42b3-b0da-a26910374a61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:39.252170 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:39.252170 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:39.252170 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:39.252170 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:39.252170 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:39.252170 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:39.252170 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:39.252170 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:39.252170 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:39.252170 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:39.252170 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:39.252170 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:39.252170 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:39.252170 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:39.252170 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:39.253368 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:39.253368 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:39.253368 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:39.253368 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:39.253368 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:39.253368 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:39.253368 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:39.253368 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:39.253368 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:39.253368 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:39.253368 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:39.253368 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:39.253368 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:39.253368 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:39.253368 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:39.253368 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:39.253368 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:39.254700 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:39.254700 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:39.254700 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:39.257872 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 311/633] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:39.258749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3372275-8ba5-42b3-b0da-a26910374a61 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:39.259658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9a866-cd58-409d-8a00-df80bbdcf62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:39.260713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9a866-cd58-409d-8a00-df80bbdcf62d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:39.261158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9a866-cd58-409d-8a00-df80bbdcf62d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:39.261575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9a866-cd58-409d-8a00-df80bbdcf62d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:39.277010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9a866-cd58-409d-8a00-df80bbdcf62d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:39.279566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9a866-cd58-409d-8a00-df80bbdcf62d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:39.300274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-ffc9a866-cd58-409d-8a00-df80bbdcf62d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:39.300274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:39.300274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:39.300274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:39.300274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:39.300274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:39.300274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:39.300274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:39.300274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:39.300274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:39.300274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:39.300274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:39.300274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:39.300274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:39.300274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:39.300274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:39.301524 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:39.301524 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:39.301524 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:39.301524 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:39.301524 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:39.301524 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:39.301524 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:39.301524 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:39.301524 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:39.301524 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:39.301524 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:39.301524 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:39.301524 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:39.301524 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:39.301524 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:39.301524 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:39.301524 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:39.302448 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:39.302448 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:39.302448 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:39.304585 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 323/634] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:39.306708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9a866-cd58-409d-8a00-df80bbdcf62d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:39.372731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3372275-8ba5-42b3-b0da-a26910374a61 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:39.409808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e973c3-45fa-4ab6-aaaa-74005d9304fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:39.410429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e973c3-45fa-4ab6-aaaa-74005d9304fe None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:39.410709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e973c3-45fa-4ab6-aaaa-74005d9304fe None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:39.410979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e973c3-45fa-4ab6-aaaa-74005d9304fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:39.416658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9a866-cd58-409d-8a00-df80bbdcf62d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:39.423210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e973c3-45fa-4ab6-aaaa-74005d9304fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:39.425137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e973c3-45fa-4ab6-aaaa-74005d9304fe None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:39.427288 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:39.442442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-59e973c3-45fa-4ab6-aaaa-74005d9304fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:39.442442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:39.442442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:39.442442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:39.442442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:39.442442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:39.442442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:39.442442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:39.442442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:39.442442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:39.442442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:39.442442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:39.442442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:39.442442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:39.442442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:39.442442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:39.443440 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:39.443440 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:39.443440 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:39.443440 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:39.443440 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:39.443440 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:39.443440 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:39.443440 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:39.443440 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:39.443440 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:39.443440 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:39.443440 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:39.443440 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:39.443440 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:39.443440 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:39.443440 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:39.443440 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:39.444316 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:39.444316 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:39.444316 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:39.444316 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 312/635] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:39.444316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e973c3-45fa-4ab6-aaaa-74005d9304fe None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:39.457973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315c00f-92b0-4ee7-88b4-8be50a6f9528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:39.458569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315c00f-92b0-4ee7-88b4-8be50a6f9528 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:39.458844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315c00f-92b0-4ee7-88b4-8be50a6f9528 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:39.459113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315c00f-92b0-4ee7-88b4-8be50a6f9528 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:39.459735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315c00f-92b0-4ee7-88b4-8be50a6f9528 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:39.460031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315c00f-92b0-4ee7-88b4-8be50a6f9528 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:39.461398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315c00f-92b0-4ee7-88b4-8be50a6f9528 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:39.473595 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 324/636] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:39.474799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125980df-c298-4dda-8ce1-32ebf777f209 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:39.475077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125980df-c298-4dda-8ce1-32ebf777f209 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:39.475346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125980df-c298-4dda-8ce1-32ebf777f209 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:39.476698 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 325/637] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:39.477216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125980df-c298-4dda-8ce1-32ebf777f209 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:39.483119 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:39.558455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e973c3-45fa-4ab6-aaaa-74005d9304fe None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:39.585087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125980df-c298-4dda-8ce1-32ebf777f209 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:39.593356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b28cc2-3035-4ec9-8f2e-3727f8c846a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:39.593982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b28cc2-3035-4ec9-8f2e-3727f8c846a3 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:39.594267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b28cc2-3035-4ec9-8f2e-3727f8c846a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:39.594532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b28cc2-3035-4ec9-8f2e-3727f8c846a3 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:39.595170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b28cc2-3035-4ec9-8f2e-3727f8c846a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:39.595470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b28cc2-3035-4ec9-8f2e-3727f8c846a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:39.596848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b28cc2-3035-4ec9-8f2e-3727f8c846a3 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:39.610947 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 313/638] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:39.611742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b28cc2-3035-4ec9-8f2e-3727f8c846a3 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:39.628830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb71a9-e3fe-4617-b057-20b43811b9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:39.629363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb71a9-e3fe-4617-b057-20b43811b9cb None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:39.629640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb71a9-e3fe-4617-b057-20b43811b9cb None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:39.629908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb71a9-e3fe-4617-b057-20b43811b9cb None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:39.630543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb71a9-e3fe-4617-b057-20b43811b9cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:39.630843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb71a9-e3fe-4617-b057-20b43811b9cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:39.632185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb71a9-e3fe-4617-b057-20b43811b9cb None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:39.644653 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 326/639] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:39.645812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d64f5-1635-445e-adaf-8e075d73a10f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:39.646093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d64f5-1635-445e-adaf-8e075d73a10f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:39.646364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d64f5-1635-445e-adaf-8e075d73a10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:39.665652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a90d64f5-1635-445e-adaf-8e075d73a10f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:39.666851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a90d64f5-1635-445e-adaf-8e075d73a10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:39.690627 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:39.712436 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:39.726358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b28cc2-3035-4ec9-8f2e-3727f8c846a3 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:39.744631 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 327/640] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:39.744631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d64f5-1635-445e-adaf-8e075d73a10f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:39.772049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c188f24-fbed-4f78-964a-77c870a6f2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:39.772826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c188f24-fbed-4f78-964a-77c870a6f2b3 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:39.773166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c188f24-fbed-4f78-964a-77c870a6f2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:39.773502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c188f24-fbed-4f78-964a-77c870a6f2b3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:39.781749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c188f24-fbed-4f78-964a-77c870a6f2b3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:39.783196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c188f24-fbed-4f78-964a-77c870a6f2b3 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:39.796660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-8c188f24-fbed-4f78-964a-77c870a6f2b3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:27:39.796660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:39.796660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:39.796660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:39.796660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:39.796660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:39.796660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:39.796660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:39.796660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:39.796660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:39.796660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:39.796660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:39.796660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:27:39.796660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:27:39.796660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:27:39.796660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:27:39.797674 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:39.797674 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:39.797674 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:27:39.797674 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:39.797674 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:27:39.797674 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:39.797674 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:39.797674 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:39.797674 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:39.797674 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:39.797674 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:39.797674 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:39.797674 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:39.797674 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:39.797674 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:39.797674 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:39.797674 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:39.797674 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:39.799178 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:39.799178 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:39.799178 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:27:39.799178 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:27:39.799178 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:27:39.799178 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:27:39.799178 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:27:39.799178 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:27:39.799178 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:27:39.799178 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:39.799178 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 314/641] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:39.799178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c188f24-fbed-4f78-964a-77c870a6f2b3 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:39.867578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d64f5-1635-445e-adaf-8e075d73a10f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:39.908274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c188f24-fbed-4f78-964a-77c870a6f2b3 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:39.912487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1545d-925b-440f-9308-3fe5f1e9e418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:39.913219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1545d-925b-440f-9308-3fe5f1e9e418 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:39.913501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1545d-925b-440f-9308-3fe5f1e9e418 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:39.913769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1545d-925b-440f-9308-3fe5f1e9e418 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:39.930407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1545d-925b-440f-9308-3fe5f1e9e418 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:39.932675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1545d-925b-440f-9308-3fe5f1e9e418 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:39.949698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf23b1-115e-4ab5-822e-a84c1484d6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:39.950402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf23b1-115e-4ab5-822e-a84c1484d6f3 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:39.950751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf23b1-115e-4ab5-822e-a84c1484d6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:39.951089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf23b1-115e-4ab5-822e-a84c1484d6f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:39.952149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-ebb1545d-925b-440f-9308-3fe5f1e9e418 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 30 09:27:39.952149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:39.952149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:39.952149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:39.952149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:39.952149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:39.952149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:39.952149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:39.952149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:39.952149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:39.952149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:39.952149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:39.952149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:27:39.952149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:27:39.952149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:27:39.952149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:27:39.953174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:39.953174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:39.953174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:27:39.953174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:39.953174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:27:39.953174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:39.953174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:39.953174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:39.953174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:39.953174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:39.953174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:39.953174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:39.953174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:39.953174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:39.953174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:39.953174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:39.953174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:39.953174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:39.954122 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:39.954122 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:39.954122 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:27:39.954122 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:27:39.954122 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:27:39.954122 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:27:39.954122 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:27:39.954122 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:27:39.954122 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 30 09:27:39.954122 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:39.957354 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 328/642] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:39.958344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1545d-925b-440f-9308-3fe5f1e9e418 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:39.962399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf23b1-115e-4ab5-822e-a84c1484d6f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:39.964080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf23b1-115e-4ab5-822e-a84c1484d6f3 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:39.976673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-4adf23b1-115e-4ab5-822e-a84c1484d6f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:27:39.976673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:39.976673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:39.976673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:39.976673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:39.976673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:39.976673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:39.976673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:39.976673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:39.976673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:39.976673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:39.976673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:39.976673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:27:39.976673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:27:39.976673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:27:39.976673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:27:39.977974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:39.977974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:39.977974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:27:39.977974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:39.977974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:27:39.977974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:39.977974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:39.977974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:39.977974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:39.977974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:39.977974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:39.977974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:39.977974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:39.977974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:39.977974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:39.977974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:39.977974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:39.977974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:39.979168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:39.979168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:39.979168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:27:39.979168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:27:39.979168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:27:39.979168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:27:39.979168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:27:39.979168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:27:39.979168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:27:39.979168 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:39.985328 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 315/643] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Sep 30 09:27:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:39.985328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf23b1-115e-4ab5-822e-a84c1484d6f3 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:39.991283 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:40.000895 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:40.098784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1545d-925b-440f-9308-3fe5f1e9e418 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:40.099029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf23b1-115e-4ab5-822e-a84c1484d6f3 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:40.134154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1dba9-d5b4-4df8-85fc-5421a360925d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:40.134749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1dba9-d5b4-4df8-85fc-5421a360925d None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:40.135025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1dba9-d5b4-4df8-85fc-5421a360925d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:40.135292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1dba9-d5b4-4df8-85fc-5421a360925d None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:40.136009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1dba9-d5b4-4df8-85fc-5421a360925d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:40.136305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1dba9-d5b4-4df8-85fc-5421a360925d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:40.137749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1dba9-d5b4-4df8-85fc-5421a360925d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:40.139878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbf9c0-e6ef-4c65-973a-207731f1ff09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:40.141200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbf9c0-e6ef-4c65-973a-207731f1ff09 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:40.141478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbf9c0-e6ef-4c65-973a-207731f1ff09 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:40.141750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbf9c0-e6ef-4c65-973a-207731f1ff09 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:40.142492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbbf9c0-e6ef-4c65-973a-207731f1ff09 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:40.142797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbbf9c0-e6ef-4c65-973a-207731f1ff09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:40.144221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbbf9c0-e6ef-4c65-973a-207731f1ff09 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:40.156844 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 316/644] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Sep 30 09:27:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:40.157719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1dba9-d5b4-4df8-85fc-5421a360925d None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:40.166492 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 329/645] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Sep 30 09:27:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:40.168372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbf9c0-e6ef-4c65-973a-207731f1ff09 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:40.229976 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:40.255504 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:40.267703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1dba9-d5b4-4df8-85fc-5421a360925d None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:40.279089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbf9c0-e6ef-4c65-973a-207731f1ff09 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:40.302578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fd170-dc60-483b-b4f0-7e4805306ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:40.303173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fd170-dc60-483b-b4f0-7e4805306ae1 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:40.303447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fd170-dc60-483b-b4f0-7e4805306ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:40.303709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fd170-dc60-483b-b4f0-7e4805306ae1 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:40.304420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fd170-dc60-483b-b4f0-7e4805306ae1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:40.304749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fd170-dc60-483b-b4f0-7e4805306ae1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:40.306667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fd170-dc60-483b-b4f0-7e4805306ae1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:40.313714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56c7d1-ef5f-4cc2-86f4-220dbdb33a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:40.314338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56c7d1-ef5f-4cc2-86f4-220dbdb33a33 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:40.314614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56c7d1-ef5f-4cc2-86f4-220dbdb33a33 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:40.314890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56c7d1-ef5f-4cc2-86f4-220dbdb33a33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:40.323670 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 317/646] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Sep 30 09:27:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:40.324461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fd170-dc60-483b-b4f0-7e4805306ae1 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:40.329244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56c7d1-ef5f-4cc2-86f4-220dbdb33a33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:40.334245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-1c56c7d1-ef5f-4cc2-86f4-220dbdb33a33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:40.334245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:40.334245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:40.334245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:40.334245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:40.334245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:40.334245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:40.334245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:40.334245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:40.334245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:40.334245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:40.334245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:40.334245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:40.334245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:40.334245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:40.334245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:40.335184 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:40.335184 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:40.335184 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:40.335184 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:40.335184 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:40.335184 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:40.335184 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:40.335184 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:40.335184 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:40.335184 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:40.335184 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:40.335184 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:40.335184 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:40.335184 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:40.335184 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:40.335184 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:40.336005 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:40.336005 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:40.336005 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:40.336005 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:40.336005 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:40.336005 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:40.336005 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:40.336005 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:40.336005 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:40.336005 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:40.336005 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:40.336005 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:40.336005 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 330/647] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:27:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:40.336732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56c7d1-ef5f-4cc2-86f4-220dbdb33a33 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:40.424654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fd170-dc60-483b-b4f0-7e4805306ae1 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:40.434390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56c7d1-ef5f-4cc2-86f4-220dbdb33a33 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:40.447281 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:40.458254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c4767-6e00-4fb7-b2e1-43432ec8be05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:40.458845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c4767-6e00-4fb7-b2e1-43432ec8be05 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:40.459117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c4767-6e00-4fb7-b2e1-43432ec8be05 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:40.459385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c4767-6e00-4fb7-b2e1-43432ec8be05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:40.467778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908936a8-fcb5-4f98-9683-bffd4d38f7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:40.468388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908936a8-fcb5-4f98-9683-bffd4d38f7d7 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:40.468678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908936a8-fcb5-4f98-9683-bffd4d38f7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:40.468949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908936a8-fcb5-4f98-9683-bffd4d38f7d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:40.476833 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:40.526771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c4767-6e00-4fb7-b2e1-43432ec8be05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:40.528195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c4767-6e00-4fb7-b2e1-43432ec8be05 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:40.537544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908936a8-fcb5-4f98-9683-bffd4d38f7d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:40.538967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908936a8-fcb5-4f98-9683-bffd4d38f7d7 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:40.625599 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 318/648] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:27:40.626831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d9587-7260-4091-8c10-174fe5b5df21 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:40.627111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d9587-7260-4091-8c10-174fe5b5df21 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:40.627377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d9587-7260-4091-8c10-174fe5b5df21 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:40.628628 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 319/649] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:40.629315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d9587-7260-4091-8c10-174fe5b5df21 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:40.639916 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 331/650] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:27:40.640959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908936a8-fcb5-4f98-9683-bffd4d38f7d7 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:40.657256 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:40.680191 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:40.734245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d9587-7260-4091-8c10-174fe5b5df21 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:40.738469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908936a8-fcb5-4f98-9683-bffd4d38f7d7 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:40.768206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d2c7f-6ce5-4b21-96c5-228e8514ac38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:40.768829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d2c7f-6ce5-4b21-96c5-228e8514ac38 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:40.769103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d2c7f-6ce5-4b21-96c5-228e8514ac38 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:40.769368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d2c7f-6ce5-4b21-96c5-228e8514ac38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:40.771037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b4d20-01c0-4cf1-b0d8-38ef3bbd3020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:40.771630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b4d20-01c0-4cf1-b0d8-38ef3bbd3020 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:40.771905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b4d20-01c0-4cf1-b0d8-38ef3bbd3020 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:40.772167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b4d20-01c0-4cf1-b0d8-38ef3bbd3020 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:40.772857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b4d20-01c0-4cf1-b0d8-38ef3bbd3020 None admin] RBAC: Adding query filter params (name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:40.773150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b4d20-01c0-4cf1-b0d8-38ef3bbd3020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:40.775115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b4d20-01c0-4cf1-b0d8-38ef3bbd3020 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:40.782833 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 332/651] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Sep 30 09:27:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:40.783593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b4d20-01c0-4cf1-b0d8-38ef3bbd3020 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:40.837777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d2c7f-6ce5-4b21-96c5-228e8514ac38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:40.839475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d2c7f-6ce5-4b21-96c5-228e8514ac38 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:40.862255 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:40.881271 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:40.885199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b4d20-01c0-4cf1-b0d8-38ef3bbd3020 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:40.919030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb966e-962c-453d-ab83-5c23385160bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:40.919877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb966e-962c-453d-ab83-5c23385160bf None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:40.919973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb966e-962c-453d-ab83-5c23385160bf None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:40.920165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb966e-962c-453d-ab83-5c23385160bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:40.931017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb966e-962c-453d-ab83-5c23385160bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:40.932375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb966e-962c-453d-ab83-5c23385160bf None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:40.938964 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 320/652] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:27:40.940566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbe09a-3cf2-4320-88da-521741fbe00b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:40.940946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbe09a-3cf2-4320-88da-521741fbe00b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:40.941274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbe09a-3cf2-4320-88da-521741fbe00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:40.949946 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-8beb966e-962c-453d-ab83-5c23385160bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:40.949946 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:40.949946 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:40.949946 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:40.949946 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:40.949946 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:40.949946 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:40.949946 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:40.949946 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:40.949946 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:40.949946 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:40.949946 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:40.949946 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:40.949946 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:40.949946 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:40.949946 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:40.955492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:40.955492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:40.955492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:40.955492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:40.955492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:40.955492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:40.955492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:40.955492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:40.955492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:40.955492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:40.955492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:40.955492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:40.955492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:40.955492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:40.955492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:40.955492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:40.955492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:40.956962 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:40.956962 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:40.956962 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:40.956962 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 333/653] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:40.956962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb966e-962c-453d-ab83-5c23385160bf None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:40.958882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e2fbe09a-3cf2-4320-88da-521741fbe00b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:40.960055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e2fbe09a-3cf2-4320-88da-521741fbe00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:41.027606 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 321/654] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:41.028314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbe09a-3cf2-4320-88da-521741fbe00b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:41.051894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb966e-962c-453d-ab83-5c23385160bf None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:41.087787 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b07c2-9739-4435-992a-8e929fc17c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:41.088493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b07c2-9739-4435-992a-8e929fc17c1f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:41.088882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b07c2-9739-4435-992a-8e929fc17c1f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:41.089151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b07c2-9739-4435-992a-8e929fc17c1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:41.090262 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:41.102091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b07c2-9739-4435-992a-8e929fc17c1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:41.104189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b07c2-9739-4435-992a-8e929fc17c1f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:41.119701 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-301b07c2-9739-4435-992a-8e929fc17c1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:41.119701 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:41.119701 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:41.119701 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:41.119701 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:41.119701 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:41.119701 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:41.119701 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:41.119701 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:41.119701 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:41.119701 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:41.119701 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:41.119701 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:41.119701 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:41.119701 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:41.119701 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:41.120860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:41.120860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:41.120860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:41.120860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:41.120860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:41.120860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:41.120860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:41.120860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:41.120860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:41.120860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:41.120860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:41.120860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:41.120860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:41.120860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:41.120860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:41.120860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:41.120860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:41.121853 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:41.121853 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:41.121853 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:41.121853 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 334/655] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:41.122097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b07c2-9739-4435-992a-8e929fc17c1f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:41.128629 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:41.139067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbe09a-3cf2-4320-88da-521741fbe00b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:41.175367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa41818-7349-4d76-9f40-29ec2d9ac228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:41.175999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa41818-7349-4d76-9f40-29ec2d9ac228 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:41.176279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa41818-7349-4d76-9f40-29ec2d9ac228 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:41.176547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa41818-7349-4d76-9f40-29ec2d9ac228 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:41.194195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa41818-7349-4d76-9f40-29ec2d9ac228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:41.195787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa41818-7349-4d76-9f40-29ec2d9ac228 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:41.213474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-baa41818-7349-4d76-9f40-29ec2d9ac228 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:41.213474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:41.213474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:41.213474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:41.213474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:41.213474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:41.213474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:41.213474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:41.213474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:41.213474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:41.213474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:41.213474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:41.213474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:41.213474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:41.213474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:41.213474 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:41.214675 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:41.214675 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:41.214675 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:41.214675 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:41.214675 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:41.214675 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:41.214675 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:41.214675 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:41.214675 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:41.214675 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:41.214675 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:41.214675 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:41.214675 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:41.214675 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:41.214675 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:41.214675 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:41.214675 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:41.215783 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:41.215783 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:41.215783 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:41.216235 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 322/656] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:41.217101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa41818-7349-4d76-9f40-29ec2d9ac228 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:41.249545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b07c2-9739-4435-992a-8e929fc17c1f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:41.282994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e79755-0ce6-4e2e-9ea6-316759e17b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:41.283687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e79755-0ce6-4e2e-9ea6-316759e17b2f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:41.284025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e79755-0ce6-4e2e-9ea6-316759e17b2f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:41.284358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e79755-0ce6-4e2e-9ea6-316759e17b2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:41.295243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e79755-0ce6-4e2e-9ea6-316759e17b2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:41.296790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e79755-0ce6-4e2e-9ea6-316759e17b2f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:41.311803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-05e79755-0ce6-4e2e-9ea6-316759e17b2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:41.311803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:41.311803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:41.311803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:41.311803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:41.311803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:41.311803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:41.311803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:41.311803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:41.311803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:41.311803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:41.311803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:41.311803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:41.311803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:41.311803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:41.311803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:41.312942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:41.312942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:41.312942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:41.312942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:41.312942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:41.312942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:41.312942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:41.312942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:41.312942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:41.312942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:41.312942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:41.312942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:41.312942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:41.312942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:41.312942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:41.312942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:41.312942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:41.314020 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:41.314020 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:41.314020 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:41.314020 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 335/657] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:41.314020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e79755-0ce6-4e2e-9ea6-316759e17b2f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:41.327241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa41818-7349-4d76-9f40-29ec2d9ac228 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:41.334892 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:41.362856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120a259-a7c5-40c5-91bd-0652f68d3b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:41.363456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120a259-a7c5-40c5-91bd-0652f68d3b1f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:41.363735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120a259-a7c5-40c5-91bd-0652f68d3b1f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:41.364006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120a259-a7c5-40c5-91bd-0652f68d3b1f None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:41.364669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120a259-a7c5-40c5-91bd-0652f68d3b1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:41.364973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120a259-a7c5-40c5-91bd-0652f68d3b1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:41.366314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120a259-a7c5-40c5-91bd-0652f68d3b1f None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:41.370333 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:41.378766 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 323/658] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:41.379554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120a259-a7c5-40c5-91bd-0652f68d3b1f None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:41.414269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e79755-0ce6-4e2e-9ea6-316759e17b2f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:41.449487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3385c5f-94a0-4f25-8e47-c5835eb3a673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:41.450440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3385c5f-94a0-4f25-8e47-c5835eb3a673 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:41.450920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3385c5f-94a0-4f25-8e47-c5835eb3a673 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:41.451392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3385c5f-94a0-4f25-8e47-c5835eb3a673 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:41.452566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3385c5f-94a0-4f25-8e47-c5835eb3a673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:41.453098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3385c5f-94a0-4f25-8e47-c5835eb3a673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:41.455107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3385c5f-94a0-4f25-8e47-c5835eb3a673 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:41.470745 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 336/659] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:41.471635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3385c5f-94a0-4f25-8e47-c5835eb3a673 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:41.484680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120a259-a7c5-40c5-91bd-0652f68d3b1f None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:41.518340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfedf6-fadc-40f5-8bf5-4f2e944906e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:41.518933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfedf6-fadc-40f5-8bf5-4f2e944906e9 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:41.519212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfedf6-fadc-40f5-8bf5-4f2e944906e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:41.519484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfedf6-fadc-40f5-8bf5-4f2e944906e9 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:41.520119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfedf6-fadc-40f5-8bf5-4f2e944906e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:41.520419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfedf6-fadc-40f5-8bf5-4f2e944906e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:41.521803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfedf6-fadc-40f5-8bf5-4f2e944906e9 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:41.534682 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 324/660] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:41.535726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfedf6-fadc-40f5-8bf5-4f2e944906e9 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:41.563489 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:41.573578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3385c5f-94a0-4f25-8e47-c5835eb3a673 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:41.590525 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:41.608829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6b28a-4fd1-4625-bc75-34c845b5dc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:41.609465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6b28a-4fd1-4625-bc75-34c845b5dc7e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:41.609739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6b28a-4fd1-4625-bc75-34c845b5dc7e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:41.610005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6b28a-4fd1-4625-bc75-34c845b5dc7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:41.619763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6b28a-4fd1-4625-bc75-34c845b5dc7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:41.624388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-3fa6b28a-4fd1-4625-bc75-34c845b5dc7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:41.624388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:41.624388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:41.624388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:41.624388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:41.624388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:41.624388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:41.624388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:41.624388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:41.624388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:41.624388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:41.624388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:41.624388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:41.624388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:41.624388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:41.624388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:41.625550 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:41.625550 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:41.625550 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:41.625550 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:41.625550 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:41.625550 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:41.625550 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:41.625550 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:41.625550 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:41.625550 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:41.625550 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:41.625550 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:41.625550 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:41.625550 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:41.625550 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:41.625550 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:41.626515 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:41.626515 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:41.626515 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:41.626515 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:41.626515 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:41.626515 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:41.626515 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:41.626515 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:41.626515 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:41.626515 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:41.626515 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:41.626515 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:41.626515 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 337/661] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:27:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:41.626515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6b28a-4fd1-4625-bc75-34c845b5dc7e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:41.641872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfedf6-fadc-40f5-8bf5-4f2e944906e9 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:41.675853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e048a2d-cff4-4608-ac64-968e098b8902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:41.676446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e048a2d-cff4-4608-ac64-968e098b8902 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:41.676763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e048a2d-cff4-4608-ac64-968e098b8902 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:41.677037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e048a2d-cff4-4608-ac64-968e098b8902 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:41.677670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e048a2d-cff4-4608-ac64-968e098b8902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:41.677970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e048a2d-cff4-4608-ac64-968e098b8902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:41.679305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e048a2d-cff4-4608-ac64-968e098b8902 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:41.691596 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 325/662] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:41.692375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e048a2d-cff4-4608-ac64-968e098b8902 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:41.724455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6b28a-4fd1-4625-bc75-34c845b5dc7e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:41.760195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce499782-4119-4a3d-b872-3191c47eee49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:41.761031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce499782-4119-4a3d-b872-3191c47eee49 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:41.761162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce499782-4119-4a3d-b872-3191c47eee49 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:41.761436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce499782-4119-4a3d-b872-3191c47eee49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:41.769714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce499782-4119-4a3d-b872-3191c47eee49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:41.771155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce499782-4119-4a3d-b872-3191c47eee49 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:41.778325 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:41.783104 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-ce499782-4119-4a3d-b872-3191c47eee49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:41.783104 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:41.783104 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:41.783104 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:41.783104 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:41.783104 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:41.783104 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:41.783104 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:41.783104 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:41.783104 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:41.783104 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:41.783104 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:41.783104 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:27:41.783104 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:27:41.783104 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:27:41.784162 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:27:41.784162 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:41.784162 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:41.784162 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:41.784162 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:41.784162 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:41.784162 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:41.784162 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:41.784162 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:41.784162 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:41.784162 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:41.784162 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:41.784162 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:41.784162 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:41.784162 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:41.784162 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:41.784162 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:41.790012 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:27:41.790012 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:27:41.790012 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:27:41.790012 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:27:41.790012 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:27:41.790012 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:27:41.790012 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:41.790012 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:41.790012 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 338/663] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:41.790012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce499782-4119-4a3d-b872-3191c47eee49 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:41.801908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e048a2d-cff4-4608-ac64-968e098b8902 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:41.819723 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:41.839398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b391a5-2922-4305-b858-0a6ce7937937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:41.840012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b391a5-2922-4305-b858-0a6ce7937937 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:41.840283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b391a5-2922-4305-b858-0a6ce7937937 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:41.840698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b391a5-2922-4305-b858-0a6ce7937937 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:41.847651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b391a5-2922-4305-b858-0a6ce7937937 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:41.849105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b391a5-2922-4305-b858-0a6ce7937937 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:41.861238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-68b391a5-2922-4305-b858-0a6ce7937937 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:41.861238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:41.861238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:41.861238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:41.861238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:41.861238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:41.861238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:41.861238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:41.861238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:41.861238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:41.861238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:41.861238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:41.861238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:27:41.861238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:27:41.861238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:27:41.862293 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:27:41.862293 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:41.862293 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:41.862293 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:41.862293 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:41.862293 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:41.862293 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:41.862293 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:41.862293 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:41.862293 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:41.862293 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:41.862293 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:41.862293 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:41.862293 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:41.862293 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:41.862293 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:41.862293 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:41.863305 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:27:41.863305 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:27:41.863305 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:27:41.863305 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:27:41.863305 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:27:41.863305 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:27:41.863305 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:41.863305 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:41.866382 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 326/664] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:41.867334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b391a5-2922-4305-b858-0a6ce7937937 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:41.885400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce499782-4119-4a3d-b872-3191c47eee49 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:41.924537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336b66f-12b6-43cb-b615-d2494e0a974b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:41.925184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336b66f-12b6-43cb-b615-d2494e0a974b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:41.925458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336b66f-12b6-43cb-b615-d2494e0a974b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:41.925722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336b66f-12b6-43cb-b615-d2494e0a974b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:41.933176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336b66f-12b6-43cb-b615-d2494e0a974b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:41.934584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336b66f-12b6-43cb-b615-d2494e0a974b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:41.945676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-8336b66f-12b6-43cb-b615-d2494e0a974b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 09:27:41.945676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:41.945676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:41.945676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:41.945676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:41.945676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:41.945676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:41.945676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:41.945676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:41.945676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:41.945676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:41.945676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:41.945676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:27:41.945676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:27:41.945676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:27:41.945676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:27:41.947487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:41.947487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:41.947487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:27:41.947487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:41.947487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:27:41.947487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:41.947487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:41.947487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:41.947487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:41.947487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:41.947487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:41.947487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:41.947487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:41.947487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:41.947487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:41.947487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:41.947487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:41.947487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:41.948694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:41.948694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:41.948694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:27:41.948694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:27:41.948694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:27:41.948694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:27:41.948694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:27:41.948694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:27:41.948694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 09:27:41.948694 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:41.948694 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 339/665] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:27:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:41.948694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336b66f-12b6-43cb-b615-d2494e0a974b None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:41.973503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b391a5-2922-4305-b858-0a6ce7937937 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:42.007078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dd3e9-2bcc-4d11-aa92-c618653547e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:42.007670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dd3e9-2bcc-4d11-aa92-c618653547e1 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:42.007951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dd3e9-2bcc-4d11-aa92-c618653547e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:42.008216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dd3e9-2bcc-4d11-aa92-c618653547e1 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:42.009888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667dd3e9-2bcc-4d11-aa92-c618653547e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:42.010194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667dd3e9-2bcc-4d11-aa92-c618653547e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:42.011538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667dd3e9-2bcc-4d11-aa92-c618653547e1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:42.019272 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 327/666] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Sep 30 09:27:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:42.020042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dd3e9-2bcc-4d11-aa92-c618653547e1 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:42.033784 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:42.041978 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:42.048204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336b66f-12b6-43cb-b615-d2494e0a974b None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:42.082220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caedb6a-3ae8-4c8f-8d62-ff5cdec137a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:42.082835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caedb6a-3ae8-4c8f-8d62-ff5cdec137a2 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:42.083110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caedb6a-3ae8-4c8f-8d62-ff5cdec137a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:42.083377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caedb6a-3ae8-4c8f-8d62-ff5cdec137a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:42.090675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caedb6a-3ae8-4c8f-8d62-ff5cdec137a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:42.092106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caedb6a-3ae8-4c8f-8d62-ff5cdec137a2 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:42.104419 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-5caedb6a-3ae8-4c8f-8d62-ff5cdec137a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:42.104419 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:42.104419 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:42.104419 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:42.104419 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:42.104419 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:42.104419 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:42.104419 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:42.104419 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:42.104419 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:42.104419 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:42.104419 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:42.104419 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:27:42.104419 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:27:42.104419 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:27:42.105487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:27:42.105487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:42.105487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:42.105487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:42.105487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:42.105487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:42.105487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:42.105487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:42.105487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:42.105487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:42.105487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:42.105487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:42.105487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:42.105487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:42.105487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:42.105487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:42.105487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:42.106715 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:27:42.106715 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:27:42.106715 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:27:42.106715 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:27:42.106715 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:27:42.106715 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:27:42.106715 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:42.106715 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:42.106715 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 340/667] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:42.106715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caedb6a-3ae8-4c8f-8d62-ff5cdec137a2 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:42.128797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dd3e9-2bcc-4d11-aa92-c618653547e1 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:42.162706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b44e7-fe36-4128-bf02-19206a3bbc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:42.163310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b44e7-fe36-4128-bf02-19206a3bbc57 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:42.163588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b44e7-fe36-4128-bf02-19206a3bbc57 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:42.163857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b44e7-fe36-4128-bf02-19206a3bbc57 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:42.164541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b44e7-fe36-4128-bf02-19206a3bbc57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:42.165363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b44e7-fe36-4128-bf02-19206a3bbc57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:42.166767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b44e7-fe36-4128-bf02-19206a3bbc57 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:42.178415 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 328/668] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:27:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:42.179195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b44e7-fe36-4128-bf02-19206a3bbc57 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:42.213619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caedb6a-3ae8-4c8f-8d62-ff5cdec137a2 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:42.244996 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:42.246306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa173692-7d8f-4b0b-b188-c55f7e279d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:42.246907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa173692-7d8f-4b0b-b188-c55f7e279d79 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:42.247186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa173692-7d8f-4b0b-b188-c55f7e279d79 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:42.247453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa173692-7d8f-4b0b-b188-c55f7e279d79 None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:42.248142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa173692-7d8f-4b0b-b188-c55f7e279d79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:42.248448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa173692-7d8f-4b0b-b188-c55f7e279d79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:42.249916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa173692-7d8f-4b0b-b188-c55f7e279d79 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:42.261739 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 341/669] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:27:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:42.262459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa173692-7d8f-4b0b-b188-c55f7e279d79 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:42.280364 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:42.285374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b44e7-fe36-4128-bf02-19206a3bbc57 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:42.319303 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a3e00-dc8a-40aa-95a3-9c59f44d6be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:42.319894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a3e00-dc8a-40aa-95a3-9c59f44d6be7 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:42.320169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a3e00-dc8a-40aa-95a3-9c59f44d6be7 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:42.320434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a3e00-dc8a-40aa-95a3-9c59f44d6be7 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:42.321419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a3e00-dc8a-40aa-95a3-9c59f44d6be7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:42.321722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a3e00-dc8a-40aa-95a3-9c59f44d6be7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:42.323118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a3e00-dc8a-40aa-95a3-9c59f44d6be7 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:42.340247 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 329/670] 10.222.0.16 () {56 vars in 1139 bytes} [Fri Sep 30 09:27:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:42.341142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a3e00-dc8a-40aa-95a3-9c59f44d6be7 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:42.364043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa173692-7d8f-4b0b-b188-c55f7e279d79 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:42.396969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684aa96-ef27-42ed-b345-01de86d0b9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:42.397581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684aa96-ef27-42ed-b345-01de86d0b9b4 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:42.397854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684aa96-ef27-42ed-b345-01de86d0b9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:42.398118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684aa96-ef27-42ed-b345-01de86d0b9b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:42.408139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684aa96-ef27-42ed-b345-01de86d0b9b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:42.409584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684aa96-ef27-42ed-b345-01de86d0b9b4 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:42.425264 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-1684aa96-ef27-42ed-b345-01de86d0b9b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:42.425264 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:42.425264 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:42.425264 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:42.425264 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:42.425264 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:42.425264 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:42.425264 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:42.425264 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:42.425264 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:42.425264 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:42.425264 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:42.425264 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:42.425264 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:42.425264 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:42.425264 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:42.426382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:42.426382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:42.426382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:42.426382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:42.426382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:42.426382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:42.426382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:42.426382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:42.426382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:42.426382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:42.426382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:42.426382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:42.426382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:42.426382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:42.426382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:42.426382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:42.426382 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:42.427398 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:42.427398 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:42.427398 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:42.427398 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 342/671] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:42.427398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684aa96-ef27-42ed-b345-01de86d0b9b4 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:42.442503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a3e00-dc8a-40aa-95a3-9c59f44d6be7 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:42.468802 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:42.477310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fc6e6-2c2f-45d5-9cb2-75c9957696f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:42.478712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fc6e6-2c2f-45d5-9cb2-75c9957696f0 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:42.478987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fc6e6-2c2f-45d5-9cb2-75c9957696f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:42.479264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fc6e6-2c2f-45d5-9cb2-75c9957696f0 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:42.479949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517fc6e6-2c2f-45d5-9cb2-75c9957696f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:42.480247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517fc6e6-2c2f-45d5-9cb2-75c9957696f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:42.481730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517fc6e6-2c2f-45d5-9cb2-75c9957696f0 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:42.492709 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 330/672] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:27:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:42.493622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fc6e6-2c2f-45d5-9cb2-75c9957696f0 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:42.495530 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:42.529977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684aa96-ef27-42ed-b345-01de86d0b9b4 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:42.563882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6a6db-b8e8-421e-8d51-4aac75c8c33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:42.564581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6a6db-b8e8-421e-8d51-4aac75c8c33d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:42.564897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6a6db-b8e8-421e-8d51-4aac75c8c33d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:42.565178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6a6db-b8e8-421e-8d51-4aac75c8c33d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:42.565896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6a6db-b8e8-421e-8d51-4aac75c8c33d None admin] RBAC: Adding query filter params (role.id=4089b59a020f44b98fad2a34b61fd573, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=ebc6604430ba4e2283994e5cb8ef18d3) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:42.566204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6a6db-b8e8-421e-8d51-4aac75c8c33d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:42.567618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6a6db-b8e8-421e-8d51-4aac75c8c33d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:42.573490 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 343/673] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:27:42 2022] GET /identity/v3/role_assignments?user.id=ebc6604430ba4e2283994e5cb8ef18d3&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=4089b59a020f44b98fad2a34b61fd573 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:42.574268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6a6db-b8e8-421e-8d51-4aac75c8c33d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:42.610243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fc6e6-2c2f-45d5-9cb2-75c9957696f0 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:42.650510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b317b-bfa6-4018-9acd-b8c89a8d31b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:42.651129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b317b-bfa6-4018-9acd-b8c89a8d31b4 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:42.651405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b317b-bfa6-4018-9acd-b8c89a8d31b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:42.651672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b317b-bfa6-4018-9acd-b8c89a8d31b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:42.652402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b317b-bfa6-4018-9acd-b8c89a8d31b4 None admin] RBAC: Adding query filter params (role.id=4089b59a020f44b98fad2a34b61fd573, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=947a48b06bb74f068b70e8c17a8da422) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:42.652744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b317b-bfa6-4018-9acd-b8c89a8d31b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:42.654182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b317b-bfa6-4018-9acd-b8c89a8d31b4 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:42.672725 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 331/674] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:27:42 2022] GET /identity/v3/role_assignments?user.id=947a48b06bb74f068b70e8c17a8da422&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=4089b59a020f44b98fad2a34b61fd573 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:42.672725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b317b-bfa6-4018-9acd-b8c89a8d31b4 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:42.704137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6a6db-b8e8-421e-8d51-4aac75c8c33d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:42.735115 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:42.743403 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:42.751930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5a2ca-50aa-40d0-a390-1f5ff958ee28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:42.753163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5a2ca-50aa-40d0-a390-1f5ff958ee28 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:42.753610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5a2ca-50aa-40d0-a390-1f5ff958ee28 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:42.754241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5a2ca-50aa-40d0-a390-1f5ff958ee28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:42.804587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b317b-bfa6-4018-9acd-b8c89a8d31b4 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:42.848067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5a2ca-50aa-40d0-a390-1f5ff958ee28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:42.849606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5a2ca-50aa-40d0-a390-1f5ff958ee28 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:42.864297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f5332-7ef9-430a-bfdb-9e2215c6670b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:42.865541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f5332-7ef9-430a-bfdb-9e2215c6670b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:42.866003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f5332-7ef9-430a-bfdb-9e2215c6670b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:42.866471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f5332-7ef9-430a-bfdb-9e2215c6670b None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:42.867488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f5332-7ef9-430a-bfdb-9e2215c6670b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:42.867849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f5332-7ef9-430a-bfdb-9e2215c6670b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:42.870899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f5332-7ef9-430a-bfdb-9e2215c6670b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:42.886469 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 332/675] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:42.887204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f5332-7ef9-430a-bfdb-9e2215c6670b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:42.983576 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 344/676] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:27:42.984508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5a2ca-50aa-40d0-a390-1f5ff958ee28 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:43.022435 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:43.029506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f5332-7ef9-430a-bfdb-9e2215c6670b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:43.041781 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:43.070533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bafddf-453e-4d63-a51f-3c14e8cc5941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:43.071101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bafddf-453e-4d63-a51f-3c14e8cc5941 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:43.071567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bafddf-453e-4d63-a51f-3c14e8cc5941 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:43.072138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bafddf-453e-4d63-a51f-3c14e8cc5941 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:43.072639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bafddf-453e-4d63-a51f-3c14e8cc5941 None admin] RBAC: Adding query filter params (role.id=4089b59a020f44b98fad2a34b61fd573, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=aa607111024540d1a09b01dfd1e5e8cd) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:43.072942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bafddf-453e-4d63-a51f-3c14e8cc5941 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:43.074404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bafddf-453e-4d63-a51f-3c14e8cc5941 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:43.082446 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 333/677] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:27:42 2022] GET /identity/v3/role_assignments?user.id=aa607111024540d1a09b01dfd1e5e8cd&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=4089b59a020f44b98fad2a34b61fd573 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:43.083360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bafddf-453e-4d63-a51f-3c14e8cc5941 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:43.106920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5a2ca-50aa-40d0-a390-1f5ff958ee28 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:43.146854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39d207-e368-4023-a58c-ae66c19ea99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:43.147921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39d207-e368-4023-a58c-ae66c19ea99e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:43.148409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39d207-e368-4023-a58c-ae66c19ea99e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:43.148938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39d207-e368-4023-a58c-ae66c19ea99e None admin] PATH_INFO: `/v3/users/swift` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:43.158853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39d207-e368-4023-a58c-ae66c19ea99e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:43.160584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39d207-e368-4023-a58c-ae66c19ea99e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:43.175430 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-bf39d207-e368-4023-a58c-ae66c19ea99e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:27:43.175430 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:43.175430 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:43.175430 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:43.175430 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:43.175430 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:43.175430 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:43.175430 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:43.175430 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:43.175430 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:43.175430 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:43.175430 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:43.175430 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:27:43.175430 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:27:43.175430 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:27:43.175430 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:27:43.176442 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:43.176442 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:43.176442 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:27:43.176442 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:43.176442 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:27:43.176442 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:43.176442 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:43.176442 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:43.176442 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:43.176442 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:43.176442 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:43.176442 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:43.176442 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:43.176442 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:43.176442 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:43.176442 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:43.176442 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:43.176442 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:43.177417 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:43.177417 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:43.177417 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:27:43.177417 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:27:43.177417 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:27:43.177417 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:27:43.177417 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:27:43.177417 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:27:43.177417 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:27:43.177417 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:43.180126 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 345/678] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:27:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:43.186926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39d207-e368-4023-a58c-ae66c19ea99e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:43.200400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bafddf-453e-4d63-a51f-3c14e8cc5941 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:43.246380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6bd05-3f74-40b1-a148-7fbbcbdb2329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:43.248422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6bd05-3f74-40b1-a148-7fbbcbdb2329 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:43.249639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6bd05-3f74-40b1-a148-7fbbcbdb2329 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:43.250447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6bd05-3f74-40b1-a148-7fbbcbdb2329 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:43.266318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6bd05-3f74-40b1-a148-7fbbcbdb2329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:43.268762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6bd05-3f74-40b1-a148-7fbbcbdb2329 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:43.306800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-99e6bd05-3f74-40b1-a148-7fbbcbdb2329 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:43.306800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:43.306800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:43.306800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:43.306800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:43.306800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:43.306800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:43.306800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:43.306800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:43.306800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:43.306800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:43.306800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:43.306800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:43.306800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:43.306800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:43.306800 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:43.307849 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:43.307849 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:43.307849 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:43.307849 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:43.307849 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:43.307849 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:43.307849 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:43.307849 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:43.307849 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:43.307849 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:43.307849 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:43.307849 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:43.307849 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:43.307849 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:43.307849 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:43.307849 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:43.307849 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:43.308775 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:43.308775 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:43.308775 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:43.313136 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 334/679] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:43.317684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39d207-e368-4023-a58c-ae66c19ea99e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:43.318788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6bd05-3f74-40b1-a148-7fbbcbdb2329 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:43.320859 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:43.365518 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:43.408261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed2ce6-6ea9-4c95-a856-614a18448825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:43.408891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed2ce6-6ea9-4c95-a856-614a18448825 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:43.409170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed2ce6-6ea9-4c95-a856-614a18448825 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:43.409437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed2ce6-6ea9-4c95-a856-614a18448825 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:43.410183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed2ce6-6ea9-4c95-a856-614a18448825 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:43.410482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed2ce6-6ea9-4c95-a856-614a18448825 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:43.411909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed2ce6-6ea9-4c95-a856-614a18448825 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:43.435028 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 346/680] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Sep 30 09:27:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:43.440329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed2ce6-6ea9-4c95-a856-614a18448825 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:43.471742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6bd05-3f74-40b1-a148-7fbbcbdb2329 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:43.521151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4dbe3-edcd-4c9e-a833-ea61566ff46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:43.521779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4dbe3-edcd-4c9e-a833-ea61566ff46a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:43.522454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4dbe3-edcd-4c9e-a833-ea61566ff46a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:43.522741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4dbe3-edcd-4c9e-a833-ea61566ff46a None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:43.523677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4dbe3-edcd-4c9e-a833-ea61566ff46a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:43.523983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4dbe3-edcd-4c9e-a833-ea61566ff46a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:43.525943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4dbe3-edcd-4c9e-a833-ea61566ff46a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:43.544751 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 335/681] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:43.550194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4dbe3-edcd-4c9e-a833-ea61566ff46a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:43.570950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed2ce6-6ea9-4c95-a856-614a18448825 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:43.611773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7da8a-29df-447f-8796-fad0fc3dfe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:43.612371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7da8a-29df-447f-8796-fad0fc3dfe4a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:43.612680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7da8a-29df-447f-8796-fad0fc3dfe4a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:43.612950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7da8a-29df-447f-8796-fad0fc3dfe4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:43.638401 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:43.667485 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:43.692264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4dbe3-edcd-4c9e-a833-ea61566ff46a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:43.716337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7da8a-29df-447f-8796-fad0fc3dfe4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:43.717967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7da8a-29df-447f-8796-fad0fc3dfe4a None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:43.735797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79cf3c-6b2f-4fa5-9260-e1e77701a379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:43.736425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79cf3c-6b2f-4fa5-9260-e1e77701a379 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:43.736732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79cf3c-6b2f-4fa5-9260-e1e77701a379 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:43.737002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79cf3c-6b2f-4fa5-9260-e1e77701a379 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:43.744949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79cf3c-6b2f-4fa5-9260-e1e77701a379 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:43.746374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79cf3c-6b2f-4fa5-9260-e1e77701a379 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:43.760094 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-3b79cf3c-6b2f-4fa5-9260-e1e77701a379 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:43.760094 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:43.760094 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:43.760094 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:43.760094 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:43.760094 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:43.760094 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:43.760094 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:43.760094 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:43.760094 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:43.760094 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:43.760094 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:43.760094 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:27:43.760094 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:27:43.760094 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:27:43.762179 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:27:43.762179 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:43.762179 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:43.762179 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:43.762179 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:43.762179 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:43.762179 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:43.762179 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:43.762179 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:43.762179 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:43.762179 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:43.762179 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:43.762179 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:43.762179 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:43.762179 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:43.762179 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:43.762179 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:43.764287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:27:43.764287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:27:43.764287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:27:43.764287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:27:43.764287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:27:43.764287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:27:43.764287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:43.764287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:43.764287 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 336/682] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:43.769885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79cf3c-6b2f-4fa5-9260-e1e77701a379 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:43.880048 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 347/683] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 09:27:43.885735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7da8a-29df-447f-8796-fad0fc3dfe4a None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:43.899870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79cf3c-6b2f-4fa5-9260-e1e77701a379 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:43.939206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f14c9-0eb0-4654-8382-ba44a50a9d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:43.939816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f14c9-0eb0-4654-8382-ba44a50a9d01 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:43.940093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f14c9-0eb0-4654-8382-ba44a50a9d01 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:43.940365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f14c9-0eb0-4654-8382-ba44a50a9d01 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:43.941078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f14c9-0eb0-4654-8382-ba44a50a9d01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:43.941383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f14c9-0eb0-4654-8382-ba44a50a9d01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:43.942791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f14c9-0eb0-4654-8382-ba44a50a9d01 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:43.971488 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 337/684] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:27:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:43.980449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f14c9-0eb0-4654-8382-ba44a50a9d01 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:43.989367 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:44.005257 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:44.070888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7da8a-29df-447f-8796-fad0fc3dfe4a None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:44.138811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d125d-371a-4da9-a9bf-002e9275a16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:44.139348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d125d-371a-4da9-a9bf-002e9275a16a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:44.139621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d125d-371a-4da9-a9bf-002e9275a16a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:44.139892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d125d-371a-4da9-a9bf-002e9275a16a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:44.162187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d125d-371a-4da9-a9bf-002e9275a16a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:44.163647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d125d-371a-4da9-a9bf-002e9275a16a None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:44.165537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f14c9-0eb0-4654-8382-ba44a50a9d01 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:44.208437 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-c17d125d-371a-4da9-a9bf-002e9275a16a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:44.208437 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:44.208437 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:44.208437 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:44.208437 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:44.208437 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:44.208437 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:44.208437 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:44.208437 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:44.208437 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:44.208437 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:44.208437 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:44.208437 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:44.208437 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:44.208437 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:44.208437 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:44.210234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:44.210234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:44.210234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:44.210234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:44.210234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:44.210234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:44.210234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:44.210234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:44.210234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:44.210234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:44.210234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:44.210234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:44.210234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:44.210234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:44.210234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:44.210234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:44.210234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:44.211227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:44.211227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:44.211227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:44.215110 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 348/685] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:27:44.221895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d125d-371a-4da9-a9bf-002e9275a16a None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:44.223067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d099f6c-35bb-4ae6-ad58-44ba9d12fcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:44.223736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d099f6c-35bb-4ae6-ad58-44ba9d12fcbb None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:44.224015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d099f6c-35bb-4ae6-ad58-44ba9d12fcbb None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:44.224284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d099f6c-35bb-4ae6-ad58-44ba9d12fcbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:44.225981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d099f6c-35bb-4ae6-ad58-44ba9d12fcbb None admin] RBAC: Adding query filter params (role.id=4089b59a020f44b98fad2a34b61fd573, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=a9b0fd833b134a089433cd2985caba80) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:44.226289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d099f6c-35bb-4ae6-ad58-44ba9d12fcbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:44.228339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d099f6c-35bb-4ae6-ad58-44ba9d12fcbb None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:44.235557 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 338/686] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:27:43 2022] GET /identity/v3/role_assignments?user.id=a9b0fd833b134a089433cd2985caba80&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=4089b59a020f44b98fad2a34b61fd573 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:44.384774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d125d-371a-4da9-a9bf-002e9275a16a None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:44.386500 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:44.435349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f9254-1f56-4942-a696-397449d04d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:44.435872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f9254-1f56-4942-a696-397449d04d08 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:44.436147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f9254-1f56-4942-a696-397449d04d08 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:44.436414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f9254-1f56-4942-a696-397449d04d08 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:44.437089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f9254-1f56-4942-a696-397449d04d08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:44.437395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f9254-1f56-4942-a696-397449d04d08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:44.438744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f9254-1f56-4942-a696-397449d04d08 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:44.460313 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 349/687] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:44.466539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d099f6c-35bb-4ae6-ad58-44ba9d12fcbb None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:44.553246 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:44.589206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d099f6c-35bb-4ae6-ad58-44ba9d12fcbb None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:44.649700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06a818-f7ff-423b-a7fb-b62ab03d3ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:44.650702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06a818-f7ff-423b-a7fb-b62ab03d3ec9 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:44.651180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06a818-f7ff-423b-a7fb-b62ab03d3ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:44.651671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06a818-f7ff-423b-a7fb-b62ab03d3ec9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:44.663878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06a818-f7ff-423b-a7fb-b62ab03d3ec9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:44.665723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06a818-f7ff-423b-a7fb-b62ab03d3ec9 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:44.683267 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-ba06a818-f7ff-423b-a7fb-b62ab03d3ec9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:44.683267 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:44.683267 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:44.683267 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:44.683267 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:44.683267 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:44.683267 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:44.683267 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:44.683267 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:44.683267 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:44.683267 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:44.683267 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:44.683267 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:27:44.683267 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:27:44.683267 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:27:44.684199 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:27:44.684199 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:44.684199 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:44.684199 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:44.684199 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:44.684199 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:44.684199 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:44.684199 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:44.684199 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:44.684199 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:44.684199 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:44.684199 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:44.684199 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:44.684199 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:44.684199 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:44.684199 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:44.684199 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:44.685660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:27:44.685660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:27:44.685660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:27:44.685660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:27:44.685660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:27:44.685660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:27:44.685660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:44.685660 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:44.685660 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 339/688] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:44.691228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f9254-1f56-4942-a696-397449d04d08 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:44.844145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f9254-1f56-4942-a696-397449d04d08 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:44.896434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc81e9-b990-44fd-8fd6-b0a09bf1b86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:44.897070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc81e9-b990-44fd-8fd6-b0a09bf1b86c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:44.897343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc81e9-b990-44fd-8fd6-b0a09bf1b86c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:44.897656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc81e9-b990-44fd-8fd6-b0a09bf1b86c None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:44.898355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc81e9-b990-44fd-8fd6-b0a09bf1b86c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:44.898653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc81e9-b990-44fd-8fd6-b0a09bf1b86c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:44.900307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc81e9-b990-44fd-8fd6-b0a09bf1b86c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:44.931582 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 350/689] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:27:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:44.937523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06a818-f7ff-423b-a7fb-b62ab03d3ec9 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:45.084310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06a818-f7ff-423b-a7fb-b62ab03d3ec9 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:45.120870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764e11b-a4b3-4f6d-aba5-73c97327e342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:45.121563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764e11b-a4b3-4f6d-aba5-73c97327e342 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:45.121887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764e11b-a4b3-4f6d-aba5-73c97327e342 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:45.122201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764e11b-a4b3-4f6d-aba5-73c97327e342 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:45.123089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764e11b-a4b3-4f6d-aba5-73c97327e342 None admin] RBAC: Adding query filter params (role.id=4089b59a020f44b98fad2a34b61fd573, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=963c491a2d2e409b8b45e4fb6aff41c3) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:45.123398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764e11b-a4b3-4f6d-aba5-73c97327e342 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:45.124827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764e11b-a4b3-4f6d-aba5-73c97327e342 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:45.132046 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 340/690] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:27:44 2022] GET /identity/v3/role_assignments?user.id=963c491a2d2e409b8b45e4fb6aff41c3&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=4089b59a020f44b98fad2a34b61fd573 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:45.132649 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:45.168394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbf24c-e076-4273-960c-4f9bb2735ba2 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:45.169448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbf24c-e076-4273-960c-4f9bb2735ba2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:45.169926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbf24c-e076-4273-960c-4f9bb2735ba2 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:45.171548 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 351/691] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:45.177619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167846a-f364-411a-b13e-1a2b3e06560e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:45.178238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167846a-f364-411a-b13e-1a2b3e06560e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:45.178716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167846a-f364-411a-b13e-1a2b3e06560e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:45.200226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4167846a-f364-411a-b13e-1a2b3e06560e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:45.201892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4167846a-f364-411a-b13e-1a2b3e06560e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:45.311664 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 341/692] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:45.490594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac23364-562b-4b4d-9903-9b66f17926ba None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:45.490915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac23364-562b-4b4d-9903-9b66f17926ba None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:45.491090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac23364-562b-4b4d-9903-9b66f17926ba None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:45.492634 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 352/693] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:45.498430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660acfaf-696b-40d0-9481-0779fc1cbb71 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:45.498965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660acfaf-696b-40d0-9481-0779fc1cbb71 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:45.498965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660acfaf-696b-40d0-9481-0779fc1cbb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:45.517509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-660acfaf-696b-40d0-9481-0779fc1cbb71 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:45.518712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-660acfaf-696b-40d0-9481-0779fc1cbb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:45.591776 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 342/694] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:45.644698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac23364-562b-4b4d-9903-9b66f17926ba None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:45.673731 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:45.760739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac23364-562b-4b4d-9903-9b66f17926ba None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:45.797114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fee98-27ab-4e5b-a935-516e83df6e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:45.797735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fee98-27ab-4e5b-a935-516e83df6e7e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:45.798011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fee98-27ab-4e5b-a935-516e83df6e7e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:45.798282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fee98-27ab-4e5b-a935-516e83df6e7e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:45.798866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fee98-27ab-4e5b-a935-516e83df6e7e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:45.800209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fee98-27ab-4e5b-a935-516e83df6e7e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:45.812541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-bf8fee98-27ab-4e5b-a935-516e83df6e7e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:27:45.812541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:45.812541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:27:45.812541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:27:45.812541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:27:45.812541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:27:45.812541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:27:45.812541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:27:45.812541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:27:45.812541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:45.812541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:27:45.812541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:45.812541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:45.812541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:45.812541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:45.812541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:45.812541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:45.813637 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:45.813637 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:45.813637 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:45.813637 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:45.813637 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:45.813637 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:45.813637 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:27:45.813637 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:27:45.813637 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:27:45.813637 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:27:45.813637 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:45.813637 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:45.813637 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:45.813637 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:45.813637 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:45.813637 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:45.814489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:45.814489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:45.814489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:45.814489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:45.814489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:45.814489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:45.814489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:45.814489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:45.814489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:45.814489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:45.814489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:27:45.814489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:27:45.814489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:27:45.814489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:45.814489 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 353/695] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Sep 30 09:27:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:45.819743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660acfaf-696b-40d0-9481-0779fc1cbb71 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:45.898221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fee98-27ab-4e5b-a935-516e83df6e7e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:45.944528 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:46.042224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660acfaf-696b-40d0-9481-0779fc1cbb71 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:46.064980 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:46.093868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489e0b8-f275-4725-a566-080f7964e302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:46.094892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489e0b8-f275-4725-a566-080f7964e302 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:46.095405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489e0b8-f275-4725-a566-080f7964e302 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:46.095865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489e0b8-f275-4725-a566-080f7964e302 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:46.096749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489e0b8-f275-4725-a566-080f7964e302 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:46.097257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489e0b8-f275-4725-a566-080f7964e302 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:46.099065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489e0b8-f275-4725-a566-080f7964e302 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:46.101357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fee98-27ab-4e5b-a935-516e83df6e7e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:46.105125 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 343/696] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Sep 30 09:27:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:46.114475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489e0b8-f275-4725-a566-080f7964e302 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:46.169546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d4c63-fe1a-4b01-9243-b2eb1446a7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:46.170197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d4c63-fe1a-4b01-9243-b2eb1446a7e6 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:46.170433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d4c63-fe1a-4b01-9243-b2eb1446a7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:46.170699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d4c63-fe1a-4b01-9243-b2eb1446a7e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:46.191722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d4c63-fe1a-4b01-9243-b2eb1446a7e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:46.193340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d4c63-fe1a-4b01-9243-b2eb1446a7e6 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:46.223467 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-727d4c63-fe1a-4b01-9243-b2eb1446a7e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:46.223467 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:46.223467 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:46.223467 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:46.223467 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:46.223467 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:46.223467 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:46.223467 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:46.223467 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:46.223467 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:46.223467 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:46.223467 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:46.223467 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:46.223467 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:46.223467 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:46.223467 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:46.224492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:46.224492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:46.224492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:46.224492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:46.224492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:46.224492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:46.224492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:46.224492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:46.224492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:46.224492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:46.224492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:46.224492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:46.224492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:46.224492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:46.224492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:46.224492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:46.224492 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:46.225467 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:46.225467 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:46.225467 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:46.225467 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 354/697] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:46.235521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d4c63-fe1a-4b01-9243-b2eb1446a7e6 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:46.316387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489e0b8-f275-4725-a566-080f7964e302 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:46.350503 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:46.369523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa9755-6fea-4cd8-9bf8-6a086126167a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:46.370237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa9755-6fea-4cd8-9bf8-6a086126167a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:46.370637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa9755-6fea-4cd8-9bf8-6a086126167a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:46.370751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d4c63-fe1a-4b01-9243-b2eb1446a7e6 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:46.370987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa9755-6fea-4cd8-9bf8-6a086126167a None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:46.371683 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa9755-6fea-4cd8-9bf8-6a086126167a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:46.372135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa9755-6fea-4cd8-9bf8-6a086126167a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:46.373669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa9755-6fea-4cd8-9bf8-6a086126167a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:46.388757 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 344/698] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Sep 30 09:27:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:46.390346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0e90e-d16e-40fe-ad26-7f058f86568e None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:46.390704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0e90e-d16e-40fe-ad26-7f058f86568e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:46.391126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0e90e-d16e-40fe-ad26-7f058f86568e None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:46.392915 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 345/699] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:46.398902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8d8fd-a4c0-4a9c-b496-b95dbac114dd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:46.399333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8d8fd-a4c0-4a9c-b496-b95dbac114dd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:46.399679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8d8fd-a4c0-4a9c-b496-b95dbac114dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:46.431856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27c186-bfda-4e04-999a-037508bc5d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:46.432483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27c186-bfda-4e04-999a-037508bc5d11 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:46.432789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27c186-bfda-4e04-999a-037508bc5d11 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:46.433062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27c186-bfda-4e04-999a-037508bc5d11 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:46.433717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27c186-bfda-4e04-999a-037508bc5d11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:46.434047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27c186-bfda-4e04-999a-037508bc5d11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:46.435398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27c186-bfda-4e04-999a-037508bc5d11 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:46.437825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-71b8d8fd-a4c0-4a9c-b496-b95dbac114dd None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:46.439056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-71b8d8fd-a4c0-4a9c-b496-b95dbac114dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:46.453023 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:46.463680 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 355/700] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:46.470904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27c186-bfda-4e04-999a-037508bc5d11 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:46.592219 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 346/701] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:46.626720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27c186-bfda-4e04-999a-037508bc5d11 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:46.663343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567f711-2c4b-4476-a398-43e061e50654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:46.664298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567f711-2c4b-4476-a398-43e061e50654 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:46.665417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567f711-2c4b-4476-a398-43e061e50654 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:46.665974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567f711-2c4b-4476-a398-43e061e50654 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:46.666817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567f711-2c4b-4476-a398-43e061e50654 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:46.668414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567f711-2c4b-4476-a398-43e061e50654 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:46.695273 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 356/702] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Sep 30 09:27:46 2022] POST /identity/v3/users => generated 254 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:27:46.937460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8d8fd-a4c0-4a9c-b496-b95dbac114dd None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:47.054795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8d8fd-a4c0-4a9c-b496-b95dbac114dd None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:47.069259 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:47.099528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c390c11-9c7b-46ba-ac7d-4adfee7a9bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:47.100162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c390c11-9c7b-46ba-ac7d-4adfee7a9bb6 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:47.100439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c390c11-9c7b-46ba-ac7d-4adfee7a9bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:47.100753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c390c11-9c7b-46ba-ac7d-4adfee7a9bb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:47.111754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c390c11-9c7b-46ba-ac7d-4adfee7a9bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:47.116661 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-2c390c11-9c7b-46ba-ac7d-4adfee7a9bb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:47.116661 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:47.116661 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:47.116661 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:47.116661 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:47.116661 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:47.116661 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:47.116661 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:47.116661 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:47.116661 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:47.116661 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:47.116661 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:47.116661 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:47.116661 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:47.116661 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:47.116661 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:47.117584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:47.117584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:47.117584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:47.117584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:47.117584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:47.117584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:47.117584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:47.117584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:47.117584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:47.117584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:47.117584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:47.117584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:47.117584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:47.117584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:47.117584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:47.117584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:47.119078 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:47.119078 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:47.119078 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:47.119078 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:47.119078 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:47.119078 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:47.119078 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:47.119078 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:47.119078 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:47.119078 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:47.119078 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:47.119078 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:47.119078 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 347/703] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:27:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:47.125970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567f711-2c4b-4476-a398-43e061e50654 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:47.194426 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:47.248444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567f711-2c4b-4476-a398-43e061e50654 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:47.292008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddded47-62b5-44ad-a52e-96c279659361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:47.292631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddded47-62b5-44ad-a52e-96c279659361 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:47.292910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddded47-62b5-44ad-a52e-96c279659361 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:47.293176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddded47-62b5-44ad-a52e-96c279659361 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:47.293840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddded47-62b5-44ad-a52e-96c279659361 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:47.294137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddded47-62b5-44ad-a52e-96c279659361 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:47.295490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddded47-62b5-44ad-a52e-96c279659361 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:47.303903 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 357/704] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:47.310568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c390c11-9c7b-46ba-ac7d-4adfee7a9bb6 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:47.369484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee773e6-2dc4-463c-bfb3-6adc12048f15 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:47.369922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee773e6-2dc4-463c-bfb3-6adc12048f15 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:47.370199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee773e6-2dc4-463c-bfb3-6adc12048f15 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:47.372381 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 358/705] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:47.384474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16fc36-4eb1-4f92-a1c4-04c54c950f31 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:47.384780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16fc36-4eb1-4f92-a1c4-04c54c950f31 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:47.385052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16fc36-4eb1-4f92-a1c4-04c54c950f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:47.413730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bb16fc36-4eb1-4f92-a1c4-04c54c950f31 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:47.415487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bb16fc36-4eb1-4f92-a1c4-04c54c950f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:47.498365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c390c11-9c7b-46ba-ac7d-4adfee7a9bb6 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:47.546336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0ba37-3dc4-463d-b8eb-2c04bced4c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:47.548322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0ba37-3dc4-463d-b8eb-2c04bced4c4d None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:47.549145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0ba37-3dc4-463d-b8eb-2c04bced4c4d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:47.550034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0ba37-3dc4-463d-b8eb-2c04bced4c4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:47.557769 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 359/706] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 30 09:27:47.573110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0ba37-3dc4-463d-b8eb-2c04bced4c4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:47.574801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0ba37-3dc4-463d-b8eb-2c04bced4c4d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:47.600935 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-32b0ba37-3dc4-463d-b8eb-2c04bced4c4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:47.600935 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:47.600935 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:47.600935 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:47.600935 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:47.600935 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:47.600935 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:47.600935 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:47.600935 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:47.600935 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:47.600935 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:47.600935 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:47.600935 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:47.600935 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:47.600935 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:47.600935 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:47.602606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:47.602606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:47.602606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:47.602606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:47.602606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:47.602606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:47.602606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:47.602606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:47.602606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:47.602606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:47.602606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:47.602606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:47.602606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:47.602606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:47.602606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:47.602606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:47.602606 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:47.603675 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:47.603675 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:47.603675 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:47.605405 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 348/707] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:47.610860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16fc36-4eb1-4f92-a1c4-04c54c950f31 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:47.677598 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:47.751343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16fc36-4eb1-4f92-a1c4-04c54c950f31 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:47.785430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82ef96-a5fb-4114-8120-a1781b381cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:47.786350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82ef96-a5fb-4114-8120-a1781b381cfd None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:47.786823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82ef96-a5fb-4114-8120-a1781b381cfd None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:47.787303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82ef96-a5fb-4114-8120-a1781b381cfd None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:47.788127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82ef96-a5fb-4114-8120-a1781b381cfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:47.788639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82ef96-a5fb-4114-8120-a1781b381cfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:47.791108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82ef96-a5fb-4114-8120-a1781b381cfd None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:47.806677 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 360/708] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:47.812283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0ba37-3dc4-463d-b8eb-2c04bced4c4d None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:47.842689 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:47.954730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0ba37-3dc4-463d-b8eb-2c04bced4c4d None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:48.005862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82ef96-a5fb-4114-8120-a1781b381cfd None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:48.010289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ed937-dc2b-47e3-8ca8-014a3fdeffe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:48.010930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ed937-dc2b-47e3-8ca8-014a3fdeffe9 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:48.011205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ed937-dc2b-47e3-8ca8-014a3fdeffe9 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:48.012746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ed937-dc2b-47e3-8ca8-014a3fdeffe9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:48.021139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ed937-dc2b-47e3-8ca8-014a3fdeffe9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:48.022557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ed937-dc2b-47e3-8ca8-014a3fdeffe9 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:48.050270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-484ed937-dc2b-47e3-8ca8-014a3fdeffe9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:27:48.050270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:48.050270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:48.050270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:48.050270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:48.050270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:48.050270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:48.050270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:48.050270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:48.050270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:48.050270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:48.050270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:48.050270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:27:48.050270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:27:48.050270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:27:48.050270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:27:48.051275 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:48.051275 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:48.051275 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:27:48.051275 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:48.051275 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:27:48.051275 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:48.051275 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:48.051275 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:48.051275 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:48.051275 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:48.051275 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:48.051275 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:48.051275 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:48.051275 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:48.051275 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:48.051275 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:48.051275 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:48.051275 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:48.052277 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:48.052277 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:48.052277 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:27:48.052277 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:27:48.052277 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:27:48.052277 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:27:48.052277 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:27:48.052277 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:27:48.052277 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:27:48.052277 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:48.052277 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 349/709] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Sep 30 09:27:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:48.057867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ed937-dc2b-47e3-8ca8-014a3fdeffe9 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:48.124736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82ef96-a5fb-4114-8120-a1781b381cfd None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:48.146572 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:48.162706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b8c6c-051b-4241-bef5-5c17dad65b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:48.163666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b8c6c-051b-4241-bef5-5c17dad65b61 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:48.164139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b8c6c-051b-4241-bef5-5c17dad65b61 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:48.164694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b8c6c-051b-4241-bef5-5c17dad65b61 None admin] PATH_INFO: `/v3/services/network` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:48.165533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b8c6c-051b-4241-bef5-5c17dad65b61 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:48.167108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b8c6c-051b-4241-bef5-5c17dad65b61 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:48.176636 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-e13b8c6c-051b-4241-bef5-5c17dad65b61 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:27:48.176636 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:48.176636 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:27:48.176636 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:27:48.176636 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:27:48.176636 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:27:48.176636 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:27:48.176636 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:27:48.176636 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:27:48.176636 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:48.176636 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:27:48.176636 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:48.176636 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:48.176636 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:48.176636 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:48.176636 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:48.176636 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:48.177658 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:48.177658 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:48.177658 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:48.177658 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:48.177658 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:48.177658 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:48.177658 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:27:48.177658 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:27:48.177658 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:27:48.177658 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:27:48.177658 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:48.177658 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:48.177658 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:48.177658 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:48.177658 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:48.177658 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:48.178480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:48.178480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:48.178480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:48.178480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:48.178480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:48.178480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:48.178480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:48.178480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:48.178480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:48.178480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:48.178480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:27:48.178480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:27:48.178480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:27:48.178480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:48.181250 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 361/710] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:48 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:27:48.187564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600a692-4e4a-4046-b967-3bdcb6e09edd None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:48.188096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600a692-4e4a-4046-b967-3bdcb6e09edd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:48.188557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600a692-4e4a-4046-b967-3bdcb6e09edd None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:48.190318 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 362/711] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:48.191406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600a692-4e4a-4046-b967-3bdcb6e09edd None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:48.221023 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:48.239797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ed937-dc2b-47e3-8ca8-014a3fdeffe9 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:48.279330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20327a25-8e23-4863-a2b7-4577f1c578d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:48.279832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20327a25-8e23-4863-a2b7-4577f1c578d3 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:48.280111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20327a25-8e23-4863-a2b7-4577f1c578d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:48.280383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20327a25-8e23-4863-a2b7-4577f1c578d3 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:48.281283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20327a25-8e23-4863-a2b7-4577f1c578d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:48.281536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20327a25-8e23-4863-a2b7-4577f1c578d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:48.283061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20327a25-8e23-4863-a2b7-4577f1c578d3 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:48.302048 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 350/712] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Sep 30 09:27:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:48.302587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600a692-4e4a-4046-b967-3bdcb6e09edd None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:48.303670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918f6ed-0d42-444c-895c-f5237fc3a475 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:48.303955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918f6ed-0d42-444c-895c-f5237fc3a475 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:48.304229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918f6ed-0d42-444c-895c-f5237fc3a475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:48.326407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d918f6ed-0d42-444c-895c-f5237fc3a475 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:48.327564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d918f6ed-0d42-444c-895c-f5237fc3a475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:48.342049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ca396-ab6e-4592-89f4-1b65ed5ccd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:48.343115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ca396-ab6e-4592-89f4-1b65ed5ccd36 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:48.343644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ca396-ab6e-4592-89f4-1b65ed5ccd36 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:48.344473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ca396-ab6e-4592-89f4-1b65ed5ccd36 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:48.345609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ca396-ab6e-4592-89f4-1b65ed5ccd36 None admin] RBAC: Adding query filter params (name=network) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:48.346155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ca396-ab6e-4592-89f4-1b65ed5ccd36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:48.348193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ca396-ab6e-4592-89f4-1b65ed5ccd36 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:48.354606 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 363/713] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Sep 30 09:27:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:48.355644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ca396-ab6e-4592-89f4-1b65ed5ccd36 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:48.397155 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:48.416895 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 351/714] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:48.417917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918f6ed-0d42-444c-895c-f5237fc3a475 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:48.476404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ca396-ab6e-4592-89f4-1b65ed5ccd36 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:48.516680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3088d0-5115-44fa-8a15-65b1dd05f5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:48.517663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3088d0-5115-44fa-8a15-65b1dd05f5f5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:48.518136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3088d0-5115-44fa-8a15-65b1dd05f5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:48.518745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3088d0-5115-44fa-8a15-65b1dd05f5f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:48.557135 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:48.598517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3088d0-5115-44fa-8a15-65b1dd05f5f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:48.600314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3088d0-5115-44fa-8a15-65b1dd05f5f5 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:48.619677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918f6ed-0d42-444c-895c-f5237fc3a475 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:48.640688 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:48.673246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5f2db-2597-4b0c-be38-c5047bc74392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:48.673857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5f2db-2597-4b0c-be38-c5047bc74392 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:48.674131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5f2db-2597-4b0c-be38-c5047bc74392 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:48.674403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5f2db-2597-4b0c-be38-c5047bc74392 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:48.675042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5f2db-2597-4b0c-be38-c5047bc74392 None admin] RBAC: Adding query filter params (type=network) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:48.675344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5f2db-2597-4b0c-be38-c5047bc74392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:48.676977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5f2db-2597-4b0c-be38-c5047bc74392 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:48.683205 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 352/715] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Sep 30 09:27:48 2022] GET /identity/v3/services?type=network => generated 124 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:48.722176 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 364/716] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:27:48.730198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5f2db-2597-4b0c-be38-c5047bc74392 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:48.883040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5f2db-2597-4b0c-be38-c5047bc74392 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:48.905986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3088d0-5115-44fa-8a15-65b1dd05f5f5 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:48.935106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb75d66-b5bb-4ee7-8af8-5e489760729e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:48.935759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb75d66-b5bb-4ee7-8af8-5e489760729e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:48.936037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb75d66-b5bb-4ee7-8af8-5e489760729e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:48.936307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb75d66-b5bb-4ee7-8af8-5e489760729e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:48.939609 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:48.952285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb75d66-b5bb-4ee7-8af8-5e489760729e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:48.953948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb75d66-b5bb-4ee7-8af8-5e489760729e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:48.971493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-eeb75d66-b5bb-4ee7-8af8-5e489760729e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:48.971493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:48.971493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:48.971493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:48.971493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:48.971493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:48.971493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:48.971493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:48.971493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:48.971493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:48.971493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:48.971493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:48.971493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:48.971493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:48.971493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:48.971493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:48.972493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:48.972493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:48.972493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:48.972493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:48.972493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:48.972493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:48.972493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:48.972493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:48.972493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:48.972493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:48.972493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:48.972493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:48.972493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:48.972493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:48.972493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:48.972493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:48.972493 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:48.973813 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:48.973813 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:48.973813 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:48.973813 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 353/717] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:48.979457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb75d66-b5bb-4ee7-8af8-5e489760729e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:49.041161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3088d0-5115-44fa-8a15-65b1dd05f5f5 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:49.079098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ba5cd-644f-46aa-a1a5-d8d7a5f3cb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:49.079719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ba5cd-644f-46aa-a1a5-d8d7a5f3cb3f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:49.079993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ba5cd-644f-46aa-a1a5-d8d7a5f3cb3f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:49.080262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ba5cd-644f-46aa-a1a5-d8d7a5f3cb3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:49.082376 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:49.095457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ba5cd-644f-46aa-a1a5-d8d7a5f3cb3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:49.102157 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-851ba5cd-644f-46aa-a1a5-d8d7a5f3cb3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:49.102157 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:49.102157 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:49.102157 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:49.102157 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:49.102157 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:49.102157 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:49.102157 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:49.102157 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:49.102157 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:49.102157 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:49.102157 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:49.102157 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:49.102157 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:49.102157 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:49.102157 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:49.103131 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:49.103131 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:49.103131 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:49.103131 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:49.103131 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:49.103131 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:49.103131 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:49.103131 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:49.103131 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:49.103131 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:49.103131 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:49.103131 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:49.103131 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:49.103131 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:49.103131 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:49.103131 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:49.104114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:49.104114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:49.104114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:49.104114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:49.104114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:49.104114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:49.104114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:49.104114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:49.104114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:49.104114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:49.104114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:49.104114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:49.104782 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 365/718] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:27:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:27:49.105754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa5558-62f2-4460-8073-1bf1e447d3b9 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:49.106121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa5558-62f2-4460-8073-1bf1e447d3b9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:49.106268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa5558-62f2-4460-8073-1bf1e447d3b9 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:49.108354 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 366/719] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:49.113415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa5558-62f2-4460-8073-1bf1e447d3b9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:49.118518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb75d66-b5bb-4ee7-8af8-5e489760729e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:49.158325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e782ce-e238-464d-83c6-82e4358cdae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:49.158950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e782ce-e238-464d-83c6-82e4358cdae5 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:49.159367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e782ce-e238-464d-83c6-82e4358cdae5 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:49.159707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e782ce-e238-464d-83c6-82e4358cdae5 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:49.160755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e782ce-e238-464d-83c6-82e4358cdae5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:49.161148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e782ce-e238-464d-83c6-82e4358cdae5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:49.162646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e782ce-e238-464d-83c6-82e4358cdae5 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:49.178414 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 354/720] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:49.185450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08f8ac-4c47-405c-81f3-657c71cccb31 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:49.185737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08f8ac-4c47-405c-81f3-657c71cccb31 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:49.186011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08f8ac-4c47-405c-81f3-657c71cccb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:49.209623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5d08f8ac-4c47-405c-81f3-657c71cccb31 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:49.210762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5d08f8ac-4c47-405c-81f3-657c71cccb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:49.241587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa5558-62f2-4460-8073-1bf1e447d3b9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:49.265539 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:49.281249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40605511-586c-4334-b451-8458f7003200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:49.282344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40605511-586c-4334-b451-8458f7003200 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:49.282844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40605511-586c-4334-b451-8458f7003200 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:49.283460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40605511-586c-4334-b451-8458f7003200 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:49.284411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40605511-586c-4334-b451-8458f7003200 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:49.284925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40605511-586c-4334-b451-8458f7003200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:49.286528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40605511-586c-4334-b451-8458f7003200 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:49.297409 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 367/721] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:49.298241 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 355/722] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:49.298889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40605511-586c-4334-b451-8458f7003200 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:49.309574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08f8ac-4c47-405c-81f3-657c71cccb31 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:49.370832 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:49.410920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40605511-586c-4334-b451-8458f7003200 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:49.457912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ada72-023e-4acc-9cb5-d54ec1d0e0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:49.458887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ada72-023e-4acc-9cb5-d54ec1d0e0e5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:49.459383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ada72-023e-4acc-9cb5-d54ec1d0e0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:49.459860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ada72-023e-4acc-9cb5-d54ec1d0e0e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:49.471278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ada72-023e-4acc-9cb5-d54ec1d0e0e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:49.473833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ada72-023e-4acc-9cb5-d54ec1d0e0e5 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:49.497336 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-ed2ada72-023e-4acc-9cb5-d54ec1d0e0e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:49.497336 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:49.497336 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:49.497336 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:49.497336 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:49.497336 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:49.497336 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:49.497336 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:49.497336 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:49.497336 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:49.497336 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:49.497336 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:49.497336 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:27:49.497336 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:27:49.497336 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:27:49.498314 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:27:49.498314 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:49.498314 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:49.498314 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:49.498314 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:49.498314 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:49.498314 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:49.498314 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:49.498314 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:49.498314 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:49.498314 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:49.498314 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:49.498314 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:49.498314 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:49.498314 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:49.498314 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:49.498314 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:49.499263 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:27:49.499263 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:27:49.499263 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:27:49.499263 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:27:49.499263 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:27:49.499263 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:27:49.499263 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:49.499263 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:49.504305 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 368/723] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:49.506664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08f8ac-4c47-405c-81f3-657c71cccb31 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:49.510534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ada72-023e-4acc-9cb5-d54ec1d0e0e5 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:49.605344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7bc9c-53a3-4f49-a706-aa8505e4cf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:49.605991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7bc9c-53a3-4f49-a706-aa8505e4cf06 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:49.606275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7bc9c-53a3-4f49-a706-aa8505e4cf06 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:49.606543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7bc9c-53a3-4f49-a706-aa8505e4cf06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:49.634228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7bc9c-53a3-4f49-a706-aa8505e4cf06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:49.635648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7bc9c-53a3-4f49-a706-aa8505e4cf06 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:49.643876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ada72-023e-4acc-9cb5-d54ec1d0e0e5 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:49.670480 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-4fe7bc9c-53a3-4f49-a706-aa8505e4cf06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:49.670480 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:49.670480 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:49.670480 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:49.670480 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:49.670480 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:49.670480 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:49.670480 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:49.670480 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:49.670480 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:49.670480 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:49.670480 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:49.670480 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:49.670480 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:49.670480 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:49.670480 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:49.671500 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:49.671500 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:49.671500 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:49.671500 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:49.671500 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:49.671500 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:49.671500 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:49.671500 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:49.671500 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:49.671500 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:49.671500 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:49.671500 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:49.671500 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:49.671500 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:49.671500 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:49.671500 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:49.671500 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:49.672412 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:49.672412 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:49.672412 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:49.672412 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 356/724] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:49.676172 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:49.682056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7bc9c-53a3-4f49-a706-aa8505e4cf06 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:49.684873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a220a-1dc1-4fa7-bc83-396dfe2d6a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:49.685932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a220a-1dc1-4fa7-bc83-396dfe2d6a8d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:49.686404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a220a-1dc1-4fa7-bc83-396dfe2d6a8d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:49.686937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a220a-1dc1-4fa7-bc83-396dfe2d6a8d None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:49.687867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a220a-1dc1-4fa7-bc83-396dfe2d6a8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:49.688361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a220a-1dc1-4fa7-bc83-396dfe2d6a8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:49.690058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a220a-1dc1-4fa7-bc83-396dfe2d6a8d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:49.707571 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 369/725] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:27:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:49.709055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52421d-afb3-43f0-8af9-9e05084ccee3 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:49.709473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52421d-afb3-43f0-8af9-9e05084ccee3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:49.709877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52421d-afb3-43f0-8af9-9e05084ccee3 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:49.712254 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 370/726] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:49.713162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52421d-afb3-43f0-8af9-9e05084ccee3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:49.728329 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:49.810768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7bc9c-53a3-4f49-a706-aa8505e4cf06 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:49.850697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c22d1-b0da-4f4f-93ff-f94407848718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:49.851301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c22d1-b0da-4f4f-93ff-f94407848718 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:49.851574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c22d1-b0da-4f4f-93ff-f94407848718 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:49.851838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c22d1-b0da-4f4f-93ff-f94407848718 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:49.852515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c22d1-b0da-4f4f-93ff-f94407848718 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:49.852841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c22d1-b0da-4f4f-93ff-f94407848718 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:49.854199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c22d1-b0da-4f4f-93ff-f94407848718 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:49.872273 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 357/727] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:49.872273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c22d1-b0da-4f4f-93ff-f94407848718 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:49.942746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52421d-afb3-43f0-8af9-9e05084ccee3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:49.972895 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:49.978276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8e6e8-d0ed-494b-b0a1-e57bfe2360ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:49.978846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8e6e8-d0ed-494b-b0a1-e57bfe2360ee None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:49.979120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8e6e8-d0ed-494b-b0a1-e57bfe2360ee None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:49.979383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8e6e8-d0ed-494b-b0a1-e57bfe2360ee None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:49.980014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8e6e8-d0ed-494b-b0a1-e57bfe2360ee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:49.981454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8e6e8-d0ed-494b-b0a1-e57bfe2360ee None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:49.983323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c22d1-b0da-4f4f-93ff-f94407848718 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:49.998740 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 371/728] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Sep 30 09:27:49 2022] POST /identity/v3/services => generated 251 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:27:49.999994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa0fe9-20d3-4e2d-aa70-841b14aee90f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:50.000279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa0fe9-20d3-4e2d-aa70-841b14aee90f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:50.000559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa0fe9-20d3-4e2d-aa70-841b14aee90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:50.021065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-83fa0fe9-20d3-4e2d-aa70-841b14aee90f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:50.022623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-83fa0fe9-20d3-4e2d-aa70-841b14aee90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:50.057649 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:50.058177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b90b4-1a42-41bc-b29e-fb321e26faa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:50.060589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b90b4-1a42-41bc-b29e-fb321e26faa2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:50.061343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b90b4-1a42-41bc-b29e-fb321e26faa2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:50.061930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b90b4-1a42-41bc-b29e-fb321e26faa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:50.063130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b90b4-1a42-41bc-b29e-fb321e26faa2 None admin] RBAC: Adding query filter params (role.id=f06b5fed717d4b03a5083dd847274296, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=aa607111024540d1a09b01dfd1e5e8cd) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:50.064182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b90b4-1a42-41bc-b29e-fb321e26faa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:50.066482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b90b4-1a42-41bc-b29e-fb321e26faa2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:50.083047 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 358/729] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:27:49 2022] GET /identity/v3/role_assignments?user.id=aa607111024540d1a09b01dfd1e5e8cd&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=f06b5fed717d4b03a5083dd847274296 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:50.083047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b90b4-1a42-41bc-b29e-fb321e26faa2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:50.130378 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 372/730] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:50.258176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b90b4-1a42-41bc-b29e-fb321e26faa2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:50.300735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633921c-f350-483f-a2f4-247a5e61146f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:50.302763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633921c-f350-483f-a2f4-247a5e61146f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:50.302763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633921c-f350-483f-a2f4-247a5e61146f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:50.302763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633921c-f350-483f-a2f4-247a5e61146f None admin] PATH_INFO: `/v3/users/swift` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:50.310684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633921c-f350-483f-a2f4-247a5e61146f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:50.312181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633921c-f350-483f-a2f4-247a5e61146f None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:50.324796 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-4633921c-f350-483f-a2f4-247a5e61146f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:27:50.324796 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:50.324796 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:50.324796 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:50.324796 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:50.324796 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:50.324796 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:50.324796 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:50.324796 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:50.324796 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:50.324796 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:50.324796 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:50.324796 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:27:50.324796 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:27:50.324796 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:27:50.324796 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:27:50.325742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:50.325742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:50.325742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:27:50.325742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:50.325742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:27:50.325742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:50.325742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:50.325742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:50.325742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:50.325742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:50.325742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:50.325742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:50.325742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:50.325742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:50.325742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:50.325742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:50.325742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:50.325742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:50.326681 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:50.326681 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:50.326681 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:27:50.326681 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:27:50.326681 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:27:50.326681 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:27:50.326681 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:27:50.326681 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:27:50.326681 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:27:50.326681 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:50.326681 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 359/731] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:27:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:50.334640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa0fe9-20d3-4e2d-aa70-841b14aee90f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:50.425065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633921c-f350-483f-a2f4-247a5e61146f None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:50.448266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa0fe9-20d3-4e2d-aa70-841b14aee90f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:50.448960 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:50.492514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f23175-568a-4840-af4d-bc5c06b5444f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:50.494388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f23175-568a-4840-af4d-bc5c06b5444f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:50.494876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f23175-568a-4840-af4d-bc5c06b5444f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:50.495351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f23175-568a-4840-af4d-bc5c06b5444f None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:50.496286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f23175-568a-4840-af4d-bc5c06b5444f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:50.496842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f23175-568a-4840-af4d-bc5c06b5444f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:50.498622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f23175-568a-4840-af4d-bc5c06b5444f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:50.539502 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 373/732] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Sep 30 09:27:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:50.543758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f23175-568a-4840-af4d-bc5c06b5444f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:50.564809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633921c-f350-483f-a2f4-247a5e61146f None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:50.589008 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:50.613658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac465cb-9b62-4c22-b52a-6c8b63bebeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:50.614334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac465cb-9b62-4c22-b52a-6c8b63bebeab None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:50.614608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac465cb-9b62-4c22-b52a-6c8b63bebeab None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:50.614873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac465cb-9b62-4c22-b52a-6c8b63bebeab None admin] PATH_INFO: `/v3/roles/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:50.635266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac465cb-9b62-4c22-b52a-6c8b63bebeab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:50.645431 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-5ac465cb-9b62-4c22-b52a-6c8b63bebeab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:50.645431 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:50.645431 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:50.645431 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:50.645431 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:50.645431 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:50.645431 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:50.645431 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:50.645431 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:50.645431 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:50.645431 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:50.645431 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:50.645431 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:50.645431 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:50.645431 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:50.645431 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:50.646377 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:50.646377 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:50.646377 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:50.646377 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:50.646377 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:50.646377 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:50.646377 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:50.646377 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:50.646377 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:50.646377 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:50.646377 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:50.646377 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:50.646377 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:50.646377 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:50.646377 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:50.646377 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:50.647203 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:50.647203 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:50.647203 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:50.647203 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:50.647203 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:50.647203 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:50.647203 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:50.647203 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:50.647203 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:50.647203 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:50.647203 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:50.647203 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:50.647203 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 360/733] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:27:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:50.654860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac465cb-9b62-4c22-b52a-6c8b63bebeab None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:50.738940 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:50.764242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f23175-568a-4840-af4d-bc5c06b5444f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:50.774788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac465cb-9b62-4c22-b52a-6c8b63bebeab None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:50.811493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b8a65-0722-4b17-8e19-0d28b3171ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:50.812474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b8a65-0722-4b17-8e19-0d28b3171ce6 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:50.812973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b8a65-0722-4b17-8e19-0d28b3171ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:50.813456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b8a65-0722-4b17-8e19-0d28b3171ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:50.814385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b8a65-0722-4b17-8e19-0d28b3171ce6 None admin] RBAC: Adding query filter params (name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:50.814877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b8a65-0722-4b17-8e19-0d28b3171ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:50.816448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b8a65-0722-4b17-8e19-0d28b3171ce6 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:50.826248 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 361/734] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Sep 30 09:27:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:50.833639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b8a65-0722-4b17-8e19-0d28b3171ce6 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:50.849301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fbd33-c04e-41f8-9c4c-0f126db11c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:50.849934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fbd33-c04e-41f8-9c4c-0f126db11c5f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:50.850206 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fbd33-c04e-41f8-9c4c-0f126db11c5f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:50.850471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fbd33-c04e-41f8-9c4c-0f126db11c5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:50.978131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fbd33-c04e-41f8-9c4c-0f126db11c5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:50.979570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fbd33-c04e-41f8-9c4c-0f126db11c5f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:50.986242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b8a65-0722-4b17-8e19-0d28b3171ce6 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:51.018089 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:51.027579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d821e18-5e21-4772-ac41-077e2996e74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:51.028224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d821e18-5e21-4772-ac41-077e2996e74e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:51.028507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d821e18-5e21-4772-ac41-077e2996e74e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:51.028807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d821e18-5e21-4772-ac41-077e2996e74e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:51.032954 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:51.047249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d821e18-5e21-4772-ac41-077e2996e74e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:51.048717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d821e18-5e21-4772-ac41-077e2996e74e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:51.078584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-2d821e18-5e21-4772-ac41-077e2996e74e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:51.078584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:51.078584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:51.078584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:51.078584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:51.078584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:51.078584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:51.078584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:51.078584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:51.078584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:51.078584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:51.078584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:51.078584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:51.078584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:51.078584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:51.078584 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:51.079561 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:51.079561 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:51.079561 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:51.079561 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:51.079561 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:51.079561 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:51.079561 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:51.079561 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:51.079561 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:51.079561 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:51.079561 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:51.079561 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:51.079561 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:51.079561 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:51.079561 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:51.079561 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:51.079561 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:51.080529 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:51.080529 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:51.080529 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:51.081180 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 362/735] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:51.089832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d821e18-5e21-4772-ac41-077e2996e74e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:51.174795 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 374/736] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:50 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:27:51.180700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fbd33-c04e-41f8-9c4c-0f126db11c5f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:51.216308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d821e18-5e21-4772-ac41-077e2996e74e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:51.251690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e2abf-cd34-431b-ab93-b79f3bc808f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:51.252693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e2abf-cd34-431b-ab93-b79f3bc808f5 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:51.253174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e2abf-cd34-431b-ab93-b79f3bc808f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:51.253641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e2abf-cd34-431b-ab93-b79f3bc808f5 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:51.254501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e2abf-cd34-431b-ab93-b79f3bc808f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:51.255001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e2abf-cd34-431b-ab93-b79f3bc808f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:51.256565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e2abf-cd34-431b-ab93-b79f3bc808f5 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:51.270337 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 363/737] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:51.271938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f14751-0541-4dfb-85a5-d1ee095ecc24 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:51.272418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f14751-0541-4dfb-85a5-d1ee095ecc24 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:51.272907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f14751-0541-4dfb-85a5-d1ee095ecc24 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:51.275317 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 364/738] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:51.276406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f14751-0541-4dfb-85a5-d1ee095ecc24 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:51.341089 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:51.365408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fbd33-c04e-41f8-9c4c-0f126db11c5f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:51.394025 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:51.399911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f14751-0541-4dfb-85a5-d1ee095ecc24 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:51.407923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6e371-1c74-4057-9e4c-94986ba43a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:51.409074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6e371-1c74-4057-9e4c-94986ba43a56 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:51.409370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6e371-1c74-4057-9e4c-94986ba43a56 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:51.409648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6e371-1c74-4057-9e4c-94986ba43a56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:51.424472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6e371-1c74-4057-9e4c-94986ba43a56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:51.426213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6e371-1c74-4057-9e4c-94986ba43a56 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:51.438500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df416d-c0e6-4d93-bb75-d200460994ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:51.439398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df416d-c0e6-4d93-bb75-d200460994ee None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:51.439887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df416d-c0e6-4d93-bb75-d200460994ee None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:51.440350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df416d-c0e6-4d93-bb75-d200460994ee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:51.444945 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-d7f6e371-1c74-4057-9e4c-94986ba43a56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:51.444945 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:51.444945 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:51.444945 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:51.444945 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:51.444945 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:51.444945 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:51.444945 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:51.444945 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:51.444945 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:51.444945 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:51.444945 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:51.444945 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:51.444945 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:51.444945 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:51.444945 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:51.445944 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:51.445944 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:51.445944 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:51.445944 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:51.445944 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:51.445944 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:51.445944 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:51.445944 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:51.445944 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:51.445944 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:51.445944 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:51.445944 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:51.445944 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:51.445944 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:51.445944 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:51.445944 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:51.445944 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:51.448283 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:51.448283 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:51.448283 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:51.451465 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 375/739] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:27:51.452917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df416d-c0e6-4d93-bb75-d200460994ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:51.453120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1e268-2edb-4daa-8452-2b871f71262e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:51.453414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1e268-2edb-4daa-8452-2b871f71262e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:51.453691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1e268-2edb-4daa-8452-2b871f71262e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:51.455154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df416d-c0e6-4d93-bb75-d200460994ee None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:51.468776 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-80df416d-c0e6-4d93-bb75-d200460994ee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:27:51.468776 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:51.468776 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:51.468776 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:51.468776 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:51.468776 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:51.468776 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:51.468776 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:51.468776 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:51.468776 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:51.468776 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:51.468776 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:51.468776 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:27:51.468776 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:27:51.468776 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:27:51.468776 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:27:51.469753 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:51.469753 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:51.469753 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:27:51.469753 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:51.469753 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:27:51.469753 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:51.469753 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:51.469753 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:51.469753 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:51.469753 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:51.469753 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:51.469753 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:51.469753 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:51.469753 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:51.469753 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:51.469753 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:51.469753 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:51.469753 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:51.470699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:51.470699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:51.470699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:27:51.470699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:27:51.470699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:27:51.470699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:27:51.470699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:27:51.470699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:27:51.470699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:27:51.470699 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:51.473205 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 365/740] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Sep 30 09:27:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:51.473447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-dec1e268-2edb-4daa-8452-2b871f71262e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:51.474482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df416d-c0e6-4d93-bb75-d200460994ee None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:51.474670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dec1e268-2edb-4daa-8452-2b871f71262e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:51.549046 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 376/741] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:27:51.549904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1e268-2edb-4daa-8452-2b871f71262e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:51.639669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df416d-c0e6-4d93-bb75-d200460994ee None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:51.642189 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:51.679495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812010c9-0a09-4fb6-b1db-726ef3063313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:51.685756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812010c9-0a09-4fb6-b1db-726ef3063313 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:51.686281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812010c9-0a09-4fb6-b1db-726ef3063313 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:51.686740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812010c9-0a09-4fb6-b1db-726ef3063313 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:51.687601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812010c9-0a09-4fb6-b1db-726ef3063313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:51.688041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1e268-2edb-4daa-8452-2b871f71262e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:51.688320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812010c9-0a09-4fb6-b1db-726ef3063313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:51.689987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812010c9-0a09-4fb6-b1db-726ef3063313 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:51.698908 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:51.715505 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 366/742] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:51.721236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812010c9-0a09-4fb6-b1db-726ef3063313 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:51.726489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477057f4-f1c5-4934-95a1-d9b84060a5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:51.727677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477057f4-f1c5-4934-95a1-d9b84060a5f6 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:51.727677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477057f4-f1c5-4934-95a1-d9b84060a5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:51.727677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477057f4-f1c5-4934-95a1-d9b84060a5f6 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:51.728494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477057f4-f1c5-4934-95a1-d9b84060a5f6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:51.728834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477057f4-f1c5-4934-95a1-d9b84060a5f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:51.730269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477057f4-f1c5-4934-95a1-d9b84060a5f6 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:51.748731 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 377/743] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Sep 30 09:27:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:51.756060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477057f4-f1c5-4934-95a1-d9b84060a5f6 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:51.863764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477057f4-f1c5-4934-95a1-d9b84060a5f6 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:51.867946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812010c9-0a09-4fb6-b1db-726ef3063313 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:51.904986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994320ec-c84c-4400-b393-d82befc58f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:51.905509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994320ec-c84c-4400-b393-d82befc58f6a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:51.905788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994320ec-c84c-4400-b393-d82befc58f6a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:51.906058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994320ec-c84c-4400-b393-d82befc58f6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:51.911139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e01491-1b93-47ff-abe4-726eb41648e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:51.920050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e01491-1b93-47ff-abe4-726eb41648e6 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:51.920050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e01491-1b93-47ff-abe4-726eb41648e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:51.920050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e01491-1b93-47ff-abe4-726eb41648e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:51.936949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e01491-1b93-47ff-abe4-726eb41648e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:51.938392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e01491-1b93-47ff-abe4-726eb41648e6 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:51.958142 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-08e01491-1b93-47ff-abe4-726eb41648e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:51.958142 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:51.958142 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:51.958142 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:51.958142 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:51.958142 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:51.958142 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:51.958142 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:51.958142 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:51.958142 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:51.958142 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:51.958142 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:51.958142 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:27:51.958142 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:27:51.958142 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:27:51.959058 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:27:51.959058 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:51.959058 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:51.959058 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:51.959058 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:51.959058 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:51.959058 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:51.959058 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:51.959058 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:51.959058 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:51.959058 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:51.959058 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:51.959058 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:51.959058 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:51.959058 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:51.959058 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:51.959058 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:51.959967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:27:51.959967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:27:51.959967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:27:51.959967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:27:51.959967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:27:51.959967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:27:51.959967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:51.959967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:51.966970 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 367/744] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:27:51.966970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e01491-1b93-47ff-abe4-726eb41648e6 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:51.974184 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:51.998605 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:52.021322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994320ec-c84c-4400-b393-d82befc58f6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:52.023525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994320ec-c84c-4400-b393-d82befc58f6a None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:52.091346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e01491-1b93-47ff-abe4-726eb41648e6 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:52.127620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba834d-ff2a-45a5-a546-822d4eca3930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:52.128589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba834d-ff2a-45a5-a546-822d4eca3930 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:52.129099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba834d-ff2a-45a5-a546-822d4eca3930 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:52.129592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba834d-ff2a-45a5-a546-822d4eca3930 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:52.130444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba834d-ff2a-45a5-a546-822d4eca3930 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:52.132008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba834d-ff2a-45a5-a546-822d4eca3930 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:52.146902 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 378/745] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:27:51 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 09:27:52.146902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994320ec-c84c-4400-b393-d82befc58f6a None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:52.164536 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 368/746] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Sep 30 09:27:51 2022] POST /identity/v3/services => generated 240 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:27:52.164536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba834d-ff2a-45a5-a546-822d4eca3930 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:52.269256 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:52.319509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994320ec-c84c-4400-b393-d82befc58f6a None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:52.368701 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:52.382955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c58bf5-4fd0-4ad2-83c0-df1ab2ba7aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:52.384327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c58bf5-4fd0-4ad2-83c0-df1ab2ba7aaa None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:52.385675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c58bf5-4fd0-4ad2-83c0-df1ab2ba7aaa None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:52.385992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c58bf5-4fd0-4ad2-83c0-df1ab2ba7aaa None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:52.386692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c58bf5-4fd0-4ad2-83c0-df1ab2ba7aaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:52.387584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c58bf5-4fd0-4ad2-83c0-df1ab2ba7aaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:52.388885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c58bf5-4fd0-4ad2-83c0-df1ab2ba7aaa None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:52.393110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba834d-ff2a-45a5-a546-822d4eca3930 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:52.406639 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 379/747] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:27:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:52.413263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c58bf5-4fd0-4ad2-83c0-df1ab2ba7aaa None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:52.437225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24422b45-b3d1-4b11-96ec-61478cf75e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:52.437781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24422b45-b3d1-4b11-96ec-61478cf75e1e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:52.438060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24422b45-b3d1-4b11-96ec-61478cf75e1e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:52.438331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24422b45-b3d1-4b11-96ec-61478cf75e1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:52.452053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24422b45-b3d1-4b11-96ec-61478cf75e1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:52.453748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24422b45-b3d1-4b11-96ec-61478cf75e1e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:52.474873 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-24422b45-b3d1-4b11-96ec-61478cf75e1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:52.474873 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:52.474873 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:52.474873 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:52.474873 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:52.474873 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:52.474873 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:52.474873 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:52.474873 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:52.474873 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:52.474873 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:52.474873 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:52.474873 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:52.474873 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:52.474873 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:52.474873 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:52.475902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:52.475902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:52.475902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:52.475902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:52.475902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:52.475902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:52.475902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:52.475902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:52.475902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:52.475902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:52.475902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:52.475902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:52.475902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:52.475902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:52.475902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:52.475902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:52.475902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:52.476840 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:52.476840 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:52.476840 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:52.477012 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 369/748] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:52.486540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24422b45-b3d1-4b11-96ec-61478cf75e1e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:52.586234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c58bf5-4fd0-4ad2-83c0-df1ab2ba7aaa None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:52.613445 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:52.629127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c530f96-f005-4de6-a4b9-bdde70da3695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:52.630244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c530f96-f005-4de6-a4b9-bdde70da3695 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:52.630738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c530f96-f005-4de6-a4b9-bdde70da3695 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:52.631091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c530f96-f005-4de6-a4b9-bdde70da3695 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:52.631899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c530f96-f005-4de6-a4b9-bdde70da3695 None admin] RBAC: Adding query filter params (role.id=f06b5fed717d4b03a5083dd847274296, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=963c491a2d2e409b8b45e4fb6aff41c3) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:52.632287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c530f96-f005-4de6-a4b9-bdde70da3695 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:52.634362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c530f96-f005-4de6-a4b9-bdde70da3695 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:52.641067 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 380/749] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:27:52 2022] GET /identity/v3/role_assignments?user.id=963c491a2d2e409b8b45e4fb6aff41c3&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=f06b5fed717d4b03a5083dd847274296 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:52.642402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31a88f-8bb0-43ac-ab5e-418d93cb3088 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:52.642781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31a88f-8bb0-43ac-ab5e-418d93cb3088 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:52.643153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31a88f-8bb0-43ac-ab5e-418d93cb3088 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:52.644696 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 381/750] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:52.659516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfabe36-856b-4815-b457-11a20c5acf71 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:52.659867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfabe36-856b-4815-b457-11a20c5acf71 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:52.660067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfabe36-856b-4815-b457-11a20c5acf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:52.690067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8bfabe36-856b-4815-b457-11a20c5acf71 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:52.691205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8bfabe36-856b-4815-b457-11a20c5acf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:52.726586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24422b45-b3d1-4b11-96ec-61478cf75e1e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:52.766423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d9ba4-e954-4606-96c9-274c354c6b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:52.767173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d9ba4-e954-4606-96c9-274c354c6b44 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:52.767553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d9ba4-e954-4606-96c9-274c354c6b44 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:52.767824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d9ba4-e954-4606-96c9-274c354c6b44 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:52.768477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d9ba4-e954-4606-96c9-274c354c6b44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:52.768801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d9ba4-e954-4606-96c9-274c354c6b44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:52.770280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d9ba4-e954-4606-96c9-274c354c6b44 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:52.775917 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 382/751] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:27:52.784644 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 370/752] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:52.784969 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:52.785687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dc622-c5eb-4844-bba0-e9571a133df2 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:52.785838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dc622-c5eb-4844-bba0-e9571a133df2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:52.786243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dc622-c5eb-4844-bba0-e9571a133df2 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:52.787769 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 383/753] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:52 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:52.793861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d9ba4-e954-4606-96c9-274c354c6b44 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:52.794054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f4dc7-6e5b-418f-a996-9a847fbc5c85 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:52.794171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f4dc7-6e5b-418f-a996-9a847fbc5c85 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:52.794429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f4dc7-6e5b-418f-a996-9a847fbc5c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:52.840119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-aa9f4dc7-6e5b-418f-a996-9a847fbc5c85 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:52.840754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-aa9f4dc7-6e5b-418f-a996-9a847fbc5c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:52.908767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d9ba4-e954-4606-96c9-274c354c6b44 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:52.960889 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 384/754] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:27:52.967793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1754dbf-8e65-4714-8f2a-f13bd1a38841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:52.968462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1754dbf-8e65-4714-8f2a-f13bd1a38841 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:52.968766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1754dbf-8e65-4714-8f2a-f13bd1a38841 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:52.969085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1754dbf-8e65-4714-8f2a-f13bd1a38841 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:52.979952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1754dbf-8e65-4714-8f2a-f13bd1a38841 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:52.981422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1754dbf-8e65-4714-8f2a-f13bd1a38841 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:52.996107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-d1754dbf-8e65-4714-8f2a-f13bd1a38841 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:52.996107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:52.996107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:52.996107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:52.996107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:52.996107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:52.996107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:52.996107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:52.996107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:52.996107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:52.996107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:52.996107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:52.996107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:27:52.996107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:27:52.996107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:27:52.997107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:27:52.997107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:52.997107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:52.997107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:52.997107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:52.997107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:52.997107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:52.997107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:52.997107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:52.997107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:52.997107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:52.997107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:52.997107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:52.997107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:52.997107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:52.997107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:52.997107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:52.997987 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:27:52.997987 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:27:52.997987 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:27:52.997987 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:27:52.997987 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:27:52.997987 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:27:52.997987 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:52.997987 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:52.997987 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 371/755] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:53.002856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f4dc7-6e5b-418f-a996-9a847fbc5c85 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:53.068633 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:53.096672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1754dbf-8e65-4714-8f2a-f13bd1a38841 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:53.168448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f4dc7-6e5b-418f-a996-9a847fbc5c85 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:53.207701 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:53.246220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4918476-3f4f-4054-b57c-96da5ad665f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:53.246854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4918476-3f4f-4054-b57c-96da5ad665f4 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:53.247128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4918476-3f4f-4054-b57c-96da5ad665f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:53.247461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4918476-3f4f-4054-b57c-96da5ad665f4 None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:53.248171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4918476-3f4f-4054-b57c-96da5ad665f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:53.248520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4918476-3f4f-4054-b57c-96da5ad665f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:53.250018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4918476-3f4f-4054-b57c-96da5ad665f4 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:53.259369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1754dbf-8e65-4714-8f2a-f13bd1a38841 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:53.277003 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 385/756] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:27:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:53.278453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4918476-3f4f-4054-b57c-96da5ad665f4 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:53.311820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071c5c2-3561-4878-948a-caa7b1cfe399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:53.312442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071c5c2-3561-4878-948a-caa7b1cfe399 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:53.312971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071c5c2-3561-4878-948a-caa7b1cfe399 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:53.314193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071c5c2-3561-4878-948a-caa7b1cfe399 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:53.335686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071c5c2-3561-4878-948a-caa7b1cfe399 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:53.343366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-d071c5c2-3561-4878-948a-caa7b1cfe399 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:53.343366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:53.343366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:53.343366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:53.343366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:53.343366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:53.343366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:53.343366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:53.343366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:53.343366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:53.343366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:53.343366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:53.343366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:53.343366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:53.343366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:53.343366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:53.344324 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:53.344324 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:53.344324 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:53.344324 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:53.344324 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:53.344324 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:53.344324 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:53.344324 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:53.344324 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:53.344324 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:53.344324 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:53.344324 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:53.344324 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:53.344324 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:53.344324 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:53.344324 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:53.345193 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:53.345193 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:53.345193 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:53.345193 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:53.345193 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:53.345193 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:53.345193 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:53.345193 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:53.345193 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:53.345193 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:53.345193 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:53.345193 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:53.348682 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 372/757] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:27:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:27:53.349862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071c5c2-3561-4878-948a-caa7b1cfe399 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:53.416713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4918476-3f4f-4054-b57c-96da5ad665f4 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:53.420371 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:53.462173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a728f-dcac-4475-8365-ef61a0fc96c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:53.462769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a728f-dcac-4475-8365-ef61a0fc96c4 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:53.463045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a728f-dcac-4475-8365-ef61a0fc96c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:53.463489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a728f-dcac-4475-8365-ef61a0fc96c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:53.464358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a728f-dcac-4475-8365-ef61a0fc96c4 None admin] RBAC: Adding query filter params (role.id=4089b59a020f44b98fad2a34b61fd573, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=9bdab836a64d43ea842629d29b6f8d47) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:53.464686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a728f-dcac-4475-8365-ef61a0fc96c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:53.466100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a728f-dcac-4475-8365-ef61a0fc96c4 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:53.466445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071c5c2-3561-4878-948a-caa7b1cfe399 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:53.472749 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 386/758] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:27:53 2022] GET /identity/v3/role_assignments?user.id=9bdab836a64d43ea842629d29b6f8d47&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=4089b59a020f44b98fad2a34b61fd573 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:53.473544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a728f-dcac-4475-8365-ef61a0fc96c4 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:53.485899 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:53.525917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391edf69-40de-4732-9304-bfb16b02e311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:53.526935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391edf69-40de-4732-9304-bfb16b02e311 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:53.527428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391edf69-40de-4732-9304-bfb16b02e311 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:53.527898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391edf69-40de-4732-9304-bfb16b02e311 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:53.528719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391edf69-40de-4732-9304-bfb16b02e311 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:53.530486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391edf69-40de-4732-9304-bfb16b02e311 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:53.559065 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-391edf69-40de-4732-9304-bfb16b02e311 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:27:53.559065 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:53.559065 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:27:53.559065 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:27:53.559065 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:27:53.559065 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:27:53.559065 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:27:53.559065 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:27:53.559065 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:27:53.559065 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:53.559065 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:27:53.559065 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:53.559065 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:53.559065 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:53.559065 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:53.559065 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:53.559065 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:53.560164 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:53.560164 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:53.560164 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:53.560164 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:53.560164 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:53.560164 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:53.560164 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:27:53.560164 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:27:53.560164 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:27:53.560164 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:27:53.560164 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:53.560164 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:53.560164 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:53.560164 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:53.560164 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:53.560164 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:53.561067 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:53.561067 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:53.561067 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:53.561067 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:53.561067 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:53.561067 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:53.561067 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:53.561067 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:53.561067 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:53.561067 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:53.561067 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:27:53.561067 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:27:53.561067 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:27:53.561067 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:53.572860 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 373/759] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Sep 30 09:27:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:53.580851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391edf69-40de-4732-9304-bfb16b02e311 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:53.693016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a728f-dcac-4475-8365-ef61a0fc96c4 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:53.740912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391edf69-40de-4732-9304-bfb16b02e311 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:53.775364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e543924-cfff-4463-8060-1fa2ec4a7bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:53.776140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e543924-cfff-4463-8060-1fa2ec4a7bd5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:53.776370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e543924-cfff-4463-8060-1fa2ec4a7bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:53.776731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e543924-cfff-4463-8060-1fa2ec4a7bd5 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:53.777489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a2fbc-2c88-4263-a918-83b0136c64e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:53.777614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e543924-cfff-4463-8060-1fa2ec4a7bd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:53.777812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e543924-cfff-4463-8060-1fa2ec4a7bd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:53.778087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a2fbc-2c88-4263-a918-83b0136c64e6 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:53.778362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a2fbc-2c88-4263-a918-83b0136c64e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:53.778632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a2fbc-2c88-4263-a918-83b0136c64e6 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:53.779148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e543924-cfff-4463-8060-1fa2ec4a7bd5 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:53.779253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a2fbc-2c88-4263-a918-83b0136c64e6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:53.779538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a2fbc-2c88-4263-a918-83b0136c64e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:53.780901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a2fbc-2c88-4263-a918-83b0136c64e6 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:53.785865 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 374/760] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Sep 30 09:27:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:53.792248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a2fbc-2c88-4263-a918-83b0136c64e6 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:53.799632 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 387/761] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:53.805717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e543924-cfff-4463-8060-1fa2ec4a7bd5 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:53.858071 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:53.892956 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:53.942744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a2fbc-2c88-4263-a918-83b0136c64e6 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:53.981081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5273af-7fbd-4cea-9bf3-75ebc1949f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:53.982453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5273af-7fbd-4cea-9bf3-75ebc1949f06 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:53.982938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5273af-7fbd-4cea-9bf3-75ebc1949f06 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:53.983470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5273af-7fbd-4cea-9bf3-75ebc1949f06 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:53.984297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5273af-7fbd-4cea-9bf3-75ebc1949f06 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:53.984832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5273af-7fbd-4cea-9bf3-75ebc1949f06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:53.986904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5273af-7fbd-4cea-9bf3-75ebc1949f06 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:53.996624 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 375/762] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Sep 30 09:27:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:53.997525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e543924-cfff-4463-8060-1fa2ec4a7bd5 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:53.999022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5273af-7fbd-4cea-9bf3-75ebc1949f06 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:54.078741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc43703-c39f-488f-8c99-870e067f5313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:54.080743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc43703-c39f-488f-8c99-870e067f5313 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:54.083092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc43703-c39f-488f-8c99-870e067f5313 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:54.088157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc43703-c39f-488f-8c99-870e067f5313 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:54.106299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc43703-c39f-488f-8c99-870e067f5313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:54.109312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc43703-c39f-488f-8c99-870e067f5313 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:54.142825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5273af-7fbd-4cea-9bf3-75ebc1949f06 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:54.146051 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-6fc43703-c39f-488f-8c99-870e067f5313 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:54.146051 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:54.146051 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:54.146051 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:54.146051 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:54.146051 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:54.146051 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:54.146051 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:54.146051 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:54.146051 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:54.146051 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:54.146051 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:54.146051 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:54.146051 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:54.146051 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:54.146051 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:54.146978 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:54.146978 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:54.146978 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:54.146978 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:54.146978 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:54.146978 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:54.146978 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:54.146978 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:54.146978 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:54.146978 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:54.146978 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:54.146978 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:54.146978 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:54.146978 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:54.146978 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:54.146978 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:54.146978 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:54.147935 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:54.147935 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:54.147935 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:54.147935 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 388/763] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:54.157540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc43703-c39f-488f-8c99-870e067f5313 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:54.160976 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:54.190607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0688ff-b30a-42b7-b230-ed361b2e72ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:54.191582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0688ff-b30a-42b7-b230-ed361b2e72ba None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:54.192064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0688ff-b30a-42b7-b230-ed361b2e72ba None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:54.192561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0688ff-b30a-42b7-b230-ed361b2e72ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:54.193503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0688ff-b30a-42b7-b230-ed361b2e72ba None admin] RBAC: Adding query filter params (interface=public, service_id=ef6eb4b8def94570b259a70d128efe68, region_id=RegionOne) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:54.194014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0688ff-b30a-42b7-b230-ed361b2e72ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:54.197900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0688ff-b30a-42b7-b230-ed361b2e72ba None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:54.221036 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 376/764] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Sep 30 09:27:53 2022] GET /identity/v3/endpoints?service_id=ef6eb4b8def94570b259a70d128efe68&interface=public®ion_id=RegionOne => generated 194 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:54.224363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0688ff-b30a-42b7-b230-ed361b2e72ba None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:54.348778 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:54.388246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc43703-c39f-488f-8c99-870e067f5313 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:54.434721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa57df-e7a2-4d36-bb6b-5e8e01b6fa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:54.435715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa57df-e7a2-4d36-bb6b-5e8e01b6fa5a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:54.436246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa57df-e7a2-4d36-bb6b-5e8e01b6fa5a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:54.436752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa57df-e7a2-4d36-bb6b-5e8e01b6fa5a None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:54.438623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa57df-e7a2-4d36-bb6b-5e8e01b6fa5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:54.440409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa57df-e7a2-4d36-bb6b-5e8e01b6fa5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:54.444038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa57df-e7a2-4d36-bb6b-5e8e01b6fa5a None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:54.449463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0688ff-b30a-42b7-b230-ed361b2e72ba None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:54.472750 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 389/765] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:54.476878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa57df-e7a2-4d36-bb6b-5e8e01b6fa5a None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:54.523632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2359fa0-1391-49e5-a25f-ad59df78a003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:54.525269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2359fa0-1391-49e5-a25f-ad59df78a003 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:54.525774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2359fa0-1391-49e5-a25f-ad59df78a003 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:54.526246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2359fa0-1391-49e5-a25f-ad59df78a003 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:54.527068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2359fa0-1391-49e5-a25f-ad59df78a003 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:54.528672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2359fa0-1391-49e5-a25f-ad59df78a003 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:54.547700 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 377/766] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Sep 30 09:27:54 2022] GET /identity/v3/services => generated 772 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:54.648188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa57df-e7a2-4d36-bb6b-5e8e01b6fa5a None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:54.674842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7601c-35e0-4093-8686-a5f79d637120 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:54.675212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7601c-35e0-4093-8686-a5f79d637120 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:54.675383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7601c-35e0-4093-8686-a5f79d637120 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:54.677637 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 378/767] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:27:54.683124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e8f5-a987-4a1d-827b-fd0f9656cdbd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:54.683450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e8f5-a987-4a1d-827b-fd0f9656cdbd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:54.683710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e8f5-a987-4a1d-827b-fd0f9656cdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:54.718876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f133546-c87e-4229-8fc5-b93e57399890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:54.720236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f133546-c87e-4229-8fc5-b93e57399890 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:54.720750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f133546-c87e-4229-8fc5-b93e57399890 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:54.721252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f133546-c87e-4229-8fc5-b93e57399890 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:54.735614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ddc7e8f5-a987-4a1d-827b-fd0f9656cdbd None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:54.736772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f133546-c87e-4229-8fc5-b93e57399890 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:54.738919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ddc7e8f5-a987-4a1d-827b-fd0f9656cdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:54.740196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f133546-c87e-4229-8fc5-b93e57399890 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:54.770743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-7f133546-c87e-4229-8fc5-b93e57399890 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:27:54.770743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:54.770743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:54.770743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:54.770743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:54.770743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:54.770743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:54.770743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:54.770743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:54.770743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:54.770743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:54.770743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:54.770743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:27:54.770743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:27:54.770743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:27:54.770743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:27:54.771786 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:54.771786 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:54.771786 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:27:54.771786 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:54.771786 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:27:54.771786 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:54.771786 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:54.771786 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:54.771786 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:54.771786 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:54.771786 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:54.771786 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:54.771786 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:54.771786 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:54.771786 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:54.771786 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:54.771786 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:54.771786 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:54.772765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:54.772765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:54.772765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:27:54.772765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:27:54.772765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:27:54.772765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:27:54.772765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:27:54.772765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:27:54.772765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:27:54.772765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:54.778315 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 390/768] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Sep 30 09:27:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:54.782085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f133546-c87e-4229-8fc5-b93e57399890 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:54.787365 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:54.815932 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:54.865894 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 379/769] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:27:54.933465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f133546-c87e-4229-8fc5-b93e57399890 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:54.982515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0dbad1-d276-4c8e-902b-1d97e9524399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:54.983125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dbad1-d276-4c8e-902b-1d97e9524399 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:54.983405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dbad1-d276-4c8e-902b-1d97e9524399 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:54.983678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dbad1-d276-4c8e-902b-1d97e9524399 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:54.984417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0dbad1-d276-4c8e-902b-1d97e9524399 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:54.984745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0dbad1-d276-4c8e-902b-1d97e9524399 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:54.986166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0dbad1-d276-4c8e-902b-1d97e9524399 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:55.014826 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 391/770] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Sep 30 09:27:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:55.020663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7e8f5-a987-4a1d-827b-fd0f9656cdbd None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:55.154127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7e8f5-a987-4a1d-827b-fd0f9656cdbd None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:55.197308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e10d0a-8f84-4b42-903c-903bc7d891b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:55.197868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e10d0a-8f84-4b42-903c-903bc7d891b3 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:55.198143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e10d0a-8f84-4b42-903c-903bc7d891b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:55.198410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e10d0a-8f84-4b42-903c-903bc7d891b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:55.216334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e10d0a-8f84-4b42-903c-903bc7d891b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:55.217842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e10d0a-8f84-4b42-903c-903bc7d891b3 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:55.239906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-d0e10d0a-8f84-4b42-903c-903bc7d891b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:55.239906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:55.239906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:55.239906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:55.239906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:55.239906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:55.239906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:55.239906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:55.239906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:55.239906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:55.239906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:55.239906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:55.239906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:55.239906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:55.239906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:55.239906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:55.240927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:55.240927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:55.240927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:55.240927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:55.240927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:55.240927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:55.240927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:55.240927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:55.240927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:55.240927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:55.240927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:55.240927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:55.240927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:55.240927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:55.240927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:55.240927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:55.240927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:55.241821 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:55.241821 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:55.241821 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:55.241821 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 380/771] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:55.246780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0dbad1-d276-4c8e-902b-1d97e9524399 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:55.268004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731db05-b37d-449e-8974-c05d4da5549e None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:55.268331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731db05-b37d-449e-8974-c05d4da5549e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:55.268552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731db05-b37d-449e-8974-c05d4da5549e None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:55.270377 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 381/772] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:55.277390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e95c3-f4a2-4d67-8f89-3ba50b5836f2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:55.277671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e95c3-f4a2-4d67-8f89-3ba50b5836f2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:55.277939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e95c3-f4a2-4d67-8f89-3ba50b5836f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:55.308574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e00e95c3-f4a2-4d67-8f89-3ba50b5836f2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:55.309791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e00e95c3-f4a2-4d67-8f89-3ba50b5836f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:55.324987 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:55.343599 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:55.387072 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 382/773] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:27:55.388011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e95c3-f4a2-4d67-8f89-3ba50b5836f2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:55.403662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0dbad1-d276-4c8e-902b-1d97e9524399 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:55.479567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f74ed-9407-4f32-b875-ae3a1e6adc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:55.480473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f74ed-9407-4f32-b875-ae3a1e6adc85 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:55.480865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f74ed-9407-4f32-b875-ae3a1e6adc85 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:55.481346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f74ed-9407-4f32-b875-ae3a1e6adc85 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:55.482395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f74ed-9407-4f32-b875-ae3a1e6adc85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:55.482910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f74ed-9407-4f32-b875-ae3a1e6adc85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:55.484550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f74ed-9407-4f32-b875-ae3a1e6adc85 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:55.510456 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 392/774] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:55.515472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f74ed-9407-4f32-b875-ae3a1e6adc85 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:55.557904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e95c3-f4a2-4d67-8f89-3ba50b5836f2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:55.626224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdfa79-dcea-40fe-8fb4-644e12dd7c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:55.626864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdfa79-dcea-40fe-8fb4-644e12dd7c09 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:55.627144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdfa79-dcea-40fe-8fb4-644e12dd7c09 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:55.627417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdfa79-dcea-40fe-8fb4-644e12dd7c09 None admin] PATH_INFO: `/v3/services/network` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:55.628004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdfa79-dcea-40fe-8fb4-644e12dd7c09 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:55.629383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdfa79-dcea-40fe-8fb4-644e12dd7c09 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:55.645530 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-09bdfa79-dcea-40fe-8fb4-644e12dd7c09 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:27:55.645530 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:55.645530 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:27:55.645530 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:27:55.645530 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:27:55.645530 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:27:55.645530 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:27:55.645530 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:27:55.645530 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:27:55.645530 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:55.645530 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:27:55.645530 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:55.645530 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:55.645530 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:55.645530 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:55.645530 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:55.645530 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:55.646605 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:55.646605 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:55.646605 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:55.646605 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:55.646605 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:55.646605 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:55.646605 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:27:55.646605 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:27:55.646605 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:27:55.646605 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:27:55.646605 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:55.646605 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:55.646605 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:55.646605 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:55.646605 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:55.646605 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:55.647442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:55.647442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:55.647442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:55.647442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:55.647442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:55.647442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:55.647442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:55.647442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:55.647442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:55.647442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:55.647442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:27:55.647442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:27:55.647442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:27:55.647442 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:55.649090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f74ed-9407-4f32-b875-ae3a1e6adc85 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:55.653041 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 383/775] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:55 2022] GET /identity/v3/services/network => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:55.658486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdfa79-dcea-40fe-8fb4-644e12dd7c09 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:55.671180 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:55.687724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d29526-aab5-409b-990b-3e7bee158145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:55.688399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d29526-aab5-409b-990b-3e7bee158145 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:55.688719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d29526-aab5-409b-990b-3e7bee158145 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:55.689028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d29526-aab5-409b-990b-3e7bee158145 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:55.689537 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:55.701934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d29526-aab5-409b-990b-3e7bee158145 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:55.704894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d29526-aab5-409b-990b-3e7bee158145 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:55.731053 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-48d29526-aab5-409b-990b-3e7bee158145 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:55.731053 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:55.731053 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:55.731053 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:55.731053 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:55.731053 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:55.731053 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:55.731053 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:55.731053 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:55.731053 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:55.731053 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:55.731053 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:55.731053 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:27:55.731053 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:27:55.731053 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:27:55.732385 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:27:55.732385 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:55.732385 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:55.732385 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:55.732385 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:55.732385 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:55.732385 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:55.732385 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:55.732385 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:55.732385 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:55.732385 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:55.732385 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:55.732385 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:55.732385 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:55.732385 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:55.732385 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:55.732385 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:55.733333 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:27:55.733333 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:27:55.733333 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:27:55.733333 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:27:55.733333 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:27:55.733333 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:27:55.733333 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:55.733333 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:55.738009 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 393/776] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:27:55.748243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d29526-aab5-409b-990b-3e7bee158145 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:55.822843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdfa79-dcea-40fe-8fb4-644e12dd7c09 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:55.861865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451d0e4-47fc-4e2b-8cb6-2551a6cef88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:55.862730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451d0e4-47fc-4e2b-8cb6-2551a6cef88c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:55.863039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451d0e4-47fc-4e2b-8cb6-2551a6cef88c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:55.863686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451d0e4-47fc-4e2b-8cb6-2551a6cef88c None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:55.864621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451d0e4-47fc-4e2b-8cb6-2551a6cef88c None admin] RBAC: Adding query filter params (name=network) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:55.864940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451d0e4-47fc-4e2b-8cb6-2551a6cef88c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:55.866191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d29526-aab5-409b-990b-3e7bee158145 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:55.866355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451d0e4-47fc-4e2b-8cb6-2551a6cef88c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:55.872313 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 384/777] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Sep 30 09:27:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:55.873152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451d0e4-47fc-4e2b-8cb6-2551a6cef88c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:55.904741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fdf70-09b5-46b6-a270-89115e68aea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:55.905758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fdf70-09b5-46b6-a270-89115e68aea0 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:55.906239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fdf70-09b5-46b6-a270-89115e68aea0 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:55.906699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fdf70-09b5-46b6-a270-89115e68aea0 None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:55.907579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27fdf70-09b5-46b6-a270-89115e68aea0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:55.908172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27fdf70-09b5-46b6-a270-89115e68aea0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:55.909904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27fdf70-09b5-46b6-a270-89115e68aea0 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:55.926274 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 394/778] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:27:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:55.932654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528fb9f-8643-44e6-a63c-309f1a47d6bd None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:55.932942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528fb9f-8643-44e6-a63c-309f1a47d6bd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:55.933214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528fb9f-8643-44e6-a63c-309f1a47d6bd None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:55.934567 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 395/779] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:55.935123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528fb9f-8643-44e6-a63c-309f1a47d6bd None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:55.964211 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:55.982456 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:55.988680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451d0e4-47fc-4e2b-8cb6-2551a6cef88c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:56.027471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfac6b-7188-4156-968e-b34de6c3dea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:56.028499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfac6b-7188-4156-968e-b34de6c3dea7 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:56.028807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfac6b-7188-4156-968e-b34de6c3dea7 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:56.029231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfac6b-7188-4156-968e-b34de6c3dea7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:56.042341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfac6b-7188-4156-968e-b34de6c3dea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:56.048488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-b0dfac6b-7188-4156-968e-b34de6c3dea7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:56.048488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:56.048488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:56.048488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:56.048488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:56.048488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:56.048488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:56.048488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:56.048488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:56.048488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:56.048488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:56.048488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:56.048488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:56.048488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:56.048488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:56.048488 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:56.049523 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:56.049523 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:56.049523 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:56.049523 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:56.049523 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:56.049523 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:56.049523 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:56.049523 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:56.049523 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:56.049523 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:56.049523 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:56.049523 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:56.049523 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:56.049523 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:56.049523 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:56.049523 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:56.050375 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:56.050375 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:56.050375 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:56.050375 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:56.050375 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:56.050375 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:56.050375 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:56.050375 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:56.050375 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:56.050375 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:56.050375 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:56.050375 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:56.050375 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 385/780] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:27:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:56.050375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfac6b-7188-4156-968e-b34de6c3dea7 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:56.058275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528fb9f-8643-44e6-a63c-309f1a47d6bd None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:56.095423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895a1b9-5b45-46b9-b94e-1f54dce87c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:56.096034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895a1b9-5b45-46b9-b94e-1f54dce87c05 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:56.096622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895a1b9-5b45-46b9-b94e-1f54dce87c05 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:56.096900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895a1b9-5b45-46b9-b94e-1f54dce87c05 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:56.097529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895a1b9-5b45-46b9-b94e-1f54dce87c05 None admin] RBAC: Adding query filter params (type=network) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:56.097823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895a1b9-5b45-46b9-b94e-1f54dce87c05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:56.099166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895a1b9-5b45-46b9-b94e-1f54dce87c05 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:56.106175 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 396/781] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Sep 30 09:27:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:56.107365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729f433-9479-4c54-9f65-7fcf0dc57221 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:56.107645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729f433-9479-4c54-9f65-7fcf0dc57221 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:56.107952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729f433-9479-4c54-9f65-7fcf0dc57221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:56.125658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1729f433-9479-4c54-9f65-7fcf0dc57221 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:56.126834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1729f433-9479-4c54-9f65-7fcf0dc57221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:56.162570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfac6b-7188-4156-968e-b34de6c3dea7 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:56.194550 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 397/782] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:27:56.195381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729f433-9479-4c54-9f65-7fcf0dc57221 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:56.205562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9229e83-5fa4-4508-b2c9-7aabb37fc988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:56.206310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9229e83-5fa4-4508-b2c9-7aabb37fc988 None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:56.206659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9229e83-5fa4-4508-b2c9-7aabb37fc988 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:56.207251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9229e83-5fa4-4508-b2c9-7aabb37fc988 None admin] PATH_INFO: `/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/aa607111024540d1a09b01dfd1e5e8cd/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:56.209276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9229e83-5fa4-4508-b2c9-7aabb37fc988 None admin] RBAC: Authorizing `identity:create_grant(project_id=1fbc72b5e3b84c8fb74d8d4952a26e76, user_id=aa607111024540d1a09b01dfd1e5e8cd, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:56.210764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9229e83-5fa4-4508-b2c9-7aabb37fc988 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:56.214374 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:56.236790 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 386/783] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:27:56 2022] PUT /identity/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/aa607111024540d1a09b01dfd1e5e8cd/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:27:56.238810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9229e83-5fa4-4508-b2c9-7aabb37fc988 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:56.253060 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:56.387150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729f433-9479-4c54-9f65-7fcf0dc57221 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:56.428986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1012e-fdce-46c2-8b03-9bc5a09ce585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:56.429961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1012e-fdce-46c2-8b03-9bc5a09ce585 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:56.430628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1012e-fdce-46c2-8b03-9bc5a09ce585 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:56.431127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1012e-fdce-46c2-8b03-9bc5a09ce585 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:56.432002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1012e-fdce-46c2-8b03-9bc5a09ce585 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:56.432503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1012e-fdce-46c2-8b03-9bc5a09ce585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:56.434170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1012e-fdce-46c2-8b03-9bc5a09ce585 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:56.447389 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 398/784] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:56.451634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9229e83-5fa4-4508-b2c9-7aabb37fc988 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:56.452776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1012e-fdce-46c2-8b03-9bc5a09ce585 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:56.486201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757eebee-9cd8-41e4-a5af-d8eee829fe21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:56.487126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757eebee-9cd8-41e4-a5af-d8eee829fe21 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:56.487126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757eebee-9cd8-41e4-a5af-d8eee829fe21 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:56.487402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757eebee-9cd8-41e4-a5af-d8eee829fe21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:56.488089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757eebee-9cd8-41e4-a5af-d8eee829fe21 None admin] RBAC: Adding query filter params (interface=public, service_id=df739eb8ab8e47998c132e0a777a2c62, region_id=RegionOne) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:56.488403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757eebee-9cd8-41e4-a5af-d8eee829fe21 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:56.489783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757eebee-9cd8-41e4-a5af-d8eee829fe21 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:56.495741 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 387/785] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Sep 30 09:27:56 2022] GET /identity/v3/endpoints?service_id=df739eb8ab8e47998c132e0a777a2c62&interface=public®ion_id=RegionOne => generated 194 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:56.501160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757eebee-9cd8-41e4-a5af-d8eee829fe21 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:56.568627 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:56.606763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757eebee-9cd8-41e4-a5af-d8eee829fe21 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:56.623602 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:56.630651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1012e-fdce-46c2-8b03-9bc5a09ce585 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:56.641782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcedfa-9874-44b5-a409-ae400c5cf856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:56.642514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcedfa-9874-44b5-a409-ae400c5cf856 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:56.642896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcedfa-9874-44b5-a409-ae400c5cf856 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:56.643233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcedfa-9874-44b5-a409-ae400c5cf856 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:56.643900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcedfa-9874-44b5-a409-ae400c5cf856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:56.645338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcedfa-9874-44b5-a409-ae400c5cf856 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:56.651372 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 388/786] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Sep 30 09:27:56 2022] GET /identity/v3/services => generated 772 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:27:56.656829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcedfa-9874-44b5-a409-ae400c5cf856 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:56.685114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa1730-c4b7-4cb0-89c7-101a97d3392d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:56.686147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa1730-c4b7-4cb0-89c7-101a97d3392d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:56.686605 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa1730-c4b7-4cb0-89c7-101a97d3392d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:56.687075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa1730-c4b7-4cb0-89c7-101a97d3392d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:56.709168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa1730-c4b7-4cb0-89c7-101a97d3392d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:56.711047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa1730-c4b7-4cb0-89c7-101a97d3392d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:56.728391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-85fa1730-c4b7-4cb0-89c7-101a97d3392d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:56.728391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:56.728391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:56.728391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:56.728391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:56.728391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:56.728391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:56.728391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:56.728391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:56.728391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:56.728391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:56.728391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:56.728391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:56.728391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:56.728391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:56.728391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:56.729434 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:56.729434 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:56.729434 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:56.729434 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:56.729434 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:56.729434 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:56.729434 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:56.729434 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:56.729434 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:56.729434 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:56.729434 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:56.729434 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:56.729434 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:56.729434 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:56.729434 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:56.729434 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:56.729434 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:56.730326 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:56.730326 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:56.730326 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:56.736700 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 399/787] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:56.739035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa1730-c4b7-4cb0-89c7-101a97d3392d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:56.769062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcedfa-9874-44b5-a409-ae400c5cf856 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:56.795995 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:56.808749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90274457-dc07-4073-9fe1-c797283ca821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:56.809544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90274457-dc07-4073-9fe1-c797283ca821 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:56.809923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90274457-dc07-4073-9fe1-c797283ca821 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:56.810289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90274457-dc07-4073-9fe1-c797283ca821 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:56.823417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90274457-dc07-4073-9fe1-c797283ca821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:56.828586 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-90274457-dc07-4073-9fe1-c797283ca821 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:56.828586 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:56.828586 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:56.828586 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:56.828586 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:56.828586 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:56.828586 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:56.828586 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:56.828586 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:56.828586 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:56.828586 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:56.828586 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:56.828586 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:56.828586 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:56.828586 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:56.828586 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:56.829755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:56.829755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:56.829755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:56.829755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:56.829755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:56.829755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:56.829755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:56.829755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:56.829755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:56.829755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:56.829755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:56.829755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:56.829755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:56.829755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:56.829755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:56.829755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:56.830816 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:56.830816 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:56.830816 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:56.830816 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:56.830816 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:56.830816 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:56.830816 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:56.830816 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:56.830816 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:56.830816 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:56.830816 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:27:56.830816 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:56.833096 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 389/788] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:27:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:56.843547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90274457-dc07-4073-9fe1-c797283ca821 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:56.935925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa1730-c4b7-4cb0-89c7-101a97d3392d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:56.978505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62e436-ff89-422a-804c-27b6b7b3d6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:56.979228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62e436-ff89-422a-804c-27b6b7b3d6af None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:56.979510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62e436-ff89-422a-804c-27b6b7b3d6af None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:56.979782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62e436-ff89-422a-804c-27b6b7b3d6af None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:56.980438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62e436-ff89-422a-804c-27b6b7b3d6af None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:56.980775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62e436-ff89-422a-804c-27b6b7b3d6af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:56.981783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90274457-dc07-4073-9fe1-c797283ca821 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:56.982174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62e436-ff89-422a-804c-27b6b7b3d6af None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:56.996925 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 400/789] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:57.002203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62e436-ff89-422a-804c-27b6b7b3d6af None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:57.014185 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:57.019736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd34ffd-7b29-41eb-977a-a199c6ea50db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:57.020341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd34ffd-7b29-41eb-977a-a199c6ea50db None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:57.020636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd34ffd-7b29-41eb-977a-a199c6ea50db None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:57.020910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd34ffd-7b29-41eb-977a-a199c6ea50db None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:57.021573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd34ffd-7b29-41eb-977a-a199c6ea50db None admin] RBAC: Adding query filter params (name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:57.021869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd34ffd-7b29-41eb-977a-a199c6ea50db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:57.023216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd34ffd-7b29-41eb-977a-a199c6ea50db None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:57.032163 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 390/790] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Sep 30 09:27:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:57.038162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd34ffd-7b29-41eb-977a-a199c6ea50db None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:57.102854 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:57.115708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62e436-ff89-422a-804c-27b6b7b3d6af None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:57.151982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a7824-2e43-4e75-bcb6-60b54db46a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:57.152825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a7824-2e43-4e75-bcb6-60b54db46a94 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:57.153148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a7824-2e43-4e75-bcb6-60b54db46a94 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:57.153420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a7824-2e43-4e75-bcb6-60b54db46a94 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:57.160840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a7824-2e43-4e75-bcb6-60b54db46a94 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:57.162459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a7824-2e43-4e75-bcb6-60b54db46a94 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:57.167677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd34ffd-7b29-41eb-977a-a199c6ea50db None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:57.175317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-8b7a7824-2e43-4e75-bcb6-60b54db46a94 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:27:57.175317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:57.175317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:57.175317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:57.175317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:57.175317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:57.175317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:57.175317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:57.175317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:57.175317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:57.175317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:57.175317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:57.175317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:27:57.175317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:27:57.175317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:27:57.175317 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:27:57.176274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:57.176274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:57.176274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:27:57.176274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:57.176274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:27:57.176274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:57.176274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:57.176274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:57.176274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:57.176274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:57.176274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:57.176274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:57.176274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:57.176274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:57.176274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:57.176274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:57.176274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:57.176274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:57.177235 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:57.177235 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:57.177235 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:27:57.177235 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:27:57.177235 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:27:57.177235 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:27:57.177235 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:27:57.177235 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:27:57.177235 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:27:57.177235 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:57.181419 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 401/791] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:27:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:57.182730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a8488-9a9e-440c-8c01-468f6792d404 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:57.183008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a8488-9a9e-440c-8c01-468f6792d404 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:57.183272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a8488-9a9e-440c-8c01-468f6792d404 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:57.188780 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 402/792] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:57.189544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a8488-9a9e-440c-8c01-468f6792d404 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:57.213237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3608e-5183-45c6-ba24-e2123d9b3747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:57.214486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3608e-5183-45c6-ba24-e2123d9b3747 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:57.215096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3608e-5183-45c6-ba24-e2123d9b3747 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:57.215574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3608e-5183-45c6-ba24-e2123d9b3747 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:57.230746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3608e-5183-45c6-ba24-e2123d9b3747 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:57.232931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3608e-5183-45c6-ba24-e2123d9b3747 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:57.252527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-2bf3608e-5183-45c6-ba24-e2123d9b3747 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:57.252527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:57.252527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:57.252527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:57.252527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:57.252527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:57.252527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:57.252527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:57.252527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:57.252527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:57.252527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:57.252527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:57.252527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:57.252527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:57.252527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:57.252527 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:57.253511 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:57.253511 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:57.253511 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:57.253511 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:57.253511 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:57.253511 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:57.253511 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:57.253511 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:57.253511 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:57.253511 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:57.253511 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:57.253511 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:57.253511 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:57.253511 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:57.253511 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:57.253511 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:57.253511 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:57.254399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:57.254399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:57.254399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:57.256834 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 391/793] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:57.258346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ac51c-cd0d-450c-9858-ab12f2ff9cf4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:57.258774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ac51c-cd0d-450c-9858-ab12f2ff9cf4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:57.259181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ac51c-cd0d-450c-9858-ab12f2ff9cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:57.261023 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:57.282951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6a1ac51c-cd0d-450c-9858-ab12f2ff9cf4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:57.284371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6a1ac51c-cd0d-450c-9858-ab12f2ff9cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:57.299955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a8488-9a9e-440c-8c01-468f6792d404 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:57.346050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715513c2-9434-4ebb-b418-8979d7367c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:57.347053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715513c2-9434-4ebb-b418-8979d7367c01 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:57.347440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715513c2-9434-4ebb-b418-8979d7367c01 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:57.347806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715513c2-9434-4ebb-b418-8979d7367c01 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:57.348639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715513c2-9434-4ebb-b418-8979d7367c01 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:57.349203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715513c2-9434-4ebb-b418-8979d7367c01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:57.351302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715513c2-9434-4ebb-b418-8979d7367c01 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:57.380623 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 403/794] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Sep 30 09:27:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:57.380623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715513c2-9434-4ebb-b418-8979d7367c01 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:57.380899 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 392/795] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:27:57.380899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ac51c-cd0d-450c-9858-ab12f2ff9cf4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:57.425320 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:57.534724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ac51c-cd0d-450c-9858-ab12f2ff9cf4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:57.543323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715513c2-9434-4ebb-b418-8979d7367c01 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:57.592982 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:57.601629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc8f56-fbaa-4843-8128-23758873e37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:57.603156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc8f56-fbaa-4843-8128-23758873e37f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:57.603431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc8f56-fbaa-4843-8128-23758873e37f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:57.603701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc8f56-fbaa-4843-8128-23758873e37f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:57.606275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70a797-a640-4843-9557-0778b71eb362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:57.606876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70a797-a640-4843-9557-0778b71eb362 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:57.607151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70a797-a640-4843-9557-0778b71eb362 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:57.607416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70a797-a640-4843-9557-0778b71eb362 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:57.608053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d70a797-a640-4843-9557-0778b71eb362 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:57.608352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d70a797-a640-4843-9557-0778b71eb362 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:57.609722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d70a797-a640-4843-9557-0778b71eb362 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:57.628849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc8f56-fbaa-4843-8128-23758873e37f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:57.630294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc8f56-fbaa-4843-8128-23758873e37f None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:57.635249 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 404/796] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:57.640641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70a797-a640-4843-9557-0778b71eb362 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:57.655835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-6dbc8f56-fbaa-4843-8128-23758873e37f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:57.655835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:57.655835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:57.655835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:57.655835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:57.655835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:57.655835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:57.655835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:57.655835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:57.655835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:57.655835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:57.655835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:57.655835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:57.655835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:57.655835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:57.655835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:57.656875 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:57.656875 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:57.656875 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:57.656875 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:57.656875 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:57.656875 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:57.656875 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:57.656875 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:57.656875 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:57.656875 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:57.656875 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:57.656875 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:57.656875 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:57.656875 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:57.656875 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:57.656875 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:57.656875 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:57.657762 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:57.657762 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:57.657762 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:57.659258 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 393/797] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:57.666121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc8f56-fbaa-4843-8128-23758873e37f None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:57.773014 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:57.782682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70a797-a640-4843-9557-0778b71eb362 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:57.800058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc8f56-fbaa-4843-8128-23758873e37f None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:57.831980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c108dc2-c037-4c67-94af-a7af020b01f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:57.833034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c108dc2-c037-4c67-94af-a7af020b01f8 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:57.833507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c108dc2-c037-4c67-94af-a7af020b01f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:57.834003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c108dc2-c037-4c67-94af-a7af020b01f8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:57.835094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b60dc6-cf46-4522-942d-ec0634993a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:57.835701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b60dc6-cf46-4522-942d-ec0634993a9b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:57.835978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b60dc6-cf46-4522-942d-ec0634993a9b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:57.836281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b60dc6-cf46-4522-942d-ec0634993a9b None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:57.837652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b60dc6-cf46-4522-942d-ec0634993a9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:57.837944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b60dc6-cf46-4522-942d-ec0634993a9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:57.839611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b60dc6-cf46-4522-942d-ec0634993a9b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:57.845341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c108dc2-c037-4c67-94af-a7af020b01f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:57.847546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c108dc2-c037-4c67-94af-a7af020b01f8 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:57.851423 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 394/798] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:57.852135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b60dc6-cf46-4522-942d-ec0634993a9b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:57.861718 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-6c108dc2-c037-4c67-94af-a7af020b01f8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:27:57.861718 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:57.861718 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:57.861718 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:57.861718 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:57.861718 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:57.861718 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:57.861718 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:57.861718 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:57.861718 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:57.861718 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:57.861718 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:57.861718 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:27:57.861718 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:27:57.861718 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:27:57.861718 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:27:57.862680 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:57.862680 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:57.862680 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:27:57.862680 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:57.862680 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:27:57.862680 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:27:57.862680 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:57.862680 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:57.862680 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:57.862680 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:57.862680 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:57.862680 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:57.862680 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:57.862680 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:57.862680 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:57.862680 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:57.862680 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:57.862680 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:57.863619 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:57.863619 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:57.863619 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:27:57.863619 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:27:57.863619 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:27:57.863619 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:27:57.863619 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:27:57.863619 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:27:57.863619 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:27:57.863619 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:57.863619 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 405/799] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Sep 30 09:27:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:27:57.868563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c108dc2-c037-4c67-94af-a7af020b01f8 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:57.934133 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:57.982550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b60dc6-cf46-4522-942d-ec0634993a9b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:57.991706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c108dc2-c037-4c67-94af-a7af020b01f8 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:58.023648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0dae0-4699-4089-a041-fd5c2b3a65e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:58.025531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0dae0-4699-4089-a041-fd5c2b3a65e4 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:58.025818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0dae0-4699-4089-a041-fd5c2b3a65e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:58.026090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0dae0-4699-4089-a041-fd5c2b3a65e4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:58.026680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0dae0-4699-4089-a041-fd5c2b3a65e4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:58.028051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0dae0-4699-4089-a041-fd5c2b3a65e4 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:58.037348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52d709-72ef-4871-a47b-6c1a37c42273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:58.038393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52d709-72ef-4871-a47b-6c1a37c42273 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:58.038866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52d709-72ef-4871-a47b-6c1a37c42273 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:58.038985 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-46a0dae0-4699-4089-a041-fd5c2b3a65e4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:27:58.038985 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:58.038985 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:27:58.038985 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:27:58.038985 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:27:58.038985 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:27:58.038985 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:27:58.038985 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:27:58.038985 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:27:58.038985 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:58.038985 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:27:58.038985 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:58.038985 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:58.038985 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:58.038985 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:58.038985 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:58.038985 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:58.040499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:58.040499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:58.040499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:58.040499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:58.040499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:58.040499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:58.040499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:27:58.040499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:27:58.040499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:27:58.040499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:27:58.040499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:58.040499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:58.040499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:58.040499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:58.040499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:58.040499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:58.041355 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:58.041355 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:58.041355 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:58.041355 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:58.041355 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:58.041355 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:58.041355 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:58.041355 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:58.041355 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:58.041355 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:58.041355 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:27:58.041355 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:27:58.041355 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 09:27:58.041355 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:27:58.042925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52d709-72ef-4871-a47b-6c1a37c42273 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:58.045544 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 395/800] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Sep 30 09:27:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:58.046421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0dae0-4699-4089-a041-fd5c2b3a65e4 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:58.051010 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:58.053938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52d709-72ef-4871-a47b-6c1a37c42273 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:58.055915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52d709-72ef-4871-a47b-6c1a37c42273 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:58.072890 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-8b52d709-72ef-4871-a47b-6c1a37c42273 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:58.072890 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:58.072890 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:58.072890 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:58.072890 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:58.072890 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:58.072890 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:58.072890 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:58.072890 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:58.072890 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:58.072890 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:58.072890 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:58.072890 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:27:58.072890 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:27:58.072890 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:27:58.073992 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:27:58.073992 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:58.073992 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:58.073992 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:58.073992 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:58.073992 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:58.073992 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:58.073992 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:58.073992 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:58.073992 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:58.073992 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:58.073992 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:58.073992 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:58.073992 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:58.073992 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:58.073992 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:58.073992 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:58.075061 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:27:58.075061 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:27:58.075061 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:27:58.075061 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:27:58.075061 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:27:58.075061 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:27:58.075061 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:58.075061 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:58.076852 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 406/801] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:58.077641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52d709-72ef-4871-a47b-6c1a37c42273 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:58.163921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0dae0-4699-4089-a041-fd5c2b3a65e4 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:58.193370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52d709-72ef-4871-a47b-6c1a37c42273 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:58.199801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17129203-fc8c-4812-8d11-1085ac87cfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:58.200487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17129203-fc8c-4812-8d11-1085ac87cfb8 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:58.200863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17129203-fc8c-4812-8d11-1085ac87cfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:58.201257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17129203-fc8c-4812-8d11-1085ac87cfb8 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:58.201501 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:58.202567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17129203-fc8c-4812-8d11-1085ac87cfb8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:58.202949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17129203-fc8c-4812-8d11-1085ac87cfb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:58.204572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17129203-fc8c-4812-8d11-1085ac87cfb8 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:58.225244 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 396/802] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Sep 30 09:27:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:58.226283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17129203-fc8c-4812-8d11-1085ac87cfb8 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:58.232432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2efb8e-1f02-4330-9691-b489261ed7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:58.233198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2efb8e-1f02-4330-9691-b489261ed7c9 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:58.233538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2efb8e-1f02-4330-9691-b489261ed7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:58.233869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2efb8e-1f02-4330-9691-b489261ed7c9 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:58.234563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2efb8e-1f02-4330-9691-b489261ed7c9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:58.234944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2efb8e-1f02-4330-9691-b489261ed7c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:58.236473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2efb8e-1f02-4330-9691-b489261ed7c9 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:58.241688 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 407/803] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Sep 30 09:27:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:58.242515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2efb8e-1f02-4330-9691-b489261ed7c9 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:58.299118 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:58.344306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17129203-fc8c-4812-8d11-1085ac87cfb8 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:58.350133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2efb8e-1f02-4330-9691-b489261ed7c9 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:58.381613 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254a3d5-9d87-4652-b18b-301b4476bc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:58.382457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254a3d5-9d87-4652-b18b-301b4476bc81 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:58.382852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254a3d5-9d87-4652-b18b-301b4476bc81 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:58.383727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254a3d5-9d87-4652-b18b-301b4476bc81 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:58.384511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254a3d5-9d87-4652-b18b-301b4476bc81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:58.384952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254a3d5-9d87-4652-b18b-301b4476bc81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:58.386443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254a3d5-9d87-4652-b18b-301b4476bc81 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:58.388494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21d4fe-fac7-47c4-b242-d6f65ebe9c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:58.389508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21d4fe-fac7-47c4-b242-d6f65ebe9c56 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:58.389924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21d4fe-fac7-47c4-b242-d6f65ebe9c56 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:58.390332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21d4fe-fac7-47c4-b242-d6f65ebe9c56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:58.401626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21d4fe-fac7-47c4-b242-d6f65ebe9c56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:58.403299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21d4fe-fac7-47c4-b242-d6f65ebe9c56 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:58.404931 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 397/804] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:27:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:58.406061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254a3d5-9d87-4652-b18b-301b4476bc81 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:58.419708 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-1f21d4fe-fac7-47c4-b242-d6f65ebe9c56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:58.419708 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:58.419708 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:58.419708 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:58.419708 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:58.419708 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:58.419708 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:58.419708 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:58.419708 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:58.419708 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:58.419708 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:58.419708 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:58.419708 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:58.419708 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:58.419708 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:58.419708 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:58.420745 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:58.420745 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:58.420745 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:58.420745 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:58.420745 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:58.420745 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:58.420745 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:58.420745 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:58.420745 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:58.420745 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:58.420745 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:58.420745 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:58.420745 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:58.420745 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:58.420745 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:58.420745 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:58.420745 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:58.421742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:58.421742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:58.421742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:58.423977 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 408/805] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:58.425105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21d4fe-fac7-47c4-b242-d6f65ebe9c56 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:58.453341 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:58.524124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254a3d5-9d87-4652-b18b-301b4476bc81 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:58.535175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21d4fe-fac7-47c4-b242-d6f65ebe9c56 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:58.549042 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:58.561851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8a4ac-50d9-458b-9363-7a28bf69f593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:58.562548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8a4ac-50d9-458b-9363-7a28bf69f593 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:58.563035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8a4ac-50d9-458b-9363-7a28bf69f593 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:58.563415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8a4ac-50d9-458b-9363-7a28bf69f593 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:58.564301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8a4ac-50d9-458b-9363-7a28bf69f593 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:58.564566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8a4ac-50d9-458b-9363-7a28bf69f593 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:58.566039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8a4ac-50d9-458b-9363-7a28bf69f593 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:58.577005 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 398/806] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Sep 30 09:27:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:58.577386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d470b-308c-428b-ac24-63e179ede95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:58.578213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8a4ac-50d9-458b-9363-7a28bf69f593 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:58.578476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d470b-308c-428b-ac24-63e179ede95d None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:58.578921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d470b-308c-428b-ac24-63e179ede95d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:58.579362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d470b-308c-428b-ac24-63e179ede95d None admin] PATH_INFO: `/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/963c491a2d2e409b8b45e4fb6aff41c3/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:58.581681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d470b-308c-428b-ac24-63e179ede95d None admin] RBAC: Authorizing `identity:create_grant(project_id=1fbc72b5e3b84c8fb74d8d4952a26e76, user_id=963c491a2d2e409b8b45e4fb6aff41c3, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:58.583884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d470b-308c-428b-ac24-63e179ede95d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:58.603661 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 409/807] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:27:58 2022] PUT /identity/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/963c491a2d2e409b8b45e4fb6aff41c3/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:27:58.604909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d470b-308c-428b-ac24-63e179ede95d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:58.714115 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:58.741172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d470b-308c-428b-ac24-63e179ede95d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:58.760244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8a4ac-50d9-458b-9363-7a28bf69f593 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:58.783454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8d938-2198-408e-b187-c8a8f3570ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:58.784139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8d938-2198-408e-b187-c8a8f3570ca9 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:58.784343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8d938-2198-408e-b187-c8a8f3570ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:58.784632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8d938-2198-408e-b187-c8a8f3570ca9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:58.786007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8d938-2198-408e-b187-c8a8f3570ca9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:58.787776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8d938-2198-408e-b187-c8a8f3570ca9 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:58.809603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57001682-6c36-40f8-950f-bb2b9b410596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:58.810475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57001682-6c36-40f8-950f-bb2b9b410596 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:58.810587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57001682-6c36-40f8-950f-bb2b9b410596 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:58.810791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57001682-6c36-40f8-950f-bb2b9b410596 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:58.811461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57001682-6c36-40f8-950f-bb2b9b410596 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:58.811782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57001682-6c36-40f8-950f-bb2b9b410596 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:58.813269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57001682-6c36-40f8-950f-bb2b9b410596 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:58.828481 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 399/809] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:58.828961 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 410/809] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:27:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:27:58.829828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff7708-4989-4c39-a083-b26868a59a94 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:58.830120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff7708-4989-4c39-a083-b26868a59a94 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:58.830428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff7708-4989-4c39-a083-b26868a59a94 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:58.834783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8d938-2198-408e-b187-c8a8f3570ca9 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:58.836895 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 400/810] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:58.838359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2f135-4671-4cbd-9f6d-4404c2d551e3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:58.838644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2f135-4671-4cbd-9f6d-4404c2d551e3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:58.838920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2f135-4671-4cbd-9f6d-4404c2d551e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:58.866533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-eed2f135-4671-4cbd-9f6d-4404c2d551e3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:58.869260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eed2f135-4671-4cbd-9f6d-4404c2d551e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:58.925030 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:58.962561 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 401/811] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:27:59.005797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8d938-2198-408e-b187-c8a8f3570ca9 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:59.063826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baae65-45b5-4e11-9e94-d93614759eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:59.064461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baae65-45b5-4e11-9e94-d93614759eb2 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:59.064765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baae65-45b5-4e11-9e94-d93614759eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:59.065039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baae65-45b5-4e11-9e94-d93614759eb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:59.077259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baae65-45b5-4e11-9e94-d93614759eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:59.078717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baae65-45b5-4e11-9e94-d93614759eb2 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:59.080801 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:59.094421 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-c4baae65-45b5-4e11-9e94-d93614759eb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:59.094421 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:59.094421 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:59.094421 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:59.094421 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:59.094421 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:59.094421 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:59.094421 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:59.094421 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:59.094421 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:59.094421 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:59.094421 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:59.094421 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:27:59.094421 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:27:59.094421 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:27:59.095563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:27:59.095563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:59.095563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:59.095563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:59.095563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:59.095563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:59.095563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:59.095563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:59.095563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:59.095563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:59.095563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:59.095563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:59.095563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:59.095563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:59.095563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:59.095563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:59.095563 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:59.096738 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:27:59.096738 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:27:59.096738 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:27:59.096738 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:27:59.096738 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:27:59.096738 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:27:59.096738 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:27:59.096738 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:59.099155 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 411/812] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:59.109689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2f135-4671-4cbd-9f6d-4404c2d551e3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:59.221869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2f135-4671-4cbd-9f6d-4404c2d551e3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:59.261468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37e503-0c6e-49b2-bb2b-d8c2c83aefc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:59.262088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37e503-0c6e-49b2-bb2b-d8c2c83aefc9 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:59.262367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37e503-0c6e-49b2-bb2b-d8c2c83aefc9 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:59.262639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37e503-0c6e-49b2-bb2b-d8c2c83aefc9 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:59.263334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37e503-0c6e-49b2-bb2b-d8c2c83aefc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:59.263637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37e503-0c6e-49b2-bb2b-d8c2c83aefc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:59.265089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37e503-0c6e-49b2-bb2b-d8c2c83aefc9 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:59.267605 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7018be-e972-45a3-b154-d9f1dafda1f1 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:59.267888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7018be-e972-45a3-b154-d9f1dafda1f1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:59.268161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7018be-e972-45a3-b154-d9f1dafda1f1 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:59.269694 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 412/813] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:27:59.277937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef92a5c-d50f-4276-8a89-03463245f6e3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:59.278216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef92a5c-d50f-4276-8a89-03463245f6e3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:59.278531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef92a5c-d50f-4276-8a89-03463245f6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:59.284672 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 402/814] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:27:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:59.286290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37e503-0c6e-49b2-bb2b-d8c2c83aefc9 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:59.311848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4ef92a5c-d50f-4276-8a89-03463245f6e3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:27:59.314982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4ef92a5c-d50f-4276-8a89-03463245f6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:27:59.404627 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 413/815] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:27:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:27:59.404627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef92a5c-d50f-4276-8a89-03463245f6e3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:59.493845 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:59.519770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef92a5c-d50f-4276-8a89-03463245f6e3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:59.552293 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:59.565672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e721a-6477-4f49-9b6e-c25207cc90f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:59.566742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e721a-6477-4f49-9b6e-c25207cc90f1 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:59.567269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e721a-6477-4f49-9b6e-c25207cc90f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:59.567691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e721a-6477-4f49-9b6e-c25207cc90f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:59.581151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e721a-6477-4f49-9b6e-c25207cc90f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:27:59.586860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-030e721a-6477-4f49-9b6e-c25207cc90f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:59.586860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:59.586860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:59.586860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:59.586860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:59.586860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:59.586860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:59.586860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:59.586860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:59.586860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:59.586860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:59.586860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:59.586860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:27:59.586860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:27:59.586860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:27:59.586860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:27:59.587896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:27:59.587896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:27:59.587896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:27:59.587896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:27:59.587896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:59.587896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:59.587896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:59.587896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:59.587896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:59.587896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:59.587896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:59.587896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:59.587896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:59.587896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:59.587896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:59.587896 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:59.588770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:59.588770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:59.588770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:59.588770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:59.588770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:27:59.588770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:27:59.588770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:27:59.588770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:27:59.588770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:27:59.588770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:27:59.588770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:27:59.588770 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:59.591514 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 414/816] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:27:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:59.597394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e721a-6477-4f49-9b6e-c25207cc90f1 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:59.694551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37e503-0c6e-49b2-bb2b-d8c2c83aefc9 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:59.710818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e721a-6477-4f49-9b6e-c25207cc90f1 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:59.751676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323b240-1e58-4149-91ee-432ce48dd1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:59.752522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323b240-1e58-4149-91ee-432ce48dd1a2 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:59.753100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323b240-1e58-4149-91ee-432ce48dd1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:59.753515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323b240-1e58-4149-91ee-432ce48dd1a2 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:59.754329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323b240-1e58-4149-91ee-432ce48dd1a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:27:59.754788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323b240-1e58-4149-91ee-432ce48dd1a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:59.756406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323b240-1e58-4149-91ee-432ce48dd1a2 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:59.766932 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 415/817] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:27:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:27:59.772666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323b240-1e58-4149-91ee-432ce48dd1a2 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:59.803260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b826164-000c-4539-bb3f-c20311f3d9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:59.803945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b826164-000c-4539-bb3f-c20311f3d9be None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:59.804316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b826164-000c-4539-bb3f-c20311f3d9be None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:59.804740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b826164-000c-4539-bb3f-c20311f3d9be None admin] PATH_INFO: `/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/9bdab836a64d43ea842629d29b6f8d47/roles/4089b59a020f44b98fad2a34b61fd573` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:59.827833 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:59.829253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b826164-000c-4539-bb3f-c20311f3d9be None admin] RBAC: Authorizing `identity:create_grant(project_id=1fbc72b5e3b84c8fb74d8d4952a26e76, user_id=9bdab836a64d43ea842629d29b6f8d47, role_id=4089b59a020f44b98fad2a34b61fd573)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:59.832294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b826164-000c-4539-bb3f-c20311f3d9be None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:59.854157 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 403/818] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:27:59 2022] PUT /identity/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/9bdab836a64d43ea842629d29b6f8d47/roles/4089b59a020f44b98fad2a34b61fd573 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:27:59.855723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b826164-000c-4539-bb3f-c20311f3d9be None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:27:59.893096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323b240-1e58-4149-91ee-432ce48dd1a2 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:27:59.939145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b0a78-c4bb-4db5-819e-21cf2a63748f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:27:59.940061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b0a78-c4bb-4db5-819e-21cf2a63748f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:27:59.940564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b0a78-c4bb-4db5-819e-21cf2a63748f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:27:59.941104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b0a78-c4bb-4db5-819e-21cf2a63748f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:27:59.954341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b0a78-c4bb-4db5-819e-21cf2a63748f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:27:59.956228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b0a78-c4bb-4db5-819e-21cf2a63748f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:27:59.973109 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-858b0a78-c4bb-4db5-819e-21cf2a63748f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:59.973109 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:27:59.973109 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:27:59.973109 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:27:59.973109 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:27:59.973109 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:27:59.973109 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:27:59.973109 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:27:59.973109 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:27:59.973109 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:27:59.973109 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:27:59.973109 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:27:59.973109 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:27:59.973109 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:27:59.973109 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:27:59.973109 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:27:59.974146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:27:59.974146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:27:59.974146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:27:59.974146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:27:59.974146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:27:59.974146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:27:59.974146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:27:59.974146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:27:59.974146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:27:59.974146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:27:59.974146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:27:59.974146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:27:59.974146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:27:59.974146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:27:59.974146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:27:59.974146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:27:59.974146 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:27:59.975070 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:27:59.975070 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:27:59.975070 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:27:59.976857 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 416/819] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:27:59.985683 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:27:59.994326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b0a78-c4bb-4db5-819e-21cf2a63748f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:00.015994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b826164-000c-4539-bb3f-c20311f3d9be None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:00.069760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b033c77-93ad-43bb-975c-fb58401d770c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:00.070464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b033c77-93ad-43bb-975c-fb58401d770c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:00.071298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b033c77-93ad-43bb-975c-fb58401d770c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:00.071566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b033c77-93ad-43bb-975c-fb58401d770c None admin] PATH_INFO: `/v3/services/network` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:00.072271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b033c77-93ad-43bb-975c-fb58401d770c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:00.077920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b033c77-93ad-43bb-975c-fb58401d770c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:00.096739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-4b033c77-93ad-43bb-975c-fb58401d770c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:28:00.096739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:00.096739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:28:00.096739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:28:00.096739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:28:00.096739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:28:00.096739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:28:00.096739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:00.096739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:28:00.096739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:00.096739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:28:00.096739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:00.096739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:00.096739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:00.096739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:00.096739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:00.096739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:00.097830 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:00.097830 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:00.097830 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:00.097830 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:00.097830 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:00.097830 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:00.097830 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:28:00.097830 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:28:00.097830 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:28:00.097830 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:28:00.097830 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:00.097830 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:00.097830 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:00.097830 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:00.097830 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:00.097830 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:00.099347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:00.099347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:00.099347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:00.099347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:00.099347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:00.099347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:00.099347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:00.099347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:00.099347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:00.099347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:00.099347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:28:00.099347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:00.099347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 09:28:00.099347 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:00.099347 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 404/820] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:27:59 2022] GET /identity/v3/services/network => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:00.105555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b033c77-93ad-43bb-975c-fb58401d770c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:00.189436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b0a78-c4bb-4db5-819e-21cf2a63748f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:00.192449 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:00.233161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b033c77-93ad-43bb-975c-fb58401d770c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:00.239525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327f0b8-caaf-47fe-8316-f4cb9862c3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:00.240130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327f0b8-caaf-47fe-8316-f4cb9862c3ed None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:00.240408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327f0b8-caaf-47fe-8316-f4cb9862c3ed None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:00.240711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327f0b8-caaf-47fe-8316-f4cb9862c3ed None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:00.241351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327f0b8-caaf-47fe-8316-f4cb9862c3ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:00.241650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327f0b8-caaf-47fe-8316-f4cb9862c3ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:00.244157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327f0b8-caaf-47fe-8316-f4cb9862c3ed None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:00.264427 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 417/821] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:00.265669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327f0b8-caaf-47fe-8316-f4cb9862c3ed None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:00.333386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e2286-e313-4c60-a7b8-ae7b40691f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:00.333922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e2286-e313-4c60-a7b8-ae7b40691f08 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:00.334201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e2286-e313-4c60-a7b8-ae7b40691f08 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:00.334469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e2286-e313-4c60-a7b8-ae7b40691f08 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:00.335102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e2286-e313-4c60-a7b8-ae7b40691f08 None admin] RBAC: Adding query filter params (name=network) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:00.335402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e2286-e313-4c60-a7b8-ae7b40691f08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:00.337404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e2286-e313-4c60-a7b8-ae7b40691f08 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:00.354774 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 405/822] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Sep 30 09:28:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:00.372055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e2286-e313-4c60-a7b8-ae7b40691f08 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:00.378807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327f0b8-caaf-47fe-8316-f4cb9862c3ed None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:00.404971 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:00.420051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e741636-f553-44c2-a39f-dfbea797d566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:00.420763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e741636-f553-44c2-a39f-dfbea797d566 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:00.421188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e741636-f553-44c2-a39f-dfbea797d566 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:00.421520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e741636-f553-44c2-a39f-dfbea797d566 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:00.430649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e741636-f553-44c2-a39f-dfbea797d566 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:00.432634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e741636-f553-44c2-a39f-dfbea797d566 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:00.446535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-5e741636-f553-44c2-a39f-dfbea797d566 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:28:00.446535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:00.446535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:00.446535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:00.446535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:00.446535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:00.446535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:00.446535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:00.446535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:00.446535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:00.446535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:00.446535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:00.446535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:28:00.446535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:28:00.446535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:28:00.446535 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:28:00.447455 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:00.447455 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:00.447455 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:28:00.447455 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:00.447455 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:28:00.447455 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:00.447455 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:00.447455 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:00.447455 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:00.447455 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:00.447455 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:00.447455 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:00.447455 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:00.447455 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:00.447455 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:00.447455 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:00.447455 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:00.447455 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:00.449037 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:00.449037 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:00.449037 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:28:00.449037 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:28:00.449037 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:28:00.449037 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:28:00.449037 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:28:00.449037 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:28:00.449037 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:28:00.449037 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:00.449037 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 418/823] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Sep 30 09:28:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:00.453227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e741636-f553-44c2-a39f-dfbea797d566 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:00.505263 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:00.594430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e2286-e313-4c60-a7b8-ae7b40691f08 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:00.653350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e741636-f553-44c2-a39f-dfbea797d566 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:00.665033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b9e76-8f86-404f-bea3-46e478c81a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:00.665691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b9e76-8f86-404f-bea3-46e478c81a4e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:00.665968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b9e76-8f86-404f-bea3-46e478c81a4e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:00.666237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b9e76-8f86-404f-bea3-46e478c81a4e None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:00.666869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b9e76-8f86-404f-bea3-46e478c81a4e None admin] RBAC: Adding query filter params (type=network) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:00.667169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b9e76-8f86-404f-bea3-46e478c81a4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:00.668507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b9e76-8f86-404f-bea3-46e478c81a4e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:00.680521 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 406/824] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Sep 30 09:28:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:00.687812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b9e76-8f86-404f-bea3-46e478c81a4e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:00.730165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141701a-e3de-407f-8f55-402425452ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:00.730771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141701a-e3de-407f-8f55-402425452ea5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:00.731048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141701a-e3de-407f-8f55-402425452ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:00.731314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141701a-e3de-407f-8f55-402425452ea5 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:00.732042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141701a-e3de-407f-8f55-402425452ea5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:00.732344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141701a-e3de-407f-8f55-402425452ea5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:00.733797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141701a-e3de-407f-8f55-402425452ea5 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:00.773770 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 419/825] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Sep 30 09:28:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:00.779612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141701a-e3de-407f-8f55-402425452ea5 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:00.813898 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:00.842941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b9e76-8f86-404f-bea3-46e478c81a4e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:00.881175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ccbd5-b6dd-46f6-bf04-addef9f734f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:00.882126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ccbd5-b6dd-46f6-bf04-addef9f734f0 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:00.882502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ccbd5-b6dd-46f6-bf04-addef9f734f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:00.882868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ccbd5-b6dd-46f6-bf04-addef9f734f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:00.884173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ccbd5-b6dd-46f6-bf04-addef9f734f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:00.885642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ccbd5-b6dd-46f6-bf04-addef9f734f0 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:00.909664 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 407/826] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:28:00 2022] POST /identity/v3/endpoints => generated 337 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:28:00.997945 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:01.030835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141701a-e3de-407f-8f55-402425452ea5 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:01.101813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cc866-7c16-4604-aa33-a115fcf16c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:01.102381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cc866-7c16-4604-aa33-a115fcf16c85 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:01.102662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cc866-7c16-4604-aa33-a115fcf16c85 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:01.103025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cc866-7c16-4604-aa33-a115fcf16c85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:01.176995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7cc866-7c16-4604-aa33-a115fcf16c85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:01.178368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7cc866-7c16-4604-aa33-a115fcf16c85 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:01.265135 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:01.292978 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 420/827] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:28:00 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:28:01.298333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ccbd5-b6dd-46f6-bf04-addef9f734f0 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:01.354498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a6488-0f93-4feb-9e11-48f9a48467e0 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:01.354893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a6488-0f93-4feb-9e11-48f9a48467e0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:01.355172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a6488-0f93-4feb-9e11-48f9a48467e0 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:01.356814 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 421/828] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:01.362215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae9655-cac5-44fa-b863-5c539a17aaf1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:01.362503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae9655-cac5-44fa-b863-5c539a17aaf1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:01.362783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae9655-cac5-44fa-b863-5c539a17aaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:01.387053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4dae9655-cac5-44fa-b863-5c539a17aaf1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:01.388259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4dae9655-cac5-44fa-b863-5c539a17aaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:01.436473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ccbd5-b6dd-46f6-bf04-addef9f734f0 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:01.476750 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:01.484379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e810f-efbd-4ab4-9416-f39edc7441fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:01.485168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e810f-efbd-4ab4-9416-f39edc7441fa None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:01.485441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e810f-efbd-4ab4-9416-f39edc7441fa None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:01.485710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e810f-efbd-4ab4-9416-f39edc7441fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:01.488695 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 422/829] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:01.502217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e810f-efbd-4ab4-9416-f39edc7441fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:01.503654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e810f-efbd-4ab4-9416-f39edc7441fa None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:01.519052 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-6f9e810f-efbd-4ab4-9416-f39edc7441fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:01.519052 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:01.519052 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:01.519052 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:01.519052 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:01.519052 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:01.519052 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:01.519052 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:01.519052 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:01.519052 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:01.519052 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:01.519052 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:01.519052 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:28:01.519052 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:28:01.519052 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:28:01.519052 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:28:01.521017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:01.521017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:01.521017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:01.521017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:01.521017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:01.521017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:01.521017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:01.521017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:01.521017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:01.521017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:01.521017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:01.521017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:01.521017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:01.521017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:01.521017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:01.521017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:01.521017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:28:01.522184 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:28:01.522184 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:01.522184 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:01.522184 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 408/830] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:01.529768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae9655-cac5-44fa-b863-5c539a17aaf1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:01.546700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae29ac-0f0c-44ed-aa88-b667a110bac7 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:01.546700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae29ac-0f0c-44ed-aa88-b667a110bac7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:01.546700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae29ac-0f0c-44ed-aa88-b667a110bac7 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:01.547311 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 409/831] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:28:01.552136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2728e0-64a4-4105-a0a0-796cc2c27466 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:01.552411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2728e0-64a4-4105-a0a0-796cc2c27466 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:01.552707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2728e0-64a4-4105-a0a0-796cc2c27466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:01.574887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fe2728e0-64a4-4105-a0a0-796cc2c27466 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:01.576581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fe2728e0-64a4-4105-a0a0-796cc2c27466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:01.647331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae9655-cac5-44fa-b863-5c539a17aaf1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:01.656849 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:01.662967 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 410/832] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:28:01.689683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad463c2c-d58b-4baa-bb52-42c7e5ab126b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:01.690539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad463c2c-d58b-4baa-bb52-42c7e5ab126b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:01.691028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad463c2c-d58b-4baa-bb52-42c7e5ab126b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:01.691480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad463c2c-d58b-4baa-bb52-42c7e5ab126b None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:01.692388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad463c2c-d58b-4baa-bb52-42c7e5ab126b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:01.692893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad463c2c-d58b-4baa-bb52-42c7e5ab126b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:01.694457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad463c2c-d58b-4baa-bb52-42c7e5ab126b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:01.707386 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 423/833] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:01.713698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2728e0-64a4-4105-a0a0-796cc2c27466 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:01.791084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad463c2c-d58b-4baa-bb52-42c7e5ab126b None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:01.830189 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2728e0-64a4-4105-a0a0-796cc2c27466 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:01.847650 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:01.878375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00940d17-b451-451e-ad51-b5d27ac21238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:01.879091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00940d17-b451-451e-ad51-b5d27ac21238 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:01.879373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00940d17-b451-451e-ad51-b5d27ac21238 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:01.879641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00940d17-b451-451e-ad51-b5d27ac21238 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:01.888575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00940d17-b451-451e-ad51-b5d27ac21238 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:01.890304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00940d17-b451-451e-ad51-b5d27ac21238 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:01.902673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-00940d17-b451-451e-ad51-b5d27ac21238 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:28:01.902673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:01.902673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:01.902673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:01.902673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:01.902673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:01.902673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:01.902673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:01.902673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:01.902673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:01.902673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:01.902673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:01.902673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:28:01.902673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:28:01.902673 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:28:01.903612 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:28:01.903612 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:01.903612 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:01.903612 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:01.903612 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:01.903612 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:01.903612 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:01.903612 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:01.903612 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:01.903612 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:01.903612 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:01.903612 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:01.903612 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:01.903612 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:01.903612 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:01.903612 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:01.903612 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:01.904487 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:28:01.904487 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:28:01.904487 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:28:01.904487 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:28:01.904487 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:28:01.904487 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:28:01.904487 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:28:01.904487 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:01.907417 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 411/834] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:28:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:01.910136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00940d17-b451-451e-ad51-b5d27ac21238 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:01.933702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad463c2c-d58b-4baa-bb52-42c7e5ab126b None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:01.974619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f539cbf-122d-414b-9e04-659d863e57cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:01.975158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f539cbf-122d-414b-9e04-659d863e57cf None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:01.975453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f539cbf-122d-414b-9e04-659d863e57cf None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:01.975691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f539cbf-122d-414b-9e04-659d863e57cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:01.986005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f539cbf-122d-414b-9e04-659d863e57cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:28:01.991759 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-2f539cbf-122d-414b-9e04-659d863e57cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:28:01.991759 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:01.991759 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:01.991759 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:01.991759 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:01.991759 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:01.991759 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:01.991759 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:01.991759 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:01.991759 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:01.991759 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:01.991759 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:01.991759 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:28:01.991759 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:28:01.991759 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:28:01.991759 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:28:01.993453 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:28:01.993453 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:28:01.993453 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:28:01.993453 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:28:01.993453 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:01.993453 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:01.993453 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:01.993453 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:01.993453 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:01.993453 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:01.993453 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:01.993453 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:01.993453 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:01.993453 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:01.993453 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:01.993453 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:01.994300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:01.994300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:01.994300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:01.994300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:01.994300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:28:01.994300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:28:01.994300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:28:01.994300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:28:01.994300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:28:01.994300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:28:01.994300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:28:01.994300 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:01.996756 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 424/835] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:28:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:01.997895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f539cbf-122d-414b-9e04-659d863e57cf None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:02.023206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00940d17-b451-451e-ad51-b5d27ac21238 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:02.028877 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:02.061668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494afdd1-861a-42f2-826f-ccf1ef8fbb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:02.062714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494afdd1-861a-42f2-826f-ccf1ef8fbb19 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:02.063242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494afdd1-861a-42f2-826f-ccf1ef8fbb19 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:02.063716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494afdd1-861a-42f2-826f-ccf1ef8fbb19 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:02.064815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494afdd1-861a-42f2-826f-ccf1ef8fbb19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:02.065368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494afdd1-861a-42f2-826f-ccf1ef8fbb19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:02.066943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494afdd1-861a-42f2-826f-ccf1ef8fbb19 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:02.085166 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 412/836] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:28:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:02.086648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494afdd1-861a-42f2-826f-ccf1ef8fbb19 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:02.103389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f539cbf-122d-414b-9e04-659d863e57cf None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:02.122183 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:02.138691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44472cd-1ec1-498c-a4fc-1897d27505e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:02.139312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44472cd-1ec1-498c-a4fc-1897d27505e7 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:02.139586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44472cd-1ec1-498c-a4fc-1897d27505e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:02.139870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44472cd-1ec1-498c-a4fc-1897d27505e7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:02.140423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44472cd-1ec1-498c-a4fc-1897d27505e7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:02.141815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44472cd-1ec1-498c-a4fc-1897d27505e7 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:02.151097 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-f44472cd-1ec1-498c-a4fc-1897d27505e7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:28:02.151097 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:02.151097 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:28:02.151097 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:28:02.151097 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:28:02.151097 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:28:02.151097 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:28:02.151097 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:02.151097 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:28:02.151097 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:02.151097 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:28:02.151097 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:02.151097 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:02.151097 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:02.151097 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:02.151097 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:02.151097 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:02.152076 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:02.152076 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:02.152076 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:02.152076 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:02.152076 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:02.152076 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:02.152076 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:28:02.152076 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:28:02.152076 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:28:02.152076 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:28:02.152076 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:02.152076 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:02.152076 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:02.152076 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:02.152076 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:02.152076 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:02.152968 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:02.152968 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:02.152968 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:02.152968 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:02.152968 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:02.152968 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:02.152968 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:02.152968 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:02.152968 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:02.152968 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:02.152968 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:28:02.152968 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:02.152968 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:28:02.152968 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:02.152968 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 425/837] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Sep 30 09:28:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:02.153767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44472cd-1ec1-498c-a4fc-1897d27505e7 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:02.209345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494afdd1-861a-42f2-826f-ccf1ef8fbb19 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:02.247573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c9e56-f58a-49c0-bd52-66915f39622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:02.248168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c9e56-f58a-49c0-bd52-66915f39622d None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:02.248461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c9e56-f58a-49c0-bd52-66915f39622d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:02.248728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c9e56-f58a-49c0-bd52-66915f39622d None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:02.249381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c9e56-f58a-49c0-bd52-66915f39622d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:02.249675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c9e56-f58a-49c0-bd52-66915f39622d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:02.250041 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:02.251013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c9e56-f58a-49c0-bd52-66915f39622d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:02.259528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44472cd-1ec1-498c-a4fc-1897d27505e7 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:02.260552 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 413/838] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:28:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:02.261270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c9e56-f58a-49c0-bd52-66915f39622d None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:02.304051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9138a-1813-4874-85f5-9370e61637d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:02.304726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9138a-1813-4874-85f5-9370e61637d3 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:02.305142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9138a-1813-4874-85f5-9370e61637d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:02.305413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9138a-1813-4874-85f5-9370e61637d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:02.306146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9138a-1813-4874-85f5-9370e61637d3 None admin] RBAC: Adding query filter params (role.id=f06b5fed717d4b03a5083dd847274296, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=aa607111024540d1a09b01dfd1e5e8cd) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:02.306452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9138a-1813-4874-85f5-9370e61637d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:02.307882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9138a-1813-4874-85f5-9370e61637d3 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:02.314268 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 426/839] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:28:02 2022] GET /identity/v3/role_assignments?user.id=aa607111024540d1a09b01dfd1e5e8cd&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=f06b5fed717d4b03a5083dd847274296 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:02.314268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9138a-1813-4874-85f5-9370e61637d3 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:02.397975 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:02.407146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c9e56-f58a-49c0-bd52-66915f39622d None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:02.444312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517f9b7-8666-416e-bf72-cf344f73b1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:02.444976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517f9b7-8666-416e-bf72-cf344f73b1ee None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:02.445255 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517f9b7-8666-416e-bf72-cf344f73b1ee None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:02.446058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517f9b7-8666-416e-bf72-cf344f73b1ee None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:02.447345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517f9b7-8666-416e-bf72-cf344f73b1ee None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:02.447650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517f9b7-8666-416e-bf72-cf344f73b1ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:02.449154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517f9b7-8666-416e-bf72-cf344f73b1ee None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:02.458983 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 414/840] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Sep 30 09:28:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:02.458983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8124c-bd22-4baf-a4f6-c7e66c294603 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:02.458983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8124c-bd22-4baf-a4f6-c7e66c294603 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:02.458983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8124c-bd22-4baf-a4f6-c7e66c294603 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:02.458983 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 415/841] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:02.460747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8124c-bd22-4baf-a4f6-c7e66c294603 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:02.466062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9138a-1813-4874-85f5-9370e61637d3 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:02.506420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd4549-96b6-4348-9a01-ce1de783decd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:02.507070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd4549-96b6-4348-9a01-ce1de783decd None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:02.507419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd4549-96b6-4348-9a01-ce1de783decd None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:02.507695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd4549-96b6-4348-9a01-ce1de783decd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:02.522015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd4549-96b6-4348-9a01-ce1de783decd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:02.524232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd4549-96b6-4348-9a01-ce1de783decd None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:02.540428 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-76dd4549-96b6-4348-9a01-ce1de783decd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:02.540428 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:02.540428 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:02.540428 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:02.540428 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:02.540428 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:02.540428 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:02.540428 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:02.540428 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:02.540428 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:02.540428 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:02.540428 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:02.540428 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:28:02.540428 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:28:02.540428 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:28:02.540428 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:28:02.541551 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:02.541551 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:02.541551 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:02.541551 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:02.541551 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:02.541551 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:02.541551 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:02.541551 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:02.541551 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:02.541551 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:02.541551 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:02.541551 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:02.541551 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:02.541551 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:02.541551 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:02.541551 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:02.541551 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:28:02.542550 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:28:02.542550 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:02.542550 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:02.543919 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 427/842] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:02.545266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4269d68-3929-411a-ae8f-ee5cebf6377b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:02.545684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4269d68-3929-411a-ae8f-ee5cebf6377b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:02.546112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4269d68-3929-411a-ae8f-ee5cebf6377b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:02.559058 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:02.566151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e4269d68-3929-411a-ae8f-ee5cebf6377b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:02.567356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e4269d68-3929-411a-ae8f-ee5cebf6377b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:02.592453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8124c-bd22-4baf-a4f6-c7e66c294603 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:02.628645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a88130-d33b-412a-b33a-9ac3d400b6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:02.629244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a88130-d33b-412a-b33a-9ac3d400b6ff None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:02.629532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a88130-d33b-412a-b33a-9ac3d400b6ff None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:02.629802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a88130-d33b-412a-b33a-9ac3d400b6ff None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:02.630428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a88130-d33b-412a-b33a-9ac3d400b6ff None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:02.630728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a88130-d33b-412a-b33a-9ac3d400b6ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:02.632085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a88130-d33b-412a-b33a-9ac3d400b6ff None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:02.644656 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 428/844] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:02.644827 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 416/844] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Sep 30 09:28:02 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:02.644935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4269d68-3929-411a-ae8f-ee5cebf6377b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:02.764311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4269d68-3929-411a-ae8f-ee5cebf6377b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:02.803810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ec6b3-f243-4b25-ba72-849143729051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:02.804762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ec6b3-f243-4b25-ba72-849143729051 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:02.805224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ec6b3-f243-4b25-ba72-849143729051 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:02.805636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ec6b3-f243-4b25-ba72-849143729051 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:02.806524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ec6b3-f243-4b25-ba72-849143729051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:02.806988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ec6b3-f243-4b25-ba72-849143729051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:02.808592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ec6b3-f243-4b25-ba72-849143729051 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:02.811766 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:02.823065 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 429/845] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:02.829104 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a88130-d33b-412a-b33a-9ac3d400b6ff None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:02.858993 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:02.940090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a88130-d33b-412a-b33a-9ac3d400b6ff None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:02.945338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ec6b3-f243-4b25-ba72-849143729051 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:02.977294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e381a-43f0-4274-99c1-1651a5b1abab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:02.977914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e381a-43f0-4274-99c1-1651a5b1abab None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:02.978188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e381a-43f0-4274-99c1-1651a5b1abab None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:02.978566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e381a-43f0-4274-99c1-1651a5b1abab None admin] PATH_INFO: `/v3/users/swift` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:02.986798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e381a-43f0-4274-99c1-1651a5b1abab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:02.988344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e381a-43f0-4274-99c1-1651a5b1abab None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:03.001623 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-6f5e381a-43f0-4274-99c1-1651a5b1abab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:28:03.001623 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:03.001623 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:03.001623 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:03.001623 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:03.001623 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:03.001623 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:03.001623 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:03.001623 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:03.001623 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:03.001623 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:03.001623 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:03.001623 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:28:03.001623 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:28:03.001623 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:28:03.001623 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:28:03.002619 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:03.002619 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:03.002619 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:28:03.002619 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:03.002619 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:28:03.002619 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:03.002619 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:03.002619 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:03.002619 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:03.002619 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:03.002619 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:03.002619 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:03.002619 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:03.002619 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:03.002619 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:03.002619 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:03.002619 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:03.002619 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:03.003562 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:03.003562 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:03.003562 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:28:03.003562 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:28:03.003562 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:28:03.003562 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:28:03.003562 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:28:03.003562 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:28:03.003562 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 09:28:03.003562 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:03.003562 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 417/846] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:28:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:03.009366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e381a-43f0-4274-99c1-1651a5b1abab None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:03.065654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ec6b3-f243-4b25-ba72-849143729051 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:03.101479 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:03.112834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68853d5-be23-44d2-96ce-54214e2ef1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:03.114240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68853d5-be23-44d2-96ce-54214e2ef1d4 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:03.114922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68853d5-be23-44d2-96ce-54214e2ef1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:03.115350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68853d5-be23-44d2-96ce-54214e2ef1d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:03.123881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e381a-43f0-4274-99c1-1651a5b1abab None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:03.131181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68853d5-be23-44d2-96ce-54214e2ef1d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:28:03.139705 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-a68853d5-be23-44d2-96ce-54214e2ef1d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:28:03.139705 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:03.139705 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:03.139705 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:03.139705 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:03.139705 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:03.139705 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:03.139705 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:03.139705 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:03.139705 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:03.139705 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:03.139705 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:03.139705 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:28:03.139705 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:28:03.139705 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:28:03.139705 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:28:03.140832 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:28:03.140832 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:28:03.140832 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:28:03.140832 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:28:03.140832 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:03.140832 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:03.140832 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:03.140832 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:03.140832 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:03.140832 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:03.140832 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:03.140832 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:03.140832 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:03.140832 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:03.140832 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:03.140832 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:03.141846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:03.141846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:03.141846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:03.141846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:03.141846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:28:03.141846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:28:03.141846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:28:03.141846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:28:03.141846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:28:03.141846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:28:03.141846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:28:03.141846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:03.144580 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 430/847] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:28:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:03.153273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68853d5-be23-44d2-96ce-54214e2ef1d4 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:03.170499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d194aef-311f-4c69-820c-002e34780363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:03.171179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d194aef-311f-4c69-820c-002e34780363 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:03.171531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d194aef-311f-4c69-820c-002e34780363 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:03.171869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d194aef-311f-4c69-820c-002e34780363 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:03.172710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d194aef-311f-4c69-820c-002e34780363 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:03.173084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d194aef-311f-4c69-820c-002e34780363 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:03.174555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d194aef-311f-4c69-820c-002e34780363 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:03.193884 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 418/848] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Sep 30 09:28:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:03.199945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d194aef-311f-4c69-820c-002e34780363 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:03.222685 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:03.284660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68853d5-be23-44d2-96ce-54214e2ef1d4 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:03.312797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d194aef-311f-4c69-820c-002e34780363 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:03.322990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741b914-705a-431a-8f6e-d91f3e64a68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:03.323923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741b914-705a-431a-8f6e-d91f3e64a68e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:03.324395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741b914-705a-431a-8f6e-d91f3e64a68e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:03.324977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741b914-705a-431a-8f6e-d91f3e64a68e None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:03.325849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741b914-705a-431a-8f6e-d91f3e64a68e None admin] RBAC: Adding query filter params (name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:03.326340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741b914-705a-431a-8f6e-d91f3e64a68e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:03.328007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741b914-705a-431a-8f6e-d91f3e64a68e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:03.338173 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 431/849] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Sep 30 09:28:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:03.343386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741b914-705a-431a-8f6e-d91f3e64a68e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:03.355288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7c122-7f1b-4edf-b9bd-9fd9112a85a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:03.356279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7c122-7f1b-4edf-b9bd-9fd9112a85a1 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:03.356832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7c122-7f1b-4edf-b9bd-9fd9112a85a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:03.357318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7c122-7f1b-4edf-b9bd-9fd9112a85a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:03.369920 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:03.440415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7c122-7f1b-4edf-b9bd-9fd9112a85a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:03.442266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7c122-7f1b-4edf-b9bd-9fd9112a85a1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:03.479819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741b914-705a-431a-8f6e-d91f3e64a68e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:03.501496 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:03.529175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3dfe32-243e-44f5-9eae-1aa2267d804d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:03.529646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3dfe32-243e-44f5-9eae-1aa2267d804d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:03.529919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3dfe32-243e-44f5-9eae-1aa2267d804d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:03.530187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3dfe32-243e-44f5-9eae-1aa2267d804d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:03.542164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3dfe32-243e-44f5-9eae-1aa2267d804d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:03.543618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3dfe32-243e-44f5-9eae-1aa2267d804d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:03.559724 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-6b3dfe32-243e-44f5-9eae-1aa2267d804d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:03.559724 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:03.559724 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:03.559724 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:03.559724 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:03.559724 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:03.559724 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:03.559724 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:03.559724 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:03.559724 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:03.559724 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:03.559724 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:03.559724 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:28:03.559724 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:28:03.559724 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:28:03.559724 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:28:03.560846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:03.560846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:03.560846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:03.560846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:03.560846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:03.560846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:03.560846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:03.560846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:03.560846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:03.560846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:03.560846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:03.560846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:03.560846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:03.560846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:03.560846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:03.560846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:03.560846 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:28:03.561733 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:28:03.561733 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:03.561733 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:03.561733 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 432/850] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:03.570606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3dfe32-243e-44f5-9eae-1aa2267d804d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:03.572193 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 419/851] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:28:03 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:28:03.573378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7c122-7f1b-4edf-b9bd-9fd9112a85a1 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:03.621682 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:03.688155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7c122-7f1b-4edf-b9bd-9fd9112a85a1 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:03.699633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3dfe32-243e-44f5-9eae-1aa2267d804d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:03.731861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336b652-dbda-43b4-bd38-997037e1cb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:03.732784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336b652-dbda-43b4-bd38-997037e1cb35 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:03.733234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336b652-dbda-43b4-bd38-997037e1cb35 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:03.733713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336b652-dbda-43b4-bd38-997037e1cb35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:03.744735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6013b8b-f9dc-4bea-b6f6-04cfc79adf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:03.745645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6013b8b-f9dc-4bea-b6f6-04cfc79adf94 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:03.746187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6013b8b-f9dc-4bea-b6f6-04cfc79adf94 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:03.746649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6013b8b-f9dc-4bea-b6f6-04cfc79adf94 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:03.746965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336b652-dbda-43b4-bd38-997037e1cb35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:03.747708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6013b8b-f9dc-4bea-b6f6-04cfc79adf94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:03.748256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6013b8b-f9dc-4bea-b6f6-04cfc79adf94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:03.748371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336b652-dbda-43b4-bd38-997037e1cb35 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:03.749908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6013b8b-f9dc-4bea-b6f6-04cfc79adf94 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:03.764123 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-9336b652-dbda-43b4-bd38-997037e1cb35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:03.764123 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:03.764123 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:03.764123 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:03.764123 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:03.764123 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:03.764123 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:03.764123 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:03.764123 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:03.764123 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:03.764123 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:03.764123 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:03.764123 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:28:03.764123 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:28:03.764123 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:28:03.764123 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:28:03.765150 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:03.765150 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:03.765150 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:03.765150 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:03.765150 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:03.765150 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:03.765150 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:03.765150 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:03.765150 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:03.765150 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:03.765150 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:03.765150 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:03.765150 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:03.765150 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:03.765150 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:03.765150 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:03.765150 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:28:03.766023 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:28:03.766023 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:03.766023 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:03.766874 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 433/852] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:03.768734 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 420/853] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:03.770483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6013b8b-f9dc-4bea-b6f6-04cfc79adf94 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:03.776098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336b652-dbda-43b4-bd38-997037e1cb35 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:03.810044 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:03.903114 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:03.903299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6013b8b-f9dc-4bea-b6f6-04cfc79adf94 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:03.915488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336b652-dbda-43b4-bd38-997037e1cb35 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:03.951687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93841a4a-f294-4174-b351-dc42ff555ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:03.952590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93841a4a-f294-4174-b351-dc42ff555ca5 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:03.953002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93841a4a-f294-4174-b351-dc42ff555ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:03.953342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93841a4a-f294-4174-b351-dc42ff555ca5 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:03.954070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93841a4a-f294-4174-b351-dc42ff555ca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:03.954480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93841a4a-f294-4174-b351-dc42ff555ca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:03.955948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93841a4a-f294-4174-b351-dc42ff555ca5 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:03.956178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5a788-6701-4e3c-8d83-3c51fc745324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:03.957255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5a788-6701-4e3c-8d83-3c51fc745324 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:03.957680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5a788-6701-4e3c-8d83-3c51fc745324 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:03.958317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5a788-6701-4e3c-8d83-3c51fc745324 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:03.969177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5a788-6701-4e3c-8d83-3c51fc745324 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:03.974862 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 421/854] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:03.975027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5a788-6701-4e3c-8d83-3c51fc745324 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:03.975915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93841a4a-f294-4174-b351-dc42ff555ca5 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:03.988836 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-02f5a788-6701-4e3c-8d83-3c51fc745324 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:28:03.988836 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:03.988836 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:03.988836 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:03.988836 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:03.988836 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:03.988836 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:03.988836 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:03.988836 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:03.988836 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:03.988836 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:03.988836 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:03.988836 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:28:03.988836 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:28:03.988836 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:28:03.988836 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:28:03.989821 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:03.989821 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:03.989821 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:28:03.989821 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:03.989821 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:28:03.989821 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:03.989821 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:03.989821 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:03.989821 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:03.989821 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:03.989821 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:03.989821 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:03.989821 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:03.989821 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:03.989821 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:03.989821 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:03.989821 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:03.989821 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:03.990771 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:03.990771 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:03.990771 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:28:03.990771 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:28:03.990771 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:28:03.990771 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:28:03.990771 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:28:03.990771 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:28:03.990771 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:28:03.990771 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:03.995029 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 434/855] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Sep 30 09:28:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:03.996395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5a788-6701-4e3c-8d83-3c51fc745324 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:04.105204 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:04.113340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93841a4a-f294-4174-b351-dc42ff555ca5 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:04.117792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5a788-6701-4e3c-8d83-3c51fc745324 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:04.163313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b479a-770a-4eb5-9561-d68e4f8cb446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:04.163862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b479a-770a-4eb5-9561-d68e4f8cb446 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:04.164138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b479a-770a-4eb5-9561-d68e4f8cb446 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:04.164462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b479a-770a-4eb5-9561-d68e4f8cb446 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:04.166879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322941b-21ab-47d3-a0ae-bced3f37578e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:04.167755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322941b-21ab-47d3-a0ae-bced3f37578e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:04.168268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322941b-21ab-47d3-a0ae-bced3f37578e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:04.168842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322941b-21ab-47d3-a0ae-bced3f37578e None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:04.169802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322941b-21ab-47d3-a0ae-bced3f37578e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:04.170329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322941b-21ab-47d3-a0ae-bced3f37578e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:04.172006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322941b-21ab-47d3-a0ae-bced3f37578e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:04.172707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b479a-770a-4eb5-9561-d68e4f8cb446 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:04.174375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b479a-770a-4eb5-9561-d68e4f8cb446 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:04.195806 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-5f2b479a-770a-4eb5-9561-d68e4f8cb446 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:28:04.195806 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:04.195806 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:04.195806 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:04.195806 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:04.195806 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:04.195806 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:04.195806 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:04.195806 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:04.195806 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:04.195806 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:04.195806 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:04.195806 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:28:04.195806 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:28:04.195806 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:28:04.197502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:28:04.197502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:04.197502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:04.197502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:04.197502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:04.197502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:04.197502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:04.197502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:04.197502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:04.197502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:04.197502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:04.197502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:04.197502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:04.197502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:04.197502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:04.197502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:04.197502 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:04.198386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:28:04.198386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:28:04.198386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:28:04.198386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:28:04.198386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:28:04.198386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:28:04.198386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:28:04.198386 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:04.199576 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 435/856] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Sep 30 09:28:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:04.201418 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 422/857] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:28:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:04.207334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b479a-770a-4eb5-9561-d68e4f8cb446 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:04.207794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322941b-21ab-47d3-a0ae-bced3f37578e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:04.225944 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:04.322720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322941b-21ab-47d3-a0ae-bced3f37578e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:04.346557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b479a-770a-4eb5-9561-d68e4f8cb446 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:04.363475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8597769-48bd-486c-b595-37b7d7d702de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:04.364146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8597769-48bd-486c-b595-37b7d7d702de None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:04.364427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8597769-48bd-486c-b595-37b7d7d702de None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:04.364797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8597769-48bd-486c-b595-37b7d7d702de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:04.390247 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:04.394265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86a115-e2e0-45e2-80c0-7e5e2e8f5df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:04.394887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86a115-e2e0-45e2-80c0-7e5e2e8f5df8 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:04.396019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86a115-e2e0-45e2-80c0-7e5e2e8f5df8 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:04.396777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86a115-e2e0-45e2-80c0-7e5e2e8f5df8 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:04.397735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86a115-e2e0-45e2-80c0-7e5e2e8f5df8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:04.398058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86a115-e2e0-45e2-80c0-7e5e2e8f5df8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:04.399704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86a115-e2e0-45e2-80c0-7e5e2e8f5df8 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:04.420702 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 423/858] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:28:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:04.423500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86a115-e2e0-45e2-80c0-7e5e2e8f5df8 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:04.454315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8597769-48bd-486c-b595-37b7d7d702de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:04.455872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8597769-48bd-486c-b595-37b7d7d702de None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:04.518517 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:04.566067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86a115-e2e0-45e2-80c0-7e5e2e8f5df8 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:04.591771 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 436/859] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:28:04 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:28:04.592200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8597769-48bd-486c-b595-37b7d7d702de None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:04.616249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426822d-ef61-478e-b98a-ea862dc1a8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:04.618346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426822d-ef61-478e-b98a-ea862dc1a8c7 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:04.618962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426822d-ef61-478e-b98a-ea862dc1a8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:04.619860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426822d-ef61-478e-b98a-ea862dc1a8c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:04.621229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426822d-ef61-478e-b98a-ea862dc1a8c7 None admin] RBAC: Adding query filter params (role.id=f06b5fed717d4b03a5083dd847274296, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=963c491a2d2e409b8b45e4fb6aff41c3) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:04.621996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426822d-ef61-478e-b98a-ea862dc1a8c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:04.624341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426822d-ef61-478e-b98a-ea862dc1a8c7 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:04.633020 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 424/860] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:28:04 2022] GET /identity/v3/role_assignments?user.id=963c491a2d2e409b8b45e4fb6aff41c3&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=f06b5fed717d4b03a5083dd847274296 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:04.646662 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:04.660710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3adf9-0f2d-4da9-b57b-b14efebdf11d None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:04.661337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3adf9-0f2d-4da9-b57b-b14efebdf11d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:04.661826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3adf9-0f2d-4da9-b57b-b14efebdf11d None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:04.663729 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 425/861] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:28:04.670318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f0d1e-24d9-42ad-9b79-9b00beeeecff None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:04.670998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f0d1e-24d9-42ad-9b79-9b00beeeecff None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:04.671484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f0d1e-24d9-42ad-9b79-9b00beeeecff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:04.690678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-de4f0d1e-24d9-42ad-9b79-9b00beeeecff None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:04.692297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-de4f0d1e-24d9-42ad-9b79-9b00beeeecff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:04.711009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8597769-48bd-486c-b595-37b7d7d702de None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:04.750252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc66ac8-b6f6-4493-96d2-980a399f01a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:04.750949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc66ac8-b6f6-4493-96d2-980a399f01a8 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:04.751261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc66ac8-b6f6-4493-96d2-980a399f01a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:04.751535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc66ac8-b6f6-4493-96d2-980a399f01a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:04.763509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc66ac8-b6f6-4493-96d2-980a399f01a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:04.765081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc66ac8-b6f6-4493-96d2-980a399f01a8 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:04.781028 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 426/862] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:28:04.781871 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-1dc66ac8-b6f6-4493-96d2-980a399f01a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:04.781871 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:04.781871 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:04.781871 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:04.781871 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:04.781871 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:04.781871 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:04.781871 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:04.781871 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:04.781871 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:04.781871 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:04.781871 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:04.781871 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:28:04.781871 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:28:04.781871 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:28:04.781871 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:28:04.782803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:04.782803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:04.782803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:04.782803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:04.782803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:04.782803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:04.782803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:04.782803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:04.782803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:04.782803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:04.782803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:04.782803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:04.782803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:04.782803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:04.782803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:04.782803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:04.782803 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:28:04.783701 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:28:04.783701 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:04.783701 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:04.788540 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 437/863] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:04.790357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f0d1e-24d9-42ad-9b79-9b00beeeecff None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:04.866331 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:04.910423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f0d1e-24d9-42ad-9b79-9b00beeeecff None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:04.939961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4b486-4bc9-4445-9268-4d337dbee13c None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:04.940262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4b486-4bc9-4445-9268-4d337dbee13c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:04.940621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4b486-4bc9-4445-9268-4d337dbee13c None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:04.941833 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 438/864] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:04.950105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce077964-259f-4fcf-8b79-5dfb2f0157e3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:04.950385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce077964-259f-4fcf-8b79-5dfb2f0157e3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:04.950662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce077964-259f-4fcf-8b79-5dfb2f0157e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:04.965615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726f6fb-548b-412d-b9a5-77f39c82f40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:04.966901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726f6fb-548b-412d-b9a5-77f39c82f40c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:04.967378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726f6fb-548b-412d-b9a5-77f39c82f40c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:04.967888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726f6fb-548b-412d-b9a5-77f39c82f40c None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:04.968760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726f6fb-548b-412d-b9a5-77f39c82f40c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:04.969277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726f6fb-548b-412d-b9a5-77f39c82f40c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:04.970106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ce077964-259f-4fcf-8b79-5dfb2f0157e3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:04.971037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726f6fb-548b-412d-b9a5-77f39c82f40c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:04.971295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ce077964-259f-4fcf-8b79-5dfb2f0157e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:04.984942 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 427/865] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:04.992342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726f6fb-548b-412d-b9a5-77f39c82f40c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:05.060676 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 439/866] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:28:05.067429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce077964-259f-4fcf-8b79-5dfb2f0157e3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:05.109319 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:05.125600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726f6fb-548b-412d-b9a5-77f39c82f40c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:05.159993 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:05.172389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b562a5-c2cb-4fa7-bd71-5bd74cc254c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:05.173408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b562a5-c2cb-4fa7-bd71-5bd74cc254c5 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:05.173690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b562a5-c2cb-4fa7-bd71-5bd74cc254c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:05.173960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b562a5-c2cb-4fa7-bd71-5bd74cc254c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:05.183257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b562a5-c2cb-4fa7-bd71-5bd74cc254c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:05.184975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b562a5-c2cb-4fa7-bd71-5bd74cc254c5 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:05.189237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce077964-259f-4fcf-8b79-5dfb2f0157e3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:05.200908 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-13b562a5-c2cb-4fa7-bd71-5bd74cc254c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:28:05.200908 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:05.200908 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:05.200908 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:05.200908 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:05.200908 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:05.200908 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:05.200908 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:05.200908 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:05.200908 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:05.200908 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:05.200908 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:05.200908 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:28:05.200908 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:28:05.200908 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:28:05.202033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:28:05.202033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:05.202033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:05.202033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:05.202033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:05.202033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:05.202033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:05.202033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:05.202033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:05.202033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:05.202033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:05.202033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:05.202033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:05.202033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:05.202033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:05.202033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:05.202033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:05.203110 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:28:05.203110 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:28:05.203110 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:28:05.203110 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:28:05.203110 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:28:05.203110 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:28:05.203110 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:28:05.203110 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:05.204676 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 428/867] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:28:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:05.208564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b562a5-c2cb-4fa7-bd71-5bd74cc254c5 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:05.235153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ce9bd-3e41-48a0-8e3a-6b3c3889ce0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:05.235986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ce9bd-3e41-48a0-8e3a-6b3c3889ce0b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:05.236104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ce9bd-3e41-48a0-8e3a-6b3c3889ce0b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:05.236372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ce9bd-3e41-48a0-8e3a-6b3c3889ce0b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:05.236995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ce9bd-3e41-48a0-8e3a-6b3c3889ce0b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:05.238403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ce9bd-3e41-48a0-8e3a-6b3c3889ce0b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:05.247773 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-bb5ce9bd-3e41-48a0-8e3a-6b3c3889ce0b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:28:05.247773 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:05.247773 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:28:05.247773 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:28:05.247773 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:28:05.247773 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:28:05.247773 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:28:05.247773 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:05.247773 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:28:05.247773 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:05.247773 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:28:05.247773 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:05.247773 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:05.247773 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:05.247773 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:05.247773 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:05.248923 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:05.248923 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:05.248923 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:05.248923 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:05.248923 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:05.248923 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:05.248923 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:05.248923 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:28:05.248923 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:28:05.248923 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:28:05.248923 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:28:05.248923 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:05.248923 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:05.248923 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:05.248923 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:05.248923 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:05.248923 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:05.250153 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:05.250153 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:05.250153 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:05.250153 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:05.250153 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:05.250153 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:05.250153 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:05.250153 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:05.250153 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:05.250153 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:05.250153 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:28:05.250153 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:05.250153 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:28:05.250153 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:05.253970 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 440/868] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Sep 30 09:28:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:05.254858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ce9bd-3e41-48a0-8e3a-6b3c3889ce0b None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:05.330508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b562a5-c2cb-4fa7-bd71-5bd74cc254c5 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:05.368586 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:05.368858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71918c50-d3ec-48ef-aeed-9599b0493765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:05.369716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71918c50-d3ec-48ef-aeed-9599b0493765 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:05.370060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71918c50-d3ec-48ef-aeed-9599b0493765 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:05.370338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71918c50-d3ec-48ef-aeed-9599b0493765 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:05.371353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71918c50-d3ec-48ef-aeed-9599b0493765 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:05.371661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71918c50-d3ec-48ef-aeed-9599b0493765 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:05.373421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71918c50-d3ec-48ef-aeed-9599b0493765 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:05.377164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ce9bd-3e41-48a0-8e3a-6b3c3889ce0b None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:05.387588 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 429/869] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:28:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:05.388397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71918c50-d3ec-48ef-aeed-9599b0493765 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:05.417226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00efd8-2933-4b87-a1af-c05ae4380787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:05.418109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00efd8-2933-4b87-a1af-c05ae4380787 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:05.418386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00efd8-2933-4b87-a1af-c05ae4380787 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:05.418702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00efd8-2933-4b87-a1af-c05ae4380787 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:05.419326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00efd8-2933-4b87-a1af-c05ae4380787 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:05.419674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00efd8-2933-4b87-a1af-c05ae4380787 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:05.421049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00efd8-2933-4b87-a1af-c05ae4380787 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:05.425736 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 441/870] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Sep 30 09:28:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:05.426526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00efd8-2933-4b87-a1af-c05ae4380787 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:05.445132 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:05.506184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71918c50-d3ec-48ef-aeed-9599b0493765 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:05.542021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00efd8-2933-4b87-a1af-c05ae4380787 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:05.544538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b3d60-f16c-4288-9fb0-9ce894415e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:05.545177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b3d60-f16c-4288-9fb0-9ce894415e37 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:05.545450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b3d60-f16c-4288-9fb0-9ce894415e37 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:05.545713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b3d60-f16c-4288-9fb0-9ce894415e37 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:05.546364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b3d60-f16c-4288-9fb0-9ce894415e37 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:05.547712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b3d60-f16c-4288-9fb0-9ce894415e37 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:05.562499 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 430/871] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Sep 30 09:28:05 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:28:05.563305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b3d60-f16c-4288-9fb0-9ce894415e37 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:05.599264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3167f-7509-4f56-8f83-120575b46bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:05.600711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3167f-7509-4f56-8f83-120575b46bf3 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:05.601516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3167f-7509-4f56-8f83-120575b46bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:05.602547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3167f-7509-4f56-8f83-120575b46bf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:05.604374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3167f-7509-4f56-8f83-120575b46bf3 None admin] RBAC: Adding query filter params (role.id=4089b59a020f44b98fad2a34b61fd573, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=9bdab836a64d43ea842629d29b6f8d47) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:05.605038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3167f-7509-4f56-8f83-120575b46bf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:05.608165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3167f-7509-4f56-8f83-120575b46bf3 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:05.617185 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 442/872] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:28:05 2022] GET /identity/v3/role_assignments?user.id=9bdab836a64d43ea842629d29b6f8d47&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=4089b59a020f44b98fad2a34b61fd573 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:05.696752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b3d60-f16c-4288-9fb0-9ce894415e37 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:05.705870 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:05.741260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0faab-3ed3-4300-b085-698b5f7d45ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:05.742543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0faab-3ed3-4300-b085-698b5f7d45ab None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:05.743249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0faab-3ed3-4300-b085-698b5f7d45ab None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:05.743729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0faab-3ed3-4300-b085-698b5f7d45ab None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:05.744634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0faab-3ed3-4300-b085-698b5f7d45ab None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:05.745158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0faab-3ed3-4300-b085-698b5f7d45ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:05.746995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0faab-3ed3-4300-b085-698b5f7d45ab None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:05.753027 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 431/873] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Sep 30 09:28:05 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:06.949167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e54768-6a22-4371-b776-ecab11f65981 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:06.949703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e54768-6a22-4371-b776-ecab11f65981 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:06.949703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e54768-6a22-4371-b776-ecab11f65981 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:06.951167 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 443/874] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:06.956687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7dbce-fdc6-4100-bc8a-68136591e35a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:06.957736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7dbce-fdc6-4100-bc8a-68136591e35a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:06.958214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7dbce-fdc6-4100-bc8a-68136591e35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:06.976919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-95f7dbce-fdc6-4100-bc8a-68136591e35a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:06.978389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-95f7dbce-fdc6-4100-bc8a-68136591e35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:07.051336 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 432/875] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:06 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:07.321284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e54768-6a22-4371-b776-ecab11f65981 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:07.342131 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:07.435482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e54768-6a22-4371-b776-ecab11f65981 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:07.472180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192eb56-8f24-4447-918b-5b2901c5bf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:07.472838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192eb56-8f24-4447-918b-5b2901c5bf63 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:07.473120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192eb56-8f24-4447-918b-5b2901c5bf63 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:07.473391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192eb56-8f24-4447-918b-5b2901c5bf63 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:07.473974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192eb56-8f24-4447-918b-5b2901c5bf63 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:07.475330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192eb56-8f24-4447-918b-5b2901c5bf63 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:07.484676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-9192eb56-8f24-4447-918b-5b2901c5bf63 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:28:07.484676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:07.484676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:28:07.484676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:28:07.484676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:28:07.484676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:28:07.484676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:28:07.484676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:07.484676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:28:07.484676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:07.484676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:28:07.484676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:07.484676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:07.484676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:07.484676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:07.484676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:07.484676 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:07.485740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:07.485740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:07.485740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:07.485740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:07.485740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:07.485740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:07.485740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:28:07.485740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:28:07.485740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:28:07.485740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:28:07.485740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:07.485740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:07.485740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:07.485740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:07.485740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:07.485740 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:07.486664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:07.486664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:07.486664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:07.486664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:07.486664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:07.486664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:07.486664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:07.486664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:07.486664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:07.486664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:07.486664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:28:07.486664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:07.486664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:28:07.486664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:07.486664 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 444/876] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Sep 30 09:28:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:07.494219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7dbce-fdc6-4100-bc8a-68136591e35a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:07.596179 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:07.599767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7dbce-fdc6-4100-bc8a-68136591e35a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:07.635811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd437a-8e02-4911-a31b-8bf58e163bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:07.636853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd437a-8e02-4911-a31b-8bf58e163bf1 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:07.637342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd437a-8e02-4911-a31b-8bf58e163bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:07.637808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd437a-8e02-4911-a31b-8bf58e163bf1 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:07.638652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd437a-8e02-4911-a31b-8bf58e163bf1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:07.639187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd437a-8e02-4911-a31b-8bf58e163bf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:07.640766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd437a-8e02-4911-a31b-8bf58e163bf1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:07.645968 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 433/877] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Sep 30 09:28:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:07.652380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192eb56-8f24-4447-918b-5b2901c5bf63 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:07.738026 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:07.760341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192eb56-8f24-4447-918b-5b2901c5bf63 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:07.802071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4b774-8235-434a-8d46-c248c1907828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:07.802706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4b774-8235-434a-8d46-c248c1907828 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:07.802990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4b774-8235-434a-8d46-c248c1907828 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:07.803265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4b774-8235-434a-8d46-c248c1907828 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:07.803928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4b774-8235-434a-8d46-c248c1907828 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:07.804232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4b774-8235-434a-8d46-c248c1907828 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:07.806410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4b774-8235-434a-8d46-c248c1907828 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:07.812190 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 445/878] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Sep 30 09:28:07 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:07.902632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c913f-c989-41a9-b68c-6b57632db7d1 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:07.902818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c913f-c989-41a9-b68c-6b57632db7d1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:07.903114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c913f-c989-41a9-b68c-6b57632db7d1 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:07.904817 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 434/879] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:07.910641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f534869-74d8-47c0-bcc7-ac659e325ee5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:07.910946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f534869-74d8-47c0-bcc7-ac659e325ee5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:07.911183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f534869-74d8-47c0-bcc7-ac659e325ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:07.919523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67263b-88c3-444f-8988-b680d85a6770 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:07.919832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67263b-88c3-444f-8988-b680d85a6770 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:07.920059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67263b-88c3-444f-8988-b680d85a6770 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:07.921745 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 435/880] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:07.932630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a0dd5-8312-4333-a770-1f8bbf61089b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:07.932630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a0dd5-8312-4333-a770-1f8bbf61089b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:07.932630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a0dd5-8312-4333-a770-1f8bbf61089b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:07.935421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5f534869-74d8-47c0-bcc7-ac659e325ee5 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:07.936954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5f534869-74d8-47c0-bcc7-ac659e325ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:07.953768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fe1a0dd5-8312-4333-a770-1f8bbf61089b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:07.955671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fe1a0dd5-8312-4333-a770-1f8bbf61089b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:08.036699 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 446/881] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:07 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:08.054478 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 436/882] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:07 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:28:08.090962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffa55b-063b-47ad-8047-540c59cbde27 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:08.091288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffa55b-063b-47ad-8047-540c59cbde27 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:08.091527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffa55b-063b-47ad-8047-540c59cbde27 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:08.093147 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 447/883] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:08.098348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c47e4b-40ff-4fbe-a104-9c1d04008ec8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:08.098635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c47e4b-40ff-4fbe-a104-9c1d04008ec8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:08.098905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c47e4b-40ff-4fbe-a104-9c1d04008ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:08.117599 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-02c47e4b-40ff-4fbe-a104-9c1d04008ec8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:08.118711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-02c47e4b-40ff-4fbe-a104-9c1d04008ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:08.189107 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 437/884] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:08 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:08.303555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffa55b-063b-47ad-8047-540c59cbde27 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:08.329022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c47e4b-40ff-4fbe-a104-9c1d04008ec8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:08.358836 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:08.396883 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:08.426352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffa55b-063b-47ad-8047-540c59cbde27 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:08.449622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c47e4b-40ff-4fbe-a104-9c1d04008ec8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:08.469460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb57c62-f8e3-4678-b5a5-4800118e0106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:08.470097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb57c62-f8e3-4678-b5a5-4800118e0106 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:08.470709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb57c62-f8e3-4678-b5a5-4800118e0106 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:08.470988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb57c62-f8e3-4678-b5a5-4800118e0106 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:08.484356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb57c62-f8e3-4678-b5a5-4800118e0106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:28:08.487812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d104e-3470-480f-97a8-c3535e45353a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:08.488431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d104e-3470-480f-97a8-c3535e45353a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:08.488732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d104e-3470-480f-97a8-c3535e45353a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:08.488997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d104e-3470-480f-97a8-c3535e45353a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:08.489545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-3cb57c62-f8e3-4678-b5a5-4800118e0106 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:28:08.489545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:08.489545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:08.489545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:08.489545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:08.489545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:08.489545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:08.489545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:08.489545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:08.489545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:08.489545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:08.489545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:08.489545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:28:08.489545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:28:08.489545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:28:08.489545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:28:08.490480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:28:08.490480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:28:08.490480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:28:08.490480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:28:08.490480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:08.490480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:08.490480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:08.490480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:08.490480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:08.490480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:08.490480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:08.490480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:08.490480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:08.490480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:08.490480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:08.490480 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:08.491342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:08.491342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:08.491342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:08.491342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:08.491342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:28:08.491342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:28:08.491342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:28:08.491342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:28:08.491342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:28:08.491342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:28:08.491342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:28:08.491342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:08.492027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d104e-3470-480f-97a8-c3535e45353a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:08.492027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d104e-3470-480f-97a8-c3535e45353a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:08.492831 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 448/885] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Sep 30 09:28:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:08.492831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb57c62-f8e3-4678-b5a5-4800118e0106 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:08.507539 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-635d104e-3470-480f-97a8-c3535e45353a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:28:08.507539 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:08.507539 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:28:08.507539 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:28:08.507539 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:28:08.507539 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:28:08.507539 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:28:08.507539 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:08.507539 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:28:08.507539 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:08.507539 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:28:08.507539 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:08.507539 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:08.507539 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:08.507539 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:08.507539 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:08.507539 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:08.509812 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:08.509812 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:08.509812 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:08.509812 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:08.509812 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:08.509812 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:08.509812 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:28:08.509812 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:28:08.509812 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:28:08.509812 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:28:08.509812 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:08.509812 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:08.509812 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:08.509812 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:08.509812 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:08.509812 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:08.510656 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:08.510656 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:08.510656 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:08.510656 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:08.510656 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:08.510656 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:08.510656 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:08.510656 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:08.510656 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:08.510656 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:08.510656 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:28:08.510656 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:08.510656 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:28:08.510656 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:08.510656 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 438/886] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Sep 30 09:28:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:08.511524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d104e-3470-480f-97a8-c3535e45353a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:08.605423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb57c62-f8e3-4678-b5a5-4800118e0106 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:08.608092 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:08.622824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d104e-3470-480f-97a8-c3535e45353a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:08.643041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcebd3d-c202-41f8-8858-a3d72f4f4162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:08.643863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcebd3d-c202-41f8-8858-a3d72f4f4162 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:08.644310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcebd3d-c202-41f8-8858-a3d72f4f4162 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:08.644766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcebd3d-c202-41f8-8858-a3d72f4f4162 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:08.645693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcebd3d-c202-41f8-8858-a3d72f4f4162 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:08.647334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcebd3d-c202-41f8-8858-a3d72f4f4162 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:08.653247 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:08.662090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276ce9a-52d4-469d-a452-35fe44e62269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:08.662698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276ce9a-52d4-469d-a452-35fe44e62269 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:08.662983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276ce9a-52d4-469d-a452-35fe44e62269 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:08.663252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276ce9a-52d4-469d-a452-35fe44e62269 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:08.663919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276ce9a-52d4-469d-a452-35fe44e62269 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:08.664441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276ce9a-52d4-469d-a452-35fe44e62269 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:08.665658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276ce9a-52d4-469d-a452-35fe44e62269 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:08.680763 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 439/887] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Sep 30 09:28:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:08.680763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276ce9a-52d4-469d-a452-35fe44e62269 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:08.681405 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 449/888] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Sep 30 09:28:08 2022] POST /identity/v3/services => generated 269 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:28:08.681405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcebd3d-c202-41f8-8858-a3d72f4f4162 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:08.801515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276ce9a-52d4-469d-a452-35fe44e62269 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:08.804965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcebd3d-c202-41f8-8858-a3d72f4f4162 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:08.842059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f633b-8450-4a5b-ab7a-6eb1066f2de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:08.843048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f633b-8450-4a5b-ab7a-6eb1066f2de4 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:08.843175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d859ff5-a506-470c-abbb-b0e4c2d3f214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:08.843598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f633b-8450-4a5b-ab7a-6eb1066f2de4 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:08.843744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d859ff5-a506-470c-abbb-b0e4c2d3f214 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:08.843986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d859ff5-a506-470c-abbb-b0e4c2d3f214 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:08.844276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d859ff5-a506-470c-abbb-b0e4c2d3f214 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:08.844491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f633b-8450-4a5b-ab7a-6eb1066f2de4 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:08.845363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f633b-8450-4a5b-ab7a-6eb1066f2de4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:08.845834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f633b-8450-4a5b-ab7a-6eb1066f2de4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:08.847372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f633b-8450-4a5b-ab7a-6eb1066f2de4 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:08.857861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d859ff5-a506-470c-abbb-b0e4c2d3f214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:08.858418 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 440/889] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Sep 30 09:28:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:08.859031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d859ff5-a506-470c-abbb-b0e4c2d3f214 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:08.859697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f633b-8450-4a5b-ab7a-6eb1066f2de4 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:08.874574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-6d859ff5-a506-470c-abbb-b0e4c2d3f214 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:08.874574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:08.874574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:08.874574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:08.874574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:08.874574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:08.874574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:08.874574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:08.874574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:08.874574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:08.874574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:08.874574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:08.874574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:28:08.874574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:28:08.874574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:28:08.874574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:28:08.875670 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:08.875670 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:08.875670 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:08.875670 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:08.875670 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:08.875670 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:08.875670 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:08.875670 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:08.875670 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:08.875670 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:08.875670 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:08.875670 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:08.875670 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:08.875670 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:08.875670 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:08.875670 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:08.875670 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:28:08.876576 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:28:08.876576 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:08.876576 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:08.880366 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 450/890] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:08.880937 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:08.882021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d859ff5-a506-470c-abbb-b0e4c2d3f214 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:08.938729 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:08.993646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f633b-8450-4a5b-ab7a-6eb1066f2de4 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:09.014768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d859ff5-a506-470c-abbb-b0e4c2d3f214 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:09.035622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b40551-130c-4392-a43b-d14ef1f0a3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:09.036380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b40551-130c-4392-a43b-d14ef1f0a3a6 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:09.036807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b40551-130c-4392-a43b-d14ef1f0a3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:09.037198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b40551-130c-4392-a43b-d14ef1f0a3a6 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:09.037831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b40551-130c-4392-a43b-d14ef1f0a3a6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:09.038308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b40551-130c-4392-a43b-d14ef1f0a3a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:09.040388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b40551-130c-4392-a43b-d14ef1f0a3a6 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:09.045805 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 441/891] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Sep 30 09:28:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:09.052023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b40551-130c-4392-a43b-d14ef1f0a3a6 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:09.060219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec9f45-5e73-456d-a0dd-3fd0f4637d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:09.060860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec9f45-5e73-456d-a0dd-3fd0f4637d05 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:09.061144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec9f45-5e73-456d-a0dd-3fd0f4637d05 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:09.061413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec9f45-5e73-456d-a0dd-3fd0f4637d05 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:09.062061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec9f45-5e73-456d-a0dd-3fd0f4637d05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:09.062363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec9f45-5e73-456d-a0dd-3fd0f4637d05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:09.063773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec9f45-5e73-456d-a0dd-3fd0f4637d05 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:09.078901 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 451/892] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:09.084388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec9f45-5e73-456d-a0dd-3fd0f4637d05 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:09.154096 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:09.184151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b40551-130c-4392-a43b-d14ef1f0a3a6 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:09.219247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec9f45-5e73-456d-a0dd-3fd0f4637d05 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:09.223142 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:09.233991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f74b6-4cf7-4b9e-be8b-503b06045728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:09.234603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f74b6-4cf7-4b9e-be8b-503b06045728 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:09.234877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f74b6-4cf7-4b9e-be8b-503b06045728 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:09.235144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f74b6-4cf7-4b9e-be8b-503b06045728 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:09.235966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f74b6-4cf7-4b9e-be8b-503b06045728 None admin] RBAC: Adding query filter params (interface=public, service_id=98eea23fbf454dd59b52cf5cc651a738, region_id=RegionOne) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:09.236299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f74b6-4cf7-4b9e-be8b-503b06045728 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:09.237702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f74b6-4cf7-4b9e-be8b-503b06045728 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:09.244251 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 442/893] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Sep 30 09:28:09 2022] GET /identity/v3/endpoints?service_id=98eea23fbf454dd59b52cf5cc651a738&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:09.250170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f74b6-4cf7-4b9e-be8b-503b06045728 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:09.264231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7de8fb-ba13-4daf-98b6-3ff3c9b94895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:09.264937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7de8fb-ba13-4daf-98b6-3ff3c9b94895 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:09.265218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7de8fb-ba13-4daf-98b6-3ff3c9b94895 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:09.265490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7de8fb-ba13-4daf-98b6-3ff3c9b94895 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:09.274026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7de8fb-ba13-4daf-98b6-3ff3c9b94895 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:09.275466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7de8fb-ba13-4daf-98b6-3ff3c9b94895 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:09.287313 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-4b7de8fb-ba13-4daf-98b6-3ff3c9b94895 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:28:09.287313 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:09.287313 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:09.287313 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:09.287313 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:09.287313 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:09.287313 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:09.287313 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:09.287313 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:09.287313 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:09.287313 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:09.287313 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:09.287313 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:28:09.287313 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:28:09.287313 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:28:09.287313 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:28:09.288320 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:09.288320 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:09.288320 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:28:09.288320 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:09.288320 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:28:09.288320 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:09.288320 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:09.288320 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:09.288320 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:09.288320 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:09.288320 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:09.288320 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:09.288320 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:09.288320 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:09.288320 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:09.288320 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:09.288320 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:09.288320 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:09.290303 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:09.290303 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:09.290303 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:28:09.290303 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:28:09.290303 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:28:09.290303 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:28:09.290303 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:28:09.290303 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:28:09.290303 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:28:09.290303 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:09.290303 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 452/894] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Sep 30 09:28:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:09.294882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7de8fb-ba13-4daf-98b6-3ff3c9b94895 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:09.387682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f74b6-4cf7-4b9e-be8b-503b06045728 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:09.398037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7de8fb-ba13-4daf-98b6-3ff3c9b94895 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:09.433345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96eeaef-aa42-45fb-bd81-d971fafb4676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:09.434060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96eeaef-aa42-45fb-bd81-d971fafb4676 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:09.434350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96eeaef-aa42-45fb-bd81-d971fafb4676 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:09.434616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96eeaef-aa42-45fb-bd81-d971fafb4676 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:09.435436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96eeaef-aa42-45fb-bd81-d971fafb4676 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:09.435805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96eeaef-aa42-45fb-bd81-d971fafb4676 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:09.437630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96eeaef-aa42-45fb-bd81-d971fafb4676 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:09.438666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d5e21-1ebc-4bf2-bb11-c85068e779b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:09.439754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d5e21-1ebc-4bf2-bb11-c85068e779b3 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:09.440895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d5e21-1ebc-4bf2-bb11-c85068e779b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:09.441121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d5e21-1ebc-4bf2-bb11-c85068e779b3 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:09.441728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d5e21-1ebc-4bf2-bb11-c85068e779b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:09.443045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d5e21-1ebc-4bf2-bb11-c85068e779b3 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:09.452099 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 443/895] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Sep 30 09:28:09 2022] GET /identity/v3/services => generated 1268 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:28:09.464901 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 453/896] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Sep 30 09:28:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:09.470398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d5e21-1ebc-4bf2-bb11-c85068e779b3 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:09.481217 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:09.584906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d5e21-1ebc-4bf2-bb11-c85068e779b3 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:09.623565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355a840-7998-421b-956d-96c6ca5b04df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:09.624566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355a840-7998-421b-956d-96c6ca5b04df None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:09.625073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355a840-7998-421b-956d-96c6ca5b04df None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:09.625538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355a840-7998-421b-956d-96c6ca5b04df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:09.700572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355a840-7998-421b-956d-96c6ca5b04df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:09.702370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355a840-7998-421b-956d-96c6ca5b04df None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:09.712783 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:09.812728 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 444/897] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:28:09 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 30 09:28:09.815205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96eeaef-aa42-45fb-bd81-d971fafb4676 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:09.841091 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:09.927771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96eeaef-aa42-45fb-bd81-d971fafb4676 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:09.969431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cccd9-a303-4949-ad7f-c3db4b354d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:09.969980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cccd9-a303-4949-ad7f-c3db4b354d8f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:09.970262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cccd9-a303-4949-ad7f-c3db4b354d8f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:09.970533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cccd9-a303-4949-ad7f-c3db4b354d8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:09.981130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8cccd9-a303-4949-ad7f-c3db4b354d8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:09.982558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8cccd9-a303-4949-ad7f-c3db4b354d8f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:09.998149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-3d8cccd9-a303-4949-ad7f-c3db4b354d8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:09.998149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:09.998149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:09.998149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:09.998149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:09.998149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:09.998149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:09.998149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:09.998149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:09.998149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:09.998149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:09.998149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:09.998149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:28:09.998149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:28:09.998149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:28:09.998149 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:28:09.999118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:09.999118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:09.999118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:09.999118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:09.999118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:09.999118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:09.999118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:09.999118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:09.999118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:09.999118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:09.999118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:09.999118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:09.999118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:09.999118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:09.999118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:09.999118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:09.999118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:28:10.000386 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:28:10.000386 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:10.000386 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:10.000386 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 454/898] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:10.006465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355a840-7998-421b-956d-96c6ca5b04df None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:10.123544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355a840-7998-421b-956d-96c6ca5b04df None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:10.131125 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:10.154305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e4109-4390-4ae9-a17a-4df09cce8d1a None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:10.154849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e4109-4390-4ae9-a17a-4df09cce8d1a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:10.154849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e4109-4390-4ae9-a17a-4df09cce8d1a None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:10.156173 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 455/899] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:10.161169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644393f9-361e-4127-bbf3-d1a2744c81ab None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:10.161450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644393f9-361e-4127-bbf3-d1a2744c81ab None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:10.161724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644393f9-361e-4127-bbf3-d1a2744c81ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:10.163921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f957e-e56b-4b33-ab8b-eaf07202821c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:10.165198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f957e-e56b-4b33-ab8b-eaf07202821c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:10.165562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f957e-e56b-4b33-ab8b-eaf07202821c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:10.165908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f957e-e56b-4b33-ab8b-eaf07202821c None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:10.166549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f957e-e56b-4b33-ab8b-eaf07202821c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:10.166918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f957e-e56b-4b33-ab8b-eaf07202821c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:10.168374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f957e-e56b-4b33-ab8b-eaf07202821c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:10.180667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-644393f9-361e-4127-bbf3-d1a2744c81ab None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:10.181876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-644393f9-361e-4127-bbf3-d1a2744c81ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:10.185310 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 445/900] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:10.189676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f957e-e56b-4b33-ab8b-eaf07202821c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:10.258272 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 456/901] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:28:10.308856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f957e-e56b-4b33-ab8b-eaf07202821c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:10.349725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7179cb-af8b-4e78-b50a-dd133e4ca412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:10.350689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7179cb-af8b-4e78-b50a-dd133e4ca412 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:10.351197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7179cb-af8b-4e78-b50a-dd133e4ca412 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:10.352358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7179cb-af8b-4e78-b50a-dd133e4ca412 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:10.359743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7179cb-af8b-4e78-b50a-dd133e4ca412 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:10.361427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7179cb-af8b-4e78-b50a-dd133e4ca412 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:10.373602 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-fa7179cb-af8b-4e78-b50a-dd133e4ca412 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:28:10.373602 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:10.373602 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:10.373602 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:10.373602 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:10.373602 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:10.373602 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:10.373602 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:10.373602 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:10.373602 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:10.373602 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:10.373602 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:10.373602 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:28:10.373602 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:28:10.373602 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:28:10.374515 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:28:10.374515 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:10.374515 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:10.374515 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:10.374515 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:10.374515 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:10.374515 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:10.374515 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:10.374515 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:10.374515 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:10.374515 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:10.374515 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:10.374515 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:10.374515 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:10.374515 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:10.374515 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:10.374515 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:10.375416 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:28:10.375416 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:28:10.375416 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:28:10.375416 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:28:10.375416 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:28:10.375416 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:28:10.375416 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:28:10.375416 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:10.377816 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 446/902] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:28:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:10.383568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644393f9-361e-4127-bbf3-d1a2744c81ab None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:10.387226 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:10.495163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644393f9-361e-4127-bbf3-d1a2744c81ab None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:10.534361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06871d-876f-468e-bd0a-e6b87b5bb9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:10.534900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06871d-876f-468e-bd0a-e6b87b5bb9a0 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:10.535202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06871d-876f-468e-bd0a-e6b87b5bb9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:10.535438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06871d-876f-468e-bd0a-e6b87b5bb9a0 None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:10.536126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06871d-876f-468e-bd0a-e6b87b5bb9a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:10.536431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06871d-876f-468e-bd0a-e6b87b5bb9a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:10.537886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06871d-876f-468e-bd0a-e6b87b5bb9a0 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:10.555792 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 457/903] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:28:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:10.557200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7179cb-af8b-4e78-b50a-dd133e4ca412 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:10.578722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06871d-876f-468e-bd0a-e6b87b5bb9a0 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:10.587566 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:10.657329 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:10.684232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7179cb-af8b-4e78-b50a-dd133e4ca412 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:10.710187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06871d-876f-468e-bd0a-e6b87b5bb9a0 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:10.722540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9190d21-378d-4a0a-ae53-e4ea704beb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:10.722917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9190d21-378d-4a0a-ae53-e4ea704beb16 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:10.723191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9190d21-378d-4a0a-ae53-e4ea704beb16 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:10.723457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9190d21-378d-4a0a-ae53-e4ea704beb16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:10.724173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9190d21-378d-4a0a-ae53-e4ea704beb16 None admin] RBAC: Adding query filter params (role.id=a147711fae6d4aa1873fdea65ad1663b, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=9bdab836a64d43ea842629d29b6f8d47) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:10.724473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9190d21-378d-4a0a-ae53-e4ea704beb16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:10.726090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9190d21-378d-4a0a-ae53-e4ea704beb16 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:10.736695 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 447/904] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:28:10 2022] GET /identity/v3/role_assignments?user.id=9bdab836a64d43ea842629d29b6f8d47&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=a147711fae6d4aa1873fdea65ad1663b => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:10.761609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aed5b5-b0be-4293-9529-6c26323c69af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:10.762240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aed5b5-b0be-4293-9529-6c26323c69af None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:10.762518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aed5b5-b0be-4293-9529-6c26323c69af None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:10.762788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aed5b5-b0be-4293-9529-6c26323c69af None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:10.763455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aed5b5-b0be-4293-9529-6c26323c69af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:10.764880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aed5b5-b0be-4293-9529-6c26323c69af None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:10.785721 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 458/905] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Sep 30 09:28:10 2022] POST /identity/v3/services => generated 241 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:28:11.064124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edcdf8-82a7-4859-92dc-e2ec3d1c1169 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:11.064422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edcdf8-82a7-4859-92dc-e2ec3d1c1169 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:11.064617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edcdf8-82a7-4859-92dc-e2ec3d1c1169 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:11.066251 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 448/906] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:11.071887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16950bf9-0084-4cbf-8c67-13c1dd864cfb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:11.072180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16950bf9-0084-4cbf-8c67-13c1dd864cfb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:11.072454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16950bf9-0084-4cbf-8c67-13c1dd864cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:11.092282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-16950bf9-0084-4cbf-8c67-13c1dd864cfb None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:11.093479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-16950bf9-0084-4cbf-8c67-13c1dd864cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:11.171847 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 459/907] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:11.444178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edcdf8-82a7-4859-92dc-e2ec3d1c1169 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:11.555907 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:11.571749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edcdf8-82a7-4859-92dc-e2ec3d1c1169 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:11.617297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554e7f9-340b-4814-8049-1577aff05b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:11.618933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554e7f9-340b-4814-8049-1577aff05b4e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:11.619428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554e7f9-340b-4814-8049-1577aff05b4e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:11.619972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554e7f9-340b-4814-8049-1577aff05b4e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:11.620795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554e7f9-340b-4814-8049-1577aff05b4e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:11.622356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554e7f9-340b-4814-8049-1577aff05b4e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:11.638667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-8554e7f9-340b-4814-8049-1577aff05b4e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:28:11.638667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:11.638667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:28:11.638667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:28:11.638667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:28:11.638667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:28:11.638667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:28:11.638667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:11.638667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:28:11.638667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:11.638667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:28:11.638667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:11.638667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:11.638667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:11.638667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:11.638667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:11.640341 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:11.640341 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:11.640341 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:11.640341 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:11.640341 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:11.640341 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:11.640341 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:11.640341 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:28:11.640341 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:28:11.640341 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:28:11.640341 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:28:11.640341 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:11.640341 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:11.640341 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:11.640341 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:11.640341 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:11.640341 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:11.641270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:11.641270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:11.641270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:11.641270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:11.641270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:11.641270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:11.641270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:11.641270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:11.641270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:11.641270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:11.641270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:28:11.641270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:11.641270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:28:11.641270 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:11.645254 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 449/908] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Sep 30 09:28:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:11.654045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16950bf9-0084-4cbf-8c67-13c1dd864cfb None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:11.732979 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:11.796285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16950bf9-0084-4cbf-8c67-13c1dd864cfb None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:11.833531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf8bf8-edea-4e44-b0b9-18ddc89b1396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:11.834507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf8bf8-edea-4e44-b0b9-18ddc89b1396 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:11.834992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf8bf8-edea-4e44-b0b9-18ddc89b1396 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:11.835478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf8bf8-edea-4e44-b0b9-18ddc89b1396 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:11.836908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf8bf8-edea-4e44-b0b9-18ddc89b1396 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:11.837411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf8bf8-edea-4e44-b0b9-18ddc89b1396 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:11.838991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf8bf8-edea-4e44-b0b9-18ddc89b1396 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:11.844797 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 460/909] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Sep 30 09:28:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:11.857172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554e7f9-340b-4814-8049-1577aff05b4e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:11.863749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b508f78-570c-4ff7-8973-3e97fea6e752 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:11.864033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b508f78-570c-4ff7-8973-3e97fea6e752 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:11.864301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b508f78-570c-4ff7-8973-3e97fea6e752 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:11.865903 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 461/910] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:28:11.872543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c47df8-760a-46a6-a896-2d4ab27196db None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:11.872929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c47df8-760a-46a6-a896-2d4ab27196db None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:11.873153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c47df8-760a-46a6-a896-2d4ab27196db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:11.894683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-77c47df8-760a-46a6-a896-2d4ab27196db None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:11.895889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-77c47df8-760a-46a6-a896-2d4ab27196db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:11.982533 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 462/911] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:28:12.000556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554e7f9-340b-4814-8049-1577aff05b4e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:12.045471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afca6e6-d27d-46ec-b2b1-41cf94147dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:12.046379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afca6e6-d27d-46ec-b2b1-41cf94147dc1 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:12.047768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afca6e6-d27d-46ec-b2b1-41cf94147dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:12.047768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afca6e6-d27d-46ec-b2b1-41cf94147dc1 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:12.047768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afca6e6-d27d-46ec-b2b1-41cf94147dc1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:12.047768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afca6e6-d27d-46ec-b2b1-41cf94147dc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:12.049393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afca6e6-d27d-46ec-b2b1-41cf94147dc1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:12.056736 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 450/912] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Sep 30 09:28:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:12.065155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c47df8-760a-46a6-a896-2d4ab27196db None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:12.128898 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:12.197856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c47df8-760a-46a6-a896-2d4ab27196db None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:12.238016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02035c19-549a-4516-b630-275a8c933b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:12.238980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02035c19-549a-4516-b630-275a8c933b09 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:12.239482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02035c19-549a-4516-b630-275a8c933b09 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:12.239967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02035c19-549a-4516-b630-275a8c933b09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:12.240918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02035c19-549a-4516-b630-275a8c933b09 None admin] RBAC: Adding query filter params (interface=public, service_id=042a032df1c44d408c0803826d09134d, region_id=RegionOne) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:12.241416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02035c19-549a-4516-b630-275a8c933b09 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:12.243699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02035c19-549a-4516-b630-275a8c933b09 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:12.255747 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 463/913] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Sep 30 09:28:12 2022] GET /identity/v3/endpoints?service_id=042a032df1c44d408c0803826d09134d&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:12.261358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afca6e6-d27d-46ec-b2b1-41cf94147dc1 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:12.261720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02035c19-549a-4516-b630-275a8c933b09 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:12.286743 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:12.388635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02035c19-549a-4516-b630-275a8c933b09 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:12.396898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afca6e6-d27d-46ec-b2b1-41cf94147dc1 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:12.405703 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:12.437234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba84b4-b7bd-4455-b9b2-91b56a3866b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:12.437877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba84b4-b7bd-4455-b9b2-91b56a3866b6 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:12.438151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba84b4-b7bd-4455-b9b2-91b56a3866b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:12.438271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c37703-95d8-4b52-a709-d5280c59ec0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:12.438442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba84b4-b7bd-4455-b9b2-91b56a3866b6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:12.438983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba84b4-b7bd-4455-b9b2-91b56a3866b6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:12.439086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c37703-95d8-4b52-a709-d5280c59ec0e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:12.439347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c37703-95d8-4b52-a709-d5280c59ec0e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:12.439693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c37703-95d8-4b52-a709-d5280c59ec0e None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:12.440310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba84b4-b7bd-4455-b9b2-91b56a3866b6 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:12.440413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c37703-95d8-4b52-a709-d5280c59ec0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:12.441816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c37703-95d8-4b52-a709-d5280c59ec0e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:12.449565 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 464/914] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Sep 30 09:28:12 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:28:12.450083 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-93ba84b4-b7bd-4455-b9b2-91b56a3866b6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:28:12.450083 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:12.450083 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:28:12.450083 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:28:12.450083 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:28:12.450083 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:28:12.450083 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:28:12.450083 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:12.450083 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:28:12.450083 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:12.450083 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:28:12.450083 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:12.450083 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:12.450083 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:12.450083 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:12.450083 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:12.450083 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:12.451546 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:12.451546 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:12.451546 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:12.451546 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:12.451546 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:12.451546 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:12.451546 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:28:12.451546 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:28:12.451546 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:28:12.451546 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:28:12.451546 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:12.451546 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:12.451546 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:12.451546 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:12.451546 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:12.451546 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:12.452565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:12.452565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:12.452565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:12.452565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:12.452565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:12.452565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:12.452565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:12.452565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:12.452565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:12.452565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:12.452565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:28:12.452565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:12.452565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 09:28:12.452565 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:12.453513 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 451/915] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Sep 30 09:28:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:12.459689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c37703-95d8-4b52-a709-d5280c59ec0e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:12.578628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c37703-95d8-4b52-a709-d5280c59ec0e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:12.618091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929599a-0d4b-4687-9aac-48aa107f8e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:12.618714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929599a-0d4b-4687-9aac-48aa107f8e32 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:12.618994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929599a-0d4b-4687-9aac-48aa107f8e32 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:12.619267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929599a-0d4b-4687-9aac-48aa107f8e32 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:12.619910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929599a-0d4b-4687-9aac-48aa107f8e32 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:12.620216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929599a-0d4b-4687-9aac-48aa107f8e32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:12.621631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929599a-0d4b-4687-9aac-48aa107f8e32 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:12.627396 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 465/916] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Sep 30 09:28:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:12.634532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba84b4-b7bd-4455-b9b2-91b56a3866b6 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:12.729016 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:12.750391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba84b4-b7bd-4455-b9b2-91b56a3866b6 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:12.786694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e73a5d-3fe8-4b69-a77d-236c6522b729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:12.787692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e73a5d-3fe8-4b69-a77d-236c6522b729 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:12.788171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e73a5d-3fe8-4b69-a77d-236c6522b729 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:12.788678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e73a5d-3fe8-4b69-a77d-236c6522b729 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:12.790032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e73a5d-3fe8-4b69-a77d-236c6522b729 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:12.790566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e73a5d-3fe8-4b69-a77d-236c6522b729 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:12.792109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e73a5d-3fe8-4b69-a77d-236c6522b729 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:12.798053 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 452/917] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Sep 30 09:28:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:12.803849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929599a-0d4b-4687-9aac-48aa107f8e32 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:12.844676 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:12.922888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929599a-0d4b-4687-9aac-48aa107f8e32 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:12.961569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42d37f-da4a-4449-a04b-24ac7557b4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:12.962181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42d37f-da4a-4449-a04b-24ac7557b4cb None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:12.962501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42d37f-da4a-4449-a04b-24ac7557b4cb None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:12.962773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42d37f-da4a-4449-a04b-24ac7557b4cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:12.963447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42d37f-da4a-4449-a04b-24ac7557b4cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:12.964821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42d37f-da4a-4449-a04b-24ac7557b4cb None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:12.993465 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 466/918] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:28:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:28:13.166095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb42bea-9cac-40e1-bfe9-6ce7cd20afac None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:13.166279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb42bea-9cac-40e1-bfe9-6ce7cd20afac None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:13.166536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb42bea-9cac-40e1-bfe9-6ce7cd20afac None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:13.168266 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 453/919] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:13.175100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33647f1f-f778-4bb4-86e3-c68eb51a6770 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:13.175100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33647f1f-f778-4bb4-86e3-c68eb51a6770 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:13.175100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33647f1f-f778-4bb4-86e3-c68eb51a6770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:13.194844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-33647f1f-f778-4bb4-86e3-c68eb51a6770 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:13.196338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-33647f1f-f778-4bb4-86e3-c68eb51a6770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:13.268032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876c19-a893-490f-a629-d91fd01261ad None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:13.268368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876c19-a893-490f-a629-d91fd01261ad None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:13.268575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876c19-a893-490f-a629-d91fd01261ad None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:13.270187 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 454/920] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:28:13.276114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf24f4c-9370-4018-9b4c-a2f554265fe3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:13.276398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf24f4c-9370-4018-9b4c-a2f554265fe3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:13.276706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf24f4c-9370-4018-9b4c-a2f554265fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:13.277303 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 467/921] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:13.298491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dbf24f4c-9370-4018-9b4c-a2f554265fe3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:13.300069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dbf24f4c-9370-4018-9b4c-a2f554265fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:13.374739 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 455/922] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:28:13.564337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33647f1f-f778-4bb4-86e3-c68eb51a6770 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:13.584024 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:13.651767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf24f4c-9370-4018-9b4c-a2f554265fe3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:13.675398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33647f1f-f778-4bb4-86e3-c68eb51a6770 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:13.724102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4122d-86a4-478b-a178-95e3fad31b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:13.724864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4122d-86a4-478b-a178-95e3fad31b6f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:13.725150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4122d-86a4-478b-a178-95e3fad31b6f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:13.725686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4122d-86a4-478b-a178-95e3fad31b6f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:13.727010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4122d-86a4-478b-a178-95e3fad31b6f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:13.729033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4122d-86a4-478b-a178-95e3fad31b6f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:13.738367 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:13.739502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-58d4122d-86a4-478b-a178-95e3fad31b6f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:28:13.739502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:13.739502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:28:13.739502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:28:13.739502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:28:13.739502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:28:13.739502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:28:13.739502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:13.739502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:28:13.739502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:13.739502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:28:13.739502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:13.739502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:13.739502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:13.739502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:13.739502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:13.739502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:13.740583 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:13.740583 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:13.740583 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:13.740583 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:13.740583 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:13.740583 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:13.740583 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:28:13.740583 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:28:13.740583 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:28:13.740583 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:28:13.740583 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:13.740583 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:13.740583 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:13.740583 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:13.740583 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:13.740583 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:13.741494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:13.741494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:13.741494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:13.741494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:13.741494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:13.741494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:13.741494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:13.741494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:13.741494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:13.741494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:13.741494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:28:13.741494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:13.741494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:28:13.741494 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:13.745828 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 468/923] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Sep 30 09:28:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:13.751154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4122d-86a4-478b-a178-95e3fad31b6f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:13.778130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf24f4c-9370-4018-9b4c-a2f554265fe3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:13.822578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5239df-757a-4513-8b7d-89626a428436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:13.823134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5239df-757a-4513-8b7d-89626a428436 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:13.823454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5239df-757a-4513-8b7d-89626a428436 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:13.823736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5239df-757a-4513-8b7d-89626a428436 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:13.837108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5239df-757a-4513-8b7d-89626a428436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:28:13.841257 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:13.842795 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-db5239df-757a-4513-8b7d-89626a428436 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:28:13.842795 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:13.842795 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:13.842795 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:13.842795 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:13.842795 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:13.842795 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:13.842795 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:13.842795 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:13.842795 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:13.842795 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:13.842795 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:13.842795 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:28:13.842795 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:28:13.842795 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:28:13.842795 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:28:13.843882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:28:13.843882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:28:13.843882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:28:13.843882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:28:13.843882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:13.843882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:13.843882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:13.843882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:13.843882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:13.843882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:13.843882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:13.843882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:13.843882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:13.843882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:13.843882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:13.843882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:13.844744 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:13.844744 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:13.844744 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:13.844744 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:13.844744 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:28:13.844744 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:28:13.844744 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:28:13.844744 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:28:13.844744 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:28:13.844744 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:28:13.844744 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:28:13.844744 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:13.848670 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 456/924] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Sep 30 09:28:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:13.850694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5239df-757a-4513-8b7d-89626a428436 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:13.868967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4122d-86a4-478b-a178-95e3fad31b6f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:13.915043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2b44a-b1d5-43b1-9136-18902e18c21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:13.915043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2b44a-b1d5-43b1-9136-18902e18c21e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:13.915043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2b44a-b1d5-43b1-9136-18902e18c21e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:13.915043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2b44a-b1d5-43b1-9136-18902e18c21e None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:13.915457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2b44a-b1d5-43b1-9136-18902e18c21e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:13.915457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2b44a-b1d5-43b1-9136-18902e18c21e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:13.918844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2b44a-b1d5-43b1-9136-18902e18c21e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:13.931821 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 469/925] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Sep 30 09:28:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:13.934415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2b44a-b1d5-43b1-9136-18902e18c21e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:13.982674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5239df-757a-4513-8b7d-89626a428436 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:14.026385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15e1e1-56c2-4199-9fc6-736c7393f4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:14.027415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15e1e1-56c2-4199-9fc6-736c7393f4fe None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:14.027924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15e1e1-56c2-4199-9fc6-736c7393f4fe None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:14.028395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15e1e1-56c2-4199-9fc6-736c7393f4fe None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:14.031115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15e1e1-56c2-4199-9fc6-736c7393f4fe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:14.031951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15e1e1-56c2-4199-9fc6-736c7393f4fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:14.033824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15e1e1-56c2-4199-9fc6-736c7393f4fe None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:14.037478 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:14.054377 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 457/926] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Sep 30 09:28:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:14.055960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15e1e1-56c2-4199-9fc6-736c7393f4fe None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:14.073864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2b44a-b1d5-43b1-9136-18902e18c21e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:14.119434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c052d-0200-4b10-bf07-6ddf7e9452c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:14.120387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c052d-0200-4b10-bf07-6ddf7e9452c6 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:14.120761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c052d-0200-4b10-bf07-6ddf7e9452c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:14.121089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c052d-0200-4b10-bf07-6ddf7e9452c6 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:14.121782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c052d-0200-4b10-bf07-6ddf7e9452c6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:14.122386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c052d-0200-4b10-bf07-6ddf7e9452c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:14.124519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c052d-0200-4b10-bf07-6ddf7e9452c6 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:14.136683 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 470/927] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Sep 30 09:28:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:14.138744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c052d-0200-4b10-bf07-6ddf7e9452c6 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:14.156161 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:14.178915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15e1e1-56c2-4199-9fc6-736c7393f4fe None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:14.219310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bf754-f181-4ed0-a83b-da9b2654aef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:14.219944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bf754-f181-4ed0-a83b-da9b2654aef2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:14.220273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bf754-f181-4ed0-a83b-da9b2654aef2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:14.220554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bf754-f181-4ed0-a83b-da9b2654aef2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:14.233286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bf754-f181-4ed0-a83b-da9b2654aef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:14.234892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bf754-f181-4ed0-a83b-da9b2654aef2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:14.252131 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-620bf754-f181-4ed0-a83b-da9b2654aef2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:14.252131 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:14.252131 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:14.252131 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:14.252131 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:14.252131 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:14.252131 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:14.252131 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:14.252131 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:14.252131 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:14.252131 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:14.252131 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:14.252131 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:28:14.252131 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:28:14.252131 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:28:14.252131 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:28:14.253201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:14.253201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:14.253201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:14.253201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:14.253201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:14.253201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:14.253201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:14.253201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:14.253201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:14.253201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:14.253201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:14.253201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:14.253201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:14.253201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:14.253201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:14.253201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:14.253201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:28:14.254067 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:28:14.254067 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:14.254067 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:14.258534 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 458/928] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:14.259389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bf754-f181-4ed0-a83b-da9b2654aef2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:14.278991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c052d-0200-4b10-bf07-6ddf7e9452c6 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:14.314420 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:14.327272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3526ea4-0ac1-41fd-a649-b27e96d56513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:14.328090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3526ea4-0ac1-41fd-a649-b27e96d56513 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:14.328373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3526ea4-0ac1-41fd-a649-b27e96d56513 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:14.328684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3526ea4-0ac1-41fd-a649-b27e96d56513 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:14.329384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3526ea4-0ac1-41fd-a649-b27e96d56513 None admin] RBAC: Adding query filter params (interface=public, service_id=947aa5f32dbd4caba70307b24ce049a0, region_id=RegionOne) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:14.329743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3526ea4-0ac1-41fd-a649-b27e96d56513 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:14.331122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3526ea4-0ac1-41fd-a649-b27e96d56513 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:14.341417 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 471/929] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Sep 30 09:28:14 2022] GET /identity/v3/endpoints?service_id=947aa5f32dbd4caba70307b24ce049a0&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:14.342633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3526ea4-0ac1-41fd-a649-b27e96d56513 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:14.380399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bf754-f181-4ed0-a83b-da9b2654aef2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:14.420057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da180ef8-1698-4261-a98b-46cc93532ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:14.421026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da180ef8-1698-4261-a98b-46cc93532ade None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:14.421481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da180ef8-1698-4261-a98b-46cc93532ade None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:14.421953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da180ef8-1698-4261-a98b-46cc93532ade None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:14.422763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da180ef8-1698-4261-a98b-46cc93532ade None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:14.423234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da180ef8-1698-4261-a98b-46cc93532ade None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:14.424124 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:14.425609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da180ef8-1698-4261-a98b-46cc93532ade None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:14.440490 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 459/930] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:14.446098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da180ef8-1698-4261-a98b-46cc93532ade None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:14.452192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3526ea4-0ac1-41fd-a649-b27e96d56513 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:14.487421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4a075-a744-412b-b814-1df0895976f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:14.488135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4a075-a744-412b-b814-1df0895976f2 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:14.488470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4a075-a744-412b-b814-1df0895976f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:14.488838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4a075-a744-412b-b814-1df0895976f2 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:14.489948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4a075-a744-412b-b814-1df0895976f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:14.490907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4a075-a744-412b-b814-1df0895976f2 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:14.504757 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 472/931] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Sep 30 09:28:14 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:28:14.568854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da180ef8-1698-4261-a98b-46cc93532ade None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:14.582413 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:14.613748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd5b03-fb0d-410f-a17b-2934a09f742b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:14.614731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd5b03-fb0d-410f-a17b-2934a09f742b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:14.615190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd5b03-fb0d-410f-a17b-2934a09f742b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:14.615641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd5b03-fb0d-410f-a17b-2934a09f742b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:14.625846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd5b03-fb0d-410f-a17b-2934a09f742b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:14.627684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd5b03-fb0d-410f-a17b-2934a09f742b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:14.642456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-f6cd5b03-fb0d-410f-a17b-2934a09f742b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:28:14.642456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:14.642456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:14.642456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:14.642456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:14.642456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:14.642456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:14.642456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:14.642456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:14.642456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:14.642456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:14.642456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:14.642456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:28:14.642456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:28:14.642456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:28:14.642456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:28:14.643477 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:14.643477 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:14.643477 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:28:14.643477 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:14.643477 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:28:14.643477 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:14.643477 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:14.643477 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:14.643477 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:14.643477 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:14.643477 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:14.643477 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:14.643477 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:14.643477 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:14.643477 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:14.643477 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:14.643477 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:14.643477 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:14.644444 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:14.644444 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:14.644444 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:28:14.644444 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:28:14.644444 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:28:14.644444 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:28:14.644444 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:28:14.644444 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:28:14.644444 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:28:14.644444 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:14.646927 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 460/932] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Sep 30 09:28:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:14.653391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4a075-a744-412b-b814-1df0895976f2 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:14.744228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc6f78-10c5-4ec6-b87c-60a59d3162d0 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:14.744799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc6f78-10c5-4ec6-b87c-60a59d3162d0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:14.744799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc6f78-10c5-4ec6-b87c-60a59d3162d0 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:14.746352 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 461/933] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:14.751354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bfe90-74b2-4743-b8e7-53794246760e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:14.751633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bfe90-74b2-4743-b8e7-53794246760e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:14.751901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bfe90-74b2-4743-b8e7-53794246760e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:14.770693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-891bfe90-74b2-4743-b8e7-53794246760e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:14.771143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4a075-a744-412b-b814-1df0895976f2 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:14.771911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-891bfe90-74b2-4743-b8e7-53794246760e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:14.819262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34972211-d7e9-4c14-b46f-de9d5ae76ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:14.820773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34972211-d7e9-4c14-b46f-de9d5ae76ab1 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:14.821305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34972211-d7e9-4c14-b46f-de9d5ae76ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:14.821728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34972211-d7e9-4c14-b46f-de9d5ae76ab1 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:14.822853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34972211-d7e9-4c14-b46f-de9d5ae76ab1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:14.823871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34972211-d7e9-4c14-b46f-de9d5ae76ab1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:14.826819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34972211-d7e9-4c14-b46f-de9d5ae76ab1 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:14.840494 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:14.852894 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 462/934] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:28:14.853209 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 473/935] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Sep 30 09:28:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:14.860882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bfe90-74b2-4743-b8e7-53794246760e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:14.961038 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:14.964979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bfe90-74b2-4743-b8e7-53794246760e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:15.001328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221f19d-ce03-4fac-9df7-3786dca513e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:15.002199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221f19d-ce03-4fac-9df7-3786dca513e8 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:15.002663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221f19d-ce03-4fac-9df7-3786dca513e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:15.003082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221f19d-ce03-4fac-9df7-3786dca513e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:15.013498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221f19d-ce03-4fac-9df7-3786dca513e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:15.015115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221f19d-ce03-4fac-9df7-3786dca513e8 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:15.030033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-a221f19d-ce03-4fac-9df7-3786dca513e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:15.030033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:15.030033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:15.030033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:15.030033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:15.030033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:15.030033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:15.030033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:15.030033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:15.030033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:15.030033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:15.030033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:15.030033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:28:15.030033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:28:15.030033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:28:15.030033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:28:15.031192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:15.031192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:15.031192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:15.031192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:15.031192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:15.031192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:15.031192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:15.031192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:15.031192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:15.031192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:15.031192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:15.031192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:15.031192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:15.031192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:15.031192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:15.031192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:15.031192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:28:15.032306 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:28:15.032306 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:15.032306 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:15.033975 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 463/936] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:15.040316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34972211-d7e9-4c14-b46f-de9d5ae76ab1 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:15.122031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221f19d-ce03-4fac-9df7-3786dca513e8 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:15.154249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34972211-d7e9-4c14-b46f-de9d5ae76ab1 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:15.194832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b36847-b7bc-4984-a48c-f52d8f781ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:15.196202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b36847-b7bc-4984-a48c-f52d8f781ad6 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:15.196527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b36847-b7bc-4984-a48c-f52d8f781ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:15.196769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b36847-b7bc-4984-a48c-f52d8f781ad6 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:15.197412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b36847-b7bc-4984-a48c-f52d8f781ad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:15.197710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b36847-b7bc-4984-a48c-f52d8f781ad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:15.199181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b36847-b7bc-4984-a48c-f52d8f781ad6 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:15.212639 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 474/937] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:15.217831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b36847-b7bc-4984-a48c-f52d8f781ad6 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:15.242535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221f19d-ce03-4fac-9df7-3786dca513e8 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:15.281473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d25ef-ce3c-4bf2-94b2-405940fe12f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:15.282109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d25ef-ce3c-4bf2-94b2-405940fe12f6 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:15.282391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d25ef-ce3c-4bf2-94b2-405940fe12f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:15.282661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d25ef-ce3c-4bf2-94b2-405940fe12f6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:15.283252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d25ef-ce3c-4bf2-94b2-405940fe12f6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:15.284768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d25ef-ce3c-4bf2-94b2-405940fe12f6 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:15.288184 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:15.296996 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-9c5d25ef-ce3c-4bf2-94b2-405940fe12f6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:28:15.296996 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:15.296996 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:28:15.296996 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:28:15.296996 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:28:15.296996 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:28:15.296996 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:28:15.296996 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:15.296996 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:28:15.296996 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:15.296996 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:28:15.296996 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:15.296996 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:15.296996 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:15.296996 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:15.296996 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:15.298071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:15.298071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:15.298071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:15.298071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:15.298071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:15.298071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:15.298071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:15.298071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:28:15.298071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:28:15.298071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:28:15.298071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:28:15.298071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:15.298071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:15.298071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:15.298071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:15.298071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:15.298071 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:15.298981 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:15.298981 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:15.298981 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:15.298981 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:15.298981 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:15.298981 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:15.298981 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:15.298981 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:15.298981 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:15.298981 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:15.298981 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:28:15.298981 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:15.298981 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 09:28:15.298981 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:15.301408 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 464/938] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Sep 30 09:28:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:15.309606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d25ef-ce3c-4bf2-94b2-405940fe12f6 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:15.336759 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:15.349309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b36847-b7bc-4984-a48c-f52d8f781ad6 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:15.387869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a1dc9-2a17-4a0d-958c-b9773b165573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:15.388406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a1dc9-2a17-4a0d-958c-b9773b165573 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:15.388716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a1dc9-2a17-4a0d-958c-b9773b165573 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:15.388987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a1dc9-2a17-4a0d-958c-b9773b165573 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:15.395766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a1dc9-2a17-4a0d-958c-b9773b165573 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:15.397221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a1dc9-2a17-4a0d-958c-b9773b165573 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:15.412849 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-514a1dc9-2a17-4a0d-958c-b9773b165573 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:28:15.412849 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:15.412849 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:15.412849 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:15.412849 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:15.412849 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:15.412849 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:15.412849 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:15.412849 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:15.412849 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:15.412849 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:15.412849 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:15.412849 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:28:15.412849 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:28:15.412849 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:28:15.413852 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:28:15.413852 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:15.413852 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:15.413852 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:15.413852 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:15.413852 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:15.413852 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:15.413852 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:15.413852 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:15.413852 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:15.413852 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:15.413852 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:15.413852 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:15.413852 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:15.413852 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:15.413852 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:15.413852 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:15.414916 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:28:15.414916 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:28:15.414916 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:28:15.414916 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:28:15.414916 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:28:15.414916 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:28:15.414916 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:28:15.414916 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:15.414916 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 475/939] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:28:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:15.416077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd82086-ffad-4c7f-8197-6307331df49c None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:15.416077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd82086-ffad-4c7f-8197-6307331df49c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:15.416329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd82086-ffad-4c7f-8197-6307331df49c None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:15.417735 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 476/940] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:15.425726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd82086-ffad-4c7f-8197-6307331df49c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:15.437262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d25ef-ce3c-4bf2-94b2-405940fe12f6 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:15.486929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e10477-4e94-41af-ac02-e56eacd29a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:15.487645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e10477-4e94-41af-ac02-e56eacd29a8d None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:15.487844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e10477-4e94-41af-ac02-e56eacd29a8d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:15.488107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e10477-4e94-41af-ac02-e56eacd29a8d None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:15.488790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e10477-4e94-41af-ac02-e56eacd29a8d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:15.489091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e10477-4e94-41af-ac02-e56eacd29a8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:15.490437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e10477-4e94-41af-ac02-e56eacd29a8d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:15.496165 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 465/941] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Sep 30 09:28:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:15.497344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a05936-1a2a-4b67-adae-bd887f0eb313 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:15.497623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a05936-1a2a-4b67-adae-bd887f0eb313 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:15.497892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a05936-1a2a-4b67-adae-bd887f0eb313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:15.515914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-21a05936-1a2a-4b67-adae-bd887f0eb313 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:15.517120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-21a05936-1a2a-4b67-adae-bd887f0eb313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:15.554916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd82086-ffad-4c7f-8197-6307331df49c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:15.572210 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:15.592332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442d095-4275-47f0-8cd8-f92ce2795a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:15.592941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442d095-4275-47f0-8cd8-f92ce2795a89 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:15.593256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442d095-4275-47f0-8cd8-f92ce2795a89 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:15.593476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442d095-4275-47f0-8cd8-f92ce2795a89 None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:15.594180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442d095-4275-47f0-8cd8-f92ce2795a89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:15.594454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442d095-4275-47f0-8cd8-f92ce2795a89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:15.595606 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 466/942] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:15.596356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a05936-1a2a-4b67-adae-bd887f0eb313 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:15.597093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442d095-4275-47f0-8cd8-f92ce2795a89 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:15.610167 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:15.615220 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 477/943] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:28:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:15.622346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442d095-4275-47f0-8cd8-f92ce2795a89 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:15.709995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a05936-1a2a-4b67-adae-bd887f0eb313 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:15.748491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3b125-3424-4bc4-8639-c765f28e1df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:15.749277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3b125-3424-4bc4-8639-c765f28e1df2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:15.749489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3b125-3424-4bc4-8639-c765f28e1df2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:15.749712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3b125-3424-4bc4-8639-c765f28e1df2 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:15.750344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3b125-3424-4bc4-8639-c765f28e1df2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:15.750638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3b125-3424-4bc4-8639-c765f28e1df2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:15.752048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3b125-3424-4bc4-8639-c765f28e1df2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:15.759831 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 467/944] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Sep 30 09:28:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:15.765582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3b125-3424-4bc4-8639-c765f28e1df2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:15.770619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442d095-4275-47f0-8cd8-f92ce2795a89 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:15.816305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8f802-9138-4344-83ae-75d367100983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:15.817426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8f802-9138-4344-83ae-75d367100983 None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:15.818125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8f802-9138-4344-83ae-75d367100983 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:15.819054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8f802-9138-4344-83ae-75d367100983 None admin] PATH_INFO: `/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/9bdab836a64d43ea842629d29b6f8d47/roles/a147711fae6d4aa1873fdea65ad1663b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:15.823153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8f802-9138-4344-83ae-75d367100983 None admin] RBAC: Authorizing `identity:create_grant(project_id=1fbc72b5e3b84c8fb74d8d4952a26e76, user_id=9bdab836a64d43ea842629d29b6f8d47, role_id=a147711fae6d4aa1873fdea65ad1663b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:15.824829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8f802-9138-4344-83ae-75d367100983 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:15.844027 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 478/945] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:28:15 2022] PUT /identity/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/9bdab836a64d43ea842629d29b6f8d47/roles/a147711fae6d4aa1873fdea65ad1663b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:28:15.858626 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:15.877904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8f802-9138-4344-83ae-75d367100983 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:15.892829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3b125-3424-4bc4-8639-c765f28e1df2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:15.922331 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:15.936795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038161c3-43b9-47d4-9200-f7356ceacaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:15.937701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038161c3-43b9-47d4-9200-f7356ceacaa1 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:15.937998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038161c3-43b9-47d4-9200-f7356ceacaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:15.938272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038161c3-43b9-47d4-9200-f7356ceacaa1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:15.938969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038161c3-43b9-47d4-9200-f7356ceacaa1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:15.940356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038161c3-43b9-47d4-9200-f7356ceacaa1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:15.972792 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 468/946] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:28:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:28:16.020588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8f802-9138-4344-83ae-75d367100983 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:16.073451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafa3f2-bdaa-41bc-bb26-88e23e5c3ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:16.074490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafa3f2-bdaa-41bc-bb26-88e23e5c3ba2 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:16.075288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafa3f2-bdaa-41bc-bb26-88e23e5c3ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:16.075803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafa3f2-bdaa-41bc-bb26-88e23e5c3ba2 None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:16.076797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafa3f2-bdaa-41bc-bb26-88e23e5c3ba2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:16.078660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafa3f2-bdaa-41bc-bb26-88e23e5c3ba2 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:16.081736 n-d-master-1 devstack@keystone.service[82079]: WARNING keystone.server.flask.common [None req-6cafa3f2-bdaa-41bc-bb26-88e23e5c3ba2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 30 09:28:16.103221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.sql.core [None req-6cafa3f2-bdaa-41bc-bb26-88e23e5c3ba2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 30 09:28:16.103221 n-d-master-1 devstack@keystone.service[82079]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 30 09:28:16.103221 n-d-master-1 devstack@keystone.service[82079]: [parameters: {'id': 'a4f82c973501466ab601fe990bfef9c2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 30 09:28:16.103221 n-d-master-1 devstack@keystone.service[82079]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82079) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 30 09:28:16.122309 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-6cafa3f2-bdaa-41bc-bb26-88e23e5c3ba2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a4f82c973501466ab601fe990bfef9c2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a4f82c973501466ab601fe990bfef9c2. Sep 30 09:28:16.122309 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:16.122309 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 09:28:16.122309 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 09:28:16.122309 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 09:28:16.122309 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 09:28:16.122309 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 09:28:16.122309 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 09:28:16.122309 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 09:28:16.122309 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application conn.query(q) Sep 30 09:28:16.122309 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 09:28:16.122309 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 09:28:16.122309 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 09:28:16.123391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result.read() Sep 30 09:28:16.123391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 09:28:16.123391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 09:28:16.123391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 09:28:16.123391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 09:28:16.123391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 09:28:16.123391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 09:28:16.123391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 09:28:16.123391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 09:28:16.123391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 30 09:28:16.123391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:16.123391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 30 09:28:16.123391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:16.123391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:16.123391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 30 09:28:16.123391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 30 09:28:16.123391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 30 09:28:16.123391 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 30 09:28:16.124630 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 09:28:16.124630 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application next(self.gen) Sep 30 09:28:16.124630 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 30 09:28:16.124630 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application yield resource Sep 30 09:28:16.124630 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 09:28:16.124630 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application next(self.gen) Sep 30 09:28:16.124630 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 30 09:28:16.124630 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.session.rollback() Sep 30 09:28:16.124630 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 30 09:28:16.124630 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.force_reraise() Sep 30 09:28:16.124630 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 30 09:28:16.124630 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise self.value Sep 30 09:28:16.124630 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 30 09:28:16.124630 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 30 09:28:16.124630 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 30 09:28:16.124630 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application session.commit() Sep 30 09:28:16.124630 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 30 09:28:16.126011 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 30 09:28:16.126011 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 30 09:28:16.126011 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._prepare_impl() Sep 30 09:28:16.126011 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 30 09:28:16.126011 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.session.flush() Sep 30 09:28:16.126011 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 30 09:28:16.126011 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._flush(objects) Sep 30 09:28:16.126011 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 30 09:28:16.126011 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 30 09:28:16.126011 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 30 09:28:16.126011 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application compat.raise_( Sep 30 09:28:16.126011 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 09:28:16.126011 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception Sep 30 09:28:16.126011 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 30 09:28:16.126011 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application flush_context.execute() Sep 30 09:28:16.126011 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 30 09:28:16.126011 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rec.execute(self) Sep 30 09:28:16.126928 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 30 09:28:16.126928 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 30 09:28:16.126928 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 30 09:28:16.126928 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 30 09:28:16.126928 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 30 09:28:16.126928 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 30 09:28:16.126928 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 30 09:28:16.126928 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 30 09:28:16.126928 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 30 09:28:16.126928 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 30 09:28:16.126928 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 30 09:28:16.126928 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 30 09:28:16.126928 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 30 09:28:16.126928 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 30 09:28:16.126928 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 30 09:28:16.127749 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 30 09:28:16.127749 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 09:28:16.127749 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception Sep 30 09:28:16.127749 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 09:28:16.127749 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 09:28:16.127749 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 09:28:16.127749 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 09:28:16.127749 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 09:28:16.127749 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 09:28:16.127749 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 09:28:16.127749 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application conn.query(q) Sep 30 09:28:16.127749 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 09:28:16.127749 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 09:28:16.127749 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 09:28:16.127749 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result.read() Sep 30 09:28:16.127749 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 09:28:16.127749 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 09:28:16.128732 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 09:28:16.128732 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 09:28:16.128732 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 09:28:16.128732 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 09:28:16.128732 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 09:28:16.128732 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 09:28:16.128732 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 30 09:28:16.128732 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 30 09:28:16.128732 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [parameters: {'id': 'a4f82c973501466ab601fe990bfef9c2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 30 09:28:16.128732 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 30 09:28:16.128732 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:16.128732 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:28:16.128732 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:16.128732 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:16.128732 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 30 09:28:16.129616 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 30 09:28:16.129616 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 30 09:28:16.129616 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 30 09:28:16.129616 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 30 09:28:16.129616 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:16.129616 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:28:16.129616 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:16.129616 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:16.129616 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:16.129616 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:16.129616 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:16.129616 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:16.129616 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:16.129616 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:16.129616 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:16.129616 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:16.129616 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:16.130790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:16.130790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 30 09:28:16.130790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 30 09:28:16.130790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:16.130790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:16.130790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 30 09:28:16.130790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 30 09:28:16.130790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a4f82c973501466ab601fe990bfef9c2. Sep 30 09:28:16.130790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:16.133943 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 479/947] 10.222.0.16 () {60 vars in 1140 bytes} [Fri Sep 30 09:28:15 2022] POST /identity/v3/projects => generated 262 bytes in 256 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:16.140471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038161c3-43b9-47d4-9200-f7356ceacaa1 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:16.254614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038161c3-43b9-47d4-9200-f7356ceacaa1 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:16.284965 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:16.292617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03f1e8-53fc-4ddf-8f98-cb2d785bd30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:16.293329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03f1e8-53fc-4ddf-8f98-cb2d785bd30c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:16.293675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03f1e8-53fc-4ddf-8f98-cb2d785bd30c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:16.293947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03f1e8-53fc-4ddf-8f98-cb2d785bd30c None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:16.301889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03f1e8-53fc-4ddf-8f98-cb2d785bd30c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:16.303310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03f1e8-53fc-4ddf-8f98-cb2d785bd30c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:16.315769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-fe03f1e8-53fc-4ddf-8f98-cb2d785bd30c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:28:16.315769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:16.315769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:16.315769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:16.315769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:16.315769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:16.315769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:16.315769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:16.315769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:16.315769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:16.315769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:16.315769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:16.315769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:28:16.315769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:28:16.315769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:28:16.316902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:28:16.316902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:16.316902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:16.316902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:16.316902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:16.316902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:16.316902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:16.316902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:16.316902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:16.316902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:16.316902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:16.316902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:16.316902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:16.316902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:16.316902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:16.316902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:16.316902 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:16.317967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:28:16.317967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:28:16.317967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:28:16.317967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:28:16.317967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:28:16.317967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:28:16.317967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:28:16.317967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:16.317967 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 469/948] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:28:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:16.323311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafa3f2-bdaa-41bc-bb26-88e23e5c3ba2 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:16.420069 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:16.433685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafa3f2-bdaa-41bc-bb26-88e23e5c3ba2 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:16.470885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e0d91-b89a-43c8-992e-48cbdfc4f138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:16.471615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e0d91-b89a-43c8-992e-48cbdfc4f138 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:16.471900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e0d91-b89a-43c8-992e-48cbdfc4f138 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:16.472170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e0d91-b89a-43c8-992e-48cbdfc4f138 None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:16.472869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e0d91-b89a-43c8-992e-48cbdfc4f138 None admin] RBAC: Adding query filter params (name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:16.473174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e0d91-b89a-43c8-992e-48cbdfc4f138 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:16.474847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e0d91-b89a-43c8-992e-48cbdfc4f138 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:16.497072 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 480/949] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Sep 30 09:28:16 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:16.762197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3d2ec-c3c8-4aed-8c19-a7ac4136b099 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:16.762868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3d2ec-c3c8-4aed-8c19-a7ac4136b099 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:16.762868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3d2ec-c3c8-4aed-8c19-a7ac4136b099 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:16.764307 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 470/950] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:16.770116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cc042-9f43-40c5-b014-a3a685535628 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:16.770381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cc042-9f43-40c5-b014-a3a685535628 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:16.770658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cc042-9f43-40c5-b014-a3a685535628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:16.789793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7e9cc042-9f43-40c5-b014-a3a685535628 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:16.791278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7e9cc042-9f43-40c5-b014-a3a685535628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:16.863241 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 481/951] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:28:17.135136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3d2ec-c3c8-4aed-8c19-a7ac4136b099 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:17.245354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3d2ec-c3c8-4aed-8c19-a7ac4136b099 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:17.281996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05148d69-748c-41e1-8440-87553c1da1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:17.283004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05148d69-748c-41e1-8440-87553c1da1da None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:17.283492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05148d69-748c-41e1-8440-87553c1da1da None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:17.283985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05148d69-748c-41e1-8440-87553c1da1da None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:17.284799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05148d69-748c-41e1-8440-87553c1da1da None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:17.286339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05148d69-748c-41e1-8440-87553c1da1da None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:17.296092 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-05148d69-748c-41e1-8440-87553c1da1da None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:28:17.296092 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:17.296092 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:28:17.296092 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:28:17.296092 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:28:17.296092 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:28:17.296092 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:28:17.296092 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:17.296092 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:28:17.296092 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:17.296092 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:28:17.296092 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:17.296092 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:17.296092 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:17.296092 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:17.296092 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:17.296092 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:17.297160 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:17.297160 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:17.297160 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:17.297160 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:17.297160 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:17.297160 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:17.297160 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:28:17.297160 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:28:17.297160 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:28:17.297160 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:28:17.297160 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:17.297160 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:17.297160 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:17.297160 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:17.297160 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:17.297160 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:17.298200 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:17.298200 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:17.298200 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:17.298200 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:17.298200 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:17.298200 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:17.298200 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:17.298200 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:17.298200 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:17.298200 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:17.298200 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:28:17.298200 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:17.298200 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:28:17.298200 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:17.301030 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 471/952] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Sep 30 09:28:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:17.306941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9cc042-9f43-40c5-b014-a3a685535628 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:17.392046 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:17.416573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9cc042-9f43-40c5-b014-a3a685535628 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:17.453408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225879e3-2052-4410-b7d6-66059d8f6c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:17.453999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225879e3-2052-4410-b7d6-66059d8f6c54 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:17.454269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225879e3-2052-4410-b7d6-66059d8f6c54 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:17.454533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225879e3-2052-4410-b7d6-66059d8f6c54 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:17.455151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225879e3-2052-4410-b7d6-66059d8f6c54 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:17.455445 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225879e3-2052-4410-b7d6-66059d8f6c54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:17.457051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225879e3-2052-4410-b7d6-66059d8f6c54 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:17.462524 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 482/953] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Sep 30 09:28:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:17.470313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05148d69-748c-41e1-8440-87553c1da1da None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:17.536841 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:17.585973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05148d69-748c-41e1-8440-87553c1da1da None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:17.625204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e4d06-4a61-4f54-ad0d-1cc7f283daaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:17.626023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e4d06-4a61-4f54-ad0d-1cc7f283daaa None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:17.626449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e4d06-4a61-4f54-ad0d-1cc7f283daaa None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:17.626883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e4d06-4a61-4f54-ad0d-1cc7f283daaa None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:17.627662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e4d06-4a61-4f54-ad0d-1cc7f283daaa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:17.628116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e4d06-4a61-4f54-ad0d-1cc7f283daaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:17.629635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e4d06-4a61-4f54-ad0d-1cc7f283daaa None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:17.635784 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 472/954] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Sep 30 09:28:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:17.641969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225879e3-2052-4410-b7d6-66059d8f6c54 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:17.748164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225879e3-2052-4410-b7d6-66059d8f6c54 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:17.783038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561ec1f-78a8-484c-8763-a6ba506debf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:17.783638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561ec1f-78a8-484c-8763-a6ba506debf7 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:17.783910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561ec1f-78a8-484c-8763-a6ba506debf7 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:17.784177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561ec1f-78a8-484c-8763-a6ba506debf7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:17.784876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561ec1f-78a8-484c-8763-a6ba506debf7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:17.786208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561ec1f-78a8-484c-8763-a6ba506debf7 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:17.801907 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:17.809050 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 483/955] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:28:17 2022] POST /identity/v3/endpoints => generated 349 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:28:18.216173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af56f5-02c5-4317-89cf-bb1c0cc865f9 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:18.216729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af56f5-02c5-4317-89cf-bb1c0cc865f9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:18.216729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af56f5-02c5-4317-89cf-bb1c0cc865f9 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:18.218524 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 473/956] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:18.224379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fd215-5ec6-4756-a0f0-9cd7472cc276 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:18.224720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fd215-5ec6-4756-a0f0-9cd7472cc276 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:18.224960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fd215-5ec6-4756-a0f0-9cd7472cc276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:18.244435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-150fd215-5ec6-4756-a0f0-9cd7472cc276 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:18.245648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-150fd215-5ec6-4756-a0f0-9cd7472cc276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:18.323418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a4c4c-f017-45c3-a0f1-2617988dc892 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:18.323733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a4c4c-f017-45c3-a0f1-2617988dc892 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:18.323963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a4c4c-f017-45c3-a0f1-2617988dc892 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:18.325562 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 474/958] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:28:18.325672 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 484/958] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:18.330704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe52b47-adbb-4821-b7ff-050aee73da45 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:18.330979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe52b47-adbb-4821-b7ff-050aee73da45 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:18.331246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe52b47-adbb-4821-b7ff-050aee73da45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:18.350611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cbe52b47-adbb-4821-b7ff-050aee73da45 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:18.352433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cbe52b47-adbb-4821-b7ff-050aee73da45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:18.423962 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 475/959] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:18.594840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fd215-5ec6-4756-a0f0-9cd7472cc276 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:18.699687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fd215-5ec6-4756-a0f0-9cd7472cc276 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:18.700666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe52b47-adbb-4821-b7ff-050aee73da45 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:18.729926 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:18.743047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374a122-c99b-4e42-ba79-40f2e32cc9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:18.743676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374a122-c99b-4e42-ba79-40f2e32cc9c5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:18.743952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374a122-c99b-4e42-ba79-40f2e32cc9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:18.744220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374a122-c99b-4e42-ba79-40f2e32cc9c5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:18.755545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374a122-c99b-4e42-ba79-40f2e32cc9c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:28:18.756394 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:18.761854 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-6374a122-c99b-4e42-ba79-40f2e32cc9c5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:28:18.761854 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:18.761854 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:18.761854 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:18.761854 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:18.761854 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:18.761854 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:18.761854 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:18.761854 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:18.761854 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:18.761854 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:18.761854 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:18.761854 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:28:18.761854 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:28:18.761854 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:28:18.761854 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:28:18.762924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:28:18.762924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:28:18.762924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:28:18.762924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:28:18.762924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:18.762924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:18.762924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:18.762924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:18.762924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:18.762924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:18.762924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:18.762924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:18.762924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:18.762924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:18.762924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:18.762924 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:18.763765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:18.763765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:18.763765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:18.763765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:18.763765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:28:18.763765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:28:18.763765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:28:18.763765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:28:18.763765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:28:18.763765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:28:18.763765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:28:18.763765 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:18.767956 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 485/960] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Sep 30 09:28:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:18.769458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374a122-c99b-4e42-ba79-40f2e32cc9c5 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:18.809727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe52b47-adbb-4821-b7ff-050aee73da45 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:18.846086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff82a0-bcec-4987-a7b9-d8fad8119cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:18.846628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff82a0-bcec-4987-a7b9-d8fad8119cc0 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:18.846901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff82a0-bcec-4987-a7b9-d8fad8119cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:18.847166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff82a0-bcec-4987-a7b9-d8fad8119cc0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:18.847750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff82a0-bcec-4987-a7b9-d8fad8119cc0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:18.849125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff82a0-bcec-4987-a7b9-d8fad8119cc0 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:18.858504 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-acff82a0-bcec-4987-a7b9-d8fad8119cc0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:28:18.858504 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:18.858504 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:28:18.858504 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:28:18.858504 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:28:18.858504 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:28:18.858504 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:28:18.858504 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:18.858504 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:28:18.858504 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:18.858504 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:28:18.858504 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:18.858504 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:18.858504 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:18.858504 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:18.858504 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:18.858504 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:18.859711 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:18.859711 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:18.859711 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:18.859711 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:18.859711 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:18.859711 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:18.859711 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:28:18.859711 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:28:18.859711 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:28:18.859711 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:28:18.859711 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:18.859711 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:18.859711 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:18.859711 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:18.859711 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:18.859711 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:18.860759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:18.860759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:18.860759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:18.860759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:18.860759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:18.860759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:18.860759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:18.860759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:18.860759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:18.860759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:18.860759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:28:18.860759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:18.860759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:28:18.860759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:18.864510 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 476/961] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:28:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:18.865748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57259303-b580-4ed2-b89f-b1b68b7b7532 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:18.866027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57259303-b580-4ed2-b89f-b1b68b7b7532 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:18.866302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57259303-b580-4ed2-b89f-b1b68b7b7532 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:18.868283 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 477/962] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:18.869001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57259303-b580-4ed2-b89f-b1b68b7b7532 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:18.880834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374a122-c99b-4e42-ba79-40f2e32cc9c5 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:18.914797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b87fd-109f-4b41-a892-95f1a6911349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:18.915396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b87fd-109f-4b41-a892-95f1a6911349 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:18.915670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b87fd-109f-4b41-a892-95f1a6911349 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:18.915932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b87fd-109f-4b41-a892-95f1a6911349 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:18.916594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b87fd-109f-4b41-a892-95f1a6911349 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:18.916961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b87fd-109f-4b41-a892-95f1a6911349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:18.918265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b87fd-109f-4b41-a892-95f1a6911349 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:18.928645 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 486/963] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Sep 30 09:28:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:18.928796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362379cb-c274-441d-9fa6-86cbe7808b0c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:18.929092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362379cb-c274-441d-9fa6-86cbe7808b0c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:18.929519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362379cb-c274-441d-9fa6-86cbe7808b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:18.948288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-362379cb-c274-441d-9fa6-86cbe7808b0c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:18.949481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-362379cb-c274-441d-9fa6-86cbe7808b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:18.988545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57259303-b580-4ed2-b89f-b1b68b7b7532 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:18.994372 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:19.002955 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:19.021189 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 487/964] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:19.025817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362379cb-c274-441d-9fa6-86cbe7808b0c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:19.026955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d460c0-790c-40d7-bbd8-c5ab1754e96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:19.027625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d460c0-790c-40d7-bbd8-c5ab1754e96d None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:19.027973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d460c0-790c-40d7-bbd8-c5ab1754e96d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:19.028311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d460c0-790c-40d7-bbd8-c5ab1754e96d None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:19.029083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d460c0-790c-40d7-bbd8-c5ab1754e96d None admin] RBAC: Adding query filter params (name=compute) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:19.029424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d460c0-790c-40d7-bbd8-c5ab1754e96d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:19.031131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d460c0-790c-40d7-bbd8-c5ab1754e96d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:19.035972 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 478/965] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Sep 30 09:28:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:19.041568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d460c0-790c-40d7-bbd8-c5ab1754e96d None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:19.156723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362379cb-c274-441d-9fa6-86cbe7808b0c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:19.162033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d460c0-790c-40d7-bbd8-c5ab1754e96d None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:19.197130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3aa37-6b8b-4871-9a77-2e7c6d3eaa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:19.197770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3aa37-6b8b-4871-9a77-2e7c6d3eaa6b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:19.198052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3aa37-6b8b-4871-9a77-2e7c6d3eaa6b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:19.198318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3aa37-6b8b-4871-9a77-2e7c6d3eaa6b None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:19.198937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3aa37-6b8b-4871-9a77-2e7c6d3eaa6b None admin] RBAC: Adding query filter params (type=compute) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:19.199286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3aa37-6b8b-4871-9a77-2e7c6d3eaa6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:19.200572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3aa37-6b8b-4871-9a77-2e7c6d3eaa6b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:19.204273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed9159-77df-470f-96fe-e68dc6de77d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:19.205119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed9159-77df-470f-96fe-e68dc6de77d6 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:19.205422 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 479/966] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Sep 30 09:28:19 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:19.205793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed9159-77df-470f-96fe-e68dc6de77d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:19.206135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed9159-77df-470f-96fe-e68dc6de77d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:19.223117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed9159-77df-470f-96fe-e68dc6de77d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:19.225054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed9159-77df-470f-96fe-e68dc6de77d6 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:19.242816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-45ed9159-77df-470f-96fe-e68dc6de77d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:19.242816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:19.242816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:19.242816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:19.242816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:19.242816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:19.242816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:19.242816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:19.242816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:19.242816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:19.242816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:19.242816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:19.242816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:28:19.242816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:28:19.242816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:28:19.242816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:28:19.243961 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:19.243961 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:19.243961 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:19.243961 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:19.243961 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:19.243961 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:19.243961 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:19.243961 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:19.243961 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:19.243961 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:19.243961 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:19.243961 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:19.243961 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:19.243961 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:19.243961 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:19.243961 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:19.243961 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:28:19.244883 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:28:19.244883 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:19.244883 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:19.247187 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 488/967] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:19.253758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3aa37-6b8b-4871-9a77-2e7c6d3eaa6b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:19.291503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed9159-77df-470f-96fe-e68dc6de77d6 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:19.303096 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:19.337957 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:19.392776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3aa37-6b8b-4871-9a77-2e7c6d3eaa6b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:19.420689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed9159-77df-470f-96fe-e68dc6de77d6 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:19.454570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9b8f7-5259-49c9-a164-ad77ff1fe3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:19.455184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9b8f7-5259-49c9-a164-ad77ff1fe3f4 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:19.455469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9b8f7-5259-49c9-a164-ad77ff1fe3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:19.455733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9b8f7-5259-49c9-a164-ad77ff1fe3f4 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:19.456382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9b8f7-5259-49c9-a164-ad77ff1fe3f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:19.459052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9b8f7-5259-49c9-a164-ad77ff1fe3f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:19.459052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9b8f7-5259-49c9-a164-ad77ff1fe3f4 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:19.467514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad34c6-6df2-44e3-a4ca-c8a392384930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:19.468127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad34c6-6df2-44e3-a4ca-c8a392384930 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:19.468407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad34c6-6df2-44e3-a4ca-c8a392384930 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:19.469448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad34c6-6df2-44e3-a4ca-c8a392384930 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:19.470113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad34c6-6df2-44e3-a4ca-c8a392384930 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:19.472260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad34c6-6df2-44e3-a4ca-c8a392384930 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:19.474618 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 480/968] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:19.485615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9b8f7-5259-49c9-a164-ad77ff1fe3f4 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:19.493592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.sql.core [None req-fdad34c6-6df2-44e3-a4ca-c8a392384930 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 30 09:28:19.493592 n-d-master-1 devstack@keystone.service[82079]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 30 09:28:19.493592 n-d-master-1 devstack@keystone.service[82079]: [parameters: {'user_id': 'a9f42a6bfe4848bc86c255ce4f5f6fa5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 30 09:28:19.493592 n-d-master-1 devstack@keystone.service[82079]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82079) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 30 09:28:19.505493 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-fdad34c6-6df2-44e3-a4ca-c8a392384930 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 30 09:28:19.505493 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:19.505493 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 09:28:19.505493 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 09:28:19.505493 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 09:28:19.505493 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 09:28:19.505493 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 09:28:19.505493 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 09:28:19.505493 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 09:28:19.505493 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application conn.query(q) Sep 30 09:28:19.505493 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 09:28:19.505493 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 09:28:19.505493 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 09:28:19.505493 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result.read() Sep 30 09:28:19.505493 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 09:28:19.506504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 09:28:19.506504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 09:28:19.506504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 09:28:19.506504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 09:28:19.506504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 09:28:19.506504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 09:28:19.506504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 09:28:19.506504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 30 09:28:19.506504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:19.506504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 30 09:28:19.506504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:19.506504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:19.506504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 30 09:28:19.506504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 30 09:28:19.506504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 30 09:28:19.506504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 30 09:28:19.506504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 09:28:19.506504 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application next(self.gen) Sep 30 09:28:19.507533 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 30 09:28:19.507533 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application yield resource Sep 30 09:28:19.507533 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 09:28:19.507533 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application next(self.gen) Sep 30 09:28:19.507533 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 30 09:28:19.507533 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.session.rollback() Sep 30 09:28:19.507533 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 30 09:28:19.507533 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.force_reraise() Sep 30 09:28:19.507533 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 30 09:28:19.507533 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise self.value Sep 30 09:28:19.507533 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 30 09:28:19.507533 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 30 09:28:19.507533 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 30 09:28:19.507533 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application session.commit() Sep 30 09:28:19.507533 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 30 09:28:19.507533 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 30 09:28:19.507533 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 30 09:28:19.508743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._prepare_impl() Sep 30 09:28:19.508743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 30 09:28:19.508743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.session.flush() Sep 30 09:28:19.508743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 30 09:28:19.508743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._flush(objects) Sep 30 09:28:19.508743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 30 09:28:19.508743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 30 09:28:19.508743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 30 09:28:19.508743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application compat.raise_( Sep 30 09:28:19.508743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 09:28:19.508743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception Sep 30 09:28:19.508743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 30 09:28:19.508743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application flush_context.execute() Sep 30 09:28:19.508743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 30 09:28:19.508743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rec.execute(self) Sep 30 09:28:19.508743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 30 09:28:19.508743 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 30 09:28:19.509655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 30 09:28:19.509655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 30 09:28:19.509655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 30 09:28:19.509655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 30 09:28:19.509655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 30 09:28:19.509655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 30 09:28:19.509655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 30 09:28:19.509655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 30 09:28:19.509655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 30 09:28:19.509655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 30 09:28:19.509655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 30 09:28:19.509655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 30 09:28:19.509655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 30 09:28:19.509655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 30 09:28:19.509655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 09:28:19.509655 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception Sep 30 09:28:19.510518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 09:28:19.510518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 09:28:19.510518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 09:28:19.510518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 09:28:19.510518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 09:28:19.510518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 09:28:19.510518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 09:28:19.510518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application conn.query(q) Sep 30 09:28:19.510518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 09:28:19.510518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 09:28:19.510518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 09:28:19.510518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result.read() Sep 30 09:28:19.510518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 09:28:19.510518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 09:28:19.510518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 09:28:19.510518 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 09:28:19.511357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 09:28:19.511357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 09:28:19.511357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 09:28:19.511357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 09:28:19.511357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 30 09:28:19.511357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 30 09:28:19.511357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a9f42a6bfe4848bc86c255ce4f5f6fa5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 30 09:28:19.511357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 30 09:28:19.511357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:19.511357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:28:19.511357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:19.511357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:19.511357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:19.511357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:19.511357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:19.512163 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:19.512163 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:19.512163 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:19.512163 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:19.512163 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:19.512163 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:19.512163 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:19.512163 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 30 09:28:19.512163 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 30 09:28:19.512163 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:19.512163 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:19.512163 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:28:19.512163 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:19.512163 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:28:19.512163 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:19.512163 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 30 09:28:19.512163 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 30 09:28:19.518939 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 30 09:28:19.518939 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 30 09:28:19.518939 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 30 09:28:19.518939 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 30 09:28:19.518939 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 30 09:28:19.518939 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:19.518939 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 489/969] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Sep 30 09:28:19 2022] POST /identity/v3/users => generated 160 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:19.523307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad34c6-6df2-44e3-a4ca-c8a392384930 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:19.607312 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:19.610665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9b8f7-5259-49c9-a164-ad77ff1fe3f4 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:19.625098 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:19.633952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad34c6-6df2-44e3-a4ca-c8a392384930 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:19.654042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7765b-ac83-4b3f-8859-5fd7bf9035ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:19.654755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7765b-ac83-4b3f-8859-5fd7bf9035ec None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:19.655098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7765b-ac83-4b3f-8859-5fd7bf9035ec None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:19.655452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7765b-ac83-4b3f-8859-5fd7bf9035ec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:19.666019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7765b-ac83-4b3f-8859-5fd7bf9035ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:19.667789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7765b-ac83-4b3f-8859-5fd7bf9035ec None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:19.678970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf4eda-684f-43e5-83dc-57ff5d54dfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:19.680690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf4eda-684f-43e5-83dc-57ff5d54dfa9 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:19.681159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf4eda-684f-43e5-83dc-57ff5d54dfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:19.681618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf4eda-684f-43e5-83dc-57ff5d54dfa9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:19.681984 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-8fb7765b-ac83-4b3f-8859-5fd7bf9035ec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:28:19.681984 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:19.681984 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:19.681984 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:19.681984 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:19.681984 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:19.681984 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:19.681984 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:19.681984 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:19.681984 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:19.681984 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:19.681984 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:19.681984 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:28:19.681984 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:28:19.681984 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:28:19.681984 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:28:19.682897 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:19.682897 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:19.682897 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:28:19.682897 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:19.682897 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:28:19.682897 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:19.682897 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:19.682897 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:19.682897 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:19.682897 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:19.682897 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:19.682897 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:19.682897 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:19.682897 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:19.682897 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:19.682897 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:19.682897 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:19.682897 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:19.683870 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:19.683870 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:19.683870 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:28:19.683870 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:28:19.683870 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:28:19.683870 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:28:19.683870 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:28:19.683870 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:28:19.683870 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 09:28:19.683870 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:19.688275 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 481/970] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Sep 30 09:28:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:19.689964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7765b-ac83-4b3f-8859-5fd7bf9035ec None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:19.694669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf4eda-684f-43e5-83dc-57ff5d54dfa9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:19.697022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf4eda-684f-43e5-83dc-57ff5d54dfa9 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:19.714489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-eacf4eda-684f-43e5-83dc-57ff5d54dfa9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:28:19.714489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:19.714489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:19.714489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:19.714489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:19.714489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:19.714489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:19.714489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:19.714489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:19.714489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:19.714489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:19.714489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:19.714489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:28:19.714489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:28:19.714489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:28:19.714489 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:28:19.715511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:19.715511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:19.715511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:28:19.715511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:19.715511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:28:19.715511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:19.715511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:19.715511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:19.715511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:19.715511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:19.715511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:19.715511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:19.715511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:19.715511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:19.715511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:19.715511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:19.715511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:19.715511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:19.716460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:19.716460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:19.716460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:28:19.716460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:28:19.716460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:28:19.716460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:28:19.716460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:28:19.716460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:28:19.716460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 09:28:19.716460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:19.720068 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 490/971] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:28:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:19.726138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf4eda-684f-43e5-83dc-57ff5d54dfa9 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:19.813235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7765b-ac83-4b3f-8859-5fd7bf9035ec None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:19.852040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e7d47-af6c-411f-83ed-0bc8dd868ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:19.852764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e7d47-af6c-411f-83ed-0bc8dd868ce7 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:19.853040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf4eda-684f-43e5-83dc-57ff5d54dfa9 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:19.853148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e7d47-af6c-411f-83ed-0bc8dd868ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:19.853369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e7d47-af6c-411f-83ed-0bc8dd868ce7 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:19.854101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e7d47-af6c-411f-83ed-0bc8dd868ce7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:19.854643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e7d47-af6c-411f-83ed-0bc8dd868ce7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:19.856955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e7d47-af6c-411f-83ed-0bc8dd868ce7 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:19.885908 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 482/972] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Sep 30 09:28:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:19.886946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e7d47-af6c-411f-83ed-0bc8dd868ce7 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:19.893918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fd64a-4b3d-4441-a3c2-e4e0226930f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:19.894537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fd64a-4b3d-4441-a3c2-e4e0226930f2 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:19.894818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fd64a-4b3d-4441-a3c2-e4e0226930f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:19.895090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fd64a-4b3d-4441-a3c2-e4e0226930f2 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:19.895797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fd64a-4b3d-4441-a3c2-e4e0226930f2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:19.896148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fd64a-4b3d-4441-a3c2-e4e0226930f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:19.897656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fd64a-4b3d-4441-a3c2-e4e0226930f2 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:19.908364 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:19.940711 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 491/973] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Sep 30 09:28:19 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:20.015946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e7d47-af6c-411f-83ed-0bc8dd868ce7 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:20.066123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3a4f3-382b-4ff7-b1f3-855a2c14a8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:20.067004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3a4f3-382b-4ff7-b1f3-855a2c14a8c1 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:20.067434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3a4f3-382b-4ff7-b1f3-855a2c14a8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:20.067856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3a4f3-382b-4ff7-b1f3-855a2c14a8c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:20.083029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188eb66-3ccd-4ad5-8d3f-3b6f21e2625f None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:20.083310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188eb66-3ccd-4ad5-8d3f-3b6f21e2625f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:20.083589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188eb66-3ccd-4ad5-8d3f-3b6f21e2625f None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:20.089404 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 492/974] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:28:20.091085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5759af8-6ae0-4f0d-8f81-59a470e2ca6f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:20.091372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5759af8-6ae0-4f0d-8f81-59a470e2ca6f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:20.091643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5759af8-6ae0-4f0d-8f81-59a470e2ca6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:20.113456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e5759af8-6ae0-4f0d-8f81-59a470e2ca6f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:20.116316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e5759af8-6ae0-4f0d-8f81-59a470e2ca6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:20.121012 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:20.153508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3a4f3-382b-4ff7-b1f3-855a2c14a8c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:20.154930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3a4f3-382b-4ff7-b1f3-855a2c14a8c1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:20.176781 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:20.209000 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 493/975] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:20.279224 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 483/976] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:28:19 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:28:20.285443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5759af8-6ae0-4f0d-8f81-59a470e2ca6f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:20.390258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5759af8-6ae0-4f0d-8f81-59a470e2ca6f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:20.433375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370707d-b195-47d6-8942-d32e87013d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:20.433998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370707d-b195-47d6-8942-d32e87013d2d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:20.434283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370707d-b195-47d6-8942-d32e87013d2d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:20.434556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370707d-b195-47d6-8942-d32e87013d2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:20.441028 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:20.446648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370707d-b195-47d6-8942-d32e87013d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:20.448092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370707d-b195-47d6-8942-d32e87013d2d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:20.463591 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-4370707d-b195-47d6-8942-d32e87013d2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:20.463591 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:20.463591 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:20.463591 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:20.463591 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:20.463591 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:20.463591 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:20.463591 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:20.463591 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:20.463591 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:20.463591 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:20.463591 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:20.463591 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:28:20.463591 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:28:20.463591 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:28:20.463591 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:28:20.464503 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:20.464503 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:20.464503 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:20.464503 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:20.464503 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:20.464503 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:20.464503 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:20.464503 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:20.464503 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:20.464503 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:20.464503 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:20.464503 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:20.464503 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:20.464503 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:20.464503 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:20.464503 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:20.464503 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:28:20.470462 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:28:20.470462 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:20.470462 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:20.470462 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 494/977] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:20.470708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3a4f3-382b-4ff7-b1f3-855a2c14a8c1 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:20.477776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370707d-b195-47d6-8942-d32e87013d2d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:20.576486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3a4f3-382b-4ff7-b1f3-855a2c14a8c1 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:20.581751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370707d-b195-47d6-8942-d32e87013d2d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:20.595445 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:20.614446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b48689-9162-4192-b3b1-6143b09bbf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:20.615165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b48689-9162-4192-b3b1-6143b09bbf50 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:20.615523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b48689-9162-4192-b3b1-6143b09bbf50 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:20.615861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b48689-9162-4192-b3b1-6143b09bbf50 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:20.616510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b48689-9162-4192-b3b1-6143b09bbf50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:20.616871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b48689-9162-4192-b3b1-6143b09bbf50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:20.618226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b48689-9162-4192-b3b1-6143b09bbf50 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:20.621537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ddf75-eb66-4e6a-a387-4aa66f4ddb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:20.622324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ddf75-eb66-4e6a-a387-4aa66f4ddb3e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:20.622767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ddf75-eb66-4e6a-a387-4aa66f4ddb3e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:20.623189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ddf75-eb66-4e6a-a387-4aa66f4ddb3e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:20.623908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ddf75-eb66-4e6a-a387-4aa66f4ddb3e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:20.625453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ddf75-eb66-4e6a-a387-4aa66f4ddb3e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:20.630220 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 484/978] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:20.635516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b48689-9162-4192-b3b1-6143b09bbf50 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:20.635665 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-0c0ddf75-eb66-4e6a-a387-4aa66f4ddb3e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:28:20.635665 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:20.635665 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:28:20.635665 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:28:20.635665 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:28:20.635665 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:28:20.635665 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:28:20.635665 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:20.635665 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:28:20.635665 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:20.635665 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:28:20.635665 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:20.635665 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:20.635665 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:20.635665 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:20.635665 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:20.635665 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:20.636804 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:20.636804 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:20.636804 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:20.636804 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:20.636804 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:20.636804 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:20.636804 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:28:20.636804 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:28:20.636804 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:28:20.636804 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:28:20.636804 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:20.636804 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:20.636804 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:20.636804 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:20.636804 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:20.636804 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:20.637651 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:20.637651 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:20.637651 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:20.637651 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:20.637651 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:20.637651 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:20.637651 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:20.637651 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:20.637651 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:20.637651 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:20.637651 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:28:20.637651 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:20.637651 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:28:20.637651 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:20.640768 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 495/979] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Sep 30 09:28:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:20.643707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ddf75-eb66-4e6a-a387-4aa66f4ddb3e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:20.707056 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:20.744941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b48689-9162-4192-b3b1-6143b09bbf50 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:20.760121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ddf75-eb66-4e6a-a387-4aa66f4ddb3e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:20.779870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb5be7-22d4-4b1a-8787-bc4e94c4a213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:20.780483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb5be7-22d4-4b1a-8787-bc4e94c4a213 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:20.780788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb5be7-22d4-4b1a-8787-bc4e94c4a213 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:20.781083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb5be7-22d4-4b1a-8787-bc4e94c4a213 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:20.787620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb5be7-22d4-4b1a-8787-bc4e94c4a213 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:20.789579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb5be7-22d4-4b1a-8787-bc4e94c4a213 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:20.798317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621982e5-7f27-476d-9764-2452d528049a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:20.798909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621982e5-7f27-476d-9764-2452d528049a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:20.799183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621982e5-7f27-476d-9764-2452d528049a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:20.799449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621982e5-7f27-476d-9764-2452d528049a None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:20.800064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621982e5-7f27-476d-9764-2452d528049a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:20.800362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621982e5-7f27-476d-9764-2452d528049a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:20.801296 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-e7cb5be7-22d4-4b1a-8787-bc4e94c4a213 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:28:20.801296 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:20.801296 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:20.801296 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:20.801296 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:20.801296 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:20.801296 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:20.801296 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:20.801296 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:20.801296 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:20.801296 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:20.801296 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:20.801296 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:28:20.801296 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:28:20.801296 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:28:20.802236 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:28:20.802236 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:20.802236 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:20.802236 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:20.802236 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:20.802236 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:20.802236 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:20.802236 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:20.802236 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:20.802236 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:20.802236 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:20.802236 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:20.802236 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:20.802236 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:20.802236 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:20.802236 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:20.802236 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:20.808463 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:28:20.808463 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:28:20.808463 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:28:20.808463 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:28:20.808463 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:28:20.808463 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:28:20.808463 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:28:20.808463 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:20.808954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621982e5-7f27-476d-9764-2452d528049a None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:20.809035 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 485/980] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:28:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:20.809035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb5be7-22d4-4b1a-8787-bc4e94c4a213 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:20.817032 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 496/981] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Sep 30 09:28:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:20.818041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621982e5-7f27-476d-9764-2452d528049a None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:20.850146 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:20.913346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb5be7-22d4-4b1a-8787-bc4e94c4a213 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:20.927733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621982e5-7f27-476d-9764-2452d528049a None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:20.946227 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:20.953132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26427b34-42e0-4cc6-b746-cf06f8ecc644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:20.953730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26427b34-42e0-4cc6-b746-cf06f8ecc644 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:20.954004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26427b34-42e0-4cc6-b746-cf06f8ecc644 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:20.954333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26427b34-42e0-4cc6-b746-cf06f8ecc644 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:20.955019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26427b34-42e0-4cc6-b746-cf06f8ecc644 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:20.955318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26427b34-42e0-4cc6-b746-cf06f8ecc644 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:20.956731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26427b34-42e0-4cc6-b746-cf06f8ecc644 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:20.965439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923ed18-a3b7-4f1f-afac-e43b02566547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:20.966107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923ed18-a3b7-4f1f-afac-e43b02566547 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:20.966726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923ed18-a3b7-4f1f-afac-e43b02566547 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:20.966726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923ed18-a3b7-4f1f-afac-e43b02566547 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:20.967319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923ed18-a3b7-4f1f-afac-e43b02566547 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:20.967625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923ed18-a3b7-4f1f-afac-e43b02566547 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:20.968991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923ed18-a3b7-4f1f-afac-e43b02566547 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:20.970369 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 486/982] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:28:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:20.977628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26427b34-42e0-4cc6-b746-cf06f8ecc644 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:20.984389 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 497/983] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Sep 30 09:28:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:20.985295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923ed18-a3b7-4f1f-afac-e43b02566547 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:21.085485 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:21.089104 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26427b34-42e0-4cc6-b746-cf06f8ecc644 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:21.090413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923ed18-a3b7-4f1f-afac-e43b02566547 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:21.125926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa3327-7975-4ea5-adb4-c8e6bb67e1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:21.126278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d68ae-1f4c-4ee4-8c3e-24a70ba583ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:21.126661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa3327-7975-4ea5-adb4-c8e6bb67e1c2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:21.126877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d68ae-1f4c-4ee4-8c3e-24a70ba583ea None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:21.126981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa3327-7975-4ea5-adb4-c8e6bb67e1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:21.127157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d68ae-1f4c-4ee4-8c3e-24a70ba583ea None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:21.127254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa3327-7975-4ea5-adb4-c8e6bb67e1c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:21.127402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d68ae-1f4c-4ee4-8c3e-24a70ba583ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:21.127891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa3327-7975-4ea5-adb4-c8e6bb67e1c2 None admin] RBAC: Adding query filter params (role.id=a147711fae6d4aa1873fdea65ad1663b, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=9bdab836a64d43ea842629d29b6f8d47) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:21.128099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d68ae-1f4c-4ee4-8c3e-24a70ba583ea None admin] RBAC: Adding query filter params (interface=admin, service_id=947aa5f32dbd4caba70307b24ce049a0, region_id=RegionOne) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:21.128213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa3327-7975-4ea5-adb4-c8e6bb67e1c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:21.128403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d68ae-1f4c-4ee4-8c3e-24a70ba583ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:21.129604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa3327-7975-4ea5-adb4-c8e6bb67e1c2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:21.129775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d68ae-1f4c-4ee4-8c3e-24a70ba583ea None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:21.143267 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 487/984] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:28:20 2022] GET /identity/v3/role_assignments?user.id=9bdab836a64d43ea842629d29b6f8d47&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=a147711fae6d4aa1873fdea65ad1663b => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:21.143481 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 498/985] 10.222.0.16 () {56 vars in 1249 bytes} [Fri Sep 30 09:28:20 2022] GET /identity/v3/endpoints?service_id=947aa5f32dbd4caba70307b24ce049a0&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:21.143567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa3327-7975-4ea5-adb4-c8e6bb67e1c2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:21.259038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa3327-7975-4ea5-adb4-c8e6bb67e1c2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:21.294797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd81fc6-e551-4635-a595-d62bf1ac5b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:21.295452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd81fc6-e551-4635-a595-d62bf1ac5b97 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:21.295669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd81fc6-e551-4635-a595-d62bf1ac5b97 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:21.295919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd81fc6-e551-4635-a595-d62bf1ac5b97 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:21.296518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd81fc6-e551-4635-a595-d62bf1ac5b97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:21.297901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd81fc6-e551-4635-a595-d62bf1ac5b97 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:21.304750 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 488/986] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Sep 30 09:28:21 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:28:21.541319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455bab9-279b-4761-a53d-409b8103f0af None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:21.541717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455bab9-279b-4761-a53d-409b8103f0af None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:21.541919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455bab9-279b-4761-a53d-409b8103f0af None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:21.543378 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 499/987] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:21.548436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17096553-392c-4e3a-8d5d-c9c0f29fc24b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:21.548766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17096553-392c-4e3a-8d5d-c9c0f29fc24b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:21.549043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17096553-392c-4e3a-8d5d-c9c0f29fc24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:21.567412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-17096553-392c-4e3a-8d5d-c9c0f29fc24b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:21.568845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-17096553-392c-4e3a-8d5d-c9c0f29fc24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:21.590280 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:21.638514 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 489/988] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:21.914972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455bab9-279b-4761-a53d-409b8103f0af None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:21.970079 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:22.029596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455bab9-279b-4761-a53d-409b8103f0af None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:22.066127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82553f-2e47-4380-907b-18912e8894e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:22.066763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82553f-2e47-4380-907b-18912e8894e2 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:22.067068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82553f-2e47-4380-907b-18912e8894e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:22.067343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82553f-2e47-4380-907b-18912e8894e2 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:22.068116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82553f-2e47-4380-907b-18912e8894e2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:22.069547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82553f-2e47-4380-907b-18912e8894e2 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:22.088636 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 500/989] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Sep 30 09:28:21 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:28:23.331392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98c91c-01fe-4b17-b83c-b0a6c993faf1 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:23.332182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98c91c-01fe-4b17-b83c-b0a6c993faf1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:23.332182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98c91c-01fe-4b17-b83c-b0a6c993faf1 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:23.333571 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 490/990] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:23.339344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665815f-20e8-4a3c-8c73-3cce6aa69a5b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:23.339739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665815f-20e8-4a3c-8c73-3cce6aa69a5b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:23.339883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665815f-20e8-4a3c-8c73-3cce6aa69a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:23.358173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5665815f-20e8-4a3c-8c73-3cce6aa69a5b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:23.359384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5665815f-20e8-4a3c-8c73-3cce6aa69a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:23.440756 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 501/991] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:23.487104 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2617ca-3ed0-4734-ba26-cd2f9d23809b None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:23.487388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2617ca-3ed0-4734-ba26-cd2f9d23809b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:23.487861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2617ca-3ed0-4734-ba26-cd2f9d23809b None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:23.489218 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 491/992] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:23.495221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4257099-2b32-426b-934b-392006cfb192 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:23.495505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4257099-2b32-426b-934b-392006cfb192 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:23.495773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4257099-2b32-426b-934b-392006cfb192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:23.514781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a4257099-2b32-426b-934b-392006cfb192 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:23.515960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a4257099-2b32-426b-934b-392006cfb192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:23.541824 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:23.585636 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 502/993] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:23.705389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2617ca-3ed0-4734-ba26-cd2f9d23809b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:23.806113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2617ca-3ed0-4734-ba26-cd2f9d23809b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:23.839763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deaaba2-8176-452f-829a-c8b6a339ce07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:23.840297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deaaba2-8176-452f-829a-c8b6a339ce07 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:23.840572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deaaba2-8176-452f-829a-c8b6a339ce07 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:23.840881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deaaba2-8176-452f-829a-c8b6a339ce07 None admin] PATH_INFO: `/v3/services/image` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:23.841451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deaaba2-8176-452f-829a-c8b6a339ce07 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:23.842783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deaaba2-8176-452f-829a-c8b6a339ce07 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:23.851537 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-0deaaba2-8176-452f-829a-c8b6a339ce07 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:28:23.851537 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:23.851537 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:28:23.851537 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:28:23.851537 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:28:23.851537 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:28:23.851537 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:28:23.851537 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:23.851537 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:28:23.851537 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:23.851537 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:28:23.851537 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:23.851537 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:23.851537 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:23.851537 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:23.851537 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:23.851537 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:23.852755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:23.852755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:23.852755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:23.852755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:23.852755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:23.852755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:23.852755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:28:23.852755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:28:23.852755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:28:23.852755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:28:23.852755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:23.852755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:23.852755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:23.852755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:23.852755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:23.852755 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:23.853626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:23.853626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:23.853626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:23.853626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:23.853626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:23.853626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:23.853626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:23.853626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:23.853626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:23.853626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:23.853626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:28:23.853626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:23.853626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:28:23.853626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:23.853626 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 492/994] 10.222.0.16 () {56 vars in 1105 bytes} [Fri Sep 30 09:28:23 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:23.855968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4257099-2b32-426b-934b-392006cfb192 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:23.858395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deaaba2-8176-452f-829a-c8b6a339ce07 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:23.881989 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:23.969849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4257099-2b32-426b-934b-392006cfb192 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:23.977109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deaaba2-8176-452f-829a-c8b6a339ce07 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:24.004527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f518dd-24d4-4fd1-9445-011332c03181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:24.005193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f518dd-24d4-4fd1-9445-011332c03181 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:24.005562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f518dd-24d4-4fd1-9445-011332c03181 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:24.005740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f518dd-24d4-4fd1-9445-011332c03181 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:24.006317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f518dd-24d4-4fd1-9445-011332c03181 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:24.008227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f518dd-24d4-4fd1-9445-011332c03181 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:24.015851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da6e32-e114-48aa-9102-b9630eb3baf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:24.016659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da6e32-e114-48aa-9102-b9630eb3baf8 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:24.017084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da6e32-e114-48aa-9102-b9630eb3baf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:24.017519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da6e32-e114-48aa-9102-b9630eb3baf8 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:24.017798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-f9f518dd-24d4-4fd1-9445-011332c03181 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:28:24.017798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:24.017798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:28:24.017798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:28:24.017798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:28:24.017798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:28:24.017798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:28:24.017798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:24.017798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:28:24.017798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:24.017798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:28:24.017798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:24.017798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:24.017798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:24.017798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:24.017798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:24.017798 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:24.018820 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:24.018820 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:24.018820 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:24.018820 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:24.018820 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:24.018820 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:24.018820 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:28:24.018820 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:28:24.018820 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:28:24.018820 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:28:24.018820 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:24.018820 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:24.018820 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:24.018820 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:24.018820 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:24.018820 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:24.019661 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:24.019661 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:24.019661 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:24.019661 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:24.019661 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:24.019661 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:24.019661 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:24.019661 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:24.019661 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:24.019661 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:24.019661 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:28:24.019661 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:24.019661 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 09:28:24.019661 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:24.020389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da6e32-e114-48aa-9102-b9630eb3baf8 None admin] RBAC: Adding query filter params (name=image) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:24.020389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da6e32-e114-48aa-9102-b9630eb3baf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:24.020526 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 503/995] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Sep 30 09:28:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:24.021801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da6e32-e114-48aa-9102-b9630eb3baf8 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:24.024976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f518dd-24d4-4fd1-9445-011332c03181 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:24.028639 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 493/996] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:24.032438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da6e32-e114-48aa-9102-b9630eb3baf8 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:24.054610 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:24.121078 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:24.130664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f518dd-24d4-4fd1-9445-011332c03181 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:24.138421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da6e32-e114-48aa-9102-b9630eb3baf8 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:24.168304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf33916-c440-4042-a1ea-d003c95be57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:24.169387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf33916-c440-4042-a1ea-d003c95be57c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:24.169847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf33916-c440-4042-a1ea-d003c95be57c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:24.170296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf33916-c440-4042-a1ea-d003c95be57c None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:24.171133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf33916-c440-4042-a1ea-d003c95be57c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:24.171635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf33916-c440-4042-a1ea-d003c95be57c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:24.173130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf33916-c440-4042-a1ea-d003c95be57c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:24.174047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fb25c-2795-48d8-af18-0da3f22a1559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:24.174679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fb25c-2795-48d8-af18-0da3f22a1559 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:24.174962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fb25c-2795-48d8-af18-0da3f22a1559 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:24.175238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fb25c-2795-48d8-af18-0da3f22a1559 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:24.175884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fb25c-2795-48d8-af18-0da3f22a1559 None admin] RBAC: Adding query filter params (type=image) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:24.176190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fb25c-2795-48d8-af18-0da3f22a1559 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:24.177627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fb25c-2795-48d8-af18-0da3f22a1559 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:24.182960 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 494/997] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:24.184207 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 504/998] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Sep 30 09:28:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:24.185133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fb25c-2795-48d8-af18-0da3f22a1559 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:24.292848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7cb8b-a1df-407a-beb5-b335e899be0b None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:24.293446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7cb8b-a1df-407a-beb5-b335e899be0b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:24.293721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7cb8b-a1df-407a-beb5-b335e899be0b None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:24.295080 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 505/999] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:28:24.300872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23303aa7-b611-43e7-a5f6-1e3ffac6bc12 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:24.301238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23303aa7-b611-43e7-a5f6-1e3ffac6bc12 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:24.301715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23303aa7-b611-43e7-a5f6-1e3ffac6bc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:24.303911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fb25c-2795-48d8-af18-0da3f22a1559 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:24.322839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-23303aa7-b611-43e7-a5f6-1e3ffac6bc12 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:24.324173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-23303aa7-b611-43e7-a5f6-1e3ffac6bc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:24.343353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e5fd6-b935-4f96-b0c9-ce963f002f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:24.344059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e5fd6-b935-4f96-b0c9-ce963f002f32 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:24.344231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e5fd6-b935-4f96-b0c9-ce963f002f32 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:24.344499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e5fd6-b935-4f96-b0c9-ce963f002f32 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:24.345170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e5fd6-b935-4f96-b0c9-ce963f002f32 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:24.345470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e5fd6-b935-4f96-b0c9-ce963f002f32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:24.346837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e5fd6-b935-4f96-b0c9-ce963f002f32 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:24.352739 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 495/1000] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Sep 30 09:28:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:24.358132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e5fd6-b935-4f96-b0c9-ce963f002f32 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:24.378261 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:24.409255 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 506/1001] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:28:24.478256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e5fd6-b935-4f96-b0c9-ce963f002f32 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:24.510684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50497a4e-a9cb-4d62-876a-ca1151e073b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:24.511289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50497a4e-a9cb-4d62-876a-ca1151e073b2 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:24.511567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50497a4e-a9cb-4d62-876a-ca1151e073b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:24.511835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50497a4e-a9cb-4d62-876a-ca1151e073b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:24.512483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50497a4e-a9cb-4d62-876a-ca1151e073b2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:24.513859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50497a4e-a9cb-4d62-876a-ca1151e073b2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:24.531065 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 496/1002] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:28:24 2022] POST /identity/v3/endpoints => generated 325 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:28:24.694026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23303aa7-b611-43e7-a5f6-1e3ffac6bc12 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:24.719491 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:24.802133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23303aa7-b611-43e7-a5f6-1e3ffac6bc12 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:24.843208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534c6b4-9562-48f3-a0b9-f4d0ec0a2131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:24.843837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534c6b4-9562-48f3-a0b9-f4d0ec0a2131 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:24.844116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534c6b4-9562-48f3-a0b9-f4d0ec0a2131 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:24.844388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534c6b4-9562-48f3-a0b9-f4d0ec0a2131 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:24.844995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534c6b4-9562-48f3-a0b9-f4d0ec0a2131 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:24.846337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534c6b4-9562-48f3-a0b9-f4d0ec0a2131 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:24.855251 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-0534c6b4-9562-48f3-a0b9-f4d0ec0a2131 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:28:24.855251 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:24.855251 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:28:24.855251 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:28:24.855251 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:28:24.855251 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:28:24.855251 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:28:24.855251 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:24.855251 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:28:24.855251 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:24.855251 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:28:24.855251 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:24.855251 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:24.855251 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:24.855251 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:24.855251 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:24.855251 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:24.856238 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:24.856238 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:24.856238 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:24.856238 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:24.856238 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:24.856238 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:24.856238 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:28:24.856238 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:28:24.856238 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:28:24.856238 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:28:24.856238 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:24.856238 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:24.856238 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:24.856238 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:24.856238 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:24.856238 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:24.857673 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:24.857673 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:24.857673 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:24.857673 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:24.857673 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:24.857673 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:24.857673 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:24.857673 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:24.857673 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:24.857673 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:24.857673 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:28:24.857673 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:24.857673 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:28:24.857673 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:24.857673 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 507/1003] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:28:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:24.862470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50497a4e-a9cb-4d62-876a-ca1151e073b2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:24.941313 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:24.974875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50497a4e-a9cb-4d62-876a-ca1151e073b2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:25.009853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5e672-7890-4280-a6c0-737c1aea7f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:25.010561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5e672-7890-4280-a6c0-737c1aea7f93 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:25.010844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5e672-7890-4280-a6c0-737c1aea7f93 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:25.011117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5e672-7890-4280-a6c0-737c1aea7f93 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:25.011748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5e672-7890-4280-a6c0-737c1aea7f93 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:25.012052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5e672-7890-4280-a6c0-737c1aea7f93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:25.013442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5e672-7890-4280-a6c0-737c1aea7f93 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:25.021291 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 497/1004] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Sep 30 09:28:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:25.024703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534c6b4-9562-48f3-a0b9-f4d0ec0a2131 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:25.108909 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:25.130072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534c6b4-9562-48f3-a0b9-f4d0ec0a2131 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:25.163124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f317e-d30f-4ce1-a975-bd7edda329d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:25.163742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f317e-d30f-4ce1-a975-bd7edda329d0 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:25.164022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f317e-d30f-4ce1-a975-bd7edda329d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:25.164285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f317e-d30f-4ce1-a975-bd7edda329d0 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:25.164932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f317e-d30f-4ce1-a975-bd7edda329d0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:25.165231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f317e-d30f-4ce1-a975-bd7edda329d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:25.166566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f317e-d30f-4ce1-a975-bd7edda329d0 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:25.171448 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 508/1005] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Sep 30 09:28:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:25.177054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5e672-7890-4280-a6c0-737c1aea7f93 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:25.276768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5e672-7890-4280-a6c0-737c1aea7f93 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:25.309592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bf881-fb43-4d6f-9a5f-7c39f7d5d725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:25.310189 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bf881-fb43-4d6f-9a5f-7c39f7d5d725 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:25.310461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bf881-fb43-4d6f-9a5f-7c39f7d5d725 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:25.310725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bf881-fb43-4d6f-9a5f-7c39f7d5d725 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:25.311405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bf881-fb43-4d6f-9a5f-7c39f7d5d725 None admin] RBAC: Adding query filter params (interface=public, service_id=9d8bad941117484d9d8a0f3d8ee872e5, region_id=RegionOne) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:25.311706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bf881-fb43-4d6f-9a5f-7c39f7d5d725 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:25.313075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bf881-fb43-4d6f-9a5f-7c39f7d5d725 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:25.315403 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:25.320834 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 498/1006] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Sep 30 09:28:25 2022] GET /identity/v3/endpoints?service_id=9d8bad941117484d9d8a0f3d8ee872e5&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:25.325467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f317e-d30f-4ce1-a975-bd7edda329d0 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:25.425228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f317e-d30f-4ce1-a975-bd7edda329d0 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:25.463812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a43b34-a53b-4750-8c14-30ed9507236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:25.464422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a43b34-a53b-4750-8c14-30ed9507236f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:25.464732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a43b34-a53b-4750-8c14-30ed9507236f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:25.465006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a43b34-a53b-4750-8c14-30ed9507236f None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:25.465608 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a43b34-a53b-4750-8c14-30ed9507236f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:25.466962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a43b34-a53b-4750-8c14-30ed9507236f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:25.480702 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 509/1007] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Sep 30 09:28:25 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:28:26.369658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fceed4-7249-4eb0-9a18-b7b67f351c47 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:26.370180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fceed4-7249-4eb0-9a18-b7b67f351c47 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:26.370180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fceed4-7249-4eb0-9a18-b7b67f351c47 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:26.374847 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 499/1008] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:26.376880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9abee-0fdd-4dcf-8573-979ee51b95e1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:26.377166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9abee-0fdd-4dcf-8573-979ee51b95e1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:26.377436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9abee-0fdd-4dcf-8573-979ee51b95e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:26.396101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e3a9abee-0fdd-4dcf-8573-979ee51b95e1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:26.397288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e3a9abee-0fdd-4dcf-8573-979ee51b95e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:26.399863 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:26.468522 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 510/1009] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:26 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:26.744723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fceed4-7249-4eb0-9a18-b7b67f351c47 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:26.760994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a99f8-4676-4cb4-a17d-bf7286283397 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:26.761305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a99f8-4676-4cb4-a17d-bf7286283397 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:26.761584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a99f8-4676-4cb4-a17d-bf7286283397 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:26.763784 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 511/1010] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:28:26.768840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efc06f-95a5-40b5-8526-481354efed9d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:26.769124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efc06f-95a5-40b5-8526-481354efed9d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:26.769399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efc06f-95a5-40b5-8526-481354efed9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:26.787563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d9efc06f-95a5-40b5-8526-481354efed9d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:26.789464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d9efc06f-95a5-40b5-8526-481354efed9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:26.854917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fceed4-7249-4eb0-9a18-b7b67f351c47 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:26.857739 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 512/1011] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:26 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:26.888689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb23713-21d0-4290-bb99-d98aedd1839c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:26.889291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb23713-21d0-4290-bb99-d98aedd1839c None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:26.889564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb23713-21d0-4290-bb99-d98aedd1839c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:26.889828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb23713-21d0-4290-bb99-d98aedd1839c None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:26.890470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb23713-21d0-4290-bb99-d98aedd1839c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:26.891824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb23713-21d0-4290-bb99-d98aedd1839c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:26.907863 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 500/1012] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Sep 30 09:28:26 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:28:27.130307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efc06f-95a5-40b5-8526-481354efed9d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:27.197321 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:27.233136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efc06f-95a5-40b5-8526-481354efed9d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:27.272482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f64c3-722f-4960-aba5-23ee5ba82e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:27.273674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f64c3-722f-4960-aba5-23ee5ba82e8e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:27.274043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f64c3-722f-4960-aba5-23ee5ba82e8e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:27.274323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f64c3-722f-4960-aba5-23ee5ba82e8e None admin] PATH_INFO: `/v3/domains/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:27.275440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f64c3-722f-4960-aba5-23ee5ba82e8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:27.276890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f64c3-722f-4960-aba5-23ee5ba82e8e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:27.278605 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 513/1013] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:27.284399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb23713-21d0-4290-bb99-d98aedd1839c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:27.345979 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:27.391606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb23713-21d0-4290-bb99-d98aedd1839c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:27.428538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb129cdd-d3d5-428d-b74c-9ddc5747a055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:27.430094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb129cdd-d3d5-428d-b74c-9ddc5747a055 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:27.430581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb129cdd-d3d5-428d-b74c-9ddc5747a055 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:27.431066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb129cdd-d3d5-428d-b74c-9ddc5747a055 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:27.431900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb129cdd-d3d5-428d-b74c-9ddc5747a055 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:27.433531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb129cdd-d3d5-428d-b74c-9ddc5747a055 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:27.468648 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 501/1014] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Sep 30 09:28:27 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:28:27.672229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94225d-7da0-48d0-9535-1c15a0d8fabe None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:27.672813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94225d-7da0-48d0-9535-1c15a0d8fabe None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:27.672813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94225d-7da0-48d0-9535-1c15a0d8fabe None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:27.674243 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 514/1015] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:27.679903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e73a3-e9da-42d5-b979-6bb6563fe24f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:27.680186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e73a3-e9da-42d5-b979-6bb6563fe24f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:27.680680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e73a3-e9da-42d5-b979-6bb6563fe24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:27.699955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-364e73a3-e9da-42d5-b979-6bb6563fe24f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:27.701193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-364e73a3-e9da-42d5-b979-6bb6563fe24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:27.771761 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 502/1016] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:27 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:28.041871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94225d-7da0-48d0-9535-1c15a0d8fabe None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:28.147066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94225d-7da0-48d0-9535-1c15a0d8fabe None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:28.177635 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:28.183979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f281be1-6b71-406c-9761-656e81102752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:28.184625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f281be1-6b71-406c-9761-656e81102752 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:28.184912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f281be1-6b71-406c-9761-656e81102752 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:28.185184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f281be1-6b71-406c-9761-656e81102752 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:28.185762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f281be1-6b71-406c-9761-656e81102752 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:28.187109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f281be1-6b71-406c-9761-656e81102752 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:28.196066 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-3f281be1-6b71-406c-9761-656e81102752 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:28:28.196066 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:28.196066 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:28:28.196066 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:28:28.196066 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:28:28.196066 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:28:28.196066 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:28:28.196066 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:28.196066 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:28:28.196066 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:28.196066 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:28:28.196066 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:28.196066 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:28.196066 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:28.196066 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:28.196066 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:28.196066 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:28.197112 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:28.197112 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:28.197112 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:28.197112 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:28.197112 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:28.197112 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:28.197112 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:28:28.197112 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:28:28.197112 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:28:28.197112 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:28:28.197112 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:28.197112 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:28.197112 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:28.197112 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:28.197112 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:28.197112 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:28.197965 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:28.197965 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:28.197965 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:28.197965 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:28.197965 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:28.197965 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:28.197965 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:28.197965 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:28.197965 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:28.197965 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:28.197965 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:28:28.197965 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:28.197965 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 09:28:28.197965 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:28.197965 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 515/1017] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:28:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:28.203224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e73a3-e9da-42d5-b979-6bb6563fe24f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:28.247678 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:28.305953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e73a3-e9da-42d5-b979-6bb6563fe24f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:28.339256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e6a9c-9db5-42a1-9814-d337d35e21a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:28.339856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e6a9c-9db5-42a1-9814-d337d35e21a2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:28.340134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e6a9c-9db5-42a1-9814-d337d35e21a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:28.340405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e6a9c-9db5-42a1-9814-d337d35e21a2 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:28.341054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e6a9c-9db5-42a1-9814-d337d35e21a2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:28.341356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e6a9c-9db5-42a1-9814-d337d35e21a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:28.342703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e6a9c-9db5-42a1-9814-d337d35e21a2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:28.347586 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 503/1018] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Sep 30 09:28:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:28.354050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f281be1-6b71-406c-9761-656e81102752 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:28.460076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f281be1-6b71-406c-9761-656e81102752 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:28.494941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630b204-0006-466d-b493-996ca2aa07d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:28.495547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630b204-0006-466d-b493-996ca2aa07d6 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:28.495826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630b204-0006-466d-b493-996ca2aa07d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:28.496099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630b204-0006-466d-b493-996ca2aa07d6 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:28.496755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630b204-0006-466d-b493-996ca2aa07d6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:28.497060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630b204-0006-466d-b493-996ca2aa07d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:28.498412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630b204-0006-466d-b493-996ca2aa07d6 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:28.508271 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 516/1019] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Sep 30 09:28:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:28.509807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e6a9c-9db5-42a1-9814-d337d35e21a2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:28.612242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e6a9c-9db5-42a1-9814-d337d35e21a2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:28.619693 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:28.647155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad891e07-796c-4f70-85f2-5b5162b4b532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:28.648272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad891e07-796c-4f70-85f2-5b5162b4b532 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:28.648549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad891e07-796c-4f70-85f2-5b5162b4b532 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:28.648845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad891e07-796c-4f70-85f2-5b5162b4b532 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:28.649516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad891e07-796c-4f70-85f2-5b5162b4b532 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:28.650857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad891e07-796c-4f70-85f2-5b5162b4b532 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:28.670707 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 504/1020] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:28:28 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:28:29.091100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bcae4-fc7c-42ec-bcd7-f0e51a6bcfa5 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:29.091610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bcae4-fc7c-42ec-bcd7-f0e51a6bcfa5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:29.091716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bcae4-fc7c-42ec-bcd7-f0e51a6bcfa5 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:29.093040 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 517/1021] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:29.098224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774321dc-91a9-4c22-9317-f1819fe37f4a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:29.098619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774321dc-91a9-4c22-9317-f1819fe37f4a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:29.099086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774321dc-91a9-4c22-9317-f1819fe37f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:29.118366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-774321dc-91a9-4c22-9317-f1819fe37f4a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:29.119548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-774321dc-91a9-4c22-9317-f1819fe37f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:29.199124 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 505/1022] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:29.469885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bcae4-fc7c-42ec-bcd7-f0e51a6bcfa5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:29.534041 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:29.586159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bcae4-fc7c-42ec-bcd7-f0e51a6bcfa5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:29.626498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a466f-b65c-41a0-80e1-df73fe95ede2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:29.627127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a466f-b65c-41a0-80e1-df73fe95ede2 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:29.627408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a466f-b65c-41a0-80e1-df73fe95ede2 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:29.627681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a466f-b65c-41a0-80e1-df73fe95ede2 None admin] PATH_INFO: `/v3/services/image` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:29.628260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a466f-b65c-41a0-80e1-df73fe95ede2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:29.629635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a466f-b65c-41a0-80e1-df73fe95ede2 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:29.638668 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-642a466f-b65c-41a0-80e1-df73fe95ede2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:28:29.638668 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:29.638668 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:28:29.638668 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:28:29.638668 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:28:29.638668 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:28:29.638668 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:28:29.638668 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:29.638668 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:28:29.638668 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:29.638668 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:28:29.638668 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:29.638668 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:29.638668 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:29.638668 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:29.638668 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:29.638668 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:29.639674 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:29.639674 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:29.639674 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:29.639674 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:29.639674 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:29.639674 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:29.639674 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:28:29.639674 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:28:29.639674 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:28:29.639674 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:28:29.639674 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:29.639674 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:29.639674 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:29.639674 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:29.639674 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:29.639674 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:29.640568 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:29.640568 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:29.640568 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:29.640568 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:29.640568 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:29.640568 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:29.640568 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:29.640568 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:29.640568 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:29.640568 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:29.640568 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:28:29.640568 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:29.640568 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:28:29.640568 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:29.640568 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 518/1023] 10.222.0.16 () {56 vars in 1105 bytes} [Fri Sep 30 09:28:29 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:29.647600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774321dc-91a9-4c22-9317-f1819fe37f4a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:29.709101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66437b8c-d012-42b1-86ef-fed7a9a7d43c None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:29.709360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66437b8c-d012-42b1-86ef-fed7a9a7d43c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:29.709636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66437b8c-d012-42b1-86ef-fed7a9a7d43c None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:29.711029 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 519/1024] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:29.716065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ad5ba-3400-4222-a1fb-4c9b42d84fde None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:29.716415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ad5ba-3400-4222-a1fb-4c9b42d84fde None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:29.716815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ad5ba-3400-4222-a1fb-4c9b42d84fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:29.737139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9a8ad5ba-3400-4222-a1fb-4c9b42d84fde None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:29.738322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9a8ad5ba-3400-4222-a1fb-4c9b42d84fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:29.743633 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:29.758977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774321dc-91a9-4c22-9317-f1819fe37f4a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:29.798132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c947bc-4989-407e-a707-53294f93c267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:29.798733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c947bc-4989-407e-a707-53294f93c267 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:29.799009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c947bc-4989-407e-a707-53294f93c267 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:29.799270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c947bc-4989-407e-a707-53294f93c267 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:29.799896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c947bc-4989-407e-a707-53294f93c267 None admin] RBAC: Adding query filter params (name=image) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:29.800354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c947bc-4989-407e-a707-53294f93c267 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:29.802075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c947bc-4989-407e-a707-53294f93c267 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:29.807935 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 506/1025] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:29.813248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c947bc-4989-407e-a707-53294f93c267 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:29.816393 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 520/1026] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:28:29.918605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c947bc-4989-407e-a707-53294f93c267 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:29.956367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7fb96-0c80-4fcc-b97b-b2d1651c5304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:29.957267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7fb96-0c80-4fcc-b97b-b2d1651c5304 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:29.957548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7fb96-0c80-4fcc-b97b-b2d1651c5304 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:29.957815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7fb96-0c80-4fcc-b97b-b2d1651c5304 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:29.958438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7fb96-0c80-4fcc-b97b-b2d1651c5304 None admin] RBAC: Adding query filter params (type=image) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:29.958740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7fb96-0c80-4fcc-b97b-b2d1651c5304 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:29.960898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7fb96-0c80-4fcc-b97b-b2d1651c5304 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:29.970908 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 507/1027] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:29.972015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ad5ba-3400-4222-a1fb-4c9b42d84fde None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:30.033645 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:30.080436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ad5ba-3400-4222-a1fb-4c9b42d84fde None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:30.087067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7fb96-0c80-4fcc-b97b-b2d1651c5304 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:30.105003 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:30.118497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377ec9a-0eb8-4c74-8c9e-3c222af4d9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:30.119109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377ec9a-0eb8-4c74-8c9e-3c222af4d9b1 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:30.119377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377ec9a-0eb8-4c74-8c9e-3c222af4d9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:30.119649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377ec9a-0eb8-4c74-8c9e-3c222af4d9b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:30.120356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377ec9a-0eb8-4c74-8c9e-3c222af4d9b1 None admin] RBAC: Adding query filter params (interface=public, service_id=5da957956b144372b27f5728948d374f, region_id=RegionOne) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:30.120678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377ec9a-0eb8-4c74-8c9e-3c222af4d9b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:30.122030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377ec9a-0eb8-4c74-8c9e-3c222af4d9b1 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:30.126941 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 521/1028] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Sep 30 09:28:29 2022] GET /identity/v3/endpoints?service_id=5da957956b144372b27f5728948d374f&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:30.133027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377ec9a-0eb8-4c74-8c9e-3c222af4d9b1 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:30.200206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7fb96-0c80-4fcc-b97b-b2d1651c5304 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:30.235963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7082be-36cd-4e09-9939-9d27d93b866a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:30.236570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7082be-36cd-4e09-9939-9d27d93b866a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:30.236872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7082be-36cd-4e09-9939-9d27d93b866a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:30.237138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7082be-36cd-4e09-9939-9d27d93b866a None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:30.237484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377ec9a-0eb8-4c74-8c9e-3c222af4d9b1 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:30.238247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7082be-36cd-4e09-9939-9d27d93b866a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:30.240333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7082be-36cd-4e09-9939-9d27d93b866a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:30.241204 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 508/1029] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:30.247250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7082be-36cd-4e09-9939-9d27d93b866a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:30.256353 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:30.276632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290b234-3234-447f-981a-8fb182d3757a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:30.277247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290b234-3234-447f-981a-8fb182d3757a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:30.277644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290b234-3234-447f-981a-8fb182d3757a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:30.277918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290b234-3234-447f-981a-8fb182d3757a None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:30.278559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290b234-3234-447f-981a-8fb182d3757a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:30.279913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290b234-3234-447f-981a-8fb182d3757a None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:30.296713 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 522/1030] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Sep 30 09:28:30 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:28:30.346130 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:30.364553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7082be-36cd-4e09-9939-9d27d93b866a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:30.402498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04ce35-6946-486e-92dd-9e4b44d48074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:30.403114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04ce35-6946-486e-92dd-9e4b44d48074 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:30.403386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04ce35-6946-486e-92dd-9e4b44d48074 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:30.403650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04ce35-6946-486e-92dd-9e4b44d48074 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:30.404301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04ce35-6946-486e-92dd-9e4b44d48074 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:30.405753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04ce35-6946-486e-92dd-9e4b44d48074 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:30.432408 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 509/1031] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Sep 30 09:28:30 2022] POST /identity/v3/users => generated 285 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:28:30.970973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf229f65-e8f8-4a6a-8f90-55c9df285d3e None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:30.971303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf229f65-e8f8-4a6a-8f90-55c9df285d3e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:30.971520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf229f65-e8f8-4a6a-8f90-55c9df285d3e None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:30.972924 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 523/1032] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:30.978652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e35a77-df58-4a76-8853-466ee1fd374a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:30.979117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e35a77-df58-4a76-8853-466ee1fd374a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:30.979195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e35a77-df58-4a76-8853-466ee1fd374a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:31.001963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f6e35a77-df58-4a76-8853-466ee1fd374a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:31.003157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f6e35a77-df58-4a76-8853-466ee1fd374a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:31.076631 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 510/1033] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:31.349587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf229f65-e8f8-4a6a-8f90-55c9df285d3e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:31.455516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf229f65-e8f8-4a6a-8f90-55c9df285d3e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:31.489211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f842f-d00c-4f6e-a7e9-c75b3f29294e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:31.489830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f842f-d00c-4f6e-a7e9-c75b3f29294e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:31.490112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f842f-d00c-4f6e-a7e9-c75b3f29294e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:31.490383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f842f-d00c-4f6e-a7e9-c75b3f29294e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:31.500940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f842f-d00c-4f6e-a7e9-c75b3f29294e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:28:31.505574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-fe2f842f-d00c-4f6e-a7e9-c75b3f29294e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:28:31.505574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:31.505574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:31.505574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:31.505574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:31.505574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:31.505574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:31.505574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:31.505574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:31.505574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:31.505574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:31.505574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:31.505574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:28:31.505574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:28:31.505574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:28:31.505574 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:28:31.506508 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:28:31.506508 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:28:31.506508 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:28:31.506508 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:28:31.506508 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:31.506508 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:31.506508 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:31.506508 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:31.506508 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:31.506508 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:31.506508 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:31.506508 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:31.506508 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:31.506508 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:31.506508 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:31.506508 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:31.508141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:31.508141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:31.508141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:31.508141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:31.508141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:28:31.508141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:28:31.508141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:28:31.508141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:28:31.508141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:28:31.508141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:28:31.508141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:28:31.508141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:31.512317 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 524/1034] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Sep 30 09:28:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:31.513726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e35a77-df58-4a76-8853-466ee1fd374a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:31.585802 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:31.617609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e35a77-df58-4a76-8853-466ee1fd374a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:31.652590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69cdebb-82c0-41ee-977f-56563bb47be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:31.653223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cdebb-82c0-41ee-977f-56563bb47be8 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:31.653503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cdebb-82c0-41ee-977f-56563bb47be8 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:31.653775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cdebb-82c0-41ee-977f-56563bb47be8 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:31.654435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69cdebb-82c0-41ee-977f-56563bb47be8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:31.654739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69cdebb-82c0-41ee-977f-56563bb47be8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:31.656085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69cdebb-82c0-41ee-977f-56563bb47be8 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:31.664076 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 511/1035] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Sep 30 09:28:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:31.670159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f842f-d00c-4f6e-a7e9-c75b3f29294e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:31.715610 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:31.774734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f842f-d00c-4f6e-a7e9-c75b3f29294e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:31.810944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea28f70-1bc5-4b47-bc9f-3d320075ac59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:31.811855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea28f70-1bc5-4b47-bc9f-3d320075ac59 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:31.812352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea28f70-1bc5-4b47-bc9f-3d320075ac59 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:31.812844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea28f70-1bc5-4b47-bc9f-3d320075ac59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:31.822909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea28f70-1bc5-4b47-bc9f-3d320075ac59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:31.824549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea28f70-1bc5-4b47-bc9f-3d320075ac59 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:31.838996 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-7ea28f70-1bc5-4b47-bc9f-3d320075ac59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:31.838996 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:31.838996 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:31.838996 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:31.838996 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:31.838996 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:31.838996 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:31.838996 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:31.838996 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:31.838996 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:31.838996 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:31.838996 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:31.838996 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:28:31.838996 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:28:31.838996 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:28:31.838996 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:28:31.840118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:31.840118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:31.840118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:31.840118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:31.840118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:31.840118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:31.840118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:31.840118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:31.840118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:31.840118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:31.840118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:31.840118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:31.840118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:31.840118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:31.840118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:31.840118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:31.840118 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:28:31.841269 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:28:31.841269 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:31.841269 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:31.847628 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 525/1036] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:31.849292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69cdebb-82c0-41ee-977f-56563bb47be8 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:31.959139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69cdebb-82c0-41ee-977f-56563bb47be8 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:31.988863 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:31.995525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f613116-8d15-4736-ba5d-5acc6311d6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:31.996322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f613116-8d15-4736-ba5d-5acc6311d6bb None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:31.996779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f613116-8d15-4736-ba5d-5acc6311d6bb None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:31.997197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f613116-8d15-4736-ba5d-5acc6311d6bb None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:31.997978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f613116-8d15-4736-ba5d-5acc6311d6bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:31.998422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f613116-8d15-4736-ba5d-5acc6311d6bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:32.000104 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f613116-8d15-4736-ba5d-5acc6311d6bb None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:32.016969 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 512/1037] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:32.018467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea28f70-1bc5-4b47-bc9f-3d320075ac59 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:32.113485 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:32.121212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea28f70-1bc5-4b47-bc9f-3d320075ac59 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:32.156464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5035d3-5248-4a80-8b1b-e1235ee24a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:32.157381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5035d3-5248-4a80-8b1b-e1235ee24a89 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:32.157806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5035d3-5248-4a80-8b1b-e1235ee24a89 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:32.158227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5035d3-5248-4a80-8b1b-e1235ee24a89 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:32.166010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5035d3-5248-4a80-8b1b-e1235ee24a89 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:32.167678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5035d3-5248-4a80-8b1b-e1235ee24a89 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:32.179790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-cc5035d3-5248-4a80-8b1b-e1235ee24a89 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:28:32.179790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:32.179790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:32.179790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:32.179790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:32.179790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:32.179790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:32.179790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:32.179790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:32.179790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:32.179790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:32.179790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:32.179790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:28:32.179790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:28:32.179790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:28:32.179790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:28:32.180880 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:32.180880 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:32.180880 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:28:32.180880 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:32.180880 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:28:32.180880 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:32.180880 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:32.180880 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:32.180880 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:32.180880 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:32.180880 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:32.180880 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:32.180880 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:32.180880 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:32.180880 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:32.180880 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:32.180880 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:32.180880 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:32.186402 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:32.186402 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:32.186402 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:28:32.186402 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:28:32.186402 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:28:32.186402 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:28:32.186402 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:28:32.186402 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:28:32.186402 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:28:32.186402 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:32.186402 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 526/1038] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Sep 30 09:28:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:32.188685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f613116-8d15-4736-ba5d-5acc6311d6bb None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:32.289225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f613116-8d15-4736-ba5d-5acc6311d6bb None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:32.327639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8260fd-9392-4bf2-b08b-918681bbf5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:32.328543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8260fd-9392-4bf2-b08b-918681bbf5b4 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:32.328987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8260fd-9392-4bf2-b08b-918681bbf5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:32.329405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8260fd-9392-4bf2-b08b-918681bbf5b4 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:32.330271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8260fd-9392-4bf2-b08b-918681bbf5b4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:32.330745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8260fd-9392-4bf2-b08b-918681bbf5b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:32.332544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8260fd-9392-4bf2-b08b-918681bbf5b4 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:32.355246 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 513/1039] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Sep 30 09:28:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:32.361279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5035d3-5248-4a80-8b1b-e1235ee24a89 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:32.471670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5035d3-5248-4a80-8b1b-e1235ee24a89 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:32.508118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a88af-75a3-496a-acde-9a468620cf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:32.508771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a88af-75a3-496a-acde-9a468620cf50 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:32.509098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a88af-75a3-496a-acde-9a468620cf50 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:32.509388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a88af-75a3-496a-acde-9a468620cf50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:32.512621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9846785-f92a-4b6c-b9df-357f8d69808b None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:32.512926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9846785-f92a-4b6c-b9df-357f8d69808b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:32.513179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9846785-f92a-4b6c-b9df-357f8d69808b None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:32.514720 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 514/1040] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:32.520319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb90106-83e0-47c3-af3a-57753d89a3f9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:32.520652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb90106-83e0-47c3-af3a-57753d89a3f9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:32.520905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb90106-83e0-47c3-af3a-57753d89a3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:32.541525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ccb90106-83e0-47c3-af3a-57753d89a3f9 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:32.542795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ccb90106-83e0-47c3-af3a-57753d89a3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:32.547798 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:32.597861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a88af-75a3-496a-acde-9a468620cf50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:32.599650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a88af-75a3-496a-acde-9a468620cf50 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:32.600855 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:32.626098 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 515/1041] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:28:32.640163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363ed1a-3cb0-44ce-9a02-4b62a789f413 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:32.640438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363ed1a-3cb0-44ce-9a02-4b62a789f413 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:32.640737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363ed1a-3cb0-44ce-9a02-4b62a789f413 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:32.642173 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 516/1042] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:28:32.646871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754a72e-2a1b-46ab-af48-de406d17e095 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:32.647147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754a72e-2a1b-46ab-af48-de406d17e095 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:32.647423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754a72e-2a1b-46ab-af48-de406d17e095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:32.666237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d754a72e-2a1b-46ab-af48-de406d17e095 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:32.667409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d754a72e-2a1b-46ab-af48-de406d17e095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:32.706119 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 527/1043] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:28:32 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:28:32.713462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a88af-75a3-496a-acde-9a468620cf50 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:32.736690 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 517/1044] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:28:32.776830 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:32.821932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a88af-75a3-496a-acde-9a468620cf50 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:32.856293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6e925-768c-4e96-917c-f7c2506da369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:32.856952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6e925-768c-4e96-917c-f7c2506da369 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:32.857231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6e925-768c-4e96-917c-f7c2506da369 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:32.857501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6e925-768c-4e96-917c-f7c2506da369 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:32.867448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6e925-768c-4e96-917c-f7c2506da369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:32.868896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6e925-768c-4e96-917c-f7c2506da369 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:32.884910 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-d4d6e925-768c-4e96-917c-f7c2506da369 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:32.884910 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:32.884910 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:32.884910 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:32.884910 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:32.884910 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:32.884910 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:32.884910 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:32.884910 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:32.884910 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:32.884910 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:32.884910 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:32.884910 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:28:32.884910 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:28:32.884910 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:28:32.884910 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:28:32.891060 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:32.891060 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:32.891060 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:32.891060 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:32.891060 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:32.891060 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:32.891060 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:32.891060 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:32.891060 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:32.891060 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:32.891060 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:32.891060 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:32.891060 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:32.891060 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:32.891060 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:32.891060 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:32.891060 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:28:32.891974 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:28:32.891974 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:32.891974 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:32.891974 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 528/1045] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:32.893630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754a72e-2a1b-46ab-af48-de406d17e095 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:32.906076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6e925-768c-4e96-917c-f7c2506da369 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:33.007678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754a72e-2a1b-46ab-af48-de406d17e095 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:33.017553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6e925-768c-4e96-917c-f7c2506da369 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:33.018487 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:33.024743 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:33.043360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93357d25-99d2-4ded-98e8-6e05714d254b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:33.043963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93357d25-99d2-4ded-98e8-6e05714d254b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:33.044239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93357d25-99d2-4ded-98e8-6e05714d254b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:33.044514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93357d25-99d2-4ded-98e8-6e05714d254b None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:33.045183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93357d25-99d2-4ded-98e8-6e05714d254b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:33.045483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93357d25-99d2-4ded-98e8-6e05714d254b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:33.046836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93357d25-99d2-4ded-98e8-6e05714d254b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:33.051033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30405ab8-b41e-44ab-90e1-14149f50e6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:33.051643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30405ab8-b41e-44ab-90e1-14149f50e6d1 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:33.051914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30405ab8-b41e-44ab-90e1-14149f50e6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:33.052177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30405ab8-b41e-44ab-90e1-14149f50e6d1 None admin] PATH_INFO: `/v3/services/image` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:33.052770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30405ab8-b41e-44ab-90e1-14149f50e6d1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:33.054790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30405ab8-b41e-44ab-90e1-14149f50e6d1 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:33.058442 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 518/1046] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:33.059232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93357d25-99d2-4ded-98e8-6e05714d254b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:33.063282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-30405ab8-b41e-44ab-90e1-14149f50e6d1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:28:33.063282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:33.063282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:28:33.063282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:28:33.063282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:28:33.063282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:28:33.063282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:28:33.063282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:33.063282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:28:33.063282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:33.063282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:28:33.063282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:33.063282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:33.063282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:33.063282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:33.063282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:33.063282 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:33.064427 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:33.064427 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:33.064427 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:33.064427 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:33.064427 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:33.064427 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:33.064427 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:28:33.064427 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:28:33.064427 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:28:33.064427 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:28:33.064427 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:33.064427 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:33.064427 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:33.064427 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:33.064427 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:33.064427 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:33.065297 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:33.065297 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:33.065297 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:33.065297 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:33.065297 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:33.065297 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:33.065297 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:33.065297 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:33.065297 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:33.065297 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:33.065297 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:28:33.065297 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:28:33.065297 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 09:28:33.065297 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:33.065297 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 529/1047] 10.222.0.16 () {56 vars in 1105 bytes} [Fri Sep 30 09:28:32 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:33.066086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30405ab8-b41e-44ab-90e1-14149f50e6d1 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:33.163296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93357d25-99d2-4ded-98e8-6e05714d254b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:33.163569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30405ab8-b41e-44ab-90e1-14149f50e6d1 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:33.196033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9b42e-3593-4d87-8d64-cde60ff40dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:33.196360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34b1dd-54b4-4dc8-b16c-34b20a791bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:33.196664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9b42e-3593-4d87-8d64-cde60ff40dbd None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:33.197000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34b1dd-54b4-4dc8-b16c-34b20a791bc5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:33.197222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9b42e-3593-4d87-8d64-cde60ff40dbd None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:33.197337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34b1dd-54b4-4dc8-b16c-34b20a791bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:33.197497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9b42e-3593-4d87-8d64-cde60ff40dbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:33.197608 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34b1dd-54b4-4dc8-b16c-34b20a791bc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:33.204066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34b1dd-54b4-4dc8-b16c-34b20a791bc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:33.205514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34b1dd-54b4-4dc8-b16c-34b20a791bc5 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:33.208337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9b42e-3593-4d87-8d64-cde60ff40dbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:28:33.213250 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-39c9b42e-3593-4d87-8d64-cde60ff40dbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:28:33.213250 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:33.213250 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:33.213250 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:33.213250 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:33.213250 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:33.213250 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:33.213250 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:33.213250 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:33.213250 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:33.213250 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:33.213250 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:33.213250 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:28:33.213250 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:28:33.213250 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:28:33.213250 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:28:33.214351 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:28:33.214351 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:28:33.214351 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:28:33.214351 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:28:33.214351 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:33.214351 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:33.214351 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:33.214351 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:33.214351 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:33.214351 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:33.214351 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:33.214351 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:33.214351 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:33.214351 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:33.214351 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:33.214351 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:33.215519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:33.215519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:33.215519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:33.215519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:33.215519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:28:33.215519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:28:33.215519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:28:33.215519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:28:33.215519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:28:33.215519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:28:33.215519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:28:33.215519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:33.215519 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 519/1048] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:28:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:33.215519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9b42e-3593-4d87-8d64-cde60ff40dbd None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:33.218860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-1c34b1dd-54b4-4dc8-b16c-34b20a791bc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:28:33.218860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:33.218860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:33.218860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:33.218860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:33.218860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:33.218860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:33.218860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:33.218860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:33.218860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:33.218860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:33.218860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:33.218860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:28:33.218860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:28:33.218860 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:28:33.219822 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:28:33.219822 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:33.219822 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:33.219822 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:33.219822 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:33.219822 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:33.219822 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:33.219822 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:33.219822 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:33.219822 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:33.219822 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:33.219822 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:33.219822 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:33.219822 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:33.219822 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:33.219822 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:33.219822 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:33.220752 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:28:33.220752 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:28:33.220752 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:28:33.220752 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:28:33.220752 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:28:33.220752 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:28:33.220752 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:28:33.220752 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:33.221196 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 530/1049] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:28:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:33.222505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34b1dd-54b4-4dc8-b16c-34b20a791bc5 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:33.248640 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:33.252790 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:33.315589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9b42e-3593-4d87-8d64-cde60ff40dbd None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:33.322925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34b1dd-54b4-4dc8-b16c-34b20a791bc5 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:33.349720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044da47-aca3-42b9-b119-fcf9af5aec4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:33.350317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044da47-aca3-42b9-b119-fcf9af5aec4f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:33.350785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044da47-aca3-42b9-b119-fcf9af5aec4f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:33.351042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044da47-aca3-42b9-b119-fcf9af5aec4f None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:33.351663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044da47-aca3-42b9-b119-fcf9af5aec4f None admin] RBAC: Adding query filter params (name=image) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:33.351965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044da47-aca3-42b9-b119-fcf9af5aec4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:33.353411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044da47-aca3-42b9-b119-fcf9af5aec4f None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:33.356585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a26e9b-a662-4360-b606-3e815fdfa3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:33.357200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a26e9b-a662-4360-b606-3e815fdfa3ca None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:33.357475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a26e9b-a662-4360-b606-3e815fdfa3ca None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:33.357741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a26e9b-a662-4360-b606-3e815fdfa3ca None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:33.358036 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 520/1050] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:33.362827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a26e9b-a662-4360-b606-3e815fdfa3ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:33.362827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a26e9b-a662-4360-b606-3e815fdfa3ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:33.363340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044da47-aca3-42b9-b119-fcf9af5aec4f None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:33.363431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a26e9b-a662-4360-b606-3e815fdfa3ca None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:33.368554 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 531/1051] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:28:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:33.369364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a26e9b-a662-4360-b606-3e815fdfa3ca None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:33.454402 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:33.456266 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:33.462504 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044da47-aca3-42b9-b119-fcf9af5aec4f None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:33.468795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a26e9b-a662-4360-b606-3e815fdfa3ca None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:33.495447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1292cab-bef7-4c5c-9801-d0aebaaf3253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:33.496040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1292cab-bef7-4c5c-9801-d0aebaaf3253 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:33.496310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1292cab-bef7-4c5c-9801-d0aebaaf3253 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:33.496579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1292cab-bef7-4c5c-9801-d0aebaaf3253 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:33.497272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1292cab-bef7-4c5c-9801-d0aebaaf3253 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:33.497572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1292cab-bef7-4c5c-9801-d0aebaaf3253 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:33.498948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1292cab-bef7-4c5c-9801-d0aebaaf3253 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:33.502671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d22cd7-871d-470f-a70b-0f3f7a69db54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:33.503269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d22cd7-871d-470f-a70b-0f3f7a69db54 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:33.503547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d22cd7-871d-470f-a70b-0f3f7a69db54 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:33.503816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d22cd7-871d-470f-a70b-0f3f7a69db54 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:33.504439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d22cd7-871d-470f-a70b-0f3f7a69db54 None admin] RBAC: Adding query filter params (type=image) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:33.504783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d22cd7-871d-470f-a70b-0f3f7a69db54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:33.506591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d22cd7-871d-470f-a70b-0f3f7a69db54 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:33.511469 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 521/1052] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:28:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:33.512256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1292cab-bef7-4c5c-9801-d0aebaaf3253 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:33.519177 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 532/1053] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:33.519177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d22cd7-871d-470f-a70b-0f3f7a69db54 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:33.615954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1292cab-bef7-4c5c-9801-d0aebaaf3253 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:33.618840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d22cd7-871d-470f-a70b-0f3f7a69db54 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:33.651948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99656dbb-cde2-4b3a-ae09-3152714b4de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:33.652542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99656dbb-cde2-4b3a-ae09-3152714b4de8 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:33.652851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99656dbb-cde2-4b3a-ae09-3152714b4de8 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:33.653111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99656dbb-cde2-4b3a-ae09-3152714b4de8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:33.653826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99656dbb-cde2-4b3a-ae09-3152714b4de8 None admin] RBAC: Adding query filter params (role.id=a147711fae6d4aa1873fdea65ad1663b, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=aa607111024540d1a09b01dfd1e5e8cd) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:33.654127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99656dbb-cde2-4b3a-ae09-3152714b4de8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:33.655531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99656dbb-cde2-4b3a-ae09-3152714b4de8 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:33.657011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbbf10-e338-4bf7-800e-e9b785f22a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:33.658095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbbf10-e338-4bf7-800e-e9b785f22a64 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:33.658095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbbf10-e338-4bf7-800e-e9b785f22a64 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:33.658294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbbf10-e338-4bf7-800e-e9b785f22a64 None admin] PATH_INFO: `/v3/users/3cb4479c432f4d4c8016ff2b51acebfb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:33.661092 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 533/1054] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:28:33 2022] GET /identity/v3/role_assignments?user.id=aa607111024540d1a09b01dfd1e5e8cd&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=a147711fae6d4aa1873fdea65ad1663b => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:33.661918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99656dbb-cde2-4b3a-ae09-3152714b4de8 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:33.686045 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:33.689592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbbf10-e338-4bf7-800e-e9b785f22a64 None admin] RBAC: Authorizing `identity:get_user(user_id=3cb4479c432f4d4c8016ff2b51acebfb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:33.691070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbbf10-e338-4bf7-800e-e9b785f22a64 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:33.698529 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 522/1055] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:28:33 2022] GET /identity/v3/users/3cb4479c432f4d4c8016ff2b51acebfb => generated 285 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:33.699799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbbf10-e338-4bf7-800e-e9b785f22a64 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:33.715802 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:33.782957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99656dbb-cde2-4b3a-ae09-3152714b4de8 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:33.821557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcca0a-4f06-4b49-9b41-364f6d4bc666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:33.822166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcca0a-4f06-4b49-9b41-364f6d4bc666 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:33.822441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcca0a-4f06-4b49-9b41-364f6d4bc666 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:33.822709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcca0a-4f06-4b49-9b41-364f6d4bc666 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:33.823372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcca0a-4f06-4b49-9b41-364f6d4bc666 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:33.824750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcca0a-4f06-4b49-9b41-364f6d4bc666 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:33.824853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbbf10-e338-4bf7-800e-e9b785f22a64 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:33.845817 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 534/1056] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:28:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:28:33.873270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf6de3-2d00-42e9-8163-7ba70b261aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:33.873803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf6de3-2d00-42e9-8163-7ba70b261aec None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:33.874079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf6de3-2d00-42e9-8163-7ba70b261aec None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:33.874349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf6de3-2d00-42e9-8163-7ba70b261aec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:33.958809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf6de3-2d00-42e9-8163-7ba70b261aec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:33.960309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf6de3-2d00-42e9-8163-7ba70b261aec None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:33.971945 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:34.070953 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 523/1057] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:28:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 30 09:28:34.077232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcca0a-4f06-4b49-9b41-364f6d4bc666 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:34.158311 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:34.184447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcca0a-4f06-4b49-9b41-364f6d4bc666 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:34.217895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e8382-29eb-4a71-b5d7-c8c47142f606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:34.218570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e8382-29eb-4a71-b5d7-c8c47142f606 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:34.218847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e8382-29eb-4a71-b5d7-c8c47142f606 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:34.219113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e8382-29eb-4a71-b5d7-c8c47142f606 None admin] PATH_INFO: `/v3/projects/7e10c9c115934787b8eed9ffc6824ae7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:34.220200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e8382-29eb-4a71-b5d7-c8c47142f606 None admin] RBAC: Authorizing `identity:get_project(project_id=7e10c9c115934787b8eed9ffc6824ae7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:34.221644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e8382-29eb-4a71-b5d7-c8c47142f606 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:34.228640 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 535/1058] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:28:34 2022] GET /identity/v3/projects/7e10c9c115934787b8eed9ffc6824ae7 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:34.229842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf6de3-2d00-42e9-8163-7ba70b261aec None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:34.327338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf6de3-2d00-42e9-8163-7ba70b261aec None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:34.338936 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:34.367023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596836e-35ed-4889-b7d5-3db54d3c49a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:34.367538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596836e-35ed-4889-b7d5-3db54d3c49a1 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:34.367851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596836e-35ed-4889-b7d5-3db54d3c49a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:34.368128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596836e-35ed-4889-b7d5-3db54d3c49a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:34.368871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596836e-35ed-4889-b7d5-3db54d3c49a1 None admin] RBAC: Adding query filter params (role.id=f06b5fed717d4b03a5083dd847274296, scope.project.id=7e10c9c115934787b8eed9ffc6824ae7, user.id=3cb4479c432f4d4c8016ff2b51acebfb) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:34.369171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596836e-35ed-4889-b7d5-3db54d3c49a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:34.370560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596836e-35ed-4889-b7d5-3db54d3c49a1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:34.384650 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 524/1059] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:28:34 2022] GET /identity/v3/role_assignments?user.id=3cb4479c432f4d4c8016ff2b51acebfb&scope.project.id=7e10c9c115934787b8eed9ffc6824ae7&role.id=f06b5fed717d4b03a5083dd847274296 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:35.848519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07cd63-36a0-4d3a-938e-e1ae37f4417c None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:35.849076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07cd63-36a0-4d3a-938e-e1ae37f4417c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:35.849076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07cd63-36a0-4d3a-938e-e1ae37f4417c None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:35.851074 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 536/1060] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:35.856223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc227d8c-0840-44d1-92a2-701cabce2c4f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:35.856673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc227d8c-0840-44d1-92a2-701cabce2c4f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:35.856838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc227d8c-0840-44d1-92a2-701cabce2c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:35.875490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bc227d8c-0840-44d1-92a2-701cabce2c4f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:35.876685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bc227d8c-0840-44d1-92a2-701cabce2c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:35.948260 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 525/1061] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:36.155410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57cb0d-5ad9-4ee5-b190-66f7709ba336 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:36.155744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57cb0d-5ad9-4ee5-b190-66f7709ba336 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:36.155868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57cb0d-5ad9-4ee5-b190-66f7709ba336 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:36.157372 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 537/1062] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:36.162463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c8bdc-b92c-4e83-90c9-20c5a473747c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:36.162818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c8bdc-b92c-4e83-90c9-20c5a473747c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:36.163209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c8bdc-b92c-4e83-90c9-20c5a473747c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:36.181712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ea1c8bdc-b92c-4e83-90c9-20c5a473747c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:36.182913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ea1c8bdc-b92c-4e83-90c9-20c5a473747c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:36.231030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57cb0d-5ad9-4ee5-b190-66f7709ba336 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:36.254142 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 526/1063] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:36.338540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57cb0d-5ad9-4ee5-b190-66f7709ba336 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:36.373571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65bfcf-32a9-4633-95bf-60e93470ac27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:36.374191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65bfcf-32a9-4633-95bf-60e93470ac27 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:36.374466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65bfcf-32a9-4633-95bf-60e93470ac27 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:36.374732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65bfcf-32a9-4633-95bf-60e93470ac27 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:36.385537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65bfcf-32a9-4633-95bf-60e93470ac27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:28:36.390227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-0f65bfcf-32a9-4633-95bf-60e93470ac27 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:28:36.390227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:36.390227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:36.390227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:36.390227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:36.390227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:36.390227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:36.390227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:36.390227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:36.390227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:36.390227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:36.390227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:36.390227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:28:36.390227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:28:36.390227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:28:36.390227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:28:36.391148 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:28:36.391148 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:28:36.391148 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:28:36.391148 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:28:36.391148 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:36.391148 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:36.391148 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:36.391148 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:36.391148 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:36.391148 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:36.391148 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:36.391148 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:36.391148 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:36.391148 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:36.391148 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:36.391148 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:36.391990 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:36.391990 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:36.391990 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:36.391990 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:36.391990 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:28:36.391990 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:28:36.391990 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:28:36.391990 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:28:36.391990 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:28:36.391990 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:28:36.391990 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:28:36.391990 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:36.391990 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 538/1064] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Sep 30 09:28:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:36.398249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c8bdc-b92c-4e83-90c9-20c5a473747c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:36.430604 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:36.503566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c8bdc-b92c-4e83-90c9-20c5a473747c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:36.528152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65bfcf-32a9-4633-95bf-60e93470ac27 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:36.532440 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:36.540587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e7092-4b4a-4f1d-be72-002aaf31bd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:36.541938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e7092-4b4a-4f1d-be72-002aaf31bd70 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:36.542265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e7092-4b4a-4f1d-be72-002aaf31bd70 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:36.542558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e7092-4b4a-4f1d-be72-002aaf31bd70 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:36.543607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e7092-4b4a-4f1d-be72-002aaf31bd70 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:36.544180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e7092-4b4a-4f1d-be72-002aaf31bd70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:36.545971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e7092-4b4a-4f1d-be72-002aaf31bd70 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:36.562256 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 527/1065] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Sep 30 09:28:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:36.563357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e7092-4b4a-4f1d-be72-002aaf31bd70 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:36.635655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65bfcf-32a9-4633-95bf-60e93470ac27 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:36.656506 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:36.664039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e7092-4b4a-4f1d-be72-002aaf31bd70 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:36.670351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7d015-2641-49cd-a2f8-fce8ae6a3918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:36.670954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7d015-2641-49cd-a2f8-fce8ae6a3918 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:36.671223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7d015-2641-49cd-a2f8-fce8ae6a3918 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:36.671486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7d015-2641-49cd-a2f8-fce8ae6a3918 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:36.696567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157e894-90c5-441f-90e5-ab8e910a567d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:36.697141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157e894-90c5-441f-90e5-ab8e910a567d None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:36.697418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157e894-90c5-441f-90e5-ab8e910a567d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:36.697684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157e894-90c5-441f-90e5-ab8e910a567d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:36.708134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157e894-90c5-441f-90e5-ab8e910a567d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:36.709567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157e894-90c5-441f-90e5-ab8e910a567d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:36.723549 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-7157e894-90c5-441f-90e5-ab8e910a567d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:36.723549 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:36.723549 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:36.723549 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:36.723549 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:36.723549 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:36.723549 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:36.723549 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:36.723549 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:36.723549 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:36.723549 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:36.723549 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:36.723549 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:28:36.723549 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:28:36.723549 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:28:36.723549 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:28:36.724498 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:36.724498 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:36.724498 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:36.724498 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:36.724498 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:36.724498 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:36.724498 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:36.724498 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:36.724498 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:36.724498 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:36.724498 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:36.724498 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:36.724498 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:36.724498 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:36.724498 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:36.724498 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:36.724498 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:28:36.726279 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:28:36.726279 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:36.726279 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:36.726279 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 528/1066] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:36.726644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bf8de-b3c3-4ea2-b5ab-0ad20b3d9342 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:36.726720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bf8de-b3c3-4ea2-b5ab-0ad20b3d9342 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:36.726963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bf8de-b3c3-4ea2-b5ab-0ad20b3d9342 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:36.728181 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 529/1067] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:36.730929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bf8de-b3c3-4ea2-b5ab-0ad20b3d9342 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:36.743293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7d015-2641-49cd-a2f8-fce8ae6a3918 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:36.744749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7d015-2641-49cd-a2f8-fce8ae6a3918 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:36.747277 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:36.831032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bf8de-b3c3-4ea2-b5ab-0ad20b3d9342 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:36.843117 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 539/1068] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:28:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 30 09:28:36.844322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf754f-f17d-43aa-a778-d3bf8c82dda3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:36.844623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf754f-f17d-43aa-a778-d3bf8c82dda3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:36.844899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf754f-f17d-43aa-a778-d3bf8c82dda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:36.862585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e6cf754f-f17d-43aa-a778-d3bf8c82dda3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:36.864002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e6cf754f-f17d-43aa-a778-d3bf8c82dda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:36.865766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d0264-00c2-4f94-9b38-5c5706035192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:36.866372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d0264-00c2-4f94-9b38-5c5706035192 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:36.866652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d0264-00c2-4f94-9b38-5c5706035192 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:36.866924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d0264-00c2-4f94-9b38-5c5706035192 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:36.867563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d0264-00c2-4f94-9b38-5c5706035192 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:36.867865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d0264-00c2-4f94-9b38-5c5706035192 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:36.869256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d0264-00c2-4f94-9b38-5c5706035192 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:36.886761 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 530/1069] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:36.886761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d0264-00c2-4f94-9b38-5c5706035192 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:36.891172 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:36.937253 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 540/1070] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:36.937920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf754f-f17d-43aa-a778-d3bf8c82dda3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:36.974863 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:36.990397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d0264-00c2-4f94-9b38-5c5706035192 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:37.026256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b4311-1127-4254-86ac-5c9a2a5a5ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:37.026878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b4311-1127-4254-86ac-5c9a2a5a5ae5 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:37.027154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b4311-1127-4254-86ac-5c9a2a5a5ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:37.027417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b4311-1127-4254-86ac-5c9a2a5a5ae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:37.038620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b4311-1127-4254-86ac-5c9a2a5a5ae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:37.040137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b4311-1127-4254-86ac-5c9a2a5a5ae5 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:37.046411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf754f-f17d-43aa-a778-d3bf8c82dda3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:37.055104 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-500b4311-1127-4254-86ac-5c9a2a5a5ae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:37.055104 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:37.055104 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:37.055104 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:37.055104 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:37.055104 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:37.055104 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:37.055104 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:37.055104 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:37.055104 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:37.055104 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:37.055104 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:37.055104 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:28:37.055104 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:28:37.055104 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:28:37.055104 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:28:37.056082 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:37.056082 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:37.056082 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:37.056082 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:37.056082 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:37.056082 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:37.056082 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:37.056082 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:37.056082 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:37.056082 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:37.056082 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:37.056082 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:37.056082 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:37.056082 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:37.056082 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:37.056082 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:37.056082 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:28:37.057012 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:28:37.057012 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:37.057012 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:37.057012 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 531/1071] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:37.062197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b4311-1127-4254-86ac-5c9a2a5a5ae5 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:37.083273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df90b9-0de0-4bea-992b-076baf029509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:37.083893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df90b9-0de0-4bea-992b-076baf029509 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:37.084165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df90b9-0de0-4bea-992b-076baf029509 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:37.084433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df90b9-0de0-4bea-992b-076baf029509 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:37.092069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df90b9-0de0-4bea-992b-076baf029509 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:37.093718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df90b9-0de0-4bea-992b-076baf029509 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:37.106216 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-45df90b9-0de0-4bea-992b-076baf029509 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:28:37.106216 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:37.106216 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:37.106216 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:37.106216 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:37.106216 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:37.106216 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:37.106216 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:37.106216 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:37.106216 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:37.106216 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:37.106216 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:37.106216 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:28:37.106216 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:28:37.106216 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:28:37.106216 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:28:37.107189 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:37.107189 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:37.107189 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:28:37.107189 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:37.107189 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:28:37.107189 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:37.107189 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:37.107189 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:37.107189 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:37.107189 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:37.107189 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:37.107189 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:37.107189 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:37.107189 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:37.107189 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:37.107189 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:37.107189 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:37.107189 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:37.108160 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:37.108160 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:37.108160 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:28:37.108160 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:28:37.108160 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:28:37.108160 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:28:37.108160 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:28:37.108160 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:28:37.108160 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:28:37.108160 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:37.108160 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 541/1072] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Sep 30 09:28:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:37.112883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df90b9-0de0-4bea-992b-076baf029509 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:37.128181 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:37.173826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b4311-1127-4254-86ac-5c9a2a5a5ae5 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:37.207808 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:37.210989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2fc097-a29f-4ca2-b37c-8fd3023ad35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:37.211589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fc097-a29f-4ca2-b37c-8fd3023ad35a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:37.211867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fc097-a29f-4ca2-b37c-8fd3023ad35a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:37.212136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fc097-a29f-4ca2-b37c-8fd3023ad35a None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:37.212798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2fc097-a29f-4ca2-b37c-8fd3023ad35a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:37.213096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2fc097-a29f-4ca2-b37c-8fd3023ad35a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:37.214435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2fc097-a29f-4ca2-b37c-8fd3023ad35a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:37.215364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df90b9-0de0-4bea-992b-076baf029509 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:37.226714 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 532/1073] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:37.227411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2fc097-a29f-4ca2-b37c-8fd3023ad35a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:37.251494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6edea-c8fd-4c16-8707-5ad702907f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:37.252473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6edea-c8fd-4c16-8707-5ad702907f18 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:37.252983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6edea-c8fd-4c16-8707-5ad702907f18 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:37.253321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6edea-c8fd-4c16-8707-5ad702907f18 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:37.254215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6edea-c8fd-4c16-8707-5ad702907f18 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:37.254519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6edea-c8fd-4c16-8707-5ad702907f18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:37.255987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6edea-c8fd-4c16-8707-5ad702907f18 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:37.279156 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 542/1074] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Sep 30 09:28:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:37.282650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6edea-c8fd-4c16-8707-5ad702907f18 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:37.354162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2fc097-a29f-4ca2-b37c-8fd3023ad35a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:37.375940 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:37.395134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6edea-c8fd-4c16-8707-5ad702907f18 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:37.396351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7571912-e3be-4d3b-9d09-a41b46454344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:37.397127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7571912-e3be-4d3b-9d09-a41b46454344 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:37.398068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7571912-e3be-4d3b-9d09-a41b46454344 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:37.398342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7571912-e3be-4d3b-9d09-a41b46454344 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:37.410201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7571912-e3be-4d3b-9d09-a41b46454344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:28:37.415055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-d7571912-e3be-4d3b-9d09-a41b46454344 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:28:37.415055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:37.415055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:37.415055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:37.415055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:37.415055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:37.415055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:37.415055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:37.415055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:37.415055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:37.415055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:37.415055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:37.415055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:28:37.415055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:28:37.415055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:28:37.415055 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:28:37.415970 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:28:37.415970 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:28:37.415970 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:28:37.415970 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:28:37.415970 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:37.415970 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:37.415970 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:37.415970 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:37.415970 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:37.415970 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:37.415970 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:37.415970 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:37.415970 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:37.415970 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:37.415970 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:37.415970 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:37.416983 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:37.416983 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:37.416983 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:37.416983 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:37.416983 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:28:37.416983 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:28:37.416983 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:28:37.416983 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:28:37.416983 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:28:37.416983 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:28:37.416983 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:28:37.416983 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:37.420718 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 533/1075] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:28:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:37.422572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7571912-e3be-4d3b-9d09-a41b46454344 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:37.439889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f670806-b55f-4241-b7f9-e5d0f28b4648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:37.440636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f670806-b55f-4241-b7f9-e5d0f28b4648 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:37.440914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f670806-b55f-4241-b7f9-e5d0f28b4648 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:37.441506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f670806-b55f-4241-b7f9-e5d0f28b4648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:37.453144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f670806-b55f-4241-b7f9-e5d0f28b4648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:37.455187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f670806-b55f-4241-b7f9-e5d0f28b4648 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:37.472487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-9f670806-b55f-4241-b7f9-e5d0f28b4648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:37.472487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:37.472487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:37.472487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:37.472487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:37.472487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:37.472487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:37.472487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:37.472487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:37.472487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:37.472487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:37.472487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:37.472487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:28:37.472487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:28:37.472487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:28:37.472487 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:28:37.473667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:37.473667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:37.473667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:37.473667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:37.473667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:37.473667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:37.473667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:37.473667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:37.473667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:37.473667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:37.473667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:37.473667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:37.473667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:37.473667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:37.473667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:37.473667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:37.473667 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:28:37.474590 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:28:37.474590 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:37.474590 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:37.475270 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 543/1076] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:37.480960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f670806-b55f-4241-b7f9-e5d0f28b4648 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:37.485189 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:37.552785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7571912-e3be-4d3b-9d09-a41b46454344 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:37.589691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f670806-b55f-4241-b7f9-e5d0f28b4648 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:37.591875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c08c1-615c-44f7-8ca2-fbe4b4b69ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:37.592478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c08c1-615c-44f7-8ca2-fbe4b4b69ff5 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:37.592946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c08c1-615c-44f7-8ca2-fbe4b4b69ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:37.593225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c08c1-615c-44f7-8ca2-fbe4b4b69ff5 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:37.593885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c08c1-615c-44f7-8ca2-fbe4b4b69ff5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:37.594187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c08c1-615c-44f7-8ca2-fbe4b4b69ff5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:37.595534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c08c1-615c-44f7-8ca2-fbe4b4b69ff5 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:37.604497 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 534/1077] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:28:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:37.610116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c08c1-615c-44f7-8ca2-fbe4b4b69ff5 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:37.627352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15169f0a-bf80-4da0-a084-6584dee148af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:37.628201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15169f0a-bf80-4da0-a084-6584dee148af None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:37.628477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15169f0a-bf80-4da0-a084-6584dee148af None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:37.628786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15169f0a-bf80-4da0-a084-6584dee148af None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:37.629418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15169f0a-bf80-4da0-a084-6584dee148af None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:37.629718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15169f0a-bf80-4da0-a084-6584dee148af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:37.631140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15169f0a-bf80-4da0-a084-6584dee148af None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:37.643182 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 544/1078] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:37.649667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15169f0a-bf80-4da0-a084-6584dee148af None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:37.654830 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:37.711507 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:37.714170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c08c1-615c-44f7-8ca2-fbe4b4b69ff5 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:37.751335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c07497-964f-4137-a84a-c25329cf9c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:37.751729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15169f0a-bf80-4da0-a084-6584dee148af None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:37.752013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c07497-964f-4137-a84a-c25329cf9c7d None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:37.752323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c07497-964f-4137-a84a-c25329cf9c7d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:37.752622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c07497-964f-4137-a84a-c25329cf9c7d None admin] PATH_INFO: `/v3/users/3cb4479c432f4d4c8016ff2b51acebfb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:37.753767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c07497-964f-4137-a84a-c25329cf9c7d None admin] RBAC: Authorizing `identity:get_user(user_id=3cb4479c432f4d4c8016ff2b51acebfb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:37.755174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c07497-964f-4137-a84a-c25329cf9c7d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:37.757318 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 535/1079] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:28:37 2022] GET /identity/v3/users/3cb4479c432f4d4c8016ff2b51acebfb => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:37.763643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c07497-964f-4137-a84a-c25329cf9c7d None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:37.785660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ca0d7-87c9-45f4-96f2-024799416374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:37.786272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ca0d7-87c9-45f4-96f2-024799416374 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:37.786546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ca0d7-87c9-45f4-96f2-024799416374 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:37.786811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ca0d7-87c9-45f4-96f2-024799416374 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:37.794006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ca0d7-87c9-45f4-96f2-024799416374 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:37.795508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ca0d7-87c9-45f4-96f2-024799416374 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:37.807191 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-e18ca0d7-87c9-45f4-96f2-024799416374 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:28:37.807191 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:37.807191 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:37.807191 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:37.807191 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:37.807191 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:37.807191 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:37.807191 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:37.807191 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:37.807191 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:37.807191 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:37.807191 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:37.807191 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:28:37.807191 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:28:37.807191 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:28:37.808308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:28:37.808308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:37.808308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:37.808308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:37.808308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:37.808308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:37.808308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:37.808308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:37.808308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:37.808308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:37.808308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:37.808308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:37.808308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:37.808308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:37.808308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:37.808308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:37.808308 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:37.809327 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:28:37.809327 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:28:37.809327 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:28:37.809327 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:28:37.809327 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:28:37.809327 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:28:37.809327 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:28:37.809327 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:37.813260 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 545/1080] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:28:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:37.814207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ca0d7-87c9-45f4-96f2-024799416374 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:37.863878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c07497-964f-4137-a84a-c25329cf9c7d None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:37.873770 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:37.899194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3d5d3-b472-4bc2-abbb-35053ccce79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:37.899804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3d5d3-b472-4bc2-abbb-35053ccce79d None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:37.900075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3d5d3-b472-4bc2-abbb-35053ccce79d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:37.900342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3d5d3-b472-4bc2-abbb-35053ccce79d None admin] PATH_INFO: `/v3/projects/7e10c9c115934787b8eed9ffc6824ae7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:37.901878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3d5d3-b472-4bc2-abbb-35053ccce79d None admin] RBAC: Authorizing `identity:get_project(project_id=7e10c9c115934787b8eed9ffc6824ae7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:37.903267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3d5d3-b472-4bc2-abbb-35053ccce79d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:37.904969 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 536/1081] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:28:37 2022] GET /identity/v3/projects/7e10c9c115934787b8eed9ffc6824ae7 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:37.910677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3d5d3-b472-4bc2-abbb-35053ccce79d None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:37.912315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ca0d7-87c9-45f4-96f2-024799416374 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:37.938403 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:37.950192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cae98-f854-49bf-9594-969c1b2e65c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:37.950790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cae98-f854-49bf-9594-969c1b2e65c8 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:37.951063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cae98-f854-49bf-9594-969c1b2e65c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:37.951327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cae98-f854-49bf-9594-969c1b2e65c8 None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:37.952005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cae98-f854-49bf-9594-969c1b2e65c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:37.952338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cae98-f854-49bf-9594-969c1b2e65c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:37.953773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cae98-f854-49bf-9594-969c1b2e65c8 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:37.965666 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 546/1082] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:28:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:37.971459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cae98-f854-49bf-9594-969c1b2e65c8 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:38.014989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3d5d3-b472-4bc2-abbb-35053ccce79d None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:38.048401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e579009-5ef6-4dc4-ae0d-971f995ee73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:38.049081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e579009-5ef6-4dc4-ae0d-971f995ee73f None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:38.049355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e579009-5ef6-4dc4-ae0d-971f995ee73f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:38.049626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e579009-5ef6-4dc4-ae0d-971f995ee73f None admin] PATH_INFO: `/v3/projects/7e10c9c115934787b8eed9ffc6824ae7/users/3cb4479c432f4d4c8016ff2b51acebfb/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:38.051534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e579009-5ef6-4dc4-ae0d-971f995ee73f None admin] RBAC: Authorizing `identity:create_grant(project_id=7e10c9c115934787b8eed9ffc6824ae7, user_id=3cb4479c432f4d4c8016ff2b51acebfb, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:38.052963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e579009-5ef6-4dc4-ae0d-971f995ee73f None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:38.066315 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 537/1083] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:28:37 2022] PUT /identity/v3/projects/7e10c9c115934787b8eed9ffc6824ae7/users/3cb4479c432f4d4c8016ff2b51acebfb/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:28:38.070537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cae98-f854-49bf-9594-969c1b2e65c8 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:38.107263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae264ef2-7452-4756-a7fd-5a5ef4d864cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:38.107934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae264ef2-7452-4756-a7fd-5a5ef4d864cf None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:38.108210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae264ef2-7452-4756-a7fd-5a5ef4d864cf None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:38.108479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae264ef2-7452-4756-a7fd-5a5ef4d864cf None admin] PATH_INFO: `/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/aa607111024540d1a09b01dfd1e5e8cd/roles/a147711fae6d4aa1873fdea65ad1663b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:38.110845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae264ef2-7452-4756-a7fd-5a5ef4d864cf None admin] RBAC: Authorizing `identity:create_grant(project_id=1fbc72b5e3b84c8fb74d8d4952a26e76, user_id=aa607111024540d1a09b01dfd1e5e8cd, role_id=a147711fae6d4aa1873fdea65ad1663b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:38.112282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae264ef2-7452-4756-a7fd-5a5ef4d864cf None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:38.127787 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 547/1084] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:28:37 2022] PUT /identity/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/aa607111024540d1a09b01dfd1e5e8cd/roles/a147711fae6d4aa1873fdea65ad1663b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:28:40.220625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a050df-0d56-480f-b15f-30b186cea8b3 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:40.221174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a050df-0d56-480f-b15f-30b186cea8b3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:40.221174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a050df-0d56-480f-b15f-30b186cea8b3 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:40.222439 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 538/1085] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:40.228400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0935b-3e73-4642-9f15-b1085255b6cf None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:40.228903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0935b-3e73-4642-9f15-b1085255b6cf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:40.229014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0935b-3e73-4642-9f15-b1085255b6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:40.246503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c1d0935b-3e73-4642-9f15-b1085255b6cf None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:40.247676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c1d0935b-3e73-4642-9f15-b1085255b6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:40.288768 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:40.300472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13ea76-f101-4e1a-a633-2636956da875 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:40.300791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13ea76-f101-4e1a-a633-2636956da875 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:40.301069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13ea76-f101-4e1a-a633-2636956da875 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:40.302401 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 539/1086] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:40.307463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cae67-7ebb-4f3c-8295-c7b9d58e197b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:40.307742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cae67-7ebb-4f3c-8295-c7b9d58e197b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:40.308019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cae67-7ebb-4f3c-8295-c7b9d58e197b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:40.317022 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 548/1087] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:40.326129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ca0cae67-7ebb-4f3c-8295-c7b9d58e197b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:40.327293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ca0cae67-7ebb-4f3c-8295-c7b9d58e197b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:40.356151 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:40.394102 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 540/1088] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:28:40.589025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0935b-3e73-4642-9f15-b1085255b6cf None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:40.658590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0cae67-7ebb-4f3c-8295-c7b9d58e197b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:40.684411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0935b-3e73-4642-9f15-b1085255b6cf None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:40.718035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588b251-9aff-492d-9a57-737886ac005b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:40.718649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588b251-9aff-492d-9a57-737886ac005b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:40.719008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588b251-9aff-492d-9a57-737886ac005b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:40.719188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588b251-9aff-492d-9a57-737886ac005b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:40.729008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588b251-9aff-492d-9a57-737886ac005b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:28:40.733690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-4588b251-9aff-492d-9a57-737886ac005b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:28:40.733690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:40.733690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:40.733690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:40.733690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:40.733690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:40.733690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:40.733690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:40.733690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:40.733690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:40.733690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:40.733690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:40.733690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:28:40.733690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:28:40.733690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:28:40.733690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:28:40.734790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:28:40.734790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:28:40.734790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:28:40.734790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:28:40.734790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:40.734790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:40.734790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:40.734790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:40.734790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:40.734790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:40.734790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:40.734790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:40.734790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:40.734790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:40.734790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:40.734790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:40.735796 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:40.735796 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:40.735796 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:40.735796 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:40.735796 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:28:40.735796 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:28:40.735796 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:28:40.735796 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:28:40.735796 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:28:40.735796 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:28:40.735796 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:28:40.735796 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:40.735796 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 549/1089] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:28:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:40.740591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588b251-9aff-492d-9a57-737886ac005b None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:40.758640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0cae67-7ebb-4f3c-8295-c7b9d58e197b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:40.773839 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:40.792625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ff9f7-5801-4908-a121-85a25a60b666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:40.793264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ff9f7-5801-4908-a121-85a25a60b666 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:40.793535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ff9f7-5801-4908-a121-85a25a60b666 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:40.793801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ff9f7-5801-4908-a121-85a25a60b666 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:40.804497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ff9f7-5801-4908-a121-85a25a60b666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:28:40.809300 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-949ff9f7-5801-4908-a121-85a25a60b666 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:28:40.809300 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:40.809300 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:40.809300 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:40.809300 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:40.809300 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:40.809300 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:40.809300 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:40.809300 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:40.809300 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:40.809300 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:40.809300 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:40.809300 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:28:40.809300 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:28:40.809300 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:28:40.809300 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:28:40.810364 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:28:40.810364 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:28:40.810364 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:28:40.810364 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:28:40.810364 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:40.810364 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:40.810364 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:40.810364 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:40.810364 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:40.810364 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:40.810364 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:40.810364 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:40.810364 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:40.810364 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:40.810364 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:40.810364 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:40.811212 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:40.811212 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:40.811212 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:40.811212 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:40.811212 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:28:40.811212 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:28:40.811212 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:28:40.811212 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:28:40.811212 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:28:40.811212 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:28:40.811212 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 09:28:40.811212 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:40.811212 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 541/1090] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Sep 30 09:28:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:40.816100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ff9f7-5801-4908-a121-85a25a60b666 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:40.841774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588b251-9aff-492d-9a57-737886ac005b None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:40.842976 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:40.875524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45ab02-187a-4bae-b5c6-85e3a0a34b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:40.876115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45ab02-187a-4bae-b5c6-85e3a0a34b67 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:40.876387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45ab02-187a-4bae-b5c6-85e3a0a34b67 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:40.876683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45ab02-187a-4bae-b5c6-85e3a0a34b67 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:40.877336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45ab02-187a-4bae-b5c6-85e3a0a34b67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:40.877632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45ab02-187a-4bae-b5c6-85e3a0a34b67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:40.878973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45ab02-187a-4bae-b5c6-85e3a0a34b67 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:40.887088 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 550/1091] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:28:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:40.892986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45ab02-187a-4bae-b5c6-85e3a0a34b67 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:40.921056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ff9f7-5801-4908-a121-85a25a60b666 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:40.955706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b1c0d-e141-4681-9471-688cc310a4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:40.956303 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b1c0d-e141-4681-9471-688cc310a4e7 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:40.956578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b1c0d-e141-4681-9471-688cc310a4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:40.957125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b1c0d-e141-4681-9471-688cc310a4e7 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:40.957777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b1c0d-e141-4681-9471-688cc310a4e7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:40.958080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b1c0d-e141-4681-9471-688cc310a4e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:40.959426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b1c0d-e141-4681-9471-688cc310a4e7 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:40.967752 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 542/1092] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Sep 30 09:28:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:40.973550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b1c0d-e141-4681-9471-688cc310a4e7 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:40.987252 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:40.993799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45ab02-187a-4bae-b5c6-85e3a0a34b67 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:41.026438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59fb2d-9370-416e-9475-034c0f1587bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:41.027053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59fb2d-9370-416e-9475-034c0f1587bd None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:41.027386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59fb2d-9370-416e-9475-034c0f1587bd None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:41.027658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59fb2d-9370-416e-9475-034c0f1587bd None admin] PATH_INFO: `/v3/users/3cb4479c432f4d4c8016ff2b51acebfb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:41.028813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59fb2d-9370-416e-9475-034c0f1587bd None admin] RBAC: Authorizing `identity:get_user(user_id=3cb4479c432f4d4c8016ff2b51acebfb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:41.030224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59fb2d-9370-416e-9475-034c0f1587bd None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:41.031790 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 551/1093] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:28:40 2022] GET /identity/v3/users/3cb4479c432f4d4c8016ff2b51acebfb => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:41.037346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59fb2d-9370-416e-9475-034c0f1587bd None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:41.060311 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:41.072951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b1c0d-e141-4681-9471-688cc310a4e7 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:41.106135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527c657-a58f-4308-98b1-e94345b8bb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:41.106681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527c657-a58f-4308-98b1-e94345b8bb9c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:41.106956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527c657-a58f-4308-98b1-e94345b8bb9c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:41.107224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527c657-a58f-4308-98b1-e94345b8bb9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:41.118076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527c657-a58f-4308-98b1-e94345b8bb9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:41.119539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527c657-a58f-4308-98b1-e94345b8bb9c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:41.133418 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-6527c657-a58f-4308-98b1-e94345b8bb9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:41.133418 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:41.133418 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:41.133418 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:41.133418 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:41.133418 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:41.133418 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:41.133418 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:41.133418 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:41.133418 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:41.133418 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:41.133418 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:41.133418 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:28:41.133418 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:28:41.133418 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:28:41.133418 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:28:41.134569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:41.134569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:41.134569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:41.134569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:41.134569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:41.134569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:41.134569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:41.134569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:41.134569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:41.134569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:41.134569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:41.134569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:41.134569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:41.134569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:41.134569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:41.134569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:41.134569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:28:41.135479 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:28:41.135479 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:41.135479 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:41.135668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59fb2d-9370-416e-9475-034c0f1587bd None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:41.135751 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 543/1094] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:41.140129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527c657-a58f-4308-98b1-e94345b8bb9c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:41.167997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd25403-c441-4786-860c-b5f17b9ef0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:41.168631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd25403-c441-4786-860c-b5f17b9ef0f7 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:41.168899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd25403-c441-4786-860c-b5f17b9ef0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:41.169171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd25403-c441-4786-860c-b5f17b9ef0f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:41.202185 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:41.239809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd25403-c441-4786-860c-b5f17b9ef0f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:41.241347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd25403-c441-4786-860c-b5f17b9ef0f7 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:41.243161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527c657-a58f-4308-98b1-e94345b8bb9c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:41.278682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b132ca1-4421-46b7-86e5-c4e16a080582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:41.279273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b132ca1-4421-46b7-86e5-c4e16a080582 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:41.279547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b132ca1-4421-46b7-86e5-c4e16a080582 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:41.279816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b132ca1-4421-46b7-86e5-c4e16a080582 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:41.280440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b132ca1-4421-46b7-86e5-c4e16a080582 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:41.280766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b132ca1-4421-46b7-86e5-c4e16a080582 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:41.282110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b132ca1-4421-46b7-86e5-c4e16a080582 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:41.291590 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:41.299646 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 544/1095] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:41.300396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b132ca1-4421-46b7-86e5-c4e16a080582 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:41.341192 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 552/1096] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:28:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 30 09:28:41.347049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd25403-c441-4786-860c-b5f17b9ef0f7 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:41.398403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b132ca1-4421-46b7-86e5-c4e16a080582 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:41.406284 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:41.433578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fb43d-cd1e-46ee-aff0-9fa070bd16d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:41.434194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fb43d-cd1e-46ee-aff0-9fa070bd16d2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:41.434473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fb43d-cd1e-46ee-aff0-9fa070bd16d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:41.434737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fb43d-cd1e-46ee-aff0-9fa070bd16d2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:41.441570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fb43d-cd1e-46ee-aff0-9fa070bd16d2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:41.442965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fb43d-cd1e-46ee-aff0-9fa070bd16d2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:41.443999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd25403-c441-4786-860c-b5f17b9ef0f7 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:41.454671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-ba1fb43d-cd1e-46ee-aff0-9fa070bd16d2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:28:41.454671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:41.454671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:41.454671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:41.454671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:41.454671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:41.454671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:41.454671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:41.454671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:41.454671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:41.454671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:41.454671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:41.454671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:28:41.454671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:28:41.454671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:28:41.454671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:28:41.455692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:41.455692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:41.455692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:28:41.455692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:41.455692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:28:41.455692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:28:41.455692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:41.455692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:41.455692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:41.455692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:41.455692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:41.455692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:41.455692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:41.455692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:41.455692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:41.455692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:41.455692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:41.455692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:41.457046 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:41.457046 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:41.457046 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:28:41.457046 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:28:41.457046 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:28:41.457046 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:28:41.457046 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:28:41.457046 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:28:41.457046 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 09:28:41.457046 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:28:41.457046 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 545/1097] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Sep 30 09:28:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:28:41.462515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fb43d-cd1e-46ee-aff0-9fa070bd16d2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:41.483723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce7bca-e541-4441-8035-469f17a3a73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:41.484344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce7bca-e541-4441-8035-469f17a3a73d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:41.484635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce7bca-e541-4441-8035-469f17a3a73d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:41.484905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce7bca-e541-4441-8035-469f17a3a73d None admin] PATH_INFO: `/v3/projects/7e10c9c115934787b8eed9ffc6824ae7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:41.485992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce7bca-e541-4441-8035-469f17a3a73d None admin] RBAC: Authorizing `identity:get_project(project_id=7e10c9c115934787b8eed9ffc6824ae7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:41.487388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce7bca-e541-4441-8035-469f17a3a73d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:41.489019 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 553/1098] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:28:41 2022] GET /identity/v3/projects/7e10c9c115934787b8eed9ffc6824ae7 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:41.495307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce7bca-e541-4441-8035-469f17a3a73d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:41.526245 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:41.566568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fb43d-cd1e-46ee-aff0-9fa070bd16d2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:41.596170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce7bca-e541-4441-8035-469f17a3a73d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:41.600701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d9461-e07c-4395-9930-b0c6e47b00aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:41.601359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d9461-e07c-4395-9930-b0c6e47b00aa None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:41.601634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d9461-e07c-4395-9930-b0c6e47b00aa None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:41.601897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d9461-e07c-4395-9930-b0c6e47b00aa None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:41.602610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d9461-e07c-4395-9930-b0c6e47b00aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:41.602909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d9461-e07c-4395-9930-b0c6e47b00aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:41.604295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d9461-e07c-4395-9930-b0c6e47b00aa None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:41.621475 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 546/1099] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Sep 30 09:28:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:41.627047 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:41.627216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d9461-e07c-4395-9930-b0c6e47b00aa None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:41.634246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b04870-db02-40e1-8aca-be09dca95045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:41.634875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b04870-db02-40e1-8aca-be09dca95045 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:41.635148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b04870-db02-40e1-8aca-be09dca95045 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:41.635412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b04870-db02-40e1-8aca-be09dca95045 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:41.636130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b04870-db02-40e1-8aca-be09dca95045 None admin] RBAC: Adding query filter params (role.id=f06b5fed717d4b03a5083dd847274296, scope.project.id=7e10c9c115934787b8eed9ffc6824ae7, user.id=3cb4479c432f4d4c8016ff2b51acebfb) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:41.636431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b04870-db02-40e1-8aca-be09dca95045 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:41.637855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b04870-db02-40e1-8aca-be09dca95045 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:41.643679 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 554/1100] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:28:41 2022] GET /identity/v3/role_assignments?user.id=3cb4479c432f4d4c8016ff2b51acebfb&scope.project.id=7e10c9c115934787b8eed9ffc6824ae7&role.id=f06b5fed717d4b03a5083dd847274296 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:41.732260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d9461-e07c-4395-9930-b0c6e47b00aa None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:41.750615 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:41.768105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d0168-cd0b-408a-b3e7-67227fa0ab49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:41.768751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d0168-cd0b-408a-b3e7-67227fa0ab49 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:41.769027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d0168-cd0b-408a-b3e7-67227fa0ab49 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:41.769291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d0168-cd0b-408a-b3e7-67227fa0ab49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:41.848908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d0168-cd0b-408a-b3e7-67227fa0ab49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:41.850989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d0168-cd0b-408a-b3e7-67227fa0ab49 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:41.952615 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 547/1101] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:28:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 30 09:28:41.958847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b04870-db02-40e1-8aca-be09dca95045 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:42.057571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b04870-db02-40e1-8aca-be09dca95045 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:42.091084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c4253-1df5-4146-b780-547f654354b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:42.091700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c4253-1df5-4146-b780-547f654354b6 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:42.091972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c4253-1df5-4146-b780-547f654354b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:42.092235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c4253-1df5-4146-b780-547f654354b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:42.103194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c4253-1df5-4146-b780-547f654354b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:42.104628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c4253-1df5-4146-b780-547f654354b6 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:42.118125 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-cc8c4253-1df5-4146-b780-547f654354b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:42.118125 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:42.118125 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:42.118125 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:42.118125 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:42.118125 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:42.118125 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:42.118125 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:42.118125 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:42.118125 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:42.118125 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:42.118125 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:42.118125 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:28:42.118125 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:28:42.118125 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:28:42.118125 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:28:42.119255 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:42.119255 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:42.119255 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:42.119255 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:42.119255 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:42.119255 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:42.119255 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:42.119255 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:42.119255 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:42.119255 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:42.119255 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:42.119255 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:42.119255 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:42.119255 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:42.119255 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:42.119255 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:42.119255 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:28:42.120186 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:28:42.120186 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:28:42.120186 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:42.120186 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 555/1102] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:42.125025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d0168-cd0b-408a-b3e7-67227fa0ab49 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:42.142808 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:42.224292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d0168-cd0b-408a-b3e7-67227fa0ab49 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:42.258404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74c39f-b179-4bbe-ae27-444b6516dc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:42.259050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74c39f-b179-4bbe-ae27-444b6516dc1f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:42.259270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74c39f-b179-4bbe-ae27-444b6516dc1f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:42.259539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74c39f-b179-4bbe-ae27-444b6516dc1f None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:42.260170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74c39f-b179-4bbe-ae27-444b6516dc1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:42.260472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74c39f-b179-4bbe-ae27-444b6516dc1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:42.261852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74c39f-b179-4bbe-ae27-444b6516dc1f None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:42.273707 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 548/1103] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:42.279433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c4253-1df5-4146-b780-547f654354b6 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:42.329523 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:42.379997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c4253-1df5-4146-b780-547f654354b6 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:42.413907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783986f-8a27-4cd6-8919-30283379543d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:42.414516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783986f-8a27-4cd6-8919-30283379543d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:42.414792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783986f-8a27-4cd6-8919-30283379543d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:42.415059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783986f-8a27-4cd6-8919-30283379543d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:42.421556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783986f-8a27-4cd6-8919-30283379543d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:42.422960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783986f-8a27-4cd6-8919-30283379543d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:42.434528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-0783986f-8a27-4cd6-8919-30283379543d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:28:42.434528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:28:42.434528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:28:42.434528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:28:42.434528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:28:42.434528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:28:42.434528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:28:42.434528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:28:42.434528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:28:42.434528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:28:42.434528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:28:42.434528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:28:42.434528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:28:42.434528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:28:42.434528 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:28:42.435595 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:28:42.435595 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:28:42.435595 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:28:42.435595 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:28:42.435595 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:28:42.435595 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:28:42.435595 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:28:42.435595 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:28:42.435595 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:28:42.435595 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:28:42.435595 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:28:42.435595 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:28:42.435595 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:28:42.435595 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:28:42.435595 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:28:42.435595 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:28:42.435595 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:28:42.437023 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:28:42.437023 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:28:42.437023 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:28:42.437023 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:28:42.437023 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:28:42.437023 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:28:42.437023 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:28:42.437023 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:28:42.437023 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 556/1104] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:28:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:28:42.441350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74c39f-b179-4bbe-ae27-444b6516dc1f None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:42.517414 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:42.539750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74c39f-b179-4bbe-ae27-444b6516dc1f None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:42.575387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc9b2e-2e09-4e3e-a075-de114fe591ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:42.576089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc9b2e-2e09-4e3e-a075-de114fe591ae None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:42.576430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc9b2e-2e09-4e3e-a075-de114fe591ae None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:42.576799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc9b2e-2e09-4e3e-a075-de114fe591ae None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:42.577494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc9b2e-2e09-4e3e-a075-de114fe591ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:42.577796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc9b2e-2e09-4e3e-a075-de114fe591ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:42.579253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc9b2e-2e09-4e3e-a075-de114fe591ae None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:42.591583 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 549/1105] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:28:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:42.597962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783986f-8a27-4cd6-8919-30283379543d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:42.697153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783986f-8a27-4cd6-8919-30283379543d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:42.705533 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:42.731174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615900f-293b-4748-a413-0fbd28bab4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:42.731761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615900f-293b-4748-a413-0fbd28bab4fa None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:42.732037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615900f-293b-4748-a413-0fbd28bab4fa None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:42.732301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615900f-293b-4748-a413-0fbd28bab4fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:42.733046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615900f-293b-4748-a413-0fbd28bab4fa None admin] RBAC: Adding query filter params (role.id=a147711fae6d4aa1873fdea65ad1663b, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=aa607111024540d1a09b01dfd1e5e8cd) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:42.733349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615900f-293b-4748-a413-0fbd28bab4fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:42.734741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615900f-293b-4748-a413-0fbd28bab4fa None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:42.740298 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 557/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:28:42 2022] GET /identity/v3/role_assignments?user.id=aa607111024540d1a09b01dfd1e5e8cd&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=a147711fae6d4aa1873fdea65ad1663b => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:43.839930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53815771-54ae-484c-9fa3-099a215b36fe None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:43.840464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53815771-54ae-484c-9fa3-099a215b36fe None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:43.840464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53815771-54ae-484c-9fa3-099a215b36fe None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:43.841849 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 550/1107] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:43.847035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcc194-106e-4799-a0da-58b54aac8b99 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:43.847448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcc194-106e-4799-a0da-58b54aac8b99 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:43.847584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcc194-106e-4799-a0da-58b54aac8b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:43.865386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-77bcc194-106e-4799-a0da-58b54aac8b99 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:43.866729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-77bcc194-106e-4799-a0da-58b54aac8b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:43.931245 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 558/1108] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:44.199360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53815771-54ae-484c-9fa3-099a215b36fe None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:44.297602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53815771-54ae-484c-9fa3-099a215b36fe None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:44.330945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05843b-365c-456c-9978-d8096246e540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:44.331555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05843b-365c-456c-9978-d8096246e540 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:44.332084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05843b-365c-456c-9978-d8096246e540 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:44.332348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05843b-365c-456c-9978-d8096246e540 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:44.333459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05843b-365c-456c-9978-d8096246e540 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:44.335393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05843b-365c-456c-9978-d8096246e540 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:44.336951 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 551/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:44.342650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcc194-106e-4799-a0da-58b54aac8b99 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:44.436160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcc194-106e-4799-a0da-58b54aac8b99 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:44.437692 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:44.472208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a36ef5-c88a-4a19-96fb-822e6ef42528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:44.472765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a36ef5-c88a-4a19-96fb-822e6ef42528 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:44.473044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a36ef5-c88a-4a19-96fb-822e6ef42528 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:44.473320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a36ef5-c88a-4a19-96fb-822e6ef42528 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:44.473962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a36ef5-c88a-4a19-96fb-822e6ef42528 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:44.477234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a36ef5-c88a-4a19-96fb-822e6ef42528 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:44.498947 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 559/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Sep 30 09:28:44 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:28:46.682435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b564db-7ce5-4745-85f4-eca7eac99e69 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:46.683003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b564db-7ce5-4745-85f4-eca7eac99e69 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:46.683003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b564db-7ce5-4745-85f4-eca7eac99e69 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:46.684294 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 552/1111] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:46.689429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a1f84-b43e-48cc-97da-7e1c6c65c39e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:46.689825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a1f84-b43e-48cc-97da-7e1c6c65c39e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:46.689975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a1f84-b43e-48cc-97da-7e1c6c65c39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:46.708569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-186a1f84-b43e-48cc-97da-7e1c6c65c39e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:46.710051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-186a1f84-b43e-48cc-97da-7e1c6c65c39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:46.774041 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 560/1112] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:47.046837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b564db-7ce5-4745-85f4-eca7eac99e69 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:47.055763 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:47.145445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b564db-7ce5-4745-85f4-eca7eac99e69 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:47.177812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b09dc4-1360-4dec-ab15-b812a429a3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:47.178968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b09dc4-1360-4dec-ab15-b812a429a3c3 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:47.179240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b09dc4-1360-4dec-ab15-b812a429a3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:47.179507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b09dc4-1360-4dec-ab15-b812a429a3c3 None admin] PATH_INFO: `/v3/roles/27410223fa7d4717a71ac6753c80420b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:47.180888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b09dc4-1360-4dec-ab15-b812a429a3c3 None admin] RBAC: Authorizing `identity:get_role(role_id=27410223fa7d4717a71ac6753c80420b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:47.182224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b09dc4-1360-4dec-ab15-b812a429a3c3 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:47.183517 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 553/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:28:47 2022] GET /identity/v3/roles/27410223fa7d4717a71ac6753c80420b => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:47.189246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a1f84-b43e-48cc-97da-7e1c6c65c39e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:47.272720 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:47.285282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a1f84-b43e-48cc-97da-7e1c6c65c39e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:47.317752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c813b-c392-44f3-9c0d-8eda58c1d21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:47.318298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c813b-c392-44f3-9c0d-8eda58c1d21d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:47.318574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c813b-c392-44f3-9c0d-8eda58c1d21d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:47.318974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c813b-c392-44f3-9c0d-8eda58c1d21d None admin] PATH_INFO: `/v3/users/d7bc29f4a7874a34a96f71b8c1490782` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:47.331324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c813b-c392-44f3-9c0d-8eda58c1d21d None admin] RBAC: Authorizing `identity:get_user(user_id=d7bc29f4a7874a34a96f71b8c1490782)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:47.333018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c813b-c392-44f3-9c0d-8eda58c1d21d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:47.335102 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 561/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:28:47 2022] GET /identity/v3/users/d7bc29f4a7874a34a96f71b8c1490782 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:47.340805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b09dc4-1360-4dec-ab15-b812a429a3c3 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:47.413248 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:47.437030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b09dc4-1360-4dec-ab15-b812a429a3c3 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:47.470041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53aadf0-c935-44af-9f73-a745cd88dfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:47.470624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53aadf0-c935-44af-9f73-a745cd88dfff None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:47.470899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53aadf0-c935-44af-9f73-a745cd88dfff None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:47.471166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53aadf0-c935-44af-9f73-a745cd88dfff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:47.535540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53aadf0-c935-44af-9f73-a745cd88dfff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:47.536968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53aadf0-c935-44af-9f73-a745cd88dfff None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:47.611139 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:47.636407 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 554/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:28:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:28:47.642330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c813b-c392-44f3-9c0d-8eda58c1d21d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:47.737902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c813b-c392-44f3-9c0d-8eda58c1d21d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:47.770161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3ee51-08e8-4085-ad9f-ada6e269a747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:47.770764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3ee51-08e8-4085-ad9f-ada6e269a747 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:47.771037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3ee51-08e8-4085-ad9f-ada6e269a747 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:47.771301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3ee51-08e8-4085-ad9f-ada6e269a747 None admin] PATH_INFO: `/v3/projects/7e10c9c115934787b8eed9ffc6824ae7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:47.772973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a3ee51-08e8-4085-ad9f-ada6e269a747 None admin] RBAC: Authorizing `identity:get_project(project_id=7e10c9c115934787b8eed9ffc6824ae7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:47.774365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a3ee51-08e8-4085-ad9f-ada6e269a747 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:47.775939 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 562/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:28:47 2022] GET /identity/v3/projects/7e10c9c115934787b8eed9ffc6824ae7 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:47.782181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53aadf0-c935-44af-9f73-a745cd88dfff None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:47.880489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53aadf0-c935-44af-9f73-a745cd88dfff None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:47.913973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1063fe6-ad78-4498-9358-661f9246c3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:47.914574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1063fe6-ad78-4498-9358-661f9246c3de None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:47.914879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1063fe6-ad78-4498-9358-661f9246c3de None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:47.915119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1063fe6-ad78-4498-9358-661f9246c3de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:47.915842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1063fe6-ad78-4498-9358-661f9246c3de None admin] RBAC: Adding query filter params (role.id=27410223fa7d4717a71ac6753c80420b, scope.project.id=7e10c9c115934787b8eed9ffc6824ae7, user.id=d7bc29f4a7874a34a96f71b8c1490782) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:47.916145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1063fe6-ad78-4498-9358-661f9246c3de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:47.917576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1063fe6-ad78-4498-9358-661f9246c3de None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:47.923050 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 555/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:28:47 2022] GET /identity/v3/role_assignments?user.id=d7bc29f4a7874a34a96f71b8c1490782&scope.project.id=7e10c9c115934787b8eed9ffc6824ae7&role.id=27410223fa7d4717a71ac6753c80420b => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:50.028201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5c71d-08b1-4f68-a580-bb164ef7ab6f None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:50.028757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5c71d-08b1-4f68-a580-bb164ef7ab6f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:50.028757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5c71d-08b1-4f68-a580-bb164ef7ab6f None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:50.030098 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 563/1118] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:50.035308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704bc32-6d71-48d0-a6bf-b969feddd16f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:50.035718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704bc32-6d71-48d0-a6bf-b969feddd16f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:50.035851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704bc32-6d71-48d0-a6bf-b969feddd16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:50.053763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5704bc32-6d71-48d0-a6bf-b969feddd16f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:50.054918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5704bc32-6d71-48d0-a6bf-b969feddd16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:50.083468 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:50.119643 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 556/1119] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:50.388427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5c71d-08b1-4f68-a580-bb164ef7ab6f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:50.404119 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:50.494018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5c71d-08b1-4f68-a580-bb164ef7ab6f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:50.527311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187d4c3-82d6-408c-88dd-1d5167908727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:50.527921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187d4c3-82d6-408c-88dd-1d5167908727 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:50.528199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187d4c3-82d6-408c-88dd-1d5167908727 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:50.528466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187d4c3-82d6-408c-88dd-1d5167908727 None admin] PATH_INFO: `/v3/roles/27410223fa7d4717a71ac6753c80420b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:50.529853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187d4c3-82d6-408c-88dd-1d5167908727 None admin] RBAC: Authorizing `identity:get_role(role_id=27410223fa7d4717a71ac6753c80420b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:50.531192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187d4c3-82d6-408c-88dd-1d5167908727 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:50.532495 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 564/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:28:50 2022] GET /identity/v3/roles/27410223fa7d4717a71ac6753c80420b => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:50.538584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704bc32-6d71-48d0-a6bf-b969feddd16f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:50.637880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704bc32-6d71-48d0-a6bf-b969feddd16f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:50.670949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999398a-177a-48da-822a-370f25b12eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:50.671507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999398a-177a-48da-822a-370f25b12eb2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:50.671784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999398a-177a-48da-822a-370f25b12eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:50.672054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999398a-177a-48da-822a-370f25b12eb2 None admin] PATH_INFO: `/v3/users/d7bc29f4a7874a34a96f71b8c1490782` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:50.673177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999398a-177a-48da-822a-370f25b12eb2 None admin] RBAC: Authorizing `identity:get_user(user_id=d7bc29f4a7874a34a96f71b8c1490782)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:50.674583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999398a-177a-48da-822a-370f25b12eb2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:50.676137 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 557/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:28:50 2022] GET /identity/v3/users/d7bc29f4a7874a34a96f71b8c1490782 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:50.682082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187d4c3-82d6-408c-88dd-1d5167908727 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:50.761466 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:50.781318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187d4c3-82d6-408c-88dd-1d5167908727 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:50.824471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466137ab-05ce-4738-9493-56a86c32317e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:50.825132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466137ab-05ce-4738-9493-56a86c32317e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:50.825405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466137ab-05ce-4738-9493-56a86c32317e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:50.825675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466137ab-05ce-4738-9493-56a86c32317e None admin] PATH_INFO: `/v3/projects/7e10c9c115934787b8eed9ffc6824ae7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:50.826795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466137ab-05ce-4738-9493-56a86c32317e None admin] RBAC: Authorizing `identity:get_project(project_id=7e10c9c115934787b8eed9ffc6824ae7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:50.828203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466137ab-05ce-4738-9493-56a86c32317e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:50.829868 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 565/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:28:50 2022] GET /identity/v3/projects/7e10c9c115934787b8eed9ffc6824ae7 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:50.836857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999398a-177a-48da-822a-370f25b12eb2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:50.885119 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:50.948669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999398a-177a-48da-822a-370f25b12eb2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:50.980908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4233d4b-e0c9-4162-928c-b9c3ab4a696a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:50.981543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4233d4b-e0c9-4162-928c-b9c3ab4a696a None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:50.981820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4233d4b-e0c9-4162-928c-b9c3ab4a696a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:50.982092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4233d4b-e0c9-4162-928c-b9c3ab4a696a None admin] PATH_INFO: `/v3/projects/7e10c9c115934787b8eed9ffc6824ae7/users/d7bc29f4a7874a34a96f71b8c1490782/roles/27410223fa7d4717a71ac6753c80420b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:50.984176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4233d4b-e0c9-4162-928c-b9c3ab4a696a None admin] RBAC: Authorizing `identity:create_grant(project_id=7e10c9c115934787b8eed9ffc6824ae7, user_id=d7bc29f4a7874a34a96f71b8c1490782, role_id=27410223fa7d4717a71ac6753c80420b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:50.985612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4233d4b-e0c9-4162-928c-b9c3ab4a696a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:50.998492 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 558/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:28:50 2022] PUT /identity/v3/projects/7e10c9c115934787b8eed9ffc6824ae7/users/d7bc29f4a7874a34a96f71b8c1490782/roles/27410223fa7d4717a71ac6753c80420b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:28:53.204189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379abbe-631b-4c07-9334-d70fd12f0b80 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:53.204790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379abbe-631b-4c07-9334-d70fd12f0b80 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:53.204790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379abbe-631b-4c07-9334-d70fd12f0b80 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:53.206163 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 566/1124] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:53.212264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a967d-ce88-4e68-b429-1a0949d0bb39 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:53.212688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a967d-ce88-4e68-b429-1a0949d0bb39 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:53.212856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a967d-ce88-4e68-b429-1a0949d0bb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:53.231237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d85a967d-ce88-4e68-b429-1a0949d0bb39 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:53.232419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d85a967d-ce88-4e68-b429-1a0949d0bb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:53.298111 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 559/1125] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:53.562499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379abbe-631b-4c07-9334-d70fd12f0b80 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:53.662720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379abbe-631b-4c07-9334-d70fd12f0b80 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:53.695062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a605d0-7a5b-4596-8f22-d3a5b846dca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:53.695669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a605d0-7a5b-4596-8f22-d3a5b846dca7 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:53.695943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a605d0-7a5b-4596-8f22-d3a5b846dca7 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:53.696211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a605d0-7a5b-4596-8f22-d3a5b846dca7 None admin] PATH_INFO: `/v3/roles/27410223fa7d4717a71ac6753c80420b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:53.697533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a605d0-7a5b-4596-8f22-d3a5b846dca7 None admin] RBAC: Authorizing `identity:get_role(role_id=27410223fa7d4717a71ac6753c80420b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:53.698870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a605d0-7a5b-4596-8f22-d3a5b846dca7 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:53.700161 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 567/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:28:53 2022] GET /identity/v3/roles/27410223fa7d4717a71ac6753c80420b => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:53.706066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a967d-ce88-4e68-b429-1a0949d0bb39 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:53.732521 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:53.802456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a967d-ce88-4e68-b429-1a0949d0bb39 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:53.835775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fbe77-0753-4ef1-90bd-751231e70b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:53.836322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fbe77-0753-4ef1-90bd-751231e70b53 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:53.836619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fbe77-0753-4ef1-90bd-751231e70b53 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:53.836889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fbe77-0753-4ef1-90bd-751231e70b53 None admin] PATH_INFO: `/v3/users/d7bc29f4a7874a34a96f71b8c1490782` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:53.837983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fbe77-0753-4ef1-90bd-751231e70b53 None admin] RBAC: Authorizing `identity:get_user(user_id=d7bc29f4a7874a34a96f71b8c1490782)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:53.839393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fbe77-0753-4ef1-90bd-751231e70b53 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:53.840967 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 560/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:28:53 2022] GET /identity/v3/users/d7bc29f4a7874a34a96f71b8c1490782 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:53.846795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a605d0-7a5b-4596-8f22-d3a5b846dca7 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:53.865515 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:53.945419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a605d0-7a5b-4596-8f22-d3a5b846dca7 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:53.977678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924f653-c97c-4d8c-ba9e-7fb391e07114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:53.978266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924f653-c97c-4d8c-ba9e-7fb391e07114 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:53.978543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924f653-c97c-4d8c-ba9e-7fb391e07114 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:53.978811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924f653-c97c-4d8c-ba9e-7fb391e07114 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:54.042501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924f653-c97c-4d8c-ba9e-7fb391e07114 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:54.043918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924f653-c97c-4d8c-ba9e-7fb391e07114 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:54.061617 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:54.139552 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 568/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:28:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:28:54.145516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fbe77-0753-4ef1-90bd-751231e70b53 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:54.236270 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:54.244027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fbe77-0753-4ef1-90bd-751231e70b53 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:54.276877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15f60a-3fcf-4ba6-8d86-810785232bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:54.277479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15f60a-3fcf-4ba6-8d86-810785232bec None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:54.277755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15f60a-3fcf-4ba6-8d86-810785232bec None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:54.278025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15f60a-3fcf-4ba6-8d86-810785232bec None admin] PATH_INFO: `/v3/projects/7e10c9c115934787b8eed9ffc6824ae7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:54.279112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15f60a-3fcf-4ba6-8d86-810785232bec None admin] RBAC: Authorizing `identity:get_project(project_id=7e10c9c115934787b8eed9ffc6824ae7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:54.280516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15f60a-3fcf-4ba6-8d86-810785232bec None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:54.282122 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 561/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:28:54 2022] GET /identity/v3/projects/7e10c9c115934787b8eed9ffc6824ae7 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:54.288743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924f653-c97c-4d8c-ba9e-7fb391e07114 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:54.382985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924f653-c97c-4d8c-ba9e-7fb391e07114 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:54.399619 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:54.416868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a987c3-743d-4b77-9595-17dd72c3f08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:54.417454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a987c3-743d-4b77-9595-17dd72c3f08f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:54.417729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a987c3-743d-4b77-9595-17dd72c3f08f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:54.417997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a987c3-743d-4b77-9595-17dd72c3f08f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:54.418710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a987c3-743d-4b77-9595-17dd72c3f08f None admin] RBAC: Adding query filter params (role.id=27410223fa7d4717a71ac6753c80420b, scope.project.id=7e10c9c115934787b8eed9ffc6824ae7, user.id=d7bc29f4a7874a34a96f71b8c1490782) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:28:54.419017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a987c3-743d-4b77-9595-17dd72c3f08f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:54.420409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a987c3-743d-4b77-9595-17dd72c3f08f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:54.425970 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 569/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:28:54 2022] GET /identity/v3/role_assignments?user.id=d7bc29f4a7874a34a96f71b8c1490782&scope.project.id=7e10c9c115934787b8eed9ffc6824ae7&role.id=27410223fa7d4717a71ac6753c80420b => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:28:56.565941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570a42c-e137-4016-83b2-cd21cec26a39 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:56.566468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570a42c-e137-4016-83b2-cd21cec26a39 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:56.566468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570a42c-e137-4016-83b2-cd21cec26a39 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:56.567815 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 562/1131] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:56.573203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d144db-d9c6-43eb-9453-ba6854be50e2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:56.573567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d144db-d9c6-43eb-9453-ba6854be50e2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:56.573760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d144db-d9c6-43eb-9453-ba6854be50e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:56.591696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-23d144db-d9c6-43eb-9453-ba6854be50e2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:56.592899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-23d144db-d9c6-43eb-9453-ba6854be50e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:56.656331 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 570/1132] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:56.930143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570a42c-e137-4016-83b2-cd21cec26a39 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:57.026607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570a42c-e137-4016-83b2-cd21cec26a39 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:57.058678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68446d-0cc1-4bed-94d5-0aa3051ceb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:57.059274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68446d-0cc1-4bed-94d5-0aa3051ceb5c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:57.059547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68446d-0cc1-4bed-94d5-0aa3051ceb5c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:57.059814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68446d-0cc1-4bed-94d5-0aa3051ceb5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:57.060912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68446d-0cc1-4bed-94d5-0aa3051ceb5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:57.062310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68446d-0cc1-4bed-94d5-0aa3051ceb5c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:57.063821 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 563/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:57.069820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d144db-d9c6-43eb-9453-ba6854be50e2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:57.163839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d144db-d9c6-43eb-9453-ba6854be50e2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:57.176183 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:57.197243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b0131-3529-4fcc-a451-417a7aef32c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:57.197838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b0131-3529-4fcc-a451-417a7aef32c9 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:57.198116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b0131-3529-4fcc-a451-417a7aef32c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:57.198388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b0131-3529-4fcc-a451-417a7aef32c9 None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:57.199031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b0131-3529-4fcc-a451-417a7aef32c9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:57.200709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b0131-3529-4fcc-a451-417a7aef32c9 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:57.230088 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 571/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Sep 30 09:28:57 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:28:59.397973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb40d5f-b156-42d1-aac4-9ac38a1a240f None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:59.398527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb40d5f-b156-42d1-aac4-9ac38a1a240f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:59.398527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb40d5f-b156-42d1-aac4-9ac38a1a240f None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:59.399829 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 564/1135] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:28:59.405116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123c529-eb8e-4ad9-a85b-1d57bc5cf37a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:59.405549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123c529-eb8e-4ad9-a85b-1d57bc5cf37a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:59.405668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123c529-eb8e-4ad9-a85b-1d57bc5cf37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:59.423234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9123c529-eb8e-4ad9-a85b-1d57bc5cf37a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:28:59.424401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9123c529-eb8e-4ad9-a85b-1d57bc5cf37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:28:59.488300 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 572/1136] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:28:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:28:59.766641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb40d5f-b156-42d1-aac4-9ac38a1a240f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:28:59.796245 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:28:59.867427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb40d5f-b156-42d1-aac4-9ac38a1a240f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:28:59.921122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea309d-11b5-43a5-bb86-55618810baf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:28:59.921762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea309d-11b5-43a5-bb86-55618810baf8 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:28:59.922033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea309d-11b5-43a5-bb86-55618810baf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:28:59.922295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea309d-11b5-43a5-bb86-55618810baf8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:28:59.923400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea309d-11b5-43a5-bb86-55618810baf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:28:59.924838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea309d-11b5-43a5-bb86-55618810baf8 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:28:59.926388 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 565/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:28:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:28:59.932358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123c529-eb8e-4ad9-a85b-1d57bc5cf37a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:00.020653 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:00.028504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123c529-eb8e-4ad9-a85b-1d57bc5cf37a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:00.061276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cdae1-40a4-461a-9bb3-d7bbe00d0309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:00.061860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cdae1-40a4-461a-9bb3-d7bbe00d0309 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:00.062134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cdae1-40a4-461a-9bb3-d7bbe00d0309 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:00.062399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cdae1-40a4-461a-9bb3-d7bbe00d0309 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:00.063038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cdae1-40a4-461a-9bb3-d7bbe00d0309 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:00.064431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cdae1-40a4-461a-9bb3-d7bbe00d0309 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:00.086009 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 573/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Sep 30 09:28:59 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:29:02.280168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3e0a9-ee1b-4911-b1f3-d52ea1ac6934 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:02.280713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3e0a9-ee1b-4911-b1f3-d52ea1ac6934 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:02.280713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3e0a9-ee1b-4911-b1f3-d52ea1ac6934 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:02.282061 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 566/1139] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:02.288038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e68b20-f0a5-48a9-b139-a90d986ca5b3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:02.288448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e68b20-f0a5-48a9-b139-a90d986ca5b3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:02.288625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e68b20-f0a5-48a9-b139-a90d986ca5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:02.307959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e6e68b20-f0a5-48a9-b139-a90d986ca5b3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:02.309174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e6e68b20-f0a5-48a9-b139-a90d986ca5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:02.374851 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 574/1140] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:29:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:29:02.643539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3e0a9-ee1b-4911-b1f3-d52ea1ac6934 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:02.735547 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:02.740446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3e0a9-ee1b-4911-b1f3-d52ea1ac6934 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:02.773367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0785d1-ecaa-428a-bb11-993e2207075f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:02.773972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0785d1-ecaa-428a-bb11-993e2207075f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:02.774245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0785d1-ecaa-428a-bb11-993e2207075f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:02.774516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0785d1-ecaa-428a-bb11-993e2207075f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:02.784400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0785d1-ecaa-428a-bb11-993e2207075f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:29:02.789130 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-ff0785d1-ecaa-428a-bb11-993e2207075f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:29:02.789130 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:02.789130 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:02.789130 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:02.789130 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:02.789130 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:02.789130 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:02.789130 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:02.789130 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:02.789130 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:02.789130 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:02.789130 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:02.789130 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:29:02.789130 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:29:02.789130 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:29:02.789130 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:29:02.790222 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:29:02.790222 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:29:02.790222 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:29:02.790222 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:29:02.790222 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:02.790222 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:02.790222 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:02.790222 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:02.790222 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:02.790222 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:02.790222 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:02.790222 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:02.790222 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:02.790222 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:02.790222 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:02.790222 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:02.791265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:02.791265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:02.791265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:02.791265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:02.791265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:29:02.791265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:29:02.791265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:29:02.791265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:29:02.791265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:29:02.791265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:29:02.791265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:29:02.791265 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:29:02.791265 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 567/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:29:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:02.796309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e68b20-f0a5-48a9-b139-a90d986ca5b3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:02.874942 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:02.895010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e68b20-f0a5-48a9-b139-a90d986ca5b3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:02.928392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9909c5-1899-45f9-b9b4-082cbaab6a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:02.929164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9909c5-1899-45f9-b9b4-082cbaab6a0c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:02.929441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9909c5-1899-45f9-b9b4-082cbaab6a0c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:02.929707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9909c5-1899-45f9-b9b4-082cbaab6a0c None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:02.930356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9909c5-1899-45f9-b9b4-082cbaab6a0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:02.930660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9909c5-1899-45f9-b9b4-082cbaab6a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:02.932004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9909c5-1899-45f9-b9b4-082cbaab6a0c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:02.939717 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 575/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:29:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:02.946386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0785d1-ecaa-428a-bb11-993e2207075f None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:03.040939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0785d1-ecaa-428a-bb11-993e2207075f None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:03.073596 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1fef7-9bce-4e8a-9106-a970124b9903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:03.074192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1fef7-9bce-4e8a-9106-a970124b9903 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:03.074466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1fef7-9bce-4e8a-9106-a970124b9903 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:03.074741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1fef7-9bce-4e8a-9106-a970124b9903 None admin] PATH_INFO: `/v3/users/1e244ddfe278419c8a0e73da15e246cc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:03.087341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1fef7-9bce-4e8a-9106-a970124b9903 None admin] RBAC: Authorizing `identity:get_user(user_id=1e244ddfe278419c8a0e73da15e246cc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:03.088789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1fef7-9bce-4e8a-9106-a970124b9903 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:03.090303 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 568/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:29:02 2022] GET /identity/v3/users/1e244ddfe278419c8a0e73da15e246cc => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:03.095930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9909c5-1899-45f9-b9b4-082cbaab6a0c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:03.191267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9909c5-1899-45f9-b9b4-082cbaab6a0c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:03.222961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78693e-b3b2-47e3-9a83-5250994e29b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:03.223541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78693e-b3b2-47e3-9a83-5250994e29b4 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:03.223812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78693e-b3b2-47e3-9a83-5250994e29b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:03.224073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78693e-b3b2-47e3-9a83-5250994e29b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:03.235834 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:03.289346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78693e-b3b2-47e3-9a83-5250994e29b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:03.290834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78693e-b3b2-47e3-9a83-5250994e29b4 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:03.383442 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 576/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:29:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:29:03.389473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1fef7-9bce-4e8a-9106-a970124b9903 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:03.407439 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:03.485409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1fef7-9bce-4e8a-9106-a970124b9903 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:03.517638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ab23b-eae4-4054-bc8d-b46f686f4cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:03.518247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ab23b-eae4-4054-bc8d-b46f686f4cd7 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:03.518520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ab23b-eae4-4054-bc8d-b46f686f4cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:03.518787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ab23b-eae4-4054-bc8d-b46f686f4cd7 None admin] PATH_INFO: `/v3/projects/6ac619ec926f4695a0480ce580461f6b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:03.519872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ab23b-eae4-4054-bc8d-b46f686f4cd7 None admin] RBAC: Authorizing `identity:get_project(project_id=6ac619ec926f4695a0480ce580461f6b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:03.521375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ab23b-eae4-4054-bc8d-b46f686f4cd7 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:03.523038 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 569/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:29:03 2022] GET /identity/v3/projects/6ac619ec926f4695a0480ce580461f6b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:03.529116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78693e-b3b2-47e3-9a83-5250994e29b4 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:03.579455 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:03.634389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78693e-b3b2-47e3-9a83-5250994e29b4 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:03.667934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fb60a-104c-47f3-8f8f-fc05ee9affa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:03.668528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fb60a-104c-47f3-8f8f-fc05ee9affa5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:03.668832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fb60a-104c-47f3-8f8f-fc05ee9affa5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:03.669098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fb60a-104c-47f3-8f8f-fc05ee9affa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:03.669808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1fb60a-104c-47f3-8f8f-fc05ee9affa5 None admin] RBAC: Adding query filter params (role.id=f06b5fed717d4b03a5083dd847274296, scope.project.id=6ac619ec926f4695a0480ce580461f6b, user.id=1e244ddfe278419c8a0e73da15e246cc) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:03.670108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1fb60a-104c-47f3-8f8f-fc05ee9affa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:03.671508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1fb60a-104c-47f3-8f8f-fc05ee9affa5 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:03.676577 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 577/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:29:03 2022] GET /identity/v3/role_assignments?user.id=1e244ddfe278419c8a0e73da15e246cc&scope.project.id=6ac619ec926f4695a0480ce580461f6b&role.id=f06b5fed717d4b03a5083dd847274296 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:05.769028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978753ec-5fa3-4521-90a5-3e1bfbfad6dd None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:05.769560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978753ec-5fa3-4521-90a5-3e1bfbfad6dd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:05.769560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978753ec-5fa3-4521-90a5-3e1bfbfad6dd None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:05.770906 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 570/1147] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:05.776485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11d8a2-e77b-4248-aa5a-2b8466f9e82e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:05.776906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11d8a2-e77b-4248-aa5a-2b8466f9e82e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:05.777059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11d8a2-e77b-4248-aa5a-2b8466f9e82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:05.794449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ef11d8a2-e77b-4248-aa5a-2b8466f9e82e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:05.795612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ef11d8a2-e77b-4248-aa5a-2b8466f9e82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:05.862329 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 578/1148] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:29:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:29:06.134811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978753ec-5fa3-4521-90a5-3e1bfbfad6dd None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:06.217662 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:06.234293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978753ec-5fa3-4521-90a5-3e1bfbfad6dd None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:06.278936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf141a2-beea-4ebf-b5da-7053f8ecc1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:06.279558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf141a2-beea-4ebf-b5da-7053f8ecc1eb None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:06.279839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf141a2-beea-4ebf-b5da-7053f8ecc1eb None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:06.280261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf141a2-beea-4ebf-b5da-7053f8ecc1eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:06.292136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf141a2-beea-4ebf-b5da-7053f8ecc1eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:29:06.296885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-6cf141a2-beea-4ebf-b5da-7053f8ecc1eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:29:06.296885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:06.296885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:06.296885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:06.296885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:06.296885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:06.296885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:06.296885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:06.296885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:06.296885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:06.296885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:06.296885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:06.296885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:29:06.296885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:29:06.296885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:29:06.296885 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:29:06.297966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:29:06.297966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:29:06.297966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:29:06.297966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:29:06.297966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:06.297966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:06.297966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:06.297966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:06.297966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:06.297966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:06.297966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:06.297966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:06.297966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:06.297966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:06.297966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:06.297966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:06.298866 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:06.298866 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:06.298866 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:06.298866 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:06.298866 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:29:06.298866 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:29:06.298866 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:29:06.298866 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:29:06.298866 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:29:06.298866 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:29:06.298866 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:29:06.298866 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:29:06.298866 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 571/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:29:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:06.306761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11d8a2-e77b-4248-aa5a-2b8466f9e82e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:06.339486 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:06.401557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11d8a2-e77b-4248-aa5a-2b8466f9e82e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:06.434420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fdd354-3e86-46b2-a7d6-e5857b09bbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:06.435005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdd354-3e86-46b2-a7d6-e5857b09bbd3 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:06.435276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdd354-3e86-46b2-a7d6-e5857b09bbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:06.435539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdd354-3e86-46b2-a7d6-e5857b09bbd3 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:06.436185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fdd354-3e86-46b2-a7d6-e5857b09bbd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:06.436487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fdd354-3e86-46b2-a7d6-e5857b09bbd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:06.437850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fdd354-3e86-46b2-a7d6-e5857b09bbd3 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:06.446485 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 579/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:29:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:06.452340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf141a2-beea-4ebf-b5da-7053f8ecc1eb None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:06.550296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf141a2-beea-4ebf-b5da-7053f8ecc1eb None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:06.582767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31da91-c262-4ac0-9eba-f021729443e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:06.583387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31da91-c262-4ac0-9eba-f021729443e3 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:06.584327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31da91-c262-4ac0-9eba-f021729443e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:06.584592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31da91-c262-4ac0-9eba-f021729443e3 None admin] PATH_INFO: `/v3/users/1e244ddfe278419c8a0e73da15e246cc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:06.585925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31da91-c262-4ac0-9eba-f021729443e3 None admin] RBAC: Authorizing `identity:get_user(user_id=1e244ddfe278419c8a0e73da15e246cc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:06.587338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31da91-c262-4ac0-9eba-f021729443e3 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:06.588944 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 572/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:29:06 2022] GET /identity/v3/users/1e244ddfe278419c8a0e73da15e246cc => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:06.594948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fdd354-3e86-46b2-a7d6-e5857b09bbd3 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:06.688874 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:06.692669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fdd354-3e86-46b2-a7d6-e5857b09bbd3 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:06.725744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb303fdd-b0e5-4b53-9a7a-75bf8d24a6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:06.726362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb303fdd-b0e5-4b53-9a7a-75bf8d24a6b6 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:06.726640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb303fdd-b0e5-4b53-9a7a-75bf8d24a6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:06.726910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb303fdd-b0e5-4b53-9a7a-75bf8d24a6b6 None admin] PATH_INFO: `/v3/projects/6ac619ec926f4695a0480ce580461f6b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:06.727995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb303fdd-b0e5-4b53-9a7a-75bf8d24a6b6 None admin] RBAC: Authorizing `identity:get_project(project_id=6ac619ec926f4695a0480ce580461f6b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:06.729474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb303fdd-b0e5-4b53-9a7a-75bf8d24a6b6 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:06.731071 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 580/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:29:06 2022] GET /identity/v3/projects/6ac619ec926f4695a0480ce580461f6b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:29:06.737035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31da91-c262-4ac0-9eba-f021729443e3 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:06.753633 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:06.838195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31da91-c262-4ac0-9eba-f021729443e3 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:06.870427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685aa9d6-1e05-43ee-b1e5-53cdcf6cb9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:06.871064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aa9d6-1e05-43ee-b1e5-53cdcf6cb9ef None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:06.871340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aa9d6-1e05-43ee-b1e5-53cdcf6cb9ef None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:06.871609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aa9d6-1e05-43ee-b1e5-53cdcf6cb9ef None admin] PATH_INFO: `/v3/projects/6ac619ec926f4695a0480ce580461f6b/users/1e244ddfe278419c8a0e73da15e246cc/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:06.873482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685aa9d6-1e05-43ee-b1e5-53cdcf6cb9ef None admin] RBAC: Authorizing `identity:create_grant(project_id=6ac619ec926f4695a0480ce580461f6b, user_id=1e244ddfe278419c8a0e73da15e246cc, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:06.874879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685aa9d6-1e05-43ee-b1e5-53cdcf6cb9ef None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:06.887850 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 573/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:29:06 2022] PUT /identity/v3/projects/6ac619ec926f4695a0480ce580461f6b/users/1e244ddfe278419c8a0e73da15e246cc/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:29:09.016846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dd1e8-6986-460a-8a67-577a9eb07f81 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:09.017416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dd1e8-6986-460a-8a67-577a9eb07f81 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:09.017416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dd1e8-6986-460a-8a67-577a9eb07f81 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:09.018698 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 581/1154] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:09.023953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54143624-e46e-4a33-b14f-a798cb317a3b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:09.024383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54143624-e46e-4a33-b14f-a798cb317a3b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:09.024480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54143624-e46e-4a33-b14f-a798cb317a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:09.041995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-54143624-e46e-4a33-b14f-a798cb317a3b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:09.043154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-54143624-e46e-4a33-b14f-a798cb317a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:09.107056 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 574/1155] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:29:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:29:09.376978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dd1e8-6986-460a-8a67-577a9eb07f81 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:09.475121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dd1e8-6986-460a-8a67-577a9eb07f81 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:09.507557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293efb81-b0c5-4d54-be21-2d7b6011dc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:09.508163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293efb81-b0c5-4d54-be21-2d7b6011dc48 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:09.508439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293efb81-b0c5-4d54-be21-2d7b6011dc48 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:09.508741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293efb81-b0c5-4d54-be21-2d7b6011dc48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:09.518398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293efb81-b0c5-4d54-be21-2d7b6011dc48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:29:09.523215 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-293efb81-b0c5-4d54-be21-2d7b6011dc48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:29:09.523215 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:09.523215 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:09.523215 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:09.523215 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:09.523215 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:09.523215 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:09.523215 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:09.523215 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:09.523215 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:09.523215 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:09.523215 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:09.523215 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:29:09.523215 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:29:09.523215 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:29:09.523215 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:29:09.524379 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:29:09.524379 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:29:09.524379 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:29:09.524379 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:29:09.524379 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:09.524379 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:09.524379 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:09.524379 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:09.524379 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:09.524379 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:09.524379 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:09.524379 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:09.524379 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:09.524379 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:09.524379 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:09.524379 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:09.525333 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:09.525333 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:09.525333 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:09.525333 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:09.525333 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:29:09.525333 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:29:09.525333 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:29:09.525333 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:29:09.525333 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:29:09.525333 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:29:09.525333 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:29:09.525333 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:29:09.525333 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 582/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:29:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:09.530169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54143624-e46e-4a33-b14f-a798cb317a3b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:09.532324 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:09.628028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54143624-e46e-4a33-b14f-a798cb317a3b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:09.660905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c2179-35a8-4a22-a861-e651a2d677cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:09.661505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c2179-35a8-4a22-a861-e651a2d677cb None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:09.662556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c2179-35a8-4a22-a861-e651a2d677cb None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:09.662803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c2179-35a8-4a22-a861-e651a2d677cb None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:09.663466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c2179-35a8-4a22-a861-e651a2d677cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:09.663951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c2179-35a8-4a22-a861-e651a2d677cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:09.665743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c2179-35a8-4a22-a861-e651a2d677cb None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:09.674589 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 575/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:29:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:09.680479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293efb81-b0c5-4d54-be21-2d7b6011dc48 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:09.707481 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:09.780355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293efb81-b0c5-4d54-be21-2d7b6011dc48 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:09.812817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9234af0-fda2-4712-889d-6fb4d2a42c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:09.813424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9234af0-fda2-4712-889d-6fb4d2a42c53 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:09.813700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9234af0-fda2-4712-889d-6fb4d2a42c53 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:09.813967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9234af0-fda2-4712-889d-6fb4d2a42c53 None admin] PATH_INFO: `/v3/users/1e244ddfe278419c8a0e73da15e246cc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:09.815054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9234af0-fda2-4712-889d-6fb4d2a42c53 None admin] RBAC: Authorizing `identity:get_user(user_id=1e244ddfe278419c8a0e73da15e246cc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:09.816457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9234af0-fda2-4712-889d-6fb4d2a42c53 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:09.818214 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 583/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:29:09 2022] GET /identity/v3/users/1e244ddfe278419c8a0e73da15e246cc => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:09.824055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c2179-35a8-4a22-a861-e651a2d677cb None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:09.886089 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:09.922801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c2179-35a8-4a22-a861-e651a2d677cb None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:09.955452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5485b6-679d-4514-b486-ba3ea37861d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:09.956039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5485b6-679d-4514-b486-ba3ea37861d3 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:09.956311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5485b6-679d-4514-b486-ba3ea37861d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:09.956860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5485b6-679d-4514-b486-ba3ea37861d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:10.020330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5485b6-679d-4514-b486-ba3ea37861d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:10.022074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5485b6-679d-4514-b486-ba3ea37861d3 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:10.078973 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:10.117575 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 576/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:29:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:29:10.123444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9234af0-fda2-4712-889d-6fb4d2a42c53 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:10.213012 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:10.219686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9234af0-fda2-4712-889d-6fb4d2a42c53 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:10.252382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc86cf-1ee1-4b69-8082-e7d096dc2270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:10.253018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc86cf-1ee1-4b69-8082-e7d096dc2270 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:10.253296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc86cf-1ee1-4b69-8082-e7d096dc2270 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:10.253566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc86cf-1ee1-4b69-8082-e7d096dc2270 None admin] PATH_INFO: `/v3/projects/6ac619ec926f4695a0480ce580461f6b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:10.254659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc86cf-1ee1-4b69-8082-e7d096dc2270 None admin] RBAC: Authorizing `identity:get_project(project_id=6ac619ec926f4695a0480ce580461f6b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:10.256254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc86cf-1ee1-4b69-8082-e7d096dc2270 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:10.257885 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 584/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:29:10 2022] GET /identity/v3/projects/6ac619ec926f4695a0480ce580461f6b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:10.264063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5485b6-679d-4514-b486-ba3ea37861d3 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:10.359655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5485b6-679d-4514-b486-ba3ea37861d3 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:10.392554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8dbb8b-0b87-4e95-8b92-540d95813637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:10.393165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dbb8b-0b87-4e95-8b92-540d95813637 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:10.393442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dbb8b-0b87-4e95-8b92-540d95813637 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:10.393710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dbb8b-0b87-4e95-8b92-540d95813637 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:10.394422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8dbb8b-0b87-4e95-8b92-540d95813637 None admin] RBAC: Adding query filter params (role.id=f06b5fed717d4b03a5083dd847274296, scope.project.id=6ac619ec926f4695a0480ce580461f6b, user.id=1e244ddfe278419c8a0e73da15e246cc) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:10.394728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8dbb8b-0b87-4e95-8b92-540d95813637 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:10.396779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8dbb8b-0b87-4e95-8b92-540d95813637 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:10.402353 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 577/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:29:10 2022] GET /identity/v3/role_assignments?user.id=1e244ddfe278419c8a0e73da15e246cc&scope.project.id=6ac619ec926f4695a0480ce580461f6b&role.id=f06b5fed717d4b03a5083dd847274296 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:12.533285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f0a6c-dc3a-49c0-b9a2-57b9c68ddd61 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:12.533841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f0a6c-dc3a-49c0-b9a2-57b9c68ddd61 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:12.533841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f0a6c-dc3a-49c0-b9a2-57b9c68ddd61 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:12.535153 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 585/1162] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:12.540406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c722ea5-ae27-46cd-b4b9-65fa42993a6c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:12.540816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c722ea5-ae27-46cd-b4b9-65fa42993a6c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:12.540977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c722ea5-ae27-46cd-b4b9-65fa42993a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:12.558876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8c722ea5-ae27-46cd-b4b9-65fa42993a6c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:12.560046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8c722ea5-ae27-46cd-b4b9-65fa42993a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:12.582619 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:12.625053 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 578/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:29:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:29:12.894248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f0a6c-dc3a-49c0-b9a2-57b9c68ddd61 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:13.000158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f0a6c-dc3a-49c0-b9a2-57b9c68ddd61 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:13.032477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b4338-3b31-45ec-b4d4-c85b2170bf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:13.033088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b4338-3b31-45ec-b4d4-c85b2170bf32 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:13.033365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b4338-3b31-45ec-b4d4-c85b2170bf32 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:13.033633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b4338-3b31-45ec-b4d4-c85b2170bf32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:13.062414 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:13.098490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b4338-3b31-45ec-b4d4-c85b2170bf32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:13.100685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b4338-3b31-45ec-b4d4-c85b2170bf32 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:13.193615 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 586/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:29:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:29:13.199786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c722ea5-ae27-46cd-b4b9-65fa42993a6c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:13.295147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c722ea5-ae27-46cd-b4b9-65fa42993a6c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:13.331830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d4189-944a-41c1-90ca-dc67583eaeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:13.332469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d4189-944a-41c1-90ca-dc67583eaeac None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:13.333926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d4189-944a-41c1-90ca-dc67583eaeac None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:13.334209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d4189-944a-41c1-90ca-dc67583eaeac None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:13.341052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d4189-944a-41c1-90ca-dc67583eaeac None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:13.342467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d4189-944a-41c1-90ca-dc67583eaeac None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:13.354287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-5d3d4189-944a-41c1-90ca-dc67583eaeac None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 30 09:29:13.354287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:13.354287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 30 09:29:13.354287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 30 09:29:13.354287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:29:13.354287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:29:13.354287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:29:13.354287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:29:13.354287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 30 09:29:13.354287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:29:13.354287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:29:13.354287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:29:13.354287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:13.354287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:13.354287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:13.354287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:13.354287 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:13.355484 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:13.355484 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:13.355484 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:13.355484 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:13.355484 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:13.355484 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:13.355484 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:29:13.355484 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:29:13.355484 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:29:13.355484 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:29:13.355484 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:13.355484 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:13.355484 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:13.355484 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:13.355484 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:13.355484 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:13.356519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:13.356519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:13.356519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:13.356519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:13.356519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:13.356519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:13.356519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:13.356519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:13.356519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:13.356519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:13.356519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 30 09:29:13.356519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:29:13.356519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 30 09:29:13.356519 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:29:13.356519 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 579/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Sep 30 09:29:13 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:13.361529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b4338-3b31-45ec-b4d4-c85b2170bf32 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:13.427928 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:13.475886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b4338-3b31-45ec-b4d4-c85b2170bf32 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:13.514641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860454e1-ee47-4137-ab4f-fcc7029fe985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:13.515240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860454e1-ee47-4137-ab4f-fcc7029fe985 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:13.515548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860454e1-ee47-4137-ab4f-fcc7029fe985 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:13.515821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860454e1-ee47-4137-ab4f-fcc7029fe985 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:13.516459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860454e1-ee47-4137-ab4f-fcc7029fe985 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:13.516843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860454e1-ee47-4137-ab4f-fcc7029fe985 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:13.518201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860454e1-ee47-4137-ab4f-fcc7029fe985 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:13.527721 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 587/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Sep 30 09:29:13 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:15.705567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfd23d-848f-48ef-86c6-82bad5a0d72f None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:15.706131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfd23d-848f-48ef-86c6-82bad5a0d72f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:15.706131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfd23d-848f-48ef-86c6-82bad5a0d72f None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:15.707739 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 580/1167] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:15.713474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a0eac-26ac-4eb6-bc75-3b9ff7e9855f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:15.713901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a0eac-26ac-4eb6-bc75-3b9ff7e9855f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:15.714018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a0eac-26ac-4eb6-bc75-3b9ff7e9855f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:15.732153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c39a0eac-26ac-4eb6-bc75-3b9ff7e9855f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:15.733356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c39a0eac-26ac-4eb6-bc75-3b9ff7e9855f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:15.799517 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 588/1168] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:29:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:29:16.070842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfd23d-848f-48ef-86c6-82bad5a0d72f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:16.090550 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:16.173507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfd23d-848f-48ef-86c6-82bad5a0d72f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:16.207634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193a9cb-2677-49cd-bc5a-20ea6909319f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:16.208245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193a9cb-2677-49cd-bc5a-20ea6909319f None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:16.208554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193a9cb-2677-49cd-bc5a-20ea6909319f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:16.208980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193a9cb-2677-49cd-bc5a-20ea6909319f None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:16.209642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193a9cb-2677-49cd-bc5a-20ea6909319f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:16.210976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193a9cb-2677-49cd-bc5a-20ea6909319f None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:16.226255 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 581/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Fri Sep 30 09:29:16 2022] POST /identity/v3/domains => generated 267 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:29:18.386980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae1816-db95-4778-b384-76a6250e5e30 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:18.387508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae1816-db95-4778-b384-76a6250e5e30 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:18.387508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae1816-db95-4778-b384-76a6250e5e30 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:18.388892 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 589/1170] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:18.393965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20938af8-af22-4afc-86b9-de708a16ea5a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:18.394361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20938af8-af22-4afc-86b9-de708a16ea5a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:18.394508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20938af8-af22-4afc-86b9-de708a16ea5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:18.412795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-20938af8-af22-4afc-86b9-de708a16ea5a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:18.413955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-20938af8-af22-4afc-86b9-de708a16ea5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:18.477652 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 582/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:29:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:29:18.747137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae1816-db95-4778-b384-76a6250e5e30 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:18.805914 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:18.849681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae1816-db95-4778-b384-76a6250e5e30 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:18.883336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720253eb-072e-440f-954b-aa786ffd3b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:18.883942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720253eb-072e-440f-954b-aa786ffd3b22 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:18.884214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720253eb-072e-440f-954b-aa786ffd3b22 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:18.884485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720253eb-072e-440f-954b-aa786ffd3b22 None admin] PATH_INFO: `/v3/domains/add39e4fe7734f77bf5dda02462ec070` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:18.894373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720253eb-072e-440f-954b-aa786ffd3b22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=add39e4fe7734f77bf5dda02462ec070)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:18.896091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720253eb-072e-440f-954b-aa786ffd3b22 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:18.897667 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 590/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Fri Sep 30 09:29:18 2022] GET /identity/v3/domains/add39e4fe7734f77bf5dda02462ec070 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:18.903467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20938af8-af22-4afc-86b9-de708a16ea5a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:18.914031 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:19.003573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20938af8-af22-4afc-86b9-de708a16ea5a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:19.035954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34603f-ea16-4c1e-8128-7e690abd8af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:19.037139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34603f-ea16-4c1e-8128-7e690abd8af9 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:19.037407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34603f-ea16-4c1e-8128-7e690abd8af9 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:19.037672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34603f-ea16-4c1e-8128-7e690abd8af9 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:19.038317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34603f-ea16-4c1e-8128-7e690abd8af9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:19.039709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34603f-ea16-4c1e-8128-7e690abd8af9 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:19.065429 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 583/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Sep 30 09:29:18 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:29:21.196255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea897d-a3fd-4b9a-85d7-190705bc42a8 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:21.196784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea897d-a3fd-4b9a-85d7-190705bc42a8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:21.196784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea897d-a3fd-4b9a-85d7-190705bc42a8 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:21.198059 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 591/1174] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:21.203350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7072e-7c3c-4f63-8c2b-34761c93a8ad None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:21.203724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7072e-7c3c-4f63-8c2b-34761c93a8ad None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:21.203894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7072e-7c3c-4f63-8c2b-34761c93a8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:21.222455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d8b7072e-7c3c-4f63-8c2b-34761c93a8ad None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:21.224275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d8b7072e-7c3c-4f63-8c2b-34761c93a8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:21.277252 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:21.289453 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 584/1175] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:29:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:29:21.559443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea897d-a3fd-4b9a-85d7-190705bc42a8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:21.659100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea897d-a3fd-4b9a-85d7-190705bc42a8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:21.678779 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:21.698005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc762dd9-bba2-4df7-806b-49a78cff97ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:21.698624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc762dd9-bba2-4df7-806b-49a78cff97ca None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:21.698901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc762dd9-bba2-4df7-806b-49a78cff97ca None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:21.699177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc762dd9-bba2-4df7-806b-49a78cff97ca None admin] PATH_INFO: `/v3/domains/add39e4fe7734f77bf5dda02462ec070` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:21.700273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc762dd9-bba2-4df7-806b-49a78cff97ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=add39e4fe7734f77bf5dda02462ec070)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:21.701733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc762dd9-bba2-4df7-806b-49a78cff97ca None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:21.703310 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 592/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Fri Sep 30 09:29:21 2022] GET /identity/v3/domains/add39e4fe7734f77bf5dda02462ec070 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:21.710116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7072e-7c3c-4f63-8c2b-34761c93a8ad None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:21.806585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7072e-7c3c-4f63-8c2b-34761c93a8ad None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:21.840895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637de90f-952d-4fa9-9723-af875f3354fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:21.841423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637de90f-952d-4fa9-9723-af875f3354fc None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:21.842653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637de90f-952d-4fa9-9723-af875f3354fc None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:21.842929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637de90f-952d-4fa9-9723-af875f3354fc None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:21.843581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637de90f-952d-4fa9-9723-af875f3354fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:21.845019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637de90f-952d-4fa9-9723-af875f3354fc None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:21.866431 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 585/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Sep 30 09:29:21 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:29:24.037816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953a0e2-ad35-4784-82a6-50ac5e0add43 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:24.038335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953a0e2-ad35-4784-82a6-50ac5e0add43 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:24.038335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953a0e2-ad35-4784-82a6-50ac5e0add43 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:24.039682 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 593/1178] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:24.044959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9a6a0-d2af-48c6-9607-b7bd7167de82 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:24.045380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9a6a0-d2af-48c6-9607-b7bd7167de82 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:24.045495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9a6a0-d2af-48c6-9607-b7bd7167de82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:24.063581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8aa9a6a0-d2af-48c6-9607-b7bd7167de82 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:24.064770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8aa9a6a0-d2af-48c6-9607-b7bd7167de82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:24.105274 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:24.130447 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 586/1179] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:29:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:29:24.399911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953a0e2-ad35-4784-82a6-50ac5e0add43 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:24.496765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953a0e2-ad35-4784-82a6-50ac5e0add43 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:24.529316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4680de1-dfa9-4208-b687-a1d8a67dde5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:24.529923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4680de1-dfa9-4208-b687-a1d8a67dde5e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:24.530200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4680de1-dfa9-4208-b687-a1d8a67dde5e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:24.530468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4680de1-dfa9-4208-b687-a1d8a67dde5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:24.540735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4680de1-dfa9-4208-b687-a1d8a67dde5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:29:24.545371 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-c4680de1-dfa9-4208-b687-a1d8a67dde5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:29:24.545371 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:24.545371 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:24.545371 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:24.545371 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:24.545371 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:24.545371 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:24.545371 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:24.545371 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:24.545371 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:24.545371 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:24.545371 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:24.545371 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:29:24.545371 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:29:24.545371 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:29:24.545371 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:29:24.546416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:29:24.546416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:29:24.546416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:29:24.546416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:29:24.546416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:24.546416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:24.546416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:24.546416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:24.546416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:24.546416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:24.546416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:24.546416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:24.546416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:24.546416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:24.546416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:24.546416 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:24.547272 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:24.547272 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:24.547272 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:24.547272 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:24.547272 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:29:24.547272 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:29:24.547272 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:29:24.547272 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:29:24.547272 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:29:24.547272 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:29:24.547272 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:29:24.547272 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:29:24.547272 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 594/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:29:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:24.553684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9a6a0-d2af-48c6-9607-b7bd7167de82 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:24.649508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9a6a0-d2af-48c6-9607-b7bd7167de82 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:24.682488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768063d4-d4e8-4ec4-9c9b-c501d6536532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:24.683027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768063d4-d4e8-4ec4-9c9b-c501d6536532 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:24.683305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768063d4-d4e8-4ec4-9c9b-c501d6536532 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:24.683577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768063d4-d4e8-4ec4-9c9b-c501d6536532 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:24.684236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768063d4-d4e8-4ec4-9c9b-c501d6536532 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:24.684540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768063d4-d4e8-4ec4-9c9b-c501d6536532 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:24.685917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768063d4-d4e8-4ec4-9c9b-c501d6536532 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:24.693849 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 587/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:29:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:24.699732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4680de1-dfa9-4208-b687-a1d8a67dde5e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:24.745149 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:24.797117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4680de1-dfa9-4208-b687-a1d8a67dde5e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:24.829560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d589d7-2bd9-4849-a35c-bc96a289a1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:24.830170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d589d7-2bd9-4849-a35c-bc96a289a1d8 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:24.830447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d589d7-2bd9-4849-a35c-bc96a289a1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:24.830716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d589d7-2bd9-4849-a35c-bc96a289a1d8 None admin] PATH_INFO: `/v3/users/65ff520604524e0a978c235700a7231b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:24.844902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d589d7-2bd9-4849-a35c-bc96a289a1d8 None admin] RBAC: Authorizing `identity:get_user(user_id=65ff520604524e0a978c235700a7231b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:24.846314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d589d7-2bd9-4849-a35c-bc96a289a1d8 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:24.847870 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 595/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:29:24 2022] GET /identity/v3/users/65ff520604524e0a978c235700a7231b => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:24.854202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768063d4-d4e8-4ec4-9c9b-c501d6536532 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:24.893463 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:24.954828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768063d4-d4e8-4ec4-9c9b-c501d6536532 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:24.986817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b409794-0878-4b8a-96bf-8dffdbe479d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:24.987624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b409794-0878-4b8a-96bf-8dffdbe479d4 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:24.987903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b409794-0878-4b8a-96bf-8dffdbe479d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:24.988250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b409794-0878-4b8a-96bf-8dffdbe479d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:25.055078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b409794-0878-4b8a-96bf-8dffdbe479d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:25.056489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b409794-0878-4b8a-96bf-8dffdbe479d4 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:25.091986 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:25.150002 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 588/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:29:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:29:25.155907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d589d7-2bd9-4849-a35c-bc96a289a1d8 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:25.253677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d589d7-2bd9-4849-a35c-bc96a289a1d8 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:25.255140 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:25.287468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f036ff3-456f-4080-98e7-0517081b6ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:25.288070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f036ff3-456f-4080-98e7-0517081b6ddc None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:25.288340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f036ff3-456f-4080-98e7-0517081b6ddc None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:25.288620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f036ff3-456f-4080-98e7-0517081b6ddc None admin] PATH_INFO: `/v3/projects/0c91bb794b064ab2aed2491604aa3dca` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:25.289712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f036ff3-456f-4080-98e7-0517081b6ddc None admin] RBAC: Authorizing `identity:get_project(project_id=0c91bb794b064ab2aed2491604aa3dca)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:25.291119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f036ff3-456f-4080-98e7-0517081b6ddc None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:25.292727 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 596/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:29:25 2022] GET /identity/v3/projects/0c91bb794b064ab2aed2491604aa3dca => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:25.298759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b409794-0878-4b8a-96bf-8dffdbe479d4 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:25.396567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b409794-0878-4b8a-96bf-8dffdbe479d4 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:25.430585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f5a15-3389-460c-9872-60cb5192b0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:25.431170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f5a15-3389-460c-9872-60cb5192b0da None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:25.431446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f5a15-3389-460c-9872-60cb5192b0da None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:25.431714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f5a15-3389-460c-9872-60cb5192b0da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:25.432429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f5a15-3389-460c-9872-60cb5192b0da None admin] RBAC: Adding query filter params (role.id=f06b5fed717d4b03a5083dd847274296, scope.project.id=0c91bb794b064ab2aed2491604aa3dca, user.id=65ff520604524e0a978c235700a7231b) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:25.432769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f5a15-3389-460c-9872-60cb5192b0da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:25.434173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f5a15-3389-460c-9872-60cb5192b0da None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:25.439362 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 589/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:29:25 2022] GET /identity/v3/role_assignments?user.id=65ff520604524e0a978c235700a7231b&scope.project.id=0c91bb794b064ab2aed2491604aa3dca&role.id=f06b5fed717d4b03a5083dd847274296 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:27.545707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c6cbe-6af7-4b10-9a82-29444accd6fd None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:27.546295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c6cbe-6af7-4b10-9a82-29444accd6fd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:27.546295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c6cbe-6af7-4b10-9a82-29444accd6fd None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:27.547575 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 597/1186] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:27.553049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e872d4-0126-4806-bbe6-f29cb05e2052 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:27.553488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e872d4-0126-4806-bbe6-f29cb05e2052 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:27.553579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e872d4-0126-4806-bbe6-f29cb05e2052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:27.559790 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:27.572759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-14e872d4-0126-4806-bbe6-f29cb05e2052 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:27.573940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-14e872d4-0126-4806-bbe6-f29cb05e2052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:27.639256 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 590/1187] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:29:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:29:27.915943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c6cbe-6af7-4b10-9a82-29444accd6fd None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:28.024420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c6cbe-6af7-4b10-9a82-29444accd6fd None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:28.059948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a8257-9192-483d-8617-d6a3b1f8fe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:28.060565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a8257-9192-483d-8617-d6a3b1f8fe56 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:28.060877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a8257-9192-483d-8617-d6a3b1f8fe56 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:28.061151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a8257-9192-483d-8617-d6a3b1f8fe56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:28.070988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a8257-9192-483d-8617-d6a3b1f8fe56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:29:28.075690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-f92a8257-9192-483d-8617-d6a3b1f8fe56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:29:28.075690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:28.075690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:28.075690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:28.075690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:28.075690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:28.075690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:28.075690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:28.075690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:28.075690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:28.075690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:28.075690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:28.075690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:29:28.075690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:29:28.075690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:29:28.075690 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:29:28.076790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:29:28.076790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:29:28.076790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:29:28.076790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:29:28.076790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:28.076790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:28.076790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:28.076790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:28.076790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:28.076790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:28.076790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:28.076790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:28.076790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:28.076790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:28.076790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:28.076790 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:28.077842 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:28.077842 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:28.077842 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:28.077842 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:28.077842 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:29:28.077842 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:29:28.077842 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:29:28.077842 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:29:28.077842 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:29:28.077842 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:29:28.077842 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:29:28.077842 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:29:28.077842 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 598/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:29:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:28.083109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e872d4-0126-4806-bbe6-f29cb05e2052 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:28.179524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e872d4-0126-4806-bbe6-f29cb05e2052 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:28.207196 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:28.212351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf0c9b-6f31-49d1-a7d7-10d1f7022e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:28.212977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf0c9b-6f31-49d1-a7d7-10d1f7022e20 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:28.213251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf0c9b-6f31-49d1-a7d7-10d1f7022e20 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:28.213515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf0c9b-6f31-49d1-a7d7-10d1f7022e20 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:28.214169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf0c9b-6f31-49d1-a7d7-10d1f7022e20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:28.214463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf0c9b-6f31-49d1-a7d7-10d1f7022e20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:28.215795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf0c9b-6f31-49d1-a7d7-10d1f7022e20 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:28.223431 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 591/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:29:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:28.229754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a8257-9192-483d-8617-d6a3b1f8fe56 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:28.259716 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:28.326540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a8257-9192-483d-8617-d6a3b1f8fe56 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:28.359200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbbb13-62ac-405f-9153-f2e658679119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:28.359803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbbb13-62ac-405f-9153-f2e658679119 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:28.360105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbbb13-62ac-405f-9153-f2e658679119 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:28.360372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbbb13-62ac-405f-9153-f2e658679119 None admin] PATH_INFO: `/v3/users/65ff520604524e0a978c235700a7231b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:28.361488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbbb13-62ac-405f-9153-f2e658679119 None admin] RBAC: Authorizing `identity:get_user(user_id=65ff520604524e0a978c235700a7231b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:28.362908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbbb13-62ac-405f-9153-f2e658679119 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:28.364437 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 599/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:29:28 2022] GET /identity/v3/users/65ff520604524e0a978c235700a7231b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:28.371016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf0c9b-6f31-49d1-a7d7-10d1f7022e20 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:28.465898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf0c9b-6f31-49d1-a7d7-10d1f7022e20 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:28.497353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20915c92-8e72-4537-831f-7243c5560a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:28.497951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20915c92-8e72-4537-831f-7243c5560a75 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:28.498223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20915c92-8e72-4537-831f-7243c5560a75 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:28.498489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20915c92-8e72-4537-831f-7243c5560a75 None admin] PATH_INFO: `/v3/projects/0c91bb794b064ab2aed2491604aa3dca` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:28.499561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20915c92-8e72-4537-831f-7243c5560a75 None admin] RBAC: Authorizing `identity:get_project(project_id=0c91bb794b064ab2aed2491604aa3dca)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:28.500978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20915c92-8e72-4537-831f-7243c5560a75 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:28.502549 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 592/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:29:28 2022] GET /identity/v3/projects/0c91bb794b064ab2aed2491604aa3dca => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:28.508338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbbb13-62ac-405f-9153-f2e658679119 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:28.601129 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:28.605110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbbb13-62ac-405f-9153-f2e658679119 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:28.637072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc629bd-91ba-4035-9825-e5d11a2daa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:28.637712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc629bd-91ba-4035-9825-e5d11a2daa1b None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:28.637989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc629bd-91ba-4035-9825-e5d11a2daa1b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:28.638258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc629bd-91ba-4035-9825-e5d11a2daa1b None admin] PATH_INFO: `/v3/projects/0c91bb794b064ab2aed2491604aa3dca/users/65ff520604524e0a978c235700a7231b/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:28.640114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc629bd-91ba-4035-9825-e5d11a2daa1b None admin] RBAC: Authorizing `identity:create_grant(project_id=0c91bb794b064ab2aed2491604aa3dca, user_id=65ff520604524e0a978c235700a7231b, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:28.641552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc629bd-91ba-4035-9825-e5d11a2daa1b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:28.653907 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 600/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:29:28 2022] PUT /identity/v3/projects/0c91bb794b064ab2aed2491604aa3dca/users/65ff520604524e0a978c235700a7231b/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:29:30.769566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46fd42-6a67-4e99-bf04-f247c3ebe8b0 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:30.770125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46fd42-6a67-4e99-bf04-f247c3ebe8b0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:30.770125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46fd42-6a67-4e99-bf04-f247c3ebe8b0 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:30.771587 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 593/1193] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:29:30.776977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a4cbc-f63e-4c90-843a-1053d082b545 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:30.777411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a4cbc-f63e-4c90-843a-1053d082b545 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:30.777533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a4cbc-f63e-4c90-843a-1053d082b545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:30.795622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cd1a4cbc-f63e-4c90-843a-1053d082b545 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:29:30.796831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cd1a4cbc-f63e-4c90-843a-1053d082b545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:29:30.862893 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 601/1194] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:29:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:29:31.138497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46fd42-6a67-4e99-bf04-f247c3ebe8b0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:31.198727 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:31.238464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46fd42-6a67-4e99-bf04-f247c3ebe8b0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:31.270340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023893ad-ef63-4192-9f03-94c0651ed08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:31.271154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023893ad-ef63-4192-9f03-94c0651ed08f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:31.271435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023893ad-ef63-4192-9f03-94c0651ed08f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:31.271703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023893ad-ef63-4192-9f03-94c0651ed08f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:31.281732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023893ad-ef63-4192-9f03-94c0651ed08f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:29:31.286901 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-023893ad-ef63-4192-9f03-94c0651ed08f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:29:31.286901 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:29:31.286901 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:29:31.286901 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:29:31.286901 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:29:31.286901 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:29:31.286901 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:29:31.286901 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:29:31.286901 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:29:31.286901 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:29:31.286901 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:29:31.286901 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:29:31.286901 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:29:31.286901 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:29:31.286901 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:29:31.286901 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:29:31.288021 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:29:31.288021 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:29:31.288021 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:29:31.288021 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:29:31.288021 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:29:31.288021 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:29:31.288021 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:29:31.288021 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:29:31.288021 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:29:31.288021 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:29:31.288021 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:29:31.288021 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:29:31.288021 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:29:31.288021 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:29:31.288021 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:29:31.288021 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:29:31.289430 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:29:31.289430 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:29:31.289430 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:29:31.289430 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:29:31.289430 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:29:31.289430 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:29:31.289430 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:29:31.289430 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:29:31.289430 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:29:31.289430 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:29:31.289430 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:29:31.289430 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:29:31.289430 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 594/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:29:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:29:31.293989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a4cbc-f63e-4c90-843a-1053d082b545 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:31.384713 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:31.401269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a4cbc-f63e-4c90-843a-1053d082b545 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:31.445517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e1bd1-c503-40a2-b066-3135945512df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:31.446273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e1bd1-c503-40a2-b066-3135945512df None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:31.446548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e1bd1-c503-40a2-b066-3135945512df None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:31.446814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e1bd1-c503-40a2-b066-3135945512df None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:31.447455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e1bd1-c503-40a2-b066-3135945512df None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:31.447759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e1bd1-c503-40a2-b066-3135945512df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:31.449173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e1bd1-c503-40a2-b066-3135945512df None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:31.460118 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 602/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:29:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:31.466169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023893ad-ef63-4192-9f03-94c0651ed08f None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:31.563232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023893ad-ef63-4192-9f03-94c0651ed08f None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:31.585048 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:31.596179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33039a-3bd3-42ef-ad87-598e754c6286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:31.596811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33039a-3bd3-42ef-ad87-598e754c6286 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:31.597086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33039a-3bd3-42ef-ad87-598e754c6286 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:31.597352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33039a-3bd3-42ef-ad87-598e754c6286 None admin] PATH_INFO: `/v3/users/65ff520604524e0a978c235700a7231b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:31.598423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33039a-3bd3-42ef-ad87-598e754c6286 None admin] RBAC: Authorizing `identity:get_user(user_id=65ff520604524e0a978c235700a7231b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:31.600464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33039a-3bd3-42ef-ad87-598e754c6286 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:31.602024 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 595/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Sep 30 09:29:31 2022] GET /identity/v3/users/65ff520604524e0a978c235700a7231b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:31.607822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e1bd1-c503-40a2-b066-3135945512df None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:31.704461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e1bd1-c503-40a2-b066-3135945512df None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:31.737237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897243d-1afe-431f-b48c-c56e89039e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:31.737830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897243d-1afe-431f-b48c-c56e89039e1b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:31.738108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897243d-1afe-431f-b48c-c56e89039e1b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:31.738375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897243d-1afe-431f-b48c-c56e89039e1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:31.757457 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:31.805000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897243d-1afe-431f-b48c-c56e89039e1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:31.806432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897243d-1afe-431f-b48c-c56e89039e1b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:31.899514 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 603/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:29:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:29:31.905525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33039a-3bd3-42ef-ad87-598e754c6286 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:32.002127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33039a-3bd3-42ef-ad87-598e754c6286 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:32.034769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688758d6-9169-44fe-b399-ed2f4683abfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:32.035373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688758d6-9169-44fe-b399-ed2f4683abfb None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:32.035676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688758d6-9169-44fe-b399-ed2f4683abfb None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:32.035945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688758d6-9169-44fe-b399-ed2f4683abfb None admin] PATH_INFO: `/v3/projects/0c91bb794b064ab2aed2491604aa3dca` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:32.037096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688758d6-9169-44fe-b399-ed2f4683abfb None admin] RBAC: Authorizing `identity:get_project(project_id=0c91bb794b064ab2aed2491604aa3dca)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:32.038497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688758d6-9169-44fe-b399-ed2f4683abfb None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:32.040094 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 596/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Sep 30 09:29:31 2022] GET /identity/v3/projects/0c91bb794b064ab2aed2491604aa3dca => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:32.046375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897243d-1afe-431f-b48c-c56e89039e1b None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:29:32.094328 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:32.142660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897243d-1afe-431f-b48c-c56e89039e1b None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:29:32.174676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2225cd-2895-4d85-8066-7566b3505ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:29:32.175258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2225cd-2895-4d85-8066-7566b3505ab6 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:29:32.175534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2225cd-2895-4d85-8066-7566b3505ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:29:32.175801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2225cd-2895-4d85-8066-7566b3505ab6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:29:32.176510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2225cd-2895-4d85-8066-7566b3505ab6 None admin] RBAC: Adding query filter params (role.id=f06b5fed717d4b03a5083dd847274296, scope.project.id=0c91bb794b064ab2aed2491604aa3dca, user.id=65ff520604524e0a978c235700a7231b) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:29:32.176846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2225cd-2895-4d85-8066-7566b3505ab6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:29:32.178793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2225cd-2895-4d85-8066-7566b3505ab6 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:29:32.184301 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 604/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:29:32 2022] GET /identity/v3/role_assignments?user.id=65ff520604524e0a978c235700a7231b&scope.project.id=0c91bb794b064ab2aed2491604aa3dca&role.id=f06b5fed717d4b03a5083dd847274296 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:29:42.031203 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=71 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:29:42.182285 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=43 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:29.198485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a882e1-b7b5-42f4-be16-90114021b125 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:29.199032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a882e1-b7b5-42f4-be16-90114021b125 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:29.199032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a882e1-b7b5-42f4-be16-90114021b125 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:29.200851 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 597/1201] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:29.209705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999c59b-e2f0-4198-8bab-657ac5025453 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:29.210233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999c59b-e2f0-4198-8bab-657ac5025453 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:29.210233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999c59b-e2f0-4198-8bab-657ac5025453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:29.230543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8999c59b-e2f0-4198-8bab-657ac5025453 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:29.231927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8999c59b-e2f0-4198-8bab-657ac5025453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:29.332349 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 605/1202] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:30:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:30:29.644734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a882e1-b7b5-42f4-be16-90114021b125 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:29.789402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a882e1-b7b5-42f4-be16-90114021b125 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:29.837889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839132a-242c-4509-9e47-f69215a56049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:29.838540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839132a-242c-4509-9e47-f69215a56049 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:29.838826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839132a-242c-4509-9e47-f69215a56049 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:29.839100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839132a-242c-4509-9e47-f69215a56049 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:29.857386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839132a-242c-4509-9e47-f69215a56049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:29.858242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839132a-242c-4509-9e47-f69215a56049 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:29.879009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-1839132a-242c-4509-9e47-f69215a56049 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:29.879009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:29.879009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:29.879009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:29.879009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:29.879009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:29.879009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:29.879009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:29.879009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:29.879009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:29.879009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:29.879009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:29.879009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:30:29.879009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:30:29.879009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:30:29.879009 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:30:29.881395 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:29.881395 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:29.881395 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:29.881395 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:29.881395 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:29.881395 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:29.881395 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:29.881395 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:29.881395 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:29.881395 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:29.881395 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:29.881395 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:29.881395 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:29.881395 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:29.881395 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:29.881395 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:29.881395 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:30:29.882589 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:30:29.882589 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:29.882589 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:30:29.884758 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 598/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:30:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:29.893745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999c59b-e2f0-4198-8bab-657ac5025453 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:30.088685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999c59b-e2f0-4198-8bab-657ac5025453 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:30.128032 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:30.136329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b362c63-90da-469b-bfa7-6420bc0c2844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:30.137033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b362c63-90da-469b-bfa7-6420bc0c2844 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:30.137321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b362c63-90da-469b-bfa7-6420bc0c2844 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:30.137875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b362c63-90da-469b-bfa7-6420bc0c2844 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:30.138548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b362c63-90da-469b-bfa7-6420bc0c2844 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:30.138855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b362c63-90da-469b-bfa7-6420bc0c2844 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:30.140517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b362c63-90da-469b-bfa7-6420bc0c2844 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:30.160415 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 606/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:30.162467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839132a-242c-4509-9e47-f69215a56049 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:30.243655 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:30.314003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839132a-242c-4509-9e47-f69215a56049 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:30.358752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3f3d4-0e8c-4b5f-a267-6c08c603f23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:30.359425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3f3d4-0e8c-4b5f-a267-6c08c603f23e None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:30.359723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3f3d4-0e8c-4b5f-a267-6c08c603f23e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:30.360020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3f3d4-0e8c-4b5f-a267-6c08c603f23e None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:30.363205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3f3d4-0e8c-4b5f-a267-6c08c603f23e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:30.365021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3f3d4-0e8c-4b5f-a267-6c08c603f23e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:30.392496 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 599/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Sep 30 09:30:30 2022] POST /identity/v3/users => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:30:32.883055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051ccb6-9d1f-463c-8334-24913ff591e2 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:32.883557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051ccb6-9d1f-463c-8334-24913ff591e2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:32.883557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051ccb6-9d1f-463c-8334-24913ff591e2 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:32.887344 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 607/1206] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:32.892342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a256bb-f077-477d-966c-9dc24859ef44 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:32.893020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a256bb-f077-477d-966c-9dc24859ef44 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:32.893020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a256bb-f077-477d-966c-9dc24859ef44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:32.919126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a8a256bb-f077-477d-966c-9dc24859ef44 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:32.920459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a8a256bb-f077-477d-966c-9dc24859ef44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:33.020645 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 600/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:30:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:30:33.344454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051ccb6-9d1f-463c-8334-24913ff591e2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:33.484420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051ccb6-9d1f-463c-8334-24913ff591e2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:33.525725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9eeb4-4f98-432c-af4e-b11d0621cde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:33.526340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9eeb4-4f98-432c-af4e-b11d0621cde2 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:33.526670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9eeb4-4f98-432c-af4e-b11d0621cde2 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:33.526946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9eeb4-4f98-432c-af4e-b11d0621cde2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:33.538367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9eeb4-4f98-432c-af4e-b11d0621cde2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:30:33.543800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-5be9eeb4-4f98-432c-af4e-b11d0621cde2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:30:33.543800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:33.543800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:33.543800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:33.543800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:33.543800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:33.543800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:33.543800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:33.543800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:33.543800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:33.543800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:33.543800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:33.543800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:30:33.543800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:30:33.543800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:30:33.543800 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:30:33.544855 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:30:33.544855 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:30:33.544855 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:30:33.544855 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:30:33.544855 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:33.544855 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:33.544855 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:33.544855 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:33.544855 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:33.544855 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:33.544855 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:33.544855 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:33.544855 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:33.544855 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:33.544855 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:33.544855 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:33.545717 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:33.545717 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:33.545717 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:33.545717 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:33.545717 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:30:33.545717 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:30:33.545717 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:30:33.545717 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:30:33.545717 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:30:33.545717 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:30:33.545717 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:30:33.545717 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:30:33.545717 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 608/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:30:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:33.552467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a256bb-f077-477d-966c-9dc24859ef44 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:33.604964 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:33.682431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a256bb-f077-477d-966c-9dc24859ef44 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:33.726441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d649eaa-ca01-47ef-97d7-140536a9dd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:33.727056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d649eaa-ca01-47ef-97d7-140536a9dd44 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:33.727344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d649eaa-ca01-47ef-97d7-140536a9dd44 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:33.727665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d649eaa-ca01-47ef-97d7-140536a9dd44 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:33.728355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d649eaa-ca01-47ef-97d7-140536a9dd44 None admin] RBAC: Adding query filter params (name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:33.728699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d649eaa-ca01-47ef-97d7-140536a9dd44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:33.730087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d649eaa-ca01-47ef-97d7-140536a9dd44 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:33.739245 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 601/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Sep 30 09:30:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:33.745328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9eeb4-4f98-432c-af4e-b11d0621cde2 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:33.804163 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:33.862566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9eeb4-4f98-432c-af4e-b11d0621cde2 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:33.901506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76654740-0d2e-4fa7-a5e9-8eb38e60f843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:33.902324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76654740-0d2e-4fa7-a5e9-8eb38e60f843 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:33.902519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76654740-0d2e-4fa7-a5e9-8eb38e60f843 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:33.902890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76654740-0d2e-4fa7-a5e9-8eb38e60f843 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:33.923045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76654740-0d2e-4fa7-a5e9-8eb38e60f843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:33.926386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76654740-0d2e-4fa7-a5e9-8eb38e60f843 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:33.943096 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-76654740-0d2e-4fa7-a5e9-8eb38e60f843 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:33.943096 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:33.943096 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:33.943096 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:33.943096 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:33.943096 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:33.943096 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:33.943096 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:33.943096 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:33.943096 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:33.943096 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:33.943096 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:33.943096 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:30:33.943096 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:30:33.943096 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:30:33.943096 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:30:33.944168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:33.944168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:33.944168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:33.944168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:33.944168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:33.944168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:33.944168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:33.944168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:33.944168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:33.944168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:33.944168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:33.944168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:33.944168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:33.944168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:33.944168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:33.944168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:33.944168 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:30:33.945498 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:30:33.945498 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:33.945498 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:30:33.945498 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 609/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:30:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:33.950542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d649eaa-ca01-47ef-97d7-140536a9dd44 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:34.069827 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:34.076677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d649eaa-ca01-47ef-97d7-140536a9dd44 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:34.123530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f6916-a16d-4831-9615-2bc7764c4fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:34.124068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f6916-a16d-4831-9615-2bc7764c4fb1 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:34.124342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f6916-a16d-4831-9615-2bc7764c4fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:34.124640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f6916-a16d-4831-9615-2bc7764c4fb1 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:34.125314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f6916-a16d-4831-9615-2bc7764c4fb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:34.125617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f6916-a16d-4831-9615-2bc7764c4fb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:34.127075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f6916-a16d-4831-9615-2bc7764c4fb1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:34.140654 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 602/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:30:34.146439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76654740-0d2e-4fa7-a5e9-8eb38e60f843 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:34.266845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76654740-0d2e-4fa7-a5e9-8eb38e60f843 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:34.268407 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:34.303149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11459f81-def1-4fd2-a971-12e0bc209882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:34.303775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11459f81-def1-4fd2-a971-12e0bc209882 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:34.304076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11459f81-def1-4fd2-a971-12e0bc209882 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:34.304343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11459f81-def1-4fd2-a971-12e0bc209882 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:34.311736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11459f81-def1-4fd2-a971-12e0bc209882 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:34.313310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11459f81-def1-4fd2-a971-12e0bc209882 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:34.326047 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-11459f81-def1-4fd2-a971-12e0bc209882 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:30:34.326047 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:34.326047 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:34.326047 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:34.326047 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:34.326047 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:34.326047 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:34.326047 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:34.326047 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:34.326047 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:34.326047 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:34.326047 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:34.326047 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:30:34.326047 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:30:34.326047 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:30:34.326047 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:30:34.327330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:34.327330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:34.327330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:30:34.327330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:30:34.327330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:30:34.327330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:30:34.327330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:34.327330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:34.327330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:34.327330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:34.327330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:34.327330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:34.327330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:34.327330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:34.327330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:34.327330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:34.327330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:34.327330 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:34.328460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:34.328460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:34.328460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:30:34.328460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:30:34.328460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:30:34.328460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:30:34.328460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:30:34.328460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:30:34.328460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:30:34.328460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:30:34.328460 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 610/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:30:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:30:34.334414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f6916-a16d-4831-9615-2bc7764c4fb1 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:34.443237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f6916-a16d-4831-9615-2bc7764c4fb1 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:34.481989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95892e8f-6e84-49b6-aaad-a878d528b9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:34.482766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95892e8f-6e84-49b6-aaad-a878d528b9c8 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:34.483054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95892e8f-6e84-49b6-aaad-a878d528b9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:34.483408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95892e8f-6e84-49b6-aaad-a878d528b9c8 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:34.484284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95892e8f-6e84-49b6-aaad-a878d528b9c8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:34.484640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95892e8f-6e84-49b6-aaad-a878d528b9c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:34.486201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95892e8f-6e84-49b6-aaad-a878d528b9c8 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:34.506169 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 603/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Sep 30 09:30:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:30:34.512180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11459f81-def1-4fd2-a971-12e0bc209882 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:34.630463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11459f81-def1-4fd2-a971-12e0bc209882 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:34.668615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4953cf-2d5c-416b-aa82-cb0d133ca9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:34.669430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4953cf-2d5c-416b-aa82-cb0d133ca9bd None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:34.669836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4953cf-2d5c-416b-aa82-cb0d133ca9bd None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:34.670200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4953cf-2d5c-416b-aa82-cb0d133ca9bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:34.702911 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:34.750087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4953cf-2d5c-416b-aa82-cb0d133ca9bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:34.751544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4953cf-2d5c-416b-aa82-cb0d133ca9bd None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:34.863108 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 611/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:30:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:30:34.869591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95892e8f-6e84-49b6-aaad-a878d528b9c8 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:34.894147 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:34.994134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95892e8f-6e84-49b6-aaad-a878d528b9c8 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:35.037809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a685f6-52d7-4fe8-bb71-a9a4cd266552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:35.038514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a685f6-52d7-4fe8-bb71-a9a4cd266552 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:35.038832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a685f6-52d7-4fe8-bb71-a9a4cd266552 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:35.039127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a685f6-52d7-4fe8-bb71-a9a4cd266552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:35.051001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a685f6-52d7-4fe8-bb71-a9a4cd266552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:35.053216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a685f6-52d7-4fe8-bb71-a9a4cd266552 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:35.069581 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-91a685f6-52d7-4fe8-bb71-a9a4cd266552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:35.069581 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:35.069581 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:35.069581 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:35.069581 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:35.069581 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:35.069581 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:35.069581 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:35.069581 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:35.069581 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:35.069581 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:35.069581 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:35.069581 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:30:35.069581 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:30:35.069581 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:30:35.069581 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:30:35.070763 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:35.070763 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:35.070763 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:35.070763 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:35.070763 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:35.070763 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:35.070763 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:35.070763 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:35.070763 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:35.070763 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:35.070763 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:35.070763 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:35.070763 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:35.070763 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:35.070763 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:35.070763 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:35.070763 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:30:35.071878 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:30:35.071878 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:35.071878 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:30:35.071878 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 604/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:30:35.076841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4953cf-2d5c-416b-aa82-cb0d133ca9bd None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:35.147721 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:35.187857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4953cf-2d5c-416b-aa82-cb0d133ca9bd None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:35.224254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455470e-41ca-4326-b6ac-defc50c26fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:35.224892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455470e-41ca-4326-b6ac-defc50c26fe3 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:35.225238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455470e-41ca-4326-b6ac-defc50c26fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:35.225468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455470e-41ca-4326-b6ac-defc50c26fe3 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:35.226067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455470e-41ca-4326-b6ac-defc50c26fe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:35.226365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455470e-41ca-4326-b6ac-defc50c26fe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:35.227733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455470e-41ca-4326-b6ac-defc50c26fe3 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:35.240288 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 612/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:35.245436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a685f6-52d7-4fe8-bb71-a9a4cd266552 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:35.321842 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:35.358235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a685f6-52d7-4fe8-bb71-a9a4cd266552 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:35.396991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb3192-5ba9-43dc-ade2-518c8378b4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:35.397611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb3192-5ba9-43dc-ade2-518c8378b4e3 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:35.397888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb3192-5ba9-43dc-ade2-518c8378b4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:35.398220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb3192-5ba9-43dc-ade2-518c8378b4e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:35.406448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb3192-5ba9-43dc-ade2-518c8378b4e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:35.408015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb3192-5ba9-43dc-ade2-518c8378b4e3 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:35.420550 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-77bb3192-5ba9-43dc-ade2-518c8378b4e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:30:35.420550 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:35.420550 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:35.420550 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:35.420550 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:35.420550 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:35.420550 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:35.420550 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:35.420550 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:35.420550 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:35.420550 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:35.420550 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:35.420550 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:30:35.420550 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:30:35.420550 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:30:35.421690 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:30:35.421690 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:35.421690 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:35.421690 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:35.421690 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:35.421690 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:35.421690 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:35.421690 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:35.421690 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:35.421690 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:35.421690 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:35.421690 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:35.421690 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:35.421690 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:35.421690 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:35.421690 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:35.421690 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:35.422742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:30:35.422742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:30:35.422742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:30:35.422742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:30:35.422742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:30:35.422742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:30:35.422742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:30:35.422742 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:30:35.422742 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 605/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:30:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:35.428544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455470e-41ca-4326-b6ac-defc50c26fe3 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:35.543986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455470e-41ca-4326-b6ac-defc50c26fe3 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:35.569671 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:35.584631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560feaa-8bda-450a-a256-50c9bdf8afdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:35.585373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560feaa-8bda-450a-a256-50c9bdf8afdb None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:35.585697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560feaa-8bda-450a-a256-50c9bdf8afdb None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:35.585962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560feaa-8bda-450a-a256-50c9bdf8afdb None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:35.586845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560feaa-8bda-450a-a256-50c9bdf8afdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:35.587146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560feaa-8bda-450a-a256-50c9bdf8afdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:35.588584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560feaa-8bda-450a-a256-50c9bdf8afdb None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:35.602160 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 613/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:30:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:35.608450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb3192-5ba9-43dc-ade2-518c8378b4e3 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:35.726875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb3192-5ba9-43dc-ade2-518c8378b4e3 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:35.755313 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:35.761718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4233cd-696d-491b-8017-fcd929e1cd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:35.762306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4233cd-696d-491b-8017-fcd929e1cd2f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:35.762579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4233cd-696d-491b-8017-fcd929e1cd2f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:35.762849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4233cd-696d-491b-8017-fcd929e1cd2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:35.763558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4233cd-696d-491b-8017-fcd929e1cd2f None admin] RBAC: Adding query filter params (role.id=4089b59a020f44b98fad2a34b61fd573, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=cbb22d0675bc4ca893b0477cebd470c6) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:35.763859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4233cd-696d-491b-8017-fcd929e1cd2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:35.765294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4233cd-696d-491b-8017-fcd929e1cd2f None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:35.771310 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 606/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:30:35 2022] GET /identity/v3/role_assignments?user.id=cbb22d0675bc4ca893b0477cebd470c6&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=4089b59a020f44b98fad2a34b61fd573 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:37.951406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d160654-4dcd-4446-9d07-8e43ceda824f None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:37.951921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d160654-4dcd-4446-9d07-8e43ceda824f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:37.951921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d160654-4dcd-4446-9d07-8e43ceda824f None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:37.953308 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 614/1220] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:30:37.959797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbec146-9db9-43db-8fd2-da6472f74a0b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:37.960278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbec146-9db9-43db-8fd2-da6472f74a0b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:37.960450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbec146-9db9-43db-8fd2-da6472f74a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:37.979660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-afbec146-9db9-43db-8fd2-da6472f74a0b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:37.980995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-afbec146-9db9-43db-8fd2-da6472f74a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:38.052201 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 607/1221] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:30:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:30:38.346970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d160654-4dcd-4446-9d07-8e43ceda824f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:38.458138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d160654-4dcd-4446-9d07-8e43ceda824f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:38.494458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf536a3-5036-4217-b4da-6565436be939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:38.495085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf536a3-5036-4217-b4da-6565436be939 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:38.495369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf536a3-5036-4217-b4da-6565436be939 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:38.495728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf536a3-5036-4217-b4da-6565436be939 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:38.507687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf536a3-5036-4217-b4da-6565436be939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:30:38.513108 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-faf536a3-5036-4217-b4da-6565436be939 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:30:38.513108 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:38.513108 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:38.513108 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:38.513108 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:38.513108 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:38.513108 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:38.513108 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:38.513108 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:38.513108 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:38.513108 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:38.513108 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:38.513108 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:30:38.513108 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:30:38.513108 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:30:38.513108 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:30:38.514221 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:30:38.514221 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:30:38.514221 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:30:38.514221 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:30:38.514221 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:38.514221 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:38.514221 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:38.514221 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:38.514221 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:38.514221 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:38.514221 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:38.514221 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:38.514221 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:38.514221 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:38.514221 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:38.514221 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:38.515174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:38.515174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:38.515174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:38.515174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:38.515174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:30:38.515174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:30:38.515174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:30:38.515174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:30:38.515174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:30:38.515174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:30:38.515174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:30:38.515174 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:30:38.515174 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 615/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:30:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:38.521197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbec146-9db9-43db-8fd2-da6472f74a0b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:38.638763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbec146-9db9-43db-8fd2-da6472f74a0b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:38.666160 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:38.678779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b68efa-92c1-4f35-b77c-76565eb3a0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:38.679458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b68efa-92c1-4f35-b77c-76565eb3a0d9 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:38.679804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b68efa-92c1-4f35-b77c-76565eb3a0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:38.680075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b68efa-92c1-4f35-b77c-76565eb3a0d9 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:38.680791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b68efa-92c1-4f35-b77c-76565eb3a0d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:38.681215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b68efa-92c1-4f35-b77c-76565eb3a0d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:38.682570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b68efa-92c1-4f35-b77c-76565eb3a0d9 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:38.690836 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 608/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Sep 30 09:30:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:38.700480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf536a3-5036-4217-b4da-6565436be939 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:38.753177 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:38.819471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf536a3-5036-4217-b4da-6565436be939 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:38.859440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12747fb2-449c-42c5-8a3e-317fc1470b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:38.860086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12747fb2-449c-42c5-8a3e-317fc1470b96 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:38.860362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12747fb2-449c-42c5-8a3e-317fc1470b96 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:38.860660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12747fb2-449c-42c5-8a3e-317fc1470b96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:38.870678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12747fb2-449c-42c5-8a3e-317fc1470b96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:38.872168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12747fb2-449c-42c5-8a3e-317fc1470b96 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:38.887141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-12747fb2-449c-42c5-8a3e-317fc1470b96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:38.887141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:38.887141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:38.887141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:38.887141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:38.887141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:38.887141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:38.887141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:38.887141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:38.887141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:38.887141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:38.887141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:38.887141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:30:38.887141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:30:38.887141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:30:38.887141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:30:38.888744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:38.888744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:38.888744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:38.888744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:38.888744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:38.888744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:38.888744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:38.888744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:38.888744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:38.888744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:38.888744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:38.888744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:38.888744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:38.888744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:38.888744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:38.888744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:38.888744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:30:38.890232 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:30:38.890232 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:38.890232 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:30:38.890232 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 616/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:30:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:30:38.897258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b68efa-92c1-4f35-b77c-76565eb3a0d9 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:39.014010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b68efa-92c1-4f35-b77c-76565eb3a0d9 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:39.051925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fb816-4056-4258-9bbf-1e9fafdcf05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:39.052663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fb816-4056-4258-9bbf-1e9fafdcf05a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:39.053136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fb816-4056-4258-9bbf-1e9fafdcf05a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:39.053476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fb816-4056-4258-9bbf-1e9fafdcf05a None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:39.054176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fb816-4056-4258-9bbf-1e9fafdcf05a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:39.054564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fb816-4056-4258-9bbf-1e9fafdcf05a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:39.056018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fb816-4056-4258-9bbf-1e9fafdcf05a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:39.075437 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 609/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:39.076828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12747fb2-449c-42c5-8a3e-317fc1470b96 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:39.184648 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:39.191314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12747fb2-449c-42c5-8a3e-317fc1470b96 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:39.226413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518d136-03e7-4f16-9142-cc2ab4b1eedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:39.227088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518d136-03e7-4f16-9142-cc2ab4b1eedf None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:39.227371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518d136-03e7-4f16-9142-cc2ab4b1eedf None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:39.227637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518d136-03e7-4f16-9142-cc2ab4b1eedf None admin] PATH_INFO: `/v3/users/placement` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:39.237361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518d136-03e7-4f16-9142-cc2ab4b1eedf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:39.240865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518d136-03e7-4f16-9142-cc2ab4b1eedf None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:39.258678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-d518d136-03e7-4f16-9142-cc2ab4b1eedf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:30:39.258678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:39.258678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:39.258678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:39.258678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:39.258678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:39.258678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:39.258678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:39.258678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:39.258678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:39.258678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:39.258678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:39.258678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:30:39.258678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:30:39.258678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:30:39.258678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:30:39.259783 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:39.259783 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:39.259783 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:30:39.259783 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:30:39.259783 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:30:39.259783 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:30:39.259783 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:39.259783 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:39.259783 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:39.259783 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:39.259783 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:39.259783 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:39.259783 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:39.259783 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:39.259783 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:39.259783 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:39.259783 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:39.259783 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:39.260788 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:39.260788 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:39.260788 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:30:39.260788 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:30:39.260788 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:30:39.260788 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:30:39.260788 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:30:39.260788 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:30:39.260788 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:30:39.260788 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:30:39.260788 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 617/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:30:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:39.266384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fb816-4056-4258-9bbf-1e9fafdcf05a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:39.317124 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:39.376322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fb816-4056-4258-9bbf-1e9fafdcf05a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:39.419398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e83e1-a161-4613-8533-df0948437412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:39.420154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e83e1-a161-4613-8533-df0948437412 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:39.420453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e83e1-a161-4613-8533-df0948437412 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:39.420792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e83e1-a161-4613-8533-df0948437412 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:39.421517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e83e1-a161-4613-8533-df0948437412 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:39.421895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e83e1-a161-4613-8533-df0948437412 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:39.423902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e83e1-a161-4613-8533-df0948437412 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:39.445804 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 610/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Sep 30 09:30:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:39.451674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518d136-03e7-4f16-9142-cc2ab4b1eedf None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:39.574089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518d136-03e7-4f16-9142-cc2ab4b1eedf None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:39.612427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc7209-7394-46e7-ab20-403ecddb22e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:39.613085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc7209-7394-46e7-ab20-403ecddb22e5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:39.613881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc7209-7394-46e7-ab20-403ecddb22e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:39.614213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc7209-7394-46e7-ab20-403ecddb22e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:39.625356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc7209-7394-46e7-ab20-403ecddb22e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:39.627141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc7209-7394-46e7-ab20-403ecddb22e5 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:39.644357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-19fc7209-7394-46e7-ab20-403ecddb22e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:39.644357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:39.644357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:39.644357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:39.644357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:39.644357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:39.644357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:39.644357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:39.644357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:39.644357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:39.644357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:39.644357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:39.644357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:30:39.644357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:30:39.644357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:30:39.644357 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:30:39.645523 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:39.645523 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:39.645523 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:39.645523 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:39.645523 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:39.645523 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:39.645523 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:39.645523 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:39.645523 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:39.645523 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:39.645523 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:39.645523 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:39.645523 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:39.645523 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:39.645523 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:39.645523 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:39.645523 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:30:39.646469 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:30:39.646469 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:39.646469 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:30:39.646469 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 618/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:30:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:39.651970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e83e1-a161-4613-8533-df0948437412 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:39.767209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e83e1-a161-4613-8533-df0948437412 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:39.769590 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:39.807077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f92ca3-7de5-4fc7-94ae-0ec0c55a48ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:39.807876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f92ca3-7de5-4fc7-94ae-0ec0c55a48ab None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:39.808202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f92ca3-7de5-4fc7-94ae-0ec0c55a48ab None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:39.808486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f92ca3-7de5-4fc7-94ae-0ec0c55a48ab None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:39.809217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f92ca3-7de5-4fc7-94ae-0ec0c55a48ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:39.809590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f92ca3-7de5-4fc7-94ae-0ec0c55a48ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:39.811217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f92ca3-7de5-4fc7-94ae-0ec0c55a48ab None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:39.824431 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 611/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:39.830757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc7209-7394-46e7-ab20-403ecddb22e5 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:39.841544 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:39.951323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc7209-7394-46e7-ab20-403ecddb22e5 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:39.990377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe8e7b-8137-4a48-aef3-151857f1b871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:39.991011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe8e7b-8137-4a48-aef3-151857f1b871 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:39.991297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe8e7b-8137-4a48-aef3-151857f1b871 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:39.991561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe8e7b-8137-4a48-aef3-151857f1b871 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:39.999715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe8e7b-8137-4a48-aef3-151857f1b871 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:40.001291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe8e7b-8137-4a48-aef3-151857f1b871 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:40.013178 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-2ebe8e7b-8137-4a48-aef3-151857f1b871 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:30:40.013178 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:40.013178 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:40.013178 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:40.013178 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:40.013178 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:40.013178 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:40.013178 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:40.013178 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:40.013178 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:40.013178 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:40.013178 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:40.013178 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:30:40.013178 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:30:40.013178 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:30:40.014413 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:30:40.014413 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:40.014413 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:40.014413 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:40.014413 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:40.014413 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:40.014413 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:40.014413 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:40.014413 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:40.014413 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:40.014413 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:40.014413 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:40.014413 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:40.014413 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:40.014413 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:40.014413 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:40.014413 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:40.015432 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:30:40.015432 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:30:40.015432 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:30:40.015432 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:30:40.015432 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:30:40.015432 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:30:40.015432 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:30:40.015432 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:30:40.015432 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 619/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:30:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:40.021234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f92ca3-7de5-4fc7-94ae-0ec0c55a48ab None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:40.146056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f92ca3-7de5-4fc7-94ae-0ec0c55a48ab None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:40.186274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220e994-7615-4e63-941c-ac0b3eb830f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:40.187214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220e994-7615-4e63-941c-ac0b3eb830f9 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:40.187651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220e994-7615-4e63-941c-ac0b3eb830f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:40.187995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220e994-7615-4e63-941c-ac0b3eb830f9 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:40.188871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220e994-7615-4e63-941c-ac0b3eb830f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:40.189180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220e994-7615-4e63-941c-ac0b3eb830f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:40.191120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220e994-7615-4e63-941c-ac0b3eb830f9 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:40.206387 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 612/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:30:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:40.212903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe8e7b-8137-4a48-aef3-151857f1b871 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:40.284037 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:40.327689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe8e7b-8137-4a48-aef3-151857f1b871 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:40.365597 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffb02b-a01b-4f9d-a56f-af42cac70fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:40.366255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffb02b-a01b-4f9d-a56f-af42cac70fbe None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:40.366531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffb02b-a01b-4f9d-a56f-af42cac70fbe None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:40.366801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffb02b-a01b-4f9d-a56f-af42cac70fbe None admin] PATH_INFO: `/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/cbb22d0675bc4ca893b0477cebd470c6/roles/4089b59a020f44b98fad2a34b61fd573` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:40.384251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffb02b-a01b-4f9d-a56f-af42cac70fbe None admin] RBAC: Authorizing `identity:create_grant(project_id=1fbc72b5e3b84c8fb74d8d4952a26e76, user_id=cbb22d0675bc4ca893b0477cebd470c6, role_id=4089b59a020f44b98fad2a34b61fd573)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:40.385725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffb02b-a01b-4f9d-a56f-af42cac70fbe None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:40.398056 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 620/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:30:40 2022] PUT /identity/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/cbb22d0675bc4ca893b0477cebd470c6/roles/4089b59a020f44b98fad2a34b61fd573 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:30:42.736546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380068d4-c55b-4901-adf6-e5ce3e2515b7 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:42.737204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380068d4-c55b-4901-adf6-e5ce3e2515b7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:42.737204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380068d4-c55b-4901-adf6-e5ce3e2515b7 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:42.738748 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 613/1233] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:42.744333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241413b-93ec-401e-ae07-ff6f3027e825 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:42.744841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241413b-93ec-401e-ae07-ff6f3027e825 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:42.744926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241413b-93ec-401e-ae07-ff6f3027e825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:42.765440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c241413b-93ec-401e-ae07-ff6f3027e825 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:42.767016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c241413b-93ec-401e-ae07-ff6f3027e825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:42.852250 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 621/1234] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:30:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:30:43.138827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380068d4-c55b-4901-adf6-e5ce3e2515b7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:43.170896 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:43.282019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380068d4-c55b-4901-adf6-e5ce3e2515b7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:43.321821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794e613-24eb-4976-8deb-91dc938fddc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:43.322457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794e613-24eb-4976-8deb-91dc938fddc3 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:43.322810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794e613-24eb-4976-8deb-91dc938fddc3 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:43.322994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794e613-24eb-4976-8deb-91dc938fddc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:43.334717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794e613-24eb-4976-8deb-91dc938fddc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:30:43.339589 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-8794e613-24eb-4976-8deb-91dc938fddc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:30:43.339589 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:43.339589 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:43.339589 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:43.339589 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:43.339589 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:43.339589 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:43.339589 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:43.339589 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:43.339589 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:43.339589 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:43.339589 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:43.339589 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:30:43.339589 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:30:43.339589 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:30:43.339589 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:30:43.344951 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:30:43.344951 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:30:43.344951 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:30:43.344951 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:30:43.344951 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:43.344951 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:43.344951 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:43.344951 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:43.344951 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:43.344951 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:43.344951 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:43.344951 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:43.344951 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:43.344951 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:43.344951 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:43.344951 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:43.346095 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:43.346095 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:43.346095 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:43.346095 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:43.346095 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:30:43.346095 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:30:43.346095 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:30:43.346095 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:30:43.346095 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:30:43.346095 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:30:43.346095 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 09:30:43.346095 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:30:43.346095 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 614/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Sep 30 09:30:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:43.347078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241413b-93ec-401e-ae07-ff6f3027e825 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:43.403947 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:43.469600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241413b-93ec-401e-ae07-ff6f3027e825 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:43.514536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677ebb1-904b-4a83-af74-53e98b60db35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:43.515195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677ebb1-904b-4a83-af74-53e98b60db35 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:43.515476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677ebb1-904b-4a83-af74-53e98b60db35 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:43.515745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677ebb1-904b-4a83-af74-53e98b60db35 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:43.516410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677ebb1-904b-4a83-af74-53e98b60db35 None admin] RBAC: Adding query filter params (name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:43.516739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677ebb1-904b-4a83-af74-53e98b60db35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:43.518089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677ebb1-904b-4a83-af74-53e98b60db35 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:43.526989 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 622/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Sep 30 09:30:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:43.532824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794e613-24eb-4976-8deb-91dc938fddc3 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:43.639972 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:43.661818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794e613-24eb-4976-8deb-91dc938fddc3 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:43.702108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf86d79-cec4-4a20-9125-5e0e15a48902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:43.702807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf86d79-cec4-4a20-9125-5e0e15a48902 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:43.703119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf86d79-cec4-4a20-9125-5e0e15a48902 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:43.703438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf86d79-cec4-4a20-9125-5e0e15a48902 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:43.715606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf86d79-cec4-4a20-9125-5e0e15a48902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:43.717286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf86d79-cec4-4a20-9125-5e0e15a48902 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:43.734086 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-ddf86d79-cec4-4a20-9125-5e0e15a48902 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:43.734086 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:43.734086 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:43.734086 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:43.734086 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:43.734086 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:43.734086 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:43.734086 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:43.734086 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:43.734086 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:43.734086 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:43.734086 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:43.734086 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:30:43.734086 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:30:43.734086 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:30:43.734086 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:30:43.735638 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:43.735638 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:43.735638 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:43.735638 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:43.735638 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:43.735638 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:43.735638 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:43.735638 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:43.735638 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:43.735638 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:43.735638 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:43.735638 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:43.735638 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:43.735638 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:43.735638 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:43.735638 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:43.735638 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:30:43.737392 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:30:43.737392 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:43.737392 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:30:43.737392 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 615/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:43.741627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677ebb1-904b-4a83-af74-53e98b60db35 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:43.869037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677ebb1-904b-4a83-af74-53e98b60db35 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:43.880876 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:43.911264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cdfca-c26d-4123-a785-145553cf8a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:43.911928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cdfca-c26d-4123-a785-145553cf8a6e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:43.912161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cdfca-c26d-4123-a785-145553cf8a6e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:43.912433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cdfca-c26d-4123-a785-145553cf8a6e None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:43.913117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cdfca-c26d-4123-a785-145553cf8a6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:43.913420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cdfca-c26d-4123-a785-145553cf8a6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:43.914956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cdfca-c26d-4123-a785-145553cf8a6e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:43.930033 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 623/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:43.936124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf86d79-cec4-4a20-9125-5e0e15a48902 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:44.060581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf86d79-cec4-4a20-9125-5e0e15a48902 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:44.103718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705953d8-6408-48d5-98fa-66e08c160369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:44.104982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705953d8-6408-48d5-98fa-66e08c160369 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:44.105369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705953d8-6408-48d5-98fa-66e08c160369 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:44.105780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705953d8-6408-48d5-98fa-66e08c160369 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:44.109754 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:44.120549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705953d8-6408-48d5-98fa-66e08c160369 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:44.127328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705953d8-6408-48d5-98fa-66e08c160369 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:44.139342 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-705953d8-6408-48d5-98fa-66e08c160369 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:30:44.139342 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:44.139342 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:44.139342 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:44.139342 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:44.139342 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:44.139342 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:44.139342 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:44.139342 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:44.139342 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:44.139342 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:44.139342 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:44.139342 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:30:44.139342 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:30:44.139342 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:30:44.139342 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:30:44.140666 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:44.140666 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:44.140666 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:30:44.140666 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:30:44.140666 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:30:44.140666 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:30:44.140666 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:44.140666 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:44.140666 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:44.140666 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:44.140666 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:44.140666 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:44.140666 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:44.140666 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:44.140666 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:44.140666 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:44.140666 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:44.140666 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:44.142041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:44.142041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:44.142041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:30:44.142041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:30:44.142041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:30:44.142041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:30:44.142041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:30:44.142041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:30:44.142041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:30:44.142041 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:30:44.142041 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 616/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:30:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:44.147953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cdfca-c26d-4123-a785-145553cf8a6e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:44.267729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cdfca-c26d-4123-a785-145553cf8a6e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:44.307432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd2b13-ff38-4b1e-aca7-3dd2f885042f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:44.307997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd2b13-ff38-4b1e-aca7-3dd2f885042f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:44.308856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd2b13-ff38-4b1e-aca7-3dd2f885042f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:44.309179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd2b13-ff38-4b1e-aca7-3dd2f885042f None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:44.309964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd2b13-ff38-4b1e-aca7-3dd2f885042f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:44.310271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd2b13-ff38-4b1e-aca7-3dd2f885042f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:44.311715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd2b13-ff38-4b1e-aca7-3dd2f885042f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:44.332719 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 624/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Sep 30 09:30:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:44.338414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705953d8-6408-48d5-98fa-66e08c160369 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:44.464531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705953d8-6408-48d5-98fa-66e08c160369 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:44.512634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afc628-9358-41ab-8fce-a40178ee0c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:44.512634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afc628-9358-41ab-8fce-a40178ee0c95 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:44.512634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afc628-9358-41ab-8fce-a40178ee0c95 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:44.512634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afc628-9358-41ab-8fce-a40178ee0c95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:44.587693 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:44.595893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26afc628-9358-41ab-8fce-a40178ee0c95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:44.597977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26afc628-9358-41ab-8fce-a40178ee0c95 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:44.726350 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 617/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:30:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:30:44.733289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd2b13-ff38-4b1e-aca7-3dd2f885042f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:44.771166 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:44.867545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd2b13-ff38-4b1e-aca7-3dd2f885042f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:44.912464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ce154-b7fd-443c-aeac-efb399b28b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:44.913142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ce154-b7fd-443c-aeac-efb399b28b2d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:44.913401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ce154-b7fd-443c-aeac-efb399b28b2d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:44.913669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ce154-b7fd-443c-aeac-efb399b28b2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:44.927515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ce154-b7fd-443c-aeac-efb399b28b2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:44.929267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ce154-b7fd-443c-aeac-efb399b28b2d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:44.946490 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-756ce154-b7fd-443c-aeac-efb399b28b2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:44.946490 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:44.946490 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:44.946490 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:44.946490 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:44.946490 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:44.946490 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:44.946490 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:44.946490 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:44.946490 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:44.946490 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:44.946490 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:44.946490 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:30:44.946490 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:30:44.946490 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:30:44.946490 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:30:44.947744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:44.947744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:44.947744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:44.947744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:44.947744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:44.947744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:44.947744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:44.947744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:44.947744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:44.947744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:44.947744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:44.947744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:44.947744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:44.947744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:44.947744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:44.947744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:44.947744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:30:44.949265 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:30:44.949265 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:44.949265 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:30:44.949265 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 625/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:44.953618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afc628-9358-41ab-8fce-a40178ee0c95 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:45.069599 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:45.075860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afc628-9358-41ab-8fce-a40178ee0c95 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:45.117689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf711a-d29c-4bd1-a548-04a101bd3ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:45.118258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf711a-d29c-4bd1-a548-04a101bd3ad7 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:45.118517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf711a-d29c-4bd1-a548-04a101bd3ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:45.118819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf711a-d29c-4bd1-a548-04a101bd3ad7 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:45.119539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf711a-d29c-4bd1-a548-04a101bd3ad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:45.119837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf711a-d29c-4bd1-a548-04a101bd3ad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:45.121335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf711a-d29c-4bd1-a548-04a101bd3ad7 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:45.139854 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 618/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:45.141823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ce154-b7fd-443c-aeac-efb399b28b2d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:45.251915 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:45.277134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ce154-b7fd-443c-aeac-efb399b28b2d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:45.318019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81ba35-4b4e-4e33-aed8-b8e3c6ef2ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:45.318661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81ba35-4b4e-4e33-aed8-b8e3c6ef2ffd None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:45.318952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81ba35-4b4e-4e33-aed8-b8e3c6ef2ffd None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:45.319204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81ba35-4b4e-4e33-aed8-b8e3c6ef2ffd None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:45.328231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81ba35-4b4e-4e33-aed8-b8e3c6ef2ffd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:45.329742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81ba35-4b4e-4e33-aed8-b8e3c6ef2ffd None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:45.343914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-dd81ba35-4b4e-4e33-aed8-b8e3c6ef2ffd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:30:45.343914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:45.343914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:45.343914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:45.343914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:45.343914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:45.343914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:45.343914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:45.343914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:45.343914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:45.343914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:45.343914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:45.343914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:30:45.343914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:30:45.343914 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:30:45.344942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:30:45.344942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:45.344942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:45.344942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:45.344942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:45.344942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:45.344942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:45.344942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:45.344942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:45.344942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:45.344942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:45.344942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:45.344942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:45.344942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:45.344942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:45.344942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:45.344942 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:45.346460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:30:45.346460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:30:45.346460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:30:45.346460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:30:45.346460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:30:45.346460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:30:45.346460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:30:45.346460 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:30:45.353253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf711a-d29c-4bd1-a548-04a101bd3ad7 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:45.356369 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 626/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:30:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:45.486567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf711a-d29c-4bd1-a548-04a101bd3ad7 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:45.527775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb4030-cfc5-48ff-a93a-ef0fef87f29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:45.528388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb4030-cfc5-48ff-a93a-ef0fef87f29d None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:45.528752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb4030-cfc5-48ff-a93a-ef0fef87f29d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:45.528972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb4030-cfc5-48ff-a93a-ef0fef87f29d None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:45.529718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb4030-cfc5-48ff-a93a-ef0fef87f29d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:45.529963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb4030-cfc5-48ff-a93a-ef0fef87f29d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:45.531497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb4030-cfc5-48ff-a93a-ef0fef87f29d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:45.545625 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 619/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:30:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:45.552264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81ba35-4b4e-4e33-aed8-b8e3c6ef2ffd None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:45.696196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81ba35-4b4e-4e33-aed8-b8e3c6ef2ffd None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:45.740336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26468ff4-9369-4f9f-9868-0dfc6efffe18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:45.740910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26468ff4-9369-4f9f-9868-0dfc6efffe18 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:45.741197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26468ff4-9369-4f9f-9868-0dfc6efffe18 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:45.741464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26468ff4-9369-4f9f-9868-0dfc6efffe18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:45.742194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26468ff4-9369-4f9f-9868-0dfc6efffe18 None admin] RBAC: Adding query filter params (role.id=4089b59a020f44b98fad2a34b61fd573, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=cbb22d0675bc4ca893b0477cebd470c6) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:45.742524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26468ff4-9369-4f9f-9868-0dfc6efffe18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:45.743904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26468ff4-9369-4f9f-9868-0dfc6efffe18 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:45.752652 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 627/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:30:45 2022] GET /identity/v3/role_assignments?user.id=cbb22d0675bc4ca893b0477cebd470c6&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=4089b59a020f44b98fad2a34b61fd573 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:48.047661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38227b7-63bd-44d2-849e-07cb0bb17b1e None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:48.048206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38227b7-63bd-44d2-849e-07cb0bb17b1e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:48.048206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38227b7-63bd-44d2-849e-07cb0bb17b1e None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:48.049865 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 620/1247] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:48.055352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ef6d2-7972-420d-b9d3-2571fd65dedd None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:48.055817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ef6d2-7972-420d-b9d3-2571fd65dedd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:48.055922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ef6d2-7972-420d-b9d3-2571fd65dedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:48.062349 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:48.076783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-209ef6d2-7972-420d-b9d3-2571fd65dedd None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:48.077946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-209ef6d2-7972-420d-b9d3-2571fd65dedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:48.166815 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 628/1248] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:30:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 09:30:48.485853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38227b7-63bd-44d2-849e-07cb0bb17b1e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:48.508339 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:48.626141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38227b7-63bd-44d2-849e-07cb0bb17b1e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:48.670808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa09b76-3f5d-4250-9367-22b58f8e9fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:48.671447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa09b76-3f5d-4250-9367-22b58f8e9fec None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:48.671723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa09b76-3f5d-4250-9367-22b58f8e9fec None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:48.672132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa09b76-3f5d-4250-9367-22b58f8e9fec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:48.684346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa09b76-3f5d-4250-9367-22b58f8e9fec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:30:48.689920 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-8fa09b76-3f5d-4250-9367-22b58f8e9fec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:30:48.689920 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:48.689920 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:48.689920 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:48.689920 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:48.689920 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:48.689920 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:48.689920 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:48.689920 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:48.689920 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:48.689920 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:48.689920 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:48.689920 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:30:48.689920 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:30:48.689920 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:30:48.689920 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:30:48.690904 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:30:48.690904 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:30:48.690904 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:30:48.690904 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:30:48.690904 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:48.690904 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:48.690904 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:48.690904 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:48.690904 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:48.690904 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:48.690904 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:48.690904 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:48.690904 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:48.690904 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:48.690904 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:48.690904 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:48.697017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:48.697017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:48.697017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:48.697017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:48.697017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:30:48.697017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:30:48.697017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:30:48.697017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:30:48.697017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:30:48.697017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:30:48.697017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:30:48.697017 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:30:48.697017 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 621/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:30:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:48.697717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ef6d2-7972-420d-b9d3-2571fd65dedd None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:48.823518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ef6d2-7972-420d-b9d3-2571fd65dedd None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:48.863327 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:48.869157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b537d41-b218-4053-8599-7cdd64529798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:48.869821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b537d41-b218-4053-8599-7cdd64529798 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:48.870211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b537d41-b218-4053-8599-7cdd64529798 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:48.870498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b537d41-b218-4053-8599-7cdd64529798 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:48.871234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b537d41-b218-4053-8599-7cdd64529798 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:48.871550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b537d41-b218-4053-8599-7cdd64529798 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:48.873054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b537d41-b218-4053-8599-7cdd64529798 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:48.882805 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 629/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:30:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:48.888992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa09b76-3f5d-4250-9367-22b58f8e9fec None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:48.982350 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:49.009993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa09b76-3f5d-4250-9367-22b58f8e9fec None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:49.049661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9a286-6d23-4e55-8353-4d0b960e7af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:49.050554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9a286-6d23-4e55-8353-4d0b960e7af5 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:49.050961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9a286-6d23-4e55-8353-4d0b960e7af5 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:49.051238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9a286-6d23-4e55-8353-4d0b960e7af5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:49.062609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9a286-6d23-4e55-8353-4d0b960e7af5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:49.064073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9a286-6d23-4e55-8353-4d0b960e7af5 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:49.080941 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-28d9a286-6d23-4e55-8353-4d0b960e7af5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:49.080941 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:49.080941 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:49.080941 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:49.080941 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:49.080941 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:49.080941 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:49.080941 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:49.080941 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:49.080941 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:49.080941 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:49.080941 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:49.080941 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:30:49.080941 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:30:49.080941 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:30:49.080941 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:30:49.082175 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:49.082175 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:49.082175 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:49.082175 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:49.082175 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:49.082175 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:49.082175 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:49.082175 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:49.082175 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:49.082175 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:49.082175 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:49.082175 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:49.082175 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:49.082175 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:49.082175 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:49.082175 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:49.082175 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:30:49.083520 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:30:49.083520 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:49.083520 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:30:49.083520 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 622/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:49.088533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b537d41-b218-4053-8599-7cdd64529798 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:49.209154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b537d41-b218-4053-8599-7cdd64529798 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:49.252291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53082bb0-d222-4755-958a-9c93d1ee0432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:49.253033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53082bb0-d222-4755-958a-9c93d1ee0432 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:49.253943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53082bb0-d222-4755-958a-9c93d1ee0432 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:49.254370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53082bb0-d222-4755-958a-9c93d1ee0432 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:49.255076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53082bb0-d222-4755-958a-9c93d1ee0432 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:49.255382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53082bb0-d222-4755-958a-9c93d1ee0432 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:49.256903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53082bb0-d222-4755-958a-9c93d1ee0432 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:49.280645 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 630/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:49.283624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9a286-6d23-4e55-8353-4d0b960e7af5 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:49.398201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9a286-6d23-4e55-8353-4d0b960e7af5 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:49.429396 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:49.438575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2df5ec-e96d-4f79-a996-4fdca120cafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:49.439195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2df5ec-e96d-4f79-a996-4fdca120cafd None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:49.439536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2df5ec-e96d-4f79-a996-4fdca120cafd None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:49.439822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2df5ec-e96d-4f79-a996-4fdca120cafd None admin] PATH_INFO: `/v3/users/placement` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:49.448334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2df5ec-e96d-4f79-a996-4fdca120cafd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:49.449823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2df5ec-e96d-4f79-a996-4fdca120cafd None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:49.463366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-fb2df5ec-e96d-4f79-a996-4fdca120cafd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:30:49.463366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:49.463366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:49.463366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:49.463366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:49.463366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:49.463366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:49.463366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:49.463366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:49.463366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:49.463366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:49.463366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:49.463366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:30:49.463366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:30:49.463366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:30:49.463366 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:30:49.464564 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:49.464564 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:49.464564 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:30:49.464564 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:30:49.464564 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:30:49.464564 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:30:49.464564 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:49.464564 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:49.464564 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:49.464564 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:49.464564 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:49.464564 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:49.464564 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:49.464564 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:49.464564 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:49.464564 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:49.464564 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:49.464564 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:49.465689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:49.465689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:49.465689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:30:49.465689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:30:49.465689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:30:49.465689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:30:49.465689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:30:49.465689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:30:49.465689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:30:49.465689 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:30:49.465689 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 623/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:30:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:30:49.470717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53082bb0-d222-4755-958a-9c93d1ee0432 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:49.534483 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:49.595151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53082bb0-d222-4755-958a-9c93d1ee0432 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:49.637993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f073d-5e35-44fa-ade8-321fd8ac2344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:49.638670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f073d-5e35-44fa-ade8-321fd8ac2344 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:49.639030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f073d-5e35-44fa-ade8-321fd8ac2344 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:49.639293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f073d-5e35-44fa-ade8-321fd8ac2344 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:49.640012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f073d-5e35-44fa-ade8-321fd8ac2344 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:49.640368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f073d-5e35-44fa-ade8-321fd8ac2344 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:49.642006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f073d-5e35-44fa-ade8-321fd8ac2344 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:49.672166 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 631/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Sep 30 09:30:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:49.679419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2df5ec-e96d-4f79-a996-4fdca120cafd None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:49.791056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2df5ec-e96d-4f79-a996-4fdca120cafd None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:49.828103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc8e72-29f6-4f39-87d4-200dbb09a8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:49.828758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc8e72-29f6-4f39-87d4-200dbb09a8f9 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:49.829042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc8e72-29f6-4f39-87d4-200dbb09a8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:49.829322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc8e72-29f6-4f39-87d4-200dbb09a8f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:49.889358 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:49.902827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc8e72-29f6-4f39-87d4-200dbb09a8f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:49.904395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc8e72-29f6-4f39-87d4-200dbb09a8f9 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:50.016651 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 624/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:30:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:30:50.021188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f073d-5e35-44fa-ade8-321fd8ac2344 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:50.132165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f073d-5e35-44fa-ade8-321fd8ac2344 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:50.146798 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:50.169562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a83e57-49aa-41bf-8592-9464652fa582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:50.170178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a83e57-49aa-41bf-8592-9464652fa582 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:50.170449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a83e57-49aa-41bf-8592-9464652fa582 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:50.170713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a83e57-49aa-41bf-8592-9464652fa582 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:50.181911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a83e57-49aa-41bf-8592-9464652fa582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:50.183295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a83e57-49aa-41bf-8592-9464652fa582 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:50.199038 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-a9a83e57-49aa-41bf-8592-9464652fa582 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:50.199038 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:50.199038 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:50.199038 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:50.199038 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:50.199038 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:50.199038 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:50.199038 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:50.199038 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:50.199038 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:50.199038 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:50.199038 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:50.199038 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:30:50.199038 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:30:50.199038 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:30:50.199038 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:30:50.200225 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:50.200225 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:50.200225 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:50.200225 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:50.200225 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:50.200225 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:50.200225 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:50.200225 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:50.200225 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:50.200225 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:50.200225 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:50.200225 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:50.200225 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:50.200225 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:50.200225 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:50.200225 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:50.200225 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:30:50.201430 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:30:50.201430 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:50.201430 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:30:50.201430 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 632/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:30:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:50.206925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc8e72-29f6-4f39-87d4-200dbb09a8f9 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:50.296228 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:50.309498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc8e72-29f6-4f39-87d4-200dbb09a8f9 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:50.343194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffda300-c735-4b95-942d-ac2d208d8760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:50.343788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffda300-c735-4b95-942d-ac2d208d8760 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:50.344062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffda300-c735-4b95-942d-ac2d208d8760 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:50.344328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffda300-c735-4b95-942d-ac2d208d8760 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:50.344990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffda300-c735-4b95-942d-ac2d208d8760 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:50.345292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffda300-c735-4b95-942d-ac2d208d8760 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:50.346620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffda300-c735-4b95-942d-ac2d208d8760 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:50.357827 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 625/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:50.363982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a83e57-49aa-41bf-8592-9464652fa582 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:50.461415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a83e57-49aa-41bf-8592-9464652fa582 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:50.503985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8e386-e088-49fe-bab6-601e41d3e8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:50.504917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8e386-e088-49fe-bab6-601e41d3e8d7 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:50.505344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8e386-e088-49fe-bab6-601e41d3e8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:50.505756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8e386-e088-49fe-bab6-601e41d3e8d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:50.515271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8e386-e088-49fe-bab6-601e41d3e8d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:50.517561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8e386-e088-49fe-bab6-601e41d3e8d7 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:50.533234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-c6d8e386-e088-49fe-bab6-601e41d3e8d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:30:50.533234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:50.533234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:50.533234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:50.533234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:50.533234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:50.533234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:50.533234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:50.533234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:50.533234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:50.533234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:50.533234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:50.533234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:30:50.533234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:30:50.533234 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:30:50.534399 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:30:50.534399 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:50.534399 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:50.534399 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:50.534399 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:50.534399 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:50.534399 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:50.534399 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:50.534399 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:50.534399 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:50.534399 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:50.534399 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:50.534399 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:50.534399 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:50.534399 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:50.534399 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:50.534399 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:50.535703 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:30:50.535703 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:30:50.535703 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:30:50.535703 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:30:50.535703 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:30:50.535703 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:30:50.535703 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:30:50.535703 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:30:50.535703 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 633/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:30:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:50.540812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffda300-c735-4b95-942d-ac2d208d8760 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:50.644120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffda300-c735-4b95-942d-ac2d208d8760 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:50.676769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334e70a-014f-4942-9707-8491abcdc034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:50.677355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334e70a-014f-4942-9707-8491abcdc034 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:50.677633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334e70a-014f-4942-9707-8491abcdc034 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:50.677902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334e70a-014f-4942-9707-8491abcdc034 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:50.678581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334e70a-014f-4942-9707-8491abcdc034 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:50.678883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334e70a-014f-4942-9707-8491abcdc034 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:50.680288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334e70a-014f-4942-9707-8491abcdc034 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:50.692347 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 626/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:30:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:50.698434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8e386-e088-49fe-bab6-601e41d3e8d7 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:50.724284 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:50.795937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8e386-e088-49fe-bab6-601e41d3e8d7 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:50.832522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef874f0-066a-4984-b91a-d8be57f07335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:50.833146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef874f0-066a-4984-b91a-d8be57f07335 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:50.833430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef874f0-066a-4984-b91a-d8be57f07335 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:50.833700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef874f0-066a-4984-b91a-d8be57f07335 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:50.834417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef874f0-066a-4984-b91a-d8be57f07335 None admin] RBAC: Adding query filter params (role.id=f06b5fed717d4b03a5083dd847274296, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=cbb22d0675bc4ca893b0477cebd470c6) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:50.834725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef874f0-066a-4984-b91a-d8be57f07335 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:50.836136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef874f0-066a-4984-b91a-d8be57f07335 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:50.841357 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 634/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:30:50 2022] GET /identity/v3/role_assignments?user.id=cbb22d0675bc4ca893b0477cebd470c6&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=f06b5fed717d4b03a5083dd847274296 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:53.040880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7c70d-b3de-433a-9e90-b0f39886344b None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:53.041431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7c70d-b3de-433a-9e90-b0f39886344b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:53.041431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7c70d-b3de-433a-9e90-b0f39886344b None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:53.042751 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 627/1261] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:53.048284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29986177-8734-4185-9edb-f46494026b35 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:53.048704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29986177-8734-4185-9edb-f46494026b35 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:53.048862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29986177-8734-4185-9edb-f46494026b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:53.068553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-29986177-8734-4185-9edb-f46494026b35 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:53.069778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-29986177-8734-4185-9edb-f46494026b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:53.133920 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 635/1262] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:30:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:30:53.397871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7c70d-b3de-433a-9e90-b0f39886344b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:53.408569 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:53.497229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7c70d-b3de-433a-9e90-b0f39886344b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:53.529633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb20d52-c555-43e5-8bee-217134b3daa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:53.530242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb20d52-c555-43e5-8bee-217134b3daa7 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:53.530517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb20d52-c555-43e5-8bee-217134b3daa7 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:53.530786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb20d52-c555-43e5-8bee-217134b3daa7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:53.540942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb20d52-c555-43e5-8bee-217134b3daa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:30:53.545626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-bcb20d52-c555-43e5-8bee-217134b3daa7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:30:53.545626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:53.545626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:53.545626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:53.545626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:53.545626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:53.545626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:53.545626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:53.545626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:53.545626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:53.545626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:53.545626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:53.545626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:30:53.545626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:30:53.545626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:30:53.545626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:30:53.546692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:30:53.546692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:30:53.546692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:30:53.546692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:30:53.546692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:53.546692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:53.546692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:53.546692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:53.546692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:53.546692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:53.546692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:53.546692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:53.546692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:53.546692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:53.546692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:53.546692 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:53.547882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:53.547882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:53.547882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:53.547882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:53.547882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:30:53.547882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:30:53.547882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:30:53.547882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:30:53.547882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:30:53.547882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:30:53.547882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:30:53.547882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:30:53.547882 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 628/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:30:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:53.553440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29986177-8734-4185-9edb-f46494026b35 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:53.573166 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:53.661591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29986177-8734-4185-9edb-f46494026b35 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:53.693915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6831b72-1f3a-421f-836a-e66d37c09631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:53.694497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6831b72-1f3a-421f-836a-e66d37c09631 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:53.694770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6831b72-1f3a-421f-836a-e66d37c09631 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:53.695035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6831b72-1f3a-421f-836a-e66d37c09631 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:53.695682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6831b72-1f3a-421f-836a-e66d37c09631 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:53.695978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6831b72-1f3a-421f-836a-e66d37c09631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:53.697343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6831b72-1f3a-421f-836a-e66d37c09631 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:53.704965 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 636/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:30:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:53.711025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb20d52-c555-43e5-8bee-217134b3daa7 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:53.776043 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:53.809069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb20d52-c555-43e5-8bee-217134b3daa7 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:53.841039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48244620-b065-41b8-83d7-5abcbc5c9df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:53.841641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48244620-b065-41b8-83d7-5abcbc5c9df2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:53.841914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48244620-b065-41b8-83d7-5abcbc5c9df2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:53.842181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48244620-b065-41b8-83d7-5abcbc5c9df2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:53.852200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48244620-b065-41b8-83d7-5abcbc5c9df2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:53.853655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48244620-b065-41b8-83d7-5abcbc5c9df2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:53.867808 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-48244620-b065-41b8-83d7-5abcbc5c9df2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:53.867808 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:53.867808 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:53.867808 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:53.867808 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:53.867808 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:53.867808 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:53.867808 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:53.867808 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:53.867808 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:53.867808 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:53.867808 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:53.867808 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:30:53.867808 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:30:53.867808 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:30:53.867808 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:30:53.868965 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:53.868965 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:53.868965 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:53.868965 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:53.868965 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:53.868965 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:53.868965 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:53.868965 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:53.868965 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:53.868965 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:53.868965 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:53.868965 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:53.868965 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:53.868965 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:53.868965 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:53.868965 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:53.868965 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:30:53.870250 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:30:53.870250 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:53.870250 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:30:53.870250 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 629/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:30:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:53.874575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6831b72-1f3a-421f-836a-e66d37c09631 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:53.954520 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:53.973552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6831b72-1f3a-421f-836a-e66d37c09631 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:54.005917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62765281-4a22-4919-b470-e9f54cd7a9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:54.006500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62765281-4a22-4919-b470-e9f54cd7a9de None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:54.006775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62765281-4a22-4919-b470-e9f54cd7a9de None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:54.007042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62765281-4a22-4919-b470-e9f54cd7a9de None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:54.007664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62765281-4a22-4919-b470-e9f54cd7a9de None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:54.007957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62765281-4a22-4919-b470-e9f54cd7a9de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:54.009313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62765281-4a22-4919-b470-e9f54cd7a9de None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:54.020447 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 637/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:54.026035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48244620-b065-41b8-83d7-5abcbc5c9df2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:54.120572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48244620-b065-41b8-83d7-5abcbc5c9df2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:54.139504 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:54.155898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6496e-365a-47a9-a04f-6e8bcece3dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:54.156679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6496e-365a-47a9-a04f-6e8bcece3dea None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:54.156960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6496e-365a-47a9-a04f-6e8bcece3dea None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:54.157228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6496e-365a-47a9-a04f-6e8bcece3dea None admin] PATH_INFO: `/v3/users/placement` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:54.166795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6496e-365a-47a9-a04f-6e8bcece3dea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:54.168366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6496e-365a-47a9-a04f-6e8bcece3dea None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:54.181068 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-2af6496e-365a-47a9-a04f-6e8bcece3dea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:30:54.181068 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:54.181068 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:54.181068 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:54.181068 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:54.181068 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:54.181068 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:54.181068 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:54.181068 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:54.181068 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:54.181068 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:54.181068 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:54.181068 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:30:54.181068 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:30:54.181068 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:30:54.181068 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:30:54.182201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:54.182201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:54.182201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:30:54.182201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:30:54.182201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:30:54.182201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:30:54.182201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:54.182201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:54.182201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:54.182201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:54.182201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:54.182201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:54.182201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:54.182201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:54.182201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:54.182201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:54.182201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:54.182201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:54.183569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:54.183569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:54.183569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:30:54.183569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:30:54.183569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:30:54.183569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:30:54.183569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:30:54.183569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:30:54.183569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:30:54.183569 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:30:54.183569 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 630/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:30:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:54.187928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62765281-4a22-4919-b470-e9f54cd7a9de None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:54.288794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62765281-4a22-4919-b470-e9f54cd7a9de None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:54.322420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fb67a-4254-4d42-b75e-70b5032e9c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:54.323008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fb67a-4254-4d42-b75e-70b5032e9c9a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:54.323286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fb67a-4254-4d42-b75e-70b5032e9c9a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:54.323554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fb67a-4254-4d42-b75e-70b5032e9c9a None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:54.324271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6fb67a-4254-4d42-b75e-70b5032e9c9a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:54.324574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6fb67a-4254-4d42-b75e-70b5032e9c9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:54.326006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6fb67a-4254-4d42-b75e-70b5032e9c9a None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:54.335074 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:54.343444 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 638/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Sep 30 09:30:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:30:54.350036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6496e-365a-47a9-a04f-6e8bcece3dea None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:54.446549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6496e-365a-47a9-a04f-6e8bcece3dea None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:54.479634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082101b4-8f0c-4d5b-b804-885e6361dec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:54.480236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082101b4-8f0c-4d5b-b804-885e6361dec2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:54.480512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082101b4-8f0c-4d5b-b804-885e6361dec2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:54.480808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082101b4-8f0c-4d5b-b804-885e6361dec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:54.491483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082101b4-8f0c-4d5b-b804-885e6361dec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:54.492948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082101b4-8f0c-4d5b-b804-885e6361dec2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:54.507475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-082101b4-8f0c-4d5b-b804-885e6361dec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:54.507475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:54.507475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:54.507475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:54.507475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:54.507475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:54.507475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:54.507475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:54.507475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:54.507475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:54.507475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:54.507475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:54.507475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:30:54.507475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:30:54.507475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:30:54.507475 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:30:54.508669 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:54.508669 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:54.508669 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:54.508669 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:54.508669 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:54.508669 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:54.508669 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:54.508669 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:54.508669 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:54.508669 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:54.508669 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:54.508669 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:54.508669 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:54.508669 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:54.508669 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:54.508669 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:54.508669 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:30:54.509778 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:30:54.509778 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:54.509778 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:30:54.509778 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 631/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:30:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:54.516739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fb67a-4254-4d42-b75e-70b5032e9c9a None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:54.626742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fb67a-4254-4d42-b75e-70b5032e9c9a None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:54.659029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38f744-d566-44c5-aa7e-1db77a77ad92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:54.659889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38f744-d566-44c5-aa7e-1db77a77ad92 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:54.660011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38f744-d566-44c5-aa7e-1db77a77ad92 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:54.660241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38f744-d566-44c5-aa7e-1db77a77ad92 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:54.660897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38f744-d566-44c5-aa7e-1db77a77ad92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:54.661196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38f744-d566-44c5-aa7e-1db77a77ad92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:54.662527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38f744-d566-44c5-aa7e-1db77a77ad92 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:54.673149 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 639/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:54.679350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082101b4-8f0c-4d5b-b804-885e6361dec2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:54.710423 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:54.778561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082101b4-8f0c-4d5b-b804-885e6361dec2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:54.810493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b8616-aac2-4ef7-87d0-11b68e21e564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:54.811092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b8616-aac2-4ef7-87d0-11b68e21e564 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:54.811364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b8616-aac2-4ef7-87d0-11b68e21e564 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:54.811632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b8616-aac2-4ef7-87d0-11b68e21e564 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:54.818591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b8616-aac2-4ef7-87d0-11b68e21e564 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:54.819982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b8616-aac2-4ef7-87d0-11b68e21e564 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:54.830944 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-0c9b8616-aac2-4ef7-87d0-11b68e21e564 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:30:54.830944 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:54.830944 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:54.830944 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:54.830944 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:54.830944 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:54.830944 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:54.830944 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:54.830944 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:54.830944 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:54.830944 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:54.830944 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:54.830944 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:30:54.830944 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:30:54.830944 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:30:54.832268 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:30:54.832268 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:54.832268 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:54.832268 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:54.832268 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:54.832268 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:54.832268 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:54.832268 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:54.832268 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:54.832268 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:54.832268 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:54.832268 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:54.832268 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:54.832268 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:54.832268 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:54.832268 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:54.832268 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:54.833182 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:30:54.833182 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:30:54.833182 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:30:54.833182 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:30:54.833182 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:30:54.833182 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:30:54.833182 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:30:54.833182 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:30:54.833182 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 632/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:30:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:54.837817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38f744-d566-44c5-aa7e-1db77a77ad92 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:54.899675 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:54.941663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38f744-d566-44c5-aa7e-1db77a77ad92 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:54.974120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a417127-63a7-4d14-85f6-024a8e15c7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:54.974646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a417127-63a7-4d14-85f6-024a8e15c7ce None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:54.974919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a417127-63a7-4d14-85f6-024a8e15c7ce None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:54.975184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a417127-63a7-4d14-85f6-024a8e15c7ce None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:54.975879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a417127-63a7-4d14-85f6-024a8e15c7ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:54.976175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a417127-63a7-4d14-85f6-024a8e15c7ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:54.977593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a417127-63a7-4d14-85f6-024a8e15c7ce None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:54.989490 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 640/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:30:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:54.995636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b8616-aac2-4ef7-87d0-11b68e21e564 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:55.084113 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:55.092456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b8616-aac2-4ef7-87d0-11b68e21e564 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:55.124878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a66ae9-6be1-4691-836e-d92a2642d75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:55.125510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a66ae9-6be1-4691-836e-d92a2642d75b None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:55.125782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a66ae9-6be1-4691-836e-d92a2642d75b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:55.126048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a66ae9-6be1-4691-836e-d92a2642d75b None admin] PATH_INFO: `/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/cbb22d0675bc4ca893b0477cebd470c6/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:55.127893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a66ae9-6be1-4691-836e-d92a2642d75b None admin] RBAC: Authorizing `identity:create_grant(project_id=1fbc72b5e3b84c8fb74d8d4952a26e76, user_id=cbb22d0675bc4ca893b0477cebd470c6, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:55.129416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a66ae9-6be1-4691-836e-d92a2642d75b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:55.141150 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 633/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Sep 30 09:30:54 2022] PUT /identity/v3/projects/1fbc72b5e3b84c8fb74d8d4952a26e76/users/cbb22d0675bc4ca893b0477cebd470c6/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:30:57.283143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2c171-21de-4e8d-8b04-8869c57e52e6 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:57.283674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2c171-21de-4e8d-8b04-8869c57e52e6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:57.283674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2c171-21de-4e8d-8b04-8869c57e52e6 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:57.285537 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 641/1274] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:30:57.290744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d26a1c-a7be-4a32-97ba-4944c83eec06 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:57.291131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d26a1c-a7be-4a32-97ba-4944c83eec06 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:57.291278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d26a1c-a7be-4a32-97ba-4944c83eec06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:57.309657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-09d26a1c-a7be-4a32-97ba-4944c83eec06 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:30:57.310813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-09d26a1c-a7be-4a32-97ba-4944c83eec06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:30:57.374574 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 634/1275] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:30:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:30:57.645202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2c171-21de-4e8d-8b04-8869c57e52e6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:57.752433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2c171-21de-4e8d-8b04-8869c57e52e6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:57.768481 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:57.786795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ab55-eab1-4453-9b33-e763e591e5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:57.787401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ab55-eab1-4453-9b33-e763e591e5ed None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:57.787672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ab55-eab1-4453-9b33-e763e591e5ed None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:57.787935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ab55-eab1-4453-9b33-e763e591e5ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:57.797485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99ab55-eab1-4453-9b33-e763e591e5ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 09:30:57.802193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-ef99ab55-eab1-4453-9b33-e763e591e5ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:30:57.802193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:57.802193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:57.802193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:57.802193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:57.802193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:57.802193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:57.802193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:57.802193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:57.802193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:57.802193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:57.802193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:57.802193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 09:30:57.802193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 09:30:57.802193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 09:30:57.802193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 09:30:57.803323 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 09:30:57.803323 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 09:30:57.803323 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 09:30:57.803323 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 09:30:57.803323 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:57.803323 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:57.803323 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:57.803323 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:57.803323 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:57.803323 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:57.803323 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:57.803323 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:57.803323 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:57.803323 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:57.803323 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:57.803323 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:57.804438 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:57.804438 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:57.804438 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:57.804438 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:57.804438 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 09:30:57.804438 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 09:30:57.804438 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 09:30:57.804438 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 09:30:57.804438 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 09:30:57.804438 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:30:57.804438 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 09:30:57.804438 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:30:57.804438 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 642/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Sep 30 09:30:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 09:30:57.809235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d26a1c-a7be-4a32-97ba-4944c83eec06 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:57.885651 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:57.904757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d26a1c-a7be-4a32-97ba-4944c83eec06 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:57.937676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6a19d-178a-424b-81f9-33966383e247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:57.938268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6a19d-178a-424b-81f9-33966383e247 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:57.938539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6a19d-178a-424b-81f9-33966383e247 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:57.938801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6a19d-178a-424b-81f9-33966383e247 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:57.939447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6a19d-178a-424b-81f9-33966383e247 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:57.939741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6a19d-178a-424b-81f9-33966383e247 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:57.941862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6a19d-178a-424b-81f9-33966383e247 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:57.949514 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 635/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Sep 30 09:30:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:57.955577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ab55-eab1-4453-9b33-e763e591e5ed None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:58.051107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ab55-eab1-4453-9b33-e763e591e5ed None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:58.083466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aca15c-c2d3-4cd0-9a2a-db91ed29059f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:58.084093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aca15c-c2d3-4cd0-9a2a-db91ed29059f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:58.084372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aca15c-c2d3-4cd0-9a2a-db91ed29059f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:58.084667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aca15c-c2d3-4cd0-9a2a-db91ed29059f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:58.094310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aca15c-c2d3-4cd0-9a2a-db91ed29059f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:58.095720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aca15c-c2d3-4cd0-9a2a-db91ed29059f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:58.110114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-65aca15c-c2d3-4cd0-9a2a-db91ed29059f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:58.110114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:58.110114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:58.110114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:58.110114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:58.110114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:58.110114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:58.110114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:58.110114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:58.110114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:58.110114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:58.110114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:58.110114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:30:58.110114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:30:58.110114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:30:58.110114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:30:58.111301 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:58.111301 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:58.111301 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:58.111301 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:58.111301 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:58.111301 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:58.111301 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:58.111301 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:58.111301 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:58.111301 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:58.111301 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:58.111301 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:58.111301 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:58.111301 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:58.111301 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:58.111301 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:58.111301 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:30:58.112433 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:30:58.112433 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:58.112433 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:30:58.112433 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 643/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:58.117489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6a19d-178a-424b-81f9-33966383e247 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:58.216227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6a19d-178a-424b-81f9-33966383e247 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:58.248794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b40e1a-b247-46e6-9396-8cb1fc3e6275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:58.249384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b40e1a-b247-46e6-9396-8cb1fc3e6275 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:58.249662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b40e1a-b247-46e6-9396-8cb1fc3e6275 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:58.249934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b40e1a-b247-46e6-9396-8cb1fc3e6275 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:58.250562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b40e1a-b247-46e6-9396-8cb1fc3e6275 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:58.250863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b40e1a-b247-46e6-9396-8cb1fc3e6275 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:58.252194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b40e1a-b247-46e6-9396-8cb1fc3e6275 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:58.263563 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 636/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:58.269177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aca15c-c2d3-4cd0-9a2a-db91ed29059f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:58.298928 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:58.368974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aca15c-c2d3-4cd0-9a2a-db91ed29059f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:58.402338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3fe37-940c-4cbd-a680-9e8e3d8852c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:58.402949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3fe37-940c-4cbd-a680-9e8e3d8852c4 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:58.403229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3fe37-940c-4cbd-a680-9e8e3d8852c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:58.403499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3fe37-940c-4cbd-a680-9e8e3d8852c4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:58.411638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3fe37-940c-4cbd-a680-9e8e3d8852c4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:58.413095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3fe37-940c-4cbd-a680-9e8e3d8852c4 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:58.423861 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-3ba3fe37-940c-4cbd-a680-9e8e3d8852c4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:30:58.423861 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:58.423861 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:58.423861 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:58.423861 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:58.423861 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:58.423861 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:58.423861 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:58.423861 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:58.423861 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:58.423861 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:58.423861 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:58.423861 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 09:30:58.423861 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 09:30:58.423861 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 09:30:58.423861 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 09:30:58.425065 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:58.425065 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:58.425065 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:30:58.425065 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:30:58.425065 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 09:30:58.425065 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:30:58.425065 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:58.425065 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:58.425065 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:58.425065 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:58.425065 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:58.425065 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:58.425065 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:58.425065 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:58.425065 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:58.425065 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:58.425065 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:58.425065 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:58.426429 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:58.426429 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:58.426429 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 09:30:58.426429 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 09:30:58.426429 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 09:30:58.426429 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 09:30:58.426429 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 09:30:58.426429 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 09:30:58.426429 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 09:30:58.426429 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:30:58.427202 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 644/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:30:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:58.431083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b40e1a-b247-46e6-9396-8cb1fc3e6275 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:58.434773 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:58.530419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b40e1a-b247-46e6-9396-8cb1fc3e6275 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:58.565905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc171d15-1297-4291-a7a6-3c78077c7ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:58.566543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc171d15-1297-4291-a7a6-3c78077c7ec0 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:58.566792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc171d15-1297-4291-a7a6-3c78077c7ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:58.567120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc171d15-1297-4291-a7a6-3c78077c7ec0 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:58.567841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc171d15-1297-4291-a7a6-3c78077c7ec0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:58.568159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc171d15-1297-4291-a7a6-3c78077c7ec0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:58.569595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc171d15-1297-4291-a7a6-3c78077c7ec0 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:58.586941 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 637/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Sep 30 09:30:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:58.592806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3fe37-940c-4cbd-a680-9e8e3d8852c4 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:58.685367 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:58.696425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3fe37-940c-4cbd-a680-9e8e3d8852c4 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:58.731824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a34d10-f092-4535-b9c3-5cb96082b388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:58.732417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a34d10-f092-4535-b9c3-5cb96082b388 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:58.732737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a34d10-f092-4535-b9c3-5cb96082b388 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:58.733010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a34d10-f092-4535-b9c3-5cb96082b388 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:58.799533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a34d10-f092-4535-b9c3-5cb96082b388 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:58.801402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a34d10-f092-4535-b9c3-5cb96082b388 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:58.888400 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:58.899632 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 645/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Sep 30 09:30:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 09:30:58.905380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc171d15-1297-4291-a7a6-3c78077c7ec0 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:58.967782 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:59.007069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc171d15-1297-4291-a7a6-3c78077c7ec0 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:59.040643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca653a-0546-42b9-8de7-a000f1ffde7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:59.041252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca653a-0546-42b9-8de7-a000f1ffde7c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:59.041534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca653a-0546-42b9-8de7-a000f1ffde7c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:59.041802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca653a-0546-42b9-8de7-a000f1ffde7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:59.052404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca653a-0546-42b9-8de7-a000f1ffde7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:59.053799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca653a-0546-42b9-8de7-a000f1ffde7c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:59.068843 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-4cca653a-0546-42b9-8de7-a000f1ffde7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:59.068843 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:59.068843 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:59.068843 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:59.068843 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:59.068843 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:59.068843 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:59.068843 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:59.068843 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:59.068843 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:59.068843 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:59.068843 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:59.068843 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 09:30:59.068843 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 09:30:59.068843 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 09:30:59.068843 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 09:30:59.069974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:59.069974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:59.069974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:59.069974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:59.069974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:59.069974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:59.069974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:59.069974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:59.069974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:59.069974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:59.069974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:59.069974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:59.069974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:59.069974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:59.069974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:59.069974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:59.069974 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 09:30:59.071300 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 09:30:59.071300 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 09:30:59.071300 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:30:59.071300 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 638/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:59.075660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a34d10-f092-4535-b9c3-5cb96082b388 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:59.170844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a34d10-f092-4535-b9c3-5cb96082b388 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:59.203978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14981abd-fd10-4462-a7b9-05b2ed70d33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:59.204559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14981abd-fd10-4462-a7b9-05b2ed70d33b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:59.204864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14981abd-fd10-4462-a7b9-05b2ed70d33b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:59.205393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14981abd-fd10-4462-a7b9-05b2ed70d33b None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:59.206071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14981abd-fd10-4462-a7b9-05b2ed70d33b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:59.206369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14981abd-fd10-4462-a7b9-05b2ed70d33b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:59.207703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14981abd-fd10-4462-a7b9-05b2ed70d33b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:59.218466 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 646/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Sep 30 09:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:59.224096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca653a-0546-42b9-8de7-a000f1ffde7c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:59.319897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca653a-0546-42b9-8de7-a000f1ffde7c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:59.333116 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:59.352351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386548f9-51b6-4cbc-99d9-d910f7784284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:59.352975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386548f9-51b6-4cbc-99d9-d910f7784284 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:59.353248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386548f9-51b6-4cbc-99d9-d910f7784284 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:59.353515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386548f9-51b6-4cbc-99d9-d910f7784284 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:59.359779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386548f9-51b6-4cbc-99d9-d910f7784284 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:59.361205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386548f9-51b6-4cbc-99d9-d910f7784284 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:59.372495 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-386548f9-51b6-4cbc-99d9-d910f7784284 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:30:59.372495 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:30:59.372495 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:30:59.372495 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:30:59.372495 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:30:59.372495 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:30:59.372495 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:30:59.372495 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:30:59.372495 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:30:59.372495 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:30:59.372495 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:30:59.372495 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:30:59.372495 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 09:30:59.372495 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 09:30:59.372495 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 09:30:59.373603 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 09:30:59.373603 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:30:59.373603 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:30:59.373603 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:30:59.373603 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:30:59.373603 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:30:59.373603 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:30:59.373603 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:30:59.373603 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 09:30:59.373603 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:30:59.373603 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:30:59.373603 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:30:59.373603 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:30:59.373603 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:30:59.373603 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:30:59.373603 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:30:59.373603 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:30:59.374907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 09:30:59.374907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 09:30:59.374907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 09:30:59.374907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 09:30:59.374907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 09:30:59.374907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 09:30:59.374907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 09:30:59.374907 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:30:59.374907 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 639/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Sep 30 09:30:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:30:59.379405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14981abd-fd10-4462-a7b9-05b2ed70d33b None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:59.427656 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:30:59.477235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14981abd-fd10-4462-a7b9-05b2ed70d33b None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:59.509600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cd5c3-eef9-40a7-888e-ed0bbc112fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:59.510183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cd5c3-eef9-40a7-888e-ed0bbc112fd6 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:59.510456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cd5c3-eef9-40a7-888e-ed0bbc112fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:59.510723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cd5c3-eef9-40a7-888e-ed0bbc112fd6 None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:59.511394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cd5c3-eef9-40a7-888e-ed0bbc112fd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:59.511693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cd5c3-eef9-40a7-888e-ed0bbc112fd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:59.513127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cd5c3-eef9-40a7-888e-ed0bbc112fd6 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:59.525079 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 647/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Sep 30 09:30:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:30:59.531195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386548f9-51b6-4cbc-99d9-d910f7784284 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:30:59.633609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386548f9-51b6-4cbc-99d9-d910f7784284 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:30:59.666895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c1a96-7359-45ed-b054-6f25157d58f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:30:59.667483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c1a96-7359-45ed-b054-6f25157d58f4 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:30:59.667762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c1a96-7359-45ed-b054-6f25157d58f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:30:59.668031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c1a96-7359-45ed-b054-6f25157d58f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:30:59.668774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c1a96-7359-45ed-b054-6f25157d58f4 None admin] RBAC: Adding query filter params (role.id=f06b5fed717d4b03a5083dd847274296, scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76, user.id=cbb22d0675bc4ca893b0477cebd470c6) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:30:59.669081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c1a96-7359-45ed-b054-6f25157d58f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:30:59.670484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c1a96-7359-45ed-b054-6f25157d58f4 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:30:59.677331 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 640/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Sep 30 09:30:59 2022] GET /identity/v3/role_assignments?user.id=cbb22d0675bc4ca893b0477cebd470c6&scope.project.id=1fbc72b5e3b84c8fb74d8d4952a26e76&role.id=f06b5fed717d4b03a5083dd847274296 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:31:01.814680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219195d4-adeb-409a-8270-3032a8448953 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:01.815260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219195d4-adeb-409a-8270-3032a8448953 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:01.815260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219195d4-adeb-409a-8270-3032a8448953 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:01.817033 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 648/1288] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:01.823049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17230b13-f44e-4112-9daf-a2cd8e8a3b54 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:01.823545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17230b13-f44e-4112-9daf-a2cd8e8a3b54 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:01.824012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17230b13-f44e-4112-9daf-a2cd8e8a3b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:01.842748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-17230b13-f44e-4112-9daf-a2cd8e8a3b54 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:01.843926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-17230b13-f44e-4112-9daf-a2cd8e8a3b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:01.873208 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:01.909818 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 641/1289] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:31:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:31:02.177616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219195d4-adeb-409a-8270-3032a8448953 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:02.280125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219195d4-adeb-409a-8270-3032a8448953 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:02.290237 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:02.312702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80629b86-8605-4e51-bdfa-031378859842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:02.313307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80629b86-8605-4e51-bdfa-031378859842 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:02.313580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80629b86-8605-4e51-bdfa-031378859842 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:02.313848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80629b86-8605-4e51-bdfa-031378859842 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:02.314406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80629b86-8605-4e51-bdfa-031378859842 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:02.316433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80629b86-8605-4e51-bdfa-031378859842 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:02.324742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-80629b86-8605-4e51-bdfa-031378859842 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:31:02.324742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:31:02.324742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:31:02.324742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:31:02.324742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:31:02.324742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:31:02.324742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:31:02.324742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:31:02.324742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:31:02.324742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:31:02.324742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:31:02.324742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:31:02.324742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:31:02.324742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:31:02.324742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:31:02.324742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:31:02.324742 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:31:02.325929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:31:02.325929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:31:02.325929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:31:02.325929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:31:02.325929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:31:02.325929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:31:02.325929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:31:02.325929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:31:02.325929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:31:02.325929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:31:02.325929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:31:02.325929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:31:02.325929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:31:02.325929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:31:02.325929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:31:02.325929 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:31:02.326966 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:31:02.326966 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:31:02.326966 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:31:02.326966 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:31:02.326966 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:31:02.326966 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:31:02.326966 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:31:02.326966 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:31:02.326966 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:31:02.326966 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:31:02.326966 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:31:02.326966 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:31:02.326966 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:31:02.326966 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:31:02.326966 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 649/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Sep 30 09:31:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:31:02.332420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17230b13-f44e-4112-9daf-a2cd8e8a3b54 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:02.429819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17230b13-f44e-4112-9daf-a2cd8e8a3b54 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:02.463804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c036d-acd6-46b5-a6ff-99230bd9e14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:02.464401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c036d-acd6-46b5-a6ff-99230bd9e14d None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:02.464704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c036d-acd6-46b5-a6ff-99230bd9e14d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:02.464979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c036d-acd6-46b5-a6ff-99230bd9e14d None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:02.465604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c036d-acd6-46b5-a6ff-99230bd9e14d None admin] RBAC: Adding query filter params (name=placement) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:31:02.465908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c036d-acd6-46b5-a6ff-99230bd9e14d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:02.467259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c036d-acd6-46b5-a6ff-99230bd9e14d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:02.472869 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 642/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Fri Sep 30 09:31:02 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:31:02.478570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80629b86-8605-4e51-bdfa-031378859842 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:02.584453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80629b86-8605-4e51-bdfa-031378859842 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:02.622874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5ff98-9bad-4d56-83fb-86c087c7415b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:02.623536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5ff98-9bad-4d56-83fb-86c087c7415b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:02.623907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5ff98-9bad-4d56-83fb-86c087c7415b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:02.624171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5ff98-9bad-4d56-83fb-86c087c7415b None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:02.624900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5ff98-9bad-4d56-83fb-86c087c7415b None admin] RBAC: Adding query filter params (type=placement) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:31:02.625272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5ff98-9bad-4d56-83fb-86c087c7415b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:02.626891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5ff98-9bad-4d56-83fb-86c087c7415b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:02.632145 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 650/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Fri Sep 30 09:31:02 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:31:04.835179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648cade-b2c0-466f-ae21-3a5bddca7fb3 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:04.835706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648cade-b2c0-466f-ae21-3a5bddca7fb3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:04.835706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648cade-b2c0-466f-ae21-3a5bddca7fb3 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:04.837092 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 643/1293] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:04.842212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf436b-f480-42a7-a227-ed4fc403f799 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:04.842651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf436b-f480-42a7-a227-ed4fc403f799 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:04.842743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf436b-f480-42a7-a227-ed4fc403f799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:04.860990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-dcbf436b-f480-42a7-a227-ed4fc403f799 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:04.862811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dcbf436b-f480-42a7-a227-ed4fc403f799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:04.891003 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:04.928641 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 651/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:31:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:31:05.190398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648cade-b2c0-466f-ae21-3a5bddca7fb3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:05.221322 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:05.290193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648cade-b2c0-466f-ae21-3a5bddca7fb3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:05.322065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e29d8-7f97-47a5-bd77-920f5d268351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:05.322646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e29d8-7f97-47a5-bd77-920f5d268351 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:05.322921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e29d8-7f97-47a5-bd77-920f5d268351 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:05.323188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e29d8-7f97-47a5-bd77-920f5d268351 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:05.323833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e29d8-7f97-47a5-bd77-920f5d268351 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:05.325195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e29d8-7f97-47a5-bd77-920f5d268351 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:05.340343 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 644/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Sep 30 09:31:05 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:31:07.584193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586bd8b-9e99-4432-9566-cce23441e4ea None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:07.584740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586bd8b-9e99-4432-9566-cce23441e4ea None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:07.584740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586bd8b-9e99-4432-9566-cce23441e4ea None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:07.586540 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 652/1296] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:31:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:07.592421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cfea1-8424-4274-905a-a57864dd0c81 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:07.592855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cfea1-8424-4274-905a-a57864dd0c81 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:07.593005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cfea1-8424-4274-905a-a57864dd0c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:07.612431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-775cfea1-8424-4274-905a-a57864dd0c81 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:07.613675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-775cfea1-8424-4274-905a-a57864dd0c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:07.685925 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 645/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:31:07 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:31:07.952343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586bd8b-9e99-4432-9566-cce23441e4ea None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:08.050631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586bd8b-9e99-4432-9566-cce23441e4ea None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:08.083036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07917879-9e98-454b-8217-e2e09c520b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:08.083640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07917879-9e98-454b-8217-e2e09c520b37 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:08.083913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07917879-9e98-454b-8217-e2e09c520b37 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:08.084179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07917879-9e98-454b-8217-e2e09c520b37 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:08.084774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07917879-9e98-454b-8217-e2e09c520b37 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:08.086104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07917879-9e98-454b-8217-e2e09c520b37 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:08.094386 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-07917879-9e98-454b-8217-e2e09c520b37 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:31:08.094386 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:31:08.094386 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:31:08.094386 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:31:08.094386 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:31:08.094386 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:31:08.094386 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:31:08.094386 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:31:08.094386 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:31:08.094386 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:31:08.094386 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:31:08.094386 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:31:08.094386 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:31:08.094386 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:31:08.094386 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:31:08.094386 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:31:08.094386 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:31:08.095545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:31:08.095545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:31:08.095545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:31:08.095545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:31:08.095545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:31:08.095545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:31:08.095545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:31:08.095545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:31:08.095545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:31:08.095545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:31:08.095545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:31:08.095545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:31:08.095545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:31:08.095545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:31:08.095545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:31:08.095545 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:31:08.097179 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:31:08.097179 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:31:08.097179 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:31:08.097179 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:31:08.097179 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:31:08.097179 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:31:08.097179 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:31:08.097179 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:31:08.097179 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:31:08.097179 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:31:08.097179 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:31:08.097179 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:31:08.097179 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:31:08.097179 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:31:08.097179 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 653/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Sep 30 09:31:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:31:08.102062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cfea1-8424-4274-905a-a57864dd0c81 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:08.119660 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:08.198394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cfea1-8424-4274-905a-a57864dd0c81 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:08.232065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be711e3b-1769-4372-a9b1-c1a0f645e811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:08.232676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be711e3b-1769-4372-a9b1-c1a0f645e811 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:08.232952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be711e3b-1769-4372-a9b1-c1a0f645e811 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:08.233218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be711e3b-1769-4372-a9b1-c1a0f645e811 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:08.233836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be711e3b-1769-4372-a9b1-c1a0f645e811 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:31:08.234132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be711e3b-1769-4372-a9b1-c1a0f645e811 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:08.235464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be711e3b-1769-4372-a9b1-c1a0f645e811 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:08.240690 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 646/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Fri Sep 30 09:31:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:31:08.246569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07917879-9e98-454b-8217-e2e09c520b37 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:08.277104 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:08.343636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07917879-9e98-454b-8217-e2e09c520b37 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:08.375464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97889e41-c9ce-4dee-8e21-04e920ec829d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:08.376040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97889e41-c9ce-4dee-8e21-04e920ec829d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:08.376315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97889e41-c9ce-4dee-8e21-04e920ec829d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:08.376581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97889e41-c9ce-4dee-8e21-04e920ec829d None admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:08.377289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97889e41-c9ce-4dee-8e21-04e920ec829d None admin] RBAC: Adding query filter params (interface=public, service_id=7a0c1a5da6634eb2bc708535f7f5a7e4, region_id=RegionOne) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:31:08.377611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97889e41-c9ce-4dee-8e21-04e920ec829d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:08.378942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97889e41-c9ce-4dee-8e21-04e920ec829d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:08.383745 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 654/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Sep 30 09:31:08 2022] GET /identity/v3/endpoints?service_id=7a0c1a5da6634eb2bc708535f7f5a7e4&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:31:08.389300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be711e3b-1769-4372-a9b1-c1a0f645e811 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:08.468055 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:08.485938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be711e3b-1769-4372-a9b1-c1a0f645e811 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:08.519085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec31dff-0fdd-471f-922a-3f7331a3624d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:08.519662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec31dff-0fdd-471f-922a-3f7331a3624d None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:08.519939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec31dff-0fdd-471f-922a-3f7331a3624d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:08.520215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec31dff-0fdd-471f-922a-3f7331a3624d None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:08.520839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec31dff-0fdd-471f-922a-3f7331a3624d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:08.522167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec31dff-0fdd-471f-922a-3f7331a3624d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:08.528659 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 647/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Sep 30 09:31:08 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:31:10.683664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537f4ee-e724-4b61-a6f5-8199099ad89e None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:10.684205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537f4ee-e724-4b61-a6f5-8199099ad89e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:10.684684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537f4ee-e724-4b61-a6f5-8199099ad89e None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:10.686148 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 655/1302] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:31:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:31:10.692483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72004f-11ff-40a7-828d-b7fe4a84c547 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:10.692937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72004f-11ff-40a7-828d-b7fe4a84c547 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:10.693048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72004f-11ff-40a7-828d-b7fe4a84c547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:10.718117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7e72004f-11ff-40a7-828d-b7fe4a84c547 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:31:10.719286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7e72004f-11ff-40a7-828d-b7fe4a84c547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:31:10.785396 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 648/1303] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:31:10 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 09:31:11.059273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537f4ee-e724-4b61-a6f5-8199099ad89e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:11.151416 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:11.158288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537f4ee-e724-4b61-a6f5-8199099ad89e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:11.191289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd399ea1-5398-4aef-80ff-34ea200291e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:11.191888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd399ea1-5398-4aef-80ff-34ea200291e6 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:11.192162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd399ea1-5398-4aef-80ff-34ea200291e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:11.192428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd399ea1-5398-4aef-80ff-34ea200291e6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:11.193025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd399ea1-5398-4aef-80ff-34ea200291e6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:11.194366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd399ea1-5398-4aef-80ff-34ea200291e6 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:11.202744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-bd399ea1-5398-4aef-80ff-34ea200291e6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:31:11.202744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:31:11.202744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 09:31:11.202744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 09:31:11.202744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 09:31:11.202744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 09:31:11.202744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 09:31:11.202744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:31:11.202744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:31:11.202744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:31:11.202744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:31:11.202744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:31:11.202744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:31:11.202744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:31:11.202744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:31:11.202744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:31:11.202744 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:31:11.203884 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:31:11.203884 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:31:11.203884 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:31:11.203884 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:31:11.203884 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:31:11.203884 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:31:11.203884 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 09:31:11.203884 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 09:31:11.203884 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 09:31:11.203884 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 09:31:11.203884 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:31:11.203884 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:31:11.203884 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:31:11.203884 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:31:11.203884 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:31:11.203884 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:31:11.205067 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:31:11.205067 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:31:11.205067 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:31:11.205067 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:31:11.205067 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:31:11.205067 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:31:11.205067 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:31:11.205067 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:31:11.205067 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:31:11.205067 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:31:11.205067 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 09:31:11.205067 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 09:31:11.205067 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 09:31:11.205067 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:31:11.205067 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 656/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Sep 30 09:31:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:31:11.210177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72004f-11ff-40a7-828d-b7fe4a84c547 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:11.282624 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:11.305489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72004f-11ff-40a7-828d-b7fe4a84c547 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:11.338930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd89c4-1b15-468d-b4ec-63a3e7a4d06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:11.339464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd89c4-1b15-468d-b4ec-63a3e7a4d06e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:11.339741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd89c4-1b15-468d-b4ec-63a3e7a4d06e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:11.340009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd89c4-1b15-468d-b4ec-63a3e7a4d06e None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:11.340651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd89c4-1b15-468d-b4ec-63a3e7a4d06e None admin] RBAC: Adding query filter params (name=placement) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:31:11.340951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd89c4-1b15-468d-b4ec-63a3e7a4d06e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:11.342283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd89c4-1b15-468d-b4ec-63a3e7a4d06e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:11.349626 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 649/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Fri Sep 30 09:31:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:31:11.355489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd399ea1-5398-4aef-80ff-34ea200291e6 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:31:11.452810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd399ea1-5398-4aef-80ff-34ea200291e6 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:31:11.485244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd175982-c6f5-47cd-9f5d-d16ff6f2a13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:31:11.485829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd175982-c6f5-47cd-9f5d-d16ff6f2a13c None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:31:11.486115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd175982-c6f5-47cd-9f5d-d16ff6f2a13c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:31:11.486385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd175982-c6f5-47cd-9f5d-d16ff6f2a13c None admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:31:11.487149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd175982-c6f5-47cd-9f5d-d16ff6f2a13c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:31:11.488481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd175982-c6f5-47cd-9f5d-d16ff6f2a13c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:31:11.507351 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 657/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:31:11 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:31:21.344702 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=30 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:31:21.502684 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:15.880990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562ae93-c363-4bef-b623-432f2fb09199 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:15.881439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562ae93-c363-4bef-b623-432f2fb09199 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:15.881650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562ae93-c363-4bef-b623-432f2fb09199 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:15.883128 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 650/1307] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:15.890092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69b7ea-9bc6-4ccb-981b-a8b6feb4ffb4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:15.890548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69b7ea-9bc6-4ccb-981b-a8b6feb4ffb4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:15.890718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69b7ea-9bc6-4ccb-981b-a8b6feb4ffb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:16.002557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8f69b7ea-9bc6-4ccb-981b-a8b6feb4ffb4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:16.003974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8f69b7ea-9bc6-4ccb-981b-a8b6feb4ffb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:16.126982 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 658/1308] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:16.423680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923c0c5-8912-4fe7-9490-d6e165d9ba5d None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:16.423963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923c0c5-8912-4fe7-9490-d6e165d9ba5d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:16.424400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923c0c5-8912-4fe7-9490-d6e165d9ba5d None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:16.426192 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 651/1309] 10.222.0.16 () {54 vars in 964 bytes} [Fri Sep 30 09:32:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:16.432734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d7ecc-532d-44bd-a519-9b1ac4848733 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:16.433036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d7ecc-532d-44bd-a519-9b1ac4848733 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:16.433308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d7ecc-532d-44bd-a519-9b1ac4848733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:16.519498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fe4d7ecc-532d-44bd-a519-9b1ac4848733 None None] MFA Rules not processed for user `a9b0fd833b134a089433cd2985caba80`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:16.520756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fe4d7ecc-532d-44bd-a519-9b1ac4848733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:16.542677 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:16.604927 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 659/1310] 10.222.0.16 () {58 vars in 1061 bytes} [Fri Sep 30 09:32:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:16.614617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923c0c5-8912-4fe7-9490-d6e165d9ba5d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:16.616465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1923c0c5-8912-4fe7-9490-d6e165d9ba5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:16.740050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923c0c5-8912-4fe7-9490-d6e165d9ba5d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:16.824806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb346e9b-52fe-4893-9564-c5b7d9c52e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:16.825413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb346e9b-52fe-4893-9564-c5b7d9c52e15 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:16.825687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb346e9b-52fe-4893-9564-c5b7d9c52e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:16.826061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb346e9b-52fe-4893-9564-c5b7d9c52e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:16.828879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eb346e9b-52fe-4893-9564-c5b7d9c52e15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:16.888877 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:16.952249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb346e9b-52fe-4893-9564-c5b7d9c52e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:16.954982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb346e9b-52fe-4893-9564-c5b7d9c52e15 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:16.976786 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 652/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:19.520408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02283476-50c9-453a-b78e-84ff222973af None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:19.520982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02283476-50c9-453a-b78e-84ff222973af None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:19.520982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02283476-50c9-453a-b78e-84ff222973af None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:19.522335 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 660/1312] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:19.527649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7f842-1773-452e-8ebb-b94d483dcd24 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:19.528055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7f842-1773-452e-8ebb-b94d483dcd24 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:19.528186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7f842-1773-452e-8ebb-b94d483dcd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:19.608573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d1e7f842-1773-452e-8ebb-b94d483dcd24 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:19.610421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d1e7f842-1773-452e-8ebb-b94d483dcd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:19.708623 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 653/1313] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:19.995337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02283476-50c9-453a-b78e-84ff222973af None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:19.996904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-02283476-50c9-453a-b78e-84ff222973af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:20.104767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02283476-50c9-453a-b78e-84ff222973af None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:20.183771 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:20.186554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69511262-29c0-4cc9-aa96-23109df35522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:20.188178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69511262-29c0-4cc9-aa96-23109df35522 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:20.188496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69511262-29c0-4cc9-aa96-23109df35522 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:20.189076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69511262-29c0-4cc9-aa96-23109df35522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:20.191223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-69511262-29c0-4cc9-aa96-23109df35522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:20.298299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69511262-29c0-4cc9-aa96-23109df35522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:20.299726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69511262-29c0-4cc9-aa96-23109df35522 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:20.323718 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 661/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:22.855514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b86d7-95c6-43d1-b4f3-9b504f3b59bb None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:22.856056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b86d7-95c6-43d1-b4f3-9b504f3b59bb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:22.856056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b86d7-95c6-43d1-b4f3-9b504f3b59bb None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:22.857434 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 654/1315] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:22.862784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e90f3-0d93-4ac2-a346-9b45eb3ec969 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:22.863187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e90f3-0d93-4ac2-a346-9b45eb3ec969 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:22.863328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e90f3-0d93-4ac2-a346-9b45eb3ec969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:22.934565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f22e90f3-0d93-4ac2-a346-9b45eb3ec969 None None] MFA Rules not processed for user `695734af4ebc4c5fbebc32816bddfa23`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:22.935764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f22e90f3-0d93-4ac2-a346-9b45eb3ec969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:22.991890 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:23.038372 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 662/1316] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:32:22 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:23.342150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8cc5a-03ea-41e3-9b5a-8f71283e1c71 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:23.342432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8cc5a-03ea-41e3-9b5a-8f71283e1c71 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:23.342698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8cc5a-03ea-41e3-9b5a-8f71283e1c71 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:23.344124 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 655/1317] 10.222.0.16 () {54 vars in 964 bytes} [Fri Sep 30 09:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:23.351455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525517d-df70-4d9f-b666-7bdf3beffee5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:23.351741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525517d-df70-4d9f-b666-7bdf3beffee5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:23.352014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525517d-df70-4d9f-b666-7bdf3beffee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:23.431136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b525517d-df70-4d9f-b666-7bdf3beffee5 None None] MFA Rules not processed for user `a9b0fd833b134a089433cd2985caba80`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:23.432391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b525517d-df70-4d9f-b666-7bdf3beffee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:23.525187 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 663/1318] 10.222.0.16 () {58 vars in 1061 bytes} [Fri Sep 30 09:32:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:23.535018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8cc5a-03ea-41e3-9b5a-8f71283e1c71 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:23.536523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a4a8cc5a-03ea-41e3-9b5a-8f71283e1c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:23.547114 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:23.645602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8cc5a-03ea-41e3-9b5a-8f71283e1c71 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:23.722585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe31f9b-1985-4446-8c2b-b1f27f777f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:23.723185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe31f9b-1985-4446-8c2b-b1f27f777f29 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:23.723450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe31f9b-1985-4446-8c2b-b1f27f777f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:23.723717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe31f9b-1985-4446-8c2b-b1f27f777f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:23.725328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-efe31f9b-1985-4446-8c2b-b1f27f777f29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:23.792143 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:23.840875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe31f9b-1985-4446-8c2b-b1f27f777f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:23.842298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe31f9b-1985-4446-8c2b-b1f27f777f29 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:23.862233 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 656/1319] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:23 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:26.983540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcd5df-0bb4-4025-ac5f-e3e092c8b5dc None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:26.984084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcd5df-0bb4-4025-ac5f-e3e092c8b5dc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:26.984265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcd5df-0bb4-4025-ac5f-e3e092c8b5dc None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:26.985648 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 664/1320] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:26.991123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c324b7-3556-4a72-949b-86e54cc484f7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:26.991513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c324b7-3556-4a72-949b-86e54cc484f7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:26.991666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c324b7-3556-4a72-949b-86e54cc484f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:27.060378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-40c324b7-3556-4a72-949b-86e54cc484f7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:27.061671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-40c324b7-3556-4a72-949b-86e54cc484f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:27.174199 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 657/1321] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:32:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:27.470751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcd5df-0bb4-4025-ac5f-e3e092c8b5dc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:27.472266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4ddcd5df-0bb4-4025-ac5f-e3e092c8b5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:27.533611 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:27.591291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcd5df-0bb4-4025-ac5f-e3e092c8b5dc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:27.666207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643b7aa-bb69-41da-8e16-15273f8a6e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:27.666810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643b7aa-bb69-41da-8e16-15273f8a6e82 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:27.667083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643b7aa-bb69-41da-8e16-15273f8a6e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:27.667352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643b7aa-bb69-41da-8e16-15273f8a6e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:27.668948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0643b7aa-bb69-41da-8e16-15273f8a6e82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:27.766472 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:27.779866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643b7aa-bb69-41da-8e16-15273f8a6e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:27.782938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643b7aa-bb69-41da-8e16-15273f8a6e82 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:27.801088 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 665/1322] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:30.688469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eef209-5ba3-41de-aa36-170d8d773338 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:30.689042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eef209-5ba3-41de-aa36-170d8d773338 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:30.689042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eef209-5ba3-41de-aa36-170d8d773338 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:30.690527 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 658/1323] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:32:30.695586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c6d73-842e-454d-a07c-0cc994957d3b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:30.695985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c6d73-842e-454d-a07c-0cc994957d3b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:30.696123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c6d73-842e-454d-a07c-0cc994957d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:30.765899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d18c6d73-842e-454d-a07c-0cc994957d3b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:30.767135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d18c6d73-842e-454d-a07c-0cc994957d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:30.873525 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 666/1324] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:31.162153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eef209-5ba3-41de-aa36-170d8d773338 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:31.163608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-69eef209-5ba3-41de-aa36-170d8d773338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:31.183579 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:31.267830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eef209-5ba3-41de-aa36-170d8d773338 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:31.344267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9a676-b921-47cf-84c6-56cb713609d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:31.344909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9a676-b921-47cf-84c6-56cb713609d1 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:31.345191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9a676-b921-47cf-84c6-56cb713609d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:31.345462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9a676-b921-47cf-84c6-56cb713609d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:31.347044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3ed9a676-b921-47cf-84c6-56cb713609d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:31.420775 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:31.460763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9a676-b921-47cf-84c6-56cb713609d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:31.462268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9a676-b921-47cf-84c6-56cb713609d1 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:31.481200 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 659/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:33.706338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9c22b-39e7-4f50-b119-5176cdc2c8ef None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:33.706871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9c22b-39e7-4f50-b119-5176cdc2c8ef None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:33.706871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9c22b-39e7-4f50-b119-5176cdc2c8ef None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:33.708211 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 667/1326] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:33.713522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f99828-a254-46cf-8344-1324eb414c6c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:33.713951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f99828-a254-46cf-8344-1324eb414c6c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:33.714143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f99828-a254-46cf-8344-1324eb414c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:33.780387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-90f99828-a254-46cf-8344-1324eb414c6c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:33.781762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-90f99828-a254-46cf-8344-1324eb414c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:33.884788 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 660/1327] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:34.167866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9c22b-39e7-4f50-b119-5176cdc2c8ef None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:34.169486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-36d9c22b-39e7-4f50-b119-5176cdc2c8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:34.230196 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:34.274303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9c22b-39e7-4f50-b119-5176cdc2c8ef None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:34.348901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b9ae2-95d0-476f-a0a9-1afd12dfc01e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:34.349504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b9ae2-95d0-476f-a0a9-1afd12dfc01e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:34.349785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b9ae2-95d0-476f-a0a9-1afd12dfc01e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:34.350049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b9ae2-95d0-476f-a0a9-1afd12dfc01e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:34.351619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ab0b9ae2-95d0-476f-a0a9-1afd12dfc01e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:34.457571 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:34.460008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b9ae2-95d0-476f-a0a9-1afd12dfc01e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:34.461484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b9ae2-95d0-476f-a0a9-1afd12dfc01e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:34.481009 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 668/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:36.681203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b871ce-e3a1-4a1c-8b09-c36550609f2a None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:36.681774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b871ce-e3a1-4a1c-8b09-c36550609f2a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:36.681983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b871ce-e3a1-4a1c-8b09-c36550609f2a None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:36.683339 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 661/1329] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:36.689066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afae1fe-162e-4edc-88b2-0785731d20ee None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:36.689512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afae1fe-162e-4edc-88b2-0785731d20ee None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:36.689623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afae1fe-162e-4edc-88b2-0785731d20ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:36.757535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6afae1fe-162e-4edc-88b2-0785731d20ee None None] MFA Rules not processed for user `695734af4ebc4c5fbebc32816bddfa23`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:36.758743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6afae1fe-162e-4edc-88b2-0785731d20ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:36.852957 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 669/1330] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:32:36 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:37.145879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b871ce-e3a1-4a1c-8b09-c36550609f2a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:37.147493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-42b871ce-e3a1-4a1c-8b09-c36550609f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:37.187669 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:37.277429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b871ce-e3a1-4a1c-8b09-c36550609f2a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:37.365033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87924c0-06b5-4133-9e87-78b69f0290e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:37.365774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87924c0-06b5-4133-9e87-78b69f0290e4 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:37.366111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87924c0-06b5-4133-9e87-78b69f0290e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:37.366445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87924c0-06b5-4133-9e87-78b69f0290e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:37.368350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e87924c0-06b5-4133-9e87-78b69f0290e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:37.454792 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:37.488939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87924c0-06b5-4133-9e87-78b69f0290e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:37.490349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87924c0-06b5-4133-9e87-78b69f0290e4 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:37.509959 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 662/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:37 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:39.944514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c313a1-eead-4878-a4e6-7f85340d815e None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:39.945059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c313a1-eead-4878-a4e6-7f85340d815e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:39.945154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c313a1-eead-4878-a4e6-7f85340d815e None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:39.946426 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 670/1332] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:39.952498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c1ab6-2e57-4ab6-9929-6fbca39beb6e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:39.953247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c1ab6-2e57-4ab6-9929-6fbca39beb6e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:39.953525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c1ab6-2e57-4ab6-9929-6fbca39beb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:40.018053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-542c1ab6-2e57-4ab6-9929-6fbca39beb6e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:40.019284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-542c1ab6-2e57-4ab6-9929-6fbca39beb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:40.114214 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 663/1333] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:40.404628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c313a1-eead-4878-a4e6-7f85340d815e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:40.406164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-78c313a1-eead-4878-a4e6-7f85340d815e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:40.475134 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:40.509673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c313a1-eead-4878-a4e6-7f85340d815e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:40.581249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c196b46-75ac-4e08-bc17-768b7d745fbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:40.581837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c196b46-75ac-4e08-bc17-768b7d745fbc service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:40.582110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c196b46-75ac-4e08-bc17-768b7d745fbc service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:40.582408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c196b46-75ac-4e08-bc17-768b7d745fbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:40.583964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7c196b46-75ac-4e08-bc17-768b7d745fbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:40.690265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c196b46-75ac-4e08-bc17-768b7d745fbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:40.691600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c196b46-75ac-4e08-bc17-768b7d745fbc service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:40.701227 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:40.710352 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 671/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:42.884038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75a2be-0a16-47e8-bce9-fbde68e9d4ba None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:42.884549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75a2be-0a16-47e8-bce9-fbde68e9d4ba None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:42.884549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75a2be-0a16-47e8-bce9-fbde68e9d4ba None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:42.885850 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 664/1335] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:42.891536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46075a1-e15d-4d19-badf-6e33bc7a1a99 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:42.891981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46075a1-e15d-4d19-badf-6e33bc7a1a99 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:42.892096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46075a1-e15d-4d19-badf-6e33bc7a1a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:42.958195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d46075a1-e15d-4d19-badf-6e33bc7a1a99 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:42.959388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d46075a1-e15d-4d19-badf-6e33bc7a1a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:43.066243 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 672/1336] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:43.351131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75a2be-0a16-47e8-bce9-fbde68e9d4ba None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:43.352762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7f75a2be-0a16-47e8-bce9-fbde68e9d4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:43.397709 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:43.463267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75a2be-0a16-47e8-bce9-fbde68e9d4ba None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:43.541368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ddc1f-efd6-47a9-bb28-17c6a03d8eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:43.541961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ddc1f-efd6-47a9-bb28-17c6a03d8eea service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:43.542235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ddc1f-efd6-47a9-bb28-17c6a03d8eea service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:43.542500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ddc1f-efd6-47a9-bb28-17c6a03d8eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:43.544062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-957ddc1f-efd6-47a9-bb28-17c6a03d8eea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:43.628001 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:43.653267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ddc1f-efd6-47a9-bb28-17c6a03d8eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:43.655213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ddc1f-efd6-47a9-bb28-17c6a03d8eea service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:43.673432 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 665/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:46.207336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752de43-52fd-45bc-a211-92e4e1d3f2a9 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:46.207869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752de43-52fd-45bc-a211-92e4e1d3f2a9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:46.207869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752de43-52fd-45bc-a211-92e4e1d3f2a9 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:46.209176 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 673/1338] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:46.214529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c677d7d-7f2e-4399-93e0-8d00ceb47661 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:46.214950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c677d7d-7f2e-4399-93e0-8d00ceb47661 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:46.215073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c677d7d-7f2e-4399-93e0-8d00ceb47661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:46.279041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1c677d7d-7f2e-4399-93e0-8d00ceb47661 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:46.280508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1c677d7d-7f2e-4399-93e0-8d00ceb47661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:46.386115 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 666/1339] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:32:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:46.672076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752de43-52fd-45bc-a211-92e4e1d3f2a9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:46.673661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d752de43-52fd-45bc-a211-92e4e1d3f2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:46.748930 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:46.776047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752de43-52fd-45bc-a211-92e4e1d3f2a9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:46.848838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9db3c7-36c8-4b19-bb42-ecd1d210e1db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:46.849435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9db3c7-36c8-4b19-bb42-ecd1d210e1db service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:46.849710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9db3c7-36c8-4b19-bb42-ecd1d210e1db service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:46.849977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9db3c7-36c8-4b19-bb42-ecd1d210e1db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:46.851554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fa9db3c7-36c8-4b19-bb42-ecd1d210e1db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:46.957112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9db3c7-36c8-4b19-bb42-ecd1d210e1db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:46.958531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9db3c7-36c8-4b19-bb42-ecd1d210e1db service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:46.979027 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 674/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:32:51.181825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c0e26-b7b7-48ee-b9c1-1b885a4feb9e None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:51.182319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c0e26-b7b7-48ee-b9c1-1b885a4feb9e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:51.182409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c0e26-b7b7-48ee-b9c1-1b885a4feb9e None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:51.183736 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 667/1341] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:51.189232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c381a61-2fd1-4f3b-9a99-ee4011f087b8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:51.189665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c381a61-2fd1-4f3b-9a99-ee4011f087b8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:51.189783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c381a61-2fd1-4f3b-9a99-ee4011f087b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:51.195316 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:51.267227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2c381a61-2fd1-4f3b-9a99-ee4011f087b8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:51.268488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2c381a61-2fd1-4f3b-9a99-ee4011f087b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:51.371704 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 675/1342] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:51.661920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c0e26-b7b7-48ee-b9c1-1b885a4feb9e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:51.663543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-130c0e26-b7b7-48ee-b9c1-1b885a4feb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:51.712989 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:51.768976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c0e26-b7b7-48ee-b9c1-1b885a4feb9e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:51.844493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36c7cd-4d49-4f4c-899d-a676826dbac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:51.845130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36c7cd-4d49-4f4c-899d-a676826dbac3 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:51.845403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36c7cd-4d49-4f4c-899d-a676826dbac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:51.845670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36c7cd-4d49-4f4c-899d-a676826dbac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:51.847260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-da36c7cd-4d49-4f4c-899d-a676826dbac3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:51.944401 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:51.962926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36c7cd-4d49-4f4c-899d-a676826dbac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:51.964353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36c7cd-4d49-4f4c-899d-a676826dbac3 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:51.984826 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 668/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:32:54.869532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c9797-b062-49bc-be71-c84b2dd7c4dc None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:54.870073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c9797-b062-49bc-be71-c84b2dd7c4dc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:54.870073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c9797-b062-49bc-be71-c84b2dd7c4dc None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:54.871421 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 676/1344] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:32:54.876948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b6c9b-18e4-4944-8203-ceba17d2d1d2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:54.877397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b6c9b-18e4-4944-8203-ceba17d2d1d2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:54.877641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b6c9b-18e4-4944-8203-ceba17d2d1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:54.946915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-673b6c9b-18e4-4944-8203-ceba17d2d1d2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:32:54.948130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-673b6c9b-18e4-4944-8203-ceba17d2d1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:55.051173 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 669/1345] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:32:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:32:55.350283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c9797-b062-49bc-be71-c84b2dd7c4dc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:32:55.351811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5f7c9797-b062-49bc-be71-c84b2dd7c4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:55.444751 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:32:55.462434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c9797-b062-49bc-be71-c84b2dd7c4dc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:32:55.535981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ca7c7-ea41-4aa8-ae7b-028afae874ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:32:55.536500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ca7c7-ea41-4aa8-ae7b-028afae874ed service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:32:55.536803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ca7c7-ea41-4aa8-ae7b-028afae874ed service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:32:55.537071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ca7c7-ea41-4aa8-ae7b-028afae874ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:32:55.539604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-978ca7c7-ea41-4aa8-ae7b-028afae874ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:32:55.655203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ca7c7-ea41-4aa8-ae7b-028afae874ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:32:55.656703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ca7c7-ea41-4aa8-ae7b-028afae874ed service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:32:55.674382 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 677/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:32:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:33:00.049956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97f289-2085-4690-bd33-0f82704d4d28 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:00.050479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97f289-2085-4690-bd33-0f82704d4d28 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:00.050479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97f289-2085-4690-bd33-0f82704d4d28 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:00.051838 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 670/1347] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:00.056998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7adc0-dff7-4e52-bb45-5320447a935b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:00.057405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7adc0-dff7-4e52-bb45-5320447a935b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:00.057626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7adc0-dff7-4e52-bb45-5320447a935b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:00.074116 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:00.125884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-08c7adc0-dff7-4e52-bb45-5320447a935b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:00.127074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-08c7adc0-dff7-4e52-bb45-5320447a935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:00.221918 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 678/1348] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:00.507308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97f289-2085-4690-bd33-0f82704d4d28 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:00.508903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aa97f289-2085-4690-bd33-0f82704d4d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:00.566494 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:00.612781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97f289-2085-4690-bd33-0f82704d4d28 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:00.686298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f5673-e02d-44fc-ba32-de52f6cbc7de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:00.686887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f5673-e02d-44fc-ba32-de52f6cbc7de service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:00.687157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f5673-e02d-44fc-ba32-de52f6cbc7de service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:00.687418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f5673-e02d-44fc-ba32-de52f6cbc7de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:00.689009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fc1f5673-e02d-44fc-ba32-de52f6cbc7de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:00.791826 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:00.796679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f5673-e02d-44fc-ba32-de52f6cbc7de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:00.798120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f5673-e02d-44fc-ba32-de52f6cbc7de service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:00.816703 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 671/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:05.753741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5884f-d574-4580-98a4-52a67978a04d None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:05.754492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5884f-d574-4580-98a4-52a67978a04d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:05.754928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5884f-d574-4580-98a4-52a67978a04d None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:05.756410 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 679/1350] 10.222.0.16 () {54 vars in 921 bytes} [Fri Sep 30 09:33:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:05.761986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64257d-0ac0-49bc-b7f6-d140543585d9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:05.761986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64257d-0ac0-49bc-b7f6-d140543585d9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:05.763165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64257d-0ac0-49bc-b7f6-d140543585d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:05.869579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fe64257d-0ac0-49bc-b7f6-d140543585d9 None None] MFA Rules not processed for user `cbb22d0675bc4ca893b0477cebd470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:05.870752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fe64257d-0ac0-49bc-b7f6-d140543585d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:06.078628 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 672/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 09:33:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:10.220492 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=59 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:10.306245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1bbb1-5e0f-40f9-8694-c0ce413fffac None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:10.306764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1bbb1-5e0f-40f9-8694-c0ce413fffac None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:10.307028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1bbb1-5e0f-40f9-8694-c0ce413fffac None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:10.308563 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 680/1352] 10.222.0.16 () {54 vars in 921 bytes} [Fri Sep 30 09:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:10.314105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1559df-c7d3-48a9-8a44-db776d89c87f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:10.315003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1559df-c7d3-48a9-8a44-db776d89c87f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:10.315688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1559df-c7d3-48a9-8a44-db776d89c87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:10.376842 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:10.405934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9f1559df-c7d3-48a9-8a44-db776d89c87f None None] MFA Rules not processed for user `cbb22d0675bc4ca893b0477cebd470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:10.407886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9f1559df-c7d3-48a9-8a44-db776d89c87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:10.530206 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 673/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 09:33:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:11.930300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346e0e8-fec8-4d8f-bb2f-be2f888f695f None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:11.930794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346e0e8-fec8-4d8f-bb2f-be2f888f695f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:11.930889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346e0e8-fec8-4d8f-bb2f-be2f888f695f None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:11.932185 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 681/1354] 10.222.0.16 () {54 vars in 921 bytes} [Fri Sep 30 09:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:11.938117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff8ddb-b7f1-4458-a83f-fa97689f8b23 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:11.938563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff8ddb-b7f1-4458-a83f-fa97689f8b23 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:11.938784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff8ddb-b7f1-4458-a83f-fa97689f8b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:12.016326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-82ff8ddb-b7f1-4458-a83f-fa97689f8b23 None None] MFA Rules not processed for user `cbb22d0675bc4ca893b0477cebd470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:12.017598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-82ff8ddb-b7f1-4458-a83f-fa97689f8b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:12.061507 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:12.127678 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 674/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 09:33:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:15.924803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65644664-7e75-4f8e-b23d-a632f5b18059 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:15.925625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65644664-7e75-4f8e-b23d-a632f5b18059 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:15.926043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65644664-7e75-4f8e-b23d-a632f5b18059 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:15.927774 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 682/1356] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:33:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:15.933432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47135371-e5b1-4304-86e1-954b4b3b6c03 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:15.934978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47135371-e5b1-4304-86e1-954b4b3b6c03 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:15.935478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47135371-e5b1-4304-86e1-954b4b3b6c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:16.021139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-47135371-e5b1-4304-86e1-954b4b3b6c03 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:16.022319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-47135371-e5b1-4304-86e1-954b4b3b6c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:16.135796 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 675/1357] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:16.442662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbfa56-db86-49b9-a222-d3bcfcef9af3 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:16.443628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbfa56-db86-49b9-a222-d3bcfcef9af3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:16.444637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbfa56-db86-49b9-a222-d3bcfcef9af3 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:16.448482 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 683/1358] 10.222.0.16 () {54 vars in 961 bytes} [Fri Sep 30 09:33:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:16.456952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18925764-9a5f-4072-abdc-4d4ba3ae718d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:16.457271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18925764-9a5f-4072-abdc-4d4ba3ae718d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:16.457549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18925764-9a5f-4072-abdc-4d4ba3ae718d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:16.475455 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:16.541026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-18925764-9a5f-4072-abdc-4d4ba3ae718d None None] MFA Rules not processed for user `aa607111024540d1a09b01dfd1e5e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:16.542221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-18925764-9a5f-4072-abdc-4d4ba3ae718d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:16.673602 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 676/1359] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Sep 30 09:33:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:33:16.681097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbfa56-db86-49b9-a222-d3bcfcef9af3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:16.682609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-93bbfa56-db86-49b9-a222-d3bcfcef9af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:16.841265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbfa56-db86-49b9-a222-d3bcfcef9af3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:16.926089 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:16.970531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af928e-2b82-4b63-865a-87e6102f591b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:16.971113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af928e-2b82-4b63-865a-87e6102f591b service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:16.971386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af928e-2b82-4b63-865a-87e6102f591b service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:16.971654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af928e-2b82-4b63-865a-87e6102f591b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:16.973273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-94af928e-2b82-4b63-865a-87e6102f591b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:17.070946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af928e-2b82-4b63-865a-87e6102f591b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:17.072574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af928e-2b82-4b63-865a-87e6102f591b service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:17.093747 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 684/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:19.502381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df54c4-ceaa-43a9-ae02-4d648af8617d None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:19.502892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df54c4-ceaa-43a9-ae02-4d648af8617d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:19.502892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df54c4-ceaa-43a9-ae02-4d648af8617d None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:19.504211 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 677/1361] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:19.509974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a954aa-3669-4e2a-820b-4f05b0f41951 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:19.510429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a954aa-3669-4e2a-820b-4f05b0f41951 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:19.510732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a954aa-3669-4e2a-820b-4f05b0f41951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:19.610783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-15a954aa-3669-4e2a-820b-4f05b0f41951 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:19.612068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-15a954aa-3669-4e2a-820b-4f05b0f41951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:19.659917 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:19.741116 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 685/1362] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:33:20.044115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df54c4-ceaa-43a9-ae02-4d648af8617d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:20.045914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b3df54c4-ceaa-43a9-ae02-4d648af8617d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:20.131369 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:20.247250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df54c4-ceaa-43a9-ae02-4d648af8617d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:20.422208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458ddcb-2f58-4a17-8cdb-782ec9122818 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:20.422208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458ddcb-2f58-4a17-8cdb-782ec9122818 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:20.423309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458ddcb-2f58-4a17-8cdb-782ec9122818 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:20.423309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458ddcb-2f58-4a17-8cdb-782ec9122818 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:20.425083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9458ddcb-2f58-4a17-8cdb-782ec9122818 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:20.450382 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:20.518709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458ddcb-2f58-4a17-8cdb-782ec9122818 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:20.520303 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458ddcb-2f58-4a17-8cdb-782ec9122818 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:20.539603 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 678/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:33:23.060032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07047a4f-9628-47f5-bf1d-74fe3314f655 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:23.060541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07047a4f-9628-47f5-bf1d-74fe3314f655 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:23.060541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07047a4f-9628-47f5-bf1d-74fe3314f655 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:23.061863 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 686/1364] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:33:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:23.067228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da99ce-56cf-469d-a4dc-107aa15c23bb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:23.067633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da99ce-56cf-469d-a4dc-107aa15c23bb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:23.067740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da99ce-56cf-469d-a4dc-107aa15c23bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:23.137346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b3da99ce-56cf-469d-a4dc-107aa15c23bb None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:23.138554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b3da99ce-56cf-469d-a4dc-107aa15c23bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:23.245177 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:23.276414 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 679/1365] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:23.559606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f7c43-0464-468a-afec-e4080c325c98 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:23.559886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f7c43-0464-468a-afec-e4080c325c98 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:23.560160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f7c43-0464-468a-afec-e4080c325c98 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:23.561518 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 687/1366] 10.222.0.16 () {54 vars in 961 bytes} [Fri Sep 30 09:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:23.568335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f60ea-e609-43ae-ac94-a9f06afebf4b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:23.568630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f60ea-e609-43ae-ac94-a9f06afebf4b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:23.568970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f60ea-e609-43ae-ac94-a9f06afebf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:23.670139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-875f60ea-e609-43ae-ac94-a9f06afebf4b None None] MFA Rules not processed for user `aa607111024540d1a09b01dfd1e5e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:23.671701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-875f60ea-e609-43ae-ac94-a9f06afebf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:23.849881 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 680/1367] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Sep 30 09:33:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:23.859808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f7c43-0464-468a-afec-e4080c325c98 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:23.861652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7e3f7c43-0464-468a-afec-e4080c325c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:24.052629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f7c43-0464-468a-afec-e4080c325c98 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:24.077504 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:24.214784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88b3db-a1db-4b09-8dee-dd4cc8bd8208 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:24.215841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88b3db-a1db-4b09-8dee-dd4cc8bd8208 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:24.216263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88b3db-a1db-4b09-8dee-dd4cc8bd8208 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:24.216776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88b3db-a1db-4b09-8dee-dd4cc8bd8208 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:24.219834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5f88b3db-a1db-4b09-8dee-dd4cc8bd8208 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:24.340500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f88b3db-a1db-4b09-8dee-dd4cc8bd8208 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:24.342629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f88b3db-a1db-4b09-8dee-dd4cc8bd8208 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:24.371128 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 688/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:26.897490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185077ab-ac13-4736-bdb8-236cda201286 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:26.898033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185077ab-ac13-4736-bdb8-236cda201286 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:26.898033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185077ab-ac13-4736-bdb8-236cda201286 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:26.904270 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 681/1369] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:26.906147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929b037-090f-4974-b122-e0c75d276207 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:26.907043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929b037-090f-4974-b122-e0c75d276207 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:26.907541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929b037-090f-4974-b122-e0c75d276207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:26.954201 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:26.993113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f929b037-090f-4974-b122-e0c75d276207 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:26.994936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f929b037-090f-4974-b122-e0c75d276207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:27.122882 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 689/1370] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:33:27.427803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185077ab-ac13-4736-bdb8-236cda201286 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:27.429344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-185077ab-ac13-4736-bdb8-236cda201286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:27.484651 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:27.630545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185077ab-ac13-4736-bdb8-236cda201286 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:27.771626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660cd13-31bf-40bf-9f08-e4b8e5a3cf9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:27.772287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660cd13-31bf-40bf-9f08-e4b8e5a3cf9c service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:27.773019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660cd13-31bf-40bf-9f08-e4b8e5a3cf9c service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:27.773608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660cd13-31bf-40bf-9f08-e4b8e5a3cf9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:27.776522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8660cd13-31bf-40bf-9f08-e4b8e5a3cf9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:27.798035 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:27.901431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660cd13-31bf-40bf-9f08-e4b8e5a3cf9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:27.903768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660cd13-31bf-40bf-9f08-e4b8e5a3cf9c service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:27.949104 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 682/1371] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:28.238987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38e6dc-d75b-43b8-9fcd-7ecff2860ee9 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:28.239487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38e6dc-d75b-43b8-9fcd-7ecff2860ee9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:28.239487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38e6dc-d75b-43b8-9fcd-7ecff2860ee9 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:28.241099 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 690/1372] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:28.247376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71bc45-4c0a-421f-9ecc-c08851ccae94 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:28.247721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71bc45-4c0a-421f-9ecc-c08851ccae94 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:28.248007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71bc45-4c0a-421f-9ecc-c08851ccae94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:28.320636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4b71bc45-4c0a-421f-9ecc-c08851ccae94 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:28.321848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4b71bc45-4c0a-421f-9ecc-c08851ccae94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:28.410644 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:28.431120 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 683/1373] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:28.784943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d3d93-3cf8-45a2-abe3-d4c0b2b2f28e None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:28.784943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d3d93-3cf8-45a2-abe3-d4c0b2b2f28e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:28.784943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d3d93-3cf8-45a2-abe3-d4c0b2b2f28e None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:28.784943 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 691/1374] 10.222.0.16 () {54 vars in 963 bytes} [Fri Sep 30 09:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:28.789366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1721df-e33b-4523-9de6-e8163769c7ca None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:28.789656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1721df-e33b-4523-9de6-e8163769c7ca None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:28.789934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1721df-e33b-4523-9de6-e8163769c7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:28.877259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5c1721df-e33b-4523-9de6-e8163769c7ca None None] MFA Rules not processed for user `947a48b06bb74f068b70e8c17a8da422`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:28.878560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5c1721df-e33b-4523-9de6-e8163769c7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:28.970694 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 684/1375] 10.222.0.16 () {58 vars in 1060 bytes} [Fri Sep 30 09:33:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:28.978575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d3d93-3cf8-45a2-abe3-d4c0b2b2f28e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:28.980696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d29d3d93-3cf8-45a2-abe3-d4c0b2b2f28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:29.096355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d3d93-3cf8-45a2-abe3-d4c0b2b2f28e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:29.100834 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:29.182808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b7aed-5d5a-4a42-9f7b-7ca816742a9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:29.183895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b7aed-5d5a-4a42-9f7b-7ca816742a9e service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:29.184272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b7aed-5d5a-4a42-9f7b-7ca816742a9e service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:29.184670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b7aed-5d5a-4a42-9f7b-7ca816742a9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:29.186385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-114b7aed-5d5a-4a42-9f7b-7ca816742a9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:29.302579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b7aed-5d5a-4a42-9f7b-7ca816742a9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:29.304265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b7aed-5d5a-4a42-9f7b-7ca816742a9e service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:29.324636 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 692/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:30.219197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69968e48-a0f0-4f1b-91ed-713efeb6cf69 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:30.219702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69968e48-a0f0-4f1b-91ed-713efeb6cf69 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:30.219702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69968e48-a0f0-4f1b-91ed-713efeb6cf69 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:30.221491 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 685/1377] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:30.226962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304be64-850a-4ae2-96b5-abefc74b1ec6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:30.227464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304be64-850a-4ae2-96b5-abefc74b1ec6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:30.228047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304be64-850a-4ae2-96b5-abefc74b1ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:30.276169 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:30.301337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3304be64-850a-4ae2-96b5-abefc74b1ec6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:30.302532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3304be64-850a-4ae2-96b5-abefc74b1ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:30.403114 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 693/1378] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:30.694058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69968e48-a0f0-4f1b-91ed-713efeb6cf69 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:30.695551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-69968e48-a0f0-4f1b-91ed-713efeb6cf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:30.784482 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:30.871192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69968e48-a0f0-4f1b-91ed-713efeb6cf69 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:31.021510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7d301-bb9e-4ae2-8c4f-2b3f30b1e8dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:31.022127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7d301-bb9e-4ae2-8c4f-2b3f30b1e8dc service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:31.022400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7d301-bb9e-4ae2-8c4f-2b3f30b1e8dc service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:31.022667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7d301-bb9e-4ae2-8c4f-2b3f30b1e8dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:31.024286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3ea7d301-bb9e-4ae2-8c4f-2b3f30b1e8dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:31.074187 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:31.124841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7d301-bb9e-4ae2-8c4f-2b3f30b1e8dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:31.126371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7d301-bb9e-4ae2-8c4f-2b3f30b1e8dc service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:31.146279 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 686/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:33.477659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885cb3d-406b-4374-8deb-c0cec9c43c66 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:33.478667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885cb3d-406b-4374-8deb-c0cec9c43c66 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:33.479195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885cb3d-406b-4374-8deb-c0cec9c43c66 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:33.486039 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 694/1380] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:33:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:33.488353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9b7e2-c94d-42b0-bdea-227dcd126d54 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:33.488828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9b7e2-c94d-42b0-bdea-227dcd126d54 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:33.488910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9b7e2-c94d-42b0-bdea-227dcd126d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:33.568698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1ee9b7e2-c94d-42b0-bdea-227dcd126d54 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:33.569937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1ee9b7e2-c94d-42b0-bdea-227dcd126d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:33.704626 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 687/1381] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:33.989962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885cb3d-406b-4374-8deb-c0cec9c43c66 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:33.991447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a885cb3d-406b-4374-8deb-c0cec9c43c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:34.123027 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:34.171180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885cb3d-406b-4374-8deb-c0cec9c43c66 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:34.307074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d06c3-842d-4655-ab5b-319b9455e412 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:34.308127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d06c3-842d-4655-ab5b-319b9455e412 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:34.308411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d06c3-842d-4655-ab5b-319b9455e412 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:34.308695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d06c3-842d-4655-ab5b-319b9455e412 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:34.310286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-252d06c3-842d-4655-ab5b-319b9455e412 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:34.397202 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:34.416381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d06c3-842d-4655-ab5b-319b9455e412 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:34.418663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d06c3-842d-4655-ab5b-319b9455e412 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:34.437996 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 695/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:36.692624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bfcb2-151c-469e-8148-5f32ca90eb9e None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:36.693155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bfcb2-151c-469e-8148-5f32ca90eb9e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:36.693391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bfcb2-151c-469e-8148-5f32ca90eb9e None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:36.695025 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 688/1383] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:36.700932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf8c0f-db38-4198-9eca-6a57a630e70c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:36.701384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf8c0f-db38-4198-9eca-6a57a630e70c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:36.701468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf8c0f-db38-4198-9eca-6a57a630e70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:36.770567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4bdf8c0f-db38-4198-9eca-6a57a630e70c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:36.771766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4bdf8c0f-db38-4198-9eca-6a57a630e70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:36.893032 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 696/1384] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:33:37.185077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363bfcb2-151c-469e-8148-5f32ca90eb9e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:37.186580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-363bfcb2-151c-469e-8148-5f32ca90eb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:37.207637 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:37.363004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363bfcb2-151c-469e-8148-5f32ca90eb9e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:37.457643 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:37.481741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1093116-46ad-4656-9a67-b1a3b2773b95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:37.482340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1093116-46ad-4656-9a67-b1a3b2773b95 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:37.482612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1093116-46ad-4656-9a67-b1a3b2773b95 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:37.482877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1093116-46ad-4656-9a67-b1a3b2773b95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:37.484462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b1093116-46ad-4656-9a67-b1a3b2773b95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:37.595788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1093116-46ad-4656-9a67-b1a3b2773b95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:37.597487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1093116-46ad-4656-9a67-b1a3b2773b95 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:37.617399 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 689/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:39.944205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc4efc-8bfa-4d42-804c-7e5fc0572763 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:39.972412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc4efc-8bfa-4d42-804c-7e5fc0572763 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:39.972412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc4efc-8bfa-4d42-804c-7e5fc0572763 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:39.972412 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 697/1386] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:33:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:39.972860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4b776-48cf-434d-bf36-f94ebcb3f38c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:39.972860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4b776-48cf-434d-bf36-f94ebcb3f38c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:39.972860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4b776-48cf-434d-bf36-f94ebcb3f38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:40.040945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-92c4b776-48cf-434d-bf36-f94ebcb3f38c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:40.042500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-92c4b776-48cf-434d-bf36-f94ebcb3f38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:40.103426 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:40.155731 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 690/1387] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:33:40.461858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc4efc-8bfa-4d42-804c-7e5fc0572763 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:40.463371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ecdc4efc-8bfa-4d42-804c-7e5fc0572763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:40.523846 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:40.644926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc4efc-8bfa-4d42-804c-7e5fc0572763 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:40.764866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f893c-4297-49a6-b116-bc9d4ad5ecb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:40.765507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f893c-4297-49a6-b116-bc9d4ad5ecb7 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:40.765786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f893c-4297-49a6-b116-bc9d4ad5ecb7 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:40.766063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f893c-4297-49a6-b116-bc9d4ad5ecb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:40.767735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b81f893c-4297-49a6-b116-bc9d4ad5ecb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:40.781925 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:40.865815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f893c-4297-49a6-b116-bc9d4ad5ecb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:40.867486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f893c-4297-49a6-b116-bc9d4ad5ecb7 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:40.886442 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 698/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:43.422840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd015ebc-dbc9-4928-9246-22743a8ae6fb None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:43.423471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd015ebc-dbc9-4928-9246-22743a8ae6fb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:43.423471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd015ebc-dbc9-4928-9246-22743a8ae6fb None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:43.424755 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 691/1389] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:43.430055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5489b08-a2e8-449e-91fd-9ae3dc5e1247 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:43.430474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5489b08-a2e8-449e-91fd-9ae3dc5e1247 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:43.430648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5489b08-a2e8-449e-91fd-9ae3dc5e1247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:43.498163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c5489b08-a2e8-449e-91fd-9ae3dc5e1247 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:43.499362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c5489b08-a2e8-449e-91fd-9ae3dc5e1247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:43.589341 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:43.600397 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 699/1390] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:43.889441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd015ebc-dbc9-4928-9246-22743a8ae6fb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:43.891124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dd015ebc-dbc9-4928-9246-22743a8ae6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:44.040445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd015ebc-dbc9-4928-9246-22743a8ae6fb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:44.080933 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:44.160009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b0b55-3f3c-4ccc-891e-9a863c0de065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:44.160519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b0b55-3f3c-4ccc-891e-9a863c0de065 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:44.160821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b0b55-3f3c-4ccc-891e-9a863c0de065 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:44.161215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b0b55-3f3c-4ccc-891e-9a863c0de065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:44.162924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-461b0b55-3f3c-4ccc-891e-9a863c0de065 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:44.253479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b0b55-3f3c-4ccc-891e-9a863c0de065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:44.255055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b0b55-3f3c-4ccc-891e-9a863c0de065 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:44.273218 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 692/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:45.047351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ca744-89ad-4c07-aff8-5d3d8495521a None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:45.047932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ca744-89ad-4c07-aff8-5d3d8495521a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:45.047932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ca744-89ad-4c07-aff8-5d3d8495521a None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:45.049419 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 700/1392] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:45.054539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d7992-0f3b-42d1-95b2-bc57f71033a4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:45.055015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d7992-0f3b-42d1-95b2-bc57f71033a4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:45.055111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d7992-0f3b-42d1-95b2-bc57f71033a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:45.108504 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:45.122749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3e8d7992-0f3b-42d1-95b2-bc57f71033a4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:45.123943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3e8d7992-0f3b-42d1-95b2-bc57f71033a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:45.229648 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 693/1393] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:45.548365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6454d-5307-4c89-8baf-1d7b1bbba3d1 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:45.548679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6454d-5307-4c89-8baf-1d7b1bbba3d1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:45.548954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6454d-5307-4c89-8baf-1d7b1bbba3d1 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:45.550290 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 701/1394] 10.222.0.16 () {54 vars in 962 bytes} [Fri Sep 30 09:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:45.555723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052bae6-ae01-400c-868c-c9cd335339c9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:45.556005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052bae6-ae01-400c-868c-c9cd335339c9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:45.556293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052bae6-ae01-400c-868c-c9cd335339c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:45.636482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7052bae6-ae01-400c-868c-c9cd335339c9 None None] MFA Rules not processed for user `ebc6604430ba4e2283994e5cb8ef18d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:45.637738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7052bae6-ae01-400c-868c-c9cd335339c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:45.712342 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:45.725839 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 694/1395] 10.222.0.16 () {58 vars in 1059 bytes} [Fri Sep 30 09:33:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:45.734878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6454d-5307-4c89-8baf-1d7b1bbba3d1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:45.736370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3de6454d-5307-4c89-8baf-1d7b1bbba3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:45.840127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6454d-5307-4c89-8baf-1d7b1bbba3d1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:45.914680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9e4c0-fff3-4eb3-be5e-86889f729544 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:45.915279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9e4c0-fff3-4eb3-be5e-86889f729544 service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:45.915555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9e4c0-fff3-4eb3-be5e-86889f729544 service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:45.915824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9e4c0-fff3-4eb3-be5e-86889f729544 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:45.917720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-11c9e4c0-fff3-4eb3-be5e-86889f729544 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:45.962627 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:46.035408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9e4c0-fff3-4eb3-be5e-86889f729544 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:46.036858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9e4c0-fff3-4eb3-be5e-86889f729544 service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:46.054763 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 702/1396] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:46.513075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aac3ed-7e90-40c9-a8c2-9a47e027e86d None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:46.513648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aac3ed-7e90-40c9-a8c2-9a47e027e86d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:46.513648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aac3ed-7e90-40c9-a8c2-9a47e027e86d None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:46.515113 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 695/1397] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:46.520670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea5309-c6b7-44cc-b68c-d7d3dd52c4d8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:46.520961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea5309-c6b7-44cc-b68c-d7d3dd52c4d8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:46.521236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea5309-c6b7-44cc-b68c-d7d3dd52c4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:46.594653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c6ea5309-c6b7-44cc-b68c-d7d3dd52c4d8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:46.595857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c6ea5309-c6b7-44cc-b68c-d7d3dd52c4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:46.715558 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:46.718370 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 703/1398] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:33:46.852036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b8e4d-211b-464c-bbc0-6853bb4c6f5d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:46.852415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b8e4d-211b-464c-bbc0-6853bb4c6f5d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:46.852867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b8e4d-211b-464c-bbc0-6853bb4c6f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:46.926156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f18b8e4d-211b-464c-bbc0-6853bb4c6f5d None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:46.927393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f18b8e4d-211b-464c-bbc0-6853bb4c6f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:47.015748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea5309-c6b7-44cc-b68c-d7d3dd52c4d8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:47.016983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c6ea5309-c6b7-44cc-b68c-d7d3dd52c4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:47.020212 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 696/1399] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:33:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:47.063519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aef8c-c805-408d-bb29-af1dea04cdb1 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:47.063953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aef8c-c805-408d-bb29-af1dea04cdb1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:47.064225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aef8c-c805-408d-bb29-af1dea04cdb1 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:47.065610 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 697/1400] 10.222.0.16 () {54 vars in 943 bytes} [Fri Sep 30 09:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:33:47.072046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a514fae-0132-435e-83c2-f807d72b535f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:47.072944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a514fae-0132-435e-83c2-f807d72b535f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:47.073603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a514fae-0132-435e-83c2-f807d72b535f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:47.137021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea5309-c6b7-44cc-b68c-d7d3dd52c4d8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:47.153080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3a514fae-0132-435e-83c2-f807d72b535f None None] MFA Rules not processed for user `963c491a2d2e409b8b45e4fb6aff41c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:47.154590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3a514fae-0132-435e-83c2-f807d72b535f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:47.175441 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:47.249552 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:47.255905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212dc9c-de29-45da-bbcd-17e2bb6dce78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:47.256791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212dc9c-de29-45da-bbcd-17e2bb6dce78 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:47.256932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212dc9c-de29-45da-bbcd-17e2bb6dce78 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:47.257504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212dc9c-de29-45da-bbcd-17e2bb6dce78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:47.259101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3212dc9c-de29-45da-bbcd-17e2bb6dce78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:47.265100 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 698/1401] 10.222.0.16 () {58 vars in 1040 bytes} [Fri Sep 30 09:33:47 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:47.278218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a514fae-0132-435e-83c2-f807d72b535f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:47.288986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a514fae-0132-435e-83c2-f807d72b535f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:47.355902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212dc9c-de29-45da-bbcd-17e2bb6dce78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:47.357547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212dc9c-de29-45da-bbcd-17e2bb6dce78 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:47.375936 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 704/1402] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:33:47.396736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d40fda-5428-4407-9221-b6921362de12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:47.397354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d40fda-5428-4407-9221-b6921362de12 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:47.397664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d40fda-5428-4407-9221-b6921362de12 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:47.397928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d40fda-5428-4407-9221-b6921362de12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:47.399552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f5d40fda-5428-4407-9221-b6921362de12 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:47.428189 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:47.500924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d40fda-5428-4407-9221-b6921362de12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:47.503021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d40fda-5428-4407-9221-b6921362de12 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:47.516842 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 699/1403] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:33:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 09:33:49.754368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dd54c-1cf6-4d1b-995d-17dc6027bc7a None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:49.754368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dd54c-1cf6-4d1b-995d-17dc6027bc7a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:49.754368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dd54c-1cf6-4d1b-995d-17dc6027bc7a None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:49.756062 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 705/1404] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:33:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:49.762985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ee4ab-f5d7-4eea-aab8-fa0a1d0e4b5d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:49.763436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ee4ab-f5d7-4eea-aab8-fa0a1d0e4b5d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:49.763535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ee4ab-f5d7-4eea-aab8-fa0a1d0e4b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:49.836882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0a4ee4ab-f5d7-4eea-aab8-fa0a1d0e4b5d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:49.838416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0a4ee4ab-f5d7-4eea-aab8-fa0a1d0e4b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:49.952462 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 700/1405] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:50.253892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879dd54c-1cf6-4d1b-995d-17dc6027bc7a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:50.255839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-879dd54c-1cf6-4d1b-995d-17dc6027bc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:50.375515 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:50.410467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879dd54c-1cf6-4d1b-995d-17dc6027bc7a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:50.542148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3ec59-fa76-4714-8a58-fa75ea8e0d39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:50.542752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3ec59-fa76-4714-8a58-fa75ea8e0d39 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:50.543027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3ec59-fa76-4714-8a58-fa75ea8e0d39 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:50.543291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3ec59-fa76-4714-8a58-fa75ea8e0d39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:50.544995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9cd3ec59-fa76-4714-8a58-fa75ea8e0d39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:50.649962 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:50.661109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3ec59-fa76-4714-8a58-fa75ea8e0d39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:50.662709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3ec59-fa76-4714-8a58-fa75ea8e0d39 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:50.685263 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 706/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:33:52.927105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c08312-f4af-4fa9-9b84-74bcf9ad82d7 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:52.927589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c08312-f4af-4fa9-9b84-74bcf9ad82d7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:52.927672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c08312-f4af-4fa9-9b84-74bcf9ad82d7 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:52.932943 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 701/1407] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:33:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:33:52.935234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799829ec-8470-4616-b8e9-52cc09f8e7ad None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:52.935648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799829ec-8470-4616-b8e9-52cc09f8e7ad None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:52.935778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799829ec-8470-4616-b8e9-52cc09f8e7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:53.135001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-799829ec-8470-4616-b8e9-52cc09f8e7ad None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:33:53.136490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-799829ec-8470-4616-b8e9-52cc09f8e7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:53.239646 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 707/1408] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:33:53.526838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c08312-f4af-4fa9-9b84-74bcf9ad82d7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:33:53.528513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e6c08312-f4af-4fa9-9b84-74bcf9ad82d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:53.550644 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:53.697615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c08312-f4af-4fa9-9b84-74bcf9ad82d7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:33:53.800121 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:33:53.826442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69341a-af8c-4d29-843b-f311753d4f54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:33:53.827493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69341a-af8c-4d29-843b-f311753d4f54 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:33:53.827867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69341a-af8c-4d29-843b-f311753d4f54 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:33:53.828193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69341a-af8c-4d29-843b-f311753d4f54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:33:53.829909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bb69341a-af8c-4d29-843b-f311753d4f54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:33:53.942659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69341a-af8c-4d29-843b-f311753d4f54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:33:53.944268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69341a-af8c-4d29-843b-f311753d4f54 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:33:53.968143 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 702/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:33:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:34:03.238317 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=74 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:03.965826 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=54 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:11.184941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb570d5-63b8-4072-a6de-4a1a7320e073 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:11.185473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb570d5-63b8-4072-a6de-4a1a7320e073 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:11.185473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb570d5-63b8-4072-a6de-4a1a7320e073 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:11.186747 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 708/1410] 10.222.0.16 () {54 vars in 918 bytes} [Fri Sep 30 09:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:34:11.191886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d68d4f-6ac6-45ba-a064-9bb0b65e05fd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:11.192299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d68d4f-6ac6-45ba-a064-9bb0b65e05fd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:11.192428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d68d4f-6ac6-45ba-a064-9bb0b65e05fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:11.273437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f3d68d4f-6ac6-45ba-a064-9bb0b65e05fd None None] MFA Rules not processed for user `cbb22d0675bc4ca893b0477cebd470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:34:11.275266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f3d68d4f-6ac6-45ba-a064-9bb0b65e05fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:11.380157 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 703/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Fri Sep 30 09:34:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:34:11.394733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c54a7-1ed6-4422-8679-5e51d6131ce4 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:11.395042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c54a7-1ed6-4422-8679-5e51d6131ce4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:11.395308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c54a7-1ed6-4422-8679-5e51d6131ce4 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:11.396631 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 709/1412] 10.222.0.16 () {54 vars in 918 bytes} [Fri Sep 30 09:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:34:11.401940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66931f11-efc6-43bb-8fc0-8cc39c3269cd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:11.402222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66931f11-efc6-43bb-8fc0-8cc39c3269cd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:11.402492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66931f11-efc6-43bb-8fc0-8cc39c3269cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:11.474520 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:11.477542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-66931f11-efc6-43bb-8fc0-8cc39c3269cd None None] MFA Rules not processed for user `aa607111024540d1a09b01dfd1e5e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:34:11.479274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-66931f11-efc6-43bb-8fc0-8cc39c3269cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:11.598958 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 704/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Fri Sep 30 09:34:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:34:14.191542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b19c4c-e197-49ce-bfce-6df9035cba03 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:14.192075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b19c4c-e197-49ce-bfce-6df9035cba03 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:14.192075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b19c4c-e197-49ce-bfce-6df9035cba03 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:14.193349 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:34:14.199251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ae4d5-3b71-47f1-992b-c6f3922f491a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:14.199633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ae4d5-3b71-47f1-992b-c6f3922f491a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:14.199829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ae4d5-3b71-47f1-992b-c6f3922f491a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:14.266233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1b5ae4d5-3b71-47f1-992b-c6f3922f491a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:34:14.267434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1b5ae4d5-3b71-47f1-992b-c6f3922f491a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:14.321287 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:14.364697 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:34:14.654899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b19c4c-e197-49ce-bfce-6df9035cba03 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:34:14.656710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-70b19c4c-e197-49ce-bfce-6df9035cba03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:14.799755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b19c4c-e197-49ce-bfce-6df9035cba03 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:34:14.874303 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:14.921676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb394abc-658b-47c8-8f3a-ac95493af0d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:34:14.921881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb394abc-658b-47c8-8f3a-ac95493af0d9 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:14.922156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb394abc-658b-47c8-8f3a-ac95493af0d9 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:14.922423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb394abc-658b-47c8-8f3a-ac95493af0d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:14.924000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eb394abc-658b-47c8-8f3a-ac95493af0d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:15.012863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb394abc-658b-47c8-8f3a-ac95493af0d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:34:15.014448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb394abc-658b-47c8-8f3a-ac95493af0d9 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:34:15.032408 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 711/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:34:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:34:16.180348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bc841-aea2-4150-aa33-4cd656cde01a None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:16.180845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bc841-aea2-4150-aa33-4cd656cde01a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:16.180945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bc841-aea2-4150-aa33-4cd656cde01a None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:16.182304 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:34:16.188643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a4182-9756-4620-9280-b5cacdadf975 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:16.189064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a4182-9756-4620-9280-b5cacdadf975 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:16.189203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a4182-9756-4620-9280-b5cacdadf975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:16.262887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4d4a4182-9756-4620-9280-b5cacdadf975 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:34:16.264078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4d4a4182-9756-4620-9280-b5cacdadf975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:16.294940 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:16.369957 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:34:16.535090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bc841-aea2-4150-aa33-4cd656cde01a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:34:16.536594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f50bc841-aea2-4150-aa33-4cd656cde01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:16.690065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bc841-aea2-4150-aa33-4cd656cde01a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:34:16.731960 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:16.803348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ada363-f705-4ca7-a1e9-ca4c83c4df74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:34:16.803862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ada363-f705-4ca7-a1e9-ca4c83c4df74 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:16.804132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ada363-f705-4ca7-a1e9-ca4c83c4df74 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:16.804394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ada363-f705-4ca7-a1e9-ca4c83c4df74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:16.806492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-22ada363-f705-4ca7-a1e9-ca4c83c4df74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:16.895346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ada363-f705-4ca7-a1e9-ca4c83c4df74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:34:16.896956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ada363-f705-4ca7-a1e9-ca4c83c4df74 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:34:16.914828 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 707/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:34:18.055341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a6a2d-2532-47e5-baf8-e31a395398cb None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:18.055898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a6a2d-2532-47e5-baf8-e31a395398cb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:18.055898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a6a2d-2532-47e5-baf8-e31a395398cb None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:18.057280 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:34:18.063563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb3372-60cb-40d9-9f6e-656a2082d4a3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:18.063994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb3372-60cb-40d9-9f6e-656a2082d4a3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:18.064089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb3372-60cb-40d9-9f6e-656a2082d4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:18.118497 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:18.140391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-01fb3372-60cb-40d9-9f6e-656a2082d4a3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:34:18.141654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-01fb3372-60cb-40d9-9f6e-656a2082d4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:18.238473 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:34:18.399304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a6a2d-2532-47e5-baf8-e31a395398cb None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:34:18.400838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-971a6a2d-2532-47e5-baf8-e31a395398cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:18.544024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a6a2d-2532-47e5-baf8-e31a395398cb None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:34:18.556460 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:18.656012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3ea7d-6d3c-4523-8b79-f048b3b02a6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:34:18.656626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3ea7d-6d3c-4523-8b79-f048b3b02a6b service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:18.656908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3ea7d-6d3c-4523-8b79-f048b3b02a6b service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:18.657171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3ea7d-6d3c-4523-8b79-f048b3b02a6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:18.658775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-17e3ea7d-6d3c-4523-8b79-f048b3b02a6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:18.748969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3ea7d-6d3c-4523-8b79-f048b3b02a6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:34:18.750535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3ea7d-6d3c-4523-8b79-f048b3b02a6b service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:34:18.767944 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 714/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:34:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:34:19.875825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af48f3-7835-468c-a8f1-4dd37189538b None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:19.876392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af48f3-7835-468c-a8f1-4dd37189538b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:19.876392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af48f3-7835-468c-a8f1-4dd37189538b None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:19.877727 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:34:19.883972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26be881-f3e2-4254-8b18-f37d335bbb43 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:19.884415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26be881-f3e2-4254-8b18-f37d335bbb43 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:19.884513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26be881-f3e2-4254-8b18-f37d335bbb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:19.905606 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:19.963466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d26be881-f3e2-4254-8b18-f37d335bbb43 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:34:19.964752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d26be881-f3e2-4254-8b18-f37d335bbb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:20.058900 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:34:20.209743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af48f3-7835-468c-a8f1-4dd37189538b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:34:20.210883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-07af48f3-7835-468c-a8f1-4dd37189538b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:20.319408 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:20.355615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af48f3-7835-468c-a8f1-4dd37189538b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:34:20.467130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022375d-ccb2-4b59-8110-8152176cd502 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:34:20.467655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022375d-ccb2-4b59-8110-8152176cd502 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:20.467931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022375d-ccb2-4b59-8110-8152176cd502 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:20.468201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022375d-ccb2-4b59-8110-8152176cd502 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:20.469856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2022375d-ccb2-4b59-8110-8152176cd502 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:20.544855 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:20.559120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022375d-ccb2-4b59-8110-8152176cd502 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:34:20.560826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022375d-ccb2-4b59-8110-8152176cd502 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:34:20.579298 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 710/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:34:21.692519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca3b86-c17d-4c67-9363-f53b92bbc25d None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:21.693147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca3b86-c17d-4c67-9363-f53b92bbc25d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:21.693429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca3b86-c17d-4c67-9363-f53b92bbc25d None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:21.695843 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:34:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:34:21.704859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5684f-fbf2-46ea-8324-a1cf3f1336df None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:21.705421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5684f-fbf2-46ea-8324-a1cf3f1336df None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:21.705623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5684f-fbf2-46ea-8324-a1cf3f1336df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:21.793612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c5f5684f-fbf2-46ea-8324-a1cf3f1336df None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:34:21.795541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c5f5684f-fbf2-46ea-8324-a1cf3f1336df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:21.915748 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:34:22.094208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca3b86-c17d-4c67-9363-f53b92bbc25d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:34:22.096406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-98ca3b86-c17d-4c67-9363-f53b92bbc25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:22.198271 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:22.260150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca3b86-c17d-4c67-9363-f53b92bbc25d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:34:22.371981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b28ec-8df3-40ad-887c-4d008df22825 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:34:22.372576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b28ec-8df3-40ad-887c-4d008df22825 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:22.372879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b28ec-8df3-40ad-887c-4d008df22825 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:22.373144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b28ec-8df3-40ad-887c-4d008df22825 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:22.374723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ad2b28ec-8df3-40ad-887c-4d008df22825 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:22.421519 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:22.462015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b28ec-8df3-40ad-887c-4d008df22825 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:34:22.463514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b28ec-8df3-40ad-887c-4d008df22825 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:34:22.481528 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 717/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:34:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:34:23.524582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dd249-20ee-4555-a7f8-4a4b3bf74f36 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:23.525166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dd249-20ee-4555-a7f8-4a4b3bf74f36 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:23.525166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dd249-20ee-4555-a7f8-4a4b3bf74f36 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:23.526517 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:34:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:34:23.532565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e71ac-b5d3-487d-bf78-6920fab5dfa2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:23.533014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e71ac-b5d3-487d-bf78-6920fab5dfa2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:23.533131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e71ac-b5d3-487d-bf78-6920fab5dfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:23.608051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-926e71ac-b5d3-487d-bf78-6920fab5dfa2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:34:23.609181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-926e71ac-b5d3-487d-bf78-6920fab5dfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:23.702586 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:34:23.857997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2dd249-20ee-4555-a7f8-4a4b3bf74f36 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:34:23.859573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6e2dd249-20ee-4555-a7f8-4a4b3bf74f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:23.909181 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:24.006038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2dd249-20ee-4555-a7f8-4a4b3bf74f36 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:34:24.116550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc3552-a721-4ce3-9ad7-acbe2e212c12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:34:24.117104 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc3552-a721-4ce3-9ad7-acbe2e212c12 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:24.117424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc3552-a721-4ce3-9ad7-acbe2e212c12 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:24.117789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc3552-a721-4ce3-9ad7-acbe2e212c12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:24.119374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2cdc3552-a721-4ce3-9ad7-acbe2e212c12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:24.126132 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:24.207767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc3552-a721-4ce3-9ad7-acbe2e212c12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:34:24.209373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc3552-a721-4ce3-9ad7-acbe2e212c12 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:34:24.226732 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 713/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:34:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:34:25.282763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac83794-d209-4bd8-a946-26dcc6dc7902 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:25.283308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac83794-d209-4bd8-a946-26dcc6dc7902 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:25.283308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac83794-d209-4bd8-a946-26dcc6dc7902 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:25.284679 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:34:25.291323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab24db8-6e03-43cc-876c-b604069e1d05 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:25.291769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab24db8-6e03-43cc-876c-b604069e1d05 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:25.291864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab24db8-6e03-43cc-876c-b604069e1d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:25.374968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cab24db8-6e03-43cc-876c-b604069e1d05 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:34:25.376148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cab24db8-6e03-43cc-876c-b604069e1d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:25.442998 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:25.472490 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:34:25.628229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac83794-d209-4bd8-a946-26dcc6dc7902 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:34:25.629691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eac83794-d209-4bd8-a946-26dcc6dc7902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:25.656111 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:25.785680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac83794-d209-4bd8-a946-26dcc6dc7902 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:34:25.874862 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:25.901762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b69078-3e1f-4d82-9594-df1fcedaa29d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:34:25.902296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b69078-3e1f-4d82-9594-df1fcedaa29d service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:25.902573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b69078-3e1f-4d82-9594-df1fcedaa29d service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:25.902841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b69078-3e1f-4d82-9594-df1fcedaa29d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:25.904429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c8b69078-3e1f-4d82-9594-df1fcedaa29d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:25.996800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b69078-3e1f-4d82-9594-df1fcedaa29d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:34:25.998373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b69078-3e1f-4d82-9594-df1fcedaa29d service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:34:26.016292 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 720/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:34:27.078043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6298fa-e2ce-4e73-a803-fd418ddc9e6b None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:27.078608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6298fa-e2ce-4e73-a803-fd418ddc9e6b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:27.078608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6298fa-e2ce-4e73-a803-fd418ddc9e6b None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:27.079898 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:34:27.086041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259db8bb-46ea-44c9-b934-6579eb122af1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:27.087013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259db8bb-46ea-44c9-b934-6579eb122af1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:27.087212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259db8bb-46ea-44c9-b934-6579eb122af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:27.161957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-259db8bb-46ea-44c9-b934-6579eb122af1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:34:27.163152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-259db8bb-46ea-44c9-b934-6579eb122af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:27.205279 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:27.257535 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:34:27.407759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6298fa-e2ce-4e73-a803-fd418ddc9e6b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:34:27.409307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2a6298fa-e2ce-4e73-a803-fd418ddc9e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:27.558768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6298fa-e2ce-4e73-a803-fd418ddc9e6b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:34:27.612944 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:27.670795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843cf49-94d5-4fe2-879d-8fc4195a70ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:34:27.671388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843cf49-94d5-4fe2-879d-8fc4195a70ed service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:27.671660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843cf49-94d5-4fe2-879d-8fc4195a70ed service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:27.671925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843cf49-94d5-4fe2-879d-8fc4195a70ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:27.673535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d843cf49-94d5-4fe2-879d-8fc4195a70ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:27.762573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843cf49-94d5-4fe2-879d-8fc4195a70ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:34:27.764072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843cf49-94d5-4fe2-879d-8fc4195a70ed service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:34:27.782515 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 716/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:34:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:34:28.833717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691e225-c01f-4a9e-8b2e-692496159d92 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:28.834264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691e225-c01f-4a9e-8b2e-692496159d92 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:28.834264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691e225-c01f-4a9e-8b2e-692496159d92 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:28.835612 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:34:28.842338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d173a96-eccd-49a1-bed2-663cfb72fcf8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:28.842787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d173a96-eccd-49a1-bed2-663cfb72fcf8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:28.842885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d173a96-eccd-49a1-bed2-663cfb72fcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:28.917850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6d173a96-eccd-49a1-bed2-663cfb72fcf8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:34:28.919048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6d173a96-eccd-49a1-bed2-663cfb72fcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:28.921350 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:29.016867 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:34:29.178927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691e225-c01f-4a9e-8b2e-692496159d92 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:34:29.180449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f691e225-c01f-4a9e-8b2e-692496159d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:29.325337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691e225-c01f-4a9e-8b2e-692496159d92 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:34:29.351926 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:29.436904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714808f0-df21-4f08-9877-e9ca2e616984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:34:29.437423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714808f0-df21-4f08-9877-e9ca2e616984 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:29.437700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714808f0-df21-4f08-9877-e9ca2e616984 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:29.437968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714808f0-df21-4f08-9877-e9ca2e616984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:29.439598 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-714808f0-df21-4f08-9877-e9ca2e616984 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:29.530781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714808f0-df21-4f08-9877-e9ca2e616984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:34:29.532399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714808f0-df21-4f08-9877-e9ca2e616984 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:34:29.549953 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 723/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:34:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:34:31.659027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c4634-f0e2-43fb-a901-701247d45775 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:31.659591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c4634-f0e2-43fb-a901-701247d45775 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:31.659591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c4634-f0e2-43fb-a901-701247d45775 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:31.660913 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:34:31.666343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2b700-99cd-4b19-b3d5-5a812473acbc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:31.666771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2b700-99cd-4b19-b3d5-5a812473acbc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:31.666874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2b700-99cd-4b19-b3d5-5a812473acbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:31.707774 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:31.733508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7dc2b700-99cd-4b19-b3d5-5a812473acbc None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:34:31.734714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7dc2b700-99cd-4b19-b3d5-5a812473acbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:31.829872 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:34:32.146521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c4634-f0e2-43fb-a901-701247d45775 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:34:32.148038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-903c4634-f0e2-43fb-a901-701247d45775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:32.255440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c4634-f0e2-43fb-a901-701247d45775 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:34:32.290076 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:32.331274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181151d-1e5d-4fa1-bbfe-2f52953ebf28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:34:32.331863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181151d-1e5d-4fa1-bbfe-2f52953ebf28 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:32.332135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181151d-1e5d-4fa1-bbfe-2f52953ebf28 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:32.332402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181151d-1e5d-4fa1-bbfe-2f52953ebf28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:32.333996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2181151d-1e5d-4fa1-bbfe-2f52953ebf28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:32.440283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181151d-1e5d-4fa1-bbfe-2f52953ebf28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:34:32.441732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181151d-1e5d-4fa1-bbfe-2f52953ebf28 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:34:32.459231 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 719/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:34:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:34:34.837975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8d442-1312-4243-a898-ed9f39b0ecf9 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:34.838587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8d442-1312-4243-a898-ed9f39b0ecf9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:34.838587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8d442-1312-4243-a898-ed9f39b0ecf9 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:34.839958 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:34:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:34:34.845259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c14ac6-1a8b-465a-ae69-81d662916262 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:34.845649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c14ac6-1a8b-465a-ae69-81d662916262 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:34.845811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c14ac6-1a8b-465a-ae69-81d662916262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:34.912108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-75c14ac6-1a8b-465a-ae69-81d662916262 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:34:34.913340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-75c14ac6-1a8b-465a-ae69-81d662916262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:34.927624 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:35.013218 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:34:35.297877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8d442-1312-4243-a898-ed9f39b0ecf9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:34:35.299403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-78d8d442-1312-4243-a898-ed9f39b0ecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:35.403179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8d442-1312-4243-a898-ed9f39b0ecf9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:34:35.415646 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:35.477207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42377d-15d1-4ad4-a827-c8bed8d5ccaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:34:35.477800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42377d-15d1-4ad4-a827-c8bed8d5ccaa service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:35.478093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42377d-15d1-4ad4-a827-c8bed8d5ccaa service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:35.478341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42377d-15d1-4ad4-a827-c8bed8d5ccaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:35.479916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cf42377d-15d1-4ad4-a827-c8bed8d5ccaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:35.586074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42377d-15d1-4ad4-a827-c8bed8d5ccaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:34:35.587462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42377d-15d1-4ad4-a827-c8bed8d5ccaa service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:34:35.605370 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 726/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:34:38.049074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d14d0-1d8f-4697-875d-fa3299ec5c2b None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:38.049719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d14d0-1d8f-4697-875d-fa3299ec5c2b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:38.049719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d14d0-1d8f-4697-875d-fa3299ec5c2b None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:38.050957 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:34:38.056775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8165420-d6b6-4e20-8e76-8110faf63831 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:38.057195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8165420-d6b6-4e20-8e76-8110faf63831 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:38.057355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8165420-d6b6-4e20-8e76-8110faf63831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:38.106834 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:38.125014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a8165420-d6b6-4e20-8e76-8110faf63831 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:34:38.126211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a8165420-d6b6-4e20-8e76-8110faf63831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:38.220150 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:34:38.501739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d14d0-1d8f-4697-875d-fa3299ec5c2b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:34:38.503266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c71d14d0-1d8f-4697-875d-fa3299ec5c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:38.604974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d14d0-1d8f-4697-875d-fa3299ec5c2b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:34:38.644879 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:38.677951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a5a5d-80a9-4c0f-8ced-df94e1b3ca42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:34:38.678548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a5a5d-80a9-4c0f-8ced-df94e1b3ca42 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:38.678817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a5a5d-80a9-4c0f-8ced-df94e1b3ca42 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:38.679080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a5a5d-80a9-4c0f-8ced-df94e1b3ca42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:38.681190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-141a5a5d-80a9-4c0f-8ced-df94e1b3ca42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:38.787109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a5a5d-80a9-4c0f-8ced-df94e1b3ca42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:34:38.788418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a5a5d-80a9-4c0f-8ced-df94e1b3ca42 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:34:38.807499 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 722/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:34:41.082420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493cc66-ee94-454c-9045-acb07f7f7f4e None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:41.082971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493cc66-ee94-454c-9045-acb07f7f7f4e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:41.082971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493cc66-ee94-454c-9045-acb07f7f7f4e None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:41.084365 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:34:41.090283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d4929-5920-49cc-9def-045e19ad7c2a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:41.090713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d4929-5920-49cc-9def-045e19ad7c2a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:41.090841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d4929-5920-49cc-9def-045e19ad7c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:41.158170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-830d4929-5920-49cc-9def-045e19ad7c2a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:34:41.159401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-830d4929-5920-49cc-9def-045e19ad7c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:41.181734 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:41.263216 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:34:41.554385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493cc66-ee94-454c-9045-acb07f7f7f4e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:34:41.556520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4493cc66-ee94-454c-9045-acb07f7f7f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:41.670319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493cc66-ee94-454c-9045-acb07f7f7f4e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:34:41.690952 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:41.744283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bc032-4c33-435f-a0d3-73fe65ccd1a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:34:41.744902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bc032-4c33-435f-a0d3-73fe65ccd1a4 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:41.745176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bc032-4c33-435f-a0d3-73fe65ccd1a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:41.745443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bc032-4c33-435f-a0d3-73fe65ccd1a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:41.747021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-867bc032-4c33-435f-a0d3-73fe65ccd1a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:41.854002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bc032-4c33-435f-a0d3-73fe65ccd1a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:34:41.855335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bc032-4c33-435f-a0d3-73fe65ccd1a4 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:34:41.873147 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 729/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:34:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:34:44.186313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52eea52-79bf-4d35-82fd-48cbc05c62b6 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:44.186835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52eea52-79bf-4d35-82fd-48cbc05c62b6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:44.186835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52eea52-79bf-4d35-82fd-48cbc05c62b6 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:44.188109 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:34:44.193520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ddde9-e77e-491e-a70d-55eaded61650 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:44.193916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ddde9-e77e-491e-a70d-55eaded61650 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:44.194077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ddde9-e77e-491e-a70d-55eaded61650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:44.259121 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:44.262524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c13ddde9-e77e-491e-a70d-55eaded61650 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:34:44.264090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c13ddde9-e77e-491e-a70d-55eaded61650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:44.357555 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:34:44.643947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52eea52-79bf-4d35-82fd-48cbc05c62b6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:34:44.645506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f52eea52-79bf-4d35-82fd-48cbc05c62b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:44.750333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52eea52-79bf-4d35-82fd-48cbc05c62b6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:34:44.799265 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:44.823674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49900c60-44dc-4c17-8aa0-cf6e917069c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:34:44.824263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49900c60-44dc-4c17-8aa0-cf6e917069c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:44.824533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49900c60-44dc-4c17-8aa0-cf6e917069c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:44.824824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49900c60-44dc-4c17-8aa0-cf6e917069c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:44.826403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-49900c60-44dc-4c17-8aa0-cf6e917069c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:44.938186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49900c60-44dc-4c17-8aa0-cf6e917069c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:34:44.939589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49900c60-44dc-4c17-8aa0-cf6e917069c2 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:34:44.957503 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 725/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:34:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:34:47.215029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13031d58-c498-4aed-997e-283270020e60 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:47.215561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13031d58-c498-4aed-997e-283270020e60 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:47.215561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13031d58-c498-4aed-997e-283270020e60 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:47.216857 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:34:47.222206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bcc39-1c5d-472f-a57b-bd140946588a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:47.222608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bcc39-1c5d-472f-a57b-bd140946588a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:47.222755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bcc39-1c5d-472f-a57b-bd140946588a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:47.288105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-125bcc39-1c5d-472f-a57b-bd140946588a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:34:47.289451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-125bcc39-1c5d-472f-a57b-bd140946588a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:47.317643 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:47.388450 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:34:47.673876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13031d58-c498-4aed-997e-283270020e60 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:34:47.675429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-13031d58-c498-4aed-997e-283270020e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:47.806138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13031d58-c498-4aed-997e-283270020e60 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:34:47.833662 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:47.878946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32990e58-da16-4ee0-84f9-3f10c7dd59c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:34:47.879543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32990e58-da16-4ee0-84f9-3f10c7dd59c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:47.879815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32990e58-da16-4ee0-84f9-3f10c7dd59c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:47.880078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32990e58-da16-4ee0-84f9-3f10c7dd59c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:47.881695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-32990e58-da16-4ee0-84f9-3f10c7dd59c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:47.990918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32990e58-da16-4ee0-84f9-3f10c7dd59c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:34:47.993008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32990e58-da16-4ee0-84f9-3f10c7dd59c1 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:34:48.010865 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 732/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:34:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:34:50.226253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b351aa-768a-4c9f-8739-f650777dbe9b None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:50.226780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b351aa-768a-4c9f-8739-f650777dbe9b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:50.226780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b351aa-768a-4c9f-8739-f650777dbe9b None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:50.228274 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:34:50.233623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b97e44-b87e-424a-972a-ba3830f5a7c5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:50.234054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b97e44-b87e-424a-972a-ba3830f5a7c5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:50.234166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b97e44-b87e-424a-972a-ba3830f5a7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:50.298749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-27b97e44-b87e-424a-972a-ba3830f5a7c5 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:34:50.299946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-27b97e44-b87e-424a-972a-ba3830f5a7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:50.308283 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:50.394925 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:34:50.680407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b351aa-768a-4c9f-8739-f650777dbe9b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:34:50.681988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f2b351aa-768a-4c9f-8739-f650777dbe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:50.786643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b351aa-768a-4c9f-8739-f650777dbe9b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:34:50.843784 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:50.861609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563dd5d-b1ac-4a85-ade3-7055f731eb07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:34:50.862207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563dd5d-b1ac-4a85-ade3-7055f731eb07 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:50.862481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563dd5d-b1ac-4a85-ade3-7055f731eb07 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:50.862748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563dd5d-b1ac-4a85-ade3-7055f731eb07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:50.864332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d563dd5d-b1ac-4a85-ade3-7055f731eb07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:50.973211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563dd5d-b1ac-4a85-ade3-7055f731eb07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:34:50.974537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563dd5d-b1ac-4a85-ade3-7055f731eb07 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:34:50.992140 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 728/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:34:53.177679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c62f-5cb5-408c-aa62-28ef4124163c None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:53.178218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c62f-5cb5-408c-aa62-28ef4124163c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:53.178218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c62f-5cb5-408c-aa62-28ef4124163c None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:53.179462 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:34:53.184707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b49ec-17e2-462b-8e71-e772ef1b318f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:53.185112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b49ec-17e2-462b-8e71-e772ef1b318f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:53.185242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b49ec-17e2-462b-8e71-e772ef1b318f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:53.250363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b15b49ec-17e2-462b-8e71-e772ef1b318f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:34:53.251559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b15b49ec-17e2-462b-8e71-e772ef1b318f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:53.289767 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:53.348972 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:34:53.632237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5c62f-5cb5-408c-aa62-28ef4124163c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:34:53.634449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-04d5c62f-5cb5-408c-aa62-28ef4124163c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:53.735500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5c62f-5cb5-408c-aa62-28ef4124163c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:34:53.773604 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:53.809458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb29f86-e8fe-4343-bc1e-c563914c0b2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:34:53.810062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb29f86-e8fe-4343-bc1e-c563914c0b2b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:53.810336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb29f86-e8fe-4343-bc1e-c563914c0b2b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:53.810602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb29f86-e8fe-4343-bc1e-c563914c0b2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:53.812185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6eb29f86-e8fe-4343-bc1e-c563914c0b2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:53.923095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb29f86-e8fe-4343-bc1e-c563914c0b2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:34:53.924520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb29f86-e8fe-4343-bc1e-c563914c0b2b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:34:53.942779 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 735/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:34:56.150390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e4fe1-6cfd-4aa8-80ba-5207b9080d6c None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:56.150977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e4fe1-6cfd-4aa8-80ba-5207b9080d6c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:56.150977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e4fe1-6cfd-4aa8-80ba-5207b9080d6c None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:56.152373 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:34:56.158373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b63d0-d5a2-4a4f-94dc-6e1d28451409 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:56.158938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b63d0-d5a2-4a4f-94dc-6e1d28451409 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:56.158938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b63d0-d5a2-4a4f-94dc-6e1d28451409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:56.233134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-255b63d0-d5a2-4a4f-94dc-6e1d28451409 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:34:56.234319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-255b63d0-d5a2-4a4f-94dc-6e1d28451409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:56.251548 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:56.328242 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:34:56.613485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e4fe1-6cfd-4aa8-80ba-5207b9080d6c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:34:56.614996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a41e4fe1-6cfd-4aa8-80ba-5207b9080d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:56.717409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e4fe1-6cfd-4aa8-80ba-5207b9080d6c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:34:56.792114 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:56.799271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e458d-63af-4504-9d48-1f39caa4adab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:34:56.799871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e458d-63af-4504-9d48-1f39caa4adab service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:56.800148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e458d-63af-4504-9d48-1f39caa4adab service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:56.800416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e458d-63af-4504-9d48-1f39caa4adab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:56.802041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d43e458d-63af-4504-9d48-1f39caa4adab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:56.912968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e458d-63af-4504-9d48-1f39caa4adab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:34:56.914369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e458d-63af-4504-9d48-1f39caa4adab service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:34:56.934020 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 731/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:34:59.094381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0957cd-f068-4a73-81e3-e36b4311cafa None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:59.094910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0957cd-f068-4a73-81e3-e36b4311cafa None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:59.094910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0957cd-f068-4a73-81e3-e36b4311cafa None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:59.096247 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:34:59.101564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb144ea-4a97-4178-9b05-ebd4c35e75e2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:59.102514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb144ea-4a97-4178-9b05-ebd4c35e75e2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:59.102727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb144ea-4a97-4178-9b05-ebd4c35e75e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:59.171574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7fb144ea-4a97-4178-9b05-ebd4c35e75e2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:34:59.172735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7fb144ea-4a97-4178-9b05-ebd4c35e75e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:59.220573 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:59.271342 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:34:59.553545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0957cd-f068-4a73-81e3-e36b4311cafa None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:34:59.555565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0a0957cd-f068-4a73-81e3-e36b4311cafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:59.657343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0957cd-f068-4a73-81e3-e36b4311cafa None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:34:59.705659 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:34:59.732063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19baffd-7906-460e-b863-f0bb4edfdb42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:34:59.732696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19baffd-7906-460e-b863-f0bb4edfdb42 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:34:59.732979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19baffd-7906-460e-b863-f0bb4edfdb42 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:34:59.733249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19baffd-7906-460e-b863-f0bb4edfdb42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:34:59.734833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a19baffd-7906-460e-b863-f0bb4edfdb42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:34:59.844685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19baffd-7906-460e-b863-f0bb4edfdb42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:34:59.846034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19baffd-7906-460e-b863-f0bb4edfdb42 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:34:59.864131 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 738/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:09.269811 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=22 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:09.861942 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=66 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:20.236982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23953878-71d4-463a-9cba-8292926d4d1b None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:20.237512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23953878-71d4-463a-9cba-8292926d4d1b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:20.237512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23953878-71d4-463a-9cba-8292926d4d1b None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:20.238798 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 733/1471] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:35:20.244868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8a998-c0cd-4586-b60d-01dfd4827036 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:20.245262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8a998-c0cd-4586-b60d-01dfd4827036 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:20.245412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8a998-c0cd-4586-b60d-01dfd4827036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:20.312992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9cb8a998-c0cd-4586-b60d-01dfd4827036 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:20.314201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9cb8a998-c0cd-4586-b60d-01dfd4827036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:20.407889 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 739/1472] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:20.710200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7ddd8-c3ec-4b87-b5bb-1865f70a0e2a None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:20.710475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7ddd8-c3ec-4b87-b5bb-1865f70a0e2a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:20.710740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7ddd8-c3ec-4b87-b5bb-1865f70a0e2a None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:20.712980 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 734/1473] 10.222.0.16 () {54 vars in 962 bytes} [Fri Sep 30 09:35:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:35:20.717892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4906a-dee5-40db-9191-1b8cbffa952a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:20.718173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4906a-dee5-40db-9191-1b8cbffa952a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:20.718440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4906a-dee5-40db-9191-1b8cbffa952a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:20.792885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5ed4906a-dee5-40db-9191-1b8cbffa952a None None] MFA Rules not processed for user `ebc6604430ba4e2283994e5cb8ef18d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:20.794067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5ed4906a-dee5-40db-9191-1b8cbffa952a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:20.814430 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:20.870207 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 740/1474] 10.222.0.16 () {58 vars in 1059 bytes} [Fri Sep 30 09:35:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:20.877816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7ddd8-c3ec-4b87-b5bb-1865f70a0e2a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:20.879362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2da7ddd8-c3ec-4b87-b5bb-1865f70a0e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:20.983491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7ddd8-c3ec-4b87-b5bb-1865f70a0e2a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:21.060277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a2625-d79e-44f2-bbcf-2a0b03c44958 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:21.060901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a2625-d79e-44f2-bbcf-2a0b03c44958 service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:21.061178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a2625-d79e-44f2-bbcf-2a0b03c44958 service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:21.061445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a2625-d79e-44f2-bbcf-2a0b03c44958 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:21.063022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-413a2625-d79e-44f2-bbcf-2a0b03c44958 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:21.118259 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:21.172067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a2625-d79e-44f2-bbcf-2a0b03c44958 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:21.173494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a2625-d79e-44f2-bbcf-2a0b03c44958 service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:21.191500 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 735/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:23.537790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6372e-92bb-469c-add9-7bb38a45cbdf None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:23.538380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6372e-92bb-469c-add9-7bb38a45cbdf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:23.538380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6372e-92bb-469c-add9-7bb38a45cbdf None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:23.539720 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 741/1476] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:35:23.545192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd47035-2194-402d-b2ca-9d49f4e5ea55 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:23.545587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd47035-2194-402d-b2ca-9d49f4e5ea55 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:23.545729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd47035-2194-402d-b2ca-9d49f4e5ea55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:23.611334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9bd47035-2194-402d-b2ca-9d49f4e5ea55 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:23.612451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9bd47035-2194-402d-b2ca-9d49f4e5ea55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:23.708911 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 736/1477] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:23.982633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6372e-92bb-469c-add9-7bb38a45cbdf None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:23.984149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6dd6372e-92bb-469c-add9-7bb38a45cbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:24.108554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6372e-92bb-469c-add9-7bb38a45cbdf None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:24.159326 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:24.202905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc842487-6b31-4461-ba05-b60a6e31f280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:24.203703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc842487-6b31-4461-ba05-b60a6e31f280 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:24.203974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc842487-6b31-4461-ba05-b60a6e31f280 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:24.204235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc842487-6b31-4461-ba05-b60a6e31f280 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:24.204908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc842487-6b31-4461-ba05-b60a6e31f280 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:24.206622 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-dc842487-6b31-4461-ba05-b60a6e31f280 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:35:24.206622 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 09:35:24.206622 n-d-master-1 devstack@keystone.service[82079]: Sep 30 09:35:24.207744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc842487-6b31-4461-ba05-b60a6e31f280 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:24.226784 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 742/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Sep 30 09:35:23 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:35:26.390235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c280313-8632-4ff1-8543-abbc2401f75f None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:26.390805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c280313-8632-4ff1-8543-abbc2401f75f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:26.390805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c280313-8632-4ff1-8543-abbc2401f75f None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:26.392167 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 737/1479] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:35:26.397492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86efafb-1022-4f4c-8472-89f6680b6052 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:26.397869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86efafb-1022-4f4c-8472-89f6680b6052 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:26.398041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86efafb-1022-4f4c-8472-89f6680b6052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:26.463206 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a86efafb-1022-4f4c-8472-89f6680b6052 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:26.464327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a86efafb-1022-4f4c-8472-89f6680b6052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:26.559352 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 743/1480] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:35:26.883325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c280313-8632-4ff1-8543-abbc2401f75f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:26.884943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0c280313-8632-4ff1-8543-abbc2401f75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:26.894862 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:27.032689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c280313-8632-4ff1-8543-abbc2401f75f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:27.115568 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:27.150217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deed0b5-d5a8-45db-9230-2059b30e1ffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:27.150740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deed0b5-d5a8-45db-9230-2059b30e1ffd service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:27.151010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deed0b5-d5a8-45db-9230-2059b30e1ffd service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:27.151270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deed0b5-d5a8-45db-9230-2059b30e1ffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:27.152948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6deed0b5-d5a8-45db-9230-2059b30e1ffd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:27.240350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deed0b5-d5a8-45db-9230-2059b30e1ffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:27.241944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deed0b5-d5a8-45db-9230-2059b30e1ffd service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:27.259889 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 738/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:29.595905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ea7de-0e54-4e5c-afb8-4136de89a789 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:29.596428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ea7de-0e54-4e5c-afb8-4136de89a789 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:29.596428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ea7de-0e54-4e5c-afb8-4136de89a789 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:29.597720 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 744/1482] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:35:29.603069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53dde8-365b-4084-adec-d9bbdda16d51 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:29.603508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53dde8-365b-4084-adec-d9bbdda16d51 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:29.603663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53dde8-365b-4084-adec-d9bbdda16d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:29.668106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ca53dde8-365b-4084-adec-d9bbdda16d51 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:29.669326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ca53dde8-365b-4084-adec-d9bbdda16d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:29.716872 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:29.766470 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 739/1483] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:30.063991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ea7de-0e54-4e5c-afb8-4136de89a789 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:30.065673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6a9ea7de-0e54-4e5c-afb8-4136de89a789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:30.089907 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:30.171046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ea7de-0e54-4e5c-afb8-4136de89a789 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:30.243790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eda504-3319-4a54-9abc-731235b25707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:30.244318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eda504-3319-4a54-9abc-731235b25707 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:30.244648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eda504-3319-4a54-9abc-731235b25707 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:30.244914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eda504-3319-4a54-9abc-731235b25707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:30.246492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-44eda504-3319-4a54-9abc-731235b25707 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:30.319623 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:30.354894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eda504-3319-4a54-9abc-731235b25707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:30.356313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eda504-3319-4a54-9abc-731235b25707 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:30.374336 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 745/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:32.566745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d55734-13ad-4b02-b8f8-33354a486d1f None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:32.567406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d55734-13ad-4b02-b8f8-33354a486d1f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:32.567406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d55734-13ad-4b02-b8f8-33354a486d1f None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:32.568667 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 740/1485] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:35:32.573962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac12c0-feba-48af-a75f-36d3eb663996 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:32.574393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac12c0-feba-48af-a75f-36d3eb663996 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:32.574507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac12c0-feba-48af-a75f-36d3eb663996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:32.639292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b2ac12c0-feba-48af-a75f-36d3eb663996 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:32.640479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b2ac12c0-feba-48af-a75f-36d3eb663996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:32.734735 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 746/1486] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:33.026767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d55734-13ad-4b02-b8f8-33354a486d1f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:33.028287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-62d55734-13ad-4b02-b8f8-33354a486d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:33.130190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d55734-13ad-4b02-b8f8-33354a486d1f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:33.203702 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:33.205235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732fcd2d-7821-4ac2-b578-580d3bacaf75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:33.205909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fcd2d-7821-4ac2-b578-580d3bacaf75 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:33.206412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fcd2d-7821-4ac2-b578-580d3bacaf75 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:33.206856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fcd2d-7821-4ac2-b578-580d3bacaf75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:33.208630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-732fcd2d-7821-4ac2-b578-580d3bacaf75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:33.441735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732fcd2d-7821-4ac2-b578-580d3bacaf75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:33.443146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732fcd2d-7821-4ac2-b578-580d3bacaf75 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:33.462697 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 741/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:35.682144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31cdc8-db7b-4a94-8ed6-7aee9694c75c None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:35.682670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31cdc8-db7b-4a94-8ed6-7aee9694c75c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:35.682670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31cdc8-db7b-4a94-8ed6-7aee9694c75c None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:35.683917 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 747/1488] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:35:35.689152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00ac6b-4925-4815-99c7-1c70ed022ad3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:35.689553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00ac6b-4925-4815-99c7-1c70ed022ad3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:35.689691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00ac6b-4925-4815-99c7-1c70ed022ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:35.760181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ee00ac6b-4925-4815-99c7-1c70ed022ad3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:35.761418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ee00ac6b-4925-4815-99c7-1c70ed022ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:35.815502 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:35.858805 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 742/1489] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:35:36.146699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31cdc8-db7b-4a94-8ed6-7aee9694c75c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:36.148513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bf31cdc8-db7b-4a94-8ed6-7aee9694c75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:36.185552 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:36.251508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31cdc8-db7b-4a94-8ed6-7aee9694c75c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:36.322256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b3bb3-8332-4748-8692-cbd3e26d167e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:36.322842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b3bb3-8332-4748-8692-cbd3e26d167e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:36.323114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b3bb3-8332-4748-8692-cbd3e26d167e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:36.323373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b3bb3-8332-4748-8692-cbd3e26d167e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:36.324964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-349b3bb3-8332-4748-8692-cbd3e26d167e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:36.403890 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:36.434211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b3bb3-8332-4748-8692-cbd3e26d167e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:36.435621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b3bb3-8332-4748-8692-cbd3e26d167e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:36.454090 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 748/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:35:38.803406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf2263-a2ef-49f1-ba5c-8f1e8aad9493 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:38.803990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf2263-a2ef-49f1-ba5c-8f1e8aad9493 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:38.803990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf2263-a2ef-49f1-ba5c-8f1e8aad9493 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:38.805888 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 743/1491] 10.222.0.16 () {54 vars in 927 bytes} [Fri Sep 30 09:35:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:35:38.811396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca141b-d3ca-4d1f-9448-ba2a43124a95 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:38.811785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca141b-d3ca-4d1f-9448-ba2a43124a95 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:38.811959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca141b-d3ca-4d1f-9448-ba2a43124a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:38.878115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f4ca141b-d3ca-4d1f-9448-ba2a43124a95 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:35:38.879318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f4ca141b-d3ca-4d1f-9448-ba2a43124a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:38.978374 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 749/1492] 10.222.0.16 () {58 vars in 1024 bytes} [Fri Sep 30 09:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:35:39.269691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf2263-a2ef-49f1-ba5c-8f1e8aad9493 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:35:39.271249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-79bf2263-a2ef-49f1-ba5c-8f1e8aad9493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:39.376384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf2263-a2ef-49f1-ba5c-8f1e8aad9493 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:35:39.448413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffd1e3-9041-4b00-bea8-cec5fecd812e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:35:39.449036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffd1e3-9041-4b00-bea8-cec5fecd812e service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:35:39.449312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffd1e3-9041-4b00-bea8-cec5fecd812e service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:35:39.449581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffd1e3-9041-4b00-bea8-cec5fecd812e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:35:39.451193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c1ffd1e3-9041-4b00-bea8-cec5fecd812e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:35:39.461821 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:39.561692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffd1e3-9041-4b00-bea8-cec5fecd812e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:35:39.563010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffd1e3-9041-4b00-bea8-cec5fecd812e service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:35:39.580918 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 744/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:35:48.976803 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=82 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:35:49.578429 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=50 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:52.841949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d244f8-7dd0-4173-a101-b65d3efb6fe6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:52.842568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d244f8-7dd0-4173-a101-b65d3efb6fe6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:52.842568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d244f8-7dd0-4173-a101-b65d3efb6fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:52.918542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-85d244f8-7dd0-4173-a101-b65d3efb6fe6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:52.919190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-85d244f8-7dd0-4173-a101-b65d3efb6fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:53.015564 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 750/1494] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:53.024667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afde8a0-9b4f-437f-8dab-c2d8ee84b7da None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:53.025162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afde8a0-9b4f-437f-8dab-c2d8ee84b7da None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:53.025285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afde8a0-9b4f-437f-8dab-c2d8ee84b7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:53.098874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2afde8a0-9b4f-437f-8dab-c2d8ee84b7da None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:53.099974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2afde8a0-9b4f-437f-8dab-c2d8ee84b7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:53.197808 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 745/1495] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:53.202426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d244f8-7dd0-4173-a101-b65d3efb6fe6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:53.203618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-85d244f8-7dd0-4173-a101-b65d3efb6fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:53.215047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d244f8-7dd0-4173-a101-b65d3efb6fe6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:53.276355 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:53.308986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb020a0-ab86-499f-ba61-11c61d5ada9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:53.309576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb020a0-ab86-499f-ba61-11c61d5ada9f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:53.309846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb020a0-ab86-499f-ba61-11c61d5ada9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:53.310110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb020a0-ab86-499f-ba61-11c61d5ada9f admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:53.310732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb020a0-ab86-499f-ba61-11c61d5ada9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:36:53.311027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb020a0-ab86-499f-ba61-11c61d5ada9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:53.312021 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-9bb020a0-ab86-499f-ba61-11c61d5ada9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:36:53.312021 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 09:36:53.312021 n-d-master-1 devstack@keystone.service[82079]: Sep 30 09:36:53.312911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb020a0-ab86-499f-ba61-11c61d5ada9f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:53.325157 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 751/1496] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:36:53.333798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afde8a0-9b4f-437f-8dab-c2d8ee84b7da None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:53.342734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afde8a0-9b4f-437f-8dab-c2d8ee84b7da None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:53.403342 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:53.438192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca267bc-a8e3-4aa7-86dc-2efe5b6cd0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:53.438792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca267bc-a8e3-4aa7-86dc-2efe5b6cd0db admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:53.439065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca267bc-a8e3-4aa7-86dc-2efe5b6cd0db admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:53.439327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca267bc-a8e3-4aa7-86dc-2efe5b6cd0db admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:53.439943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca267bc-a8e3-4aa7-86dc-2efe5b6cd0db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:53.441674 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-8ca267bc-a8e3-4aa7-86dc-2efe5b6cd0db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:36:53.441674 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 09:36:53.441674 n-d-master-1 devstack@keystone.service[82080]: Sep 30 09:36:53.442845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca267bc-a8e3-4aa7-86dc-2efe5b6cd0db admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:53.499811 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 746/1497] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:36:53 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:36:53.503978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb020a0-ab86-499f-ba61-11c61d5ada9f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:53.505562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9bb020a0-ab86-499f-ba61-11c61d5ada9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:53.537729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb020a0-ab86-499f-ba61-11c61d5ada9f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:53.630868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fb1e9-1fb4-4543-9c37-45d9e6ec6e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:53.631463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fb1e9-1fb4-4543-9c37-45d9e6ec6e47 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:53.631734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fb1e9-1fb4-4543-9c37-45d9e6ec6e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:53.631996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fb1e9-1fb4-4543-9c37-45d9e6ec6e47 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:53.633400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fb1e9-1fb4-4543-9c37-45d9e6ec6e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:53.634399 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-d18fb1e9-1fb4-4543-9c37-45d9e6ec6e47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:36:53.634399 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 09:36:53.634399 n-d-master-1 devstack@keystone.service[82079]: Sep 30 09:36:53.635579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fb1e9-1fb4-4543-9c37-45d9e6ec6e47 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:53.677583 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 752/1498] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:36:53 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:36:53.681934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca267bc-a8e3-4aa7-86dc-2efe5b6cd0db admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:53.683425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8ca267bc-a8e3-4aa7-86dc-2efe5b6cd0db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:53.745919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca267bc-a8e3-4aa7-86dc-2efe5b6cd0db admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:53.829572 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:53.840783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed10c6-c24a-4870-9e12-78fea416eb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:53.841381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed10c6-c24a-4870-9e12-78fea416eb2c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:53.841681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed10c6-c24a-4870-9e12-78fea416eb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:53.841964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed10c6-c24a-4870-9e12-78fea416eb2c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:53.842605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed10c6-c24a-4870-9e12-78fea416eb2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:53.843636 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-d6ed10c6-c24a-4870-9e12-78fea416eb2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:36:53.843636 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 09:36:53.843636 n-d-master-1 devstack@keystone.service[82080]: Sep 30 09:36:53.844502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed10c6-c24a-4870-9e12-78fea416eb2c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:53.856579 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 747/1499] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:53.860566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fb1e9-1fb4-4543-9c37-45d9e6ec6e47 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:53.862156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d18fb1e9-1fb4-4543-9c37-45d9e6ec6e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:53.873910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fb1e9-1fb4-4543-9c37-45d9e6ec6e47 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:53.899090 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:53.970191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7e0b6-f4e8-4d40-a266-5556ad7eb243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:53.970724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7e0b6-f4e8-4d40-a266-5556ad7eb243 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:53.970996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7e0b6-f4e8-4d40-a266-5556ad7eb243 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:53.971257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7e0b6-f4e8-4d40-a266-5556ad7eb243 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:53.971887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7e0b6-f4e8-4d40-a266-5556ad7eb243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:53.972912 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-acb7e0b6-f4e8-4d40-a266-5556ad7eb243 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:36:53.972912 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 09:36:53.972912 n-d-master-1 devstack@keystone.service[82079]: Sep 30 09:36:53.973791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7e0b6-f4e8-4d40-a266-5556ad7eb243 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:53.986489 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 753/1500] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:36:53.990664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed10c6-c24a-4870-9e12-78fea416eb2c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:53.992274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d6ed10c6-c24a-4870-9e12-78fea416eb2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:54.025829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed10c6-c24a-4870-9e12-78fea416eb2c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:54.121578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55390d-6f3a-4a3e-8782-90263a5bdc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:54.122229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55390d-6f3a-4a3e-8782-90263a5bdc27 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:54.122502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55390d-6f3a-4a3e-8782-90263a5bdc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:54.122771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55390d-6f3a-4a3e-8782-90263a5bdc27 admin admin] PATH_INFO: `/v3/projects/32ae4c0cbe824f1aa35e9494be0f3679/users/549132c4b3d64ab1b47fc6710ec15a92/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:54.145369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55390d-6f3a-4a3e-8782-90263a5bdc27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ae4c0cbe824f1aa35e9494be0f3679, user_id=549132c4b3d64ab1b47fc6710ec15a92, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:54.146372 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-5c55390d-6f3a-4a3e-8782-90263a5bdc27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:36:54.146372 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 09:36:54.146372 n-d-master-1 devstack@keystone.service[82080]: Sep 30 09:36:54.148939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55390d-6f3a-4a3e-8782-90263a5bdc27 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:54.174033 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 748/1501] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:36:53 2022] PUT /identity/v3/projects/32ae4c0cbe824f1aa35e9494be0f3679/users/549132c4b3d64ab1b47fc6710ec15a92/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:54.186550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0048c-9b6b-4899-bb25-479b3e94e81f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:54.186837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0048c-9b6b-4899-bb25-479b3e94e81f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:54.187107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0048c-9b6b-4899-bb25-479b3e94e81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:54.243047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d0e0048c-9b6b-4899-bb25-479b3e94e81f None None] MFA Rules not processed for user `549132c4b3d64ab1b47fc6710ec15a92`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:54.244157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d0e0048c-9b6b-4899-bb25-479b3e94e81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:54.319505 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 754/1502] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:36:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:54.333583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093c8ae-2cc1-46c0-a78c-1140212b1de8 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:54.333871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093c8ae-2cc1-46c0-a78c-1140212b1de8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:54.334146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093c8ae-2cc1-46c0-a78c-1140212b1de8 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:54.336260 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 749/1503] 10.222.0.16 () {54 vars in 963 bytes} [Fri Sep 30 09:36:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:36:54.341203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773daaea-8830-48f2-859e-199d7c6524f6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:54.341507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773daaea-8830-48f2-859e-199d7c6524f6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:54.341791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773daaea-8830-48f2-859e-199d7c6524f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:54.372317 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:54.416089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-773daaea-8830-48f2-859e-199d7c6524f6 None None] MFA Rules not processed for user `947a48b06bb74f068b70e8c17a8da422`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:54.417319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-773daaea-8830-48f2-859e-199d7c6524f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:54.490615 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 755/1504] 10.222.0.16 () {58 vars in 1060 bytes} [Fri Sep 30 09:36:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:54.498277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093c8ae-2cc1-46c0-a78c-1140212b1de8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:54.499810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7093c8ae-2cc1-46c0-a78c-1140212b1de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:54.551773 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:54.607836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093c8ae-2cc1-46c0-a78c-1140212b1de8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:54.683036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a283f6-d7f3-449a-a5d5-2f3bcf1eae41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:54.683630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a283f6-d7f3-449a-a5d5-2f3bcf1eae41 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:54.683906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a283f6-d7f3-449a-a5d5-2f3bcf1eae41 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:54.684174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a283f6-d7f3-449a-a5d5-2f3bcf1eae41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:54.685794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d2a283f6-d7f3-449a-a5d5-2f3bcf1eae41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:54.787258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a283f6-d7f3-449a-a5d5-2f3bcf1eae41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:54.789151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a283f6-d7f3-449a-a5d5-2f3bcf1eae41 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:54.792541 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:54.808133 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 750/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:54.854257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d48fc-f71f-4a7a-b361-53dbf7687cdf None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:54.854549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d48fc-f71f-4a7a-b361-53dbf7687cdf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:54.854827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d48fc-f71f-4a7a-b361-53dbf7687cdf None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:54.856080 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 756/1506] 10.222.0.16 () {52 vars in 830 bytes} [Fri Sep 30 09:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:36:54.859546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a283f6-d7f3-449a-a5d5-2f3bcf1eae41 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:54.860772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d2a283f6-d7f3-449a-a5d5-2f3bcf1eae41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:54.959814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a283f6-d7f3-449a-a5d5-2f3bcf1eae41 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:55.052991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5d6f5-d86c-4870-ab36-6de5590bfcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:55.053662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5d6f5-d86c-4870-ab36-6de5590bfcc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:55.053785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5d6f5-d86c-4870-ab36-6de5590bfcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:55.054710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5d6f5-d86c-4870-ab36-6de5590bfcc7 admin admin] PATH_INFO: `/v3/users/549132c4b3d64ab1b47fc6710ec15a92` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:55.067250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5d6f5-d86c-4870-ab36-6de5590bfcc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=549132c4b3d64ab1b47fc6710ec15a92)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:55.068248 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-5ed5d6f5-d86c-4870-ab36-6de5590bfcc7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:36:55.068248 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 09:36:55.068248 n-d-master-1 devstack@keystone.service[82080]: Sep 30 09:36:55.069485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5d6f5-d86c-4870-ab36-6de5590bfcc7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:55.078801 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:55.135271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ed5d6f5-d86c-4870-ab36-6de5590bfcc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '549132c4b3d64ab1b47fc6710ec15a92'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:55.144275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ed5d6f5-d86c-4870-ab36-6de5590bfcc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '549132c4b3d64ab1b47fc6710ec15a92'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:55.144851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ed5d6f5-d86c-4870-ab36-6de5590bfcc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '549132c4b3d64ab1b47fc6710ec15a92'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:55.168821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ed5d6f5-d86c-4870-ab36-6de5590bfcc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '549132c4b3d64ab1b47fc6710ec15a92'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:55.183500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ed5d6f5-d86c-4870-ab36-6de5590bfcc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '549132c4b3d64ab1b47fc6710ec15a92'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:55.189006 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 751/1507] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:36:54 2022] DELETE /identity/v3/users/549132c4b3d64ab1b47fc6710ec15a92 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:36:55.193321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3bb42-63fb-4fd7-90a4-62295463a25d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:55.193770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3bb42-63fb-4fd7-90a4-62295463a25d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:55.193878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3bb42-63fb-4fd7-90a4-62295463a25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:55.250477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3ad3bb42-63fb-4fd7-90a4-62295463a25d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:36:55.251651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3ad3bb42-63fb-4fd7-90a4-62295463a25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:55.324929 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:55.338581 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 757/1508] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:36:55.348078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5d6f5-d86c-4870-ab36-6de5590bfcc7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:55.349315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5ed5d6f5-d86c-4870-ab36-6de5590bfcc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:55.451243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5d6f5-d86c-4870-ab36-6de5590bfcc7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:55.507644 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:36:55.529089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a679ac-178b-460d-b464-50168a0bc502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:55.529695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a679ac-178b-460d-b464-50168a0bc502 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:55.529971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a679ac-178b-460d-b464-50168a0bc502 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:55.530238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a679ac-178b-460d-b464-50168a0bc502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:55.531826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-30a679ac-178b-460d-b464-50168a0bc502 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:55.640701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a679ac-178b-460d-b464-50168a0bc502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:55.642032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a679ac-178b-460d-b464-50168a0bc502 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:55.660876 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 752/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:36:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:36:55.988892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3bb42-63fb-4fd7-90a4-62295463a25d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:36:55.990114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3ad3bb42-63fb-4fd7-90a4-62295463a25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:36:56.001538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3bb42-63fb-4fd7-90a4-62295463a25d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:36:56.098511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bac71e-b956-491a-9101-bc12a870c2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:36:56.099131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bac71e-b956-491a-9101-bc12a870c2fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:36:56.099403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bac71e-b956-491a-9101-bc12a870c2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:36:56.099666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bac71e-b956-491a-9101-bc12a870c2fe admin admin] PATH_INFO: `/v3/projects/32ae4c0cbe824f1aa35e9494be0f3679` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:36:56.109567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bac71e-b956-491a-9101-bc12a870c2fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ae4c0cbe824f1aa35e9494be0f3679)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:36:56.110579 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-f3bac71e-b956-491a-9101-bc12a870c2fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:36:56.110579 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 09:36:56.110579 n-d-master-1 devstack@keystone.service[82079]: Sep 30 09:36:56.111756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bac71e-b956-491a-9101-bc12a870c2fe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:36:56.171135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f3bac71e-b956-491a-9101-bc12a870c2fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ae4c0cbe824f1aa35e9494be0f3679', 'request_id': 'req-f3bac71e-b956-491a-9101-bc12a870c2fe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:56.181015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f3bac71e-b956-491a-9101-bc12a870c2fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ae4c0cbe824f1aa35e9494be0f3679', 'request_id': 'req-f3bac71e-b956-491a-9101-bc12a870c2fe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:56.187316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f3bac71e-b956-491a-9101-bc12a870c2fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ae4c0cbe824f1aa35e9494be0f3679', 'request_id': 'req-f3bac71e-b956-491a-9101-bc12a870c2fe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:56.217780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f3bac71e-b956-491a-9101-bc12a870c2fe admin admin] The token cache is being invalidate because project 32ae4c0cbe824f1aa35e9494be0f3679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:36:56.218430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f3bac71e-b956-491a-9101-bc12a870c2fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:56.218523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f3bac71e-b956-491a-9101-bc12a870c2fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:36:56.219881 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 758/1510] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:36:55 2022] DELETE /identity/v3/projects/32ae4c0cbe824f1aa35e9494be0f3679 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:37:05.658725 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=62 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:37:06.215653 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:20.657770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fc3f0-e467-4859-8ee1-b32623316d05 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:20.658365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fc3f0-e467-4859-8ee1-b32623316d05 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:20.658365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fc3f0-e467-4859-8ee1-b32623316d05 None None] PATH_INFO: `/v3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:20.659596 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 753/1511] 10.222.0.17 () {54 vars in 925 bytes} [Fri Sep 30 09:40:20 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:40:20.665634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcb780-f424-4f1d-b9b8-5236f44f27d9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:20.666082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcb780-f424-4f1d-b9b8-5236f44f27d9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:20.666209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcb780-f424-4f1d-b9b8-5236f44f27d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:20.747926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-74dcb780-f424-4f1d-b9b8-5236f44f27d9 None None] MFA Rules not processed for user `cbb22d0675bc4ca893b0477cebd470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:20.749187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-74dcb780-f424-4f1d-b9b8-5236f44f27d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:20.867096 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 759/1512] 10.222.0.17 () {58 vars in 1015 bytes} [Fri Sep 30 09:40:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:23.129860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a35a0-d38f-4479-94d6-dc5da595a85e None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:23.130410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a35a0-d38f-4479-94d6-dc5da595a85e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:23.130410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a35a0-d38f-4479-94d6-dc5da595a85e None None] PATH_INFO: `/v3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:23.131702 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 754/1513] 10.222.0.45 () {54 vars in 925 bytes} [Fri Sep 30 09:40:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:40:23.138217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d42f06-f8b8-4a66-93ff-c378a7c569ff None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:23.138614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d42f06-f8b8-4a66-93ff-c378a7c569ff None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:23.138906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d42f06-f8b8-4a66-93ff-c378a7c569ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:23.158927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-07d42f06-f8b8-4a66-93ff-c378a7c569ff None None] MFA Rules not processed for user `cbb22d0675bc4ca893b0477cebd470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:23.160147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-07d42f06-f8b8-4a66-93ff-c378a7c569ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:23.168687 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 760/1514] 10.222.0.45 () {58 vars in 1015 bytes} [Fri Sep 30 09:40:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:29.503500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886451ad-30b3-4d5b-9920-e04f9955997b None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:29.503973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886451ad-30b3-4d5b-9920-e04f9955997b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:29.504069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886451ad-30b3-4d5b-9920-e04f9955997b None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:29.505379 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 755/1515] 10.222.0.16 () {54 vars in 961 bytes} [Fri Sep 30 09:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:40:29.510343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f649a-2df9-4a95-876c-760573783f17 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:29.510783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f649a-2df9-4a95-876c-760573783f17 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:29.510918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f649a-2df9-4a95-876c-760573783f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:29.532424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6b6f649a-2df9-4a95-876c-760573783f17 None None] MFA Rules not processed for user `cbb22d0675bc4ca893b0477cebd470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:29.533643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6b6f649a-2df9-4a95-876c-760573783f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:29.543449 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 761/1516] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Sep 30 09:40:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:29.551282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886451ad-30b3-4d5b-9920-e04f9955997b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:29.565964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886451ad-30b3-4d5b-9920-e04f9955997b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:29.570759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613974f3-8f85-4a36-9f05-25a7e0392917 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:29.571345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613974f3-8f85-4a36-9f05-25a7e0392917 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:29.571650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613974f3-8f85-4a36-9f05-25a7e0392917 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:29.571920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613974f3-8f85-4a36-9f05-25a7e0392917 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:29.580101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613974f3-8f85-4a36-9f05-25a7e0392917 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:29.581943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613974f3-8f85-4a36-9f05-25a7e0392917 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:29.592196 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 756/1517] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:40:31.710731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f649a-2df9-4a95-876c-760573783f17 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:31.721155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f649a-2df9-4a95-876c-760573783f17 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:31.726158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f065e6-8e44-49e8-8ddd-028bea72adda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:31.726750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f065e6-8e44-49e8-8ddd-028bea72adda service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:31.727042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f065e6-8e44-49e8-8ddd-028bea72adda service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:31.727297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f065e6-8e44-49e8-8ddd-028bea72adda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:31.735316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f065e6-8e44-49e8-8ddd-028bea72adda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:31.736934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f065e6-8e44-49e8-8ddd-028bea72adda service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:31.746872 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 762/1518] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:40:39.587435 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:41.742394 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:40:45.906210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17920c-e13a-4dd8-8821-b00a2f3850c1 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:45.906738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17920c-e13a-4dd8-8821-b00a2f3850c1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:45.906738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17920c-e13a-4dd8-8821-b00a2f3850c1 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:45.908020 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 757/1519] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:40:45.912928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5e820-b43d-458c-8091-9c3d0a837cd1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:45.913365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5e820-b43d-458c-8091-9c3d0a837cd1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:45.913540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5e820-b43d-458c-8091-9c3d0a837cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:45.973409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a2e5e820-b43d-458c-8091-9c3d0a837cd1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:45.974610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a2e5e820-b43d-458c-8091-9c3d0a837cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:46.054092 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 763/1520] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:46.207385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17920c-e13a-4dd8-8821-b00a2f3850c1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:46.209145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ec17920c-e13a-4dd8-8821-b00a2f3850c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:46.312232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17920c-e13a-4dd8-8821-b00a2f3850c1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:46.317653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288d678-5456-4fd5-a444-d947a84f2839 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:46.318253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288d678-5456-4fd5-a444-d947a84f2839 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:46.318532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288d678-5456-4fd5-a444-d947a84f2839 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:46.318803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288d678-5456-4fd5-a444-d947a84f2839 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:46.326762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288d678-5456-4fd5-a444-d947a84f2839 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:46.328306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288d678-5456-4fd5-a444-d947a84f2839 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:46.337628 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 758/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:40:47.418402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e49d2-ac6c-4381-880f-fc5ee427982b None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:47.418996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e49d2-ac6c-4381-880f-fc5ee427982b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:47.418996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e49d2-ac6c-4381-880f-fc5ee427982b None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:47.420387 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 09:40:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:40:47.426619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2c932-14ce-49f7-b70e-4fa2aa96c369 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:47.427046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2c932-14ce-49f7-b70e-4fa2aa96c369 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:47.427190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2c932-14ce-49f7-b70e-4fa2aa96c369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:47.446987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d6f2c932-14ce-49f7-b70e-4fa2aa96c369 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:47.448181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d6f2c932-14ce-49f7-b70e-4fa2aa96c369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:47.455843 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 09:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:47.608819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e49d2-ac6c-4381-880f-fc5ee427982b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:47.624085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e49d2-ac6c-4381-880f-fc5ee427982b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:47.629474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27137ad0-8708-4e96-855f-a8dea4c57f1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:47.630064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27137ad0-8708-4e96-855f-a8dea4c57f1e service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:47.630344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27137ad0-8708-4e96-855f-a8dea4c57f1e service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:47.630617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27137ad0-8708-4e96-855f-a8dea4c57f1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:47.639050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27137ad0-8708-4e96-855f-a8dea4c57f1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:47.640651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27137ad0-8708-4e96-855f-a8dea4c57f1e service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:47.649800 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 765/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:40:51.532195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e112c2c-2493-41e7-a532-4d06ccd49ef3 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:51.532648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e112c2c-2493-41e7-a532-4d06ccd49ef3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:51.532775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e112c2c-2493-41e7-a532-4d06ccd49ef3 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:51.534156 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:40:51.539531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4f4ee-90f7-433c-ac92-2307d32e3abb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:51.539965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4f4ee-90f7-433c-ac92-2307d32e3abb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:51.540068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4f4ee-90f7-433c-ac92-2307d32e3abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:51.559994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-63e4f4ee-90f7-433c-ac92-2307d32e3abb None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:51.561215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-63e4f4ee-90f7-433c-ac92-2307d32e3abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:51.569008 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:51.859994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e112c2c-2493-41e7-a532-4d06ccd49ef3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:51.861691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6e112c2c-2493-41e7-a532-4d06ccd49ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:51.939864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e112c2c-2493-41e7-a532-4d06ccd49ef3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:51.943326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57169aaa-2393-4d3f-8199-017b55a7c6d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:51.943920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57169aaa-2393-4d3f-8199-017b55a7c6d7 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:51.944193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57169aaa-2393-4d3f-8199-017b55a7c6d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:51.944457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57169aaa-2393-4d3f-8199-017b55a7c6d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:51.953697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57169aaa-2393-4d3f-8199-017b55a7c6d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:51.955093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57169aaa-2393-4d3f-8199-017b55a7c6d7 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:51.965320 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 761/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:40:54.117042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad00944-63c9-4005-b556-9c351aa3bf1a None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:54.117606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad00944-63c9-4005-b556-9c351aa3bf1a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:54.117606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad00944-63c9-4005-b556-9c351aa3bf1a None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:54.118909 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 09:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:40:54.124171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00163d1-f171-4dea-8076-359752218229 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:54.124616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00163d1-f171-4dea-8076-359752218229 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:54.124781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00163d1-f171-4dea-8076-359752218229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:54.144708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a00163d1-f171-4dea-8076-359752218229 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:40:54.145885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a00163d1-f171-4dea-8076-359752218229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:40:54.154486 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 09:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:40:54.453629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad00944-63c9-4005-b556-9c351aa3bf1a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:40:54.464428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad00944-63c9-4005-b556-9c351aa3bf1a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:40:54.467928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea26310-3d7f-40ce-a1ae-3820722120aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:40:54.468510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea26310-3d7f-40ce-a1ae-3820722120aa service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:40:54.468812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea26310-3d7f-40ce-a1ae-3820722120aa service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:40:54.469084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea26310-3d7f-40ce-a1ae-3820722120aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:40:54.477753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea26310-3d7f-40ce-a1ae-3820722120aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:40:54.479270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea26310-3d7f-40ce-a1ae-3820722120aa service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:40:54.488586 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 768/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:40:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:41:04.139225 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:41:04.484484 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=65 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:41:46.353566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a420c0-71c7-464b-8434-524cceee05e5 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:46.354079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a420c0-71c7-464b-8434-524cceee05e5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:46.354079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a420c0-71c7-464b-8434-524cceee05e5 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:46.355447 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 763/1531] 10.222.0.16 () {54 vars in 921 bytes} [Fri Sep 30 09:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:41:46.361149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cbf20-e23a-415a-9dc3-c4358ad3d8dd None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:41:46.361624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cbf20-e23a-415a-9dc3-c4358ad3d8dd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:41:46.361792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cbf20-e23a-415a-9dc3-c4358ad3d8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:41:46.382702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-016cbf20-e23a-415a-9dc3-c4358ad3d8dd None None] MFA Rules not processed for user `cbb22d0675bc4ca893b0477cebd470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:41:46.383897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-016cbf20-e23a-415a-9dc3-c4358ad3d8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:41:46.393082 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 769/1532] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 09:41:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:41:56.377469 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:18.533578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561618b-ce71-47fb-a137-77e2430a87a2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:18.534103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561618b-ce71-47fb-a137-77e2430a87a2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:18.534103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561618b-ce71-47fb-a137-77e2430a87a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:18.552307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f26b35-a29c-432c-b11a-d1411d955f40 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:18.553462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f26b35-a29c-432c-b11a-d1411d955f40 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:18.553961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f26b35-a29c-432c-b11a-d1411d955f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:18.588327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2561618b-ce71-47fb-a137-77e2430a87a2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:18.588611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-91f26b35-a29c-432c-b11a-d1411d955f40 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:18.589594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2561618b-ce71-47fb-a137-77e2430a87a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:18.594229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-91f26b35-a29c-432c-b11a-d1411d955f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:18.615199 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 770/1533] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:18.616007 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 764/1534] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:18.621789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672a839-8d1c-49df-ab15-e577cd732fc5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:18.622155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672a839-8d1c-49df-ab15-e577cd732fc5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:18.622494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672a839-8d1c-49df-ab15-e577cd732fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:18.638352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fc80d-6e3f-4ba9-abe3-7bca8d49bd95 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:18.638661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fc80d-6e3f-4ba9-abe3-7bca8d49bd95 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:18.638892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fc80d-6e3f-4ba9-abe3-7bca8d49bd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:18.675372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c672a839-8d1c-49df-ab15-e577cd732fc5 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:18.677368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f48fc80d-6e3f-4ba9-abe3-7bca8d49bd95 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:18.678506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f48fc80d-6e3f-4ba9-abe3-7bca8d49bd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:18.679371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c672a839-8d1c-49df-ab15-e577cd732fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:18.698647 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 771/1536] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:42:18.698817 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 765/1536] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:18.701050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088a198-e819-4356-93af-3a7d980ca21f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:18.701611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088a198-e819-4356-93af-3a7d980ca21f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:18.702410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088a198-e819-4356-93af-3a7d980ca21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:18.704028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb5967-208a-418d-8d9f-a2a6f68d2ba2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:18.704299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb5967-208a-418d-8d9f-a2a6f68d2ba2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:18.704747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb5967-208a-418d-8d9f-a2a6f68d2ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:18.739660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f088a198-e819-4356-93af-3a7d980ca21f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:18.740907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f088a198-e819-4356-93af-3a7d980ca21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:18.743745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fdfb5967-208a-418d-8d9f-a2a6f68d2ba2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:18.745454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fdfb5967-208a-418d-8d9f-a2a6f68d2ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:18.755087 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 766/1537] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:18.756714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306585c-0746-4c99-94cb-81dd359a4ab0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:18.757198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306585c-0746-4c99-94cb-81dd359a4ab0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:18.757663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306585c-0746-4c99-94cb-81dd359a4ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:18.775048 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 772/1538] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:18.776949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615ea9a-67cd-4b03-98c4-41dffe0bf3d0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:18.778141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615ea9a-67cd-4b03-98c4-41dffe0bf3d0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:18.778448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615ea9a-67cd-4b03-98c4-41dffe0bf3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:18.783782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9306585c-0746-4c99-94cb-81dd359a4ab0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:18.785583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9306585c-0746-4c99-94cb-81dd359a4ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:18.796868 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 767/1539] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:18.798303 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306585c-0746-4c99-94cb-81dd359a4ab0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:18.807154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6615ea9a-67cd-4b03-98c4-41dffe0bf3d0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:18.809002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6615ea9a-67cd-4b03-98c4-41dffe0bf3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:18.810526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306585c-0746-4c99-94cb-81dd359a4ab0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:18.816404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f359dd-1284-4ceb-a862-45a95e97bc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:18.817271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f359dd-1284-4ceb-a862-45a95e97bc27 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:18.818222 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 773/1540] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:18.818681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f359dd-1284-4ceb-a862-45a95e97bc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:18.819046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615ea9a-67cd-4b03-98c4-41dffe0bf3d0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:18.819372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f359dd-1284-4ceb-a862-45a95e97bc27 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:18.820163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f359dd-1284-4ceb-a862-45a95e97bc27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:42:18.824750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f359dd-1284-4ceb-a862-45a95e97bc27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:18.826059 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-e0f359dd-1284-4ceb-a862-45a95e97bc27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:42:18.826059 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 09:42:18.826059 n-d-master-1 devstack@keystone.service[82080]: Sep 30 09:42:18.827017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f359dd-1284-4ceb-a862-45a95e97bc27 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:18.831896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615ea9a-67cd-4b03-98c4-41dffe0bf3d0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:18.836760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364fcaa-8fa5-493e-a87d-fbd298e14de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:18.837372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364fcaa-8fa5-493e-a87d-fbd298e14de7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:18.838266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364fcaa-8fa5-493e-a87d-fbd298e14de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:18.838553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364fcaa-8fa5-493e-a87d-fbd298e14de7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:18.839203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364fcaa-8fa5-493e-a87d-fbd298e14de7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:42:18.839509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364fcaa-8fa5-493e-a87d-fbd298e14de7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:18.842556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364fcaa-8fa5-493e-a87d-fbd298e14de7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:18.847137 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 768/1541] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:42:18.848764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03d748-f605-442c-8252-09d4d417bf09 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:18.849291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03d748-f605-442c-8252-09d4d417bf09 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:18.849755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03d748-f605-442c-8252-09d4d417bf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:18.856129 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 774/1542] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:42:18.857796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c29c7-f60e-4e65-b06f-f955affcf7c6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:18.858162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c29c7-f60e-4e65-b06f-f955affcf7c6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:18.858652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c29c7-f60e-4e65-b06f-f955affcf7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:18.877781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ed03d748-f605-442c-8252-09d4d417bf09 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:18.879251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ed03d748-f605-442c-8252-09d4d417bf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:18.883285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-df1c29c7-f60e-4e65-b06f-f955affcf7c6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:18.884536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-df1c29c7-f60e-4e65-b06f-f955affcf7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:18.890096 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 769/1543] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:18.891540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0325a0a-36bf-4a30-8db6-64183e4a9fcd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:18.892124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0325a0a-36bf-4a30-8db6-64183e4a9fcd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:18.892717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0325a0a-36bf-4a30-8db6-64183e4a9fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:18.894658 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 775/1544] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:18.896019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dada6b-aa6a-4f32-92c4-37fe266ef6d4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:18.896493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dada6b-aa6a-4f32-92c4-37fe266ef6d4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:18.896880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dada6b-aa6a-4f32-92c4-37fe266ef6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:18.915524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b0325a0a-36bf-4a30-8db6-64183e4a9fcd None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:18.917380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b0325a0a-36bf-4a30-8db6-64183e4a9fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:18.928127 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 770/1545] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:18.929839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a37ccc-8eab-4231-8215-e94bf6363558 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:18.930325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a37ccc-8eab-4231-8215-e94bf6363558 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:18.930785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a37ccc-8eab-4231-8215-e94bf6363558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:18.930882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c6dada6b-aa6a-4f32-92c4-37fe266ef6d4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:18.932333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c6dada6b-aa6a-4f32-92c4-37fe266ef6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:18.941582 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 776/1546] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:18.943652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66621e1-5828-42f9-be42-bffd276587a4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:18.943942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66621e1-5828-42f9-be42-bffd276587a4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:18.944216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66621e1-5828-42f9-be42-bffd276587a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:18.956135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d0a37ccc-8eab-4231-8215-e94bf6363558 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:18.958184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d0a37ccc-8eab-4231-8215-e94bf6363558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:18.967996 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 771/1547] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:18.969129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a37ccc-8eab-4231-8215-e94bf6363558 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:18.972300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a66621e1-5828-42f9-be42-bffd276587a4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:18.973553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a66621e1-5828-42f9-be42-bffd276587a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:18.979848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a37ccc-8eab-4231-8215-e94bf6363558 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:18.985739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0437433-9d97-4bab-b00e-70a30cc33a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:18.985901 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 777/1548] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:18.989788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66621e1-5828-42f9-be42-bffd276587a4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:18.990755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0437433-9d97-4bab-b00e-70a30cc33a7e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:18.991220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0437433-9d97-4bab-b00e-70a30cc33a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:18.991779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0437433-9d97-4bab-b00e-70a30cc33a7e admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:18.992866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0437433-9d97-4bab-b00e-70a30cc33a7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:18.995602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0437433-9d97-4bab-b00e-70a30cc33a7e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:18.998315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66621e1-5828-42f9-be42-bffd276587a4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.002897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc9611-ee8d-4315-9d5f-b3dde17bff98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.003579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc9611-ee8d-4315-9d5f-b3dde17bff98 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.003855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc9611-ee8d-4315-9d5f-b3dde17bff98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.004118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc9611-ee8d-4315-9d5f-b3dde17bff98 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.004780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc9611-ee8d-4315-9d5f-b3dde17bff98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.005785 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-0cdc9611-ee8d-4315-9d5f-b3dde17bff98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:42:19.005785 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 09:42:19.005785 n-d-master-1 devstack@keystone.service[82079]: Sep 30 09:42:19.006947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc9611-ee8d-4315-9d5f-b3dde17bff98 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.035681 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 772/1549] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:18 2022] POST /identity/v3/projects => generated 393 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:19.036438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0437433-9d97-4bab-b00e-70a30cc33a7e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.036643 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 778/1550] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:18 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:19.041333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e115c-e738-4baa-957f-f6de7c055ab4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.041615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e115c-e738-4baa-957f-f6de7c055ab4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.041892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e115c-e738-4baa-957f-f6de7c055ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.061901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-579e115c-e738-4baa-957f-f6de7c055ab4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:19.063091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-579e115c-e738-4baa-957f-f6de7c055ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:19.100210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0437433-9d97-4bab-b00e-70a30cc33a7e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.129561 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 779/1551] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:19.130226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e115c-e738-4baa-957f-f6de7c055ab4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.140451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e115c-e738-4baa-957f-f6de7c055ab4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.145292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388e2f9-a7fe-4197-a69b-cb3a8076186e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.145908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388e2f9-a7fe-4197-a69b-cb3a8076186e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.146181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388e2f9-a7fe-4197-a69b-cb3a8076186e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.146447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388e2f9-a7fe-4197-a69b-cb3a8076186e admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.147096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388e2f9-a7fe-4197-a69b-cb3a8076186e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:42:19.147400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388e2f9-a7fe-4197-a69b-cb3a8076186e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.149036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388e2f9-a7fe-4197-a69b-cb3a8076186e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.170699 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 780/1552] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:42:19.170699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0732f7-4c52-4cc3-9494-b6d8a3ee50e3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.170699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0732f7-4c52-4cc3-9494-b6d8a3ee50e3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.170699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0732f7-4c52-4cc3-9494-b6d8a3ee50e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.182162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6393bb7-2d19-4497-88dc-d9befb79706d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.182774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6393bb7-2d19-4497-88dc-d9befb79706d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.183045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6393bb7-2d19-4497-88dc-d9befb79706d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.183307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6393bb7-2d19-4497-88dc-d9befb79706d admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.184017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6393bb7-2d19-4497-88dc-d9befb79706d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:42:19.184315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6393bb7-2d19-4497-88dc-d9befb79706d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.185948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6393bb7-2d19-4497-88dc-d9befb79706d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.186646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2c0732f7-4c52-4cc3-9494-b6d8a3ee50e3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:19.187849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2c0732f7-4c52-4cc3-9494-b6d8a3ee50e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:19.196475 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 781/1553] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:19.197324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0732f7-4c52-4cc3-9494-b6d8a3ee50e3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.205185 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 773/1554] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:42:19.205185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6393bb7-2d19-4497-88dc-d9befb79706d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.208171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0732f7-4c52-4cc3-9494-b6d8a3ee50e3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.211359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6393bb7-2d19-4497-88dc-d9befb79706d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.212839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d972f70-1f30-4f94-8bd4-732241a63cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.213439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d972f70-1f30-4f94-8bd4-732241a63cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.213719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d972f70-1f30-4f94-8bd4-732241a63cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.213992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d972f70-1f30-4f94-8bd4-732241a63cc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.214667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d972f70-1f30-4f94-8bd4-732241a63cc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:42:19.215674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d972f70-1f30-4f94-8bd4-732241a63cc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.216722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7842e4a-9a3e-495f-a213-33cf6e467b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.217318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7842e4a-9a3e-495f-a213-33cf6e467b40 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.217413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d972f70-1f30-4f94-8bd4-732241a63cc8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.217593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7842e4a-9a3e-495f-a213-33cf6e467b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.217856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7842e4a-9a3e-495f-a213-33cf6e467b40 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.218519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7842e4a-9a3e-495f-a213-33cf6e467b40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:42:19.219057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7842e4a-9a3e-495f-a213-33cf6e467b40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.221176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7842e4a-9a3e-495f-a213-33cf6e467b40 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.229463 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 782/1555] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:42:19.230207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d972f70-1f30-4f94-8bd4-732241a63cc8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.231586 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:19.244486 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 774/1556] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:42:19.245843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7842e4a-9a3e-495f-a213-33cf6e467b40 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.247569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d972f70-1f30-4f94-8bd4-732241a63cc8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.252484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f938d4-498d-43c5-8650-fcdc131d16bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.253235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f938d4-498d-43c5-8650-fcdc131d16bf admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.253563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f938d4-498d-43c5-8650-fcdc131d16bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.253834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f938d4-498d-43c5-8650-fcdc131d16bf admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.254456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f938d4-498d-43c5-8650-fcdc131d16bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.256346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f938d4-498d-43c5-8650-fcdc131d16bf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.258665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7842e4a-9a3e-495f-a213-33cf6e467b40 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.268064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1daec-985e-472a-97f0-95934641ffb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.268798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1daec-985e-472a-97f0-95934641ffb5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.269152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1daec-985e-472a-97f0-95934641ffb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.269512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1daec-985e-472a-97f0-95934641ffb5 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.270164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1daec-985e-472a-97f0-95934641ffb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.271215 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-8ce1daec-985e-472a-97f0-95934641ffb5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:42:19.271215 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 09:42:19.271215 n-d-master-1 devstack@keystone.service[82080]: Sep 30 09:42:19.272507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1daec-985e-472a-97f0-95934641ffb5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.281885 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 783/1557] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:19 2022] POST /identity/v3/users => generated 297 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:19.282749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f938d4-498d-43c5-8650-fcdc131d16bf admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.293758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f938d4-498d-43c5-8650-fcdc131d16bf admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.300173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed8433-d7d4-48f8-885d-2a030500b1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.300873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed8433-d7d4-48f8-885d-2a030500b1ab admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.301243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed8433-d7d4-48f8-885d-2a030500b1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.301573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed8433-d7d4-48f8-885d-2a030500b1ab admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.305061 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 775/1558] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:19 2022] POST /identity/v3/users => generated 292 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:19.305209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed8433-d7d4-48f8-885d-2a030500b1ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:42:19.305209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed8433-d7d4-48f8-885d-2a030500b1ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.305374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1daec-985e-472a-97f0-95934641ffb5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.305459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed8433-d7d4-48f8-885d-2a030500b1ab admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.318208 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 784/1559] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:42:19.318746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1daec-985e-472a-97f0-95934641ffb5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.319155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed8433-d7d4-48f8-885d-2a030500b1ab admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.324860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440df4ea-cd96-4930-b7d1-29f24309a75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.326371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440df4ea-cd96-4930-b7d1-29f24309a75e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.327275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440df4ea-cd96-4930-b7d1-29f24309a75e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.327275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440df4ea-cd96-4930-b7d1-29f24309a75e admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.327662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440df4ea-cd96-4930-b7d1-29f24309a75e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.329692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440df4ea-cd96-4930-b7d1-29f24309a75e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.330647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed8433-d7d4-48f8-885d-2a030500b1ab admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.335611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2525e1-74dd-4f49-8104-e26fa5c5b9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.336268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2525e1-74dd-4f49-8104-e26fa5c5b9ec admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.336553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2525e1-74dd-4f49-8104-e26fa5c5b9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.336857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2525e1-74dd-4f49-8104-e26fa5c5b9ec admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.337525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2525e1-74dd-4f49-8104-e26fa5c5b9ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:42:19.337840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2525e1-74dd-4f49-8104-e26fa5c5b9ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.339408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2525e1-74dd-4f49-8104-e26fa5c5b9ec admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.353683 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 785/1560] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:42:19.354888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2525e1-74dd-4f49-8104-e26fa5c5b9ec admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.362271 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:19.362556 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 776/1561] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:19 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:19.363325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440df4ea-cd96-4930-b7d1-29f24309a75e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.369818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2525e1-74dd-4f49-8104-e26fa5c5b9ec admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.427829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440df4ea-cd96-4930-b7d1-29f24309a75e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.432536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237558d2-8ad4-4a15-8bbc-59c4ca5ccb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.433169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237558d2-8ad4-4a15-8bbc-59c4ca5ccb3f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.433508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237558d2-8ad4-4a15-8bbc-59c4ca5ccb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.433766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237558d2-8ad4-4a15-8bbc-59c4ca5ccb3f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.434396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237558d2-8ad4-4a15-8bbc-59c4ca5ccb3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.436260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237558d2-8ad4-4a15-8bbc-59c4ca5ccb3f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.439190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94acfe-133d-46ea-81ff-5d8e28e30e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.440226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94acfe-133d-46ea-81ff-5d8e28e30e91 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.440693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94acfe-133d-46ea-81ff-5d8e28e30e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.441111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94acfe-133d-46ea-81ff-5d8e28e30e91 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.441873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94acfe-133d-46ea-81ff-5d8e28e30e91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.444090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94acfe-133d-46ea-81ff-5d8e28e30e91 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.464359 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 777/1562] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:19 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:19.465895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237558d2-8ad4-4a15-8bbc-59c4ca5ccb3f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.478104 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 786/1563] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:19 2022] POST /identity/v3/projects => generated 399 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:19.478951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94acfe-133d-46ea-81ff-5d8e28e30e91 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.537013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237558d2-8ad4-4a15-8bbc-59c4ca5ccb3f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.542885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae289e-1d49-4cbf-959c-bf443a4f195f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.544673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae289e-1d49-4cbf-959c-bf443a4f195f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.544899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94acfe-133d-46ea-81ff-5d8e28e30e91 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.545005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae289e-1d49-4cbf-959c-bf443a4f195f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.545166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae289e-1d49-4cbf-959c-bf443a4f195f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.545904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae289e-1d49-4cbf-959c-bf443a4f195f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.547809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae289e-1d49-4cbf-959c-bf443a4f195f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.549497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972e377-aaff-45e7-8906-2151afa97406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.550097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972e377-aaff-45e7-8906-2151afa97406 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.550371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972e377-aaff-45e7-8906-2151afa97406 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.550637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972e377-aaff-45e7-8906-2151afa97406 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.551392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972e377-aaff-45e7-8906-2151afa97406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.553000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972e377-aaff-45e7-8906-2151afa97406 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.564548 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 787/1564] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:19.568387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972e377-aaff-45e7-8906-2151afa97406 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.579466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972e377-aaff-45e7-8906-2151afa97406 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.579908 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 778/1565] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:19 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:19.581841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae289e-1d49-4cbf-959c-bf443a4f195f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.620109 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:19.644936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9f911-844f-4dfa-b7ae-6ee378d22cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.645579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9f911-844f-4dfa-b7ae-6ee378d22cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.645861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9f911-844f-4dfa-b7ae-6ee378d22cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.646132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9f911-844f-4dfa-b7ae-6ee378d22cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.646782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9f911-844f-4dfa-b7ae-6ee378d22cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.648444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9f911-844f-4dfa-b7ae-6ee378d22cb7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.659420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae289e-1d49-4cbf-959c-bf443a4f195f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.660239 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 788/1566] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:19.660744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9f911-844f-4dfa-b7ae-6ee378d22cb7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.667632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406f1a4-a44d-4c57-8725-b6abe34b88e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.668401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406f1a4-a44d-4c57-8725-b6abe34b88e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.668731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406f1a4-a44d-4c57-8725-b6abe34b88e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.669002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406f1a4-a44d-4c57-8725-b6abe34b88e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.669637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406f1a4-a44d-4c57-8725-b6abe34b88e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.671503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406f1a4-a44d-4c57-8725-b6abe34b88e3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.673876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9f911-844f-4dfa-b7ae-6ee378d22cb7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.678489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed5493-63b4-4597-a049-0d8881f2274b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.679083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed5493-63b4-4597-a049-0d8881f2274b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.679364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed5493-63b4-4597-a049-0d8881f2274b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.679637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed5493-63b4-4597-a049-0d8881f2274b admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.680257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed5493-63b4-4597-a049-0d8881f2274b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.682167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed5493-63b4-4597-a049-0d8881f2274b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.700241 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 779/1567] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:19 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:19.700879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406f1a4-a44d-4c57-8725-b6abe34b88e3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.709027 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:19.717955 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 789/1568] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:19 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:19.718692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed5493-63b4-4597-a049-0d8881f2274b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.773647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406f1a4-a44d-4c57-8725-b6abe34b88e3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.789488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed5493-63b4-4597-a049-0d8881f2274b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.794987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130aa78-e47f-4ba0-907a-5878c4cbcfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.795562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130aa78-e47f-4ba0-907a-5878c4cbcfc6 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.795836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130aa78-e47f-4ba0-907a-5878c4cbcfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.796103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130aa78-e47f-4ba0-907a-5878c4cbcfc6 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.796768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130aa78-e47f-4ba0-907a-5878c4cbcfc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.798691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130aa78-e47f-4ba0-907a-5878c4cbcfc6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.822275 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 790/1569] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:19 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:19.823006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130aa78-e47f-4ba0-907a-5878c4cbcfc6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.834116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130aa78-e47f-4ba0-907a-5878c4cbcfc6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.839028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736e270-8c39-4127-9e39-ad18d599a63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.839665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736e270-8c39-4127-9e39-ad18d599a63f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.840002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736e270-8c39-4127-9e39-ad18d599a63f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.840365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736e270-8c39-4127-9e39-ad18d599a63f admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.841071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736e270-8c39-4127-9e39-ad18d599a63f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.842965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736e270-8c39-4127-9e39-ad18d599a63f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.843502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d936d-1955-4918-8fee-89267b8dca2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.844131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d936d-1955-4918-8fee-89267b8dca2a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.844410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d936d-1955-4918-8fee-89267b8dca2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.844713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d936d-1955-4918-8fee-89267b8dca2a admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.845343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d936d-1955-4918-8fee-89267b8dca2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.847251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d936d-1955-4918-8fee-89267b8dca2a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.867577 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 791/1570] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:19 2022] POST /identity/v3/users => generated 300 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:19.868488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736e270-8c39-4127-9e39-ad18d599a63f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.869274 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 780/1571] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:19 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:19.870207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d936d-1955-4918-8fee-89267b8dca2a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.878898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736e270-8c39-4127-9e39-ad18d599a63f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.881752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d936d-1955-4918-8fee-89267b8dca2a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.884003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128fb42-df03-4a61-bfa1-1b0fef48c12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.884593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128fb42-df03-4a61-bfa1-1b0fef48c12c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.884905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128fb42-df03-4a61-bfa1-1b0fef48c12c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.885176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128fb42-df03-4a61-bfa1-1b0fef48c12c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.885806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128fb42-df03-4a61-bfa1-1b0fef48c12c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.886539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164bdf7-8842-433c-a8b7-9f2d3ec57308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.887269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164bdf7-8842-433c-a8b7-9f2d3ec57308 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.887507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128fb42-df03-4a61-bfa1-1b0fef48c12c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.887604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164bdf7-8842-433c-a8b7-9f2d3ec57308 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.887960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164bdf7-8842-433c-a8b7-9f2d3ec57308 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.888589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164bdf7-8842-433c-a8b7-9f2d3ec57308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.890503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164bdf7-8842-433c-a8b7-9f2d3ec57308 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.898221 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 792/1572] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:19.899010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128fb42-df03-4a61-bfa1-1b0fef48c12c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.909386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128fb42-df03-4a61-bfa1-1b0fef48c12c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.916527 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 781/1573] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:19 2022] POST /identity/v3/users => generated 290 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:19.916527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164bdf7-8842-433c-a8b7-9f2d3ec57308 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.918778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f31955-c337-4202-9f89-e3fd1c99e2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.919542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f31955-c337-4202-9f89-e3fd1c99e2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.919822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f31955-c337-4202-9f89-e3fd1c99e2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.920088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f31955-c337-4202-9f89-e3fd1c99e2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.920759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f31955-c337-4202-9f89-e3fd1c99e2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.922351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f31955-c337-4202-9f89-e3fd1c99e2f8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.925401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164bdf7-8842-433c-a8b7-9f2d3ec57308 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.930391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da55d17-9bca-4525-8338-a37759c94354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.930985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da55d17-9bca-4525-8338-a37759c94354 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.931268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da55d17-9bca-4525-8338-a37759c94354 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.931538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da55d17-9bca-4525-8338-a37759c94354 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.932157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da55d17-9bca-4525-8338-a37759c94354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.933648 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 793/1574] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:19.934411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da55d17-9bca-4525-8338-a37759c94354 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.937591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f31955-c337-4202-9f89-e3fd1c99e2f8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.947318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f31955-c337-4202-9f89-e3fd1c99e2f8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.953731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d42b7-46cd-4482-a453-7b150be803e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.954322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d42b7-46cd-4482-a453-7b150be803e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.954601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d42b7-46cd-4482-a453-7b150be803e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.954871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d42b7-46cd-4482-a453-7b150be803e9 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.955488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d42b7-46cd-4482-a453-7b150be803e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.957755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d42b7-46cd-4482-a453-7b150be803e9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.958208 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 782/1575] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:19 2022] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:19.958878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da55d17-9bca-4525-8338-a37759c94354 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.969785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da55d17-9bca-4525-8338-a37759c94354 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.974893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cb96a-1c71-4bde-aec6-8c2b0ec55513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.975605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cb96a-1c71-4bde-aec6-8c2b0ec55513 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.975885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cb96a-1c71-4bde-aec6-8c2b0ec55513 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.976216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cb96a-1c71-4bde-aec6-8c2b0ec55513 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:19.976885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cb96a-1c71-4bde-aec6-8c2b0ec55513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:19.978454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cb96a-1c71-4bde-aec6-8c2b0ec55513 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:19.985814 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 794/1576] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:19 2022] POST /identity/v3/users => generated 285 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:19.985814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d42b7-46cd-4482-a453-7b150be803e9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.989386 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 783/1577] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:19.990083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cb96a-1c71-4bde-aec6-8c2b0ec55513 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:19.993582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d42b7-46cd-4482-a453-7b150be803e9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:19.998233 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:19.998682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d811e5f-fdd2-4733-9b94-74331203ab29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:19.999079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d811e5f-fdd2-4733-9b94-74331203ab29 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:19.999361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d811e5f-fdd2-4733-9b94-74331203ab29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:19.999621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d811e5f-fdd2-4733-9b94-74331203ab29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.000321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d811e5f-fdd2-4733-9b94-74331203ab29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:20.001845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d811e5f-fdd2-4733-9b94-74331203ab29 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:20.002503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cb96a-1c71-4bde-aec6-8c2b0ec55513 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:20.009097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a9074-cf4a-4fca-923d-d692bdb9f70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:20.010068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a9074-cf4a-4fca-923d-d692bdb9f70a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.010564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a9074-cf4a-4fca-923d-d692bdb9f70a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.011018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a9074-cf4a-4fca-923d-d692bdb9f70a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.012098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a9074-cf4a-4fca-923d-d692bdb9f70a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:20.013726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a9074-cf4a-4fca-923d-d692bdb9f70a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:20.016989 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 795/1578] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:20.016989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d811e5f-fdd2-4733-9b94-74331203ab29 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:20.024049 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 784/1579] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:20.024811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a9074-cf4a-4fca-923d-d692bdb9f70a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:20.028696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d811e5f-fdd2-4733-9b94-74331203ab29 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:20.034060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40121638-b00f-4cd7-98af-64e41157ded9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:20.034683 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a9074-cf4a-4fca-923d-d692bdb9f70a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:20.034805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40121638-b00f-4cd7-98af-64e41157ded9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.035004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40121638-b00f-4cd7-98af-64e41157ded9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.035273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40121638-b00f-4cd7-98af-64e41157ded9 admin admin] PATH_INFO: `/v3/projects/31786ef652af4cb39b75bc5187b09215/users/d83be3deadd74d24a632830e73682cde/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.039190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b01a32-c489-4e03-8e96-5f82224efe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:20.039770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b01a32-c489-4e03-8e96-5f82224efe8e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.040043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b01a32-c489-4e03-8e96-5f82224efe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.040310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b01a32-c489-4e03-8e96-5f82224efe8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.040965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b01a32-c489-4e03-8e96-5f82224efe8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:20.042530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b01a32-c489-4e03-8e96-5f82224efe8e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:20.050818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40121638-b00f-4cd7-98af-64e41157ded9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31786ef652af4cb39b75bc5187b09215, user_id=d83be3deadd74d24a632830e73682cde, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:20.051774 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-40121638-b00f-4cd7-98af-64e41157ded9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:42:20.051774 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 09:42:20.051774 n-d-master-1 devstack@keystone.service[82079]: Sep 30 09:42:20.053031 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 785/1580] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:20.053660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b01a32-c489-4e03-8e96-5f82224efe8e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:20.054101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40121638-b00f-4cd7-98af-64e41157ded9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:20.063831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b01a32-c489-4e03-8e96-5f82224efe8e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:20.068559 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 796/1581] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:20 2022] PUT /identity/v3/projects/31786ef652af4cb39b75bc5187b09215/users/d83be3deadd74d24a632830e73682cde/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:20.069380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40121638-b00f-4cd7-98af-64e41157ded9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:20.123319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb449a-7351-43a0-a5bf-0fa4ad9c1b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:20.123977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb449a-7351-43a0-a5bf-0fa4ad9c1b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.124256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb449a-7351-43a0-a5bf-0fa4ad9c1b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.124526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb449a-7351-43a0-a5bf-0fa4ad9c1b59 admin admin] PATH_INFO: `/v3/projects/3690619318174c2d9c4dbabae3f97edf/users/1a10ab88faf24a118cc7b6f3adf404da/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.136739 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:20.139283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb449a-7351-43a0-a5bf-0fa4ad9c1b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3690619318174c2d9c4dbabae3f97edf, user_id=1a10ab88faf24a118cc7b6f3adf404da, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:20.141976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40121638-b00f-4cd7-98af-64e41157ded9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:20.142327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb449a-7351-43a0-a5bf-0fa4ad9c1b59 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:20.148111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ae8a8-12da-4d6f-bf42-22977579b83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:20.148811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ae8a8-12da-4d6f-bf42-22977579b83e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.149091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ae8a8-12da-4d6f-bf42-22977579b83e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.149357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ae8a8-12da-4d6f-bf42-22977579b83e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.149994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ae8a8-12da-4d6f-bf42-22977579b83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:20.151554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ae8a8-12da-4d6f-bf42-22977579b83e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:20.155661 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 786/1582] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:20 2022] PUT /identity/v3/projects/3690619318174c2d9c4dbabae3f97edf/users/1a10ab88faf24a118cc7b6f3adf404da/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:20.156460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb449a-7351-43a0-a5bf-0fa4ad9c1b59 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:20.168536 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 797/1583] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:20.170057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ae8a8-12da-4d6f-bf42-22977579b83e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:20.180440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ae8a8-12da-4d6f-bf42-22977579b83e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:20.223752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb449a-7351-43a0-a5bf-0fa4ad9c1b59 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:20.228305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad22ec8-7746-409c-b2d9-eb8c7e66ee1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:20.228931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad22ec8-7746-409c-b2d9-eb8c7e66ee1f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.229213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad22ec8-7746-409c-b2d9-eb8c7e66ee1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.229479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad22ec8-7746-409c-b2d9-eb8c7e66ee1f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.230105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad22ec8-7746-409c-b2d9-eb8c7e66ee1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:20.231756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad22ec8-7746-409c-b2d9-eb8c7e66ee1f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:20.237957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ae7db-52c6-44ac-8cdf-6c8450e7f3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:20.238594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ae7db-52c6-44ac-8cdf-6c8450e7f3cb admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.238870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ae7db-52c6-44ac-8cdf-6c8450e7f3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.239140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ae7db-52c6-44ac-8cdf-6c8450e7f3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.239769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ae7db-52c6-44ac-8cdf-6c8450e7f3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:20.241450 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 787/1584] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:20.241643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ae7db-52c6-44ac-8cdf-6c8450e7f3cb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:20.242385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad22ec8-7746-409c-b2d9-eb8c7e66ee1f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:20.255401 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 798/1585] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:20.255401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ae7db-52c6-44ac-8cdf-6c8450e7f3cb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:20.255612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad22ec8-7746-409c-b2d9-eb8c7e66ee1f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:20.258325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066d3bc-7857-4b75-b76a-536cd24beb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:20.259061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066d3bc-7857-4b75-b76a-536cd24beb39 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.259338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066d3bc-7857-4b75-b76a-536cd24beb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.259605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066d3bc-7857-4b75-b76a-536cd24beb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.260233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066d3bc-7857-4b75-b76a-536cd24beb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:20.262407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066d3bc-7857-4b75-b76a-536cd24beb39 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:20.263465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ae7db-52c6-44ac-8cdf-6c8450e7f3cb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:20.267955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f443dbf-733a-4949-b3d6-af5f43b6e752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:20.268526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f443dbf-733a-4949-b3d6-af5f43b6e752 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.268829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f443dbf-733a-4949-b3d6-af5f43b6e752 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.269097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f443dbf-733a-4949-b3d6-af5f43b6e752 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.269715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f443dbf-733a-4949-b3d6-af5f43b6e752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:20.271259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f443dbf-733a-4949-b3d6-af5f43b6e752 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:20.272483 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 788/1586] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:20.276355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066d3bc-7857-4b75-b76a-536cd24beb39 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:20.284737 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 799/1587] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:20.284737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81cccb-f51a-463e-9648-64647b35376f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.284737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81cccb-f51a-463e-9648-64647b35376f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.284737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81cccb-f51a-463e-9648-64647b35376f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.288846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066d3bc-7857-4b75-b76a-536cd24beb39 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:20.294154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f726e5-9c68-478e-b068-8766a6b3f6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:20.294739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f726e5-9c68-478e-b068-8766a6b3f6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.295017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f726e5-9c68-478e-b068-8766a6b3f6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.295286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f726e5-9c68-478e-b068-8766a6b3f6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.295942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f726e5-9c68-478e-b068-8766a6b3f6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:20.297645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f726e5-9c68-478e-b068-8766a6b3f6d8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:20.308046 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 789/1588] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:20.312570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3e81cccb-f51a-463e-9648-64647b35376f None None] MFA Rules not processed for user `d83be3deadd74d24a632830e73682cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:20.312817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c86ff4-b68c-4329-bb91-ca42524b0115 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.313102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c86ff4-b68c-4329-bb91-ca42524b0115 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.313383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c86ff4-b68c-4329-bb91-ca42524b0115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.313900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3e81cccb-f51a-463e-9648-64647b35376f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:20.341451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f9c86ff4-b68c-4329-bb91-ca42524b0115 None None] MFA Rules not processed for user `1a10ab88faf24a118cc7b6f3adf404da`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:20.342660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f9c86ff4-b68c-4329-bb91-ca42524b0115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:20.371469 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:20.384996 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 800/1589] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:20.384996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81cccb-f51a-463e-9648-64647b35376f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:20.393004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81cccb-f51a-463e-9648-64647b35376f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:20.397587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7615fc-65e2-4501-b83b-bcd0e562210f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:20.398175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7615fc-65e2-4501-b83b-bcd0e562210f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.398456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7615fc-65e2-4501-b83b-bcd0e562210f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.398727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7615fc-65e2-4501-b83b-bcd0e562210f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.399362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7615fc-65e2-4501-b83b-bcd0e562210f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:20.400980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7615fc-65e2-4501-b83b-bcd0e562210f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:20.411627 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 790/1590] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:20.412462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c86ff4-b68c-4329-bb91-ca42524b0115 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:20.415028 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 801/1591] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:20.415855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7615fc-65e2-4501-b83b-bcd0e562210f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:20.424886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c86ff4-b68c-4329-bb91-ca42524b0115 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:20.425940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7615fc-65e2-4501-b83b-bcd0e562210f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:20.429386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6079a-6b6b-4433-ae7c-5adc6a686161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:20.429997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6079a-6b6b-4433-ae7c-5adc6a686161 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.430271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6079a-6b6b-4433-ae7c-5adc6a686161 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.430411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4157e-a476-4d73-ae2a-6c31e4c00957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:20.430527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6079a-6b6b-4433-ae7c-5adc6a686161 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.431041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4157e-a476-4d73-ae2a-6c31e4c00957 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.431181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6079a-6b6b-4433-ae7c-5adc6a686161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:20.431320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4157e-a476-4d73-ae2a-6c31e4c00957 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.431593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4157e-a476-4d73-ae2a-6c31e4c00957 admin admin] PATH_INFO: `/v3/projects/a1057707ad4c4a82b37451280530a7a5/users/30cb31b44aeb4d64b0c24db25ebe4cf5/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.432807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6079a-6b6b-4433-ae7c-5adc6a686161 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:20.442765 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 791/1592] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:20.443607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6079a-6b6b-4433-ae7c-5adc6a686161 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:20.450465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec4157e-a476-4d73-ae2a-6c31e4c00957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1057707ad4c4a82b37451280530a7a5, user_id=30cb31b44aeb4d64b0c24db25ebe4cf5, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:20.453114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec4157e-a476-4d73-ae2a-6c31e4c00957 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:20.453536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6079a-6b6b-4433-ae7c-5adc6a686161 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:20.458677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd9847-f221-448a-81d2-3f837c78e1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:20.459318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd9847-f221-448a-81d2-3f837c78e1bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.459696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd9847-f221-448a-81d2-3f837c78e1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.460015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd9847-f221-448a-81d2-3f837c78e1bc admin admin] PATH_INFO: `/v3/projects/ed0ea14d4b264d15a6ddef3f99b88e5b/users/956ce93d49804853bbfe3cc987d5b1b3/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.467882 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 802/1593] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:20 2022] PUT /identity/v3/projects/a1057707ad4c4a82b37451280530a7a5/users/30cb31b44aeb4d64b0c24db25ebe4cf5/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:20.468783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4157e-a476-4d73-ae2a-6c31e4c00957 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:20.488497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd9847-f221-448a-81d2-3f837c78e1bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed0ea14d4b264d15a6ddef3f99b88e5b, user_id=956ce93d49804853bbfe3cc987d5b1b3, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:20.490495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd9847-f221-448a-81d2-3f837c78e1bc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:20.504847 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 792/1594] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:20 2022] PUT /identity/v3/projects/ed0ea14d4b264d15a6ddef3f99b88e5b/users/956ce93d49804853bbfe3cc987d5b1b3/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:20.505906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd9847-f221-448a-81d2-3f837c78e1bc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:20.513155 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:20.544375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4157e-a476-4d73-ae2a-6c31e4c00957 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:20.579219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd9847-f221-448a-81d2-3f837c78e1bc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:20.584341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43deeb-80df-4514-b784-d95abe81e5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:20.585034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43deeb-80df-4514-b784-d95abe81e5f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.585308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43deeb-80df-4514-b784-d95abe81e5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.585576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43deeb-80df-4514-b784-d95abe81e5f3 admin admin] PATH_INFO: `/v3/projects/c0baae3464194a818232b045acd45874/users/1ed6e8a43efc4d478bec1de47ae2915f/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.600698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43deeb-80df-4514-b784-d95abe81e5f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0baae3464194a818232b045acd45874, user_id=1ed6e8a43efc4d478bec1de47ae2915f, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:20.603329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43deeb-80df-4514-b784-d95abe81e5f3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:20.603656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed232e-7673-41b0-b62f-0171ee50a678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:20.604312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed232e-7673-41b0-b62f-0171ee50a678 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.604592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed232e-7673-41b0-b62f-0171ee50a678 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.604895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed232e-7673-41b0-b62f-0171ee50a678 admin admin] PATH_INFO: `/v3/projects/9dc05d03adbd411582d529b168ec7709/users/5e41424deb9044f782b8aacba3c5cc95/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.617419 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 793/1595] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:20 2022] PUT /identity/v3/projects/c0baae3464194a818232b045acd45874/users/1ed6e8a43efc4d478bec1de47ae2915f/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:20.618192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43deeb-80df-4514-b784-d95abe81e5f3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:20.621677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed232e-7673-41b0-b62f-0171ee50a678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc05d03adbd411582d529b168ec7709, user_id=5e41424deb9044f782b8aacba3c5cc95, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:20.624782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed232e-7673-41b0-b62f-0171ee50a678 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:20.638537 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 803/1596] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:20 2022] PUT /identity/v3/projects/9dc05d03adbd411582d529b168ec7709/users/5e41424deb9044f782b8aacba3c5cc95/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:20.639324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed232e-7673-41b0-b62f-0171ee50a678 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:20.700075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43deeb-80df-4514-b784-d95abe81e5f3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:20.700949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed232e-7673-41b0-b62f-0171ee50a678 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:20.704788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65389a-aef7-4f07-8e83-9cf9fee48e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:20.705417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65389a-aef7-4f07-8e83-9cf9fee48e64 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.705535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f104d0-983a-4c35-a74a-3232e6e14c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:20.705956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65389a-aef7-4f07-8e83-9cf9fee48e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.706286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65389a-aef7-4f07-8e83-9cf9fee48e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.706454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f104d0-983a-4c35-a74a-3232e6e14c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.706690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f104d0-983a-4c35-a74a-3232e6e14c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.706908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65389a-aef7-4f07-8e83-9cf9fee48e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:20.707000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f104d0-983a-4c35-a74a-3232e6e14c3d admin admin] PATH_INFO: `/v3/projects/8abba10152a3464f8a3ae127eec97382/users/afde748057354f5b8561ae635c362c8c/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.708802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65389a-aef7-4f07-8e83-9cf9fee48e64 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:20.722036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f104d0-983a-4c35-a74a-3232e6e14c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8abba10152a3464f8a3ae127eec97382, user_id=afde748057354f5b8561ae635c362c8c, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:20.725050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f104d0-983a-4c35-a74a-3232e6e14c3d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:20.738693 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 794/1597] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:20 2022] POST /identity/v3/projects => generated 395 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:20.739729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65389a-aef7-4f07-8e83-9cf9fee48e64 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:20.739847 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 804/1598] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:20 2022] PUT /identity/v3/projects/8abba10152a3464f8a3ae127eec97382/users/afde748057354f5b8561ae635c362c8c/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:20.740765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f104d0-983a-4c35-a74a-3232e6e14c3d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:20.751094 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:20.795564 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:20.813006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f104d0-983a-4c35-a74a-3232e6e14c3d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:20.813620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65389a-aef7-4f07-8e83-9cf9fee48e64 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:20.817615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965b6fd-6157-41c4-88a3-46e73e654f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:20.818153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5de8d-840e-4ebb-834b-f0f0ba205ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:20.818271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965b6fd-6157-41c4-88a3-46e73e654f2b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.818524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965b6fd-6157-41c4-88a3-46e73e654f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.818747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5de8d-840e-4ebb-834b-f0f0ba205ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.818840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965b6fd-6157-41c4-88a3-46e73e654f2b admin admin] PATH_INFO: `/v3/projects/6028136ce4444c169635eab90c3269ed/users/1fd370be740e4ad2828371c7af7b4bc2/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.819022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5de8d-840e-4ebb-834b-f0f0ba205ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.819291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5de8d-840e-4ebb-834b-f0f0ba205ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.819912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5de8d-840e-4ebb-834b-f0f0ba205ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:20.821808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5de8d-840e-4ebb-834b-f0f0ba205ca0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:20.833864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965b6fd-6157-41c4-88a3-46e73e654f2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6028136ce4444c169635eab90c3269ed, user_id=1fd370be740e4ad2828371c7af7b4bc2, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:20.836399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965b6fd-6157-41c4-88a3-46e73e654f2b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:20.850501 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 805/1599] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:20 2022] PUT /identity/v3/projects/6028136ce4444c169635eab90c3269ed/users/1fd370be740e4ad2828371c7af7b4bc2/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:20.850649 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 795/1600] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:20 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:20.851524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7c9e6-291c-409d-835d-eb4f0c19e6ed None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.851795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7c9e6-291c-409d-835d-eb4f0c19e6ed None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.852062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7c9e6-291c-409d-835d-eb4f0c19e6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.854473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc39408-ea1b-4f2f-9762-5b210d8a7408 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.854805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc39408-ea1b-4f2f-9762-5b210d8a7408 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.855082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc39408-ea1b-4f2f-9762-5b210d8a7408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.884472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cfc39408-ea1b-4f2f-9762-5b210d8a7408 None None] MFA Rules not processed for user `956ce93d49804853bbfe3cc987d5b1b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:20.885698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cfc39408-ea1b-4f2f-9762-5b210d8a7408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:20.887426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-aef7c9e6-291c-409d-835d-eb4f0c19e6ed None None] MFA Rules not processed for user `30cb31b44aeb4d64b0c24db25ebe4cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:20.888607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-aef7c9e6-291c-409d-835d-eb4f0c19e6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:20.950841 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 796/1601] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:20 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:20.952165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a622531-4318-480e-935f-5bb166243b2b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.952450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a622531-4318-480e-935f-5bb166243b2b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.952753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a622531-4318-480e-935f-5bb166243b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.963971 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 806/1602] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:20.966069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ee79a-542d-496c-bd25-860e6930a157 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:20.966686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ee79a-542d-496c-bd25-860e6930a157 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:20.966686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ee79a-542d-496c-bd25-860e6930a157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:20.983366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8a622531-4318-480e-935f-5bb166243b2b None None] MFA Rules not processed for user `1ed6e8a43efc4d478bec1de47ae2915f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:20.984564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8a622531-4318-480e-935f-5bb166243b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:20.997289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-299ee79a-542d-496c-bd25-860e6930a157 None None] MFA Rules not processed for user `5e41424deb9044f782b8aacba3c5cc95`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:20.998603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-299ee79a-542d-496c-bd25-860e6930a157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:21.051779 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 797/1603] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:21.052680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a622531-4318-480e-935f-5bb166243b2b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:21.062460 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:21.067981 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 807/1604] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:21.069480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57e256-2bb0-4045-8846-7b522b455a08 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.069763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57e256-2bb0-4045-8846-7b522b455a08 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.070037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57e256-2bb0-4045-8846-7b522b455a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.101370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ac57e256-2bb0-4045-8846-7b522b455a08 None None] MFA Rules not processed for user `afde748057354f5b8561ae635c362c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:21.102510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ac57e256-2bb0-4045-8846-7b522b455a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:21.119055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a622531-4318-480e-935f-5bb166243b2b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:21.124027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c30da-4f79-4440-86c7-e0b87ca4aefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:21.124984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c30da-4f79-4440-86c7-e0b87ca4aefb admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.125274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c30da-4f79-4440-86c7-e0b87ca4aefb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.125526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c30da-4f79-4440-86c7-e0b87ca4aefb admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.126149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c30da-4f79-4440-86c7-e0b87ca4aefb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:21.128028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c30da-4f79-4440-86c7-e0b87ca4aefb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:21.138364 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:21.156133 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 798/1605] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:21 2022] POST /identity/v3/users => generated 304 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:21.156133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c30da-4f79-4440-86c7-e0b87ca4aefb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:21.162578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c30da-4f79-4440-86c7-e0b87ca4aefb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:21.167223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11181e9d-89d5-4b35-a828-acc0c7155a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:21.167810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11181e9d-89d5-4b35-a828-acc0c7155a41 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.168441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11181e9d-89d5-4b35-a828-acc0c7155a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.168441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11181e9d-89d5-4b35-a828-acc0c7155a41 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.168975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11181e9d-89d5-4b35-a828-acc0c7155a41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:21.170888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11181e9d-89d5-4b35-a828-acc0c7155a41 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:21.172611 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 808/1606] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:21.173907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09accb-5df2-422b-8e93-e990b067cc45 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.174196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09accb-5df2-422b-8e93-e990b067cc45 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.174485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09accb-5df2-422b-8e93-e990b067cc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.195781 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 799/1607] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:21 2022] POST /identity/v3/users => generated 297 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:21.195781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11181e9d-89d5-4b35-a828-acc0c7155a41 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:21.202111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6e09accb-5df2-422b-8e93-e990b067cc45 None None] MFA Rules not processed for user `1fd370be740e4ad2828371c7af7b4bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:21.203304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6e09accb-5df2-422b-8e93-e990b067cc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:21.205483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11181e9d-89d5-4b35-a828-acc0c7155a41 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:21.210468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18857c39-b76b-49d6-8e06-9f92f5c7080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:21.211050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18857c39-b76b-49d6-8e06-9f92f5c7080a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.211329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18857c39-b76b-49d6-8e06-9f92f5c7080a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.211598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18857c39-b76b-49d6-8e06-9f92f5c7080a admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.212216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18857c39-b76b-49d6-8e06-9f92f5c7080a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:21.214107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18857c39-b76b-49d6-8e06-9f92f5c7080a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:21.242033 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 800/1608] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:21 2022] POST /identity/v3/projects => generated 397 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:21.242914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18857c39-b76b-49d6-8e06-9f92f5c7080a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:21.271793 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 809/1609] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:21.272661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09accb-5df2-422b-8e93-e990b067cc45 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:21.283840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09accb-5df2-422b-8e93-e990b067cc45 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:21.305012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18857c39-b76b-49d6-8e06-9f92f5c7080a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:21.309830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac09fcc-4d39-461d-b466-05e10bcc3075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:21.310423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac09fcc-4d39-461d-b466-05e10bcc3075 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.310702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac09fcc-4d39-461d-b466-05e10bcc3075 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.310971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac09fcc-4d39-461d-b466-05e10bcc3075 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.311591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac09fcc-4d39-461d-b466-05e10bcc3075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:21.313504 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac09fcc-4d39-461d-b466-05e10bcc3075 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:21.341615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabfa89-ec40-4871-bdda-ede76bd085f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:21.342224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabfa89-ec40-4871-bdda-ede76bd085f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.342501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabfa89-ec40-4871-bdda-ede76bd085f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.342773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabfa89-ec40-4871-bdda-ede76bd085f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.343428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabfa89-ec40-4871-bdda-ede76bd085f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:21.343615 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 801/1610] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:21 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:21.344498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac09fcc-4d39-461d-b466-05e10bcc3075 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:21.349201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabfa89-ec40-4871-bdda-ede76bd085f4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:21.381438 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 810/1611] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:21 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:21.382195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabfa89-ec40-4871-bdda-ede76bd085f4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:21.399098 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:21.421710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac09fcc-4d39-461d-b466-05e10bcc3075 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:21.434991 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:21.449439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabfa89-ec40-4871-bdda-ede76bd085f4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:21.454289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9aa7c7-dcdd-45f6-835c-d5ff8ce67ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:21.454890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9aa7c7-dcdd-45f6-835c-d5ff8ce67ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.455166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9aa7c7-dcdd-45f6-835c-d5ff8ce67ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.455547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9aa7c7-dcdd-45f6-835c-d5ff8ce67ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.456443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9aa7c7-dcdd-45f6-835c-d5ff8ce67ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:21.458050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9aa7c7-dcdd-45f6-835c-d5ff8ce67ad2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:21.468540 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 811/1612] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:21.469361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9aa7c7-dcdd-45f6-835c-d5ff8ce67ad2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:21.478752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9aa7c7-dcdd-45f6-835c-d5ff8ce67ad2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:21.483445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6996d8-e37b-4bf4-bca8-f95abbfe88b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:21.484055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6996d8-e37b-4bf4-bca8-f95abbfe88b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.484148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075dc73-386c-455d-9d65-b8042550ca70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:21.484326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6996d8-e37b-4bf4-bca8-f95abbfe88b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.484591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6996d8-e37b-4bf4-bca8-f95abbfe88b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.484694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075dc73-386c-455d-9d65-b8042550ca70 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.484953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075dc73-386c-455d-9d65-b8042550ca70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.485223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075dc73-386c-455d-9d65-b8042550ca70 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.485333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6996d8-e37b-4bf4-bca8-f95abbfe88b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:21.485831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075dc73-386c-455d-9d65-b8042550ca70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:21.487083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6996d8-e37b-4bf4-bca8-f95abbfe88b1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:21.487702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075dc73-386c-455d-9d65-b8042550ca70 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:21.519256 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 802/1613] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:21 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:21.519464 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 812/1614] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:21 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:21.519581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6996d8-e37b-4bf4-bca8-f95abbfe88b1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:21.519672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075dc73-386c-455d-9d65-b8042550ca70 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:21.588181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075dc73-386c-455d-9d65-b8042550ca70 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:21.593202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6996d8-e37b-4bf4-bca8-f95abbfe88b1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:21.594328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac18f71-b8c6-432c-80b2-dee885691676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:21.594947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac18f71-b8c6-432c-80b2-dee885691676 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.595231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac18f71-b8c6-432c-80b2-dee885691676 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.595515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac18f71-b8c6-432c-80b2-dee885691676 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.596140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac18f71-b8c6-432c-80b2-dee885691676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:21.598152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac18f71-b8c6-432c-80b2-dee885691676 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:21.601135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1686b-bee2-4220-936f-944d97c4496e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:21.602014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1686b-bee2-4220-936f-944d97c4496e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.602454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1686b-bee2-4220-936f-944d97c4496e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.602717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1686b-bee2-4220-936f-944d97c4496e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.603570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1686b-bee2-4220-936f-944d97c4496e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:21.606106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1686b-bee2-4220-936f-944d97c4496e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:21.618496 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 803/1615] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:21.619329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1686b-bee2-4220-936f-944d97c4496e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:21.623773 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 813/1616] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:21 2022] POST /identity/v3/users => generated 305 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:21.623773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac18f71-b8c6-432c-80b2-dee885691676 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:21.631618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1686b-bee2-4220-936f-944d97c4496e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:21.633727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac18f71-b8c6-432c-80b2-dee885691676 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:21.636155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f2029-f66e-4c40-8b41-35d838bb879c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:21.637483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f2029-f66e-4c40-8b41-35d838bb879c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.637772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f2029-f66e-4c40-8b41-35d838bb879c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.638050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f2029-f66e-4c40-8b41-35d838bb879c admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.638333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36812ea1-5115-4b5d-8d4e-6eec395a182e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:21.638680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f2029-f66e-4c40-8b41-35d838bb879c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:21.638914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36812ea1-5115-4b5d-8d4e-6eec395a182e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.639190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36812ea1-5115-4b5d-8d4e-6eec395a182e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.639456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36812ea1-5115-4b5d-8d4e-6eec395a182e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.640067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36812ea1-5115-4b5d-8d4e-6eec395a182e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:21.640561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f2029-f66e-4c40-8b41-35d838bb879c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:21.641964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36812ea1-5115-4b5d-8d4e-6eec395a182e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:21.664173 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 814/1617] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:21 2022] POST /identity/v3/users => generated 300 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:21.665013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36812ea1-5115-4b5d-8d4e-6eec395a182e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:21.671520 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 804/1618] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:21 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:21.671520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f2029-f66e-4c40-8b41-35d838bb879c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:21.676904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36812ea1-5115-4b5d-8d4e-6eec395a182e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:21.720816 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:21.734934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1188e-fbb8-4148-ab5c-49d3b21b35b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:21.735412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f2029-f66e-4c40-8b41-35d838bb879c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:21.735543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1188e-fbb8-4148-ab5c-49d3b21b35b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.735873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1188e-fbb8-4148-ab5c-49d3b21b35b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.736141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1188e-fbb8-4148-ab5c-49d3b21b35b5 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.736811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1188e-fbb8-4148-ab5c-49d3b21b35b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:21.738698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1188e-fbb8-4148-ab5c-49d3b21b35b5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:21.740104 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879ec8d-556d-40e0-b1a8-7cea5fd66e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:21.740791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879ec8d-556d-40e0-b1a8-7cea5fd66e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.741074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879ec8d-556d-40e0-b1a8-7cea5fd66e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.741350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879ec8d-556d-40e0-b1a8-7cea5fd66e40 admin admin] PATH_INFO: `/v3/projects/3cca7ee364554888a73b1f6f8cd25681/users/a981f725bdfa4727b4ae8fe8c1479082/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.757680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879ec8d-556d-40e0-b1a8-7cea5fd66e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cca7ee364554888a73b1f6f8cd25681, user_id=a981f725bdfa4727b4ae8fe8c1479082, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:21.760112 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 815/1619] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:21 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:21.760324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879ec8d-556d-40e0-b1a8-7cea5fd66e40 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:21.760929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1188e-fbb8-4148-ab5c-49d3b21b35b5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:21.772428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1188e-fbb8-4148-ab5c-49d3b21b35b5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:21.776533 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 805/1620] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:21 2022] PUT /identity/v3/projects/3cca7ee364554888a73b1f6f8cd25681/users/a981f725bdfa4727b4ae8fe8c1479082/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:21.777983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879ec8d-556d-40e0-b1a8-7cea5fd66e40 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:21.801764 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:21.836618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2083d0b-bf62-4424-91bb-d2890c8bad5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:21.836864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2083d0b-bf62-4424-91bb-d2890c8bad5d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.837132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2083d0b-bf62-4424-91bb-d2890c8bad5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.837453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2083d0b-bf62-4424-91bb-d2890c8bad5d admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.838211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2083d0b-bf62-4424-91bb-d2890c8bad5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:21.841148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2083d0b-bf62-4424-91bb-d2890c8bad5d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:21.847474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879ec8d-556d-40e0-b1a8-7cea5fd66e40 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:21.852623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61868d-7182-4727-973f-252b910ac42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:21.853199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61868d-7182-4727-973f-252b910ac42c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.853568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61868d-7182-4727-973f-252b910ac42c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.853913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61868d-7182-4727-973f-252b910ac42c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.854551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61868d-7182-4727-973f-252b910ac42c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:21.856879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61868d-7182-4727-973f-252b910ac42c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:21.867231 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 816/1621] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:21 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:21.868097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2083d0b-bf62-4424-91bb-d2890c8bad5d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:21.880466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2083d0b-bf62-4424-91bb-d2890c8bad5d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:21.881966 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 806/1622] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:21 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:21.882744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61868d-7182-4727-973f-252b910ac42c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:21.885641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26af75-102c-47fb-bd27-ac583c464245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:21.886504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26af75-102c-47fb-bd27-ac583c464245 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.888124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26af75-102c-47fb-bd27-ac583c464245 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.888508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26af75-102c-47fb-bd27-ac583c464245 admin admin] PATH_INFO: `/v3/projects/eae3875a20c343ecbda9f672b5177a1a/users/cf3572f3866246d88dbd0e66efda98a3/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.895905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61868d-7182-4727-973f-252b910ac42c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:21.901837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c3dc5-b28d-4292-aaee-0167fea2ca84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:21.902753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c3dc5-b28d-4292-aaee-0167fea2ca84 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:21.903216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c3dc5-b28d-4292-aaee-0167fea2ca84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:21.903533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c3dc5-b28d-4292-aaee-0167fea2ca84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:21.904571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26af75-102c-47fb-bd27-ac583c464245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eae3875a20c343ecbda9f672b5177a1a, user_id=cf3572f3866246d88dbd0e66efda98a3, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:21.904837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c3dc5-b28d-4292-aaee-0167fea2ca84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:21.906604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c3dc5-b28d-4292-aaee-0167fea2ca84 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:21.907324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26af75-102c-47fb-bd27-ac583c464245 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:21.923444 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 807/1623] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:21.924177 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 817/1624] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:21 2022] PUT /identity/v3/projects/eae3875a20c343ecbda9f672b5177a1a/users/cf3572f3866246d88dbd0e66efda98a3/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:21.924323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c3dc5-b28d-4292-aaee-0167fea2ca84 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:21.925320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26af75-102c-47fb-bd27-ac583c464245 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:21.937824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c3dc5-b28d-4292-aaee-0167fea2ca84 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:21.996702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26af75-102c-47fb-bd27-ac583c464245 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:21.999911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6aa597-e9d8-415a-9088-f3f1476e9fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:22.000553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aa597-e9d8-415a-9088-f3f1476e9fce admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.000877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aa597-e9d8-415a-9088-f3f1476e9fce admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.001133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aa597-e9d8-415a-9088-f3f1476e9fce admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.001777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6aa597-e9d8-415a-9088-f3f1476e9fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:22.002238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0e51a-10d2-49ee-bb1b-5d8a39babbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:22.002846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0e51a-10d2-49ee-bb1b-5d8a39babbb2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.003125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0e51a-10d2-49ee-bb1b-5d8a39babbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.003394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0e51a-10d2-49ee-bb1b-5d8a39babbb2 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.003490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6aa597-e9d8-415a-9088-f3f1476e9fce admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:22.004020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0e51a-10d2-49ee-bb1b-5d8a39babbb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:22.005975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0e51a-10d2-49ee-bb1b-5d8a39babbb2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:22.018751 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 808/1625] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:22.019961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6aa597-e9d8-415a-9088-f3f1476e9fce admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:22.031263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6aa597-e9d8-415a-9088-f3f1476e9fce admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:22.035523 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 818/1626] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:21 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:22.036329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a04c3-2035-468a-8cab-72c0d30530fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:22.036975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a04c3-2035-468a-8cab-72c0d30530fc admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.037253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a04c3-2035-468a-8cab-72c0d30530fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.037526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a04c3-2035-468a-8cab-72c0d30530fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.038254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a04c3-2035-468a-8cab-72c0d30530fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:22.038735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0e51a-10d2-49ee-bb1b-5d8a39babbb2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:22.039909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a04c3-2035-468a-8cab-72c0d30530fc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:22.050176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0e51a-10d2-49ee-bb1b-5d8a39babbb2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:22.054789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe556f8-6dd9-416b-9a81-91d4dc657364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:22.055385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe556f8-6dd9-416b-9a81-91d4dc657364 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.055661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe556f8-6dd9-416b-9a81-91d4dc657364 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.055927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe556f8-6dd9-416b-9a81-91d4dc657364 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.056556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe556f8-6dd9-416b-9a81-91d4dc657364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:22.058158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe556f8-6dd9-416b-9a81-91d4dc657364 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:22.065278 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 809/1627] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:22.065278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a04c3-2035-468a-8cab-72c0d30530fc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:22.074864 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 819/1628] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:22.074864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe556f8-6dd9-416b-9a81-91d4dc657364 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:22.077802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a04c3-2035-468a-8cab-72c0d30530fc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:22.082875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d941204-c16b-43d2-a3b1-753857bec108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:22.083386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe556f8-6dd9-416b-9a81-91d4dc657364 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:22.083484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d941204-c16b-43d2-a3b1-753857bec108 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.083728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d941204-c16b-43d2-a3b1-753857bec108 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.084002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d941204-c16b-43d2-a3b1-753857bec108 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.084690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d941204-c16b-43d2-a3b1-753857bec108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:22.086243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d941204-c16b-43d2-a3b1-753857bec108 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:22.088275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a0e98-61fa-4694-a5d5-d7d8ee58cc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:22.088926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a0e98-61fa-4694-a5d5-d7d8ee58cc55 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.089208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a0e98-61fa-4694-a5d5-d7d8ee58cc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.089495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a0e98-61fa-4694-a5d5-d7d8ee58cc55 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.090427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a0e98-61fa-4694-a5d5-d7d8ee58cc55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:22.092060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a0e98-61fa-4694-a5d5-d7d8ee58cc55 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:22.096938 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 810/1629] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:22.097703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d941204-c16b-43d2-a3b1-753857bec108 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:22.102915 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 820/1630] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:22.103760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a0e98-61fa-4694-a5d5-d7d8ee58cc55 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:22.111627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d941204-c16b-43d2-a3b1-753857bec108 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:22.113919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a0e98-61fa-4694-a5d5-d7d8ee58cc55 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:22.116210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f7cf8-cc32-4134-b647-1a02eb186d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:22.116880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f7cf8-cc32-4134-b647-1a02eb186d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.117272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f7cf8-cc32-4134-b647-1a02eb186d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.117558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f7cf8-cc32-4134-b647-1a02eb186d41 admin admin] PATH_INFO: `/v3/projects/2596452dd7cf48a58276e050c4847a80/users/0b4c7ff8b586411aafdec4510626c458/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.119046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a21d0-56b8-4fbe-a9eb-bc5003a9c82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:22.119626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a21d0-56b8-4fbe-a9eb-bc5003a9c82a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.119905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a21d0-56b8-4fbe-a9eb-bc5003a9c82a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.120176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a21d0-56b8-4fbe-a9eb-bc5003a9c82a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.121510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a21d0-56b8-4fbe-a9eb-bc5003a9c82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:22.123080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a21d0-56b8-4fbe-a9eb-bc5003a9c82a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:22.133140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f7cf8-cc32-4134-b647-1a02eb186d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2596452dd7cf48a58276e050c4847a80, user_id=0b4c7ff8b586411aafdec4510626c458, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:22.133484 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 821/1631] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:22.134324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a21d0-56b8-4fbe-a9eb-bc5003a9c82a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:22.135991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f7cf8-cc32-4134-b647-1a02eb186d41 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:22.144760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a21d0-56b8-4fbe-a9eb-bc5003a9c82a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:22.145916 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:22.150915 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 811/1632] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:22 2022] PUT /identity/v3/projects/2596452dd7cf48a58276e050c4847a80/users/0b4c7ff8b586411aafdec4510626c458/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:22.152852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f7cf8-cc32-4134-b647-1a02eb186d41 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:22.191836 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:22.206659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d78ca8-204b-49c4-bc7e-7cbca5c05572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:22.207311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d78ca8-204b-49c4-bc7e-7cbca5c05572 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.207583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d78ca8-204b-49c4-bc7e-7cbca5c05572 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.207956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d78ca8-204b-49c4-bc7e-7cbca5c05572 admin admin] PATH_INFO: `/v3/projects/eba7f2d771ac480abe87eb4cd4df69ac/users/cc87618fdef24c199901ca726ab4a6e5/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.219861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f7cf8-cc32-4134-b647-1a02eb186d41 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:22.222720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d78ca8-204b-49c4-bc7e-7cbca5c05572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba7f2d771ac480abe87eb4cd4df69ac, user_id=cc87618fdef24c199901ca726ab4a6e5, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:22.224520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a3083-2ddd-486d-a78f-f3fe1f404502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:22.226439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d78ca8-204b-49c4-bc7e-7cbca5c05572 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:22.226546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a3083-2ddd-486d-a78f-f3fe1f404502 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.226546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a3083-2ddd-486d-a78f-f3fe1f404502 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.226708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a3083-2ddd-486d-a78f-f3fe1f404502 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.227281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a3083-2ddd-486d-a78f-f3fe1f404502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:22.228875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a3083-2ddd-486d-a78f-f3fe1f404502 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:22.239314 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 822/1633] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:22 2022] PUT /identity/v3/projects/eba7f2d771ac480abe87eb4cd4df69ac/users/cc87618fdef24c199901ca726ab4a6e5/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:22.240085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d78ca8-204b-49c4-bc7e-7cbca5c05572 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:22.243629 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 812/1634] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:22.243629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a3083-2ddd-486d-a78f-f3fe1f404502 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:22.253149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a3083-2ddd-486d-a78f-f3fe1f404502 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:22.306011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d78ca8-204b-49c4-bc7e-7cbca5c05572 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:22.310546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a532434-061b-47e0-83c6-7a5024957166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:22.311196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a532434-061b-47e0-83c6-7a5024957166 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.311473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a532434-061b-47e0-83c6-7a5024957166 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.311746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a532434-061b-47e0-83c6-7a5024957166 admin admin] PATH_INFO: `/v3/projects/c9de10355880479f8fb1786c004decb0/users/126543753a3a4af5b7e5de4126f58387/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.312989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc24b1-99a2-4a2e-948d-87f4305bf56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:22.313702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc24b1-99a2-4a2e-948d-87f4305bf56b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.314047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc24b1-99a2-4a2e-948d-87f4305bf56b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.314426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc24b1-99a2-4a2e-948d-87f4305bf56b admin admin] PATH_INFO: `/v3/projects/3cca7ee364554888a73b1f6f8cd25681/users/a981f725bdfa4727b4ae8fe8c1479082/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.316300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc24b1-99a2-4a2e-948d-87f4305bf56b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cca7ee364554888a73b1f6f8cd25681, user_id=a981f725bdfa4727b4ae8fe8c1479082, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:22.318988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc24b1-99a2-4a2e-948d-87f4305bf56b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:22.326192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a532434-061b-47e0-83c6-7a5024957166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9de10355880479f8fb1786c004decb0, user_id=126543753a3a4af5b7e5de4126f58387, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:22.328836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a532434-061b-47e0-83c6-7a5024957166 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:22.330164 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 813/1635] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:22 2022] PUT /identity/v3/projects/3cca7ee364554888a73b1f6f8cd25681/users/a981f725bdfa4727b4ae8fe8c1479082/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:22.331480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc24b1-99a2-4a2e-948d-87f4305bf56b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:22.344457 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 823/1636] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:22 2022] PUT /identity/v3/projects/c9de10355880479f8fb1786c004decb0/users/126543753a3a4af5b7e5de4126f58387/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:22.345315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a532434-061b-47e0-83c6-7a5024957166 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:22.395936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc24b1-99a2-4a2e-948d-87f4305bf56b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:22.406955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a532434-061b-47e0-83c6-7a5024957166 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:22.412040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b143f-9dc9-4ad3-9cbe-cf6d0bd8317f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:22.412728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b143f-9dc9-4ad3-9cbe-cf6d0bd8317f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.413004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b143f-9dc9-4ad3-9cbe-cf6d0bd8317f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.413274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b143f-9dc9-4ad3-9cbe-cf6d0bd8317f admin admin] PATH_INFO: `/v3/projects/dfe08f303eab41029c11657360186f06/users/8629e93fb060455d8fba8ba04ef2ec08/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.428727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b143f-9dc9-4ad3-9cbe-cf6d0bd8317f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe08f303eab41029c11657360186f06, user_id=8629e93fb060455d8fba8ba04ef2ec08, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:22.429341 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:22.431666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b143f-9dc9-4ad3-9cbe-cf6d0bd8317f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:22.445088 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 824/1637] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:22 2022] PUT /identity/v3/projects/dfe08f303eab41029c11657360186f06/users/8629e93fb060455d8fba8ba04ef2ec08/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:22.446036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b143f-9dc9-4ad3-9cbe-cf6d0bd8317f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:22.458569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a6b5b-75ca-4857-8e5f-89948967d928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:22.459280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a6b5b-75ca-4857-8e5f-89948967d928 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.459583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a6b5b-75ca-4857-8e5f-89948967d928 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.459848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a6b5b-75ca-4857-8e5f-89948967d928 admin admin] PATH_INFO: `/v3/projects/2d7e502f111d4476a24bbd7da6ebe284/users/70827d8950d74591b99a22ea4e843aad/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.475005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a6b5b-75ca-4857-8e5f-89948967d928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7e502f111d4476a24bbd7da6ebe284, user_id=70827d8950d74591b99a22ea4e843aad, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:22.477665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a6b5b-75ca-4857-8e5f-89948967d928 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:22.486156 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:22.493037 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 814/1638] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:22 2022] PUT /identity/v3/projects/2d7e502f111d4476a24bbd7da6ebe284/users/70827d8950d74591b99a22ea4e843aad/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:22.497623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a6b5b-75ca-4857-8e5f-89948967d928 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:22.508947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b143f-9dc9-4ad3-9cbe-cf6d0bd8317f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:22.558470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a6b5b-75ca-4857-8e5f-89948967d928 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:22.562942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f4226-64d6-4eba-a96e-037589c64471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:22.563550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f4226-64d6-4eba-a96e-037589c64471 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.563826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f4226-64d6-4eba-a96e-037589c64471 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.564095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f4226-64d6-4eba-a96e-037589c64471 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.564770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f4226-64d6-4eba-a96e-037589c64471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:22.566359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f4226-64d6-4eba-a96e-037589c64471 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:22.567320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2c6da-21a2-4d6e-b093-126f6a6a1528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:22.567971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2c6da-21a2-4d6e-b093-126f6a6a1528 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.568249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2c6da-21a2-4d6e-b093-126f6a6a1528 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.568515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2c6da-21a2-4d6e-b093-126f6a6a1528 admin admin] PATH_INFO: `/v3/projects/eae3875a20c343ecbda9f672b5177a1a/users/cf3572f3866246d88dbd0e66efda98a3/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.570438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2c6da-21a2-4d6e-b093-126f6a6a1528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eae3875a20c343ecbda9f672b5177a1a, user_id=cf3572f3866246d88dbd0e66efda98a3, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:22.573092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2c6da-21a2-4d6e-b093-126f6a6a1528 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:22.576306 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 815/1639] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:22.580252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f4226-64d6-4eba-a96e-037589c64471 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:22.584379 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 825/1640] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:22 2022] PUT /identity/v3/projects/eae3875a20c343ecbda9f672b5177a1a/users/cf3572f3866246d88dbd0e66efda98a3/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:22.593314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2c6da-21a2-4d6e-b093-126f6a6a1528 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:22.593447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f4226-64d6-4eba-a96e-037589c64471 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:22.650593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb82b51-fef3-493f-9c93-dc634f679a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:22.651114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb82b51-fef3-493f-9c93-dc634f679a0a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.651384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb82b51-fef3-493f-9c93-dc634f679a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.651652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb82b51-fef3-493f-9c93-dc634f679a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.652873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb82b51-fef3-493f-9c93-dc634f679a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:22.654565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb82b51-fef3-493f-9c93-dc634f679a0a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:22.655230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2c6da-21a2-4d6e-b093-126f6a6a1528 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:22.659825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fb3fe-bc9b-4a54-96e0-04ba14a7a218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:22.660497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fb3fe-bc9b-4a54-96e0-04ba14a7a218 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.660804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fb3fe-bc9b-4a54-96e0-04ba14a7a218 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.661079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fb3fe-bc9b-4a54-96e0-04ba14a7a218 admin admin] PATH_INFO: `/v3/projects/c34dc699e66740b3b0c81b055510d87e/users/5e41a982f9cb40feb88ee664ac02b4bc/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.664483 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 816/1641] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:22.665744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc609b-f59f-4769-98fe-a6045de3c2c1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.666026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc609b-f59f-4769-98fe-a6045de3c2c1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.666298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc609b-f59f-4769-98fe-a6045de3c2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.678721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fb3fe-bc9b-4a54-96e0-04ba14a7a218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34dc699e66740b3b0c81b055510d87e, user_id=5e41a982f9cb40feb88ee664ac02b4bc, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:22.681409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fb3fe-bc9b-4a54-96e0-04ba14a7a218 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:22.694723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f1bc609b-f59f-4769-98fe-a6045de3c2c1 None None] MFA Rules not processed for user `a981f725bdfa4727b4ae8fe8c1479082`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:22.695381 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 826/1642] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:22 2022] PUT /identity/v3/projects/c34dc699e66740b3b0c81b055510d87e/users/5e41a982f9cb40feb88ee664ac02b4bc/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:22.695923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f1bc609b-f59f-4769-98fe-a6045de3c2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:22.696460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fb3fe-bc9b-4a54-96e0-04ba14a7a218 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:22.740830 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:22.762939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fb3fe-bc9b-4a54-96e0-04ba14a7a218 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:22.767711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfd343-139e-4fe7-b05e-8c22625f2f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:22.768338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfd343-139e-4fe7-b05e-8c22625f2f71 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.768623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfd343-139e-4fe7-b05e-8c22625f2f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.769160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfd343-139e-4fe7-b05e-8c22625f2f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.769257 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 817/1643] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:22 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:22.769637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfd343-139e-4fe7-b05e-8c22625f2f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:22.769814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc609b-f59f-4769-98fe-a6045de3c2c1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:22.771329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfd343-139e-4fe7-b05e-8c22625f2f71 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:22.774093 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:22.780049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc609b-f59f-4769-98fe-a6045de3c2c1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:22.784777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ececd1c-aac4-4625-be30-db69a4e29063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:22.785389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ececd1c-aac4-4625-be30-db69a4e29063 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.785674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ececd1c-aac4-4625-be30-db69a4e29063 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.785944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ececd1c-aac4-4625-be30-db69a4e29063 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.789336 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 827/1644] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:22.789459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ececd1c-aac4-4625-be30-db69a4e29063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:22.789547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfd343-139e-4fe7-b05e-8c22625f2f71 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:22.789648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ececd1c-aac4-4625-be30-db69a4e29063 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:22.800657 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 818/1645] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:22.801260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ececd1c-aac4-4625-be30-db69a4e29063 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:22.807088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfd343-139e-4fe7-b05e-8c22625f2f71 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:22.812511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bf168-96be-4087-b155-152a75f6b5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:22.813139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bf168-96be-4087-b155-152a75f6b5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.813243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ececd1c-aac4-4625-be30-db69a4e29063 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:22.813418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bf168-96be-4087-b155-152a75f6b5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.813684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bf168-96be-4087-b155-152a75f6b5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.814322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bf168-96be-4087-b155-152a75f6b5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:22.815900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bf168-96be-4087-b155-152a75f6b5a3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:22.817810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157f4e5-f746-41b0-a38e-0ac13dd958ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:22.818445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157f4e5-f746-41b0-a38e-0ac13dd958ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.818725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157f4e5-f746-41b0-a38e-0ac13dd958ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.818995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157f4e5-f746-41b0-a38e-0ac13dd958ea admin admin] PATH_INFO: `/v3/projects/2596452dd7cf48a58276e050c4847a80/users/0b4c7ff8b586411aafdec4510626c458/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.821084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157f4e5-f746-41b0-a38e-0ac13dd958ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2596452dd7cf48a58276e050c4847a80, user_id=0b4c7ff8b586411aafdec4510626c458, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:22.823770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157f4e5-f746-41b0-a38e-0ac13dd958ea admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:22.826032 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 828/1646] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:22.827369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163ac42-f166-4928-acca-82707bd6588c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.827673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163ac42-f166-4928-acca-82707bd6588c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.827906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163ac42-f166-4928-acca-82707bd6588c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.840493 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 819/1647] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:22 2022] PUT /identity/v3/projects/2596452dd7cf48a58276e050c4847a80/users/0b4c7ff8b586411aafdec4510626c458/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:22.841313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157f4e5-f746-41b0-a38e-0ac13dd958ea admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:22.857121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9163ac42-f166-4928-acca-82707bd6588c None None] MFA Rules not processed for user `cf3572f3866246d88dbd0e66efda98a3`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:22.858348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9163ac42-f166-4928-acca-82707bd6588c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:22.912696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157f4e5-f746-41b0-a38e-0ac13dd958ea admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:22.918075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544e0ec-11b5-4b74-95e9-1133678dc183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:22.918898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544e0ec-11b5-4b74-95e9-1133678dc183 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:22.919334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544e0ec-11b5-4b74-95e9-1133678dc183 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:22.919760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544e0ec-11b5-4b74-95e9-1133678dc183 admin admin] PATH_INFO: `/v3/projects/eba7f2d771ac480abe87eb4cd4df69ac/users/cc87618fdef24c199901ca726ab4a6e5/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:22.921718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544e0ec-11b5-4b74-95e9-1133678dc183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba7f2d771ac480abe87eb4cd4df69ac, user_id=cc87618fdef24c199901ca726ab4a6e5, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:22.924331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544e0ec-11b5-4b74-95e9-1133678dc183 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:22.929657 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 829/1648] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:22.934270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163ac42-f166-4928-acca-82707bd6588c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:22.944333 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 820/1649] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:22 2022] PUT /identity/v3/projects/eba7f2d771ac480abe87eb4cd4df69ac/users/cc87618fdef24c199901ca726ab4a6e5/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:22.944333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544e0ec-11b5-4b74-95e9-1133678dc183 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:22.946656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163ac42-f166-4928-acca-82707bd6588c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:23.006709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fe50a-dc4f-44fc-b489-2bcd2c27d9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:23.007350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fe50a-dc4f-44fc-b489-2bcd2c27d9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.007628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fe50a-dc4f-44fc-b489-2bcd2c27d9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.007902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fe50a-dc4f-44fc-b489-2bcd2c27d9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.008538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1fe50a-dc4f-44fc-b489-2bcd2c27d9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:23.010167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1fe50a-dc4f-44fc-b489-2bcd2c27d9d0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:23.012865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544e0ec-11b5-4b74-95e9-1133678dc183 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:23.017684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04c93d-43c9-4992-9c98-019d4a262f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:23.018288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04c93d-43c9-4992-9c98-019d4a262f55 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.018565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04c93d-43c9-4992-9c98-019d4a262f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.018864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04c93d-43c9-4992-9c98-019d4a262f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.019493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04c93d-43c9-4992-9c98-019d4a262f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:23.024138 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 830/1650] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:23.024276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04c93d-43c9-4992-9c98-019d4a262f55 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:23.024361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fe50a-dc4f-44fc-b489-2bcd2c27d9d0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:23.033444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fe50a-dc4f-44fc-b489-2bcd2c27d9d0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:23.038162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e44a7f-cca6-4ef4-984f-c07726d09737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:23.038797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e44a7f-cca6-4ef4-984f-c07726d09737 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.039076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e44a7f-cca6-4ef4-984f-c07726d09737 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.039372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e44a7f-cca6-4ef4-984f-c07726d09737 admin admin] PATH_INFO: `/v3/projects/c9de10355880479f8fb1786c004decb0/users/126543753a3a4af5b7e5de4126f58387/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.041327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e44a7f-cca6-4ef4-984f-c07726d09737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9de10355880479f8fb1786c004decb0, user_id=126543753a3a4af5b7e5de4126f58387, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:23.044216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e44a7f-cca6-4ef4-984f-c07726d09737 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:23.050119 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 821/1651] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:22 2022] POST /identity/v3/projects => generated 393 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:23.051098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04c93d-43c9-4992-9c98-019d4a262f55 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:23.058886 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 831/1652] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:23 2022] PUT /identity/v3/projects/c9de10355880479f8fb1786c004decb0/users/126543753a3a4af5b7e5de4126f58387/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:23.060376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e44a7f-cca6-4ef4-984f-c07726d09737 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:23.087378 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:23.117356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04c93d-43c9-4992-9c98-019d4a262f55 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:23.125184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b49622-fc8c-468a-8f30-d503d8d842a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:23.126292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b49622-fc8c-468a-8f30-d503d8d842a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.126773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b49622-fc8c-468a-8f30-d503d8d842a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.127235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b49622-fc8c-468a-8f30-d503d8d842a5 admin admin] PATH_INFO: `/v3/projects/dfe08f303eab41029c11657360186f06/users/8629e93fb060455d8fba8ba04ef2ec08/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.130440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b49622-fc8c-468a-8f30-d503d8d842a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe08f303eab41029c11657360186f06, user_id=8629e93fb060455d8fba8ba04ef2ec08, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:23.131840 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:23.133135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b49622-fc8c-468a-8f30-d503d8d842a5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:23.140408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e44a7f-cca6-4ef4-984f-c07726d09737 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:23.146329 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 822/1653] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:23 2022] PUT /identity/v3/projects/dfe08f303eab41029c11657360186f06/users/8629e93fb060455d8fba8ba04ef2ec08/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:23.147574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a44fdb-f815-47b7-809f-9d9ab5a0f149 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.147854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a44fdb-f815-47b7-809f-9d9ab5a0f149 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.148123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a44fdb-f815-47b7-809f-9d9ab5a0f149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.179146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e4a44fdb-f815-47b7-809f-9d9ab5a0f149 None None] MFA Rules not processed for user `0b4c7ff8b586411aafdec4510626c458`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:23.180286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e4a44fdb-f815-47b7-809f-9d9ab5a0f149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:23.212860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f72df2-edb4-42d8-86f1-2168456b6255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:23.213514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f72df2-edb4-42d8-86f1-2168456b6255 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.213795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f72df2-edb4-42d8-86f1-2168456b6255 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.214059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f72df2-edb4-42d8-86f1-2168456b6255 admin admin] PATH_INFO: `/v3/projects/2d7e502f111d4476a24bbd7da6ebe284/users/70827d8950d74591b99a22ea4e843aad/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.216058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f72df2-edb4-42d8-86f1-2168456b6255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7e502f111d4476a24bbd7da6ebe284, user_id=70827d8950d74591b99a22ea4e843aad, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:23.218718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f72df2-edb4-42d8-86f1-2168456b6255 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:23.228775 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 832/1654] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:23 2022] PUT /identity/v3/projects/2d7e502f111d4476a24bbd7da6ebe284/users/70827d8950d74591b99a22ea4e843aad/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:23.229964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81cbe2-6079-4d76-8578-d82e267b2b41 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.230276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81cbe2-6079-4d76-8578-d82e267b2b41 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.230546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81cbe2-6079-4d76-8578-d82e267b2b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.257813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cf81cbe2-6079-4d76-8578-d82e267b2b41 None None] MFA Rules not processed for user `cc87618fdef24c199901ca726ab4a6e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:23.258765 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 823/1655] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:23 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:23.259014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cf81cbe2-6079-4d76-8578-d82e267b2b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:23.260005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e761c-eaff-44c7-b234-6c01a3f1cb9d None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.260276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e761c-eaff-44c7-b234-6c01a3f1cb9d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.260550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e761c-eaff-44c7-b234-6c01a3f1cb9d None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.262787 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 824/1656] 10.222.0.16 () {54 vars in 961 bytes} [Fri Sep 30 09:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:42:23.263460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e761c-eaff-44c7-b234-6c01a3f1cb9d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:23.337599 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e761c-eaff-44c7-b234-6c01a3f1cb9d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:23.348553 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 833/1657] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:23 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:23.348553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81cbe2-6079-4d76-8578-d82e267b2b41 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:23.348763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556e2a7-f2c4-4004-9430-3896df924fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:23.348763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556e2a7-f2c4-4004-9430-3896df924fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.348763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556e2a7-f2c4-4004-9430-3896df924fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.348763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556e2a7-f2c4-4004-9430-3896df924fdc admin admin] PATH_INFO: `/v3/projects/c34dc699e66740b3b0c81b055510d87e/users/5e41a982f9cb40feb88ee664ac02b4bc/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.349072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556e2a7-f2c4-4004-9430-3896df924fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34dc699e66740b3b0c81b055510d87e, user_id=5e41a982f9cb40feb88ee664ac02b4bc, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:23.349072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556e2a7-f2c4-4004-9430-3896df924fdc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:23.353873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81cbe2-6079-4d76-8578-d82e267b2b41 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:23.360258 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 825/1658] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:23 2022] PUT /identity/v3/projects/c34dc699e66740b3b0c81b055510d87e/users/5e41a982f9cb40feb88ee664ac02b4bc/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:23.361529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3754d4a-2061-4acd-a64b-3c5a8f6285c6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.361993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3754d4a-2061-4acd-a64b-3c5a8f6285c6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.362292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3754d4a-2061-4acd-a64b-3c5a8f6285c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.391883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c3754d4a-2061-4acd-a64b-3c5a8f6285c6 None None] MFA Rules not processed for user `126543753a3a4af5b7e5de4126f58387`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:23.393137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c3754d4a-2061-4acd-a64b-3c5a8f6285c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:23.414675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9eb43-da8e-48fc-9c73-4835e15f167a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:23.415302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9eb43-da8e-48fc-9c73-4835e15f167a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.415575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9eb43-da8e-48fc-9c73-4835e15f167a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.415842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9eb43-da8e-48fc-9c73-4835e15f167a admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.416456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9eb43-da8e-48fc-9c73-4835e15f167a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:23.419465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9eb43-da8e-48fc-9c73-4835e15f167a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:23.426969 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:23.442203 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 834/1659] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:23 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:23.444653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8bf23-cdd7-43dd-a38d-c099b0770d1d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.445399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8bf23-cdd7-43dd-a38d-c099b0770d1d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.446022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8bf23-cdd7-43dd-a38d-c099b0770d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.464651 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 826/1660] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:23.466691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd3a0c-c91e-4213-9ed8-5d622ebe3482 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.466973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd3a0c-c91e-4213-9ed8-5d622ebe3482 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.467241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd3a0c-c91e-4213-9ed8-5d622ebe3482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.468853 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:23.477699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1bc8bf23-cdd7-43dd-a38d-c099b0770d1d None None] MFA Rules not processed for user `8629e93fb060455d8fba8ba04ef2ec08`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:23.479314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1bc8bf23-cdd7-43dd-a38d-c099b0770d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:23.496722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4afd3a0c-c91e-4213-9ed8-5d622ebe3482 None None] MFA Rules not processed for user `70827d8950d74591b99a22ea4e843aad`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:23.498007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4afd3a0c-c91e-4213-9ed8-5d622ebe3482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:23.547116 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 835/1661] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:23.548403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cd157-a836-4c63-924a-4f4423dd3f83 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.548722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cd157-a836-4c63-924a-4f4423dd3f83 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.548997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cd157-a836-4c63-924a-4f4423dd3f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.576675 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 827/1662] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:23.577854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6860e1e-f88f-4612-aab9-53f463fe2455 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.578138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6860e1e-f88f-4612-aab9-53f463fe2455 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.578406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6860e1e-f88f-4612-aab9-53f463fe2455 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.579616 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 828/1663] 10.222.0.16 () {54 vars in 961 bytes} [Fri Sep 30 09:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:42:23.585363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24816ff8-bb05-41a8-8f95-414b02833986 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.585643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24816ff8-bb05-41a8-8f95-414b02833986 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.585914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24816ff8-bb05-41a8-8f95-414b02833986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.592223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f11cd157-a836-4c63-924a-4f4423dd3f83 None None] MFA Rules not processed for user `aa607111024540d1a09b01dfd1e5e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:23.593453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f11cd157-a836-4c63-924a-4f4423dd3f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:23.605674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-24816ff8-bb05-41a8-8f95-414b02833986 None None] MFA Rules not processed for user `30cb31b44aeb4d64b0c24db25ebe4cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:23.606842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-24816ff8-bb05-41a8-8f95-414b02833986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:23.661362 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 829/1664] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:23.661677 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 836/1665] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Sep 30 09:42:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:23.662709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cd157-a836-4c63-924a-4f4423dd3f83 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:23.662936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ea8d7-e13c-4b5b-9a59-72d37b10c633 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.663420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ea8d7-e13c-4b5b-9a59-72d37b10c633 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.663785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ea8d7-e13c-4b5b-9a59-72d37b10c633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.676096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cd157-a836-4c63-924a-4f4423dd3f83 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:23.680504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1036e-49aa-46d0-9f44-5b8228018531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:23.681125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1036e-49aa-46d0-9f44-5b8228018531 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.681401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1036e-49aa-46d0-9f44-5b8228018531 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.681668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1036e-49aa-46d0-9f44-5b8228018531 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.682308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1036e-49aa-46d0-9f44-5b8228018531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:23.684678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1036e-49aa-46d0-9f44-5b8228018531 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:23.693024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-093ea8d7-e13c-4b5b-9a59-72d37b10c633 None None] MFA Rules not processed for user `5e41a982f9cb40feb88ee664ac02b4bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:23.694162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-093ea8d7-e13c-4b5b-9a59-72d37b10c633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:23.695143 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 837/1666] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:23.698169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cbdc1-272e-41f8-be34-c029208bc4ea None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.698169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cbdc1-272e-41f8-be34-c029208bc4ea None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.698169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cbdc1-272e-41f8-be34-c029208bc4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.717876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2a8cbdc1-272e-41f8-be34-c029208bc4ea None None] MFA Rules not processed for user `aa607111024540d1a09b01dfd1e5e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:23.719056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2a8cbdc1-272e-41f8-be34-c029208bc4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:23.728484 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 838/1667] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Sep 30 09:42:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:23.729303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8cbdc1-272e-41f8-be34-c029208bc4ea None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:23.741475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8cbdc1-272e-41f8-be34-c029208bc4ea None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:23.742820 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:23.748095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3cd2d-2674-4102-a32a-e13cf66d7d3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:23.748743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3cd2d-2674-4102-a32a-e13cf66d7d3c service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.749026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3cd2d-2674-4102-a32a-e13cf66d7d3c service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.749301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3cd2d-2674-4102-a32a-e13cf66d7d3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.765384 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 830/1668] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:23.766287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ea8d7-e13c-4b5b-9a59-72d37b10c633 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:23.775903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ea8d7-e13c-4b5b-9a59-72d37b10c633 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:23.781504 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c01f3-56c3-48e7-af6c-1b2d88948c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:23.782090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c01f3-56c3-48e7-af6c-1b2d88948c9c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.782367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c01f3-56c3-48e7-af6c-1b2d88948c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.782639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c01f3-56c3-48e7-af6c-1b2d88948c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.783278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c01f3-56c3-48e7-af6c-1b2d88948c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:23.785019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c01f3-56c3-48e7-af6c-1b2d88948c9c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:23.800324 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 831/1669] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:23.800324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c01f3-56c3-48e7-af6c-1b2d88948c9c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:23.804453 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:23.812193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c01f3-56c3-48e7-af6c-1b2d88948c9c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:23.814029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3cd2d-2674-4102-a32a-e13cf66d7d3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:23.815597 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3cd2d-2674-4102-a32a-e13cf66d7d3c service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:23.817679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7d6c0-d138-437f-a11d-9b0d7c71677c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:23.818275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7d6c0-d138-437f-a11d-9b0d7c71677c service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.818554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7d6c0-d138-437f-a11d-9b0d7c71677c service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.818828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7d6c0-d138-437f-a11d-9b0d7c71677c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.825150 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 839/1670] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:23.833456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3cd2d-2674-4102-a32a-e13cf66d7d3c service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:23.844856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3cd2d-2674-4102-a32a-e13cf66d7d3c service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:23.849529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683b171-5739-4e6c-81f9-38881a6c3dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:23.850170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683b171-5739-4e6c-81f9-38881a6c3dfa admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.850448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683b171-5739-4e6c-81f9-38881a6c3dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.850721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683b171-5739-4e6c-81f9-38881a6c3dfa admin admin] PATH_INFO: `/v3/projects/cc339296b51442879880bef4ed9f136f/users/8c7f5738e2f345e3bc931fc92af2822f/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.866741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683b171-5739-4e6c-81f9-38881a6c3dfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc339296b51442879880bef4ed9f136f, user_id=8c7f5738e2f345e3bc931fc92af2822f, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:23.869414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683b171-5739-4e6c-81f9-38881a6c3dfa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:23.889631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7d6c0-d138-437f-a11d-9b0d7c71677c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:23.891343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7d6c0-d138-437f-a11d-9b0d7c71677c service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:23.892293 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 840/1671] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:23 2022] PUT /identity/v3/projects/cc339296b51442879880bef4ed9f136f/users/8c7f5738e2f345e3bc931fc92af2822f/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:23.902559 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 832/1672] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:23 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:23.906082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc9076-ef73-40dc-8695-10f2cc3d4de0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:23.906512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc9076-ef73-40dc-8695-10f2cc3d4de0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:23.907592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc9076-ef73-40dc-8695-10f2cc3d4de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:23.953125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ecfc9076-ef73-40dc-8695-10f2cc3d4de0 None None] MFA Rules not processed for user `8c7f5738e2f345e3bc931fc92af2822f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:23.954514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ecfc9076-ef73-40dc-8695-10f2cc3d4de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:24.024285 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 841/1673] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:24.100826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7d6c0-d138-437f-a11d-9b0d7c71677c service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:24.111690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7d6c0-d138-437f-a11d-9b0d7c71677c service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:24.176027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc9076-ef73-40dc-8695-10f2cc3d4de0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:24.177531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993fa4f-3b1b-43b9-8eb2-96cf7f267d2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:24.178137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993fa4f-3b1b-43b9-8eb2-96cf7f267d2c service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:24.178412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993fa4f-3b1b-43b9-8eb2-96cf7f267d2c service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:24.178678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993fa4f-3b1b-43b9-8eb2-96cf7f267d2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:24.190918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc9076-ef73-40dc-8695-10f2cc3d4de0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:24.196657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e48ca0-9de7-4e15-90c9-6530c3181b03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:24.197269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e48ca0-9de7-4e15-90c9-6530c3181b03 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:24.197549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e48ca0-9de7-4e15-90c9-6530c3181b03 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:24.197830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e48ca0-9de7-4e15-90c9-6530c3181b03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:24.238215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993fa4f-3b1b-43b9-8eb2-96cf7f267d2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:24.239831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993fa4f-3b1b-43b9-8eb2-96cf7f267d2c service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:24.250597 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 833/1674] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:24.261682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e48ca0-9de7-4e15-90c9-6530c3181b03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:24.263243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e48ca0-9de7-4e15-90c9-6530c3181b03 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:24.272458 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 842/1675] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:42:24.315270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993fa4f-3b1b-43b9-8eb2-96cf7f267d2c service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:24.320937 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:24.327006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993fa4f-3b1b-43b9-8eb2-96cf7f267d2c service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:24.333866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65bf87-6782-4ca8-b434-caf190b1cded service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:24.334477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65bf87-6782-4ca8-b434-caf190b1cded service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:24.334764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65bf87-6782-4ca8-b434-caf190b1cded service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:24.335056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65bf87-6782-4ca8-b434-caf190b1cded service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:24.358089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e48ca0-9de7-4e15-90c9-6530c3181b03 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:24.373356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e48ca0-9de7-4e15-90c9-6530c3181b03 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:24.379078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353e35f-1317-4fea-9175-400562052484 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:24.379577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353e35f-1317-4fea-9175-400562052484 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:24.379850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353e35f-1317-4fea-9175-400562052484 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:24.380116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353e35f-1317-4fea-9175-400562052484 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:24.399661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65bf87-6782-4ca8-b434-caf190b1cded service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:24.401259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65bf87-6782-4ca8-b434-caf190b1cded service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:24.411544 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 834/1676] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:24.433072 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:24.444995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353e35f-1317-4fea-9175-400562052484 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:24.447692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353e35f-1317-4fea-9175-400562052484 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:24.458961 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 843/1677] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:42:24.471240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65bf87-6782-4ca8-b434-caf190b1cded service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:24.482638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65bf87-6782-4ca8-b434-caf190b1cded service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:24.488037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67d6ee-b977-4a21-a944-9946981b932b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:24.488721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67d6ee-b977-4a21-a944-9946981b932b service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:24.488947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67d6ee-b977-4a21-a944-9946981b932b service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:24.489219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67d6ee-b977-4a21-a944-9946981b932b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:24.528577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e88b72-57cf-48bd-a5d3-ceaec4eb3886 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:24.528890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e88b72-57cf-48bd-a5d3-ceaec4eb3886 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:24.529161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e88b72-57cf-48bd-a5d3-ceaec4eb3886 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:24.530970 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 844/1678] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:42:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:42:24.536701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de7f86-c274-4a8a-8053-5b41f8a2ba6e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:24.536993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de7f86-c274-4a8a-8053-5b41f8a2ba6e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:24.537271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de7f86-c274-4a8a-8053-5b41f8a2ba6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:24.552797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67d6ee-b977-4a21-a944-9946981b932b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:24.554373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67d6ee-b977-4a21-a944-9946981b932b service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:24.557655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f9de7f86-c274-4a8a-8053-5b41f8a2ba6e None None] MFA Rules not processed for user `aa607111024540d1a09b01dfd1e5e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:24.558951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f9de7f86-c274-4a8a-8053-5b41f8a2ba6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:24.565340 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 835/1679] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:24.568062 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 845/1680] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:42:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:42:24.581149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67d6ee-b977-4a21-a944-9946981b932b service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:24.582643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ea67d6ee-b977-4a21-a944-9946981b932b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:24.612022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de7f86-c274-4a8a-8053-5b41f8a2ba6e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:24.623299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de7f86-c274-4a8a-8053-5b41f8a2ba6e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:24.629065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce9746-4fc9-4ed7-90c1-252f926a3d93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:24.629662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce9746-4fc9-4ed7-90c1-252f926a3d93 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:24.629938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce9746-4fc9-4ed7-90c1-252f926a3d93 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:24.630212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce9746-4fc9-4ed7-90c1-252f926a3d93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:24.666399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67d6ee-b977-4a21-a944-9946981b932b service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:24.671739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29958a09-6d1d-4b75-a411-f6bb11abe8d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:24.672354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29958a09-6d1d-4b75-a411-f6bb11abe8d2 service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:24.672665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29958a09-6d1d-4b75-a411-f6bb11abe8d2 service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:24.672943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29958a09-6d1d-4b75-a411-f6bb11abe8d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:24.683810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29958a09-6d1d-4b75-a411-f6bb11abe8d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:24.685258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29958a09-6d1d-4b75-a411-f6bb11abe8d2 service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:24.695917 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 836/1681] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:42:24.696846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce9746-4fc9-4ed7-90c1-252f926a3d93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:24.698538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce9746-4fc9-4ed7-90c1-252f926a3d93 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:24.708739 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 846/1682] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:24 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:24.857174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51183ee-b90c-465f-b6ad-904d691a0968 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:24.857464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51183ee-b90c-465f-b6ad-904d691a0968 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:24.857743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51183ee-b90c-465f-b6ad-904d691a0968 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:24.859129 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 837/1683] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:42:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:42:24.863822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce9746-4fc9-4ed7-90c1-252f926a3d93 service nova] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:42:24.875699 n-d-master-1 devstack@keystone.service[82079]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-3bce9746-4fc9-4ed7-90c1-252f926a3d93 service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Sep 30 09:42:24.876008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce9746-4fc9-4ed7-90c1-252f926a3d93 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:24.887265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce9746-4fc9-4ed7-90c1-252f926a3d93 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:24.892122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1deeb3d-47a1-4b7b-ad4a-8efd827d91ba tempest-FlavorsAccessTestJSON-787734420 tempest-FlavorsAccessTestJSON-787734420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '126543753a3a4af5b7e5de4126f58387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9de10355880479f8fb1786c004decb0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:24.892804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1deeb3d-47a1-4b7b-ad4a-8efd827d91ba tempest-FlavorsAccessTestJSON-787734420 tempest-FlavorsAccessTestJSON-787734420-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:24.893087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1deeb3d-47a1-4b7b-ad4a-8efd827d91ba tempest-FlavorsAccessTestJSON-787734420 tempest-FlavorsAccessTestJSON-787734420-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:24.893362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1deeb3d-47a1-4b7b-ad4a-8efd827d91ba tempest-FlavorsAccessTestJSON-787734420 tempest-FlavorsAccessTestJSON-787734420-project-admin] PATH_INFO: `/v3/projects/c0baae3464194a818232b045acd45874` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:24.894509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1deeb3d-47a1-4b7b-ad4a-8efd827d91ba tempest-FlavorsAccessTestJSON-787734420 tempest-FlavorsAccessTestJSON-787734420-project-admin] RBAC: Authorizing `identity:get_project(project_id=c0baae3464194a818232b045acd45874)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:24.896559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1deeb3d-47a1-4b7b-ad4a-8efd827d91ba tempest-FlavorsAccessTestJSON-787734420 tempest-FlavorsAccessTestJSON-787734420-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:24.898461 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 847/1684] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:42:24 2022] GET /identity/v3/projects/c0baae3464194a818232b045acd45874 => generated 379 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:42:25.018732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51183ee-b90c-465f-b6ad-904d691a0968 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:25.024821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134536c-b744-4086-9c0a-e3ae518eb24a None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:25.025109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134536c-b744-4086-9c0a-e3ae518eb24a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:25.025383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134536c-b744-4086-9c0a-e3ae518eb24a None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:25.026849 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 848/1685] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:42:25.032402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134536c-b744-4086-9c0a-e3ae518eb24a None None] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:42:25.035171 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:25.049743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134536c-b744-4086-9c0a-e3ae518eb24a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:25.059789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134536c-b744-4086-9c0a-e3ae518eb24a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:25.064283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287bdfe-ee4e-455c-b59e-921fa0c97db2 tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a981f725bdfa4727b4ae8fe8c1479082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cca7ee364554888a73b1f6f8cd25681', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:25.065050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287bdfe-ee4e-455c-b59e-921fa0c97db2 tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:25.065343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287bdfe-ee4e-455c-b59e-921fa0c97db2 tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:25.065616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287bdfe-ee4e-455c-b59e-921fa0c97db2 tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] PATH_INFO: `/v3/projects/31786ef652af4cb39b75bc5187b09215` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:25.066721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287bdfe-ee4e-455c-b59e-921fa0c97db2 tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] RBAC: Authorizing `identity:get_project(project_id=31786ef652af4cb39b75bc5187b09215)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:25.068779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287bdfe-ee4e-455c-b59e-921fa0c97db2 tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:25.070426 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 849/1686] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:42:25 2022] GET /identity/v3/projects/31786ef652af4cb39b75bc5187b09215 => generated 393 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:42:25.095974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51183ee-b90c-465f-b6ad-904d691a0968 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:25.100793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837505b-0e6b-4bcb-b9cc-5540ad5f095a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:25.101591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837505b-0e6b-4bcb-b9cc-5540ad5f095a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:25.101849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837505b-0e6b-4bcb-b9cc-5540ad5f095a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:25.102135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837505b-0e6b-4bcb-b9cc-5540ad5f095a admin admin] PATH_INFO: `/v3/users/1fd370be740e4ad2828371c7af7b4bc2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:25.103671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837505b-0e6b-4bcb-b9cc-5540ad5f095a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fd370be740e4ad2828371c7af7b4bc2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:25.106053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837505b-0e6b-4bcb-b9cc-5540ad5f095a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:25.140594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287bdfe-ee4e-455c-b59e-921fa0c97db2 tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:25.156102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287bdfe-ee4e-455c-b59e-921fa0c97db2 tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:25.165356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a1086-76c0-42da-8986-d17534365f08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:25.165975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a1086-76c0-42da-8986-d17534365f08 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:25.166260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a1086-76c0-42da-8986-d17534365f08 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:25.166536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a1086-76c0-42da-8986-d17534365f08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:25.168253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a837505b-0e6b-4bcb-b9cc-5540ad5f095a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fd370be740e4ad2828371c7af7b4bc2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:25.177491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a837505b-0e6b-4bcb-b9cc-5540ad5f095a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fd370be740e4ad2828371c7af7b4bc2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:25.178105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a837505b-0e6b-4bcb-b9cc-5540ad5f095a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fd370be740e4ad2828371c7af7b4bc2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:25.192499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a837505b-0e6b-4bcb-b9cc-5540ad5f095a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fd370be740e4ad2828371c7af7b4bc2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:25.200869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a837505b-0e6b-4bcb-b9cc-5540ad5f095a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fd370be740e4ad2828371c7af7b4bc2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:25.207508 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 838/1687] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:42:25 2022] DELETE /identity/v3/users/1fd370be740e4ad2828371c7af7b4bc2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:25.211737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cde4b5-6a47-4717-ae9f-78724f76a3c0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:25.212082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cde4b5-6a47-4717-ae9f-78724f76a3c0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:25.212533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cde4b5-6a47-4717-ae9f-78724f76a3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:25.234114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f8cde4b5-6a47-4717-ae9f-78724f76a3c0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:25.235698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f8cde4b5-6a47-4717-ae9f-78724f76a3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:25.237969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a1086-76c0-42da-8986-d17534365f08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:25.239572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a1086-76c0-42da-8986-d17534365f08 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:25.249449 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 850/1688] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:42:25.334541 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 839/1689] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:42:25.341911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bffa2-cfdc-4e5e-ad9d-49d3ccd281f6 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:25.342197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bffa2-cfdc-4e5e-ad9d-49d3ccd281f6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:25.342470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bffa2-cfdc-4e5e-ad9d-49d3ccd281f6 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:25.343811 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 851/1690] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:42:25.347945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cde4b5-6a47-4717-ae9f-78724f76a3c0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:25.349279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bffa2-cfdc-4e5e-ad9d-49d3ccd281f6 None None] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:42:25.350828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f8cde4b5-6a47-4717-ae9f-78724f76a3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:25.351265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0f6bffa2-cfdc-4e5e-ad9d-49d3ccd281f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:25.404469 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:25.434966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cde4b5-6a47-4717-ae9f-78724f76a3c0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:25.438466 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:25.439179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbde95-fde7-47f3-bcd2-eecb8b7585a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:25.439879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbde95-fde7-47f3-bcd2-eecb8b7585a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:25.440082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbde95-fde7-47f3-bcd2-eecb8b7585a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:25.440444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbde95-fde7-47f3-bcd2-eecb8b7585a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:25.451972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbde95-fde7-47f3-bcd2-eecb8b7585a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:25.453498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbde95-fde7-47f3-bcd2-eecb8b7585a7 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:25.462001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bffa2-cfdc-4e5e-ad9d-49d3ccd281f6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:25.463268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0f6bffa2-cfdc-4e5e-ad9d-49d3ccd281f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:25.468498 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 840/1691] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:25.470463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3b033-e031-4e6c-95f1-e340987de125 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:25.470969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3b033-e031-4e6c-95f1-e340987de125 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:25.471629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3b033-e031-4e6c-95f1-e340987de125 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:25.474042 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 841/1692] 10.222.0.16 () {54 vars in 961 bytes} [Fri Sep 30 09:42:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:42:25.475629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b1a01-c2e2-4f88-98ef-399220de5f70 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:25.476051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b1a01-c2e2-4f88-98ef-399220de5f70 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:25.476458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b1a01-c2e2-4f88-98ef-399220de5f70 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:25.480782 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 842/1693] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:42:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:42:25.482164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c142d2-2e67-4e45-a9f6-dbc31c6a1847 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:25.482750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c142d2-2e67-4e45-a9f6-dbc31c6a1847 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:25.483181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c142d2-2e67-4e45-a9f6-dbc31c6a1847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:25.508588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a2c142d2-2e67-4e45-a9f6-dbc31c6a1847 None None] MFA Rules not processed for user `cbb22d0675bc4ca893b0477cebd470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:25.509873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a2c142d2-2e67-4e45-a9f6-dbc31c6a1847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:25.549148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bffa2-cfdc-4e5e-ad9d-49d3ccd281f6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:25.556290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c958a2-046f-4d25-aaed-590978ff66b0 tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a981f725bdfa4727b4ae8fe8c1479082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cca7ee364554888a73b1f6f8cd25681', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:25.557064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c958a2-046f-4d25-aaed-590978ff66b0 tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:25.557539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c958a2-046f-4d25-aaed-590978ff66b0 tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:25.557881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c958a2-046f-4d25-aaed-590978ff66b0 tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] PATH_INFO: `/v3/projects/31786ef652af4cb39b75bc5187b09215` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:25.559666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c958a2-046f-4d25-aaed-590978ff66b0 tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] RBAC: Authorizing `identity:get_project(project_id=31786ef652af4cb39b75bc5187b09215)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:25.562661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c958a2-046f-4d25-aaed-590978ff66b0 tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:25.564505 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 852/1694] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:42:25 2022] GET /identity/v3/projects/31786ef652af4cb39b75bc5187b09215 => generated 393 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:42:25.566041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb160f20-e795-4e40-9f17-fa38cf7d69ea None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:25.566376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb160f20-e795-4e40-9f17-fa38cf7d69ea None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:25.566861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb160f20-e795-4e40-9f17-fa38cf7d69ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:25.591589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bb160f20-e795-4e40-9f17-fa38cf7d69ea None None] MFA Rules not processed for user `cbb22d0675bc4ca893b0477cebd470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:25.593561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bb160f20-e795-4e40-9f17-fa38cf7d69ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:25.595347 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 843/1695] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Sep 30 09:42:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:25.604123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c142d2-2e67-4e45-a9f6-dbc31c6a1847 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:25.609933 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 853/1696] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:42:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:25.618593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c142d2-2e67-4e45-a9f6-dbc31c6a1847 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:25.634379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920b701-7f40-4141-847d-3c366323623f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:25.635350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920b701-7f40-4141-847d-3c366323623f service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:25.636088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920b701-7f40-4141-847d-3c366323623f service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:25.637206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920b701-7f40-4141-847d-3c366323623f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:25.639728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb160f20-e795-4e40-9f17-fa38cf7d69ea None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:25.641512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bb160f20-e795-4e40-9f17-fa38cf7d69ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:25.642569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9920b701-7f40-4141-847d-3c366323623f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:25.656084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb160f20-e795-4e40-9f17-fa38cf7d69ea None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:25.657684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920b701-7f40-4141-847d-3c366323623f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:25.660958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920b701-7f40-4141-847d-3c366323623f service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:25.661706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac86ba-ce24-4465-9a84-b82a15f8e0a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:25.662428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac86ba-ce24-4465-9a84-b82a15f8e0a0 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:25.662803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac86ba-ce24-4465-9a84-b82a15f8e0a0 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:25.663170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac86ba-ce24-4465-9a84-b82a15f8e0a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:25.675396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac86ba-ce24-4465-9a84-b82a15f8e0a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:25.677678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac86ba-ce24-4465-9a84-b82a15f8e0a0 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:25.686568 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 844/1697] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:42:25.687012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734bb0d-a6bf-4383-a81b-961c6559ba4b None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:25.687188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734bb0d-a6bf-4383-a81b-961c6559ba4b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:25.688614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734bb0d-a6bf-4383-a81b-961c6559ba4b None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:25.692449 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 845/1698] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:42:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:42:25.693235 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 854/1699] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:42:25.698079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734bb0d-a6bf-4383-a81b-961c6559ba4b None None] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:42:25.719742 n-d-master-1 devstack@keystone.service[82080]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-b734bb0d-a6bf-4383-a81b-961c6559ba4b None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Sep 30 09:42:25.720080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734bb0d-a6bf-4383-a81b-961c6559ba4b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:25.722337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b734bb0d-a6bf-4383-a81b-961c6559ba4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:25.806850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734bb0d-a6bf-4383-a81b-961c6559ba4b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:25.812552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738a1c9-45e0-4d1a-9106-77ac0137fafc tempest-FlavorsAccessTestJSON-787734420 tempest-FlavorsAccessTestJSON-787734420-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '126543753a3a4af5b7e5de4126f58387', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9de10355880479f8fb1786c004decb0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:25.813295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738a1c9-45e0-4d1a-9106-77ac0137fafc tempest-FlavorsAccessTestJSON-787734420 tempest-FlavorsAccessTestJSON-787734420-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:25.813639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738a1c9-45e0-4d1a-9106-77ac0137fafc tempest-FlavorsAccessTestJSON-787734420 tempest-FlavorsAccessTestJSON-787734420-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:25.813978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738a1c9-45e0-4d1a-9106-77ac0137fafc tempest-FlavorsAccessTestJSON-787734420 tempest-FlavorsAccessTestJSON-787734420-project-admin] PATH_INFO: `/v3/projects/c0baae3464194a818232b045acd45874` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:25.815190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738a1c9-45e0-4d1a-9106-77ac0137fafc tempest-FlavorsAccessTestJSON-787734420 tempest-FlavorsAccessTestJSON-787734420-project-admin] RBAC: Authorizing `identity:get_project(project_id=c0baae3464194a818232b045acd45874)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:25.817323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738a1c9-45e0-4d1a-9106-77ac0137fafc tempest-FlavorsAccessTestJSON-787734420 tempest-FlavorsAccessTestJSON-787734420-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:25.833149 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 846/1700] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:42:25 2022] GET /identity/v3/projects/c0baae3464194a818232b045acd45874 => generated 379 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:42:25.847478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f27bc6-cd48-44bc-b794-7035f7561f1c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:25.849874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f27bc6-cd48-44bc-b794-7035f7561f1c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:25.849874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f27bc6-cd48-44bc-b794-7035f7561f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:25.873100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738a1c9-45e0-4d1a-9106-77ac0137fafc tempest-FlavorsAccessTestJSON-787734420 tempest-FlavorsAccessTestJSON-787734420-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:25.884283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1738a1c9-45e0-4d1a-9106-77ac0137fafc tempest-FlavorsAccessTestJSON-787734420 tempest-FlavorsAccessTestJSON-787734420-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:25.887018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-30f27bc6-cd48-44bc-b794-7035f7561f1c None None] MFA Rules not processed for user `1a10ab88faf24a118cc7b6f3adf404da`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:25.891840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-30f27bc6-cd48-44bc-b794-7035f7561f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:25.906328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738a1c9-45e0-4d1a-9106-77ac0137fafc tempest-FlavorsAccessTestJSON-787734420 tempest-FlavorsAccessTestJSON-787734420-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:25.927636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d1860-fada-494f-88fc-834f870bddb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:25.930607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d1860-fada-494f-88fc-834f870bddb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:25.932660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d1860-fada-494f-88fc-834f870bddb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:25.933127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d1860-fada-494f-88fc-834f870bddb9 admin admin] PATH_INFO: `/v3/projects/6028136ce4444c169635eab90c3269ed` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:25.936038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d1860-fada-494f-88fc-834f870bddb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6028136ce4444c169635eab90c3269ed)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:25.939176 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-692d1860-fada-494f-88fc-834f870bddb9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:42:25.939176 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 09:42:25.939176 n-d-master-1 devstack@keystone.service[82080]: Sep 30 09:42:25.943850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d1860-fada-494f-88fc-834f870bddb9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:25.975515 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 855/1701] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:25.977640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6abc29-f0ed-47ff-9e98-e266f446036c None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:25.977955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6abc29-f0ed-47ff-9e98-e266f446036c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:25.978386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6abc29-f0ed-47ff-9e98-e266f446036c None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:25.981588 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 856/1702] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:42:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:42:25.982949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf1120-01ac-403e-bf83-5c7d269debc2 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:25.983166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf1120-01ac-403e-bf83-5c7d269debc2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:25.983665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf1120-01ac-403e-bf83-5c7d269debc2 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:25.985581 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 857/1703] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:42:25.991766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50440d8-69df-4bc3-a6d2-c0e105c0721b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:25.992060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50440d8-69df-4bc3-a6d2-c0e105c0721b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:25.992844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50440d8-69df-4bc3-a6d2-c0e105c0721b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:26.014535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c50440d8-69df-4bc3-a6d2-c0e105c0721b None None] MFA Rules not processed for user `aa607111024540d1a09b01dfd1e5e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:26.015535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-692d1860-fada-494f-88fc-834f870bddb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6028136ce4444c169635eab90c3269ed', 'request_id': 'req-692d1860-fada-494f-88fc-834f870bddb9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:26.015835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c50440d8-69df-4bc3-a6d2-c0e105c0721b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:26.019059 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:26.026514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-692d1860-fada-494f-88fc-834f870bddb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6028136ce4444c169635eab90c3269ed', 'request_id': 'req-692d1860-fada-494f-88fc-834f870bddb9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:26.035369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-692d1860-fada-494f-88fc-834f870bddb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6028136ce4444c169635eab90c3269ed', 'request_id': 'req-692d1860-fada-494f-88fc-834f870bddb9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:26.055822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-692d1860-fada-494f-88fc-834f870bddb9 admin admin] The token cache is being invalidate because project 6028136ce4444c169635eab90c3269ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:42:26.056061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-692d1860-fada-494f-88fc-834f870bddb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:26.056742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-692d1860-fada-494f-88fc-834f870bddb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:26.058587 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 847/1704] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:42:25 2022] DELETE /identity/v3/projects/6028136ce4444c169635eab90c3269ed => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:26.059412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d1860-fada-494f-88fc-834f870bddb9 admin admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:42:26.060759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-692d1860-fada-494f-88fc-834f870bddb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:26.106938 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 858/1705] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:42:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:26.107882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50440d8-69df-4bc3-a6d2-c0e105c0721b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:26.109241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c50440d8-69df-4bc3-a6d2-c0e105c0721b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:26.124477 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:26.143696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d1860-fada-494f-88fc-834f870bddb9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:26.145513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-692d1860-fada-494f-88fc-834f870bddb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:26.189465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50440d8-69df-4bc3-a6d2-c0e105c0721b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:26.194387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bd95b-125d-4f1e-8d4e-609437abeb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:26.195871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bd95b-125d-4f1e-8d4e-609437abeb4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:26.196199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bd95b-125d-4f1e-8d4e-609437abeb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:26.196478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bd95b-125d-4f1e-8d4e-609437abeb4f admin admin] PATH_INFO: `/v3/users/5e41a982f9cb40feb88ee664ac02b4bc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:26.199708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407bd95b-125d-4f1e-8d4e-609437abeb4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e41a982f9cb40feb88ee664ac02b4bc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:26.200835 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-407bd95b-125d-4f1e-8d4e-609437abeb4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:42:26.200835 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 09:42:26.200835 n-d-master-1 devstack@keystone.service[82079]: Sep 30 09:42:26.204329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407bd95b-125d-4f1e-8d4e-609437abeb4f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:26.248621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d1860-fada-494f-88fc-834f870bddb9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:26.254698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a08ba-acb6-4946-91cb-7cd2221c84bd tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a981f725bdfa4727b4ae8fe8c1479082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cca7ee364554888a73b1f6f8cd25681', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:26.255734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a08ba-acb6-4946-91cb-7cd2221c84bd tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:26.256169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a08ba-acb6-4946-91cb-7cd2221c84bd tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:26.256634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a08ba-acb6-4946-91cb-7cd2221c84bd tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] PATH_INFO: `/v3/projects/31786ef652af4cb39b75bc5187b09215` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:26.259458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a08ba-acb6-4946-91cb-7cd2221c84bd tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] RBAC: Authorizing `identity:get_project(project_id=31786ef652af4cb39b75bc5187b09215)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:26.265009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a08ba-acb6-4946-91cb-7cd2221c84bd tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:26.272150 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 848/1706] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:42:26 2022] GET /identity/v3/projects/31786ef652af4cb39b75bc5187b09215 => generated 393 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:42:26.279413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a08ba-acb6-4946-91cb-7cd2221c84bd tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:26.281739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ac0a08ba-acb6-4946-91cb-7cd2221c84bd tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:26.307160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-407bd95b-125d-4f1e-8d4e-609437abeb4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e41a982f9cb40feb88ee664ac02b4bc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:26.309137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-407bd95b-125d-4f1e-8d4e-609437abeb4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e41a982f9cb40feb88ee664ac02b4bc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:26.322192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-407bd95b-125d-4f1e-8d4e-609437abeb4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e41a982f9cb40feb88ee664ac02b4bc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:26.361299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-407bd95b-125d-4f1e-8d4e-609437abeb4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e41a982f9cb40feb88ee664ac02b4bc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:26.374698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-407bd95b-125d-4f1e-8d4e-609437abeb4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e41a982f9cb40feb88ee664ac02b4bc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:26.377571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a08ba-acb6-4946-91cb-7cd2221c84bd tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:26.381181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a51108-f445-449c-a27c-668bb54225d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:26.381864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a51108-f445-449c-a27c-668bb54225d0 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:26.391837 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 859/1707] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:42:26 2022] DELETE /identity/v3/users/5e41a982f9cb40feb88ee664ac02b4bc => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:26.392786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a51108-f445-449c-a27c-668bb54225d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:26.392786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a51108-f445-449c-a27c-668bb54225d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:26.393007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bd95b-125d-4f1e-8d4e-609437abeb4f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:26.393007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-407bd95b-125d-4f1e-8d4e-609437abeb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:26.394894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-99a51108-f445-449c-a27c-668bb54225d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:26.421690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a51108-f445-449c-a27c-668bb54225d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:26.424199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a51108-f445-449c-a27c-668bb54225d0 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:26.441303 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 849/1708] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:26.488579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bd95b-125d-4f1e-8d4e-609437abeb4f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:26.501010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25ffff-0b1a-471e-853a-d182703bf1f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:26.502218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25ffff-0b1a-471e-853a-d182703bf1f9 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:26.502363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25ffff-0b1a-471e-853a-d182703bf1f9 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:26.502776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25ffff-0b1a-471e-853a-d182703bf1f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:26.505129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5e25ffff-0b1a-471e-853a-d182703bf1f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:26.561025 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:26.628902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25ffff-0b1a-471e-853a-d182703bf1f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:26.631030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25ffff-0b1a-471e-853a-d182703bf1f9 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:26.641568 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 860/1709] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:26.719665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a51108-f445-449c-a27c-668bb54225d0 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:26.721907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-99a51108-f445-449c-a27c-668bb54225d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:26.746964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a51108-f445-449c-a27c-668bb54225d0 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:26.802930 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:26.883690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4026ec-0fa4-4d85-b4ed-9ead01d343f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:26.884193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4026ec-0fa4-4d85-b4ed-9ead01d343f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:26.884476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4026ec-0fa4-4d85-b4ed-9ead01d343f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:26.884784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4026ec-0fa4-4d85-b4ed-9ead01d343f8 admin admin] PATH_INFO: `/v3/projects/c34dc699e66740b3b0c81b055510d87e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:26.886935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4026ec-0fa4-4d85-b4ed-9ead01d343f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34dc699e66740b3b0c81b055510d87e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:26.888962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4026ec-0fa4-4d85-b4ed-9ead01d343f8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:26.962101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ca4026ec-0fa4-4d85-b4ed-9ead01d343f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34dc699e66740b3b0c81b055510d87e', 'request_id': 'req-ca4026ec-0fa4-4d85-b4ed-9ead01d343f8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:26.967008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25ffff-0b1a-471e-853a-d182703bf1f9 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:26.968522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5e25ffff-0b1a-471e-853a-d182703bf1f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:26.978351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ca4026ec-0fa4-4d85-b4ed-9ead01d343f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34dc699e66740b3b0c81b055510d87e', 'request_id': 'req-ca4026ec-0fa4-4d85-b4ed-9ead01d343f8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:26.988535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ca4026ec-0fa4-4d85-b4ed-9ead01d343f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34dc699e66740b3b0c81b055510d87e', 'request_id': 'req-ca4026ec-0fa4-4d85-b4ed-9ead01d343f8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:27.001320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ca4026ec-0fa4-4d85-b4ed-9ead01d343f8 admin admin] The token cache is being invalidate because project c34dc699e66740b3b0c81b055510d87e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:42:27.001833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ca4026ec-0fa4-4d85-b4ed-9ead01d343f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:27.002583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ca4026ec-0fa4-4d85-b4ed-9ead01d343f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:27.003495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25ffff-0b1a-471e-853a-d182703bf1f9 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:27.004514 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 850/1710] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:42:26 2022] DELETE /identity/v3/projects/c34dc699e66740b3b0c81b055510d87e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:27.005258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4026ec-0fa4-4d85-b4ed-9ead01d343f8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:27.006638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ca4026ec-0fa4-4d85-b4ed-9ead01d343f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:27.080148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d3210-bb87-492f-9214-9a64ebfb81c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:27.081242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d3210-bb87-492f-9214-9a64ebfb81c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:27.081602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d3210-bb87-492f-9214-9a64ebfb81c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:27.081942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d3210-bb87-492f-9214-9a64ebfb81c0 admin admin] PATH_INFO: `/v3/users/1ed6e8a43efc4d478bec1de47ae2915f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:27.083214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d3210-bb87-492f-9214-9a64ebfb81c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ed6e8a43efc4d478bec1de47ae2915f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:27.085606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d3210-bb87-492f-9214-9a64ebfb81c0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:27.118960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4026ec-0fa4-4d85-b4ed-9ead01d343f8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:27.126556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b7ea3-ce98-4366-aac4-520e12a5bd3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:27.127549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b7ea3-ce98-4366-aac4-520e12a5bd3d service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:27.127952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b7ea3-ce98-4366-aac4-520e12a5bd3d service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:27.128219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b7ea3-ce98-4366-aac4-520e12a5bd3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:27.129989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7e6b7ea3-ce98-4366-aac4-520e12a5bd3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:27.156944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b39d3210-bb87-492f-9214-9a64ebfb81c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ed6e8a43efc4d478bec1de47ae2915f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:27.157628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b39d3210-bb87-492f-9214-9a64ebfb81c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ed6e8a43efc4d478bec1de47ae2915f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:27.166632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b39d3210-bb87-492f-9214-9a64ebfb81c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ed6e8a43efc4d478bec1de47ae2915f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:27.192631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b39d3210-bb87-492f-9214-9a64ebfb81c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ed6e8a43efc4d478bec1de47ae2915f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:27.204284 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:27.220069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b7ea3-ce98-4366-aac4-520e12a5bd3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:27.221435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b7ea3-ce98-4366-aac4-520e12a5bd3d service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:27.226922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b39d3210-bb87-492f-9214-9a64ebfb81c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ed6e8a43efc4d478bec1de47ae2915f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:27.235488 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 861/1711] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:42:26 2022] DELETE /identity/v3/users/1ed6e8a43efc4d478bec1de47ae2915f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:27.237505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b2c03-cdee-43da-b396-a37c79a87e47 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:27.237961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b2c03-cdee-43da-b396-a37c79a87e47 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:27.238243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b2c03-cdee-43da-b396-a37c79a87e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:27.246184 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 851/1712] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:27 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:27.248094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415b67c-9bac-4aa0-b8dd-07244e6f583b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:27.263214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415b67c-9bac-4aa0-b8dd-07244e6f583b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:27.263214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415b67c-9bac-4aa0-b8dd-07244e6f583b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:27.266291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-736b2c03-cdee-43da-b396-a37c79a87e47 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:27.267534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-736b2c03-cdee-43da-b396-a37c79a87e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:27.307445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e415b67c-9bac-4aa0-b8dd-07244e6f583b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:27.316569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e415b67c-9bac-4aa0-b8dd-07244e6f583b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:27.364473 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:27.396858 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 862/1713] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:27.402044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951f7c8-fe36-4661-a767-e4b9d12da90a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:27.402683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951f7c8-fe36-4661-a767-e4b9d12da90a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:27.403271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951f7c8-fe36-4661-a767-e4b9d12da90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:27.437122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6951f7c8-fe36-4661-a767-e4b9d12da90a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:27.438494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6951f7c8-fe36-4661-a767-e4b9d12da90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:27.442089 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 852/1714] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:27.443385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e730e0-f33f-4ef3-a6ac-400b99aa2a73 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:27.443660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e730e0-f33f-4ef3-a6ac-400b99aa2a73 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:27.443928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e730e0-f33f-4ef3-a6ac-400b99aa2a73 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:27.447580 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 853/1715] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:42:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:42:27.454308 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 863/1716] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:27.454487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e730e0-f33f-4ef3-a6ac-400b99aa2a73 None None] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:42:27.456536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951f7c8-fe36-4661-a767-e4b9d12da90a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:27.462004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-16e730e0-f33f-4ef3-a6ac-400b99aa2a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:27.468618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951f7c8-fe36-4661-a767-e4b9d12da90a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:27.474178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828d851-ff7f-4d34-b275-dd2ffe3b01a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:27.474656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828d851-ff7f-4d34-b275-dd2ffe3b01a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:27.474937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828d851-ff7f-4d34-b275-dd2ffe3b01a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:27.475216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828d851-ff7f-4d34-b275-dd2ffe3b01a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:27.476294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828d851-ff7f-4d34-b275-dd2ffe3b01a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:42:27.476294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828d851-ff7f-4d34-b275-dd2ffe3b01a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:27.477888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828d851-ff7f-4d34-b275-dd2ffe3b01a8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:27.493819 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 864/1717] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:42:27.494667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828d851-ff7f-4d34-b275-dd2ffe3b01a8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:27.497914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3828d851-ff7f-4d34-b275-dd2ffe3b01a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:27.599917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828d851-ff7f-4d34-b275-dd2ffe3b01a8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:27.604183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc0dfc-56de-4ba7-b11b-5d98a665eab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:27.605700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc0dfc-56de-4ba7-b11b-5d98a665eab3 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:27.606218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc0dfc-56de-4ba7-b11b-5d98a665eab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:27.607394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc0dfc-56de-4ba7-b11b-5d98a665eab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:27.612220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e730e0-f33f-4ef3-a6ac-400b99aa2a73 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:27.623650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-16e730e0-f33f-4ef3-a6ac-400b99aa2a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:27.625327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc0dfc-56de-4ba7-b11b-5d98a665eab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:27.627420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc0dfc-56de-4ba7-b11b-5d98a665eab3 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:27.644092 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 865/1718] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:27.645057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc0dfc-56de-4ba7-b11b-5d98a665eab3 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:27.662043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc0dfc-56de-4ba7-b11b-5d98a665eab3 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:27.669498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e562b1d-59bd-473f-b034-8efba08524e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:27.670925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e562b1d-59bd-473f-b034-8efba08524e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:27.671278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e562b1d-59bd-473f-b034-8efba08524e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:27.671618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e562b1d-59bd-473f-b034-8efba08524e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:27.672472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e562b1d-59bd-473f-b034-8efba08524e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:27.676485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e562b1d-59bd-473f-b034-8efba08524e7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:27.721220 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 866/1719] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:27 2022] POST /identity/v3/projects => generated 401 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:27.727226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e562b1d-59bd-473f-b034-8efba08524e7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:27.732438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e730e0-f33f-4ef3-a6ac-400b99aa2a73 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:27.833785 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:27.849774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e562b1d-59bd-473f-b034-8efba08524e7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:27.859754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8208a7d-fbde-4b36-9005-b544fb7a5a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:27.860930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8208a7d-fbde-4b36-9005-b544fb7a5a80 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:27.861507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8208a7d-fbde-4b36-9005-b544fb7a5a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:27.861961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8208a7d-fbde-4b36-9005-b544fb7a5a80 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:27.863029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8208a7d-fbde-4b36-9005-b544fb7a5a80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:27.867159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8208a7d-fbde-4b36-9005-b544fb7a5a80 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:27.913697 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 867/1720] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:27 2022] POST /identity/v3/users => generated 301 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:27.921500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8208a7d-fbde-4b36-9005-b544fb7a5a80 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:27.931158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79878b-2dda-434e-adcf-ef90898e3f96 tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a981f725bdfa4727b4ae8fe8c1479082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cca7ee364554888a73b1f6f8cd25681', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:27.931970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79878b-2dda-434e-adcf-ef90898e3f96 tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:27.934219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79878b-2dda-434e-adcf-ef90898e3f96 tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:27.934219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79878b-2dda-434e-adcf-ef90898e3f96 tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] PATH_INFO: `/v3/projects/31786ef652af4cb39b75bc5187b09215` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:27.939727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79878b-2dda-434e-adcf-ef90898e3f96 tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] RBAC: Authorizing `identity:get_project(project_id=31786ef652af4cb39b75bc5187b09215)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:27.942829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79878b-2dda-434e-adcf-ef90898e3f96 tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:27.944881 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 854/1721] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:42:27 2022] GET /identity/v3/projects/31786ef652af4cb39b75bc5187b09215 => generated 393 bytes in 491 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:42:27.946211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8208a7d-fbde-4b36-9005-b544fb7a5a80 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:27.966470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbbe09-cacb-421e-a02b-30dbe69c5990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:27.967894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbbe09-cacb-421e-a02b-30dbe69c5990 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:27.972279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbbe09-cacb-421e-a02b-30dbe69c5990 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:27.972966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbbe09-cacb-421e-a02b-30dbe69c5990 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:27.974773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbbe09-cacb-421e-a02b-30dbe69c5990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:27.978307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbbe09-cacb-421e-a02b-30dbe69c5990 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:27.994573 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 868/1722] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:28.000106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79878b-2dda-434e-adcf-ef90898e3f96 tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:28.030472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79878b-2dda-434e-adcf-ef90898e3f96 tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:28.045227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3812a7-421e-4fc7-ba65-24d33d74c413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:28.045872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3812a7-421e-4fc7-ba65-24d33d74c413 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:28.046153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3812a7-421e-4fc7-ba65-24d33d74c413 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:28.046420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3812a7-421e-4fc7-ba65-24d33d74c413 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:28.047072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3812a7-421e-4fc7-ba65-24d33d74c413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:28.048704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3812a7-421e-4fc7-ba65-24d33d74c413 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:28.080363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281be46b-dee6-4f35-b6b6-8548694b3d76 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:28.081088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281be46b-dee6-4f35-b6b6-8548694b3d76 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:28.081370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281be46b-dee6-4f35-b6b6-8548694b3d76 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:28.082995 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 869/1723] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:42:28.083655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281be46b-dee6-4f35-b6b6-8548694b3d76 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:28.087775 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 855/1724] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:28.095825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3812a7-421e-4fc7-ba65-24d33d74c413 admin admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:42:28.133137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281be46b-dee6-4f35-b6b6-8548694b3d76 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:28.149075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28f571-840d-42f6-a072-497584d3ec51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:28.152471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28f571-840d-42f6-a072-497584d3ec51 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:28.158619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28f571-840d-42f6-a072-497584d3ec51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:28.159235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28f571-840d-42f6-a072-497584d3ec51 admin admin] PATH_INFO: `/v3/projects/4c91a1b730584c7bbc0ecfdc9e58d95f/users/62956fe5a4d44689b2413b132a78351c/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:28.210954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28f571-840d-42f6-a072-497584d3ec51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c91a1b730584c7bbc0ecfdc9e58d95f, user_id=62956fe5a4d44689b2413b132a78351c, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:28.222249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28f571-840d-42f6-a072-497584d3ec51 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:28.258988 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 870/1725] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:28 2022] PUT /identity/v3/projects/4c91a1b730584c7bbc0ecfdc9e58d95f/users/62956fe5a4d44689b2413b132a78351c/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:28.265008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65dfab-ae71-47aa-92c3-c4f67731a10f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:28.265286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65dfab-ae71-47aa-92c3-c4f67731a10f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:28.265563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65dfab-ae71-47aa-92c3-c4f67731a10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:28.275078 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:28.299407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3812a7-421e-4fc7-ba65-24d33d74c413 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:28.331703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3812a7-421e-4fc7-ba65-24d33d74c413 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:28.379019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7b65dfab-ae71-47aa-92c3-c4f67731a10f None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:28.380628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7b65dfab-ae71-47aa-92c3-c4f67731a10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:28.451092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273bc3c-891f-4157-80e6-fdb419d4a20b tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a981f725bdfa4727b4ae8fe8c1479082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cca7ee364554888a73b1f6f8cd25681', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:28.451794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273bc3c-891f-4157-80e6-fdb419d4a20b tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:28.452368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273bc3c-891f-4157-80e6-fdb419d4a20b tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:28.452696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273bc3c-891f-4157-80e6-fdb419d4a20b tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] PATH_INFO: `/v3/projects/31786ef652af4cb39b75bc5187b09215` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:28.454213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273bc3c-891f-4157-80e6-fdb419d4a20b tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] RBAC: Authorizing `identity:get_project(project_id=31786ef652af4cb39b75bc5187b09215)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:28.457230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273bc3c-891f-4157-80e6-fdb419d4a20b tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:28.475186 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 856/1726] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:42:28 2022] GET /identity/v3/projects/31786ef652af4cb39b75bc5187b09215 => generated 393 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:42:28.476737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ca5ca-b7c9-4b4c-af4a-a965c612e6bb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:28.477085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ca5ca-b7c9-4b4c-af4a-a965c612e6bb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:28.477559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ca5ca-b7c9-4b4c-af4a-a965c612e6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:28.503138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-309ca5ca-b7c9-4b4c-af4a-a965c612e6bb None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:28.503138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-309ca5ca-b7c9-4b4c-af4a-a965c612e6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:28.523055 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 871/1727] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:42:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:28.524036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65dfab-ae71-47aa-92c3-c4f67731a10f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:28.525797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7b65dfab-ae71-47aa-92c3-c4f67731a10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:28.572139 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:28.591600 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 857/1728] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:28.607191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ca5ca-b7c9-4b4c-af4a-a965c612e6bb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:28.654273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65dfab-ae71-47aa-92c3-c4f67731a10f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:28.659930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bdeb5-e91a-47e8-8731-f553defdbb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:28.660622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bdeb5-e91a-47e8-8731-f553defdbb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:28.660917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bdeb5-e91a-47e8-8731-f553defdbb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:28.661187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bdeb5-e91a-47e8-8731-f553defdbb77 admin admin] PATH_INFO: `/v3/projects/c0baae3464194a818232b045acd45874` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:28.662313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bdeb5-e91a-47e8-8731-f553defdbb77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0baae3464194a818232b045acd45874)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:28.664261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bdeb5-e91a-47e8-8731-f553defdbb77 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:28.705304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ca5ca-b7c9-4b4c-af4a-a965c612e6bb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:28.715000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9251d3e-459c-49b6-99be-2935fa8279fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:28.716303 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9251d3e-459c-49b6-99be-2935fa8279fc service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:28.717591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9251d3e-459c-49b6-99be-2935fa8279fc service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:28.718172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9251d3e-459c-49b6-99be-2935fa8279fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:28.732276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-380bdeb5-e91a-47e8-8731-f553defdbb77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0baae3464194a818232b045acd45874', 'request_id': 'req-380bdeb5-e91a-47e8-8731-f553defdbb77'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:28.734478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9251d3e-459c-49b6-99be-2935fa8279fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:28.736630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9251d3e-459c-49b6-99be-2935fa8279fc service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:28.743272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-380bdeb5-e91a-47e8-8731-f553defdbb77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0baae3464194a818232b045acd45874', 'request_id': 'req-380bdeb5-e91a-47e8-8731-f553defdbb77'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:28.752746 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 858/1729] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:42:28.752968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-380bdeb5-e91a-47e8-8731-f553defdbb77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0baae3464194a818232b045acd45874', 'request_id': 'req-380bdeb5-e91a-47e8-8731-f553defdbb77'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:28.754735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9251d3e-459c-49b6-99be-2935fa8279fc service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:28.757044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c9251d3e-459c-49b6-99be-2935fa8279fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:28.767507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-380bdeb5-e91a-47e8-8731-f553defdbb77 admin admin] The token cache is being invalidate because project c0baae3464194a818232b045acd45874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:42:28.768649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-380bdeb5-e91a-47e8-8731-f553defdbb77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:28.769359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-380bdeb5-e91a-47e8-8731-f553defdbb77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:28.771216 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 872/1730] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:42:28 2022] DELETE /identity/v3/projects/c0baae3464194a818232b045acd45874 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:28.772756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2936d77-7944-41ad-91ba-5224867a71e4 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:28.773041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2936d77-7944-41ad-91ba-5224867a71e4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:28.773313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2936d77-7944-41ad-91ba-5224867a71e4 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:28.775022 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 873/1731] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:42:28.776840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2936d77-7944-41ad-91ba-5224867a71e4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:28.778736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f2936d77-7944-41ad-91ba-5224867a71e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:28.788025 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:28.899465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2936d77-7944-41ad-91ba-5224867a71e4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:28.910858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8a46f-dd26-427e-ba59-37cff7fdde46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:28.911515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8a46f-dd26-427e-ba59-37cff7fdde46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:28.912301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8a46f-dd26-427e-ba59-37cff7fdde46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:28.912726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8a46f-dd26-427e-ba59-37cff7fdde46 admin admin] PATH_INFO: `/v3/users/126543753a3a4af5b7e5de4126f58387` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:28.913461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9251d3e-459c-49b6-99be-2935fa8279fc service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:28.914637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8a46f-dd26-427e-ba59-37cff7fdde46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=126543753a3a4af5b7e5de4126f58387)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:28.916670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8a46f-dd26-427e-ba59-37cff7fdde46 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:29.018406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e768b-5fb6-48f2-b1e4-2227505f4cd6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:29.019193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e768b-5fb6-48f2-b1e4-2227505f4cd6 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:29.019481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e768b-5fb6-48f2-b1e4-2227505f4cd6 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:29.019815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e768b-5fb6-48f2-b1e4-2227505f4cd6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:29.021956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f45e768b-5fb6-48f2-b1e4-2227505f4cd6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:29.032525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-61f8a46f-dd26-427e-ba59-37cff7fdde46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '126543753a3a4af5b7e5de4126f58387'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:29.033498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-61f8a46f-dd26-427e-ba59-37cff7fdde46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '126543753a3a4af5b7e5de4126f58387'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:29.054775 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:29.060923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-61f8a46f-dd26-427e-ba59-37cff7fdde46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '126543753a3a4af5b7e5de4126f58387'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:29.102926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e768b-5fb6-48f2-b1e4-2227505f4cd6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:29.103927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-61f8a46f-dd26-427e-ba59-37cff7fdde46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '126543753a3a4af5b7e5de4126f58387'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:29.108140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e768b-5fb6-48f2-b1e4-2227505f4cd6 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:29.114236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-61f8a46f-dd26-427e-ba59-37cff7fdde46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '126543753a3a4af5b7e5de4126f58387'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:29.126877 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 874/1732] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:42:28 2022] DELETE /identity/v3/users/126543753a3a4af5b7e5de4126f58387 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:29.129229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8a46f-dd26-427e-ba59-37cff7fdde46 admin admin] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:42:29.130851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-61f8a46f-dd26-427e-ba59-37cff7fdde46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:29.153396 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 859/1733] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:42:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:42:29.236289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8a46f-dd26-427e-ba59-37cff7fdde46 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:29.237833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-61f8a46f-dd26-427e-ba59-37cff7fdde46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:29.297098 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:29.404827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8a46f-dd26-427e-ba59-37cff7fdde46 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:29.424542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fae3a6-552b-41c2-8dec-6271f52ffb1a tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a981f725bdfa4727b4ae8fe8c1479082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cca7ee364554888a73b1f6f8cd25681', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:29.425240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fae3a6-552b-41c2-8dec-6271f52ffb1a tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:29.425519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fae3a6-552b-41c2-8dec-6271f52ffb1a tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:29.426047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fae3a6-552b-41c2-8dec-6271f52ffb1a tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] PATH_INFO: `/v3/projects/cc339296b51442879880bef4ed9f136f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:29.428340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fae3a6-552b-41c2-8dec-6271f52ffb1a tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] RBAC: Authorizing `identity:get_project(project_id=cc339296b51442879880bef4ed9f136f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:29.430821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fae3a6-552b-41c2-8dec-6271f52ffb1a tempest-FlavorsAccessNegativeTestJSON-1391070206 tempest-FlavorsAccessNegativeTestJSON-1391070206-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:29.453282 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 875/1734] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:42:29 2022] GET /identity/v3/projects/cc339296b51442879880bef4ed9f136f => generated 393 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:42:29.631144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e768b-5fb6-48f2-b1e4-2227505f4cd6 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:29.633089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f45e768b-5fb6-48f2-b1e4-2227505f4cd6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:29.652016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e768b-5fb6-48f2-b1e4-2227505f4cd6 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:29.788202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482817e-0f4e-40da-bc3b-954ab3c2af43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:29.789383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482817e-0f4e-40da-bc3b-954ab3c2af43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:29.789778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482817e-0f4e-40da-bc3b-954ab3c2af43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:29.790074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482817e-0f4e-40da-bc3b-954ab3c2af43 admin admin] PATH_INFO: `/v3/users/d83be3deadd74d24a632830e73682cde` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:29.791797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482817e-0f4e-40da-bc3b-954ab3c2af43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d83be3deadd74d24a632830e73682cde)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:29.795795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482817e-0f4e-40da-bc3b-954ab3c2af43 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:29.876899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a482817e-0f4e-40da-bc3b-954ab3c2af43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd83be3deadd74d24a632830e73682cde'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:29.889725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a482817e-0f4e-40da-bc3b-954ab3c2af43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd83be3deadd74d24a632830e73682cde'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:29.891193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a482817e-0f4e-40da-bc3b-954ab3c2af43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd83be3deadd74d24a632830e73682cde'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:29.944026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a482817e-0f4e-40da-bc3b-954ab3c2af43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd83be3deadd74d24a632830e73682cde'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:29.970262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a482817e-0f4e-40da-bc3b-954ab3c2af43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd83be3deadd74d24a632830e73682cde'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:29.992657 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 860/1735] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:42:29 2022] DELETE /identity/v3/users/d83be3deadd74d24a632830e73682cde => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:29.994863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14e621-302d-4d14-b91d-048b64e906a8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:29.995152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14e621-302d-4d14-b91d-048b64e906a8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:29.996109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14e621-302d-4d14-b91d-048b64e906a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:30.040019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1c14e621-302d-4d14-b91d-048b64e906a8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:30.043094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1c14e621-302d-4d14-b91d-048b64e906a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:30.244053 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 876/1736] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:30.249993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b3efd-7c3a-436e-9b72-38afff06ec56 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:30.250773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b3efd-7c3a-436e-9b72-38afff06ec56 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:30.251201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b3efd-7c3a-436e-9b72-38afff06ec56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:30.271207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14e621-302d-4d14-b91d-048b64e906a8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:30.273078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1c14e621-302d-4d14-b91d-048b64e906a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:30.370597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dc9b3efd-7c3a-436e-9b72-38afff06ec56 None None] MFA Rules not processed for user `a9b0fd833b134a089433cd2985caba80`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:30.371977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dc9b3efd-7c3a-436e-9b72-38afff06ec56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:30.407248 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:30.451782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14e621-302d-4d14-b91d-048b64e906a8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:30.457868 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 861/1737] 10.222.0.17 () {58 vars in 1015 bytes} [Fri Sep 30 09:42:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:30.457996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d416249-4f4d-4d44-aa7a-ea766752a16e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:30.458814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d416249-4f4d-4d44-aa7a-ea766752a16e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:30.459400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d416249-4f4d-4d44-aa7a-ea766752a16e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:30.459713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d416249-4f4d-4d44-aa7a-ea766752a16e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:30.478229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d416249-4f4d-4d44-aa7a-ea766752a16e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:30.481729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d416249-4f4d-4d44-aa7a-ea766752a16e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:30.488491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b3efd-7c3a-436e-9b72-38afff06ec56 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:30.490622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dc9b3efd-7c3a-436e-9b72-38afff06ec56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:30.498730 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 877/1738] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:42:30.508187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b3efd-7c3a-436e-9b72-38afff06ec56 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:30.519885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bee0eb-5560-4535-a5c4-b0bd70d13223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:30.522575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bee0eb-5560-4535-a5c4-b0bd70d13223 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:30.523245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bee0eb-5560-4535-a5c4-b0bd70d13223 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:30.524082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bee0eb-5560-4535-a5c4-b0bd70d13223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:30.536454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bee0eb-5560-4535-a5c4-b0bd70d13223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:30.539232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bee0eb-5560-4535-a5c4-b0bd70d13223 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:30.559115 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 862/1739] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:42:30.581446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d416249-4f4d-4d44-aa7a-ea766752a16e service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:30.583260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3d416249-4f4d-4d44-aa7a-ea766752a16e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:30.610363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d416249-4f4d-4d44-aa7a-ea766752a16e service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:30.623814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f476d81-f896-4cfc-bf26-c864acf21ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:30.624938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f476d81-f896-4cfc-bf26-c864acf21ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:30.625887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f476d81-f896-4cfc-bf26-c864acf21ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:30.626795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f476d81-f896-4cfc-bf26-c864acf21ba4 admin admin] PATH_INFO: `/v3/projects/c9de10355880479f8fb1786c004decb0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:30.628445 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f476d81-f896-4cfc-bf26-c864acf21ba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9de10355880479f8fb1786c004decb0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:30.631351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f476d81-f896-4cfc-bf26-c864acf21ba4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:30.754853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9f476d81-f896-4cfc-bf26-c864acf21ba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9de10355880479f8fb1786c004decb0', 'request_id': 'req-9f476d81-f896-4cfc-bf26-c864acf21ba4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:30.774863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9f476d81-f896-4cfc-bf26-c864acf21ba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9de10355880479f8fb1786c004decb0', 'request_id': 'req-9f476d81-f896-4cfc-bf26-c864acf21ba4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:30.780658 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:30.787828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9f476d81-f896-4cfc-bf26-c864acf21ba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9de10355880479f8fb1786c004decb0', 'request_id': 'req-9f476d81-f896-4cfc-bf26-c864acf21ba4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:30.812919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9f476d81-f896-4cfc-bf26-c864acf21ba4 admin admin] The token cache is being invalidate because project c9de10355880479f8fb1786c004decb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:42:30.814912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9f476d81-f896-4cfc-bf26-c864acf21ba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:30.816983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9f476d81-f896-4cfc-bf26-c864acf21ba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:30.825073 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 878/1740] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:42:30 2022] DELETE /identity/v3/projects/c9de10355880479f8fb1786c004decb0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:30.829864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc214a-fdac-4c25-b915-178a898634f8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:30.832687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc214a-fdac-4c25-b915-178a898634f8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:30.833349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc214a-fdac-4c25-b915-178a898634f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:30.879750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-defc214a-fdac-4c25-b915-178a898634f8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:30.882374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-defc214a-fdac-4c25-b915-178a898634f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:31.024730 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 863/1741] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:31.035480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87d085-1447-4282-aa3e-9160d90614d3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:31.036096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87d085-1447-4282-aa3e-9160d90614d3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:31.036520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87d085-1447-4282-aa3e-9160d90614d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:31.106084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7f87d085-1447-4282-aa3e-9160d90614d3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:31.106084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7f87d085-1447-4282-aa3e-9160d90614d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:31.138248 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 879/1742] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:31.144307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc214a-fdac-4c25-b915-178a898634f8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:31.159770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc214a-fdac-4c25-b915-178a898634f8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:31.178768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d68a7-2823-4f05-8d8e-eb0715d4caa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:31.179467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d68a7-2823-4f05-8d8e-eb0715d4caa0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:31.179744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d68a7-2823-4f05-8d8e-eb0715d4caa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:31.180013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d68a7-2823-4f05-8d8e-eb0715d4caa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:31.180716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d68a7-2823-4f05-8d8e-eb0715d4caa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:42:31.181018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d68a7-2823-4f05-8d8e-eb0715d4caa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:31.190282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d68a7-2823-4f05-8d8e-eb0715d4caa0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:31.241349 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 864/1743] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:42:31.243817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87d085-1447-4282-aa3e-9160d90614d3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:31.262723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87d085-1447-4282-aa3e-9160d90614d3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:31.270158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5902d7-1cb4-4e06-9261-1cf6cdbd5750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:31.270862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5902d7-1cb4-4e06-9261-1cf6cdbd5750 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:31.271350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5902d7-1cb4-4e06-9261-1cf6cdbd5750 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:31.273994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5902d7-1cb4-4e06-9261-1cf6cdbd5750 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:31.276647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5902d7-1cb4-4e06-9261-1cf6cdbd5750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:31.280314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5902d7-1cb4-4e06-9261-1cf6cdbd5750 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:31.364095 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 880/1744] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:31 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:31.368194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d68a7-2823-4f05-8d8e-eb0715d4caa0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:31.380686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d68a7-2823-4f05-8d8e-eb0715d4caa0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:31.466009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbba6f1-fc1b-448b-a1d3-e33a7eb38837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:31.467120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbba6f1-fc1b-448b-a1d3-e33a7eb38837 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:31.467509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbba6f1-fc1b-448b-a1d3-e33a7eb38837 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:31.467937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbba6f1-fc1b-448b-a1d3-e33a7eb38837 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:31.469124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbba6f1-fc1b-448b-a1d3-e33a7eb38837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:31.471592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbba6f1-fc1b-448b-a1d3-e33a7eb38837 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:31.513947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5902d7-1cb4-4e06-9261-1cf6cdbd5750 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:31.524545 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 865/1745] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:31 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:31.529691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5902d7-1cb4-4e06-9261-1cf6cdbd5750 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:31.537509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b4d2f-2e70-44a7-85e6-1d38bd63b3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:31.538274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b4d2f-2e70-44a7-85e6-1d38bd63b3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:31.538591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b4d2f-2e70-44a7-85e6-1d38bd63b3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:31.539035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b4d2f-2e70-44a7-85e6-1d38bd63b3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:31.539779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b4d2f-2e70-44a7-85e6-1d38bd63b3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:31.541657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b4d2f-2e70-44a7-85e6-1d38bd63b3b3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:31.562177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbba6f1-fc1b-448b-a1d3-e33a7eb38837 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:31.582380 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 881/1746] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:31.582800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbba6f1-fc1b-448b-a1d3-e33a7eb38837 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:31.589433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a14a6-d7fb-4e45-8c4c-15b27b77ec62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:31.590112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a14a6-d7fb-4e45-8c4c-15b27b77ec62 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:31.590410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a14a6-d7fb-4e45-8c4c-15b27b77ec62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:31.590716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a14a6-d7fb-4e45-8c4c-15b27b77ec62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:31.591579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a14a6-d7fb-4e45-8c4c-15b27b77ec62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:31.593588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a14a6-d7fb-4e45-8c4c-15b27b77ec62 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:31.615558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b4d2f-2e70-44a7-85e6-1d38bd63b3b3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:31.615783 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 866/1747] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:31.629941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b4d2f-2e70-44a7-85e6-1d38bd63b3b3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:31.637463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e7bfa-0634-4c11-8f9f-fdc41f1a9334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:31.638606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e7bfa-0634-4c11-8f9f-fdc41f1a9334 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:31.638997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e7bfa-0634-4c11-8f9f-fdc41f1a9334 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:31.639418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e7bfa-0634-4c11-8f9f-fdc41f1a9334 admin admin] PATH_INFO: `/v3/projects/06dce6950d594a53b565e453cb008c69/users/1323468988d84b6b86498a699bef3fa0/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:31.675074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e7bfa-0634-4c11-8f9f-fdc41f1a9334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06dce6950d594a53b565e453cb008c69, user_id=1323468988d84b6b86498a699bef3fa0, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:31.682483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e7bfa-0634-4c11-8f9f-fdc41f1a9334 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:31.708821 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 882/1748] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:31 2022] PUT /identity/v3/projects/06dce6950d594a53b565e453cb008c69/users/1323468988d84b6b86498a699bef3fa0/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:31.721565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798510b-c455-4a8e-8003-fbf2cb699692 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:31.722392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798510b-c455-4a8e-8003-fbf2cb699692 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:31.722880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798510b-c455-4a8e-8003-fbf2cb699692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:31.800375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a798510b-c455-4a8e-8003-fbf2cb699692 None None] MFA Rules not processed for user `1323468988d84b6b86498a699bef3fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:31.802664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a798510b-c455-4a8e-8003-fbf2cb699692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:31.807514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e7bfa-0634-4c11-8f9f-fdc41f1a9334 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:31.810033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-034e7bfa-0634-4c11-8f9f-fdc41f1a9334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:31.858148 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:31.942147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e7bfa-0634-4c11-8f9f-fdc41f1a9334 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:31.973716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45294e57-c6c3-4d49-80fa-ebf5d88e6d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:31.974509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45294e57-c6c3-4d49-80fa-ebf5d88e6d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:31.974907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45294e57-c6c3-4d49-80fa-ebf5d88e6d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:31.975219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45294e57-c6c3-4d49-80fa-ebf5d88e6d46 admin admin] PATH_INFO: `/v3/projects/31786ef652af4cb39b75bc5187b09215` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:31.977321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45294e57-c6c3-4d49-80fa-ebf5d88e6d46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31786ef652af4cb39b75bc5187b09215)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:31.983139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45294e57-c6c3-4d49-80fa-ebf5d88e6d46 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:31.988749 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 867/1749] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:32.019291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798510b-c455-4a8e-8003-fbf2cb699692 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:32.062970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798510b-c455-4a8e-8003-fbf2cb699692 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:32.070502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d091ae-6ae3-43d4-a156-4ebd8fb5c461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:32.071566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d091ae-6ae3-43d4-a156-4ebd8fb5c461 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:32.072019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d091ae-6ae3-43d4-a156-4ebd8fb5c461 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:32.072473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d091ae-6ae3-43d4-a156-4ebd8fb5c461 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:32.074437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d091ae-6ae3-43d4-a156-4ebd8fb5c461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:32.077326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d091ae-6ae3-43d4-a156-4ebd8fb5c461 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:32.137287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-45294e57-c6c3-4d49-80fa-ebf5d88e6d46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31786ef652af4cb39b75bc5187b09215', 'request_id': 'req-45294e57-c6c3-4d49-80fa-ebf5d88e6d46'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:32.169732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-45294e57-c6c3-4d49-80fa-ebf5d88e6d46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31786ef652af4cb39b75bc5187b09215', 'request_id': 'req-45294e57-c6c3-4d49-80fa-ebf5d88e6d46'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:32.186432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-45294e57-c6c3-4d49-80fa-ebf5d88e6d46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31786ef652af4cb39b75bc5187b09215', 'request_id': 'req-45294e57-c6c3-4d49-80fa-ebf5d88e6d46'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:32.228795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-45294e57-c6c3-4d49-80fa-ebf5d88e6d46 admin admin] The token cache is being invalidate because project 31786ef652af4cb39b75bc5187b09215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:42:32.229144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-45294e57-c6c3-4d49-80fa-ebf5d88e6d46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:32.230409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-45294e57-c6c3-4d49-80fa-ebf5d88e6d46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:32.234020 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 883/1750] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:42:31 2022] DELETE /identity/v3/projects/31786ef652af4cb39b75bc5187b09215 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:32.237071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45294e57-c6c3-4d49-80fa-ebf5d88e6d46 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:32.237217 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 868/1751] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:32 2022] POST /identity/v3/projects => generated 385 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:32.239267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d091ae-6ae3-43d4-a156-4ebd8fb5c461 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:32.242662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-45294e57-c6c3-4d49-80fa-ebf5d88e6d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:32.243562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-51d091ae-6ae3-43d4-a156-4ebd8fb5c461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:32.300809 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:32.409904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d091ae-6ae3-43d4-a156-4ebd8fb5c461 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:32.419777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45294e57-c6c3-4d49-80fa-ebf5d88e6d46 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:32.427757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60d329-ed03-40c3-aaac-c070b6a9b4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:32.428429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60d329-ed03-40c3-aaac-c070b6a9b4af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:32.430780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60d329-ed03-40c3-aaac-c070b6a9b4af admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:32.431118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60d329-ed03-40c3-aaac-c070b6a9b4af admin admin] PATH_INFO: `/v3/users/a981f725bdfa4727b4ae8fe8c1479082` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:32.433507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc60d329-ed03-40c3-aaac-c070b6a9b4af admin admin] RBAC: Authorizing `identity:delete_user(user_id=a981f725bdfa4727b4ae8fe8c1479082)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:32.435749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc60d329-ed03-40c3-aaac-c070b6a9b4af admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:32.436644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5b696-21d8-4b72-9309-e506f5c9dabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:32.437268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5b696-21d8-4b72-9309-e506f5c9dabd admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:32.437567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5b696-21d8-4b72-9309-e506f5c9dabd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:32.437812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5b696-21d8-4b72-9309-e506f5c9dabd admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:32.438453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5b696-21d8-4b72-9309-e506f5c9dabd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:32.440359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5b696-21d8-4b72-9309-e506f5c9dabd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:32.480378 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 884/1752] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:32 2022] POST /identity/v3/users => generated 299 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:32.488545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5b696-21d8-4b72-9309-e506f5c9dabd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:32.511405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5b696-21d8-4b72-9309-e506f5c9dabd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:32.542785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08e70f-9a25-4cae-b8c5-e57ed8f213d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:32.545663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08e70f-9a25-4cae-b8c5-e57ed8f213d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:32.546528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08e70f-9a25-4cae-b8c5-e57ed8f213d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:32.546817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08e70f-9a25-4cae-b8c5-e57ed8f213d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:32.549942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08e70f-9a25-4cae-b8c5-e57ed8f213d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:32.555616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08e70f-9a25-4cae-b8c5-e57ed8f213d6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:32.599129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fc60d329-ed03-40c3-aaac-c070b6a9b4af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a981f725bdfa4727b4ae8fe8c1479082'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:32.606920 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 885/1753] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:32.608876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fc60d329-ed03-40c3-aaac-c070b6a9b4af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a981f725bdfa4727b4ae8fe8c1479082'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:32.609750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fc60d329-ed03-40c3-aaac-c070b6a9b4af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a981f725bdfa4727b4ae8fe8c1479082'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:32.613813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08e70f-9a25-4cae-b8c5-e57ed8f213d6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:32.647088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08e70f-9a25-4cae-b8c5-e57ed8f213d6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:32.652816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fc60d329-ed03-40c3-aaac-c070b6a9b4af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a981f725bdfa4727b4ae8fe8c1479082'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:32.661571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d00d9-92f6-426c-86cf-9981235996bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:32.662402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d00d9-92f6-426c-86cf-9981235996bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:32.662791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d00d9-92f6-426c-86cf-9981235996bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:32.663742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d00d9-92f6-426c-86cf-9981235996bd admin admin] PATH_INFO: `/v3/projects/3a7a6717655843f2980cf35bd0067bb0/users/40777bd0f4504c24966fe85fec93ec47/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:32.672240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fc60d329-ed03-40c3-aaac-c070b6a9b4af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a981f725bdfa4727b4ae8fe8c1479082'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:32.686419 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 869/1754] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:42:32 2022] DELETE /identity/v3/users/a981f725bdfa4727b4ae8fe8c1479082 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:32.701899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d00d9-92f6-426c-86cf-9981235996bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a7a6717655843f2980cf35bd0067bb0, user_id=40777bd0f4504c24966fe85fec93ec47, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:32.705200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d00d9-92f6-426c-86cf-9981235996bd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:32.738895 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 886/1755] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:32 2022] PUT /identity/v3/projects/3a7a6717655843f2980cf35bd0067bb0/users/40777bd0f4504c24966fe85fec93ec47/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:32.744363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60d329-ed03-40c3-aaac-c070b6a9b4af admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:32.748975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fc60d329-ed03-40c3-aaac-c070b6a9b4af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:32.815776 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:32.975626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60d329-ed03-40c3-aaac-c070b6a9b4af admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:33.180771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87098464-fd21-4201-ba7f-98abef737c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:33.181677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87098464-fd21-4201-ba7f-98abef737c85 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:33.182179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87098464-fd21-4201-ba7f-98abef737c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:33.183347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87098464-fd21-4201-ba7f-98abef737c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:33.194563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87098464-fd21-4201-ba7f-98abef737c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:33.199605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87098464-fd21-4201-ba7f-98abef737c85 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:33.256179 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 870/1756] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 514 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:33.262415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d00d9-92f6-426c-86cf-9981235996bd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:33.279102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d00d9-92f6-426c-86cf-9981235996bd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:33.285035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19ab86-8f85-45b0-8afc-ea8eaf6bcd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:33.285812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19ab86-8f85-45b0-8afc-ea8eaf6bcd7e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:33.286159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19ab86-8f85-45b0-8afc-ea8eaf6bcd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:33.286624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19ab86-8f85-45b0-8afc-ea8eaf6bcd7e admin admin] PATH_INFO: `/v3/projects/3a7a6717655843f2980cf35bd0067bb0/users/40777bd0f4504c24966fe85fec93ec47/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:33.292381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19ab86-8f85-45b0-8afc-ea8eaf6bcd7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a7a6717655843f2980cf35bd0067bb0, user_id=40777bd0f4504c24966fe85fec93ec47, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:33.296298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19ab86-8f85-45b0-8afc-ea8eaf6bcd7e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:33.333147 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 887/1757] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:33 2022] PUT /identity/v3/projects/3a7a6717655843f2980cf35bd0067bb0/users/40777bd0f4504c24966fe85fec93ec47/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:33.341133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0a89f-8e54-43d1-8701-01f6ddb14e67 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:33.341428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0a89f-8e54-43d1-8701-01f6ddb14e67 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:33.341703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0a89f-8e54-43d1-8701-01f6ddb14e67 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:33.346074 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 871/1758] 10.222.0.16 () {54 vars in 921 bytes} [Fri Sep 30 09:42:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:42:33.347644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439c412-96cc-465f-b7f2-88246d9695fb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:33.347936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439c412-96cc-465f-b7f2-88246d9695fb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:33.348212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439c412-96cc-465f-b7f2-88246d9695fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:33.357204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb1bed-647d-49d2-8ac7-3ac3ac6dcf4d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:33.357415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb1bed-647d-49d2-8ac7-3ac3ac6dcf4d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:33.358173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb1bed-647d-49d2-8ac7-3ac3ac6dcf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:33.405042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9feb1bed-647d-49d2-8ac7-3ac3ac6dcf4d None None] MFA Rules not processed for user `aa607111024540d1a09b01dfd1e5e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:33.406623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9feb1bed-647d-49d2-8ac7-3ac3ac6dcf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:33.440129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c439c412-96cc-465f-b7f2-88246d9695fb None None] MFA Rules not processed for user `40777bd0f4504c24966fe85fec93ec47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:33.441781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c439c412-96cc-465f-b7f2-88246d9695fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:33.630718 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 872/1759] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 09:42:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:33.645918 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 888/1760] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:33.670889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb1bed-647d-49d2-8ac7-3ac3ac6dcf4d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:33.673313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9feb1bed-647d-49d2-8ac7-3ac3ac6dcf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:33.694381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439c412-96cc-465f-b7f2-88246d9695fb None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:33.697211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb1bed-647d-49d2-8ac7-3ac3ac6dcf4d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:33.699832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c439c412-96cc-465f-b7f2-88246d9695fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:33.710165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742ea2e-71ac-4ca5-8877-2b9894d30afb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:33.711434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742ea2e-71ac-4ca5-8877-2b9894d30afb service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:33.712026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742ea2e-71ac-4ca5-8877-2b9894d30afb service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:33.712505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742ea2e-71ac-4ca5-8877-2b9894d30afb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:33.725517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742ea2e-71ac-4ca5-8877-2b9894d30afb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:33.727608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742ea2e-71ac-4ca5-8877-2b9894d30afb service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:33.747875 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 873/1761] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:33.752362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439c412-96cc-465f-b7f2-88246d9695fb None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:33.765962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130de1cb-84b1-4d2a-a38b-a02e8c93cca2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:33.766655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130de1cb-84b1-4d2a-a38b-a02e8c93cca2 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:33.767014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130de1cb-84b1-4d2a-a38b-a02e8c93cca2 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:33.767306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130de1cb-84b1-4d2a-a38b-a02e8c93cca2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:33.801222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130de1cb-84b1-4d2a-a38b-a02e8c93cca2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:33.808971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130de1cb-84b1-4d2a-a38b-a02e8c93cca2 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:33.838581 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 889/1762] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:34.443217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742ea2e-71ac-4ca5-8877-2b9894d30afb service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:34.445532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3742ea2e-71ac-4ca5-8877-2b9894d30afb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:34.534074 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:34.566068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742ea2e-71ac-4ca5-8877-2b9894d30afb service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:34.572008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c390d0-b376-49b7-a957-0691ea4bf2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:34.572882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c390d0-b376-49b7-a957-0691ea4bf2c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:34.574008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c390d0-b376-49b7-a957-0691ea4bf2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:34.574380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c390d0-b376-49b7-a957-0691ea4bf2c0 admin admin] PATH_INFO: `/v3/projects/3cca7ee364554888a73b1f6f8cd25681` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:34.576385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c390d0-b376-49b7-a957-0691ea4bf2c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cca7ee364554888a73b1f6f8cd25681)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:34.578634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c390d0-b376-49b7-a957-0691ea4bf2c0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:34.737821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a7c390d0-b376-49b7-a957-0691ea4bf2c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cca7ee364554888a73b1f6f8cd25681', 'request_id': 'req-a7c390d0-b376-49b7-a957-0691ea4bf2c0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:34.756153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a7c390d0-b376-49b7-a957-0691ea4bf2c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cca7ee364554888a73b1f6f8cd25681', 'request_id': 'req-a7c390d0-b376-49b7-a957-0691ea4bf2c0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:34.774372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a7c390d0-b376-49b7-a957-0691ea4bf2c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cca7ee364554888a73b1f6f8cd25681', 'request_id': 'req-a7c390d0-b376-49b7-a957-0691ea4bf2c0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:34.810581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a7c390d0-b376-49b7-a957-0691ea4bf2c0 admin admin] The token cache is being invalidate because project 3cca7ee364554888a73b1f6f8cd25681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:42:34.812148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a7c390d0-b376-49b7-a957-0691ea4bf2c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:34.812148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a7c390d0-b376-49b7-a957-0691ea4bf2c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:34.813280 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 874/1763] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:42:34 2022] DELETE /identity/v3/projects/3cca7ee364554888a73b1f6f8cd25681 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:34.819799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130de1cb-84b1-4d2a-a38b-a02e8c93cca2 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:34.841482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c390d0-b376-49b7-a957-0691ea4bf2c0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:34.845577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a7c390d0-b376-49b7-a957-0691ea4bf2c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:34.847070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130de1cb-84b1-4d2a-a38b-a02e8c93cca2 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:34.971790 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:35.125590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1892db-3cf2-4bc2-8999-96bd031d6aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:35.126274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1892db-3cf2-4bc2-8999-96bd031d6aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:35.126528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1892db-3cf2-4bc2-8999-96bd031d6aac admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:35.126800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1892db-3cf2-4bc2-8999-96bd031d6aac admin admin] PATH_INFO: `/v3/users/8c7f5738e2f345e3bc931fc92af2822f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:35.139173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1892db-3cf2-4bc2-8999-96bd031d6aac admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c7f5738e2f345e3bc931fc92af2822f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:35.143474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1892db-3cf2-4bc2-8999-96bd031d6aac admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:35.155308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c390d0-b376-49b7-a957-0691ea4bf2c0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:35.172546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654a427-e9e3-4b85-a625-3a7a4a35489b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:35.173150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654a427-e9e3-4b85-a625-3a7a4a35489b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:35.181974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654a427-e9e3-4b85-a625-3a7a4a35489b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:35.182334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654a427-e9e3-4b85-a625-3a7a4a35489b admin admin] PATH_INFO: `/v3/users/1323468988d84b6b86498a699bef3fa0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:35.196082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654a427-e9e3-4b85-a625-3a7a4a35489b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1323468988d84b6b86498a699bef3fa0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:35.199308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654a427-e9e3-4b85-a625-3a7a4a35489b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:35.287288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f1892db-3cf2-4bc2-8999-96bd031d6aac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c7f5738e2f345e3bc931fc92af2822f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:35.288083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f1892db-3cf2-4bc2-8999-96bd031d6aac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c7f5738e2f345e3bc931fc92af2822f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:35.324327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f1892db-3cf2-4bc2-8999-96bd031d6aac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c7f5738e2f345e3bc931fc92af2822f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:35.326170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3654a427-e9e3-4b85-a625-3a7a4a35489b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1323468988d84b6b86498a699bef3fa0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:35.341884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3654a427-e9e3-4b85-a625-3a7a4a35489b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1323468988d84b6b86498a699bef3fa0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:35.342787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3654a427-e9e3-4b85-a625-3a7a4a35489b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1323468988d84b6b86498a699bef3fa0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:35.373884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f1892db-3cf2-4bc2-8999-96bd031d6aac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c7f5738e2f345e3bc931fc92af2822f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:35.375505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3654a427-e9e3-4b85-a625-3a7a4a35489b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1323468988d84b6b86498a699bef3fa0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:35.378883 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:35.389928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f1892db-3cf2-4bc2-8999-96bd031d6aac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c7f5738e2f345e3bc931fc92af2822f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:35.408888 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 890/1764] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:42:34 2022] DELETE /identity/v3/users/8c7f5738e2f345e3bc931fc92af2822f => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:35.412673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3654a427-e9e3-4b85-a625-3a7a4a35489b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1323468988d84b6b86498a699bef3fa0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:35.432482 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 875/1765] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:42:34 2022] DELETE /identity/v3/users/1323468988d84b6b86498a699bef3fa0 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:35.436934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf792fb6-e211-4597-9c5b-d37176d3a4b8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:35.437670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf792fb6-e211-4597-9c5b-d37176d3a4b8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:35.438399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf792fb6-e211-4597-9c5b-d37176d3a4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:35.494351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cf792fb6-e211-4597-9c5b-d37176d3a4b8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:35.497344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cf792fb6-e211-4597-9c5b-d37176d3a4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:35.661297 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 891/1766] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:35.735724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654a427-e9e3-4b85-a625-3a7a4a35489b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:35.738133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3654a427-e9e3-4b85-a625-3a7a4a35489b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:35.871812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654a427-e9e3-4b85-a625-3a7a4a35489b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:35.879253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02573d-b4d1-43c1-9d7f-70d713761b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:35.880176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02573d-b4d1-43c1-9d7f-70d713761b00 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:35.880466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02573d-b4d1-43c1-9d7f-70d713761b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:35.881016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02573d-b4d1-43c1-9d7f-70d713761b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:35.895316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02573d-b4d1-43c1-9d7f-70d713761b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:35.897880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02573d-b4d1-43c1-9d7f-70d713761b00 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:35.921523 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 876/1767] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:37.039968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf792fb6-e211-4597-9c5b-d37176d3a4b8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:37.042453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cf792fb6-e211-4597-9c5b-d37176d3a4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:37.064106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf792fb6-e211-4597-9c5b-d37176d3a4b8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:37.070075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4dd37-4627-4a34-9cfb-52691b0f5aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:37.070749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4dd37-4627-4a34-9cfb-52691b0f5aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:37.071177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4dd37-4627-4a34-9cfb-52691b0f5aab admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:37.071649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4dd37-4627-4a34-9cfb-52691b0f5aab admin admin] PATH_INFO: `/v3/projects/cc339296b51442879880bef4ed9f136f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:37.072702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4dd37-4627-4a34-9cfb-52691b0f5aab admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc339296b51442879880bef4ed9f136f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:37.075977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4dd37-4627-4a34-9cfb-52691b0f5aab admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:37.153313 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:37.165288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-24a4dd37-4627-4a34-9cfb-52691b0f5aab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc339296b51442879880bef4ed9f136f', 'request_id': 'req-24a4dd37-4627-4a34-9cfb-52691b0f5aab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:37.185828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-24a4dd37-4627-4a34-9cfb-52691b0f5aab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc339296b51442879880bef4ed9f136f', 'request_id': 'req-24a4dd37-4627-4a34-9cfb-52691b0f5aab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:37.201048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943d898-710f-42db-b879-b0b92e400f33 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:37.201626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-24a4dd37-4627-4a34-9cfb-52691b0f5aab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc339296b51442879880bef4ed9f136f', 'request_id': 'req-24a4dd37-4627-4a34-9cfb-52691b0f5aab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:37.201729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943d898-710f-42db-b879-b0b92e400f33 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:37.201729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943d898-710f-42db-b879-b0b92e400f33 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:37.203378 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 877/1768] 10.222.0.16 () {54 vars in 921 bytes} [Fri Sep 30 09:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:42:37.239417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-24a4dd37-4627-4a34-9cfb-52691b0f5aab admin admin] The token cache is being invalidate because project cc339296b51442879880bef4ed9f136f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:42:37.240366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-24a4dd37-4627-4a34-9cfb-52691b0f5aab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:37.242765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-24a4dd37-4627-4a34-9cfb-52691b0f5aab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:37.253198 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 892/1769] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:42:37 2022] DELETE /identity/v3/projects/cc339296b51442879880bef4ed9f136f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:37.254209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727f169-8f82-4d96-b6b8-721bc91d24d4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:37.254519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727f169-8f82-4d96-b6b8-721bc91d24d4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:37.254866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727f169-8f82-4d96-b6b8-721bc91d24d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:37.269990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fdf9c-61c9-419b-8689-c9d07fbf9bfc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:37.270376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fdf9c-61c9-419b-8689-c9d07fbf9bfc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:37.271960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fdf9c-61c9-419b-8689-c9d07fbf9bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:37.323370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6727f169-8f82-4d96-b6b8-721bc91d24d4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:37.324673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6727f169-8f82-4d96-b6b8-721bc91d24d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:37.346602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-425fdf9c-61c9-419b-8689-c9d07fbf9bfc None None] MFA Rules not processed for user `aa607111024540d1a09b01dfd1e5e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:37.348501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-425fdf9c-61c9-419b-8689-c9d07fbf9bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:37.545398 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 893/1770] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 09:42:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:42:37.568737 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 878/1771] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:37.580056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090b95d-3d4a-41bb-8b2b-d967907cf7a8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:37.580494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090b95d-3d4a-41bb-8b2b-d967907cf7a8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:37.581149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090b95d-3d4a-41bb-8b2b-d967907cf7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:37.627110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727f169-8f82-4d96-b6b8-721bc91d24d4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:37.628638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6727f169-8f82-4d96-b6b8-721bc91d24d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:37.649099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727f169-8f82-4d96-b6b8-721bc91d24d4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:37.660764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f8673-715a-45b3-8297-e0a65d0fdbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:37.661413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f8673-715a-45b3-8297-e0a65d0fdbd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:37.661690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f8673-715a-45b3-8297-e0a65d0fdbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:37.661952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f8673-715a-45b3-8297-e0a65d0fdbd0 admin admin] PATH_INFO: `/v3/projects/06dce6950d594a53b565e453cb008c69` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:37.668801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f8673-715a-45b3-8297-e0a65d0fdbd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06dce6950d594a53b565e453cb008c69)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:37.671018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f8673-715a-45b3-8297-e0a65d0fdbd0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:37.671876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4090b95d-3d4a-41bb-8b2b-d967907cf7a8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:37.674684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4090b95d-3d4a-41bb-8b2b-d967907cf7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:37.710667 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 894/1772] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:37.715688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090b95d-3d4a-41bb-8b2b-d967907cf7a8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:37.736317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090b95d-3d4a-41bb-8b2b-d967907cf7a8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:37.769288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b621e68-803b-4640-adaa-355d437a7498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:37.770640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b621e68-803b-4640-adaa-355d437a7498 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:37.771847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b621e68-803b-4640-adaa-355d437a7498 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:37.772332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-439f8673-715a-45b3-8297-e0a65d0fdbd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06dce6950d594a53b565e453cb008c69', 'request_id': 'req-439f8673-715a-45b3-8297-e0a65d0fdbd0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:37.775543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b621e68-803b-4640-adaa-355d437a7498 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:37.777054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b621e68-803b-4640-adaa-355d437a7498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:42:37.783141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b621e68-803b-4640-adaa-355d437a7498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:37.785063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b621e68-803b-4640-adaa-355d437a7498 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:37.791839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-439f8673-715a-45b3-8297-e0a65d0fdbd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06dce6950d594a53b565e453cb008c69', 'request_id': 'req-439f8673-715a-45b3-8297-e0a65d0fdbd0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:37.801140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-439f8673-715a-45b3-8297-e0a65d0fdbd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06dce6950d594a53b565e453cb008c69', 'request_id': 'req-439f8673-715a-45b3-8297-e0a65d0fdbd0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:37.825873 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 895/1773] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:42:37.826867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-439f8673-715a-45b3-8297-e0a65d0fdbd0 admin admin] The token cache is being invalidate because project 06dce6950d594a53b565e453cb008c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:42:37.827159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-439f8673-715a-45b3-8297-e0a65d0fdbd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:37.827880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-439f8673-715a-45b3-8297-e0a65d0fdbd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:37.829944 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 879/1774] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:42:37 2022] DELETE /identity/v3/projects/06dce6950d594a53b565e453cb008c69 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:37.831437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b621e68-803b-4640-adaa-355d437a7498 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:37.833731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f8673-715a-45b3-8297-e0a65d0fdbd0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:37.837144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-439f8673-715a-45b3-8297-e0a65d0fdbd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:37.838139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8b621e68-803b-4640-adaa-355d437a7498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:37.860771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b621e68-803b-4640-adaa-355d437a7498 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:37.874514 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:37.984225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f8673-715a-45b3-8297-e0a65d0fdbd0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:37.989364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71b9a0-5789-474c-ab9e-3a5bead5a5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:37.990070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71b9a0-5789-474c-ab9e-3a5bead5a5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:37.990351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71b9a0-5789-474c-ab9e-3a5bead5a5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:37.990621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71b9a0-5789-474c-ab9e-3a5bead5a5f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:37.991277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71b9a0-5789-474c-ab9e-3a5bead5a5f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:37.999005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71b9a0-5789-474c-ab9e-3a5bead5a5f0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:37.999533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe53675-5336-4304-9f1c-ead744935cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:38.000210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53675-5336-4304-9f1c-ead744935cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:38.000475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53675-5336-4304-9f1c-ead744935cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:38.000808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53675-5336-4304-9f1c-ead744935cd8 admin admin] PATH_INFO: `/v3/users/40777bd0f4504c24966fe85fec93ec47` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:38.002062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe53675-5336-4304-9f1c-ead744935cd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40777bd0f4504c24966fe85fec93ec47)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:38.004905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe53675-5336-4304-9f1c-ead744935cd8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:38.065671 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 896/1775] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:37 2022] POST /identity/v3/projects => generated 373 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:38.066833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71b9a0-5789-474c-ab9e-3a5bead5a5f0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:38.115799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8fe53675-5336-4304-9f1c-ead744935cd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40777bd0f4504c24966fe85fec93ec47'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:38.134281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8fe53675-5336-4304-9f1c-ead744935cd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40777bd0f4504c24966fe85fec93ec47'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:38.135074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8fe53675-5336-4304-9f1c-ead744935cd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40777bd0f4504c24966fe85fec93ec47'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:38.143998 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:38.163033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8fe53675-5336-4304-9f1c-ead744935cd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40777bd0f4504c24966fe85fec93ec47'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:38.181493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8fe53675-5336-4304-9f1c-ead744935cd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40777bd0f4504c24966fe85fec93ec47'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:38.194892 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 880/1776] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:42:37 2022] DELETE /identity/v3/users/40777bd0f4504c24966fe85fec93ec47 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:42:38.231610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71b9a0-5789-474c-ab9e-3a5bead5a5f0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:38.366511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefe92e-db49-46fc-b6a1-0e180cadec12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:38.367460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefe92e-db49-46fc-b6a1-0e180cadec12 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:38.367838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefe92e-db49-46fc-b6a1-0e180cadec12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:38.368254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefe92e-db49-46fc-b6a1-0e180cadec12 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:38.369182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefe92e-db49-46fc-b6a1-0e180cadec12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:38.371441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefe92e-db49-46fc-b6a1-0e180cadec12 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:38.405294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe53675-5336-4304-9f1c-ead744935cd8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:38.407168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8fe53675-5336-4304-9f1c-ead744935cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:38.453728 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 897/1777] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:38 2022] POST /identity/v3/users => generated 287 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:38.458672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefe92e-db49-46fc-b6a1-0e180cadec12 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:38.464647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2aefe92e-db49-46fc-b6a1-0e180cadec12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:38.503594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefe92e-db49-46fc-b6a1-0e180cadec12 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:38.513385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf825a-8ecb-4cce-ab21-c108640a6ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:38.513907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf825a-8ecb-4cce-ab21-c108640a6ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:38.514358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf825a-8ecb-4cce-ab21-c108640a6ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:38.514641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf825a-8ecb-4cce-ab21-c108640a6ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:38.515504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf825a-8ecb-4cce-ab21-c108640a6ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:38.518056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf825a-8ecb-4cce-ab21-c108640a6ef4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:38.552077 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 898/1778] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:38.553189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf825a-8ecb-4cce-ab21-c108640a6ef4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:38.587043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe53675-5336-4304-9f1c-ead744935cd8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:38.590097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf825a-8ecb-4cce-ab21-c108640a6ef4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:38.594819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb6beb-99f1-419c-9b55-096fe9ca4f76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:38.595702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb6beb-99f1-419c-9b55-096fe9ca4f76 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:38.596155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb6beb-99f1-419c-9b55-096fe9ca4f76 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:38.596569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb6beb-99f1-419c-9b55-096fe9ca4f76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:38.602631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-18fb6beb-99f1-419c-9b55-096fe9ca4f76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:38.609731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faadeb01-b42a-44f2-af99-ee0b38fd7744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:38.611363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadeb01-b42a-44f2-af99-ee0b38fd7744 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:38.611757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadeb01-b42a-44f2-af99-ee0b38fd7744 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:38.612135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadeb01-b42a-44f2-af99-ee0b38fd7744 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:38.613387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faadeb01-b42a-44f2-af99-ee0b38fd7744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:38.615178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faadeb01-b42a-44f2-af99-ee0b38fd7744 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:38.623154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb6beb-99f1-419c-9b55-096fe9ca4f76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:38.625020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb6beb-99f1-419c-9b55-096fe9ca4f76 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:38.632888 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 899/1779] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:38.633958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faadeb01-b42a-44f2-af99-ee0b38fd7744 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:38.657411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faadeb01-b42a-44f2-af99-ee0b38fd7744 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:38.657763 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 881/1780] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:42:38.664026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e76a01-6c25-4880-af39-5564fd73ed8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:38.665510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e76a01-6c25-4880-af39-5564fd73ed8d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:38.666020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e76a01-6c25-4880-af39-5564fd73ed8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:38.666546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e76a01-6c25-4880-af39-5564fd73ed8d admin admin] PATH_INFO: `/v3/projects/01aa86f429f84ffaa83f10edf6fa2f1c/users/8fd9a6eec11e4d9c8315a0a1e2a387f7/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:38.697765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e76a01-6c25-4880-af39-5564fd73ed8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=01aa86f429f84ffaa83f10edf6fa2f1c, user_id=8fd9a6eec11e4d9c8315a0a1e2a387f7, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:38.701969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e76a01-6c25-4880-af39-5564fd73ed8d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:38.741694 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 900/1781] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:38 2022] PUT /identity/v3/projects/01aa86f429f84ffaa83f10edf6fa2f1c/users/8fd9a6eec11e4d9c8315a0a1e2a387f7/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:38.743331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d64b3-b240-4605-88b6-dc90d2b2f275 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:38.743634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d64b3-b240-4605-88b6-dc90d2b2f275 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:38.743901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d64b3-b240-4605-88b6-dc90d2b2f275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:38.821375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-149d64b3-b240-4605-88b6-dc90d2b2f275 None None] MFA Rules not processed for user `8fd9a6eec11e4d9c8315a0a1e2a387f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:38.824979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-149d64b3-b240-4605-88b6-dc90d2b2f275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:38.843086 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:39.037787 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 882/1782] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:42:39.043939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e76a01-6c25-4880-af39-5564fd73ed8d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:39.238167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e76a01-6c25-4880-af39-5564fd73ed8d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:39.244371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c6e2c-c84c-4678-aceb-e5632861cd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:39.246145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c6e2c-c84c-4678-aceb-e5632861cd99 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:39.246605 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c6e2c-c84c-4678-aceb-e5632861cd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:39.247028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c6e2c-c84c-4678-aceb-e5632861cd99 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:39.248744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c6e2c-c84c-4678-aceb-e5632861cd99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:39.250871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c6e2c-c84c-4678-aceb-e5632861cd99 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:39.315546 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 901/1783] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:39 2022] POST /identity/v3/projects => generated 375 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:39.321631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d64b3-b240-4605-88b6-dc90d2b2f275 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:39.340579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d64b3-b240-4605-88b6-dc90d2b2f275 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:39.407453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c6e2c-c84c-4678-aceb-e5632861cd99 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:39.411564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-310c6e2c-c84c-4678-aceb-e5632861cd99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:39.417098 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:39.616882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c6e2c-c84c-4678-aceb-e5632861cd99 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:39.627854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02d469-d8ff-4fe7-bbeb-97b53670f9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:39.628498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02d469-d8ff-4fe7-bbeb-97b53670f9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:39.630873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02d469-d8ff-4fe7-bbeb-97b53670f9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:39.631169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02d469-d8ff-4fe7-bbeb-97b53670f9d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:39.634078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02d469-d8ff-4fe7-bbeb-97b53670f9d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:39.635610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828aabe-eaac-4370-8746-17658b04f8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:39.636835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828aabe-eaac-4370-8746-17658b04f8ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:39.642297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828aabe-eaac-4370-8746-17658b04f8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:39.642838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828aabe-eaac-4370-8746-17658b04f8ba admin admin] PATH_INFO: `/v3/projects/3a7a6717655843f2980cf35bd0067bb0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:39.644338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02d469-d8ff-4fe7-bbeb-97b53670f9d5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:39.658892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828aabe-eaac-4370-8746-17658b04f8ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a7a6717655843f2980cf35bd0067bb0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:39.661193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828aabe-eaac-4370-8746-17658b04f8ba admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:39.707412 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 883/1784] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:39 2022] POST /identity/v3/users => generated 294 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:39.711889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02d469-d8ff-4fe7-bbeb-97b53670f9d5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:39.750575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02d469-d8ff-4fe7-bbeb-97b53670f9d5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:39.767789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618002dc-60e9-415c-b406-36a9bca51d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:39.768523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618002dc-60e9-415c-b406-36a9bca51d8a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:39.768735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618002dc-60e9-415c-b406-36a9bca51d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:39.769010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618002dc-60e9-415c-b406-36a9bca51d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:39.770033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618002dc-60e9-415c-b406-36a9bca51d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:39.786002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618002dc-60e9-415c-b406-36a9bca51d8a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:39.798115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5828aabe-eaac-4370-8746-17658b04f8ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a7a6717655843f2980cf35bd0067bb0', 'request_id': 'req-5828aabe-eaac-4370-8746-17658b04f8ba'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:39.820102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5828aabe-eaac-4370-8746-17658b04f8ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a7a6717655843f2980cf35bd0067bb0', 'request_id': 'req-5828aabe-eaac-4370-8746-17658b04f8ba'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:39.820363 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 884/1785] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:39.821433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618002dc-60e9-415c-b406-36a9bca51d8a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:39.845758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5828aabe-eaac-4370-8746-17658b04f8ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a7a6717655843f2980cf35bd0067bb0', 'request_id': 'req-5828aabe-eaac-4370-8746-17658b04f8ba'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:39.848910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618002dc-60e9-415c-b406-36a9bca51d8a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:39.881870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5828aabe-eaac-4370-8746-17658b04f8ba admin admin] The token cache is being invalidate because project 3a7a6717655843f2980cf35bd0067bb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:42:39.882231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5828aabe-eaac-4370-8746-17658b04f8ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:39.883514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5828aabe-eaac-4370-8746-17658b04f8ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:39.891714 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 902/1786] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:42:39 2022] DELETE /identity/v3/projects/3a7a6717655843f2980cf35bd0067bb0 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:39.893290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e0dd5-fa8a-434d-b916-3d4ef91509b6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:39.893575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e0dd5-fa8a-434d-b916-3d4ef91509b6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:39.893844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e0dd5-fa8a-434d-b916-3d4ef91509b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:39.927737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ea1e0dd5-fa8a-434d-b916-3d4ef91509b6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:39.929175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ea1e0dd5-fa8a-434d-b916-3d4ef91509b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:40.045787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbbcf8-aea1-4625-8593-fe38c008ae15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:40.046423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbbcf8-aea1-4625-8593-fe38c008ae15 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:40.046704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbbcf8-aea1-4625-8593-fe38c008ae15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:40.046987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbbcf8-aea1-4625-8593-fe38c008ae15 admin admin] PATH_INFO: `/v3/projects/b9441dc093da4dd6813eb52600256dc4/users/94762833a059469f851d210245b7bdee/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:40.111059 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 903/1787] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:40.119485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cbbcf8-aea1-4625-8593-fe38c008ae15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9441dc093da4dd6813eb52600256dc4, user_id=94762833a059469f851d210245b7bdee, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:40.120539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3090d9f-4426-49a1-9c7d-813a25f2d7c5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:40.122836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cbbcf8-aea1-4625-8593-fe38c008ae15 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:40.126678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3090d9f-4426-49a1-9c7d-813a25f2d7c5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:40.126986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3090d9f-4426-49a1-9c7d-813a25f2d7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:40.163286 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 885/1788] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:39 2022] PUT /identity/v3/projects/b9441dc093da4dd6813eb52600256dc4/users/94762833a059469f851d210245b7bdee/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:40.169029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbbcf8-aea1-4625-8593-fe38c008ae15 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:40.170621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e3cbbcf8-aea1-4625-8593-fe38c008ae15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:40.175045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a3090d9f-4426-49a1-9c7d-813a25f2d7c5 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:40.176248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a3090d9f-4426-49a1-9c7d-813a25f2d7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:40.194420 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:40.259567 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:40.322195 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 904/1789] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:40.324321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3090d9f-4426-49a1-9c7d-813a25f2d7c5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:40.347492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3090d9f-4426-49a1-9c7d-813a25f2d7c5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:40.352626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbbcf8-aea1-4625-8593-fe38c008ae15 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:40.358849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20787bb4-c6cc-40e0-996c-52df38695c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:40.359409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20787bb4-c6cc-40e0-996c-52df38695c64 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:40.359691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20787bb4-c6cc-40e0-996c-52df38695c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:40.359968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20787bb4-c6cc-40e0-996c-52df38695c64 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:40.360673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20787bb4-c6cc-40e0-996c-52df38695c64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:42:40.360989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20787bb4-c6cc-40e0-996c-52df38695c64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:40.362619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20787bb4-c6cc-40e0-996c-52df38695c64 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:40.369603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496c2b8-c8f3-41bd-adda-24170cf56232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:40.371863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496c2b8-c8f3-41bd-adda-24170cf56232 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:40.372150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496c2b8-c8f3-41bd-adda-24170cf56232 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:40.372419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496c2b8-c8f3-41bd-adda-24170cf56232 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:40.373117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496c2b8-c8f3-41bd-adda-24170cf56232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:40.374750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496c2b8-c8f3-41bd-adda-24170cf56232 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:40.391651 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 905/1790] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:42:40.395542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20787bb4-c6cc-40e0-996c-52df38695c64 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:40.396638 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 886/1791] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:40.402414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496c2b8-c8f3-41bd-adda-24170cf56232 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:40.416471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20787bb4-c6cc-40e0-996c-52df38695c64 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:40.424129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496c2b8-c8f3-41bd-adda-24170cf56232 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:40.427732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293e36b-0a79-4e39-a6fd-7dd526ed38f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:40.428335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293e36b-0a79-4e39-a6fd-7dd526ed38f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:40.428936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293e36b-0a79-4e39-a6fd-7dd526ed38f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:40.429111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293e36b-0a79-4e39-a6fd-7dd526ed38f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:40.429654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293e36b-0a79-4e39-a6fd-7dd526ed38f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:40.431695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293e36b-0a79-4e39-a6fd-7dd526ed38f3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:40.444025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa85bd-3268-4822-b356-39bf589ccacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:40.444727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa85bd-3268-4822-b356-39bf589ccacb admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:40.445012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa85bd-3268-4822-b356-39bf589ccacb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:40.445288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa85bd-3268-4822-b356-39bf589ccacb admin admin] PATH_INFO: `/v3/projects/b9441dc093da4dd6813eb52600256dc4/users/94762833a059469f851d210245b7bdee/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:40.455232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa85bd-3268-4822-b356-39bf589ccacb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9441dc093da4dd6813eb52600256dc4, user_id=94762833a059469f851d210245b7bdee, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:40.459722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa85bd-3268-4822-b356-39bf589ccacb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:40.505277 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 887/1792] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:40 2022] PUT /identity/v3/projects/b9441dc093da4dd6813eb52600256dc4/users/94762833a059469f851d210245b7bdee/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:40.516131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d1855-612c-422b-8e10-537a64715425 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:40.516468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d1855-612c-422b-8e10-537a64715425 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:40.516772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d1855-612c-422b-8e10-537a64715425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:40.543240 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 906/1793] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:40 2022] POST /identity/v3/projects => generated 403 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:40.547848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293e36b-0a79-4e39-a6fd-7dd526ed38f3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:40.597499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-586d1855-612c-422b-8e10-537a64715425 None None] MFA Rules not processed for user `94762833a059469f851d210245b7bdee`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:40.599549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-586d1855-612c-422b-8e10-537a64715425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:40.726491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293e36b-0a79-4e39-a6fd-7dd526ed38f3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:40.743699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37810e3-ce61-45eb-8079-6506d206ae6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:40.746078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37810e3-ce61-45eb-8079-6506d206ae6e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:40.746564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37810e3-ce61-45eb-8079-6506d206ae6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:40.747007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37810e3-ce61-45eb-8079-6506d206ae6e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:40.747828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37810e3-ce61-45eb-8079-6506d206ae6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:40.759701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37810e3-ce61-45eb-8079-6506d206ae6e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:40.772668 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 888/1794] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:40.782511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d1855-612c-422b-8e10-537a64715425 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:40.784700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-586d1855-612c-422b-8e10-537a64715425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:40.804169 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 907/1795] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:40 2022] POST /identity/v3/users => generated 302 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:40.805564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37810e3-ce61-45eb-8079-6506d206ae6e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:40.850201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37810e3-ce61-45eb-8079-6506d206ae6e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:40.871609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a0808-701a-45fd-8d8e-27a465edf990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:40.872684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a0808-701a-45fd-8d8e-27a465edf990 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:40.873606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a0808-701a-45fd-8d8e-27a465edf990 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:40.874523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a0808-701a-45fd-8d8e-27a465edf990 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:40.875515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a0808-701a-45fd-8d8e-27a465edf990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:40.877472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a0808-701a-45fd-8d8e-27a465edf990 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:40.904266 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 908/1796] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:40.910980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a0808-701a-45fd-8d8e-27a465edf990 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:40.944389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a0808-701a-45fd-8d8e-27a465edf990 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:40.954689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648559fe-c338-4790-b54f-61a36901e081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:40.955935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648559fe-c338-4790-b54f-61a36901e081 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:40.956438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648559fe-c338-4790-b54f-61a36901e081 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:40.956959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648559fe-c338-4790-b54f-61a36901e081 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:40.958053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648559fe-c338-4790-b54f-61a36901e081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:40.958460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d1855-612c-422b-8e10-537a64715425 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:40.960477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648559fe-c338-4790-b54f-61a36901e081 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:40.975990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671f961-7bca-4944-8907-81e1b4b1518d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:40.976648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671f961-7bca-4944-8907-81e1b4b1518d service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:40.976946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671f961-7bca-4944-8907-81e1b4b1518d service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:40.977207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671f961-7bca-4944-8907-81e1b4b1518d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:40.989001 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 909/1797] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:40.991246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37929ac2-47f3-4462-9bf2-1911e1c34e53 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:40.991637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37929ac2-47f3-4462-9bf2-1911e1c34e53 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:40.992009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37929ac2-47f3-4462-9bf2-1911e1c34e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:41.001917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671f961-7bca-4944-8907-81e1b4b1518d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:41.004623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671f961-7bca-4944-8907-81e1b4b1518d service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:41.028497 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 889/1798] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:41.030569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-37929ac2-47f3-4462-9bf2-1911e1c34e53 None None] MFA Rules not processed for user `62956fe5a4d44689b2413b132a78351c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:41.031243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671f961-7bca-4944-8907-81e1b4b1518d service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:41.032145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-37929ac2-47f3-4462-9bf2-1911e1c34e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:41.066514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671f961-7bca-4944-8907-81e1b4b1518d service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:41.074512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592362f-3615-49ba-95b4-d4f2485af9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:41.075494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592362f-3615-49ba-95b4-d4f2485af9c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:41.075986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592362f-3615-49ba-95b4-d4f2485af9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:41.076464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592362f-3615-49ba-95b4-d4f2485af9c6 admin admin] PATH_INFO: `/v3/projects/1f071cecb5e34811896fb894691885eb/users/11d9416d751e4587a81977377b1e3c51/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:41.079662 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:41.101525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8592362f-3615-49ba-95b4-d4f2485af9c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f071cecb5e34811896fb894691885eb, user_id=11d9416d751e4587a81977377b1e3c51, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:41.104397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8592362f-3615-49ba-95b4-d4f2485af9c6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:41.129262 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 890/1799] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:41 2022] PUT /identity/v3/projects/1f071cecb5e34811896fb894691885eb/users/11d9416d751e4587a81977377b1e3c51/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:41.134102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592362f-3615-49ba-95b4-d4f2485af9c6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:41.136425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8592362f-3615-49ba-95b4-d4f2485af9c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:41.160838 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:41.180865 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 910/1800] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:40 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:41.180865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a967a-44c8-4bf9-b0d8-642bc840d6a6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:41.180865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a967a-44c8-4bf9-b0d8-642bc840d6a6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:41.180865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a967a-44c8-4bf9-b0d8-642bc840d6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:41.209670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-464a967a-44c8-4bf9-b0d8-642bc840d6a6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:41.211260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-464a967a-44c8-4bf9-b0d8-642bc840d6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:41.242104 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592362f-3615-49ba-95b4-d4f2485af9c6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:41.250855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ba7c3-a1a2-4895-9e55-516953deacda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:41.251512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ba7c3-a1a2-4895-9e55-516953deacda service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:41.251791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ba7c3-a1a2-4895-9e55-516953deacda service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:41.252070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ba7c3-a1a2-4895-9e55-516953deacda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:41.255070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-242ba7c3-a1a2-4895-9e55-516953deacda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:41.295776 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 911/1801] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:41.296759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a967a-44c8-4bf9-b0d8-642bc840d6a6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:41.300480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-464a967a-44c8-4bf9-b0d8-642bc840d6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:41.313881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a967a-44c8-4bf9-b0d8-642bc840d6a6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:41.320806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27117bf6-99aa-438c-b268-cf132a754db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:41.321533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27117bf6-99aa-438c-b268-cf132a754db1 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:41.322174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27117bf6-99aa-438c-b268-cf132a754db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:41.322461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27117bf6-99aa-438c-b268-cf132a754db1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:41.323138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27117bf6-99aa-438c-b268-cf132a754db1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:41.325096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27117bf6-99aa-438c-b268-cf132a754db1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:41.342864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ba7c3-a1a2-4895-9e55-516953deacda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:41.344450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ba7c3-a1a2-4895-9e55-516953deacda service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:41.356238 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 891/1802] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:41.357246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ba7c3-a1a2-4895-9e55-516953deacda service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:41.358642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-242ba7c3-a1a2-4895-9e55-516953deacda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:41.362051 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 912/1803] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:41 2022] POST /identity/v3/projects => generated 403 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:41.363382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27117bf6-99aa-438c-b268-cf132a754db1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:41.458928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27117bf6-99aa-438c-b268-cf132a754db1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:41.469972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ba7c3-a1a2-4895-9e55-516953deacda service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:41.475071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d2f13-9ff2-49b6-b5b3-455fa1b4cb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:41.475844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d2f13-9ff2-49b6-b5b3-455fa1b4cb95 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:41.476223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d2f13-9ff2-49b6-b5b3-455fa1b4cb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:41.476692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d2f13-9ff2-49b6-b5b3-455fa1b4cb95 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:41.477432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d2f13-9ff2-49b6-b5b3-455fa1b4cb95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:41.480296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d2f13-9ff2-49b6-b5b3-455fa1b4cb95 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:41.517059 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 913/1804] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:41 2022] POST /identity/v3/users => generated 308 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:41.518193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d2f13-9ff2-49b6-b5b3-455fa1b4cb95 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:41.530469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d2f13-9ff2-49b6-b5b3-455fa1b4cb95 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:41.535456 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:41.536948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94377ceb-adc9-47a2-869b-32403c6a4377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:41.537756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94377ceb-adc9-47a2-869b-32403c6a4377 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:41.538060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94377ceb-adc9-47a2-869b-32403c6a4377 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:41.538390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94377ceb-adc9-47a2-869b-32403c6a4377 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:41.539042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94377ceb-adc9-47a2-869b-32403c6a4377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:41.540651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94377ceb-adc9-47a2-869b-32403c6a4377 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:41.553328 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 914/1805] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:41.559821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94377ceb-adc9-47a2-869b-32403c6a4377 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:41.573263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe2bd7-e60b-4342-bb41-f405b394b937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:41.573460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94377ceb-adc9-47a2-869b-32403c6a4377 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:41.574452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe2bd7-e60b-4342-bb41-f405b394b937 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:41.574741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe2bd7-e60b-4342-bb41-f405b394b937 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:41.575019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe2bd7-e60b-4342-bb41-f405b394b937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:41.588747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe2bd7-e60b-4342-bb41-f405b394b937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:41.591092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe2bd7-e60b-4342-bb41-f405b394b937 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:41.595687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5149297-d9ed-457d-9eae-8c7dd4b45dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:41.599713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5149297-d9ed-457d-9eae-8c7dd4b45dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:41.600009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5149297-d9ed-457d-9eae-8c7dd4b45dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:41.600510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5149297-d9ed-457d-9eae-8c7dd4b45dc8 admin admin] PATH_INFO: `/v3/projects/786f5598752048378db76c7d27199197/users/2dd21bb1f4894be393a51c8a268dc869/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:41.603458 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 892/1806] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:41.629291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5149297-d9ed-457d-9eae-8c7dd4b45dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=786f5598752048378db76c7d27199197, user_id=2dd21bb1f4894be393a51c8a268dc869, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:41.636989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5149297-d9ed-457d-9eae-8c7dd4b45dc8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:41.668276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe2bd7-e60b-4342-bb41-f405b394b937 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:41.674327 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 915/1807] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:41 2022] PUT /identity/v3/projects/786f5598752048378db76c7d27199197/users/2dd21bb1f4894be393a51c8a268dc869/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:42:41.685695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe2bd7-e60b-4342-bb41-f405b394b937 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:41.698219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5149297-d9ed-457d-9eae-8c7dd4b45dc8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:41.743620 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:41.788702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185268a-89a6-43cf-997b-738693bb1b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:41.790066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185268a-89a6-43cf-997b-738693bb1b7c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:41.790403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185268a-89a6-43cf-997b-738693bb1b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:41.790759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185268a-89a6-43cf-997b-738693bb1b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:41.792516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185268a-89a6-43cf-997b-738693bb1b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:41.794278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5149297-d9ed-457d-9eae-8c7dd4b45dc8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:41.794632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185268a-89a6-43cf-997b-738693bb1b7c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:41.801019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b572ac-08e9-4620-85ea-9d6eceb83046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:41.802476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b572ac-08e9-4620-85ea-9d6eceb83046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:41.802964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b572ac-08e9-4620-85ea-9d6eceb83046 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:41.803495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b572ac-08e9-4620-85ea-9d6eceb83046 admin admin] PATH_INFO: `/v3/users/8fd9a6eec11e4d9c8315a0a1e2a387f7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:41.805195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b572ac-08e9-4620-85ea-9d6eceb83046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fd9a6eec11e4d9c8315a0a1e2a387f7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:41.808669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b572ac-08e9-4620-85ea-9d6eceb83046 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:41.809133 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 893/1808] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:41.814175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185268a-89a6-43cf-997b-738693bb1b7c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:41.830306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185268a-89a6-43cf-997b-738693bb1b7c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:41.839623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d8c91-a3c5-4f3b-9a02-f0bd4eaf8558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:41.840802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d8c91-a3c5-4f3b-9a02-f0bd4eaf8558 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:41.841291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d8c91-a3c5-4f3b-9a02-f0bd4eaf8558 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:41.841912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d8c91-a3c5-4f3b-9a02-f0bd4eaf8558 admin admin] PATH_INFO: `/v3/projects/786f5598752048378db76c7d27199197/users/2dd21bb1f4894be393a51c8a268dc869/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:41.845074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d8c91-a3c5-4f3b-9a02-f0bd4eaf8558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=786f5598752048378db76c7d27199197, user_id=2dd21bb1f4894be393a51c8a268dc869, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:41.850356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d8c91-a3c5-4f3b-9a02-f0bd4eaf8558 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:41.869352 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 894/1809] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:41 2022] PUT /identity/v3/projects/786f5598752048378db76c7d27199197/users/2dd21bb1f4894be393a51c8a268dc869/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:42:41.918884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d5b572ac-08e9-4620-85ea-9d6eceb83046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fd9a6eec11e4d9c8315a0a1e2a387f7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:41.919997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d5b572ac-08e9-4620-85ea-9d6eceb83046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fd9a6eec11e4d9c8315a0a1e2a387f7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:41.936040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d5b572ac-08e9-4620-85ea-9d6eceb83046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fd9a6eec11e4d9c8315a0a1e2a387f7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:41.953399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d5b572ac-08e9-4620-85ea-9d6eceb83046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fd9a6eec11e4d9c8315a0a1e2a387f7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:41.964976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d5b572ac-08e9-4620-85ea-9d6eceb83046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fd9a6eec11e4d9c8315a0a1e2a387f7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:41.973973 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 916/1810] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:42:41 2022] DELETE /identity/v3/users/8fd9a6eec11e4d9c8315a0a1e2a387f7 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:42:41.978388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7718d-16b7-4f9c-9f12-9dba3a24e720 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:41.978671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7718d-16b7-4f9c-9f12-9dba3a24e720 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:41.978949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7718d-16b7-4f9c-9f12-9dba3a24e720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:42.005139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-99c7718d-16b7-4f9c-9f12-9dba3a24e720 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:42.006329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-99c7718d-16b7-4f9c-9f12-9dba3a24e720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:42.106067 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 895/1811] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:42.124510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b572ac-08e9-4620-85ea-9d6eceb83046 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:42.126617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d5b572ac-08e9-4620-85ea-9d6eceb83046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:42.231254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b572ac-08e9-4620-85ea-9d6eceb83046 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:42.239741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e3ce2-3c2a-4cbe-a170-4c998d953d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:42.240991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e3ce2-3c2a-4cbe-a170-4c998d953d14 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:42.241801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e3ce2-3c2a-4cbe-a170-4c998d953d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:42.242606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e3ce2-3c2a-4cbe-a170-4c998d953d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:42.260159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e3ce2-3c2a-4cbe-a170-4c998d953d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:42.264212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e3ce2-3c2a-4cbe-a170-4c998d953d14 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:42.283270 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 917/1812] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:42.675372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7718d-16b7-4f9c-9f12-9dba3a24e720 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:42.676857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-99c7718d-16b7-4f9c-9f12-9dba3a24e720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:42.705392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7718d-16b7-4f9c-9f12-9dba3a24e720 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:42.714065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930b284-eef4-46e3-b210-1a17e19092d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:42.715528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930b284-eef4-46e3-b210-1a17e19092d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:42.715839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930b284-eef4-46e3-b210-1a17e19092d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:42.716406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930b284-eef4-46e3-b210-1a17e19092d1 admin admin] PATH_INFO: `/v3/projects/01aa86f429f84ffaa83f10edf6fa2f1c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:42.717843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930b284-eef4-46e3-b210-1a17e19092d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01aa86f429f84ffaa83f10edf6fa2f1c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:42.719762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930b284-eef4-46e3-b210-1a17e19092d1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:42.790866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0930b284-eef4-46e3-b210-1a17e19092d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01aa86f429f84ffaa83f10edf6fa2f1c', 'request_id': 'req-0930b284-eef4-46e3-b210-1a17e19092d1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:42.804414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0930b284-eef4-46e3-b210-1a17e19092d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01aa86f429f84ffaa83f10edf6fa2f1c', 'request_id': 'req-0930b284-eef4-46e3-b210-1a17e19092d1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:42.807173 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:42.816394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0930b284-eef4-46e3-b210-1a17e19092d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01aa86f429f84ffaa83f10edf6fa2f1c', 'request_id': 'req-0930b284-eef4-46e3-b210-1a17e19092d1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:42.837702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0930b284-eef4-46e3-b210-1a17e19092d1 admin admin] The token cache is being invalidate because project 01aa86f429f84ffaa83f10edf6fa2f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:42:42.838401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0930b284-eef4-46e3-b210-1a17e19092d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:42.839856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0930b284-eef4-46e3-b210-1a17e19092d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:42.842112 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 896/1813] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:42:42 2022] DELETE /identity/v3/projects/01aa86f429f84ffaa83f10edf6fa2f1c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:42.846081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e3ce2-3c2a-4cbe-a170-4c998d953d14 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:42.866440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e3ce2-3c2a-4cbe-a170-4c998d953d14 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:42.947338 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:42.965562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d9504-78a2-4c7a-b278-f9cde1666cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:42.967504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d9504-78a2-4c7a-b278-f9cde1666cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:42.967780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d9504-78a2-4c7a-b278-f9cde1666cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:42.968052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d9504-78a2-4c7a-b278-f9cde1666cf3 admin admin] PATH_INFO: `/v3/users/94762833a059469f851d210245b7bdee` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:42.969402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d9504-78a2-4c7a-b278-f9cde1666cf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94762833a059469f851d210245b7bdee)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:42.971313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d9504-78a2-4c7a-b278-f9cde1666cf3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:43.037591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a59d9504-78a2-4c7a-b278-f9cde1666cf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94762833a059469f851d210245b7bdee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:43.038280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a59d9504-78a2-4c7a-b278-f9cde1666cf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94762833a059469f851d210245b7bdee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:43.050112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a59d9504-78a2-4c7a-b278-f9cde1666cf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94762833a059469f851d210245b7bdee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:43.073709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a59d9504-78a2-4c7a-b278-f9cde1666cf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94762833a059469f851d210245b7bdee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:43.082645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a59d9504-78a2-4c7a-b278-f9cde1666cf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94762833a059469f851d210245b7bdee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:43.101904 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 918/1814] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:42:42 2022] DELETE /identity/v3/users/94762833a059469f851d210245b7bdee => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:44.183612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930b284-eef4-46e3-b210-1a17e19092d1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:44.187603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0930b284-eef4-46e3-b210-1a17e19092d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:44.232925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930b284-eef4-46e3-b210-1a17e19092d1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:44.362236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d3a3a-34b0-4b08-af9b-e2dc4555759c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:44.363723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d3a3a-34b0-4b08-af9b-e2dc4555759c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:44.364130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d3a3a-34b0-4b08-af9b-e2dc4555759c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:44.364502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d3a3a-34b0-4b08-af9b-e2dc4555759c admin admin] PATH_INFO: `/v3/projects/b9441dc093da4dd6813eb52600256dc4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:44.366266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d3a3a-34b0-4b08-af9b-e2dc4555759c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9441dc093da4dd6813eb52600256dc4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:44.368910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d3a3a-34b0-4b08-af9b-e2dc4555759c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:44.445859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9a0d3a3a-34b0-4b08-af9b-e2dc4555759c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9441dc093da4dd6813eb52600256dc4', 'request_id': 'req-9a0d3a3a-34b0-4b08-af9b-e2dc4555759c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:44.454568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9a0d3a3a-34b0-4b08-af9b-e2dc4555759c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9441dc093da4dd6813eb52600256dc4', 'request_id': 'req-9a0d3a3a-34b0-4b08-af9b-e2dc4555759c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:44.462700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9a0d3a3a-34b0-4b08-af9b-e2dc4555759c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9441dc093da4dd6813eb52600256dc4', 'request_id': 'req-9a0d3a3a-34b0-4b08-af9b-e2dc4555759c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:44.478781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9a0d3a3a-34b0-4b08-af9b-e2dc4555759c admin admin] The token cache is being invalidate because project b9441dc093da4dd6813eb52600256dc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:42:44.479633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9a0d3a3a-34b0-4b08-af9b-e2dc4555759c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:44.480286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9a0d3a3a-34b0-4b08-af9b-e2dc4555759c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:42:44.482181 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 897/1815] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:42:44 2022] DELETE /identity/v3/projects/b9441dc093da4dd6813eb52600256dc4 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:44.487375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac34448-3834-4dd7-875b-ffc7752b745f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:44.487820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac34448-3834-4dd7-875b-ffc7752b745f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:44.488048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac34448-3834-4dd7-875b-ffc7752b745f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:44.519975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fac34448-3834-4dd7-875b-ffc7752b745f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:44.521653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fac34448-3834-4dd7-875b-ffc7752b745f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:44.630902 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 919/1816] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:44.639861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b2de6-679a-422e-b312-2644b5da84c8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:44.639861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b2de6-679a-422e-b312-2644b5da84c8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:44.640421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b2de6-679a-422e-b312-2644b5da84c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:44.667657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b28b2de6-679a-422e-b312-2644b5da84c8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:44.668993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b28b2de6-679a-422e-b312-2644b5da84c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:44.687011 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 898/1817] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:44.695504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac34448-3834-4dd7-875b-ffc7752b745f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:44.710248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac34448-3834-4dd7-875b-ffc7752b745f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:44.717965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26d696-949b-4675-8a0c-083b6049bf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:44.720258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26d696-949b-4675-8a0c-083b6049bf22 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:44.720822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26d696-949b-4675-8a0c-083b6049bf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:44.721281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26d696-949b-4675-8a0c-083b6049bf22 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:44.722154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26d696-949b-4675-8a0c-083b6049bf22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:42:44.722648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26d696-949b-4675-8a0c-083b6049bf22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:44.724680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26d696-949b-4675-8a0c-083b6049bf22 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:44.749937 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 920/1818] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:42:44.755074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b2de6-679a-422e-b312-2644b5da84c8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:44.769160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b2de6-679a-422e-b312-2644b5da84c8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:44.775714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681a6e4-e29a-49ab-b668-a92bf6007999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:44.777191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681a6e4-e29a-49ab-b668-a92bf6007999 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:44.777664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681a6e4-e29a-49ab-b668-a92bf6007999 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:44.778376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681a6e4-e29a-49ab-b668-a92bf6007999 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:44.779937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681a6e4-e29a-49ab-b668-a92bf6007999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:44.782081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681a6e4-e29a-49ab-b668-a92bf6007999 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:44.859122 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 899/1819] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:44 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:44.859315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26d696-949b-4675-8a0c-083b6049bf22 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:44.872740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26d696-949b-4675-8a0c-083b6049bf22 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:44.981632 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:45.003142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26274c9b-2541-494c-a1c9-791384bac13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:45.005270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26274c9b-2541-494c-a1c9-791384bac13e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:45.005571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26274c9b-2541-494c-a1c9-791384bac13e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:45.005841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26274c9b-2541-494c-a1c9-791384bac13e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:45.006494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26274c9b-2541-494c-a1c9-791384bac13e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:45.008419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26274c9b-2541-494c-a1c9-791384bac13e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:45.048665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681a6e4-e29a-49ab-b668-a92bf6007999 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:45.056970 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 921/1820] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:44 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:42:45.069610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681a6e4-e29a-49ab-b668-a92bf6007999 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:45.085698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fb12a-121e-4305-aeee-ffca45b2acac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:45.087612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fb12a-121e-4305-aeee-ffca45b2acac admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:45.087889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fb12a-121e-4305-aeee-ffca45b2acac admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:45.089308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fb12a-121e-4305-aeee-ffca45b2acac admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:45.090426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fb12a-121e-4305-aeee-ffca45b2acac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:45.095796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fb12a-121e-4305-aeee-ffca45b2acac admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:45.122510 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 900/1821] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:42:45.126665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26274c9b-2541-494c-a1c9-791384bac13e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:45.141800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26274c9b-2541-494c-a1c9-791384bac13e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:45.150571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4b29d-af13-417d-92da-9e4396a54f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:45.153191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4b29d-af13-417d-92da-9e4396a54f5a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:45.153583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4b29d-af13-417d-92da-9e4396a54f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:45.154414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4b29d-af13-417d-92da-9e4396a54f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:45.155280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4b29d-af13-417d-92da-9e4396a54f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:45.157376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4b29d-af13-417d-92da-9e4396a54f5a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:45.187768 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 922/1822] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:45.189014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fb12a-121e-4305-aeee-ffca45b2acac admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:45.203903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fb12a-121e-4305-aeee-ffca45b2acac admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:45.222769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dd079-7c8b-4f71-b52f-b61ed0db12c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:45.223175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dd079-7c8b-4f71-b52f-b61ed0db12c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:45.223458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dd079-7c8b-4f71-b52f-b61ed0db12c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:45.224437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dd079-7c8b-4f71-b52f-b61ed0db12c4 admin admin] PATH_INFO: `/v3/projects/bf5fd568163342f09d7d60e01ffd65aa/users/22e55fa3cbc34ea19c099f2859dd7ab5/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:45.256019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120dd079-7c8b-4f71-b52f-b61ed0db12c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf5fd568163342f09d7d60e01ffd65aa, user_id=22e55fa3cbc34ea19c099f2859dd7ab5, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:45.259611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120dd079-7c8b-4f71-b52f-b61ed0db12c4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:45.307256 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 901/1823] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:45 2022] PUT /identity/v3/projects/bf5fd568163342f09d7d60e01ffd65aa/users/22e55fa3cbc34ea19c099f2859dd7ab5/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:45.320472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0654c9b-8f0e-4eb6-b434-fe843fc94fa9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:45.320836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0654c9b-8f0e-4eb6-b434-fe843fc94fa9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:45.321056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0654c9b-8f0e-4eb6-b434-fe843fc94fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:45.405338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a0654c9b-8f0e-4eb6-b434-fe843fc94fa9 None None] MFA Rules not processed for user `22e55fa3cbc34ea19c099f2859dd7ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:45.409187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a0654c9b-8f0e-4eb6-b434-fe843fc94fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:45.529263 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 923/1824] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:45.533346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dd079-7c8b-4f71-b52f-b61ed0db12c4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:45.554176 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:45.683490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dd079-7c8b-4f71-b52f-b61ed0db12c4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:45.694163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8f9a8-f783-43d1-963e-977ce27a643d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:45.695081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8f9a8-f783-43d1-963e-977ce27a643d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:45.695503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8f9a8-f783-43d1-963e-977ce27a643d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:45.695880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8f9a8-f783-43d1-963e-977ce27a643d admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:45.697253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8f9a8-f783-43d1-963e-977ce27a643d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:45.702333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8f9a8-f783-43d1-963e-977ce27a643d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:45.775576 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 902/1825] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:45 2022] POST /identity/v3/projects => generated 373 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:45.780484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0654c9b-8f0e-4eb6-b434-fe843fc94fa9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:45.796204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0654c9b-8f0e-4eb6-b434-fe843fc94fa9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:45.973489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fca37-ecf8-49ac-aff1-9a2c018c5453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:45.978746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fca37-ecf8-49ac-aff1-9a2c018c5453 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:45.980287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fca37-ecf8-49ac-aff1-9a2c018c5453 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:45.981597 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fca37-ecf8-49ac-aff1-9a2c018c5453 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:45.993545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fca37-ecf8-49ac-aff1-9a2c018c5453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:46.005750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fca37-ecf8-49ac-aff1-9a2c018c5453 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:46.100061 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 924/1826] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:45 2022] POST /identity/v3/users => generated 293 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:46.103117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8f9a8-f783-43d1-963e-977ce27a643d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:46.162736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8f9a8-f783-43d1-963e-977ce27a643d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:46.190223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd284029-eaab-4f38-9d18-9c057b48e2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:46.190919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd284029-eaab-4f38-9d18-9c057b48e2eb admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:46.191203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd284029-eaab-4f38-9d18-9c057b48e2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:46.191472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd284029-eaab-4f38-9d18-9c057b48e2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:46.192196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd284029-eaab-4f38-9d18-9c057b48e2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:46.193824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd284029-eaab-4f38-9d18-9c057b48e2eb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:46.211126 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 903/1827] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:46.212441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fca37-ecf8-49ac-aff1-9a2c018c5453 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:46.224807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fca37-ecf8-49ac-aff1-9a2c018c5453 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:46.232421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fbc34-db09-49b9-bd4b-7e78afc90af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:46.233192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fbc34-db09-49b9-bd4b-7e78afc90af0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:46.233471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fbc34-db09-49b9-bd4b-7e78afc90af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:46.233743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fbc34-db09-49b9-bd4b-7e78afc90af0 admin admin] PATH_INFO: `/v3/projects/3f131a57649f410380d5e4e9ac51bd28/users/56aa8cc730e9434399e2a86196d2cf32/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:46.275815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fbc34-db09-49b9-bd4b-7e78afc90af0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f131a57649f410380d5e4e9ac51bd28, user_id=56aa8cc730e9434399e2a86196d2cf32, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:46.280357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fbc34-db09-49b9-bd4b-7e78afc90af0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:46.317679 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 925/1828] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:46 2022] PUT /identity/v3/projects/3f131a57649f410380d5e4e9ac51bd28/users/56aa8cc730e9434399e2a86196d2cf32/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:46.322153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd284029-eaab-4f38-9d18-9c057b48e2eb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:46.335350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd284029-eaab-4f38-9d18-9c057b48e2eb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:46.492954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0ab75-1226-41a2-9318-f64c1f17ff16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:46.493591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0ab75-1226-41a2-9318-f64c1f17ff16 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:46.493869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0ab75-1226-41a2-9318-f64c1f17ff16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:46.494137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0ab75-1226-41a2-9318-f64c1f17ff16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:46.495318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0ab75-1226-41a2-9318-f64c1f17ff16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:46.499678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0ab75-1226-41a2-9318-f64c1f17ff16 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:46.531118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fbc34-db09-49b9-bd4b-7e78afc90af0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:46.534030 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 904/1829] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:46.544810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fbc34-db09-49b9-bd4b-7e78afc90af0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:46.549660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c71b0-514d-4a6e-bab0-e618abd054a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:46.550482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c71b0-514d-4a6e-bab0-e618abd054a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:46.550772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c71b0-514d-4a6e-bab0-e618abd054a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:46.551037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c71b0-514d-4a6e-bab0-e618abd054a9 admin admin] PATH_INFO: `/v3/projects/3f131a57649f410380d5e4e9ac51bd28/users/56aa8cc730e9434399e2a86196d2cf32/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:46.553036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c71b0-514d-4a6e-bab0-e618abd054a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f131a57649f410380d5e4e9ac51bd28, user_id=56aa8cc730e9434399e2a86196d2cf32, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:46.557721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c71b0-514d-4a6e-bab0-e618abd054a9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:46.586651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe1dd2-ef4d-4b66-a407-c85d1b8db815 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:46.586946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe1dd2-ef4d-4b66-a407-c85d1b8db815 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:46.587225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe1dd2-ef4d-4b66-a407-c85d1b8db815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:46.590218 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 926/1830] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:46 2022] PUT /identity/v3/projects/3f131a57649f410380d5e4e9ac51bd28/users/56aa8cc730e9434399e2a86196d2cf32/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:42:46.624506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-aafe1dd2-ef4d-4b66-a407-c85d1b8db815 None None] MFA Rules not processed for user `56aa8cc730e9434399e2a86196d2cf32`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:46.628279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aafe1dd2-ef4d-4b66-a407-c85d1b8db815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:46.747252 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 905/1831] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:46.758868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b471e-0310-4bee-aafd-9d2db89d7ccf None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:46.759208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b471e-0310-4bee-aafd-9d2db89d7ccf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:46.759481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b471e-0310-4bee-aafd-9d2db89d7ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:46.783708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5f9b471e-0310-4bee-aafd-9d2db89d7ccf None None] MFA Rules not processed for user `22e55fa3cbc34ea19c099f2859dd7ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:46.785056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5f9b471e-0310-4bee-aafd-9d2db89d7ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:46.801874 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:46.888073 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 927/1832] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:47.066038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe1dd2-ef4d-4b66-a407-c85d1b8db815 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:47.068677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aafe1dd2-ef4d-4b66-a407-c85d1b8db815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:47.083579 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:47.247929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe1dd2-ef4d-4b66-a407-c85d1b8db815 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:47.267985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e7b17-3115-433a-9418-e69ce91a52dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:47.268510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e7b17-3115-433a-9418-e69ce91a52dd service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:47.268801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e7b17-3115-433a-9418-e69ce91a52dd service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:47.269069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e7b17-3115-433a-9418-e69ce91a52dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:47.286724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e7b17-3115-433a-9418-e69ce91a52dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:47.288262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e7b17-3115-433a-9418-e69ce91a52dd service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:47.317121 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 906/1833] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:50.033066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697bc0e-3a04-4820-9c08-8ab285cc2c97 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:50.033659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697bc0e-3a04-4820-9c08-8ab285cc2c97 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:50.036353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697bc0e-3a04-4820-9c08-8ab285cc2c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:50.179050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d697bc0e-3a04-4820-9c08-8ab285cc2c97 None None] MFA Rules not processed for user `11d9416d751e4587a81977377b1e3c51`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:50.180729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d697bc0e-3a04-4820-9c08-8ab285cc2c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:50.302172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e7b17-3115-433a-9418-e69ce91a52dd service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:50.303375 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 928/1834] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:50 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:50.304152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-466e7b17-3115-433a-9418-e69ce91a52dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:50.384695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e7b17-3115-433a-9418-e69ce91a52dd service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:50.392216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa26f4-a22a-4590-8d67-1a633788cae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:50.393189 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa26f4-a22a-4590-8d67-1a633788cae0 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:50.393683 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa26f4-a22a-4590-8d67-1a633788cae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:50.394157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa26f4-a22a-4590-8d67-1a633788cae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:50.395033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa26f4-a22a-4590-8d67-1a633788cae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:50.397204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa26f4-a22a-4590-8d67-1a633788cae0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:50.438896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697bc0e-3a04-4820-9c08-8ab285cc2c97 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:50.445519 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 907/1835] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:42:50 2022] POST /identity/v3/projects => generated 405 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:42:50.467942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697bc0e-3a04-4820-9c08-8ab285cc2c97 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:50.639434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd4fa2-08b2-4f1d-9840-9071e42bf677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:50.640086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd4fa2-08b2-4f1d-9840-9071e42bf677 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:50.640373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd4fa2-08b2-4f1d-9840-9071e42bf677 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:50.640692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd4fa2-08b2-4f1d-9840-9071e42bf677 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:50.641327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd4fa2-08b2-4f1d-9840-9071e42bf677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:50.643627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd4fa2-08b2-4f1d-9840-9071e42bf677 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:50.692140 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 929/1836] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:42:50 2022] POST /identity/v3/users => generated 309 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:42:50.694471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa26f4-a22a-4590-8d67-1a633788cae0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:50.713068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa26f4-a22a-4590-8d67-1a633788cae0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:50.730817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26faf4fb-2d5d-4109-9380-08f691bb1eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:50.731686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26faf4fb-2d5d-4109-9380-08f691bb1eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:50.732249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26faf4fb-2d5d-4109-9380-08f691bb1eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:50.732846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26faf4fb-2d5d-4109-9380-08f691bb1eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:50.733616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26faf4fb-2d5d-4109-9380-08f691bb1eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:50.737251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26faf4fb-2d5d-4109-9380-08f691bb1eb4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:50.745038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723972d-77c0-4743-a29f-1b0ab0e4efca None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:50.745400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723972d-77c0-4743-a29f-1b0ab0e4efca None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:50.745631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723972d-77c0-4743-a29f-1b0ab0e4efca None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:50.747744 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 930/1837] 10.222.0.16 () {54 vars in 921 bytes} [Fri Sep 30 09:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:42:50.771115 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 908/1838] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:50.772225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26faf4fb-2d5d-4109-9380-08f691bb1eb4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:50.773532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9083596-94c9-47ac-83ef-ee87dcfd5f8a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:50.775288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9083596-94c9-47ac-83ef-ee87dcfd5f8a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:50.775691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9083596-94c9-47ac-83ef-ee87dcfd5f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:50.798273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26faf4fb-2d5d-4109-9380-08f691bb1eb4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:50.826331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f9083596-94c9-47ac-83ef-ee87dcfd5f8a None None] MFA Rules not processed for user `aa607111024540d1a09b01dfd1e5e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:50.827590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f9083596-94c9-47ac-83ef-ee87dcfd5f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:50.828758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10c229-5ef3-40dd-af53-4d8cc7e05e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:50.829731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10c229-5ef3-40dd-af53-4d8cc7e05e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:50.832036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10c229-5ef3-40dd-af53-4d8cc7e05e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:50.832518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10c229-5ef3-40dd-af53-4d8cc7e05e2a admin admin] PATH_INFO: `/v3/projects/b3c4864673594d77a3532b511b97d598/users/74aa1c64074c41c7a1fd2dd752df2688/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:50.878601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10c229-5ef3-40dd-af53-4d8cc7e05e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c4864673594d77a3532b511b97d598, user_id=74aa1c64074c41c7a1fd2dd752df2688, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:50.882058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10c229-5ef3-40dd-af53-4d8cc7e05e2a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:50.929098 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:50.952402 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 909/1839] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:50 2022] PUT /identity/v3/projects/b3c4864673594d77a3532b511b97d598/users/74aa1c64074c41c7a1fd2dd752df2688/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:50.963101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10c229-5ef3-40dd-af53-4d8cc7e05e2a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:51.001516 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 931/1840] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 09:42:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:51.029968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9083596-94c9-47ac-83ef-ee87dcfd5f8a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:51.050171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9083596-94c9-47ac-83ef-ee87dcfd5f8a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:51.094531 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:51.173100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10c229-5ef3-40dd-af53-4d8cc7e05e2a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:51.192526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25396c75-5bea-49e0-9d94-e147493b9efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:51.193663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25396c75-5bea-49e0-9d94-e147493b9efb admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:51.193663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25396c75-5bea-49e0-9d94-e147493b9efb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:51.193853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25396c75-5bea-49e0-9d94-e147493b9efb admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:51.194530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25396c75-5bea-49e0-9d94-e147493b9efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:51.196027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25396c75-5bea-49e0-9d94-e147493b9efb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:51.239652 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 910/1841] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:42:51.241387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25396c75-5bea-49e0-9d94-e147493b9efb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:51.269196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25396c75-5bea-49e0-9d94-e147493b9efb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:51.270068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fb690-ef9f-4079-bfd3-16a9956e02f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:51.270872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fb690-ef9f-4079-bfd3-16a9956e02f9 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:51.271331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fb690-ef9f-4079-bfd3-16a9956e02f9 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:51.271752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fb690-ef9f-4079-bfd3-16a9956e02f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:51.283330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de5760-4886-43a5-9115-90ae5d6157dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:51.284014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de5760-4886-43a5-9115-90ae5d6157dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:51.284290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de5760-4886-43a5-9115-90ae5d6157dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:51.284562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de5760-4886-43a5-9115-90ae5d6157dd admin admin] PATH_INFO: `/v3/projects/b3c4864673594d77a3532b511b97d598/users/74aa1c64074c41c7a1fd2dd752df2688/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:51.289241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de5760-4886-43a5-9115-90ae5d6157dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c4864673594d77a3532b511b97d598, user_id=74aa1c64074c41c7a1fd2dd752df2688, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:51.292585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de5760-4886-43a5-9115-90ae5d6157dd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:51.296143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480fb690-ef9f-4079-bfd3-16a9956e02f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:51.300369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480fb690-ef9f-4079-bfd3-16a9956e02f9 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:51.318327 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 911/1842] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:42:51 2022] PUT /identity/v3/projects/b3c4864673594d77a3532b511b97d598/users/74aa1c64074c41c7a1fd2dd752df2688/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:42:51.326764 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 932/1843] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:42:51.917157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde27ce-b9a8-41ae-9c31-37de30044edb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:51.917689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde27ce-b9a8-41ae-9c31-37de30044edb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:51.918230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde27ce-b9a8-41ae-9c31-37de30044edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:51.974036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dfde27ce-b9a8-41ae-9c31-37de30044edb None None] MFA Rules not processed for user `2dd21bb1f4894be393a51c8a268dc869`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:51.975341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dfde27ce-b9a8-41ae-9c31-37de30044edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:52.132227 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 912/1844] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:51 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:52.141675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fb690-ef9f-4079-bfd3-16a9956e02f9 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:52.157843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fb690-ef9f-4079-bfd3-16a9956e02f9 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:52.335219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48803b41-80a1-44ad-9502-13669f7482ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:52.336107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48803b41-80a1-44ad-9502-13669f7482ce service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:52.336472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48803b41-80a1-44ad-9502-13669f7482ce service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:52.336776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48803b41-80a1-44ad-9502-13669f7482ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:52.342306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-48803b41-80a1-44ad-9502-13669f7482ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:52.522033 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:42:52.533594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48803b41-80a1-44ad-9502-13669f7482ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:52.536440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48803b41-80a1-44ad-9502-13669f7482ce service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:52.563607 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 933/1845] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:52 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:52.610764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde27ce-b9a8-41ae-9c31-37de30044edb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:52.649468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde27ce-b9a8-41ae-9c31-37de30044edb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:52.674704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfed60-b892-4bf6-aa97-9adac2caf73f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:52.675437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfed60-b892-4bf6-aa97-9adac2caf73f service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:52.675717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfed60-b892-4bf6-aa97-9adac2caf73f service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:52.676252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfed60-b892-4bf6-aa97-9adac2caf73f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:52.711124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfed60-b892-4bf6-aa97-9adac2caf73f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:52.715905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfed60-b892-4bf6-aa97-9adac2caf73f service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:52.756712 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 913/1846] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:52 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:55.945588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79441c18-e3e8-43c6-92d5-917ca8517396 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:55.946130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79441c18-e3e8-43c6-92d5-917ca8517396 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:55.946130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79441c18-e3e8-43c6-92d5-917ca8517396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:55.979777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-79441c18-e3e8-43c6-92d5-917ca8517396 None None] MFA Rules not processed for user `62956fe5a4d44689b2413b132a78351c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:55.981685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-79441c18-e3e8-43c6-92d5-917ca8517396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:55.990540 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 934/1847] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:42:55 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:56.366439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfed60-b892-4bf6-aa97-9adac2caf73f service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:56.370470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-accfed60-b892-4bf6-aa97-9adac2caf73f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:56.388044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfed60-b892-4bf6-aa97-9adac2caf73f service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:56.399487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdf771-2be5-42d2-905b-5773a684fa05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:56.400129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdf771-2be5-42d2-905b-5773a684fa05 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:56.401059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdf771-2be5-42d2-905b-5773a684fa05 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:56.401227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdf771-2be5-42d2-905b-5773a684fa05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:56.423265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d4bdf771-2be5-42d2-905b-5773a684fa05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:56.515638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdf771-2be5-42d2-905b-5773a684fa05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:56.517356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdf771-2be5-42d2-905b-5773a684fa05 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:56.527542 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 914/1848] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:56 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:56.801788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f86315-064b-4dc1-89d9-a970a240b7ec None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:56.802347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f86315-064b-4dc1-89d9-a970a240b7ec None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:56.803090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f86315-064b-4dc1-89d9-a970a240b7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:56.849926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-78f86315-064b-4dc1-89d9-a970a240b7ec None None] MFA Rules not processed for user `a9b0fd833b134a089433cd2985caba80`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:56.851409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-78f86315-064b-4dc1-89d9-a970a240b7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:56.957303 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 935/1849] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:42:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:56.996628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdf771-2be5-42d2-905b-5773a684fa05 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:56.998569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d4bdf771-2be5-42d2-905b-5773a684fa05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:57.015977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdf771-2be5-42d2-905b-5773a684fa05 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:57.023701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42f26c-c7d2-4fc9-9c08-ac63a5069e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:57.024357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42f26c-c7d2-4fc9-9c08-ac63a5069e21 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:57.026440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42f26c-c7d2-4fc9-9c08-ac63a5069e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:57.026760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42f26c-c7d2-4fc9-9c08-ac63a5069e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:57.039626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42f26c-c7d2-4fc9-9c08-ac63a5069e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:57.042082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42f26c-c7d2-4fc9-9c08-ac63a5069e21 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:57.051909 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 915/1850] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:42:58.459842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ab1b3-2db3-4072-8cca-afdc4a339eab None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:58.460372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ab1b3-2db3-4072-8cca-afdc4a339eab None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:58.460372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ab1b3-2db3-4072-8cca-afdc4a339eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:58.520031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b35ab1b3-2db3-4072-8cca-afdc4a339eab None None] MFA Rules not processed for user `a9b0fd833b134a089433cd2985caba80`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:42:58.521711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b35ab1b3-2db3-4072-8cca-afdc4a339eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:58.531619 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 936/1851] 10.222.0.45 () {58 vars in 1015 bytes} [Fri Sep 30 09:42:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:42:58.553740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42f26c-c7d2-4fc9-9c08-ac63a5069e21 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:42:58.555263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5a42f26c-c7d2-4fc9-9c08-ac63a5069e21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:42:58.579935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42f26c-c7d2-4fc9-9c08-ac63a5069e21 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:42:58.596263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816c611-8b6a-4389-9982-61fde683e5e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:42:58.597197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816c611-8b6a-4389-9982-61fde683e5e1 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:42:58.597627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816c611-8b6a-4389-9982-61fde683e5e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:42:58.598043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816c611-8b6a-4389-9982-61fde683e5e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:42:58.618886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816c611-8b6a-4389-9982-61fde683e5e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:42:58.622009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816c611-8b6a-4389-9982-61fde683e5e1 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:42:58.636298 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 916/1852] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:42:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:01.735845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc7a6c-16d3-47cd-8004-54cab25c4fe1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:01.736327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc7a6c-16d3-47cd-8004-54cab25c4fe1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:01.736418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc7a6c-16d3-47cd-8004-54cab25c4fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:01.775789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cbbc7a6c-16d3-47cd-8004-54cab25c4fe1 None None] MFA Rules not processed for user `30cb31b44aeb4d64b0c24db25ebe4cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:01.777556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cbbc7a6c-16d3-47cd-8004-54cab25c4fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:01.902430 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 937/1853] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:02.248679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42265d5a-2d21-4eb0-a70e-bb633768a8cb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:02.249110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42265d5a-2d21-4eb0-a70e-bb633768a8cb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:02.249202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42265d5a-2d21-4eb0-a70e-bb633768a8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:02.262278 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:02.288313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-42265d5a-2d21-4eb0-a70e-bb633768a8cb None None] MFA Rules not processed for user `74aa1c64074c41c7a1fd2dd752df2688`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:02.289725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-42265d5a-2d21-4eb0-a70e-bb633768a8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:02.388323 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 917/1854] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:02 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:03.661937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f87af5-a945-49d0-ac31-dc5d3989f467 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:03.662493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f87af5-a945-49d0-ac31-dc5d3989f467 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:03.662632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f87af5-a945-49d0-ac31-dc5d3989f467 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:03.664229 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 938/1855] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:43:03.672149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6da5-aba8-430e-ac4e-0aa169fa590c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:03.672791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6da5-aba8-430e-ac4e-0aa169fa590c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:03.673106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6da5-aba8-430e-ac4e-0aa169fa590c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:03.696808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5ffe6da5-aba8-430e-ac4e-0aa169fa590c None None] MFA Rules not processed for user `cbb22d0675bc4ca893b0477cebd470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:03.699145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5ffe6da5-aba8-430e-ac4e-0aa169fa590c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:03.833740 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 918/1856] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:43:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:03.871835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f87af5-a945-49d0-ac31-dc5d3989f467 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:03.876136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d8f87af5-a945-49d0-ac31-dc5d3989f467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:03.903273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f87af5-a945-49d0-ac31-dc5d3989f467 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:03.915310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804c212-59e7-401f-a0b9-30fe5501f4f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:03.916877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804c212-59e7-401f-a0b9-30fe5501f4f5 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:03.917480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804c212-59e7-401f-a0b9-30fe5501f4f5 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:03.917938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804c212-59e7-401f-a0b9-30fe5501f4f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:03.931177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804c212-59e7-401f-a0b9-30fe5501f4f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:03.933907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804c212-59e7-401f-a0b9-30fe5501f4f5 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:03.949637 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 939/1857] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:07.934064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe6da5-aba8-430e-ac4e-0aa169fa590c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:07.936222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5ffe6da5-aba8-430e-ac4e-0aa169fa590c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:08.199407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe6da5-aba8-430e-ac4e-0aa169fa590c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:08.204399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87930c6e-138d-464a-9b17-351f1d28ba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:08.205193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87930c6e-138d-464a-9b17-351f1d28ba65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:08.205734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87930c6e-138d-464a-9b17-351f1d28ba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:08.206009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87930c6e-138d-464a-9b17-351f1d28ba65 admin admin] PATH_INFO: `/v3/users/5e41424deb9044f782b8aacba3c5cc95` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:08.207159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87930c6e-138d-464a-9b17-351f1d28ba65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e41424deb9044f782b8aacba3c5cc95)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:08.209604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87930c6e-138d-464a-9b17-351f1d28ba65 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:08.260450 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:08.320744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-87930c6e-138d-464a-9b17-351f1d28ba65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e41424deb9044f782b8aacba3c5cc95'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:08.357629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-87930c6e-138d-464a-9b17-351f1d28ba65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e41424deb9044f782b8aacba3c5cc95'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:08.359361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-87930c6e-138d-464a-9b17-351f1d28ba65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e41424deb9044f782b8aacba3c5cc95'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:08.405933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-87930c6e-138d-464a-9b17-351f1d28ba65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e41424deb9044f782b8aacba3c5cc95'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:08.424077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-87930c6e-138d-464a-9b17-351f1d28ba65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e41424deb9044f782b8aacba3c5cc95'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:08.435301 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 919/1858] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:07 2022] DELETE /identity/v3/users/5e41424deb9044f782b8aacba3c5cc95 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:08.437226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74ab8e-2335-4e2c-94cd-7254b7a4803d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:08.438236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74ab8e-2335-4e2c-94cd-7254b7a4803d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:08.438826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74ab8e-2335-4e2c-94cd-7254b7a4803d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:08.480693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4d74ab8e-2335-4e2c-94cd-7254b7a4803d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:08.482123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4d74ab8e-2335-4e2c-94cd-7254b7a4803d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:08.593057 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 940/1859] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:08.617740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87930c6e-138d-464a-9b17-351f1d28ba65 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:08.619562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-87930c6e-138d-464a-9b17-351f1d28ba65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:08.721790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d46008-6303-48fe-a359-5a4d0e8887ae None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:08.721978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d46008-6303-48fe-a359-5a4d0e8887ae None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:08.722263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d46008-6303-48fe-a359-5a4d0e8887ae None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:08.722819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87930c6e-138d-464a-9b17-351f1d28ba65 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:08.723864 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 941/1860] 10.222.0.16 () {54 vars in 921 bytes} [Fri Sep 30 09:43:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:43:08.728339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951a60b-ce42-4725-8157-11549b74a52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:08.730376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951a60b-ce42-4725-8157-11549b74a52e service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:08.730780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951a60b-ce42-4725-8157-11549b74a52e service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:08.731166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951a60b-ce42-4725-8157-11549b74a52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:08.746869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951a60b-ce42-4725-8157-11549b74a52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:08.748691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951a60b-ce42-4725-8157-11549b74a52e service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:08.772364 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 920/1861] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:09.021419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3d8c1-bf52-4d16-8489-a007f869d370 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:09.021887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3d8c1-bf52-4d16-8489-a007f869d370 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:09.022244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3d8c1-bf52-4d16-8489-a007f869d370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:09.079447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7cb3d8c1-bf52-4d16-8489-a007f869d370 None None] MFA Rules not processed for user `cbb22d0675bc4ca893b0477cebd470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:09.085079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7cb3d8c1-bf52-4d16-8489-a007f869d370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:09.129630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951a60b-ce42-4725-8157-11549b74a52e service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:09.132474 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:09.134792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e951a60b-ce42-4725-8157-11549b74a52e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:09.256994 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 942/1862] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 09:43:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:09.264534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951a60b-ce42-4725-8157-11549b74a52e service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:09.273235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a75ad4-9871-42ed-a9de-c10891d53207 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:09.274411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a75ad4-9871-42ed-a9de-c10891d53207 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:09.274693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a75ad4-9871-42ed-a9de-c10891d53207 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:09.275888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a75ad4-9871-42ed-a9de-c10891d53207 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:09.278252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-84a75ad4-9871-42ed-a9de-c10891d53207 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:09.279011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3d8c1-bf52-4d16-8489-a007f869d370 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:09.280560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7cb3d8c1-bf52-4d16-8489-a007f869d370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:09.299969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3d8c1-bf52-4d16-8489-a007f869d370 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:09.306260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa146eb-c766-4694-b93c-eee86aacfec8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:09.307563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa146eb-c766-4694-b93c-eee86aacfec8 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:09.308001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa146eb-c766-4694-b93c-eee86aacfec8 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:09.308962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa146eb-c766-4694-b93c-eee86aacfec8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:09.320582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa146eb-c766-4694-b93c-eee86aacfec8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:09.324221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa146eb-c766-4694-b93c-eee86aacfec8 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:09.350967 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 943/1863] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:43:09.357145 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:09.379408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a75ad4-9871-42ed-a9de-c10891d53207 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:09.381763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a75ad4-9871-42ed-a9de-c10891d53207 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:09.392408 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 921/1864] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:09 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:43:09.880911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa146eb-c766-4694-b93c-eee86aacfec8 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:09.882383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-caa146eb-c766-4694-b93c-eee86aacfec8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:09.908625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa146eb-c766-4694-b93c-eee86aacfec8 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:09.925614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6024002-e75e-4c03-8d8f-f0f4cb9da72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:09.926585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6024002-e75e-4c03-8d8f-f0f4cb9da72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:09.927015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6024002-e75e-4c03-8d8f-f0f4cb9da72d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:09.928111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6024002-e75e-4c03-8d8f-f0f4cb9da72d admin admin] PATH_INFO: `/v3/projects/9dc05d03adbd411582d529b168ec7709` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:09.930714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6024002-e75e-4c03-8d8f-f0f4cb9da72d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dc05d03adbd411582d529b168ec7709)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:09.933171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6024002-e75e-4c03-8d8f-f0f4cb9da72d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:10.016225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6024002-e75e-4c03-8d8f-f0f4cb9da72d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dc05d03adbd411582d529b168ec7709', 'request_id': 'req-a6024002-e75e-4c03-8d8f-f0f4cb9da72d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:10.028405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6024002-e75e-4c03-8d8f-f0f4cb9da72d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dc05d03adbd411582d529b168ec7709', 'request_id': 'req-a6024002-e75e-4c03-8d8f-f0f4cb9da72d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:10.037789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6024002-e75e-4c03-8d8f-f0f4cb9da72d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dc05d03adbd411582d529b168ec7709', 'request_id': 'req-a6024002-e75e-4c03-8d8f-f0f4cb9da72d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:10.066595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6024002-e75e-4c03-8d8f-f0f4cb9da72d admin admin] The token cache is being invalidate because project 9dc05d03adbd411582d529b168ec7709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:10.066903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6024002-e75e-4c03-8d8f-f0f4cb9da72d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:10.068928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6024002-e75e-4c03-8d8f-f0f4cb9da72d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:10.070554 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 944/1865] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:09 2022] DELETE /identity/v3/projects/9dc05d03adbd411582d529b168ec7709 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:10.075270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a75ad4-9871-42ed-a9de-c10891d53207 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:10.090079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a75ad4-9871-42ed-a9de-c10891d53207 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:10.174850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd405dea-fbb1-4b47-9302-cf96ed8844c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:10.176154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd405dea-fbb1-4b47-9302-cf96ed8844c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:10.176631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd405dea-fbb1-4b47-9302-cf96ed8844c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:10.177089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd405dea-fbb1-4b47-9302-cf96ed8844c9 admin admin] PATH_INFO: `/v3/users/70827d8950d74591b99a22ea4e843aad` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:10.178389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd405dea-fbb1-4b47-9302-cf96ed8844c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70827d8950d74591b99a22ea4e843aad)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:10.180716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd405dea-fbb1-4b47-9302-cf96ed8844c9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:10.288702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd405dea-fbb1-4b47-9302-cf96ed8844c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70827d8950d74591b99a22ea4e843aad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:10.306924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd405dea-fbb1-4b47-9302-cf96ed8844c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70827d8950d74591b99a22ea4e843aad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:10.308343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd405dea-fbb1-4b47-9302-cf96ed8844c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70827d8950d74591b99a22ea4e843aad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:10.341584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd405dea-fbb1-4b47-9302-cf96ed8844c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70827d8950d74591b99a22ea4e843aad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:10.359921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd405dea-fbb1-4b47-9302-cf96ed8844c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70827d8950d74591b99a22ea4e843aad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:10.367851 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 922/1866] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:10 2022] DELETE /identity/v3/users/70827d8950d74591b99a22ea4e843aad => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:10.388966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6024002-e75e-4c03-8d8f-f0f4cb9da72d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:10.391146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a6024002-e75e-4c03-8d8f-f0f4cb9da72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:10.413814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6024002-e75e-4c03-8d8f-f0f4cb9da72d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:10.522323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b63e50-7186-4d8a-9c95-1b0a7b71e011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:10.522920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b63e50-7186-4d8a-9c95-1b0a7b71e011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:10.523375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b63e50-7186-4d8a-9c95-1b0a7b71e011 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:10.523652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b63e50-7186-4d8a-9c95-1b0a7b71e011 admin admin] PATH_INFO: `/v3/users/afde748057354f5b8561ae635c362c8c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:10.526543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b63e50-7186-4d8a-9c95-1b0a7b71e011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afde748057354f5b8561ae635c362c8c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:10.528573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b63e50-7186-4d8a-9c95-1b0a7b71e011 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:10.593822 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:10.614629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36b63e50-7186-4d8a-9c95-1b0a7b71e011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afde748057354f5b8561ae635c362c8c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:10.616065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36b63e50-7186-4d8a-9c95-1b0a7b71e011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afde748057354f5b8561ae635c362c8c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:10.631503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36b63e50-7186-4d8a-9c95-1b0a7b71e011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afde748057354f5b8561ae635c362c8c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:10.649275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36b63e50-7186-4d8a-9c95-1b0a7b71e011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afde748057354f5b8561ae635c362c8c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:10.661791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36b63e50-7186-4d8a-9c95-1b0a7b71e011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afde748057354f5b8561ae635c362c8c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:10.672843 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 945/1867] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:10 2022] DELETE /identity/v3/users/afde748057354f5b8561ae635c362c8c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:10.678430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ed2e5-f74d-4cf8-8aad-27d5792b326e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:10.678716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ed2e5-f74d-4cf8-8aad-27d5792b326e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:10.678990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ed2e5-f74d-4cf8-8aad-27d5792b326e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:10.729156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-754ed2e5-f74d-4cf8-8aad-27d5792b326e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:10.730812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-754ed2e5-f74d-4cf8-8aad-27d5792b326e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:10.873495 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 923/1868] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:10.919857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b63e50-7186-4d8a-9c95-1b0a7b71e011 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:10.921464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-36b63e50-7186-4d8a-9c95-1b0a7b71e011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:11.076065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b63e50-7186-4d8a-9c95-1b0a7b71e011 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:11.088855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c0487-f006-411b-9caa-564d89127ec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:11.089880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c0487-f006-411b-9caa-564d89127ec6 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:11.090297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c0487-f006-411b-9caa-564d89127ec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:11.090746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c0487-f006-411b-9caa-564d89127ec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:11.117923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ed2e5-f74d-4cf8-8aad-27d5792b326e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:11.119240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c0487-f006-411b-9caa-564d89127ec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:11.120334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-754ed2e5-f74d-4cf8-8aad-27d5792b326e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:11.122712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c0487-f006-411b-9caa-564d89127ec6 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:11.141756 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:11.151842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ed2e5-f74d-4cf8-8aad-27d5792b326e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:11.158151 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 946/1869] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:11.160110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e57bd-a131-42b7-8ae0-fd99ede00000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:11.160959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e57bd-a131-42b7-8ae0-fd99ede00000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:11.161134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e57bd-a131-42b7-8ae0-fd99ede00000 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:11.161581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e57bd-a131-42b7-8ae0-fd99ede00000 admin admin] PATH_INFO: `/v3/users/1a10ab88faf24a118cc7b6f3adf404da` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:11.163165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e57bd-a131-42b7-8ae0-fd99ede00000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a10ab88faf24a118cc7b6f3adf404da)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:11.165240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e57bd-a131-42b7-8ae0-fd99ede00000 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:11.192404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c0487-f006-411b-9caa-564d89127ec6 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:11.195191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b08c0487-f006-411b-9caa-564d89127ec6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:11.270625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c0487-f006-411b-9caa-564d89127ec6 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:11.282468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-920e57bd-a131-42b7-8ae0-fd99ede00000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a10ab88faf24a118cc7b6f3adf404da'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:11.310503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966b0c6-9a7d-4bf4-b262-583f392b44b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:11.311274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966b0c6-9a7d-4bf4-b262-583f392b44b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:11.311538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966b0c6-9a7d-4bf4-b262-583f392b44b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:11.311976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966b0c6-9a7d-4bf4-b262-583f392b44b9 admin admin] PATH_INFO: `/v3/projects/2d7e502f111d4476a24bbd7da6ebe284` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:11.313305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966b0c6-9a7d-4bf4-b262-583f392b44b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7e502f111d4476a24bbd7da6ebe284)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:11.314706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-920e57bd-a131-42b7-8ae0-fd99ede00000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a10ab88faf24a118cc7b6f3adf404da'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:11.315301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966b0c6-9a7d-4bf4-b262-583f392b44b9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:11.316285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-920e57bd-a131-42b7-8ae0-fd99ede00000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a10ab88faf24a118cc7b6f3adf404da'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:11.349562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-920e57bd-a131-42b7-8ae0-fd99ede00000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a10ab88faf24a118cc7b6f3adf404da'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:11.386064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-920e57bd-a131-42b7-8ae0-fd99ede00000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a10ab88faf24a118cc7b6f3adf404da'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:11.406449 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 924/1870] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:11 2022] DELETE /identity/v3/users/1a10ab88faf24a118cc7b6f3adf404da => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:43:11.411057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046556c-641a-452f-bb8e-aa8e0b637616 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:11.411554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046556c-641a-452f-bb8e-aa8e0b637616 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:11.411975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046556c-641a-452f-bb8e-aa8e0b637616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:11.448885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c966b0c6-9a7d-4bf4-b262-583f392b44b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7e502f111d4476a24bbd7da6ebe284', 'request_id': 'req-c966b0c6-9a7d-4bf4-b262-583f392b44b9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:11.457338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e046556c-641a-452f-bb8e-aa8e0b637616 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:11.458565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e046556c-641a-452f-bb8e-aa8e0b637616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:11.479442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c966b0c6-9a7d-4bf4-b262-583f392b44b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7e502f111d4476a24bbd7da6ebe284', 'request_id': 'req-c966b0c6-9a7d-4bf4-b262-583f392b44b9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:11.489150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c966b0c6-9a7d-4bf4-b262-583f392b44b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7e502f111d4476a24bbd7da6ebe284', 'request_id': 'req-c966b0c6-9a7d-4bf4-b262-583f392b44b9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:11.513534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c966b0c6-9a7d-4bf4-b262-583f392b44b9 admin admin] The token cache is being invalidate because project 2d7e502f111d4476a24bbd7da6ebe284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:11.513976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c966b0c6-9a7d-4bf4-b262-583f392b44b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:11.515463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c966b0c6-9a7d-4bf4-b262-583f392b44b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:11.519958 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 947/1871] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:11 2022] DELETE /identity/v3/projects/2d7e502f111d4476a24bbd7da6ebe284 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:11.524767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33daf9-ba74-4f4a-b622-fa082bc7b658 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:11.525056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33daf9-ba74-4f4a-b622-fa082bc7b658 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:11.525494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33daf9-ba74-4f4a-b622-fa082bc7b658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:11.561201 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 925/1872] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:43:11.591203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9d33daf9-ba74-4f4a-b622-fa082bc7b658 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:11.592542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9d33daf9-ba74-4f4a-b622-fa082bc7b658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:11.592711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046556c-641a-452f-bb8e-aa8e0b637616 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:11.594149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e046556c-641a-452f-bb8e-aa8e0b637616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:11.617982 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 948/1873] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:11.620677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856dcfc-8ca1-4b9e-8b80-ba1be7f8143d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:11.620882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856dcfc-8ca1-4b9e-8b80-ba1be7f8143d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:11.621259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856dcfc-8ca1-4b9e-8b80-ba1be7f8143d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:11.666540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3856dcfc-8ca1-4b9e-8b80-ba1be7f8143d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:11.667803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3856dcfc-8ca1-4b9e-8b80-ba1be7f8143d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:11.685862 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 949/1874] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:11.694689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856dcfc-8ca1-4b9e-8b80-ba1be7f8143d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:11.719551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856dcfc-8ca1-4b9e-8b80-ba1be7f8143d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:11.741220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046556c-641a-452f-bb8e-aa8e0b637616 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:11.742863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7ff0f-ad16-4bc7-86d0-65467d56c312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:11.743062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7ff0f-ad16-4bc7-86d0-65467d56c312 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:11.743555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7ff0f-ad16-4bc7-86d0-65467d56c312 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:11.745987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7ff0f-ad16-4bc7-86d0-65467d56c312 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:11.747368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7ff0f-ad16-4bc7-86d0-65467d56c312 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:11.748054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7ff0f-ad16-4bc7-86d0-65467d56c312 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:11.750564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7ff0f-ad16-4bc7-86d0-65467d56c312 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:11.754230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f25fcd-821c-40f2-9c14-114e100d57cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:11.755979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f25fcd-821c-40f2-9c14-114e100d57cb service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:11.756927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f25fcd-821c-40f2-9c14-114e100d57cb service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:11.757629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f25fcd-821c-40f2-9c14-114e100d57cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:11.781452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f25fcd-821c-40f2-9c14-114e100d57cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:11.783346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f25fcd-821c-40f2-9c14-114e100d57cb service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:11.791648 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 950/1875] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:11.792221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7ff0f-ad16-4bc7-86d0-65467d56c312 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:11.809042 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 926/1876] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:43:11.814993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7ff0f-ad16-4bc7-86d0-65467d56c312 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:11.831059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493d7b5-bfd7-4f12-b421-07554dbea81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:11.831773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493d7b5-bfd7-4f12-b421-07554dbea81e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:11.832127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493d7b5-bfd7-4f12-b421-07554dbea81e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:11.832893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493d7b5-bfd7-4f12-b421-07554dbea81e admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:11.834172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493d7b5-bfd7-4f12-b421-07554dbea81e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:11.836212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493d7b5-bfd7-4f12-b421-07554dbea81e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:11.854537 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:11.919778 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 951/1877] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:11 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:11.924515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f25fcd-821c-40f2-9c14-114e100d57cb service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:11.939948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f25fcd-821c-40f2-9c14-114e100d57cb service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:11.959888 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:12.020064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811de7d-34b1-4c0b-994a-d520deb5ff19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:12.021001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811de7d-34b1-4c0b-994a-d520deb5ff19 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:12.021443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811de7d-34b1-4c0b-994a-d520deb5ff19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:12.021883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811de7d-34b1-4c0b-994a-d520deb5ff19 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:12.022677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811de7d-34b1-4c0b-994a-d520deb5ff19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:12.025424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811de7d-34b1-4c0b-994a-d520deb5ff19 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:12.069170 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 927/1878] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:11 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:12.073786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493d7b5-bfd7-4f12-b421-07554dbea81e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:12.086893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493d7b5-bfd7-4f12-b421-07554dbea81e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:12.097070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b2aaf-4c1a-4050-be99-03962bdaf8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:12.097692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b2aaf-4c1a-4050-be99-03962bdaf8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:12.097966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b2aaf-4c1a-4050-be99-03962bdaf8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:12.098230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b2aaf-4c1a-4050-be99-03962bdaf8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:12.098880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b2aaf-4c1a-4050-be99-03962bdaf8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:12.100526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b2aaf-4c1a-4050-be99-03962bdaf8e3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:12.125658 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 952/1879] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:43:12.130528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811de7d-34b1-4c0b-994a-d520deb5ff19 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:12.145551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811de7d-34b1-4c0b-994a-d520deb5ff19 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:12.154901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b2aaf-4c1a-4050-be99-03962bdaf8e3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:12.157514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-698b2aaf-4c1a-4050-be99-03962bdaf8e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:12.172011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be5352-8cbb-4a5f-b99e-f2b287002794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:12.172676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be5352-8cbb-4a5f-b99e-f2b287002794 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:12.172959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be5352-8cbb-4a5f-b99e-f2b287002794 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:12.173225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be5352-8cbb-4a5f-b99e-f2b287002794 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:12.173875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be5352-8cbb-4a5f-b99e-f2b287002794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:12.175477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be5352-8cbb-4a5f-b99e-f2b287002794 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:12.198368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b2aaf-4c1a-4050-be99-03962bdaf8e3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:12.200211 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 928/1880] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:12.204098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be5352-8cbb-4a5f-b99e-f2b287002794 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:12.209921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b36d3-e917-4b9c-8ad3-61127510b086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:12.210881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b36d3-e917-4b9c-8ad3-61127510b086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:12.211408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b36d3-e917-4b9c-8ad3-61127510b086 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:12.211899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b36d3-e917-4b9c-8ad3-61127510b086 admin admin] PATH_INFO: `/v3/projects/8abba10152a3464f8a3ae127eec97382` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:12.214024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b36d3-e917-4b9c-8ad3-61127510b086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8abba10152a3464f8a3ae127eec97382)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:12.216896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b36d3-e917-4b9c-8ad3-61127510b086 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:12.230563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be5352-8cbb-4a5f-b99e-f2b287002794 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:12.235850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cbaf2-a04b-4569-9fd7-943d89a38dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:12.237182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cbaf2-a04b-4569-9fd7-943d89a38dce admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:12.238117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cbaf2-a04b-4569-9fd7-943d89a38dce admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:12.238648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cbaf2-a04b-4569-9fd7-943d89a38dce admin admin] PATH_INFO: `/v3/projects/a8f115689c3244da9ed1e8796b2bc03a/users/637500f51a844565933647dd243be935/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:12.261354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cbaf2-a04b-4569-9fd7-943d89a38dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f115689c3244da9ed1e8796b2bc03a, user_id=637500f51a844565933647dd243be935, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:12.264828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cbaf2-a04b-4569-9fd7-943d89a38dce admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:12.294964 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 929/1881] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:12 2022] PUT /identity/v3/projects/a8f115689c3244da9ed1e8796b2bc03a/users/637500f51a844565933647dd243be935/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:12.304997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4cfed-a950-4b49-8545-b6fc0d2205eb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:12.305339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4cfed-a950-4b49-8545-b6fc0d2205eb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:12.305618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4cfed-a950-4b49-8545-b6fc0d2205eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:12.361064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-65e4cfed-a950-4b49-8545-b6fc0d2205eb None None] MFA Rules not processed for user `637500f51a844565933647dd243be935`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:12.361602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dd1b36d3-e917-4b9c-8ad3-61127510b086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8abba10152a3464f8a3ae127eec97382', 'request_id': 'req-dd1b36d3-e917-4b9c-8ad3-61127510b086'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:12.363376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-65e4cfed-a950-4b49-8545-b6fc0d2205eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:12.375192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dd1b36d3-e917-4b9c-8ad3-61127510b086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8abba10152a3464f8a3ae127eec97382', 'request_id': 'req-dd1b36d3-e917-4b9c-8ad3-61127510b086'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:12.386836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dd1b36d3-e917-4b9c-8ad3-61127510b086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8abba10152a3464f8a3ae127eec97382', 'request_id': 'req-dd1b36d3-e917-4b9c-8ad3-61127510b086'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:12.417175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dd1b36d3-e917-4b9c-8ad3-61127510b086 admin admin] The token cache is being invalidate because project 8abba10152a3464f8a3ae127eec97382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:12.418919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dd1b36d3-e917-4b9c-8ad3-61127510b086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:12.419841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dd1b36d3-e917-4b9c-8ad3-61127510b086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:12.424220 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 953/1882] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:12 2022] DELETE /identity/v3/projects/8abba10152a3464f8a3ae127eec97382 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:43:12.431289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b36d3-e917-4b9c-8ad3-61127510b086 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:12.434732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dd1b36d3-e917-4b9c-8ad3-61127510b086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:12.544884 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 930/1883] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:43:12.558516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4cfed-a950-4b49-8545-b6fc0d2205eb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:12.562020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-65e4cfed-a950-4b49-8545-b6fc0d2205eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:12.635926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b36d3-e917-4b9c-8ad3-61127510b086 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:12.668850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e144a6b-4019-4861-9d52-0e37f9630157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:12.669666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e144a6b-4019-4861-9d52-0e37f9630157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:12.670546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e144a6b-4019-4861-9d52-0e37f9630157 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:12.671371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e144a6b-4019-4861-9d52-0e37f9630157 admin admin] PATH_INFO: `/v3/users/8629e93fb060455d8fba8ba04ef2ec08` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:12.673462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e144a6b-4019-4861-9d52-0e37f9630157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8629e93fb060455d8fba8ba04ef2ec08)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:12.677262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e144a6b-4019-4861-9d52-0e37f9630157 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:12.749561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4cfed-a950-4b49-8545-b6fc0d2205eb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:12.755933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c07a2e-a960-4f4e-ac1c-74862273dfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:12.757297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c07a2e-a960-4f4e-ac1c-74862273dfb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:12.757830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c07a2e-a960-4f4e-ac1c-74862273dfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:12.758265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c07a2e-a960-4f4e-ac1c-74862273dfb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:12.760136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c07a2e-a960-4f4e-ac1c-74862273dfb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:12.762730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c07a2e-a960-4f4e-ac1c-74862273dfb6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:12.775561 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:12.789180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4e144a6b-4019-4861-9d52-0e37f9630157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8629e93fb060455d8fba8ba04ef2ec08'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:12.790098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4e144a6b-4019-4861-9d52-0e37f9630157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8629e93fb060455d8fba8ba04ef2ec08'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:12.824673 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 931/1884] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:12 2022] POST /identity/v3/projects => generated 381 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:12.832205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4e144a6b-4019-4861-9d52-0e37f9630157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8629e93fb060455d8fba8ba04ef2ec08'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:12.832457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c07a2e-a960-4f4e-ac1c-74862273dfb6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:12.835640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f0c07a2e-a960-4f4e-ac1c-74862273dfb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:12.842011 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:INSERT=3,keystone:DELETE=16 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:12.865485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4e144a6b-4019-4861-9d52-0e37f9630157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8629e93fb060455d8fba8ba04ef2ec08'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:12.877074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4e144a6b-4019-4861-9d52-0e37f9630157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8629e93fb060455d8fba8ba04ef2ec08'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:12.888304 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 954/1885] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:12 2022] DELETE /identity/v3/users/8629e93fb060455d8fba8ba04ef2ec08 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:12.945789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c07a2e-a960-4f4e-ac1c-74862273dfb6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:13.105208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558302f-c46f-4e7f-8353-9e450b2a4510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:13.106077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558302f-c46f-4e7f-8353-9e450b2a4510 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:13.106707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558302f-c46f-4e7f-8353-9e450b2a4510 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:13.107207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558302f-c46f-4e7f-8353-9e450b2a4510 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:13.108048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558302f-c46f-4e7f-8353-9e450b2a4510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:13.110185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558302f-c46f-4e7f-8353-9e450b2a4510 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:13.141503 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 932/1886] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:12 2022] POST /identity/v3/users => generated 297 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:13.145594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e144a6b-4019-4861-9d52-0e37f9630157 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:13.158639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e144a6b-4019-4861-9d52-0e37f9630157 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:13.160375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558302f-c46f-4e7f-8353-9e450b2a4510 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:13.162777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7558302f-c46f-4e7f-8353-9e450b2a4510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:13.174103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6f348-0a64-416c-bd6f-9af02624f167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:13.175013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6f348-0a64-416c-bd6f-9af02624f167 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:13.175356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6f348-0a64-416c-bd6f-9af02624f167 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:13.175631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6f348-0a64-416c-bd6f-9af02624f167 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:13.176278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6f348-0a64-416c-bd6f-9af02624f167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:13.178218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6f348-0a64-416c-bd6f-9af02624f167 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:13.189033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558302f-c46f-4e7f-8353-9e450b2a4510 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:13.201090 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 955/1887] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:13.203029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6f348-0a64-416c-bd6f-9af02624f167 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:13.206477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1149834-63af-4d7d-8037-40aa3f67fbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:13.207945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1149834-63af-4d7d-8037-40aa3f67fbd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:13.208446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1149834-63af-4d7d-8037-40aa3f67fbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:13.208920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1149834-63af-4d7d-8037-40aa3f67fbd5 admin admin] PATH_INFO: `/v3/projects/3690619318174c2d9c4dbabae3f97edf` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:13.210306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-59d6f348-0a64-416c-bd6f-9af02624f167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:13.211087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1149834-63af-4d7d-8037-40aa3f67fbd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3690619318174c2d9c4dbabae3f97edf)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:13.214670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1149834-63af-4d7d-8037-40aa3f67fbd5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:13.238638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6f348-0a64-416c-bd6f-9af02624f167 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:13.256573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3069b-5ae3-4467-8f80-8375a33778b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:13.257795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3069b-5ae3-4467-8f80-8375a33778b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:13.258266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3069b-5ae3-4467-8f80-8375a33778b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:13.258603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3069b-5ae3-4467-8f80-8375a33778b1 admin admin] PATH_INFO: `/v3/users/956ce93d49804853bbfe3cc987d5b1b3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:13.260096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3069b-5ae3-4467-8f80-8375a33778b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=956ce93d49804853bbfe3cc987d5b1b3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:13.268059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3069b-5ae3-4467-8f80-8375a33778b1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:13.339372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f1149834-63af-4d7d-8037-40aa3f67fbd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3690619318174c2d9c4dbabae3f97edf', 'request_id': 'req-f1149834-63af-4d7d-8037-40aa3f67fbd5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:13.362259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f1149834-63af-4d7d-8037-40aa3f67fbd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3690619318174c2d9c4dbabae3f97edf', 'request_id': 'req-f1149834-63af-4d7d-8037-40aa3f67fbd5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:13.389681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f1149834-63af-4d7d-8037-40aa3f67fbd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3690619318174c2d9c4dbabae3f97edf', 'request_id': 'req-f1149834-63af-4d7d-8037-40aa3f67fbd5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:13.397772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4bb3069b-5ae3-4467-8f80-8375a33778b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '956ce93d49804853bbfe3cc987d5b1b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:13.400572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4bb3069b-5ae3-4467-8f80-8375a33778b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '956ce93d49804853bbfe3cc987d5b1b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:13.423998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4bb3069b-5ae3-4467-8f80-8375a33778b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '956ce93d49804853bbfe3cc987d5b1b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:13.434629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f1149834-63af-4d7d-8037-40aa3f67fbd5 admin admin] The token cache is being invalidate because project 3690619318174c2d9c4dbabae3f97edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:13.434975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f1149834-63af-4d7d-8037-40aa3f67fbd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:13.439101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f1149834-63af-4d7d-8037-40aa3f67fbd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:13.443463 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 933/1888] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:13 2022] DELETE /identity/v3/projects/3690619318174c2d9c4dbabae3f97edf => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:13.447153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1149834-63af-4d7d-8037-40aa3f67fbd5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:13.448525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f1149834-63af-4d7d-8037-40aa3f67fbd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:13.460678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4bb3069b-5ae3-4467-8f80-8375a33778b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '956ce93d49804853bbfe3cc987d5b1b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:13.476967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4bb3069b-5ae3-4467-8f80-8375a33778b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '956ce93d49804853bbfe3cc987d5b1b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:13.483293 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:13.502112 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 956/1889] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:13 2022] DELETE /identity/v3/users/956ce93d49804853bbfe3cc987d5b1b3 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:13.502112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3069b-5ae3-4467-8f80-8375a33778b1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:13.502978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4bb3069b-5ae3-4467-8f80-8375a33778b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:13.637890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1149834-63af-4d7d-8037-40aa3f67fbd5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:13.694210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3069b-5ae3-4467-8f80-8375a33778b1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:13.708887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9b367-9d50-42ad-a8b6-3a286aa19c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:13.709544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9b367-9d50-42ad-a8b6-3a286aa19c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:13.709824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9b367-9d50-42ad-a8b6-3a286aa19c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:13.710093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9b367-9d50-42ad-a8b6-3a286aa19c67 admin admin] PATH_INFO: `/v3/users/cf3572f3866246d88dbd0e66efda98a3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:13.713419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9b367-9d50-42ad-a8b6-3a286aa19c67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf3572f3866246d88dbd0e66efda98a3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:13.715390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9b367-9d50-42ad-a8b6-3a286aa19c67 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:13.793060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44263088-0dde-4f6d-b2d6-92ed3091fc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:13.793854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44263088-0dde-4f6d-b2d6-92ed3091fc13 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:13.795316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44263088-0dde-4f6d-b2d6-92ed3091fc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:13.795610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44263088-0dde-4f6d-b2d6-92ed3091fc13 admin admin] PATH_INFO: `/v3/projects/bca54ad2d71c4edca55c538eec84cbeb/users/29d603be2a704ab3be759f66674537b0/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:13.831542 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:13.843098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6dd9b367-9d50-42ad-a8b6-3a286aa19c67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf3572f3866246d88dbd0e66efda98a3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:13.848211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6dd9b367-9d50-42ad-a8b6-3a286aa19c67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf3572f3866246d88dbd0e66efda98a3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:13.855947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44263088-0dde-4f6d-b2d6-92ed3091fc13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca54ad2d71c4edca55c538eec84cbeb, user_id=29d603be2a704ab3be759f66674537b0, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:13.861177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44263088-0dde-4f6d-b2d6-92ed3091fc13 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:13.877745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6dd9b367-9d50-42ad-a8b6-3a286aa19c67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf3572f3866246d88dbd0e66efda98a3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:13.906214 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 934/1890] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:13 2022] PUT /identity/v3/projects/bca54ad2d71c4edca55c538eec84cbeb/users/29d603be2a704ab3be759f66674537b0/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:13.911171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c372fb-e1ed-46d5-9149-d090a8b1fb9d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:13.911348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c372fb-e1ed-46d5-9149-d090a8b1fb9d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:13.911570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c372fb-e1ed-46d5-9149-d090a8b1fb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:13.935089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6dd9b367-9d50-42ad-a8b6-3a286aa19c67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf3572f3866246d88dbd0e66efda98a3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:13.944026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6dd9b367-9d50-42ad-a8b6-3a286aa19c67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf3572f3866246d88dbd0e66efda98a3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:13.948536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a5c372fb-e1ed-46d5-9149-d090a8b1fb9d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:13.953864 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 957/1891] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:13 2022] DELETE /identity/v3/users/cf3572f3866246d88dbd0e66efda98a3 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:13.955452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9b367-9d50-42ad-a8b6-3a286aa19c67 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:13.958458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6dd9b367-9d50-42ad-a8b6-3a286aa19c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:13.964428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a5c372fb-e1ed-46d5-9149-d090a8b1fb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:14.154577 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 935/1892] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:14.161448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c372fb-e1ed-46d5-9149-d090a8b1fb9d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:14.166345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a5c372fb-e1ed-46d5-9149-d090a8b1fb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:14.169424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9b367-9d50-42ad-a8b6-3a286aa19c67 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:14.180015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2561d-f848-4cd9-a995-3913d10d1b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:14.180666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2561d-f848-4cd9-a995-3913d10d1b1d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:14.181156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2561d-f848-4cd9-a995-3913d10d1b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:14.181849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2561d-f848-4cd9-a995-3913d10d1b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:14.182621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2561d-f848-4cd9-a995-3913d10d1b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:14.185115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2561d-f848-4cd9-a995-3913d10d1b1d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:14.190713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c372fb-e1ed-46d5-9149-d090a8b1fb9d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:14.215107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712fa0c-6057-4fc6-bcf8-8bab00ca601d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:14.216336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712fa0c-6057-4fc6-bcf8-8bab00ca601d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:14.216628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712fa0c-6057-4fc6-bcf8-8bab00ca601d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:14.220432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712fa0c-6057-4fc6-bcf8-8bab00ca601d admin admin] PATH_INFO: `/v3/projects/dfe08f303eab41029c11657360186f06` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:14.225761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712fa0c-6057-4fc6-bcf8-8bab00ca601d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe08f303eab41029c11657360186f06)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:14.230177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712fa0c-6057-4fc6-bcf8-8bab00ca601d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:14.230923 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 958/1893] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:14.232256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2561d-f848-4cd9-a995-3913d10d1b1d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:14.234542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-15d2561d-f848-4cd9-a995-3913d10d1b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:14.294136 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:14.317915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b712fa0c-6057-4fc6-bcf8-8bab00ca601d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe08f303eab41029c11657360186f06', 'request_id': 'req-b712fa0c-6057-4fc6-bcf8-8bab00ca601d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:14.341359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b712fa0c-6057-4fc6-bcf8-8bab00ca601d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe08f303eab41029c11657360186f06', 'request_id': 'req-b712fa0c-6057-4fc6-bcf8-8bab00ca601d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:14.351808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b712fa0c-6057-4fc6-bcf8-8bab00ca601d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe08f303eab41029c11657360186f06', 'request_id': 'req-b712fa0c-6057-4fc6-bcf8-8bab00ca601d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:14.380013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b712fa0c-6057-4fc6-bcf8-8bab00ca601d admin admin] The token cache is being invalidate because project dfe08f303eab41029c11657360186f06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:14.380013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b712fa0c-6057-4fc6-bcf8-8bab00ca601d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:14.381291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b712fa0c-6057-4fc6-bcf8-8bab00ca601d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:14.383133 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 936/1894] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:14 2022] DELETE /identity/v3/projects/dfe08f303eab41029c11657360186f06 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:14.389256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712fa0c-6057-4fc6-bcf8-8bab00ca601d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:14.390882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b712fa0c-6057-4fc6-bcf8-8bab00ca601d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:14.397838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2561d-f848-4cd9-a995-3913d10d1b1d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:14.506966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712fa0c-6057-4fc6-bcf8-8bab00ca601d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:14.509261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97acf19-fbff-4a0a-a02f-77ea9da9ece2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:14.510052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97acf19-fbff-4a0a-a02f-77ea9da9ece2 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:14.510422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97acf19-fbff-4a0a-a02f-77ea9da9ece2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:14.511524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97acf19-fbff-4a0a-a02f-77ea9da9ece2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:14.512468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa4cf4-c1d1-4dac-a210-2a6ea86417e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:14.513232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa4cf4-c1d1-4dac-a210-2a6ea86417e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:14.513558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa4cf4-c1d1-4dac-a210-2a6ea86417e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:14.513946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa4cf4-c1d1-4dac-a210-2a6ea86417e3 admin admin] PATH_INFO: `/v3/projects/bca54ad2d71c4edca55c538eec84cbeb/users/29d603be2a704ab3be759f66674537b0/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:14.514828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f97acf19-fbff-4a0a-a02f-77ea9da9ece2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:14.516074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa4cf4-c1d1-4dac-a210-2a6ea86417e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca54ad2d71c4edca55c538eec84cbeb, user_id=29d603be2a704ab3be759f66674537b0, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:14.519410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa4cf4-c1d1-4dac-a210-2a6ea86417e3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:14.540690 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 937/1895] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:14 2022] PUT /identity/v3/projects/bca54ad2d71c4edca55c538eec84cbeb/users/29d603be2a704ab3be759f66674537b0/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:14.540690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dfb02-c88c-4b63-a3eb-57d0414db8df None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:14.540690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dfb02-c88c-4b63-a3eb-57d0414db8df None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:14.540690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dfb02-c88c-4b63-a3eb-57d0414db8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:14.542859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97acf19-fbff-4a0a-a02f-77ea9da9ece2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:14.544404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97acf19-fbff-4a0a-a02f-77ea9da9ece2 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:14.564513 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 959/1896] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:14.565415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97acf19-fbff-4a0a-a02f-77ea9da9ece2 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:14.568938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f97acf19-fbff-4a0a-a02f-77ea9da9ece2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:14.569103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-675dfb02-c88c-4b63-a3eb-57d0414db8df None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:14.570514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-675dfb02-c88c-4b63-a3eb-57d0414db8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:14.597140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97acf19-fbff-4a0a-a02f-77ea9da9ece2 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:14.615032 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:14.697359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e4364-7a30-4881-b638-06039f6ee735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:14.699443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e4364-7a30-4881-b638-06039f6ee735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:14.699952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e4364-7a30-4881-b638-06039f6ee735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:14.700518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e4364-7a30-4881-b638-06039f6ee735 admin admin] PATH_INFO: `/v3/projects/eae3875a20c343ecbda9f672b5177a1a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:14.702095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e4364-7a30-4881-b638-06039f6ee735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eae3875a20c343ecbda9f672b5177a1a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:14.705416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e4364-7a30-4881-b638-06039f6ee735 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:14.705583 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 938/1897] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:14.707305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c79d59-8abb-4262-b32f-06b08214d580 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:14.707590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c79d59-8abb-4262-b32f-06b08214d580 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:14.707858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c79d59-8abb-4262-b32f-06b08214d580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:14.752381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-79c79d59-8abb-4262-b32f-06b08214d580 None None] MFA Rules not processed for user `29d603be2a704ab3be759f66674537b0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:14.753933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-79c79d59-8abb-4262-b32f-06b08214d580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:14.829916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-296e4364-7a30-4881-b638-06039f6ee735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eae3875a20c343ecbda9f672b5177a1a', 'request_id': 'req-296e4364-7a30-4881-b638-06039f6ee735'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:14.852116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-296e4364-7a30-4881-b638-06039f6ee735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eae3875a20c343ecbda9f672b5177a1a', 'request_id': 'req-296e4364-7a30-4881-b638-06039f6ee735'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:14.865310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-296e4364-7a30-4881-b638-06039f6ee735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eae3875a20c343ecbda9f672b5177a1a', 'request_id': 'req-296e4364-7a30-4881-b638-06039f6ee735'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:14.882897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-296e4364-7a30-4881-b638-06039f6ee735 admin admin] The token cache is being invalidate because project eae3875a20c343ecbda9f672b5177a1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:14.883468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-296e4364-7a30-4881-b638-06039f6ee735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:14.886329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-296e4364-7a30-4881-b638-06039f6ee735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:14.888419 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 960/1898] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:14 2022] DELETE /identity/v3/projects/eae3875a20c343ecbda9f672b5177a1a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:14.892097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9e830-0c1e-40ec-9a66-9fb93c6eb8dc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:14.892500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9e830-0c1e-40ec-9a66-9fb93c6eb8dc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:14.893218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9e830-0c1e-40ec-9a66-9fb93c6eb8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:14.903630 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:14.925439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-aac9e830-0c1e-40ec-9a66-9fb93c6eb8dc None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:14.927152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-aac9e830-0c1e-40ec-9a66-9fb93c6eb8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:14.986000 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 939/1899] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:14.987348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723a39a-cdf1-4fdd-b4bf-ff693878a3af None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:14.987638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723a39a-cdf1-4fdd-b4bf-ff693878a3af None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:14.987927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723a39a-cdf1-4fdd-b4bf-ff693878a3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:15.040086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1723a39a-cdf1-4fdd-b4bf-ff693878a3af None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:15.045007 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 961/1900] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:15.045526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1723a39a-cdf1-4fdd-b4bf-ff693878a3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:15.046485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9e830-0c1e-40ec-9a66-9fb93c6eb8dc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:15.048359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-aac9e830-0c1e-40ec-9a66-9fb93c6eb8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:15.088528 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 940/1901] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:15.089897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723a39a-cdf1-4fdd-b4bf-ff693878a3af None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:15.108305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723a39a-cdf1-4fdd-b4bf-ff693878a3af None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:15.115440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f19c2-ea05-4bbb-a396-20ddde433892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:15.117314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f19c2-ea05-4bbb-a396-20ddde433892 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:15.117728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f19c2-ea05-4bbb-a396-20ddde433892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:15.118226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f19c2-ea05-4bbb-a396-20ddde433892 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:15.120370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f19c2-ea05-4bbb-a396-20ddde433892 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:15.120984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f19c2-ea05-4bbb-a396-20ddde433892 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:15.122731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f19c2-ea05-4bbb-a396-20ddde433892 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:15.135641 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:15.154791 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 941/1902] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:15.156153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af813d2-6a70-4756-91bb-8713f5b89c86 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:15.156448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af813d2-6a70-4756-91bb-8713f5b89c86 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:15.156736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af813d2-6a70-4756-91bb-8713f5b89c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:15.211161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9e830-0c1e-40ec-9a66-9fb93c6eb8dc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:15.222278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b5c28-875c-47b6-a608-47a2766e7215 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:15.223440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b5c28-875c-47b6-a608-47a2766e7215 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:15.223625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5af813d2-6a70-4756-91bb-8713f5b89c86 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:15.224646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b5c28-875c-47b6-a608-47a2766e7215 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:15.224887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5af813d2-6a70-4756-91bb-8713f5b89c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:15.225832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b5c28-875c-47b6-a608-47a2766e7215 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:15.258289 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 942/1903] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:15.258289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af813d2-6a70-4756-91bb-8713f5b89c86 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:15.278265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af813d2-6a70-4756-91bb-8713f5b89c86 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:15.289326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f542b30-178d-4261-85e0-769788262abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:15.291306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f542b30-178d-4261-85e0-769788262abc admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:15.291963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f542b30-178d-4261-85e0-769788262abc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:15.292511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f542b30-178d-4261-85e0-769788262abc admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:15.293494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f542b30-178d-4261-85e0-769788262abc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:15.297663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f542b30-178d-4261-85e0-769788262abc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:15.345880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b5c28-875c-47b6-a608-47a2766e7215 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:15.347792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b5c28-875c-47b6-a608-47a2766e7215 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:15.358782 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 943/1904] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:15 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:15.362169 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 962/1905] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:15.363901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f542b30-178d-4261-85e0-769788262abc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:15.375506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b5c28-875c-47b6-a608-47a2766e7215 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:15.378134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1e3b5c28-875c-47b6-a608-47a2766e7215 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:15.411113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b5c28-875c-47b6-a608-47a2766e7215 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:15.470822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f542b30-178d-4261-85e0-769788262abc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:15.475798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f35c9a-4df7-44ad-a964-06c8cd750945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:15.476716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f35c9a-4df7-44ad-a964-06c8cd750945 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:15.477005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f35c9a-4df7-44ad-a964-06c8cd750945 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:15.477292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f35c9a-4df7-44ad-a964-06c8cd750945 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:15.479976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f35c9a-4df7-44ad-a964-06c8cd750945 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:15.481666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f35c9a-4df7-44ad-a964-06c8cd750945 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:15.483347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f35c9a-4df7-44ad-a964-06c8cd750945 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:15.501444 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 944/1906] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:15.502490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f35c9a-4df7-44ad-a964-06c8cd750945 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:15.504782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93d707-5e6d-48ff-b74f-a76de617bf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:15.505431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93d707-5e6d-48ff-b74f-a76de617bf02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:15.505825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93d707-5e6d-48ff-b74f-a76de617bf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:15.506112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93d707-5e6d-48ff-b74f-a76de617bf02 admin admin] PATH_INFO: `/v3/projects/ed0ea14d4b264d15a6ddef3f99b88e5b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:15.507245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93d707-5e6d-48ff-b74f-a76de617bf02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed0ea14d4b264d15a6ddef3f99b88e5b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:15.509480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93d707-5e6d-48ff-b74f-a76de617bf02 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:15.512874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f35c9a-4df7-44ad-a964-06c8cd750945 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:15.517670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e10a4-f382-42f3-8d83-2030a8911203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:15.519172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e10a4-f382-42f3-8d83-2030a8911203 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:15.519447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e10a4-f382-42f3-8d83-2030a8911203 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:15.519717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e10a4-f382-42f3-8d83-2030a8911203 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:15.520348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e10a4-f382-42f3-8d83-2030a8911203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:15.522604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e10a4-f382-42f3-8d83-2030a8911203 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:15.549647 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 945/1907] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:15 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:15.550744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e10a4-f382-42f3-8d83-2030a8911203 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:15.562029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e10a4-f382-42f3-8d83-2030a8911203 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:15.569373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bf93d707-5e6d-48ff-b74f-a76de617bf02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed0ea14d4b264d15a6ddef3f99b88e5b', 'request_id': 'req-bf93d707-5e6d-48ff-b74f-a76de617bf02'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:15.583032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bf93d707-5e6d-48ff-b74f-a76de617bf02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed0ea14d4b264d15a6ddef3f99b88e5b', 'request_id': 'req-bf93d707-5e6d-48ff-b74f-a76de617bf02'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:15.591382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bf93d707-5e6d-48ff-b74f-a76de617bf02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed0ea14d4b264d15a6ddef3f99b88e5b', 'request_id': 'req-bf93d707-5e6d-48ff-b74f-a76de617bf02'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:15.605774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bf93d707-5e6d-48ff-b74f-a76de617bf02 admin admin] The token cache is being invalidate because project ed0ea14d4b264d15a6ddef3f99b88e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:15.606032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bf93d707-5e6d-48ff-b74f-a76de617bf02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:15.607380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bf93d707-5e6d-48ff-b74f-a76de617bf02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:15.609177 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 963/1908] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:15 2022] DELETE /identity/v3/projects/ed0ea14d4b264d15a6ddef3f99b88e5b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:15.609920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93d707-5e6d-48ff-b74f-a76de617bf02 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:15.612936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bf93d707-5e6d-48ff-b74f-a76de617bf02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:15.627542 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:15.638676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598833a-b48f-4b84-aa99-e794593a60dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:15.639452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598833a-b48f-4b84-aa99-e794593a60dc admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:15.639801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598833a-b48f-4b84-aa99-e794593a60dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:15.640370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598833a-b48f-4b84-aa99-e794593a60dc admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:15.642844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598833a-b48f-4b84-aa99-e794593a60dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:15.645373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598833a-b48f-4b84-aa99-e794593a60dc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:15.666189 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:15.685525 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 946/1909] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:15 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:15.685525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598833a-b48f-4b84-aa99-e794593a60dc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:15.687211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f598833a-b48f-4b84-aa99-e794593a60dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:15.695502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93d707-5e6d-48ff-b74f-a76de617bf02 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:15.763935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda15882-8a89-4377-8186-4f3d9f83efe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:15.764873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda15882-8a89-4377-8186-4f3d9f83efe7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:15.765161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda15882-8a89-4377-8186-4f3d9f83efe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:15.765439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda15882-8a89-4377-8186-4f3d9f83efe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:15.766090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda15882-8a89-4377-8186-4f3d9f83efe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:15.767736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda15882-8a89-4377-8186-4f3d9f83efe7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:15.769559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598833a-b48f-4b84-aa99-e794593a60dc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:15.775583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17bf0f-f1fe-473f-9cfe-0d341877f3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:15.776574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17bf0f-f1fe-473f-9cfe-0d341877f3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:15.777027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17bf0f-f1fe-473f-9cfe-0d341877f3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:15.777555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17bf0f-f1fe-473f-9cfe-0d341877f3ca admin admin] PATH_INFO: `/v3/users/0b4c7ff8b586411aafdec4510626c458` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:15.781985 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 964/1910] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:15.781985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650c2d8-1b06-4c73-a4bf-9a0dfffc6508 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:15.781985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650c2d8-1b06-4c73-a4bf-9a0dfffc6508 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:15.781985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650c2d8-1b06-4c73-a4bf-9a0dfffc6508 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:15.782592 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 965/1911] 10.222.0.16 () {54 vars in 921 bytes} [Fri Sep 30 09:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:43:15.783077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650c2d8-1b06-4c73-a4bf-9a0dfffc6508 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:15.785165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17bf0f-f1fe-473f-9cfe-0d341877f3ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b4c7ff8b586411aafdec4510626c458)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:15.785264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b650c2d8-1b06-4c73-a4bf-9a0dfffc6508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:15.791400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17bf0f-f1fe-473f-9cfe-0d341877f3ca admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:15.803603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650c2d8-1b06-4c73-a4bf-9a0dfffc6508 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:15.808424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b083e06-cd36-4abc-97e1-6a1dd9ad6973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:15.809753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b083e06-cd36-4abc-97e1-6a1dd9ad6973 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:15.810035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b083e06-cd36-4abc-97e1-6a1dd9ad6973 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:15.810309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b083e06-cd36-4abc-97e1-6a1dd9ad6973 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:15.810940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b083e06-cd36-4abc-97e1-6a1dd9ad6973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:15.812858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b083e06-cd36-4abc-97e1-6a1dd9ad6973 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:15.844009 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 966/1912] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:15 2022] POST /identity/v3/users => generated 291 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:15.844009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b083e06-cd36-4abc-97e1-6a1dd9ad6973 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:15.863145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b083e06-cd36-4abc-97e1-6a1dd9ad6973 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:15.867402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c17bf0f-f1fe-473f-9cfe-0d341877f3ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b4c7ff8b586411aafdec4510626c458'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:15.868516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1e5b2-2c3f-414f-9051-70b69cd99908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:15.869156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1e5b2-2c3f-414f-9051-70b69cd99908 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:15.869442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1e5b2-2c3f-414f-9051-70b69cd99908 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:15.869878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1e5b2-2c3f-414f-9051-70b69cd99908 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:15.870973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1e5b2-2c3f-414f-9051-70b69cd99908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:15.873042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1e5b2-2c3f-414f-9051-70b69cd99908 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:15.876791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c17bf0f-f1fe-473f-9cfe-0d341877f3ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b4c7ff8b586411aafdec4510626c458'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:15.877476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c17bf0f-f1fe-473f-9cfe-0d341877f3ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b4c7ff8b586411aafdec4510626c458'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:15.888766 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 967/1913] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:15.890951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1e5b2-2c3f-414f-9051-70b69cd99908 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:15.893583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d5d1e5b2-2c3f-414f-9051-70b69cd99908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:15.902528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c17bf0f-f1fe-473f-9cfe-0d341877f3ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b4c7ff8b586411aafdec4510626c458'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:15.907985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1e5b2-2c3f-414f-9051-70b69cd99908 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:15.911601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c17bf0f-f1fe-473f-9cfe-0d341877f3ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b4c7ff8b586411aafdec4510626c458'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:15.915394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41780df0-22ac-48ac-b619-50d196b854b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:15.916215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41780df0-22ac-48ac-b619-50d196b854b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:15.916814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41780df0-22ac-48ac-b619-50d196b854b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:15.917248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41780df0-22ac-48ac-b619-50d196b854b3 admin admin] PATH_INFO: `/v3/users/11d9416d751e4587a81977377b1e3c51` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:15.918314 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 947/1914] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:15 2022] DELETE /identity/v3/users/0b4c7ff8b586411aafdec4510626c458 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:15.918728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41780df0-22ac-48ac-b619-50d196b854b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11d9416d751e4587a81977377b1e3c51)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:15.919557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4472cab-0405-426c-ba28-bab5eb4de15f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:15.919837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4472cab-0405-426c-ba28-bab5eb4de15f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:15.920105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4472cab-0405-426c-ba28-bab5eb4de15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:15.921190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41780df0-22ac-48ac-b619-50d196b854b3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:15.959371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a4472cab-0405-426c-ba28-bab5eb4de15f None None] MFA Rules not processed for user `cbb22d0675bc4ca893b0477cebd470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:15.961088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a4472cab-0405-426c-ba28-bab5eb4de15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:15.996053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-41780df0-22ac-48ac-b619-50d196b854b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11d9416d751e4587a81977377b1e3c51'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:15.996857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-41780df0-22ac-48ac-b619-50d196b854b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11d9416d751e4587a81977377b1e3c51'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:16.011480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-41780df0-22ac-48ac-b619-50d196b854b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11d9416d751e4587a81977377b1e3c51'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:16.051048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-41780df0-22ac-48ac-b619-50d196b854b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11d9416d751e4587a81977377b1e3c51'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:16.059957 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:16.063879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-41780df0-22ac-48ac-b619-50d196b854b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11d9416d751e4587a81977377b1e3c51'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:16.072077 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 948/1915] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 09:43:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:16.073966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4472cab-0405-426c-ba28-bab5eb4de15f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:16.075523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a4472cab-0405-426c-ba28-bab5eb4de15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:16.086007 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 968/1916] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:15 2022] DELETE /identity/v3/users/11d9416d751e4587a81977377b1e3c51 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:16.086007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41780df0-22ac-48ac-b619-50d196b854b3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:16.088140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-41780df0-22ac-48ac-b619-50d196b854b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:16.110050 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:16.219307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41780df0-22ac-48ac-b619-50d196b854b3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:16.225739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b596442-2b20-4951-92fb-2f0581da5cb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:16.226530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b596442-2b20-4951-92fb-2f0581da5cb8 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:16.226808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b596442-2b20-4951-92fb-2f0581da5cb8 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:16.227073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b596442-2b20-4951-92fb-2f0581da5cb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:16.229740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4b596442-2b20-4951-92fb-2f0581da5cb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:16.242791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4472cab-0405-426c-ba28-bab5eb4de15f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:16.336619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976aa950-788e-4a4e-878d-890078a44136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:16.338123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976aa950-788e-4a4e-878d-890078a44136 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:16.338489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976aa950-788e-4a4e-878d-890078a44136 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:16.338793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976aa950-788e-4a4e-878d-890078a44136 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:16.338897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b596442-2b20-4951-92fb-2f0581da5cb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:16.339562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976aa950-788e-4a4e-878d-890078a44136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:16.340467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b596442-2b20-4951-92fb-2f0581da5cb8 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:16.341678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976aa950-788e-4a4e-878d-890078a44136 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:16.354582 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 969/1917] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:16.355408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b596442-2b20-4951-92fb-2f0581da5cb8 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:16.357209 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 949/1918] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:16.357818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4b596442-2b20-4951-92fb-2f0581da5cb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:16.358228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976aa950-788e-4a4e-878d-890078a44136 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:16.359899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-976aa950-788e-4a4e-878d-890078a44136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:16.376273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b596442-2b20-4951-92fb-2f0581da5cb8 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:16.392075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3bee2-0b09-4507-ba58-0061534f8ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:16.392920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3bee2-0b09-4507-ba58-0061534f8ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:16.393323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3bee2-0b09-4507-ba58-0061534f8ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:16.393748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3bee2-0b09-4507-ba58-0061534f8ffe admin admin] PATH_INFO: `/v3/projects/51ef2e4421d644d7b6a7fd98f400ffcc/users/b6a0b9cbb6f54e85b0536c9acebb84eb/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:16.428761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3bee2-0b09-4507-ba58-0061534f8ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ef2e4421d644d7b6a7fd98f400ffcc, user_id=b6a0b9cbb6f54e85b0536c9acebb84eb, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:16.435859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3bee2-0b09-4507-ba58-0061534f8ffe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:16.471432 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 970/1919] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:16 2022] PUT /identity/v3/projects/51ef2e4421d644d7b6a7fd98f400ffcc/users/b6a0b9cbb6f54e85b0536c9acebb84eb/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:16.478114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3bee2-0b09-4507-ba58-0061534f8ffe admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:16.485563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-64d3bee2-0b09-4507-ba58-0061534f8ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:16.496866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976aa950-788e-4a4e-878d-890078a44136 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:16.572954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3bee2-0b09-4507-ba58-0061534f8ffe admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:16.578004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11541df2-7190-46d3-baf8-9a34f808db29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:16.578650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11541df2-7190-46d3-baf8-9a34f808db29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:16.579371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11541df2-7190-46d3-baf8-9a34f808db29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:16.579535 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:16.579637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11541df2-7190-46d3-baf8-9a34f808db29 admin admin] PATH_INFO: `/v3/projects/2596452dd7cf48a58276e050c4847a80` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:16.580696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11541df2-7190-46d3-baf8-9a34f808db29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2596452dd7cf48a58276e050c4847a80)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:16.583475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11541df2-7190-46d3-baf8-9a34f808db29 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:16.586695 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:16.596935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd38743-0053-428e-b953-c207a88eacc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:16.597773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd38743-0053-428e-b953-c207a88eacc6 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:16.598271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd38743-0053-428e-b953-c207a88eacc6 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:16.598686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd38743-0053-428e-b953-c207a88eacc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:16.613730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd38743-0053-428e-b953-c207a88eacc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:16.616398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd38743-0053-428e-b953-c207a88eacc6 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:16.644668 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 950/1920] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:16.646300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd38743-0053-428e-b953-c207a88eacc6 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:16.648126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11541df2-7190-46d3-baf8-9a34f808db29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2596452dd7cf48a58276e050c4847a80', 'request_id': 'req-11541df2-7190-46d3-baf8-9a34f808db29'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:16.659341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11541df2-7190-46d3-baf8-9a34f808db29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2596452dd7cf48a58276e050c4847a80', 'request_id': 'req-11541df2-7190-46d3-baf8-9a34f808db29'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:16.663802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd38743-0053-428e-b953-c207a88eacc6 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:16.670726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11541df2-7190-46d3-baf8-9a34f808db29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2596452dd7cf48a58276e050c4847a80', 'request_id': 'req-11541df2-7190-46d3-baf8-9a34f808db29'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:16.691402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11541df2-7190-46d3-baf8-9a34f808db29 admin admin] The token cache is being invalidate because project 2596452dd7cf48a58276e050c4847a80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:16.691917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11541df2-7190-46d3-baf8-9a34f808db29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:16.693248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11541df2-7190-46d3-baf8-9a34f808db29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:16.695390 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 971/1921] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:16 2022] DELETE /identity/v3/projects/2596452dd7cf48a58276e050c4847a80 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:16.697825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782313b9-131d-49fb-83af-ee489504c474 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:16.698368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782313b9-131d-49fb-83af-ee489504c474 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:16.698978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782313b9-131d-49fb-83af-ee489504c474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:16.730685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-782313b9-131d-49fb-83af-ee489504c474 None None] MFA Rules not processed for user `b6a0b9cbb6f54e85b0536c9acebb84eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:16.732077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-782313b9-131d-49fb-83af-ee489504c474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:16.739791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999ef87-86b3-4524-a490-8e1f7adb97c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:16.740404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999ef87-86b3-4524-a490-8e1f7adb97c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:16.741216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999ef87-86b3-4524-a490-8e1f7adb97c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:16.741216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999ef87-86b3-4524-a490-8e1f7adb97c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:16.741976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999ef87-86b3-4524-a490-8e1f7adb97c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:16.744821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999ef87-86b3-4524-a490-8e1f7adb97c8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:16.756916 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 951/1922] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:16.758073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999ef87-86b3-4524-a490-8e1f7adb97c8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:16.766663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2999ef87-86b3-4524-a490-8e1f7adb97c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:16.785471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999ef87-86b3-4524-a490-8e1f7adb97c8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:16.794449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368dce5-45f0-41aa-8764-4ce06b847419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:16.795959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368dce5-45f0-41aa-8764-4ce06b847419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:16.796474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368dce5-45f0-41aa-8764-4ce06b847419 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:16.797257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368dce5-45f0-41aa-8764-4ce06b847419 admin admin] PATH_INFO: `/v3/projects/1f071cecb5e34811896fb894691885eb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:16.799087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368dce5-45f0-41aa-8764-4ce06b847419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f071cecb5e34811896fb894691885eb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:16.802118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368dce5-45f0-41aa-8764-4ce06b847419 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:16.826024 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 972/1923] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:16.826024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782313b9-131d-49fb-83af-ee489504c474 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:16.826024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-782313b9-131d-49fb-83af-ee489504c474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:16.839488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782313b9-131d-49fb-83af-ee489504c474 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:16.845033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ae8bd-01cc-40ed-ad74-d63a00a89ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:16.845738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ae8bd-01cc-40ed-ad74-d63a00a89ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:16.846182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ae8bd-01cc-40ed-ad74-d63a00a89ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:16.846498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ae8bd-01cc-40ed-ad74-d63a00a89ce7 admin admin] PATH_INFO: `/v3/users/637500f51a844565933647dd243be935` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:16.847701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ae8bd-01cc-40ed-ad74-d63a00a89ce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=637500f51a844565933647dd243be935)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:16.849850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ae8bd-01cc-40ed-ad74-d63a00a89ce7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:16.875985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d368dce5-45f0-41aa-8764-4ce06b847419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f071cecb5e34811896fb894691885eb', 'request_id': 'req-d368dce5-45f0-41aa-8764-4ce06b847419'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:16.889089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d368dce5-45f0-41aa-8764-4ce06b847419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f071cecb5e34811896fb894691885eb', 'request_id': 'req-d368dce5-45f0-41aa-8764-4ce06b847419'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:16.902364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d368dce5-45f0-41aa-8764-4ce06b847419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f071cecb5e34811896fb894691885eb', 'request_id': 'req-d368dce5-45f0-41aa-8764-4ce06b847419'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:16.950739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d368dce5-45f0-41aa-8764-4ce06b847419 admin admin] The token cache is being invalidate because project 1f071cecb5e34811896fb894691885eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:16.951040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d368dce5-45f0-41aa-8764-4ce06b847419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:16.952263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d368dce5-45f0-41aa-8764-4ce06b847419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:16.952760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-025ae8bd-01cc-40ed-ad74-d63a00a89ce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '637500f51a844565933647dd243be935'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:16.954043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-025ae8bd-01cc-40ed-ad74-d63a00a89ce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '637500f51a844565933647dd243be935'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:16.957791 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 952/1924] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:16 2022] DELETE /identity/v3/projects/1f071cecb5e34811896fb894691885eb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:16.959246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25f73a-25b5-425c-ab1e-89dfad59b853 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:16.959545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25f73a-25b5-425c-ab1e-89dfad59b853 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:16.960090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25f73a-25b5-425c-ab1e-89dfad59b853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:16.966456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-025ae8bd-01cc-40ed-ad74-d63a00a89ce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '637500f51a844565933647dd243be935'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:16.985304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-025ae8bd-01cc-40ed-ad74-d63a00a89ce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '637500f51a844565933647dd243be935'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:16.987176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1e25f73a-25b5-425c-ab1e-89dfad59b853 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:16.988913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1e25f73a-25b5-425c-ab1e-89dfad59b853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:16.992307 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:16.997414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-025ae8bd-01cc-40ed-ad74-d63a00a89ce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '637500f51a844565933647dd243be935'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:17.011616 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 973/1925] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:16 2022] DELETE /identity/v3/users/637500f51a844565933647dd243be935 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:17.013099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ae8bd-01cc-40ed-ad74-d63a00a89ce7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:17.015131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-025ae8bd-01cc-40ed-ad74-d63a00a89ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:17.074430 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 953/1926] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:17.085732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25f73a-25b5-425c-ab1e-89dfad59b853 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:17.087271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1e25f73a-25b5-425c-ab1e-89dfad59b853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:17.105102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25f73a-25b5-425c-ab1e-89dfad59b853 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:17.109016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ae8bd-01cc-40ed-ad74-d63a00a89ce7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:17.110099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054adaa3-fa6f-4ecf-bf1e-1ad19a688b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:17.110699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054adaa3-fa6f-4ecf-bf1e-1ad19a688b8b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:17.110946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054adaa3-fa6f-4ecf-bf1e-1ad19a688b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:17.111200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054adaa3-fa6f-4ecf-bf1e-1ad19a688b8b admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:17.111834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054adaa3-fa6f-4ecf-bf1e-1ad19a688b8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:17.114084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054adaa3-fa6f-4ecf-bf1e-1ad19a688b8b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:17.116139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e93a4-1f33-4e85-a5c5-a173af3beb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:17.116911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e93a4-1f33-4e85-a5c5-a173af3beb41 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:17.117292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e93a4-1f33-4e85-a5c5-a173af3beb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:17.117663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e93a4-1f33-4e85-a5c5-a173af3beb41 admin admin] PATH_INFO: `/v3/projects/de5ffd7040a74632ad46a5f7d6edfee5/users/f178daeedc3145de85ee82a57e6d8078/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:17.119387 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:17.138144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e93a4-1f33-4e85-a5c5-a173af3beb41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5ffd7040a74632ad46a5f7d6edfee5, user_id=f178daeedc3145de85ee82a57e6d8078, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:17.141107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e93a4-1f33-4e85-a5c5-a173af3beb41 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:17.152276 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 954/1927] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:17 2022] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:17.152276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054adaa3-fa6f-4ecf-bf1e-1ad19a688b8b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:17.152677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-054adaa3-fa6f-4ecf-bf1e-1ad19a688b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:17.160385 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 974/1928] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:17 2022] PUT /identity/v3/projects/de5ffd7040a74632ad46a5f7d6edfee5/users/f178daeedc3145de85ee82a57e6d8078/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:17.161496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41101cc-35f4-4493-b725-036a371af715 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:17.161781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41101cc-35f4-4493-b725-036a371af715 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:17.162048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41101cc-35f4-4493-b725-036a371af715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:17.182598 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c41101cc-35f4-4493-b725-036a371af715 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:17.183807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c41101cc-35f4-4493-b725-036a371af715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:17.236962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054adaa3-fa6f-4ecf-bf1e-1ad19a688b8b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:17.251118 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 975/1929] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:17.252686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2bfbf-fc9b-4afc-a26a-ad45237ca545 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:17.253067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2bfbf-fc9b-4afc-a26a-ad45237ca545 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:17.253434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2bfbf-fc9b-4afc-a26a-ad45237ca545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:17.275743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-23f2bfbf-fc9b-4afc-a26a-ad45237ca545 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:17.277411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-23f2bfbf-fc9b-4afc-a26a-ad45237ca545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:17.288978 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 976/1930] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:17.290096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2bfbf-fc9b-4afc-a26a-ad45237ca545 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:17.311314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2bfbf-fc9b-4afc-a26a-ad45237ca545 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:17.317299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5e475-1d3d-4069-be20-59255dbbc4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:17.318189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5e475-1d3d-4069-be20-59255dbbc4b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:17.318535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5e475-1d3d-4069-be20-59255dbbc4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:17.318922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5e475-1d3d-4069-be20-59255dbbc4b2 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:17.319402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c66f7-3c73-44a4-bb60-8f2bec54a19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:17.319745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5e475-1d3d-4069-be20-59255dbbc4b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:17.320065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c66f7-3c73-44a4-bb60-8f2bec54a19b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:17.320348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c66f7-3c73-44a4-bb60-8f2bec54a19b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:17.320638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c66f7-3c73-44a4-bb60-8f2bec54a19b admin admin] PATH_INFO: `/v3/users/74aa1c64074c41c7a1fd2dd752df2688` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:17.322676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c66f7-3c73-44a4-bb60-8f2bec54a19b admin admin] RBAC: Authorizing `identity:delete_user(user_id=74aa1c64074c41c7a1fd2dd752df2688)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:17.323028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5e475-1d3d-4069-be20-59255dbbc4b2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:17.324582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c66f7-3c73-44a4-bb60-8f2bec54a19b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:17.353883 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 977/1931] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:17 2022] POST /identity/v3/users => generated 300 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:17.355357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10733a-33e7-4b0c-835b-54054c784459 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:17.355742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10733a-33e7-4b0c-835b-54054c784459 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:17.356000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10733a-33e7-4b0c-835b-54054c784459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:17.388222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ee10733a-33e7-4b0c-835b-54054c784459 None None] MFA Rules not processed for user `f178daeedc3145de85ee82a57e6d8078`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:17.389390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ee10733a-33e7-4b0c-835b-54054c784459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:17.393641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d1c66f7-3c73-44a4-bb60-8f2bec54a19b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74aa1c64074c41c7a1fd2dd752df2688'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:17.403702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d1c66f7-3c73-44a4-bb60-8f2bec54a19b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74aa1c64074c41c7a1fd2dd752df2688'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:17.404869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d1c66f7-3c73-44a4-bb60-8f2bec54a19b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74aa1c64074c41c7a1fd2dd752df2688'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:17.425667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d1c66f7-3c73-44a4-bb60-8f2bec54a19b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74aa1c64074c41c7a1fd2dd752df2688'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:17.434956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d1c66f7-3c73-44a4-bb60-8f2bec54a19b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74aa1c64074c41c7a1fd2dd752df2688'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:17.439975 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:17.444075 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 955/1932] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:17 2022] DELETE /identity/v3/users/74aa1c64074c41c7a1fd2dd752df2688 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:17.444947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c66f7-3c73-44a4-bb60-8f2bec54a19b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:17.447787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5d1c66f7-3c73-44a4-bb60-8f2bec54a19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:17.467362 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:17.485983 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 978/1933] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:17.486914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10733a-33e7-4b0c-835b-54054c784459 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:17.490309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ee10733a-33e7-4b0c-835b-54054c784459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:17.521486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10733a-33e7-4b0c-835b-54054c784459 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:17.563523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c66f7-3c73-44a4-bb60-8f2bec54a19b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:17.570877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd64a81-07f4-4c96-bd18-9c30060cca29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:17.572551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd64a81-07f4-4c96-bd18-9c30060cca29 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:17.574680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd64a81-07f4-4c96-bd18-9c30060cca29 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:17.575252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd64a81-07f4-4c96-bd18-9c30060cca29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:17.579201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4dd64a81-07f4-4c96-bd18-9c30060cca29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:17.654148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d983c65-ad6d-4192-b97d-6a9196068c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:17.655336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d983c65-ad6d-4192-b97d-6a9196068c2a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:17.657202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d983c65-ad6d-4192-b97d-6a9196068c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:17.657624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d983c65-ad6d-4192-b97d-6a9196068c2a admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:17.658681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d983c65-ad6d-4192-b97d-6a9196068c2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:17.659100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d983c65-ad6d-4192-b97d-6a9196068c2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:17.661219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d983c65-ad6d-4192-b97d-6a9196068c2a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:17.684239 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 979/1934] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:17.685869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2abaf5-ca07-4a6e-8018-1f82d4db1247 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:17.686247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2abaf5-ca07-4a6e-8018-1f82d4db1247 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:17.686613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2abaf5-ca07-4a6e-8018-1f82d4db1247 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:17.688582 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 980/1935] 10.222.0.16 () {54 vars in 921 bytes} [Fri Sep 30 09:43:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:43:17.689391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2abaf5-ca07-4a6e-8018-1f82d4db1247 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:17.691518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2f2abaf5-ca07-4a6e-8018-1f82d4db1247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:17.705982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd64a81-07f4-4c96-bd18-9c30060cca29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:17.708249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd64a81-07f4-4c96-bd18-9c30060cca29 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:17.712590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2abaf5-ca07-4a6e-8018-1f82d4db1247 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:17.719751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92836d68-35d6-4b15-a9e6-593ee1606bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:17.720714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92836d68-35d6-4b15-a9e6-593ee1606bae admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:17.721291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92836d68-35d6-4b15-a9e6-593ee1606bae admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:17.722017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92836d68-35d6-4b15-a9e6-593ee1606bae admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:17.722701 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 956/1936] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:17.723520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92836d68-35d6-4b15-a9e6-593ee1606bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:17.723744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd64a81-07f4-4c96-bd18-9c30060cca29 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:17.725372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4dd64a81-07f4-4c96-bd18-9c30060cca29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:17.726401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92836d68-35d6-4b15-a9e6-593ee1606bae admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:17.741079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd64a81-07f4-4c96-bd18-9c30060cca29 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:17.744680 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 981/1937] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:17.745900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92836d68-35d6-4b15-a9e6-593ee1606bae admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:17.750683 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476eb42-ed78-4a29-981d-63c46dfe6d4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:17.751304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476eb42-ed78-4a29-981d-63c46dfe6d4a service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:17.751615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476eb42-ed78-4a29-981d-63c46dfe6d4a service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:17.751884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476eb42-ed78-4a29-981d-63c46dfe6d4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:17.759504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92836d68-35d6-4b15-a9e6-593ee1606bae admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:17.769140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f8e59-f798-4724-a3bb-90ce4fe0fe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:17.770390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f8e59-f798-4724-a3bb-90ce4fe0fe48 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:17.771401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f8e59-f798-4724-a3bb-90ce4fe0fe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:17.772024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f8e59-f798-4724-a3bb-90ce4fe0fe48 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:17.773369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f8e59-f798-4724-a3bb-90ce4fe0fe48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:17.777364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f8e59-f798-4724-a3bb-90ce4fe0fe48 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:17.820915 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 982/1938] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:17 2022] POST /identity/v3/projects => generated 403 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:17.822816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceae198-4808-4d44-b9b3-95eec3b90873 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:17.823325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceae198-4808-4d44-b9b3-95eec3b90873 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:17.823690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceae198-4808-4d44-b9b3-95eec3b90873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:17.883016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476eb42-ed78-4a29-981d-63c46dfe6d4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:17.886346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3ceae198-4808-4d44-b9b3-95eec3b90873 None None] MFA Rules not processed for user `a9b0fd833b134a089433cd2985caba80`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:17.887318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476eb42-ed78-4a29-981d-63c46dfe6d4a service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:17.887774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3ceae198-4808-4d44-b9b3-95eec3b90873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:17.914218 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 957/1939] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:17.915778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476eb42-ed78-4a29-981d-63c46dfe6d4a service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:17.929967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476eb42-ed78-4a29-981d-63c46dfe6d4a service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:17.975919 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 983/1940] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 09:43:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:17.976998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceae198-4808-4d44-b9b3-95eec3b90873 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:17.979000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3ceae198-4808-4d44-b9b3-95eec3b90873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:18.030244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea89506-261d-4cd5-af4b-06d3391196ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:18.031210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea89506-261d-4cd5-af4b-06d3391196ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:18.031629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea89506-261d-4cd5-af4b-06d3391196ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:18.032085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea89506-261d-4cd5-af4b-06d3391196ed admin admin] PATH_INFO: `/v3/projects/1bfcfca308654cb1bc6073230e780d8e/users/23ff5b0de4df4681971e2e5033526026/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:18.035161 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:18.049356 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:18.058950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea89506-261d-4cd5-af4b-06d3391196ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfcfca308654cb1bc6073230e780d8e, user_id=23ff5b0de4df4681971e2e5033526026, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:18.064635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea89506-261d-4cd5-af4b-06d3391196ed admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:18.069041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceae198-4808-4d44-b9b3-95eec3b90873 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:18.075341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd8aca-0551-4662-b534-cea85324099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:18.076101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd8aca-0551-4662-b534-cea85324099a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:18.076490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd8aca-0551-4662-b534-cea85324099a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:18.076860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd8aca-0551-4662-b534-cea85324099a admin admin] PATH_INFO: `/v3/projects/b3c4864673594d77a3532b511b97d598` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:18.078108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd8aca-0551-4662-b534-cea85324099a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c4864673594d77a3532b511b97d598)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:18.080074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd8aca-0551-4662-b534-cea85324099a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:18.082189 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 958/1941] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:17 2022] PUT /identity/v3/projects/1bfcfca308654cb1bc6073230e780d8e/users/23ff5b0de4df4681971e2e5033526026/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:18.083122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea89506-261d-4cd5-af4b-06d3391196ed admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:18.168842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46cd8aca-0551-4662-b534-cea85324099a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c4864673594d77a3532b511b97d598', 'request_id': 'req-46cd8aca-0551-4662-b534-cea85324099a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:18.182792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46cd8aca-0551-4662-b534-cea85324099a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c4864673594d77a3532b511b97d598', 'request_id': 'req-46cd8aca-0551-4662-b534-cea85324099a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:18.188946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea89506-261d-4cd5-af4b-06d3391196ed admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:18.199168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46cd8aca-0551-4662-b534-cea85324099a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c4864673594d77a3532b511b97d598', 'request_id': 'req-46cd8aca-0551-4662-b534-cea85324099a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:18.213592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46cd8aca-0551-4662-b534-cea85324099a admin admin] The token cache is being invalidate because project b3c4864673594d77a3532b511b97d598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:18.213978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46cd8aca-0551-4662-b534-cea85324099a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:18.214810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46cd8aca-0551-4662-b534-cea85324099a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:18.216786 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 984/1942] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:17 2022] DELETE /identity/v3/projects/b3c4864673594d77a3532b511b97d598 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:18.217964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd8aca-0551-4662-b534-cea85324099a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:18.220076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-46cd8aca-0551-4662-b534-cea85324099a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:18.305408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5bbb8-20f7-4053-9e83-eb9dd0c511db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:18.306754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5bbb8-20f7-4053-9e83-eb9dd0c511db admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:18.307209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5bbb8-20f7-4053-9e83-eb9dd0c511db admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:18.307489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5bbb8-20f7-4053-9e83-eb9dd0c511db admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:18.308126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5bbb8-20f7-4053-9e83-eb9dd0c511db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:18.310081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5bbb8-20f7-4053-9e83-eb9dd0c511db admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:18.330813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd8aca-0551-4662-b534-cea85324099a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:18.340180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72153cd5-ffd9-4685-aa70-1f4b9bbbf9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:18.343653 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 959/1943] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:18 2022] POST /identity/v3/users => generated 302 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:18.343808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72153cd5-ffd9-4685-aa70-1f4b9bbbf9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:18.343906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5bbb8-20f7-4053-9e83-eb9dd0c511db admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:18.343994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72153cd5-ffd9-4685-aa70-1f4b9bbbf9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:18.343994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72153cd5-ffd9-4685-aa70-1f4b9bbbf9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:18.345610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-06a5bbb8-20f7-4053-9e83-eb9dd0c511db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:18.347250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-72153cd5-ffd9-4685-aa70-1f4b9bbbf9f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:18.360743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5bbb8-20f7-4053-9e83-eb9dd0c511db admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:18.365913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355eb64-6dc6-453a-b108-ed19ebed3a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:18.366800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355eb64-6dc6-453a-b108-ed19ebed3a53 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:18.367178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355eb64-6dc6-453a-b108-ed19ebed3a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:18.367654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355eb64-6dc6-453a-b108-ed19ebed3a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:18.368931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3355eb64-6dc6-453a-b108-ed19ebed3a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:18.370687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3355eb64-6dc6-453a-b108-ed19ebed3a53 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:18.388351 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 960/1944] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:18.389992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310269f0-3c02-4ca5-8bdb-729401c929ce None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:18.390385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310269f0-3c02-4ca5-8bdb-729401c929ce None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:18.390758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310269f0-3c02-4ca5-8bdb-729401c929ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:18.394523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72153cd5-ffd9-4685-aa70-1f4b9bbbf9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:18.396428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72153cd5-ffd9-4685-aa70-1f4b9bbbf9f8 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:18.406889 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 985/1945] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:18.408513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72153cd5-ffd9-4685-aa70-1f4b9bbbf9f8 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:18.410031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-72153cd5-ffd9-4685-aa70-1f4b9bbbf9f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:18.417345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-310269f0-3c02-4ca5-8bdb-729401c929ce None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:18.419601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-310269f0-3c02-4ca5-8bdb-729401c929ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:18.428720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72153cd5-ffd9-4685-aa70-1f4b9bbbf9f8 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:18.431711 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 961/1946] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:18.432901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310269f0-3c02-4ca5-8bdb-729401c929ce None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:18.434002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4907fef-dfc2-4cc8-9830-5ad8d38a0b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:18.434483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-310269f0-3c02-4ca5-8bdb-729401c929ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:18.434764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4907fef-dfc2-4cc8-9830-5ad8d38a0b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:18.435050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4907fef-dfc2-4cc8-9830-5ad8d38a0b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:18.435321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4907fef-dfc2-4cc8-9830-5ad8d38a0b53 admin admin] PATH_INFO: `/v3/projects/a8f115689c3244da9ed1e8796b2bc03a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:18.436440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4907fef-dfc2-4cc8-9830-5ad8d38a0b53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8f115689c3244da9ed1e8796b2bc03a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:18.438408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4907fef-dfc2-4cc8-9830-5ad8d38a0b53 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:18.450307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310269f0-3c02-4ca5-8bdb-729401c929ce None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:18.456139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477e875-de6d-4571-ad09-a3d332606286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:18.457005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477e875-de6d-4571-ad09-a3d332606286 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:18.464811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477e875-de6d-4571-ad09-a3d332606286 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:18.465136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477e875-de6d-4571-ad09-a3d332606286 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:18.465823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477e875-de6d-4571-ad09-a3d332606286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:18.467553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477e875-de6d-4571-ad09-a3d332606286 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:18.486120 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 962/1947] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:18.487518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477e875-de6d-4571-ad09-a3d332606286 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:18.500289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477e875-de6d-4571-ad09-a3d332606286 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:18.506340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147679a3-99f1-4015-ab2f-e9ea79da6044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:18.507483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147679a3-99f1-4015-ab2f-e9ea79da6044 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:18.507964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147679a3-99f1-4015-ab2f-e9ea79da6044 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:18.508530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147679a3-99f1-4015-ab2f-e9ea79da6044 admin admin] PATH_INFO: `/v3/projects/1bfcfca308654cb1bc6073230e780d8e/users/23ff5b0de4df4681971e2e5033526026/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:18.512266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147679a3-99f1-4015-ab2f-e9ea79da6044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfcfca308654cb1bc6073230e780d8e, user_id=23ff5b0de4df4681971e2e5033526026, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:18.515222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147679a3-99f1-4015-ab2f-e9ea79da6044 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:18.530154 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 963/1948] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:18 2022] PUT /identity/v3/projects/1bfcfca308654cb1bc6073230e780d8e/users/23ff5b0de4df4681971e2e5033526026/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:18.531083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4907fef-dfc2-4cc8-9830-5ad8d38a0b53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8f115689c3244da9ed1e8796b2bc03a', 'request_id': 'req-d4907fef-dfc2-4cc8-9830-5ad8d38a0b53'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:18.531558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5963ce3-b934-45fc-aa6b-edc65e5c7cec None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:18.531844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5963ce3-b934-45fc-aa6b-edc65e5c7cec None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:18.532169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5963ce3-b934-45fc-aa6b-edc65e5c7cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:18.546158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4907fef-dfc2-4cc8-9830-5ad8d38a0b53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8f115689c3244da9ed1e8796b2bc03a', 'request_id': 'req-d4907fef-dfc2-4cc8-9830-5ad8d38a0b53'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:18.553216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4907fef-dfc2-4cc8-9830-5ad8d38a0b53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8f115689c3244da9ed1e8796b2bc03a', 'request_id': 'req-d4907fef-dfc2-4cc8-9830-5ad8d38a0b53'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:18.553570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b5963ce3-b934-45fc-aa6b-edc65e5c7cec None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:18.554928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b5963ce3-b934-45fc-aa6b-edc65e5c7cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:18.566047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4907fef-dfc2-4cc8-9830-5ad8d38a0b53 admin admin] The token cache is being invalidate because project a8f115689c3244da9ed1e8796b2bc03a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:18.566370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4907fef-dfc2-4cc8-9830-5ad8d38a0b53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:18.567015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4907fef-dfc2-4cc8-9830-5ad8d38a0b53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:18.568649 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 986/1949] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:18 2022] DELETE /identity/v3/projects/a8f115689c3244da9ed1e8796b2bc03a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:18.573030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4907fef-dfc2-4cc8-9830-5ad8d38a0b53 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:18.573958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d4907fef-dfc2-4cc8-9830-5ad8d38a0b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:18.584577 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:18.600820 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:18.632027 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 964/1950] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:18.632921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5963ce3-b934-45fc-aa6b-edc65e5c7cec None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:18.634988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b5963ce3-b934-45fc-aa6b-edc65e5c7cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:18.646755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5963ce3-b934-45fc-aa6b-edc65e5c7cec None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:18.654217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2ead6-448d-4ef7-a4c6-91a1648f527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:18.655146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2ead6-448d-4ef7-a4c6-91a1648f527e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:18.655721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4907fef-dfc2-4cc8-9830-5ad8d38a0b53 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:18.655955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2ead6-448d-4ef7-a4c6-91a1648f527e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:18.656871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2ead6-448d-4ef7-a4c6-91a1648f527e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:18.657915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2ead6-448d-4ef7-a4c6-91a1648f527e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:18.660119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2ead6-448d-4ef7-a4c6-91a1648f527e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:18.660765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d93e1d-d3e2-4b75-901c-cc611ec4c38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:18.661419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d93e1d-d3e2-4b75-901c-cc611ec4c38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:18.661697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d93e1d-d3e2-4b75-901c-cc611ec4c38a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:18.661971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d93e1d-d3e2-4b75-901c-cc611ec4c38a admin admin] PATH_INFO: `/v3/users/f178daeedc3145de85ee82a57e6d8078` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:18.663635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d93e1d-d3e2-4b75-901c-cc611ec4c38a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f178daeedc3145de85ee82a57e6d8078)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:18.666164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d93e1d-d3e2-4b75-901c-cc611ec4c38a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:18.675400 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 965/1951] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:18.677043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc26ce-d617-4785-ac3a-8031dbeeb2ee None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:18.677189 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc26ce-d617-4785-ac3a-8031dbeeb2ee None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:18.677754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc26ce-d617-4785-ac3a-8031dbeeb2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:18.718651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8bbc26ce-d617-4785-ac3a-8031dbeeb2ee None None] MFA Rules not processed for user `23ff5b0de4df4681971e2e5033526026`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:18.720110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8bbc26ce-d617-4785-ac3a-8031dbeeb2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:18.734116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4d93e1d-d3e2-4b75-901c-cc611ec4c38a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f178daeedc3145de85ee82a57e6d8078'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:18.734801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4d93e1d-d3e2-4b75-901c-cc611ec4c38a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f178daeedc3145de85ee82a57e6d8078'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:18.751202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4d93e1d-d3e2-4b75-901c-cc611ec4c38a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f178daeedc3145de85ee82a57e6d8078'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:18.767549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4d93e1d-d3e2-4b75-901c-cc611ec4c38a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f178daeedc3145de85ee82a57e6d8078'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:18.775514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4d93e1d-d3e2-4b75-901c-cc611ec4c38a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f178daeedc3145de85ee82a57e6d8078'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:18.784867 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 987/1952] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:18 2022] DELETE /identity/v3/users/f178daeedc3145de85ee82a57e6d8078 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:18.784867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d93e1d-d3e2-4b75-901c-cc611ec4c38a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:18.784867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d4d93e1d-d3e2-4b75-901c-cc611ec4c38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:18.815482 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 966/1953] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:18 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:18.816339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc26ce-d617-4785-ac3a-8031dbeeb2ee None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:18.818016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8bbc26ce-d617-4785-ac3a-8031dbeeb2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:18.838407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc26ce-d617-4785-ac3a-8031dbeeb2ee None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:18.883337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d93e1d-d3e2-4b75-901c-cc611ec4c38a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:18.889567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761f2c9-7ae3-4fb7-bf0b-a9aaa1203dcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:18.890239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761f2c9-7ae3-4fb7-bf0b-a9aaa1203dcc service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:18.890523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761f2c9-7ae3-4fb7-bf0b-a9aaa1203dcc service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:18.890795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761f2c9-7ae3-4fb7-bf0b-a9aaa1203dcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:18.892579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f761f2c9-7ae3-4fb7-bf0b-a9aaa1203dcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:18.907086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761f2c9-7ae3-4fb7-bf0b-a9aaa1203dcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:18.908687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761f2c9-7ae3-4fb7-bf0b-a9aaa1203dcc service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:18.912325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadaa8e8-8f0a-44c1-a310-aefbc29937cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:18.913205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaa8e8-8f0a-44c1-a310-aefbc29937cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:18.913650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaa8e8-8f0a-44c1-a310-aefbc29937cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:18.914085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaa8e8-8f0a-44c1-a310-aefbc29937cc admin admin] PATH_INFO: `/v3/users/29d603be2a704ab3be759f66674537b0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:18.919270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadaa8e8-8f0a-44c1-a310-aefbc29937cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=29d603be2a704ab3be759f66674537b0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:18.921667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadaa8e8-8f0a-44c1-a310-aefbc29937cc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:18.930055 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 988/1954] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:18.931191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761f2c9-7ae3-4fb7-bf0b-a9aaa1203dcc service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:18.934325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f761f2c9-7ae3-4fb7-bf0b-a9aaa1203dcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:18.952785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761f2c9-7ae3-4fb7-bf0b-a9aaa1203dcc service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:18.960292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e67ddd-2157-46bb-ab66-d1ff0de4478c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:18.961010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e67ddd-2157-46bb-ab66-d1ff0de4478c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:18.961348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e67ddd-2157-46bb-ab66-d1ff0de4478c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:18.961989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e67ddd-2157-46bb-ab66-d1ff0de4478c admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:18.962737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e67ddd-2157-46bb-ab66-d1ff0de4478c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:18.963144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e67ddd-2157-46bb-ab66-d1ff0de4478c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:18.966182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e67ddd-2157-46bb-ab66-d1ff0de4478c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:18.990187 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 989/1955] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:18.990187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e67ddd-2157-46bb-ab66-d1ff0de4478c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:19.001361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-11e67ddd-2157-46bb-ab66-d1ff0de4478c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:19.017811 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:19.022357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e67ddd-2157-46bb-ab66-d1ff0de4478c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:19.023991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eadaa8e8-8f0a-44c1-a310-aefbc29937cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29d603be2a704ab3be759f66674537b0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:19.029008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c88b31-030a-462a-bab7-c5f2a895f372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:19.029834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c88b31-030a-462a-bab7-c5f2a895f372 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:19.030213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c88b31-030a-462a-bab7-c5f2a895f372 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:19.030618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c88b31-030a-462a-bab7-c5f2a895f372 admin admin] PATH_INFO: `/v3/projects/851f788d9df64a70b805f7e32fe61030/users/2b8e09db6d194eb38b963a5fc58d0903/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:19.048005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eadaa8e8-8f0a-44c1-a310-aefbc29937cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29d603be2a704ab3be759f66674537b0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:19.048663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eadaa8e8-8f0a-44c1-a310-aefbc29937cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29d603be2a704ab3be759f66674537b0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:19.050532 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:19.060474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c88b31-030a-462a-bab7-c5f2a895f372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=851f788d9df64a70b805f7e32fe61030, user_id=2b8e09db6d194eb38b963a5fc58d0903, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:19.066179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c88b31-030a-462a-bab7-c5f2a895f372 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:19.076353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eadaa8e8-8f0a-44c1-a310-aefbc29937cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29d603be2a704ab3be759f66674537b0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:19.084149 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 990/1956] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:18 2022] PUT /identity/v3/projects/851f788d9df64a70b805f7e32fe61030/users/2b8e09db6d194eb38b963a5fc58d0903/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:19.085789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4749a-e52b-460f-b832-8411f5237bcc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:19.086163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4749a-e52b-460f-b832-8411f5237bcc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:19.086854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4749a-e52b-460f-b832-8411f5237bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:19.094654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eadaa8e8-8f0a-44c1-a310-aefbc29937cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29d603be2a704ab3be759f66674537b0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:19.110426 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 967/1957] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:18 2022] DELETE /identity/v3/users/29d603be2a704ab3be759f66674537b0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:19.111452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadaa8e8-8f0a-44c1-a310-aefbc29937cc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:19.111554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-61e4749a-e52b-460f-b832-8411f5237bcc None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:19.113013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eadaa8e8-8f0a-44c1-a310-aefbc29937cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:19.125075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-61e4749a-e52b-460f-b832-8411f5237bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:19.222944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadaa8e8-8f0a-44c1-a310-aefbc29937cc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:19.231987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf566cc-b918-4b4d-bf9e-339df69439f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:19.232732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf566cc-b918-4b4d-bf9e-339df69439f9 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:19.233016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf566cc-b918-4b4d-bf9e-339df69439f9 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:19.233360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf566cc-b918-4b4d-bf9e-339df69439f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:19.235413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0cf566cc-b918-4b4d-bf9e-339df69439f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:19.237093 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 991/1958] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:19.238118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4749a-e52b-460f-b832-8411f5237bcc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:19.239939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-61e4749a-e52b-460f-b832-8411f5237bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:19.257817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4749a-e52b-460f-b832-8411f5237bcc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:19.265334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56881fb-b5a0-4dd8-98fb-13ecb56e18e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:19.265955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56881fb-b5a0-4dd8-98fb-13ecb56e18e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:19.266228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56881fb-b5a0-4dd8-98fb-13ecb56e18e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:19.266494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56881fb-b5a0-4dd8-98fb-13ecb56e18e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:19.267128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56881fb-b5a0-4dd8-98fb-13ecb56e18e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:19.270723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56881fb-b5a0-4dd8-98fb-13ecb56e18e6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:19.312690 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 992/1959] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:19 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:19.312690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8598d55-cf43-476c-b53a-181fdd2d86df None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:19.312690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8598d55-cf43-476c-b53a-181fdd2d86df None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:19.312690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8598d55-cf43-476c-b53a-181fdd2d86df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:19.338138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf566cc-b918-4b4d-bf9e-339df69439f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:19.339875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf566cc-b918-4b4d-bf9e-339df69439f9 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:19.348397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e8598d55-cf43-476c-b53a-181fdd2d86df None None] MFA Rules not processed for user `2b8e09db6d194eb38b963a5fc58d0903`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:19.350338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e8598d55-cf43-476c-b53a-181fdd2d86df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:19.351269 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 968/1960] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:19 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:19.354843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf566cc-b918-4b4d-bf9e-339df69439f9 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:19.355606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0cf566cc-b918-4b4d-bf9e-339df69439f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:19.451565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf566cc-b918-4b4d-bf9e-339df69439f9 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:19.468177 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 993/1961] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:19 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:19.469685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70de02-f65f-4cae-87f5-3b7a4e734e32 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:19.469987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70de02-f65f-4cae-87f5-3b7a4e734e32 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:19.470245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70de02-f65f-4cae-87f5-3b7a4e734e32 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:19.476743 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 994/1962] 10.222.0.16 () {54 vars in 921 bytes} [Fri Sep 30 09:43:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:43:19.478200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70de02-f65f-4cae-87f5-3b7a4e734e32 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:19.486780 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:19.555305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94970c5a-2b63-4d59-b807-52f2102cb87c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:19.557004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94970c5a-2b63-4d59-b807-52f2102cb87c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:19.557510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94970c5a-2b63-4d59-b807-52f2102cb87c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:19.557955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94970c5a-2b63-4d59-b807-52f2102cb87c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:19.570204 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:19.596218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70de02-f65f-4cae-87f5-3b7a4e734e32 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:19.603986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d760d-585b-4f6e-894e-dbe7e3955acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:19.604725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d760d-585b-4f6e-894e-dbe7e3955acc admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:19.605008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d760d-585b-4f6e-894e-dbe7e3955acc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:19.605467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d760d-585b-4f6e-894e-dbe7e3955acc admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:19.606354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d760d-585b-4f6e-894e-dbe7e3955acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:19.608484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d760d-585b-4f6e-894e-dbe7e3955acc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:19.646561 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 995/1963] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:19 2022] POST /identity/v3/users => generated 291 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:19.647682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d760d-585b-4f6e-894e-dbe7e3955acc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:19.663831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94970c5a-2b63-4d59-b807-52f2102cb87c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:19.666293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94970c5a-2b63-4d59-b807-52f2102cb87c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:19.693867 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 969/1964] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:19.694716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94970c5a-2b63-4d59-b807-52f2102cb87c service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:19.706018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-94970c5a-2b63-4d59-b807-52f2102cb87c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:19.725316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94970c5a-2b63-4d59-b807-52f2102cb87c service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:19.734364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9c37f-8430-4034-8f65-bb7520d49fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:19.736133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9c37f-8430-4034-8f65-bb7520d49fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:19.736646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9c37f-8430-4034-8f65-bb7520d49fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:19.737123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9c37f-8430-4034-8f65-bb7520d49fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:19.738789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9c37f-8430-4034-8f65-bb7520d49fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:19.741577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9c37f-8430-4034-8f65-bb7520d49fe4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:19.800965 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 970/1965] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:19 2022] POST /identity/v3/projects => generated 403 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:19.803363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e0c9a-8053-42f7-9dd1-f6c27f15fab1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:19.804335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e0c9a-8053-42f7-9dd1-f6c27f15fab1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:19.805196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e0c9a-8053-42f7-9dd1-f6c27f15fab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:19.812217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d760d-585b-4f6e-894e-dbe7e3955acc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:19.838422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-198e0c9a-8053-42f7-9dd1-f6c27f15fab1 None None] MFA Rules not processed for user `aa607111024540d1a09b01dfd1e5e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:19.841822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-198e0c9a-8053-42f7-9dd1-f6c27f15fab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:19.912204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23cc7c-2579-4d6c-adb5-759241a2d994 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:19.912927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23cc7c-2579-4d6c-adb5-759241a2d994 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:19.913211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23cc7c-2579-4d6c-adb5-759241a2d994 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:19.913486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23cc7c-2579-4d6c-adb5-759241a2d994 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:19.919758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8e23cc7c-2579-4d6c-adb5-759241a2d994 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:19.984329 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 971/1966] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 09:43:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:19.985379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e0c9a-8053-42f7-9dd1-f6c27f15fab1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:19.986603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-198e0c9a-8053-42f7-9dd1-f6c27f15fab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:20.018635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23cc7c-2579-4d6c-adb5-759241a2d994 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:20.020262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23cc7c-2579-4d6c-adb5-759241a2d994 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:20.034659 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 996/1967] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:20.035707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23cc7c-2579-4d6c-adb5-759241a2d994 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:20.053016 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:20.075567 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:20.082325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e0c9a-8053-42f7-9dd1-f6c27f15fab1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:20.087676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec632f0b-068a-4f04-86b5-68a1bc7fa2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:20.088291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec632f0b-068a-4f04-86b5-68a1bc7fa2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:20.088559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec632f0b-068a-4f04-86b5-68a1bc7fa2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:20.089268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec632f0b-068a-4f04-86b5-68a1bc7fa2e7 admin admin] PATH_INFO: `/v3/projects/bca54ad2d71c4edca55c538eec84cbeb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:20.090506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec632f0b-068a-4f04-86b5-68a1bc7fa2e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bca54ad2d71c4edca55c538eec84cbeb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:20.092346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec632f0b-068a-4f04-86b5-68a1bc7fa2e7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:20.161924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23cc7c-2579-4d6c-adb5-759241a2d994 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:20.189357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ec632f0b-068a-4f04-86b5-68a1bc7fa2e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bca54ad2d71c4edca55c538eec84cbeb', 'request_id': 'req-ec632f0b-068a-4f04-86b5-68a1bc7fa2e7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:20.210337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ec632f0b-068a-4f04-86b5-68a1bc7fa2e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bca54ad2d71c4edca55c538eec84cbeb', 'request_id': 'req-ec632f0b-068a-4f04-86b5-68a1bc7fa2e7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:20.222901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ec632f0b-068a-4f04-86b5-68a1bc7fa2e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bca54ad2d71c4edca55c538eec84cbeb', 'request_id': 'req-ec632f0b-068a-4f04-86b5-68a1bc7fa2e7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:20.238468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ec632f0b-068a-4f04-86b5-68a1bc7fa2e7 admin admin] The token cache is being invalidate because project bca54ad2d71c4edca55c538eec84cbeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:20.238644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ec632f0b-068a-4f04-86b5-68a1bc7fa2e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:20.240021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ec632f0b-068a-4f04-86b5-68a1bc7fa2e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:20.245075 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 972/1968] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:19 2022] DELETE /identity/v3/projects/bca54ad2d71c4edca55c538eec84cbeb => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:20.245075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec632f0b-068a-4f04-86b5-68a1bc7fa2e7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:20.245075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ec632f0b-068a-4f04-86b5-68a1bc7fa2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:20.255935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9eb735-1a10-4c22-a8bd-784855939b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:20.256636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9eb735-1a10-4c22-a8bd-784855939b40 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:20.257237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9eb735-1a10-4c22-a8bd-784855939b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:20.257237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9eb735-1a10-4c22-a8bd-784855939b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:20.257918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9eb735-1a10-4c22-a8bd-784855939b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:20.260110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9eb735-1a10-4c22-a8bd-784855939b40 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:20.271071 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 997/1969] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:20.271903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9eb735-1a10-4c22-a8bd-784855939b40 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:20.274212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7e9eb735-1a10-4c22-a8bd-784855939b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:20.349104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9eb735-1a10-4c22-a8bd-784855939b40 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:20.361721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29720665-b00a-49e8-8ab4-e2a30b361de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:20.363619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29720665-b00a-49e8-8ab4-e2a30b361de3 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:20.363899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29720665-b00a-49e8-8ab4-e2a30b361de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:20.364163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29720665-b00a-49e8-8ab4-e2a30b361de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:20.365981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-29720665-b00a-49e8-8ab4-e2a30b361de3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:20.372943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec632f0b-068a-4f04-86b5-68a1bc7fa2e7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:20.385832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e1274-9f63-4639-9ecc-6534816b2ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:20.386470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e1274-9f63-4639-9ecc-6534816b2ada admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:20.386795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e1274-9f63-4639-9ecc-6534816b2ada admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:20.387075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e1274-9f63-4639-9ecc-6534816b2ada admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:20.387769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e1274-9f63-4639-9ecc-6534816b2ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:20.389800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e1274-9f63-4639-9ecc-6534816b2ada admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:20.432283 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 973/1970] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:20 2022] POST /identity/v3/users => generated 308 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:20.433673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e1274-9f63-4639-9ecc-6534816b2ada admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:20.436736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e78e1274-9f63-4639-9ecc-6534816b2ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:20.457444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29720665-b00a-49e8-8ab4-e2a30b361de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:20.457444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29720665-b00a-49e8-8ab4-e2a30b361de3 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:20.462879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e1274-9f63-4639-9ecc-6534816b2ada admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:20.463396 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:20.471480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100456b-8577-417d-bf87-a12811b41aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:20.472113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100456b-8577-417d-bf87-a12811b41aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:20.472394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100456b-8577-417d-bf87-a12811b41aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:20.472731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100456b-8577-417d-bf87-a12811b41aa8 admin admin] PATH_INFO: `/v3/projects/de5ffd7040a74632ad46a5f7d6edfee5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:20.479389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100456b-8577-417d-bf87-a12811b41aa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de5ffd7040a74632ad46a5f7d6edfee5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:20.481330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100456b-8577-417d-bf87-a12811b41aa8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:20.481989 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 998/1971] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:20.484558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482318ba-7501-4b47-80de-7daee1791a59 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:20.484867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482318ba-7501-4b47-80de-7daee1791a59 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:20.485274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482318ba-7501-4b47-80de-7daee1791a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:20.519502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-482318ba-7501-4b47-80de-7daee1791a59 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:20.521409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-482318ba-7501-4b47-80de-7daee1791a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:20.546133 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 999/1972] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:20.546512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482318ba-7501-4b47-80de-7daee1791a59 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:20.553659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-482318ba-7501-4b47-80de-7daee1791a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:20.567580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482318ba-7501-4b47-80de-7daee1791a59 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:20.585111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f100456b-8577-417d-bf87-a12811b41aa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de5ffd7040a74632ad46a5f7d6edfee5', 'request_id': 'req-f100456b-8577-417d-bf87-a12811b41aa8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:20.589806 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=12,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:20.599903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f100456b-8577-417d-bf87-a12811b41aa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de5ffd7040a74632ad46a5f7d6edfee5', 'request_id': 'req-f100456b-8577-417d-bf87-a12811b41aa8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:20.610230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f100456b-8577-417d-bf87-a12811b41aa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de5ffd7040a74632ad46a5f7d6edfee5', 'request_id': 'req-f100456b-8577-417d-bf87-a12811b41aa8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:20.625464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f100456b-8577-417d-bf87-a12811b41aa8 admin admin] The token cache is being invalidate because project de5ffd7040a74632ad46a5f7d6edfee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:20.625784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f100456b-8577-417d-bf87-a12811b41aa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:20.626446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f100456b-8577-417d-bf87-a12811b41aa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:20.630534 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 974/1973] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:20 2022] DELETE /identity/v3/projects/de5ffd7040a74632ad46a5f7d6edfee5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:20.631546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100456b-8577-417d-bf87-a12811b41aa8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:20.632973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f100456b-8577-417d-bf87-a12811b41aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:20.669806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae89e42-10f9-464a-b68d-dd6c8279a310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:20.671127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae89e42-10f9-464a-b68d-dd6c8279a310 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:20.671408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae89e42-10f9-464a-b68d-dd6c8279a310 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:20.671671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae89e42-10f9-464a-b68d-dd6c8279a310 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:20.672318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae89e42-10f9-464a-b68d-dd6c8279a310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:20.673945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae89e42-10f9-464a-b68d-dd6c8279a310 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:20.688041 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1000/1974] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:20.688041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3612599-414a-4e30-a39c-dc6d79c33247 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:20.688041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3612599-414a-4e30-a39c-dc6d79c33247 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:20.688041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3612599-414a-4e30-a39c-dc6d79c33247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:20.709621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a3612599-414a-4e30-a39c-dc6d79c33247 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:20.715115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a3612599-414a-4e30-a39c-dc6d79c33247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:20.734523 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1001/1975] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:20.735938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec489de3-ae82-40ce-8df2-300610c1861b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:20.736316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec489de3-ae82-40ce-8df2-300610c1861b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:20.736718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec489de3-ae82-40ce-8df2-300610c1861b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:20.761006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ec489de3-ae82-40ce-8df2-300610c1861b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:20.762889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ec489de3-ae82-40ce-8df2-300610c1861b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:20.765031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100456b-8577-417d-bf87-a12811b41aa8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:20.770594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b5b2b-ab56-42f0-81de-75a61e7f992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:20.778829 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1002/1976] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:20.779101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b5b2b-ab56-42f0-81de-75a61e7f992b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:20.779101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b5b2b-ab56-42f0-81de-75a61e7f992b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:20.779101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b5b2b-ab56-42f0-81de-75a61e7f992b admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:20.779352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec489de3-ae82-40ce-8df2-300610c1861b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:20.779436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b5b2b-ab56-42f0-81de-75a61e7f992b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:20.779517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ec489de3-ae82-40ce-8df2-300610c1861b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:20.779600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b5b2b-ab56-42f0-81de-75a61e7f992b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:20.788896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec489de3-ae82-40ce-8df2-300610c1861b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:20.794321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fda78-f476-45c0-b2ae-1c84e24eabf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:20.794963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fda78-f476-45c0-b2ae-1c84e24eabf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:20.795241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fda78-f476-45c0-b2ae-1c84e24eabf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:20.795513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fda78-f476-45c0-b2ae-1c84e24eabf3 admin admin] PATH_INFO: `/v3/users/b6a0b9cbb6f54e85b0536c9acebb84eb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:20.796736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fda78-f476-45c0-b2ae-1c84e24eabf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6a0b9cbb6f54e85b0536c9acebb84eb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:20.798642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fda78-f476-45c0-b2ae-1c84e24eabf3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:20.804662 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 975/1977] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:20.806908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b5b2b-ab56-42f0-81de-75a61e7f992b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:20.811316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7d7b5b2b-ab56-42f0-81de-75a61e7f992b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:20.842261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b5b2b-ab56-42f0-81de-75a61e7f992b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:20.853843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac776b-74ac-4864-bb38-452c31a750dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:20.854703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac776b-74ac-4864-bb38-452c31a750dc admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:20.855045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac776b-74ac-4864-bb38-452c31a750dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:20.855386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac776b-74ac-4864-bb38-452c31a750dc admin admin] PATH_INFO: `/v3/projects/6a8af9c909d548858ee3d922c68259b7/users/eda6ecf4563c45238ec0ae9af09c60ff/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:20.865854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ed8fda78-f476-45c0-b2ae-1c84e24eabf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6a0b9cbb6f54e85b0536c9acebb84eb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:20.866657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ed8fda78-f476-45c0-b2ae-1c84e24eabf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6a0b9cbb6f54e85b0536c9acebb84eb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:20.878057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ed8fda78-f476-45c0-b2ae-1c84e24eabf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6a0b9cbb6f54e85b0536c9acebb84eb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:20.890955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac776b-74ac-4864-bb38-452c31a750dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a8af9c909d548858ee3d922c68259b7, user_id=eda6ecf4563c45238ec0ae9af09c60ff, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:20.893849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac776b-74ac-4864-bb38-452c31a750dc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:20.895146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ed8fda78-f476-45c0-b2ae-1c84e24eabf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6a0b9cbb6f54e85b0536c9acebb84eb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:20.905416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ed8fda78-f476-45c0-b2ae-1c84e24eabf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6a0b9cbb6f54e85b0536c9acebb84eb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:20.914637 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 976/1978] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:20 2022] PUT /identity/v3/projects/6a8af9c909d548858ee3d922c68259b7/users/eda6ecf4563c45238ec0ae9af09c60ff/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:20.916750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac776b-74ac-4864-bb38-452c31a750dc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:20.925759 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1003/1979] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:20 2022] DELETE /identity/v3/users/b6a0b9cbb6f54e85b0536c9acebb84eb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:20.927464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e03d2-ec85-4987-8e40-8b504c1a1479 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:20.928386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a7ac776b-74ac-4864-bb38-452c31a750dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:20.933277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e03d2-ec85-4987-8e40-8b504c1a1479 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:20.933559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e03d2-ec85-4987-8e40-8b504c1a1479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:20.984158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6f7e03d2-ec85-4987-8e40-8b504c1a1479 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:20.986642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6f7e03d2-ec85-4987-8e40-8b504c1a1479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:21.046104 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac776b-74ac-4864-bb38-452c31a750dc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:21.052416 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:21.072507 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1004/1980] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:21.072507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e03d2-ec85-4987-8e40-8b504c1a1479 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:21.073181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6f7e03d2-ec85-4987-8e40-8b504c1a1479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:21.084957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e03d2-ec85-4987-8e40-8b504c1a1479 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:21.091309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95e6f6-4372-48f5-908a-7228a155fb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:21.092158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95e6f6-4372-48f5-908a-7228a155fb22 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:21.092520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95e6f6-4372-48f5-908a-7228a155fb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:21.092888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95e6f6-4372-48f5-908a-7228a155fb22 admin admin] PATH_INFO: `/v3/projects/5f3a8950fb084966bea2581177520a23/users/6aea2af32477422b913372adbfafcc08/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:21.109084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95e6f6-4372-48f5-908a-7228a155fb22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3a8950fb084966bea2581177520a23, user_id=6aea2af32477422b913372adbfafcc08, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:21.111847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95e6f6-4372-48f5-908a-7228a155fb22 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:21.115148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875451a1-49c3-4851-899e-291fb2ef7ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:21.115767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875451a1-49c3-4851-899e-291fb2ef7ade admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:21.116048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875451a1-49c3-4851-899e-291fb2ef7ade admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:21.116315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875451a1-49c3-4851-899e-291fb2ef7ade admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:21.117179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875451a1-49c3-4851-899e-291fb2ef7ade admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:21.117716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875451a1-49c3-4851-899e-291fb2ef7ade admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:21.120446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875451a1-49c3-4851-899e-291fb2ef7ade admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:21.123115 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:21.139516 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1005/1981] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:21 2022] PUT /identity/v3/projects/5f3a8950fb084966bea2581177520a23/users/6aea2af32477422b913372adbfafcc08/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:21.139723 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 977/1982] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:21.140881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920977d2-6f2f-4c03-ad54-893e7d3821ac None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:21.141209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920977d2-6f2f-4c03-ad54-893e7d3821ac None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:21.141389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4b00f-1183-4ba8-bdce-6b11bcb7ee1f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:21.141494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920977d2-6f2f-4c03-ad54-893e7d3821ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:21.141679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4b00f-1183-4ba8-bdce-6b11bcb7ee1f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:21.142544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4b00f-1183-4ba8-bdce-6b11bcb7ee1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:21.164184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-920977d2-6f2f-4c03-ad54-893e7d3821ac None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:21.165937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-920977d2-6f2f-4c03-ad54-893e7d3821ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:21.187800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c2c4b00f-1183-4ba8-bdce-6b11bcb7ee1f None None] MFA Rules not processed for user `eda6ecf4563c45238ec0ae9af09c60ff`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:21.189691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c2c4b00f-1183-4ba8-bdce-6b11bcb7ee1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:21.240090 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 978/1983] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:21.241612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920977d2-6f2f-4c03-ad54-893e7d3821ac None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:21.264494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920977d2-6f2f-4c03-ad54-893e7d3821ac None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:21.270367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b2136-bb2f-45b0-809e-1e1f9f3515c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:21.271041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b2136-bb2f-45b0-809e-1e1f9f3515c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:21.271323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b2136-bb2f-45b0-809e-1e1f9f3515c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:21.271866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b2136-bb2f-45b0-809e-1e1f9f3515c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:21.272533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b2136-bb2f-45b0-809e-1e1f9f3515c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:21.273394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b2136-bb2f-45b0-809e-1e1f9f3515c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:21.275998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b2136-bb2f-45b0-809e-1e1f9f3515c4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:21.292929 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 979/1984] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:21.297221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b2136-bb2f-45b0-809e-1e1f9f3515c4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:21.311750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b2136-bb2f-45b0-809e-1e1f9f3515c4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:21.316227 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1006/1985] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:21.317397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4b00f-1183-4ba8-bdce-6b11bcb7ee1f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:21.320684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de6a6a-729b-4eb7-98df-98f368c35b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:21.324222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de6a6a-729b-4eb7-98df-98f368c35b2f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:21.325183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de6a6a-729b-4eb7-98df-98f368c35b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:21.325567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de6a6a-729b-4eb7-98df-98f368c35b2f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:21.326437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de6a6a-729b-4eb7-98df-98f368c35b2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:21.328430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de6a6a-729b-4eb7-98df-98f368c35b2f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:21.343757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4b00f-1183-4ba8-bdce-6b11bcb7ee1f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:21.349771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb0b42-86b1-4b3d-abab-f3bf53376380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:21.351030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb0b42-86b1-4b3d-abab-f3bf53376380 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:21.351452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb0b42-86b1-4b3d-abab-f3bf53376380 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:21.351854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb0b42-86b1-4b3d-abab-f3bf53376380 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:21.353185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb0b42-86b1-4b3d-abab-f3bf53376380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:21.355265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb0b42-86b1-4b3d-abab-f3bf53376380 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:21.371664 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1007/1986] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:21.372759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb0b42-86b1-4b3d-abab-f3bf53376380 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:21.372879 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 980/1987] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:21 2022] POST /identity/v3/projects => generated 409 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:21.373929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de6a6a-729b-4eb7-98df-98f368c35b2f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:21.376924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-55bb0b42-86b1-4b3d-abab-f3bf53376380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:21.473088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de6a6a-729b-4eb7-98df-98f368c35b2f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:21.474353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb0b42-86b1-4b3d-abab-f3bf53376380 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:21.478686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303fa67-9393-406c-a587-70849e8fc2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:21.479443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303fa67-9393-406c-a587-70849e8fc2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:21.479717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303fa67-9393-406c-a587-70849e8fc2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:21.479984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303fa67-9393-406c-a587-70849e8fc2d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:21.480639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303fa67-9393-406c-a587-70849e8fc2d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:21.482526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303fa67-9393-406c-a587-70849e8fc2d7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:21.515621 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 981/1988] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:21 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:21.516636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303fa67-9393-406c-a587-70849e8fc2d7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:21.518180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6303fa67-9393-406c-a587-70849e8fc2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:21.548771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fcfd2c-ed73-4bd6-9718-df64ccb3c03d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:21.549674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcfd2c-ed73-4bd6-9718-df64ccb3c03d service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:21.550150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcfd2c-ed73-4bd6-9718-df64ccb3c03d service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:21.551298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcfd2c-ed73-4bd6-9718-df64ccb3c03d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:21.562731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fcfd2c-ed73-4bd6-9718-df64ccb3c03d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:21.564176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fcfd2c-ed73-4bd6-9718-df64ccb3c03d service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:21.569147 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:21.575431 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1008/1989] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:21.576485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fcfd2c-ed73-4bd6-9718-df64ccb3c03d service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:21.582329 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:21.588704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fcfd2c-ed73-4bd6-9718-df64ccb3c03d service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:21.595104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55cf68-7fee-4da6-9507-44a5d4cfc1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:21.595883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55cf68-7fee-4da6-9507-44a5d4cfc1bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:21.596255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55cf68-7fee-4da6-9507-44a5d4cfc1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:21.596634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55cf68-7fee-4da6-9507-44a5d4cfc1bc admin admin] PATH_INFO: `/v3/projects/5f3a8950fb084966bea2581177520a23/users/6aea2af32477422b913372adbfafcc08/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:21.598790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55cf68-7fee-4da6-9507-44a5d4cfc1bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3a8950fb084966bea2581177520a23, user_id=6aea2af32477422b913372adbfafcc08, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:21.599796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303fa67-9393-406c-a587-70849e8fc2d7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:21.601838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55cf68-7fee-4da6-9507-44a5d4cfc1bc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:21.606228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80235cf2-8a0d-49d7-8506-bf8d07bc01e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:21.607218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80235cf2-8a0d-49d7-8506-bf8d07bc01e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:21.607218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80235cf2-8a0d-49d7-8506-bf8d07bc01e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:21.607418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80235cf2-8a0d-49d7-8506-bf8d07bc01e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:21.614365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80235cf2-8a0d-49d7-8506-bf8d07bc01e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:21.617077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80235cf2-8a0d-49d7-8506-bf8d07bc01e9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:21.625827 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1009/1990] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:21 2022] PUT /identity/v3/projects/5f3a8950fb084966bea2581177520a23/users/6aea2af32477422b913372adbfafcc08/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:21.627007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55cf68-7fee-4da6-9507-44a5d4cfc1bc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:21.665750 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 982/1991] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:21 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:21.666938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80235cf2-8a0d-49d7-8506-bf8d07bc01e9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:21.770179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55cf68-7fee-4da6-9507-44a5d4cfc1bc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:21.821918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80235cf2-8a0d-49d7-8506-bf8d07bc01e9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:21.832299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b674046-8f6d-40a3-a424-e7f0549399aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:21.832923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b674046-8f6d-40a3-a424-e7f0549399aa admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:21.833198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b674046-8f6d-40a3-a424-e7f0549399aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:21.833465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b674046-8f6d-40a3-a424-e7f0549399aa admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:21.840791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b674046-8f6d-40a3-a424-e7f0549399aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:21.842918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b674046-8f6d-40a3-a424-e7f0549399aa admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:21.887544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3df62-55a5-457c-8890-3d7d9034d876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:21.888467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3df62-55a5-457c-8890-3d7d9034d876 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:21.888977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3df62-55a5-457c-8890-3d7d9034d876 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:21.889397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3df62-55a5-457c-8890-3d7d9034d876 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:21.890228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3df62-55a5-457c-8890-3d7d9034d876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:21.892614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3df62-55a5-457c-8890-3d7d9034d876 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:21.897624 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 983/1992] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:21 2022] POST /identity/v3/users => generated 292 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:21.902627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83274d24-73ba-4dda-ae54-0967ebb62a27 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:21.902918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83274d24-73ba-4dda-ae54-0967ebb62a27 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:21.903189 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83274d24-73ba-4dda-ae54-0967ebb62a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:21.930216 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1010/1993] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:21 2022] POST /identity/v3/users => generated 305 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:21.934654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3df62-55a5-457c-8890-3d7d9034d876 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:21.952818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3df62-55a5-457c-8890-3d7d9034d876 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:21.961162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2f038-183b-4627-86b9-b2cce8a7675a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:21.961826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2f038-183b-4627-86b9-b2cce8a7675a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:21.962414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2f038-183b-4627-86b9-b2cce8a7675a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:21.962765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2f038-183b-4627-86b9-b2cce8a7675a admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:21.964497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2f038-183b-4627-86b9-b2cce8a7675a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:21.966956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2f038-183b-4627-86b9-b2cce8a7675a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:21.968496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-83274d24-73ba-4dda-ae54-0967ebb62a27 None None] MFA Rules not processed for user `6aea2af32477422b913372adbfafcc08`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:21.969814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-83274d24-73ba-4dda-ae54-0967ebb62a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:22.022905 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1011/1994] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:21 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:22.023845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2f038-183b-4627-86b9-b2cce8a7675a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:22.035174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2f038-183b-4627-86b9-b2cce8a7675a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:22.050218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a8822-05a9-4e0e-8dd4-1f3456278f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:22.050913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a8822-05a9-4e0e-8dd4-1f3456278f58 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:22.051306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a8822-05a9-4e0e-8dd4-1f3456278f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:22.051577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a8822-05a9-4e0e-8dd4-1f3456278f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:22.052355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a8822-05a9-4e0e-8dd4-1f3456278f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:22.058689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a8822-05a9-4e0e-8dd4-1f3456278f58 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:22.075741 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1012/1995] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:22.076706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a8822-05a9-4e0e-8dd4-1f3456278f58 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:22.088409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a8822-05a9-4e0e-8dd4-1f3456278f58 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:22.092735 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 984/1996] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:21 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:22.093643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ac135-92de-42f2-a732-342a1ce5a679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:22.094078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83274d24-73ba-4dda-ae54-0967ebb62a27 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:22.094459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ac135-92de-42f2-a732-342a1ce5a679 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:22.094738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ac135-92de-42f2-a732-342a1ce5a679 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:22.095007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ac135-92de-42f2-a732-342a1ce5a679 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:22.095665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ac135-92de-42f2-a732-342a1ce5a679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:22.097455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ac135-92de-42f2-a732-342a1ce5a679 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:22.104577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-83274d24-73ba-4dda-ae54-0967ebb62a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:22.112464 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1013/1997] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:22.112464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ac135-92de-42f2-a732-342a1ce5a679 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:22.125487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83274d24-73ba-4dda-ae54-0967ebb62a27 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:22.126451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ac135-92de-42f2-a732-342a1ce5a679 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:22.131330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791450cd-4c3c-4508-aa89-c80eaed4a114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:22.131501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c23d98-53ca-439c-9bdf-58282350f741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:22.132065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c23d98-53ca-439c-9bdf-58282350f741 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:22.132147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791450cd-4c3c-4508-aa89-c80eaed4a114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:22.132403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c23d98-53ca-439c-9bdf-58282350f741 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:22.132488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791450cd-4c3c-4508-aa89-c80eaed4a114 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:22.132714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c23d98-53ca-439c-9bdf-58282350f741 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:22.132883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791450cd-4c3c-4508-aa89-c80eaed4a114 admin admin] PATH_INFO: `/v3/projects/51ef2e4421d644d7b6a7fd98f400ffcc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:22.133423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c23d98-53ca-439c-9bdf-58282350f741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:22.134265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791450cd-4c3c-4508-aa89-c80eaed4a114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51ef2e4421d644d7b6a7fd98f400ffcc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:22.136005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c23d98-53ca-439c-9bdf-58282350f741 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:22.136210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791450cd-4c3c-4508-aa89-c80eaed4a114 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:22.150335 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1014/1998] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:22.155098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c23d98-53ca-439c-9bdf-58282350f741 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:22.167891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c23d98-53ca-439c-9bdf-58282350f741 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:22.177199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009ac9e-13da-43d3-82ef-47be419c3592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:22.177885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009ac9e-13da-43d3-82ef-47be419c3592 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:22.178171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009ac9e-13da-43d3-82ef-47be419c3592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:22.178426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009ac9e-13da-43d3-82ef-47be419c3592 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:22.179194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009ac9e-13da-43d3-82ef-47be419c3592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:22.181029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009ac9e-13da-43d3-82ef-47be419c3592 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:22.194722 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:22.206133 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1015/1999] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:22.207928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009ac9e-13da-43d3-82ef-47be419c3592 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:22.210985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3009ac9e-13da-43d3-82ef-47be419c3592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:22.216902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-791450cd-4c3c-4508-aa89-c80eaed4a114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ef2e4421d644d7b6a7fd98f400ffcc', 'request_id': 'req-791450cd-4c3c-4508-aa89-c80eaed4a114'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:22.228885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-791450cd-4c3c-4508-aa89-c80eaed4a114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ef2e4421d644d7b6a7fd98f400ffcc', 'request_id': 'req-791450cd-4c3c-4508-aa89-c80eaed4a114'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:22.237240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-791450cd-4c3c-4508-aa89-c80eaed4a114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ef2e4421d644d7b6a7fd98f400ffcc', 'request_id': 'req-791450cd-4c3c-4508-aa89-c80eaed4a114'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:22.249879 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:22.255154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-791450cd-4c3c-4508-aa89-c80eaed4a114 admin admin] The token cache is being invalidate because project 51ef2e4421d644d7b6a7fd98f400ffcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:22.256431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-791450cd-4c3c-4508-aa89-c80eaed4a114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:22.258015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-791450cd-4c3c-4508-aa89-c80eaed4a114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:22.262685 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 985/2000] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:22 2022] DELETE /identity/v3/projects/51ef2e4421d644d7b6a7fd98f400ffcc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:22.264154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791450cd-4c3c-4508-aa89-c80eaed4a114 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:22.266079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-791450cd-4c3c-4508-aa89-c80eaed4a114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:22.338361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009ac9e-13da-43d3-82ef-47be419c3592 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:22.405580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791450cd-4c3c-4508-aa89-c80eaed4a114 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:22.412776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28788c-da32-4d90-acd7-2b70602daa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:22.414232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28788c-da32-4d90-acd7-2b70602daa56 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:22.414767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28788c-da32-4d90-acd7-2b70602daa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:22.415665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28788c-da32-4d90-acd7-2b70602daa56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:22.416679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28788c-da32-4d90-acd7-2b70602daa56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:22.418775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28788c-da32-4d90-acd7-2b70602daa56 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:22.432851 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 986/2001] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:22.434466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28788c-da32-4d90-acd7-2b70602daa56 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:22.438377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bd28788c-da32-4d90-acd7-2b70602daa56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:22.471920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d99ec-115c-457d-800b-807ec71dc1fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:22.472555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d99ec-115c-457d-800b-807ec71dc1fd service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:22.472864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d99ec-115c-457d-800b-807ec71dc1fd service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:22.474055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28788c-da32-4d90-acd7-2b70602daa56 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:22.474470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d99ec-115c-457d-800b-807ec71dc1fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:22.477909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-203d99ec-115c-457d-800b-807ec71dc1fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:22.488077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cbcc4-7e93-4a60-acf3-a9c21d90d9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:22.488814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cbcc4-7e93-4a60-acf3-a9c21d90d9d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:22.489095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cbcc4-7e93-4a60-acf3-a9c21d90d9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:22.489366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cbcc4-7e93-4a60-acf3-a9c21d90d9d9 admin admin] PATH_INFO: `/v3/projects/75dfac6d55f7400fb9147ab85724600e/users/72edd28f8176411995b96feb65baf6a8/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:22.527611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4cbcc4-7e93-4a60-acf3-a9c21d90d9d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75dfac6d55f7400fb9147ab85724600e, user_id=72edd28f8176411995b96feb65baf6a8, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:22.531015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4cbcc4-7e93-4a60-acf3-a9c21d90d9d9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:22.552196 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 987/2002] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:22 2022] PUT /identity/v3/projects/75dfac6d55f7400fb9147ab85724600e/users/72edd28f8176411995b96feb65baf6a8/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:22.554176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cbcc4-7e93-4a60-acf3-a9c21d90d9d9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:22.557573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4d4cbcc4-7e93-4a60-acf3-a9c21d90d9d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:22.568966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d99ec-115c-457d-800b-807ec71dc1fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:22.572051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d99ec-115c-457d-800b-807ec71dc1fd service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:22.597983 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1016/2003] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:22 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:22.599931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d99ec-115c-457d-800b-807ec71dc1fd service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:22.603291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-203d99ec-115c-457d-800b-807ec71dc1fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:22.637904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d99ec-115c-457d-800b-807ec71dc1fd service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:22.741922 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:22.760185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e541c8-552e-4519-9681-d0fccbda7f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:22.760904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e541c8-552e-4519-9681-d0fccbda7f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:22.764055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e541c8-552e-4519-9681-d0fccbda7f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:22.764352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e541c8-552e-4519-9681-d0fccbda7f79 admin admin] PATH_INFO: `/v3/users/23ff5b0de4df4681971e2e5033526026` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:22.765632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e541c8-552e-4519-9681-d0fccbda7f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ff5b0de4df4681971e2e5033526026)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:22.771921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e541c8-552e-4519-9681-d0fccbda7f79 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:22.777034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cbcc4-7e93-4a60-acf3-a9c21d90d9d9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:22.783640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55484444-8ffa-4ad7-b441-6f1757aa71d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:22.784316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55484444-8ffa-4ad7-b441-6f1757aa71d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:22.784617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55484444-8ffa-4ad7-b441-6f1757aa71d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:22.784900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55484444-8ffa-4ad7-b441-6f1757aa71d5 admin admin] PATH_INFO: `/v3/projects/ed85f87a198a41f7abd48dc304df5748/users/cbe231a0958243e5bf0289e91f7c893c/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:22.811179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55484444-8ffa-4ad7-b441-6f1757aa71d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed85f87a198a41f7abd48dc304df5748, user_id=cbe231a0958243e5bf0289e91f7c893c, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:22.814785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55484444-8ffa-4ad7-b441-6f1757aa71d5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:22.840731 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 988/2004] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:22 2022] PUT /identity/v3/projects/ed85f87a198a41f7abd48dc304df5748/users/cbe231a0958243e5bf0289e91f7c893c/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:22.840731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55484444-8ffa-4ad7-b441-6f1757aa71d5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:22.886558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84e541c8-552e-4519-9681-d0fccbda7f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ff5b0de4df4681971e2e5033526026'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:22.887579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84e541c8-552e-4519-9681-d0fccbda7f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ff5b0de4df4681971e2e5033526026'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:22.900773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84e541c8-552e-4519-9681-d0fccbda7f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ff5b0de4df4681971e2e5033526026'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:22.908970 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:22.926527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84e541c8-552e-4519-9681-d0fccbda7f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ff5b0de4df4681971e2e5033526026'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:22.936865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84e541c8-552e-4519-9681-d0fccbda7f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ff5b0de4df4681971e2e5033526026'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:22.951319 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1017/2005] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:22 2022] DELETE /identity/v3/users/23ff5b0de4df4681971e2e5033526026 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:22.952773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e541c8-552e-4519-9681-d0fccbda7f79 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:22.954508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-84e541c8-552e-4519-9681-d0fccbda7f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:23.027126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55484444-8ffa-4ad7-b441-6f1757aa71d5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:23.105030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e541c8-552e-4519-9681-d0fccbda7f79 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:23.110362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad895af-5ebd-4877-a298-98dfdd18cce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:23.111601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad895af-5ebd-4877-a298-98dfdd18cce5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:23.111601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad895af-5ebd-4877-a298-98dfdd18cce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:23.111815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad895af-5ebd-4877-a298-98dfdd18cce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:23.112398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad895af-5ebd-4877-a298-98dfdd18cce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:23.114488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad895af-5ebd-4877-a298-98dfdd18cce5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:23.132269 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1018/2006] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:23.135088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38261fc-ad44-436f-9ada-77462dc18f9d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:23.135088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38261fc-ad44-436f-9ada-77462dc18f9d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:23.135287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38261fc-ad44-436f-9ada-77462dc18f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:23.168083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905b577-83ce-4346-9c18-3a22ea6e4dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:23.168953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905b577-83ce-4346-9c18-3a22ea6e4dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:23.169234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905b577-83ce-4346-9c18-3a22ea6e4dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:23.169501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905b577-83ce-4346-9c18-3a22ea6e4dc9 admin admin] PATH_INFO: `/v3/projects/09c0fe7ef721446495f900a05d88eb3e/users/98076ff8699148adbd1d6ec507021136/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:23.181410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e38261fc-ad44-436f-9ada-77462dc18f9d None None] MFA Rules not processed for user `cbe231a0958243e5bf0289e91f7c893c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:23.184860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e38261fc-ad44-436f-9ada-77462dc18f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:23.194475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905b577-83ce-4346-9c18-3a22ea6e4dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09c0fe7ef721446495f900a05d88eb3e, user_id=98076ff8699148adbd1d6ec507021136, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:23.197385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905b577-83ce-4346-9c18-3a22ea6e4dc9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:23.229212 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 989/2007] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:22 2022] PUT /identity/v3/projects/09c0fe7ef721446495f900a05d88eb3e/users/98076ff8699148adbd1d6ec507021136/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:23.230475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905b577-83ce-4346-9c18-3a22ea6e4dc9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:23.241481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1905b577-83ce-4346-9c18-3a22ea6e4dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:23.335417 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:23.348020 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1019/2008] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:23.349415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38261fc-ad44-436f-9ada-77462dc18f9d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:23.364149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38261fc-ad44-436f-9ada-77462dc18f9d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:23.380057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905b577-83ce-4346-9c18-3a22ea6e4dc9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:23.387334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51928b-a4ed-40de-a715-f1c27d3048bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:23.387973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51928b-a4ed-40de-a715-f1c27d3048bd service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:23.388250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51928b-a4ed-40de-a715-f1c27d3048bd service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:23.388516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51928b-a4ed-40de-a715-f1c27d3048bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:23.391337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ba51928b-a4ed-40de-a715-f1c27d3048bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:23.441517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad24656-65d1-4a22-b34e-c29fc9f50419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:23.442421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad24656-65d1-4a22-b34e-c29fc9f50419 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:23.442864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad24656-65d1-4a22-b34e-c29fc9f50419 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:23.443284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad24656-65d1-4a22-b34e-c29fc9f50419 admin admin] PATH_INFO: `/v3/projects/75dfac6d55f7400fb9147ab85724600e/users/72edd28f8176411995b96feb65baf6a8/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:23.445629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad24656-65d1-4a22-b34e-c29fc9f50419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75dfac6d55f7400fb9147ab85724600e, user_id=72edd28f8176411995b96feb65baf6a8, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:23.449742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad24656-65d1-4a22-b34e-c29fc9f50419 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:23.475190 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1020/2009] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:23 2022] PUT /identity/v3/projects/75dfac6d55f7400fb9147ab85724600e/users/72edd28f8176411995b96feb65baf6a8/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:23.476926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b122ce-8496-4753-a6f7-4edb0561c9eb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:23.477885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b122ce-8496-4753-a6f7-4edb0561c9eb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:23.478256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b122ce-8496-4753-a6f7-4edb0561c9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:23.479506 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:23.498565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51928b-a4ed-40de-a715-f1c27d3048bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:23.502572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51928b-a4ed-40de-a715-f1c27d3048bd service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:23.522433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-37b122ce-8496-4753-a6f7-4edb0561c9eb None None] MFA Rules not processed for user `98076ff8699148adbd1d6ec507021136`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:23.523537 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 990/2010] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:23 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:23.524734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51928b-a4ed-40de-a715-f1c27d3048bd service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:23.525242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-37b122ce-8496-4753-a6f7-4edb0561c9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:23.527328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ba51928b-a4ed-40de-a715-f1c27d3048bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:23.559138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51928b-a4ed-40de-a715-f1c27d3048bd service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:23.658311 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1021/2011] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:23 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:23.659679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f6586-7965-4989-b61e-e82fff317d5c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:23.660350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f6586-7965-4989-b61e-e82fff317d5c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:23.660650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f6586-7965-4989-b61e-e82fff317d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:23.688035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91c565-5fb0-4f49-8840-e5bd7e7385eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:23.688979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91c565-5fb0-4f49-8840-e5bd7e7385eb admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:23.689324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91c565-5fb0-4f49-8840-e5bd7e7385eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:23.689660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91c565-5fb0-4f49-8840-e5bd7e7385eb admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:23.690411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91c565-5fb0-4f49-8840-e5bd7e7385eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:23.694164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91c565-5fb0-4f49-8840-e5bd7e7385eb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:23.702168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-195f6586-7965-4989-b61e-e82fff317d5c None None] MFA Rules not processed for user `72edd28f8176411995b96feb65baf6a8`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:23.703618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-195f6586-7965-4989-b61e-e82fff317d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:23.750040 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 991/2012] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:23 2022] POST /identity/v3/projects => generated 381 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:23.750040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91c565-5fb0-4f49-8840-e5bd7e7385eb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:23.765083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2b91c565-5fb0-4f49-8840-e5bd7e7385eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:23.944262 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1022/2013] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:23.944262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f6586-7965-4989-b61e-e82fff317d5c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:23.961216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91c565-5fb0-4f49-8840-e5bd7e7385eb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:23.963239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f6586-7965-4989-b61e-e82fff317d5c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:23.972318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e690a-4dde-42a9-bc2c-937322296811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:23.972719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2086710-03f0-4a96-ac80-11468c71b4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:23.972857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e690a-4dde-42a9-bc2c-937322296811 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:23.972857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e690a-4dde-42a9-bc2c-937322296811 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:23.973049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2086710-03f0-4a96-ac80-11468c71b4fe admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:23.973120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e690a-4dde-42a9-bc2c-937322296811 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:23.973188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2086710-03f0-4a96-ac80-11468c71b4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:23.973188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2086710-03f0-4a96-ac80-11468c71b4fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:23.973396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e690a-4dde-42a9-bc2c-937322296811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:23.975239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e690a-4dde-42a9-bc2c-937322296811 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:23.977304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2086710-03f0-4a96-ac80-11468c71b4fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:23.980566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2086710-03f0-4a96-ac80-11468c71b4fe admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:24.001795 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:24.032302 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1023/2014] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:23 2022] POST /identity/v3/users => generated 297 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:24.033278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e690a-4dde-42a9-bc2c-937322296811 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:24.040703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-976e690a-4dde-42a9-bc2c-937322296811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:24.045037 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 992/2015] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:23 2022] POST /identity/v3/projects => generated 407 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:24.046323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2086710-03f0-4a96-ac80-11468c71b4fe admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:24.049415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c2086710-03f0-4a96-ac80-11468c71b4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:24.073996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e690a-4dde-42a9-bc2c-937322296811 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:24.131971 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:24.155745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2086710-03f0-4a96-ac80-11468c71b4fe admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:24.156773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faced830-2fc0-4790-82ca-4d5c8143ab10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:24.157628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faced830-2fc0-4790-82ca-4d5c8143ab10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:24.157940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faced830-2fc0-4790-82ca-4d5c8143ab10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:24.158316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faced830-2fc0-4790-82ca-4d5c8143ab10 admin admin] PATH_INFO: `/v3/projects/1bfcfca308654cb1bc6073230e780d8e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:24.159926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faced830-2fc0-4790-82ca-4d5c8143ab10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bfcfca308654cb1bc6073230e780d8e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:24.162337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faced830-2fc0-4790-82ca-4d5c8143ab10 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:24.162858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27263a4-11af-42b0-9c53-c932ac6371b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:24.163505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27263a4-11af-42b0-9c53-c932ac6371b3 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:24.163964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27263a4-11af-42b0-9c53-c932ac6371b3 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:24.164243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27263a4-11af-42b0-9c53-c932ac6371b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:24.231379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-faced830-2fc0-4790-82ca-4d5c8143ab10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bfcfca308654cb1bc6073230e780d8e', 'request_id': 'req-faced830-2fc0-4790-82ca-4d5c8143ab10'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:24.246455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-faced830-2fc0-4790-82ca-4d5c8143ab10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bfcfca308654cb1bc6073230e780d8e', 'request_id': 'req-faced830-2fc0-4790-82ca-4d5c8143ab10'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:24.255393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-faced830-2fc0-4790-82ca-4d5c8143ab10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bfcfca308654cb1bc6073230e780d8e', 'request_id': 'req-faced830-2fc0-4790-82ca-4d5c8143ab10'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:24.265649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27263a4-11af-42b0-9c53-c932ac6371b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:24.267821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27263a4-11af-42b0-9c53-c932ac6371b3 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:24.270992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-faced830-2fc0-4790-82ca-4d5c8143ab10 admin admin] The token cache is being invalidate because project 1bfcfca308654cb1bc6073230e780d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:24.271374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-faced830-2fc0-4790-82ca-4d5c8143ab10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:24.272706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-faced830-2fc0-4790-82ca-4d5c8143ab10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:24.280471 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1024/2016] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:24 2022] DELETE /identity/v3/projects/1bfcfca308654cb1bc6073230e780d8e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:24.281556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faced830-2fc0-4790-82ca-4d5c8143ab10 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:24.283000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-faced830-2fc0-4790-82ca-4d5c8143ab10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:24.298344 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 993/2017] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:24.300892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27263a4-11af-42b0-9c53-c932ac6371b3 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:24.318649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27263a4-11af-42b0-9c53-c932ac6371b3 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:24.410262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faced830-2fc0-4790-82ca-4d5c8143ab10 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:24.415908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60afb14-f4b1-4f13-95c7-07186412d4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:24.416527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60afb14-f4b1-4f13-95c7-07186412d4af admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:24.416852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60afb14-f4b1-4f13-95c7-07186412d4af admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:24.417126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60afb14-f4b1-4f13-95c7-07186412d4af admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:24.418453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60afb14-f4b1-4f13-95c7-07186412d4af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:24.420675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60afb14-f4b1-4f13-95c7-07186412d4af admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:24.432912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cc5b4-01a5-43e5-8004-151639f0ad73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:24.433548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cc5b4-01a5-43e5-8004-151639f0ad73 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:24.433816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cc5b4-01a5-43e5-8004-151639f0ad73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:24.434076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cc5b4-01a5-43e5-8004-151639f0ad73 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:24.434719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cc5b4-01a5-43e5-8004-151639f0ad73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:24.437025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cc5b4-01a5-43e5-8004-151639f0ad73 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:24.449000 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1025/2018] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:24.450408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261cdc0-d0e1-4e31-bbf8-5a1f8dafb250 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:24.450695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261cdc0-d0e1-4e31-bbf8-5a1f8dafb250 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:24.450969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261cdc0-d0e1-4e31-bbf8-5a1f8dafb250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:24.470239 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 994/2019] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:24 2022] POST /identity/v3/users => generated 310 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:24.471115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cc5b4-01a5-43e5-8004-151639f0ad73 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:24.478093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8261cdc0-d0e1-4e31-bbf8-5a1f8dafb250 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:24.479637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8261cdc0-d0e1-4e31-bbf8-5a1f8dafb250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:24.488912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cc5b4-01a5-43e5-8004-151639f0ad73 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:24.495409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1eff5-53a4-4f4f-9186-7c2f73ed7a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:24.496206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1eff5-53a4-4f4f-9186-7c2f73ed7a77 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:24.496576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1eff5-53a4-4f4f-9186-7c2f73ed7a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:24.497071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1eff5-53a4-4f4f-9186-7c2f73ed7a77 admin admin] PATH_INFO: `/v3/projects/a0fead7a8e8940dd9fb9cd9c06d79fa3/users/88c1e54190814197b4823fd528cfaf86/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:24.498089 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1026/2020] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:24.499027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261cdc0-d0e1-4e31-bbf8-5a1f8dafb250 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:24.501374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8261cdc0-d0e1-4e31-bbf8-5a1f8dafb250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:24.521344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261cdc0-d0e1-4e31-bbf8-5a1f8dafb250 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:24.523108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1eff5-53a4-4f4f-9186-7c2f73ed7a77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0fead7a8e8940dd9fb9cd9c06d79fa3, user_id=88c1e54190814197b4823fd528cfaf86, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:24.527363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1eff5-53a4-4f4f-9186-7c2f73ed7a77 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:24.528110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382e7f9-e192-481a-8c35-1013dc9f3fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:24.528861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382e7f9-e192-481a-8c35-1013dc9f3fbd admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:24.529799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382e7f9-e192-481a-8c35-1013dc9f3fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:24.530087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382e7f9-e192-481a-8c35-1013dc9f3fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:24.530733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382e7f9-e192-481a-8c35-1013dc9f3fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:24.533296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382e7f9-e192-481a-8c35-1013dc9f3fbd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:24.537917 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:24.550844 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 995/2021] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:24 2022] PUT /identity/v3/projects/a0fead7a8e8940dd9fb9cd9c06d79fa3/users/88c1e54190814197b4823fd528cfaf86/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:24.551461 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1027/2022] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:24.556121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ab125-36cb-4332-990f-45c484ddfdbd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:24.556489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ab125-36cb-4332-990f-45c484ddfdbd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:24.556856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ab125-36cb-4332-990f-45c484ddfdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:24.560306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382e7f9-e192-481a-8c35-1013dc9f3fbd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:24.574282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382e7f9-e192-481a-8c35-1013dc9f3fbd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:24.592694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-871ab125-36cb-4332-990f-45c484ddfdbd None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:24.592694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-871ab125-36cb-4332-990f-45c484ddfdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:24.697649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce576b29-e187-4273-b86b-30c9236197d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:24.700621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce576b29-e187-4273-b86b-30c9236197d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:24.701588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce576b29-e187-4273-b86b-30c9236197d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:24.701875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce576b29-e187-4273-b86b-30c9236197d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:24.704656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce576b29-e187-4273-b86b-30c9236197d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:24.710104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce576b29-e187-4273-b86b-30c9236197d7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:24.718711 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:24.737158 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 996/2023] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:24.737158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ab125-36cb-4332-990f-45c484ddfdbd None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:24.744788 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1028/2024] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:24.748278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce576b29-e187-4273-b86b-30c9236197d7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:24.755974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ab125-36cb-4332-990f-45c484ddfdbd None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:24.763976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d2296-312c-4c26-8cfe-20adb8762c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:24.765957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d2296-312c-4c26-8cfe-20adb8762c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:24.766247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d2296-312c-4c26-8cfe-20adb8762c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:24.766522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d2296-312c-4c26-8cfe-20adb8762c51 admin admin] PATH_INFO: `/v3/projects/73572c16a70647e6850443aac6e7c1cf/users/b764c43cdf5f463fbdd787efbb2a5f1a/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:24.770104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce576b29-e187-4273-b86b-30c9236197d7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:24.784662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bee5e-cb3f-4254-8d1b-39188d6b9df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:24.788740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bee5e-cb3f-4254-8d1b-39188d6b9df0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:24.788740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bee5e-cb3f-4254-8d1b-39188d6b9df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:24.788740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bee5e-cb3f-4254-8d1b-39188d6b9df0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:24.790314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6bee5e-cb3f-4254-8d1b-39188d6b9df0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:24.793483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6bee5e-cb3f-4254-8d1b-39188d6b9df0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:24.795125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6bee5e-cb3f-4254-8d1b-39188d6b9df0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:24.804248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d2296-312c-4c26-8cfe-20adb8762c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73572c16a70647e6850443aac6e7c1cf, user_id=b764c43cdf5f463fbdd787efbb2a5f1a, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:24.813747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d2296-312c-4c26-8cfe-20adb8762c51 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:24.826415 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1029/2025] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:24.827291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bee5e-cb3f-4254-8d1b-39188d6b9df0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:24.840199 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 997/2026] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:24 2022] PUT /identity/v3/projects/73572c16a70647e6850443aac6e7c1cf/users/b764c43cdf5f463fbdd787efbb2a5f1a/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:24.841093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d2296-312c-4c26-8cfe-20adb8762c51 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:24.849638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-044d2296-312c-4c26-8cfe-20adb8762c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:24.854376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bee5e-cb3f-4254-8d1b-39188d6b9df0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:24.983066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0d82e-5bb5-4ffd-9eb5-f0f065ffa36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:24.984296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0d82e-5bb5-4ffd-9eb5-f0f065ffa36e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:24.984783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0d82e-5bb5-4ffd-9eb5-f0f065ffa36e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:24.986374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0d82e-5bb5-4ffd-9eb5-f0f065ffa36e admin admin] PATH_INFO: `/v3/projects/a0fead7a8e8940dd9fb9cd9c06d79fa3/users/88c1e54190814197b4823fd528cfaf86/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:24.989574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0d82e-5bb5-4ffd-9eb5-f0f065ffa36e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0fead7a8e8940dd9fb9cd9c06d79fa3, user_id=88c1e54190814197b4823fd528cfaf86, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:24.992690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0d82e-5bb5-4ffd-9eb5-f0f065ffa36e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:24.999008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d2296-312c-4c26-8cfe-20adb8762c51 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:25.005650 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1030/2027] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:24 2022] PUT /identity/v3/projects/a0fead7a8e8940dd9fb9cd9c06d79fa3/users/88c1e54190814197b4823fd528cfaf86/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:25.011124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0d82e-5bb5-4ffd-9eb5-f0f065ffa36e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:25.098702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0d82e-5bb5-4ffd-9eb5-f0f065ffa36e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:25.104535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79098c7-241a-449e-9762-c9fd77379358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:25.105170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79098c7-241a-449e-9762-c9fd77379358 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:25.105446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79098c7-241a-449e-9762-c9fd77379358 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:25.105891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79098c7-241a-449e-9762-c9fd77379358 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:25.106354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b836a2d-581b-4e56-b180-1845a9e6bbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:25.106576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79098c7-241a-449e-9762-c9fd77379358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:25.107244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b836a2d-581b-4e56-b180-1845a9e6bbed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:25.107758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b836a2d-581b-4e56-b180-1845a9e6bbed admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:25.108217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b836a2d-581b-4e56-b180-1845a9e6bbed admin admin] PATH_INFO: `/v3/users/2b8e09db6d194eb38b963a5fc58d0903` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:25.109237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79098c7-241a-449e-9762-c9fd77379358 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:25.109473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b836a2d-581b-4e56-b180-1845a9e6bbed admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8e09db6d194eb38b963a5fc58d0903)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:25.111349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b836a2d-581b-4e56-b180-1845a9e6bbed admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:25.136668 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:25.143485 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1031/2028] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:25 2022] POST /identity/v3/projects => generated 411 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:25.144470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79098c7-241a-449e-9762-c9fd77379358 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:25.177064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b836a2d-581b-4e56-b180-1845a9e6bbed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8e09db6d194eb38b963a5fc58d0903'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:25.189701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b836a2d-581b-4e56-b180-1845a9e6bbed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8e09db6d194eb38b963a5fc58d0903'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:25.190339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b836a2d-581b-4e56-b180-1845a9e6bbed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8e09db6d194eb38b963a5fc58d0903'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:25.206845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b836a2d-581b-4e56-b180-1845a9e6bbed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8e09db6d194eb38b963a5fc58d0903'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:25.214618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b836a2d-581b-4e56-b180-1845a9e6bbed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8e09db6d194eb38b963a5fc58d0903'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:25.219280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79098c7-241a-449e-9762-c9fd77379358 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:25.221568 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 998/2029] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:24 2022] DELETE /identity/v3/users/2b8e09db6d194eb38b963a5fc58d0903 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:25.222868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d415e-aea6-4db8-888f-2f6471d5f59e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:25.223151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d415e-aea6-4db8-888f-2f6471d5f59e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:25.223420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d415e-aea6-4db8-888f-2f6471d5f59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:25.230001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd899b0-aa2b-4bba-b290-a8bf847547c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:25.230254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd899b0-aa2b-4bba-b290-a8bf847547c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:25.230458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd899b0-aa2b-4bba-b290-a8bf847547c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:25.230736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd899b0-aa2b-4bba-b290-a8bf847547c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:25.231102 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:25.231383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd899b0-aa2b-4bba-b290-a8bf847547c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:25.233095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd899b0-aa2b-4bba-b290-a8bf847547c3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:25.245540 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1032/2030] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:25.246672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd899b0-aa2b-4bba-b290-a8bf847547c3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:25.248474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7dd899b0-aa2b-4bba-b290-a8bf847547c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:25.261086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6d7d415e-aea6-4db8-888f-2f6471d5f59e None None] MFA Rules not processed for user `88c1e54190814197b4823fd528cfaf86`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:25.262123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd899b0-aa2b-4bba-b290-a8bf847547c3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:25.262532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6d7d415e-aea6-4db8-888f-2f6471d5f59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:25.344365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918fad0-e4d9-470c-9202-0c04be815c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:25.345390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918fad0-e4d9-470c-9202-0c04be815c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:25.345673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918fad0-e4d9-470c-9202-0c04be815c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:25.346094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918fad0-e4d9-470c-9202-0c04be815c44 admin admin] PATH_INFO: `/v3/users/eda6ecf4563c45238ec0ae9af09c60ff` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:25.347796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918fad0-e4d9-470c-9202-0c04be815c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eda6ecf4563c45238ec0ae9af09c60ff)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:25.349906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918fad0-e4d9-470c-9202-0c04be815c44 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:25.355603 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 999/2031] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:25.355603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d415e-aea6-4db8-888f-2f6471d5f59e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:25.355603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6d7d415e-aea6-4db8-888f-2f6471d5f59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:25.377749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d415e-aea6-4db8-888f-2f6471d5f59e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:25.384911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3b7fc-9889-459a-9cd1-d4b16883e572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:25.390072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3b7fc-9889-459a-9cd1-d4b16883e572 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:25.390707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3b7fc-9889-459a-9cd1-d4b16883e572 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:25.391949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3b7fc-9889-459a-9cd1-d4b16883e572 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:25.392640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3b7fc-9889-459a-9cd1-d4b16883e572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:25.394786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3b7fc-9889-459a-9cd1-d4b16883e572 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:25.422996 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1000/2032] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:25 2022] POST /identity/v3/users => generated 306 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:25.425214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa8e57-5590-4d05-8302-752bf56d4c86 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:25.425410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa8e57-5590-4d05-8302-752bf56d4c86 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:25.425687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa8e57-5590-4d05-8302-752bf56d4c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:25.432882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c918fad0-e4d9-470c-9202-0c04be815c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eda6ecf4563c45238ec0ae9af09c60ff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:25.433692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c918fad0-e4d9-470c-9202-0c04be815c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eda6ecf4563c45238ec0ae9af09c60ff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:25.445691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c918fad0-e4d9-470c-9202-0c04be815c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eda6ecf4563c45238ec0ae9af09c60ff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:25.446092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8dfa8e57-5590-4d05-8302-752bf56d4c86 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:25.447316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8dfa8e57-5590-4d05-8302-752bf56d4c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:25.457558 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1001/2033] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:25.458380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa8e57-5590-4d05-8302-752bf56d4c86 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:25.461275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8dfa8e57-5590-4d05-8302-752bf56d4c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:25.463360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c918fad0-e4d9-470c-9202-0c04be815c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eda6ecf4563c45238ec0ae9af09c60ff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:25.475183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c918fad0-e4d9-470c-9202-0c04be815c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eda6ecf4563c45238ec0ae9af09c60ff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:25.475538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa8e57-5590-4d05-8302-752bf56d4c86 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:25.482234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82431eb2-6feb-4c14-b979-be6326b0dc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:25.483224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82431eb2-6feb-4c14-b979-be6326b0dc55 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:25.483557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82431eb2-6feb-4c14-b979-be6326b0dc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:25.483834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82431eb2-6feb-4c14-b979-be6326b0dc55 admin admin] PATH_INFO: `/v3/projects/73572c16a70647e6850443aac6e7c1cf/users/b764c43cdf5f463fbdd787efbb2a5f1a/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:25.485820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82431eb2-6feb-4c14-b979-be6326b0dc55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73572c16a70647e6850443aac6e7c1cf, user_id=b764c43cdf5f463fbdd787efbb2a5f1a, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:25.486435 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1033/2034] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:25 2022] DELETE /identity/v3/users/eda6ecf4563c45238ec0ae9af09c60ff => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:25.488063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918fad0-e4d9-470c-9202-0c04be815c44 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:25.488893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82431eb2-6feb-4c14-b979-be6326b0dc55 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:25.490627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c918fad0-e4d9-470c-9202-0c04be815c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:25.502479 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1002/2035] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:25 2022] PUT /identity/v3/projects/73572c16a70647e6850443aac6e7c1cf/users/b764c43cdf5f463fbdd787efbb2a5f1a/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:25.503477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82431eb2-6feb-4c14-b979-be6326b0dc55 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:25.505248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-82431eb2-6feb-4c14-b979-be6326b0dc55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:25.538488 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:25.602858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82431eb2-6feb-4c14-b979-be6326b0dc55 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:25.607834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d067ad5-117d-4132-a5ec-f5faea43140c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:25.608585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d067ad5-117d-4132-a5ec-f5faea43140c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:25.608967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d067ad5-117d-4132-a5ec-f5faea43140c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:25.609466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d067ad5-117d-4132-a5ec-f5faea43140c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:25.610240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d067ad5-117d-4132-a5ec-f5faea43140c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:25.611843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d067ad5-117d-4132-a5ec-f5faea43140c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:25.626208 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1003/2036] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:25.626208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d105b-dc24-4789-b39c-45e7451f7215 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:25.626208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d105b-dc24-4789-b39c-45e7451f7215 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:25.626208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d105b-dc24-4789-b39c-45e7451f7215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:25.646806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918fad0-e4d9-470c-9202-0c04be815c44 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:25.654500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-838d105b-dc24-4789-b39c-45e7451f7215 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:25.655922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-838d105b-dc24-4789-b39c-45e7451f7215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:25.671044 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1004/2037] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:25.672157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d105b-dc24-4789-b39c-45e7451f7215 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:25.674139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-838d105b-dc24-4789-b39c-45e7451f7215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:25.747715 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:25.773433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d00b3f-676d-493d-bf8f-b03d2a82f234 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:25.775072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d00b3f-676d-493d-bf8f-b03d2a82f234 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:25.775586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d00b3f-676d-493d-bf8f-b03d2a82f234 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:25.776148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d105b-dc24-4789-b39c-45e7451f7215 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:25.776409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d00b3f-676d-493d-bf8f-b03d2a82f234 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:25.779634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-61d00b3f-676d-493d-bf8f-b03d2a82f234 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:25.780963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd8508-7242-4123-bd4a-98507731589d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:25.781695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd8508-7242-4123-bd4a-98507731589d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:25.782040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd8508-7242-4123-bd4a-98507731589d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:25.782310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd8508-7242-4123-bd4a-98507731589d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:25.795127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd8508-7242-4123-bd4a-98507731589d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:25.796959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd8508-7242-4123-bd4a-98507731589d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:25.813736 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1005/2038] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:25.815150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b884a-2a19-4461-8a26-19138c05e9a7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:25.815438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b884a-2a19-4461-8a26-19138c05e9a7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:25.815884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b884a-2a19-4461-8a26-19138c05e9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:25.858446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b61b884a-2a19-4461-8a26-19138c05e9a7 None None] MFA Rules not processed for user `b764c43cdf5f463fbdd787efbb2a5f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:25.859779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b61b884a-2a19-4461-8a26-19138c05e9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:25.862626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d00b3f-676d-493d-bf8f-b03d2a82f234 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:25.864327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d00b3f-676d-493d-bf8f-b03d2a82f234 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:25.877152 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1034/2039] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:25.877976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d00b3f-676d-493d-bf8f-b03d2a82f234 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:25.894162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d00b3f-676d-493d-bf8f-b03d2a82f234 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:25.904428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6bb29-6378-421b-bac2-0ddb3fecd0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:25.904428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6bb29-6378-421b-bac2-0ddb3fecd0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:25.904428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6bb29-6378-421b-bac2-0ddb3fecd0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:25.904793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6bb29-6378-421b-bac2-0ddb3fecd0d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:25.905941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6bb29-6378-421b-bac2-0ddb3fecd0d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:25.910310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6bb29-6378-421b-bac2-0ddb3fecd0d6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:25.935933 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1035/2040] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:25.938801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6bb29-6378-421b-bac2-0ddb3fecd0d6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:25.963443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6bb29-6378-421b-bac2-0ddb3fecd0d6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:25.975516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ae547-701e-4f9e-9f52-e0e9fb3d2072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:25.976139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ae547-701e-4f9e-9f52-e0e9fb3d2072 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:25.976416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ae547-701e-4f9e-9f52-e0e9fb3d2072 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:25.976708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ae547-701e-4f9e-9f52-e0e9fb3d2072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:26.000175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ae547-701e-4f9e-9f52-e0e9fb3d2072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:26.001668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ae547-701e-4f9e-9f52-e0e9fb3d2072 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:26.015204 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1006/2041] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:25 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:26.016951 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1036/2042] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:26.017502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b884a-2a19-4461-8a26-19138c05e9a7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:26.017741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ae547-701e-4f9e-9f52-e0e9fb3d2072 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:26.025762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b61b884a-2a19-4461-8a26-19138c05e9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:26.032076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ae547-701e-4f9e-9f52-e0e9fb3d2072 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:26.042928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4669df4-b62d-48b8-9128-b9a8c06c3e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:26.044645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4669df4-b62d-48b8-9128-b9a8c06c3e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:26.044645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4669df4-b62d-48b8-9128-b9a8c06c3e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:26.044645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4669df4-b62d-48b8-9128-b9a8c06c3e48 admin admin] PATH_INFO: `/v3/projects/6d30bc9c7421452c9231f7ec0995a8a7/users/1e5b2b8096554a248f68a2ca3e2c7aa3/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:26.046385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b884a-2a19-4461-8a26-19138c05e9a7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:26.059244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b5f51-2939-4a52-b5f5-7fc130a49b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:26.061015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b5f51-2939-4a52-b5f5-7fc130a49b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:26.061392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b5f51-2939-4a52-b5f5-7fc130a49b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:26.061692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b5f51-2939-4a52-b5f5-7fc130a49b04 admin admin] PATH_INFO: `/v3/users/cbe231a0958243e5bf0289e91f7c893c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:26.062981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b5f51-2939-4a52-b5f5-7fc130a49b04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe231a0958243e5bf0289e91f7c893c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:26.065462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b5f51-2939-4a52-b5f5-7fc130a49b04 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:26.068477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4669df4-b62d-48b8-9128-b9a8c06c3e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d30bc9c7421452c9231f7ec0995a8a7, user_id=1e5b2b8096554a248f68a2ca3e2c7aa3, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:26.074239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4669df4-b62d-48b8-9128-b9a8c06c3e48 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:26.107305 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1037/2043] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:26 2022] PUT /identity/v3/projects/6d30bc9c7421452c9231f7ec0995a8a7/users/1e5b2b8096554a248f68a2ca3e2c7aa3/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:26.122461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fff720-e86e-4b82-a8c4-1b3499db6529 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:26.122908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fff720-e86e-4b82-a8c4-1b3499db6529 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:26.123259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fff720-e86e-4b82-a8c4-1b3499db6529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:26.133068 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:26.146269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c46b5f51-2939-4a52-b5f5-7fc130a49b04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe231a0958243e5bf0289e91f7c893c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:26.158427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c46b5f51-2939-4a52-b5f5-7fc130a49b04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe231a0958243e5bf0289e91f7c893c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:26.159299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c46b5f51-2939-4a52-b5f5-7fc130a49b04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe231a0958243e5bf0289e91f7c893c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:26.168935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-28fff720-e86e-4b82-a8c4-1b3499db6529 None None] MFA Rules not processed for user `1e5b2b8096554a248f68a2ca3e2c7aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:26.172202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-28fff720-e86e-4b82-a8c4-1b3499db6529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:26.189535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c46b5f51-2939-4a52-b5f5-7fc130a49b04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe231a0958243e5bf0289e91f7c893c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:26.207093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c46b5f51-2939-4a52-b5f5-7fc130a49b04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe231a0958243e5bf0289e91f7c893c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:26.217235 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1007/2044] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:26 2022] DELETE /identity/v3/users/cbe231a0958243e5bf0289e91f7c893c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:26.221406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae89dde-3616-4f3f-ab88-b083ceca306f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:26.221932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae89dde-3616-4f3f-ab88-b083ceca306f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:26.222475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae89dde-3616-4f3f-ab88-b083ceca306f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:26.262090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cae89dde-3616-4f3f-ab88-b083ceca306f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:26.263845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cae89dde-3616-4f3f-ab88-b083ceca306f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:26.338775 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:26.354401 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1038/2045] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:26 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:26.356920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fff720-e86e-4b82-a8c4-1b3499db6529 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:26.361578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-28fff720-e86e-4b82-a8c4-1b3499db6529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:26.402816 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1008/2046] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:26.404025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae89dde-3616-4f3f-ab88-b083ceca306f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:26.406561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cae89dde-3616-4f3f-ab88-b083ceca306f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:26.426394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae89dde-3616-4f3f-ab88-b083ceca306f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:26.452296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0ccbd-4c67-4ec0-b6c9-d5f27633ab79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:26.455957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0ccbd-4c67-4ec0-b6c9-d5f27633ab79 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:26.456253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0ccbd-4c67-4ec0-b6c9-d5f27633ab79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:26.460785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0ccbd-4c67-4ec0-b6c9-d5f27633ab79 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:26.464404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0ccbd-4c67-4ec0-b6c9-d5f27633ab79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:26.468842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0ccbd-4c67-4ec0-b6c9-d5f27633ab79 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:26.546884 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1009/2047] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:26 2022] POST /identity/v3/projects => generated 409 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:26.546884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0ccbd-4c67-4ec0-b6c9-d5f27633ab79 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:26.550152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aaa0ccbd-4c67-4ec0-b6c9-d5f27633ab79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:26.573754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fff720-e86e-4b82-a8c4-1b3499db6529 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:26.647010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0ccbd-4c67-4ec0-b6c9-d5f27633ab79 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:26.653011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f63515-fcce-43da-b09d-d5303b1ce2f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:26.654040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f63515-fcce-43da-b09d-d5303b1ce2f2 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:26.654537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f63515-fcce-43da-b09d-d5303b1ce2f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:26.654824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f63515-fcce-43da-b09d-d5303b1ce2f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:26.718151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e428d-9ec6-48b5-b253-8a5978d4d4be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:26.718151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e428d-9ec6-48b5-b253-8a5978d4d4be service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:26.718151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e428d-9ec6-48b5-b253-8a5978d4d4be service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:26.718151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e428d-9ec6-48b5-b253-8a5978d4d4be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:26.720113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4e5e428d-9ec6-48b5-b253-8a5978d4d4be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:26.758970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f63515-fcce-43da-b09d-d5303b1ce2f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:26.763302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f63515-fcce-43da-b09d-d5303b1ce2f2 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:26.779038 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1010/2048] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:26.779779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f63515-fcce-43da-b09d-d5303b1ce2f2 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:26.779920 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:26.793331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f63515-fcce-43da-b09d-d5303b1ce2f2 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:26.803102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc1d08-2c17-4233-8820-c9a98b470c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:26.804043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc1d08-2c17-4233-8820-c9a98b470c5c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:26.804710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc1d08-2c17-4233-8820-c9a98b470c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:26.805192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc1d08-2c17-4233-8820-c9a98b470c5c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:26.806154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc1d08-2c17-4233-8820-c9a98b470c5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:26.808586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc1d08-2c17-4233-8820-c9a98b470c5c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:26.837870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e428d-9ec6-48b5-b253-8a5978d4d4be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:26.840008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e428d-9ec6-48b5-b253-8a5978d4d4be service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:26.844764 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1011/2049] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:26 2022] POST /identity/v3/users => generated 311 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:26.847842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc1d08-2c17-4233-8820-c9a98b470c5c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:26.867247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc1d08-2c17-4233-8820-c9a98b470c5c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:26.874984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96d66c-b785-44f9-bc44-de9a72c40868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:26.875459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96d66c-b785-44f9-bc44-de9a72c40868 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:26.875890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96d66c-b785-44f9-bc44-de9a72c40868 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:26.876195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96d66c-b785-44f9-bc44-de9a72c40868 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:26.876935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96d66c-b785-44f9-bc44-de9a72c40868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:26.879239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96d66c-b785-44f9-bc44-de9a72c40868 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:26.880563 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1039/2050] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:26 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:26.896532 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1012/2051] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:43:26.902204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e428d-9ec6-48b5-b253-8a5978d4d4be service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:26.916087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e428d-9ec6-48b5-b253-8a5978d4d4be service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:26.921158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5c4b8-1680-458d-99df-012ab4c27a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:26.921447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5c4b8-1680-458d-99df-012ab4c27a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:26.922001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5c4b8-1680-458d-99df-012ab4c27a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:26.922349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5c4b8-1680-458d-99df-012ab4c27a73 admin admin] PATH_INFO: `/v3/projects/c87afdb200794b74a44747706d282676/users/3390471f01194ce385e4e250f6c35f5f/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:26.941150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5c4b8-1680-458d-99df-012ab4c27a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c87afdb200794b74a44747706d282676, user_id=3390471f01194ce385e4e250f6c35f5f, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:26.946804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5c4b8-1680-458d-99df-012ab4c27a73 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:26.980983 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1040/2052] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:26 2022] PUT /identity/v3/projects/c87afdb200794b74a44747706d282676/users/3390471f01194ce385e4e250f6c35f5f/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:26.982349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96d66c-b785-44f9-bc44-de9a72c40868 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:26.992103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5c4b8-1680-458d-99df-012ab4c27a73 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:26.995608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96d66c-b785-44f9-bc44-de9a72c40868 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:26.997823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-58f5c4b8-1680-458d-99df-012ab4c27a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:27.112120 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:27.157359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5c4b8-1680-458d-99df-012ab4c27a73 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:27.157462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716229c4-6b0f-4fd5-88ce-21e8bbbc933d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:27.158247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716229c4-6b0f-4fd5-88ce-21e8bbbc933d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:27.158536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716229c4-6b0f-4fd5-88ce-21e8bbbc933d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:27.158926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716229c4-6b0f-4fd5-88ce-21e8bbbc933d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:27.159460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716229c4-6b0f-4fd5-88ce-21e8bbbc933d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:27.161069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716229c4-6b0f-4fd5-88ce-21e8bbbc933d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:27.163867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a466b0-6b9b-463a-9341-9070c398ddd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:27.164489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a466b0-6b9b-463a-9341-9070c398ddd7 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:27.165433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a466b0-6b9b-463a-9341-9070c398ddd7 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:27.165711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a466b0-6b9b-463a-9341-9070c398ddd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:27.168157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-86a466b0-6b9b-463a-9341-9070c398ddd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:27.176639 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1013/2053] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:27.176639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716229c4-6b0f-4fd5-88ce-21e8bbbc933d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:27.178931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-716229c4-6b0f-4fd5-88ce-21e8bbbc933d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:27.193870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716229c4-6b0f-4fd5-88ce-21e8bbbc933d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:27.200184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c6d20-2747-48fc-b6ec-c1462cb392b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:27.200993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c6d20-2747-48fc-b6ec-c1462cb392b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:27.201311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c6d20-2747-48fc-b6ec-c1462cb392b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:27.201653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c6d20-2747-48fc-b6ec-c1462cb392b5 admin admin] PATH_INFO: `/v3/projects/851f788d9df64a70b805f7e32fe61030` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:27.202875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c6d20-2747-48fc-b6ec-c1462cb392b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=851f788d9df64a70b805f7e32fe61030)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:27.205021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c6d20-2747-48fc-b6ec-c1462cb392b5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:27.242222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a466b0-6b9b-463a-9341-9070c398ddd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:27.244270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a466b0-6b9b-463a-9341-9070c398ddd7 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:27.256463 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1041/2054] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:26 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:27.257598 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a466b0-6b9b-463a-9341-9070c398ddd7 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:27.259643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-86a466b0-6b9b-463a-9341-9070c398ddd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:27.265794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c63c6d20-2747-48fc-b6ec-c1462cb392b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '851f788d9df64a70b805f7e32fe61030', 'request_id': 'req-c63c6d20-2747-48fc-b6ec-c1462cb392b5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.281358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c63c6d20-2747-48fc-b6ec-c1462cb392b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '851f788d9df64a70b805f7e32fe61030', 'request_id': 'req-c63c6d20-2747-48fc-b6ec-c1462cb392b5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.282682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a466b0-6b9b-463a-9341-9070c398ddd7 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:27.290147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c63c6d20-2747-48fc-b6ec-c1462cb392b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '851f788d9df64a70b805f7e32fe61030', 'request_id': 'req-c63c6d20-2747-48fc-b6ec-c1462cb392b5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.309954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c63c6d20-2747-48fc-b6ec-c1462cb392b5 admin admin] The token cache is being invalidate because project 851f788d9df64a70b805f7e32fe61030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:27.309954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c63c6d20-2747-48fc-b6ec-c1462cb392b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.309954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c63c6d20-2747-48fc-b6ec-c1462cb392b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.317492 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1014/2055] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:27 2022] DELETE /identity/v3/projects/851f788d9df64a70b805f7e32fe61030 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:27.317649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c6d20-2747-48fc-b6ec-c1462cb392b5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:27.319157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c63c6d20-2747-48fc-b6ec-c1462cb392b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:27.347690 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:27.412245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75559f8-536f-4bb1-9f6c-6e39e160a5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:27.413074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75559f8-536f-4bb1-9f6c-6e39e160a5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:27.413374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75559f8-536f-4bb1-9f6c-6e39e160a5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:27.413614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75559f8-536f-4bb1-9f6c-6e39e160a5ee admin admin] PATH_INFO: `/v3/projects/6a8af9c909d548858ee3d922c68259b7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:27.417515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75559f8-536f-4bb1-9f6c-6e39e160a5ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a8af9c909d548858ee3d922c68259b7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:27.419445 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75559f8-536f-4bb1-9f6c-6e39e160a5ee admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:27.458913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c6d20-2747-48fc-b6ec-c1462cb392b5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:27.465500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e74a6-d399-4ed7-9c36-1bf0171c57e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:27.466245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e74a6-d399-4ed7-9c36-1bf0171c57e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:27.466426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e74a6-d399-4ed7-9c36-1bf0171c57e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:27.466696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e74a6-d399-4ed7-9c36-1bf0171c57e8 admin admin] PATH_INFO: `/v3/projects/c87afdb200794b74a44747706d282676/users/3390471f01194ce385e4e250f6c35f5f/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:27.473710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e74a6-d399-4ed7-9c36-1bf0171c57e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c87afdb200794b74a44747706d282676, user_id=3390471f01194ce385e4e250f6c35f5f, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:27.476276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e74a6-d399-4ed7-9c36-1bf0171c57e8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:27.489080 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1015/2056] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:27 2022] PUT /identity/v3/projects/c87afdb200794b74a44747706d282676/users/3390471f01194ce385e4e250f6c35f5f/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:27.490045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e74a6-d399-4ed7-9c36-1bf0171c57e8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:27.500894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-af2e74a6-d399-4ed7-9c36-1bf0171c57e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:27.501455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c75559f8-536f-4bb1-9f6c-6e39e160a5ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a8af9c909d548858ee3d922c68259b7', 'request_id': 'req-c75559f8-536f-4bb1-9f6c-6e39e160a5ee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.512808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c75559f8-536f-4bb1-9f6c-6e39e160a5ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a8af9c909d548858ee3d922c68259b7', 'request_id': 'req-c75559f8-536f-4bb1-9f6c-6e39e160a5ee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.521176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c75559f8-536f-4bb1-9f6c-6e39e160a5ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a8af9c909d548858ee3d922c68259b7', 'request_id': 'req-c75559f8-536f-4bb1-9f6c-6e39e160a5ee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.557233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c75559f8-536f-4bb1-9f6c-6e39e160a5ee admin admin] The token cache is being invalidate because project 6a8af9c909d548858ee3d922c68259b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:27.557526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c75559f8-536f-4bb1-9f6c-6e39e160a5ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.558200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c75559f8-536f-4bb1-9f6c-6e39e160a5ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.563043 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1042/2057] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:27 2022] DELETE /identity/v3/projects/6a8af9c909d548858ee3d922c68259b7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:27.563897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75559f8-536f-4bb1-9f6c-6e39e160a5ee admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:27.565318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c75559f8-536f-4bb1-9f6c-6e39e160a5ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:27.599407 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:27.611252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e74a6-d399-4ed7-9c36-1bf0171c57e8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:27.616836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a05b83-29ac-4f32-b392-2ea3dc082474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:27.618071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a05b83-29ac-4f32-b392-2ea3dc082474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:27.618349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a05b83-29ac-4f32-b392-2ea3dc082474 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:27.618617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a05b83-29ac-4f32-b392-2ea3dc082474 admin admin] PATH_INFO: `/v3/users/6aea2af32477422b913372adbfafcc08` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:27.620255 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a05b83-29ac-4f32-b392-2ea3dc082474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aea2af32477422b913372adbfafcc08)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:27.622210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a05b83-29ac-4f32-b392-2ea3dc082474 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:27.646589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75559f8-536f-4bb1-9f6c-6e39e160a5ee admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:27.652084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8807ff8-ac5a-4c28-b808-b435b0b673de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:27.652903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8807ff8-ac5a-4c28-b808-b435b0b673de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:27.653181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8807ff8-ac5a-4c28-b808-b435b0b673de admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:27.653610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8807ff8-ac5a-4c28-b808-b435b0b673de admin admin] PATH_INFO: `/v3/projects/ed85f87a198a41f7abd48dc304df5748` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:27.654735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8807ff8-ac5a-4c28-b808-b435b0b673de admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed85f87a198a41f7abd48dc304df5748)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:27.656630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8807ff8-ac5a-4c28-b808-b435b0b673de admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:27.681045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9a05b83-29ac-4f32-b392-2ea3dc082474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aea2af32477422b913372adbfafcc08'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.689032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9a05b83-29ac-4f32-b392-2ea3dc082474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aea2af32477422b913372adbfafcc08'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.689685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9a05b83-29ac-4f32-b392-2ea3dc082474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aea2af32477422b913372adbfafcc08'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.703785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9a05b83-29ac-4f32-b392-2ea3dc082474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aea2af32477422b913372adbfafcc08'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.708317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b8807ff8-ac5a-4c28-b808-b435b0b673de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed85f87a198a41f7abd48dc304df5748', 'request_id': 'req-b8807ff8-ac5a-4c28-b808-b435b0b673de'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.712252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9a05b83-29ac-4f32-b392-2ea3dc082474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aea2af32477422b913372adbfafcc08'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.716491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b8807ff8-ac5a-4c28-b808-b435b0b673de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed85f87a198a41f7abd48dc304df5748', 'request_id': 'req-b8807ff8-ac5a-4c28-b808-b435b0b673de'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.719309 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1016/2058] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:27 2022] DELETE /identity/v3/users/6aea2af32477422b913372adbfafcc08 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:27.720120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a05b83-29ac-4f32-b392-2ea3dc082474 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:27.721550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b9a05b83-29ac-4f32-b392-2ea3dc082474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:27.724309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b8807ff8-ac5a-4c28-b808-b435b0b673de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed85f87a198a41f7abd48dc304df5748', 'request_id': 'req-b8807ff8-ac5a-4c28-b808-b435b0b673de'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.726291 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:27.738680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b8807ff8-ac5a-4c28-b808-b435b0b673de admin admin] The token cache is being invalidate because project ed85f87a198a41f7abd48dc304df5748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:27.739093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b8807ff8-ac5a-4c28-b808-b435b0b673de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.740150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b8807ff8-ac5a-4c28-b808-b435b0b673de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.744732 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1043/2059] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:27 2022] DELETE /identity/v3/projects/ed85f87a198a41f7abd48dc304df5748 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:27.747393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04dedd-32ee-4c4b-b1ad-48a309d6cd27 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:27.748019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04dedd-32ee-4c4b-b1ad-48a309d6cd27 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:27.748591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04dedd-32ee-4c4b-b1ad-48a309d6cd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:27.780343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ed04dedd-32ee-4c4b-b1ad-48a309d6cd27 None None] MFA Rules not processed for user `3390471f01194ce385e4e250f6c35f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:27.781651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ed04dedd-32ee-4c4b-b1ad-48a309d6cd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:27.800110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a05b83-29ac-4f32-b392-2ea3dc082474 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:27.805654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fb5af-de98-456f-a2a2-4558df686d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:27.806374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fb5af-de98-456f-a2a2-4558df686d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:27.806661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fb5af-de98-456f-a2a2-4558df686d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:27.806940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fb5af-de98-456f-a2a2-4558df686d13 admin admin] PATH_INFO: `/v3/users/98076ff8699148adbd1d6ec507021136` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:27.808443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9fb5af-de98-456f-a2a2-4558df686d13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98076ff8699148adbd1d6ec507021136)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:27.810039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9fb5af-de98-456f-a2a2-4558df686d13 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:27.862945 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1044/2060] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:27 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:27.864041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04dedd-32ee-4c4b-b1ad-48a309d6cd27 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:27.865617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ed04dedd-32ee-4c4b-b1ad-48a309d6cd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:27.872055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3b9fb5af-de98-456f-a2a2-4558df686d13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98076ff8699148adbd1d6ec507021136'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.880907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3b9fb5af-de98-456f-a2a2-4558df686d13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98076ff8699148adbd1d6ec507021136'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.881504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04dedd-32ee-4c4b-b1ad-48a309d6cd27 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:27.881860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3b9fb5af-de98-456f-a2a2-4558df686d13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98076ff8699148adbd1d6ec507021136'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.893778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64404c5-a965-4d29-abe8-92019567d267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:27.894426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64404c5-a965-4d29-abe8-92019567d267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:27.895304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64404c5-a965-4d29-abe8-92019567d267 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:27.895587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64404c5-a965-4d29-abe8-92019567d267 admin admin] PATH_INFO: `/v3/users/72edd28f8176411995b96feb65baf6a8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:27.896911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64404c5-a965-4d29-abe8-92019567d267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72edd28f8176411995b96feb65baf6a8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:27.897491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3b9fb5af-de98-456f-a2a2-4558df686d13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98076ff8699148adbd1d6ec507021136'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.900087 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:27.900334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64404c5-a965-4d29-abe8-92019567d267 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:27.908155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3b9fb5af-de98-456f-a2a2-4558df686d13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98076ff8699148adbd1d6ec507021136'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.917977 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1017/2061] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:27 2022] DELETE /identity/v3/users/98076ff8699148adbd1d6ec507021136 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:27.919143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fb5af-de98-456f-a2a2-4558df686d13 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:27.921395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3b9fb5af-de98-456f-a2a2-4558df686d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:27.972759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f64404c5-a965-4d29-abe8-92019567d267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72edd28f8176411995b96feb65baf6a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.973547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f64404c5-a965-4d29-abe8-92019567d267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72edd28f8176411995b96feb65baf6a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.982643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f64404c5-a965-4d29-abe8-92019567d267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72edd28f8176411995b96feb65baf6a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:27.998270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f64404c5-a965-4d29-abe8-92019567d267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72edd28f8176411995b96feb65baf6a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:28.004084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fb5af-de98-456f-a2a2-4558df686d13 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:28.008930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f64404c5-a965-4d29-abe8-92019567d267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72edd28f8176411995b96feb65baf6a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:28.011471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97c827-4c95-4483-a2cc-f4e7b33b8e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:28.012100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97c827-4c95-4483-a2cc-f4e7b33b8e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:28.012451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97c827-4c95-4483-a2cc-f4e7b33b8e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:28.012928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97c827-4c95-4483-a2cc-f4e7b33b8e51 admin admin] PATH_INFO: `/v3/users/30cb31b44aeb4d64b0c24db25ebe4cf5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:28.014402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97c827-4c95-4483-a2cc-f4e7b33b8e51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30cb31b44aeb4d64b0c24db25ebe4cf5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:28.019350 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1045/2062] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:27 2022] DELETE /identity/v3/users/72edd28f8176411995b96feb65baf6a8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:28.019350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64404c5-a965-4d29-abe8-92019567d267 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:28.019622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97c827-4c95-4483-a2cc-f4e7b33b8e51 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:28.019713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f64404c5-a965-4d29-abe8-92019567d267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:28.096180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd97c827-4c95-4483-a2cc-f4e7b33b8e51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30cb31b44aeb4d64b0c24db25ebe4cf5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:28.106689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd97c827-4c95-4483-a2cc-f4e7b33b8e51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30cb31b44aeb4d64b0c24db25ebe4cf5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:28.107355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd97c827-4c95-4483-a2cc-f4e7b33b8e51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30cb31b44aeb4d64b0c24db25ebe4cf5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:28.110094 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:28.122836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd97c827-4c95-4483-a2cc-f4e7b33b8e51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30cb31b44aeb4d64b0c24db25ebe4cf5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:28.134186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd97c827-4c95-4483-a2cc-f4e7b33b8e51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30cb31b44aeb4d64b0c24db25ebe4cf5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:28.134960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64404c5-a965-4d29-abe8-92019567d267 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:28.141146 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1018/2063] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:27 2022] DELETE /identity/v3/users/30cb31b44aeb4d64b0c24db25ebe4cf5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:28.141304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e0c29-f74c-499d-9b17-8b6f45028cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:28.141772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97c827-4c95-4483-a2cc-f4e7b33b8e51 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:28.141882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e0c29-f74c-499d-9b17-8b6f45028cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:28.142098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e0c29-f74c-499d-9b17-8b6f45028cde admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:28.142431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e0c29-f74c-499d-9b17-8b6f45028cde admin admin] PATH_INFO: `/v3/users/88c1e54190814197b4823fd528cfaf86` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:28.143118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bd97c827-4c95-4483-a2cc-f4e7b33b8e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:28.143696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e0c29-f74c-499d-9b17-8b6f45028cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=88c1e54190814197b4823fd528cfaf86)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:28.147150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e0c29-f74c-499d-9b17-8b6f45028cde admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:28.221895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f23e0c29-f74c-499d-9b17-8b6f45028cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88c1e54190814197b4823fd528cfaf86'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:28.223237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f23e0c29-f74c-499d-9b17-8b6f45028cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88c1e54190814197b4823fd528cfaf86'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:28.227543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97c827-4c95-4483-a2cc-f4e7b33b8e51 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:28.233329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f23e0c29-f74c-499d-9b17-8b6f45028cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88c1e54190814197b4823fd528cfaf86'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:28.233543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8211a5-ee40-48ee-83d4-38c818661fa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:28.234212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8211a5-ee40-48ee-83d4-38c818661fa5 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:28.234488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8211a5-ee40-48ee-83d4-38c818661fa5 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:28.234781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8211a5-ee40-48ee-83d4-38c818661fa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:28.236803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cf8211a5-ee40-48ee-83d4-38c818661fa5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:28.243361 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:28.248208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f23e0c29-f74c-499d-9b17-8b6f45028cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88c1e54190814197b4823fd528cfaf86'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:28.256454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f23e0c29-f74c-499d-9b17-8b6f45028cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88c1e54190814197b4823fd528cfaf86'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:28.264318 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1046/2064] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:28 2022] DELETE /identity/v3/users/88c1e54190814197b4823fd528cfaf86 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:28.265593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0252a5-eea3-49be-a78b-b4897c0a4532 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:28.265882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0252a5-eea3-49be-a78b-b4897c0a4532 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:28.266185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0252a5-eea3-49be-a78b-b4897c0a4532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:28.291575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ef0252a5-eea3-49be-a78b-b4897c0a4532 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:28.293135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ef0252a5-eea3-49be-a78b-b4897c0a4532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:28.314985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8211a5-ee40-48ee-83d4-38c818661fa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:28.317665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8211a5-ee40-48ee-83d4-38c818661fa5 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:28.333465 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1019/2065] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:28 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:28.334415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8211a5-ee40-48ee-83d4-38c818661fa5 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:28.336017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cf8211a5-ee40-48ee-83d4-38c818661fa5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:28.392865 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1047/2066] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:28.392865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a35292-f691-448c-b299-3f2840af6440 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:28.392865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a35292-f691-448c-b299-3f2840af6440 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:28.392865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a35292-f691-448c-b299-3f2840af6440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:28.427222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f3a35292-f691-448c-b299-3f2840af6440 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:28.428737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f3a35292-f691-448c-b299-3f2840af6440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:28.437556 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1048/2067] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:28.438593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a35292-f691-448c-b299-3f2840af6440 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:28.441849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f3a35292-f691-448c-b299-3f2840af6440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:28.448643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8211a5-ee40-48ee-83d4-38c818661fa5 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:28.455293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b54bb-bdac-4b01-b383-f15d35b7783a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:28.455565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a35292-f691-448c-b299-3f2840af6440 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:28.456075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b54bb-bdac-4b01-b383-f15d35b7783a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:28.456438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b54bb-bdac-4b01-b383-f15d35b7783a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:28.456808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b54bb-bdac-4b01-b383-f15d35b7783a admin admin] PATH_INFO: `/v3/projects/5f3a8950fb084966bea2581177520a23` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:28.458117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b54bb-bdac-4b01-b383-f15d35b7783a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f3a8950fb084966bea2581177520a23)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:28.460491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b54bb-bdac-4b01-b383-f15d35b7783a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:28.460848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6316b3c-da70-4d77-9287-8c9d32859509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:28.461516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6316b3c-da70-4d77-9287-8c9d32859509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:28.461796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6316b3c-da70-4d77-9287-8c9d32859509 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:28.462067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6316b3c-da70-4d77-9287-8c9d32859509 admin admin] PATH_INFO: `/v3/projects/75dfac6d55f7400fb9147ab85724600e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:28.463200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6316b3c-da70-4d77-9287-8c9d32859509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75dfac6d55f7400fb9147ab85724600e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:28.465181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6316b3c-da70-4d77-9287-8c9d32859509 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:28.522232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4c7b54bb-bdac-4b01-b383-f15d35b7783a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f3a8950fb084966bea2581177520a23', 'request_id': 'req-4c7b54bb-bdac-4b01-b383-f15d35b7783a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:28.526361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6316b3c-da70-4d77-9287-8c9d32859509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75dfac6d55f7400fb9147ab85724600e', 'request_id': 'req-f6316b3c-da70-4d77-9287-8c9d32859509'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:28.533147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4c7b54bb-bdac-4b01-b383-f15d35b7783a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f3a8950fb084966bea2581177520a23', 'request_id': 'req-4c7b54bb-bdac-4b01-b383-f15d35b7783a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:28.534850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6316b3c-da70-4d77-9287-8c9d32859509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75dfac6d55f7400fb9147ab85724600e', 'request_id': 'req-f6316b3c-da70-4d77-9287-8c9d32859509'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:28.539395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4c7b54bb-bdac-4b01-b383-f15d35b7783a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f3a8950fb084966bea2581177520a23', 'request_id': 'req-4c7b54bb-bdac-4b01-b383-f15d35b7783a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:28.539615 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:28.543656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6316b3c-da70-4d77-9287-8c9d32859509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75dfac6d55f7400fb9147ab85724600e', 'request_id': 'req-f6316b3c-da70-4d77-9287-8c9d32859509'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:28.551955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4c7b54bb-bdac-4b01-b383-f15d35b7783a admin admin] The token cache is being invalidate because project 5f3a8950fb084966bea2581177520a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:28.552262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4c7b54bb-bdac-4b01-b383-f15d35b7783a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:28.553004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4c7b54bb-bdac-4b01-b383-f15d35b7783a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:28.554882 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1020/2068] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:28 2022] DELETE /identity/v3/projects/5f3a8950fb084966bea2581177520a23 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:28.556371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b54bb-bdac-4b01-b383-f15d35b7783a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:28.557830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4c7b54bb-bdac-4b01-b383-f15d35b7783a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:28.568964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6316b3c-da70-4d77-9287-8c9d32859509 admin admin] The token cache is being invalidate because project 75dfac6d55f7400fb9147ab85724600e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:28.569251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6316b3c-da70-4d77-9287-8c9d32859509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:28.569939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6316b3c-da70-4d77-9287-8c9d32859509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:28.572507 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1049/2069] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:28 2022] DELETE /identity/v3/projects/75dfac6d55f7400fb9147ab85724600e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:28.573568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6316b3c-da70-4d77-9287-8c9d32859509 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:28.575629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f6316b3c-da70-4d77-9287-8c9d32859509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:28.611816 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:28.641865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b54bb-bdac-4b01-b383-f15d35b7783a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:28.647609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68408ddb-d551-4bf7-8ea2-933f8e4dccdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:28.648241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68408ddb-d551-4bf7-8ea2-933f8e4dccdb service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:28.648522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68408ddb-d551-4bf7-8ea2-933f8e4dccdb service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:28.648925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68408ddb-d551-4bf7-8ea2-933f8e4dccdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:28.650729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-68408ddb-d551-4bf7-8ea2-933f8e4dccdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:28.677583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6316b3c-da70-4d77-9287-8c9d32859509 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:28.728350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68408ddb-d551-4bf7-8ea2-933f8e4dccdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:28.730168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68408ddb-d551-4bf7-8ea2-933f8e4dccdb service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:28.744830 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1021/2070] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:28.747809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68408ddb-d551-4bf7-8ea2-933f8e4dccdb service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:28.750143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-68408ddb-d551-4bf7-8ea2-933f8e4dccdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:28.764539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68408ddb-d551-4bf7-8ea2-933f8e4dccdb service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:28.768870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d2b44-9ef5-4988-b957-fda54a0d9c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:28.769481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d2b44-9ef5-4988-b957-fda54a0d9c5b service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:28.769754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d2b44-9ef5-4988-b957-fda54a0d9c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:28.770020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d2b44-9ef5-4988-b957-fda54a0d9c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:28.772110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-da6d2b44-9ef5-4988-b957-fda54a0d9c5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:28.777167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4298d24-1927-4cdf-841a-e1b84f3e492b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:28.778112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4298d24-1927-4cdf-841a-e1b84f3e492b service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:28.778531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4298d24-1927-4cdf-841a-e1b84f3e492b service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:28.778955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4298d24-1927-4cdf-841a-e1b84f3e492b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:28.781219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c4298d24-1927-4cdf-841a-e1b84f3e492b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:28.792145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d2b44-9ef5-4988-b957-fda54a0d9c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:28.793850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d2b44-9ef5-4988-b957-fda54a0d9c5b service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:28.806256 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1022/2071] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:28.808230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffb504-ec3f-4dfa-b2ab-355c1f12188a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:28.808514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffb504-ec3f-4dfa-b2ab-355c1f12188a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:28.808826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffb504-ec3f-4dfa-b2ab-355c1f12188a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:28.836012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b0ffb504-ec3f-4dfa-b2ab-355c1f12188a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:28.839068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b0ffb504-ec3f-4dfa-b2ab-355c1f12188a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:28.848466 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1023/2072] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:28.849989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fbaa2-9a7d-46cb-968a-9ab12bbd2b95 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:28.850272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fbaa2-9a7d-46cb-968a-9ab12bbd2b95 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:28.850545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fbaa2-9a7d-46cb-968a-9ab12bbd2b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:28.874186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-654fbaa2-9a7d-46cb-968a-9ab12bbd2b95 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:28.875409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-654fbaa2-9a7d-46cb-968a-9ab12bbd2b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:28.891824 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1024/2073] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:28.891824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fbaa2-9a7d-46cb-968a-9ab12bbd2b95 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:28.891824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-654fbaa2-9a7d-46cb-968a-9ab12bbd2b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:28.905370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fbaa2-9a7d-46cb-968a-9ab12bbd2b95 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:28.905989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4298d24-1927-4cdf-841a-e1b84f3e492b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:28.908844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4298d24-1927-4cdf-841a-e1b84f3e492b service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:28.911987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964a4b0-9f93-4110-a3d1-5ab469151191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:28.912919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964a4b0-9f93-4110-a3d1-5ab469151191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:28.913429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964a4b0-9f93-4110-a3d1-5ab469151191 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:28.914250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964a4b0-9f93-4110-a3d1-5ab469151191 admin admin] PATH_INFO: `/v3/projects/a0fead7a8e8940dd9fb9cd9c06d79fa3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:28.917179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964a4b0-9f93-4110-a3d1-5ab469151191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0fead7a8e8940dd9fb9cd9c06d79fa3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:28.919968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964a4b0-9f93-4110-a3d1-5ab469151191 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:28.922941 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1050/2074] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:28 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:28.924458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7f2ad-cf8a-4986-b33a-47d1c07324e5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:28.926849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7f2ad-cf8a-4986-b33a-47d1c07324e5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:28.927053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7f2ad-cf8a-4986-b33a-47d1c07324e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:28.955883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-05b7f2ad-cf8a-4986-b33a-47d1c07324e5 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:28.957453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-05b7f2ad-cf8a-4986-b33a-47d1c07324e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:28.968640 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1051/2075] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:28.970151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e668dc9-5f05-4af5-a95f-a035c6f91970 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:28.970504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e668dc9-5f05-4af5-a95f-a035c6f91970 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:28.971010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e668dc9-5f05-4af5-a95f-a035c6f91970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:29.003017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0e668dc9-5f05-4af5-a95f-a035c6f91970 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:29.004296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0e668dc9-5f05-4af5-a95f-a035c6f91970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:29.006094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8964a4b0-9f93-4110-a3d1-5ab469151191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0fead7a8e8940dd9fb9cd9c06d79fa3', 'request_id': 'req-8964a4b0-9f93-4110-a3d1-5ab469151191'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.017517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8964a4b0-9f93-4110-a3d1-5ab469151191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0fead7a8e8940dd9fb9cd9c06d79fa3', 'request_id': 'req-8964a4b0-9f93-4110-a3d1-5ab469151191'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.019217 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:29.026539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8964a4b0-9f93-4110-a3d1-5ab469151191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0fead7a8e8940dd9fb9cd9c06d79fa3', 'request_id': 'req-8964a4b0-9f93-4110-a3d1-5ab469151191'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.040715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8964a4b0-9f93-4110-a3d1-5ab469151191 admin admin] The token cache is being invalidate because project a0fead7a8e8940dd9fb9cd9c06d79fa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:29.042753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8964a4b0-9f93-4110-a3d1-5ab469151191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.043541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8964a4b0-9f93-4110-a3d1-5ab469151191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.049158 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1025/2076] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:28 2022] DELETE /identity/v3/projects/a0fead7a8e8940dd9fb9cd9c06d79fa3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:29.050459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964a4b0-9f93-4110-a3d1-5ab469151191 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:29.054450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8964a4b0-9f93-4110-a3d1-5ab469151191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:29.093050 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1052/2077] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:29.094553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e668dc9-5f05-4af5-a95f-a035c6f91970 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:29.100760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0e668dc9-5f05-4af5-a95f-a035c6f91970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:29.116292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e668dc9-5f05-4af5-a95f-a035c6f91970 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:29.127032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95da7b-9329-4882-9755-4dcececc73d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:29.127497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95da7b-9329-4882-9755-4dcececc73d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:29.127864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95da7b-9329-4882-9755-4dcececc73d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:29.128146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95da7b-9329-4882-9755-4dcececc73d1 admin admin] PATH_INFO: `/v3/users/1e5b2b8096554a248f68a2ca3e2c7aa3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:29.129902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95da7b-9329-4882-9755-4dcececc73d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e5b2b8096554a248f68a2ca3e2c7aa3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:29.132892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95da7b-9329-4882-9755-4dcececc73d1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:29.142985 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:29.181936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964a4b0-9f93-4110-a3d1-5ab469151191 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:29.188043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c32e9-93a4-400b-bb34-7e20c9596d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:29.188705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c32e9-93a4-400b-bb34-7e20c9596d26 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:29.188983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c32e9-93a4-400b-bb34-7e20c9596d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:29.189256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c32e9-93a4-400b-bb34-7e20c9596d26 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:29.189971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c32e9-93a4-400b-bb34-7e20c9596d26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:29.190279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c32e9-93a4-400b-bb34-7e20c9596d26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:29.191868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c32e9-93a4-400b-bb34-7e20c9596d26 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:29.201018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7b95da7b-9329-4882-9755-4dcececc73d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e5b2b8096554a248f68a2ca3e2c7aa3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.201701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7b95da7b-9329-4882-9755-4dcececc73d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e5b2b8096554a248f68a2ca3e2c7aa3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.212384 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1026/2078] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:29.215015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7b95da7b-9329-4882-9755-4dcececc73d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e5b2b8096554a248f68a2ca3e2c7aa3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.217499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023f0ee-b034-46d5-b38f-f80f1b956a5b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:29.217775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023f0ee-b034-46d5-b38f-f80f1b956a5b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:29.218068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023f0ee-b034-46d5-b38f-f80f1b956a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:29.233575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7b95da7b-9329-4882-9755-4dcececc73d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e5b2b8096554a248f68a2ca3e2c7aa3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.241580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7b95da7b-9329-4882-9755-4dcececc73d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e5b2b8096554a248f68a2ca3e2c7aa3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.245056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e023f0ee-b034-46d5-b38f-f80f1b956a5b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:29.247046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e023f0ee-b034-46d5-b38f-f80f1b956a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:29.251826 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1053/2079] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:29 2022] DELETE /identity/v3/users/1e5b2b8096554a248f68a2ca3e2c7aa3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:29.252878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95da7b-9329-4882-9755-4dcececc73d1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:29.254361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7b95da7b-9329-4882-9755-4dcececc73d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:29.256850 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1027/2080] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:29.257528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023f0ee-b034-46d5-b38f-f80f1b956a5b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:29.258821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e023f0ee-b034-46d5-b38f-f80f1b956a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:29.270725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023f0ee-b034-46d5-b38f-f80f1b956a5b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:29.330631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95da7b-9329-4882-9755-4dcececc73d1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:29.335383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af472b3-1dd9-4f7d-8cb1-9a8f234fb989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:29.335968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af472b3-1dd9-4f7d-8cb1-9a8f234fb989 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:29.336822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af472b3-1dd9-4f7d-8cb1-9a8f234fb989 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:29.337179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af472b3-1dd9-4f7d-8cb1-9a8f234fb989 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:29.337814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af472b3-1dd9-4f7d-8cb1-9a8f234fb989 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:29.338113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af472b3-1dd9-4f7d-8cb1-9a8f234fb989 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:29.339687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af472b3-1dd9-4f7d-8cb1-9a8f234fb989 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:29.345353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a87de-1aa7-494f-ad22-3329c2c7b827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:29.346092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a87de-1aa7-494f-ad22-3329c2c7b827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:29.346477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a87de-1aa7-494f-ad22-3329c2c7b827 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:29.346952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a87de-1aa7-494f-ad22-3329c2c7b827 admin admin] PATH_INFO: `/v3/projects/a1057707ad4c4a82b37451280530a7a5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:29.348330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a87de-1aa7-494f-ad22-3329c2c7b827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1057707ad4c4a82b37451280530a7a5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:29.350914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a87de-1aa7-494f-ad22-3329c2c7b827 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:29.354270 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1054/2081] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:29.355332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af472b3-1dd9-4f7d-8cb1-9a8f234fb989 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:29.357540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6af472b3-1dd9-4f7d-8cb1-9a8f234fb989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:29.373520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af472b3-1dd9-4f7d-8cb1-9a8f234fb989 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:29.379231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c560ed-2a7a-445b-a963-f7e0ad1da1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:29.379842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c560ed-2a7a-445b-a963-f7e0ad1da1c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:29.380107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c560ed-2a7a-445b-a963-f7e0ad1da1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:29.380966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c560ed-2a7a-445b-a963-f7e0ad1da1c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:29.381829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c560ed-2a7a-445b-a963-f7e0ad1da1c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:29.384398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c560ed-2a7a-445b-a963-f7e0ad1da1c1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:29.418867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-795a87de-1aa7-494f-ad22-3329c2c7b827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1057707ad4c4a82b37451280530a7a5', 'request_id': 'req-795a87de-1aa7-494f-ad22-3329c2c7b827'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.425232 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1055/2082] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:29 2022] POST /identity/v3/projects => generated 391 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:29.425232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c560ed-2a7a-445b-a963-f7e0ad1da1c1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:29.427274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f5c560ed-2a7a-445b-a963-f7e0ad1da1c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:29.428475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-795a87de-1aa7-494f-ad22-3329c2c7b827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1057707ad4c4a82b37451280530a7a5', 'request_id': 'req-795a87de-1aa7-494f-ad22-3329c2c7b827'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.432304 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:29.443718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-795a87de-1aa7-494f-ad22-3329c2c7b827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1057707ad4c4a82b37451280530a7a5', 'request_id': 'req-795a87de-1aa7-494f-ad22-3329c2c7b827'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.456452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-795a87de-1aa7-494f-ad22-3329c2c7b827 admin admin] The token cache is being invalidate because project a1057707ad4c4a82b37451280530a7a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:29.456785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-795a87de-1aa7-494f-ad22-3329c2c7b827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.457456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-795a87de-1aa7-494f-ad22-3329c2c7b827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.459654 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1028/2083] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:29 2022] DELETE /identity/v3/projects/a1057707ad4c4a82b37451280530a7a5 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:29.460901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c531203-f4ba-47a5-a67d-e7fac23d4791 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:29.461384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c531203-f4ba-47a5-a67d-e7fac23d4791 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:29.462393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c531203-f4ba-47a5-a67d-e7fac23d4791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:29.485527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6c531203-f4ba-47a5-a67d-e7fac23d4791 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:29.486727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6c531203-f4ba-47a5-a67d-e7fac23d4791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:29.508897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c560ed-2a7a-445b-a963-f7e0ad1da1c1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:29.518287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295e1b4-04d4-44fb-920a-1bc7b7969340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:29.518997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295e1b4-04d4-44fb-920a-1bc7b7969340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:29.519213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295e1b4-04d4-44fb-920a-1bc7b7969340 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:29.520187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295e1b4-04d4-44fb-920a-1bc7b7969340 admin admin] PATH_INFO: `/v3/projects/09c0fe7ef721446495f900a05d88eb3e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:29.521390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295e1b4-04d4-44fb-920a-1bc7b7969340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09c0fe7ef721446495f900a05d88eb3e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:29.523498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295e1b4-04d4-44fb-920a-1bc7b7969340 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:29.544153 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:29.556992 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1029/2084] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:29.558583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffb543-a3a1-4117-9327-1417579eac0e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:29.559383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffb543-a3a1-4117-9327-1417579eac0e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:29.559710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffb543-a3a1-4117-9327-1417579eac0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:29.580919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0295e1b4-04d4-44fb-920a-1bc7b7969340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09c0fe7ef721446495f900a05d88eb3e', 'request_id': 'req-0295e1b4-04d4-44fb-920a-1bc7b7969340'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.583382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-72ffb543-a3a1-4117-9327-1417579eac0e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:29.584637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-72ffb543-a3a1-4117-9327-1417579eac0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:29.594355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0295e1b4-04d4-44fb-920a-1bc7b7969340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09c0fe7ef721446495f900a05d88eb3e', 'request_id': 'req-0295e1b4-04d4-44fb-920a-1bc7b7969340'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.601041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0295e1b4-04d4-44fb-920a-1bc7b7969340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09c0fe7ef721446495f900a05d88eb3e', 'request_id': 'req-0295e1b4-04d4-44fb-920a-1bc7b7969340'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.614165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0295e1b4-04d4-44fb-920a-1bc7b7969340 admin admin] The token cache is being invalidate because project 09c0fe7ef721446495f900a05d88eb3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:29.614453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0295e1b4-04d4-44fb-920a-1bc7b7969340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.615250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0295e1b4-04d4-44fb-920a-1bc7b7969340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.616903 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1056/2085] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:29 2022] DELETE /identity/v3/projects/09c0fe7ef721446495f900a05d88eb3e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:29.618968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295e1b4-04d4-44fb-920a-1bc7b7969340 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:29.620335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0295e1b4-04d4-44fb-920a-1bc7b7969340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:29.656988 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1030/2086] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:29.658051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffb543-a3a1-4117-9327-1417579eac0e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:29.659833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-72ffb543-a3a1-4117-9327-1417579eac0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:29.672788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffb543-a3a1-4117-9327-1417579eac0e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:29.677559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8b422-fa26-40eb-8d91-22d9af102548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:29.678168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8b422-fa26-40eb-8d91-22d9af102548 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:29.678445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8b422-fa26-40eb-8d91-22d9af102548 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:29.678715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8b422-fa26-40eb-8d91-22d9af102548 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:29.679347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8b422-fa26-40eb-8d91-22d9af102548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:29.682751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8b422-fa26-40eb-8d91-22d9af102548 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:29.704951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295e1b4-04d4-44fb-920a-1bc7b7969340 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:29.709305 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1031/2087] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:29 2022] POST /identity/v3/users => generated 296 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:29.710399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8b422-fa26-40eb-8d91-22d9af102548 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:29.713136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1fe8b422-fa26-40eb-8d91-22d9af102548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:29.720989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fda289-c838-4962-857b-878bc14338ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:29.721911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fda289-c838-4962-857b-878bc14338ad admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:29.722391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fda289-c838-4962-857b-878bc14338ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:29.723049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fda289-c838-4962-857b-878bc14338ad admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:29.724297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fda289-c838-4962-857b-878bc14338ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:29.728441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fda289-c838-4962-857b-878bc14338ad admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:29.733829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8b422-fa26-40eb-8d91-22d9af102548 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:29.743799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e970de8-896c-41d4-9231-6713bc060a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:29.745817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e970de8-896c-41d4-9231-6713bc060a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:29.746217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e970de8-896c-41d4-9231-6713bc060a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:29.746586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e970de8-896c-41d4-9231-6713bc060a1f admin admin] PATH_INFO: `/v3/users/cc87618fdef24c199901ca726ab4a6e5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:29.748069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e970de8-896c-41d4-9231-6713bc060a1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc87618fdef24c199901ca726ab4a6e5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:29.750519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e970de8-896c-41d4-9231-6713bc060a1f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:29.764549 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1057/2088] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:29 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:29.765424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fda289-c838-4962-857b-878bc14338ad admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:29.767119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-14fda289-c838-4962-857b-878bc14338ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:29.788447 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:29.811819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4e970de8-896c-41d4-9231-6713bc060a1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc87618fdef24c199901ca726ab4a6e5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.822123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4e970de8-896c-41d4-9231-6713bc060a1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc87618fdef24c199901ca726ab4a6e5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.822687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4e970de8-896c-41d4-9231-6713bc060a1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc87618fdef24c199901ca726ab4a6e5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.837311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4e970de8-896c-41d4-9231-6713bc060a1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc87618fdef24c199901ca726ab4a6e5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.838565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fda289-c838-4962-857b-878bc14338ad admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:29.842448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f47c9-4bc5-4323-b997-3a2dfe1dd557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:29.843052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f47c9-4bc5-4323-b997-3a2dfe1dd557 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:29.843326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f47c9-4bc5-4323-b997-3a2dfe1dd557 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:29.843649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f47c9-4bc5-4323-b997-3a2dfe1dd557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:29.844275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4e970de8-896c-41d4-9231-6713bc060a1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc87618fdef24c199901ca726ab4a6e5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:29.845622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-331f47c9-4bc5-4323-b997-3a2dfe1dd557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:29.850571 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1032/2089] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:29 2022] DELETE /identity/v3/users/cc87618fdef24c199901ca726ab4a6e5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:29.851398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e970de8-896c-41d4-9231-6713bc060a1f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:29.853406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4e970de8-896c-41d4-9231-6713bc060a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:29.930311 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:29.936234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f47c9-4bc5-4323-b997-3a2dfe1dd557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:29.938524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f47c9-4bc5-4323-b997-3a2dfe1dd557 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:29.950876 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1058/2090] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:29.951587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f47c9-4bc5-4323-b997-3a2dfe1dd557 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:29.951794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e970de8-896c-41d4-9231-6713bc060a1f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:29.958220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042f6a4-3be2-4b67-b52c-8cae518a98f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:29.958994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042f6a4-3be2-4b67-b52c-8cae518a98f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:29.959340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042f6a4-3be2-4b67-b52c-8cae518a98f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:29.959612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042f6a4-3be2-4b67-b52c-8cae518a98f3 admin admin] PATH_INFO: `/v3/users/b764c43cdf5f463fbdd787efbb2a5f1a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:29.960770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042f6a4-3be2-4b67-b52c-8cae518a98f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b764c43cdf5f463fbdd787efbb2a5f1a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:29.963521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f47c9-4bc5-4323-b997-3a2dfe1dd557 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:29.963737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042f6a4-3be2-4b67-b52c-8cae518a98f3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:29.968931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1482a3-901c-49da-b6b1-dda595ef0aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:29.969626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1482a3-901c-49da-b6b1-dda595ef0aff admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:29.969959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1482a3-901c-49da-b6b1-dda595ef0aff admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:29.970298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1482a3-901c-49da-b6b1-dda595ef0aff admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:29.971688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1482a3-901c-49da-b6b1-dda595ef0aff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:29.971688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1482a3-901c-49da-b6b1-dda595ef0aff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:29.973075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1482a3-901c-49da-b6b1-dda595ef0aff admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:29.987670 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1059/2091] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:29.988763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1482a3-901c-49da-b6b1-dda595ef0aff admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:29.992332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bd1482a3-901c-49da-b6b1-dda595ef0aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:30.011554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1482a3-901c-49da-b6b1-dda595ef0aff admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:30.018650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb5268-1120-4d9f-aef2-48aaac81bea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:30.019625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb5268-1120-4d9f-aef2-48aaac81bea6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:30.020085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb5268-1120-4d9f-aef2-48aaac81bea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:30.020707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb5268-1120-4d9f-aef2-48aaac81bea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:30.021784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb5268-1120-4d9f-aef2-48aaac81bea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:30.024451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb5268-1120-4d9f-aef2-48aaac81bea6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:30.042404 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1060/2092] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:30.043565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb5268-1120-4d9f-aef2-48aaac81bea6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:30.046577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0ddb5268-1120-4d9f-aef2-48aaac81bea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:30.052528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e042f6a4-3be2-4b67-b52c-8cae518a98f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b764c43cdf5f463fbdd787efbb2a5f1a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:30.064438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e042f6a4-3be2-4b67-b52c-8cae518a98f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b764c43cdf5f463fbdd787efbb2a5f1a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:30.065980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e042f6a4-3be2-4b67-b52c-8cae518a98f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b764c43cdf5f463fbdd787efbb2a5f1a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:30.067442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb5268-1120-4d9f-aef2-48aaac81bea6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:30.073722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19762b76-c289-40a9-bda1-df816b9fef5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:30.074685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19762b76-c289-40a9-bda1-df816b9fef5d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:30.075172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19762b76-c289-40a9-bda1-df816b9fef5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:30.075952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19762b76-c289-40a9-bda1-df816b9fef5d admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:30.076979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19762b76-c289-40a9-bda1-df816b9fef5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:30.079354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19762b76-c289-40a9-bda1-df816b9fef5d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:30.083849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e042f6a4-3be2-4b67-b52c-8cae518a98f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b764c43cdf5f463fbdd787efbb2a5f1a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:30.101718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e042f6a4-3be2-4b67-b52c-8cae518a98f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b764c43cdf5f463fbdd787efbb2a5f1a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:30.120015 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1033/2093] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:29 2022] DELETE /identity/v3/users/b764c43cdf5f463fbdd787efbb2a5f1a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:30.121050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042f6a4-3be2-4b67-b52c-8cae518a98f3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:30.121403 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1061/2094] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:30 2022] POST /identity/v3/users => generated 293 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:30.122787 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19762b76-c289-40a9-bda1-df816b9fef5d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:30.124121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e042f6a4-3be2-4b67-b52c-8cae518a98f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:30.126494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-19762b76-c289-40a9-bda1-df816b9fef5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:30.146719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19762b76-c289-40a9-bda1-df816b9fef5d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:30.231830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4dcf6-56fe-446e-8829-673bab6b9263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:30.232459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4dcf6-56fe-446e-8829-673bab6b9263 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:30.232825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4dcf6-56fe-446e-8829-673bab6b9263 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:30.233100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4dcf6-56fe-446e-8829-673bab6b9263 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:30.233894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4dcf6-56fe-446e-8829-673bab6b9263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:30.235506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042f6a4-3be2-4b67-b52c-8cae518a98f3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:30.235634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4dcf6-56fe-446e-8829-673bab6b9263 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:30.243307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156b827-5675-4a13-ae44-f777ce011c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:30.243993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156b827-5675-4a13-ae44-f777ce011c3f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:30.244273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156b827-5675-4a13-ae44-f777ce011c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:30.244540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156b827-5675-4a13-ae44-f777ce011c3f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:30.245205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156b827-5675-4a13-ae44-f777ce011c3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:30.247495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156b827-5675-4a13-ae44-f777ce011c3f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:30.251955 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1062/2095] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:30.253282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4dcf6-56fe-446e-8829-673bab6b9263 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:30.256158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8ed4dcf6-56fe-446e-8829-673bab6b9263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:30.272522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4dcf6-56fe-446e-8829-673bab6b9263 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:30.281905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819832a1-51a5-4e96-960f-0d5d68480ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:30.283955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819832a1-51a5-4e96-960f-0d5d68480ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:30.284214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819832a1-51a5-4e96-960f-0d5d68480ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:30.286259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819832a1-51a5-4e96-960f-0d5d68480ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:30.286259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819832a1-51a5-4e96-960f-0d5d68480ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:30.292227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819832a1-51a5-4e96-960f-0d5d68480ba4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:30.304630 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1034/2096] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:30 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:30.307050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156b827-5675-4a13-ae44-f777ce011c3f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:30.314314 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1063/2097] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:30.315236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819832a1-51a5-4e96-960f-0d5d68480ba4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:30.326737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819832a1-51a5-4e96-960f-0d5d68480ba4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:30.336788 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:30.417225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cff45d-3933-4eb3-bcfa-0047a182af63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:30.417913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cff45d-3933-4eb3-bcfa-0047a182af63 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:30.418237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cff45d-3933-4eb3-bcfa-0047a182af63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:30.418869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cff45d-3933-4eb3-bcfa-0047a182af63 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:30.419583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cff45d-3933-4eb3-bcfa-0047a182af63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:30.422674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cff45d-3933-4eb3-bcfa-0047a182af63 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:30.424832 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:30.436003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156b827-5675-4a13-ae44-f777ce011c3f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:30.446351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c021f2e-3fc3-4946-9c61-fbee99fb69f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:30.447894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c021f2e-3fc3-4946-9c61-fbee99fb69f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:30.448874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c021f2e-3fc3-4946-9c61-fbee99fb69f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:30.449454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c021f2e-3fc3-4946-9c61-fbee99fb69f5 admin admin] PATH_INFO: `/v3/projects/7e5a96bc0045495d9d75a61d6571bc11/users/f10ba32c82614a22b12bf94ba36f14df/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:30.471539 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1064/2098] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:30 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:30.479965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cff45d-3933-4eb3-bcfa-0047a182af63 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:30.482500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c021f2e-3fc3-4946-9c61-fbee99fb69f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e5a96bc0045495d9d75a61d6571bc11, user_id=f10ba32c82614a22b12bf94ba36f14df, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:30.485507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c021f2e-3fc3-4946-9c61-fbee99fb69f5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:30.496184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cff45d-3933-4eb3-bcfa-0047a182af63 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:30.504586 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1035/2099] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:30 2022] PUT /identity/v3/projects/7e5a96bc0045495d9d75a61d6571bc11/users/f10ba32c82614a22b12bf94ba36f14df/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:30.508836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c021f2e-3fc3-4946-9c61-fbee99fb69f5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:30.508836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9c021f2e-3fc3-4946-9c61-fbee99fb69f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:30.588514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44b34e-7122-4872-a37e-6e67d16f9c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:30.589275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44b34e-7122-4872-a37e-6e67d16f9c6a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:30.589628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44b34e-7122-4872-a37e-6e67d16f9c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:30.589972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44b34e-7122-4872-a37e-6e67d16f9c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:30.590691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44b34e-7122-4872-a37e-6e67d16f9c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:30.593410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44b34e-7122-4872-a37e-6e67d16f9c6a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:30.605962 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1065/2100] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:30.606977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44b34e-7122-4872-a37e-6e67d16f9c6a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:30.607162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c021f2e-3fc3-4946-9c61-fbee99fb69f5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:30.612921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247bb26-541a-421f-b0bf-7129d3fcdf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:30.613555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247bb26-541a-421f-b0bf-7129d3fcdf99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:30.613832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247bb26-541a-421f-b0bf-7129d3fcdf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:30.614403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247bb26-541a-421f-b0bf-7129d3fcdf99 admin admin] PATH_INFO: `/v3/projects/eba7f2d771ac480abe87eb4cd4df69ac` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:30.615215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247bb26-541a-421f-b0bf-7129d3fcdf99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eba7f2d771ac480abe87eb4cd4df69ac)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:30.617142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247bb26-541a-421f-b0bf-7129d3fcdf99 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:30.620775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44b34e-7122-4872-a37e-6e67d16f9c6a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:30.627947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2c788-9973-45b3-8e1d-615f1da2d457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:30.628922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2c788-9973-45b3-8e1d-615f1da2d457 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:30.629523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2c788-9973-45b3-8e1d-615f1da2d457 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:30.629796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2c788-9973-45b3-8e1d-615f1da2d457 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:30.630572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2c788-9973-45b3-8e1d-615f1da2d457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:30.633127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2c788-9973-45b3-8e1d-615f1da2d457 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:30.654860 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1066/2101] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:30.654860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2c788-9973-45b3-8e1d-615f1da2d457 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:30.657377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fac2c788-9973-45b3-8e1d-615f1da2d457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:30.674856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2c788-9973-45b3-8e1d-615f1da2d457 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:30.682518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5247bb26-541a-421f-b0bf-7129d3fcdf99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eba7f2d771ac480abe87eb4cd4df69ac', 'request_id': 'req-5247bb26-541a-421f-b0bf-7129d3fcdf99'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:30.691371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5247bb26-541a-421f-b0bf-7129d3fcdf99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eba7f2d771ac480abe87eb4cd4df69ac', 'request_id': 'req-5247bb26-541a-421f-b0bf-7129d3fcdf99'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:30.698518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5247bb26-541a-421f-b0bf-7129d3fcdf99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eba7f2d771ac480abe87eb4cd4df69ac', 'request_id': 'req-5247bb26-541a-421f-b0bf-7129d3fcdf99'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:30.710576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5247bb26-541a-421f-b0bf-7129d3fcdf99 admin admin] The token cache is being invalidate because project eba7f2d771ac480abe87eb4cd4df69ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:30.711098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5247bb26-541a-421f-b0bf-7129d3fcdf99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:30.712378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5247bb26-541a-421f-b0bf-7129d3fcdf99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:30.714153 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1036/2102] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:30 2022] DELETE /identity/v3/projects/eba7f2d771ac480abe87eb4cd4df69ac => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:30.715243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac54ec-da58-4bb2-a97e-a93061a94a05 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:30.715532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac54ec-da58-4bb2-a97e-a93061a94a05 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:30.715800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac54ec-da58-4bb2-a97e-a93061a94a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:30.736773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c58990-5e96-41e3-aace-ffb2251b18cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:30.737404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c58990-5e96-41e3-aace-ffb2251b18cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:30.737684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c58990-5e96-41e3-aace-ffb2251b18cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:30.737956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c58990-5e96-41e3-aace-ffb2251b18cf admin admin] PATH_INFO: `/v3/projects/6d30bc9c7421452c9231f7ec0995a8a7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:30.739095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c58990-5e96-41e3-aace-ffb2251b18cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d30bc9c7421452c9231f7ec0995a8a7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:30.741095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c58990-5e96-41e3-aace-ffb2251b18cf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:30.745938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d3ac54ec-da58-4bb2-a97e-a93061a94a05 None None] MFA Rules not processed for user `f10ba32c82614a22b12bf94ba36f14df`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:30.747140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d3ac54ec-da58-4bb2-a97e-a93061a94a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:30.784774 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:30.805595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-00c58990-5e96-41e3-aace-ffb2251b18cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d30bc9c7421452c9231f7ec0995a8a7', 'request_id': 'req-00c58990-5e96-41e3-aace-ffb2251b18cf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:30.814679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-00c58990-5e96-41e3-aace-ffb2251b18cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d30bc9c7421452c9231f7ec0995a8a7', 'request_id': 'req-00c58990-5e96-41e3-aace-ffb2251b18cf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:30.822486 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:30.824330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-00c58990-5e96-41e3-aace-ffb2251b18cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d30bc9c7421452c9231f7ec0995a8a7', 'request_id': 'req-00c58990-5e96-41e3-aace-ffb2251b18cf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:30.826897 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1037/2103] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:30.827628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac54ec-da58-4bb2-a97e-a93061a94a05 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:30.829829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d3ac54ec-da58-4bb2-a97e-a93061a94a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:30.840556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-00c58990-5e96-41e3-aace-ffb2251b18cf admin admin] The token cache is being invalidate because project 6d30bc9c7421452c9231f7ec0995a8a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:30.840880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-00c58990-5e96-41e3-aace-ffb2251b18cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:30.841534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-00c58990-5e96-41e3-aace-ffb2251b18cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:30.843030 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1067/2104] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:30 2022] DELETE /identity/v3/projects/6d30bc9c7421452c9231f7ec0995a8a7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:30.843780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c58990-5e96-41e3-aace-ffb2251b18cf admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:30.845186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-00c58990-5e96-41e3-aace-ffb2251b18cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:30.845307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac54ec-da58-4bb2-a97e-a93061a94a05 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:30.903463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a4d3a-0aef-4225-9888-46b4376aa3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:30.904161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a4d3a-0aef-4225-9888-46b4376aa3eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:30.904439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a4d3a-0aef-4225-9888-46b4376aa3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:30.904736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a4d3a-0aef-4225-9888-46b4376aa3eb admin admin] PATH_INFO: `/v3/projects/3094e3b5657144d6a1ef64264725cf31/users/d11295fa702d46838a5c30e64edfd63b/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:30.908858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c58990-5e96-41e3-aace-ffb2251b18cf admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:30.919005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73e27a-799c-4725-a83b-758127a2383b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:30.919688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73e27a-799c-4725-a83b-758127a2383b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:30.919938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73e27a-799c-4725-a83b-758127a2383b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:30.920353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73e27a-799c-4725-a83b-758127a2383b admin admin] PATH_INFO: `/v3/projects/73572c16a70647e6850443aac6e7c1cf` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:30.920795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a4d3a-0aef-4225-9888-46b4376aa3eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3094e3b5657144d6a1ef64264725cf31, user_id=d11295fa702d46838a5c30e64edfd63b, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:30.921671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73e27a-799c-4725-a83b-758127a2383b admin admin] RBAC: Authorizing `identity:delete_project(project_id=73572c16a70647e6850443aac6e7c1cf)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:30.923399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a4d3a-0aef-4225-9888-46b4376aa3eb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:30.923791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73e27a-799c-4725-a83b-758127a2383b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:30.937758 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1038/2105] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:30 2022] PUT /identity/v3/projects/3094e3b5657144d6a1ef64264725cf31/users/d11295fa702d46838a5c30e64edfd63b/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:30.938565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a4d3a-0aef-4225-9888-46b4376aa3eb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:30.940111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a58a4d3a-0aef-4225-9888-46b4376aa3eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:30.981142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ba73e27a-799c-4725-a83b-758127a2383b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73572c16a70647e6850443aac6e7c1cf', 'request_id': 'req-ba73e27a-799c-4725-a83b-758127a2383b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:30.989112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ba73e27a-799c-4725-a83b-758127a2383b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73572c16a70647e6850443aac6e7c1cf', 'request_id': 'req-ba73e27a-799c-4725-a83b-758127a2383b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:30.994785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ba73e27a-799c-4725-a83b-758127a2383b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73572c16a70647e6850443aac6e7c1cf', 'request_id': 'req-ba73e27a-799c-4725-a83b-758127a2383b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:31.006241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ba73e27a-799c-4725-a83b-758127a2383b admin admin] The token cache is being invalidate because project 73572c16a70647e6850443aac6e7c1cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:31.006746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ba73e27a-799c-4725-a83b-758127a2383b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:31.007218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ba73e27a-799c-4725-a83b-758127a2383b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:31.009625 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1068/2106] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:30 2022] DELETE /identity/v3/projects/73572c16a70647e6850443aac6e7c1cf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:31.010817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f457498-ff17-4c72-83b1-923ceac90e75 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:31.011127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f457498-ff17-4c72-83b1-923ceac90e75 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:31.011467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f457498-ff17-4c72-83b1-923ceac90e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:31.015991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a4d3a-0aef-4225-9888-46b4376aa3eb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:31.031973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4f457498-ff17-4c72-83b1-923ceac90e75 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:31.033199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4f457498-ff17-4c72-83b1-923ceac90e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:31.077374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b425a-1f0b-4482-8bfd-fed278c60b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:31.077900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b425a-1f0b-4482-8bfd-fed278c60b67 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:31.078177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b425a-1f0b-4482-8bfd-fed278c60b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:31.078672 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:31.078797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b425a-1f0b-4482-8bfd-fed278c60b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:31.079615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b425a-1f0b-4482-8bfd-fed278c60b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:31.081414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b425a-1f0b-4482-8bfd-fed278c60b67 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:31.100813 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1039/2107] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:31.100813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b425a-1f0b-4482-8bfd-fed278c60b67 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:31.100813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fd7b425a-1f0b-4482-8bfd-fed278c60b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:31.107343 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1069/2108] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:31.108237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f457498-ff17-4c72-83b1-923ceac90e75 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:31.110450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4f457498-ff17-4c72-83b1-923ceac90e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:31.113026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b425a-1f0b-4482-8bfd-fed278c60b67 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:31.118968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8711d1-cf53-4a94-a4ec-1a8a48529798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:31.120007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8711d1-cf53-4a94-a4ec-1a8a48529798 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:31.120361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8711d1-cf53-4a94-a4ec-1a8a48529798 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:31.120674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8711d1-cf53-4a94-a4ec-1a8a48529798 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:31.121375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8711d1-cf53-4a94-a4ec-1a8a48529798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:31.123289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8711d1-cf53-4a94-a4ec-1a8a48529798 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:31.128276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f457498-ff17-4c72-83b1-923ceac90e75 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:31.129499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc74ed6-07b7-430a-ac63-9a980e99c2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:31.130154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc74ed6-07b7-430a-ac63-9a980e99c2db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:31.130437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc74ed6-07b7-430a-ac63-9a980e99c2db admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:31.130706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc74ed6-07b7-430a-ac63-9a980e99c2db admin admin] PATH_INFO: `/v3/users/3390471f01194ce385e4e250f6c35f5f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:31.132032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc74ed6-07b7-430a-ac63-9a980e99c2db admin admin] RBAC: Authorizing `identity:delete_user(user_id=3390471f01194ce385e4e250f6c35f5f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:31.134502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc74ed6-07b7-430a-ac63-9a980e99c2db admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:31.155065 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1040/2109] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:31 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:31.156310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e7f16-4419-48fb-8eee-162400b5f01f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:31.156592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e7f16-4419-48fb-8eee-162400b5f01f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:31.156887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e7f16-4419-48fb-8eee-162400b5f01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:31.166872 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:31.192125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-163e7f16-4419-48fb-8eee-162400b5f01f None None] MFA Rules not processed for user `d11295fa702d46838a5c30e64edfd63b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:31.193406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-163e7f16-4419-48fb-8eee-162400b5f01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:31.193979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ddc74ed6-07b7-430a-ac63-9a980e99c2db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3390471f01194ce385e4e250f6c35f5f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:31.194809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ddc74ed6-07b7-430a-ac63-9a980e99c2db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3390471f01194ce385e4e250f6c35f5f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:31.202765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ddc74ed6-07b7-430a-ac63-9a980e99c2db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3390471f01194ce385e4e250f6c35f5f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:31.217208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ddc74ed6-07b7-430a-ac63-9a980e99c2db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3390471f01194ce385e4e250f6c35f5f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:31.224084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ddc74ed6-07b7-430a-ac63-9a980e99c2db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3390471f01194ce385e4e250f6c35f5f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:31.230072 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1070/2110] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:31 2022] DELETE /identity/v3/users/3390471f01194ce385e4e250f6c35f5f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:31.231409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff6046-6725-4d2c-8bd2-195163e4523d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:31.231756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff6046-6725-4d2c-8bd2-195163e4523d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:31.232108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff6046-6725-4d2c-8bd2-195163e4523d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:31.261132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-08ff6046-6725-4d2c-8bd2-195163e4523d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:31.262688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-08ff6046-6725-4d2c-8bd2-195163e4523d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:31.271080 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1041/2111] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:31.271979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e7f16-4419-48fb-8eee-162400b5f01f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:31.273288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-163e7f16-4419-48fb-8eee-162400b5f01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:31.376804 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1071/2112] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:31.377940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e7f16-4419-48fb-8eee-162400b5f01f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:31.378115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621753-023e-4589-8df0-f48160d138f2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:31.378665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621753-023e-4589-8df0-f48160d138f2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:31.378948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621753-023e-4589-8df0-f48160d138f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:31.388519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d8f9a-d84f-4d7b-8b44-9d2a2a5d7292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:31.390299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d8f9a-d84f-4d7b-8b44-9d2a2a5d7292 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:31.390676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d8f9a-d84f-4d7b-8b44-9d2a2a5d7292 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:31.391032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d8f9a-d84f-4d7b-8b44-9d2a2a5d7292 admin admin] PATH_INFO: `/v3/projects/a8ec103a96134d6b8e1f2cd0d9aa537d/users/a6b6314249fd4fd69df0b3b1f4449cde/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:31.403507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c1621753-023e-4589-8df0-f48160d138f2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:31.404903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c1621753-023e-4589-8df0-f48160d138f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:31.415589 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1072/2113] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:31.416546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1621753-023e-4589-8df0-f48160d138f2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:31.418820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c1621753-023e-4589-8df0-f48160d138f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:31.419298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d8f9a-d84f-4d7b-8b44-9d2a2a5d7292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8ec103a96134d6b8e1f2cd0d9aa537d, user_id=a6b6314249fd4fd69df0b3b1f4449cde, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:31.423156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d8f9a-d84f-4d7b-8b44-9d2a2a5d7292 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:31.433188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1621753-023e-4589-8df0-f48160d138f2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:31.438838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895ebb4-937b-491f-bd64-89f1509d61f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:31.439961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895ebb4-937b-491f-bd64-89f1509d61f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:31.440474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895ebb4-937b-491f-bd64-89f1509d61f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:31.444873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895ebb4-937b-491f-bd64-89f1509d61f2 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:31.446687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895ebb4-937b-491f-bd64-89f1509d61f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:31.449630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895ebb4-937b-491f-bd64-89f1509d61f2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:31.452948 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1042/2114] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:31 2022] PUT /identity/v3/projects/a8ec103a96134d6b8e1f2cd0d9aa537d/users/a6b6314249fd4fd69df0b3b1f4449cde/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:31.454250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d8f9a-d84f-4d7b-8b44-9d2a2a5d7292 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:31.465881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-093d8f9a-d84f-4d7b-8b44-9d2a2a5d7292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:31.495056 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1073/2115] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:31 2022] POST /identity/v3/users => generated 302 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:31.496526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c346e2-b98a-4dd4-872d-cf85e7b98454 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:31.497281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c346e2-b98a-4dd4-872d-cf85e7b98454 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:31.497567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c346e2-b98a-4dd4-872d-cf85e7b98454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:31.525937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-53c346e2-b98a-4dd4-872d-cf85e7b98454 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:31.527763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-53c346e2-b98a-4dd4-872d-cf85e7b98454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:31.558277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d8f9a-d84f-4d7b-8b44-9d2a2a5d7292 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:31.563097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af52dd-972d-4d20-8982-5c79839442bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:31.563776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af52dd-972d-4d20-8982-5c79839442bc admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:31.564125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af52dd-972d-4d20-8982-5c79839442bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:31.564473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af52dd-972d-4d20-8982-5c79839442bc admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:31.565204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af52dd-972d-4d20-8982-5c79839442bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:31.567649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af52dd-972d-4d20-8982-5c79839442bc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:31.572065 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:31.599702 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1043/2116] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:31 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:31.600857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af52dd-972d-4d20-8982-5c79839442bc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:31.605820 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:31.632962 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1074/2117] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:31.632962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06035d51-5875-4f2d-841b-9632c2235b3b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:31.632962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06035d51-5875-4f2d-841b-9632c2235b3b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:31.632962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06035d51-5875-4f2d-841b-9632c2235b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:31.667757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-06035d51-5875-4f2d-841b-9632c2235b3b None None] MFA Rules not processed for user `a6b6314249fd4fd69df0b3b1f4449cde`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:31.669333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-06035d51-5875-4f2d-841b-9632c2235b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:31.685761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af52dd-972d-4d20-8982-5c79839442bc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:31.690598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08e952-1ba9-4493-beb9-ae2f01351a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:31.691199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08e952-1ba9-4493-beb9-ae2f01351a22 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:31.691473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08e952-1ba9-4493-beb9-ae2f01351a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:31.691741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08e952-1ba9-4493-beb9-ae2f01351a22 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:31.692390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08e952-1ba9-4493-beb9-ae2f01351a22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:31.692724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08e952-1ba9-4493-beb9-ae2f01351a22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:31.694303 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08e952-1ba9-4493-beb9-ae2f01351a22 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:31.706833 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1044/2118] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:31.707942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08e952-1ba9-4493-beb9-ae2f01351a22 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:31.720695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08e952-1ba9-4493-beb9-ae2f01351a22 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:31.725174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30271d24-7d0b-40f2-83f6-5eb8adb16290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:31.725771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30271d24-7d0b-40f2-83f6-5eb8adb16290 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:31.726046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30271d24-7d0b-40f2-83f6-5eb8adb16290 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:31.726312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30271d24-7d0b-40f2-83f6-5eb8adb16290 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:31.726974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30271d24-7d0b-40f2-83f6-5eb8adb16290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:31.728551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30271d24-7d0b-40f2-83f6-5eb8adb16290 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:31.737163 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1075/2119] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:31.737976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06035d51-5875-4f2d-841b-9632c2235b3b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:31.742494 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1045/2120] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:31.742494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30271d24-7d0b-40f2-83f6-5eb8adb16290 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:31.743791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-30271d24-7d0b-40f2-83f6-5eb8adb16290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:31.749257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06035d51-5875-4f2d-841b-9632c2235b3b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:31.753773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3ee14-b8eb-43a5-a73a-677ac39656b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:31.754388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3ee14-b8eb-43a5-a73a-677ac39656b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:31.754652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3ee14-b8eb-43a5-a73a-677ac39656b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:31.754920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3ee14-b8eb-43a5-a73a-677ac39656b3 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:31.755536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3ee14-b8eb-43a5-a73a-677ac39656b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:31.756696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30271d24-7d0b-40f2-83f6-5eb8adb16290 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:31.757454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3ee14-b8eb-43a5-a73a-677ac39656b3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:31.762065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b3b32-9b3c-4e92-b755-b22978b8f66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:31.762679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b3b32-9b3c-4e92-b755-b22978b8f66c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:31.762955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b3b32-9b3c-4e92-b755-b22978b8f66c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:31.763233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b3b32-9b3c-4e92-b755-b22978b8f66c admin admin] PATH_INFO: `/v3/projects/c87afdb200794b74a44747706d282676` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:31.764312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b3b32-9b3c-4e92-b755-b22978b8f66c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c87afdb200794b74a44747706d282676)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:31.766206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b3b32-9b3c-4e92-b755-b22978b8f66c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:31.780752 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1076/2121] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:31 2022] POST /identity/v3/users => generated 299 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:31.781592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3ee14-b8eb-43a5-a73a-677ac39656b3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:31.791776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3ee14-b8eb-43a5-a73a-677ac39656b3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:31.796641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed784a97-df9b-4732-8e0c-e095c39331ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:31.797296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed784a97-df9b-4732-8e0c-e095c39331ad admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:31.797642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed784a97-df9b-4732-8e0c-e095c39331ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:31.797973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed784a97-df9b-4732-8e0c-e095c39331ad admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:31.798772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed784a97-df9b-4732-8e0c-e095c39331ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:31.799019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed784a97-df9b-4732-8e0c-e095c39331ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:31.800817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed784a97-df9b-4732-8e0c-e095c39331ad admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:31.813828 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1077/2122] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:31.814615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed784a97-df9b-4732-8e0c-e095c39331ad admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:31.817271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7a4b3b32-9b3c-4e92-b755-b22978b8f66c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c87afdb200794b74a44747706d282676', 'request_id': 'req-7a4b3b32-9b3c-4e92-b755-b22978b8f66c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:31.825040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed784a97-df9b-4732-8e0c-e095c39331ad admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:31.826109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7a4b3b32-9b3c-4e92-b755-b22978b8f66c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c87afdb200794b74a44747706d282676', 'request_id': 'req-7a4b3b32-9b3c-4e92-b755-b22978b8f66c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:31.832512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7a4b3b32-9b3c-4e92-b755-b22978b8f66c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c87afdb200794b74a44747706d282676', 'request_id': 'req-7a4b3b32-9b3c-4e92-b755-b22978b8f66c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:31.845157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7a4b3b32-9b3c-4e92-b755-b22978b8f66c admin admin] The token cache is being invalidate because project c87afdb200794b74a44747706d282676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:31.845440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7a4b3b32-9b3c-4e92-b755-b22978b8f66c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:31.846145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7a4b3b32-9b3c-4e92-b755-b22978b8f66c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:31.847994 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1046/2123] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:31 2022] DELETE /identity/v3/projects/c87afdb200794b74a44747706d282676 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:31.848890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b3b32-9b3c-4e92-b755-b22978b8f66c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:31.850387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7a4b3b32-9b3c-4e92-b755-b22978b8f66c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:31.887788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32974015-c649-47e0-83ee-7d5eeb4f5027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:31.888301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32974015-c649-47e0-83ee-7d5eeb4f5027 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:31.888575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32974015-c649-47e0-83ee-7d5eeb4f5027 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:31.888872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32974015-c649-47e0-83ee-7d5eeb4f5027 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:31.889495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32974015-c649-47e0-83ee-7d5eeb4f5027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:31.891360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32974015-c649-47e0-83ee-7d5eeb4f5027 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:31.917021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b3b32-9b3c-4e92-b755-b22978b8f66c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:31.922515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99623a-d638-4929-bd0e-0835f2d906a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:31.922898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99623a-d638-4929-bd0e-0835f2d906a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:31.923222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99623a-d638-4929-bd0e-0835f2d906a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:31.923496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99623a-d638-4929-bd0e-0835f2d906a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:31.927139 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1078/2124] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:31 2022] POST /identity/v3/projects => generated 389 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:31.927791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99623a-d638-4929-bd0e-0835f2d906a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:31.927918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32974015-c649-47e0-83ee-7d5eeb4f5027 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:31.928008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99623a-d638-4929-bd0e-0835f2d906a9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:31.928089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-32974015-c649-47e0-83ee-7d5eeb4f5027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:31.942174 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:31.950609 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:31.957711 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1047/2125] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:31 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:31.958508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99623a-d638-4929-bd0e-0835f2d906a9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:31.960056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1b99623a-d638-4929-bd0e-0835f2d906a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:31.996265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32974015-c649-47e0-83ee-7d5eeb4f5027 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:32.025138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99623a-d638-4929-bd0e-0835f2d906a9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:32.029766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06ce29-3cc9-4969-ae30-faa7e7c41add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:32.030371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06ce29-3cc9-4969-ae30-faa7e7c41add admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.030649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06ce29-3cc9-4969-ae30-faa7e7c41add admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.030920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06ce29-3cc9-4969-ae30-faa7e7c41add admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.031564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06ce29-3cc9-4969-ae30-faa7e7c41add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:32.033221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06ce29-3cc9-4969-ae30-faa7e7c41add admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:32.043724 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1048/2126] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:32.044507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06ce29-3cc9-4969-ae30-faa7e7c41add admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:32.046163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7b06ce29-3cc9-4969-ae30-faa7e7c41add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:32.056990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcde79-7391-470e-9bb0-3669cf2b8109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:32.057649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcde79-7391-470e-9bb0-3669cf2b8109 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.057922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcde79-7391-470e-9bb0-3669cf2b8109 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.058191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcde79-7391-470e-9bb0-3669cf2b8109 admin admin] PATH_INFO: `/v3/projects/f53cc3183b9146ba91d646f3161848c5/users/fec8d36f9c9248a899911d3280d3d878/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.059463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06ce29-3cc9-4969-ae30-faa7e7c41add admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:32.064126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f7293-0592-4565-b138-97cdabfba308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:32.064742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f7293-0592-4565-b138-97cdabfba308 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.065026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f7293-0592-4565-b138-97cdabfba308 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.065297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f7293-0592-4565-b138-97cdabfba308 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.065947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f7293-0592-4565-b138-97cdabfba308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:32.067810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f7293-0592-4565-b138-97cdabfba308 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:32.072904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcde79-7391-470e-9bb0-3669cf2b8109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f53cc3183b9146ba91d646f3161848c5, user_id=fec8d36f9c9248a899911d3280d3d878, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:32.075498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcde79-7391-470e-9bb0-3669cf2b8109 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:32.089616 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1079/2127] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:31 2022] PUT /identity/v3/projects/f53cc3183b9146ba91d646f3161848c5/users/fec8d36f9c9248a899911d3280d3d878/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:32.091449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d536c-641d-47b3-80f0-fe4665090c96 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.091938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d536c-641d-47b3-80f0-fe4665090c96 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.092478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d536c-641d-47b3-80f0-fe4665090c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.097297 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1049/2128] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:32 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:32.098042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f7293-0592-4565-b138-97cdabfba308 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:32.099777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ee8f7293-0592-4565-b138-97cdabfba308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:32.112509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-473d536c-641d-47b3-80f0-fe4665090c96 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:32.113761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-473d536c-641d-47b3-80f0-fe4665090c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:32.166230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f7293-0592-4565-b138-97cdabfba308 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:32.170926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85ef26-eb2a-41c7-a769-83b00175b25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:32.171528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85ef26-eb2a-41c7-a769-83b00175b25c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.171808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85ef26-eb2a-41c7-a769-83b00175b25c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.172082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85ef26-eb2a-41c7-a769-83b00175b25c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.172750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85ef26-eb2a-41c7-a769-83b00175b25c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:32.174662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85ef26-eb2a-41c7-a769-83b00175b25c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:32.175148 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1080/2129] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:32.175957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d536c-641d-47b3-80f0-fe4665090c96 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:32.187153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d536c-641d-47b3-80f0-fe4665090c96 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:32.192452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40040bd7-3fbb-48a7-9299-aaf9e63f4d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:32.193072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40040bd7-3fbb-48a7-9299-aaf9e63f4d0a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.193342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40040bd7-3fbb-48a7-9299-aaf9e63f4d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.193606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40040bd7-3fbb-48a7-9299-aaf9e63f4d0a admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.194219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40040bd7-3fbb-48a7-9299-aaf9e63f4d0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:32.196864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40040bd7-3fbb-48a7-9299-aaf9e63f4d0a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:32.198034 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1050/2130] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:32 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:32.198832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85ef26-eb2a-41c7-a769-83b00175b25c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:32.212332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85ef26-eb2a-41c7-a769-83b00175b25c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:32.217246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d2e98-c09e-48b2-a7f0-594cc2093109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:32.217890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d2e98-c09e-48b2-a7f0-594cc2093109 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.218170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d2e98-c09e-48b2-a7f0-594cc2093109 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.218445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d2e98-c09e-48b2-a7f0-594cc2093109 admin admin] PATH_INFO: `/v3/projects/a88d625038c247a5ba2a65e10fcf2a18/users/0eaf4a7e89834d6ba421ee88bdc6eea3/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.218887 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1081/2131] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:32 2022] POST /identity/v3/users => generated 294 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:32.219585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40040bd7-3fbb-48a7-9299-aaf9e63f4d0a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:32.228937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40040bd7-3fbb-48a7-9299-aaf9e63f4d0a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:32.234297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d9148-1fa0-4226-960e-26a546214afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:32.234895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d9148-1fa0-4226-960e-26a546214afe admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.235178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d9148-1fa0-4226-960e-26a546214afe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.235449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d9148-1fa0-4226-960e-26a546214afe admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.235595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d2e98-c09e-48b2-a7f0-594cc2093109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a88d625038c247a5ba2a65e10fcf2a18, user_id=0eaf4a7e89834d6ba421ee88bdc6eea3, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:32.236116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d9148-1fa0-4226-960e-26a546214afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:32.237757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d9148-1fa0-4226-960e-26a546214afe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:32.238279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d2e98-c09e-48b2-a7f0-594cc2093109 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:32.248352 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1082/2132] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:32.251712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d9148-1fa0-4226-960e-26a546214afe admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:32.252921 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1051/2133] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:32 2022] PUT /identity/v3/projects/a88d625038c247a5ba2a65e10fcf2a18/users/0eaf4a7e89834d6ba421ee88bdc6eea3/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:32.254275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1111d-174c-46dd-9773-821025ad56cb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.254554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1111d-174c-46dd-9773-821025ad56cb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.254829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1111d-174c-46dd-9773-821025ad56cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.261867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d9148-1fa0-4226-960e-26a546214afe admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:32.275391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f0b1111d-174c-46dd-9773-821025ad56cb None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:32.276578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f0b1111d-174c-46dd-9773-821025ad56cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:32.280482 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:32.307652 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:32.322807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6471a-32db-48c4-907b-b7c992ee8697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:32.323505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6471a-32db-48c4-907b-b7c992ee8697 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.323901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6471a-32db-48c4-907b-b7c992ee8697 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.324250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6471a-32db-48c4-907b-b7c992ee8697 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.324997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6471a-32db-48c4-907b-b7c992ee8697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:32.327043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6471a-32db-48c4-907b-b7c992ee8697 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:32.339927 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1052/2134] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:32.340803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1111d-174c-46dd-9773-821025ad56cb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:32.349887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1111d-174c-46dd-9773-821025ad56cb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:32.350053 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1083/2135] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:32 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:32.350937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6471a-32db-48c4-907b-b7c992ee8697 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:32.356964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f305dc3-6ce8-4330-a85a-7f12338c9040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:32.357566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f305dc3-6ce8-4330-a85a-7f12338c9040 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.357842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f305dc3-6ce8-4330-a85a-7f12338c9040 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.358114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f305dc3-6ce8-4330-a85a-7f12338c9040 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.358764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f305dc3-6ce8-4330-a85a-7f12338c9040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:32.360344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f305dc3-6ce8-4330-a85a-7f12338c9040 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:32.362456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6471a-32db-48c4-907b-b7c992ee8697 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:32.367034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312570d-469c-47ee-b98d-8e0f86a20376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:32.368199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312570d-469c-47ee-b98d-8e0f86a20376 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.368762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312570d-469c-47ee-b98d-8e0f86a20376 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.368882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312570d-469c-47ee-b98d-8e0f86a20376 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.369524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312570d-469c-47ee-b98d-8e0f86a20376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:32.371086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312570d-469c-47ee-b98d-8e0f86a20376 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:32.374642 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1053/2136] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:32.374642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f305dc3-6ce8-4330-a85a-7f12338c9040 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:32.385421 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1084/2137] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:32.385421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312570d-469c-47ee-b98d-8e0f86a20376 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:32.385650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f305dc3-6ce8-4330-a85a-7f12338c9040 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:32.388249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb72e1-1df3-4a8b-b914-3c7cb076ac97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:32.388928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb72e1-1df3-4a8b-b914-3c7cb076ac97 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.389761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb72e1-1df3-4a8b-b914-3c7cb076ac97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.389761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb72e1-1df3-4a8b-b914-3c7cb076ac97 admin admin] PATH_INFO: `/v3/projects/f53cc3183b9146ba91d646f3161848c5/users/fec8d36f9c9248a899911d3280d3d878/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.391334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb72e1-1df3-4a8b-b914-3c7cb076ac97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f53cc3183b9146ba91d646f3161848c5, user_id=fec8d36f9c9248a899911d3280d3d878, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:32.392969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312570d-469c-47ee-b98d-8e0f86a20376 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:32.393990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb72e1-1df3-4a8b-b914-3c7cb076ac97 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:32.397632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d635357-c805-49e9-9e58-54c40f4a4057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:32.398201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d635357-c805-49e9-9e58-54c40f4a4057 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.398471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d635357-c805-49e9-9e58-54c40f4a4057 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.398854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d635357-c805-49e9-9e58-54c40f4a4057 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.399553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d635357-c805-49e9-9e58-54c40f4a4057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:32.401131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d635357-c805-49e9-9e58-54c40f4a4057 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:32.405602 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1054/2138] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:32 2022] PUT /identity/v3/projects/f53cc3183b9146ba91d646f3161848c5/users/fec8d36f9c9248a899911d3280d3d878/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:32.406513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb72e1-1df3-4a8b-b914-3c7cb076ac97 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:32.414862 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1085/2139] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:32.414862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d635357-c805-49e9-9e58-54c40f4a4057 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:32.426149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d635357-c805-49e9-9e58-54c40f4a4057 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:32.470510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb72e1-1df3-4a8b-b914-3c7cb076ac97 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:32.478053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea382e-5956-415d-a09c-6216099e9e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:32.478612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea382e-5956-415d-a09c-6216099e9e9d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.478883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea382e-5956-415d-a09c-6216099e9e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.479147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea382e-5956-415d-a09c-6216099e9e9d admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.479806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea382e-5956-415d-a09c-6216099e9e9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:32.480122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea382e-5956-415d-a09c-6216099e9e9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:32.481914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea382e-5956-415d-a09c-6216099e9e9d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:32.493725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80a5df-5476-4dca-aa29-a25fd094cce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:32.494281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80a5df-5476-4dca-aa29-a25fd094cce2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.494562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80a5df-5476-4dca-aa29-a25fd094cce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.494806 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1055/2140] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:32.494931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80a5df-5476-4dca-aa29-a25fd094cce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.495523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80a5df-5476-4dca-aa29-a25fd094cce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:32.495623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea382e-5956-415d-a09c-6216099e9e9d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:32.497218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80a5df-5476-4dca-aa29-a25fd094cce2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:32.505693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea382e-5956-415d-a09c-6216099e9e9d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:32.509968 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1086/2141] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:32.510907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80a5df-5476-4dca-aa29-a25fd094cce2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:32.513518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1f5c5-905f-47ad-a0d0-2cd387006e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:32.514106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1f5c5-905f-47ad-a0d0-2cd387006e73 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.514379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1f5c5-905f-47ad-a0d0-2cd387006e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.514654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1f5c5-905f-47ad-a0d0-2cd387006e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.515286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1f5c5-905f-47ad-a0d0-2cd387006e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:32.516873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1f5c5-905f-47ad-a0d0-2cd387006e73 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:32.520854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80a5df-5476-4dca-aa29-a25fd094cce2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:32.526726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a76bf-799b-4a99-a11e-e41ebfa8ae51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:32.527363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a76bf-799b-4a99-a11e-e41ebfa8ae51 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.527644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a76bf-799b-4a99-a11e-e41ebfa8ae51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.527921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a76bf-799b-4a99-a11e-e41ebfa8ae51 admin admin] PATH_INFO: `/v3/projects/3173aa84bb7a44968062ce8110c493b3/users/4c1625ef25d94523a280d711982c661a/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.528885 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1056/2142] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:32.529509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1f5c5-905f-47ad-a0d0-2cd387006e73 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:32.541206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1f5c5-905f-47ad-a0d0-2cd387006e73 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:32.544366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a76bf-799b-4a99-a11e-e41ebfa8ae51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3173aa84bb7a44968062ce8110c493b3, user_id=4c1625ef25d94523a280d711982c661a, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:32.547046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a76bf-799b-4a99-a11e-e41ebfa8ae51 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:32.548921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71b7a0-6cb8-4f22-b5ae-b9131458ecac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:32.549888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71b7a0-6cb8-4f22-b5ae-b9131458ecac admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.550574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71b7a0-6cb8-4f22-b5ae-b9131458ecac admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.550853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71b7a0-6cb8-4f22-b5ae-b9131458ecac admin admin] PATH_INFO: `/v3/projects/a88d625038c247a5ba2a65e10fcf2a18/users/0eaf4a7e89834d6ba421ee88bdc6eea3/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.552976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71b7a0-6cb8-4f22-b5ae-b9131458ecac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a88d625038c247a5ba2a65e10fcf2a18, user_id=0eaf4a7e89834d6ba421ee88bdc6eea3, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:32.555685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71b7a0-6cb8-4f22-b5ae-b9131458ecac admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:32.562732 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1087/2143] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:32 2022] PUT /identity/v3/projects/3173aa84bb7a44968062ce8110c493b3/users/4c1625ef25d94523a280d711982c661a/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:32.564153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e86725-d6cd-4872-bcd6-ccb15421a64d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.567017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e86725-d6cd-4872-bcd6-ccb15421a64d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.567017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e86725-d6cd-4872-bcd6-ccb15421a64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.570124 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1057/2144] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:32 2022] PUT /identity/v3/projects/a88d625038c247a5ba2a65e10fcf2a18/users/0eaf4a7e89834d6ba421ee88bdc6eea3/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:32.571793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71b7a0-6cb8-4f22-b5ae-b9131458ecac admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:32.603637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-81e86725-d6cd-4872-bcd6-ccb15421a64d None None] MFA Rules not processed for user `fec8d36f9c9248a899911d3280d3d878`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:32.604891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-81e86725-d6cd-4872-bcd6-ccb15421a64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:32.657546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71b7a0-6cb8-4f22-b5ae-b9131458ecac admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:32.659479 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:32.663416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf81ec1-ac16-4e8f-82ee-906ad72f9399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:32.663995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf81ec1-ac16-4e8f-82ee-906ad72f9399 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.664179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf81ec1-ac16-4e8f-82ee-906ad72f9399 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.664588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf81ec1-ac16-4e8f-82ee-906ad72f9399 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.665165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf81ec1-ac16-4e8f-82ee-906ad72f9399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:32.667062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf81ec1-ac16-4e8f-82ee-906ad72f9399 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:32.694141 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1088/2145] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:32 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:32.694141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e86725-d6cd-4872-bcd6-ccb15421a64d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:32.704890 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1058/2146] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:32 2022] POST /identity/v3/projects => generated 397 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:32.705679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e86725-d6cd-4872-bcd6-ccb15421a64d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:32.705776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf81ec1-ac16-4e8f-82ee-906ad72f9399 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:32.714853 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:32.765391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185821b8-700c-4a71-8f7b-1a929b46187f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:32.766002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185821b8-700c-4a71-8f7b-1a929b46187f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.766283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185821b8-700c-4a71-8f7b-1a929b46187f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.766561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185821b8-700c-4a71-8f7b-1a929b46187f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.767204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185821b8-700c-4a71-8f7b-1a929b46187f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:32.768841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185821b8-700c-4a71-8f7b-1a929b46187f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:32.779756 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1089/2147] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:32.781662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185821b8-700c-4a71-8f7b-1a929b46187f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:32.786700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf81ec1-ac16-4e8f-82ee-906ad72f9399 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:32.792351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb8196-f92f-4561-8144-204b85a9ecbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:32.792714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb8196-f92f-4561-8144-204b85a9ecbe admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.792997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb8196-f92f-4561-8144-204b85a9ecbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.793265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb8196-f92f-4561-8144-204b85a9ecbe admin admin] PATH_INFO: `/v3/projects/1deb300362744977af4d956392f5c48b/users/b80674f5d2fc4ed38d34a5ae09f90570/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.794004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185821b8-700c-4a71-8f7b-1a929b46187f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:32.799916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af522b4e-bcb2-416a-8a4d-89bd1a7bfba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:32.800656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af522b4e-bcb2-416a-8a4d-89bd1a7bfba9 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.801011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af522b4e-bcb2-416a-8a4d-89bd1a7bfba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.801352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af522b4e-bcb2-416a-8a4d-89bd1a7bfba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.802071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af522b4e-bcb2-416a-8a4d-89bd1a7bfba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:32.803871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af522b4e-bcb2-416a-8a4d-89bd1a7bfba9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:32.809228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb8196-f92f-4561-8144-204b85a9ecbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1deb300362744977af4d956392f5c48b, user_id=b80674f5d2fc4ed38d34a5ae09f90570, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:32.812075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb8196-f92f-4561-8144-204b85a9ecbe admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:32.817518 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1090/2148] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:32.818940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb689f5-914a-442e-9e3f-e68012cc04ae None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.819219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb689f5-914a-442e-9e3f-e68012cc04ae None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.819578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb689f5-914a-442e-9e3f-e68012cc04ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.828493 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1059/2149] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:32 2022] PUT /identity/v3/projects/1deb300362744977af4d956392f5c48b/users/b80674f5d2fc4ed38d34a5ae09f90570/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:32.829345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb8196-f92f-4561-8144-204b85a9ecbe admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:32.835937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a6bb8196-f92f-4561-8144-204b85a9ecbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:32.848478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ccb689f5-914a-442e-9e3f-e68012cc04ae None None] MFA Rules not processed for user `0eaf4a7e89834d6ba421ee88bdc6eea3`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:32.849698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ccb689f5-914a-442e-9e3f-e68012cc04ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:32.910496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb8196-f92f-4561-8144-204b85a9ecbe admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:32.916465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d1175-a91d-4dd8-9f26-65d0951b02d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:32.917121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d1175-a91d-4dd8-9f26-65d0951b02d5 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.917407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d1175-a91d-4dd8-9f26-65d0951b02d5 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.917678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d1175-a91d-4dd8-9f26-65d0951b02d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.920990 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1091/2150] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:32.921804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb689f5-914a-442e-9e3f-e68012cc04ae None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:32.980016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d1175-a91d-4dd8-9f26-65d0951b02d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:32.981879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d1175-a91d-4dd8-9f26-65d0951b02d5 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:32.981999 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:32.986064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb689f5-914a-442e-9e3f-e68012cc04ae None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:32.990936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dcdd0-4fe9-4304-ac01-bab35c5f5c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:32.991217 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1060/2151] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:32 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:32.991533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dcdd0-4fe9-4304-ac01-bab35c5f5c01 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:32.991940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dcdd0-4fe9-4304-ac01-bab35c5f5c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:32.992041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d1175-a91d-4dd8-9f26-65d0951b02d5 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:32.992212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dcdd0-4fe9-4304-ac01-bab35c5f5c01 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:32.993531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dcdd0-4fe9-4304-ac01-bab35c5f5c01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:32.995415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dcdd0-4fe9-4304-ac01-bab35c5f5c01 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:33.002842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d1175-a91d-4dd8-9f26-65d0951b02d5 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:33.008887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f925b-8c8a-4239-8eca-449a7b0765c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:33.009537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f925b-8c8a-4239-8eca-449a7b0765c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:33.009887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f925b-8c8a-4239-8eca-449a7b0765c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:33.010251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f925b-8c8a-4239-8eca-449a7b0765c0 admin admin] PATH_INFO: `/v3/projects/2de5cac6900445c49cf9aa74f285462e/users/f5dbf9494eb94dc280b8b647082b8ed9/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:33.022974 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1092/2152] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:32 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:33.022974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dcdd0-4fe9-4304-ac01-bab35c5f5c01 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:33.027176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f925b-8c8a-4239-8eca-449a7b0765c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de5cac6900445c49cf9aa74f285462e, user_id=f5dbf9494eb94dc280b8b647082b8ed9, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:33.029849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f925b-8c8a-4239-8eca-449a7b0765c0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:33.033545 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:33.036440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dcdd0-4fe9-4304-ac01-bab35c5f5c01 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:33.045140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a3074-c8b1-483c-b955-a388b7bbf0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:33.045140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a3074-c8b1-483c-b955-a388b7bbf0ff admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:33.045711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a3074-c8b1-483c-b955-a388b7bbf0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:33.046082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a3074-c8b1-483c-b955-a388b7bbf0ff admin admin] PATH_INFO: `/v3/projects/3173aa84bb7a44968062ce8110c493b3/users/4c1625ef25d94523a280d711982c661a/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:33.056658 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1061/2153] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:32 2022] PUT /identity/v3/projects/2de5cac6900445c49cf9aa74f285462e/users/f5dbf9494eb94dc280b8b647082b8ed9/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:33.057205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a3074-c8b1-483c-b955-a388b7bbf0ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=3173aa84bb7a44968062ce8110c493b3, user_id=4c1625ef25d94523a280d711982c661a, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:33.057301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc6abb-1c84-481a-a996-25a6f591e721 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:33.057301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc6abb-1c84-481a-a996-25a6f591e721 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:33.057301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc6abb-1c84-481a-a996-25a6f591e721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:33.057538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a3074-c8b1-483c-b955-a388b7bbf0ff admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:33.068214 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1093/2154] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:33 2022] PUT /identity/v3/projects/3173aa84bb7a44968062ce8110c493b3/users/4c1625ef25d94523a280d711982c661a/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:33.079210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a3074-c8b1-483c-b955-a388b7bbf0ff admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:33.081338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-534a3074-c8b1-483c-b955-a388b7bbf0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:33.087489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-eccc6abb-1c84-481a-a996-25a6f591e721 None None] MFA Rules not processed for user `b80674f5d2fc4ed38d34a5ae09f90570`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:33.089267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eccc6abb-1c84-481a-a996-25a6f591e721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:33.166011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a3074-c8b1-483c-b955-a388b7bbf0ff admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:33.171717 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1062/2155] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:33.171717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc6abb-1c84-481a-a996-25a6f591e721 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:33.174555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64a2c9-ad3b-49cf-bbda-f14a486d1720 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:33.175564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64a2c9-ad3b-49cf-bbda-f14a486d1720 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:33.175909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64a2c9-ad3b-49cf-bbda-f14a486d1720 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:33.176246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64a2c9-ad3b-49cf-bbda-f14a486d1720 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:33.238489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc6abb-1c84-481a-a996-25a6f591e721 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:33.243335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed28db-4f69-40db-94a1-4b1752dabb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:33.243933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed28db-4f69-40db-94a1-4b1752dabb8e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:33.244215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed28db-4f69-40db-94a1-4b1752dabb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:33.244488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed28db-4f69-40db-94a1-4b1752dabb8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:33.244708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64a2c9-ad3b-49cf-bbda-f14a486d1720 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:33.245164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed28db-4f69-40db-94a1-4b1752dabb8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:33.246312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64a2c9-ad3b-49cf-bbda-f14a486d1720 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:33.246712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed28db-4f69-40db-94a1-4b1752dabb8e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:33.255959 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1094/2156] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:33.256648 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1063/2157] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:33.257775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23d25e-e5df-407d-a62e-555f7688d1b6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:33.259077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23d25e-e5df-407d-a62e-555f7688d1b6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:33.259349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23d25e-e5df-407d-a62e-555f7688d1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:33.260966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df736fc-d0dc-4c7f-a180-149cc99ea77d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:33.261268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df736fc-d0dc-4c7f-a180-149cc99ea77d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:33.261539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df736fc-d0dc-4c7f-a180-149cc99ea77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:33.290790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3c23d25e-e5df-407d-a62e-555f7688d1b6 None None] MFA Rules not processed for user `4c1625ef25d94523a280d711982c661a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:33.291850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7df736fc-d0dc-4c7f-a180-149cc99ea77d None None] MFA Rules not processed for user `f5dbf9494eb94dc280b8b647082b8ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:33.291995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3c23d25e-e5df-407d-a62e-555f7688d1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:33.293222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7df736fc-d0dc-4c7f-a180-149cc99ea77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:33.359499 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:33.371478 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1095/2158] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:33.372436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df736fc-d0dc-4c7f-a180-149cc99ea77d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:33.377792 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1064/2159] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:33.377792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23d25e-e5df-407d-a62e-555f7688d1b6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:33.385984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df736fc-d0dc-4c7f-a180-149cc99ea77d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:33.388080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23d25e-e5df-407d-a62e-555f7688d1b6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:33.390913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3fe4b-bbae-4be1-a734-c380f74a1c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:33.391585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3fe4b-bbae-4be1-a734-c380f74a1c04 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:33.391950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3fe4b-bbae-4be1-a734-c380f74a1c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:33.392267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3fe4b-bbae-4be1-a734-c380f74a1c04 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:33.392998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c3fe4b-bbae-4be1-a734-c380f74a1c04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:33.393713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfacd4a-dc2b-43fd-b04f-c984a8f8dd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:33.394399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfacd4a-dc2b-43fd-b04f-c984a8f8dd08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:33.395033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfacd4a-dc2b-43fd-b04f-c984a8f8dd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:33.395152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c3fe4b-bbae-4be1-a734-c380f74a1c04 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:33.395431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfacd4a-dc2b-43fd-b04f-c984a8f8dd08 admin admin] PATH_INFO: `/v3/users/f10ba32c82614a22b12bf94ba36f14df` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:33.396899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfacd4a-dc2b-43fd-b04f-c984a8f8dd08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f10ba32c82614a22b12bf94ba36f14df)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:33.399614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfacd4a-dc2b-43fd-b04f-c984a8f8dd08 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:33.401367 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:33.430116 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1096/2160] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:33 2022] POST /identity/v3/projects => generated 393 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:33.431185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3fe4b-bbae-4be1-a734-c380f74a1c04 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:33.462067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fbfacd4a-dc2b-43fd-b04f-c984a8f8dd08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f10ba32c82614a22b12bf94ba36f14df'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:33.471217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fbfacd4a-dc2b-43fd-b04f-c984a8f8dd08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f10ba32c82614a22b12bf94ba36f14df'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:33.472734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fbfacd4a-dc2b-43fd-b04f-c984a8f8dd08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f10ba32c82614a22b12bf94ba36f14df'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:33.489713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fbfacd4a-dc2b-43fd-b04f-c984a8f8dd08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f10ba32c82614a22b12bf94ba36f14df'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:33.498994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fbfacd4a-dc2b-43fd-b04f-c984a8f8dd08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f10ba32c82614a22b12bf94ba36f14df'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:33.504829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3fe4b-bbae-4be1-a734-c380f74a1c04 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:33.508929 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1065/2161] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:33 2022] DELETE /identity/v3/users/f10ba32c82614a22b12bf94ba36f14df => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:33.509728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfacd4a-dc2b-43fd-b04f-c984a8f8dd08 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:33.511101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fbfacd4a-dc2b-43fd-b04f-c984a8f8dd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:33.513770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb9cb1-fcdd-4380-9e0a-d61f390c2a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:33.520749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb9cb1-fcdd-4380-9e0a-d61f390c2a0a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:33.520749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb9cb1-fcdd-4380-9e0a-d61f390c2a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:33.520749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb9cb1-fcdd-4380-9e0a-d61f390c2a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:33.520749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb9cb1-fcdd-4380-9e0a-d61f390c2a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:33.520749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb9cb1-fcdd-4380-9e0a-d61f390c2a0a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:33.532048 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1097/2162] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:33.532048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb9cb1-fcdd-4380-9e0a-d61f390c2a0a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:33.533735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4fdb9cb1-fcdd-4380-9e0a-d61f390c2a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:33.586402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfacd4a-dc2b-43fd-b04f-c984a8f8dd08 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:33.593517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3a02f-22c6-4ae5-af13-a5ba233feb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:33.594520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3a02f-22c6-4ae5-af13-a5ba233feb49 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:33.594641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3a02f-22c6-4ae5-af13-a5ba233feb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:33.595087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3a02f-22c6-4ae5-af13-a5ba233feb49 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:33.596053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3a02f-22c6-4ae5-af13-a5ba233feb49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:33.598670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3a02f-22c6-4ae5-af13-a5ba233feb49 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:33.631089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb9cb1-fcdd-4380-9e0a-d61f390c2a0a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:33.632346 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1066/2163] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:33 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:33.633989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3a02f-22c6-4ae5-af13-a5ba233feb49 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:33.636018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-64b3a02f-22c6-4ae5-af13-a5ba233feb49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:33.704151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5a4e2-6080-408c-a57d-1b5099df6f51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:33.704848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5a4e2-6080-408c-a57d-1b5099df6f51 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:33.705379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5a4e2-6080-408c-a57d-1b5099df6f51 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:33.705643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5a4e2-6080-408c-a57d-1b5099df6f51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:33.707385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d0e5a4e2-6080-408c-a57d-1b5099df6f51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:33.712352 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:33.714304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3a02f-22c6-4ae5-af13-a5ba233feb49 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:33.719304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482f2bc-edb5-4cf0-b249-41f7b6b347d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:33.719916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482f2bc-edb5-4cf0-b249-41f7b6b347d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:33.720193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482f2bc-edb5-4cf0-b249-41f7b6b347d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:33.720463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482f2bc-edb5-4cf0-b249-41f7b6b347d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:33.721246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482f2bc-edb5-4cf0-b249-41f7b6b347d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:33.723224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482f2bc-edb5-4cf0-b249-41f7b6b347d6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:33.733863 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:33.753093 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1067/2164] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:33 2022] POST /identity/v3/users => generated 303 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:33.754992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e3f53-6661-4224-bfd2-8e8df1e63089 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:33.755345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e3f53-6661-4224-bfd2-8e8df1e63089 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:33.755780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e3f53-6661-4224-bfd2-8e8df1e63089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:33.779171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c72e3f53-6661-4224-bfd2-8e8df1e63089 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:33.780527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c72e3f53-6661-4224-bfd2-8e8df1e63089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:33.788420 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1068/2165] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:33.789164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e3f53-6661-4224-bfd2-8e8df1e63089 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:33.790410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5a4e2-6080-408c-a57d-1b5099df6f51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:33.791074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c72e3f53-6661-4224-bfd2-8e8df1e63089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:33.792002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5a4e2-6080-408c-a57d-1b5099df6f51 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:33.802743 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1098/2166] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:33.803409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e3f53-6661-4224-bfd2-8e8df1e63089 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:33.803534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5a4e2-6080-408c-a57d-1b5099df6f51 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:33.809053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ab82d-85e4-450a-9618-530f6e1535a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:33.809813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ab82d-85e4-450a-9618-530f6e1535a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:33.810153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ab82d-85e4-450a-9618-530f6e1535a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:33.810725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ab82d-85e4-450a-9618-530f6e1535a5 admin admin] PATH_INFO: `/v3/projects/c3c7a238cf594e1d8e3812fa3fc49259/users/7fca17ba092e44f1a37b108778dc7a0d/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:33.815791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5a4e2-6080-408c-a57d-1b5099df6f51 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:33.821448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e412f7c-ef3a-4574-a958-11c5eb3a9338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:33.822201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e412f7c-ef3a-4574-a958-11c5eb3a9338 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:33.822477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e412f7c-ef3a-4574-a958-11c5eb3a9338 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:33.822820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e412f7c-ef3a-4574-a958-11c5eb3a9338 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:33.823661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e412f7c-ef3a-4574-a958-11c5eb3a9338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:33.825828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e412f7c-ef3a-4574-a958-11c5eb3a9338 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:33.827324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ab82d-85e4-450a-9618-530f6e1535a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c7a238cf594e1d8e3812fa3fc49259, user_id=7fca17ba092e44f1a37b108778dc7a0d, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:33.830385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ab82d-85e4-450a-9618-530f6e1535a5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:33.851378 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1069/2167] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:33 2022] PUT /identity/v3/projects/c3c7a238cf594e1d8e3812fa3fc49259/users/7fca17ba092e44f1a37b108778dc7a0d/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:33.851378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ab82d-85e4-450a-9618-530f6e1535a5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:33.851378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a42ab82d-85e4-450a-9618-530f6e1535a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:33.855902 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1099/2168] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:33 2022] POST /identity/v3/users => generated 294 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:33.857127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e412f7c-ef3a-4574-a958-11c5eb3a9338 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:33.868809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e412f7c-ef3a-4574-a958-11c5eb3a9338 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:33.947451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ab82d-85e4-450a-9618-530f6e1535a5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:33.951644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447e88d-2720-4bb5-9944-2601f8b0164f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:33.952270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447e88d-2720-4bb5-9944-2601f8b0164f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:33.952548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447e88d-2720-4bb5-9944-2601f8b0164f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:33.952842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447e88d-2720-4bb5-9944-2601f8b0164f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:33.953485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447e88d-2720-4bb5-9944-2601f8b0164f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:33.955443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447e88d-2720-4bb5-9944-2601f8b0164f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:33.955875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572d9fb-d646-4126-aaea-2fd8418ab9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:33.957056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572d9fb-d646-4126-aaea-2fd8418ab9e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:33.957500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572d9fb-d646-4126-aaea-2fd8418ab9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:33.958395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572d9fb-d646-4126-aaea-2fd8418ab9e1 admin admin] PATH_INFO: `/v3/users/d11295fa702d46838a5c30e64edfd63b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:33.960547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572d9fb-d646-4126-aaea-2fd8418ab9e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d11295fa702d46838a5c30e64edfd63b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:33.964133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572d9fb-d646-4126-aaea-2fd8418ab9e1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:33.967352 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1100/2169] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:33.968282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447e88d-2720-4bb5-9944-2601f8b0164f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:33.972530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8447e88d-2720-4bb5-9944-2601f8b0164f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:34.031458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e572d9fb-d646-4126-aaea-2fd8418ab9e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd11295fa702d46838a5c30e64edfd63b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:34.040943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e572d9fb-d646-4126-aaea-2fd8418ab9e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd11295fa702d46838a5c30e64edfd63b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:34.041700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e572d9fb-d646-4126-aaea-2fd8418ab9e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd11295fa702d46838a5c30e64edfd63b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:34.049221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447e88d-2720-4bb5-9944-2601f8b0164f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:34.052956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a5a54-8cbb-410d-98fa-f560e650b077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:34.053554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a5a54-8cbb-410d-98fa-f560e650b077 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:34.053826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a5a54-8cbb-410d-98fa-f560e650b077 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:34.054094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a5a54-8cbb-410d-98fa-f560e650b077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:34.056442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e572d9fb-d646-4126-aaea-2fd8418ab9e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd11295fa702d46838a5c30e64edfd63b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:34.065418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e572d9fb-d646-4126-aaea-2fd8418ab9e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd11295fa702d46838a5c30e64edfd63b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:34.065538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a5a54-8cbb-410d-98fa-f560e650b077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:34.067118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a5a54-8cbb-410d-98fa-f560e650b077 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:34.072984 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1070/2170] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:33 2022] DELETE /identity/v3/users/d11295fa702d46838a5c30e64edfd63b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:34.077670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ad04c-51d6-432b-aef2-2f6c895a612f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:34.078014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ad04c-51d6-432b-aef2-2f6c895a612f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:34.078323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ad04c-51d6-432b-aef2-2f6c895a612f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:34.083057 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1101/2171] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:34.083925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a5a54-8cbb-410d-98fa-f560e650b077 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:34.095698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a5a54-8cbb-410d-98fa-f560e650b077 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:34.098398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-787ad04c-51d6-432b-aef2-2f6c895a612f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:34.099605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-787ad04c-51d6-432b-aef2-2f6c895a612f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:34.121535 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:34.171560 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:34.177534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ac92a-0f89-4a87-8f36-97cbd8024ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:34.178266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ac92a-0f89-4a87-8f36-97cbd8024ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:34.178609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ac92a-0f89-4a87-8f36-97cbd8024ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:34.178982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ac92a-0f89-4a87-8f36-97cbd8024ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:34.179726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ac92a-0f89-4a87-8f36-97cbd8024ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:34.181861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ac92a-0f89-4a87-8f36-97cbd8024ea4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:34.194277 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1102/2172] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:34.199197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ac92a-0f89-4a87-8f36-97cbd8024ea4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:34.201154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-433ac92a-0f89-4a87-8f36-97cbd8024ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:34.206851 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1071/2173] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:34.208340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c6f38-34c4-4301-b0d9-4932aa07adbb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:34.208784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c6f38-34c4-4301-b0d9-4932aa07adbb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:34.209210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c6f38-34c4-4301-b0d9-4932aa07adbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:34.220886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ac92a-0f89-4a87-8f36-97cbd8024ea4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:34.230143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef74e2-1d3d-4b75-8e80-bffe5d1378b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:34.230819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef74e2-1d3d-4b75-8e80-bffe5d1378b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:34.231100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef74e2-1d3d-4b75-8e80-bffe5d1378b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:34.231373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef74e2-1d3d-4b75-8e80-bffe5d1378b3 admin admin] PATH_INFO: `/v3/projects/d9a26fd5851149cb800152c4019a8dc9/users/c34337cf040d4540865e0d9959cfbcdd/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:34.240342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ce7c6f38-34c4-4301-b0d9-4932aa07adbb None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:34.242725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ce7c6f38-34c4-4301-b0d9-4932aa07adbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:34.252410 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1072/2174] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:34.253463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c6f38-34c4-4301-b0d9-4932aa07adbb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:34.262183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef74e2-1d3d-4b75-8e80-bffe5d1378b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a26fd5851149cb800152c4019a8dc9, user_id=c34337cf040d4540865e0d9959cfbcdd, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:34.263068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ce7c6f38-34c4-4301-b0d9-4932aa07adbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:34.270552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef74e2-1d3d-4b75-8e80-bffe5d1378b3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:34.284156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c6f38-34c4-4301-b0d9-4932aa07adbb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:34.288897 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1103/2175] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:34 2022] PUT /identity/v3/projects/d9a26fd5851149cb800152c4019a8dc9/users/c34337cf040d4540865e0d9959cfbcdd/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:34.291304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef74e2-1d3d-4b75-8e80-bffe5d1378b3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:34.293648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e3ef74e2-1d3d-4b75-8e80-bffe5d1378b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:34.359823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7a57a-5ff6-4158-b89d-7e51f8d77249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:34.360626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7a57a-5ff6-4158-b89d-7e51f8d77249 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:34.360984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7a57a-5ff6-4158-b89d-7e51f8d77249 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:34.361264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7a57a-5ff6-4158-b89d-7e51f8d77249 admin admin] PATH_INFO: `/v3/projects/5ee6e8cc264e414898f5e3c5045743c2/users/e299d69478504afaaa010e7497d3d333/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:34.381028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef74e2-1d3d-4b75-8e80-bffe5d1378b3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:34.383815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e612c-f683-480c-89d6-833075fa1fb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:34.384808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e612c-f683-480c-89d6-833075fa1fb6 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:34.385091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e612c-f683-480c-89d6-833075fa1fb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:34.385834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e612c-f683-480c-89d6-833075fa1fb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:34.393188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7a57a-5ff6-4158-b89d-7e51f8d77249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee6e8cc264e414898f5e3c5045743c2, user_id=e299d69478504afaaa010e7497d3d333, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:34.395860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7a57a-5ff6-4158-b89d-7e51f8d77249 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:34.396402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e612c-f683-480c-89d6-833075fa1fb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:34.397865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e612c-f683-480c-89d6-833075fa1fb6 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:34.424627 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1104/2176] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:34.425852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e612c-f683-480c-89d6-833075fa1fb6 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:34.433440 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1073/2177] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:34 2022] PUT /identity/v3/projects/5ee6e8cc264e414898f5e3c5045743c2/users/e299d69478504afaaa010e7497d3d333/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:34.434667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7a57a-5ff6-4158-b89d-7e51f8d77249 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:34.439310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e612c-f683-480c-89d6-833075fa1fb6 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:34.523561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7f847-6d02-47ef-a273-14747419241c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:34.524925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7f847-6d02-47ef-a273-14747419241c service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:34.525417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7f847-6d02-47ef-a273-14747419241c service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:34.525880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7f847-6d02-47ef-a273-14747419241c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:34.558310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7a57a-5ff6-4158-b89d-7e51f8d77249 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:34.566051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df3a9c-ee02-43a3-a2bf-d147673851c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:34.566770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df3a9c-ee02-43a3-a2bf-d147673851c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:34.567347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df3a9c-ee02-43a3-a2bf-d147673851c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:34.567627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df3a9c-ee02-43a3-a2bf-d147673851c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:34.568538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df3a9c-ee02-43a3-a2bf-d147673851c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:34.571352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df3a9c-ee02-43a3-a2bf-d147673851c8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:34.588865 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1074/2178] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:34.588865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df3a9c-ee02-43a3-a2bf-d147673851c8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:34.602174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df3a9c-ee02-43a3-a2bf-d147673851c8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:34.607065 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:34.610597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112777a-97d6-465d-8a30-8e4c61216158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:34.611189 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112777a-97d6-465d-8a30-8e4c61216158 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:34.611460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112777a-97d6-465d-8a30-8e4c61216158 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:34.611772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112777a-97d6-465d-8a30-8e4c61216158 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:34.612459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112777a-97d6-465d-8a30-8e4c61216158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:34.614099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112777a-97d6-465d-8a30-8e4c61216158 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:34.623868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7f847-6d02-47ef-a273-14747419241c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:34.625342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7f847-6d02-47ef-a273-14747419241c service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:34.633655 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1075/2179] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:34.635099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112777a-97d6-465d-8a30-8e4c61216158 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:34.636857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6112777a-97d6-465d-8a30-8e4c61216158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:34.641343 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1105/2180] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:34.642529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7f847-6d02-47ef-a273-14747419241c service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:34.653182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112777a-97d6-465d-8a30-8e4c61216158 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:34.653898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7f847-6d02-47ef-a273-14747419241c service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:34.659812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc946a04-8ef1-49d9-a9ac-b7c818a3e46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:34.660470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc946a04-8ef1-49d9-a9ac-b7c818a3e46e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:34.660736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab10dba-b402-4567-8274-4f2d9ebb7b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:34.661266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab10dba-b402-4567-8274-4f2d9ebb7b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:34.661536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab10dba-b402-4567-8274-4f2d9ebb7b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:34.661800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab10dba-b402-4567-8274-4f2d9ebb7b83 admin admin] PATH_INFO: `/v3/projects/7e5a96bc0045495d9d75a61d6571bc11` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:34.662586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc946a04-8ef1-49d9-a9ac-b7c818a3e46e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:34.662851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc946a04-8ef1-49d9-a9ac-b7c818a3e46e admin admin] PATH_INFO: `/v3/projects/d9a26fd5851149cb800152c4019a8dc9/users/c34337cf040d4540865e0d9959cfbcdd/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:34.663421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab10dba-b402-4567-8274-4f2d9ebb7b83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e5a96bc0045495d9d75a61d6571bc11)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:34.665700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc946a04-8ef1-49d9-a9ac-b7c818a3e46e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a26fd5851149cb800152c4019a8dc9, user_id=c34337cf040d4540865e0d9959cfbcdd, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:34.667398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab10dba-b402-4567-8274-4f2d9ebb7b83 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:34.668956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc946a04-8ef1-49d9-a9ac-b7c818a3e46e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:34.682385 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1106/2181] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:34 2022] PUT /identity/v3/projects/d9a26fd5851149cb800152c4019a8dc9/users/c34337cf040d4540865e0d9959cfbcdd/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:34.683225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc946a04-8ef1-49d9-a9ac-b7c818a3e46e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:34.693348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cc946a04-8ef1-49d9-a9ac-b7c818a3e46e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:34.744226 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:34.757761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1ab10dba-b402-4567-8274-4f2d9ebb7b83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e5a96bc0045495d9d75a61d6571bc11', 'request_id': 'req-1ab10dba-b402-4567-8274-4f2d9ebb7b83'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:34.770175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1ab10dba-b402-4567-8274-4f2d9ebb7b83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e5a96bc0045495d9d75a61d6571bc11', 'request_id': 'req-1ab10dba-b402-4567-8274-4f2d9ebb7b83'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:34.780983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1ab10dba-b402-4567-8274-4f2d9ebb7b83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e5a96bc0045495d9d75a61d6571bc11', 'request_id': 'req-1ab10dba-b402-4567-8274-4f2d9ebb7b83'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:34.795302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1ab10dba-b402-4567-8274-4f2d9ebb7b83 admin admin] The token cache is being invalidate because project 7e5a96bc0045495d9d75a61d6571bc11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:34.795657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1ab10dba-b402-4567-8274-4f2d9ebb7b83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:34.796340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1ab10dba-b402-4567-8274-4f2d9ebb7b83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:34.798135 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1076/2182] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:34 2022] DELETE /identity/v3/projects/7e5a96bc0045495d9d75a61d6571bc11 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:34.799579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab10dba-b402-4567-8274-4f2d9ebb7b83 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:34.802812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1ab10dba-b402-4567-8274-4f2d9ebb7b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:34.811230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc946a04-8ef1-49d9-a9ac-b7c818a3e46e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:34.884946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab10dba-b402-4567-8274-4f2d9ebb7b83 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:34.886869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59997e-6249-468a-a892-07b6fd8da543 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:34.887572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59997e-6249-468a-a892-07b6fd8da543 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:34.887914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59997e-6249-468a-a892-07b6fd8da543 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:34.888384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59997e-6249-468a-a892-07b6fd8da543 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:34.890232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bc59997e-6249-468a-a892-07b6fd8da543 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:34.895399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a21c7-85b4-47ea-928a-d46658ab47bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:34.896259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a21c7-85b4-47ea-928a-d46658ab47bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:34.896553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a21c7-85b4-47ea-928a-d46658ab47bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:34.896861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a21c7-85b4-47ea-928a-d46658ab47bc admin admin] PATH_INFO: `/v3/projects/5ee6e8cc264e414898f5e3c5045743c2/users/e299d69478504afaaa010e7497d3d333/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:34.899406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a21c7-85b4-47ea-928a-d46658ab47bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee6e8cc264e414898f5e3c5045743c2, user_id=e299d69478504afaaa010e7497d3d333, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:34.902233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a21c7-85b4-47ea-928a-d46658ab47bc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:34.925062 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1077/2183] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:34 2022] PUT /identity/v3/projects/5ee6e8cc264e414898f5e3c5045743c2/users/e299d69478504afaaa010e7497d3d333/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:34.927480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b8878-23e7-4834-8536-07812a07a9d5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:34.927777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b8878-23e7-4834-8536-07812a07a9d5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:34.928422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b8878-23e7-4834-8536-07812a07a9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:35.004453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-138b8878-23e7-4834-8536-07812a07a9d5 None None] MFA Rules not processed for user `c34337cf040d4540865e0d9959cfbcdd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:35.005792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59997e-6249-468a-a892-07b6fd8da543 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:35.005915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-138b8878-23e7-4834-8536-07812a07a9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:35.007499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59997e-6249-468a-a892-07b6fd8da543 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:35.021623 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1107/2184] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:35.037471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59997e-6249-468a-a892-07b6fd8da543 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:35.044489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bc59997e-6249-468a-a892-07b6fd8da543 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:35.105277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59997e-6249-468a-a892-07b6fd8da543 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:35.125607 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:35.167081 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1078/2185] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:34 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:35.169834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cce34-0686-4608-a481-bac9732b6bfc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:35.170226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cce34-0686-4608-a481-bac9732b6bfc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:35.170642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cce34-0686-4608-a481-bac9732b6bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:35.211395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f45cce34-0686-4608-a481-bac9732b6bfc None None] MFA Rules not processed for user `e299d69478504afaaa010e7497d3d333`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:35.212971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f45cce34-0686-4608-a481-bac9732b6bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:35.261380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07396d2a-b45f-4c8c-a7e8-78478882262b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:35.262742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07396d2a-b45f-4c8c-a7e8-78478882262b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:35.262742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07396d2a-b45f-4c8c-a7e8-78478882262b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:35.262920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07396d2a-b45f-4c8c-a7e8-78478882262b admin admin] PATH_INFO: `/v3/users/fec8d36f9c9248a899911d3280d3d878` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:35.264509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07396d2a-b45f-4c8c-a7e8-78478882262b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fec8d36f9c9248a899911d3280d3d878)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:35.267938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07396d2a-b45f-4c8c-a7e8-78478882262b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:35.288033 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:35.371704 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1079/2186] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:35.372790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45cce34-0686-4608-a481-bac9732b6bfc None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:35.374552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f45cce34-0686-4608-a481-bac9732b6bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:35.391405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45cce34-0686-4608-a481-bac9732b6bfc None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:35.394927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-07396d2a-b45f-4c8c-a7e8-78478882262b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fec8d36f9c9248a899911d3280d3d878'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:35.396705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-07396d2a-b45f-4c8c-a7e8-78478882262b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fec8d36f9c9248a899911d3280d3d878'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:35.398618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cdbb5-81a1-4f89-9765-c83676eec342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:35.400202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cdbb5-81a1-4f89-9765-c83676eec342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:35.400202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cdbb5-81a1-4f89-9765-c83676eec342 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:35.406481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cdbb5-81a1-4f89-9765-c83676eec342 admin admin] PATH_INFO: `/v3/projects/3094e3b5657144d6a1ef64264725cf31` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:35.409610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cdbb5-81a1-4f89-9765-c83676eec342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3094e3b5657144d6a1ef64264725cf31)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:35.414113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cdbb5-81a1-4f89-9765-c83676eec342 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:35.427196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-07396d2a-b45f-4c8c-a7e8-78478882262b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fec8d36f9c9248a899911d3280d3d878'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:35.445620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-07396d2a-b45f-4c8c-a7e8-78478882262b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fec8d36f9c9248a899911d3280d3d878'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:35.489173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-07396d2a-b45f-4c8c-a7e8-78478882262b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fec8d36f9c9248a899911d3280d3d878'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:35.491376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9b6cdbb5-81a1-4f89-9765-c83676eec342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3094e3b5657144d6a1ef64264725cf31', 'request_id': 'req-9b6cdbb5-81a1-4f89-9765-c83676eec342'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:35.506701 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1108/2187] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:35 2022] DELETE /identity/v3/users/fec8d36f9c9248a899911d3280d3d878 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:35.507196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9b6cdbb5-81a1-4f89-9765-c83676eec342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3094e3b5657144d6a1ef64264725cf31', 'request_id': 'req-9b6cdbb5-81a1-4f89-9765-c83676eec342'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:35.509781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07396d2a-b45f-4c8c-a7e8-78478882262b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:35.512672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-07396d2a-b45f-4c8c-a7e8-78478882262b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:35.515033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9b6cdbb5-81a1-4f89-9765-c83676eec342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3094e3b5657144d6a1ef64264725cf31', 'request_id': 'req-9b6cdbb5-81a1-4f89-9765-c83676eec342'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:35.564540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9b6cdbb5-81a1-4f89-9765-c83676eec342 admin admin] The token cache is being invalidate because project 3094e3b5657144d6a1ef64264725cf31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:35.572547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9b6cdbb5-81a1-4f89-9765-c83676eec342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:35.573875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9b6cdbb5-81a1-4f89-9765-c83676eec342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:35.576031 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1080/2188] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:35 2022] DELETE /identity/v3/projects/3094e3b5657144d6a1ef64264725cf31 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:35.579703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cdbb5-81a1-4f89-9765-c83676eec342 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:35.581849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9b6cdbb5-81a1-4f89-9765-c83676eec342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:35.680644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07396d2a-b45f-4c8c-a7e8-78478882262b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:35.687522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463e6f1-17fc-42ba-aab0-444b91f72716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:35.688236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463e6f1-17fc-42ba-aab0-444b91f72716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:35.688805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463e6f1-17fc-42ba-aab0-444b91f72716 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:35.689417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463e6f1-17fc-42ba-aab0-444b91f72716 admin admin] PATH_INFO: `/v3/users/b80674f5d2fc4ed38d34a5ae09f90570` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:35.691272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463e6f1-17fc-42ba-aab0-444b91f72716 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b80674f5d2fc4ed38d34a5ae09f90570)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:35.693540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463e6f1-17fc-42ba-aab0-444b91f72716 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:35.743459 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:35.761440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cdbb5-81a1-4f89-9765-c83676eec342 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:35.771980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7463e6f1-17fc-42ba-aab0-444b91f72716 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b80674f5d2fc4ed38d34a5ae09f90570'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:35.772847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7463e6f1-17fc-42ba-aab0-444b91f72716 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b80674f5d2fc4ed38d34a5ae09f90570'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:35.792296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7463e6f1-17fc-42ba-aab0-444b91f72716 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b80674f5d2fc4ed38d34a5ae09f90570'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:35.827233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7463e6f1-17fc-42ba-aab0-444b91f72716 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b80674f5d2fc4ed38d34a5ae09f90570'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:35.843671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7463e6f1-17fc-42ba-aab0-444b91f72716 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b80674f5d2fc4ed38d34a5ae09f90570'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:35.854195 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1109/2189] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:35 2022] DELETE /identity/v3/users/b80674f5d2fc4ed38d34a5ae09f90570 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:35.855320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463e6f1-17fc-42ba-aab0-444b91f72716 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:35.857246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7463e6f1-17fc-42ba-aab0-444b91f72716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:35.900059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e08a1-a5dc-48df-826a-8137612fa4b0 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299d69478504afaaa010e7497d3d333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee6e8cc264e414898f5e3c5045743c2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:35.901412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e08a1-a5dc-48df-826a-8137612fa4b0 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:35.901846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e08a1-a5dc-48df-826a-8137612fa4b0 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:35.902437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e08a1-a5dc-48df-826a-8137612fa4b0 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:35.903401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e08a1-a5dc-48df-826a-8137612fa4b0 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:35.904270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e08a1-a5dc-48df-826a-8137612fa4b0 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:35.907005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e08a1-a5dc-48df-826a-8137612fa4b0 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:35.911391 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:35.962085 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1081/2190] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:35.966081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b85922-367e-48ea-9ad6-778db060df63 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:35.970898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b85922-367e-48ea-9ad6-778db060df63 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:35.971185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b85922-367e-48ea-9ad6-778db060df63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:36.036860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d5b85922-367e-48ea-9ad6-778db060df63 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:36.038819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d5b85922-367e-48ea-9ad6-778db060df63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:36.048433 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1082/2191] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:36.049271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b85922-367e-48ea-9ad6-778db060df63 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:36.050661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d5b85922-367e-48ea-9ad6-778db060df63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:36.062634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463e6f1-17fc-42ba-aab0-444b91f72716 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:36.067580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b35bb-a652-4084-b8d4-010288c84917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:36.068388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b35bb-a652-4084-b8d4-010288c84917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:36.068887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b35bb-a652-4084-b8d4-010288c84917 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:36.069323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b35bb-a652-4084-b8d4-010288c84917 admin admin] PATH_INFO: `/v3/users/0eaf4a7e89834d6ba421ee88bdc6eea3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:36.072001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b35bb-a652-4084-b8d4-010288c84917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eaf4a7e89834d6ba421ee88bdc6eea3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:36.074337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b35bb-a652-4084-b8d4-010288c84917 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:36.201743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c05b35bb-a652-4084-b8d4-010288c84917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eaf4a7e89834d6ba421ee88bdc6eea3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:36.202535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c05b35bb-a652-4084-b8d4-010288c84917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eaf4a7e89834d6ba421ee88bdc6eea3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:36.222363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b85922-367e-48ea-9ad6-778db060df63 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:36.233517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636e86e-c9a9-4e2e-aa91-9244cf17f0cc tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299d69478504afaaa010e7497d3d333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee6e8cc264e414898f5e3c5045743c2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:36.234392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636e86e-c9a9-4e2e-aa91-9244cf17f0cc tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:36.234727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636e86e-c9a9-4e2e-aa91-9244cf17f0cc tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:36.235013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636e86e-c9a9-4e2e-aa91-9244cf17f0cc tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:36.235152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c05b35bb-a652-4084-b8d4-010288c84917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eaf4a7e89834d6ba421ee88bdc6eea3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:36.235963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636e86e-c9a9-4e2e-aa91-9244cf17f0cc tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:36.241514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636e86e-c9a9-4e2e-aa91-9244cf17f0cc tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:36.258948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c05b35bb-a652-4084-b8d4-010288c84917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eaf4a7e89834d6ba421ee88bdc6eea3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:36.273644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c05b35bb-a652-4084-b8d4-010288c84917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eaf4a7e89834d6ba421ee88bdc6eea3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:36.312966 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1110/2192] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:35 2022] DELETE /identity/v3/users/0eaf4a7e89834d6ba421ee88bdc6eea3 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:36.312966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b35bb-a652-4084-b8d4-010288c84917 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:36.323774 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1083/2193] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:36 2022] POST /identity/v3/projects => generated 369 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:36.324490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636e86e-c9a9-4e2e-aa91-9244cf17f0cc tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:36.326373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4636e86e-c9a9-4e2e-aa91-9244cf17f0cc tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:36.328324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c05b35bb-a652-4084-b8d4-010288c84917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:36.421372 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:36.450693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636e86e-c9a9-4e2e-aa91-9244cf17f0cc tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:36.459533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3841c5b-0726-458d-a9a7-ec867ccc2970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:36.460382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3841c5b-0726-458d-a9a7-ec867ccc2970 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:36.463127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3841c5b-0726-458d-a9a7-ec867ccc2970 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:36.465293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3841c5b-0726-458d-a9a7-ec867ccc2970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:36.469407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d3841c5b-0726-458d-a9a7-ec867ccc2970 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:36.502228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b35bb-a652-4084-b8d4-010288c84917 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:36.657052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3841c5b-0726-458d-a9a7-ec867ccc2970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:36.661724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3841c5b-0726-458d-a9a7-ec867ccc2970 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:36.678998 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1084/2194] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:36.680940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3841c5b-0726-458d-a9a7-ec867ccc2970 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:36.686712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d3841c5b-0726-458d-a9a7-ec867ccc2970 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:36.717542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101b25c-8979-4dde-9518-5727f65456b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:36.718230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101b25c-8979-4dde-9518-5727f65456b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:36.718508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101b25c-8979-4dde-9518-5727f65456b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:36.718778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101b25c-8979-4dde-9518-5727f65456b1 admin admin] PATH_INFO: `/v3/projects/f53cc3183b9146ba91d646f3161848c5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:36.722371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101b25c-8979-4dde-9518-5727f65456b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f53cc3183b9146ba91d646f3161848c5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:36.724523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101b25c-8979-4dde-9518-5727f65456b1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:36.765687 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:36.829355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4101b25c-8979-4dde-9518-5727f65456b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f53cc3183b9146ba91d646f3161848c5', 'request_id': 'req-4101b25c-8979-4dde-9518-5727f65456b1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:36.841820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4101b25c-8979-4dde-9518-5727f65456b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f53cc3183b9146ba91d646f3161848c5', 'request_id': 'req-4101b25c-8979-4dde-9518-5727f65456b1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:36.870009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4101b25c-8979-4dde-9518-5727f65456b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f53cc3183b9146ba91d646f3161848c5', 'request_id': 'req-4101b25c-8979-4dde-9518-5727f65456b1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:36.903313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4101b25c-8979-4dde-9518-5727f65456b1 admin admin] The token cache is being invalidate because project f53cc3183b9146ba91d646f3161848c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:36.903451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4101b25c-8979-4dde-9518-5727f65456b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:36.905466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4101b25c-8979-4dde-9518-5727f65456b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:36.907520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3841c5b-0726-458d-a9a7-ec867ccc2970 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:36.931330 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1111/2195] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:36 2022] DELETE /identity/v3/projects/f53cc3183b9146ba91d646f3161848c5 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:36.933309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a335c72-e1ba-48fc-b479-d192dea350a7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:36.933599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a335c72-e1ba-48fc-b479-d192dea350a7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:36.934033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a335c72-e1ba-48fc-b479-d192dea350a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:37.002384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7a335c72-e1ba-48fc-b479-d192dea350a7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:37.003728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7a335c72-e1ba-48fc-b479-d192dea350a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:37.069709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19bfc3-e9cf-4eea-92e4-af48819427b2 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299d69478504afaaa010e7497d3d333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee6e8cc264e414898f5e3c5045743c2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:37.070927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19bfc3-e9cf-4eea-92e4-af48819427b2 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:37.071295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19bfc3-e9cf-4eea-92e4-af48819427b2 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:37.071413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19bfc3-e9cf-4eea-92e4-af48819427b2 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:37.073886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19bfc3-e9cf-4eea-92e4-af48819427b2 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:37.074283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19bfc3-e9cf-4eea-92e4-af48819427b2 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:37.075816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19bfc3-e9cf-4eea-92e4-af48819427b2 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:37.111154 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1085/2196] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:37.111154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19bfc3-e9cf-4eea-92e4-af48819427b2 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:37.114351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0e19bfc3-e9cf-4eea-92e4-af48819427b2 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:37.124204 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1112/2197] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:37.125636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a335c72-e1ba-48fc-b479-d192dea350a7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:37.127155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7a335c72-e1ba-48fc-b479-d192dea350a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:37.137550 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:37.140996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19bfc3-e9cf-4eea-92e4-af48819427b2 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:37.145968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a335c72-e1ba-48fc-b479-d192dea350a7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:37.146182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54307f5-d9bc-4154-803c-39bae300e23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:37.146820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54307f5-d9bc-4154-803c-39bae300e23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:37.147073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54307f5-d9bc-4154-803c-39bae300e23d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:37.147342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54307f5-d9bc-4154-803c-39bae300e23d admin admin] PATH_INFO: `/v3/users/a6b6314249fd4fd69df0b3b1f4449cde` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:37.148916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54307f5-d9bc-4154-803c-39bae300e23d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b6314249fd4fd69df0b3b1f4449cde)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:37.150841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54307f5-d9bc-4154-803c-39bae300e23d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:37.162828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d97c4-ee73-46a7-bc97-626dc399484a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:37.163831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d97c4-ee73-46a7-bc97-626dc399484a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:37.165282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d97c4-ee73-46a7-bc97-626dc399484a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:37.165750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d97c4-ee73-46a7-bc97-626dc399484a admin admin] PATH_INFO: `/v3/projects/a88d625038c247a5ba2a65e10fcf2a18` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:37.167657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d97c4-ee73-46a7-bc97-626dc399484a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a88d625038c247a5ba2a65e10fcf2a18)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:37.186800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d97c4-ee73-46a7-bc97-626dc399484a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:37.229519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e54307f5-d9bc-4154-803c-39bae300e23d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b6314249fd4fd69df0b3b1f4449cde'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:37.238708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e54307f5-d9bc-4154-803c-39bae300e23d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b6314249fd4fd69df0b3b1f4449cde'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:37.239640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e54307f5-d9bc-4154-803c-39bae300e23d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b6314249fd4fd69df0b3b1f4449cde'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:37.253760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9a7d97c4-ee73-46a7-bc97-626dc399484a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a88d625038c247a5ba2a65e10fcf2a18', 'request_id': 'req-9a7d97c4-ee73-46a7-bc97-626dc399484a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:37.255452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e54307f5-d9bc-4154-803c-39bae300e23d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b6314249fd4fd69df0b3b1f4449cde'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:37.263321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9a7d97c4-ee73-46a7-bc97-626dc399484a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a88d625038c247a5ba2a65e10fcf2a18', 'request_id': 'req-9a7d97c4-ee73-46a7-bc97-626dc399484a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:37.265118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e54307f5-d9bc-4154-803c-39bae300e23d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b6314249fd4fd69df0b3b1f4449cde'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:37.271446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9a7d97c4-ee73-46a7-bc97-626dc399484a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a88d625038c247a5ba2a65e10fcf2a18', 'request_id': 'req-9a7d97c4-ee73-46a7-bc97-626dc399484a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:37.272399 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1086/2198] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:37 2022] DELETE /identity/v3/users/a6b6314249fd4fd69df0b3b1f4449cde => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:37.273211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54307f5-d9bc-4154-803c-39bae300e23d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:37.276637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e54307f5-d9bc-4154-803c-39bae300e23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:37.286428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9a7d97c4-ee73-46a7-bc97-626dc399484a admin admin] The token cache is being invalidate because project a88d625038c247a5ba2a65e10fcf2a18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:37.286814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9a7d97c4-ee73-46a7-bc97-626dc399484a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:37.287893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9a7d97c4-ee73-46a7-bc97-626dc399484a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:37.291019 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1113/2199] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:37 2022] DELETE /identity/v3/projects/a88d625038c247a5ba2a65e10fcf2a18 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:37.292298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e83d-6397-4cf2-b032-19b124207982 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:37.292865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e83d-6397-4cf2-b032-19b124207982 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:37.293147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e83d-6397-4cf2-b032-19b124207982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:37.321121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a9b0e83d-6397-4cf2-b032-19b124207982 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:37.322350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a9b0e83d-6397-4cf2-b032-19b124207982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:37.335695 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:37.394516 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1114/2200] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:37.396069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f47c0-a986-472e-8b3a-a2bb62679c83 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:37.396436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f47c0-a986-472e-8b3a-a2bb62679c83 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:37.396803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f47c0-a986-472e-8b3a-a2bb62679c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:37.399315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54307f5-d9bc-4154-803c-39bae300e23d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:37.405610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f472139-f732-42d4-b887-164578477841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:37.406337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f472139-f732-42d4-b887-164578477841 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:37.406713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f472139-f732-42d4-b887-164578477841 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:37.407084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f472139-f732-42d4-b887-164578477841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:37.409008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4f472139-f732-42d4-b887-164578477841 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:37.419093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f09f47c0-a986-472e-8b3a-a2bb62679c83 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:37.420436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f09f47c0-a986-472e-8b3a-a2bb62679c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:37.431641 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1115/2201] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:37.433316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417a19a-8cb3-404d-a8d7-b830e04efe9f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:37.433652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417a19a-8cb3-404d-a8d7-b830e04efe9f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:37.433978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417a19a-8cb3-404d-a8d7-b830e04efe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:37.458876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4417a19a-8cb3-404d-a8d7-b830e04efe9f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:37.460377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4417a19a-8cb3-404d-a8d7-b830e04efe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:37.471564 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1116/2202] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:37.477954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417a19a-8cb3-404d-a8d7-b830e04efe9f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:37.487035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f472139-f732-42d4-b887-164578477841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:37.487918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417a19a-8cb3-404d-a8d7-b830e04efe9f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:37.488635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f472139-f732-42d4-b887-164578477841 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:37.494525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38382f-fd2a-4fd2-b475-2cacbc431993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:37.495277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38382f-fd2a-4fd2-b475-2cacbc431993 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:37.495390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38382f-fd2a-4fd2-b475-2cacbc431993 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:37.497596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38382f-fd2a-4fd2-b475-2cacbc431993 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:37.497596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38382f-fd2a-4fd2-b475-2cacbc431993 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:37.497596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38382f-fd2a-4fd2-b475-2cacbc431993 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:37.498190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38382f-fd2a-4fd2-b475-2cacbc431993 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:37.500445 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1087/2203] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:37.501275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f472139-f732-42d4-b887-164578477841 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:37.502770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4f472139-f732-42d4-b887-164578477841 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:37.514256 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1117/2204] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:37.515856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db219f-f022-4bfe-8251-198ca8d2f102 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:37.520864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db219f-f022-4bfe-8251-198ca8d2f102 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:37.521161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db219f-f022-4bfe-8251-198ca8d2f102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:37.553980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c8db219f-f022-4bfe-8251-198ca8d2f102 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:37.556152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c8db219f-f022-4bfe-8251-198ca8d2f102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:37.571609 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1118/2205] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:37.571609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db219f-f022-4bfe-8251-198ca8d2f102 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:37.593967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db219f-f022-4bfe-8251-198ca8d2f102 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:37.600830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bdbf7-381c-4f40-8b63-5248def62331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:37.603268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bdbf7-381c-4f40-8b63-5248def62331 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:37.603268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bdbf7-381c-4f40-8b63-5248def62331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:37.603268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bdbf7-381c-4f40-8b63-5248def62331 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:37.603986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bdbf7-381c-4f40-8b63-5248def62331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:37.606254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bdbf7-381c-4f40-8b63-5248def62331 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:37.622265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f472139-f732-42d4-b887-164578477841 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:37.628817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2657dd-55d4-4bdc-ad0c-6ddbbbafc832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:37.629696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2657dd-55d4-4bdc-ad0c-6ddbbbafc832 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:37.630192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2657dd-55d4-4bdc-ad0c-6ddbbbafc832 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:37.630601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2657dd-55d4-4bdc-ad0c-6ddbbbafc832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:37.650153 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1119/2206] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:37 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:37.651644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f95b7-43e3-43e1-9629-377a2f3ccf70 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:37.651997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f95b7-43e3-43e1-9629-377a2f3ccf70 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:37.652527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f95b7-43e3-43e1-9629-377a2f3ccf70 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:37.652659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2657dd-55d4-4bdc-ad0c-6ddbbbafc832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:37.654105 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1120/2207] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:43:37.654893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f95b7-43e3-43e1-9629-377a2f3ccf70 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:37.656753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-675f95b7-43e3-43e1-9629-377a2f3ccf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:37.659133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2657dd-55d4-4bdc-ad0c-6ddbbbafc832 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:37.672868 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1088/2208] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:37.673627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2657dd-55d4-4bdc-ad0c-6ddbbbafc832 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:37.685192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2657dd-55d4-4bdc-ad0c-6ddbbbafc832 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:37.720296 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:37.785352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f95b7-43e3-43e1-9629-377a2f3ccf70 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:37.793952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1875d-d073-4535-b8f8-a8e571f5b437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:37.795908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1875d-d073-4535-b8f8-a8e571f5b437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:37.796525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1875d-d073-4535-b8f8-a8e571f5b437 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:37.796973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1875d-d073-4535-b8f8-a8e571f5b437 admin admin] PATH_INFO: `/v3/projects/1deb300362744977af4d956392f5c48b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:37.797764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee051b81-4681-401f-8732-8706163e20d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:37.798624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee051b81-4681-401f-8732-8706163e20d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:37.799007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee051b81-4681-401f-8732-8706163e20d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:37.799353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee051b81-4681-401f-8732-8706163e20d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:37.799645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1875d-d073-4535-b8f8-a8e571f5b437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1deb300362744977af4d956392f5c48b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:37.800464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee051b81-4681-401f-8732-8706163e20d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:37.801147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee051b81-4681-401f-8732-8706163e20d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:37.802334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee051b81-4681-401f-8732-8706163e20d9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:37.804516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1875d-d073-4535-b8f8-a8e571f5b437 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:37.817917 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1089/2209] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:37.819145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee051b81-4681-401f-8732-8706163e20d9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:37.842745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee051b81-4681-401f-8732-8706163e20d9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:37.850783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6de62-e64f-4527-8d5b-233436b0dfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:37.851600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6de62-e64f-4527-8d5b-233436b0dfc2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:37.852941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6de62-e64f-4527-8d5b-233436b0dfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:37.853393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6de62-e64f-4527-8d5b-233436b0dfc2 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:37.854208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6de62-e64f-4527-8d5b-233436b0dfc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:37.856593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6de62-e64f-4527-8d5b-233436b0dfc2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:37.866321 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:37.907338 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1090/2210] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:37 2022] POST /identity/v3/users => generated 292 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:37.907338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6de62-e64f-4527-8d5b-233436b0dfc2 admin admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:43:37.911509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-68e6de62-e64f-4527-8d5b-233436b0dfc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:37.922892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f0d1875d-d073-4535-b8f8-a8e571f5b437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1deb300362744977af4d956392f5c48b', 'request_id': 'req-f0d1875d-d073-4535-b8f8-a8e571f5b437'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:37.940644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f0d1875d-d073-4535-b8f8-a8e571f5b437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1deb300362744977af4d956392f5c48b', 'request_id': 'req-f0d1875d-d073-4535-b8f8-a8e571f5b437'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:37.951126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f0d1875d-d073-4535-b8f8-a8e571f5b437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1deb300362744977af4d956392f5c48b', 'request_id': 'req-f0d1875d-d073-4535-b8f8-a8e571f5b437'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:37.994696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f0d1875d-d073-4535-b8f8-a8e571f5b437 admin admin] The token cache is being invalidate because project 1deb300362744977af4d956392f5c48b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:37.996622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f0d1875d-d073-4535-b8f8-a8e571f5b437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:37.998819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f0d1875d-d073-4535-b8f8-a8e571f5b437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:38.004129 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1121/2211] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:37 2022] DELETE /identity/v3/projects/1deb300362744977af4d956392f5c48b => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:38.005473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1875d-d073-4535-b8f8-a8e571f5b437 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:38.008634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f0d1875d-d073-4535-b8f8-a8e571f5b437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:38.049842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6de62-e64f-4527-8d5b-233436b0dfc2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:38.153175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6de62-e64f-4527-8d5b-233436b0dfc2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:38.172209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1875d-d073-4535-b8f8-a8e571f5b437 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:38.177070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b049a4-1bf4-4795-910a-4250a2c06ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:38.177682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b049a4-1bf4-4795-910a-4250a2c06ddb admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:38.177960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b049a4-1bf4-4795-910a-4250a2c06ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:38.178230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b049a4-1bf4-4795-910a-4250a2c06ddb admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:38.178871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b049a4-1bf4-4795-910a-4250a2c06ddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:38.181595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b049a4-1bf4-4795-910a-4250a2c06ddb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:38.229791 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1122/2212] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:38 2022] POST /identity/v3/projects => generated 395 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:38.232316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b049a4-1bf4-4795-910a-4250a2c06ddb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:38.234002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-94b049a4-1bf4-4795-910a-4250a2c06ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:38.236408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f15fed-e871-41c0-882b-9efdc5f99fab tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299d69478504afaaa010e7497d3d333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee6e8cc264e414898f5e3c5045743c2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:38.237177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f15fed-e871-41c0-882b-9efdc5f99fab tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:38.237558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f15fed-e871-41c0-882b-9efdc5f99fab tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:38.237971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f15fed-e871-41c0-882b-9efdc5f99fab tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] PATH_INFO: `/v3/projects/14a1589218b64bab8289b7e6c685d0ea` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:38.239898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f15fed-e871-41c0-882b-9efdc5f99fab tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorizing `identity:get_project(project_id=14a1589218b64bab8289b7e6c685d0ea)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:38.243676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f15fed-e871-41c0-882b-9efdc5f99fab tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:38.271995 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1091/2213] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:43:37 2022] GET /identity/v3/projects/14a1589218b64bab8289b7e6c685d0ea => generated 369 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:38.274333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f15fed-e871-41c0-882b-9efdc5f99fab tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:38.279400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-64f15fed-e871-41c0-882b-9efdc5f99fab tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:38.310113 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:38.311986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f15fed-e871-41c0-882b-9efdc5f99fab tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:38.342760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b049a4-1bf4-4795-910a-4250a2c06ddb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:38.349701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a30cf-ff15-4133-87da-14ff5024c410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:38.350673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a30cf-ff15-4133-87da-14ff5024c410 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:38.350916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a30cf-ff15-4133-87da-14ff5024c410 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:38.351175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a30cf-ff15-4133-87da-14ff5024c410 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:38.352875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a30cf-ff15-4133-87da-14ff5024c410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:38.354747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a30cf-ff15-4133-87da-14ff5024c410 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:38.368657 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1123/2214] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:38.369599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a30cf-ff15-4133-87da-14ff5024c410 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:38.372892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-518a30cf-ff15-4133-87da-14ff5024c410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:38.395803 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:38.405155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a30cf-ff15-4133-87da-14ff5024c410 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:38.413337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120d709-4672-4e97-bb77-a937f059d90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:38.415139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120d709-4672-4e97-bb77-a937f059d90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:38.415263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120d709-4672-4e97-bb77-a937f059d90e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:38.416393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120d709-4672-4e97-bb77-a937f059d90e admin admin] PATH_INFO: `/v3/projects/a8ec103a96134d6b8e1f2cd0d9aa537d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:38.418657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120d709-4672-4e97-bb77-a937f059d90e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8ec103a96134d6b8e1f2cd0d9aa537d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:38.429171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120d709-4672-4e97-bb77-a937f059d90e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:38.462276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ca017-8ac6-48b7-a7ad-f81f93cae3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:38.463636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ca017-8ac6-48b7-a7ad-f81f93cae3dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:38.463916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ca017-8ac6-48b7-a7ad-f81f93cae3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:38.464191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ca017-8ac6-48b7-a7ad-f81f93cae3dc admin admin] PATH_INFO: `/v3/users/c34337cf040d4540865e0d9959cfbcdd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:38.468277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ca017-8ac6-48b7-a7ad-f81f93cae3dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34337cf040d4540865e0d9959cfbcdd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:38.475839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ca017-8ac6-48b7-a7ad-f81f93cae3dc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:38.524989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4120d709-4672-4e97-bb77-a937f059d90e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8ec103a96134d6b8e1f2cd0d9aa537d', 'request_id': 'req-4120d709-4672-4e97-bb77-a937f059d90e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:38.537470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4120d709-4672-4e97-bb77-a937f059d90e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8ec103a96134d6b8e1f2cd0d9aa537d', 'request_id': 'req-4120d709-4672-4e97-bb77-a937f059d90e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:38.553880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4120d709-4672-4e97-bb77-a937f059d90e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8ec103a96134d6b8e1f2cd0d9aa537d', 'request_id': 'req-4120d709-4672-4e97-bb77-a937f059d90e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:38.554938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-857ca017-8ac6-48b7-a7ad-f81f93cae3dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34337cf040d4540865e0d9959cfbcdd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:38.563582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-857ca017-8ac6-48b7-a7ad-f81f93cae3dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34337cf040d4540865e0d9959cfbcdd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:38.564280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-857ca017-8ac6-48b7-a7ad-f81f93cae3dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34337cf040d4540865e0d9959cfbcdd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:38.569652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4120d709-4672-4e97-bb77-a937f059d90e admin admin] The token cache is being invalidate because project a8ec103a96134d6b8e1f2cd0d9aa537d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:38.569945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4120d709-4672-4e97-bb77-a937f059d90e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:38.571103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4120d709-4672-4e97-bb77-a937f059d90e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:38.572887 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1124/2215] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:38 2022] DELETE /identity/v3/projects/a8ec103a96134d6b8e1f2cd0d9aa537d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:38.573379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120d709-4672-4e97-bb77-a937f059d90e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:38.575261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4120d709-4672-4e97-bb77-a937f059d90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:38.582372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-857ca017-8ac6-48b7-a7ad-f81f93cae3dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34337cf040d4540865e0d9959cfbcdd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:38.590097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-857ca017-8ac6-48b7-a7ad-f81f93cae3dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34337cf040d4540865e0d9959cfbcdd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:38.596315 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1092/2216] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:38 2022] DELETE /identity/v3/users/c34337cf040d4540865e0d9959cfbcdd => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:38.597143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ca017-8ac6-48b7-a7ad-f81f93cae3dc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:38.598436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-857ca017-8ac6-48b7-a7ad-f81f93cae3dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:38.686414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120d709-4672-4e97-bb77-a937f059d90e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:38.717224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ca017-8ac6-48b7-a7ad-f81f93cae3dc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:38.723209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe91f23-fa06-4fce-aa26-d6bfaa84a9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:38.724117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe91f23-fa06-4fce-aa26-d6bfaa84a9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:38.724558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe91f23-fa06-4fce-aa26-d6bfaa84a9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:38.725228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe91f23-fa06-4fce-aa26-d6bfaa84a9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:38.726299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe91f23-fa06-4fce-aa26-d6bfaa84a9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:38.728779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe91f23-fa06-4fce-aa26-d6bfaa84a9b6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:38.741960 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1093/2217] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:38.743838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c723d7d-3404-4d5b-8440-061fb1221231 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:38.744231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c723d7d-3404-4d5b-8440-061fb1221231 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:38.744647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c723d7d-3404-4d5b-8440-061fb1221231 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:38.746678 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1094/2218] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:43:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:43:38.747482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c723d7d-3404-4d5b-8440-061fb1221231 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:38.749574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1c723d7d-3404-4d5b-8440-061fb1221231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:38.775026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c723d7d-3404-4d5b-8440-061fb1221231 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:38.781995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c191dc-0471-4821-8ee2-5490377df20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:38.782818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c191dc-0471-4821-8ee2-5490377df20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:38.783146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c191dc-0471-4821-8ee2-5490377df20b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:38.783668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c191dc-0471-4821-8ee2-5490377df20b admin admin] PATH_INFO: `/v3/users/4c1625ef25d94523a280d711982c661a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:38.789161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c191dc-0471-4821-8ee2-5490377df20b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c1625ef25d94523a280d711982c661a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:38.793731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c191dc-0471-4821-8ee2-5490377df20b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:38.870263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf709fb2-4237-4f0d-9d84-f77de249f851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:38.871305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf709fb2-4237-4f0d-9d84-f77de249f851 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:38.871718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf709fb2-4237-4f0d-9d84-f77de249f851 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:38.872140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf709fb2-4237-4f0d-9d84-f77de249f851 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:38.873075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf709fb2-4237-4f0d-9d84-f77de249f851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:38.875814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf709fb2-4237-4f0d-9d84-f77de249f851 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:38.895538 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:38.910233 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1125/2219] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:38 2022] POST /identity/v3/users => generated 298 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:38.914253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f2c191dc-0471-4821-8ee2-5490377df20b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c1625ef25d94523a280d711982c661a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:38.927693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf709fb2-4237-4f0d-9d84-f77de249f851 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:38.935522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f2c191dc-0471-4821-8ee2-5490377df20b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c1625ef25d94523a280d711982c661a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:38.936741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f2c191dc-0471-4821-8ee2-5490377df20b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c1625ef25d94523a280d711982c661a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:38.937286 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:38.946499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf709fb2-4237-4f0d-9d84-f77de249f851 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:38.952805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014b6e9-4dae-41b9-9913-849730aa1d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:38.956323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014b6e9-4dae-41b9-9913-849730aa1d07 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:38.956654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014b6e9-4dae-41b9-9913-849730aa1d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:38.957192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014b6e9-4dae-41b9-9913-849730aa1d07 admin admin] PATH_INFO: `/v3/projects/183da6234c234ab49dab937c0d1cc51e/users/33d61d4558a241189b2e21d35b5350f2/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:38.963296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f2c191dc-0471-4821-8ee2-5490377df20b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c1625ef25d94523a280d711982c661a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:38.973804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f2c191dc-0471-4821-8ee2-5490377df20b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c1625ef25d94523a280d711982c661a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:38.975750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014b6e9-4dae-41b9-9913-849730aa1d07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=183da6234c234ab49dab937c0d1cc51e, user_id=33d61d4558a241189b2e21d35b5350f2, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:38.979933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014b6e9-4dae-41b9-9913-849730aa1d07 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:38.989025 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1095/2220] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:38 2022] DELETE /identity/v3/users/4c1625ef25d94523a280d711982c661a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:38.992838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c191dc-0471-4821-8ee2-5490377df20b admin admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:43:38.996467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f2c191dc-0471-4821-8ee2-5490377df20b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:39.017308 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1126/2221] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:38 2022] PUT /identity/v3/projects/183da6234c234ab49dab937c0d1cc51e/users/33d61d4558a241189b2e21d35b5350f2/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:39.017308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014b6e9-4dae-41b9-9913-849730aa1d07 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:39.019052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3014b6e9-4dae-41b9-9913-849730aa1d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:39.157701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014b6e9-4dae-41b9-9913-849730aa1d07 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:39.163223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce194c0d-ce9c-4e39-abd7-7b3bf425bcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:39.164801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce194c0d-ce9c-4e39-abd7-7b3bf425bcde admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:39.165287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce194c0d-ce9c-4e39-abd7-7b3bf425bcde admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:39.165751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce194c0d-ce9c-4e39-abd7-7b3bf425bcde admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:39.166602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce194c0d-ce9c-4e39-abd7-7b3bf425bcde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:39.168455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce194c0d-ce9c-4e39-abd7-7b3bf425bcde admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:39.171687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c191dc-0471-4821-8ee2-5490377df20b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:39.177715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f2c191dc-0471-4821-8ee2-5490377df20b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:39.185780 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1127/2222] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:39.187406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc61ae-a7a8-45af-8038-6dbe2ceec320 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:39.187803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc61ae-a7a8-45af-8038-6dbe2ceec320 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:39.188167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc61ae-a7a8-45af-8038-6dbe2ceec320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:39.260969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2dcc61ae-a7a8-45af-8038-6dbe2ceec320 None None] MFA Rules not processed for user `33d61d4558a241189b2e21d35b5350f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:39.263845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2dcc61ae-a7a8-45af-8038-6dbe2ceec320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:39.294861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c191dc-0471-4821-8ee2-5490377df20b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:39.372107 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1128/2223] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:39.372891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc61ae-a7a8-45af-8038-6dbe2ceec320 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:39.399399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc61ae-a7a8-45af-8038-6dbe2ceec320 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:39.409876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6418d54-220a-4437-919f-d13c66c5e3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:39.410829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6418d54-220a-4437-919f-d13c66c5e3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:39.411078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6418d54-220a-4437-919f-d13c66c5e3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:39.411351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6418d54-220a-4437-919f-d13c66c5e3f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:39.411539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6b04b-b044-4af0-b10c-c85da27818c2 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299d69478504afaaa010e7497d3d333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee6e8cc264e414898f5e3c5045743c2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:39.412057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6418d54-220a-4437-919f-d13c66c5e3f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:39.412299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6b04b-b044-4af0-b10c-c85da27818c2 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:39.412589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6b04b-b044-4af0-b10c-c85da27818c2 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:39.412910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6b04b-b044-4af0-b10c-c85da27818c2 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] PATH_INFO: `/v3/projects/14a1589218b64bab8289b7e6c685d0ea` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:39.413613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6418d54-220a-4437-919f-d13c66c5e3f1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:39.416594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6b04b-b044-4af0-b10c-c85da27818c2 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorizing `identity:get_project(project_id=14a1589218b64bab8289b7e6c685d0ea)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:39.425527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6b04b-b044-4af0-b10c-c85da27818c2 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:39.429040 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1096/2224] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:43:38 2022] GET /identity/v3/projects/14a1589218b64bab8289b7e6c685d0ea => generated 369 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:39.443211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6b04b-b044-4af0-b10c-c85da27818c2 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:39.448682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4ee6b04b-b044-4af0-b10c-c85da27818c2 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:39.454233 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1129/2225] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:39.455502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6418d54-220a-4437-919f-d13c66c5e3f1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:39.457609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e6418d54-220a-4437-919f-d13c66c5e3f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:39.474331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6b04b-b044-4af0-b10c-c85da27818c2 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:39.475680 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:39.487541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe2ee6-d059-4498-ae24-21639ab10efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:39.488268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe2ee6-d059-4498-ae24-21639ab10efd admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:39.488636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe2ee6-d059-4498-ae24-21639ab10efd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:39.489123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe2ee6-d059-4498-ae24-21639ab10efd admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:39.492759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe2ee6-d059-4498-ae24-21639ab10efd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:39.496332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6418d54-220a-4437-919f-d13c66c5e3f1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:39.498288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe2ee6-d059-4498-ae24-21639ab10efd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:39.517543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92717b7-7804-44f2-84c9-6f76822a5b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:39.518198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92717b7-7804-44f2-84c9-6f76822a5b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:39.518483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92717b7-7804-44f2-84c9-6f76822a5b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:39.518747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92717b7-7804-44f2-84c9-6f76822a5b96 admin admin] PATH_INFO: `/v3/projects/d9a26fd5851149cb800152c4019a8dc9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:39.522957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92717b7-7804-44f2-84c9-6f76822a5b96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a26fd5851149cb800152c4019a8dc9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:39.525539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92717b7-7804-44f2-84c9-6f76822a5b96 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:39.556326 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1097/2226] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:39 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:39.559081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe2ee6-d059-4498-ae24-21639ab10efd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:39.603958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f92717b7-7804-44f2-84c9-6f76822a5b96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a26fd5851149cb800152c4019a8dc9', 'request_id': 'req-f92717b7-7804-44f2-84c9-6f76822a5b96'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:39.608676 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:39.615006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f92717b7-7804-44f2-84c9-6f76822a5b96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a26fd5851149cb800152c4019a8dc9', 'request_id': 'req-f92717b7-7804-44f2-84c9-6f76822a5b96'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:39.624631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f92717b7-7804-44f2-84c9-6f76822a5b96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a26fd5851149cb800152c4019a8dc9', 'request_id': 'req-f92717b7-7804-44f2-84c9-6f76822a5b96'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:39.646486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f92717b7-7804-44f2-84c9-6f76822a5b96 admin admin] The token cache is being invalidate because project d9a26fd5851149cb800152c4019a8dc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:39.647167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f92717b7-7804-44f2-84c9-6f76822a5b96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:39.648104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f92717b7-7804-44f2-84c9-6f76822a5b96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:39.652738 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1130/2227] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:39 2022] DELETE /identity/v3/projects/d9a26fd5851149cb800152c4019a8dc9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:39.653618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92717b7-7804-44f2-84c9-6f76822a5b96 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:39.657769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f92717b7-7804-44f2-84c9-6f76822a5b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:39.666229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe2ee6-d059-4498-ae24-21639ab10efd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:39.744660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b2f75-d3f4-4ab0-9b03-4e2ed7dbf38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:39.745877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b2f75-d3f4-4ab0-9b03-4e2ed7dbf38e admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:39.746029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b2f75-d3f4-4ab0-9b03-4e2ed7dbf38e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:39.746422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b2f75-d3f4-4ab0-9b03-4e2ed7dbf38e admin admin] PATH_INFO: `/v3/projects/1b215a8c81c14330a5bd679f8e74ef57/users/a21d45726c0d4c21a997ac67e2b07e00/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:39.748763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92717b7-7804-44f2-84c9-6f76822a5b96 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:39.754610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7112e-9593-47c1-b4f1-8d869a752339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:39.755452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7112e-9593-47c1-b4f1-8d869a752339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:39.755799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7112e-9593-47c1-b4f1-8d869a752339 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:39.756154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7112e-9593-47c1-b4f1-8d869a752339 admin admin] PATH_INFO: `/v3/projects/3173aa84bb7a44968062ce8110c493b3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:39.757397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7112e-9593-47c1-b4f1-8d869a752339 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3173aa84bb7a44968062ce8110c493b3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:39.761162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7112e-9593-47c1-b4f1-8d869a752339 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:39.769673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b2f75-d3f4-4ab0-9b03-4e2ed7dbf38e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b215a8c81c14330a5bd679f8e74ef57, user_id=a21d45726c0d4c21a997ac67e2b07e00, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:39.775400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b2f75-d3f4-4ab0-9b03-4e2ed7dbf38e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:39.794382 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1098/2228] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:39 2022] PUT /identity/v3/projects/1b215a8c81c14330a5bd679f8e74ef57/users/a21d45726c0d4c21a997ac67e2b07e00/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:39.798635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b2f75-d3f4-4ab0-9b03-4e2ed7dbf38e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:39.800405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d45b2f75-d3f4-4ab0-9b03-4e2ed7dbf38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:39.864413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-43e7112e-9593-47c1-b4f1-8d869a752339 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3173aa84bb7a44968062ce8110c493b3', 'request_id': 'req-43e7112e-9593-47c1-b4f1-8d869a752339'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:39.874736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-43e7112e-9593-47c1-b4f1-8d869a752339 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3173aa84bb7a44968062ce8110c493b3', 'request_id': 'req-43e7112e-9593-47c1-b4f1-8d869a752339'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:39.886331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-43e7112e-9593-47c1-b4f1-8d869a752339 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3173aa84bb7a44968062ce8110c493b3', 'request_id': 'req-43e7112e-9593-47c1-b4f1-8d869a752339'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:39.900489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-43e7112e-9593-47c1-b4f1-8d869a752339 admin admin] The token cache is being invalidate because project 3173aa84bb7a44968062ce8110c493b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:39.901652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-43e7112e-9593-47c1-b4f1-8d869a752339 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:39.902590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-43e7112e-9593-47c1-b4f1-8d869a752339 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:39.904539 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1131/2229] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:39 2022] DELETE /identity/v3/projects/3173aa84bb7a44968062ce8110c493b3 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:39.905676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7112e-9593-47c1-b4f1-8d869a752339 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:39.907256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-43e7112e-9593-47c1-b4f1-8d869a752339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:39.908956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b2f75-d3f4-4ab0-9b03-4e2ed7dbf38e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:39.949647 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:40.016151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7112e-9593-47c1-b4f1-8d869a752339 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:40.026205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937a67c-e85d-494d-a2e0-f5925c6c9673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:40.027034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937a67c-e85d-494d-a2e0-f5925c6c9673 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:40.027322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937a67c-e85d-494d-a2e0-f5925c6c9673 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:40.027599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937a67c-e85d-494d-a2e0-f5925c6c9673 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:40.028358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937a67c-e85d-494d-a2e0-f5925c6c9673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:40.030705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937a67c-e85d-494d-a2e0-f5925c6c9673 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:40.034862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8edc3-f366-4627-9161-51fab9210ca0 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299d69478504afaaa010e7497d3d333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee6e8cc264e414898f5e3c5045743c2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:40.035484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8edc3-f366-4627-9161-51fab9210ca0 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:40.036389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8edc3-f366-4627-9161-51fab9210ca0 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:40.036752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8edc3-f366-4627-9161-51fab9210ca0 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:40.037424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8edc3-f366-4627-9161-51fab9210ca0 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:40.037735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8edc3-f366-4627-9161-51fab9210ca0 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:40.039420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8edc3-f366-4627-9161-51fab9210ca0 tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:40.056348 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=5,keystone:DELETE=10,keystone:SELECT=85 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:40.065430 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1099/2230] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:40.066292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ac445-2a91-45e7-b304-52300775ba21 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:40.066996 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1132/2231] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:39 2022] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:40.068295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f5814-d232-4088-8147-184f54d81fad None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:40.068806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ac445-2a91-45e7-b304-52300775ba21 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:40.069083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ac445-2a91-45e7-b304-52300775ba21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:40.072537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f5814-d232-4088-8147-184f54d81fad None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:40.073374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f5814-d232-4088-8147-184f54d81fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:40.100075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-375f5814-d232-4088-8147-184f54d81fad None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:40.101615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-375f5814-d232-4088-8147-184f54d81fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:40.105852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e68ac445-2a91-45e7-b304-52300775ba21 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:40.107827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e68ac445-2a91-45e7-b304-52300775ba21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:40.116719 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1133/2232] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:40.118076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcb91c-8fd4-4c60-a0b0-baa583120870 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:40.118362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcb91c-8fd4-4c60-a0b0-baa583120870 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:40.118637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcb91c-8fd4-4c60-a0b0-baa583120870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:40.120086 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1100/2233] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:40.121383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ac445-2a91-45e7-b304-52300775ba21 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:40.126013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e68ac445-2a91-45e7-b304-52300775ba21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:40.145719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ac445-2a91-45e7-b304-52300775ba21 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:40.149628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-54fcb91c-8fd4-4c60-a0b0-baa583120870 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:40.151335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-54fcb91c-8fd4-4c60-a0b0-baa583120870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:40.153058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5695838-0e9d-4e6f-9f4d-2ecc20d0d70a tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299d69478504afaaa010e7497d3d333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee6e8cc264e414898f5e3c5045743c2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:40.153926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5695838-0e9d-4e6f-9f4d-2ecc20d0d70a tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:40.154228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5695838-0e9d-4e6f-9f4d-2ecc20d0d70a tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:40.154517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5695838-0e9d-4e6f-9f4d-2ecc20d0d70a tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:40.155372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5695838-0e9d-4e6f-9f4d-2ecc20d0d70a tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:40.157677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5695838-0e9d-4e6f-9f4d-2ecc20d0d70a tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:40.170160 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1134/2234] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:40.170160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcb91c-8fd4-4c60-a0b0-baa583120870 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:40.185310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcb91c-8fd4-4c60-a0b0-baa583120870 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:40.189808 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1101/2235] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:40 2022] POST /identity/v3/users => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:40.190849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312bec4-8a06-4047-a9bb-9967f34a706e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:40.191351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5695838-0e9d-4e6f-9f4d-2ecc20d0d70a tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:40.191732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312bec4-8a06-4047-a9bb-9967f34a706e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:40.192212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312bec4-8a06-4047-a9bb-9967f34a706e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:40.192647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312bec4-8a06-4047-a9bb-9967f34a706e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:40.194392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312bec4-8a06-4047-a9bb-9967f34a706e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:40.195728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f5695838-0e9d-4e6f-9f4d-2ecc20d0d70a tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:40.197492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312bec4-8a06-4047-a9bb-9967f34a706e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:40.215827 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1135/2236] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:40.217749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f4eac-d573-4f86-9183-fdb9116e53a5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:40.218946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f4eac-d573-4f86-9183-fdb9116e53a5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:40.219287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f4eac-d573-4f86-9183-fdb9116e53a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:40.245659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-025f4eac-d573-4f86-9183-fdb9116e53a5 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:40.247035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-025f4eac-d573-4f86-9183-fdb9116e53a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:40.260067 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1136/2237] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:40.261767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879af4c4-de9f-4e05-8833-a7cbd662eead None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:40.262152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879af4c4-de9f-4e05-8833-a7cbd662eead None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:40.262558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879af4c4-de9f-4e05-8833-a7cbd662eead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:40.301545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-879af4c4-de9f-4e05-8833-a7cbd662eead None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:40.302929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-879af4c4-de9f-4e05-8833-a7cbd662eead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:40.320965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5695838-0e9d-4e6f-9f4d-2ecc20d0d70a tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:40.327234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf3a7d-a9d1-44ac-848c-543cf8600ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:40.327870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf3a7d-a9d1-44ac-848c-543cf8600ecb service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:40.328145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf3a7d-a9d1-44ac-848c-543cf8600ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:40.328414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf3a7d-a9d1-44ac-848c-543cf8600ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:40.336548 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1137/2238] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:40.338049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879af4c4-de9f-4e05-8833-a7cbd662eead None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:40.347472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf3a7d-a9d1-44ac-848c-543cf8600ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:40.349034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf3a7d-a9d1-44ac-848c-543cf8600ecb service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:40.350407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879af4c4-de9f-4e05-8833-a7cbd662eead None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:40.355358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03813e-cdfc-4c72-970d-afda1293b13a tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299d69478504afaaa010e7497d3d333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee6e8cc264e414898f5e3c5045743c2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:40.356072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03813e-cdfc-4c72-970d-afda1293b13a tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:40.356427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03813e-cdfc-4c72-970d-afda1293b13a tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:40.356800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03813e-cdfc-4c72-970d-afda1293b13a tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:40.357910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03813e-cdfc-4c72-970d-afda1293b13a tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:40.358286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03813e-cdfc-4c72-970d-afda1293b13a tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:40.359962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03813e-cdfc-4c72-970d-afda1293b13a tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:40.364009 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1102/2239] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:40.364881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf3a7d-a9d1-44ac-848c-543cf8600ecb service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:40.379347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf3a7d-a9d1-44ac-848c-543cf8600ecb service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:40.387051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5966e-7cc6-432c-bbb1-b2a33516cffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:40.387483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5966e-7cc6-432c-bbb1-b2a33516cffd admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:40.387760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5966e-7cc6-432c-bbb1-b2a33516cffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:40.388033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5966e-7cc6-432c-bbb1-b2a33516cffd admin admin] PATH_INFO: `/v3/projects/3562e60a283043e3a791bb9d86c595ab/users/cfc2212810b24c4386618a42ef612840/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:40.399269 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1138/2240] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:40.401678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03813e-cdfc-4c72-970d-afda1293b13a tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:40.427234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5966e-7cc6-432c-bbb1-b2a33516cffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3562e60a283043e3a791bb9d86c595ab, user_id=cfc2212810b24c4386618a42ef612840, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:40.434384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5966e-7cc6-432c-bbb1-b2a33516cffd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:40.442306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03813e-cdfc-4c72-970d-afda1293b13a tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:40.459347 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1103/2241] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:40 2022] PUT /identity/v3/projects/3562e60a283043e3a791bb9d86c595ab/users/cfc2212810b24c4386618a42ef612840/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:40.459347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5966e-7cc6-432c-bbb1-b2a33516cffd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:40.467347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4f87b-e2f8-4716-9bd8-1c0797bb9caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:40.467965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4f87b-e2f8-4716-9bd8-1c0797bb9caf admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:40.468240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4f87b-e2f8-4716-9bd8-1c0797bb9caf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:40.468505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4f87b-e2f8-4716-9bd8-1c0797bb9caf admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:40.469187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4f87b-e2f8-4716-9bd8-1c0797bb9caf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:40.469490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4f87b-e2f8-4716-9bd8-1c0797bb9caf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:40.474913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4f87b-e2f8-4716-9bd8-1c0797bb9caf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:40.503429 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1139/2242] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:40.503429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd883b-8dd4-4269-825a-4ca8a902a2fc None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:40.503429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd883b-8dd4-4269-825a-4ca8a902a2fc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:40.503429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd883b-8dd4-4269-825a-4ca8a902a2fc None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:40.512693 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1140/2243] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:43:40 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:43:40.513747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd883b-8dd4-4269-825a-4ca8a902a2fc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:40.591614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5966e-7cc6-432c-bbb1-b2a33516cffd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:40.604363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c4b16-18cc-497b-b41f-adc06eb6dec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:40.606073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c4b16-18cc-497b-b41f-adc06eb6dec2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:40.607245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c4b16-18cc-497b-b41f-adc06eb6dec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:40.608964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c4b16-18cc-497b-b41f-adc06eb6dec2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:40.609882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c4b16-18cc-497b-b41f-adc06eb6dec2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:40.611327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c4b16-18cc-497b-b41f-adc06eb6dec2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:40.614192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c4b16-18cc-497b-b41f-adc06eb6dec2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:40.648015 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1104/2244] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:40.652139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c4b16-18cc-497b-b41f-adc06eb6dec2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:40.654045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd883b-8dd4-4269-825a-4ca8a902a2fc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:40.661520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49efc9b-1259-4774-95a9-2b3a0153ba0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:40.662782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49efc9b-1259-4774-95a9-2b3a0153ba0e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:40.663212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49efc9b-1259-4774-95a9-2b3a0153ba0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:40.663491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49efc9b-1259-4774-95a9-2b3a0153ba0e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:40.663707 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:40.664712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49efc9b-1259-4774-95a9-2b3a0153ba0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:40.668812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49efc9b-1259-4774-95a9-2b3a0153ba0e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:40.676828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c4b16-18cc-497b-b41f-adc06eb6dec2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:40.683949 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1141/2245] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:40.684864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49efc9b-1259-4774-95a9-2b3a0153ba0e admin admin] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:43:40.687298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d49efc9b-1259-4774-95a9-2b3a0153ba0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:40.697543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc120b-03a6-4133-9ce0-a1f488a648f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:40.698272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc120b-03a6-4133-9ce0-a1f488a648f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:40.698556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc120b-03a6-4133-9ce0-a1f488a648f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:40.698830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc120b-03a6-4133-9ce0-a1f488a648f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:40.699992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc120b-03a6-4133-9ce0-a1f488a648f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:40.706996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc120b-03a6-4133-9ce0-a1f488a648f4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:40.770445 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1105/2246] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:40 2022] POST /identity/v3/projects => generated 393 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:40.771963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc120b-03a6-4133-9ce0-a1f488a648f4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:40.826003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49efc9b-1259-4774-95a9-2b3a0153ba0e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:40.870366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc120b-03a6-4133-9ce0-a1f488a648f4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:40.877372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6685f92-3c02-4a54-949d-5c79ed8d8f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:40.878553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6685f92-3c02-4a54-949d-5c79ed8d8f8e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:40.879060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6685f92-3c02-4a54-949d-5c79ed8d8f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:40.879554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6685f92-3c02-4a54-949d-5c79ed8d8f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:40.880477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6685f92-3c02-4a54-949d-5c79ed8d8f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:40.884053 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:40.884471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6685f92-3c02-4a54-949d-5c79ed8d8f8e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:40.971495 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1106/2247] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:40 2022] POST /identity/v3/projects => generated 399 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:40.971495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6685f92-3c02-4a54-949d-5c79ed8d8f8e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:40.984194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49efc9b-1259-4774-95a9-2b3a0153ba0e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:41.138249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6685f92-3c02-4a54-949d-5c79ed8d8f8e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:41.144796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a9403-6504-4675-b7b7-66ce83b7f8bc tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299d69478504afaaa010e7497d3d333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee6e8cc264e414898f5e3c5045743c2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:41.145342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db16d1-3767-4d48-9071-2d0dbb660c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:41.145660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db16d1-3767-4d48-9071-2d0dbb660c5b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:41.145981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db16d1-3767-4d48-9071-2d0dbb660c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:41.146392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db16d1-3767-4d48-9071-2d0dbb660c5b admin admin] PATH_INFO: `/v3/projects/3562e60a283043e3a791bb9d86c595ab/users/cfc2212810b24c4386618a42ef612840/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:41.146779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a9403-6504-4675-b7b7-66ce83b7f8bc tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:41.147240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a9403-6504-4675-b7b7-66ce83b7f8bc tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:41.147720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a9403-6504-4675-b7b7-66ce83b7f8bc tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] PATH_INFO: `/v3/projects/14a1589218b64bab8289b7e6c685d0ea` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:41.149221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db16d1-3767-4d48-9071-2d0dbb660c5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3562e60a283043e3a791bb9d86c595ab, user_id=cfc2212810b24c4386618a42ef612840, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:41.150176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a9403-6504-4675-b7b7-66ce83b7f8bc tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorizing `identity:get_project(project_id=14a1589218b64bab8289b7e6c685d0ea)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:41.153070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db16d1-3767-4d48-9071-2d0dbb660c5b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:41.153412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a9403-6504-4675-b7b7-66ce83b7f8bc tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:41.157787 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1142/2248] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:43:40 2022] GET /identity/v3/projects/14a1589218b64bab8289b7e6c685d0ea => generated 369 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:41.158757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a9403-6504-4675-b7b7-66ce83b7f8bc tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:41.188704 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1107/2249] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:40 2022] PUT /identity/v3/projects/3562e60a283043e3a791bb9d86c595ab/users/cfc2212810b24c4386618a42ef612840/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:41.189891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db16d1-3767-4d48-9071-2d0dbb660c5b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:41.206008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a9403-6504-4675-b7b7-66ce83b7f8bc tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:41.350424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db16d1-3767-4d48-9071-2d0dbb660c5b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:41.362393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae965464-a2d8-4fc0-879e-09dff4a32fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:41.363018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae965464-a2d8-4fc0-879e-09dff4a32fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:41.363296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae965464-a2d8-4fc0-879e-09dff4a32fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:41.363566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae965464-a2d8-4fc0-879e-09dff4a32fa3 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:41.364207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae965464-a2d8-4fc0-879e-09dff4a32fa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:41.366162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae965464-a2d8-4fc0-879e-09dff4a32fa3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:41.366375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf5daf-8ca2-4282-a096-2c4355520a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:41.367300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf5daf-8ca2-4282-a096-2c4355520a26 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:41.367502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf5daf-8ca2-4282-a096-2c4355520a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:41.367779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf5daf-8ca2-4282-a096-2c4355520a26 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:41.368423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf5daf-8ca2-4282-a096-2c4355520a26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:41.376588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf5daf-8ca2-4282-a096-2c4355520a26 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:41.393688 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:41.422084 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1108/2250] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:41 2022] POST /identity/v3/users => generated 300 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:41.428921 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1143/2251] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:41 2022] POST /identity/v3/users => generated 297 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:41.428921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae965464-a2d8-4fc0-879e-09dff4a32fa3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:41.429246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4a50f-14ea-42af-9030-2b59166d2e86 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:41.429246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4a50f-14ea-42af-9030-2b59166d2e86 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:41.429246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4a50f-14ea-42af-9030-2b59166d2e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:41.482408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae965464-a2d8-4fc0-879e-09dff4a32fa3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:41.488809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b18013-c435-4a58-a216-c7ffb9233fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:41.489994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b18013-c435-4a58-a216-c7ffb9233fad admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:41.490598 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b18013-c435-4a58-a216-c7ffb9233fad admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:41.491134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b18013-c435-4a58-a216-c7ffb9233fad admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:41.492237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b18013-c435-4a58-a216-c7ffb9233fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:41.493591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-72f4a50f-14ea-42af-9030-2b59166d2e86 None None] MFA Rules not processed for user `cfc2212810b24c4386618a42ef612840`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:41.495033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-72f4a50f-14ea-42af-9030-2b59166d2e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:41.495942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b18013-c435-4a58-a216-c7ffb9233fad admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:41.514552 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1144/2252] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:41.516652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b18013-c435-4a58-a216-c7ffb9233fad admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:41.538273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b18013-c435-4a58-a216-c7ffb9233fad admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:41.544417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc649da-534a-4866-a7d8-055470029dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:41.546022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc649da-534a-4866-a7d8-055470029dba admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:41.546564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc649da-534a-4866-a7d8-055470029dba admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:41.547055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc649da-534a-4866-a7d8-055470029dba admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:41.547920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc649da-534a-4866-a7d8-055470029dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:41.551853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc649da-534a-4866-a7d8-055470029dba admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:41.568733 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1145/2253] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:41.575037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8ab41-69a6-4595-9b21-487a0612542e None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:41.575746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8ab41-69a6-4595-9b21-487a0612542e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:41.576220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8ab41-69a6-4595-9b21-487a0612542e None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:41.579377 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1146/2254] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:43:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:43:41.580669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8ab41-69a6-4595-9b21-487a0612542e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:41.609968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8ab41-69a6-4595-9b21-487a0612542e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:41.627194 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1109/2255] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:41.628198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4a50f-14ea-42af-9030-2b59166d2e86 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:41.637766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaade40d-0864-468d-a9f5-43191e643adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:41.638314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaade40d-0864-468d-a9f5-43191e643adb admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:41.638608 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaade40d-0864-468d-a9f5-43191e643adb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:41.638803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaade40d-0864-468d-a9f5-43191e643adb admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:41.639887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaade40d-0864-468d-a9f5-43191e643adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:41.641509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaade40d-0864-468d-a9f5-43191e643adb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:41.655503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4a50f-14ea-42af-9030-2b59166d2e86 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:41.670873 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1147/2256] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:41.670873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaade40d-0864-468d-a9f5-43191e643adb admin admin] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:43:41.672910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bc7a8-0625-44a8-8d96-9ef652007522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:41.673538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bc7a8-0625-44a8-8d96-9ef652007522 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:41.673812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bc7a8-0625-44a8-8d96-9ef652007522 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:41.674076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bc7a8-0625-44a8-8d96-9ef652007522 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:41.674722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bc7a8-0625-44a8-8d96-9ef652007522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:41.676305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bc7a8-0625-44a8-8d96-9ef652007522 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:41.678545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eaade40d-0864-468d-a9f5-43191e643adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:41.707742 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1110/2257] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:41.712024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bc7a8-0625-44a8-8d96-9ef652007522 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:41.763684 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:41.834039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaade40d-0864-468d-a9f5-43191e643adb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:41.868568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bc7a8-0625-44a8-8d96-9ef652007522 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:41.888323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e7ce3-213d-4aaf-82e5-713bec68e56f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:41.888973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e7ce3-213d-4aaf-82e5-713bec68e56f service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:41.889252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e7ce3-213d-4aaf-82e5-713bec68e56f service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:41.889525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e7ce3-213d-4aaf-82e5-713bec68e56f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:41.931210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e7ce3-213d-4aaf-82e5-713bec68e56f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:41.933477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e7ce3-213d-4aaf-82e5-713bec68e56f service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:41.950671 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1111/2258] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:41.963386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e7ce3-213d-4aaf-82e5-713bec68e56f service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:41.991546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaade40d-0864-468d-a9f5-43191e643adb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:41.995302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e7ce3-213d-4aaf-82e5-713bec68e56f service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:42.004008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1ee86-a063-4e30-8681-feee9e5b624c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:42.004812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbdce1-b574-42e1-80dd-5fd18621833e tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299d69478504afaaa010e7497d3d333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee6e8cc264e414898f5e3c5045743c2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:42.005585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1ee86-a063-4e30-8681-feee9e5b624c admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:42.005859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1ee86-a063-4e30-8681-feee9e5b624c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:42.006123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1ee86-a063-4e30-8681-feee9e5b624c admin admin] PATH_INFO: `/v3/projects/bc139700866a45a4bd2d79e15ce37862/users/4510be741ffd4331bfd9a636e48d57fd/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:42.008752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbdce1-b574-42e1-80dd-5fd18621833e tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:42.009131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbdce1-b574-42e1-80dd-5fd18621833e tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:42.009403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbdce1-b574-42e1-80dd-5fd18621833e tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] PATH_INFO: `/v3/projects/14a1589218b64bab8289b7e6c685d0ea` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:42.012247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbdce1-b574-42e1-80dd-5fd18621833e tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorizing `identity:get_project(project_id=14a1589218b64bab8289b7e6c685d0ea)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:42.014327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbdce1-b574-42e1-80dd-5fd18621833e tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:42.016185 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1148/2259] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:43:41 2022] GET /identity/v3/projects/14a1589218b64bab8289b7e6c685d0ea => generated 369 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:42.017879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbdce1-b574-42e1-80dd-5fd18621833e tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:42.045969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbdce1-b574-42e1-80dd-5fd18621833e tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:42.048673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1ee86-a063-4e30-8681-feee9e5b624c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc139700866a45a4bd2d79e15ce37862, user_id=4510be741ffd4331bfd9a636e48d57fd, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:42.051791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1ee86-a063-4e30-8681-feee9e5b624c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:42.060641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf665b9-7e0c-43b6-b800-de77b7188cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:42.061369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf665b9-7e0c-43b6-b800-de77b7188cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:42.061646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf665b9-7e0c-43b6-b800-de77b7188cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:42.061912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf665b9-7e0c-43b6-b800-de77b7188cd6 admin admin] PATH_INFO: `/v3/projects/5ba2b77426ef44af846ef8a28e6eb375/users/062ae27bd8a7463fa7a0b869b6ab0c3f/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:42.084107 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1112/2260] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:41 2022] PUT /identity/v3/projects/bc139700866a45a4bd2d79e15ce37862/users/4510be741ffd4331bfd9a636e48d57fd/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:42.085568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08873fa4-a0d3-4b35-bf17-33688b78d643 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:42.086049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08873fa4-a0d3-4b35-bf17-33688b78d643 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:42.086345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08873fa4-a0d3-4b35-bf17-33688b78d643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:42.094917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf665b9-7e0c-43b6-b800-de77b7188cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ba2b77426ef44af846ef8a28e6eb375, user_id=062ae27bd8a7463fa7a0b869b6ab0c3f, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:42.106164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf665b9-7e0c-43b6-b800-de77b7188cd6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:42.126410 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1149/2261] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:42 2022] PUT /identity/v3/projects/5ba2b77426ef44af846ef8a28e6eb375/users/062ae27bd8a7463fa7a0b869b6ab0c3f/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:42.127153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf665b9-7e0c-43b6-b800-de77b7188cd6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:42.157871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-08873fa4-a0d3-4b35-bf17-33688b78d643 None None] MFA Rules not processed for user `7fca17ba092e44f1a37b108778dc7a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:42.159473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-08873fa4-a0d3-4b35-bf17-33688b78d643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:42.173406 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:42.256045 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1113/2262] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:42 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:42.258160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8ad05-b0e9-449f-845d-1461002af4ba None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:42.258949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8ad05-b0e9-449f-845d-1461002af4ba None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:42.259080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8ad05-b0e9-449f-845d-1461002af4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:42.264799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf665b9-7e0c-43b6-b800-de77b7188cd6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:42.271352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607f5f9-0130-4ff2-b816-4b56e93858ec tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299d69478504afaaa010e7497d3d333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee6e8cc264e414898f5e3c5045743c2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:42.272017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607f5f9-0130-4ff2-b816-4b56e93858ec tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:42.272300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607f5f9-0130-4ff2-b816-4b56e93858ec tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:42.272572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607f5f9-0130-4ff2-b816-4b56e93858ec tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] PATH_INFO: `/v3/users/99d2f01f82e540cbb58332951cf2b559` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:42.290099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607f5f9-0130-4ff2-b816-4b56e93858ec tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorizing `identity:delete_user(user_id=99d2f01f82e540cbb58332951cf2b559)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:42.292075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607f5f9-0130-4ff2-b816-4b56e93858ec tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:42.304134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4ae8ad05-b0e9-449f-845d-1461002af4ba None None] MFA Rules not processed for user `4510be741ffd4331bfd9a636e48d57fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:42.305548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4ae8ad05-b0e9-449f-845d-1461002af4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:42.342998 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:42.359073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7607f5f9-0130-4ff2-b816-4b56e93858ec tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d2f01f82e540cbb58332951cf2b559'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:42.359851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7607f5f9-0130-4ff2-b816-4b56e93858ec tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d2f01f82e540cbb58332951cf2b559'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:42.370862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7607f5f9-0130-4ff2-b816-4b56e93858ec tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d2f01f82e540cbb58332951cf2b559'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:42.389348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7607f5f9-0130-4ff2-b816-4b56e93858ec tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d2f01f82e540cbb58332951cf2b559'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:42.397787 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7607f5f9-0130-4ff2-b816-4b56e93858ec tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d2f01f82e540cbb58332951cf2b559'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:42.412411 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1150/2263] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:42 2022] DELETE /identity/v3/users/99d2f01f82e540cbb58332951cf2b559 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:42.413891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607f5f9-0130-4ff2-b816-4b56e93858ec tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:42.415685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7607f5f9-0130-4ff2-b816-4b56e93858ec tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:42.425183 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1114/2264] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:42 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:42.426624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aa4b3-b882-40b4-925e-1d8be2f7300b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:42.426908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aa4b3-b882-40b4-925e-1d8be2f7300b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:42.427182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aa4b3-b882-40b4-925e-1d8be2f7300b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:42.497736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a65aa4b3-b882-40b4-925e-1d8be2f7300b None None] MFA Rules not processed for user `062ae27bd8a7463fa7a0b869b6ab0c3f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:42.499752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a65aa4b3-b882-40b4-925e-1d8be2f7300b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:42.544025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607f5f9-0130-4ff2-b816-4b56e93858ec tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:42.559172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35c015-64ec-44aa-930a-3a9b8b403c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:42.563189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35c015-64ec-44aa-930a-3a9b8b403c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:42.563499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35c015-64ec-44aa-930a-3a9b8b403c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:42.563777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35c015-64ec-44aa-930a-3a9b8b403c41 admin admin] PATH_INFO: `/v3/users/33d61d4558a241189b2e21d35b5350f2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:42.567526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35c015-64ec-44aa-930a-3a9b8b403c41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d61d4558a241189b2e21d35b5350f2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:42.574978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35c015-64ec-44aa-930a-3a9b8b403c41 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:42.694275 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1115/2265] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:42.700653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65aa4b3-b882-40b4-925e-1d8be2f7300b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:42.702089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a65aa4b3-b882-40b4-925e-1d8be2f7300b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:42.735424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7f35c015-64ec-44aa-930a-3a9b8b403c41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d61d4558a241189b2e21d35b5350f2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:42.735971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65aa4b3-b882-40b4-925e-1d8be2f7300b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:42.736409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7f35c015-64ec-44aa-930a-3a9b8b403c41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d61d4558a241189b2e21d35b5350f2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:42.748092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab203e-db50-4cb7-a9a7-af6f4c821a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:42.748918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab203e-db50-4cb7-a9a7-af6f4c821a87 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:42.749269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab203e-db50-4cb7-a9a7-af6f4c821a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:42.749610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab203e-db50-4cb7-a9a7-af6f4c821a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:42.750419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab203e-db50-4cb7-a9a7-af6f4c821a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:42.752829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab203e-db50-4cb7-a9a7-af6f4c821a87 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:42.760885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7f35c015-64ec-44aa-930a-3a9b8b403c41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d61d4558a241189b2e21d35b5350f2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:42.808348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7f35c015-64ec-44aa-930a-3a9b8b403c41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d61d4558a241189b2e21d35b5350f2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:42.833936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7f35c015-64ec-44aa-930a-3a9b8b403c41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d61d4558a241189b2e21d35b5350f2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:42.856946 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1151/2266] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:42 2022] DELETE /identity/v3/users/33d61d4558a241189b2e21d35b5350f2 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:42.856946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35c015-64ec-44aa-930a-3a9b8b403c41 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:42.863790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7f35c015-64ec-44aa-930a-3a9b8b403c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:42.873856 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1116/2267] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:42 2022] POST /identity/v3/projects => generated 397 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:42.875631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab203e-db50-4cb7-a9a7-af6f4c821a87 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:42.878021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0cab203e-db50-4cb7-a9a7-af6f4c821a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:42.917912 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:42.968765 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:43.059114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35c015-64ec-44aa-930a-3a9b8b403c41 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:43.090710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab203e-db50-4cb7-a9a7-af6f4c821a87 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:43.105196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89566a04-cb8e-4b27-9b26-6e50548ee3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:43.106135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566a04-cb8e-4b27-9b26-6e50548ee3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:43.106915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566a04-cb8e-4b27-9b26-6e50548ee3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:43.107391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566a04-cb8e-4b27-9b26-6e50548ee3f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:43.108406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89566a04-cb8e-4b27-9b26-6e50548ee3f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:43.111776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89566a04-cb8e-4b27-9b26-6e50548ee3f2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:43.145563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e318f-f8be-4870-a8c2-494b8d95d8af tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e299d69478504afaaa010e7497d3d333', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ee6e8cc264e414898f5e3c5045743c2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:43.146331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e318f-f8be-4870-a8c2-494b8d95d8af tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:43.146680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e318f-f8be-4870-a8c2-494b8d95d8af tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:43.147511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e318f-f8be-4870-a8c2-494b8d95d8af tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] PATH_INFO: `/v3/projects/14a1589218b64bab8289b7e6c685d0ea` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:43.148939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e318f-f8be-4870-a8c2-494b8d95d8af tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorizing `identity:delete_project(project_id=14a1589218b64bab8289b7e6c685d0ea)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:43.151028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e318f-f8be-4870-a8c2-494b8d95d8af tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:43.184719 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1117/2268] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:42 2022] POST /identity/v3/projects => generated 397 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:43.188699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89566a04-cb8e-4b27-9b26-6e50548ee3f2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:43.191030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-89566a04-cb8e-4b27-9b26-6e50548ee3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:43.234753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cb3e318f-f8be-4870-a8c2-494b8d95d8af tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14a1589218b64bab8289b7e6c685d0ea', 'request_id': 'req-cb3e318f-f8be-4870-a8c2-494b8d95d8af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:43.246825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cb3e318f-f8be-4870-a8c2-494b8d95d8af tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14a1589218b64bab8289b7e6c685d0ea', 'request_id': 'req-cb3e318f-f8be-4870-a8c2-494b8d95d8af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:43.256134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cb3e318f-f8be-4870-a8c2-494b8d95d8af tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14a1589218b64bab8289b7e6c685d0ea', 'request_id': 'req-cb3e318f-f8be-4870-a8c2-494b8d95d8af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:43.292199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cb3e318f-f8be-4870-a8c2-494b8d95d8af tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] The token cache is being invalidate because project 14a1589218b64bab8289b7e6c685d0ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:43.292832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cb3e318f-f8be-4870-a8c2-494b8d95d8af tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:43.295552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cb3e318f-f8be-4870-a8c2-494b8d95d8af tempest-QuotasAdminTestV236-1903009477 tempest-QuotasAdminTestV236-1903009477-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:43.297420 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1152/2269] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:42 2022] DELETE /identity/v3/projects/14a1589218b64bab8289b7e6c685d0ea => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:43.305076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1a751-adb0-4ad4-a8ca-8b4adc21d9b8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:43.307909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1a751-adb0-4ad4-a8ca-8b4adc21d9b8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:43.307909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1a751-adb0-4ad4-a8ca-8b4adc21d9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:43.342803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89566a04-cb8e-4b27-9b26-6e50548ee3f2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:43.350011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8bb1a751-adb0-4ad4-a8ca-8b4adc21d9b8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:43.351442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8bb1a751-adb0-4ad4-a8ca-8b4adc21d9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:43.463968 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1153/2270] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:43.464944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1a751-adb0-4ad4-a8ca-8b4adc21d9b8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:43.482777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8bb1a751-adb0-4ad4-a8ca-8b4adc21d9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:43.483556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3946f-1990-41d3-84b0-a507e1868a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:43.484191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3946f-1990-41d3-84b0-a507e1868a4e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:43.484474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3946f-1990-41d3-84b0-a507e1868a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:43.484817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3946f-1990-41d3-84b0-a507e1868a4e admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:43.485484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3946f-1990-41d3-84b0-a507e1868a4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:43.487631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3946f-1990-41d3-84b0-a507e1868a4e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:43.504780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1a751-adb0-4ad4-a8ca-8b4adc21d9b8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:43.512475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1422c48-1938-4c21-a4c0-61add6eaf7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:43.513261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1422c48-1938-4c21-a4c0-61add6eaf7d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:43.514080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1422c48-1938-4c21-a4c0-61add6eaf7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:43.514080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1422c48-1938-4c21-a4c0-61add6eaf7d7 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:43.514688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1422c48-1938-4c21-a4c0-61add6eaf7d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:43.517450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1422c48-1938-4c21-a4c0-61add6eaf7d7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:43.535566 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:43.565737 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1154/2271] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:43 2022] POST /identity/v3/users => generated 305 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:43.565963 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1118/2272] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:43 2022] POST /identity/v3/projects => generated 395 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:43.566791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3946f-1990-41d3-84b0-a507e1868a4e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:43.566920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1422c48-1938-4c21-a4c0-61add6eaf7d7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:43.571668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f1422c48-1938-4c21-a4c0-61add6eaf7d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:43.572482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6cb3946f-1990-41d3-84b0-a507e1868a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:43.598123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1422c48-1938-4c21-a4c0-61add6eaf7d7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:43.619564 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:43.669412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3946f-1990-41d3-84b0-a507e1868a4e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:43.675458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb3f4e-7ca9-4782-a265-337cfe85eb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:43.676209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb3f4e-7ca9-4782-a265-337cfe85eb04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:43.676584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb3f4e-7ca9-4782-a265-337cfe85eb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:43.677260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb3f4e-7ca9-4782-a265-337cfe85eb04 admin admin] PATH_INFO: `/v3/users/f5dbf9494eb94dc280b8b647082b8ed9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:43.679266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb3f4e-7ca9-4782-a265-337cfe85eb04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5dbf9494eb94dc280b8b647082b8ed9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:43.682483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb3f4e-7ca9-4782-a265-337cfe85eb04 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:43.685297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d7d25-d004-437c-a58a-973d2195a0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:43.686338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d7d25-d004-437c-a58a-973d2195a0f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:43.686787 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d7d25-d004-437c-a58a-973d2195a0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:43.687193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d7d25-d004-437c-a58a-973d2195a0f8 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:43.687845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d7d25-d004-437c-a58a-973d2195a0f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:43.689832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d7d25-d004-437c-a58a-973d2195a0f8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:43.719124 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1155/2273] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:43 2022] POST /identity/v3/users => generated 305 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:43.720088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d7d25-d004-437c-a58a-973d2195a0f8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:43.722236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b67d7d25-d004-437c-a58a-973d2195a0f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:43.748588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b4eb3f4e-7ca9-4782-a265-337cfe85eb04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5dbf9494eb94dc280b8b647082b8ed9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:43.760594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b4eb3f4e-7ca9-4782-a265-337cfe85eb04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5dbf9494eb94dc280b8b647082b8ed9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:43.761625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b4eb3f4e-7ca9-4782-a265-337cfe85eb04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5dbf9494eb94dc280b8b647082b8ed9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:43.779270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b4eb3f4e-7ca9-4782-a265-337cfe85eb04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5dbf9494eb94dc280b8b647082b8ed9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:43.788433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b4eb3f4e-7ca9-4782-a265-337cfe85eb04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5dbf9494eb94dc280b8b647082b8ed9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:43.798814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d7d25-d004-437c-a58a-973d2195a0f8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:43.799039 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1119/2274] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:43 2022] DELETE /identity/v3/users/f5dbf9494eb94dc280b8b647082b8ed9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:43.799039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb3f4e-7ca9-4782-a265-337cfe85eb04 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:43.799039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b4eb3f4e-7ca9-4782-a265-337cfe85eb04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:43.886293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb3f4e-7ca9-4782-a265-337cfe85eb04 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:43.887964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a70497-e2fa-4e4d-8acc-81554fb1e228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:43.890156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a70497-e2fa-4e4d-8acc-81554fb1e228 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:43.891340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a70497-e2fa-4e4d-8acc-81554fb1e228 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:43.891668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30584188-baaa-4f0e-8d60-aa545830bca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:43.892106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a70497-e2fa-4e4d-8acc-81554fb1e228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:43.892851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30584188-baaa-4f0e-8d60-aa545830bca5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:43.894038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30584188-baaa-4f0e-8d60-aa545830bca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:43.894038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30584188-baaa-4f0e-8d60-aa545830bca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:43.894038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30584188-baaa-4f0e-8d60-aa545830bca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:43.896053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30584188-baaa-4f0e-8d60-aa545830bca5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:43.897601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c0a70497-e2fa-4e4d-8acc-81554fb1e228 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:43.909980 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1120/2275] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:43.910824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30584188-baaa-4f0e-8d60-aa545830bca5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:43.912513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-30584188-baaa-4f0e-8d60-aa545830bca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:43.929737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a70497-e2fa-4e4d-8acc-81554fb1e228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:43.931218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a70497-e2fa-4e4d-8acc-81554fb1e228 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:43.937430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30584188-baaa-4f0e-8d60-aa545830bca5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:43.942817 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1156/2276] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:43.943538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a70497-e2fa-4e4d-8acc-81554fb1e228 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:43.953075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da8b03-6237-435c-9880-76fd866eade9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:43.953716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da8b03-6237-435c-9880-76fd866eade9 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:43.953995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da8b03-6237-435c-9880-76fd866eade9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:43.954264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da8b03-6237-435c-9880-76fd866eade9 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:43.955158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da8b03-6237-435c-9880-76fd866eade9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:43.957108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da8b03-6237-435c-9880-76fd866eade9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:43.962377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c0a70497-e2fa-4e4d-8acc-81554fb1e228 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:43.986940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a70497-e2fa-4e4d-8acc-81554fb1e228 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:43.992654 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1121/2277] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:43 2022] POST /identity/v3/users => generated 304 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:43.994138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f8da8-ef4b-412f-b5ed-07e2ac4a45db None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:43.995896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f8da8-ef4b-412f-b5ed-07e2ac4a45db None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:43.996321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f8da8-ef4b-412f-b5ed-07e2ac4a45db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:43.998514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa1665-2fab-41c3-a5bb-73b0bb9e715a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:43.999315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa1665-2fab-41c3-a5bb-73b0bb9e715a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:43.999581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa1665-2fab-41c3-a5bb-73b0bb9e715a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:44.000048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa1665-2fab-41c3-a5bb-73b0bb9e715a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:44.000926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa1665-2fab-41c3-a5bb-73b0bb9e715a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:44.007998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa1665-2fab-41c3-a5bb-73b0bb9e715a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:44.022629 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1157/2278] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:44.024798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa1665-2fab-41c3-a5bb-73b0bb9e715a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:44.044672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-283f8da8-ef4b-412f-b5ed-07e2ac4a45db None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:44.049852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa1665-2fab-41c3-a5bb-73b0bb9e715a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:44.050463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-283f8da8-ef4b-412f-b5ed-07e2ac4a45db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:44.064087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b5484-95d9-4d34-991f-fbd06db2d868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:44.065067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b5484-95d9-4d34-991f-fbd06db2d868 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:44.066383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b5484-95d9-4d34-991f-fbd06db2d868 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:44.066993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b5484-95d9-4d34-991f-fbd06db2d868 admin admin] PATH_INFO: `/v3/projects/c94313db12764911b03cce95cbb3ec48/users/5856ac6dc0f844489e69cc75104a62df/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:44.092050 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1122/2279] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:44.092050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f8da8-ef4b-412f-b5ed-07e2ac4a45db None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:44.104461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b5484-95d9-4d34-991f-fbd06db2d868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c94313db12764911b03cce95cbb3ec48, user_id=5856ac6dc0f844489e69cc75104a62df, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:44.108204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b5484-95d9-4d34-991f-fbd06db2d868 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:44.127604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f8da8-ef4b-412f-b5ed-07e2ac4a45db None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:44.139004 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1158/2280] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:44 2022] PUT /identity/v3/projects/c94313db12764911b03cce95cbb3ec48/users/5856ac6dc0f844489e69cc75104a62df/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:44.145163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76358c12-f270-4e7d-ba4f-00ccabbc27e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:44.145710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b5484-95d9-4d34-991f-fbd06db2d868 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:44.145958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76358c12-f270-4e7d-ba4f-00ccabbc27e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:44.146313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76358c12-f270-4e7d-ba4f-00ccabbc27e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:44.146655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76358c12-f270-4e7d-ba4f-00ccabbc27e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:44.147398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76358c12-f270-4e7d-ba4f-00ccabbc27e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:44.149696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76358c12-f270-4e7d-ba4f-00ccabbc27e9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:44.173483 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1123/2281] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:44.174711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76358c12-f270-4e7d-ba4f-00ccabbc27e9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:44.181085 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:44.182395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-76358c12-f270-4e7d-ba4f-00ccabbc27e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:44.198381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76358c12-f270-4e7d-ba4f-00ccabbc27e9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:44.203774 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:44.282955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79160e02-26bf-44b9-b33c-63affd90fb27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:44.283755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79160e02-26bf-44b9-b33c-63affd90fb27 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:44.284222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79160e02-26bf-44b9-b33c-63affd90fb27 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:44.284570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79160e02-26bf-44b9-b33c-63affd90fb27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:44.327809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b5484-95d9-4d34-991f-fbd06db2d868 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:44.340570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f46d3-9735-406d-9d9e-88bc2afb924c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:44.344257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f46d3-9735-406d-9d9e-88bc2afb924c admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:44.344257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f46d3-9735-406d-9d9e-88bc2afb924c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:44.344504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f46d3-9735-406d-9d9e-88bc2afb924c admin admin] PATH_INFO: `/v3/projects/65080798f4f1490184bd586dfad51590/users/563efdcc6b4140f4ab3d17c54eac5de7/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:44.383882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f46d3-9735-406d-9d9e-88bc2afb924c admin admin] RBAC: Authorizing `identity:create_grant(project_id=65080798f4f1490184bd586dfad51590, user_id=563efdcc6b4140f4ab3d17c54eac5de7, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:44.388131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f46d3-9735-406d-9d9e-88bc2afb924c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:44.409861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79160e02-26bf-44b9-b33c-63affd90fb27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:44.413982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79160e02-26bf-44b9-b33c-63affd90fb27 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:44.417792 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1159/2282] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:44 2022] PUT /identity/v3/projects/65080798f4f1490184bd586dfad51590/users/563efdcc6b4140f4ab3d17c54eac5de7/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:44.422163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f46d3-9735-406d-9d9e-88bc2afb924c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:44.431943 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1124/2283] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:44.433166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79160e02-26bf-44b9-b33c-63affd90fb27 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:44.448429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79160e02-26bf-44b9-b33c-63affd90fb27 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:44.573329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad180792-b801-4323-afec-a48d913cc265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:44.574894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad180792-b801-4323-afec-a48d913cc265 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:44.575192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad180792-b801-4323-afec-a48d913cc265 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:44.575485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad180792-b801-4323-afec-a48d913cc265 admin admin] PATH_INFO: `/v3/projects/2e6705dc7d98445fb9681d161628d3b1/users/f1324ecac6bf41c3aa8c7fe2a539d0fb/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:44.601863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f46d3-9735-406d-9d9e-88bc2afb924c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:44.607534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a5ade-8b19-4ea5-a0b1-c6affbab75ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:44.610659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a5ade-8b19-4ea5-a0b1-c6affbab75ca admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:44.610659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a5ade-8b19-4ea5-a0b1-c6affbab75ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:44.610659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a5ade-8b19-4ea5-a0b1-c6affbab75ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:44.610659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a5ade-8b19-4ea5-a0b1-c6affbab75ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:44.611335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a5ade-8b19-4ea5-a0b1-c6affbab75ca admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:44.622227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad180792-b801-4323-afec-a48d913cc265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e6705dc7d98445fb9681d161628d3b1, user_id=f1324ecac6bf41c3aa8c7fe2a539d0fb, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:44.627882 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1160/2284] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:44.628056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad180792-b801-4323-afec-a48d913cc265 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:44.628159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a5ade-8b19-4ea5-a0b1-c6affbab75ca admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:44.645926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a5ade-8b19-4ea5-a0b1-c6affbab75ca admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:44.657291 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1125/2285] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:44 2022] PUT /identity/v3/projects/2e6705dc7d98445fb9681d161628d3b1/users/f1324ecac6bf41c3aa8c7fe2a539d0fb/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:44.657678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad180792-b801-4323-afec-a48d913cc265 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:44.659966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c72a5-3dc7-4d69-bc14-b59b3ef98746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:44.660751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c72a5-3dc7-4d69-bc14-b59b3ef98746 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:44.661603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c72a5-3dc7-4d69-bc14-b59b3ef98746 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:44.661603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c72a5-3dc7-4d69-bc14-b59b3ef98746 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:44.662427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c72a5-3dc7-4d69-bc14-b59b3ef98746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:44.667216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c72a5-3dc7-4d69-bc14-b59b3ef98746 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:44.670091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ad180792-b801-4323-afec-a48d913cc265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:44.688909 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1161/2286] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:44.691094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c72a5-3dc7-4d69-bc14-b59b3ef98746 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:44.714095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c72a5-3dc7-4d69-bc14-b59b3ef98746 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:44.855845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f434c4c-80c0-419e-8c44-011f136b09e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:44.856612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f434c4c-80c0-419e-8c44-011f136b09e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:44.856903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f434c4c-80c0-419e-8c44-011f136b09e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:44.857180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f434c4c-80c0-419e-8c44-011f136b09e0 admin admin] PATH_INFO: `/v3/projects/c94313db12764911b03cce95cbb3ec48/users/5856ac6dc0f844489e69cc75104a62df/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:44.861104 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:44.861725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f434c4c-80c0-419e-8c44-011f136b09e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c94313db12764911b03cce95cbb3ec48, user_id=5856ac6dc0f844489e69cc75104a62df, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:44.873218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f434c4c-80c0-419e-8c44-011f136b09e0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:44.900931 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1162/2287] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:44 2022] PUT /identity/v3/projects/c94313db12764911b03cce95cbb3ec48/users/5856ac6dc0f844489e69cc75104a62df/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:44.901830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f434c4c-80c0-419e-8c44-011f136b09e0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:44.926506 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:44.957207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad180792-b801-4323-afec-a48d913cc265 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:45.069657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f434c4c-80c0-419e-8c44-011f136b09e0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:45.083296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafe22e-ba55-44ea-9810-5e924f6aeada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:45.083938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafe22e-ba55-44ea-9810-5e924f6aeada admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:45.084374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafe22e-ba55-44ea-9810-5e924f6aeada admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:45.085247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafe22e-ba55-44ea-9810-5e924f6aeada admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:45.091159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafe22e-ba55-44ea-9810-5e924f6aeada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:45.092992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafe22e-ba55-44ea-9810-5e924f6aeada admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:45.127707 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1163/2288] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:45.128590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafe22e-ba55-44ea-9810-5e924f6aeada admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:45.161178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafe22e-ba55-44ea-9810-5e924f6aeada admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:45.174169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a3d5b-2648-41d5-8cc2-3a0d98d26a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:45.174853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a3d5b-2648-41d5-8cc2-3a0d98d26a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:45.175133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a3d5b-2648-41d5-8cc2-3a0d98d26a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:45.175406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a3d5b-2648-41d5-8cc2-3a0d98d26a34 admin admin] PATH_INFO: `/v3/projects/65080798f4f1490184bd586dfad51590/users/563efdcc6b4140f4ab3d17c54eac5de7/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:45.182737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a3d5b-2648-41d5-8cc2-3a0d98d26a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65080798f4f1490184bd586dfad51590, user_id=563efdcc6b4140f4ab3d17c54eac5de7, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:45.186901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a3d5b-2648-41d5-8cc2-3a0d98d26a34 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:45.212348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3a521-c776-47b3-8bdd-4c989a018326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:45.213230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3a521-c776-47b3-8bdd-4c989a018326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:45.213566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3a521-c776-47b3-8bdd-4c989a018326 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:45.213898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3a521-c776-47b3-8bdd-4c989a018326 admin admin] PATH_INFO: `/v3/projects/183da6234c234ab49dab937c0d1cc51e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:45.215150 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1164/2289] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:45 2022] PUT /identity/v3/projects/65080798f4f1490184bd586dfad51590/users/563efdcc6b4140f4ab3d17c54eac5de7/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:45.215291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3a521-c776-47b3-8bdd-4c989a018326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=183da6234c234ab49dab937c0d1cc51e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:45.216044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a3d5b-2648-41d5-8cc2-3a0d98d26a34 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:45.217778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3a521-c776-47b3-8bdd-4c989a018326 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:45.374031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a3d5b-2648-41d5-8cc2-3a0d98d26a34 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:45.385406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-efb3a521-c776-47b3-8bdd-4c989a018326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '183da6234c234ab49dab937c0d1cc51e', 'request_id': 'req-efb3a521-c776-47b3-8bdd-4c989a018326'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:45.403008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-efb3a521-c776-47b3-8bdd-4c989a018326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '183da6234c234ab49dab937c0d1cc51e', 'request_id': 'req-efb3a521-c776-47b3-8bdd-4c989a018326'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:45.421754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-efb3a521-c776-47b3-8bdd-4c989a018326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '183da6234c234ab49dab937c0d1cc51e', 'request_id': 'req-efb3a521-c776-47b3-8bdd-4c989a018326'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:45.444206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-efb3a521-c776-47b3-8bdd-4c989a018326 admin admin] The token cache is being invalidate because project 183da6234c234ab49dab937c0d1cc51e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:45.444582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-efb3a521-c776-47b3-8bdd-4c989a018326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:45.445653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-efb3a521-c776-47b3-8bdd-4c989a018326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:45.452462 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1126/2290] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:44 2022] DELETE /identity/v3/projects/183da6234c234ab49dab937c0d1cc51e => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:45.454470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b072f6-d849-4eb0-9fbc-b1fa7aaca760 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:45.455151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b072f6-d849-4eb0-9fbc-b1fa7aaca760 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:45.455436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b072f6-d849-4eb0-9fbc-b1fa7aaca760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:45.500211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59a016-5710-4f71-af6a-e6b4d898a8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:45.500960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59a016-5710-4f71-af6a-e6b4d898a8d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:45.501244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59a016-5710-4f71-af6a-e6b4d898a8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:45.501516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59a016-5710-4f71-af6a-e6b4d898a8d6 admin admin] PATH_INFO: `/v3/projects/2e6705dc7d98445fb9681d161628d3b1/users/f1324ecac6bf41c3aa8c7fe2a539d0fb/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:45.506054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59a016-5710-4f71-af6a-e6b4d898a8d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e6705dc7d98445fb9681d161628d3b1, user_id=f1324ecac6bf41c3aa8c7fe2a539d0fb, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:45.509067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59a016-5710-4f71-af6a-e6b4d898a8d6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:45.531662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-74b072f6-d849-4eb0-9fbc-b1fa7aaca760 None None] MFA Rules not processed for user `563efdcc6b4140f4ab3d17c54eac5de7`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:45.533090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-74b072f6-d849-4eb0-9fbc-b1fa7aaca760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:45.533956 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1165/2291] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:45 2022] PUT /identity/v3/projects/2e6705dc7d98445fb9681d161628d3b1/users/f1324ecac6bf41c3aa8c7fe2a539d0fb/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:45.535200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59a016-5710-4f71-af6a-e6b4d898a8d6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:45.537217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ab59a016-5710-4f71-af6a-e6b4d898a8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:45.610472 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:45.654744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59a016-5710-4f71-af6a-e6b4d898a8d6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:45.661286 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1127/2292] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:45 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:45.663496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c6e18-d5d3-4759-8bf5-6e6a7a61c56c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:45.663923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c6e18-d5d3-4759-8bf5-6e6a7a61c56c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:45.664243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c6e18-d5d3-4759-8bf5-6e6a7a61c56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:45.676144 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:45.677434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1005b9d-e62e-47fe-aff4-e672c1b4c621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:45.678413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1005b9d-e62e-47fe-aff4-e672c1b4c621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:45.678884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1005b9d-e62e-47fe-aff4-e672c1b4c621 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:45.679851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1005b9d-e62e-47fe-aff4-e672c1b4c621 admin admin] PATH_INFO: `/v3/users/cfc2212810b24c4386618a42ef612840` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:45.681386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1005b9d-e62e-47fe-aff4-e672c1b4c621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfc2212810b24c4386618a42ef612840)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:45.686863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1005b9d-e62e-47fe-aff4-e672c1b4c621 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:45.746463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2e6c6e18-d5d3-4759-8bf5-6e6a7a61c56c None None] MFA Rules not processed for user `f1324ecac6bf41c3aa8c7fe2a539d0fb`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:45.749773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2e6c6e18-d5d3-4759-8bf5-6e6a7a61c56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:45.821207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1005b9d-e62e-47fe-aff4-e672c1b4c621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfc2212810b24c4386618a42ef612840'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:45.822424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1005b9d-e62e-47fe-aff4-e672c1b4c621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfc2212810b24c4386618a42ef612840'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:45.846657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1005b9d-e62e-47fe-aff4-e672c1b4c621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfc2212810b24c4386618a42ef612840'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:45.879107 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1128/2293] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:45 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:45.880275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c6e18-d5d3-4759-8bf5-6e6a7a61c56c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:45.884585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2e6c6e18-d5d3-4759-8bf5-6e6a7a61c56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:45.885796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1005b9d-e62e-47fe-aff4-e672c1b4c621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfc2212810b24c4386618a42ef612840'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:45.901699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1005b9d-e62e-47fe-aff4-e672c1b4c621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfc2212810b24c4386618a42ef612840'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:45.909100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c6e18-d5d3-4759-8bf5-6e6a7a61c56c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:45.922268 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1166/2294] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:45 2022] DELETE /identity/v3/users/cfc2212810b24c4386618a42ef612840 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:45.922675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1005b9d-e62e-47fe-aff4-e672c1b4c621 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:45.924055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d1005b9d-e62e-47fe-aff4-e672c1b4c621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:45.949173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398ae23-2da7-4330-91fb-bd553a838bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:45.950246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398ae23-2da7-4330-91fb-bd553a838bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:45.950748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398ae23-2da7-4330-91fb-bd553a838bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:45.951400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398ae23-2da7-4330-91fb-bd553a838bcf admin admin] PATH_INFO: `/v3/projects/2de5cac6900445c49cf9aa74f285462e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:45.953012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398ae23-2da7-4330-91fb-bd553a838bcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2de5cac6900445c49cf9aa74f285462e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:45.958374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398ae23-2da7-4330-91fb-bd553a838bcf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:46.057849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5398ae23-2da7-4330-91fb-bd553a838bcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2de5cac6900445c49cf9aa74f285462e', 'request_id': 'req-5398ae23-2da7-4330-91fb-bd553a838bcf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:46.072416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5398ae23-2da7-4330-91fb-bd553a838bcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2de5cac6900445c49cf9aa74f285462e', 'request_id': 'req-5398ae23-2da7-4330-91fb-bd553a838bcf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:46.085963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5398ae23-2da7-4330-91fb-bd553a838bcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2de5cac6900445c49cf9aa74f285462e', 'request_id': 'req-5398ae23-2da7-4330-91fb-bd553a838bcf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:46.087479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1005b9d-e62e-47fe-aff4-e672c1b4c621 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:46.117639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5398ae23-2da7-4330-91fb-bd553a838bcf admin admin] The token cache is being invalidate because project 2de5cac6900445c49cf9aa74f285462e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:46.117639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5398ae23-2da7-4330-91fb-bd553a838bcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:46.118421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5398ae23-2da7-4330-91fb-bd553a838bcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:46.124248 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1129/2295] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:45 2022] DELETE /identity/v3/projects/2de5cac6900445c49cf9aa74f285462e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:46.126271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398ae23-2da7-4330-91fb-bd553a838bcf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:46.140536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5398ae23-2da7-4330-91fb-bd553a838bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:46.190462 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:46.227344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a225b5-905e-4388-863e-06d8edb53fd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:46.229102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a225b5-905e-4388-863e-06d8edb53fd8 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:46.229949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a225b5-905e-4388-863e-06d8edb53fd8 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:46.230114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a225b5-905e-4388-863e-06d8edb53fd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:46.240921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-59a225b5-905e-4388-863e-06d8edb53fd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:46.359370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398ae23-2da7-4330-91fb-bd553a838bcf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:46.380935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972335a-8ade-40a9-991a-5ce79967d2e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:46.381566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972335a-8ade-40a9-991a-5ce79967d2e6 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:46.381706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a225b5-905e-4388-863e-06d8edb53fd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:46.382245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972335a-8ade-40a9-991a-5ce79967d2e6 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:46.382245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972335a-8ade-40a9-991a-5ce79967d2e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:46.383918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a225b5-905e-4388-863e-06d8edb53fd8 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:46.384730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e972335a-8ade-40a9-991a-5ce79967d2e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:46.397848 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:46.399681 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1167/2296] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:45 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:46.400619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a225b5-905e-4388-863e-06d8edb53fd8 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:46.403458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-59a225b5-905e-4388-863e-06d8edb53fd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:46.549835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a225b5-905e-4388-863e-06d8edb53fd8 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:46.562360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55652c3-e248-43fa-b9aa-d64a1f47bc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:46.563645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55652c3-e248-43fa-b9aa-d64a1f47bc7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:46.563927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55652c3-e248-43fa-b9aa-d64a1f47bc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:46.564540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55652c3-e248-43fa-b9aa-d64a1f47bc7a admin admin] PATH_INFO: `/v3/users/e299d69478504afaaa010e7497d3d333` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:46.571970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55652c3-e248-43fa-b9aa-d64a1f47bc7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e299d69478504afaaa010e7497d3d333)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:46.576056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972335a-8ade-40a9-991a-5ce79967d2e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:46.579493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55652c3-e248-43fa-b9aa-d64a1f47bc7a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:46.582918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972335a-8ade-40a9-991a-5ce79967d2e6 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:46.625534 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1130/2297] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:46 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:46.627951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972335a-8ade-40a9-991a-5ce79967d2e6 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:46.632501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e972335a-8ade-40a9-991a-5ce79967d2e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:46.673035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972335a-8ade-40a9-991a-5ce79967d2e6 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:46.687779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e809b-c601-48fb-9881-8aad9c1a9b05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:46.688386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e809b-c601-48fb-9881-8aad9c1a9b05 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:46.688693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e809b-c601-48fb-9881-8aad9c1a9b05 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:46.688960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e809b-c601-48fb-9881-8aad9c1a9b05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:46.701266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-040e809b-c601-48fb-9881-8aad9c1a9b05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:46.729036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c55652c3-e248-43fa-b9aa-d64a1f47bc7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e299d69478504afaaa010e7497d3d333'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:46.730026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c55652c3-e248-43fa-b9aa-d64a1f47bc7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e299d69478504afaaa010e7497d3d333'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:46.740755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c55652c3-e248-43fa-b9aa-d64a1f47bc7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e299d69478504afaaa010e7497d3d333'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:46.785991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c55652c3-e248-43fa-b9aa-d64a1f47bc7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e299d69478504afaaa010e7497d3d333'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:46.806860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c55652c3-e248-43fa-b9aa-d64a1f47bc7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e299d69478504afaaa010e7497d3d333'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:46.818862 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1168/2298] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:46 2022] DELETE /identity/v3/users/e299d69478504afaaa010e7497d3d333 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:46.820662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55652c3-e248-43fa-b9aa-d64a1f47bc7a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:46.823261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c55652c3-e248-43fa-b9aa-d64a1f47bc7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:46.831649 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:46.884248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e809b-c601-48fb-9881-8aad9c1a9b05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:46.886636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e809b-c601-48fb-9881-8aad9c1a9b05 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:46.908465 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1131/2299] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:46 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:47.026116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55652c3-e248-43fa-b9aa-d64a1f47bc7a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:47.046279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca51636-f43b-4be1-b9b7-b40f31f556e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:47.046279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca51636-f43b-4be1-b9b7-b40f31f556e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:47.047207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca51636-f43b-4be1-b9b7-b40f31f556e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:47.047840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca51636-f43b-4be1-b9b7-b40f31f556e9 admin admin] PATH_INFO: `/v3/users/062ae27bd8a7463fa7a0b869b6ab0c3f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:47.050690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca51636-f43b-4be1-b9b7-b40f31f556e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=062ae27bd8a7463fa7a0b869b6ab0c3f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:47.056640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca51636-f43b-4be1-b9b7-b40f31f556e9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:47.180781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ca51636-f43b-4be1-b9b7-b40f31f556e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '062ae27bd8a7463fa7a0b869b6ab0c3f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:47.182220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ca51636-f43b-4be1-b9b7-b40f31f556e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '062ae27bd8a7463fa7a0b869b6ab0c3f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:47.197392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ca51636-f43b-4be1-b9b7-b40f31f556e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '062ae27bd8a7463fa7a0b869b6ab0c3f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:47.220715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ca51636-f43b-4be1-b9b7-b40f31f556e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '062ae27bd8a7463fa7a0b869b6ab0c3f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:47.242381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ca51636-f43b-4be1-b9b7-b40f31f556e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '062ae27bd8a7463fa7a0b869b6ab0c3f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:47.260551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e809b-c601-48fb-9881-8aad9c1a9b05 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:47.261288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-040e809b-c601-48fb-9881-8aad9c1a9b05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:47.266250 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1169/2300] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:46 2022] DELETE /identity/v3/users/062ae27bd8a7463fa7a0b869b6ab0c3f => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:47.272403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3b25d-9209-4e90-961e-471cb2735a05 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:47.272743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3b25d-9209-4e90-961e-471cb2735a05 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:47.273040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3b25d-9209-4e90-961e-471cb2735a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:47.290835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e809b-c601-48fb-9881-8aad9c1a9b05 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:47.342849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f5f3b25d-9209-4e90-961e-471cb2735a05 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:47.344211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f5f3b25d-9209-4e90-961e-471cb2735a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:47.463755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277c717-d9f3-4bb8-b266-50ea52aec6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:47.465896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277c717-d9f3-4bb8-b266-50ea52aec6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:47.467026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277c717-d9f3-4bb8-b266-50ea52aec6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:47.467333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277c717-d9f3-4bb8-b266-50ea52aec6ba admin admin] PATH_INFO: `/v3/users/4510be741ffd4331bfd9a636e48d57fd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:47.470218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277c717-d9f3-4bb8-b266-50ea52aec6ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=4510be741ffd4331bfd9a636e48d57fd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:47.474329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277c717-d9f3-4bb8-b266-50ea52aec6ba admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:47.524175 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1170/2301] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:47.653577 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:47.674416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3b25d-9209-4e90-961e-471cb2735a05 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:47.677753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f5f3b25d-9209-4e90-961e-471cb2735a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:47.685771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8277c717-d9f3-4bb8-b266-50ea52aec6ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4510be741ffd4331bfd9a636e48d57fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:47.704206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8277c717-d9f3-4bb8-b266-50ea52aec6ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4510be741ffd4331bfd9a636e48d57fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:47.706254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8277c717-d9f3-4bb8-b266-50ea52aec6ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4510be741ffd4331bfd9a636e48d57fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:47.741597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8277c717-d9f3-4bb8-b266-50ea52aec6ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4510be741ffd4331bfd9a636e48d57fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:47.755474 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:47.762177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8277c717-d9f3-4bb8-b266-50ea52aec6ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4510be741ffd4331bfd9a636e48d57fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:47.778036 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1132/2302] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:47 2022] DELETE /identity/v3/users/4510be741ffd4331bfd9a636e48d57fd => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:47.782874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dfe22-0651-414f-82d8-89e9de8ddd19 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:47.782874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dfe22-0651-414f-82d8-89e9de8ddd19 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:47.783140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dfe22-0651-414f-82d8-89e9de8ddd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:47.815826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3b25d-9209-4e90-961e-471cb2735a05 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:47.821290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1d3dfe22-0651-414f-82d8-89e9de8ddd19 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:47.822576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1d3dfe22-0651-414f-82d8-89e9de8ddd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:47.938081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934495bc-1b9e-41ce-88be-7378cf3e834c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:47.939014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934495bc-1b9e-41ce-88be-7378cf3e834c service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:47.939509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934495bc-1b9e-41ce-88be-7378cf3e834c service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:47.939976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934495bc-1b9e-41ce-88be-7378cf3e834c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:47.946425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-934495bc-1b9e-41ce-88be-7378cf3e834c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:47.966284 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1133/2303] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:43:47.981015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934495bc-1b9e-41ce-88be-7378cf3e834c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:47.982730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934495bc-1b9e-41ce-88be-7378cf3e834c service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:48.007018 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1171/2304] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:43:48.059286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dfe22-0651-414f-82d8-89e9de8ddd19 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:48.061717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1d3dfe22-0651-414f-82d8-89e9de8ddd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:48.084298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dfe22-0651-414f-82d8-89e9de8ddd19 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:48.103472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fd6a7-453f-451b-8a67-20186a2849c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:48.103472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fd6a7-453f-451b-8a67-20186a2849c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:48.103788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fd6a7-453f-451b-8a67-20186a2849c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:48.103872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fd6a7-453f-451b-8a67-20186a2849c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:48.131374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fd6a7-453f-451b-8a67-20186a2849c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:48.135832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fd6a7-453f-451b-8a67-20186a2849c5 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:48.157560 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1134/2305] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:48.425489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934495bc-1b9e-41ce-88be-7378cf3e834c service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:48.427207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-934495bc-1b9e-41ce-88be-7378cf3e834c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:48.451606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934495bc-1b9e-41ce-88be-7378cf3e834c service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:48.510796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4af4f-9bb1-4cf4-9822-acbeb2fb3333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:48.511470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4af4f-9bb1-4cf4-9822-acbeb2fb3333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:48.511750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4af4f-9bb1-4cf4-9822-acbeb2fb3333 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:48.515707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4af4f-9bb1-4cf4-9822-acbeb2fb3333 admin admin] PATH_INFO: `/v3/projects/3562e60a283043e3a791bb9d86c595ab` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:48.517413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4af4f-9bb1-4cf4-9822-acbeb2fb3333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3562e60a283043e3a791bb9d86c595ab)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:48.519389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4af4f-9bb1-4cf4-9822-acbeb2fb3333 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:48.619684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fd6a7-453f-451b-8a67-20186a2849c5 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:48.621456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3a8fd6a7-453f-451b-8a67-20186a2849c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:48.661948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fd6a7-453f-451b-8a67-20186a2849c5 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:48.703543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c4b4af4f-9bb1-4cf4-9822-acbeb2fb3333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3562e60a283043e3a791bb9d86c595ab', 'request_id': 'req-c4b4af4f-9bb1-4cf4-9822-acbeb2fb3333'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:48.715604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c4b4af4f-9bb1-4cf4-9822-acbeb2fb3333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3562e60a283043e3a791bb9d86c595ab', 'request_id': 'req-c4b4af4f-9bb1-4cf4-9822-acbeb2fb3333'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:48.732209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c4b4af4f-9bb1-4cf4-9822-acbeb2fb3333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3562e60a283043e3a791bb9d86c595ab', 'request_id': 'req-c4b4af4f-9bb1-4cf4-9822-acbeb2fb3333'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:48.775741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c4b4af4f-9bb1-4cf4-9822-acbeb2fb3333 admin admin] The token cache is being invalidate because project 3562e60a283043e3a791bb9d86c595ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:48.776055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c4b4af4f-9bb1-4cf4-9822-acbeb2fb3333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:48.776991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c4b4af4f-9bb1-4cf4-9822-acbeb2fb3333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:48.779997 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1172/2306] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:48 2022] DELETE /identity/v3/projects/3562e60a283043e3a791bb9d86c595ab => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:48.787575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de9cae-1af8-4fa8-9b5b-c77f65f5c66d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:48.787852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de9cae-1af8-4fa8-9b5b-c77f65f5c66d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:48.788058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de9cae-1af8-4fa8-9b5b-c77f65f5c66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:48.793882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331c42f-9213-4f92-a0cd-b969e569e329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:48.794598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331c42f-9213-4f92-a0cd-b969e569e329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:48.794882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331c42f-9213-4f92-a0cd-b969e569e329 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:48.795598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331c42f-9213-4f92-a0cd-b969e569e329 admin admin] PATH_INFO: `/v3/projects/5ee6e8cc264e414898f5e3c5045743c2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:48.796909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331c42f-9213-4f92-a0cd-b969e569e329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ee6e8cc264e414898f5e3c5045743c2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:48.800080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331c42f-9213-4f92-a0cd-b969e569e329 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:48.880001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-76de9cae-1af8-4fa8-9b5b-c77f65f5c66d None None] MFA Rules not processed for user `a21d45726c0d4c21a997ac67e2b07e00`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:48.884896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-76de9cae-1af8-4fa8-9b5b-c77f65f5c66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:48.928218 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:48.931591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f331c42f-9213-4f92-a0cd-b969e569e329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee6e8cc264e414898f5e3c5045743c2', 'request_id': 'req-f331c42f-9213-4f92-a0cd-b969e569e329'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:48.948320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f331c42f-9213-4f92-a0cd-b969e569e329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee6e8cc264e414898f5e3c5045743c2', 'request_id': 'req-f331c42f-9213-4f92-a0cd-b969e569e329'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:48.968281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f331c42f-9213-4f92-a0cd-b969e569e329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee6e8cc264e414898f5e3c5045743c2', 'request_id': 'req-f331c42f-9213-4f92-a0cd-b969e569e329'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:48.991449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f331c42f-9213-4f92-a0cd-b969e569e329 admin admin] The token cache is being invalidate because project 5ee6e8cc264e414898f5e3c5045743c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:48.991826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f331c42f-9213-4f92-a0cd-b969e569e329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:48.992574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f331c42f-9213-4f92-a0cd-b969e569e329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:48.997029 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1135/2307] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:48 2022] DELETE /identity/v3/projects/5ee6e8cc264e414898f5e3c5045743c2 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:48.998828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b60432-8249-44bd-bdfd-bce3f38828e0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:48.999758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b60432-8249-44bd-bdfd-bce3f38828e0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:49.000129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b60432-8249-44bd-bdfd-bce3f38828e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:49.057816 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:49.076443 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1173/2308] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:48 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:49.077966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de9cae-1af8-4fa8-9b5b-c77f65f5c66d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:49.080277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-76de9cae-1af8-4fa8-9b5b-c77f65f5c66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:49.087522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d6b60432-8249-44bd-bdfd-bce3f38828e0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:49.089603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d6b60432-8249-44bd-bdfd-bce3f38828e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:49.180172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de9cae-1af8-4fa8-9b5b-c77f65f5c66d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:49.199377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01924327-4652-4fd8-89bb-75d1dc89b079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:49.200171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01924327-4652-4fd8-89bb-75d1dc89b079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:49.200518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01924327-4652-4fd8-89bb-75d1dc89b079 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:49.200925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01924327-4652-4fd8-89bb-75d1dc89b079 admin admin] PATH_INFO: `/v3/projects/5ba2b77426ef44af846ef8a28e6eb375` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:49.203388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01924327-4652-4fd8-89bb-75d1dc89b079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ba2b77426ef44af846ef8a28e6eb375)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:49.205853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01924327-4652-4fd8-89bb-75d1dc89b079 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:49.267438 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1136/2309] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:49.267438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5364ce3-ca2f-4d5b-8845-5e0ed2b46b68 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:49.267673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5364ce3-ca2f-4d5b-8845-5e0ed2b46b68 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:49.267755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5364ce3-ca2f-4d5b-8845-5e0ed2b46b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:49.310196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01924327-4652-4fd8-89bb-75d1dc89b079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ba2b77426ef44af846ef8a28e6eb375', 'request_id': 'req-01924327-4652-4fd8-89bb-75d1dc89b079'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:49.332506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c5364ce3-ca2f-4d5b-8845-5e0ed2b46b68 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:49.341449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c5364ce3-ca2f-4d5b-8845-5e0ed2b46b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:49.359686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01924327-4652-4fd8-89bb-75d1dc89b079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ba2b77426ef44af846ef8a28e6eb375', 'request_id': 'req-01924327-4652-4fd8-89bb-75d1dc89b079'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:49.385762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01924327-4652-4fd8-89bb-75d1dc89b079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ba2b77426ef44af846ef8a28e6eb375', 'request_id': 'req-01924327-4652-4fd8-89bb-75d1dc89b079'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:49.435935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01924327-4652-4fd8-89bb-75d1dc89b079 admin admin] The token cache is being invalidate because project 5ba2b77426ef44af846ef8a28e6eb375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:49.436294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01924327-4652-4fd8-89bb-75d1dc89b079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:49.436931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01924327-4652-4fd8-89bb-75d1dc89b079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:49.441764 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1174/2310] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:49 2022] DELETE /identity/v3/projects/5ba2b77426ef44af846ef8a28e6eb375 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:49.441764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ac462-6452-4716-b351-d25587e0ff2c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:49.441764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ac462-6452-4716-b351-d25587e0ff2c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:49.441764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ac462-6452-4716-b351-d25587e0ff2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:49.469513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3c0ac462-6452-4716-b351-d25587e0ff2c None None] MFA Rules not processed for user `a21d45726c0d4c21a997ac67e2b07e00`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:49.470784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3c0ac462-6452-4716-b351-d25587e0ff2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:49.572160 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1137/2311] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:49.591053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfe7bc-f179-41d6-a37a-8f43f403e33b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:49.591423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfe7bc-f179-41d6-a37a-8f43f403e33b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:49.591698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfe7bc-f179-41d6-a37a-8f43f403e33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:49.650251 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1175/2312] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:49 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:49.651400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ac462-6452-4716-b351-d25587e0ff2c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:49.655327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3c0ac462-6452-4716-b351-d25587e0ff2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:49.663966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d7cfe7bc-f179-41d6-a37a-8f43f403e33b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:49.663966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d7cfe7bc-f179-41d6-a37a-8f43f403e33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:49.692779 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1138/2313] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:49.696623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c034e-a8be-4d79-96c2-5b2d375bc759 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:49.696966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c034e-a8be-4d79-96c2-5b2d375bc759 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:49.697244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c034e-a8be-4d79-96c2-5b2d375bc759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:49.735665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ac462-6452-4716-b351-d25587e0ff2c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:49.744710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9d52e-fc83-4538-a125-533f19e71ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:49.745762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9d52e-fc83-4538-a125-533f19e71ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:49.746245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9d52e-fc83-4538-a125-533f19e71ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:49.747031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9d52e-fc83-4538-a125-533f19e71ad7 admin admin] PATH_INFO: `/v3/users/f1324ecac6bf41c3aa8c7fe2a539d0fb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:49.748471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9d52e-fc83-4538-a125-533f19e71ad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1324ecac6bf41c3aa8c7fe2a539d0fb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:49.751472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9d52e-fc83-4538-a125-533f19e71ad7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:49.752013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4f9c034e-a8be-4d79-96c2-5b2d375bc759 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:49.759555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4f9c034e-a8be-4d79-96c2-5b2d375bc759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:49.781329 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1139/2314] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:49.782209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c034e-a8be-4d79-96c2-5b2d375bc759 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:49.786138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4f9c034e-a8be-4d79-96c2-5b2d375bc759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:49.806647 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:49.866793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c5a9d52e-fc83-4538-a125-533f19e71ad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1324ecac6bf41c3aa8c7fe2a539d0fb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:49.868449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c5a9d52e-fc83-4538-a125-533f19e71ad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1324ecac6bf41c3aa8c7fe2a539d0fb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:49.884876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c5a9d52e-fc83-4538-a125-533f19e71ad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1324ecac6bf41c3aa8c7fe2a539d0fb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:49.903261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c5a9d52e-fc83-4538-a125-533f19e71ad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1324ecac6bf41c3aa8c7fe2a539d0fb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:49.942115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c5a9d52e-fc83-4538-a125-533f19e71ad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1324ecac6bf41c3aa8c7fe2a539d0fb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:49.953731 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1176/2315] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:49 2022] DELETE /identity/v3/users/f1324ecac6bf41c3aa8c7fe2a539d0fb => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:49.955827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9d52e-fc83-4538-a125-533f19e71ad7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:49.963971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c5a9d52e-fc83-4538-a125-533f19e71ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:49.998745 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:50.017063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c034e-a8be-4d79-96c2-5b2d375bc759 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:50.178592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9813fb-b2ee-4688-9197-1e10636f5281 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:50.181971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9813fb-b2ee-4688-9197-1e10636f5281 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:50.182276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9813fb-b2ee-4688-9197-1e10636f5281 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:50.182658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9813fb-b2ee-4688-9197-1e10636f5281 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:50.186700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8e9813fb-b2ee-4688-9197-1e10636f5281 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:50.365021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9813fb-b2ee-4688-9197-1e10636f5281 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:50.368179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9813fb-b2ee-4688-9197-1e10636f5281 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:50.381448 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1140/2316] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:49 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:50.384059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9813fb-b2ee-4688-9197-1e10636f5281 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:50.384967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8e9813fb-b2ee-4688-9197-1e10636f5281 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:50.451319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9d52e-fc83-4538-a125-533f19e71ad7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:50.456510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2234e1-d089-4fa0-baab-4ade591fc44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:50.457279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2234e1-d089-4fa0-baab-4ade591fc44c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:50.457652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2234e1-d089-4fa0-baab-4ade591fc44c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:50.458017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2234e1-d089-4fa0-baab-4ade591fc44c admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:50.458766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2234e1-d089-4fa0-baab-4ade591fc44c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:50.459165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2234e1-d089-4fa0-baab-4ade591fc44c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:50.460943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2234e1-d089-4fa0-baab-4ade591fc44c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:50.478202 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1177/2317] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 524 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:50.479233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2234e1-d089-4fa0-baab-4ade591fc44c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:50.487284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fc2234e1-d089-4fa0-baab-4ade591fc44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:50.511640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9813fb-b2ee-4688-9197-1e10636f5281 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:50.516646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a212a-fee2-4454-8208-b6c133650865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:50.517266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a212a-fee2-4454-8208-b6c133650865 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:50.517691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a212a-fee2-4454-8208-b6c133650865 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:50.517968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a212a-fee2-4454-8208-b6c133650865 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:50.518631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a212a-fee2-4454-8208-b6c133650865 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:50.518932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a212a-fee2-4454-8208-b6c133650865 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:50.520528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a212a-fee2-4454-8208-b6c133650865 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:50.535718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2234e1-d089-4fa0-baab-4ade591fc44c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:50.535943 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1141/2318] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:50.536693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a212a-fee2-4454-8208-b6c133650865 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:50.545641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363726a8-a504-4d9f-a06a-ec493a38eb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:50.546443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363726a8-a504-4d9f-a06a-ec493a38eb8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:50.546815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363726a8-a504-4d9f-a06a-ec493a38eb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:50.547178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363726a8-a504-4d9f-a06a-ec493a38eb8a admin admin] PATH_INFO: `/v3/projects/bc139700866a45a4bd2d79e15ce37862` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:50.548559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363726a8-a504-4d9f-a06a-ec493a38eb8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc139700866a45a4bd2d79e15ce37862)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:50.550739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363726a8-a504-4d9f-a06a-ec493a38eb8a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:50.551421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a212a-fee2-4454-8208-b6c133650865 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:50.558473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fd365-96d6-443a-9739-74bb2a345a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:50.559105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fd365-96d6-443a-9739-74bb2a345a3f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:50.559383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fd365-96d6-443a-9739-74bb2a345a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:50.559657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fd365-96d6-443a-9739-74bb2a345a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:50.560302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fd365-96d6-443a-9739-74bb2a345a3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:50.562293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fd365-96d6-443a-9739-74bb2a345a3f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:50.615750 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1142/2319] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:50 2022] POST /identity/v3/projects => generated 391 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:50.615750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fd365-96d6-443a-9739-74bb2a345a3f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:50.633827 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:50.653869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-363726a8-a504-4d9f-a06a-ec493a38eb8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc139700866a45a4bd2d79e15ce37862', 'request_id': 'req-363726a8-a504-4d9f-a06a-ec493a38eb8a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:50.667912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-363726a8-a504-4d9f-a06a-ec493a38eb8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc139700866a45a4bd2d79e15ce37862', 'request_id': 'req-363726a8-a504-4d9f-a06a-ec493a38eb8a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:50.681658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-363726a8-a504-4d9f-a06a-ec493a38eb8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc139700866a45a4bd2d79e15ce37862', 'request_id': 'req-363726a8-a504-4d9f-a06a-ec493a38eb8a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:50.706073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-363726a8-a504-4d9f-a06a-ec493a38eb8a admin admin] The token cache is being invalidate because project bc139700866a45a4bd2d79e15ce37862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:50.706510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-363726a8-a504-4d9f-a06a-ec493a38eb8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:50.709475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-363726a8-a504-4d9f-a06a-ec493a38eb8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:50.713148 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1178/2320] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:50 2022] DELETE /identity/v3/projects/bc139700866a45a4bd2d79e15ce37862 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:50.714263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363726a8-a504-4d9f-a06a-ec493a38eb8a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:50.717667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-363726a8-a504-4d9f-a06a-ec493a38eb8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:50.721177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fd365-96d6-443a-9739-74bb2a345a3f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:50.787744 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:50.860175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8a47d-3271-45c5-aea7-5e068831549b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:50.860819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8a47d-3271-45c5-aea7-5e068831549b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:50.861097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8a47d-3271-45c5-aea7-5e068831549b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:50.861367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8a47d-3271-45c5-aea7-5e068831549b admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:50.864712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8a47d-3271-45c5-aea7-5e068831549b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:50.869231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363726a8-a504-4d9f-a06a-ec493a38eb8a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:50.870752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8a47d-3271-45c5-aea7-5e068831549b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:50.879460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e8d00-494c-4a8a-84d0-1bc7bf96355a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:50.880151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e8d00-494c-4a8a-84d0-1bc7bf96355a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:50.880354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e8d00-494c-4a8a-84d0-1bc7bf96355a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:50.880637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e8d00-494c-4a8a-84d0-1bc7bf96355a admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:50.881340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e8d00-494c-4a8a-84d0-1bc7bf96355a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:50.893678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e8d00-494c-4a8a-84d0-1bc7bf96355a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:50.954586 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1143/2321] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:50 2022] POST /identity/v3/projects => generated 391 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:50.957193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8a47d-3271-45c5-aea7-5e068831549b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:50.959130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-02b8a47d-3271-45c5-aea7-5e068831549b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:50.959596 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1179/2322] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:50 2022] POST /identity/v3/users => generated 296 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:50.969750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e8d00-494c-4a8a-84d0-1bc7bf96355a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:50.972194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f86e8d00-494c-4a8a-84d0-1bc7bf96355a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:50.989995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e8d00-494c-4a8a-84d0-1bc7bf96355a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:51.068757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde3c49-c2db-43d9-895d-001bf78ad274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:51.070016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde3c49-c2db-43d9-895d-001bf78ad274 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:51.070913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde3c49-c2db-43d9-895d-001bf78ad274 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:51.071338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde3c49-c2db-43d9-895d-001bf78ad274 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:51.072315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde3c49-c2db-43d9-895d-001bf78ad274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:51.076571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde3c49-c2db-43d9-895d-001bf78ad274 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:51.102919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8a47d-3271-45c5-aea7-5e068831549b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:51.111295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50343252-72b1-4301-a274-a04cfe5000f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:51.112379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50343252-72b1-4301-a274-a04cfe5000f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:51.112735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50343252-72b1-4301-a274-a04cfe5000f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:51.113559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50343252-72b1-4301-a274-a04cfe5000f4 admin admin] PATH_INFO: `/v3/users/563efdcc6b4140f4ab3d17c54eac5de7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:51.114746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50343252-72b1-4301-a274-a04cfe5000f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=563efdcc6b4140f4ab3d17c54eac5de7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:51.116823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50343252-72b1-4301-a274-a04cfe5000f4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:51.123486 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1180/2323] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:50 2022] POST /identity/v3/users => generated 296 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:51.126226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde3c49-c2db-43d9-895d-001bf78ad274 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:51.151604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde3c49-c2db-43d9-895d-001bf78ad274 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:51.159323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f5e4f-f326-4153-825d-0816027b27fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:51.159945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f5e4f-f326-4153-825d-0816027b27fa admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:51.160278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f5e4f-f326-4153-825d-0816027b27fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:51.160549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f5e4f-f326-4153-825d-0816027b27fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:51.161284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f5e4f-f326-4153-825d-0816027b27fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:51.162958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f5e4f-f326-4153-825d-0816027b27fa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:51.179356 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1181/2324] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:51.180329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f5e4f-f326-4153-825d-0816027b27fa admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:51.194188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f5e4f-f326-4153-825d-0816027b27fa admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:51.203961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad14b9a-a1c5-4190-86c6-426e36721f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:51.205211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad14b9a-a1c5-4190-86c6-426e36721f5d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:51.206041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad14b9a-a1c5-4190-86c6-426e36721f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:51.206457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad14b9a-a1c5-4190-86c6-426e36721f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:51.207803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad14b9a-a1c5-4190-86c6-426e36721f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:51.213495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad14b9a-a1c5-4190-86c6-426e36721f5d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:51.218187 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:51.225943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50343252-72b1-4301-a274-a04cfe5000f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '563efdcc6b4140f4ab3d17c54eac5de7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:51.241419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50343252-72b1-4301-a274-a04cfe5000f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '563efdcc6b4140f4ab3d17c54eac5de7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:51.242702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50343252-72b1-4301-a274-a04cfe5000f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '563efdcc6b4140f4ab3d17c54eac5de7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:51.245835 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1182/2325] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:51.245835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad14b9a-a1c5-4190-86c6-426e36721f5d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:51.264716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50343252-72b1-4301-a274-a04cfe5000f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '563efdcc6b4140f4ab3d17c54eac5de7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:51.278136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad14b9a-a1c5-4190-86c6-426e36721f5d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:51.285377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50343252-72b1-4301-a274-a04cfe5000f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '563efdcc6b4140f4ab3d17c54eac5de7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:51.295508 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1144/2326] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:50 2022] DELETE /identity/v3/users/563efdcc6b4140f4ab3d17c54eac5de7 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:51.297359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50343252-72b1-4301-a274-a04cfe5000f4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:51.299549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b249377-4620-4fbc-9222-42f95ee6cf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:51.300181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b249377-4620-4fbc-9222-42f95ee6cf37 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:51.300487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-50343252-72b1-4301-a274-a04cfe5000f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:51.300632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b249377-4620-4fbc-9222-42f95ee6cf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:51.311422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b249377-4620-4fbc-9222-42f95ee6cf37 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:51.316214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b249377-4620-4fbc-9222-42f95ee6cf37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:51.327198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b249377-4620-4fbc-9222-42f95ee6cf37 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:51.360293 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1183/2327] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:51.366596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b249377-4620-4fbc-9222-42f95ee6cf37 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:51.369142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8b249377-4620-4fbc-9222-42f95ee6cf37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:51.386926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b249377-4620-4fbc-9222-42f95ee6cf37 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:51.457648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50343252-72b1-4301-a274-a04cfe5000f4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:51.470123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d7828-355a-4068-9192-2f10b5156d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:51.472355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d711d43-fba2-4af4-9d69-9fd9958a90d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:51.473137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d711d43-fba2-4af4-9d69-9fd9958a90d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:51.473518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d711d43-fba2-4af4-9d69-9fd9958a90d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:51.473884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d711d43-fba2-4af4-9d69-9fd9958a90d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:51.474666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d711d43-fba2-4af4-9d69-9fd9958a90d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:51.475020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d7828-355a-4068-9192-2f10b5156d80 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:51.475342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d7828-355a-4068-9192-2f10b5156d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:51.475617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d7828-355a-4068-9192-2f10b5156d80 admin admin] PATH_INFO: `/v3/projects/137e2036c9794daaa21a8842198a3ec1/users/f2e85efbee9144f6a2b42a95ee0b38cc/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:51.477472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d711d43-fba2-4af4-9d69-9fd9958a90d2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:51.490478 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:51.496816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d7828-355a-4068-9192-2f10b5156d80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=137e2036c9794daaa21a8842198a3ec1, user_id=f2e85efbee9144f6a2b42a95ee0b38cc, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:51.499834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d7828-355a-4068-9192-2f10b5156d80 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:51.505417 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1145/2328] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:51.506729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d711d43-fba2-4af4-9d69-9fd9958a90d2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:51.523587 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1184/2329] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:51 2022] PUT /identity/v3/projects/137e2036c9794daaa21a8842198a3ec1/users/f2e85efbee9144f6a2b42a95ee0b38cc/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:51.527641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d711d43-fba2-4af4-9d69-9fd9958a90d2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:51.537395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13578b-e37c-4e0e-807a-5733f9ac9110 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:51.537679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13578b-e37c-4e0e-807a-5733f9ac9110 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:51.537949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13578b-e37c-4e0e-807a-5733f9ac9110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:51.590869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6f13578b-e37c-4e0e-807a-5733f9ac9110 None None] MFA Rules not processed for user `f2e85efbee9144f6a2b42a95ee0b38cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:51.592092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6f13578b-e37c-4e0e-807a-5733f9ac9110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:51.669403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84565a43-101e-454e-80b0-b3ed8bb44e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:51.670181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84565a43-101e-454e-80b0-b3ed8bb44e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:51.670558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84565a43-101e-454e-80b0-b3ed8bb44e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:51.670928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84565a43-101e-454e-80b0-b3ed8bb44e75 admin admin] PATH_INFO: `/v3/projects/fda7b9f12da94cc4b9dd8847ff4bfbf9/users/9b6d093a37724438bb84003ff830b219/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:51.701655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84565a43-101e-454e-80b0-b3ed8bb44e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fda7b9f12da94cc4b9dd8847ff4bfbf9, user_id=9b6d093a37724438bb84003ff830b219, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:51.704622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84565a43-101e-454e-80b0-b3ed8bb44e75 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:51.735747 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1146/2330] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:51 2022] PUT /identity/v3/projects/fda7b9f12da94cc4b9dd8847ff4bfbf9/users/9b6d093a37724438bb84003ff830b219/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:51.750717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943a37b-6dae-474f-9da2-ad58bfdce261 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:51.751118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943a37b-6dae-474f-9da2-ad58bfdce261 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:51.751489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943a37b-6dae-474f-9da2-ad58bfdce261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:51.775696 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1185/2331] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:51.781977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13578b-e37c-4e0e-807a-5733f9ac9110 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:51.804853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13578b-e37c-4e0e-807a-5733f9ac9110 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:51.808469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2943a37b-6dae-474f-9da2-ad58bfdce261 None None] MFA Rules not processed for user `9b6d093a37724438bb84003ff830b219`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:51.809629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2943a37b-6dae-474f-9da2-ad58bfdce261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:51.889414 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:51.962073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5714a-f6f5-4a45-8b2b-3663c3c975d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:51.963453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5714a-f6f5-4a45-8b2b-3663c3c975d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:51.964679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5714a-f6f5-4a45-8b2b-3663c3c975d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:51.965049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5714a-f6f5-4a45-8b2b-3663c3c975d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:51.966047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5714a-f6f5-4a45-8b2b-3663c3c975d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:51.973883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5714a-f6f5-4a45-8b2b-3663c3c975d2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:52.002365 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1147/2332] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:43:52.004290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943a37b-6dae-474f-9da2-ad58bfdce261 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:52.009322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2943a37b-6dae-474f-9da2-ad58bfdce261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:52.037726 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1186/2333] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:51 2022] POST /identity/v3/projects => generated 389 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:52.041661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943a37b-6dae-474f-9da2-ad58bfdce261 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:52.042042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5714a-f6f5-4a45-8b2b-3663c3c975d2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:52.171473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5defe-2208-40cc-be38-cd2288727a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:52.172408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5defe-2208-40cc-be38-cd2288727a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:52.172827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5defe-2208-40cc-be38-cd2288727a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:52.173229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5defe-2208-40cc-be38-cd2288727a67 admin admin] PATH_INFO: `/v3/projects/2e6705dc7d98445fb9681d161628d3b1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:52.176150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5defe-2208-40cc-be38-cd2288727a67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e6705dc7d98445fb9681d161628d3b1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:52.178467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5defe-2208-40cc-be38-cd2288727a67 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:52.191830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5714a-f6f5-4a45-8b2b-3663c3c975d2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:52.198971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c74e9-2311-4325-86e9-199ec9260aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:52.199596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c74e9-2311-4325-86e9-199ec9260aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:52.200078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c74e9-2311-4325-86e9-199ec9260aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:52.200353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c74e9-2311-4325-86e9-199ec9260aa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:52.201044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c74e9-2311-4325-86e9-199ec9260aa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:52.203381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c74e9-2311-4325-86e9-199ec9260aa7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:52.217157 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:52.272327 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1187/2334] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:52 2022] POST /identity/v3/projects => generated 389 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:52.274155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c74e9-2311-4325-86e9-199ec9260aa7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:52.288016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ef5defe-2208-40cc-be38-cd2288727a67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e6705dc7d98445fb9681d161628d3b1', 'request_id': 'req-5ef5defe-2208-40cc-be38-cd2288727a67'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:52.315803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ef5defe-2208-40cc-be38-cd2288727a67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e6705dc7d98445fb9681d161628d3b1', 'request_id': 'req-5ef5defe-2208-40cc-be38-cd2288727a67'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:52.343783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ef5defe-2208-40cc-be38-cd2288727a67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e6705dc7d98445fb9681d161628d3b1', 'request_id': 'req-5ef5defe-2208-40cc-be38-cd2288727a67'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:52.369790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ef5defe-2208-40cc-be38-cd2288727a67 admin admin] The token cache is being invalidate because project 2e6705dc7d98445fb9681d161628d3b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:52.370238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ef5defe-2208-40cc-be38-cd2288727a67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:52.373655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ef5defe-2208-40cc-be38-cd2288727a67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:52.378801 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1148/2335] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:52 2022] DELETE /identity/v3/projects/2e6705dc7d98445fb9681d161628d3b1 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:52.378801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5defe-2208-40cc-be38-cd2288727a67 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:52.378801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5ef5defe-2208-40cc-be38-cd2288727a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:52.442334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c74e9-2311-4325-86e9-199ec9260aa7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:52.459079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a5dd8-fb34-4c21-a135-f5a21ab189b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:52.461058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a5dd8-fb34-4c21-a135-f5a21ab189b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:52.461488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a5dd8-fb34-4c21-a135-f5a21ab189b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:52.461891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a5dd8-fb34-4c21-a135-f5a21ab189b2 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:52.462931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a5dd8-fb34-4c21-a135-f5a21ab189b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:52.466123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a5dd8-fb34-4c21-a135-f5a21ab189b2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:52.515907 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1188/2336] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:52 2022] POST /identity/v3/users => generated 301 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:52.520251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b96d6-56be-4d0d-b23e-3b6b38a6489c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:52.520784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b96d6-56be-4d0d-b23e-3b6b38a6489c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:52.522440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b96d6-56be-4d0d-b23e-3b6b38a6489c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:52.523918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5defe-2208-40cc-be38-cd2288727a67 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:52.544459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa13e8-0789-4380-b345-4bc183fb9c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:52.545122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa13e8-0789-4380-b345-4bc183fb9c66 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:52.545397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa13e8-0789-4380-b345-4bc183fb9c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:52.545661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa13e8-0789-4380-b345-4bc183fb9c66 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:52.546302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa13e8-0789-4380-b345-4bc183fb9c66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:52.548290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa13e8-0789-4380-b345-4bc183fb9c66 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:52.560140 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:52.583065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0d8b96d6-56be-4d0d-b23e-3b6b38a6489c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:52.583266 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1149/2337] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:52 2022] POST /identity/v3/users => generated 301 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:52.584075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa13e8-0789-4380-b345-4bc183fb9c66 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:52.588633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0d8b96d6-56be-4d0d-b23e-3b6b38a6489c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:52.589052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8faa13e8-0789-4380-b345-4bc183fb9c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:52.614390 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1189/2338] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:52.615507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b96d6-56be-4d0d-b23e-3b6b38a6489c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:52.619057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa13e8-0789-4380-b345-4bc183fb9c66 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:52.633121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad461e95-dbc8-4092-8b4d-02636bc2a275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:52.633953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad461e95-dbc8-4092-8b4d-02636bc2a275 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:52.634362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad461e95-dbc8-4092-8b4d-02636bc2a275 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:52.634861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad461e95-dbc8-4092-8b4d-02636bc2a275 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:52.635879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad461e95-dbc8-4092-8b4d-02636bc2a275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:52.637776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad461e95-dbc8-4092-8b4d-02636bc2a275 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:52.654677 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1150/2339] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:52.654677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6721b-5630-4ff2-96ee-831f0bac43d3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:52.654677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6721b-5630-4ff2-96ee-831f0bac43d3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:52.654677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6721b-5630-4ff2-96ee-831f0bac43d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:52.657350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b96d6-56be-4d0d-b23e-3b6b38a6489c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:52.665716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f287cf-a7a4-4fea-9341-2f986e913a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:52.666748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f287cf-a7a4-4fea-9341-2f986e913a1d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:52.667345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f287cf-a7a4-4fea-9341-2f986e913a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:52.667792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f287cf-a7a4-4fea-9341-2f986e913a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:52.671388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f287cf-a7a4-4fea-9341-2f986e913a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:52.673631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f287cf-a7a4-4fea-9341-2f986e913a1d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:52.678647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8da6721b-5630-4ff2-96ee-831f0bac43d3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:52.680699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8da6721b-5630-4ff2-96ee-831f0bac43d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:52.700718 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1151/2340] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:52.702574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6721b-5630-4ff2-96ee-831f0bac43d3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:52.720320 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1190/2341] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:52.721109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f287cf-a7a4-4fea-9341-2f986e913a1d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:52.723951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6721b-5630-4ff2-96ee-831f0bac43d3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:52.728653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d1f287cf-a7a4-4fea-9341-2f986e913a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:52.732464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951826bb-2c96-421e-97d8-c6e485c6497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:52.735459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951826bb-2c96-421e-97d8-c6e485c6497d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:52.737633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951826bb-2c96-421e-97d8-c6e485c6497d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:52.740457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951826bb-2c96-421e-97d8-c6e485c6497d admin admin] PATH_INFO: `/v3/projects/165fe1567f0d4e1d9815c5a9930a8475/users/b7e56bda97e144d9ab762e1a07a52915/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:52.764971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f287cf-a7a4-4fea-9341-2f986e913a1d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:52.778946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d0a9e-d429-492b-8d12-5dc49315af86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:52.781836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d0a9e-d429-492b-8d12-5dc49315af86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:52.782443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d0a9e-d429-492b-8d12-5dc49315af86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:52.782775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d0a9e-d429-492b-8d12-5dc49315af86 admin admin] PATH_INFO: `/v3/projects/65080798f4f1490184bd586dfad51590` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:52.784187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951826bb-2c96-421e-97d8-c6e485c6497d admin admin] RBAC: Authorizing `identity:create_grant(project_id=165fe1567f0d4e1d9815c5a9930a8475, user_id=b7e56bda97e144d9ab762e1a07a52915, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:52.786895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d0a9e-d429-492b-8d12-5dc49315af86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65080798f4f1490184bd586dfad51590)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:52.791271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d0a9e-d429-492b-8d12-5dc49315af86 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:52.792579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951826bb-2c96-421e-97d8-c6e485c6497d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:52.827358 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1152/2342] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:52 2022] PUT /identity/v3/projects/165fe1567f0d4e1d9815c5a9930a8475/users/b7e56bda97e144d9ab762e1a07a52915/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:52.827358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951826bb-2c96-421e-97d8-c6e485c6497d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:52.965843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dc2d0a9e-d429-492b-8d12-5dc49315af86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65080798f4f1490184bd586dfad51590', 'request_id': 'req-dc2d0a9e-d429-492b-8d12-5dc49315af86'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:52.986053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dc2d0a9e-d429-492b-8d12-5dc49315af86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65080798f4f1490184bd586dfad51590', 'request_id': 'req-dc2d0a9e-d429-492b-8d12-5dc49315af86'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:52.995099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dc2d0a9e-d429-492b-8d12-5dc49315af86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65080798f4f1490184bd586dfad51590', 'request_id': 'req-dc2d0a9e-d429-492b-8d12-5dc49315af86'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:53.012496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dc2d0a9e-d429-492b-8d12-5dc49315af86 admin admin] The token cache is being invalidate because project 65080798f4f1490184bd586dfad51590 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:53.012845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dc2d0a9e-d429-492b-8d12-5dc49315af86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:53.013732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dc2d0a9e-d429-492b-8d12-5dc49315af86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:53.018774 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1191/2343] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:52 2022] DELETE /identity/v3/projects/65080798f4f1490184bd586dfad51590 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:53.018774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d0a9e-d429-492b-8d12-5dc49315af86 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:53.020684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dc2d0a9e-d429-492b-8d12-5dc49315af86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:53.026230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951826bb-2c96-421e-97d8-c6e485c6497d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:53.127699 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:53.183224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2a1f7-66b2-4b80-8433-312b8dd71213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:53.183860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2a1f7-66b2-4b80-8433-312b8dd71213 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:53.184167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2a1f7-66b2-4b80-8433-312b8dd71213 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:53.184411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2a1f7-66b2-4b80-8433-312b8dd71213 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:53.185150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2a1f7-66b2-4b80-8433-312b8dd71213 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:53.185457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2a1f7-66b2-4b80-8433-312b8dd71213 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:53.185917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d0a9e-d429-492b-8d12-5dc49315af86 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:53.187040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2a1f7-66b2-4b80-8433-312b8dd71213 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:53.198838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cef8d5-ee70-46d2-9bd8-c551352ee517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:53.199528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cef8d5-ee70-46d2-9bd8-c551352ee517 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:53.199808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cef8d5-ee70-46d2-9bd8-c551352ee517 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:53.200075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cef8d5-ee70-46d2-9bd8-c551352ee517 admin admin] PATH_INFO: `/v3/projects/f426dcd17f4a4a01bd4df248b2165f29/users/7ea606bb1e78487c83e0ccddac005ea3/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:53.240014 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1153/2344] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:53.240943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2a1f7-66b2-4b80-8433-312b8dd71213 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:53.247225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c5a2a1f7-66b2-4b80-8433-312b8dd71213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:53.248769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cef8d5-ee70-46d2-9bd8-c551352ee517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f426dcd17f4a4a01bd4df248b2165f29, user_id=7ea606bb1e78487c83e0ccddac005ea3, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:53.283849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cef8d5-ee70-46d2-9bd8-c551352ee517 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:53.302837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2a1f7-66b2-4b80-8433-312b8dd71213 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:53.314647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b815ea-b9b2-45ce-a9de-663f458f6893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:53.315369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b815ea-b9b2-45ce-a9de-663f458f6893 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:53.315654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b815ea-b9b2-45ce-a9de-663f458f6893 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:53.315928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b815ea-b9b2-45ce-a9de-663f458f6893 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:53.316582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b815ea-b9b2-45ce-a9de-663f458f6893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:53.324399 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1192/2345] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:53 2022] PUT /identity/v3/projects/f426dcd17f4a4a01bd4df248b2165f29/users/7ea606bb1e78487c83e0ccddac005ea3/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:53.326491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b815ea-b9b2-45ce-a9de-663f458f6893 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:53.329561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d696d-4230-4b4b-ad4c-78bfe29aedea None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:53.330099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d696d-4230-4b4b-ad4c-78bfe29aedea None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:53.330367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d696d-4230-4b4b-ad4c-78bfe29aedea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:53.357284 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1154/2346] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:53.358222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b815ea-b9b2-45ce-a9de-663f458f6893 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:53.364551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c9b815ea-b9b2-45ce-a9de-663f458f6893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:53.401224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b815ea-b9b2-45ce-a9de-663f458f6893 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:53.405805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-522d696d-4230-4b4b-ad4c-78bfe29aedea None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:53.407122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-522d696d-4230-4b4b-ad4c-78bfe29aedea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:53.540024 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1193/2347] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:53.541290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d696d-4230-4b4b-ad4c-78bfe29aedea None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:53.554421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d696d-4230-4b4b-ad4c-78bfe29aedea None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:53.561166 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:53.563601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac408a20-e0e3-41e1-a843-d9f1c4223b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:53.564231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac408a20-e0e3-41e1-a843-d9f1c4223b1a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:53.564503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac408a20-e0e3-41e1-a843-d9f1c4223b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:53.564824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac408a20-e0e3-41e1-a843-d9f1c4223b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:53.565453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac408a20-e0e3-41e1-a843-d9f1c4223b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:53.567046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac408a20-e0e3-41e1-a843-d9f1c4223b1a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:53.591663 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1194/2348] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:53.592705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac408a20-e0e3-41e1-a843-d9f1c4223b1a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:53.609433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac408a20-e0e3-41e1-a843-d9f1c4223b1a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:53.613969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563b128-e380-4151-88f7-962f19cbd95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:53.614716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563b128-e380-4151-88f7-962f19cbd95b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:53.614837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cd0c8-1e38-48d5-a0a6-bff40bc7488b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:53.615012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563b128-e380-4151-88f7-962f19cbd95b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:53.615739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563b128-e380-4151-88f7-962f19cbd95b admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:53.615926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563b128-e380-4151-88f7-962f19cbd95b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:53.616200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cd0c8-1e38-48d5-a0a6-bff40bc7488b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:53.616517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cd0c8-1e38-48d5-a0a6-bff40bc7488b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:53.616841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cd0c8-1e38-48d5-a0a6-bff40bc7488b admin admin] PATH_INFO: `/v3/projects/165fe1567f0d4e1d9815c5a9930a8475/users/b7e56bda97e144d9ab762e1a07a52915/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:53.618118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563b128-e380-4151-88f7-962f19cbd95b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:53.619485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cd0c8-1e38-48d5-a0a6-bff40bc7488b admin admin] RBAC: Authorizing `identity:create_grant(project_id=165fe1567f0d4e1d9815c5a9930a8475, user_id=b7e56bda97e144d9ab762e1a07a52915, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:53.624231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cd0c8-1e38-48d5-a0a6-bff40bc7488b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:53.657646 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1195/2349] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:53 2022] PUT /identity/v3/projects/165fe1567f0d4e1d9815c5a9930a8475/users/b7e56bda97e144d9ab762e1a07a52915/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:53.680628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b941bf-10bf-4423-8faf-04a958ca82a1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:53.680628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b941bf-10bf-4423-8faf-04a958ca82a1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:53.680628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b941bf-10bf-4423-8faf-04a958ca82a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:53.688288 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1155/2350] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:53 2022] POST /identity/v3/projects => generated 371 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:53.690479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563b128-e380-4151-88f7-962f19cbd95b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:53.724039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-84b941bf-10bf-4423-8faf-04a958ca82a1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:53.729277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-84b941bf-10bf-4423-8faf-04a958ca82a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:53.847699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563b128-e380-4151-88f7-962f19cbd95b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:53.855112 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1196/2351] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:53.857415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa245de-2fff-4d83-9f98-4ccd34207c66 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:53.857882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa245de-2fff-4d83-9f98-4ccd34207c66 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:53.858700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa245de-2fff-4d83-9f98-4ccd34207c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:53.863392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041f2ee-50ea-48be-8633-ba609b220554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:53.864075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041f2ee-50ea-48be-8633-ba609b220554 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:53.864494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041f2ee-50ea-48be-8633-ba609b220554 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:53.864795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041f2ee-50ea-48be-8633-ba609b220554 admin admin] PATH_INFO: `/v3/projects/f426dcd17f4a4a01bd4df248b2165f29/users/7ea606bb1e78487c83e0ccddac005ea3/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:53.870058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041f2ee-50ea-48be-8633-ba609b220554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f426dcd17f4a4a01bd4df248b2165f29, user_id=7ea606bb1e78487c83e0ccddac005ea3, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:53.874959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041f2ee-50ea-48be-8633-ba609b220554 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:53.896911 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1156/2352] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:53 2022] PUT /identity/v3/projects/f426dcd17f4a4a01bd4df248b2165f29/users/7ea606bb1e78487c83e0ccddac005ea3/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:53.897753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5fa245de-2fff-4d83-9f98-4ccd34207c66 None None] MFA Rules not processed for user `b7e56bda97e144d9ab762e1a07a52915`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:53.899071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5fa245de-2fff-4d83-9f98-4ccd34207c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:53.907455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041f2ee-50ea-48be-8633-ba609b220554 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:53.977123 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:54.011893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041f2ee-50ea-48be-8633-ba609b220554 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:54.027473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a6857-490b-410f-9ae7-1fc17ef77f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:54.028267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a6857-490b-410f-9ae7-1fc17ef77f74 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:54.028670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a6857-490b-410f-9ae7-1fc17ef77f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:54.029048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a6857-490b-410f-9ae7-1fc17ef77f74 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:54.029939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a6857-490b-410f-9ae7-1fc17ef77f74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:54.032927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a6857-490b-410f-9ae7-1fc17ef77f74 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:54.053629 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1197/2353] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:53 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:54.054237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa245de-2fff-4d83-9f98-4ccd34207c66 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:54.065501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa245de-2fff-4d83-9f98-4ccd34207c66 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:54.071091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df3fcd-1368-4197-83cf-2caf400430db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:54.071917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df3fcd-1368-4197-83cf-2caf400430db admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:54.072240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df3fcd-1368-4197-83cf-2caf400430db admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:54.072437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df3fcd-1368-4197-83cf-2caf400430db admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:54.073135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df3fcd-1368-4197-83cf-2caf400430db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:54.073435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df3fcd-1368-4197-83cf-2caf400430db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:54.075327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df3fcd-1368-4197-83cf-2caf400430db admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:54.084584 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1157/2354] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:53 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:54.084584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c68978-ca3f-4a6c-9611-5576d8d50286 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:54.084584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c68978-ca3f-4a6c-9611-5576d8d50286 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:54.084584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c68978-ca3f-4a6c-9611-5576d8d50286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:54.098658 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1198/2355] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:54.099882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df3fcd-1368-4197-83cf-2caf400430db admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:54.119169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-55df3fcd-1368-4197-83cf-2caf400430db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:54.131130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-48c68978-ca3f-4a6c-9611-5576d8d50286 None None] MFA Rules not processed for user `7ea606bb1e78487c83e0ccddac005ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:54.132710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-48c68978-ca3f-4a6c-9611-5576d8d50286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:54.270298 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:54.367370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df3fcd-1368-4197-83cf-2caf400430db admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:54.370847 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1158/2356] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:54 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:54.371871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c68978-ca3f-4a6c-9611-5576d8d50286 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:54.384229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcee63-0656-468e-a3bf-45a08d67975c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:54.384873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcee63-0656-468e-a3bf-45a08d67975c service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:54.385576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcee63-0656-468e-a3bf-45a08d67975c service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:54.385848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcee63-0656-468e-a3bf-45a08d67975c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:54.389571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c68978-ca3f-4a6c-9611-5576d8d50286 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:54.394386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d918231-2d63-4811-b210-6b93423c4944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:54.395153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d918231-2d63-4811-b210-6b93423c4944 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:54.395540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d918231-2d63-4811-b210-6b93423c4944 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:54.395917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d918231-2d63-4811-b210-6b93423c4944 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:54.397297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d918231-2d63-4811-b210-6b93423c4944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:54.399153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d918231-2d63-4811-b210-6b93423c4944 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:54.409480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dcee63-0656-468e-a3bf-45a08d67975c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:54.411062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dcee63-0656-468e-a3bf-45a08d67975c service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:54.430523 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1159/2357] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:54.432038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d918231-2d63-4811-b210-6b93423c4944 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:54.447010 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1199/2358] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:54 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:54.448262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcee63-0656-468e-a3bf-45a08d67975c service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:54.457507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-83dcee63-0656-468e-a3bf-45a08d67975c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:54.481136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d918231-2d63-4811-b210-6b93423c4944 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:54.499953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcee63-0656-468e-a3bf-45a08d67975c service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:54.504772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61be84-c2aa-4239-a6f1-a64eb162137a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:54.505526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61be84-c2aa-4239-a6f1-a64eb162137a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:54.509786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61be84-c2aa-4239-a6f1-a64eb162137a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:54.512618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61be84-c2aa-4239-a6f1-a64eb162137a admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:54.513763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61be84-c2aa-4239-a6f1-a64eb162137a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:54.515677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61be84-c2aa-4239-a6f1-a64eb162137a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:54.528463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16966b8-f3b2-4ebc-b741-8cd5519db555 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:54.529124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16966b8-f3b2-4ebc-b741-8cd5519db555 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:54.529402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16966b8-f3b2-4ebc-b741-8cd5519db555 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:54.529667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16966b8-f3b2-4ebc-b741-8cd5519db555 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:54.538596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e16966b8-f3b2-4ebc-b741-8cd5519db555 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:54.622364 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1160/2359] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:54 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:54.624537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61be84-c2aa-4239-a6f1-a64eb162137a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:54.851359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16966b8-f3b2-4ebc-b741-8cd5519db555 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:54.862627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16966b8-f3b2-4ebc-b741-8cd5519db555 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:54.866648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61be84-c2aa-4239-a6f1-a64eb162137a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:54.873545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb1afe-d3d8-4f4d-a94a-19a86b544ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:54.874327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb1afe-d3d8-4f4d-a94a-19a86b544ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:54.874590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb1afe-d3d8-4f4d-a94a-19a86b544ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:54.875482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb1afe-d3d8-4f4d-a94a-19a86b544ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:54.876218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb1afe-d3d8-4f4d-a94a-19a86b544ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:54.878560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb1afe-d3d8-4f4d-a94a-19a86b544ca4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:54.901480 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1200/2360] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:54 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:54.903918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16966b8-f3b2-4ebc-b741-8cd5519db555 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:54.924290 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1161/2361] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:54.926681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb1afe-d3d8-4f4d-a94a-19a86b544ca4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:54.948250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16966b8-f3b2-4ebc-b741-8cd5519db555 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:54.957438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb1afe-d3d8-4f4d-a94a-19a86b544ca4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:54.969275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e093ea-c733-4b84-87f1-9256c5587c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:54.971066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e093ea-c733-4b84-87f1-9256c5587c83 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:54.971511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e093ea-c733-4b84-87f1-9256c5587c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:54.973148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e093ea-c733-4b84-87f1-9256c5587c83 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:54.978471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e093ea-c733-4b84-87f1-9256c5587c83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:54.979110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7c49f-409c-40da-9ed4-0666d907f90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:54.979326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7c49f-409c-40da-9ed4-0666d907f90e admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:54.979603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7c49f-409c-40da-9ed4-0666d907f90e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:54.979884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7c49f-409c-40da-9ed4-0666d907f90e admin admin] PATH_INFO: `/v3/projects/9d60b9eb66be48ebb98ba6b49e826f17/users/5ee27b6e2411469d9ef72ad8a7e6491f/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:54.988830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e093ea-c733-4b84-87f1-9256c5587c83 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:55.025789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7c49f-409c-40da-9ed4-0666d907f90e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d60b9eb66be48ebb98ba6b49e826f17, user_id=5ee27b6e2411469d9ef72ad8a7e6491f, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:55.028550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7c49f-409c-40da-9ed4-0666d907f90e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:55.041437 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1201/2362] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:54 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:55.042590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e093ea-c733-4b84-87f1-9256c5587c83 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:55.062864 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1162/2363] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:54 2022] PUT /identity/v3/projects/9d60b9eb66be48ebb98ba6b49e826f17/users/5ee27b6e2411469d9ef72ad8a7e6491f/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:55.065190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2a3a8-2e05-4090-bc3c-3e0ef67acae6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:55.065340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2a3a8-2e05-4090-bc3c-3e0ef67acae6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:55.065734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2a3a8-2e05-4090-bc3c-3e0ef67acae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:55.070414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e093ea-c733-4b84-87f1-9256c5587c83 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:55.117774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9de2a3a8-2e05-4090-bc3c-3e0ef67acae6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:55.122095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9de2a3a8-2e05-4090-bc3c-3e0ef67acae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:55.130000 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:55.230917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f031b-4e87-4e98-a6f2-d965f97d50f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:55.233292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f031b-4e87-4e98-a6f2-d965f97d50f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:55.233704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f031b-4e87-4e98-a6f2-d965f97d50f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:55.234514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f031b-4e87-4e98-a6f2-d965f97d50f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:55.236636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f031b-4e87-4e98-a6f2-d965f97d50f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:55.245229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f031b-4e87-4e98-a6f2-d965f97d50f3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:55.264701 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1163/2365] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:43:55.265079 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1202/2365] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:55.268415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2a3a8-2e05-4090-bc3c-3e0ef67acae6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:55.296686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2a3a8-2e05-4090-bc3c-3e0ef67acae6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:55.315595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1054e-806c-4c31-b6d5-5792fd590bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:55.316372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1054e-806c-4c31-b6d5-5792fd590bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:55.316672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1054e-806c-4c31-b6d5-5792fd590bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:55.316944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1054e-806c-4c31-b6d5-5792fd590bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:55.317649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1054e-806c-4c31-b6d5-5792fd590bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:55.320028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1054e-806c-4c31-b6d5-5792fd590bb2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:55.348664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f031b-4e87-4e98-a6f2-d965f97d50f3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:55.350534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-510f031b-4e87-4e98-a6f2-d965f97d50f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:55.360976 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1164/2366] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:55.364172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1054e-806c-4c31-b6d5-5792fd590bb2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:55.379847 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:55.397928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1054e-806c-4c31-b6d5-5792fd590bb2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:55.413583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727a2d8-d336-49dc-925c-5ba77b730dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:55.414622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727a2d8-d336-49dc-925c-5ba77b730dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:55.414908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727a2d8-d336-49dc-925c-5ba77b730dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:55.415195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727a2d8-d336-49dc-925c-5ba77b730dd3 admin admin] PATH_INFO: `/v3/projects/58b97ac766794428a534ddd17de8bb9c/users/0d11db60b55d4c1190c2bbc15a57a3af/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:55.484580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727a2d8-d336-49dc-925c-5ba77b730dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b97ac766794428a534ddd17de8bb9c, user_id=0d11db60b55d4c1190c2bbc15a57a3af, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:55.501094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727a2d8-d336-49dc-925c-5ba77b730dd3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:55.508010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f031b-4e87-4e98-a6f2-d965f97d50f3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:55.516963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382ece0-0e59-4efd-a62f-d396ba9639b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:55.517589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382ece0-0e59-4efd-a62f-d396ba9639b7 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:55.517859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382ece0-0e59-4efd-a62f-d396ba9639b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:55.518124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382ece0-0e59-4efd-a62f-d396ba9639b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:55.537262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382ece0-0e59-4efd-a62f-d396ba9639b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:55.539351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382ece0-0e59-4efd-a62f-d396ba9639b7 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:55.549270 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1165/2367] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:55 2022] PUT /identity/v3/projects/58b97ac766794428a534ddd17de8bb9c/users/0d11db60b55d4c1190c2bbc15a57a3af/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:55.560519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd97701-fc3e-4b77-ac4d-1440b93cf202 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:55.561077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd97701-fc3e-4b77-ac4d-1440b93cf202 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:55.562547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd97701-fc3e-4b77-ac4d-1440b93cf202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:55.563913 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1203/2368] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:55.697647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fbd97701-fc3e-4b77-ac4d-1440b93cf202 None None] MFA Rules not processed for user `0d11db60b55d4c1190c2bbc15a57a3af`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:55.705564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fbd97701-fc3e-4b77-ac4d-1440b93cf202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:55.925133 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1166/2369] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:55.926328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382ece0-0e59-4efd-a62f-d396ba9639b7 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:55.942922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382ece0-0e59-4efd-a62f-d396ba9639b7 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:56.098317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fa489-d180-43d1-8423-aa2944d0be61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:56.099119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fa489-d180-43d1-8423-aa2944d0be61 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:56.099396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fa489-d180-43d1-8423-aa2944d0be61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:56.099659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fa489-d180-43d1-8423-aa2944d0be61 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:56.100297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fa489-d180-43d1-8423-aa2944d0be61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:56.103250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fa489-d180-43d1-8423-aa2944d0be61 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:56.161048 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1204/2370] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:55 2022] POST /identity/v3/projects => generated 375 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:56.165422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd97701-fc3e-4b77-ac4d-1440b93cf202 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:56.194393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd97701-fc3e-4b77-ac4d-1440b93cf202 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:56.348930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fa489-d180-43d1-8423-aa2944d0be61 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:56.358464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae7247-1c86-4eed-90e1-286aac3cf90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:56.359088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae7247-1c86-4eed-90e1-286aac3cf90c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:56.359361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae7247-1c86-4eed-90e1-286aac3cf90c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:56.359627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae7247-1c86-4eed-90e1-286aac3cf90c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:56.360270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae7247-1c86-4eed-90e1-286aac3cf90c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:56.362228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae7247-1c86-4eed-90e1-286aac3cf90c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:56.371639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fa489-d180-43d1-8423-aa2944d0be61 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:56.386124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b530801-dea4-4d13-82d0-bbb743541d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:56.386783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b530801-dea4-4d13-82d0-bbb743541d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:56.387045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b530801-dea4-4d13-82d0-bbb743541d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:56.387307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b530801-dea4-4d13-82d0-bbb743541d99 admin admin] PATH_INFO: `/v3/users/f2e85efbee9144f6a2b42a95ee0b38cc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:56.389879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b530801-dea4-4d13-82d0-bbb743541d99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2e85efbee9144f6a2b42a95ee0b38cc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:56.391767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b530801-dea4-4d13-82d0-bbb743541d99 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:56.436697 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1167/2371] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:56 2022] POST /identity/v3/users => generated 294 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:56.440500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae7247-1c86-4eed-90e1-286aac3cf90c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:56.475133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae7247-1c86-4eed-90e1-286aac3cf90c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:56.495865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579b238-3f7d-4cb9-88e1-f1e9301bfd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:56.496491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579b238-3f7d-4cb9-88e1-f1e9301bfd75 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:56.497795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579b238-3f7d-4cb9-88e1-f1e9301bfd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:56.498073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579b238-3f7d-4cb9-88e1-f1e9301bfd75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:56.498727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579b238-3f7d-4cb9-88e1-f1e9301bfd75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:56.502024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579b238-3f7d-4cb9-88e1-f1e9301bfd75 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:56.532198 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:56.543250 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1168/2372] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:56.544887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579b238-3f7d-4cb9-88e1-f1e9301bfd75 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:56.551734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b530801-dea4-4d13-82d0-bbb743541d99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2e85efbee9144f6a2b42a95ee0b38cc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:56.552720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b530801-dea4-4d13-82d0-bbb743541d99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2e85efbee9144f6a2b42a95ee0b38cc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:56.565523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579b238-3f7d-4cb9-88e1-f1e9301bfd75 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:56.584759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0b2d1-5ac9-4ef9-a04f-f0a72946ed6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:56.586507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b530801-dea4-4d13-82d0-bbb743541d99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2e85efbee9144f6a2b42a95ee0b38cc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:56.586742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0b2d1-5ac9-4ef9-a04f-f0a72946ed6a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:56.586949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0b2d1-5ac9-4ef9-a04f-f0a72946ed6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:56.588135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0b2d1-5ac9-4ef9-a04f-f0a72946ed6a admin admin] PATH_INFO: `/v3/projects/cf818192d9f14c1e8c2958a32163ad41/users/102e2be78faf4b15a9d32c5fa55db5a0/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:56.629318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b530801-dea4-4d13-82d0-bbb743541d99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2e85efbee9144f6a2b42a95ee0b38cc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:56.633849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0b2d1-5ac9-4ef9-a04f-f0a72946ed6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf818192d9f14c1e8c2958a32163ad41, user_id=102e2be78faf4b15a9d32c5fa55db5a0, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:56.636998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0b2d1-5ac9-4ef9-a04f-f0a72946ed6a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:56.648989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b530801-dea4-4d13-82d0-bbb743541d99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2e85efbee9144f6a2b42a95ee0b38cc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:56.664515 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1205/2373] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:56 2022] DELETE /identity/v3/users/f2e85efbee9144f6a2b42a95ee0b38cc => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:56.665025 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1169/2374] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:56 2022] PUT /identity/v3/projects/cf818192d9f14c1e8c2958a32163ad41/users/102e2be78faf4b15a9d32c5fa55db5a0/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:43:56.668971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0b2d1-5ac9-4ef9-a04f-f0a72946ed6a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:56.669120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5023a-9357-4ff5-a066-95057cdf92f2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:56.669407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5023a-9357-4ff5-a066-95057cdf92f2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:56.669978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5023a-9357-4ff5-a066-95057cdf92f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:56.673164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7ec0b2d1-5ac9-4ef9-a04f-f0a72946ed6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:56.717227 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:56.731392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ccc5023a-9357-4ff5-a066-95057cdf92f2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:56.733957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ccc5023a-9357-4ff5-a066-95057cdf92f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:56.802737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0b2d1-5ac9-4ef9-a04f-f0a72946ed6a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:56.909746 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1206/2375] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:43:56.937295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f014d1-2603-4c82-bd02-af856fd76adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:56.938928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f014d1-2603-4c82-bd02-af856fd76adb admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:56.939224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f014d1-2603-4c82-bd02-af856fd76adb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:56.939500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f014d1-2603-4c82-bd02-af856fd76adb admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:56.939658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5023a-9357-4ff5-a066-95057cdf92f2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:56.941330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ccc5023a-9357-4ff5-a066-95057cdf92f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:56.945394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f014d1-2603-4c82-bd02-af856fd76adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:56.946968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f014d1-2603-4c82-bd02-af856fd76adb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:56.972885 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1170/2376] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:43:56.979311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f014d1-2603-4c82-bd02-af856fd76adb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:56.982529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d1f014d1-2603-4c82-bd02-af856fd76adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:57.033110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5023a-9357-4ff5-a066-95057cdf92f2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:57.038939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34202bdb-8d79-4915-b5f7-d66b4f077ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:57.039728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34202bdb-8d79-4915-b5f7-d66b4f077ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:57.040073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34202bdb-8d79-4915-b5f7-d66b4f077ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:57.040404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34202bdb-8d79-4915-b5f7-d66b4f077ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:57.050854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34202bdb-8d79-4915-b5f7-d66b4f077ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:57.053005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34202bdb-8d79-4915-b5f7-d66b4f077ac3 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:57.086153 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1207/2377] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:43:57.088843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34202bdb-8d79-4915-b5f7-d66b4f077ac3 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:57.113238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34202bdb-8d79-4915-b5f7-d66b4f077ac3 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:57.122909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dceeb-1312-454d-a7d7-6af46f67abbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:57.123801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dceeb-1312-454d-a7d7-6af46f67abbf admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:57.124111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dceeb-1312-454d-a7d7-6af46f67abbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:57.130355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dceeb-1312-454d-a7d7-6af46f67abbf admin admin] PATH_INFO: `/v3/projects/cf818192d9f14c1e8c2958a32163ad41/users/102e2be78faf4b15a9d32c5fa55db5a0/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:57.132154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1dceeb-1312-454d-a7d7-6af46f67abbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf818192d9f14c1e8c2958a32163ad41, user_id=102e2be78faf4b15a9d32c5fa55db5a0, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:57.136314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1dceeb-1312-454d-a7d7-6af46f67abbf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:57.159988 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1208/2378] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:43:57 2022] PUT /identity/v3/projects/cf818192d9f14c1e8c2958a32163ad41/users/102e2be78faf4b15a9d32c5fa55db5a0/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:57.162484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36ce6c-d32a-42de-8539-c99a8f72272b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:57.162890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36ce6c-d32a-42de-8539-c99a8f72272b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:57.164127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36ce6c-d32a-42de-8539-c99a8f72272b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:57.197779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f014d1-2603-4c82-bd02-af856fd76adb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:57.229786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bd36ce6c-d32a-42de-8539-c99a8f72272b None None] MFA Rules not processed for user `102e2be78faf4b15a9d32c5fa55db5a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:43:57.231059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bd36ce6c-d32a-42de-8539-c99a8f72272b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:57.317015 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:57.331130 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:57.350386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08079f-4233-4efd-b3b5-7c086ab0a611 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:57.351981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08079f-4233-4efd-b3b5-7c086ab0a611 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:57.352264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08079f-4233-4efd-b3b5-7c086ab0a611 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:57.353941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08079f-4233-4efd-b3b5-7c086ab0a611 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:57.373748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8a08079f-4233-4efd-b3b5-7c086ab0a611 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:57.400576 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1209/2379] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:43:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:43:57.401816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36ce6c-d32a-42de-8539-c99a8f72272b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:57.418352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36ce6c-d32a-42de-8539-c99a8f72272b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:57.431176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ada531-a0d5-4202-885e-357c3627ed3f tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102e2be78faf4b15a9d32c5fa55db5a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf818192d9f14c1e8c2958a32163ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:57.431883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ada531-a0d5-4202-885e-357c3627ed3f tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:57.432160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ada531-a0d5-4202-885e-357c3627ed3f tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:57.432433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ada531-a0d5-4202-885e-357c3627ed3f tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:57.433395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ada531-a0d5-4202-885e-357c3627ed3f tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:57.433709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ada531-a0d5-4202-885e-357c3627ed3f tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:57.441132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ada531-a0d5-4202-885e-357c3627ed3f tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:57.468746 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1210/2380] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:57.469710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ada531-a0d5-4202-885e-357c3627ed3f tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:57.493215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ada531-a0d5-4202-885e-357c3627ed3f tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:57.507364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e33879-0c2e-444d-9710-945a00e22bab tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102e2be78faf4b15a9d32c5fa55db5a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf818192d9f14c1e8c2958a32163ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:57.508092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e33879-0c2e-444d-9710-945a00e22bab tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:57.508473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e33879-0c2e-444d-9710-945a00e22bab tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:57.508898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e33879-0c2e-444d-9710-945a00e22bab tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:57.509630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e33879-0c2e-444d-9710-945a00e22bab tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:57.512265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e33879-0c2e-444d-9710-945a00e22bab tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:57.561326 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1211/2381] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:43:57 2022] POST /identity/v3/projects => generated 371 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:57.571455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08079f-4233-4efd-b3b5-7c086ab0a611 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:57.574593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08079f-4233-4efd-b3b5-7c086ab0a611 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:57.576258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e33879-0c2e-444d-9710-945a00e22bab tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:57.595647 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1171/2382] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:56 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:57.745614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e33879-0c2e-444d-9710-945a00e22bab tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:57.759862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302ed9b-1f7e-451b-b542-9a51e9a9c15e tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102e2be78faf4b15a9d32c5fa55db5a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf818192d9f14c1e8c2958a32163ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:57.760506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302ed9b-1f7e-451b-b542-9a51e9a9c15e tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:57.760980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302ed9b-1f7e-451b-b542-9a51e9a9c15e tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:57.761262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302ed9b-1f7e-451b-b542-9a51e9a9c15e tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:57.762187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302ed9b-1f7e-451b-b542-9a51e9a9c15e tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:57.762508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302ed9b-1f7e-451b-b542-9a51e9a9c15e tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:57.764329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302ed9b-1f7e-451b-b542-9a51e9a9c15e tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:57.788290 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1212/2383] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:57.795232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08079f-4233-4efd-b3b5-7c086ab0a611 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:57.796830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8a08079f-4233-4efd-b3b5-7c086ab0a611 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:57.819116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08079f-4233-4efd-b3b5-7c086ab0a611 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:58.009277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ee8e6-f14a-4b9d-baf3-392b73b91371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:58.010709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ee8e6-f14a-4b9d-baf3-392b73b91371 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:58.011399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ee8e6-f14a-4b9d-baf3-392b73b91371 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:58.011850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ee8e6-f14a-4b9d-baf3-392b73b91371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:58.029509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ee8e6-f14a-4b9d-baf3-392b73b91371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:58.032372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ee8e6-f14a-4b9d-baf3-392b73b91371 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:58.046121 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1172/2384] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:43:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:43:58.083529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40f979-80a2-4f54-9f9a-f085fd7426db None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:58.083998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40f979-80a2-4f54-9f9a-f085fd7426db None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:58.084516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40f979-80a2-4f54-9f9a-f085fd7426db None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:58.088420 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1213/2385] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:43:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:43:58.092474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ee8e6-f14a-4b9d-baf3-392b73b91371 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:58.094914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-751ee8e6-f14a-4b9d-baf3-392b73b91371 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:58.099531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40f979-80a2-4f54-9f9a-f085fd7426db None None] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:43:58.156739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40f979-80a2-4f54-9f9a-f085fd7426db None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:58.179119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40f979-80a2-4f54-9f9a-f085fd7426db None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:58.188477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1186b-9fb7-49e2-a938-02b098428594 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102e2be78faf4b15a9d32c5fa55db5a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf818192d9f14c1e8c2958a32163ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:58.190266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1186b-9fb7-49e2-a938-02b098428594 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:58.192153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1186b-9fb7-49e2-a938-02b098428594 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:58.192447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1186b-9fb7-49e2-a938-02b098428594 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] PATH_INFO: `/v3/projects/9f271c7663b24d88b7d49b3af895d9ac` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:58.197575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1186b-9fb7-49e2-a938-02b098428594 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorizing `identity:get_project(project_id=9f271c7663b24d88b7d49b3af895d9ac)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:58.203970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1186b-9fb7-49e2-a938-02b098428594 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:58.211939 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1214/2386] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:43:58 2022] GET /identity/v3/projects/9f271c7663b24d88b7d49b3af895d9ac => generated 371 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:58.301972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ee8e6-f14a-4b9d-baf3-392b73b91371 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:58.316355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66831e6c-abd7-4b0a-9afa-088b03126496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:58.319925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66831e6c-abd7-4b0a-9afa-088b03126496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:58.321910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66831e6c-abd7-4b0a-9afa-088b03126496 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:58.322983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66831e6c-abd7-4b0a-9afa-088b03126496 admin admin] PATH_INFO: `/v3/projects/137e2036c9794daaa21a8842198a3ec1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:58.327992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66831e6c-abd7-4b0a-9afa-088b03126496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=137e2036c9794daaa21a8842198a3ec1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:58.332000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66831e6c-abd7-4b0a-9afa-088b03126496 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:58.373606 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:58.431315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-66831e6c-abd7-4b0a-9afa-088b03126496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '137e2036c9794daaa21a8842198a3ec1', 'request_id': 'req-66831e6c-abd7-4b0a-9afa-088b03126496'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:58.457079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-66831e6c-abd7-4b0a-9afa-088b03126496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '137e2036c9794daaa21a8842198a3ec1', 'request_id': 'req-66831e6c-abd7-4b0a-9afa-088b03126496'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:58.468577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-66831e6c-abd7-4b0a-9afa-088b03126496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '137e2036c9794daaa21a8842198a3ec1', 'request_id': 'req-66831e6c-abd7-4b0a-9afa-088b03126496'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:58.499095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1677876-17b5-4f3d-9b22-8a938cfaa53a None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:58.500276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1677876-17b5-4f3d-9b22-8a938cfaa53a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:58.500762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1677876-17b5-4f3d-9b22-8a938cfaa53a None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:58.504134 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1215/2387] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:43:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 09:43:58.513407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-66831e6c-abd7-4b0a-9afa-088b03126496 admin admin] The token cache is being invalidate because project 137e2036c9794daaa21a8842198a3ec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:43:58.513847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-66831e6c-abd7-4b0a-9afa-088b03126496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:58.518726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1677876-17b5-4f3d-9b22-8a938cfaa53a None None] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:43:58.520005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-66831e6c-abd7-4b0a-9afa-088b03126496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:58.525131 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1173/2388] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:58 2022] DELETE /identity/v3/projects/137e2036c9794daaa21a8842198a3ec1 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:58.529009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66831e6c-abd7-4b0a-9afa-088b03126496 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:58.531403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-66831e6c-abd7-4b0a-9afa-088b03126496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:58.644531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66831e6c-abd7-4b0a-9afa-088b03126496 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:58.652637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e4f0a-9640-4374-927d-6acaecb77d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:58.653310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e4f0a-9640-4374-927d-6acaecb77d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:58.653596 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e4f0a-9640-4374-927d-6acaecb77d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:58.653873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e4f0a-9640-4374-927d-6acaecb77d5c admin admin] PATH_INFO: `/v3/users/b7e56bda97e144d9ab762e1a07a52915` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:58.655132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e4f0a-9640-4374-927d-6acaecb77d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7e56bda97e144d9ab762e1a07a52915)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:58.657781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e4f0a-9640-4374-927d-6acaecb77d5c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:58.698588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1677876-17b5-4f3d-9b22-8a938cfaa53a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:58.741297 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:58.743599 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-768e4f0a-9640-4374-927d-6acaecb77d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e56bda97e144d9ab762e1a07a52915'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:58.759854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-768e4f0a-9640-4374-927d-6acaecb77d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e56bda97e144d9ab762e1a07a52915'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:58.762218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-768e4f0a-9640-4374-927d-6acaecb77d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e56bda97e144d9ab762e1a07a52915'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:58.792839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-768e4f0a-9640-4374-927d-6acaecb77d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e56bda97e144d9ab762e1a07a52915'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:58.802749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-768e4f0a-9640-4374-927d-6acaecb77d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e56bda97e144d9ab762e1a07a52915'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:58.817316 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1174/2389] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:58 2022] DELETE /identity/v3/users/b7e56bda97e144d9ab762e1a07a52915 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:58.829436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1677876-17b5-4f3d-9b22-8a938cfaa53a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:58.951525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1f8f8-2697-4575-aa8b-210288ef8da2 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102e2be78faf4b15a9d32c5fa55db5a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf818192d9f14c1e8c2958a32163ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:58.953059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1f8f8-2697-4575-aa8b-210288ef8da2 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:58.953595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1f8f8-2697-4575-aa8b-210288ef8da2 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:58.954252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1f8f8-2697-4575-aa8b-210288ef8da2 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] PATH_INFO: `/v3/projects/9f271c7663b24d88b7d49b3af895d9ac` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:58.957102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1f8f8-2697-4575-aa8b-210288ef8da2 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorizing `identity:get_project(project_id=9f271c7663b24d88b7d49b3af895d9ac)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:58.964062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1f8f8-2697-4575-aa8b-210288ef8da2 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:58.969848 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1216/2390] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:43:58 2022] GET /identity/v3/projects/9f271c7663b24d88b7d49b3af895d9ac => generated 371 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:59.056212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e4f0a-9640-4374-927d-6acaecb77d5c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:59.057912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-768e4f0a-9640-4374-927d-6acaecb77d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:59.079358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e4f0a-9640-4374-927d-6acaecb77d5c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:59.085057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85587a76-4781-426c-be6a-156ed3973024 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102e2be78faf4b15a9d32c5fa55db5a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf818192d9f14c1e8c2958a32163ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:59.085783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85587a76-4781-426c-be6a-156ed3973024 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:59.086726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85587a76-4781-426c-be6a-156ed3973024 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:59.087007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85587a76-4781-426c-be6a-156ed3973024 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:59.087676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85587a76-4781-426c-be6a-156ed3973024 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:59.087985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85587a76-4781-426c-be6a-156ed3973024 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:59.089744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85587a76-4781-426c-be6a-156ed3973024 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:59.104457 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1175/2391] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:59.108777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1f8f8-2697-4575-aa8b-210288ef8da2 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:59.120782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1f8f8-2697-4575-aa8b-210288ef8da2 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:59.126641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084017b5-dc03-4508-ab14-9c630d04c2d6 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102e2be78faf4b15a9d32c5fa55db5a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf818192d9f14c1e8c2958a32163ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:59.127260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084017b5-dc03-4508-ab14-9c630d04c2d6 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:59.127545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084017b5-dc03-4508-ab14-9c630d04c2d6 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:59.127819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084017b5-dc03-4508-ab14-9c630d04c2d6 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:59.128465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084017b5-dc03-4508-ab14-9c630d04c2d6 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:59.130442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084017b5-dc03-4508-ab14-9c630d04c2d6 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:59.171054 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1217/2392] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:43:59 2022] POST /identity/v3/users => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:43:59.178526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85587a76-4781-426c-be6a-156ed3973024 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:59.190897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85587a76-4781-426c-be6a-156ed3973024 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:59.196919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b4f2d-e06a-4819-8517-749d87593211 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102e2be78faf4b15a9d32c5fa55db5a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf818192d9f14c1e8c2958a32163ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:59.197949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b4f2d-e06a-4819-8517-749d87593211 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:59.198331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b4f2d-e06a-4819-8517-749d87593211 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:59.198693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b4f2d-e06a-4819-8517-749d87593211 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:59.199442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b4f2d-e06a-4819-8517-749d87593211 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:43:59.199845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b4f2d-e06a-4819-8517-749d87593211 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:59.201940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b4f2d-e06a-4819-8517-749d87593211 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:59.220944 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1176/2393] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:59.242384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db1749-60dc-4cf2-adcd-e6fbc3c4baa4 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:59.242928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db1749-60dc-4cf2-adcd-e6fbc3c4baa4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:59.243899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db1749-60dc-4cf2-adcd-e6fbc3c4baa4 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:59.248284 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1218/2394] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:43:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:43:59.258631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b4f2d-e06a-4819-8517-749d87593211 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:43:59.260829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bc2b4f2d-e06a-4819-8517-749d87593211 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:59.270119 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:43:59.373085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b4f2d-e06a-4819-8517-749d87593211 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:59.383597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b4f2d-e06a-4819-8517-749d87593211 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:59.388860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbebb4c-06f1-494e-806d-f71b4e03b90f tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102e2be78faf4b15a9d32c5fa55db5a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf818192d9f14c1e8c2958a32163ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:59.389334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbebb4c-06f1-494e-806d-f71b4e03b90f tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:59.389698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbebb4c-06f1-494e-806d-f71b4e03b90f tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:59.390060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbebb4c-06f1-494e-806d-f71b4e03b90f tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] PATH_INFO: `/v3/projects/9f271c7663b24d88b7d49b3af895d9ac` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:59.391275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbebb4c-06f1-494e-806d-f71b4e03b90f tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorizing `identity:get_project(project_id=9f271c7663b24d88b7d49b3af895d9ac)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:59.393484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbebb4c-06f1-494e-806d-f71b4e03b90f tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:59.404870 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1177/2395] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:43:59 2022] GET /identity/v3/projects/9f271c7663b24d88b7d49b3af895d9ac => generated 371 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:59.574474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec89e9-4938-4dbc-ab6b-7486e9747ca5 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:59.575539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec89e9-4938-4dbc-ab6b-7486e9747ca5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:59.575964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec89e9-4938-4dbc-ab6b-7486e9747ca5 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:59.578015 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1219/2396] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:43:59.584460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbebb4c-06f1-494e-806d-f71b4e03b90f tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:43:59.604067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbebb4c-06f1-494e-806d-f71b4e03b90f tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:59.617957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbebb4c-06f1-494e-806d-f71b4e03b90f tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:59.625156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f502f-c19b-4e1e-be6d-0d4ff7def050 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102e2be78faf4b15a9d32c5fa55db5a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf818192d9f14c1e8c2958a32163ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:59.626145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f502f-c19b-4e1e-be6d-0d4ff7def050 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:59.627294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f502f-c19b-4e1e-be6d-0d4ff7def050 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:59.627800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f502f-c19b-4e1e-be6d-0d4ff7def050 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] PATH_INFO: `/v3/projects/9f271c7663b24d88b7d49b3af895d9ac` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:59.629820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f502f-c19b-4e1e-be6d-0d4ff7def050 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorizing `identity:get_project(project_id=9f271c7663b24d88b7d49b3af895d9ac)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:59.635103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f502f-c19b-4e1e-be6d-0d4ff7def050 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:59.654401 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1178/2397] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:43:59 2022] GET /identity/v3/projects/9f271c7663b24d88b7d49b3af895d9ac => generated 371 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:43:59.682014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec89e9-4938-4dbc-ab6b-7486e9747ca5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:59.698652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec89e9-4938-4dbc-ab6b-7486e9747ca5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:43:59.705262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9320adc-6995-4a01-a1bb-8657f15fade8 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102e2be78faf4b15a9d32c5fa55db5a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf818192d9f14c1e8c2958a32163ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:43:59.706158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9320adc-6995-4a01-a1bb-8657f15fade8 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:43:59.706587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9320adc-6995-4a01-a1bb-8657f15fade8 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:43:59.707005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9320adc-6995-4a01-a1bb-8657f15fade8 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] PATH_INFO: `/v3/users/acec71a259364185b569270e6b29f645` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:43:59.750121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9320adc-6995-4a01-a1bb-8657f15fade8 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorizing `identity:delete_user(user_id=acec71a259364185b569270e6b29f645)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:43:59.753682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9320adc-6995-4a01-a1bb-8657f15fade8 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:43:59.871628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a9320adc-6995-4a01-a1bb-8657f15fade8 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acec71a259364185b569270e6b29f645'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:59.873621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a9320adc-6995-4a01-a1bb-8657f15fade8 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acec71a259364185b569270e6b29f645'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:59.893114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a9320adc-6995-4a01-a1bb-8657f15fade8 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acec71a259364185b569270e6b29f645'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:59.917027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a9320adc-6995-4a01-a1bb-8657f15fade8 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acec71a259364185b569270e6b29f645'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:59.952477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a9320adc-6995-4a01-a1bb-8657f15fade8 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acec71a259364185b569270e6b29f645'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:43:59.973547 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1220/2398] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:43:59 2022] DELETE /identity/v3/users/acec71a259364185b569270e6b29f645 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:43:59.979174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f502f-c19b-4e1e-be6d-0d4ff7def050 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:43:59.983316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0e2f502f-c19b-4e1e-be6d-0d4ff7def050 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:43:59.998848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f502f-c19b-4e1e-be6d-0d4ff7def050 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:00.115530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79301c83-acb8-405b-abfe-cb5fe6447666 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102e2be78faf4b15a9d32c5fa55db5a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf818192d9f14c1e8c2958a32163ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:00.116761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79301c83-acb8-405b-abfe-cb5fe6447666 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:00.117207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79301c83-acb8-405b-abfe-cb5fe6447666 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:00.117552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79301c83-acb8-405b-abfe-cb5fe6447666 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] PATH_INFO: `/v3/projects/9f271c7663b24d88b7d49b3af895d9ac` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:00.119094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79301c83-acb8-405b-abfe-cb5fe6447666 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9f271c7663b24d88b7d49b3af895d9ac)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:00.121174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79301c83-acb8-405b-abfe-cb5fe6447666 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:00.207246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-79301c83-acb8-405b-abfe-cb5fe6447666 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f271c7663b24d88b7d49b3af895d9ac', 'request_id': 'req-79301c83-acb8-405b-abfe-cb5fe6447666'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:00.232942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-79301c83-acb8-405b-abfe-cb5fe6447666 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f271c7663b24d88b7d49b3af895d9ac', 'request_id': 'req-79301c83-acb8-405b-abfe-cb5fe6447666'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:00.262856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-79301c83-acb8-405b-abfe-cb5fe6447666 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f271c7663b24d88b7d49b3af895d9ac', 'request_id': 'req-79301c83-acb8-405b-abfe-cb5fe6447666'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:00.280474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-79301c83-acb8-405b-abfe-cb5fe6447666 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] The token cache is being invalidate because project 9f271c7663b24d88b7d49b3af895d9ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:44:00.280858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-79301c83-acb8-405b-abfe-cb5fe6447666 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:00.281538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-79301c83-acb8-405b-abfe-cb5fe6447666 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:00.285091 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1179/2399] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:43:59 2022] DELETE /identity/v3/projects/9f271c7663b24d88b7d49b3af895d9ac => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:00.291807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9320adc-6995-4a01-a1bb-8657f15fade8 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:00.293643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a9320adc-6995-4a01-a1bb-8657f15fade8 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:00.322483 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:00.406745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79301c83-acb8-405b-abfe-cb5fe6447666 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:00.408443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-79301c83-acb8-405b-abfe-cb5fe6447666 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:00.474344 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:00.495750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9320adc-6995-4a01-a1bb-8657f15fade8 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:00.590566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ed290-1612-40c6-aa9d-3365cbee7417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:00.592499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ed290-1612-40c6-aa9d-3365cbee7417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:00.592807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ed290-1612-40c6-aa9d-3365cbee7417 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:00.593088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ed290-1612-40c6-aa9d-3365cbee7417 admin admin] PATH_INFO: `/v3/users/0d11db60b55d4c1190c2bbc15a57a3af` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:00.596537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ed290-1612-40c6-aa9d-3365cbee7417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d11db60b55d4c1190c2bbc15a57a3af)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:00.599383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ed290-1612-40c6-aa9d-3365cbee7417 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:00.610591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79301c83-acb8-405b-abfe-cb5fe6447666 tempest-QuotasAdminTestV257-2022600227 tempest-QuotasAdminTestV257-2022600227-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:00.630972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab09ce-d7ed-4d02-a7c6-a5f2d4e8f193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:00.632109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab09ce-d7ed-4d02-a7c6-a5f2d4e8f193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:00.632802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab09ce-d7ed-4d02-a7c6-a5f2d4e8f193 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:00.633324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab09ce-d7ed-4d02-a7c6-a5f2d4e8f193 admin admin] PATH_INFO: `/v3/projects/165fe1567f0d4e1d9815c5a9930a8475` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:00.634820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab09ce-d7ed-4d02-a7c6-a5f2d4e8f193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=165fe1567f0d4e1d9815c5a9930a8475)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:00.637531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab09ce-d7ed-4d02-a7c6-a5f2d4e8f193 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:00.709183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-032ed290-1612-40c6-aa9d-3365cbee7417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d11db60b55d4c1190c2bbc15a57a3af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:00.711554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-032ed290-1612-40c6-aa9d-3365cbee7417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d11db60b55d4c1190c2bbc15a57a3af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:00.715633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93ab09ce-d7ed-4d02-a7c6-a5f2d4e8f193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '165fe1567f0d4e1d9815c5a9930a8475', 'request_id': 'req-93ab09ce-d7ed-4d02-a7c6-a5f2d4e8f193'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:00.727246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-032ed290-1612-40c6-aa9d-3365cbee7417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d11db60b55d4c1190c2bbc15a57a3af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:00.732990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93ab09ce-d7ed-4d02-a7c6-a5f2d4e8f193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '165fe1567f0d4e1d9815c5a9930a8475', 'request_id': 'req-93ab09ce-d7ed-4d02-a7c6-a5f2d4e8f193'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:00.742393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93ab09ce-d7ed-4d02-a7c6-a5f2d4e8f193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '165fe1567f0d4e1d9815c5a9930a8475', 'request_id': 'req-93ab09ce-d7ed-4d02-a7c6-a5f2d4e8f193'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:00.757720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93ab09ce-d7ed-4d02-a7c6-a5f2d4e8f193 admin admin] The token cache is being invalidate because project 165fe1567f0d4e1d9815c5a9930a8475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:44:00.758242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93ab09ce-d7ed-4d02-a7c6-a5f2d4e8f193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:00.759104 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93ab09ce-d7ed-4d02-a7c6-a5f2d4e8f193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:00.767086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-032ed290-1612-40c6-aa9d-3365cbee7417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d11db60b55d4c1190c2bbc15a57a3af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:00.772457 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1180/2400] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:44:00 2022] DELETE /identity/v3/projects/165fe1567f0d4e1d9815c5a9930a8475 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:00.772457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384acdc-1e79-46f8-97a6-c1d4d1b30ae1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:00.772457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384acdc-1e79-46f8-97a6-c1d4d1b30ae1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:00.772457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384acdc-1e79-46f8-97a6-c1d4d1b30ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:00.806567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-032ed290-1612-40c6-aa9d-3365cbee7417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d11db60b55d4c1190c2bbc15a57a3af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:00.811833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9384acdc-1e79-46f8-97a6-c1d4d1b30ae1 None None] MFA Rules not processed for user `5856ac6dc0f844489e69cc75104a62df`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:00.813163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9384acdc-1e79-46f8-97a6-c1d4d1b30ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:00.817942 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1221/2401] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:44:00 2022] DELETE /identity/v3/users/0d11db60b55d4c1190c2bbc15a57a3af => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:00.819929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c7d1e-80fc-4844-aa79-1f2f4fd45a57 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:00.820419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c7d1e-80fc-4844-aa79-1f2f4fd45a57 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:00.821865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c7d1e-80fc-4844-aa79-1f2f4fd45a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:00.854832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-892c7d1e-80fc-4844-aa79-1f2f4fd45a57 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:00.867383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-892c7d1e-80fc-4844-aa79-1f2f4fd45a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:00.970949 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1181/2402] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:00 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:00.983782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565c2aa-aff6-4daa-a667-e52c0fe29848 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:00.984099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565c2aa-aff6-4daa-a667-e52c0fe29848 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:00.984329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565c2aa-aff6-4daa-a667-e52c0fe29848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:01.007867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8565c2aa-aff6-4daa-a667-e52c0fe29848 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:01.011160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8565c2aa-aff6-4daa-a667-e52c0fe29848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:01.014560 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:01.089817 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:01.134736 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1222/2403] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:01.134736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c3c16-1fdb-4130-acc1-ee0fff71c6a1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:01.134736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c3c16-1fdb-4130-acc1-ee0fff71c6a1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:01.134736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c3c16-1fdb-4130-acc1-ee0fff71c6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:01.194603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d69c3c16-1fdb-4130-acc1-ee0fff71c6a1 None None] MFA Rules not processed for user `7fca17ba092e44f1a37b108778dc7a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:01.197431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d69c3c16-1fdb-4130-acc1-ee0fff71c6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:01.217439 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1182/2404] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:01.222210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e33b5e-117c-4141-ba80-6d946879a2c2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:01.222473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e33b5e-117c-4141-ba80-6d946879a2c2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:01.222752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e33b5e-117c-4141-ba80-6d946879a2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:01.277064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-86e33b5e-117c-4141-ba80-6d946879a2c2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:01.281097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-86e33b5e-117c-4141-ba80-6d946879a2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:01.304722 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1183/2405] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:01.308160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e33b5e-117c-4141-ba80-6d946879a2c2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:01.316206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-86e33b5e-117c-4141-ba80-6d946879a2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:01.368674 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1223/2406] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:01 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:01.371568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c3c16-1fdb-4130-acc1-ee0fff71c6a1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:01.396401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c3c16-1fdb-4130-acc1-ee0fff71c6a1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:01.410283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4084f-a23d-4c39-bc76-c9aebba4560f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:01.411742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4084f-a23d-4c39-bc76-c9aebba4560f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:01.412656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4084f-a23d-4c39-bc76-c9aebba4560f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:01.415333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4084f-a23d-4c39-bc76-c9aebba4560f admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:01.416467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4084f-a23d-4c39-bc76-c9aebba4560f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:44:01.417005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4084f-a23d-4c39-bc76-c9aebba4560f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:01.421070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4084f-a23d-4c39-bc76-c9aebba4560f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:01.457978 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1224/2407] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:44:01.462282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4084f-a23d-4c39-bc76-c9aebba4560f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:01.475276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4084f-a23d-4c39-bc76-c9aebba4560f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:01.481756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9acefd-061c-4bc0-96b1-f3d7d13d29c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:01.482986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9acefd-061c-4bc0-96b1-f3d7d13d29c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:01.483474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9acefd-061c-4bc0-96b1-f3d7d13d29c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:01.484362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9acefd-061c-4bc0-96b1-f3d7d13d29c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:01.485241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9acefd-061c-4bc0-96b1-f3d7d13d29c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:01.487334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9acefd-061c-4bc0-96b1-f3d7d13d29c2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:01.497580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e33b5e-117c-4141-ba80-6d946879a2c2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:01.511013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc15a9b-3f98-45dd-8237-395e6024f1f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:01.511835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc15a9b-3f98-45dd-8237-395e6024f1f1 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:01.512115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc15a9b-3f98-45dd-8237-395e6024f1f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:01.512381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc15a9b-3f98-45dd-8237-395e6024f1f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:01.535139 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1225/2408] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:44:01 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:44:01.536358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9acefd-061c-4bc0-96b1-f3d7d13d29c2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:01.539394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc15a9b-3f98-45dd-8237-395e6024f1f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:01.540889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc15a9b-3f98-45dd-8237-395e6024f1f1 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:01.542185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fd9acefd-061c-4bc0-96b1-f3d7d13d29c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:01.571872 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1184/2409] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:44:01.572751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc15a9b-3f98-45dd-8237-395e6024f1f1 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:01.598265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc15a9b-3f98-45dd-8237-395e6024f1f1 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:01.664432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9acefd-061c-4bc0-96b1-f3d7d13d29c2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:01.673632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e1d91-e464-4434-b878-1779ddfe53d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:01.674891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e1d91-e464-4434-b878-1779ddfe53d3 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:01.675382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e1d91-e464-4434-b878-1779ddfe53d3 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:01.675869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e1d91-e464-4434-b878-1779ddfe53d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:01.678882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b17e1d91-e464-4434-b878-1779ddfe53d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:01.757115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7c7c0-618d-4965-9fb0-ba95d9f2f9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:01.761732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7c7c0-618d-4965-9fb0-ba95d9f2f9bb admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:01.762089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7c7c0-618d-4965-9fb0-ba95d9f2f9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:01.762999 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:01.763490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7c7c0-618d-4965-9fb0-ba95d9f2f9bb admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:01.764175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7c7c0-618d-4965-9fb0-ba95d9f2f9bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:01.769725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7c7c0-618d-4965-9fb0-ba95d9f2f9bb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:01.795947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e1d91-e464-4434-b878-1779ddfe53d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:01.798878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e1d91-e464-4434-b878-1779ddfe53d3 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:01.820089 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1185/2410] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:44:01 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:44:01.823742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7c7c0-618d-4965-9fb0-ba95d9f2f9bb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:01.837876 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1226/2411] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:01 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:44:01.841100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7c7c0-618d-4965-9fb0-ba95d9f2f9bb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:01.862916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779859ef-ec7b-41bb-af63-342635179d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:01.864525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779859ef-ec7b-41bb-af63-342635179d6a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:01.865527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779859ef-ec7b-41bb-af63-342635179d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:01.866985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779859ef-ec7b-41bb-af63-342635179d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:01.868413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779859ef-ec7b-41bb-af63-342635179d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:01.870628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779859ef-ec7b-41bb-af63-342635179d6a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:01.888343 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1186/2412] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:44:01.891943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e1d91-e464-4434-b878-1779ddfe53d3 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:01.906525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e1d91-e464-4434-b878-1779ddfe53d3 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:01.928613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d9b7f-3de3-4526-b4e9-78071508c74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:01.930076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d9b7f-3de3-4526-b4e9-78071508c74d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:01.930388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d9b7f-3de3-4526-b4e9-78071508c74d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:01.930720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d9b7f-3de3-4526-b4e9-78071508c74d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:01.931447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d9b7f-3de3-4526-b4e9-78071508c74d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:01.933239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d9b7f-3de3-4526-b4e9-78071508c74d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:01.947296 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1227/2413] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:44:01.950910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779859ef-ec7b-41bb-af63-342635179d6a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:01.966357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779859ef-ec7b-41bb-af63-342635179d6a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:01.974142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede73f4a-1bac-425f-ad3b-0b24d610da66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:01.975994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede73f4a-1bac-425f-ad3b-0b24d610da66 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:01.976458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede73f4a-1bac-425f-ad3b-0b24d610da66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:01.976879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede73f4a-1bac-425f-ad3b-0b24d610da66 admin admin] PATH_INFO: `/v3/projects/a3569afafabc41fb9db28ec51e3e47d6/users/ea260b304dc54e1f88daa20f5b7e60c7/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:01.999520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede73f4a-1bac-425f-ad3b-0b24d610da66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3569afafabc41fb9db28ec51e3e47d6, user_id=ea260b304dc54e1f88daa20f5b7e60c7, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:02.001902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede73f4a-1bac-425f-ad3b-0b24d610da66 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:02.021111 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1187/2414] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:44:01 2022] PUT /identity/v3/projects/a3569afafabc41fb9db28ec51e3e47d6/users/ea260b304dc54e1f88daa20f5b7e60c7/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:44:02.032714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78435a02-93a9-4ec2-be3f-a22f548479f7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:02.033017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78435a02-93a9-4ec2-be3f-a22f548479f7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:02.033292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78435a02-93a9-4ec2-be3f-a22f548479f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:02.067366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-78435a02-93a9-4ec2-be3f-a22f548479f7 None None] MFA Rules not processed for user `ea260b304dc54e1f88daa20f5b7e60c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:02.068650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-78435a02-93a9-4ec2-be3f-a22f548479f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:02.181975 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1228/2415] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:02.182956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede73f4a-1bac-425f-ad3b-0b24d610da66 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:02.227527 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:02.257715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78435a02-93a9-4ec2-be3f-a22f548479f7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:02.259681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-78435a02-93a9-4ec2-be3f-a22f548479f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:02.301457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede73f4a-1bac-425f-ad3b-0b24d610da66 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:02.310667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270c7f7-bc78-4db7-ad8b-ee844d6155d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:02.311350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270c7f7-bc78-4db7-ad8b-ee844d6155d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:02.311676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270c7f7-bc78-4db7-ad8b-ee844d6155d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:02.311949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270c7f7-bc78-4db7-ad8b-ee844d6155d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:02.312790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270c7f7-bc78-4db7-ad8b-ee844d6155d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:02.315229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270c7f7-bc78-4db7-ad8b-ee844d6155d1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:02.382393 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1188/2416] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:44:02 2022] POST /identity/v3/projects => generated 375 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:44:02.385174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270c7f7-bc78-4db7-ad8b-ee844d6155d1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:02.474856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78435a02-93a9-4ec2-be3f-a22f548479f7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:02.551929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270c7f7-bc78-4db7-ad8b-ee844d6155d1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:02.569118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd6a59-7ac8-4a37-86fe-35893585f41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:02.569769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd6a59-7ac8-4a37-86fe-35893585f41e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:02.570269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd6a59-7ac8-4a37-86fe-35893585f41e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:02.570388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd6a59-7ac8-4a37-86fe-35893585f41e admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:02.571804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd6a59-7ac8-4a37-86fe-35893585f41e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:02.573776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd6a59-7ac8-4a37-86fe-35893585f41e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:02.634735 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1189/2417] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:44:02 2022] POST /identity/v3/users => generated 294 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:44:02.637266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd6a59-7ac8-4a37-86fe-35893585f41e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:02.638584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcd4d5-eb05-42ef-bb0f-9aafa2f71252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:02.639768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcd4d5-eb05-42ef-bb0f-9aafa2f71252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:02.640274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcd4d5-eb05-42ef-bb0f-9aafa2f71252 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:02.640837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcd4d5-eb05-42ef-bb0f-9aafa2f71252 admin admin] PATH_INFO: `/v3/projects/58b97ac766794428a534ddd17de8bb9c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:02.642857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcd4d5-eb05-42ef-bb0f-9aafa2f71252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58b97ac766794428a534ddd17de8bb9c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:02.645696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcd4d5-eb05-42ef-bb0f-9aafa2f71252 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:02.668946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd6a59-7ac8-4a37-86fe-35893585f41e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:02.677676 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:02.680850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e005fb-1f43-462b-bcbc-318f69cb1772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:02.681928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e005fb-1f43-462b-bcbc-318f69cb1772 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:02.682694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e005fb-1f43-462b-bcbc-318f69cb1772 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:02.683199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e005fb-1f43-462b-bcbc-318f69cb1772 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:02.683997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e005fb-1f43-462b-bcbc-318f69cb1772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:02.688611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e005fb-1f43-462b-bcbc-318f69cb1772 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:02.725971 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1190/2418] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:44:02.726993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e005fb-1f43-462b-bcbc-318f69cb1772 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:02.757542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e005fb-1f43-462b-bcbc-318f69cb1772 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:02.759930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f8bcd4d5-eb05-42ef-bb0f-9aafa2f71252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58b97ac766794428a534ddd17de8bb9c', 'request_id': 'req-f8bcd4d5-eb05-42ef-bb0f-9aafa2f71252'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:02.778943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f8bcd4d5-eb05-42ef-bb0f-9aafa2f71252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58b97ac766794428a534ddd17de8bb9c', 'request_id': 'req-f8bcd4d5-eb05-42ef-bb0f-9aafa2f71252'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:02.787319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f8bcd4d5-eb05-42ef-bb0f-9aafa2f71252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58b97ac766794428a534ddd17de8bb9c', 'request_id': 'req-f8bcd4d5-eb05-42ef-bb0f-9aafa2f71252'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:02.826317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f8bcd4d5-eb05-42ef-bb0f-9aafa2f71252 admin admin] The token cache is being invalidate because project 58b97ac766794428a534ddd17de8bb9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:44:02.826783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f8bcd4d5-eb05-42ef-bb0f-9aafa2f71252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:02.827613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f8bcd4d5-eb05-42ef-bb0f-9aafa2f71252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:02.830709 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1229/2419] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:44:02 2022] DELETE /identity/v3/projects/58b97ac766794428a534ddd17de8bb9c => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:02.835575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcd4d5-eb05-42ef-bb0f-9aafa2f71252 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:02.845253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f8bcd4d5-eb05-42ef-bb0f-9aafa2f71252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:02.875270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db93bb1-d4f9-4e2f-ac61-8838040273a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:02.876563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db93bb1-d4f9-4e2f-ac61-8838040273a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:02.877036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db93bb1-d4f9-4e2f-ac61-8838040273a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:02.877708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db93bb1-d4f9-4e2f-ac61-8838040273a4 admin admin] PATH_INFO: `/v3/projects/d93122ba0bc742caac1105905c39640b/users/2199a70ae7714d51b45e9cda069c6302/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:02.900381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db93bb1-d4f9-4e2f-ac61-8838040273a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93122ba0bc742caac1105905c39640b, user_id=2199a70ae7714d51b45e9cda069c6302, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:02.903414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db93bb1-d4f9-4e2f-ac61-8838040273a4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:02.946410 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1191/2420] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:44:02 2022] PUT /identity/v3/projects/d93122ba0bc742caac1105905c39640b/users/2199a70ae7714d51b45e9cda069c6302/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:02.950058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db93bb1-d4f9-4e2f-ac61-8838040273a4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:02.953518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7db93bb1-d4f9-4e2f-ac61-8838040273a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:02.971682 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:03.017189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcd4d5-eb05-42ef-bb0f-9aafa2f71252 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:03.122996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db93bb1-d4f9-4e2f-ac61-8838040273a4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:03.142279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d645b-3813-485e-9136-14222aeb3c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:03.143061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d645b-3813-485e-9136-14222aeb3c40 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:03.143454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d645b-3813-485e-9136-14222aeb3c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:03.143788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d645b-3813-485e-9136-14222aeb3c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:03.144543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d645b-3813-485e-9136-14222aeb3c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:03.146595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d645b-3813-485e-9136-14222aeb3c40 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:03.149844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73581d07-6220-438e-b32f-61d4785801a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:03.151100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73581d07-6220-438e-b32f-61d4785801a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:03.151787 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73581d07-6220-438e-b32f-61d4785801a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:03.152295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73581d07-6220-438e-b32f-61d4785801a8 admin admin] PATH_INFO: `/v3/users/102e2be78faf4b15a9d32c5fa55db5a0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:03.154519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73581d07-6220-438e-b32f-61d4785801a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=102e2be78faf4b15a9d32c5fa55db5a0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:03.161185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73581d07-6220-438e-b32f-61d4785801a8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:03.169507 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1192/2421] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:44:03.174085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d645b-3813-485e-9136-14222aeb3c40 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:03.193874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d645b-3813-485e-9136-14222aeb3c40 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:03.207306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c8253-5f1e-4a5f-bc10-029c942f7d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:03.208268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c8253-5f1e-4a5f-bc10-029c942f7d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:03.208685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c8253-5f1e-4a5f-bc10-029c942f7d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:03.209153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c8253-5f1e-4a5f-bc10-029c942f7d60 admin admin] PATH_INFO: `/v3/projects/d93122ba0bc742caac1105905c39640b/users/2199a70ae7714d51b45e9cda069c6302/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:03.214832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c8253-5f1e-4a5f-bc10-029c942f7d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93122ba0bc742caac1105905c39640b, user_id=2199a70ae7714d51b45e9cda069c6302, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:03.218601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c8253-5f1e-4a5f-bc10-029c942f7d60 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:03.252330 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1193/2422] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:44:03 2022] PUT /identity/v3/projects/d93122ba0bc742caac1105905c39640b/users/2199a70ae7714d51b45e9cda069c6302/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:03.263596 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33105e24-0bdc-43b9-8c8e-05ed12ef776c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:03.263986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33105e24-0bdc-43b9-8c8e-05ed12ef776c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:03.264397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33105e24-0bdc-43b9-8c8e-05ed12ef776c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:03.293037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-73581d07-6220-438e-b32f-61d4785801a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '102e2be78faf4b15a9d32c5fa55db5a0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:03.294687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-73581d07-6220-438e-b32f-61d4785801a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '102e2be78faf4b15a9d32c5fa55db5a0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:03.302660 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:03.315657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-73581d07-6220-438e-b32f-61d4785801a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '102e2be78faf4b15a9d32c5fa55db5a0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:03.326787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-33105e24-0bdc-43b9-8c8e-05ed12ef776c None None] MFA Rules not processed for user `2199a70ae7714d51b45e9cda069c6302`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:03.328166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-33105e24-0bdc-43b9-8c8e-05ed12ef776c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:03.350854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-73581d07-6220-438e-b32f-61d4785801a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '102e2be78faf4b15a9d32c5fa55db5a0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:03.369720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-73581d07-6220-438e-b32f-61d4785801a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '102e2be78faf4b15a9d32c5fa55db5a0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:03.394723 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1230/2423] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:44:02 2022] DELETE /identity/v3/users/102e2be78faf4b15a9d32c5fa55db5a0 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:44:03.505248 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1194/2424] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:44:04.202542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73581d07-6220-438e-b32f-61d4785801a8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:04.204007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-73581d07-6220-438e-b32f-61d4785801a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:04.376107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73581d07-6220-438e-b32f-61d4785801a8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:04.399967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef7e09-e173-4e8e-9458-bd9a22287617 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:04.400677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef7e09-e173-4e8e-9458-bd9a22287617 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:04.400934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef7e09-e173-4e8e-9458-bd9a22287617 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:04.401247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef7e09-e173-4e8e-9458-bd9a22287617 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:04.460760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5f4b3-59e9-4be9-89c9-7cb2c0997f63 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:04.461623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5f4b3-59e9-4be9-89c9-7cb2c0997f63 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:04.462068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5f4b3-59e9-4be9-89c9-7cb2c0997f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:04.513818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef7e09-e173-4e8e-9458-bd9a22287617 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:04.516786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bfb5f4b3-59e9-4be9-89c9-7cb2c0997f63 None None] MFA Rules not processed for user `22e55fa3cbc34ea19c099f2859dd7ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:04.518059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bfb5f4b3-59e9-4be9-89c9-7cb2c0997f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:04.519952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef7e09-e173-4e8e-9458-bd9a22287617 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:04.554618 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1231/2425] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:44:04.656355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef7e09-e173-4e8e-9458-bd9a22287617 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:04.664233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f8ef7e09-e173-4e8e-9458-bd9a22287617 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:04.731336 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1195/2426] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:04.925796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef7e09-e173-4e8e-9458-bd9a22287617 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:04.944366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4326c-8e00-4f65-811e-339ff240896c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:04.945469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4326c-8e00-4f65-811e-339ff240896c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:04.945933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4326c-8e00-4f65-811e-339ff240896c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:04.946403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4326c-8e00-4f65-811e-339ff240896c admin admin] PATH_INFO: `/v3/projects/cf818192d9f14c1e8c2958a32163ad41` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:04.957606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4326c-8e00-4f65-811e-339ff240896c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf818192d9f14c1e8c2958a32163ad41)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:04.960039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4326c-8e00-4f65-811e-339ff240896c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:04.962314 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:05.076804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2de4326c-8e00-4f65-811e-339ff240896c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf818192d9f14c1e8c2958a32163ad41', 'request_id': 'req-2de4326c-8e00-4f65-811e-339ff240896c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:05.099983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2de4326c-8e00-4f65-811e-339ff240896c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf818192d9f14c1e8c2958a32163ad41', 'request_id': 'req-2de4326c-8e00-4f65-811e-339ff240896c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:05.125524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2de4326c-8e00-4f65-811e-339ff240896c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf818192d9f14c1e8c2958a32163ad41', 'request_id': 'req-2de4326c-8e00-4f65-811e-339ff240896c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:05.178729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2de4326c-8e00-4f65-811e-339ff240896c admin admin] The token cache is being invalidate because project cf818192d9f14c1e8c2958a32163ad41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:44:05.184023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2de4326c-8e00-4f65-811e-339ff240896c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:05.187750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2de4326c-8e00-4f65-811e-339ff240896c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:05.191326 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1232/2427] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:44:04 2022] DELETE /identity/v3/projects/cf818192d9f14c1e8c2958a32163ad41 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:44:05.197904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b30a03-c425-4b37-9caf-68d691f4af3b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:05.198319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b30a03-c425-4b37-9caf-68d691f4af3b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:05.199409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b30a03-c425-4b37-9caf-68d691f4af3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:05.257151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-95b30a03-c425-4b37-9caf-68d691f4af3b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:05.258464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-95b30a03-c425-4b37-9caf-68d691f4af3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:05.300615 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:05.463011 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1196/2428] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:05.465250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb37075-8419-47f5-98c8-4bfa957173aa None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:05.466070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb37075-8419-47f5-98c8-4bfa957173aa None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:05.466580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb37075-8419-47f5-98c8-4bfa957173aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:05.504371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7eb37075-8419-47f5-98c8-4bfa957173aa None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:05.507588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7eb37075-8419-47f5-98c8-4bfa957173aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:05.530298 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1233/2429] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:44:05.534538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b30a03-c425-4b37-9caf-68d691f4af3b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:05.549725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b30a03-c425-4b37-9caf-68d691f4af3b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:05.561479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001467c-feb3-4b1e-bcef-f7f0c82e4507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:05.563325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001467c-feb3-4b1e-bcef-f7f0c82e4507 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:05.563685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001467c-feb3-4b1e-bcef-f7f0c82e4507 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:05.563971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001467c-feb3-4b1e-bcef-f7f0c82e4507 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:05.565583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001467c-feb3-4b1e-bcef-f7f0c82e4507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:44:05.567168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001467c-feb3-4b1e-bcef-f7f0c82e4507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:05.571262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001467c-feb3-4b1e-bcef-f7f0c82e4507 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:05.607927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb37075-8419-47f5-98c8-4bfa957173aa None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:05.613157 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1197/2430] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:44:05.622999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb37075-8419-47f5-98c8-4bfa957173aa None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:05.638111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17a6fd-d940-4c76-90b3-eaacb79c18c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:05.638739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17a6fd-d940-4c76-90b3-eaacb79c18c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:05.641639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17a6fd-d940-4c76-90b3-eaacb79c18c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:05.641939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17a6fd-d940-4c76-90b3-eaacb79c18c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:05.644002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17a6fd-d940-4c76-90b3-eaacb79c18c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:05.650668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17a6fd-d940-4c76-90b3-eaacb79c18c5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:05.728273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001467c-feb3-4b1e-bcef-f7f0c82e4507 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:05.734678 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1234/2431] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:44:05 2022] POST /identity/v3/projects => generated 395 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:44:05.740316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001467c-feb3-4b1e-bcef-f7f0c82e4507 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:05.918677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62342f5-c3ba-44f3-8a3f-436c5f157753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:05.918677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62342f5-c3ba-44f3-8a3f-436c5f157753 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:05.918677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62342f5-c3ba-44f3-8a3f-436c5f157753 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:05.918677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62342f5-c3ba-44f3-8a3f-436c5f157753 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:05.919460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62342f5-c3ba-44f3-8a3f-436c5f157753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:05.926363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62342f5-c3ba-44f3-8a3f-436c5f157753 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:05.984239 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1198/2432] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:44:05 2022] POST /identity/v3/users => generated 298 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:44:05.985872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17a6fd-d940-4c76-90b3-eaacb79c18c5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:06.013736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17a6fd-d940-4c76-90b3-eaacb79c18c5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:06.026343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae50f3-977c-4ed5-b234-0dc11fe2b676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:06.026968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae50f3-977c-4ed5-b234-0dc11fe2b676 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:06.029187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae50f3-977c-4ed5-b234-0dc11fe2b676 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:06.029485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae50f3-977c-4ed5-b234-0dc11fe2b676 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:06.030163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae50f3-977c-4ed5-b234-0dc11fe2b676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:06.036399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae50f3-977c-4ed5-b234-0dc11fe2b676 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:06.071834 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1235/2433] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:44:06.073883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62342f5-c3ba-44f3-8a3f-436c5f157753 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:06.093307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62342f5-c3ba-44f3-8a3f-436c5f157753 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:06.107697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e75e8d-099b-4ee8-b446-5fa97f64768d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:06.109501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e75e8d-099b-4ee8-b446-5fa97f64768d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:06.110082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e75e8d-099b-4ee8-b446-5fa97f64768d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:06.110368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e75e8d-099b-4ee8-b446-5fa97f64768d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:06.113704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e75e8d-099b-4ee8-b446-5fa97f64768d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:06.117107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e75e8d-099b-4ee8-b446-5fa97f64768d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:06.157517 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1199/2434] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:44:06.161803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae50f3-977c-4ed5-b234-0dc11fe2b676 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:06.196966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae50f3-977c-4ed5-b234-0dc11fe2b676 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:06.225592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfaba80-1f94-4c8a-adcc-ae99eec9fda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:06.228121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfaba80-1f94-4c8a-adcc-ae99eec9fda3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:06.228410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfaba80-1f94-4c8a-adcc-ae99eec9fda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:06.231094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfaba80-1f94-4c8a-adcc-ae99eec9fda3 admin admin] PATH_INFO: `/v3/projects/5c529a13b1ac4bb9a1733d26e478ac65/users/74ca7b7e17b141819d71f7ad64c36463/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:06.284237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfaba80-1f94-4c8a-adcc-ae99eec9fda3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c529a13b1ac4bb9a1733d26e478ac65, user_id=74ca7b7e17b141819d71f7ad64c36463, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:06.291006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfaba80-1f94-4c8a-adcc-ae99eec9fda3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:06.334353 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1236/2435] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:44:06 2022] PUT /identity/v3/projects/5c529a13b1ac4bb9a1733d26e478ac65/users/74ca7b7e17b141819d71f7ad64c36463/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:06.338808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947d340-d258-4aa0-ba24-097afc3c171a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:06.339418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947d340-d258-4aa0-ba24-097afc3c171a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:06.339900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947d340-d258-4aa0-ba24-097afc3c171a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:06.414006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6947d340-d258-4aa0-ba24-097afc3c171a None None] MFA Rules not processed for user `74ca7b7e17b141819d71f7ad64c36463`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:06.415926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6947d340-d258-4aa0-ba24-097afc3c171a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:06.616892 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1200/2436] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:06 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:06.624151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfaba80-1f94-4c8a-adcc-ae99eec9fda3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:06.758388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfaba80-1f94-4c8a-adcc-ae99eec9fda3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:06.767962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34034c7-59cd-4f87-87fd-3e6be5cc8c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:06.768910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34034c7-59cd-4f87-87fd-3e6be5cc8c03 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:06.781096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34034c7-59cd-4f87-87fd-3e6be5cc8c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:06.781452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34034c7-59cd-4f87-87fd-3e6be5cc8c03 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:06.782138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34034c7-59cd-4f87-87fd-3e6be5cc8c03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:06.786700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34034c7-59cd-4f87-87fd-3e6be5cc8c03 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:06.873016 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1237/2437] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:44:06 2022] POST /identity/v3/projects => generated 395 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:44:06.877396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947d340-d258-4aa0-ba24-097afc3c171a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:06.894392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947d340-d258-4aa0-ba24-097afc3c171a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:06.951107 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:07.088293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47a709-408a-4c31-911a-4d410538a44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:07.089036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47a709-408a-4c31-911a-4d410538a44e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:07.089319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47a709-408a-4c31-911a-4d410538a44e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:07.089594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47a709-408a-4c31-911a-4d410538a44e admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:07.092501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47a709-408a-4c31-911a-4d410538a44e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:07.100966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47a709-408a-4c31-911a-4d410538a44e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:07.153812 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1201/2438] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:44:06 2022] POST /identity/v3/users => generated 304 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:44:07.158321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34034c7-59cd-4f87-87fd-3e6be5cc8c03 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:07.173495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34034c7-59cd-4f87-87fd-3e6be5cc8c03 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:07.200751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365c7be-2979-4f58-90e1-22e5a17aac44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:07.200751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365c7be-2979-4f58-90e1-22e5a17aac44 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:07.210674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365c7be-2979-4f58-90e1-22e5a17aac44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:07.211837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365c7be-2979-4f58-90e1-22e5a17aac44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:07.213328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365c7be-2979-4f58-90e1-22e5a17aac44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:07.226165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365c7be-2979-4f58-90e1-22e5a17aac44 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:07.237406 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:07.248246 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1238/2439] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:44:07.251360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47a709-408a-4c31-911a-4d410538a44e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:07.271058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47a709-408a-4c31-911a-4d410538a44e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:07.289262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ed5d5-1ce9-440e-b005-7dc920dc4eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:07.290052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ed5d5-1ce9-440e-b005-7dc920dc4eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:07.290334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ed5d5-1ce9-440e-b005-7dc920dc4eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:07.290738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ed5d5-1ce9-440e-b005-7dc920dc4eb7 admin admin] PATH_INFO: `/v3/projects/afa1c9dd9ba841098ecfe5c4ec9a15e5/users/ffa8499667ff4748a7313c22555942e4/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:07.332551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ed5d5-1ce9-440e-b005-7dc920dc4eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa1c9dd9ba841098ecfe5c4ec9a15e5, user_id=ffa8499667ff4748a7313c22555942e4, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:07.343295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ed5d5-1ce9-440e-b005-7dc920dc4eb7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:07.368949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365c7be-2979-4f58-90e1-22e5a17aac44 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:07.378030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7365c7be-2979-4f58-90e1-22e5a17aac44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:07.383681 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1202/2440] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:44:07 2022] PUT /identity/v3/projects/afa1c9dd9ba841098ecfe5c4ec9a15e5/users/ffa8499667ff4748a7313c22555942e4/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:07.387550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ed5d5-1ce9-440e-b005-7dc920dc4eb7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:07.427333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365c7be-2979-4f58-90e1-22e5a17aac44 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:07.611769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405266b-02c0-441c-bb1a-34aa78466d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:07.612829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405266b-02c0-441c-bb1a-34aa78466d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:07.613400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405266b-02c0-441c-bb1a-34aa78466d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:07.614594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405266b-02c0-441c-bb1a-34aa78466d71 admin admin] PATH_INFO: `/v3/users/ea260b304dc54e1f88daa20f5b7e60c7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:07.617007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405266b-02c0-441c-bb1a-34aa78466d71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea260b304dc54e1f88daa20f5b7e60c7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:07.619231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405266b-02c0-441c-bb1a-34aa78466d71 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:07.662303 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ed5d5-1ce9-440e-b005-7dc920dc4eb7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:07.682235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d2004-a3bb-4a65-a970-d141ab714fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:07.683131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d2004-a3bb-4a65-a970-d141ab714fab admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:07.683564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d2004-a3bb-4a65-a970-d141ab714fab admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:07.683986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d2004-a3bb-4a65-a970-d141ab714fab admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:07.685335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d2004-a3bb-4a65-a970-d141ab714fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:07.702951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d2004-a3bb-4a65-a970-d141ab714fab admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:07.750070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e405266b-02c0-441c-bb1a-34aa78466d71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea260b304dc54e1f88daa20f5b7e60c7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:07.751061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e405266b-02c0-441c-bb1a-34aa78466d71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea260b304dc54e1f88daa20f5b7e60c7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:07.752801 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1203/2441] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:44:07.753756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d2004-a3bb-4a65-a970-d141ab714fab admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:07.762721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-716d2004-a3bb-4a65-a970-d141ab714fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:07.775918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e405266b-02c0-441c-bb1a-34aa78466d71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea260b304dc54e1f88daa20f5b7e60c7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:07.811442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d2004-a3bb-4a65-a970-d141ab714fab admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:07.813972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e405266b-02c0-441c-bb1a-34aa78466d71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea260b304dc54e1f88daa20f5b7e60c7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:07.842232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36324a9f-7b24-4ec0-ba8e-58c9ede975b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:07.844017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36324a9f-7b24-4ec0-ba8e-58c9ede975b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:07.844967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36324a9f-7b24-4ec0-ba8e-58c9ede975b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:07.852621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36324a9f-7b24-4ec0-ba8e-58c9ede975b1 admin admin] PATH_INFO: `/v3/users/9b6d093a37724438bb84003ff830b219` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:07.855660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36324a9f-7b24-4ec0-ba8e-58c9ede975b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6d093a37724438bb84003ff830b219)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:07.857748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e405266b-02c0-441c-bb1a-34aa78466d71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea260b304dc54e1f88daa20f5b7e60c7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:07.859315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36324a9f-7b24-4ec0-ba8e-58c9ede975b1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:07.871397 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1239/2442] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:44:07 2022] DELETE /identity/v3/users/ea260b304dc54e1f88daa20f5b7e60c7 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:07.874281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405266b-02c0-441c-bb1a-34aa78466d71 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:07.876711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e405266b-02c0-441c-bb1a-34aa78466d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:07.986917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36324a9f-7b24-4ec0-ba8e-58c9ede975b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6d093a37724438bb84003ff830b219'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:08.003156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36324a9f-7b24-4ec0-ba8e-58c9ede975b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6d093a37724438bb84003ff830b219'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:08.005155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36324a9f-7b24-4ec0-ba8e-58c9ede975b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6d093a37724438bb84003ff830b219'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:08.052480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36324a9f-7b24-4ec0-ba8e-58c9ede975b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6d093a37724438bb84003ff830b219'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:08.056407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405266b-02c0-441c-bb1a-34aa78466d71 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:08.061811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86712bd7-01f4-43b2-834a-d3bb73cbfe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:08.063444 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:08.064534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86712bd7-01f4-43b2-834a-d3bb73cbfe20 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:08.064854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86712bd7-01f4-43b2-834a-d3bb73cbfe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:08.065125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86712bd7-01f4-43b2-834a-d3bb73cbfe20 admin admin] PATH_INFO: `/v3/projects/afa1c9dd9ba841098ecfe5c4ec9a15e5/users/ffa8499667ff4748a7313c22555942e4/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:08.068232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86712bd7-01f4-43b2-834a-d3bb73cbfe20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa1c9dd9ba841098ecfe5c4ec9a15e5, user_id=ffa8499667ff4748a7313c22555942e4, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:08.072812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86712bd7-01f4-43b2-834a-d3bb73cbfe20 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:08.086513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36324a9f-7b24-4ec0-ba8e-58c9ede975b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6d093a37724438bb84003ff830b219'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:08.094344 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1240/2443] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:44:07 2022] PUT /identity/v3/projects/afa1c9dd9ba841098ecfe5c4ec9a15e5/users/ffa8499667ff4748a7313c22555942e4/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:08.095852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af3c7e-d511-453b-b08b-d31c4ee8edc2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:08.096294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af3c7e-d511-453b-b08b-d31c4ee8edc2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:08.096779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af3c7e-d511-453b-b08b-d31c4ee8edc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:08.107567 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1204/2444] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:44:07 2022] DELETE /identity/v3/users/9b6d093a37724438bb84003ff830b219 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:08.107567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abdd9f-3456-401d-84d6-bae97da18a97 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:08.107567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abdd9f-3456-401d-84d6-bae97da18a97 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:08.107567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abdd9f-3456-401d-84d6-bae97da18a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:08.125462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-30af3c7e-d511-453b-b08b-d31c4ee8edc2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:08.127627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-30af3c7e-d511-453b-b08b-d31c4ee8edc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:08.141514 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:08.150341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-02abdd9f-3456-401d-84d6-bae97da18a97 None None] MFA Rules not processed for user `ffa8499667ff4748a7313c22555942e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:08.151882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-02abdd9f-3456-401d-84d6-bae97da18a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:08.236377 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1241/2445] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:08.236377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d202435-36fa-4ba5-9382-4fa8e4247de9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:08.236377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d202435-36fa-4ba5-9382-4fa8e4247de9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:08.236721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d202435-36fa-4ba5-9382-4fa8e4247de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:08.262140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1d202435-36fa-4ba5-9382-4fa8e4247de9 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:08.263785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1d202435-36fa-4ba5-9382-4fa8e4247de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:08.277750 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1242/2446] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:08.278534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d202435-36fa-4ba5-9382-4fa8e4247de9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:08.279982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1d202435-36fa-4ba5-9382-4fa8e4247de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:08.287493 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1205/2447] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:08 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:08.288782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abdd9f-3456-401d-84d6-bae97da18a97 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:08.290355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-02abdd9f-3456-401d-84d6-bae97da18a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:08.371790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d202435-36fa-4ba5-9382-4fa8e4247de9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:08.378842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abdd9f-3456-401d-84d6-bae97da18a97 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:08.386032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73698bf-c141-4a1b-918e-8bc7c5ddf4de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:08.387263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73698bf-c141-4a1b-918e-8bc7c5ddf4de service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:08.387819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73698bf-c141-4a1b-918e-8bc7c5ddf4de service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:08.388319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73698bf-c141-4a1b-918e-8bc7c5ddf4de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:08.399122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90323a-d0e6-4cd4-b804-547fc5ed7e27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:08.399787 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90323a-d0e6-4cd4-b804-547fc5ed7e27 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:08.400038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90323a-d0e6-4cd4-b804-547fc5ed7e27 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:08.407649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73698bf-c141-4a1b-918e-8bc7c5ddf4de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:08.414120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90323a-d0e6-4cd4-b804-547fc5ed7e27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:08.425379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73698bf-c141-4a1b-918e-8bc7c5ddf4de service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:08.440784 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1206/2448] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:44:08.442305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158c649-5759-4b0e-aed8-70e27090dfc2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:08.442793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158c649-5759-4b0e-aed8-70e27090dfc2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:08.443435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158c649-5759-4b0e-aed8-70e27090dfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:08.462645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90323a-d0e6-4cd4-b804-547fc5ed7e27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:08.464108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90323a-d0e6-4cd4-b804-547fc5ed7e27 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:08.520681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9158c649-5759-4b0e-aed8-70e27090dfc2 None None] MFA Rules not processed for user `74ca7b7e17b141819d71f7ad64c36463`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:08.524063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9158c649-5759-4b0e-aed8-70e27090dfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:08.543943 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1243/2449] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:44:08.677519 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1207/2450] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:08 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:08.687308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90323a-d0e6-4cd4-b804-547fc5ed7e27 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:08.688946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0f90323a-d0e6-4cd4-b804-547fc5ed7e27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:08.836229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90323a-d0e6-4cd4-b804-547fc5ed7e27 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:08.845267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bf428-a041-471c-92c5-8e3ee6fc1b7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:08.846571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bf428-a041-471c-92c5-8e3ee6fc1b7b service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:08.847062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bf428-a041-471c-92c5-8e3ee6fc1b7b service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:08.847495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bf428-a041-471c-92c5-8e3ee6fc1b7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:08.849666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-631bf428-a041-471c-92c5-8e3ee6fc1b7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:08.863409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bf428-a041-471c-92c5-8e3ee6fc1b7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:08.865041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bf428-a041-471c-92c5-8e3ee6fc1b7b service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:08.879337 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1244/2451] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:08 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:44:09.517645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158c649-5759-4b0e-aed8-70e27090dfc2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:09.520081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9158c649-5759-4b0e-aed8-70e27090dfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:09.543900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158c649-5759-4b0e-aed8-70e27090dfc2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:09.551230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb1b28-91a7-447e-95c5-b5cb33d2397e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:09.551873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb1b28-91a7-447e-95c5-b5cb33d2397e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:09.552502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb1b28-91a7-447e-95c5-b5cb33d2397e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:09.552933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb1b28-91a7-447e-95c5-b5cb33d2397e admin admin] PATH_INFO: `/v3/projects/fda7b9f12da94cc4b9dd8847ff4bfbf9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:09.554554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb1b28-91a7-447e-95c5-b5cb33d2397e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fda7b9f12da94cc4b9dd8847ff4bfbf9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:09.556920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb1b28-91a7-447e-95c5-b5cb33d2397e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:09.585268 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:09.683438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0fcb1b28-91a7-447e-95c5-b5cb33d2397e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fda7b9f12da94cc4b9dd8847ff4bfbf9', 'request_id': 'req-0fcb1b28-91a7-447e-95c5-b5cb33d2397e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:09.704153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0fcb1b28-91a7-447e-95c5-b5cb33d2397e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fda7b9f12da94cc4b9dd8847ff4bfbf9', 'request_id': 'req-0fcb1b28-91a7-447e-95c5-b5cb33d2397e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:09.719430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0fcb1b28-91a7-447e-95c5-b5cb33d2397e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fda7b9f12da94cc4b9dd8847ff4bfbf9', 'request_id': 'req-0fcb1b28-91a7-447e-95c5-b5cb33d2397e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:09.764529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0fcb1b28-91a7-447e-95c5-b5cb33d2397e admin admin] The token cache is being invalidate because project fda7b9f12da94cc4b9dd8847ff4bfbf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:44:09.765654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0fcb1b28-91a7-447e-95c5-b5cb33d2397e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:09.766744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0fcb1b28-91a7-447e-95c5-b5cb33d2397e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:09.769758 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1208/2452] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:44:09 2022] DELETE /identity/v3/projects/fda7b9f12da94cc4b9dd8847ff4bfbf9 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:09.775380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bf428-a041-471c-92c5-8e3ee6fc1b7b service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:09.793632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bf428-a041-471c-92c5-8e3ee6fc1b7b service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:09.877466 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:09.974255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9d435-cfcb-4055-9a50-96ec22a9e0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:09.974630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9d435-cfcb-4055-9a50-96ec22a9e0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:09.974941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9d435-cfcb-4055-9a50-96ec22a9e0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:09.976669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9d435-cfcb-4055-9a50-96ec22a9e0f2 admin admin] PATH_INFO: `/v3/users/7ea606bb1e78487c83e0ccddac005ea3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:09.978658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9d435-cfcb-4055-9a50-96ec22a9e0f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea606bb1e78487c83e0ccddac005ea3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:09.980368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9d435-cfcb-4055-9a50-96ec22a9e0f2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:10.066660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-86c9d435-cfcb-4055-9a50-96ec22a9e0f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea606bb1e78487c83e0ccddac005ea3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:10.067357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-86c9d435-cfcb-4055-9a50-96ec22a9e0f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea606bb1e78487c83e0ccddac005ea3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:10.087267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-86c9d435-cfcb-4055-9a50-96ec22a9e0f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea606bb1e78487c83e0ccddac005ea3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:10.130154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-86c9d435-cfcb-4055-9a50-96ec22a9e0f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea606bb1e78487c83e0ccddac005ea3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:10.169614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-86c9d435-cfcb-4055-9a50-96ec22a9e0f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea606bb1e78487c83e0ccddac005ea3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:10.185556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb1b28-91a7-447e-95c5-b5cb33d2397e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:10.187319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0fcb1b28-91a7-447e-95c5-b5cb33d2397e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:10.206042 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1245/2453] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:44:09 2022] DELETE /identity/v3/users/7ea606bb1e78487c83e0ccddac005ea3 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:10.219248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb1b28-91a7-447e-95c5-b5cb33d2397e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:10.396119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c8af7-f545-4db4-a216-a88caeb051a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:10.397168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c8af7-f545-4db4-a216-a88caeb051a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:10.397650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c8af7-f545-4db4-a216-a88caeb051a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:10.398120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c8af7-f545-4db4-a216-a88caeb051a8 admin admin] PATH_INFO: `/v3/projects/a3569afafabc41fb9db28ec51e3e47d6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:10.399839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c8af7-f545-4db4-a216-a88caeb051a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3569afafabc41fb9db28ec51e3e47d6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:10.402390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c8af7-f545-4db4-a216-a88caeb051a8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:10.562976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e42c8af7-f545-4db4-a216-a88caeb051a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3569afafabc41fb9db28ec51e3e47d6', 'request_id': 'req-e42c8af7-f545-4db4-a216-a88caeb051a8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:10.581220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e42c8af7-f545-4db4-a216-a88caeb051a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3569afafabc41fb9db28ec51e3e47d6', 'request_id': 'req-e42c8af7-f545-4db4-a216-a88caeb051a8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:10.601868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e42c8af7-f545-4db4-a216-a88caeb051a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3569afafabc41fb9db28ec51e3e47d6', 'request_id': 'req-e42c8af7-f545-4db4-a216-a88caeb051a8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:10.635491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e42c8af7-f545-4db4-a216-a88caeb051a8 admin admin] The token cache is being invalidate because project a3569afafabc41fb9db28ec51e3e47d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:44:10.635790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e42c8af7-f545-4db4-a216-a88caeb051a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:10.641106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e42c8af7-f545-4db4-a216-a88caeb051a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:10.650534 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1209/2454] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:44:10 2022] DELETE /identity/v3/projects/a3569afafabc41fb9db28ec51e3e47d6 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:10.651213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9d435-cfcb-4055-9a50-96ec22a9e0f2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:10.652843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-86c9d435-cfcb-4055-9a50-96ec22a9e0f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:10.679502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9d435-cfcb-4055-9a50-96ec22a9e0f2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:10.814940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506b695-eede-4049-9b09-105c9df8f2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:10.815846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506b695-eede-4049-9b09-105c9df8f2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:10.816815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506b695-eede-4049-9b09-105c9df8f2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:10.817251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506b695-eede-4049-9b09-105c9df8f2e1 admin admin] PATH_INFO: `/v3/users/2199a70ae7714d51b45e9cda069c6302` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:10.819726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506b695-eede-4049-9b09-105c9df8f2e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2199a70ae7714d51b45e9cda069c6302)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:10.822943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506b695-eede-4049-9b09-105c9df8f2e1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:10.921030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0506b695-eede-4049-9b09-105c9df8f2e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2199a70ae7714d51b45e9cda069c6302'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:10.922821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0506b695-eede-4049-9b09-105c9df8f2e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2199a70ae7714d51b45e9cda069c6302'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:10.949672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0506b695-eede-4049-9b09-105c9df8f2e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2199a70ae7714d51b45e9cda069c6302'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:10.953144 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:10.975817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0506b695-eede-4049-9b09-105c9df8f2e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2199a70ae7714d51b45e9cda069c6302'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:11.001819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0506b695-eede-4049-9b09-105c9df8f2e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2199a70ae7714d51b45e9cda069c6302'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:11.023106 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1246/2455] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:44:10 2022] DELETE /identity/v3/users/2199a70ae7714d51b45e9cda069c6302 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:44:11.204043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c8af7-f545-4db4-a216-a88caeb051a8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:11.209392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e42c8af7-f545-4db4-a216-a88caeb051a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:11.227046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c8af7-f545-4db4-a216-a88caeb051a8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:11.312149 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:11.358630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0632024-29fc-4893-98db-5b4834ff108b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:11.359582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0632024-29fc-4893-98db-5b4834ff108b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:11.359959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0632024-29fc-4893-98db-5b4834ff108b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:11.360325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0632024-29fc-4893-98db-5b4834ff108b admin admin] PATH_INFO: `/v3/projects/f426dcd17f4a4a01bd4df248b2165f29` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:11.362617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0632024-29fc-4893-98db-5b4834ff108b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f426dcd17f4a4a01bd4df248b2165f29)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:11.366063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0632024-29fc-4893-98db-5b4834ff108b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:11.470404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aefbbb-6a49-4442-b031-0cdcf327e566 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:11.470772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aefbbb-6a49-4442-b031-0cdcf327e566 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:11.471056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aefbbb-6a49-4442-b031-0cdcf327e566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:11.492534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0632024-29fc-4893-98db-5b4834ff108b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f426dcd17f4a4a01bd4df248b2165f29', 'request_id': 'req-e0632024-29fc-4893-98db-5b4834ff108b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:11.512369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0632024-29fc-4893-98db-5b4834ff108b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f426dcd17f4a4a01bd4df248b2165f29', 'request_id': 'req-e0632024-29fc-4893-98db-5b4834ff108b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:11.524434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0632024-29fc-4893-98db-5b4834ff108b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f426dcd17f4a4a01bd4df248b2165f29', 'request_id': 'req-e0632024-29fc-4893-98db-5b4834ff108b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:11.552996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0632024-29fc-4893-98db-5b4834ff108b admin admin] The token cache is being invalidate because project f426dcd17f4a4a01bd4df248b2165f29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:44:11.554335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0632024-29fc-4893-98db-5b4834ff108b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:11.555160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0632024-29fc-4893-98db-5b4834ff108b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:11.561477 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1210/2456] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:44:11 2022] DELETE /identity/v3/projects/f426dcd17f4a4a01bd4df248b2165f29 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:11.566674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9376ec-be58-4662-a93f-d797026eb5f5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:11.566933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9376ec-be58-4662-a93f-d797026eb5f5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:11.567409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9376ec-be58-4662-a93f-d797026eb5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:11.583881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-70aefbbb-6a49-4442-b031-0cdcf327e566 None None] MFA Rules not processed for user `5ee27b6e2411469d9ef72ad8a7e6491f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:11.586564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-70aefbbb-6a49-4442-b031-0cdcf327e566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:11.652418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cf9376ec-be58-4662-a93f-d797026eb5f5 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:11.653757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cf9376ec-be58-4662-a93f-d797026eb5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:11.687694 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1247/2457] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:11.688942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aefbbb-6a49-4442-b031-0cdcf327e566 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:11.693351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-70aefbbb-6a49-4442-b031-0cdcf327e566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:11.783483 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1211/2458] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:11.793000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427c35f-2e54-4d22-b094-5fb9359c2408 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:11.793277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427c35f-2e54-4d22-b094-5fb9359c2408 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:11.793722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427c35f-2e54-4d22-b094-5fb9359c2408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:11.840070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a427c35f-2e54-4d22-b094-5fb9359c2408 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:11.841683 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a427c35f-2e54-4d22-b094-5fb9359c2408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:11.857267 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1212/2459] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:11.861087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427c35f-2e54-4d22-b094-5fb9359c2408 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:11.872664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aefbbb-6a49-4442-b031-0cdcf327e566 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:11.877169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427c35f-2e54-4d22-b094-5fb9359c2408 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:11.882958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba76627-8eed-4f31-9edd-60e002ce0e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:11.885184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba76627-8eed-4f31-9edd-60e002ce0e42 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:11.885545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba76627-8eed-4f31-9edd-60e002ce0e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:11.886240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba76627-8eed-4f31-9edd-60e002ce0e42 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:11.890826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba76627-8eed-4f31-9edd-60e002ce0e42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:11.891449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142c3ab-ccb9-41ef-b9d6-dc8f434ca1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:11.892493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142c3ab-ccb9-41ef-b9d6-dc8f434ca1ba admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:11.894209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba76627-8eed-4f31-9edd-60e002ce0e42 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:11.894742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142c3ab-ccb9-41ef-b9d6-dc8f434ca1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:11.897320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142c3ab-ccb9-41ef-b9d6-dc8f434ca1ba admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:11.898414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142c3ab-ccb9-41ef-b9d6-dc8f434ca1ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:44:11.906699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142c3ab-ccb9-41ef-b9d6-dc8f434ca1ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:11.908697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142c3ab-ccb9-41ef-b9d6-dc8f434ca1ba admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:11.941440 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1213/2460] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:44:11.942639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142c3ab-ccb9-41ef-b9d6-dc8f434ca1ba admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:11.961676 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1248/2461] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:44:11 2022] POST /identity/v3/projects => generated 371 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:44:11.966040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba76627-8eed-4f31-9edd-60e002ce0e42 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:11.986524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142c3ab-ccb9-41ef-b9d6-dc8f434ca1ba admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:12.072509 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:12.095356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba76627-8eed-4f31-9edd-60e002ce0e42 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:12.109237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775293c7-f179-4618-994d-855ca9165602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:12.109857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775293c7-f179-4618-994d-855ca9165602 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:12.110133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775293c7-f179-4618-994d-855ca9165602 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:12.110399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775293c7-f179-4618-994d-855ca9165602 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:12.111422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775293c7-f179-4618-994d-855ca9165602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:12.111910 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:12.112972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775293c7-f179-4618-994d-855ca9165602 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:12.142949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a2084-29a5-4044-93d2-f888afc91476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:12.143585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a2084-29a5-4044-93d2-f888afc91476 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:12.144361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a2084-29a5-4044-93d2-f888afc91476 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:12.144361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a2084-29a5-4044-93d2-f888afc91476 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:12.145599 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a2084-29a5-4044-93d2-f888afc91476 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:12.149138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a2084-29a5-4044-93d2-f888afc91476 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:12.159556 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1249/2462] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:44:11 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:44:12.161227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775293c7-f179-4618-994d-855ca9165602 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:12.183290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775293c7-f179-4618-994d-855ca9165602 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:12.190945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3cb2b-3fe7-4063-b8e8-dca73feaf7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:12.191543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3cb2b-3fe7-4063-b8e8-dca73feaf7ad admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:12.191834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3cb2b-3fe7-4063-b8e8-dca73feaf7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:12.192130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3cb2b-3fe7-4063-b8e8-dca73feaf7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:12.192816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3cb2b-3fe7-4063-b8e8-dca73feaf7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:12.194923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3cb2b-3fe7-4063-b8e8-dca73feaf7ad admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:12.221107 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1250/2463] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:44:12.224932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3cb2b-3fe7-4063-b8e8-dca73feaf7ad admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:12.231589 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1214/2464] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:44:11 2022] POST /identity/v3/projects => generated 375 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:44:12.235345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a2084-29a5-4044-93d2-f888afc91476 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:12.246244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3cb2b-3fe7-4063-b8e8-dca73feaf7ad admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:12.359773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a2084-29a5-4044-93d2-f888afc91476 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:12.366658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb583a-92a7-4edf-88ec-53880cc789c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:12.367483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb583a-92a7-4edf-88ec-53880cc789c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:12.367858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb583a-92a7-4edf-88ec-53880cc789c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:12.368221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb583a-92a7-4edf-88ec-53880cc789c3 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:12.372221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb583a-92a7-4edf-88ec-53880cc789c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:12.377152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae028db-afaa-413f-a379-69bb92c88b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:12.377579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb583a-92a7-4edf-88ec-53880cc789c3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:12.378388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae028db-afaa-413f-a379-69bb92c88b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:12.378892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae028db-afaa-413f-a379-69bb92c88b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:12.379336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae028db-afaa-413f-a379-69bb92c88b08 admin admin] PATH_INFO: `/v3/projects/56e8c36cdf674f20b27c88c70b1c071e/users/305a124029ac42f09ff8f24040cc4126/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:12.419944 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1215/2465] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:44:12 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:44:12.422338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae028db-afaa-413f-a379-69bb92c88b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e8c36cdf674f20b27c88c70b1c071e, user_id=305a124029ac42f09ff8f24040cc4126, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:12.425505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae028db-afaa-413f-a379-69bb92c88b08 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:12.426594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb583a-92a7-4edf-88ec-53880cc789c3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:12.459878 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1251/2466] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:44:12 2022] PUT /identity/v3/projects/56e8c36cdf674f20b27c88c70b1c071e/users/305a124029ac42f09ff8f24040cc4126/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:12.460872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae028db-afaa-413f-a379-69bb92c88b08 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:12.463211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb583a-92a7-4edf-88ec-53880cc789c3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:12.467997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3ae028db-afaa-413f-a379-69bb92c88b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:12.593158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfbde2-2c81-4109-8b9c-b26f5ee95061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:12.594246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfbde2-2c81-4109-8b9c-b26f5ee95061 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:12.594805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfbde2-2c81-4109-8b9c-b26f5ee95061 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:12.596121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfbde2-2c81-4109-8b9c-b26f5ee95061 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:12.597488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfbde2-2c81-4109-8b9c-b26f5ee95061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:12.599981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfbde2-2c81-4109-8b9c-b26f5ee95061 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:12.619724 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1216/2467] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:44:12.621022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfbde2-2c81-4109-8b9c-b26f5ee95061 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:12.632479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae028db-afaa-413f-a379-69bb92c88b08 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:12.643509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfbde2-2c81-4109-8b9c-b26f5ee95061 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:12.651119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2ae3f-b9f9-493e-8a39-17d94a502b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:12.651351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57be26-0317-434f-98f8-f47980af97c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:12.651802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2ae3f-b9f9-493e-8a39-17d94a502b3c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:12.651964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57be26-0317-434f-98f8-f47980af97c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:12.652072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2ae3f-b9f9-493e-8a39-17d94a502b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:12.652251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57be26-0317-434f-98f8-f47980af97c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:12.652514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57be26-0317-434f-98f8-f47980af97c8 admin admin] PATH_INFO: `/v3/projects/d93122ba0bc742caac1105905c39640b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:12.652664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2ae3f-b9f9-493e-8a39-17d94a502b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:12.653359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2ae3f-b9f9-493e-8a39-17d94a502b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:12.653743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57be26-0317-434f-98f8-f47980af97c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d93122ba0bc742caac1105905c39640b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:12.655107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2ae3f-b9f9-493e-8a39-17d94a502b3c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:12.655641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57be26-0317-434f-98f8-f47980af97c8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:12.672065 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1217/2468] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:44:12.673381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2ae3f-b9f9-493e-8a39-17d94a502b3c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:12.696693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2ae3f-b9f9-493e-8a39-17d94a502b3c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:12.702761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99b6fb-5878-49bf-8f23-c5f82b28b6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:12.703745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99b6fb-5878-49bf-8f23-c5f82b28b6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:12.704027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99b6fb-5878-49bf-8f23-c5f82b28b6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:12.704298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99b6fb-5878-49bf-8f23-c5f82b28b6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:12.705244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99b6fb-5878-49bf-8f23-c5f82b28b6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:12.708461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99b6fb-5878-49bf-8f23-c5f82b28b6a9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:12.724657 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1218/2469] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:44:12.727746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99b6fb-5878-49bf-8f23-c5f82b28b6a9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:12.745858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99b6fb-5878-49bf-8f23-c5f82b28b6a9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:12.753040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2915df-cfa5-481a-b9e2-16e28f8635e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:12.753662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2915df-cfa5-481a-b9e2-16e28f8635e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:12.753945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2915df-cfa5-481a-b9e2-16e28f8635e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:12.754218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2915df-cfa5-481a-b9e2-16e28f8635e3 admin admin] PATH_INFO: `/v3/projects/56e8c36cdf674f20b27c88c70b1c071e/users/305a124029ac42f09ff8f24040cc4126/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:12.756909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2915df-cfa5-481a-b9e2-16e28f8635e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e8c36cdf674f20b27c88c70b1c071e, user_id=305a124029ac42f09ff8f24040cc4126, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:12.761136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2915df-cfa5-481a-b9e2-16e28f8635e3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:12.778829 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1219/2470] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:44:12 2022] PUT /identity/v3/projects/56e8c36cdf674f20b27c88c70b1c071e/users/305a124029ac42f09ff8f24040cc4126/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:12.779972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2915df-cfa5-481a-b9e2-16e28f8635e3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:12.788261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5a57be26-0317-434f-98f8-f47980af97c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd93122ba0bc742caac1105905c39640b', 'request_id': 'req-5a57be26-0317-434f-98f8-f47980af97c8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:12.791561 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:12.805066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5a57be26-0317-434f-98f8-f47980af97c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd93122ba0bc742caac1105905c39640b', 'request_id': 'req-5a57be26-0317-434f-98f8-f47980af97c8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:12.820580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5a57be26-0317-434f-98f8-f47980af97c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd93122ba0bc742caac1105905c39640b', 'request_id': 'req-5a57be26-0317-434f-98f8-f47980af97c8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:12.829476 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:12.851388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5a57be26-0317-434f-98f8-f47980af97c8 admin admin] The token cache is being invalidate because project d93122ba0bc742caac1105905c39640b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:44:12.851840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5a57be26-0317-434f-98f8-f47980af97c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:12.852718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5a57be26-0317-434f-98f8-f47980af97c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:12.855138 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1252/2471] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:44:12 2022] DELETE /identity/v3/projects/d93122ba0bc742caac1105905c39640b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:12.862129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515eafc-3431-44d7-bdc5-19b922cea22f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:12.862758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515eafc-3431-44d7-bdc5-19b922cea22f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:12.863040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515eafc-3431-44d7-bdc5-19b922cea22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:12.890934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8515eafc-3431-44d7-bdc5-19b922cea22f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:12.892207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8515eafc-3431-44d7-bdc5-19b922cea22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:12.929175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2915df-cfa5-481a-b9e2-16e28f8635e3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:12.942935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f49b16-6a7b-42c3-bc91-abb2c0608db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:12.944590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f49b16-6a7b-42c3-bc91-abb2c0608db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:12.945720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f49b16-6a7b-42c3-bc91-abb2c0608db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:12.946074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f49b16-6a7b-42c3-bc91-abb2c0608db5 admin admin] PATH_INFO: `/v3/projects/4c68063aa8854c1eb025dc7b2c4a7785/users/22d9242860a3457e8012949680ea248c/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:12.971966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f49b16-6a7b-42c3-bc91-abb2c0608db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c68063aa8854c1eb025dc7b2c4a7785, user_id=22d9242860a3457e8012949680ea248c, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:12.975289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f49b16-6a7b-42c3-bc91-abb2c0608db5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:13.005174 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1220/2472] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:44:12 2022] PUT /identity/v3/projects/4c68063aa8854c1eb025dc7b2c4a7785/users/22d9242860a3457e8012949680ea248c/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:13.016547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac92c8-ab31-42d9-a32d-8b907621ef47 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:13.016966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac92c8-ab31-42d9-a32d-8b907621ef47 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:13.017109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac92c8-ab31-42d9-a32d-8b907621ef47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:13.025215 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1253/2473] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:13.034298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89570095-b4e2-4cf7-ae74-5244a5394642 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:13.034683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89570095-b4e2-4cf7-ae74-5244a5394642 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:13.034931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89570095-b4e2-4cf7-ae74-5244a5394642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:13.088245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-89570095-b4e2-4cf7-ae74-5244a5394642 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:13.092022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-89570095-b4e2-4cf7-ae74-5244a5394642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:13.095593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0aac92c8-ab31-42d9-a32d-8b907621ef47 None None] MFA Rules not processed for user `22d9242860a3457e8012949680ea248c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:13.099062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0aac92c8-ab31-42d9-a32d-8b907621ef47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:13.267722 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1254/2474] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:13.272532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89570095-b4e2-4cf7-ae74-5244a5394642 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:13.274800 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1221/2475] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:13.281640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac92c8-ab31-42d9-a32d-8b907621ef47 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:13.283091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0aac92c8-ab31-42d9-a32d-8b907621ef47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:13.299500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89570095-b4e2-4cf7-ae74-5244a5394642 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:13.304846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac92c8-ab31-42d9-a32d-8b907621ef47 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:13.308953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c0a7c-e201-47cb-86e4-42a6798c0472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:13.310657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c0a7c-e201-47cb-86e4-42a6798c0472 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:13.311100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c0a7c-e201-47cb-86e4-42a6798c0472 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:13.311547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c0a7c-e201-47cb-86e4-42a6798c0472 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:13.313121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c0a7c-e201-47cb-86e4-42a6798c0472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:44:13.313529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c0a7c-e201-47cb-86e4-42a6798c0472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:13.316056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965b769-c307-48ec-a608-115a8460ce1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:13.316287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c0a7c-e201-47cb-86e4-42a6798c0472 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:13.316705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965b769-c307-48ec-a608-115a8460ce1a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:13.316986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965b769-c307-48ec-a608-115a8460ce1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:13.317258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965b769-c307-48ec-a608-115a8460ce1a admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:13.318075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965b769-c307-48ec-a608-115a8460ce1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:13.321045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965b769-c307-48ec-a608-115a8460ce1a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:13.340211 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1255/2476] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:44:13.341389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c0a7c-e201-47cb-86e4-42a6798c0472 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:13.357164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c0a7c-e201-47cb-86e4-42a6798c0472 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:13.366466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4c81a-9074-4537-8cf9-3e4cc331d513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:13.367714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4c81a-9074-4537-8cf9-3e4cc331d513 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:13.367714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4c81a-9074-4537-8cf9-3e4cc331d513 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:13.367966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4c81a-9074-4537-8cf9-3e4cc331d513 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:13.368893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4c81a-9074-4537-8cf9-3e4cc331d513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:13.371592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4c81a-9074-4537-8cf9-3e4cc331d513 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:13.387273 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1222/2477] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:44:13 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:44:13.388358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965b769-c307-48ec-a608-115a8460ce1a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:13.422369 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1256/2478] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:44:13 2022] POST /identity/v3/projects => generated 407 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:44:13.432030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4c81a-9074-4537-8cf9-3e4cc331d513 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:13.484012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965b769-c307-48ec-a608-115a8460ce1a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:13.525257 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:13.575066 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:13.609802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4c81a-9074-4537-8cf9-3e4cc331d513 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:13.613773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644c90c-cf5d-428a-b946-a3ddf8dbf9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:13.614393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644c90c-cf5d-428a-b946-a3ddf8dbf9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:13.614673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644c90c-cf5d-428a-b946-a3ddf8dbf9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:13.614993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644c90c-cf5d-428a-b946-a3ddf8dbf9e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:13.616237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644c90c-cf5d-428a-b946-a3ddf8dbf9e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:13.618309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644c90c-cf5d-428a-b946-a3ddf8dbf9e7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:13.619745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db26f48-ceb6-432e-a122-f10752d3896d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:13.620036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db26f48-ceb6-432e-a122-f10752d3896d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:13.620315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db26f48-ceb6-432e-a122-f10752d3896d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:13.620583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db26f48-ceb6-432e-a122-f10752d3896d admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:13.624237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db26f48-ceb6-432e-a122-f10752d3896d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:13.632754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db26f48-ceb6-432e-a122-f10752d3896d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:13.651530 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1223/2479] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:44:13 2022] POST /identity/v3/users => generated 294 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:44:13.656010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644c90c-cf5d-428a-b946-a3ddf8dbf9e7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:13.670230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644c90c-cf5d-428a-b946-a3ddf8dbf9e7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:13.678343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e985ae-1ff2-4102-b663-51954c3fa5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:13.679415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e985ae-1ff2-4102-b663-51954c3fa5da admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:13.679868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e985ae-1ff2-4102-b663-51954c3fa5da admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:13.680341 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1257/2480] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:44:13 2022] POST /identity/v3/users => generated 304 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:44:13.680612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e985ae-1ff2-4102-b663-51954c3fa5da admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:13.681802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e985ae-1ff2-4102-b663-51954c3fa5da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:13.683905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e985ae-1ff2-4102-b663-51954c3fa5da admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:13.689468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db26f48-ceb6-432e-a122-f10752d3896d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:13.699672 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1224/2481] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:44:13.705405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e985ae-1ff2-4102-b663-51954c3fa5da admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:13.707145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db26f48-ceb6-432e-a122-f10752d3896d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:13.719059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e985ae-1ff2-4102-b663-51954c3fa5da admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:13.720615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ddf35-91e2-4de8-bd4e-c29a2ca50a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:13.721342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ddf35-91e2-4de8-bd4e-c29a2ca50a50 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:13.721624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ddf35-91e2-4de8-bd4e-c29a2ca50a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:13.721898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ddf35-91e2-4de8-bd4e-c29a2ca50a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:13.723281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ddf35-91e2-4de8-bd4e-c29a2ca50a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:13.727793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa49bc-397e-4586-9b73-6c59f7992cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:13.728663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa49bc-397e-4586-9b73-6c59f7992cca admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:13.729073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa49bc-397e-4586-9b73-6c59f7992cca admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:13.729506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa49bc-397e-4586-9b73-6c59f7992cca admin admin] PATH_INFO: `/v3/projects/3e922a912a9c44a8b69fd5a40c200544/users/6d6e5dd3c90648d3a3b7421c603c908a/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:13.731160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ddf35-91e2-4de8-bd4e-c29a2ca50a50 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:13.753788 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1258/2482] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:44:13.758950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ddf35-91e2-4de8-bd4e-c29a2ca50a50 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:13.772408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa49bc-397e-4586-9b73-6c59f7992cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e922a912a9c44a8b69fd5a40c200544, user_id=6d6e5dd3c90648d3a3b7421c603c908a, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:13.782563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa49bc-397e-4586-9b73-6c59f7992cca admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:13.794543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ddf35-91e2-4de8-bd4e-c29a2ca50a50 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:13.810646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726b2dd-02e7-4335-8c7e-7852666fc296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:13.811273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726b2dd-02e7-4335-8c7e-7852666fc296 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:13.811551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726b2dd-02e7-4335-8c7e-7852666fc296 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:13.811823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726b2dd-02e7-4335-8c7e-7852666fc296 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:13.812702 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1225/2483] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:44:13 2022] PUT /identity/v3/projects/3e922a912a9c44a8b69fd5a40c200544/users/6d6e5dd3c90648d3a3b7421c603c908a/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:13.812843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726b2dd-02e7-4335-8c7e-7852666fc296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:13.813880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa49bc-397e-4586-9b73-6c59f7992cca admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:13.814698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726b2dd-02e7-4335-8c7e-7852666fc296 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:13.840486 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1259/2484] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:44:13.844981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726b2dd-02e7-4335-8c7e-7852666fc296 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:13.871960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726b2dd-02e7-4335-8c7e-7852666fc296 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:13.934505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa49bc-397e-4586-9b73-6c59f7992cca admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:13.951707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed994121-fdcd-44f4-ba5d-ace9d0dc58ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:13.954757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed994121-fdcd-44f4-ba5d-ace9d0dc58ba admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:13.955528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed994121-fdcd-44f4-ba5d-ace9d0dc58ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:13.963463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed994121-fdcd-44f4-ba5d-ace9d0dc58ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:13.968278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed994121-fdcd-44f4-ba5d-ace9d0dc58ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:13.970991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed994121-fdcd-44f4-ba5d-ace9d0dc58ba admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:13.999576 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1226/2485] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:44:14.002456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed994121-fdcd-44f4-ba5d-ace9d0dc58ba admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:14.011855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2a786-407e-4351-9581-72f294e883c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:14.012580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2a786-407e-4351-9581-72f294e883c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:14.012935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2a786-407e-4351-9581-72f294e883c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:14.013258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2a786-407e-4351-9581-72f294e883c1 admin admin] PATH_INFO: `/v3/projects/14007dfd00894a3cae9d067eacde44e4/users/1e00279b2a3148cebd5d3a1e3ed3ccee/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:14.027225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed994121-fdcd-44f4-ba5d-ace9d0dc58ba admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:14.033398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2a786-407e-4351-9581-72f294e883c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14007dfd00894a3cae9d067eacde44e4, user_id=1e00279b2a3148cebd5d3a1e3ed3ccee, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:14.036486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2a786-407e-4351-9581-72f294e883c1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:14.038787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5d31c-582a-43f5-ba35-2adf2488956e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:14.039661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5d31c-582a-43f5-ba35-2adf2488956e admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:14.040039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5d31c-582a-43f5-ba35-2adf2488956e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:14.040858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5d31c-582a-43f5-ba35-2adf2488956e admin admin] PATH_INFO: `/v3/projects/3e922a912a9c44a8b69fd5a40c200544/users/6d6e5dd3c90648d3a3b7421c603c908a/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:14.045464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5d31c-582a-43f5-ba35-2adf2488956e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e922a912a9c44a8b69fd5a40c200544, user_id=6d6e5dd3c90648d3a3b7421c603c908a, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:14.055077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5d31c-582a-43f5-ba35-2adf2488956e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:14.073344 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1260/2486] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:44:13 2022] PUT /identity/v3/projects/14007dfd00894a3cae9d067eacde44e4/users/1e00279b2a3148cebd5d3a1e3ed3ccee/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:14.087448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fc412-bf42-488c-b405-ab2999b94776 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:14.087921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fc412-bf42-488c-b405-ab2999b94776 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:14.088408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fc412-bf42-488c-b405-ab2999b94776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:14.096503 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1227/2487] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:44:13 2022] PUT /identity/v3/projects/3e922a912a9c44a8b69fd5a40c200544/users/6d6e5dd3c90648d3a3b7421c603c908a/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:14.096503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd65ea3-880c-4f4e-bd18-e4fef4cb8bbc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:14.096503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd65ea3-880c-4f4e-bd18-e4fef4cb8bbc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:14.096503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd65ea3-880c-4f4e-bd18-e4fef4cb8bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:14.136944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5cd65ea3-880c-4f4e-bd18-e4fef4cb8bbc None None] MFA Rules not processed for user `6d6e5dd3c90648d3a3b7421c603c908a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:14.142609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5cd65ea3-880c-4f4e-bd18-e4fef4cb8bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:14.151187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d33fc412-bf42-488c-b405-ab2999b94776 None None] MFA Rules not processed for user `1e00279b2a3148cebd5d3a1e3ed3ccee`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:14.153056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d33fc412-bf42-488c-b405-ab2999b94776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:14.215998 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:14.250303 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1228/2488] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:14.252819 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1261/2489] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:14 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:14.254909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fc412-bf42-488c-b405-ab2999b94776 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:14.260573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dfd0f-5659-4a77-a7d0-38e93ea2b988 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:14.260873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dfd0f-5659-4a77-a7d0-38e93ea2b988 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:14.261149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dfd0f-5659-4a77-a7d0-38e93ea2b988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:14.282789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-267dfd0f-5659-4a77-a7d0-38e93ea2b988 None None] MFA Rules not processed for user `22d9242860a3457e8012949680ea248c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:14.284006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-267dfd0f-5659-4a77-a7d0-38e93ea2b988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:14.304628 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:14.373841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fc412-bf42-488c-b405-ab2999b94776 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:14.378662 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1229/2490] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:14.385310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28a1d0-9e0e-44fd-a4ef-9dd2ea31da74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:14.386709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28a1d0-9e0e-44fd-a4ef-9dd2ea31da74 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:14.386709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28a1d0-9e0e-44fd-a4ef-9dd2ea31da74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:14.386709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28a1d0-9e0e-44fd-a4ef-9dd2ea31da74 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:14.387305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28a1d0-9e0e-44fd-a4ef-9dd2ea31da74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:14.390905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28a1d0-9e0e-44fd-a4ef-9dd2ea31da74 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:14.452917 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1262/2491] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:44:14 2022] POST /identity/v3/projects => generated 407 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:44:14.454332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dfd0f-5659-4a77-a7d0-38e93ea2b988 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:14.473536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dfd0f-5659-4a77-a7d0-38e93ea2b988 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:14.599269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7335a-2311-4b22-b3fe-aa1a8da53e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:14.600992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7335a-2311-4b22-b3fe-aa1a8da53e3d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:14.601457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7335a-2311-4b22-b3fe-aa1a8da53e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:14.604251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7335a-2311-4b22-b3fe-aa1a8da53e3d admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:14.606147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7335a-2311-4b22-b3fe-aa1a8da53e3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:14.609018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7335a-2311-4b22-b3fe-aa1a8da53e3d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:14.657151 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1230/2492] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:44:14 2022] POST /identity/v3/users => generated 310 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:44:14.660982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28a1d0-9e0e-44fd-a4ef-9dd2ea31da74 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:14.681526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28a1d0-9e0e-44fd-a4ef-9dd2ea31da74 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:14.692726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20f19c-23b6-4471-864f-cffd3229b168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:14.694113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20f19c-23b6-4471-864f-cffd3229b168 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:14.694463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20f19c-23b6-4471-864f-cffd3229b168 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:14.695259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20f19c-23b6-4471-864f-cffd3229b168 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:14.697425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20f19c-23b6-4471-864f-cffd3229b168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:14.700084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20f19c-23b6-4471-864f-cffd3229b168 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:14.721243 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1263/2493] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:44:14.727194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7335a-2311-4b22-b3fe-aa1a8da53e3d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:14.806039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7335a-2311-4b22-b3fe-aa1a8da53e3d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:14.834626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbca5f-de85-42e9-a78d-009e0d166374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:14.837680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbca5f-de85-42e9-a78d-009e0d166374 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:14.838237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbca5f-de85-42e9-a78d-009e0d166374 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:14.838877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbca5f-de85-42e9-a78d-009e0d166374 admin admin] PATH_INFO: `/v3/projects/c8b77cd4ff224643b394e9e727d88cb8/users/7c40a455787646048c3607a56980809e/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:14.866487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bbca5f-de85-42e9-a78d-009e0d166374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b77cd4ff224643b394e9e727d88cb8, user_id=7c40a455787646048c3607a56980809e, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:14.870006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bbca5f-de85-42e9-a78d-009e0d166374 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:14.887883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20f19c-23b6-4471-864f-cffd3229b168 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:14.892326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5c20f19c-23b6-4471-864f-cffd3229b168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:14.901147 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1231/2494] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:44:14 2022] PUT /identity/v3/projects/c8b77cd4ff224643b394e9e727d88cb8/users/7c40a455787646048c3607a56980809e/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:14.902588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbca5f-de85-42e9-a78d-009e0d166374 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:15.045665 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:15.056173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbca5f-de85-42e9-a78d-009e0d166374 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:15.070151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af06d1-396a-4a1d-a4d5-fdec47322b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:15.070778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af06d1-396a-4a1d-a4d5-fdec47322b43 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:15.071060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af06d1-396a-4a1d-a4d5-fdec47322b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:15.071509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af06d1-396a-4a1d-a4d5-fdec47322b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:15.072276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af06d1-396a-4a1d-a4d5-fdec47322b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:15.075826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af06d1-396a-4a1d-a4d5-fdec47322b43 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:15.081533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20f19c-23b6-4471-864f-cffd3229b168 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:15.107111 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1232/2495] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:44:15.108217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af06d1-396a-4a1d-a4d5-fdec47322b43 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:15.125315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af06d1-396a-4a1d-a4d5-fdec47322b43 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:15.137176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3491e-ab7d-4d90-935c-38f8abbf6002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:15.137833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3491e-ab7d-4d90-935c-38f8abbf6002 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:15.138113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3491e-ab7d-4d90-935c-38f8abbf6002 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:15.139347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3491e-ab7d-4d90-935c-38f8abbf6002 admin admin] PATH_INFO: `/v3/projects/c8b77cd4ff224643b394e9e727d88cb8/users/7c40a455787646048c3607a56980809e/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:15.145797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3491e-ab7d-4d90-935c-38f8abbf6002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b77cd4ff224643b394e9e727d88cb8, user_id=7c40a455787646048c3607a56980809e, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:15.150171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3491e-ab7d-4d90-935c-38f8abbf6002 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:15.190039 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1233/2496] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:44:15 2022] PUT /identity/v3/projects/c8b77cd4ff224643b394e9e727d88cb8/users/7c40a455787646048c3607a56980809e/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:44:15.192357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8484bd9-b255-46e8-a66b-6e6aef4e5ff4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:15.192674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8484bd9-b255-46e8-a66b-6e6aef4e5ff4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:15.192954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8484bd9-b255-46e8-a66b-6e6aef4e5ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:15.219399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e33fda-83e1-459d-9b17-5886a86d1901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:15.220016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e33fda-83e1-459d-9b17-5886a86d1901 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:15.220290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e33fda-83e1-459d-9b17-5886a86d1901 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:15.220561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e33fda-83e1-459d-9b17-5886a86d1901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:15.248672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b8484bd9-b255-46e8-a66b-6e6aef4e5ff4 None None] MFA Rules not processed for user `7c40a455787646048c3607a56980809e`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:15.250456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b8484bd9-b255-46e8-a66b-6e6aef4e5ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:15.270153 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:15.307398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e33fda-83e1-459d-9b17-5886a86d1901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:15.310221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e33fda-83e1-459d-9b17-5886a86d1901 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:15.339572 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1264/2497] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:44:15.428972 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1234/2498] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:15 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:15.431881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e33fda-83e1-459d-9b17-5886a86d1901 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:15.448759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e33fda-83e1-459d-9b17-5886a86d1901 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:15.562025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44dc24-6186-4b1e-98bd-fce1694c1553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:15.562989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44dc24-6186-4b1e-98bd-fce1694c1553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:15.563271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44dc24-6186-4b1e-98bd-fce1694c1553 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:15.563537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44dc24-6186-4b1e-98bd-fce1694c1553 admin admin] PATH_INFO: `/v3/users/1e00279b2a3148cebd5d3a1e3ed3ccee` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:15.564799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44dc24-6186-4b1e-98bd-fce1694c1553 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e00279b2a3148cebd5d3a1e3ed3ccee)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:15.568650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44dc24-6186-4b1e-98bd-fce1694c1553 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:15.667928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5d44dc24-6186-4b1e-98bd-fce1694c1553 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e00279b2a3148cebd5d3a1e3ed3ccee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:15.668871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5d44dc24-6186-4b1e-98bd-fce1694c1553 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e00279b2a3148cebd5d3a1e3ed3ccee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:15.687130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5d44dc24-6186-4b1e-98bd-fce1694c1553 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e00279b2a3148cebd5d3a1e3ed3ccee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:15.726176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5d44dc24-6186-4b1e-98bd-fce1694c1553 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e00279b2a3148cebd5d3a1e3ed3ccee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:15.743015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5d44dc24-6186-4b1e-98bd-fce1694c1553 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e00279b2a3148cebd5d3a1e3ed3ccee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:15.778396 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1265/2499] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:44:15 2022] DELETE /identity/v3/users/1e00279b2a3148cebd5d3a1e3ed3ccee => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:15.783576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7080c8-57a8-4545-b304-ff0214438675 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:15.783827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7080c8-57a8-4545-b304-ff0214438675 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:15.784101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7080c8-57a8-4545-b304-ff0214438675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:15.823849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6e7080c8-57a8-4545-b304-ff0214438675 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:15.825289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6e7080c8-57a8-4545-b304-ff0214438675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:15.970712 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1235/2500] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:16.003527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44dc24-6186-4b1e-98bd-fce1694c1553 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:16.013260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5d44dc24-6186-4b1e-98bd-fce1694c1553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:16.157388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44dc24-6186-4b1e-98bd-fce1694c1553 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:16.164583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197cb75-57d8-4217-a2e6-a5c875c209f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:16.165662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197cb75-57d8-4217-a2e6-a5c875c209f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:16.167490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197cb75-57d8-4217-a2e6-a5c875c209f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:16.168947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197cb75-57d8-4217-a2e6-a5c875c209f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:16.181329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197cb75-57d8-4217-a2e6-a5c875c209f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:16.183038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197cb75-57d8-4217-a2e6-a5c875c209f6 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:16.187713 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:16.204046 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1266/2501] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:44:16.910714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3841e9-1d60-4882-8181-e991bf241786 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:16.911207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3841e9-1d60-4882-8181-e991bf241786 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:16.913245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3841e9-1d60-4882-8181-e991bf241786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:16.972230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7e3841e9-1d60-4882-8181-e991bf241786 None None] MFA Rules not processed for user `22d9242860a3457e8012949680ea248c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:16.973981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7e3841e9-1d60-4882-8181-e991bf241786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:17.112273 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1236/2502] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:17.584305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197cb75-57d8-4217-a2e6-a5c875c209f6 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:17.586570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e197cb75-57d8-4217-a2e6-a5c875c209f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:17.606313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197cb75-57d8-4217-a2e6-a5c875c209f6 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:17.631525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6262379-31c6-43ad-a30c-7eb7655fe9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:17.637899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6262379-31c6-43ad-a30c-7eb7655fe9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:17.638378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6262379-31c6-43ad-a30c-7eb7655fe9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:17.638809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6262379-31c6-43ad-a30c-7eb7655fe9c2 admin admin] PATH_INFO: `/v3/projects/14007dfd00894a3cae9d067eacde44e4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:17.644054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6262379-31c6-43ad-a30c-7eb7655fe9c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14007dfd00894a3cae9d067eacde44e4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:17.647698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6262379-31c6-43ad-a30c-7eb7655fe9c2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:17.759237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e6262379-31c6-43ad-a30c-7eb7655fe9c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14007dfd00894a3cae9d067eacde44e4', 'request_id': 'req-e6262379-31c6-43ad-a30c-7eb7655fe9c2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:17.775114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e6262379-31c6-43ad-a30c-7eb7655fe9c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14007dfd00894a3cae9d067eacde44e4', 'request_id': 'req-e6262379-31c6-43ad-a30c-7eb7655fe9c2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:17.782830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e6262379-31c6-43ad-a30c-7eb7655fe9c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14007dfd00894a3cae9d067eacde44e4', 'request_id': 'req-e6262379-31c6-43ad-a30c-7eb7655fe9c2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:17.799140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e6262379-31c6-43ad-a30c-7eb7655fe9c2 admin admin] The token cache is being invalidate because project 14007dfd00894a3cae9d067eacde44e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:44:17.799828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e6262379-31c6-43ad-a30c-7eb7655fe9c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:17.801481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e6262379-31c6-43ad-a30c-7eb7655fe9c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:17.807751 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1267/2503] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:44:17 2022] DELETE /identity/v3/projects/14007dfd00894a3cae9d067eacde44e4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:17.808631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3841e9-1d60-4882-8181-e991bf241786 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:17.833600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3841e9-1d60-4882-8181-e991bf241786 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:17.870559 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:17.988546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e246968-ecde-41b7-b290-819ca4cca812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:17.991174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e246968-ecde-41b7-b290-819ca4cca812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:17.992915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e246968-ecde-41b7-b290-819ca4cca812 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:17.993308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e246968-ecde-41b7-b290-819ca4cca812 admin admin] PATH_INFO: `/v3/users/7c40a455787646048c3607a56980809e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:17.997809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e246968-ecde-41b7-b290-819ca4cca812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c40a455787646048c3607a56980809e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:17.999893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e246968-ecde-41b7-b290-819ca4cca812 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:18.147758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6e246968-ecde-41b7-b290-819ca4cca812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c40a455787646048c3607a56980809e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:18.168821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6e246968-ecde-41b7-b290-819ca4cca812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c40a455787646048c3607a56980809e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:18.169473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6e246968-ecde-41b7-b290-819ca4cca812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c40a455787646048c3607a56980809e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:18.238948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6e246968-ecde-41b7-b290-819ca4cca812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c40a455787646048c3607a56980809e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:18.264924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6e246968-ecde-41b7-b290-819ca4cca812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c40a455787646048c3607a56980809e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:18.276656 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1237/2504] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:44:17 2022] DELETE /identity/v3/users/7c40a455787646048c3607a56980809e => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:21.497598 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6262379-31c6-43ad-a30c-7eb7655fe9c2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:21.500369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e6262379-31c6-43ad-a30c-7eb7655fe9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:21.549957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6262379-31c6-43ad-a30c-7eb7655fe9c2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:21.734442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb5af2-4278-49ee-ac2d-3f3ae0f95d73 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:21.734902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb5af2-4278-49ee-ac2d-3f3ae0f95d73 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:21.734902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb5af2-4278-49ee-ac2d-3f3ae0f95d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:21.780290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a7eb5af2-4278-49ee-ac2d-3f3ae0f95d73 None None] MFA Rules not processed for user `a21d45726c0d4c21a997ac67e2b07e00`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:21.782173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb0c79-4468-4d07-819b-e630361b5bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:21.783090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb0c79-4468-4d07-819b-e630361b5bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:21.783575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb0c79-4468-4d07-819b-e630361b5bef admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:21.784719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a7eb5af2-4278-49ee-ac2d-3f3ae0f95d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:21.809326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb0c79-4468-4d07-819b-e630361b5bef admin admin] PATH_INFO: `/v3/projects/c8b77cd4ff224643b394e9e727d88cb8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:21.814861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb0c79-4468-4d07-819b-e630361b5bef admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8b77cd4ff224643b394e9e727d88cb8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:21.824227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb0c79-4468-4d07-819b-e630361b5bef admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:21.912980 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1238/2505] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:21 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:44:22.055542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3d54b-8eb6-42a0-8ef2-218c19cea112 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:22.055969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3d54b-8eb6-42a0-8ef2-218c19cea112 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:22.061933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3d54b-8eb6-42a0-8ef2-218c19cea112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:22.067407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-31cb0c79-4468-4d07-819b-e630361b5bef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8b77cd4ff224643b394e9e727d88cb8', 'request_id': 'req-31cb0c79-4468-4d07-819b-e630361b5bef'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:22.087462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-31cb0c79-4468-4d07-819b-e630361b5bef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8b77cd4ff224643b394e9e727d88cb8', 'request_id': 'req-31cb0c79-4468-4d07-819b-e630361b5bef'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:22.097272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-31cb0c79-4468-4d07-819b-e630361b5bef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8b77cd4ff224643b394e9e727d88cb8', 'request_id': 'req-31cb0c79-4468-4d07-819b-e630361b5bef'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:22.123543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-31cb0c79-4468-4d07-819b-e630361b5bef admin admin] The token cache is being invalidate because project c8b77cd4ff224643b394e9e727d88cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:44:22.123981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-31cb0c79-4468-4d07-819b-e630361b5bef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:22.124527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-31cb0c79-4468-4d07-819b-e630361b5bef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:22.139018 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1268/2506] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:44:21 2022] DELETE /identity/v3/projects/c8b77cd4ff224643b394e9e727d88cb8 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:22.140534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fafe52-4c69-41cf-923b-5c7bad258006 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:22.140867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fafe52-4c69-41cf-923b-5c7bad258006 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:22.141127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fafe52-4c69-41cf-923b-5c7bad258006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:22.155682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-03e3d54b-8eb6-42a0-8ef2-218c19cea112 None None] MFA Rules not processed for user `305a124029ac42f09ff8f24040cc4126`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:22.157146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-03e3d54b-8eb6-42a0-8ef2-218c19cea112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:22.202611 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:22.225953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-32fafe52-4c69-41cf-923b-5c7bad258006 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:22.230430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-32fafe52-4c69-41cf-923b-5c7bad258006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:22.242400 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:22.376030 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1239/2507] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:22.382954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee1df7-fcbb-4442-b4b1-9d534c6f140f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:22.383317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee1df7-fcbb-4442-b4b1-9d534c6f140f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:22.383656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee1df7-fcbb-4442-b4b1-9d534c6f140f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:22.436840 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1269/2508] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:22.445971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cc417-8973-431c-b7bf-3a42e02f2fbf None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:22.446477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cc417-8973-431c-b7bf-3a42e02f2fbf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:22.447148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cc417-8973-431c-b7bf-3a42e02f2fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:22.454832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-64ee1df7-fcbb-4442-b4b1-9d534c6f140f None None] MFA Rules not processed for user `5ee27b6e2411469d9ef72ad8a7e6491f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:22.457388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-64ee1df7-fcbb-4442-b4b1-9d534c6f140f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:22.494925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1f8cc417-8973-431c-b7bf-3a42e02f2fbf None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:22.497586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1f8cc417-8973-431c-b7bf-3a42e02f2fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:22.526078 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1270/2509] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:44:22.527149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8cc417-8973-431c-b7bf-3a42e02f2fbf None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:22.553330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8cc417-8973-431c-b7bf-3a42e02f2fbf None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:22.568680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cda7d-5e1f-45ca-8d3c-d83ab62a0763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:22.571795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cda7d-5e1f-45ca-8d3c-d83ab62a0763 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:22.572383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cda7d-5e1f-45ca-8d3c-d83ab62a0763 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:22.574112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cda7d-5e1f-45ca-8d3c-d83ab62a0763 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:22.576688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cda7d-5e1f-45ca-8d3c-d83ab62a0763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:44:22.577255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cda7d-5e1f-45ca-8d3c-d83ab62a0763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:22.582407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cda7d-5e1f-45ca-8d3c-d83ab62a0763 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:22.614366 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1271/2510] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:44:22.620246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cda7d-5e1f-45ca-8d3c-d83ab62a0763 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:22.645707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cda7d-5e1f-45ca-8d3c-d83ab62a0763 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:22.666252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a419d05-7a64-441d-b777-ad3dc65b7225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:22.667866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a419d05-7a64-441d-b777-ad3dc65b7225 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:22.669705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a419d05-7a64-441d-b777-ad3dc65b7225 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:22.671034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a419d05-7a64-441d-b777-ad3dc65b7225 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:22.674023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a419d05-7a64-441d-b777-ad3dc65b7225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:22.679082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a419d05-7a64-441d-b777-ad3dc65b7225 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:22.720274 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1240/2511] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:22.751742 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1272/2512] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:44:22 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:44:22.757350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee1df7-fcbb-4442-b4b1-9d534c6f140f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:22.776422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee1df7-fcbb-4442-b4b1-9d534c6f140f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:22.867904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a419d05-7a64-441d-b777-ad3dc65b7225 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:22.878200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7a419d05-7a64-441d-b777-ad3dc65b7225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:22.894250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17871b-4f87-42bc-8a9c-57d2de6eeeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:22.894869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17871b-4f87-42bc-8a9c-57d2de6eeeae admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:22.895150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17871b-4f87-42bc-8a9c-57d2de6eeeae admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:22.895424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17871b-4f87-42bc-8a9c-57d2de6eeeae admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:22.897462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17871b-4f87-42bc-8a9c-57d2de6eeeae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:22.900212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17871b-4f87-42bc-8a9c-57d2de6eeeae admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:22.956362 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1241/2513] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:44:22 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:44:22.962040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17871b-4f87-42bc-8a9c-57d2de6eeeae admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:22.977476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17871b-4f87-42bc-8a9c-57d2de6eeeae admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:22.984936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e221a-1867-46e1-a121-7e78d540c13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:22.985617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e221a-1867-46e1-a121-7e78d540c13a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:22.985903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e221a-1867-46e1-a121-7e78d540c13a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:22.986338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e221a-1867-46e1-a121-7e78d540c13a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:22.988420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e221a-1867-46e1-a121-7e78d540c13a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:22.989702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e221a-1867-46e1-a121-7e78d540c13a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:23.008499 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1242/2514] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:44:23.010731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e221a-1867-46e1-a121-7e78d540c13a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:23.030330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e221a-1867-46e1-a121-7e78d540c13a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:23.040354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbd8c2-35ee-47c4-b315-66acc5bb9bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:23.041015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbd8c2-35ee-47c4-b315-66acc5bb9bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:23.041300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbd8c2-35ee-47c4-b315-66acc5bb9bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:23.041694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbd8c2-35ee-47c4-b315-66acc5bb9bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:23.042523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcbd8c2-35ee-47c4-b315-66acc5bb9bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:23.044529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcbd8c2-35ee-47c4-b315-66acc5bb9bc3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:23.065829 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1243/2515] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:44:23.067311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbd8c2-35ee-47c4-b315-66acc5bb9bc3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:23.069669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a419d05-7a64-441d-b777-ad3dc65b7225 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:23.081867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbd8c2-35ee-47c4-b315-66acc5bb9bc3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:23.085062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c986955-ef54-452a-b03c-1d5fa98f2a4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:23.085396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c986955-ef54-452a-b03c-1d5fa98f2a4e service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:23.085678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c986955-ef54-452a-b03c-1d5fa98f2a4e service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:23.085949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c986955-ef54-452a-b03c-1d5fa98f2a4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:23.087761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9c986955-ef54-452a-b03c-1d5fa98f2a4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:23.089574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6e1fc-b3ea-48e3-9d38-b2c6ab4b83a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:23.091034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6e1fc-b3ea-48e3-9d38-b2c6ab4b83a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:23.091881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6e1fc-b3ea-48e3-9d38-b2c6ab4b83a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:23.092239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6e1fc-b3ea-48e3-9d38-b2c6ab4b83a2 admin admin] PATH_INFO: `/v3/projects/86f98cdd8cc04fe6895de41258ed5eb8/users/bf92f4a04ac84ad7b00832eb2ac4e6de/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:23.120934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6e1fc-b3ea-48e3-9d38-b2c6ab4b83a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86f98cdd8cc04fe6895de41258ed5eb8, user_id=bf92f4a04ac84ad7b00832eb2ac4e6de, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:23.125100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6e1fc-b3ea-48e3-9d38-b2c6ab4b83a2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:23.153130 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1244/2516] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:44:23 2022] PUT /identity/v3/projects/86f98cdd8cc04fe6895de41258ed5eb8/users/bf92f4a04ac84ad7b00832eb2ac4e6de/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:23.166913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9e520-2542-4478-8392-52114afa9131 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:23.166913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9e520-2542-4478-8392-52114afa9131 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:23.166913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9e520-2542-4478-8392-52114afa9131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:23.191151 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:23.230799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-74f9e520-2542-4478-8392-52114afa9131 None None] MFA Rules not processed for user `bf92f4a04ac84ad7b00832eb2ac4e6de`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:23.233525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-74f9e520-2542-4478-8392-52114afa9131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:23.249864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c986955-ef54-452a-b03c-1d5fa98f2a4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:23.251484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c986955-ef54-452a-b03c-1d5fa98f2a4e service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:23.271230 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1273/2517] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:44:23.363715 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1245/2518] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:24.104560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aba17b-3333-45f0-9874-f30086a24515 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:24.105207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aba17b-3333-45f0-9874-f30086a24515 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:24.105546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aba17b-3333-45f0-9874-f30086a24515 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:24.107483 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1274/2519] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:44:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:44:24.112892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eab55-b344-47f1-b379-ffaefbcd9e53 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:24.113368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eab55-b344-47f1-b379-ffaefbcd9e53 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:24.113474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eab55-b344-47f1-b379-ffaefbcd9e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:24.133662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-eb5eab55-b344-47f1-b379-ffaefbcd9e53 None None] MFA Rules not processed for user `a9b0fd833b134a089433cd2985caba80`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:24.134876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eb5eab55-b344-47f1-b379-ffaefbcd9e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:24.197273 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1246/2520] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:44:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:44:24.212303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aba17b-3333-45f0-9874-f30086a24515 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:24.214021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-95aba17b-3333-45f0-9874-f30086a24515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:24.227520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aba17b-3333-45f0-9874-f30086a24515 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:24.230955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e705e98-ebe3-473f-bba4-a13edc3aa586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:24.231544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e705e98-ebe3-473f-bba4-a13edc3aa586 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:24.231818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e705e98-ebe3-473f-bba4-a13edc3aa586 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:24.232997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e705e98-ebe3-473f-bba4-a13edc3aa586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:24.237343 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:24.243258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e705e98-ebe3-473f-bba4-a13edc3aa586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:24.244992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e705e98-ebe3-473f-bba4-a13edc3aa586 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:24.254524 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1275/2521] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:44:24.517127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5eab55-b344-47f1-b379-ffaefbcd9e53 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:24.518827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eb5eab55-b344-47f1-b379-ffaefbcd9e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:24.636031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5eab55-b344-47f1-b379-ffaefbcd9e53 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:24.646978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eef0bd-8f68-4a21-9b15-0b5ca940e952 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:24.648131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eef0bd-8f68-4a21-9b15-0b5ca940e952 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:24.648486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eef0bd-8f68-4a21-9b15-0b5ca940e952 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:24.648943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eef0bd-8f68-4a21-9b15-0b5ca940e952 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:24.661547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eef0bd-8f68-4a21-9b15-0b5ca940e952 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:24.664237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eef0bd-8f68-4a21-9b15-0b5ca940e952 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:24.691070 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1247/2522] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:44:25.552280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e705e98-ebe3-473f-bba4-a13edc3aa586 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:25.647051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e705e98-ebe3-473f-bba4-a13edc3aa586 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:25.653878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402ec54-9d28-41d9-bf5a-9132c114780f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:25.654786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402ec54-9d28-41d9-bf5a-9132c114780f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:25.655063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402ec54-9d28-41d9-bf5a-9132c114780f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:25.655500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402ec54-9d28-41d9-bf5a-9132c114780f admin admin] PATH_INFO: `/v3/users/bf92f4a04ac84ad7b00832eb2ac4e6de` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:25.656706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0402ec54-9d28-41d9-bf5a-9132c114780f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf92f4a04ac84ad7b00832eb2ac4e6de)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:25.658627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0402ec54-9d28-41d9-bf5a-9132c114780f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:25.722539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0402ec54-9d28-41d9-bf5a-9132c114780f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf92f4a04ac84ad7b00832eb2ac4e6de'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:25.723457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0402ec54-9d28-41d9-bf5a-9132c114780f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf92f4a04ac84ad7b00832eb2ac4e6de'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:25.734228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0402ec54-9d28-41d9-bf5a-9132c114780f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf92f4a04ac84ad7b00832eb2ac4e6de'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:25.755027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0402ec54-9d28-41d9-bf5a-9132c114780f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf92f4a04ac84ad7b00832eb2ac4e6de'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:25.771098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0402ec54-9d28-41d9-bf5a-9132c114780f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf92f4a04ac84ad7b00832eb2ac4e6de'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:25.783396 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1276/2523] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:44:25 2022] DELETE /identity/v3/users/bf92f4a04ac84ad7b00832eb2ac4e6de => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:25.787878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365af57-8dbf-402f-8cab-9ad7b9cf066c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:25.788380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365af57-8dbf-402f-8cab-9ad7b9cf066c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:25.788493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365af57-8dbf-402f-8cab-9ad7b9cf066c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:25.810259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0365af57-8dbf-402f-8cab-9ad7b9cf066c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:25.811484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0365af57-8dbf-402f-8cab-9ad7b9cf066c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:25.855199 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:25.906137 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1248/2524] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:25.917188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402ec54-9d28-41d9-bf5a-9132c114780f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:25.921017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0402ec54-9d28-41d9-bf5a-9132c114780f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:26.012538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402ec54-9d28-41d9-bf5a-9132c114780f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:26.016774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065edc9-25a6-4024-b162-a97fa02aa39b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:26.017391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065edc9-25a6-4024-b162-a97fa02aa39b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:26.017673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065edc9-25a6-4024-b162-a97fa02aa39b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:26.017949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065edc9-25a6-4024-b162-a97fa02aa39b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:26.047892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065edc9-25a6-4024-b162-a97fa02aa39b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:26.049561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065edc9-25a6-4024-b162-a97fa02aa39b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:26.085421 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1277/2525] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:44:26.774977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365af57-8dbf-402f-8cab-9ad7b9cf066c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:26.776673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0365af57-8dbf-402f-8cab-9ad7b9cf066c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:26.799653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365af57-8dbf-402f-8cab-9ad7b9cf066c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:26.825323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15420460-9037-4e6b-826e-b18a6df0cab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:26.825983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15420460-9037-4e6b-826e-b18a6df0cab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:26.826261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15420460-9037-4e6b-826e-b18a6df0cab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:26.826556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15420460-9037-4e6b-826e-b18a6df0cab2 admin admin] PATH_INFO: `/v3/projects/86f98cdd8cc04fe6895de41258ed5eb8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:26.827677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15420460-9037-4e6b-826e-b18a6df0cab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86f98cdd8cc04fe6895de41258ed5eb8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:26.829973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15420460-9037-4e6b-826e-b18a6df0cab2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:26.962926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-15420460-9037-4e6b-826e-b18a6df0cab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86f98cdd8cc04fe6895de41258ed5eb8', 'request_id': 'req-15420460-9037-4e6b-826e-b18a6df0cab2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:26.977106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-15420460-9037-4e6b-826e-b18a6df0cab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86f98cdd8cc04fe6895de41258ed5eb8', 'request_id': 'req-15420460-9037-4e6b-826e-b18a6df0cab2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:27.007066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-15420460-9037-4e6b-826e-b18a6df0cab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86f98cdd8cc04fe6895de41258ed5eb8', 'request_id': 'req-15420460-9037-4e6b-826e-b18a6df0cab2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:27.035773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb07e2b-e4c6-4426-afa4-4e5d650d1112 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:27.036790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb07e2b-e4c6-4426-afa4-4e5d650d1112 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:27.037238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb07e2b-e4c6-4426-afa4-4e5d650d1112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:27.041950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-15420460-9037-4e6b-826e-b18a6df0cab2 admin admin] The token cache is being invalidate because project 86f98cdd8cc04fe6895de41258ed5eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:44:27.042492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-15420460-9037-4e6b-826e-b18a6df0cab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:27.044737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-15420460-9037-4e6b-826e-b18a6df0cab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:27.051093 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1249/2526] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:44:26 2022] DELETE /identity/v3/projects/86f98cdd8cc04fe6895de41258ed5eb8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:27.056712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e47ea7-1c3b-4722-ac78-195fe8436d68 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:27.057444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e47ea7-1c3b-4722-ac78-195fe8436d68 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:27.057868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e47ea7-1c3b-4722-ac78-195fe8436d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:27.101731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9cb07e2b-e4c6-4426-afa4-4e5d650d1112 None None] MFA Rules not processed for user `62956fe5a4d44689b2413b132a78351c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:27.102494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9cb07e2b-e4c6-4426-afa4-4e5d650d1112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:27.125088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-42e47ea7-1c3b-4722-ac78-195fe8436d68 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:27.126327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-42e47ea7-1c3b-4722-ac78-195fe8436d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:27.132069 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:27.197164 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1278/2527] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:27 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:27.231180 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1250/2528] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:27.233029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c16bd-dc64-4f6e-b9d5-023bbdfa347f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:27.233329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c16bd-dc64-4f6e-b9d5-023bbdfa347f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:27.233602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c16bd-dc64-4f6e-b9d5-023bbdfa347f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:27.274400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-938c16bd-dc64-4f6e-b9d5-023bbdfa347f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:27.275933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-938c16bd-dc64-4f6e-b9d5-023bbdfa347f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:27.285538 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1279/2529] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:27.290397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e47ea7-1c3b-4722-ac78-195fe8436d68 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:27.312555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e47ea7-1c3b-4722-ac78-195fe8436d68 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:27.335297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82304cc5-2112-47b8-aadd-8d92f9284e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:27.335926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82304cc5-2112-47b8-aadd-8d92f9284e31 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:27.336193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82304cc5-2112-47b8-aadd-8d92f9284e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:27.336461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82304cc5-2112-47b8-aadd-8d92f9284e31 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:27.337600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82304cc5-2112-47b8-aadd-8d92f9284e31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:44:27.337600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82304cc5-2112-47b8-aadd-8d92f9284e31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:27.339585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82304cc5-2112-47b8-aadd-8d92f9284e31 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:27.354227 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1251/2530] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:44:27.359300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c16bd-dc64-4f6e-b9d5-023bbdfa347f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:27.369018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c16bd-dc64-4f6e-b9d5-023bbdfa347f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:27.376151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97171c48-74c9-46a7-8a60-ea298d6549da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:27.376349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97171c48-74c9-46a7-8a60-ea298d6549da admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:27.376577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97171c48-74c9-46a7-8a60-ea298d6549da admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:27.376872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97171c48-74c9-46a7-8a60-ea298d6549da admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:27.377607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97171c48-74c9-46a7-8a60-ea298d6549da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:27.379723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97171c48-74c9-46a7-8a60-ea298d6549da admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:27.409831 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1280/2531] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:44:27 2022] POST /identity/v3/projects => generated 395 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:44:27.414680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82304cc5-2112-47b8-aadd-8d92f9284e31 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:27.425482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82304cc5-2112-47b8-aadd-8d92f9284e31 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:27.486853 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:27.507705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80959d54-09d4-46f0-9000-47aaf338c5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:27.508328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80959d54-09d4-46f0-9000-47aaf338c5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:27.508619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80959d54-09d4-46f0-9000-47aaf338c5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:27.508895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80959d54-09d4-46f0-9000-47aaf338c5f5 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:27.509609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80959d54-09d4-46f0-9000-47aaf338c5f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:27.511468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80959d54-09d4-46f0-9000-47aaf338c5f5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:27.541965 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1252/2532] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:44:27 2022] POST /identity/v3/users => generated 298 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:44:27.543476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97171c48-74c9-46a7-8a60-ea298d6549da admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:27.554282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97171c48-74c9-46a7-8a60-ea298d6549da admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:27.559031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc433d3-3126-4296-abf2-070eea06b493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:27.559636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc433d3-3126-4296-abf2-070eea06b493 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:27.559908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc433d3-3126-4296-abf2-070eea06b493 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:27.560170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc433d3-3126-4296-abf2-070eea06b493 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:27.560837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc433d3-3126-4296-abf2-070eea06b493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:27.562403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc433d3-3126-4296-abf2-070eea06b493 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:27.574619 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1281/2533] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:44:27.579252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80959d54-09d4-46f0-9000-47aaf338c5f5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:27.591947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80959d54-09d4-46f0-9000-47aaf338c5f5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:27.596871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f188f0-47ac-4211-9a3d-eb4783e25d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:27.597470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f188f0-47ac-4211-9a3d-eb4783e25d96 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:27.597746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f188f0-47ac-4211-9a3d-eb4783e25d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:27.598182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f188f0-47ac-4211-9a3d-eb4783e25d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:27.598825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f188f0-47ac-4211-9a3d-eb4783e25d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:27.601263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f188f0-47ac-4211-9a3d-eb4783e25d96 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:27.624629 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1253/2534] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:44:27.625114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc433d3-3126-4296-abf2-070eea06b493 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:27.629924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc433d3-3126-4296-abf2-070eea06b493 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:27.636352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24f888-90cf-42c8-9d0d-49771fae1560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:27.637360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24f888-90cf-42c8-9d0d-49771fae1560 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:27.638317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24f888-90cf-42c8-9d0d-49771fae1560 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:27.638317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24f888-90cf-42c8-9d0d-49771fae1560 admin admin] PATH_INFO: `/v3/projects/2e408faa6ffe4a8ba346edff03cb83ad/users/f02e2496358a4783bc8fe0ec597188e8/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:27.658492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24f888-90cf-42c8-9d0d-49771fae1560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e408faa6ffe4a8ba346edff03cb83ad, user_id=f02e2496358a4783bc8fe0ec597188e8, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:27.664003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24f888-90cf-42c8-9d0d-49771fae1560 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:27.690127 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1282/2535] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:44:27 2022] PUT /identity/v3/projects/2e408faa6ffe4a8ba346edff03cb83ad/users/f02e2496358a4783bc8fe0ec597188e8/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:27.695949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da97c15-28f4-4b7d-824a-c2c19627c222 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:27.696235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da97c15-28f4-4b7d-824a-c2c19627c222 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:27.696540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da97c15-28f4-4b7d-824a-c2c19627c222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:27.716057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2da97c15-28f4-4b7d-824a-c2c19627c222 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:27.717287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2da97c15-28f4-4b7d-824a-c2c19627c222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:27.820663 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1254/2536] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:27.828399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24f888-90cf-42c8-9d0d-49771fae1560 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:27.830780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ef24f888-90cf-42c8-9d0d-49771fae1560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:27.893846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24f888-90cf-42c8-9d0d-49771fae1560 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:27.898532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1928dc-4f9a-4800-b1d9-a100e47901a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:27.899138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1928dc-4f9a-4800-b1d9-a100e47901a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:27.899411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1928dc-4f9a-4800-b1d9-a100e47901a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:27.899679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1928dc-4f9a-4800-b1d9-a100e47901a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:27.908848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1928dc-4f9a-4800-b1d9-a100e47901a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:27.911104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1928dc-4f9a-4800-b1d9-a100e47901a3 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:27.929627 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1283/2537] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:44:28.231396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da97c15-28f4-4b7d-824a-c2c19627c222 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:28.233280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2da97c15-28f4-4b7d-824a-c2c19627c222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:28.404240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da97c15-28f4-4b7d-824a-c2c19627c222 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:28.410564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627a154-f466-4b1c-9e83-e0a8742b9709 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:28.411184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627a154-f466-4b1c-9e83-e0a8742b9709 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:28.411522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627a154-f466-4b1c-9e83-e0a8742b9709 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:28.411954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627a154-f466-4b1c-9e83-e0a8742b9709 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:28.413879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d627a154-f466-4b1c-9e83-e0a8742b9709 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:28.506726 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:28.512406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627a154-f466-4b1c-9e83-e0a8742b9709 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:28.514368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627a154-f466-4b1c-9e83-e0a8742b9709 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:28.538868 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1255/2538] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:28 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:44:34.462965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5262519-bfde-4c12-92f7-aaabb13c5da1 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:34.463501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5262519-bfde-4c12-92f7-aaabb13c5da1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:34.463985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5262519-bfde-4c12-92f7-aaabb13c5da1 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:34.465653 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1284/2539] 10.222.0.16 () {54 vars in 921 bytes} [Fri Sep 30 09:44:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:44:34.503140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa0b6a-fcb1-4604-aed7-d102270c2fa0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:34.503675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa0b6a-fcb1-4604-aed7-d102270c2fa0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:34.503675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa0b6a-fcb1-4604-aed7-d102270c2fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:34.563419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-59aa0b6a-fcb1-4604-aed7-d102270c2fa0 None None] MFA Rules not processed for user `aa607111024540d1a09b01dfd1e5e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:34.564709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-59aa0b6a-fcb1-4604-aed7-d102270c2fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:34.589266 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1256/2540] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 09:44:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:34.663852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5262519-bfde-4c12-92f7-aaabb13c5da1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:34.686727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5262519-bfde-4c12-92f7-aaabb13c5da1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:34.701709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3631120-3685-483a-867c-87de34646e24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:34.702039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3631120-3685-483a-867c-87de34646e24 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:34.702227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3631120-3685-483a-867c-87de34646e24 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:34.702433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3631120-3685-483a-867c-87de34646e24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:34.729895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3631120-3685-483a-867c-87de34646e24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:34.731390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3631120-3685-483a-867c-87de34646e24 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:34.779668 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1285/2541] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:44:34.888509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa158f-be4d-4998-a655-ed878c76c165 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:34.888796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa158f-be4d-4998-a655-ed878c76c165 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:34.889065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa158f-be4d-4998-a655-ed878c76c165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:34.945532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-94fa158f-be4d-4998-a655-ed878c76c165 None None] MFA Rules not processed for user `a9b0fd833b134a089433cd2985caba80`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:34.947654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-94fa158f-be4d-4998-a655-ed878c76c165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:34.970216 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1257/2542] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 09:44:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:35.088541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3631120-3685-483a-867c-87de34646e24 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:35.097695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3631120-3685-483a-867c-87de34646e24 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:35.117590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9790867-47e4-46d7-95e8-d58f3c715ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:35.118212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9790867-47e4-46d7-95e8-d58f3c715ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:35.118511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9790867-47e4-46d7-95e8-d58f3c715ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:35.118776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9790867-47e4-46d7-95e8-d58f3c715ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:35.134895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9790867-47e4-46d7-95e8-d58f3c715ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:35.136373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9790867-47e4-46d7-95e8-d58f3c715ee8 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:35.153597 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1286/2543] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:44:40.015856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c09df-2931-439e-90e7-93fd4fcd5f97 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:40.016373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c09df-2931-439e-90e7-93fd4fcd5f97 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:40.016373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c09df-2931-439e-90e7-93fd4fcd5f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:40.108326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-058c09df-2931-439e-90e7-93fd4fcd5f97 None None] MFA Rules not processed for user `f02e2496358a4783bc8fe0ec597188e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:40.110684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-058c09df-2931-439e-90e7-93fd4fcd5f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:40.216063 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1258/2544] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:40 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:40.475969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9790867-47e4-46d7-95e8-d58f3c715ee8 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:40.504065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9790867-47e4-46d7-95e8-d58f3c715ee8 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:40.512332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308f203-17fe-4dc3-a693-56bcd439c237 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:40.513244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308f203-17fe-4dc3-a693-56bcd439c237 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:40.513793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308f203-17fe-4dc3-a693-56bcd439c237 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:40.514155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308f203-17fe-4dc3-a693-56bcd439c237 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:40.529097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308f203-17fe-4dc3-a693-56bcd439c237 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:40.533066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308f203-17fe-4dc3-a693-56bcd439c237 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:40.563001 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1287/2545] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:40 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:44:47.657573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c09df-2931-439e-90e7-93fd4fcd5f97 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:47.686589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c09df-2931-439e-90e7-93fd4fcd5f97 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:47.697119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1182267-7492-466e-a8e6-692487ba204e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:47.697823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1182267-7492-466e-a8e6-692487ba204e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:47.700857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1182267-7492-466e-a8e6-692487ba204e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:47.701293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1182267-7492-466e-a8e6-692487ba204e admin admin] PATH_INFO: `/v3/users/f02e2496358a4783bc8fe0ec597188e8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:47.702933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1182267-7492-466e-a8e6-692487ba204e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f02e2496358a4783bc8fe0ec597188e8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:47.705413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1182267-7492-466e-a8e6-692487ba204e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:47.805869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d1182267-7492-466e-a8e6-692487ba204e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f02e2496358a4783bc8fe0ec597188e8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:47.816115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d1182267-7492-466e-a8e6-692487ba204e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f02e2496358a4783bc8fe0ec597188e8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:47.817214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d1182267-7492-466e-a8e6-692487ba204e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f02e2496358a4783bc8fe0ec597188e8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:47.845119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d1182267-7492-466e-a8e6-692487ba204e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f02e2496358a4783bc8fe0ec597188e8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:47.855974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d1182267-7492-466e-a8e6-692487ba204e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f02e2496358a4783bc8fe0ec597188e8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:47.864752 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1259/2546] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:44:47 2022] DELETE /identity/v3/users/f02e2496358a4783bc8fe0ec597188e8 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:48.301892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308f203-17fe-4dc3-a693-56bcd439c237 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:48.318438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308f203-17fe-4dc3-a693-56bcd439c237 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:48.367057 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:48.432388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821096e-83d2-4864-87f7-09b02523e9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:48.433724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821096e-83d2-4864-87f7-09b02523e9a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:48.434094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821096e-83d2-4864-87f7-09b02523e9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:48.434451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821096e-83d2-4864-87f7-09b02523e9a8 admin admin] PATH_INFO: `/v3/projects/2e408faa6ffe4a8ba346edff03cb83ad` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:48.436842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821096e-83d2-4864-87f7-09b02523e9a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e408faa6ffe4a8ba346edff03cb83ad)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:48.438905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821096e-83d2-4864-87f7-09b02523e9a8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:48.524934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5821096e-83d2-4864-87f7-09b02523e9a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e408faa6ffe4a8ba346edff03cb83ad', 'request_id': 'req-5821096e-83d2-4864-87f7-09b02523e9a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:48.532304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5821096e-83d2-4864-87f7-09b02523e9a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e408faa6ffe4a8ba346edff03cb83ad', 'request_id': 'req-5821096e-83d2-4864-87f7-09b02523e9a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:48.542119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5821096e-83d2-4864-87f7-09b02523e9a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e408faa6ffe4a8ba346edff03cb83ad', 'request_id': 'req-5821096e-83d2-4864-87f7-09b02523e9a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:48.571615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5821096e-83d2-4864-87f7-09b02523e9a8 admin admin] The token cache is being invalidate because project 2e408faa6ffe4a8ba346edff03cb83ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:44:48.572746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5821096e-83d2-4864-87f7-09b02523e9a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:48.575045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5821096e-83d2-4864-87f7-09b02523e9a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:48.579378 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1288/2547] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:44:48 2022] DELETE /identity/v3/projects/2e408faa6ffe4a8ba346edff03cb83ad => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:48.585027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1cc3e-5c50-4a43-8cbe-c9a3a2788075 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:48.585312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1cc3e-5c50-4a43-8cbe-c9a3a2788075 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:48.585749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1cc3e-5c50-4a43-8cbe-c9a3a2788075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:48.608579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d4e1cc3e-5c50-4a43-8cbe-c9a3a2788075 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:48.609894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d4e1cc3e-5c50-4a43-8cbe-c9a3a2788075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:48.671433 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:48.721473 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1260/2548] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:48.780847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce081786-4326-4a96-b8ec-b4ae1c9cf26c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:48.781483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce081786-4326-4a96-b8ec-b4ae1c9cf26c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:48.782086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce081786-4326-4a96-b8ec-b4ae1c9cf26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:48.827388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ce081786-4326-4a96-b8ec-b4ae1c9cf26c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:48.830325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ce081786-4326-4a96-b8ec-b4ae1c9cf26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:48.858575 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1289/2549] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:48.862525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1cc3e-5c50-4a43-8cbe-c9a3a2788075 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:48.872772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1cc3e-5c50-4a43-8cbe-c9a3a2788075 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:48.878389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b85593-c363-4676-894b-ba62765c0263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:48.879264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b85593-c363-4676-894b-ba62765c0263 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:48.879741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b85593-c363-4676-894b-ba62765c0263 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:48.880020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b85593-c363-4676-894b-ba62765c0263 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:48.880779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b85593-c363-4676-894b-ba62765c0263 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:44:48.881082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b85593-c363-4676-894b-ba62765c0263 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:48.882662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b85593-c363-4676-894b-ba62765c0263 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:48.901098 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1261/2550] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:44:48.901991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce081786-4326-4a96-b8ec-b4ae1c9cf26c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:48.916994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce081786-4326-4a96-b8ec-b4ae1c9cf26c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:48.923662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9af40-6c5c-4ff8-bbc9-7ec07d3b6ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:48.926723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9af40-6c5c-4ff8-bbc9-7ec07d3b6ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:48.927879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9af40-6c5c-4ff8-bbc9-7ec07d3b6ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:48.928166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9af40-6c5c-4ff8-bbc9-7ec07d3b6ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:48.928880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9af40-6c5c-4ff8-bbc9-7ec07d3b6ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:48.931933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9af40-6c5c-4ff8-bbc9-7ec07d3b6ea5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:48.968639 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1290/2551] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:44:48 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:44:48.971499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b85593-c363-4676-894b-ba62765c0263 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:48.982444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b85593-c363-4676-894b-ba62765c0263 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:49.069798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d237d8d-25cb-41d1-a844-2eeb76228ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:49.070883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d237d8d-25cb-41d1-a844-2eeb76228ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:49.071265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d237d8d-25cb-41d1-a844-2eeb76228ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:49.071741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d237d8d-25cb-41d1-a844-2eeb76228ed2 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:49.072875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d237d8d-25cb-41d1-a844-2eeb76228ed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:49.074902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d237d8d-25cb-41d1-a844-2eeb76228ed2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:49.107463 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1262/2552] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:44:48 2022] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:44:49.112430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9af40-6c5c-4ff8-bbc9-7ec07d3b6ea5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:49.124516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9af40-6c5c-4ff8-bbc9-7ec07d3b6ea5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:49.137702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c80a53-ccec-4c62-a8ea-9110ef5f0144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:49.138396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c80a53-ccec-4c62-a8ea-9110ef5f0144 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:49.138681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c80a53-ccec-4c62-a8ea-9110ef5f0144 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:49.138957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c80a53-ccec-4c62-a8ea-9110ef5f0144 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:49.139621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c80a53-ccec-4c62-a8ea-9110ef5f0144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:49.141675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c80a53-ccec-4c62-a8ea-9110ef5f0144 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:49.157834 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1291/2553] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:44:49.162989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d237d8d-25cb-41d1-a844-2eeb76228ed2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:49.174463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d237d8d-25cb-41d1-a844-2eeb76228ed2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:49.191619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e5ef7-dd7f-4e26-b31e-7994f1ca67d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:49.193181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e5ef7-dd7f-4e26-b31e-7994f1ca67d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:49.193611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e5ef7-dd7f-4e26-b31e-7994f1ca67d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:49.196194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e5ef7-dd7f-4e26-b31e-7994f1ca67d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:49.198720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e5ef7-dd7f-4e26-b31e-7994f1ca67d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:49.200974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e5ef7-dd7f-4e26-b31e-7994f1ca67d5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:49.241848 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1263/2554] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:44:49.245832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c80a53-ccec-4c62-a8ea-9110ef5f0144 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:49.261373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c80a53-ccec-4c62-a8ea-9110ef5f0144 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:49.274028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c35f3-f8c5-4896-80f5-0a465bc5c5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:49.274806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c35f3-f8c5-4896-80f5-0a465bc5c5ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:49.275080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c35f3-f8c5-4896-80f5-0a465bc5c5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:49.275348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c35f3-f8c5-4896-80f5-0a465bc5c5ed admin admin] PATH_INFO: `/v3/projects/7e2a6fac3e174f79817293f879389abd/users/e1f52d856b9e4b6ea65f649f30fcfeee/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:49.334280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c35f3-f8c5-4896-80f5-0a465bc5c5ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e2a6fac3e174f79817293f879389abd, user_id=e1f52d856b9e4b6ea65f649f30fcfeee, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:49.337260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c35f3-f8c5-4896-80f5-0a465bc5c5ed admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:49.356421 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1292/2555] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:44:49 2022] PUT /identity/v3/projects/7e2a6fac3e174f79817293f879389abd/users/e1f52d856b9e4b6ea65f649f30fcfeee/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:49.361743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056e626-9c1d-4539-ad2d-9b05d6597d14 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:49.362354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056e626-9c1d-4539-ad2d-9b05d6597d14 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:49.362726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056e626-9c1d-4539-ad2d-9b05d6597d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:49.389397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d056e626-9c1d-4539-ad2d-9b05d6597d14 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:49.390834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d056e626-9c1d-4539-ad2d-9b05d6597d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:49.476418 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1264/2556] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:44:49.488464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c35f3-f8c5-4896-80f5-0a465bc5c5ed admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:49.491772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-755c35f3-f8c5-4896-80f5-0a465bc5c5ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:49.589283 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:49.601588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c35f3-f8c5-4896-80f5-0a465bc5c5ed admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:49.606042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ec19c-5c16-4564-8a3d-784b7c20390b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:49.606729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ec19c-5c16-4564-8a3d-784b7c20390b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:49.607077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ec19c-5c16-4564-8a3d-784b7c20390b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:49.607419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ec19c-5c16-4564-8a3d-784b7c20390b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:49.622465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ec19c-5c16-4564-8a3d-784b7c20390b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:49.624768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ec19c-5c16-4564-8a3d-784b7c20390b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:49.635937 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1293/2557] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:44:51.117173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de9fe2-bf07-4167-b068-7a3d07033bc6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:51.117873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de9fe2-bf07-4167-b068-7a3d07033bc6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:51.118317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de9fe2-bf07-4167-b068-7a3d07033bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:51.164981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f9de9fe2-bf07-4167-b068-7a3d07033bc6 None None] MFA Rules not processed for user `22d9242860a3457e8012949680ea248c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:51.166342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f9de9fe2-bf07-4167-b068-7a3d07033bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:51.261997 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:51.295099 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1265/2558] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:51.298659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ec19c-5c16-4564-8a3d-784b7c20390b service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:51.300166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f24ec19c-5c16-4564-8a3d-784b7c20390b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:51.319862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ec19c-5c16-4564-8a3d-784b7c20390b service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:51.339928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b01bdb-b549-4aa6-90dc-b128e849b34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:51.340969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b01bdb-b549-4aa6-90dc-b128e849b34d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:51.341467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b01bdb-b549-4aa6-90dc-b128e849b34d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:51.341946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b01bdb-b549-4aa6-90dc-b128e849b34d admin admin] PATH_INFO: `/v3/users/74ca7b7e17b141819d71f7ad64c36463` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:51.343751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b01bdb-b549-4aa6-90dc-b128e849b34d admin admin] RBAC: Authorizing `identity:delete_user(user_id=74ca7b7e17b141819d71f7ad64c36463)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:51.347825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b01bdb-b549-4aa6-90dc-b128e849b34d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:51.448909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-40b01bdb-b549-4aa6-90dc-b128e849b34d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74ca7b7e17b141819d71f7ad64c36463'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:51.450025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-40b01bdb-b549-4aa6-90dc-b128e849b34d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74ca7b7e17b141819d71f7ad64c36463'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:51.491659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-40b01bdb-b549-4aa6-90dc-b128e849b34d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74ca7b7e17b141819d71f7ad64c36463'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:51.522054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-40b01bdb-b549-4aa6-90dc-b128e849b34d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74ca7b7e17b141819d71f7ad64c36463'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:51.532813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-40b01bdb-b549-4aa6-90dc-b128e849b34d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74ca7b7e17b141819d71f7ad64c36463'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:51.543400 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1294/2559] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:44:51 2022] DELETE /identity/v3/users/74ca7b7e17b141819d71f7ad64c36463 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:44:51.548063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430779fa-255e-48b0-9532-0f845b3a4c67 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:51.548219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430779fa-255e-48b0-9532-0f845b3a4c67 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:51.548469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430779fa-255e-48b0-9532-0f845b3a4c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:51.570887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-430779fa-255e-48b0-9532-0f845b3a4c67 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:51.572403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-430779fa-255e-48b0-9532-0f845b3a4c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:51.680860 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1266/2560] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:51.757249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b01bdb-b549-4aa6-90dc-b128e849b34d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:51.759008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-40b01bdb-b549-4aa6-90dc-b128e849b34d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:51.852982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b01bdb-b549-4aa6-90dc-b128e849b34d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:51.862846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92797b-c067-4f59-936c-af62139587bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:51.864531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92797b-c067-4f59-936c-af62139587bb service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:51.864952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92797b-c067-4f59-936c-af62139587bb service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:51.865232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92797b-c067-4f59-936c-af62139587bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:51.883400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92797b-c067-4f59-936c-af62139587bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:51.885438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92797b-c067-4f59-936c-af62139587bb service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:51.899628 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1295/2561] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:44:52.390553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430779fa-255e-48b0-9532-0f845b3a4c67 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:52.393538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-430779fa-255e-48b0-9532-0f845b3a4c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:52.416266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430779fa-255e-48b0-9532-0f845b3a4c67 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:52.429076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dcea1-6134-4ffa-921d-dc1248674b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:52.429762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dcea1-6134-4ffa-921d-dc1248674b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:52.430210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dcea1-6134-4ffa-921d-dc1248674b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:52.430656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dcea1-6134-4ffa-921d-dc1248674b98 admin admin] PATH_INFO: `/v3/projects/5c529a13b1ac4bb9a1733d26e478ac65` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:52.432523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dcea1-6134-4ffa-921d-dc1248674b98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c529a13b1ac4bb9a1733d26e478ac65)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:52.435160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dcea1-6134-4ffa-921d-dc1248674b98 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:52.558792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-230dcea1-6134-4ffa-921d-dc1248674b98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c529a13b1ac4bb9a1733d26e478ac65', 'request_id': 'req-230dcea1-6134-4ffa-921d-dc1248674b98'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:52.573807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-230dcea1-6134-4ffa-921d-dc1248674b98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c529a13b1ac4bb9a1733d26e478ac65', 'request_id': 'req-230dcea1-6134-4ffa-921d-dc1248674b98'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:52.585428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-230dcea1-6134-4ffa-921d-dc1248674b98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c529a13b1ac4bb9a1733d26e478ac65', 'request_id': 'req-230dcea1-6134-4ffa-921d-dc1248674b98'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:52.618094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-230dcea1-6134-4ffa-921d-dc1248674b98 admin admin] The token cache is being invalidate because project 5c529a13b1ac4bb9a1733d26e478ac65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:44:52.620115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-230dcea1-6134-4ffa-921d-dc1248674b98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:52.622290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-230dcea1-6134-4ffa-921d-dc1248674b98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:52.628241 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1267/2562] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:44:52 2022] DELETE /identity/v3/projects/5c529a13b1ac4bb9a1733d26e478ac65 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:52.630053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92797b-c067-4f59-936c-af62139587bb service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:52.640914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92797b-c067-4f59-936c-af62139587bb service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:52.740962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078af7f-5cf3-4a75-a371-7250b5b9daa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:52.741811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078af7f-5cf3-4a75-a371-7250b5b9daa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:52.742243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078af7f-5cf3-4a75-a371-7250b5b9daa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:52.742688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078af7f-5cf3-4a75-a371-7250b5b9daa0 admin admin] PATH_INFO: `/v3/users/ffa8499667ff4748a7313c22555942e4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:52.743859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078af7f-5cf3-4a75-a371-7250b5b9daa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffa8499667ff4748a7313c22555942e4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:52.745995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078af7f-5cf3-4a75-a371-7250b5b9daa0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:52.755273 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:52.843644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9078af7f-5cf3-4a75-a371-7250b5b9daa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffa8499667ff4748a7313c22555942e4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:52.844322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9078af7f-5cf3-4a75-a371-7250b5b9daa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffa8499667ff4748a7313c22555942e4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:52.864001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9078af7f-5cf3-4a75-a371-7250b5b9daa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffa8499667ff4748a7313c22555942e4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:52.897003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9078af7f-5cf3-4a75-a371-7250b5b9daa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffa8499667ff4748a7313c22555942e4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:52.909279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9078af7f-5cf3-4a75-a371-7250b5b9daa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffa8499667ff4748a7313c22555942e4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:52.924461 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1296/2563] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:44:52 2022] DELETE /identity/v3/users/ffa8499667ff4748a7313c22555942e4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:54.144348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dcea1-6134-4ffa-921d-dc1248674b98 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:54.147545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-230dcea1-6134-4ffa-921d-dc1248674b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:54.165920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dcea1-6134-4ffa-921d-dc1248674b98 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:54.309115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610dc8b-18ee-476d-a320-0d4bd8c538cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:54.309759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610dc8b-18ee-476d-a320-0d4bd8c538cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:54.310101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610dc8b-18ee-476d-a320-0d4bd8c538cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:54.310376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610dc8b-18ee-476d-a320-0d4bd8c538cc admin admin] PATH_INFO: `/v3/projects/afa1c9dd9ba841098ecfe5c4ec9a15e5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:54.311495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610dc8b-18ee-476d-a320-0d4bd8c538cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa1c9dd9ba841098ecfe5c4ec9a15e5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:54.313423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610dc8b-18ee-476d-a320-0d4bd8c538cc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:54.357015 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:54.403413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7610dc8b-18ee-476d-a320-0d4bd8c538cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa1c9dd9ba841098ecfe5c4ec9a15e5', 'request_id': 'req-7610dc8b-18ee-476d-a320-0d4bd8c538cc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:54.421952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7610dc8b-18ee-476d-a320-0d4bd8c538cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa1c9dd9ba841098ecfe5c4ec9a15e5', 'request_id': 'req-7610dc8b-18ee-476d-a320-0d4bd8c538cc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:54.429662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7610dc8b-18ee-476d-a320-0d4bd8c538cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa1c9dd9ba841098ecfe5c4ec9a15e5', 'request_id': 'req-7610dc8b-18ee-476d-a320-0d4bd8c538cc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:54.444771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7610dc8b-18ee-476d-a320-0d4bd8c538cc admin admin] The token cache is being invalidate because project afa1c9dd9ba841098ecfe5c4ec9a15e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:44:54.445192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7610dc8b-18ee-476d-a320-0d4bd8c538cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:54.445851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7610dc8b-18ee-476d-a320-0d4bd8c538cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:44:54.447589 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1268/2564] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:44:54 2022] DELETE /identity/v3/projects/afa1c9dd9ba841098ecfe5c4ec9a15e5 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:54.452421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc3798-501b-42c7-93a5-e0fb33dc1cac None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:54.453286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc3798-501b-42c7-93a5-e0fb33dc1cac None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:54.453560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc3798-501b-42c7-93a5-e0fb33dc1cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:54.476236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-98cc3798-501b-42c7-93a5-e0fb33dc1cac None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:54.478177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-98cc3798-501b-42c7-93a5-e0fb33dc1cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:54.592755 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1297/2565] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:54.601541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a152709-937b-48ec-aee5-ace1bd3c71a8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:54.603490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a152709-937b-48ec-aee5-ace1bd3c71a8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:54.603769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a152709-937b-48ec-aee5-ace1bd3c71a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:54.655267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0a152709-937b-48ec-aee5-ace1bd3c71a8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:54.658447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0a152709-937b-48ec-aee5-ace1bd3c71a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:54.685823 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1269/2566] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:44:54.691288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc3798-501b-42c7-93a5-e0fb33dc1cac None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:54.709256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc3798-501b-42c7-93a5-e0fb33dc1cac None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:54.727930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9f745-f5ee-44a5-a1e1-95215d230b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:54.729071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9f745-f5ee-44a5-a1e1-95215d230b07 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:54.729071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9f745-f5ee-44a5-a1e1-95215d230b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:54.729364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9f745-f5ee-44a5-a1e1-95215d230b07 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:54.730096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9f745-f5ee-44a5-a1e1-95215d230b07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:44:54.734522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9f745-f5ee-44a5-a1e1-95215d230b07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:54.739958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9f745-f5ee-44a5-a1e1-95215d230b07 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:54.761963 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1298/2567] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:44:54.765774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a152709-937b-48ec-aee5-ace1bd3c71a8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:54.779601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a152709-937b-48ec-aee5-ace1bd3c71a8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:54.786523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a527a-9aec-4c4c-aad7-a747e1b40332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:54.787443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a527a-9aec-4c4c-aad7-a747e1b40332 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:54.787811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a527a-9aec-4c4c-aad7-a747e1b40332 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:54.788184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a527a-9aec-4c4c-aad7-a747e1b40332 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:54.788965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a527a-9aec-4c4c-aad7-a747e1b40332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:54.791147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a527a-9aec-4c4c-aad7-a747e1b40332 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:54.834207 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1270/2568] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:44:54 2022] POST /identity/v3/projects => generated 393 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:44:54.838664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9f745-f5ee-44a5-a1e1-95215d230b07 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:54.852342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9f745-f5ee-44a5-a1e1-95215d230b07 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:55.036379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea45623-faea-4c4c-aea9-5783ac65f50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:55.036969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea45623-faea-4c4c-aea9-5783ac65f50d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:55.037247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea45623-faea-4c4c-aea9-5783ac65f50d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:55.037513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea45623-faea-4c4c-aea9-5783ac65f50d admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:55.038843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea45623-faea-4c4c-aea9-5783ac65f50d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:55.055679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea45623-faea-4c4c-aea9-5783ac65f50d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:55.090808 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:55.106649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a527a-9aec-4c4c-aad7-a747e1b40332 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:55.108556 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1299/2569] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:44:54 2022] POST /identity/v3/users => generated 297 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:44:55.119115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a527a-9aec-4c4c-aad7-a747e1b40332 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:55.124177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbcb1a-33c9-4721-ac2a-c81823b30b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:55.125125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbcb1a-33c9-4721-ac2a-c81823b30b56 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:55.125372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbcb1a-33c9-4721-ac2a-c81823b30b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:55.125733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbcb1a-33c9-4721-ac2a-c81823b30b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:55.126511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbcb1a-33c9-4721-ac2a-c81823b30b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:55.128315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbcb1a-33c9-4721-ac2a-c81823b30b56 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:55.143873 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1271/2570] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:44:55.145896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea45623-faea-4c4c-aea9-5783ac65f50d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:55.162528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea45623-faea-4c4c-aea9-5783ac65f50d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:55.173741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f24bc0-37e0-49c4-a579-e6860fb2d2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:55.175225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f24bc0-37e0-49c4-a579-e6860fb2d2cb admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:55.175699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f24bc0-37e0-49c4-a579-e6860fb2d2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:55.176272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f24bc0-37e0-49c4-a579-e6860fb2d2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:55.177235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f24bc0-37e0-49c4-a579-e6860fb2d2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:55.180024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f24bc0-37e0-49c4-a579-e6860fb2d2cb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:55.201385 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1300/2571] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:44:55.202070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbcb1a-33c9-4721-ac2a-c81823b30b56 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:55.217312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbcb1a-33c9-4721-ac2a-c81823b30b56 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:55.224180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16608854-17ee-493b-aa6d-09cb5497922b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:55.225185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16608854-17ee-493b-aa6d-09cb5497922b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:55.225706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16608854-17ee-493b-aa6d-09cb5497922b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:55.226178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16608854-17ee-493b-aa6d-09cb5497922b admin admin] PATH_INFO: `/v3/projects/38f11c255e2544a9bdf11dfd584ea2c1/users/773e221dd6224ba6aed35e6135fb0e60/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:55.248514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16608854-17ee-493b-aa6d-09cb5497922b admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f11c255e2544a9bdf11dfd584ea2c1, user_id=773e221dd6224ba6aed35e6135fb0e60, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:55.253038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16608854-17ee-493b-aa6d-09cb5497922b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:55.273405 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1272/2572] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:44:55 2022] PUT /identity/v3/projects/38f11c255e2544a9bdf11dfd584ea2c1/users/773e221dd6224ba6aed35e6135fb0e60/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:44:55.350569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca23bdc-42a7-4a2e-be6b-dda2fd807bb0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:55.350923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca23bdc-42a7-4a2e-be6b-dda2fd807bb0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:55.351127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca23bdc-42a7-4a2e-be6b-dda2fd807bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:55.387370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fca23bdc-42a7-4a2e-be6b-dda2fd807bb0 None None] MFA Rules not processed for user `773e221dd6224ba6aed35e6135fb0e60`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:55.389223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fca23bdc-42a7-4a2e-be6b-dda2fd807bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:55.482982 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1301/2573] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:44:55.487845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16608854-17ee-493b-aa6d-09cb5497922b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:55.591395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16608854-17ee-493b-aa6d-09cb5497922b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:55.599537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acf5a6-80bf-421e-aa04-ecb6990a1fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:55.600176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acf5a6-80bf-421e-aa04-ecb6990a1fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:55.600450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acf5a6-80bf-421e-aa04-ecb6990a1fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:55.600803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acf5a6-80bf-421e-aa04-ecb6990a1fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:55.601519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acf5a6-80bf-421e-aa04-ecb6990a1fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:55.603453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acf5a6-80bf-421e-aa04-ecb6990a1fe4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:55.637542 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1273/2574] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:44:55 2022] POST /identity/v3/projects => generated 391 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:44:55.641081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca23bdc-42a7-4a2e-be6b-dda2fd807bb0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:55.657198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca23bdc-42a7-4a2e-be6b-dda2fd807bb0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:55.747971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773496b8-e703-4845-acf6-6c3495de2c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:55.749780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773496b8-e703-4845-acf6-6c3495de2c02 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:55.750224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773496b8-e703-4845-acf6-6c3495de2c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:55.750655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773496b8-e703-4845-acf6-6c3495de2c02 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:55.751454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773496b8-e703-4845-acf6-6c3495de2c02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:55.753838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773496b8-e703-4845-acf6-6c3495de2c02 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:55.780814 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1302/2575] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:44:55 2022] POST /identity/v3/users => generated 302 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:44:55.784947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acf5a6-80bf-421e-aa04-ecb6990a1fe4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:55.799510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acf5a6-80bf-421e-aa04-ecb6990a1fe4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:55.805316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5982a3-0955-46d4-8680-881cb221c678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:55.806215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5982a3-0955-46d4-8680-881cb221c678 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:55.806629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5982a3-0955-46d4-8680-881cb221c678 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:55.807038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5982a3-0955-46d4-8680-881cb221c678 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:55.808370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5982a3-0955-46d4-8680-881cb221c678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:55.809688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5982a3-0955-46d4-8680-881cb221c678 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:55.851685 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1274/2576] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:44:55.852118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773496b8-e703-4845-acf6-6c3495de2c02 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:55.866147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773496b8-e703-4845-acf6-6c3495de2c02 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:55.873134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25023f-be36-4264-9d82-975bce4d8841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:55.874302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25023f-be36-4264-9d82-975bce4d8841 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:55.874596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25023f-be36-4264-9d82-975bce4d8841 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:55.874876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25023f-be36-4264-9d82-975bce4d8841 admin admin] PATH_INFO: `/v3/projects/35597ac4f46f44d697917f50aed0662a/users/c48f90f2c0374a30bdb4078051dd6744/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:55.919693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25023f-be36-4264-9d82-975bce4d8841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35597ac4f46f44d697917f50aed0662a, user_id=c48f90f2c0374a30bdb4078051dd6744, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:55.932232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25023f-be36-4264-9d82-975bce4d8841 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:55.950899 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1303/2577] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:44:55 2022] PUT /identity/v3/projects/35597ac4f46f44d697917f50aed0662a/users/c48f90f2c0374a30bdb4078051dd6744/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:44:55.955970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5982a3-0955-46d4-8680-881cb221c678 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:55.967278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5982a3-0955-46d4-8680-881cb221c678 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:55.994883 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:56.095029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b820a36-4edd-40c3-8a71-1b3bc27baec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:56.095657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b820a36-4edd-40c3-8a71-1b3bc27baec7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:56.095933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b820a36-4edd-40c3-8a71-1b3bc27baec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:56.096202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b820a36-4edd-40c3-8a71-1b3bc27baec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:56.096930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b820a36-4edd-40c3-8a71-1b3bc27baec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:56.101542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b820a36-4edd-40c3-8a71-1b3bc27baec7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:56.125384 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1275/2578] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:44:56.127799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25023f-be36-4264-9d82-975bce4d8841 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:56.139455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25023f-be36-4264-9d82-975bce4d8841 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:56.145567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d32281-ca67-4efc-b5bb-f57c67d19c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:56.145764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d32281-ca67-4efc-b5bb-f57c67d19c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:56.146074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d32281-ca67-4efc-b5bb-f57c67d19c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:56.146351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d32281-ca67-4efc-b5bb-f57c67d19c46 admin admin] PATH_INFO: `/v3/projects/35597ac4f46f44d697917f50aed0662a/users/c48f90f2c0374a30bdb4078051dd6744/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:56.148508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d32281-ca67-4efc-b5bb-f57c67d19c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35597ac4f46f44d697917f50aed0662a, user_id=c48f90f2c0374a30bdb4078051dd6744, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:56.151223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d32281-ca67-4efc-b5bb-f57c67d19c46 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:56.168643 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1304/2579] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:44:56 2022] PUT /identity/v3/projects/35597ac4f46f44d697917f50aed0662a/users/c48f90f2c0374a30bdb4078051dd6744/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:44:56.174108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2000a-e255-4fee-a0dc-fa2e8c6f73ec None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:56.175575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2000a-e255-4fee-a0dc-fa2e8c6f73ec None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:56.177005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2000a-e255-4fee-a0dc-fa2e8c6f73ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:56.226759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3dc2000a-e255-4fee-a0dc-fa2e8c6f73ec None None] MFA Rules not processed for user `c48f90f2c0374a30bdb4078051dd6744`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:56.230905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3dc2000a-e255-4fee-a0dc-fa2e8c6f73ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:56.368960 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1276/2580] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:56 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:56.378152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021a686-f972-40d0-9ae1-afb82f52e3b2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:56.378602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021a686-f972-40d0-9ae1-afb82f52e3b2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:56.378920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021a686-f972-40d0-9ae1-afb82f52e3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:56.419577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8021a686-f972-40d0-9ae1-afb82f52e3b2 None None] MFA Rules not processed for user `773e221dd6224ba6aed35e6135fb0e60`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:44:56.422379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8021a686-f972-40d0-9ae1-afb82f52e3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:56.457946 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:56.513425 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1305/2581] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:44:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:44:57.066318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2000a-e255-4fee-a0dc-fa2e8c6f73ec None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:57.067913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3dc2000a-e255-4fee-a0dc-fa2e8c6f73ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:57.237207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2000a-e255-4fee-a0dc-fa2e8c6f73ec None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:57.249989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd7449-398e-4d12-a50e-2545d32606a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:57.251044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd7449-398e-4d12-a50e-2545d32606a0 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:57.251484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd7449-398e-4d12-a50e-2545d32606a0 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:57.251923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd7449-398e-4d12-a50e-2545d32606a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:57.256069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6ccd7449-398e-4d12-a50e-2545d32606a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:44:57.322588 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:44:57.359519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd7449-398e-4d12-a50e-2545d32606a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:57.361460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd7449-398e-4d12-a50e-2545d32606a0 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:57.374120 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1277/2582] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:44:57.763660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021a686-f972-40d0-9ae1-afb82f52e3b2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:44:57.783481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021a686-f972-40d0-9ae1-afb82f52e3b2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:44:57.790927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7ad46-de62-4cc5-a16c-9238b7926f68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:44:57.791812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7ad46-de62-4cc5-a16c-9238b7926f68 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:44:57.792490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7ad46-de62-4cc5-a16c-9238b7926f68 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:44:57.792936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7ad46-de62-4cc5-a16c-9238b7926f68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:44:57.803634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7ad46-de62-4cc5-a16c-9238b7926f68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:44:57.805696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7ad46-de62-4cc5-a16c-9238b7926f68 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:44:57.843681 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1306/2583] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:44:57 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:45:00.725262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c801b8-f36c-4082-850a-e1b3bf080a5c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:00.726656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c801b8-f36c-4082-850a-e1b3bf080a5c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:00.727114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c801b8-f36c-4082-850a-e1b3bf080a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:00.761827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-85c801b8-f36c-4082-850a-e1b3bf080a5c None None] MFA Rules not processed for user `7fca17ba092e44f1a37b108778dc7a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:45:00.768968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-85c801b8-f36c-4082-850a-e1b3bf080a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:00.868914 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1278/2584] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:45:00 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:45:02.186387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd74768-25c2-4356-ad62-a379b78b51c1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:02.186802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd74768-25c2-4356-ad62-a379b78b51c1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:02.186905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd74768-25c2-4356-ad62-a379b78b51c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:02.232456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0fd74768-25c2-4356-ad62-a379b78b51c1 None None] MFA Rules not processed for user `e1f52d856b9e4b6ea65f649f30fcfeee`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:45:02.233874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0fd74768-25c2-4356-ad62-a379b78b51c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:02.368344 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1307/2585] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:45:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:45:02.402849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c801b8-f36c-4082-850a-e1b3bf080a5c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:45:02.404391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-85c801b8-f36c-4082-850a-e1b3bf080a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:02.510263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c801b8-f36c-4082-850a-e1b3bf080a5c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:45:02.515319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f2afa-0ef2-43f2-87bd-7fedd921324c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:45:02.516073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f2afa-0ef2-43f2-87bd-7fedd921324c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:02.516455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f2afa-0ef2-43f2-87bd-7fedd921324c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:02.517422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f2afa-0ef2-43f2-87bd-7fedd921324c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:02.532274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f2afa-0ef2-43f2-87bd-7fedd921324c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:45:02.534474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f2afa-0ef2-43f2-87bd-7fedd921324c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:45:02.550124 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1279/2586] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:45:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:45:04.954797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23390e4-3ac9-4fe3-bbac-76e32a37d5a9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:04.955781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23390e4-3ac9-4fe3-bbac-76e32a37d5a9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:04.956202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23390e4-3ac9-4fe3-bbac-76e32a37d5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:04.982208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c23390e4-3ac9-4fe3-bbac-76e32a37d5a9 None None] MFA Rules not processed for user `e1f52d856b9e4b6ea65f649f30fcfeee`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:45:04.983939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c23390e4-3ac9-4fe3-bbac-76e32a37d5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:04.992581 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1308/2587] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:45:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:45:06.367569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a61129-2c86-47da-b1d7-e0deb7e4616c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:06.368038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a61129-2c86-47da-b1d7-e0deb7e4616c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:06.368133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a61129-2c86-47da-b1d7-e0deb7e4616c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:06.406667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d6a61129-2c86-47da-b1d7-e0deb7e4616c None None] MFA Rules not processed for user `aa607111024540d1a09b01dfd1e5e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:45:06.408185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d6a61129-2c86-47da-b1d7-e0deb7e4616c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:06.429986 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1280/2588] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 09:45:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:45:06.436298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23390e4-3ac9-4fe3-bbac-76e32a37d5a9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:45:06.453796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23390e4-3ac9-4fe3-bbac-76e32a37d5a9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:45:06.459143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b620d57-7fba-48cb-be4b-d6e676f0e312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:45:06.459958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b620d57-7fba-48cb-be4b-d6e676f0e312 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:06.460417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b620d57-7fba-48cb-be4b-d6e676f0e312 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:06.460863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b620d57-7fba-48cb-be4b-d6e676f0e312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:06.473093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b620d57-7fba-48cb-be4b-d6e676f0e312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:45:06.477261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b620d57-7fba-48cb-be4b-d6e676f0e312 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:45:06.495983 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1309/2589] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:45:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:45:16.099864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a61129-2c86-47da-b1d7-e0deb7e4616c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:45:16.111255 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a61129-2c86-47da-b1d7-e0deb7e4616c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:45:16.117339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf119ea-a9e6-44f8-a002-4e52a7138924 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:45:16.117946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf119ea-a9e6-44f8-a002-4e52a7138924 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:16.118230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf119ea-a9e6-44f8-a002-4e52a7138924 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:16.118499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf119ea-a9e6-44f8-a002-4e52a7138924 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:16.120383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fbf119ea-a9e6-44f8-a002-4e52a7138924 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:16.186960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf119ea-a9e6-44f8-a002-4e52a7138924 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:45:16.188511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf119ea-a9e6-44f8-a002-4e52a7138924 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:45:16.201415 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1281/2590] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:45:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:45:16.488960 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=58 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:45:23.788262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc209f-f44f-4059-9494-9ed0d8a1e9c6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:23.788944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc209f-f44f-4059-9494-9ed0d8a1e9c6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:23.788944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc209f-f44f-4059-9494-9ed0d8a1e9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:23.812490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-94fc209f-f44f-4059-9494-9ed0d8a1e9c6 None None] MFA Rules not processed for user `22e55fa3cbc34ea19c099f2859dd7ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:45:23.814136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-94fc209f-f44f-4059-9494-9ed0d8a1e9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:23.882303 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1310/2591] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:45:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:45:24.269577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf119ea-a9e6-44f8-a002-4e52a7138924 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:45:24.271565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fbf119ea-a9e6-44f8-a002-4e52a7138924 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:24.286654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf119ea-a9e6-44f8-a002-4e52a7138924 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:45:24.292264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d0998-4035-4b65-8acf-b9938e92a666 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:45:24.292909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d0998-4035-4b65-8acf-b9938e92a666 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:24.293192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d0998-4035-4b65-8acf-b9938e92a666 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:24.293466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d0998-4035-4b65-8acf-b9938e92a666 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:24.298704 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:45:24.303112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d0998-4035-4b65-8acf-b9938e92a666 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:45:24.305152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d0998-4035-4b65-8acf-b9938e92a666 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:45:24.315691 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1282/2592] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:45:24 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:45:24.345233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56082939-63cc-4275-9fb3-c6662af8f12b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:24.345451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56082939-63cc-4275-9fb3-c6662af8f12b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:24.345731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56082939-63cc-4275-9fb3-c6662af8f12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:24.374561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-56082939-63cc-4275-9fb3-c6662af8f12b None None] MFA Rules not processed for user `773e221dd6224ba6aed35e6135fb0e60`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:45:24.375777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-56082939-63cc-4275-9fb3-c6662af8f12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:24.394466 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1311/2593] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:45:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:45:27.737226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7df403-d857-4a04-bd0d-c4f9b5f7770d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:27.737710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7df403-d857-4a04-bd0d-c4f9b5f7770d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:27.737862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7df403-d857-4a04-bd0d-c4f9b5f7770d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:27.768940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3f7df403-d857-4a04-bd0d-c4f9b5f7770d None None] MFA Rules not processed for user `5ee27b6e2411469d9ef72ad8a7e6491f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:45:27.770617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3f7df403-d857-4a04-bd0d-c4f9b5f7770d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:27.851738 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1283/2594] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:45:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:45:31.218655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56082939-63cc-4275-9fb3-c6662af8f12b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:45:31.219971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-56082939-63cc-4275-9fb3-c6662af8f12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:31.355685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56082939-63cc-4275-9fb3-c6662af8f12b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:45:31.361888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5c6df-7d6a-4198-a113-4323fcccb781 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:45:31.363327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5c6df-7d6a-4198-a113-4323fcccb781 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:31.363830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5c6df-7d6a-4198-a113-4323fcccb781 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:31.364579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5c6df-7d6a-4198-a113-4323fcccb781 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:31.366959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-52b5c6df-7d6a-4198-a113-4323fcccb781 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:31.383361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5c6df-7d6a-4198-a113-4323fcccb781 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:45:31.385179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5c6df-7d6a-4198-a113-4323fcccb781 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:45:31.401653 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1312/2595] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:45:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:45:32.451100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7df403-d857-4a04-bd0d-c4f9b5f7770d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:45:32.452548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3f7df403-d857-4a04-bd0d-c4f9b5f7770d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:32.475979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7df403-d857-4a04-bd0d-c4f9b5f7770d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:45:32.484890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09ceb9-1598-4848-b094-639324d3a07c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:45:32.485875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09ceb9-1598-4848-b094-639324d3a07c service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:32.486964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09ceb9-1598-4848-b094-639324d3a07c service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:32.487435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09ceb9-1598-4848-b094-639324d3a07c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:32.489524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6e09ceb9-1598-4848-b094-639324d3a07c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:32.505101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09ceb9-1598-4848-b094-639324d3a07c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:45:32.507008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09ceb9-1598-4848-b094-639324d3a07c service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:45:32.531607 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1284/2596] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:45:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:45:41.395958 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=60 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:45:42.514845 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=34 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:45:44.784321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5c6df-7d6a-4198-a113-4323fcccb781 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:45:44.785889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-52b5c6df-7d6a-4198-a113-4323fcccb781 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:44.973226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5c6df-7d6a-4198-a113-4323fcccb781 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:45:44.978299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2282c-4ae0-4a3f-a928-368c423c3bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:45:44.979253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2282c-4ae0-4a3f-a928-368c423c3bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:44.979717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2282c-4ae0-4a3f-a928-368c423c3bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:44.980206 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2282c-4ae0-4a3f-a928-368c423c3bb3 admin admin] PATH_INFO: `/v3/users/a21d45726c0d4c21a997ac67e2b07e00` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:44.983255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2282c-4ae0-4a3f-a928-368c423c3bb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a21d45726c0d4c21a997ac67e2b07e00)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:45:44.994250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2282c-4ae0-4a3f-a928-368c423c3bb3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:45:45.071021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2da2282c-4ae0-4a3f-a928-368c423c3bb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a21d45726c0d4c21a997ac67e2b07e00'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:45:45.071869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2da2282c-4ae0-4a3f-a928-368c423c3bb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a21d45726c0d4c21a997ac67e2b07e00'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:45:45.091641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2da2282c-4ae0-4a3f-a928-368c423c3bb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a21d45726c0d4c21a997ac67e2b07e00'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:45:45.140368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2da2282c-4ae0-4a3f-a928-368c423c3bb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a21d45726c0d4c21a997ac67e2b07e00'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:45:45.179877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2da2282c-4ae0-4a3f-a928-368c423c3bb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a21d45726c0d4c21a997ac67e2b07e00'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:45:45.213928 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1313/2597] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:45:44 2022] DELETE /identity/v3/users/a21d45726c0d4c21a997ac67e2b07e00 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:45:45.846736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09ceb9-1598-4848-b094-639324d3a07c service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:45:45.878086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09ceb9-1598-4848-b094-639324d3a07c service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:45:46.018598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a08e9-5247-4065-9a11-14a7e65cac85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:45:46.019792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a08e9-5247-4065-9a11-14a7e65cac85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:46.020307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a08e9-5247-4065-9a11-14a7e65cac85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:46.021224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a08e9-5247-4065-9a11-14a7e65cac85 admin admin] PATH_INFO: `/v3/projects/1b215a8c81c14330a5bd679f8e74ef57` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:46.024268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a08e9-5247-4065-9a11-14a7e65cac85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b215a8c81c14330a5bd679f8e74ef57)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:45:46.026726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a08e9-5247-4065-9a11-14a7e65cac85 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:45:46.134972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-145a08e9-5247-4065-9a11-14a7e65cac85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b215a8c81c14330a5bd679f8e74ef57', 'request_id': 'req-145a08e9-5247-4065-9a11-14a7e65cac85'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:45:46.152174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-145a08e9-5247-4065-9a11-14a7e65cac85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b215a8c81c14330a5bd679f8e74ef57', 'request_id': 'req-145a08e9-5247-4065-9a11-14a7e65cac85'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:45:46.169065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-145a08e9-5247-4065-9a11-14a7e65cac85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b215a8c81c14330a5bd679f8e74ef57', 'request_id': 'req-145a08e9-5247-4065-9a11-14a7e65cac85'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:45:46.196895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-145a08e9-5247-4065-9a11-14a7e65cac85 admin admin] The token cache is being invalidate because project 1b215a8c81c14330a5bd679f8e74ef57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:45:46.197495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-145a08e9-5247-4065-9a11-14a7e65cac85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:45:46.198592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-145a08e9-5247-4065-9a11-14a7e65cac85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:45:46.207088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa53b3-4bea-491c-a144-7e41e934e559 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:46.207981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa53b3-4bea-491c-a144-7e41e934e559 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:46.208422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa53b3-4bea-491c-a144-7e41e934e559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:46.217899 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1285/2598] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:45:45 2022] DELETE /identity/v3/projects/1b215a8c81c14330a5bd679f8e74ef57 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:45:46.237084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-35aa53b3-4bea-491c-a144-7e41e934e559 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:45:46.238424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-35aa53b3-4bea-491c-a144-7e41e934e559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:46.431092 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1314/2599] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:45:46.431463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dbcdb-845d-42cf-852e-0b7032dd54d6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:46.431955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dbcdb-845d-42cf-852e-0b7032dd54d6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:46.432294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dbcdb-845d-42cf-852e-0b7032dd54d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:46.476921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d51dbcdb-845d-42cf-852e-0b7032dd54d6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:45:46.478376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d51dbcdb-845d-42cf-852e-0b7032dd54d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:46.506095 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1286/2600] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:45:46.510682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa53b3-4bea-491c-a144-7e41e934e559 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:45:46.522752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa53b3-4bea-491c-a144-7e41e934e559 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:45:46.527512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0c0e4-e227-450b-9c4a-c7658a60077e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:45:46.528247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0c0e4-e227-450b-9c4a-c7658a60077e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:46.528954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0c0e4-e227-450b-9c4a-c7658a60077e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:46.529295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0c0e4-e227-450b-9c4a-c7658a60077e admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:46.531126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0c0e4-e227-450b-9c4a-c7658a60077e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:45:46.531540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0c0e4-e227-450b-9c4a-c7658a60077e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:45:46.533623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0c0e4-e227-450b-9c4a-c7658a60077e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:45:46.555914 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1315/2601] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:45:46.557259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51dbcdb-845d-42cf-852e-0b7032dd54d6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:45:46.567877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51dbcdb-845d-42cf-852e-0b7032dd54d6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:45:46.573168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0b5df-df70-40b0-9611-5387b4804e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:45:46.573848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0b5df-df70-40b0-9611-5387b4804e22 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:46.574194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0b5df-df70-40b0-9611-5387b4804e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:46.574524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0b5df-df70-40b0-9611-5387b4804e22 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:46.575222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0b5df-df70-40b0-9611-5387b4804e22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:45:46.577205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0b5df-df70-40b0-9611-5387b4804e22 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:45:46.617364 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1287/2602] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:45:46 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:45:46.620525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0c0e4-e227-450b-9c4a-c7658a60077e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:45:46.633651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0c0e4-e227-450b-9c4a-c7658a60077e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:45:46.638427 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:45:46.711820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b572a-d3e2-49a4-bf4b-1681dc3c541e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:45:46.712544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b572a-d3e2-49a4-bf4b-1681dc3c541e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:46.712925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b572a-d3e2-49a4-bf4b-1681dc3c541e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:46.713288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b572a-d3e2-49a4-bf4b-1681dc3c541e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:46.714248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b572a-d3e2-49a4-bf4b-1681dc3c541e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:45:46.717539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b572a-d3e2-49a4-bf4b-1681dc3c541e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:45:46.752784 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1316/2603] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:45:46 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:45:46.754235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0b5df-df70-40b0-9611-5387b4804e22 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:45:46.765378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0b5df-df70-40b0-9611-5387b4804e22 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:45:46.770682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c4135-686f-433b-bd16-eab6f92a4365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:45:46.771295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c4135-686f-433b-bd16-eab6f92a4365 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:46.771653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c4135-686f-433b-bd16-eab6f92a4365 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:46.772581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c4135-686f-433b-bd16-eab6f92a4365 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:46.772831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c4135-686f-433b-bd16-eab6f92a4365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:45:46.774453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c4135-686f-433b-bd16-eab6f92a4365 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:45:46.787554 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1288/2604] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:45:46.792089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b572a-d3e2-49a4-bf4b-1681dc3c541e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:45:46.810993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b572a-d3e2-49a4-bf4b-1681dc3c541e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:45:46.831220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbca1f9-f9a8-4abd-abc4-befe1bcecb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:45:46.832609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbca1f9-f9a8-4abd-abc4-befe1bcecb4f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:46.832947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbca1f9-f9a8-4abd-abc4-befe1bcecb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:46.833409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbca1f9-f9a8-4abd-abc4-befe1bcecb4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:46.834145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbca1f9-f9a8-4abd-abc4-befe1bcecb4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:45:46.837471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbca1f9-f9a8-4abd-abc4-befe1bcecb4f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:45:46.855305 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1317/2605] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:45:46.859260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c4135-686f-433b-bd16-eab6f92a4365 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:45:46.874076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c4135-686f-433b-bd16-eab6f92a4365 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:45:46.885015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c85bf8-4902-46b7-b0ce-8060075c83a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:45:46.885844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c85bf8-4902-46b7-b0ce-8060075c83a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:46.886223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c85bf8-4902-46b7-b0ce-8060075c83a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:46.886796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c85bf8-4902-46b7-b0ce-8060075c83a3 admin admin] PATH_INFO: `/v3/projects/8c55a5240efd4e47aea471ef9e3c7d45/users/ff5f171b2faf41988fc81c9a26404f0e/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:46.905481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c85bf8-4902-46b7-b0ce-8060075c83a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c55a5240efd4e47aea471ef9e3c7d45, user_id=ff5f171b2faf41988fc81c9a26404f0e, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:45:46.908952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c85bf8-4902-46b7-b0ce-8060075c83a3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:45:46.927101 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1289/2606] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:45:46 2022] PUT /identity/v3/projects/8c55a5240efd4e47aea471ef9e3c7d45/users/ff5f171b2faf41988fc81c9a26404f0e/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:45:46.932355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2e827-1913-4c83-a48d-bc3ebdaa6ba9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:46.932720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2e827-1913-4c83-a48d-bc3ebdaa6ba9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:46.933018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2e827-1913-4c83-a48d-bc3ebdaa6ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:46.955150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-57c2e827-1913-4c83-a48d-bc3ebdaa6ba9 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:45:46.956412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-57c2e827-1913-4c83-a48d-bc3ebdaa6ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:47.050269 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1318/2607] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:45:47.057750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c85bf8-4902-46b7-b0ce-8060075c83a3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:45:47.059848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-98c85bf8-4902-46b7-b0ce-8060075c83a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:47.094933 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:45:47.128165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c85bf8-4902-46b7-b0ce-8060075c83a3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:45:47.132035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029a71f-1458-4268-98aa-4fe7b2534c55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:45:47.133230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029a71f-1458-4268-98aa-4fe7b2534c55 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:47.133230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029a71f-1458-4268-98aa-4fe7b2534c55 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:47.133230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029a71f-1458-4268-98aa-4fe7b2534c55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:47.155252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029a71f-1458-4268-98aa-4fe7b2534c55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:45:47.155252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029a71f-1458-4268-98aa-4fe7b2534c55 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:45:47.163123 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1290/2608] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:45:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:45:57.038292 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=58,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:45:57.158224 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=14 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:45:57.215958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3a5bb-3bde-4664-92f7-65b5afbc26af None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:45:57.217555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3a5bb-3bde-4664-92f7-65b5afbc26af None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:45:57.218242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3a5bb-3bde-4664-92f7-65b5afbc26af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:45:57.259879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1be3a5bb-3bde-4664-92f7-65b5afbc26af None None] MFA Rules not processed for user `e1f52d856b9e4b6ea65f649f30fcfeee`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:45:57.262619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1be3a5bb-3bde-4664-92f7-65b5afbc26af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:45:57.383890 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1319/2609] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:45:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:00.343932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc9305-be21-4021-ad9a-a12cd42f7a30 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:00.345061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc9305-be21-4021-ad9a-a12cd42f7a30 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:00.345061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc9305-be21-4021-ad9a-a12cd42f7a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:00.379592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-61bc9305-be21-4021-ad9a-a12cd42f7a30 None None] MFA Rules not processed for user `ff5f171b2faf41988fc81c9a26404f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:00.381134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-61bc9305-be21-4021-ad9a-a12cd42f7a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:00.510312 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1291/2610] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:01.211379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3a5bb-3bde-4664-92f7-65b5afbc26af None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:01.213647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1be3a5bb-3bde-4664-92f7-65b5afbc26af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:01.397254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3a5bb-3bde-4664-92f7-65b5afbc26af None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:01.403880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e9015-1e30-4688-a6d5-276efb036694 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:01.404955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e9015-1e30-4688-a6d5-276efb036694 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:01.405322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e9015-1e30-4688-a6d5-276efb036694 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:01.405981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e9015-1e30-4688-a6d5-276efb036694 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:01.416710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e9015-1e30-4688-a6d5-276efb036694 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:01.418463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e9015-1e30-4688-a6d5-276efb036694 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:01.431972 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1320/2611] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:46:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:46:06.577791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc9305-be21-4021-ad9a-a12cd42f7a30 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:06.580814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-61bc9305-be21-4021-ad9a-a12cd42f7a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:06.596534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc9305-be21-4021-ad9a-a12cd42f7a30 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:06.601667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0de838-0a15-45de-8475-b2cb468f8647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:06.602310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0de838-0a15-45de-8475-b2cb468f8647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:06.602749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0de838-0a15-45de-8475-b2cb468f8647 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:06.603206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0de838-0a15-45de-8475-b2cb468f8647 admin admin] PATH_INFO: `/v3/users/773e221dd6224ba6aed35e6135fb0e60` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:06.604355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0de838-0a15-45de-8475-b2cb468f8647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=773e221dd6224ba6aed35e6135fb0e60)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:06.606768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0de838-0a15-45de-8475-b2cb468f8647 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:06.670547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a0de838-0a15-45de-8475-b2cb468f8647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '773e221dd6224ba6aed35e6135fb0e60'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:06.681588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a0de838-0a15-45de-8475-b2cb468f8647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '773e221dd6224ba6aed35e6135fb0e60'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:06.690743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a0de838-0a15-45de-8475-b2cb468f8647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '773e221dd6224ba6aed35e6135fb0e60'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:06.728767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a0de838-0a15-45de-8475-b2cb468f8647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '773e221dd6224ba6aed35e6135fb0e60'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:06.740531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a0de838-0a15-45de-8475-b2cb468f8647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '773e221dd6224ba6aed35e6135fb0e60'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:06.754643 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1292/2612] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:46:06 2022] DELETE /identity/v3/users/773e221dd6224ba6aed35e6135fb0e60 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:06.754983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321d3e4-18ab-4669-bfaf-9ee57b1b68b7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:06.755470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321d3e4-18ab-4669-bfaf-9ee57b1b68b7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:06.755568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321d3e4-18ab-4669-bfaf-9ee57b1b68b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:06.804296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5321d3e4-18ab-4669-bfaf-9ee57b1b68b7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:06.806439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5321d3e4-18ab-4669-bfaf-9ee57b1b68b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:06.954613 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1321/2613] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:07.008204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0de838-0a15-45de-8475-b2cb468f8647 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:07.009993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8a0de838-0a15-45de-8475-b2cb468f8647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:07.139777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0de838-0a15-45de-8475-b2cb468f8647 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:07.145684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf796f-a852-4d77-ab25-dfa821aa0060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:07.146544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf796f-a852-4d77-ab25-dfa821aa0060 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:07.146835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf796f-a852-4d77-ab25-dfa821aa0060 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:07.147109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf796f-a852-4d77-ab25-dfa821aa0060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:07.160184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf796f-a852-4d77-ab25-dfa821aa0060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:07.161788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf796f-a852-4d77-ab25-dfa821aa0060 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:07.168162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa810c-964a-4784-8fbe-e61c252eb557 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:07.170080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa810c-964a-4784-8fbe-e61c252eb557 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:07.170080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa810c-964a-4784-8fbe-e61c252eb557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:07.194565 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1293/2614] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:46:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:46:07.202535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-49aa810c-964a-4784-8fbe-e61c252eb557 None None] MFA Rules not processed for user `7fca17ba092e44f1a37b108778dc7a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:07.204858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-49aa810c-964a-4784-8fbe-e61c252eb557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:07.247756 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:07.294735 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1322/2615] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:07 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:46:08.003311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf796f-a852-4d77-ab25-dfa821aa0060 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:08.006039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ecaf796f-a852-4d77-ab25-dfa821aa0060 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:08.021854 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:08.033272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf796f-a852-4d77-ab25-dfa821aa0060 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:08.057882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f445a24-5539-4897-9aa4-885fd92c7550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:08.058929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f445a24-5539-4897-9aa4-885fd92c7550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:08.059442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f445a24-5539-4897-9aa4-885fd92c7550 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:08.059925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f445a24-5539-4897-9aa4-885fd92c7550 admin admin] PATH_INFO: `/v3/projects/38f11c255e2544a9bdf11dfd584ea2c1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:08.062532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f445a24-5539-4897-9aa4-885fd92c7550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38f11c255e2544a9bdf11dfd584ea2c1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:08.066155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f445a24-5539-4897-9aa4-885fd92c7550 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:08.141686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5f445a24-5539-4897-9aa4-885fd92c7550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38f11c255e2544a9bdf11dfd584ea2c1', 'request_id': 'req-5f445a24-5539-4897-9aa4-885fd92c7550'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:08.152473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5f445a24-5539-4897-9aa4-885fd92c7550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38f11c255e2544a9bdf11dfd584ea2c1', 'request_id': 'req-5f445a24-5539-4897-9aa4-885fd92c7550'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:08.158433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5f445a24-5539-4897-9aa4-885fd92c7550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38f11c255e2544a9bdf11dfd584ea2c1', 'request_id': 'req-5f445a24-5539-4897-9aa4-885fd92c7550'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:08.170976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5f445a24-5539-4897-9aa4-885fd92c7550 admin admin] The token cache is being invalidate because project 38f11c255e2544a9bdf11dfd584ea2c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:46:08.170976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5f445a24-5539-4897-9aa4-885fd92c7550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:08.172761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5f445a24-5539-4897-9aa4-885fd92c7550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:08.174161 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1294/2616] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:46:08 2022] DELETE /identity/v3/projects/38f11c255e2544a9bdf11dfd584ea2c1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:08.179035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa810c-964a-4784-8fbe-e61c252eb557 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:08.191052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa810c-964a-4784-8fbe-e61c252eb557 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:08.272420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7a6bf-45cd-4b58-a233-b3d2b2b261af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:08.273404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7a6bf-45cd-4b58-a233-b3d2b2b261af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:08.273706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7a6bf-45cd-4b58-a233-b3d2b2b261af admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:08.274199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7a6bf-45cd-4b58-a233-b3d2b2b261af admin admin] PATH_INFO: `/v3/users/c48f90f2c0374a30bdb4078051dd6744` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:08.275705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7a6bf-45cd-4b58-a233-b3d2b2b261af admin admin] RBAC: Authorizing `identity:delete_user(user_id=c48f90f2c0374a30bdb4078051dd6744)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:08.277731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7a6bf-45cd-4b58-a233-b3d2b2b261af admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:08.302787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336af4e-e29f-46a1-b4b4-15003fbc6703 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:08.303073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336af4e-e29f-46a1-b4b4-15003fbc6703 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:08.303349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336af4e-e29f-46a1-b4b4-15003fbc6703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:08.327531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0336af4e-e29f-46a1-b4b4-15003fbc6703 None None] MFA Rules not processed for user `ff5f171b2faf41988fc81c9a26404f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:08.329807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0336af4e-e29f-46a1-b4b4-15003fbc6703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:08.379164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1cb7a6bf-45cd-4b58-a233-b3d2b2b261af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c48f90f2c0374a30bdb4078051dd6744'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:08.380191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1cb7a6bf-45cd-4b58-a233-b3d2b2b261af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c48f90f2c0374a30bdb4078051dd6744'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:08.404466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1cb7a6bf-45cd-4b58-a233-b3d2b2b261af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c48f90f2c0374a30bdb4078051dd6744'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:08.432492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1cb7a6bf-45cd-4b58-a233-b3d2b2b261af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c48f90f2c0374a30bdb4078051dd6744'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:08.447017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1cb7a6bf-45cd-4b58-a233-b3d2b2b261af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c48f90f2c0374a30bdb4078051dd6744'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:08.459596 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1323/2617] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:46:08 2022] DELETE /identity/v3/users/c48f90f2c0374a30bdb4078051dd6744 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:08.466979 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1295/2618] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:09.138664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7a6bf-45cd-4b58-a233-b3d2b2b261af admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:09.140459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1cb7a6bf-45cd-4b58-a233-b3d2b2b261af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:09.386881 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:09.411931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7a6bf-45cd-4b58-a233-b3d2b2b261af admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:09.437201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6658c1e-24a1-4974-8a86-62e19b79987e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:09.438493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6658c1e-24a1-4974-8a86-62e19b79987e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:09.438902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6658c1e-24a1-4974-8a86-62e19b79987e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:09.439166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6658c1e-24a1-4974-8a86-62e19b79987e admin admin] PATH_INFO: `/v3/projects/35597ac4f46f44d697917f50aed0662a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:09.441006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6658c1e-24a1-4974-8a86-62e19b79987e admin admin] RBAC: Authorizing `identity:delete_project(project_id=35597ac4f46f44d697917f50aed0662a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:09.443859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6658c1e-24a1-4974-8a86-62e19b79987e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:09.586167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6658c1e-24a1-4974-8a86-62e19b79987e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35597ac4f46f44d697917f50aed0662a', 'request_id': 'req-a6658c1e-24a1-4974-8a86-62e19b79987e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:09.597795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6658c1e-24a1-4974-8a86-62e19b79987e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35597ac4f46f44d697917f50aed0662a', 'request_id': 'req-a6658c1e-24a1-4974-8a86-62e19b79987e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:09.617811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6658c1e-24a1-4974-8a86-62e19b79987e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35597ac4f46f44d697917f50aed0662a', 'request_id': 'req-a6658c1e-24a1-4974-8a86-62e19b79987e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:09.639626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6658c1e-24a1-4974-8a86-62e19b79987e admin admin] The token cache is being invalidate because project 35597ac4f46f44d697917f50aed0662a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:46:09.639921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6658c1e-24a1-4974-8a86-62e19b79987e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:09.645048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6658c1e-24a1-4974-8a86-62e19b79987e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:09.657639 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1324/2619] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:46:09 2022] DELETE /identity/v3/projects/35597ac4f46f44d697917f50aed0662a => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:09.659011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5d096-1711-4a66-8f47-784a3316035a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:09.660118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5d096-1711-4a66-8f47-784a3316035a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:09.661193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5d096-1711-4a66-8f47-784a3316035a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:09.709308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dcf5d096-1711-4a66-8f47-784a3316035a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:09.712335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dcf5d096-1711-4a66-8f47-784a3316035a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:09.919463 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1296/2620] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:09.919667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95c3e4-44a6-48f7-b47d-2cf89fe0a363 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:09.919786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95c3e4-44a6-48f7-b47d-2cf89fe0a363 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:09.920049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95c3e4-44a6-48f7-b47d-2cf89fe0a363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:09.968381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9c95c3e4-44a6-48f7-b47d-2cf89fe0a363 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:09.969804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9c95c3e4-44a6-48f7-b47d-2cf89fe0a363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:09.999018 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1325/2621] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:10.002134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5d096-1711-4a66-8f47-784a3316035a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:10.035634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5d096-1711-4a66-8f47-784a3316035a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:10.061439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00fb07-2989-4f51-b6bc-171152362a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:10.062299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00fb07-2989-4f51-b6bc-171152362a89 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:10.064029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00fb07-2989-4f51-b6bc-171152362a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:10.064478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00fb07-2989-4f51-b6bc-171152362a89 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:10.065348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00fb07-2989-4f51-b6bc-171152362a89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:46:10.073066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00fb07-2989-4f51-b6bc-171152362a89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:10.081406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00fb07-2989-4f51-b6bc-171152362a89 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:10.113966 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1297/2622] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:46:10.125863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95c3e4-44a6-48f7-b47d-2cf89fe0a363 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:10.144509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95c3e4-44a6-48f7-b47d-2cf89fe0a363 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:10.149751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f3ed2-8a1b-4182-a7df-416eba350366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:10.150371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f3ed2-8a1b-4182-a7df-416eba350366 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:10.150652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f3ed2-8a1b-4182-a7df-416eba350366 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:10.150929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f3ed2-8a1b-4182-a7df-416eba350366 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:10.151629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f3ed2-8a1b-4182-a7df-416eba350366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:10.153628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f3ed2-8a1b-4182-a7df-416eba350366 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:10.236228 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1326/2623] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:46:10 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:46:10.241108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00fb07-2989-4f51-b6bc-171152362a89 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:10.256782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00fb07-2989-4f51-b6bc-171152362a89 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:10.284975 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:10.353159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83937f-a302-45ec-9ca0-f98acfdefb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:10.354254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83937f-a302-45ec-9ca0-f98acfdefb94 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:10.354889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83937f-a302-45ec-9ca0-f98acfdefb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:10.355521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83937f-a302-45ec-9ca0-f98acfdefb94 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:10.356415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83937f-a302-45ec-9ca0-f98acfdefb94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:10.358821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83937f-a302-45ec-9ca0-f98acfdefb94 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:10.391978 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1298/2624] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:46:10 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:46:10.395296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f3ed2-8a1b-4182-a7df-416eba350366 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:10.408868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f3ed2-8a1b-4182-a7df-416eba350366 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:10.423130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a48a77-40ef-4c56-a0e4-21572702cd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:10.423761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a48a77-40ef-4c56-a0e4-21572702cd84 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:10.424036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a48a77-40ef-4c56-a0e4-21572702cd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:10.424301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a48a77-40ef-4c56-a0e4-21572702cd84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:10.424981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a48a77-40ef-4c56-a0e4-21572702cd84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:10.428400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a48a77-40ef-4c56-a0e4-21572702cd84 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:10.451599 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1327/2625] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:46:10.456000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83937f-a302-45ec-9ca0-f98acfdefb94 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:10.469330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83937f-a302-45ec-9ca0-f98acfdefb94 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:10.480653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc86852-0afd-49f8-9d59-02a1c4a32c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:10.481329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc86852-0afd-49f8-9d59-02a1c4a32c11 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:10.481605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc86852-0afd-49f8-9d59-02a1c4a32c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:10.481871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc86852-0afd-49f8-9d59-02a1c4a32c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:10.482515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc86852-0afd-49f8-9d59-02a1c4a32c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:10.485818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc86852-0afd-49f8-9d59-02a1c4a32c11 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:10.518857 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1299/2626] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:46:10.522956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a48a77-40ef-4c56-a0e4-21572702cd84 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:10.545978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a48a77-40ef-4c56-a0e4-21572702cd84 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:10.563729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99875f-4ce5-434a-ba00-971a18738625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:10.566398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99875f-4ce5-434a-ba00-971a18738625 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:10.566883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99875f-4ce5-434a-ba00-971a18738625 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:10.567505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99875f-4ce5-434a-ba00-971a18738625 admin admin] PATH_INFO: `/v3/projects/e0ea287eaa5e46dc83500f96ab1f9d90/users/71c6b78b04b34bf7984e8d8df95eb955/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:10.635846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99875f-4ce5-434a-ba00-971a18738625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0ea287eaa5e46dc83500f96ab1f9d90, user_id=71c6b78b04b34bf7984e8d8df95eb955, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:10.674747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99875f-4ce5-434a-ba00-971a18738625 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:10.722144 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1328/2627] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:46:10 2022] PUT /identity/v3/projects/e0ea287eaa5e46dc83500f96ab1f9d90/users/71c6b78b04b34bf7984e8d8df95eb955/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:10.733575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed1614-a8ae-4163-aeeb-bf7e1bd430c1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:10.735459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed1614-a8ae-4163-aeeb-bf7e1bd430c1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:10.736170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed1614-a8ae-4163-aeeb-bf7e1bd430c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:10.770995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f7ed1614-a8ae-4163-aeeb-bf7e1bd430c1 None None] MFA Rules not processed for user `71c6b78b04b34bf7984e8d8df95eb955`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:10.772503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f7ed1614-a8ae-4163-aeeb-bf7e1bd430c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:10.916004 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1300/2628] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:10.929564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99875f-4ce5-434a-ba00-971a18738625 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:10.933506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4c99875f-4ce5-434a-ba00-971a18738625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:11.084593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99875f-4ce5-434a-ba00-971a18738625 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:11.100384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b196f-1b70-4206-818d-20887963061e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:11.102460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b196f-1b70-4206-818d-20887963061e service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:11.105373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b196f-1b70-4206-818d-20887963061e service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:11.105658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b196f-1b70-4206-818d-20887963061e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:11.134089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b196f-1b70-4206-818d-20887963061e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:11.137042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b196f-1b70-4206-818d-20887963061e service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:11.182727 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1329/2629] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:46:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:46:11.499201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f26dbc-6a84-47b6-a038-5db0bf8d14e5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:11.501335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f26dbc-6a84-47b6-a038-5db0bf8d14e5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:11.501335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f26dbc-6a84-47b6-a038-5db0bf8d14e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:11.534473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-63f26dbc-6a84-47b6-a038-5db0bf8d14e5 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:11.536304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-63f26dbc-6a84-47b6-a038-5db0bf8d14e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:11.652264 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1301/2630] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:46:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:11.727630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b196f-1b70-4206-818d-20887963061e service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:11.730529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-565b196f-1b70-4206-818d-20887963061e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:11.748497 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:11.871943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b196f-1b70-4206-818d-20887963061e service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:11.878175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5746f-662e-4797-aef1-2c24f525000c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:11.879158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5746f-662e-4797-aef1-2c24f525000c service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:11.879583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5746f-662e-4797-aef1-2c24f525000c service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:11.879977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5746f-662e-4797-aef1-2c24f525000c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:11.901383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5746f-662e-4797-aef1-2c24f525000c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:11.904758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5746f-662e-4797-aef1-2c24f525000c service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:11.933799 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1330/2631] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:46:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 09:46:12.220895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4aabfc-a3e3-4b7f-8784-3dd4eb6a4397 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:12.221451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4aabfc-a3e3-4b7f-8784-3dd4eb6a4397 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:12.221451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4aabfc-a3e3-4b7f-8784-3dd4eb6a4397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:12.268651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ef4aabfc-a3e3-4b7f-8784-3dd4eb6a4397 None None] MFA Rules not processed for user `71c6b78b04b34bf7984e8d8df95eb955`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:12.272959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ef4aabfc-a3e3-4b7f-8784-3dd4eb6a4397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:12.296268 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1302/2632] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:13.592941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435fd5e-19ef-4ab5-8d51-d0d83b8228ac None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:13.593475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435fd5e-19ef-4ab5-8d51-d0d83b8228ac None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:13.593776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435fd5e-19ef-4ab5-8d51-d0d83b8228ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:13.655452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f435fd5e-19ef-4ab5-8d51-d0d83b8228ac None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:13.661979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f435fd5e-19ef-4ab5-8d51-d0d83b8228ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:13.688775 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1331/2633] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 09:46:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:13.706068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4aabfc-a3e3-4b7f-8784-3dd4eb6a4397 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:13.727959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4aabfc-a3e3-4b7f-8784-3dd4eb6a4397 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:13.740207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68abae-052b-47f5-b18e-bcd637edc623 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:13.744218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68abae-052b-47f5-b18e-bcd637edc623 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:13.746133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68abae-052b-47f5-b18e-bcd637edc623 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:13.747747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68abae-052b-47f5-b18e-bcd637edc623 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:13.776196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68abae-052b-47f5-b18e-bcd637edc623 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:13.777826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68abae-052b-47f5-b18e-bcd637edc623 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:13.800728 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1303/2634] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:46:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:46:14.109377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435fd5e-19ef-4ab5-8d51-d0d83b8228ac None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:14.257836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435fd5e-19ef-4ab5-8d51-d0d83b8228ac None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:14.272637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e03fbf-5401-414c-8ce0-7bc8a450633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:14.274512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e03fbf-5401-414c-8ce0-7bc8a450633e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:14.275706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e03fbf-5401-414c-8ce0-7bc8a450633e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:14.276200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e03fbf-5401-414c-8ce0-7bc8a450633e admin admin] PATH_INFO: `/v3/users/71c6b78b04b34bf7984e8d8df95eb955` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:14.280092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e03fbf-5401-414c-8ce0-7bc8a450633e admin admin] RBAC: Authorizing `identity:delete_user(user_id=71c6b78b04b34bf7984e8d8df95eb955)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:14.283336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e03fbf-5401-414c-8ce0-7bc8a450633e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:14.427181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-64e03fbf-5401-414c-8ce0-7bc8a450633e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71c6b78b04b34bf7984e8d8df95eb955'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:14.427945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-64e03fbf-5401-414c-8ce0-7bc8a450633e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71c6b78b04b34bf7984e8d8df95eb955'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:14.440499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-64e03fbf-5401-414c-8ce0-7bc8a450633e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71c6b78b04b34bf7984e8d8df95eb955'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:14.464546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-64e03fbf-5401-414c-8ce0-7bc8a450633e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71c6b78b04b34bf7984e8d8df95eb955'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:14.484497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-64e03fbf-5401-414c-8ce0-7bc8a450633e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71c6b78b04b34bf7984e8d8df95eb955'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:14.529374 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1332/2635] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:46:14 2022] DELETE /identity/v3/users/71c6b78b04b34bf7984e8d8df95eb955 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:14.530202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f7d91-58b0-4f68-b56c-d42fe8b94d4e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:14.530496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f7d91-58b0-4f68-b56c-d42fe8b94d4e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:14.530775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f7d91-58b0-4f68-b56c-d42fe8b94d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:14.566458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e43f7d91-58b0-4f68-b56c-d42fe8b94d4e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:14.569440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e43f7d91-58b0-4f68-b56c-d42fe8b94d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:14.583582 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:14.675432 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1304/2636] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:14.701655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e03fbf-5401-414c-8ce0-7bc8a450633e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:14.704463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-64e03fbf-5401-414c-8ce0-7bc8a450633e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:14.717816 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:14.808440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e03fbf-5401-414c-8ce0-7bc8a450633e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:14.817519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce738d-8762-4b5c-8347-cff1496c7a2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:14.818625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce738d-8762-4b5c-8347-cff1496c7a2b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:14.819501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce738d-8762-4b5c-8347-cff1496c7a2b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:14.819769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce738d-8762-4b5c-8347-cff1496c7a2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:14.835934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce738d-8762-4b5c-8347-cff1496c7a2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:14.837608 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce738d-8762-4b5c-8347-cff1496c7a2b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:14.850151 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1333/2637] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:46:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:46:15.789239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f7d91-58b0-4f68-b56c-d42fe8b94d4e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:15.789239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e43f7d91-58b0-4f68-b56c-d42fe8b94d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:15.807946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f7d91-58b0-4f68-b56c-d42fe8b94d4e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:15.814187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf0314-3a05-43bb-bf18-0ad78c98a1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:15.814828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf0314-3a05-43bb-bf18-0ad78c98a1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:15.815100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf0314-3a05-43bb-bf18-0ad78c98a1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:15.815522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf0314-3a05-43bb-bf18-0ad78c98a1b8 admin admin] PATH_INFO: `/v3/users/62956fe5a4d44689b2413b132a78351c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:15.816877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf0314-3a05-43bb-bf18-0ad78c98a1b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62956fe5a4d44689b2413b132a78351c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:15.818913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf0314-3a05-43bb-bf18-0ad78c98a1b8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:15.916585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d2bf0314-3a05-43bb-bf18-0ad78c98a1b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62956fe5a4d44689b2413b132a78351c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:15.948833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce738d-8762-4b5c-8347-cff1496c7a2b service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:15.948833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c0ce738d-8762-4b5c-8347-cff1496c7a2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:15.954042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d2bf0314-3a05-43bb-bf18-0ad78c98a1b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62956fe5a4d44689b2413b132a78351c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:15.954042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d2bf0314-3a05-43bb-bf18-0ad78c98a1b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62956fe5a4d44689b2413b132a78351c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:15.972508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d2bf0314-3a05-43bb-bf18-0ad78c98a1b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62956fe5a4d44689b2413b132a78351c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:15.984191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d2bf0314-3a05-43bb-bf18-0ad78c98a1b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62956fe5a4d44689b2413b132a78351c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:15.994990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce738d-8762-4b5c-8347-cff1496c7a2b service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:15.996641 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1305/2638] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:46:15 2022] DELETE /identity/v3/users/62956fe5a4d44689b2413b132a78351c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:16.098072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794d454-e74f-45fe-bafe-8c04be4e596d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:16.099361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794d454-e74f-45fe-bafe-8c04be4e596d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:16.100169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794d454-e74f-45fe-bafe-8c04be4e596d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:16.100776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794d454-e74f-45fe-bafe-8c04be4e596d admin admin] PATH_INFO: `/v3/projects/e0ea287eaa5e46dc83500f96ab1f9d90` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:16.102008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794d454-e74f-45fe-bafe-8c04be4e596d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0ea287eaa5e46dc83500f96ab1f9d90)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:16.103992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794d454-e74f-45fe-bafe-8c04be4e596d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:16.212163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6794d454-e74f-45fe-bafe-8c04be4e596d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0ea287eaa5e46dc83500f96ab1f9d90', 'request_id': 'req-6794d454-e74f-45fe-bafe-8c04be4e596d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:16.226996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6794d454-e74f-45fe-bafe-8c04be4e596d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0ea287eaa5e46dc83500f96ab1f9d90', 'request_id': 'req-6794d454-e74f-45fe-bafe-8c04be4e596d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:16.236460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6794d454-e74f-45fe-bafe-8c04be4e596d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0ea287eaa5e46dc83500f96ab1f9d90', 'request_id': 'req-6794d454-e74f-45fe-bafe-8c04be4e596d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:16.252174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6794d454-e74f-45fe-bafe-8c04be4e596d admin admin] The token cache is being invalidate because project e0ea287eaa5e46dc83500f96ab1f9d90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:46:16.252780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6794d454-e74f-45fe-bafe-8c04be4e596d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:16.253944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6794d454-e74f-45fe-bafe-8c04be4e596d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:16.255769 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1334/2639] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:46:15 2022] DELETE /identity/v3/projects/e0ea287eaa5e46dc83500f96ab1f9d90 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:16.261951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2a8be-7b7b-47f4-9823-a00b8524d598 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:16.262288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2a8be-7b7b-47f4-9823-a00b8524d598 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:16.262670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2a8be-7b7b-47f4-9823-a00b8524d598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:16.274759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794d454-e74f-45fe-bafe-8c04be4e596d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:16.278666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6794d454-e74f-45fe-bafe-8c04be4e596d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:16.305098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cca2a8be-7b7b-47f4-9823-a00b8524d598 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:16.307751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cca2a8be-7b7b-47f4-9823-a00b8524d598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:16.363265 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:16.393826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794d454-e74f-45fe-bafe-8c04be4e596d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:16.402048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0906ec-83b0-4a02-af6c-18812f393e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:16.402792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0906ec-83b0-4a02-af6c-18812f393e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:16.403268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0906ec-83b0-4a02-af6c-18812f393e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:16.403608 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0906ec-83b0-4a02-af6c-18812f393e01 admin admin] PATH_INFO: `/v3/projects/4c91a1b730584c7bbc0ecfdc9e58d95f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:16.404943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0906ec-83b0-4a02-af6c-18812f393e01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c91a1b730584c7bbc0ecfdc9e58d95f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:16.409651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0906ec-83b0-4a02-af6c-18812f393e01 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:16.410132 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1306/2640] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:46:16.418130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44432d-14fe-46bd-b7dc-fc727fa7c706 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:16.419673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44432d-14fe-46bd-b7dc-fc727fa7c706 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:16.421026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44432d-14fe-46bd-b7dc-fc727fa7c706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:16.454961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5c44432d-14fe-46bd-b7dc-fc727fa7c706 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:16.457284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5c44432d-14fe-46bd-b7dc-fc727fa7c706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:16.474725 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1307/2641] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:46:16.479356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44432d-14fe-46bd-b7dc-fc727fa7c706 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:16.480882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1b0906ec-83b0-4a02-af6c-18812f393e01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c91a1b730584c7bbc0ecfdc9e58d95f', 'request_id': 'req-1b0906ec-83b0-4a02-af6c-18812f393e01'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:16.493080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44432d-14fe-46bd-b7dc-fc727fa7c706 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:16.495442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1b0906ec-83b0-4a02-af6c-18812f393e01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c91a1b730584c7bbc0ecfdc9e58d95f', 'request_id': 'req-1b0906ec-83b0-4a02-af6c-18812f393e01'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:16.506948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1b0906ec-83b0-4a02-af6c-18812f393e01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c91a1b730584c7bbc0ecfdc9e58d95f', 'request_id': 'req-1b0906ec-83b0-4a02-af6c-18812f393e01'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:16.523673 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:16.532252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1b0906ec-83b0-4a02-af6c-18812f393e01 admin admin] The token cache is being invalidate because project 4c91a1b730584c7bbc0ecfdc9e58d95f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:46:16.533574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1b0906ec-83b0-4a02-af6c-18812f393e01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:16.536687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1b0906ec-83b0-4a02-af6c-18812f393e01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:16.540393 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1335/2642] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:46:16 2022] DELETE /identity/v3/projects/4c91a1b730584c7bbc0ecfdc9e58d95f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:16.544301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0906ec-83b0-4a02-af6c-18812f393e01 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:16.547315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1b0906ec-83b0-4a02-af6c-18812f393e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:16.608370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e691a-e92e-47d7-97ea-b45186f123a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:16.609595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e691a-e92e-47d7-97ea-b45186f123a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:16.610016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e691a-e92e-47d7-97ea-b45186f123a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:16.610388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e691a-e92e-47d7-97ea-b45186f123a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:16.611172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e691a-e92e-47d7-97ea-b45186f123a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:46:16.611519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e691a-e92e-47d7-97ea-b45186f123a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:16.613177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e691a-e92e-47d7-97ea-b45186f123a2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:16.630869 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1308/2643] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:46:16.635484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e691a-e92e-47d7-97ea-b45186f123a2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:16.638551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fb0e691a-e92e-47d7-97ea-b45186f123a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:16.657559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e691a-e92e-47d7-97ea-b45186f123a2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:16.665304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb14b84-7adf-49ff-a95b-4b8722ab1b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:16.666217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb14b84-7adf-49ff-a95b-4b8722ab1b81 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:16.666643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb14b84-7adf-49ff-a95b-4b8722ab1b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:16.667009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb14b84-7adf-49ff-a95b-4b8722ab1b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:16.667723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb14b84-7adf-49ff-a95b-4b8722ab1b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:16.670385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb14b84-7adf-49ff-a95b-4b8722ab1b81 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:16.680712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0906ec-83b0-4a02-af6c-18812f393e01 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:16.685960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80581f-2074-4b92-aa12-28cfa96a19ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:16.686608 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80581f-2074-4b92-aa12-28cfa96a19ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:16.686954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80581f-2074-4b92-aa12-28cfa96a19ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:16.687484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80581f-2074-4b92-aa12-28cfa96a19ad admin admin] PATH_INFO: `/v3/users/2dd21bb1f4894be393a51c8a268dc869` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:16.690275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80581f-2074-4b92-aa12-28cfa96a19ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dd21bb1f4894be393a51c8a268dc869)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:16.692245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80581f-2074-4b92-aa12-28cfa96a19ad admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:16.818857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9f80581f-2074-4b92-aa12-28cfa96a19ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dd21bb1f4894be393a51c8a268dc869'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:16.820134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9f80581f-2074-4b92-aa12-28cfa96a19ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dd21bb1f4894be393a51c8a268dc869'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:16.832674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9f80581f-2074-4b92-aa12-28cfa96a19ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dd21bb1f4894be393a51c8a268dc869'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:16.885341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9f80581f-2074-4b92-aa12-28cfa96a19ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dd21bb1f4894be393a51c8a268dc869'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:16.888054 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:16.904753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9f80581f-2074-4b92-aa12-28cfa96a19ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dd21bb1f4894be393a51c8a268dc869'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:16.923282 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1336/2644] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:46:16 2022] DELETE /identity/v3/users/2dd21bb1f4894be393a51c8a268dc869 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:46:16.939003 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1309/2645] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:46:16 2022] POST /identity/v3/projects => generated 389 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:46:16.940427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80581f-2074-4b92-aa12-28cfa96a19ad admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:16.942356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9f80581f-2074-4b92-aa12-28cfa96a19ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:17.075545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80581f-2074-4b92-aa12-28cfa96a19ad admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:17.189363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5c4d4-5f23-4898-a670-165862c9b481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:17.189998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5c4d4-5f23-4898-a670-165862c9b481 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:17.190285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5c4d4-5f23-4898-a670-165862c9b481 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:17.190557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5c4d4-5f23-4898-a670-165862c9b481 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:17.191563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5c4d4-5f23-4898-a670-165862c9b481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:17.196882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5c4d4-5f23-4898-a670-165862c9b481 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:17.248642 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1337/2646] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:46:16 2022] POST /identity/v3/users => generated 295 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:46:17.251474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb14b84-7adf-49ff-a95b-4b8722ab1b81 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:17.275901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb14b84-7adf-49ff-a95b-4b8722ab1b81 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:17.286632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94787a-791f-47b3-96ef-8b195f121e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:17.288229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94787a-791f-47b3-96ef-8b195f121e9d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:17.289367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94787a-791f-47b3-96ef-8b195f121e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:17.289799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94787a-791f-47b3-96ef-8b195f121e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:17.291421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94787a-791f-47b3-96ef-8b195f121e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:17.293884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94787a-791f-47b3-96ef-8b195f121e9d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:17.326820 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1310/2647] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:46:17.332293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5c4d4-5f23-4898-a670-165862c9b481 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:17.358317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5c4d4-5f23-4898-a670-165862c9b481 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:17.371809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db6316-17bd-4c41-8bd0-46634c476d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:17.372588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db6316-17bd-4c41-8bd0-46634c476d2e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:17.372976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db6316-17bd-4c41-8bd0-46634c476d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:17.373180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db6316-17bd-4c41-8bd0-46634c476d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:17.374173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db6316-17bd-4c41-8bd0-46634c476d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:17.392000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db6316-17bd-4c41-8bd0-46634c476d2e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:17.420331 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1338/2648] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:46:17.421352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94787a-791f-47b3-96ef-8b195f121e9d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:17.463186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94787a-791f-47b3-96ef-8b195f121e9d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:17.464207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db6316-17bd-4c41-8bd0-46634c476d2e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:17.466412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-29db6316-17bd-4c41-8bd0-46634c476d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:17.491975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db6316-17bd-4c41-8bd0-46634c476d2e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:17.495517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf14d30-b40a-43be-bd16-9f6ace7dfb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:17.497134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf14d30-b40a-43be-bd16-9f6ace7dfb18 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:17.497647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf14d30-b40a-43be-bd16-9f6ace7dfb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:17.498341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf14d30-b40a-43be-bd16-9f6ace7dfb18 admin admin] PATH_INFO: `/v3/projects/7454bf9254964e6bafba59f571796e44/users/ca416a5bcdd94249b268c87a84c2793b/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:17.505557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f649e25-91de-40d4-82ee-271a0dcd390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:17.508150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f649e25-91de-40d4-82ee-271a0dcd390e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:17.508150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f649e25-91de-40d4-82ee-271a0dcd390e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:17.508150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f649e25-91de-40d4-82ee-271a0dcd390e admin admin] PATH_INFO: `/v3/projects/786f5598752048378db76c7d27199197` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:17.508150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f649e25-91de-40d4-82ee-271a0dcd390e admin admin] RBAC: Authorizing `identity:delete_project(project_id=786f5598752048378db76c7d27199197)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:17.510115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f649e25-91de-40d4-82ee-271a0dcd390e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:17.527099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf14d30-b40a-43be-bd16-9f6ace7dfb18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7454bf9254964e6bafba59f571796e44, user_id=ca416a5bcdd94249b268c87a84c2793b, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:17.531616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf14d30-b40a-43be-bd16-9f6ace7dfb18 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:17.568833 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1311/2649] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:46:17 2022] PUT /identity/v3/projects/7454bf9254964e6bafba59f571796e44/users/ca416a5bcdd94249b268c87a84c2793b/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:17.574284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666adb7a-dfa6-41c6-bb80-1511fb3098e7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:17.575073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666adb7a-dfa6-41c6-bb80-1511fb3098e7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:17.575073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666adb7a-dfa6-41c6-bb80-1511fb3098e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:17.616918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0f649e25-91de-40d4-82ee-271a0dcd390e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '786f5598752048378db76c7d27199197', 'request_id': 'req-0f649e25-91de-40d4-82ee-271a0dcd390e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:17.637341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0f649e25-91de-40d4-82ee-271a0dcd390e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '786f5598752048378db76c7d27199197', 'request_id': 'req-0f649e25-91de-40d4-82ee-271a0dcd390e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:17.645594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0f649e25-91de-40d4-82ee-271a0dcd390e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '786f5598752048378db76c7d27199197', 'request_id': 'req-0f649e25-91de-40d4-82ee-271a0dcd390e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:17.655774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-666adb7a-dfa6-41c6-bb80-1511fb3098e7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:17.661875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-666adb7a-dfa6-41c6-bb80-1511fb3098e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:17.665057 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:17.674191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0f649e25-91de-40d4-82ee-271a0dcd390e admin admin] The token cache is being invalidate because project 786f5598752048378db76c7d27199197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:46:17.674927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0f649e25-91de-40d4-82ee-271a0dcd390e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:17.677664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0f649e25-91de-40d4-82ee-271a0dcd390e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:17.683556 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1339/2650] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:46:17 2022] DELETE /identity/v3/projects/786f5598752048378db76c7d27199197 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:46:17.691661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321622a-70e8-4a1b-b7cc-80aa58d07ffe None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:17.694717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321622a-70e8-4a1b-b7cc-80aa58d07ffe None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:17.695921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321622a-70e8-4a1b-b7cc-80aa58d07ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:17.794076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b321622a-70e8-4a1b-b7cc-80aa58d07ffe None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:17.800959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b321622a-70e8-4a1b-b7cc-80aa58d07ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:17.922305 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1312/2651] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:17.947023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666adb7a-dfa6-41c6-bb80-1511fb3098e7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:17.949369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-666adb7a-dfa6-41c6-bb80-1511fb3098e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:18.026867 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1340/2652] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:18.041164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7bac8-55b4-4f7e-8f1d-caf9d4484471 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:18.041451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7bac8-55b4-4f7e-8f1d-caf9d4484471 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:18.041728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7bac8-55b4-4f7e-8f1d-caf9d4484471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:18.085449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5ed7bac8-55b4-4f7e-8f1d-caf9d4484471 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:18.087050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5ed7bac8-55b4-4f7e-8f1d-caf9d4484471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:18.102218 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1341/2653] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:18.105316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7bac8-55b4-4f7e-8f1d-caf9d4484471 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:18.107809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666adb7a-dfa6-41c6-bb80-1511fb3098e7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:18.114632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb765a-d10e-49dd-9ec9-821c7959c28a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:18.115464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb765a-d10e-49dd-9ec9-821c7959c28a service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:18.116366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb765a-d10e-49dd-9ec9-821c7959c28a service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:18.116848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb765a-d10e-49dd-9ec9-821c7959c28a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:18.133553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb765a-d10e-49dd-9ec9-821c7959c28a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:18.133945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7bac8-55b4-4f7e-8f1d-caf9d4484471 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:18.135437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb765a-d10e-49dd-9ec9-821c7959c28a service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:18.148108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91c30b-a617-483d-947b-203f93db9334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:18.150229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91c30b-a617-483d-947b-203f93db9334 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:18.150625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91c30b-a617-483d-947b-203f93db9334 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:18.151325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91c30b-a617-483d-947b-203f93db9334 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:18.151781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91c30b-a617-483d-947b-203f93db9334 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:46:18.152200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91c30b-a617-483d-947b-203f93db9334 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:18.158075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91c30b-a617-483d-947b-203f93db9334 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:18.158755 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:18.174642 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1313/2654] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:46:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:46:18.192263 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1342/2655] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:46:18.201059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb765a-d10e-49dd-9ec9-821c7959c28a service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:18.221862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb765a-d10e-49dd-9ec9-821c7959c28a service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:18.233274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4f5fd-2020-4476-8942-c95532f2818b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:18.234625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4f5fd-2020-4476-8942-c95532f2818b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:18.235005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4f5fd-2020-4476-8942-c95532f2818b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:18.235880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4f5fd-2020-4476-8942-c95532f2818b admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:18.236277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e4f5fd-2020-4476-8942-c95532f2818b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:18.238880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e4f5fd-2020-4476-8942-c95532f2818b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:18.287564 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1314/2656] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:46:18 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:46:18.291749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91c30b-a617-483d-947b-203f93db9334 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:18.304782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91c30b-a617-483d-947b-203f93db9334 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:18.442053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266347b8-8bb4-459a-88bf-e1e7a170ac5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:18.443081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266347b8-8bb4-459a-88bf-e1e7a170ac5d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:18.443547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266347b8-8bb4-459a-88bf-e1e7a170ac5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:18.443966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266347b8-8bb4-459a-88bf-e1e7a170ac5d admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:18.445059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266347b8-8bb4-459a-88bf-e1e7a170ac5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:18.446945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266347b8-8bb4-459a-88bf-e1e7a170ac5d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:18.482775 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1343/2657] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:46:18 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:46:18.487315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4f5fd-2020-4476-8942-c95532f2818b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:18.503341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4f5fd-2020-4476-8942-c95532f2818b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:18.512281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2ac1c-e4f2-4648-89bc-e33ce6f94047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:18.513017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2ac1c-e4f2-4648-89bc-e33ce6f94047 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:18.513322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2ac1c-e4f2-4648-89bc-e33ce6f94047 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:18.513557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2ac1c-e4f2-4648-89bc-e33ce6f94047 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:18.514213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2ac1c-e4f2-4648-89bc-e33ce6f94047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:18.521549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2ac1c-e4f2-4648-89bc-e33ce6f94047 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:18.547007 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1315/2658] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:46:18.551487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266347b8-8bb4-459a-88bf-e1e7a170ac5d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:18.566179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266347b8-8bb4-459a-88bf-e1e7a170ac5d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:18.583676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55fd1c-15c6-4c63-9737-5570888d86ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:18.584578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55fd1c-15c6-4c63-9737-5570888d86ea admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:18.584578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55fd1c-15c6-4c63-9737-5570888d86ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:18.584948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55fd1c-15c6-4c63-9737-5570888d86ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:18.586108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55fd1c-15c6-4c63-9737-5570888d86ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:18.587737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55fd1c-15c6-4c63-9737-5570888d86ea admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:18.614039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2ac1c-e4f2-4648-89bc-e33ce6f94047 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:18.620614 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1344/2659] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:46:18.631667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2ac1c-e4f2-4648-89bc-e33ce6f94047 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:18.637498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f12239-8d39-4c4a-acd9-e381f6c274bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:18.638170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f12239-8d39-4c4a-acd9-e381f6c274bb admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:18.638450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f12239-8d39-4c4a-acd9-e381f6c274bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:18.645098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f12239-8d39-4c4a-acd9-e381f6c274bb admin admin] PATH_INFO: `/v3/projects/776e70d33eb14579a04ebbddf74fc4c9/users/96b37528007d4bf39d4189a15ea96c7b/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:18.684673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f12239-8d39-4c4a-acd9-e381f6c274bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=776e70d33eb14579a04ebbddf74fc4c9, user_id=96b37528007d4bf39d4189a15ea96c7b, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:18.686137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f12239-8d39-4c4a-acd9-e381f6c274bb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:18.706900 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1316/2660] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:46:18 2022] PUT /identity/v3/projects/776e70d33eb14579a04ebbddf74fc4c9/users/96b37528007d4bf39d4189a15ea96c7b/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:46:18.717058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd6318-b991-4b4b-8c35-63950519cfe9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:18.717486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd6318-b991-4b4b-8c35-63950519cfe9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:18.717858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd6318-b991-4b4b-8c35-63950519cfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:18.774823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-34bd6318-b991-4b4b-8c35-63950519cfe9 None None] MFA Rules not processed for user `96b37528007d4bf39d4189a15ea96c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:18.775803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-34bd6318-b991-4b4b-8c35-63950519cfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:18.977229 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:19.015733 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1345/2661] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:19.016927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f12239-8d39-4c4a-acd9-e381f6c274bb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:19.163419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f12239-8d39-4c4a-acd9-e381f6c274bb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:19.185565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290957a-9317-41d6-9396-ad4cf94fcc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:19.186204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290957a-9317-41d6-9396-ad4cf94fcc60 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:19.186481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290957a-9317-41d6-9396-ad4cf94fcc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:19.186849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290957a-9317-41d6-9396-ad4cf94fcc60 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:19.187497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290957a-9317-41d6-9396-ad4cf94fcc60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:19.189840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290957a-9317-41d6-9396-ad4cf94fcc60 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:19.256828 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1317/2662] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:46:19 2022] POST /identity/v3/projects => generated 375 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:46:19.260964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd6318-b991-4b4b-8c35-63950519cfe9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:19.282968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd6318-b991-4b4b-8c35-63950519cfe9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:19.409316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662c6bc-0236-46f6-80cd-c36bbab847f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:19.410018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662c6bc-0236-46f6-80cd-c36bbab847f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:19.410347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662c6bc-0236-46f6-80cd-c36bbab847f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:19.411107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662c6bc-0236-46f6-80cd-c36bbab847f0 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:19.411357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662c6bc-0236-46f6-80cd-c36bbab847f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:19.414965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662c6bc-0236-46f6-80cd-c36bbab847f0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:19.463230 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1346/2663] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:46:19 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:46:19.466958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290957a-9317-41d6-9396-ad4cf94fcc60 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:19.493274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290957a-9317-41d6-9396-ad4cf94fcc60 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:19.508168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779a0cf-2ffb-4901-bf8c-70d78c531fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:19.512098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779a0cf-2ffb-4901-bf8c-70d78c531fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:19.513512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779a0cf-2ffb-4901-bf8c-70d78c531fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:19.514061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779a0cf-2ffb-4901-bf8c-70d78c531fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:19.517557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779a0cf-2ffb-4901-bf8c-70d78c531fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:19.520343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779a0cf-2ffb-4901-bf8c-70d78c531fb5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:19.534771 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1318/2664] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:46:19.540281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662c6bc-0236-46f6-80cd-c36bbab847f0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:19.554783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662c6bc-0236-46f6-80cd-c36bbab847f0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:19.561921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f106d4-ed9d-42ec-81d6-cea14b27374f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:19.563570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f106d4-ed9d-42ec-81d6-cea14b27374f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:19.565619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f106d4-ed9d-42ec-81d6-cea14b27374f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:19.566115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f106d4-ed9d-42ec-81d6-cea14b27374f admin admin] PATH_INFO: `/v3/projects/72d1b3dbb73b45e385a1c44b5b75edd6/users/e2012ad2b7984f12a1a0bb3c4435c5af/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:19.594766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f106d4-ed9d-42ec-81d6-cea14b27374f admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d1b3dbb73b45e385a1c44b5b75edd6, user_id=e2012ad2b7984f12a1a0bb3c4435c5af, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:19.598100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f106d4-ed9d-42ec-81d6-cea14b27374f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:19.619987 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1347/2665] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:46:19 2022] PUT /identity/v3/projects/72d1b3dbb73b45e385a1c44b5b75edd6/users/e2012ad2b7984f12a1a0bb3c4435c5af/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:19.623969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779a0cf-2ffb-4901-bf8c-70d78c531fb5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:19.635338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779a0cf-2ffb-4901-bf8c-70d78c531fb5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:19.820630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4d065-2b3e-4828-8dc3-b729dff3c819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:19.833657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4d065-2b3e-4828-8dc3-b729dff3c819 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:19.833657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4d065-2b3e-4828-8dc3-b729dff3c819 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:19.833657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4d065-2b3e-4828-8dc3-b729dff3c819 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:19.833657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4d065-2b3e-4828-8dc3-b729dff3c819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:19.834821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966a42f-43d3-4348-ba0c-739b37e08258 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:19.836207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966a42f-43d3-4348-ba0c-739b37e08258 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:19.836207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966a42f-43d3-4348-ba0c-739b37e08258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:19.836405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4d065-2b3e-4828-8dc3-b729dff3c819 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:19.868817 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1319/2666] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:46:19.874038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4d065-2b3e-4828-8dc3-b729dff3c819 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:19.887284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3966a42f-43d3-4348-ba0c-739b37e08258 None None] MFA Rules not processed for user `5ee27b6e2411469d9ef72ad8a7e6491f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:19.890279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3966a42f-43d3-4348-ba0c-739b37e08258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:19.951133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4d065-2b3e-4828-8dc3-b729dff3c819 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:19.963882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d412aaa-8358-4a7d-9562-ee601453a0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:19.964654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d412aaa-8358-4a7d-9562-ee601453a0d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:19.964980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d412aaa-8358-4a7d-9562-ee601453a0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:19.966060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d412aaa-8358-4a7d-9562-ee601453a0d5 admin admin] PATH_INFO: `/v3/projects/72d1b3dbb73b45e385a1c44b5b75edd6/users/e2012ad2b7984f12a1a0bb3c4435c5af/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:19.974197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d412aaa-8358-4a7d-9562-ee601453a0d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d1b3dbb73b45e385a1c44b5b75edd6, user_id=e2012ad2b7984f12a1a0bb3c4435c5af, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:19.981884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d412aaa-8358-4a7d-9562-ee601453a0d5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:20.000701 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:20.014559 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1320/2667] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:46:19 2022] PUT /identity/v3/projects/72d1b3dbb73b45e385a1c44b5b75edd6/users/e2012ad2b7984f12a1a0bb3c4435c5af/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:20.027453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f02f0-85bc-45c5-90bd-c8a0deedde5f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:20.028773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f02f0-85bc-45c5-90bd-c8a0deedde5f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:20.029289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f02f0-85bc-45c5-90bd-c8a0deedde5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:20.077080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7d3f02f0-85bc-45c5-90bd-c8a0deedde5f None None] MFA Rules not processed for user `e2012ad2b7984f12a1a0bb3c4435c5af`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:20.081825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7d3f02f0-85bc-45c5-90bd-c8a0deedde5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:20.088818 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1348/2668] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:46:20.237420 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1321/2669] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:20.850812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966a42f-43d3-4348-ba0c-739b37e08258 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:20.852460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3966a42f-43d3-4348-ba0c-739b37e08258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:20.975408 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:21.002594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966a42f-43d3-4348-ba0c-739b37e08258 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:21.126045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d01f6a-701f-4a52-8687-0d656cf56e0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:21.127090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d01f6a-701f-4a52-8687-0d656cf56e0d service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:21.129024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d01f6a-701f-4a52-8687-0d656cf56e0d service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:21.129435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d01f6a-701f-4a52-8687-0d656cf56e0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:21.151669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d01f6a-701f-4a52-8687-0d656cf56e0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:21.153262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d01f6a-701f-4a52-8687-0d656cf56e0d service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:21.194216 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1349/2670] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:46:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:46:21.775068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f02f0-85bc-45c5-90bd-c8a0deedde5f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:21.776952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7d3f02f0-85bc-45c5-90bd-c8a0deedde5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:21.802277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f02f0-85bc-45c5-90bd-c8a0deedde5f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:21.808926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef66f8a-78b9-4d15-bf6d-2daeaa79f144 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:21.810186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef66f8a-78b9-4d15-bf6d-2daeaa79f144 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:21.810834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef66f8a-78b9-4d15-bf6d-2daeaa79f144 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:21.811592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef66f8a-78b9-4d15-bf6d-2daeaa79f144 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:21.961531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef66f8a-78b9-4d15-bf6d-2daeaa79f144 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:21.969391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef66f8a-78b9-4d15-bf6d-2daeaa79f144 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:21.995631 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1322/2671] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:46:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:46:22.927355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d01f6a-701f-4a52-8687-0d656cf56e0d service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:23.122550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d01f6a-701f-4a52-8687-0d656cf56e0d service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:23.138317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad76f40-f696-4f95-84a7-33fe2ed5447d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:23.142469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad76f40-f696-4f95-84a7-33fe2ed5447d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:23.142779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad76f40-f696-4f95-84a7-33fe2ed5447d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:23.144385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad76f40-f696-4f95-84a7-33fe2ed5447d admin admin] PATH_INFO: `/v3/users/96b37528007d4bf39d4189a15ea96c7b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:23.148315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad76f40-f696-4f95-84a7-33fe2ed5447d admin admin] RBAC: Authorizing `identity:delete_user(user_id=96b37528007d4bf39d4189a15ea96c7b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:23.153307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad76f40-f696-4f95-84a7-33fe2ed5447d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:23.324273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ad76f40-f696-4f95-84a7-33fe2ed5447d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96b37528007d4bf39d4189a15ea96c7b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:23.332252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ad76f40-f696-4f95-84a7-33fe2ed5447d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96b37528007d4bf39d4189a15ea96c7b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:23.373167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ad76f40-f696-4f95-84a7-33fe2ed5447d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96b37528007d4bf39d4189a15ea96c7b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:23.400505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ad76f40-f696-4f95-84a7-33fe2ed5447d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96b37528007d4bf39d4189a15ea96c7b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:23.431567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ad76f40-f696-4f95-84a7-33fe2ed5447d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96b37528007d4bf39d4189a15ea96c7b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:23.445163 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1350/2672] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:46:22 2022] DELETE /identity/v3/users/96b37528007d4bf39d4189a15ea96c7b => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:23.451065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2216f3-db30-4257-ae06-9f34f7c0e038 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:23.451561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2216f3-db30-4257-ae06-9f34f7c0e038 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:23.451644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2216f3-db30-4257-ae06-9f34f7c0e038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:23.556510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-af2216f3-db30-4257-ae06-9f34f7c0e038 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:23.558220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-af2216f3-db30-4257-ae06-9f34f7c0e038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:23.690125 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1323/2673] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:23.732261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad76f40-f696-4f95-84a7-33fe2ed5447d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:23.735174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3ad76f40-f696-4f95-84a7-33fe2ed5447d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:23.743958 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:23.899682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad76f40-f696-4f95-84a7-33fe2ed5447d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:23.908588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8918c8-9cc6-4a91-a6eb-7ffd84b7119e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:23.909574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8918c8-9cc6-4a91-a6eb-7ffd84b7119e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:23.910422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8918c8-9cc6-4a91-a6eb-7ffd84b7119e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:23.910907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8918c8-9cc6-4a91-a6eb-7ffd84b7119e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:23.946865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8918c8-9cc6-4a91-a6eb-7ffd84b7119e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:23.948364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8918c8-9cc6-4a91-a6eb-7ffd84b7119e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:23.961631 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1351/2674] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:46:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:46:25.085182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2216f3-db30-4257-ae06-9f34f7c0e038 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:25.091783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-af2216f3-db30-4257-ae06-9f34f7c0e038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:25.112408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2216f3-db30-4257-ae06-9f34f7c0e038 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:25.134969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e77929-3c34-409b-a47d-2402c74c1dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:25.135621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e77929-3c34-409b-a47d-2402c74c1dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:25.135896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e77929-3c34-409b-a47d-2402c74c1dec admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:25.136164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e77929-3c34-409b-a47d-2402c74c1dec admin admin] PATH_INFO: `/v3/projects/776e70d33eb14579a04ebbddf74fc4c9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:25.137333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e77929-3c34-409b-a47d-2402c74c1dec admin admin] RBAC: Authorizing `identity:delete_project(project_id=776e70d33eb14579a04ebbddf74fc4c9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:25.139231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e77929-3c34-409b-a47d-2402c74c1dec admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:25.201316 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:25.257147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d6e77929-3c34-409b-a47d-2402c74c1dec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '776e70d33eb14579a04ebbddf74fc4c9', 'request_id': 'req-d6e77929-3c34-409b-a47d-2402c74c1dec'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:25.271974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d6e77929-3c34-409b-a47d-2402c74c1dec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '776e70d33eb14579a04ebbddf74fc4c9', 'request_id': 'req-d6e77929-3c34-409b-a47d-2402c74c1dec'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:25.285892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d6e77929-3c34-409b-a47d-2402c74c1dec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '776e70d33eb14579a04ebbddf74fc4c9', 'request_id': 'req-d6e77929-3c34-409b-a47d-2402c74c1dec'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:25.318176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d6e77929-3c34-409b-a47d-2402c74c1dec admin admin] The token cache is being invalidate because project 776e70d33eb14579a04ebbddf74fc4c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:46:25.319917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d6e77929-3c34-409b-a47d-2402c74c1dec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:25.322277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d6e77929-3c34-409b-a47d-2402c74c1dec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:25.329923 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1324/2675] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:46:25 2022] DELETE /identity/v3/projects/776e70d33eb14579a04ebbddf74fc4c9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:25.330458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8918c8-9cc6-4a91-a6eb-7ffd84b7119e service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:25.342217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8918c8-9cc6-4a91-a6eb-7ffd84b7119e service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:25.458369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea57a8-ca46-4390-9db8-0a1a598b2dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:25.459016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea57a8-ca46-4390-9db8-0a1a598b2dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:25.459534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea57a8-ca46-4390-9db8-0a1a598b2dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:25.459651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea57a8-ca46-4390-9db8-0a1a598b2dd5 admin admin] PATH_INFO: `/v3/users/e2012ad2b7984f12a1a0bb3c4435c5af` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:25.460856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea57a8-ca46-4390-9db8-0a1a598b2dd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2012ad2b7984f12a1a0bb3c4435c5af)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:25.462890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea57a8-ca46-4390-9db8-0a1a598b2dd5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:25.547227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-12ea57a8-ca46-4390-9db8-0a1a598b2dd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2012ad2b7984f12a1a0bb3c4435c5af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:25.549500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-12ea57a8-ca46-4390-9db8-0a1a598b2dd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2012ad2b7984f12a1a0bb3c4435c5af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:25.560846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-12ea57a8-ca46-4390-9db8-0a1a598b2dd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2012ad2b7984f12a1a0bb3c4435c5af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:25.579257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-12ea57a8-ca46-4390-9db8-0a1a598b2dd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2012ad2b7984f12a1a0bb3c4435c5af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:25.589390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-12ea57a8-ca46-4390-9db8-0a1a598b2dd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2012ad2b7984f12a1a0bb3c4435c5af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:25.598115 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1352/2676] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:46:25 2022] DELETE /identity/v3/users/e2012ad2b7984f12a1a0bb3c4435c5af => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:27.383023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e77929-3c34-409b-a47d-2402c74c1dec admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:27.384718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d6e77929-3c34-409b-a47d-2402c74c1dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:27.420776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e77929-3c34-409b-a47d-2402c74c1dec admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:27.609807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00152748-3271-4344-9ced-94505e606bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:27.610581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00152748-3271-4344-9ced-94505e606bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:27.610864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00152748-3271-4344-9ced-94505e606bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:27.611138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00152748-3271-4344-9ced-94505e606bdf admin admin] PATH_INFO: `/v3/projects/72d1b3dbb73b45e385a1c44b5b75edd6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:27.613289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00152748-3271-4344-9ced-94505e606bdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=72d1b3dbb73b45e385a1c44b5b75edd6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:27.620574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00152748-3271-4344-9ced-94505e606bdf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:27.775859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-00152748-3271-4344-9ced-94505e606bdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72d1b3dbb73b45e385a1c44b5b75edd6', 'request_id': 'req-00152748-3271-4344-9ced-94505e606bdf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:27.798267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-00152748-3271-4344-9ced-94505e606bdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72d1b3dbb73b45e385a1c44b5b75edd6', 'request_id': 'req-00152748-3271-4344-9ced-94505e606bdf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:27.812540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-00152748-3271-4344-9ced-94505e606bdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72d1b3dbb73b45e385a1c44b5b75edd6', 'request_id': 'req-00152748-3271-4344-9ced-94505e606bdf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:27.837642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-00152748-3271-4344-9ced-94505e606bdf admin admin] The token cache is being invalidate because project 72d1b3dbb73b45e385a1c44b5b75edd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:46:27.837954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-00152748-3271-4344-9ced-94505e606bdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:27.839301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-00152748-3271-4344-9ced-94505e606bdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:27.844374 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1325/2677] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:46:27 2022] DELETE /identity/v3/projects/72d1b3dbb73b45e385a1c44b5b75edd6 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:27.849115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a12ee-430a-4a0e-a71c-ce561c159d9b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:27.849604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a12ee-430a-4a0e-a71c-ce561c159d9b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:27.849742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a12ee-430a-4a0e-a71c-ce561c159d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:27.888113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-038a12ee-430a-4a0e-a71c-ce561c159d9b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:27.890228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-038a12ee-430a-4a0e-a71c-ce561c159d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:27.933330 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:28.078127 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1353/2678] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:28.083726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af967d5-577c-4e55-92f9-46ee5b766acf None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:28.084287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af967d5-577c-4e55-92f9-46ee5b766acf None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:28.084811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af967d5-577c-4e55-92f9-46ee5b766acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:28.113475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3af967d5-577c-4e55-92f9-46ee5b766acf None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:28.115589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3af967d5-577c-4e55-92f9-46ee5b766acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:28.163387 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1326/2679] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:46:28.167757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a12ee-430a-4a0e-a71c-ce561c159d9b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:28.185062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a12ee-430a-4a0e-a71c-ce561c159d9b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:28.193919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420465e-7978-48e0-8496-4cabcf1d8026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:28.194756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420465e-7978-48e0-8496-4cabcf1d8026 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:28.195134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420465e-7978-48e0-8496-4cabcf1d8026 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:28.195506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420465e-7978-48e0-8496-4cabcf1d8026 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:28.196456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420465e-7978-48e0-8496-4cabcf1d8026 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:46:28.196841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420465e-7978-48e0-8496-4cabcf1d8026 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:28.198863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420465e-7978-48e0-8496-4cabcf1d8026 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:28.215204 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1354/2680] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:46:28.219764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af967d5-577c-4e55-92f9-46ee5b766acf None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:28.239103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af967d5-577c-4e55-92f9-46ee5b766acf None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:28.247351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d0fbb-8fb9-4d23-a0e1-e047805b8b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:28.248624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d0fbb-8fb9-4d23-a0e1-e047805b8b65 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:28.251980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d0fbb-8fb9-4d23-a0e1-e047805b8b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:28.251980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d0fbb-8fb9-4d23-a0e1-e047805b8b65 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:28.252307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d0fbb-8fb9-4d23-a0e1-e047805b8b65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:28.256188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d0fbb-8fb9-4d23-a0e1-e047805b8b65 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:28.318549 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1327/2681] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:46:28 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:46:28.321581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420465e-7978-48e0-8496-4cabcf1d8026 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:28.338582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420465e-7978-48e0-8496-4cabcf1d8026 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:28.464339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb60338-d683-4931-b57f-a1037ba0d754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:28.466508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb60338-d683-4931-b57f-a1037ba0d754 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:28.466904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb60338-d683-4931-b57f-a1037ba0d754 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:28.467283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb60338-d683-4931-b57f-a1037ba0d754 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:28.468310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb60338-d683-4931-b57f-a1037ba0d754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:28.474826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb60338-d683-4931-b57f-a1037ba0d754 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:28.551148 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1355/2682] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:46:28 2022] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:46:28.551973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d0fbb-8fb9-4d23-a0e1-e047805b8b65 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:28.567372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d0fbb-8fb9-4d23-a0e1-e047805b8b65 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:28.573475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb3fed-bba5-4337-9d69-ac5553959a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:28.574619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb3fed-bba5-4337-9d69-ac5553959a07 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:28.575148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb3fed-bba5-4337-9d69-ac5553959a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:28.575629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb3fed-bba5-4337-9d69-ac5553959a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:28.579733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb3fed-bba5-4337-9d69-ac5553959a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:28.581857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb3fed-bba5-4337-9d69-ac5553959a07 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:28.584821 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:28.598422 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1328/2683] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:46:28.602327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb60338-d683-4931-b57f-a1037ba0d754 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:28.628221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb60338-d683-4931-b57f-a1037ba0d754 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:28.635246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2019656-5c19-4697-a3aa-1216a6af9c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:28.636192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2019656-5c19-4697-a3aa-1216a6af9c51 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:28.636744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2019656-5c19-4697-a3aa-1216a6af9c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:28.638529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2019656-5c19-4697-a3aa-1216a6af9c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:28.640143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2019656-5c19-4697-a3aa-1216a6af9c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:28.642073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2019656-5c19-4697-a3aa-1216a6af9c51 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:28.664544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb3fed-bba5-4337-9d69-ac5553959a07 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:28.678440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb3fed-bba5-4337-9d69-ac5553959a07 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:28.678817 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1356/2684] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:46:28.684566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38acbd2-051f-4421-b679-f2c6376e4c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:28.685723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38acbd2-051f-4421-b679-f2c6376e4c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:28.686071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38acbd2-051f-4421-b679-f2c6376e4c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:28.686410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38acbd2-051f-4421-b679-f2c6376e4c63 admin admin] PATH_INFO: `/v3/projects/2d8bafe7cdc1459b9eb3ca0ee6d14581/users/a96ce2ea565640c5a169a8f1eb207a0f/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:28.711734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38acbd2-051f-4421-b679-f2c6376e4c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8bafe7cdc1459b9eb3ca0ee6d14581, user_id=a96ce2ea565640c5a169a8f1eb207a0f, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:28.714372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38acbd2-051f-4421-b679-f2c6376e4c63 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:28.747013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adc78b-7fbe-42f8-bd54-bcad259028af None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:28.747292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adc78b-7fbe-42f8-bd54-bcad259028af None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:28.747462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adc78b-7fbe-42f8-bd54-bcad259028af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:28.751416 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1329/2685] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:46:28 2022] PUT /identity/v3/projects/2d8bafe7cdc1459b9eb3ca0ee6d14581/users/a96ce2ea565640c5a169a8f1eb207a0f/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:46:28.799080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-74adc78b-7fbe-42f8-bd54-bcad259028af None None] MFA Rules not processed for user `a96ce2ea565640c5a169a8f1eb207a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:28.800327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-74adc78b-7fbe-42f8-bd54-bcad259028af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:28.913565 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1357/2686] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:28.917467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38acbd2-051f-4421-b679-f2c6376e4c63 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:29.039935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38acbd2-051f-4421-b679-f2c6376e4c63 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:29.053437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a68e5e-0d17-4cce-8ba9-28b95e0b2306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:29.054193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a68e5e-0d17-4cce-8ba9-28b95e0b2306 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:29.054340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a68e5e-0d17-4cce-8ba9-28b95e0b2306 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:29.054618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a68e5e-0d17-4cce-8ba9-28b95e0b2306 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:29.055266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a68e5e-0d17-4cce-8ba9-28b95e0b2306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:29.057297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a68e5e-0d17-4cce-8ba9-28b95e0b2306 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:29.178532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adc78b-7fbe-42f8-bd54-bcad259028af None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:29.189746 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1330/2687] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:46:28 2022] POST /identity/v3/projects => generated 387 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:46:29.229796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adc78b-7fbe-42f8-bd54-bcad259028af None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:29.267123 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:29.365439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca669e10-3fd3-44be-9622-c062398d43bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:29.366233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca669e10-3fd3-44be-9622-c062398d43bc admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:29.366587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca669e10-3fd3-44be-9622-c062398d43bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:29.366981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca669e10-3fd3-44be-9622-c062398d43bc admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:29.368867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca669e10-3fd3-44be-9622-c062398d43bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:29.370983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca669e10-3fd3-44be-9622-c062398d43bc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:29.420958 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1358/2688] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:46:29 2022] POST /identity/v3/users => generated 300 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:46:29.422509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a68e5e-0d17-4cce-8ba9-28b95e0b2306 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:29.433786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a68e5e-0d17-4cce-8ba9-28b95e0b2306 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:29.441939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2950a-0efe-412b-a52e-21baed3c25e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:29.444429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2950a-0efe-412b-a52e-21baed3c25e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:29.444429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2950a-0efe-412b-a52e-21baed3c25e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:29.446032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2950a-0efe-412b-a52e-21baed3c25e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:29.446571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2950a-0efe-412b-a52e-21baed3c25e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:29.450976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2950a-0efe-412b-a52e-21baed3c25e3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:29.476996 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1331/2689] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:46:29.482071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca669e10-3fd3-44be-9622-c062398d43bc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:29.498072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca669e10-3fd3-44be-9622-c062398d43bc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:29.510975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793d8f9-5f15-4069-bebf-d708afe86123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:29.511763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793d8f9-5f15-4069-bebf-d708afe86123 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:29.512224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793d8f9-5f15-4069-bebf-d708afe86123 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:29.512638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793d8f9-5f15-4069-bebf-d708afe86123 admin admin] PATH_INFO: `/v3/projects/858fbfdedf554c5db26a24499111399b/users/28a90a0255484c32952f8be9b944691c/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:29.540905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793d8f9-5f15-4069-bebf-d708afe86123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=858fbfdedf554c5db26a24499111399b, user_id=28a90a0255484c32952f8be9b944691c, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:29.544035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793d8f9-5f15-4069-bebf-d708afe86123 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:29.581208 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1359/2690] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:46:29 2022] PUT /identity/v3/projects/858fbfdedf554c5db26a24499111399b/users/28a90a0255484c32952f8be9b944691c/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:29.582470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2950a-0efe-412b-a52e-21baed3c25e3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:29.598877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2950a-0efe-412b-a52e-21baed3c25e3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:29.698614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645f1b2-22a9-44cb-8f2e-83e8e8d15233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:29.699616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645f1b2-22a9-44cb-8f2e-83e8e8d15233 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:29.699951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645f1b2-22a9-44cb-8f2e-83e8e8d15233 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:29.700221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645f1b2-22a9-44cb-8f2e-83e8e8d15233 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:29.701180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645f1b2-22a9-44cb-8f2e-83e8e8d15233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:29.703739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645f1b2-22a9-44cb-8f2e-83e8e8d15233 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:29.722236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793d8f9-5f15-4069-bebf-d708afe86123 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:29.722589 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1332/2691] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:46:29.738152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793d8f9-5f15-4069-bebf-d708afe86123 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:29.751590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e252d65-7a7d-4aeb-b190-e978bf3fdf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:29.752693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e252d65-7a7d-4aeb-b190-e978bf3fdf0a admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:29.752916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e252d65-7a7d-4aeb-b190-e978bf3fdf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:29.753192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e252d65-7a7d-4aeb-b190-e978bf3fdf0a admin admin] PATH_INFO: `/v3/projects/858fbfdedf554c5db26a24499111399b/users/28a90a0255484c32952f8be9b944691c/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:29.768678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e252d65-7a7d-4aeb-b190-e978bf3fdf0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=858fbfdedf554c5db26a24499111399b, user_id=28a90a0255484c32952f8be9b944691c, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:29.769602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e252d65-7a7d-4aeb-b190-e978bf3fdf0a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:29.789235 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1360/2692] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:46:29 2022] PUT /identity/v3/projects/858fbfdedf554c5db26a24499111399b/users/28a90a0255484c32952f8be9b944691c/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:46:29.801043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e01c5-9dd2-4b20-b500-293a7b959b96 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:29.801507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e01c5-9dd2-4b20-b500-293a7b959b96 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:29.801930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e01c5-9dd2-4b20-b500-293a7b959b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:29.859957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cb7e01c5-9dd2-4b20-b500-293a7b959b96 None None] MFA Rules not processed for user `28a90a0255484c32952f8be9b944691c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:29.861473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cb7e01c5-9dd2-4b20-b500-293a7b959b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:29.915857 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:29.976286 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1333/2693] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:30.215258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e252d65-7a7d-4aeb-b190-e978bf3fdf0a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:30.218635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0e252d65-7a7d-4aeb-b190-e978bf3fdf0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:30.332993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e252d65-7a7d-4aeb-b190-e978bf3fdf0a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:30.342202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f066a-fa00-4906-a459-aa2008b2ffc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:30.344275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f066a-fa00-4906-a459-aa2008b2ffc1 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:30.345142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f066a-fa00-4906-a459-aa2008b2ffc1 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:30.345743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f066a-fa00-4906-a459-aa2008b2ffc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:30.359205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f066a-fa00-4906-a459-aa2008b2ffc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:30.362402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f066a-fa00-4906-a459-aa2008b2ffc1 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:30.376895 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1361/2694] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:46:30 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:46:30.438209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e01c5-9dd2-4b20-b500-293a7b959b96 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:30.460742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e01c5-9dd2-4b20-b500-293a7b959b96 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:30.473384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f881c-f03e-4068-b562-c3a98a606af2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:30.474120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f881c-f03e-4068-b562-c3a98a606af2 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:30.474461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f881c-f03e-4068-b562-c3a98a606af2 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:30.474797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f881c-f03e-4068-b562-c3a98a606af2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:30.581713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f881c-f03e-4068-b562-c3a98a606af2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:30.584402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f881c-f03e-4068-b562-c3a98a606af2 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:30.606665 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1334/2695] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:46:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:46:31.517450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4810c-28fd-4f68-89c1-dc21b0ea673e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:31.518901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4810c-28fd-4f68-89c1-dc21b0ea673e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:31.520242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4810c-28fd-4f68-89c1-dc21b0ea673e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:31.554860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-daf4810c-28fd-4f68-89c1-dc21b0ea673e None None] MFA Rules not processed for user `ca416a5bcdd94249b268c87a84c2793b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:31.556267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-daf4810c-28fd-4f68-89c1-dc21b0ea673e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:31.658407 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:31.704834 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1362/2696] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:32.115684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f881c-f03e-4068-b562-c3a98a606af2 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:32.117655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7e5f881c-f03e-4068-b562-c3a98a606af2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:32.138925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f881c-f03e-4068-b562-c3a98a606af2 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:32.163145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71489e-cd35-4d69-9704-5743cd43110b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:32.164027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71489e-cd35-4d69-9704-5743cd43110b service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:32.164551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71489e-cd35-4d69-9704-5743cd43110b service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:32.165036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71489e-cd35-4d69-9704-5743cd43110b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:32.178953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71489e-cd35-4d69-9704-5743cd43110b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:32.180841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71489e-cd35-4d69-9704-5743cd43110b service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:32.232935 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1335/2697] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:46:32 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:46:32.682811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4810c-28fd-4f68-89c1-dc21b0ea673e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:32.903333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4810c-28fd-4f68-89c1-dc21b0ea673e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:32.919030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041eb1a-00de-4aff-99e4-f07a99a82eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:32.920502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041eb1a-00de-4aff-99e4-f07a99a82eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:32.922748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041eb1a-00de-4aff-99e4-f07a99a82eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:32.923186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041eb1a-00de-4aff-99e4-f07a99a82eb7 admin admin] PATH_INFO: `/v3/users/a96ce2ea565640c5a169a8f1eb207a0f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:32.926994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041eb1a-00de-4aff-99e4-f07a99a82eb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a96ce2ea565640c5a169a8f1eb207a0f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:32.931574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041eb1a-00de-4aff-99e4-f07a99a82eb7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:33.071175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6041eb1a-00de-4aff-99e4-f07a99a82eb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a96ce2ea565640c5a169a8f1eb207a0f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:33.074797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6041eb1a-00de-4aff-99e4-f07a99a82eb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a96ce2ea565640c5a169a8f1eb207a0f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:33.134274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6041eb1a-00de-4aff-99e4-f07a99a82eb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a96ce2ea565640c5a169a8f1eb207a0f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:33.198290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6041eb1a-00de-4aff-99e4-f07a99a82eb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a96ce2ea565640c5a169a8f1eb207a0f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:33.209652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6041eb1a-00de-4aff-99e4-f07a99a82eb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a96ce2ea565640c5a169a8f1eb207a0f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:33.221769 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1363/2698] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:46:32 2022] DELETE /identity/v3/users/a96ce2ea565640c5a169a8f1eb207a0f => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:33.230654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5333e-78f9-4230-a334-b577edd57ff4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:33.231197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5333e-78f9-4230-a334-b577edd57ff4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:33.231197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5333e-78f9-4230-a334-b577edd57ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:33.304752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e0c5333e-78f9-4230-a334-b577edd57ff4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:33.306178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e0c5333e-78f9-4230-a334-b577edd57ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:33.517887 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1336/2699] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:33.589132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041eb1a-00de-4aff-99e4-f07a99a82eb7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:33.591870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6041eb1a-00de-4aff-99e4-f07a99a82eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:33.839479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041eb1a-00de-4aff-99e4-f07a99a82eb7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:33.847909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e29ad1-f602-4a49-9af9-b5830ffcc230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:33.861181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e29ad1-f602-4a49-9af9-b5830ffcc230 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:33.862020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e29ad1-f602-4a49-9af9-b5830ffcc230 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:33.862636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e29ad1-f602-4a49-9af9-b5830ffcc230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:33.882166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e29ad1-f602-4a49-9af9-b5830ffcc230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:33.887873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e29ad1-f602-4a49-9af9-b5830ffcc230 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:33.918243 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1364/2700] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:46:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:46:34.979131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5333e-78f9-4230-a334-b577edd57ff4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:34.980701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e0c5333e-78f9-4230-a334-b577edd57ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:35.007036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5333e-78f9-4230-a334-b577edd57ff4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:35.022371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de540d4e-64ff-4104-b8cc-6e002a9d6e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:35.023099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de540d4e-64ff-4104-b8cc-6e002a9d6e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:35.023472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de540d4e-64ff-4104-b8cc-6e002a9d6e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:35.028473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de540d4e-64ff-4104-b8cc-6e002a9d6e29 admin admin] PATH_INFO: `/v3/projects/2d8bafe7cdc1459b9eb3ca0ee6d14581` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:35.030622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de540d4e-64ff-4104-b8cc-6e002a9d6e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d8bafe7cdc1459b9eb3ca0ee6d14581)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:35.032936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de540d4e-64ff-4104-b8cc-6e002a9d6e29 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:35.173316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-de540d4e-64ff-4104-b8cc-6e002a9d6e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d8bafe7cdc1459b9eb3ca0ee6d14581', 'request_id': 'req-de540d4e-64ff-4104-b8cc-6e002a9d6e29'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:35.175632 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:35.189688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-de540d4e-64ff-4104-b8cc-6e002a9d6e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d8bafe7cdc1459b9eb3ca0ee6d14581', 'request_id': 'req-de540d4e-64ff-4104-b8cc-6e002a9d6e29'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:35.201202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-de540d4e-64ff-4104-b8cc-6e002a9d6e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d8bafe7cdc1459b9eb3ca0ee6d14581', 'request_id': 'req-de540d4e-64ff-4104-b8cc-6e002a9d6e29'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:35.230801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-de540d4e-64ff-4104-b8cc-6e002a9d6e29 admin admin] The token cache is being invalidate because project 2d8bafe7cdc1459b9eb3ca0ee6d14581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:46:35.231369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-de540d4e-64ff-4104-b8cc-6e002a9d6e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:35.233341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-de540d4e-64ff-4104-b8cc-6e002a9d6e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:35.241044 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1337/2701] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:46:34 2022] DELETE /identity/v3/projects/2d8bafe7cdc1459b9eb3ca0ee6d14581 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:35.245160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e29ad1-f602-4a49-9af9-b5830ffcc230 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:35.274551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e29ad1-f602-4a49-9af9-b5830ffcc230 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:35.294275 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:35.480202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2889eb0-0870-492f-89b6-3a621919001e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:35.480929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2889eb0-0870-492f-89b6-3a621919001e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:35.481168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2889eb0-0870-492f-89b6-3a621919001e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:35.481443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2889eb0-0870-492f-89b6-3a621919001e admin admin] PATH_INFO: `/v3/users/28a90a0255484c32952f8be9b944691c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:35.484644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2889eb0-0870-492f-89b6-3a621919001e admin admin] RBAC: Authorizing `identity:delete_user(user_id=28a90a0255484c32952f8be9b944691c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:35.487623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2889eb0-0870-492f-89b6-3a621919001e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:35.623447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a2889eb0-0870-492f-89b6-3a621919001e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28a90a0255484c32952f8be9b944691c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:35.628314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a2889eb0-0870-492f-89b6-3a621919001e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28a90a0255484c32952f8be9b944691c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:35.647973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a2889eb0-0870-492f-89b6-3a621919001e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28a90a0255484c32952f8be9b944691c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:35.681864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a2889eb0-0870-492f-89b6-3a621919001e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28a90a0255484c32952f8be9b944691c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:35.694187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a2889eb0-0870-492f-89b6-3a621919001e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28a90a0255484c32952f8be9b944691c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:35.703031 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1365/2702] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:46:35 2022] DELETE /identity/v3/users/28a90a0255484c32952f8be9b944691c => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:46:36.919467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de540d4e-64ff-4104-b8cc-6e002a9d6e29 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:36.921776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-de540d4e-64ff-4104-b8cc-6e002a9d6e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:36.960133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de540d4e-64ff-4104-b8cc-6e002a9d6e29 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:37.120794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f93e1-c6b1-4dc1-af08-89e6ac7a541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:37.121818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f93e1-c6b1-4dc1-af08-89e6ac7a541a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:37.122289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f93e1-c6b1-4dc1-af08-89e6ac7a541a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:37.122767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f93e1-c6b1-4dc1-af08-89e6ac7a541a admin admin] PATH_INFO: `/v3/projects/858fbfdedf554c5db26a24499111399b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:37.127167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f93e1-c6b1-4dc1-af08-89e6ac7a541a admin admin] RBAC: Authorizing `identity:delete_project(project_id=858fbfdedf554c5db26a24499111399b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:37.129968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f93e1-c6b1-4dc1-af08-89e6ac7a541a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:37.252726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eb3f93e1-c6b1-4dc1-af08-89e6ac7a541a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '858fbfdedf554c5db26a24499111399b', 'request_id': 'req-eb3f93e1-c6b1-4dc1-af08-89e6ac7a541a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:37.274624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eb3f93e1-c6b1-4dc1-af08-89e6ac7a541a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '858fbfdedf554c5db26a24499111399b', 'request_id': 'req-eb3f93e1-c6b1-4dc1-af08-89e6ac7a541a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:37.298861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eb3f93e1-c6b1-4dc1-af08-89e6ac7a541a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '858fbfdedf554c5db26a24499111399b', 'request_id': 'req-eb3f93e1-c6b1-4dc1-af08-89e6ac7a541a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:37.320386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eb3f93e1-c6b1-4dc1-af08-89e6ac7a541a admin admin] The token cache is being invalidate because project 858fbfdedf554c5db26a24499111399b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:46:37.320953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eb3f93e1-c6b1-4dc1-af08-89e6ac7a541a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:37.321795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eb3f93e1-c6b1-4dc1-af08-89e6ac7a541a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:37.324087 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1338/2703] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:46:36 2022] DELETE /identity/v3/projects/858fbfdedf554c5db26a24499111399b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:37.329344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a06a92-6df6-4e0b-aaad-11b2709bc2a7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:37.329841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a06a92-6df6-4e0b-aaad-11b2709bc2a7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:37.329956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a06a92-6df6-4e0b-aaad-11b2709bc2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:37.366568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-06a06a92-6df6-4e0b-aaad-11b2709bc2a7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:37.369957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-06a06a92-6df6-4e0b-aaad-11b2709bc2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:37.513781 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1366/2704] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:37.515150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684dc631-15f7-40b6-854a-16628b5a26c5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:37.515801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684dc631-15f7-40b6-854a-16628b5a26c5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:37.515992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684dc631-15f7-40b6-854a-16628b5a26c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:37.603521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-684dc631-15f7-40b6-854a-16628b5a26c5 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:37.614054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-684dc631-15f7-40b6-854a-16628b5a26c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:37.653886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a06a92-6df6-4e0b-aaad-11b2709bc2a7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:37.658013 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1339/2705] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:37.691477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a06a92-6df6-4e0b-aaad-11b2709bc2a7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:37.710492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e721f2e-8d74-4f9a-a515-6a4e57831257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:37.715348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e721f2e-8d74-4f9a-a515-6a4e57831257 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:37.715704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e721f2e-8d74-4f9a-a515-6a4e57831257 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:37.716046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e721f2e-8d74-4f9a-a515-6a4e57831257 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:37.720354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e721f2e-8d74-4f9a-a515-6a4e57831257 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:46:37.721702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e721f2e-8d74-4f9a-a515-6a4e57831257 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:37.728841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e721f2e-8d74-4f9a-a515-6a4e57831257 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:37.773760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684dc631-15f7-40b6-854a-16628b5a26c5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:37.774159 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1367/2706] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:46:37.797042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684dc631-15f7-40b6-854a-16628b5a26c5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:37.802292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f0829-a015-4431-8fc6-0cf82fedcbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:37.802914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f0829-a015-4431-8fc6-0cf82fedcbb2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:37.803193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f0829-a015-4431-8fc6-0cf82fedcbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:37.803463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f0829-a015-4431-8fc6-0cf82fedcbb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:37.804125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f0829-a015-4431-8fc6-0cf82fedcbb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:37.806034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f0829-a015-4431-8fc6-0cf82fedcbb2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:37.863171 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1340/2707] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:46:37 2022] POST /identity/v3/projects => generated 387 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:46:37.867312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e721f2e-8d74-4f9a-a515-6a4e57831257 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:37.884278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e721f2e-8d74-4f9a-a515-6a4e57831257 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:37.928163 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:38.032659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaa5b7-524f-4dce-92c8-68b07d932d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:38.033557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaa5b7-524f-4dce-92c8-68b07d932d38 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:38.034039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaa5b7-524f-4dce-92c8-68b07d932d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:38.034409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaa5b7-524f-4dce-92c8-68b07d932d38 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:38.035149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eaa5b7-524f-4dce-92c8-68b07d932d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:38.037856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eaa5b7-524f-4dce-92c8-68b07d932d38 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:38.085021 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1368/2708] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:46:37 2022] POST /identity/v3/users => generated 294 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:46:38.088736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f0829-a015-4431-8fc6-0cf82fedcbb2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:38.101427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f0829-a015-4431-8fc6-0cf82fedcbb2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:38.106930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b75ad-42f5-490c-9542-8f4c2ba02fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:38.107762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b75ad-42f5-490c-9542-8f4c2ba02fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:38.108984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b75ad-42f5-490c-9542-8f4c2ba02fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:38.109474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b75ad-42f5-490c-9542-8f4c2ba02fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:38.110507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b75ad-42f5-490c-9542-8f4c2ba02fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:38.112329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b75ad-42f5-490c-9542-8f4c2ba02fc8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:38.128417 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1341/2709] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:46:38.132363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaa5b7-524f-4dce-92c8-68b07d932d38 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:38.147883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaa5b7-524f-4dce-92c8-68b07d932d38 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:38.158512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd9260-d236-4bb8-84a5-dce726ce9075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:38.159544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd9260-d236-4bb8-84a5-dce726ce9075 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:38.160000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd9260-d236-4bb8-84a5-dce726ce9075 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:38.160726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd9260-d236-4bb8-84a5-dce726ce9075 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:38.161587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd9260-d236-4bb8-84a5-dce726ce9075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:38.163706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd9260-d236-4bb8-84a5-dce726ce9075 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:38.178089 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1369/2710] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:46:38.183463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b75ad-42f5-490c-9542-8f4c2ba02fc8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:38.198670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b75ad-42f5-490c-9542-8f4c2ba02fc8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:38.206152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69171f7-a665-489e-b53f-3ada99698683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:38.207076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69171f7-a665-489e-b53f-3ada99698683 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:38.207567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69171f7-a665-489e-b53f-3ada99698683 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:38.208265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69171f7-a665-489e-b53f-3ada99698683 admin admin] PATH_INFO: `/v3/projects/fa164e8825d34854b5b945f60b21513d/users/7133f9974bbf4d83a7cd7af164265de7/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:38.231947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69171f7-a665-489e-b53f-3ada99698683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa164e8825d34854b5b945f60b21513d, user_id=7133f9974bbf4d83a7cd7af164265de7, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:38.235822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69171f7-a665-489e-b53f-3ada99698683 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:38.281169 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1342/2711] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:46:38 2022] PUT /identity/v3/projects/fa164e8825d34854b5b945f60b21513d/users/7133f9974bbf4d83a7cd7af164265de7/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:38.293040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b1448-9af5-45d7-ab33-13cc085fa53a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:38.293559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b1448-9af5-45d7-ab33-13cc085fa53a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:38.293990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b1448-9af5-45d7-ab33-13cc085fa53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:38.338523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-732b1448-9af5-45d7-ab33-13cc085fa53a None None] MFA Rules not processed for user `7133f9974bbf4d83a7cd7af164265de7`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:38.340107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-732b1448-9af5-45d7-ab33-13cc085fa53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:38.427410 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1370/2712] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:46:38.432394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69171f7-a665-489e-b53f-3ada99698683 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:38.440270 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:38.572879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69171f7-a665-489e-b53f-3ada99698683 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:38.583181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7974b-fa20-4df3-9a04-c1d7a56308ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:38.583907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7974b-fa20-4df3-9a04-c1d7a56308ca admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:38.584408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7974b-fa20-4df3-9a04-c1d7a56308ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:38.585618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7974b-fa20-4df3-9a04-c1d7a56308ca admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:38.586501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7974b-fa20-4df3-9a04-c1d7a56308ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:38.588988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7974b-fa20-4df3-9a04-c1d7a56308ca admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:38.638433 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1343/2713] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:46:38 2022] POST /identity/v3/projects => generated 387 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:46:38.642654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b1448-9af5-45d7-ab33-13cc085fa53a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:38.662294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b1448-9af5-45d7-ab33-13cc085fa53a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:38.859435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac283e7a-7e26-404b-a75a-671d8c301804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:38.863749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac283e7a-7e26-404b-a75a-671d8c301804 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:38.864171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac283e7a-7e26-404b-a75a-671d8c301804 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:38.868265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac283e7a-7e26-404b-a75a-671d8c301804 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:38.870852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac283e7a-7e26-404b-a75a-671d8c301804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:38.879993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac283e7a-7e26-404b-a75a-671d8c301804 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:38.971813 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1371/2714] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:46:38 2022] POST /identity/v3/users => generated 300 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:46:38.974015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7974b-fa20-4df3-9a04-c1d7a56308ca admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:39.023121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7974b-fa20-4df3-9a04-c1d7a56308ca admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:39.039312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b7263-3e50-4c3a-9526-ae3a4c275951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:39.040663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b7263-3e50-4c3a-9526-ae3a4c275951 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:39.041199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b7263-3e50-4c3a-9526-ae3a4c275951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:39.041828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b7263-3e50-4c3a-9526-ae3a4c275951 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:39.046249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b7263-3e50-4c3a-9526-ae3a4c275951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:39.067520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b7263-3e50-4c3a-9526-ae3a4c275951 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:39.119574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac283e7a-7e26-404b-a75a-671d8c301804 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:39.135364 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1344/2715] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:46:39.147448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac283e7a-7e26-404b-a75a-671d8c301804 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:39.164002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26171a-7a2f-4492-97f4-6e55c93b7590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:39.168140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26171a-7a2f-4492-97f4-6e55c93b7590 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:39.170269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26171a-7a2f-4492-97f4-6e55c93b7590 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:39.172195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26171a-7a2f-4492-97f4-6e55c93b7590 admin admin] PATH_INFO: `/v3/projects/1807a605329b401e8d20e1088b2919a1/users/4de5916e45b245e7a53db9d0081478d4/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:39.215062 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:39.228721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26171a-7a2f-4492-97f4-6e55c93b7590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1807a605329b401e8d20e1088b2919a1, user_id=4de5916e45b245e7a53db9d0081478d4, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:39.235169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26171a-7a2f-4492-97f4-6e55c93b7590 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:39.271019 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1372/2716] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:46:39 2022] PUT /identity/v3/projects/1807a605329b401e8d20e1088b2919a1/users/4de5916e45b245e7a53db9d0081478d4/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:39.282356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b7263-3e50-4c3a-9526-ae3a4c275951 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:39.314706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b7263-3e50-4c3a-9526-ae3a4c275951 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:39.579141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9652d59-16c6-4b93-bfdb-c42190be94db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:39.579980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9652d59-16c6-4b93-bfdb-c42190be94db admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:39.581696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9652d59-16c6-4b93-bfdb-c42190be94db admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:39.582145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9652d59-16c6-4b93-bfdb-c42190be94db admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:39.585708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9652d59-16c6-4b93-bfdb-c42190be94db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:39.590517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9652d59-16c6-4b93-bfdb-c42190be94db admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:39.618133 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1345/2717] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:46:39.618331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26171a-7a2f-4492-97f4-6e55c93b7590 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:39.638032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26171a-7a2f-4492-97f4-6e55c93b7590 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:39.652938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf7855-96c0-437c-86a0-c100f98fb7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:39.654377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf7855-96c0-437c-86a0-c100f98fb7e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:39.654377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf7855-96c0-437c-86a0-c100f98fb7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:39.657123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf7855-96c0-437c-86a0-c100f98fb7e2 admin admin] PATH_INFO: `/v3/projects/1807a605329b401e8d20e1088b2919a1/users/4de5916e45b245e7a53db9d0081478d4/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:39.662768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf7855-96c0-437c-86a0-c100f98fb7e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1807a605329b401e8d20e1088b2919a1, user_id=4de5916e45b245e7a53db9d0081478d4, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:39.671759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf7855-96c0-437c-86a0-c100f98fb7e2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:39.727787 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1373/2718] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:46:39 2022] PUT /identity/v3/projects/1807a605329b401e8d20e1088b2919a1/users/4de5916e45b245e7a53db9d0081478d4/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:46:39.731231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d000c3-2c68-48d1-9de4-a6d13470c6ba None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:39.731711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d000c3-2c68-48d1-9de4-a6d13470c6ba None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:39.732135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d000c3-2c68-48d1-9de4-a6d13470c6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:39.788122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d4d000c3-2c68-48d1-9de4-a6d13470c6ba None None] MFA Rules not processed for user `4de5916e45b245e7a53db9d0081478d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:39.791111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d4d000c3-2c68-48d1-9de4-a6d13470c6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:39.972292 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:39.985243 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1346/2719] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:39.995458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186671-dcc6-4e38-ada4-0d96612e54ec None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:39.996106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186671-dcc6-4e38-ada4-0d96612e54ec None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:39.997300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186671-dcc6-4e38-ada4-0d96612e54ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:40.044913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-27186671-dcc6-4e38-ada4-0d96612e54ec None None] MFA Rules not processed for user `7133f9974bbf4d83a7cd7af164265de7`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:40.048182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-27186671-dcc6-4e38-ada4-0d96612e54ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:40.161764 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1374/2720] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:40.201097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d000c3-2c68-48d1-9de4-a6d13470c6ba None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:40.202900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d4d000c3-2c68-48d1-9de4-a6d13470c6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:40.331483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d000c3-2c68-48d1-9de4-a6d13470c6ba None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:40.339615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089b636-d8e7-4495-ae99-cde9544c9930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:40.340698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089b636-d8e7-4495-ae99-cde9544c9930 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:40.341095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089b636-d8e7-4495-ae99-cde9544c9930 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:40.341531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089b636-d8e7-4495-ae99-cde9544c9930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:40.351752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089b636-d8e7-4495-ae99-cde9544c9930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:40.353881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089b636-d8e7-4495-ae99-cde9544c9930 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:40.365151 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1347/2721] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:46:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:46:44.025031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27186671-dcc6-4e38-ada4-0d96612e54ec None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:44.026687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-27186671-dcc6-4e38-ada4-0d96612e54ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:44.175919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27186671-dcc6-4e38-ada4-0d96612e54ec None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:44.191368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509f8c8-5aac-4487-ab9f-dd19ae71e14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:44.192202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509f8c8-5aac-4487-ab9f-dd19ae71e14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:44.203584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509f8c8-5aac-4487-ab9f-dd19ae71e14d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:44.205791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509f8c8-5aac-4487-ab9f-dd19ae71e14d admin admin] PATH_INFO: `/v3/users/ca416a5bcdd94249b268c87a84c2793b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:44.209988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509f8c8-5aac-4487-ab9f-dd19ae71e14d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca416a5bcdd94249b268c87a84c2793b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:44.222076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509f8c8-5aac-4487-ab9f-dd19ae71e14d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:44.276977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9509f8c8-5aac-4487-ab9f-dd19ae71e14d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca416a5bcdd94249b268c87a84c2793b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:44.278063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9509f8c8-5aac-4487-ab9f-dd19ae71e14d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca416a5bcdd94249b268c87a84c2793b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:44.286097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9509f8c8-5aac-4487-ab9f-dd19ae71e14d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca416a5bcdd94249b268c87a84c2793b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:44.299922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9509f8c8-5aac-4487-ab9f-dd19ae71e14d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca416a5bcdd94249b268c87a84c2793b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:44.309059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9509f8c8-5aac-4487-ab9f-dd19ae71e14d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca416a5bcdd94249b268c87a84c2793b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:44.311630 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:44.316155 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1375/2722] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:46:44 2022] DELETE /identity/v3/users/ca416a5bcdd94249b268c87a84c2793b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:44.525713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089b636-d8e7-4495-ae99-cde9544c9930 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:44.540457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089b636-d8e7-4495-ae99-cde9544c9930 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:44.637753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f5a3b-959c-4b60-a781-95f7359c88e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:44.638482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f5a3b-959c-4b60-a781-95f7359c88e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:44.639740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f5a3b-959c-4b60-a781-95f7359c88e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:44.640147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f5a3b-959c-4b60-a781-95f7359c88e9 admin admin] PATH_INFO: `/v3/projects/7454bf9254964e6bafba59f571796e44` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:44.641448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f5a3b-959c-4b60-a781-95f7359c88e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7454bf9254964e6bafba59f571796e44)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:44.643318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f5a3b-959c-4b60-a781-95f7359c88e9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:44.705921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc0f5a3b-959c-4b60-a781-95f7359c88e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7454bf9254964e6bafba59f571796e44', 'request_id': 'req-bc0f5a3b-959c-4b60-a781-95f7359c88e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:44.716548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc0f5a3b-959c-4b60-a781-95f7359c88e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7454bf9254964e6bafba59f571796e44', 'request_id': 'req-bc0f5a3b-959c-4b60-a781-95f7359c88e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:44.724095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc0f5a3b-959c-4b60-a781-95f7359c88e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7454bf9254964e6bafba59f571796e44', 'request_id': 'req-bc0f5a3b-959c-4b60-a781-95f7359c88e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:44.736486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc0f5a3b-959c-4b60-a781-95f7359c88e9 admin admin] The token cache is being invalidate because project 7454bf9254964e6bafba59f571796e44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:46:44.736895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc0f5a3b-959c-4b60-a781-95f7359c88e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:44.737748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc0f5a3b-959c-4b60-a781-95f7359c88e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:44.750145 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1348/2723] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:46:44 2022] DELETE /identity/v3/projects/7454bf9254964e6bafba59f571796e44 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:44.752134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390acaf4-0b45-4dd0-ae87-1cf7bd90386d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:44.752469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390acaf4-0b45-4dd0-ae87-1cf7bd90386d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:44.752866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390acaf4-0b45-4dd0-ae87-1cf7bd90386d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:44.775134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-390acaf4-0b45-4dd0-ae87-1cf7bd90386d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:44.776389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-390acaf4-0b45-4dd0-ae87-1cf7bd90386d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:44.942897 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1376/2724] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:44.951082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9b473-c86d-4881-a9b6-173a3109b371 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:44.951804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9b473-c86d-4881-a9b6-173a3109b371 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:44.951804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9b473-c86d-4881-a9b6-173a3109b371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:44.993653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-01d9b473-c86d-4881-a9b6-173a3109b371 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:44.995048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-01d9b473-c86d-4881-a9b6-173a3109b371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:45.013403 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1349/2725] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:45.024395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390acaf4-0b45-4dd0-ae87-1cf7bd90386d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:45.038934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390acaf4-0b45-4dd0-ae87-1cf7bd90386d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:45.047532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100ee83-9b5a-423c-a5da-b13d2a4032c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:45.048703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100ee83-9b5a-423c-a5da-b13d2a4032c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:45.049054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100ee83-9b5a-423c-a5da-b13d2a4032c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:45.049496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100ee83-9b5a-423c-a5da-b13d2a4032c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:45.050710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100ee83-9b5a-423c-a5da-b13d2a4032c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:46:45.051758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100ee83-9b5a-423c-a5da-b13d2a4032c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:45.054071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100ee83-9b5a-423c-a5da-b13d2a4032c0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:45.075909 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1377/2726] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:46:45.076916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9b473-c86d-4881-a9b6-173a3109b371 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:45.087513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9b473-c86d-4881-a9b6-173a3109b371 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:45.105548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c207d-d0dd-425f-a9b7-8a2e8c9c57dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:45.106566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c207d-d0dd-425f-a9b7-8a2e8c9c57dd admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:45.107032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c207d-d0dd-425f-a9b7-8a2e8c9c57dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:45.107481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c207d-d0dd-425f-a9b7-8a2e8c9c57dd admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:45.109267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c207d-d0dd-425f-a9b7-8a2e8c9c57dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:45.115602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c207d-d0dd-425f-a9b7-8a2e8c9c57dd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:45.121973 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:45.171716 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1350/2727] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:46:45 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:46:45.177108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100ee83-9b5a-423c-a5da-b13d2a4032c0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:45.217718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100ee83-9b5a-423c-a5da-b13d2a4032c0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:45.330850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74869e05-f7e7-4b40-8c31-91dccbe376fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:45.331751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74869e05-f7e7-4b40-8c31-91dccbe376fa admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:45.332029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74869e05-f7e7-4b40-8c31-91dccbe376fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:45.332296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74869e05-f7e7-4b40-8c31-91dccbe376fa admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:45.333294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74869e05-f7e7-4b40-8c31-91dccbe376fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:45.335861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74869e05-f7e7-4b40-8c31-91dccbe376fa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:45.366645 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1378/2728] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:46:45 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:46:45.367789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c207d-d0dd-425f-a9b7-8a2e8c9c57dd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:45.379463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c207d-d0dd-425f-a9b7-8a2e8c9c57dd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:45.394537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbace3f1-953a-41db-aa82-7085770080d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:45.395300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbace3f1-953a-41db-aa82-7085770080d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:45.396003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbace3f1-953a-41db-aa82-7085770080d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:45.396132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbace3f1-953a-41db-aa82-7085770080d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:45.396944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbace3f1-953a-41db-aa82-7085770080d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:45.402999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbace3f1-953a-41db-aa82-7085770080d0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:45.421710 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1351/2729] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:46:45.422466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74869e05-f7e7-4b40-8c31-91dccbe376fa admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:45.436767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74869e05-f7e7-4b40-8c31-91dccbe376fa admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:45.448147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d89218-3f0d-4098-b053-4de5f412bd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:45.449200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d89218-3f0d-4098-b053-4de5f412bd8e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:45.449774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d89218-3f0d-4098-b053-4de5f412bd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:45.450255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d89218-3f0d-4098-b053-4de5f412bd8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:45.451129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d89218-3f0d-4098-b053-4de5f412bd8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:45.454579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d89218-3f0d-4098-b053-4de5f412bd8e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:45.473801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbace3f1-953a-41db-aa82-7085770080d0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:45.493993 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1379/2730] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:46:45.499017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbace3f1-953a-41db-aa82-7085770080d0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:45.512919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e3e7c-b476-4f65-8f93-2c14fbacfb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:45.515000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e3e7c-b476-4f65-8f93-2c14fbacfb8c admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:45.515492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e3e7c-b476-4f65-8f93-2c14fbacfb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:45.516488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e3e7c-b476-4f65-8f93-2c14fbacfb8c admin admin] PATH_INFO: `/v3/projects/67464f4e5013444597325caeee103d9e/users/19a3a87ab66d4abda69fea9d490ccea6/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:45.537224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e3e7c-b476-4f65-8f93-2c14fbacfb8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=67464f4e5013444597325caeee103d9e, user_id=19a3a87ab66d4abda69fea9d490ccea6, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:45.540044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e3e7c-b476-4f65-8f93-2c14fbacfb8c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:45.557485 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1352/2731] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:46:45 2022] PUT /identity/v3/projects/67464f4e5013444597325caeee103d9e/users/19a3a87ab66d4abda69fea9d490ccea6/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:45.570308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52214ce-69d3-457c-8628-598da7d71c05 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:45.571949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52214ce-69d3-457c-8628-598da7d71c05 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:45.572225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52214ce-69d3-457c-8628-598da7d71c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:45.613624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f52214ce-69d3-457c-8628-598da7d71c05 None None] MFA Rules not processed for user `19a3a87ab66d4abda69fea9d490ccea6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:45.615440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f52214ce-69d3-457c-8628-598da7d71c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:45.729577 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:45.759075 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1380/2732] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:45.777271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24787c17-4208-409f-86d0-8442f8900483 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:45.779310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24787c17-4208-409f-86d0-8442f8900483 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:45.783651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24787c17-4208-409f-86d0-8442f8900483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:45.833731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-24787c17-4208-409f-86d0-8442f8900483 None None] MFA Rules not processed for user `19a3a87ab66d4abda69fea9d490ccea6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:45.835050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-24787c17-4208-409f-86d0-8442f8900483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:45.863544 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1353/2733] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:45.868837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52214ce-69d3-457c-8628-598da7d71c05 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:45.870736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f52214ce-69d3-457c-8628-598da7d71c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:46.106052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52214ce-69d3-457c-8628-598da7d71c05 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:46.114098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500e139-27d3-4eb0-806c-840ebbb7e96e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:46.114807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500e139-27d3-4eb0-806c-840ebbb7e96e service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:46.115413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500e139-27d3-4eb0-806c-840ebbb7e96e service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:46.115674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500e139-27d3-4eb0-806c-840ebbb7e96e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:46.129574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500e139-27d3-4eb0-806c-840ebbb7e96e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:46.131185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500e139-27d3-4eb0-806c-840ebbb7e96e service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:46.144190 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1381/2734] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:46:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:46:49.896267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad7e2d-4acc-44a9-a4fb-60ef344d1ea1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:49.896881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad7e2d-4acc-44a9-a4fb-60ef344d1ea1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:49.896881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad7e2d-4acc-44a9-a4fb-60ef344d1ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:49.944512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b4ad7e2d-4acc-44a9-a4fb-60ef344d1ea1 None None] MFA Rules not processed for user `22e55fa3cbc34ea19c099f2859dd7ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:49.946181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b4ad7e2d-4acc-44a9-a4fb-60ef344d1ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:50.039148 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1354/2735] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:54.926004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500e139-27d3-4eb0-806c-840ebbb7e96e service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:54.927781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b500e139-27d3-4eb0-806c-840ebbb7e96e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:55.028619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500e139-27d3-4eb0-806c-840ebbb7e96e service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:55.036190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91e41c-2573-4dae-ae74-c1f072c14322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:55.036899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91e41c-2573-4dae-ae74-c1f072c14322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:55.037143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91e41c-2573-4dae-ae74-c1f072c14322 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:55.037416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91e41c-2573-4dae-ae74-c1f072c14322 admin admin] PATH_INFO: `/v3/users/e1f52d856b9e4b6ea65f649f30fcfeee` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:55.038956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91e41c-2573-4dae-ae74-c1f072c14322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1f52d856b9e4b6ea65f649f30fcfeee)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:55.040704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91e41c-2573-4dae-ae74-c1f072c14322 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:55.091506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d91e41c-2573-4dae-ae74-c1f072c14322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f52d856b9e4b6ea65f649f30fcfeee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:55.092251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d91e41c-2573-4dae-ae74-c1f072c14322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f52d856b9e4b6ea65f649f30fcfeee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:55.100440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d91e41c-2573-4dae-ae74-c1f072c14322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f52d856b9e4b6ea65f649f30fcfeee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:55.114829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d91e41c-2573-4dae-ae74-c1f072c14322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f52d856b9e4b6ea65f649f30fcfeee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:55.139434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d91e41c-2573-4dae-ae74-c1f072c14322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f52d856b9e4b6ea65f649f30fcfeee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:55.143429 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:55.160076 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1382/2736] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:46:54 2022] DELETE /identity/v3/users/e1f52d856b9e4b6ea65f649f30fcfeee => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:55.636540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad7e2d-4acc-44a9-a4fb-60ef344d1ea1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:55.651892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad7e2d-4acc-44a9-a4fb-60ef344d1ea1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:55.745381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2067a8e-ac4e-47bb-8bf0-ed1954b9ddd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:55.746375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2067a8e-ac4e-47bb-8bf0-ed1954b9ddd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:55.746518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2067a8e-ac4e-47bb-8bf0-ed1954b9ddd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:55.746786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2067a8e-ac4e-47bb-8bf0-ed1954b9ddd6 admin admin] PATH_INFO: `/v3/projects/7e2a6fac3e174f79817293f879389abd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:55.749281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2067a8e-ac4e-47bb-8bf0-ed1954b9ddd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e2a6fac3e174f79817293f879389abd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:55.751333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2067a8e-ac4e-47bb-8bf0-ed1954b9ddd6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:55.878258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b2067a8e-ac4e-47bb-8bf0-ed1954b9ddd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e2a6fac3e174f79817293f879389abd', 'request_id': 'req-b2067a8e-ac4e-47bb-8bf0-ed1954b9ddd6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:55.895758 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:46:55.906467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b2067a8e-ac4e-47bb-8bf0-ed1954b9ddd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e2a6fac3e174f79817293f879389abd', 'request_id': 'req-b2067a8e-ac4e-47bb-8bf0-ed1954b9ddd6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:55.927359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b2067a8e-ac4e-47bb-8bf0-ed1954b9ddd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e2a6fac3e174f79817293f879389abd', 'request_id': 'req-b2067a8e-ac4e-47bb-8bf0-ed1954b9ddd6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:55.945546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b2067a8e-ac4e-47bb-8bf0-ed1954b9ddd6 admin admin] The token cache is being invalidate because project 7e2a6fac3e174f79817293f879389abd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:46:55.945833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b2067a8e-ac4e-47bb-8bf0-ed1954b9ddd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:55.959979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b2067a8e-ac4e-47bb-8bf0-ed1954b9ddd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:46:55.959979 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1355/2737] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:46:55 2022] DELETE /identity/v3/projects/7e2a6fac3e174f79817293f879389abd => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:55.960383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7799e0c-f258-436d-b78b-62e235432b20 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:55.960383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7799e0c-f258-436d-b78b-62e235432b20 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:55.960383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7799e0c-f258-436d-b78b-62e235432b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:55.988562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a7799e0c-f258-436d-b78b-62e235432b20 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:55.990695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a7799e0c-f258-436d-b78b-62e235432b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:56.070247 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1383/2738] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:56.078846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffae42-aaf0-42d4-ade4-019298129ed2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:56.079444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffae42-aaf0-42d4-ade4-019298129ed2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:56.079863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffae42-aaf0-42d4-ade4-019298129ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:56.120247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-15ffae42-aaf0-42d4-ade4-019298129ed2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:56.121762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-15ffae42-aaf0-42d4-ade4-019298129ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:56.131195 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1356/2739] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:46:56.135323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7799e0c-f258-436d-b78b-62e235432b20 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:56.150250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7799e0c-f258-436d-b78b-62e235432b20 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:56.155780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7085a1c-de26-45c7-90dc-c4f29ef9f49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:56.156757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7085a1c-de26-45c7-90dc-c4f29ef9f49f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:56.157044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7085a1c-de26-45c7-90dc-c4f29ef9f49f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:56.157319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7085a1c-de26-45c7-90dc-c4f29ef9f49f admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:56.157980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7085a1c-de26-45c7-90dc-c4f29ef9f49f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:46:56.158286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7085a1c-de26-45c7-90dc-c4f29ef9f49f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:56.159918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7085a1c-de26-45c7-90dc-c4f29ef9f49f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:56.178776 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1384/2740] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:46:56.182933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffae42-aaf0-42d4-ade4-019298129ed2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:56.204556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffae42-aaf0-42d4-ade4-019298129ed2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:56.209727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2b65e-3a9b-40a7-9299-d31c78d52816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:56.210506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2b65e-3a9b-40a7-9299-d31c78d52816 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:56.210795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2b65e-3a9b-40a7-9299-d31c78d52816 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:56.211146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2b65e-3a9b-40a7-9299-d31c78d52816 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:56.211857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2b65e-3a9b-40a7-9299-d31c78d52816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:56.214194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2b65e-3a9b-40a7-9299-d31c78d52816 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:56.250221 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1357/2741] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:46:56 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:46:56.251091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7085a1c-de26-45c7-90dc-c4f29ef9f49f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:56.262434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7085a1c-de26-45c7-90dc-c4f29ef9f49f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:56.332980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ac630-b350-4162-93f6-f4ac40081df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:56.333701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ac630-b350-4162-93f6-f4ac40081df3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:56.333869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ac630-b350-4162-93f6-f4ac40081df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:56.334145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ac630-b350-4162-93f6-f4ac40081df3 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:56.334771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ac630-b350-4162-93f6-f4ac40081df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:56.336776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ac630-b350-4162-93f6-f4ac40081df3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:56.360640 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1385/2742] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:46:56 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:46:56.365942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2b65e-3a9b-40a7-9299-d31c78d52816 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:56.377362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2b65e-3a9b-40a7-9299-d31c78d52816 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:56.382344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0b46e-4437-469b-bf89-3902d13c9083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:56.382951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0b46e-4437-469b-bf89-3902d13c9083 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:56.383223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0b46e-4437-469b-bf89-3902d13c9083 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:56.383511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0b46e-4437-469b-bf89-3902d13c9083 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:56.384140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0b46e-4437-469b-bf89-3902d13c9083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:56.385776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0b46e-4437-469b-bf89-3902d13c9083 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:56.400896 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1358/2743] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:46:56.402528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ac630-b350-4162-93f6-f4ac40081df3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:56.417160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ac630-b350-4162-93f6-f4ac40081df3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:56.425570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8caac27-3c85-4127-bba8-604d80523cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:56.426205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caac27-3c85-4127-bba8-604d80523cdd admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:56.426539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caac27-3c85-4127-bba8-604d80523cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:56.426819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caac27-3c85-4127-bba8-604d80523cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:56.427663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8caac27-3c85-4127-bba8-604d80523cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:56.429133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8caac27-3c85-4127-bba8-604d80523cdd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:56.444298 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1386/2744] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:46:56.448612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0b46e-4437-469b-bf89-3902d13c9083 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:56.459601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0b46e-4437-469b-bf89-3902d13c9083 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:56.464639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5cfd1-fb7a-40c7-84d6-8742b15066e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:56.465405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5cfd1-fb7a-40c7-84d6-8742b15066e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:56.465749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5cfd1-fb7a-40c7-84d6-8742b15066e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:56.466093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5cfd1-fb7a-40c7-84d6-8742b15066e0 admin admin] PATH_INFO: `/v3/projects/ce591c889212491bbf17238d4f4a4f8f/users/5a076b2be9774abf8188efe4c2060dc3/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:56.483987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5cfd1-fb7a-40c7-84d6-8742b15066e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce591c889212491bbf17238d4f4a4f8f, user_id=5a076b2be9774abf8188efe4c2060dc3, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:56.486767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5cfd1-fb7a-40c7-84d6-8742b15066e0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:56.502435 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1359/2745] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:46:56 2022] PUT /identity/v3/projects/ce591c889212491bbf17238d4f4a4f8f/users/5a076b2be9774abf8188efe4c2060dc3/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:46:56.507984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e14b0e-0936-4339-a7d7-fd535d8b594e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:56.512876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e14b0e-0936-4339-a7d7-fd535d8b594e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:56.513318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e14b0e-0936-4339-a7d7-fd535d8b594e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:56.535196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-04e14b0e-0936-4339-a7d7-fd535d8b594e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:46:56.536411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-04e14b0e-0936-4339-a7d7-fd535d8b594e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:56.600083 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1387/2746] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:46:56.610361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5cfd1-fb7a-40c7-84d6-8742b15066e0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:46:56.612082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e2b5cfd1-fb7a-40c7-84d6-8742b15066e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:46:56.678611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5cfd1-fb7a-40c7-84d6-8742b15066e0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:46:56.683021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801de3c2-db34-417a-9478-e578d9d38233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:46:56.683810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801de3c2-db34-417a-9478-e578d9d38233 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:46:56.684256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801de3c2-db34-417a-9478-e578d9d38233 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:46:56.684530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801de3c2-db34-417a-9478-e578d9d38233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:46:56.695744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801de3c2-db34-417a-9478-e578d9d38233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:46:56.697192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801de3c2-db34-417a-9478-e578d9d38233 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:46:56.708309 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1360/2747] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:46:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:47:02.674439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e14b0e-0936-4339-a7d7-fd535d8b594e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:02.676479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-04e14b0e-0936-4339-a7d7-fd535d8b594e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:02.695651 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:02.816522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e14b0e-0936-4339-a7d7-fd535d8b594e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:02.848946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4259b-d211-41cd-b573-f53404a71279 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:02.849673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4259b-d211-41cd-b573-f53404a71279 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:02.850105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4259b-d211-41cd-b573-f53404a71279 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:02.850379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4259b-d211-41cd-b573-f53404a71279 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:02.859441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5dd4259b-d211-41cd-b573-f53404a71279 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:03.008572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4259b-d211-41cd-b573-f53404a71279 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:03.010435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4259b-d211-41cd-b573-f53404a71279 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:03.031920 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1388/2748] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:47:03.472682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a0a73-a9c8-4af7-a053-d654bf068b43 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:03.473612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a0a73-a9c8-4af7-a053-d654bf068b43 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:03.473880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a0a73-a9c8-4af7-a053-d654bf068b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:03.494637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b59a0a73-a9c8-4af7-a053-d654bf068b43 None None] MFA Rules not processed for user `7133f9974bbf4d83a7cd7af164265de7`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:03.496185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b59a0a73-a9c8-4af7-a053-d654bf068b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:03.572918 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1361/2749] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:04.150888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3007bc-18ed-4442-9175-8b197b8c4b3d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:04.151356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3007bc-18ed-4442-9175-8b197b8c4b3d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:04.151470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3007bc-18ed-4442-9175-8b197b8c4b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:04.183657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ba3007bc-18ed-4442-9175-8b197b8c4b3d None None] MFA Rules not processed for user `5a076b2be9774abf8188efe4c2060dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:04.185277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ba3007bc-18ed-4442-9175-8b197b8c4b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:04.273197 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1389/2750] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:04.277106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a0a73-a9c8-4af7-a053-d654bf068b43 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:04.297403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a0a73-a9c8-4af7-a053-d654bf068b43 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:04.313469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d954c-ec3d-47d1-b61a-a398907d270a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:04.314179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d954c-ec3d-47d1-b61a-a398907d270a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:04.314464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d954c-ec3d-47d1-b61a-a398907d270a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:04.316962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d954c-ec3d-47d1-b61a-a398907d270a admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:04.316962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d954c-ec3d-47d1-b61a-a398907d270a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:04.328281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d954c-ec3d-47d1-b61a-a398907d270a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:04.362998 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1362/2751] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:47:04 2022] POST /identity/v3/projects => generated 387 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:47:04.366674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3007bc-18ed-4442-9175-8b197b8c4b3d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:04.378607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3007bc-18ed-4442-9175-8b197b8c4b3d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:04.417584 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:04.461830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a7b6b-8141-4b0e-80b9-5e2c7f5c2eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:04.462448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a7b6b-8141-4b0e-80b9-5e2c7f5c2eac admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:04.462821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a7b6b-8141-4b0e-80b9-5e2c7f5c2eac admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:04.462982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a7b6b-8141-4b0e-80b9-5e2c7f5c2eac admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:04.463616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a7b6b-8141-4b0e-80b9-5e2c7f5c2eac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:04.470830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a7b6b-8141-4b0e-80b9-5e2c7f5c2eac admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:04.532037 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1390/2752] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:47:04 2022] POST /identity/v3/users => generated 300 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:47:04.533048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d954c-ec3d-47d1-b61a-a398907d270a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:04.538789 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:04.551443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d954c-ec3d-47d1-b61a-a398907d270a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:04.566737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d08f97-30aa-40fb-bcfa-28815e0c00fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:04.569004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d08f97-30aa-40fb-bcfa-28815e0c00fb admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:04.569284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d08f97-30aa-40fb-bcfa-28815e0c00fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:04.569555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d08f97-30aa-40fb-bcfa-28815e0c00fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:04.571265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d08f97-30aa-40fb-bcfa-28815e0c00fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:04.575091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d08f97-30aa-40fb-bcfa-28815e0c00fb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:04.610031 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1363/2753] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:47:04.615181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a7b6b-8141-4b0e-80b9-5e2c7f5c2eac admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:04.651440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a7b6b-8141-4b0e-80b9-5e2c7f5c2eac admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:04.678888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78bac6-7f26-428d-a98d-248166c81e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:04.679864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78bac6-7f26-428d-a98d-248166c81e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:04.680145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78bac6-7f26-428d-a98d-248166c81e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:04.680411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78bac6-7f26-428d-a98d-248166c81e19 admin admin] PATH_INFO: `/v3/projects/43a06af1f9f04458ba3917aa0db18e12/users/c6e64eff1f724a2bab363ab940fd9e95/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:04.702465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78bac6-7f26-428d-a98d-248166c81e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43a06af1f9f04458ba3917aa0db18e12, user_id=c6e64eff1f724a2bab363ab940fd9e95, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:04.705821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78bac6-7f26-428d-a98d-248166c81e19 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:04.726731 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1391/2754] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:47:04 2022] PUT /identity/v3/projects/43a06af1f9f04458ba3917aa0db18e12/users/c6e64eff1f724a2bab363ab940fd9e95/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:04.731193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d08f97-30aa-40fb-bcfa-28815e0c00fb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:04.746896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d08f97-30aa-40fb-bcfa-28815e0c00fb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:04.846792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1de580-161e-49af-99cd-2171ec3a5d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:04.847575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1de580-161e-49af-99cd-2171ec3a5d4d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:04.847913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1de580-161e-49af-99cd-2171ec3a5d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:04.848241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1de580-161e-49af-99cd-2171ec3a5d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:04.848981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1de580-161e-49af-99cd-2171ec3a5d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:04.850771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1de580-161e-49af-99cd-2171ec3a5d4d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:04.863790 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1364/2755] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:47:04.868586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78bac6-7f26-428d-a98d-248166c81e19 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:04.880834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78bac6-7f26-428d-a98d-248166c81e19 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:04.886640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe5711-f67a-473f-bb9e-719cc6418cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:04.887334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe5711-f67a-473f-bb9e-719cc6418cea admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:04.887613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe5711-f67a-473f-bb9e-719cc6418cea admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:04.887916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe5711-f67a-473f-bb9e-719cc6418cea admin admin] PATH_INFO: `/v3/projects/43a06af1f9f04458ba3917aa0db18e12/users/c6e64eff1f724a2bab363ab940fd9e95/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:04.890058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe5711-f67a-473f-bb9e-719cc6418cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=43a06af1f9f04458ba3917aa0db18e12, user_id=c6e64eff1f724a2bab363ab940fd9e95, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:04.894035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe5711-f67a-473f-bb9e-719cc6418cea admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:04.909745 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1392/2756] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:47:04 2022] PUT /identity/v3/projects/43a06af1f9f04458ba3917aa0db18e12/users/c6e64eff1f724a2bab363ab940fd9e95/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:12.432511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1de580-161e-49af-99cd-2171ec3a5d4d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:12.434788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6d1de580-161e-49af-99cd-2171ec3a5d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:12.466570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1de580-161e-49af-99cd-2171ec3a5d4d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:12.566019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ff685-c4cf-4901-b89a-0f35893442aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:12.568665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ff685-c4cf-4901-b89a-0f35893442aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:12.569259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ff685-c4cf-4901-b89a-0f35893442aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:12.569692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ff685-c4cf-4901-b89a-0f35893442aa admin admin] PATH_INFO: `/v3/users/22d9242860a3457e8012949680ea248c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:12.571154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ff685-c4cf-4901-b89a-0f35893442aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=22d9242860a3457e8012949680ea248c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:12.574763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ff685-c4cf-4901-b89a-0f35893442aa admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:12.654177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-712ff685-c4cf-4901-b89a-0f35893442aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22d9242860a3457e8012949680ea248c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:12.664959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-712ff685-c4cf-4901-b89a-0f35893442aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22d9242860a3457e8012949680ea248c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:12.665806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-712ff685-c4cf-4901-b89a-0f35893442aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22d9242860a3457e8012949680ea248c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:12.689469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-712ff685-c4cf-4901-b89a-0f35893442aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22d9242860a3457e8012949680ea248c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:12.700278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-712ff685-c4cf-4901-b89a-0f35893442aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22d9242860a3457e8012949680ea248c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:12.728865 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1365/2757] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:47:12 2022] DELETE /identity/v3/users/22d9242860a3457e8012949680ea248c => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:12.735298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcc69c-2a40-4181-9dad-8033424d6d66 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:12.736216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcc69c-2a40-4181-9dad-8033424d6d66 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:12.736697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcc69c-2a40-4181-9dad-8033424d6d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:12.766113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-21fcc69c-2a40-4181-9dad-8033424d6d66 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:12.767605 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-21fcc69c-2a40-4181-9dad-8033424d6d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:12.896211 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1393/2758] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:47:12.911752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ff685-c4cf-4901-b89a-0f35893442aa admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:12.916878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-712ff685-c4cf-4901-b89a-0f35893442aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:12.932258 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:13.019394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ff685-c4cf-4901-b89a-0f35893442aa admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:13.032660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5272c-e0cb-43eb-9c59-9446794f91e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:13.033397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5272c-e0cb-43eb-9c59-9446794f91e4 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:13.035460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5272c-e0cb-43eb-9c59-9446794f91e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:13.035833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5272c-e0cb-43eb-9c59-9446794f91e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:13.073445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5272c-e0cb-43eb-9c59-9446794f91e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:13.074994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5272c-e0cb-43eb-9c59-9446794f91e4 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:13.089786 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1366/2759] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:47:13.451386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eef29c-1fef-4451-a197-2ccefd0b20cf None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:13.452277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eef29c-1fef-4451-a197-2ccefd0b20cf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:13.453341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eef29c-1fef-4451-a197-2ccefd0b20cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:13.483170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c4eef29c-1fef-4451-a197-2ccefd0b20cf None None] MFA Rules not processed for user `c6e64eff1f724a2bab363ab940fd9e95`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:13.484369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c4eef29c-1fef-4451-a197-2ccefd0b20cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:13.567569 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1394/2760] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:13 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:13.581439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5272c-e0cb-43eb-9c59-9446794f91e4 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:13.582866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fed5272c-e0cb-43eb-9c59-9446794f91e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:13.602004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eef29c-1fef-4451-a197-2ccefd0b20cf None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:13.603849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c4eef29c-1fef-4451-a197-2ccefd0b20cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:13.622729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eef29c-1fef-4451-a197-2ccefd0b20cf None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:13.627597 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272126d4-0b44-40e8-93cd-9cd7a8b060f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:13.628230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272126d4-0b44-40e8-93cd-9cd7a8b060f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:13.628507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272126d4-0b44-40e8-93cd-9cd7a8b060f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:13.628808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272126d4-0b44-40e8-93cd-9cd7a8b060f5 admin admin] PATH_INFO: `/v3/projects/4c68063aa8854c1eb025dc7b2c4a7785` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:13.630025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272126d4-0b44-40e8-93cd-9cd7a8b060f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c68063aa8854c1eb025dc7b2c4a7785)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:13.631912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272126d4-0b44-40e8-93cd-9cd7a8b060f5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:13.633608 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:13.686578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5272c-e0cb-43eb-9c59-9446794f91e4 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:13.689374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-272126d4-0b44-40e8-93cd-9cd7a8b060f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c68063aa8854c1eb025dc7b2c4a7785', 'request_id': 'req-272126d4-0b44-40e8-93cd-9cd7a8b060f5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:13.696802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-272126d4-0b44-40e8-93cd-9cd7a8b060f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c68063aa8854c1eb025dc7b2c4a7785', 'request_id': 'req-272126d4-0b44-40e8-93cd-9cd7a8b060f5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:13.704072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-272126d4-0b44-40e8-93cd-9cd7a8b060f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c68063aa8854c1eb025dc7b2c4a7785', 'request_id': 'req-272126d4-0b44-40e8-93cd-9cd7a8b060f5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:13.715280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-272126d4-0b44-40e8-93cd-9cd7a8b060f5 admin admin] The token cache is being invalidate because project 4c68063aa8854c1eb025dc7b2c4a7785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:47:13.715668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-272126d4-0b44-40e8-93cd-9cd7a8b060f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:13.716476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-272126d4-0b44-40e8-93cd-9cd7a8b060f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:13.718322 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1395/2761] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:47:13 2022] DELETE /identity/v3/projects/4c68063aa8854c1eb025dc7b2c4a7785 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:13.722153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272126d4-0b44-40e8-93cd-9cd7a8b060f5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:13.723460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-272126d4-0b44-40e8-93cd-9cd7a8b060f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:13.739098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a1827-c810-46ca-8a4a-0c0c163dc4ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:13.739718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a1827-c810-46ca-8a4a-0c0c163dc4ae service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:13.739999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a1827-c810-46ca-8a4a-0c0c163dc4ae service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:13.740307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a1827-c810-46ca-8a4a-0c0c163dc4ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:13.742328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-814a1827-c810-46ca-8a4a-0c0c163dc4ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:13.803395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272126d4-0b44-40e8-93cd-9cd7a8b060f5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:13.811211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3614806-9ac2-49e0-8a75-1a370303d08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:13.812090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3614806-9ac2-49e0-8a75-1a370303d08a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:13.812521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3614806-9ac2-49e0-8a75-1a370303d08a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:13.812836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3614806-9ac2-49e0-8a75-1a370303d08a admin admin] PATH_INFO: `/v3/users/6d6e5dd3c90648d3a3b7421c603c908a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:13.814018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3614806-9ac2-49e0-8a75-1a370303d08a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d6e5dd3c90648d3a3b7421c603c908a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:13.815965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3614806-9ac2-49e0-8a75-1a370303d08a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:13.837024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a1827-c810-46ca-8a4a-0c0c163dc4ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:13.838465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a1827-c810-46ca-8a4a-0c0c163dc4ae service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:13.845682 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:13.859650 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1367/2762] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:47:13.878275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3614806-9ac2-49e0-8a75-1a370303d08a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d6e5dd3c90648d3a3b7421c603c908a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:13.879318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3614806-9ac2-49e0-8a75-1a370303d08a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d6e5dd3c90648d3a3b7421c603c908a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:13.889764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3614806-9ac2-49e0-8a75-1a370303d08a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d6e5dd3c90648d3a3b7421c603c908a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:13.908162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3614806-9ac2-49e0-8a75-1a370303d08a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d6e5dd3c90648d3a3b7421c603c908a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:13.918651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3614806-9ac2-49e0-8a75-1a370303d08a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d6e5dd3c90648d3a3b7421c603c908a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:13.927017 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1396/2763] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:47:13 2022] DELETE /identity/v3/users/6d6e5dd3c90648d3a3b7421c603c908a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:47:14.151832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a1827-c810-46ca-8a4a-0c0c163dc4ae service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:14.178305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a1827-c810-46ca-8a4a-0c0c163dc4ae service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:14.387525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a078aa-8eee-4667-84c8-815b9a05e2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:14.387988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a078aa-8eee-4667-84c8-815b9a05e2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:14.388350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a078aa-8eee-4667-84c8-815b9a05e2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:14.388722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a078aa-8eee-4667-84c8-815b9a05e2bb admin admin] PATH_INFO: `/v3/projects/3e922a912a9c44a8b69fd5a40c200544` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:14.392099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a078aa-8eee-4667-84c8-815b9a05e2bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e922a912a9c44a8b69fd5a40c200544)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:14.394122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a078aa-8eee-4667-84c8-815b9a05e2bb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:14.528726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-09a078aa-8eee-4667-84c8-815b9a05e2bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e922a912a9c44a8b69fd5a40c200544', 'request_id': 'req-09a078aa-8eee-4667-84c8-815b9a05e2bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:14.541182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-09a078aa-8eee-4667-84c8-815b9a05e2bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e922a912a9c44a8b69fd5a40c200544', 'request_id': 'req-09a078aa-8eee-4667-84c8-815b9a05e2bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:14.553230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-09a078aa-8eee-4667-84c8-815b9a05e2bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e922a912a9c44a8b69fd5a40c200544', 'request_id': 'req-09a078aa-8eee-4667-84c8-815b9a05e2bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:14.567368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-09a078aa-8eee-4667-84c8-815b9a05e2bb admin admin] The token cache is being invalidate because project 3e922a912a9c44a8b69fd5a40c200544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:47:14.568011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-09a078aa-8eee-4667-84c8-815b9a05e2bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:14.569461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-09a078aa-8eee-4667-84c8-815b9a05e2bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:14.576748 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1368/2764] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:47:14 2022] DELETE /identity/v3/projects/3e922a912a9c44a8b69fd5a40c200544 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:14.578809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3c125-ff01-49ae-9c13-b49a342f84d7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:14.579102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3c125-ff01-49ae-9c13-b49a342f84d7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:14.579382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3c125-ff01-49ae-9c13-b49a342f84d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:14.610431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-70d3c125-ff01-49ae-9c13-b49a342f84d7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:14.611664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-70d3c125-ff01-49ae-9c13-b49a342f84d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:14.616403 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:14.724807 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1397/2765] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:14.733933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aba555-a57a-4078-963b-e93d00556a4f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:14.734516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aba555-a57a-4078-963b-e93d00556a4f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:14.734516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aba555-a57a-4078-963b-e93d00556a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:14.759588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-07aba555-a57a-4078-963b-e93d00556a4f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:14.761068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-07aba555-a57a-4078-963b-e93d00556a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:14.770568 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1369/2766] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:14.774871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3c125-ff01-49ae-9c13-b49a342f84d7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:14.794302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3c125-ff01-49ae-9c13-b49a342f84d7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:14.809844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba970f3-61e0-4002-8e06-294a2be9fdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:14.811332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba970f3-61e0-4002-8e06-294a2be9fdb5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:14.811844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba970f3-61e0-4002-8e06-294a2be9fdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:14.812180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba970f3-61e0-4002-8e06-294a2be9fdb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:14.813020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba970f3-61e0-4002-8e06-294a2be9fdb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:47:14.813570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba970f3-61e0-4002-8e06-294a2be9fdb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:14.817807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba970f3-61e0-4002-8e06-294a2be9fdb5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:14.843339 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1398/2767] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:47:14.844132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aba555-a57a-4078-963b-e93d00556a4f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:14.856059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aba555-a57a-4078-963b-e93d00556a4f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:14.870326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d62bae-a814-4160-bd6f-cef23a0e84d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:14.870956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d62bae-a814-4160-bd6f-cef23a0e84d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:14.871628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d62bae-a814-4160-bd6f-cef23a0e84d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:14.871905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d62bae-a814-4160-bd6f-cef23a0e84d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:14.872748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d62bae-a814-4160-bd6f-cef23a0e84d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:14.874788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d62bae-a814-4160-bd6f-cef23a0e84d2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:14.994824 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1370/2768] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:47:14 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:47:14.995980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba970f3-61e0-4002-8e06-294a2be9fdb5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:15.012138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba970f3-61e0-4002-8e06-294a2be9fdb5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:15.099207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3414f-ab66-4218-97fd-0b6c61825592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:15.100184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3414f-ab66-4218-97fd-0b6c61825592 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:15.100522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3414f-ab66-4218-97fd-0b6c61825592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:15.100948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3414f-ab66-4218-97fd-0b6c61825592 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:15.101631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3414f-ab66-4218-97fd-0b6c61825592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:15.103704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3414f-ab66-4218-97fd-0b6c61825592 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:15.129500 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1399/2769] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:47:14 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:47:15.133717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d62bae-a814-4160-bd6f-cef23a0e84d2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:15.146704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d62bae-a814-4160-bd6f-cef23a0e84d2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:15.153234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5d3d5-cfa7-4627-a081-dc7a3d621d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:15.153638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5d3d5-cfa7-4627-a081-dc7a3d621d6e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:15.153916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5d3d5-cfa7-4627-a081-dc7a3d621d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:15.154312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5d3d5-cfa7-4627-a081-dc7a3d621d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:15.155026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5d3d5-cfa7-4627-a081-dc7a3d621d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:15.156868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5d3d5-cfa7-4627-a081-dc7a3d621d6e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:15.171587 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1371/2770] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:47:15.172999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3414f-ab66-4218-97fd-0b6c61825592 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:15.186344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3414f-ab66-4218-97fd-0b6c61825592 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:15.192535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9884d9-6582-4e19-b161-a111e9ccc15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:15.193206 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9884d9-6582-4e19-b161-a111e9ccc15e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:15.193485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9884d9-6582-4e19-b161-a111e9ccc15e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:15.193758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9884d9-6582-4e19-b161-a111e9ccc15e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:15.194412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9884d9-6582-4e19-b161-a111e9ccc15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:15.196057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9884d9-6582-4e19-b161-a111e9ccc15e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:15.212428 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1400/2771] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:47:15.216896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5d3d5-cfa7-4627-a081-dc7a3d621d6e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:15.228641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5d3d5-cfa7-4627-a081-dc7a3d621d6e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:15.234414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cf1b8-8c2d-43d7-96e3-1c47266597d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:15.235307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cf1b8-8c2d-43d7-96e3-1c47266597d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:15.235736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cf1b8-8c2d-43d7-96e3-1c47266597d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:15.236945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cf1b8-8c2d-43d7-96e3-1c47266597d4 admin admin] PATH_INFO: `/v3/projects/eadf95be3b954215b136db3538a4a39a/users/c9ddd5b971ef4142bb8194d13928964b/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:15.274103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cf1b8-8c2d-43d7-96e3-1c47266597d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eadf95be3b954215b136db3538a4a39a, user_id=c9ddd5b971ef4142bb8194d13928964b, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:15.276741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cf1b8-8c2d-43d7-96e3-1c47266597d4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:15.296729 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1372/2772] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:47:15 2022] PUT /identity/v3/projects/eadf95be3b954215b136db3538a4a39a/users/c9ddd5b971ef4142bb8194d13928964b/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:15.310655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8a559-5276-4e5f-8107-239edb8f5430 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:15.311016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8a559-5276-4e5f-8107-239edb8f5430 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:15.311494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8a559-5276-4e5f-8107-239edb8f5430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:15.347809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-17b8a559-5276-4e5f-8107-239edb8f5430 None None] MFA Rules not processed for user `c9ddd5b971ef4142bb8194d13928964b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:15.349133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-17b8a559-5276-4e5f-8107-239edb8f5430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:15.487790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cf1b8-8c2d-43d7-96e3-1c47266597d4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:15.489912 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1401/2773] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:15.563395 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:15.624153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cf1b8-8c2d-43d7-96e3-1c47266597d4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:15.634053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19137e-5be4-43e9-bdfd-d11482cb0f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:15.634776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19137e-5be4-43e9-bdfd-d11482cb0f00 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:15.635116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19137e-5be4-43e9-bdfd-d11482cb0f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:15.635537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19137e-5be4-43e9-bdfd-d11482cb0f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:15.636281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19137e-5be4-43e9-bdfd-d11482cb0f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:15.640967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19137e-5be4-43e9-bdfd-d11482cb0f00 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:15.702944 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1373/2774] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:47:15 2022] POST /identity/v3/projects => generated 377 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:47:15.706744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8a559-5276-4e5f-8107-239edb8f5430 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:15.716238 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:15.727111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8a559-5276-4e5f-8107-239edb8f5430 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:15.819649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba2a0f-e526-4501-ade6-cb6cdb30c042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:15.821887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba2a0f-e526-4501-ade6-cb6cdb30c042 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:15.822168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba2a0f-e526-4501-ade6-cb6cdb30c042 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:15.825690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba2a0f-e526-4501-ade6-cb6cdb30c042 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:15.826484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba2a0f-e526-4501-ade6-cb6cdb30c042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:15.833086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba2a0f-e526-4501-ade6-cb6cdb30c042 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:15.872479 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1402/2775] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:47:15 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:47:15.876091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19137e-5be4-43e9-bdfd-d11482cb0f00 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:15.892374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19137e-5be4-43e9-bdfd-d11482cb0f00 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:15.898741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91bc81-9ad7-4048-961f-b26656381457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:15.904183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91bc81-9ad7-4048-961f-b26656381457 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:15.905907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91bc81-9ad7-4048-961f-b26656381457 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:15.906338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91bc81-9ad7-4048-961f-b26656381457 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:15.907196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91bc81-9ad7-4048-961f-b26656381457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:15.910267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91bc81-9ad7-4048-961f-b26656381457 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:15.932767 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1374/2776] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:47:15.937727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba2a0f-e526-4501-ade6-cb6cdb30c042 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:15.956448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba2a0f-e526-4501-ade6-cb6cdb30c042 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:15.962533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f71fc-e56a-4985-9db1-6edd32e73017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:15.963355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f71fc-e56a-4985-9db1-6edd32e73017 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:15.963727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f71fc-e56a-4985-9db1-6edd32e73017 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:15.964126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f71fc-e56a-4985-9db1-6edd32e73017 admin admin] PATH_INFO: `/v3/projects/290a5e37de62444b93d226acd1c59947/users/849b1603e2454346a4f08e9cc79a10ac/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:15.982313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f71fc-e56a-4985-9db1-6edd32e73017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=290a5e37de62444b93d226acd1c59947, user_id=849b1603e2454346a4f08e9cc79a10ac, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:15.985079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f71fc-e56a-4985-9db1-6edd32e73017 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:16.004898 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1403/2777] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:47:15 2022] PUT /identity/v3/projects/290a5e37de62444b93d226acd1c59947/users/849b1603e2454346a4f08e9cc79a10ac/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:16.006362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91bc81-9ad7-4048-961f-b26656381457 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:16.019148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91bc81-9ad7-4048-961f-b26656381457 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:16.143888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68379f1-e7f2-41c2-8d4f-7757088a5ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:16.144501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68379f1-e7f2-41c2-8d4f-7757088a5ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:16.145089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68379f1-e7f2-41c2-8d4f-7757088a5ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:16.145229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68379f1-e7f2-41c2-8d4f-7757088a5ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:16.145792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68379f1-e7f2-41c2-8d4f-7757088a5ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:16.147377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68379f1-e7f2-41c2-8d4f-7757088a5ac0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:16.160713 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1375/2778] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:47:16.164812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f71fc-e56a-4985-9db1-6edd32e73017 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:16.177507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f71fc-e56a-4985-9db1-6edd32e73017 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:16.182413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624c3ac-75fb-49bb-b8ae-ef751418a833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:16.183087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624c3ac-75fb-49bb-b8ae-ef751418a833 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:16.183370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624c3ac-75fb-49bb-b8ae-ef751418a833 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:16.183642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624c3ac-75fb-49bb-b8ae-ef751418a833 admin admin] PATH_INFO: `/v3/projects/290a5e37de62444b93d226acd1c59947/users/849b1603e2454346a4f08e9cc79a10ac/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:16.185764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624c3ac-75fb-49bb-b8ae-ef751418a833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=290a5e37de62444b93d226acd1c59947, user_id=849b1603e2454346a4f08e9cc79a10ac, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:16.188455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624c3ac-75fb-49bb-b8ae-ef751418a833 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:16.201509 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1404/2779] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:47:16 2022] PUT /identity/v3/projects/290a5e37de62444b93d226acd1c59947/users/849b1603e2454346a4f08e9cc79a10ac/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:16.279133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9c071-cbc3-415d-971c-4ca9ff9eae87 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:16.279335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9c071-cbc3-415d-971c-4ca9ff9eae87 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:16.279581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9c071-cbc3-415d-971c-4ca9ff9eae87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:16.314183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-31b9c071-cbc3-415d-971c-4ca9ff9eae87 None None] MFA Rules not processed for user `849b1603e2454346a4f08e9cc79a10ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:16.315398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-31b9c071-cbc3-415d-971c-4ca9ff9eae87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:16.407764 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1376/2780] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:16.420574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed4df3-493f-4639-8fc5-9c74c7a31bf7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:16.420900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed4df3-493f-4639-8fc5-9c74c7a31bf7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:16.421232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed4df3-493f-4639-8fc5-9c74c7a31bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:16.441843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d8ed4df3-493f-4639-8fc5-9c74c7a31bf7 None None] MFA Rules not processed for user `c9ddd5b971ef4142bb8194d13928964b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:16.443122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d8ed4df3-493f-4639-8fc5-9c74c7a31bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:16.514058 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1405/2781] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:47:16.525471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9c071-cbc3-415d-971c-4ca9ff9eae87 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:16.527100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-31b9c071-cbc3-415d-971c-4ca9ff9eae87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:16.569969 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:16.624138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9c071-cbc3-415d-971c-4ca9ff9eae87 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:16.629679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47219480-b47a-48e3-bf30-d94f4b63b987 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:16.630358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47219480-b47a-48e3-bf30-d94f4b63b987 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:16.630704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47219480-b47a-48e3-bf30-d94f4b63b987 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:16.631047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47219480-b47a-48e3-bf30-d94f4b63b987 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:16.640093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47219480-b47a-48e3-bf30-d94f4b63b987 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:16.641684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47219480-b47a-48e3-bf30-d94f4b63b987 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:16.650511 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1377/2782] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:47:20.561681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ae812-e590-405a-9526-c83466475447 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:20.562239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ae812-e590-405a-9526-c83466475447 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:20.562239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ae812-e590-405a-9526-c83466475447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:20.621701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1d5ae812-e590-405a-9526-c83466475447 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:20.623464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1d5ae812-e590-405a-9526-c83466475447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:20.761016 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1406/2783] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:47:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:20.847513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47219480-b47a-48e3-bf30-d94f4b63b987 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:20.850451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-47219480-b47a-48e3-bf30-d94f4b63b987 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:20.993164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47219480-b47a-48e3-bf30-d94f4b63b987 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:20.999433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581ced4-b053-40fa-ac98-c65b69ea491d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:21.000352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581ced4-b053-40fa-ac98-c65b69ea491d service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:21.000567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581ced4-b053-40fa-ac98-c65b69ea491d service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:21.000873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581ced4-b053-40fa-ac98-c65b69ea491d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:21.016789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581ced4-b053-40fa-ac98-c65b69ea491d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:21.019823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581ced4-b053-40fa-ac98-c65b69ea491d service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:21.044527 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1378/2784] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:47:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:47:24.586663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ae812-e590-405a-9526-c83466475447 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:24.589013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1d5ae812-e590-405a-9526-c83466475447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:24.602968 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:24.676305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ae812-e590-405a-9526-c83466475447 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:24.682103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6741e3-eb3b-4442-a54e-29ecafe76b53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:24.683217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6741e3-eb3b-4442-a54e-29ecafe76b53 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:24.683799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6741e3-eb3b-4442-a54e-29ecafe76b53 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:24.684145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6741e3-eb3b-4442-a54e-29ecafe76b53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:24.686536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7f6741e3-eb3b-4442-a54e-29ecafe76b53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:24.713993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6741e3-eb3b-4442-a54e-29ecafe76b53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:24.716525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6741e3-eb3b-4442-a54e-29ecafe76b53 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:24.731986 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1407/2785] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:47:31.042284 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=56 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:32.171550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581ced4-b053-40fa-ac98-c65b69ea491d service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:32.173026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b581ced4-b053-40fa-ac98-c65b69ea491d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:32.191553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581ced4-b053-40fa-ac98-c65b69ea491d service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:32.197866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e2168-f930-4822-bc36-caf7dec41ddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:32.198604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e2168-f930-4822-bc36-caf7dec41ddb service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:32.199820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e2168-f930-4822-bc36-caf7dec41ddb service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:32.200226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e2168-f930-4822-bc36-caf7dec41ddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:32.211701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e2168-f930-4822-bc36-caf7dec41ddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:32.219162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e2168-f930-4822-bc36-caf7dec41ddb service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:32.249070 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1379/2786] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:47:33.325317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6741e3-eb3b-4442-a54e-29ecafe76b53 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:33.330230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7f6741e3-eb3b-4442-a54e-29ecafe76b53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:33.525908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6741e3-eb3b-4442-a54e-29ecafe76b53 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:33.532718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ff082-54ce-46f8-b5a2-062b4a6fac66 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:33.534127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ff082-54ce-46f8-b5a2-062b4a6fac66 service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:33.534593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ff082-54ce-46f8-b5a2-062b4a6fac66 service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:33.535035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ff082-54ce-46f8-b5a2-062b4a6fac66 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:33.538086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c48ff082-54ce-46f8-b5a2-062b4a6fac66 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:33.559913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ff082-54ce-46f8-b5a2-062b4a6fac66 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:33.561788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ff082-54ce-46f8-b5a2-062b4a6fac66 service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:33.612850 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1408/2787] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:47:38.387716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e2168-f930-4822-bc36-caf7dec41ddb service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:38.455785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e2168-f930-4822-bc36-caf7dec41ddb service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:38.461114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91874b3c-5337-44c4-b848-43fd00ee8b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:38.461789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91874b3c-5337-44c4-b848-43fd00ee8b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:38.462148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91874b3c-5337-44c4-b848-43fd00ee8b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:38.462492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91874b3c-5337-44c4-b848-43fd00ee8b0b admin admin] PATH_INFO: `/v3/users/c9ddd5b971ef4142bb8194d13928964b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:38.463796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91874b3c-5337-44c4-b848-43fd00ee8b0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ddd5b971ef4142bb8194d13928964b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:38.466572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91874b3c-5337-44c4-b848-43fd00ee8b0b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:38.520163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91874b3c-5337-44c4-b848-43fd00ee8b0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ddd5b971ef4142bb8194d13928964b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:38.528875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91874b3c-5337-44c4-b848-43fd00ee8b0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ddd5b971ef4142bb8194d13928964b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:38.529521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91874b3c-5337-44c4-b848-43fd00ee8b0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ddd5b971ef4142bb8194d13928964b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:38.542127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91874b3c-5337-44c4-b848-43fd00ee8b0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ddd5b971ef4142bb8194d13928964b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:38.549826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91874b3c-5337-44c4-b848-43fd00ee8b0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ddd5b971ef4142bb8194d13928964b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:38.558864 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1380/2788] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:47:38 2022] DELETE /identity/v3/users/c9ddd5b971ef4142bb8194d13928964b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:38.560339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d6eab-9fc7-4f86-ab90-d0a7abc26a7d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:38.560848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d6eab-9fc7-4f86-ab90-d0a7abc26a7d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:38.560965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d6eab-9fc7-4f86-ab90-d0a7abc26a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:38.581837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-681d6eab-9fc7-4f86-ab90-d0a7abc26a7d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:38.583019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-681d6eab-9fc7-4f86-ab90-d0a7abc26a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:38.642637 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1409/2789] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:38.652829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91874b3c-5337-44c4-b848-43fd00ee8b0b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:38.654292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-91874b3c-5337-44c4-b848-43fd00ee8b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:38.713203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91874b3c-5337-44c4-b848-43fd00ee8b0b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:38.717721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb22c5-517e-45e9-a831-6eebb6e3f527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:38.718275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb22c5-517e-45e9-a831-6eebb6e3f527 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:38.718550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb22c5-517e-45e9-a831-6eebb6e3f527 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:38.718819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb22c5-517e-45e9-a831-6eebb6e3f527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:38.728142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb22c5-517e-45e9-a831-6eebb6e3f527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:38.729597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb22c5-517e-45e9-a831-6eebb6e3f527 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:38.739904 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1381/2790] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:47:38.983375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d6eab-9fc7-4f86-ab90-d0a7abc26a7d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:38.984955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-681d6eab-9fc7-4f86-ab90-d0a7abc26a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:38.999477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d6eab-9fc7-4f86-ab90-d0a7abc26a7d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:39.004587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef01260-1a8e-48fa-8385-8b01db8dcbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:39.005506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef01260-1a8e-48fa-8385-8b01db8dcbb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:39.006040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef01260-1a8e-48fa-8385-8b01db8dcbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:39.006680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef01260-1a8e-48fa-8385-8b01db8dcbb8 admin admin] PATH_INFO: `/v3/projects/eadf95be3b954215b136db3538a4a39a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:39.008236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef01260-1a8e-48fa-8385-8b01db8dcbb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eadf95be3b954215b136db3538a4a39a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:39.010364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef01260-1a8e-48fa-8385-8b01db8dcbb8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:39.071507 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:39.073565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4ef01260-1a8e-48fa-8385-8b01db8dcbb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eadf95be3b954215b136db3538a4a39a', 'request_id': 'req-4ef01260-1a8e-48fa-8385-8b01db8dcbb8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:39.082012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4ef01260-1a8e-48fa-8385-8b01db8dcbb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eadf95be3b954215b136db3538a4a39a', 'request_id': 'req-4ef01260-1a8e-48fa-8385-8b01db8dcbb8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:39.088020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4ef01260-1a8e-48fa-8385-8b01db8dcbb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eadf95be3b954215b136db3538a4a39a', 'request_id': 'req-4ef01260-1a8e-48fa-8385-8b01db8dcbb8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:39.100019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4ef01260-1a8e-48fa-8385-8b01db8dcbb8 admin admin] The token cache is being invalidate because project eadf95be3b954215b136db3538a4a39a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:47:39.100398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4ef01260-1a8e-48fa-8385-8b01db8dcbb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:39.101158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4ef01260-1a8e-48fa-8385-8b01db8dcbb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:39.102727 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1410/2791] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:47:38 2022] DELETE /identity/v3/projects/eadf95be3b954215b136db3538a4a39a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:39.107921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb22c5-517e-45e9-a831-6eebb6e3f527 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:39.119530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb22c5-517e-45e9-a831-6eebb6e3f527 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:39.125543 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:39.189950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296f8c8-46e2-4662-bc08-460f00f73ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:39.190700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296f8c8-46e2-4662-bc08-460f00f73ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:39.190980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296f8c8-46e2-4662-bc08-460f00f73ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:39.191253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296f8c8-46e2-4662-bc08-460f00f73ddb admin admin] PATH_INFO: `/v3/users/849b1603e2454346a4f08e9cc79a10ac` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:39.192385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296f8c8-46e2-4662-bc08-460f00f73ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=849b1603e2454346a4f08e9cc79a10ac)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:39.194365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296f8c8-46e2-4662-bc08-460f00f73ddb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:39.241864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9296f8c8-46e2-4662-bc08-460f00f73ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '849b1603e2454346a4f08e9cc79a10ac'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:39.251305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9296f8c8-46e2-4662-bc08-460f00f73ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '849b1603e2454346a4f08e9cc79a10ac'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:39.252111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9296f8c8-46e2-4662-bc08-460f00f73ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '849b1603e2454346a4f08e9cc79a10ac'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:39.267230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9296f8c8-46e2-4662-bc08-460f00f73ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '849b1603e2454346a4f08e9cc79a10ac'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:39.278461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef01260-1a8e-48fa-8385-8b01db8dcbb8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:39.278461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4ef01260-1a8e-48fa-8385-8b01db8dcbb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:39.283899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9296f8c8-46e2-4662-bc08-460f00f73ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '849b1603e2454346a4f08e9cc79a10ac'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:39.293437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef01260-1a8e-48fa-8385-8b01db8dcbb8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:39.296565 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1382/2792] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:47:39 2022] DELETE /identity/v3/users/849b1603e2454346a4f08e9cc79a10ac => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:39.366951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade748f-1e3c-4c3c-8075-85a520d93fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:39.367885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade748f-1e3c-4c3c-8075-85a520d93fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:39.368497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade748f-1e3c-4c3c-8075-85a520d93fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:39.369166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade748f-1e3c-4c3c-8075-85a520d93fc7 admin admin] PATH_INFO: `/v3/users/7133f9974bbf4d83a7cd7af164265de7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:39.371050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade748f-1e3c-4c3c-8075-85a520d93fc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7133f9974bbf4d83a7cd7af164265de7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:39.373553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade748f-1e3c-4c3c-8075-85a520d93fc7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:39.439368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7ade748f-1e3c-4c3c-8075-85a520d93fc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7133f9974bbf4d83a7cd7af164265de7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:39.440550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7ade748f-1e3c-4c3c-8075-85a520d93fc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7133f9974bbf4d83a7cd7af164265de7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:39.450805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7ade748f-1e3c-4c3c-8075-85a520d93fc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7133f9974bbf4d83a7cd7af164265de7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:39.473285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7ade748f-1e3c-4c3c-8075-85a520d93fc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7133f9974bbf4d83a7cd7af164265de7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:39.503770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7ade748f-1e3c-4c3c-8075-85a520d93fc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7133f9974bbf4d83a7cd7af164265de7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:39.518933 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1411/2793] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:47:39 2022] DELETE /identity/v3/users/7133f9974bbf4d83a7cd7af164265de7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:47:39.520704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871eb929-7be1-4baa-9e7a-609b5fb4d038 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:39.521158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871eb929-7be1-4baa-9e7a-609b5fb4d038 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:39.521373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871eb929-7be1-4baa-9e7a-609b5fb4d038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:39.548626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-871eb929-7be1-4baa-9e7a-609b5fb4d038 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:39.550317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-871eb929-7be1-4baa-9e7a-609b5fb4d038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:39.642794 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1383/2794] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:39.658169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade748f-1e3c-4c3c-8075-85a520d93fc7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:39.660238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7ade748f-1e3c-4c3c-8075-85a520d93fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:39.739651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871eb929-7be1-4baa-9e7a-609b5fb4d038 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:39.741690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-871eb929-7be1-4baa-9e7a-609b5fb4d038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:39.762364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade748f-1e3c-4c3c-8075-85a520d93fc7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:39.767100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721086fa-32bd-441b-920d-26c3b26a7531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:39.767721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721086fa-32bd-441b-920d-26c3b26a7531 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:39.767988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721086fa-32bd-441b-920d-26c3b26a7531 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:39.768257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721086fa-32bd-441b-920d-26c3b26a7531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:39.770795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871eb929-7be1-4baa-9e7a-609b5fb4d038 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:39.779073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721086fa-32bd-441b-920d-26c3b26a7531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:39.781192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721086fa-32bd-441b-920d-26c3b26a7531 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:39.781725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e01a24-4d55-4384-8129-c728cb647941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:39.782458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e01a24-4d55-4384-8129-c728cb647941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:39.782821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e01a24-4d55-4384-8129-c728cb647941 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:39.783087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e01a24-4d55-4384-8129-c728cb647941 admin admin] PATH_INFO: `/v3/projects/290a5e37de62444b93d226acd1c59947` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:39.784446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e01a24-4d55-4384-8129-c728cb647941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=290a5e37de62444b93d226acd1c59947)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:39.786393 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:39.788841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e01a24-4d55-4384-8129-c728cb647941 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:39.802307 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1412/2795] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:47:39.859550 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:39.895916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-82e01a24-4d55-4384-8129-c728cb647941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '290a5e37de62444b93d226acd1c59947', 'request_id': 'req-82e01a24-4d55-4384-8129-c728cb647941'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:39.908029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-82e01a24-4d55-4384-8129-c728cb647941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '290a5e37de62444b93d226acd1c59947', 'request_id': 'req-82e01a24-4d55-4384-8129-c728cb647941'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:39.931345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fe01b-236c-4161-98c2-cd039e01079f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:39.931571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fe01b-236c-4161-98c2-cd039e01079f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:39.931847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fe01b-236c-4161-98c2-cd039e01079f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:39.931977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-82e01a24-4d55-4384-8129-c728cb647941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '290a5e37de62444b93d226acd1c59947', 'request_id': 'req-82e01a24-4d55-4384-8129-c728cb647941'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:39.949182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-82e01a24-4d55-4384-8129-c728cb647941 admin admin] The token cache is being invalidate because project 290a5e37de62444b93d226acd1c59947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:47:39.950110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-82e01a24-4d55-4384-8129-c728cb647941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:39.950678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-82e01a24-4d55-4384-8129-c728cb647941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:39.953215 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1384/2796] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:47:39 2022] DELETE /identity/v3/projects/290a5e37de62444b93d226acd1c59947 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:47:39.953977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a83fe01b-236c-4161-98c2-cd039e01079f None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:39.955201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a83fe01b-236c-4161-98c2-cd039e01079f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:39.959081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7491c-d3d4-4b11-814b-179955547579 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:39.959348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7491c-d3d4-4b11-814b-179955547579 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:39.959621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7491c-d3d4-4b11-814b-179955547579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:39.983276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-aec7491c-d3d4-4b11-814b-179955547579 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:39.985633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aec7491c-d3d4-4b11-814b-179955547579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:40.153527 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1385/2797] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:47:40.154896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7491c-d3d4-4b11-814b-179955547579 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:40.156625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aec7491c-d3d4-4b11-814b-179955547579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:40.161445 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1413/2798] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 09:47:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:47:40.166566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74343a5a-64cb-4536-a406-c77acc2c58ec None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:40.169310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74343a5a-64cb-4536-a406-c77acc2c58ec None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:40.169795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74343a5a-64cb-4536-a406-c77acc2c58ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:40.176589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7491c-d3d4-4b11-814b-179955547579 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:40.181453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52fc49-b69e-4198-9a87-21f878cd7930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:40.182100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52fc49-b69e-4198-9a87-21f878cd7930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:40.182372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52fc49-b69e-4198-9a87-21f878cd7930 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:40.183269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52fc49-b69e-4198-9a87-21f878cd7930 admin admin] PATH_INFO: `/v3/projects/fa164e8825d34854b5b945f60b21513d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:40.184716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52fc49-b69e-4198-9a87-21f878cd7930 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa164e8825d34854b5b945f60b21513d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:40.187159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52fc49-b69e-4198-9a87-21f878cd7930 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:40.222872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-74343a5a-64cb-4536-a406-c77acc2c58ec None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:40.224543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-74343a5a-64cb-4536-a406-c77acc2c58ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:40.235040 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1414/2799] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:40.236307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74343a5a-64cb-4536-a406-c77acc2c58ec None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:40.237700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-74343a5a-64cb-4536-a406-c77acc2c58ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:40.279709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a52fc49-b69e-4198-9a87-21f878cd7930 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa164e8825d34854b5b945f60b21513d', 'request_id': 'req-5a52fc49-b69e-4198-9a87-21f878cd7930'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:40.305794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a52fc49-b69e-4198-9a87-21f878cd7930 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa164e8825d34854b5b945f60b21513d', 'request_id': 'req-5a52fc49-b69e-4198-9a87-21f878cd7930'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:40.320063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a52fc49-b69e-4198-9a87-21f878cd7930 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa164e8825d34854b5b945f60b21513d', 'request_id': 'req-5a52fc49-b69e-4198-9a87-21f878cd7930'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:40.346330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a52fc49-b69e-4198-9a87-21f878cd7930 admin admin] The token cache is being invalidate because project fa164e8825d34854b5b945f60b21513d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:47:40.346607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a52fc49-b69e-4198-9a87-21f878cd7930 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:40.347362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a52fc49-b69e-4198-9a87-21f878cd7930 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:40.348968 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1386/2800] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:47:40 2022] DELETE /identity/v3/projects/fa164e8825d34854b5b945f60b21513d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:40.349752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52fc49-b69e-4198-9a87-21f878cd7930 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:40.351261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5a52fc49-b69e-4198-9a87-21f878cd7930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:40.370057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74343a5a-64cb-4536-a406-c77acc2c58ec None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:40.410947 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:40.450078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52fc49-b69e-4198-9a87-21f878cd7930 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:40.456140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9b083-0ac8-42a8-942d-442b7dab7c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:40.456794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9b083-0ac8-42a8-942d-442b7dab7c51 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:40.457074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9b083-0ac8-42a8-942d-442b7dab7c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:40.457346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9b083-0ac8-42a8-942d-442b7dab7c51 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:40.458016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9b083-0ac8-42a8-942d-442b7dab7c51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:47:40.458319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9b083-0ac8-42a8-942d-442b7dab7c51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:40.459434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967ec12-7b7b-483a-b760-62ec9e1b8629 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:40.459910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9b083-0ac8-42a8-942d-442b7dab7c51 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:40.460051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967ec12-7b7b-483a-b760-62ec9e1b8629 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:40.460313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967ec12-7b7b-483a-b760-62ec9e1b8629 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:40.460631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967ec12-7b7b-483a-b760-62ec9e1b8629 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:40.462504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6967ec12-7b7b-483a-b760-62ec9e1b8629 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:40.476367 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1387/2801] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:47:40.476367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9b083-0ac8-42a8-942d-442b7dab7c51 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:40.485735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-97c9b083-0ac8-42a8-942d-442b7dab7c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:40.509323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9b083-0ac8-42a8-942d-442b7dab7c51 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:40.521200 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:40.522189 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046672c-b9c8-4cbd-ba49-01ea13471b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:40.523210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046672c-b9c8-4cbd-ba49-01ea13471b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:40.523398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046672c-b9c8-4cbd-ba49-01ea13471b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:40.523607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046672c-b9c8-4cbd-ba49-01ea13471b02 admin admin] PATH_INFO: `/v3/users/4de5916e45b245e7a53db9d0081478d4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:40.525110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046672c-b9c8-4cbd-ba49-01ea13471b02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4de5916e45b245e7a53db9d0081478d4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:40.527203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046672c-b9c8-4cbd-ba49-01ea13471b02 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:40.552909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967ec12-7b7b-483a-b760-62ec9e1b8629 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:40.555780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967ec12-7b7b-483a-b760-62ec9e1b8629 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:40.568882 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1415/2802] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:47:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:47:40.569883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967ec12-7b7b-483a-b760-62ec9e1b8629 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:40.581972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967ec12-7b7b-483a-b760-62ec9e1b8629 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:40.587282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825158fe-f178-4a41-8e69-2c71b63650c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:40.588088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825158fe-f178-4a41-8e69-2c71b63650c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:40.588363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825158fe-f178-4a41-8e69-2c71b63650c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:40.588657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825158fe-f178-4a41-8e69-2c71b63650c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:40.589333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825158fe-f178-4a41-8e69-2c71b63650c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:40.591211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825158fe-f178-4a41-8e69-2c71b63650c1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:40.634691 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1416/2803] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:47:40 2022] POST /identity/v3/projects => generated 391 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:47:40.638643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825158fe-f178-4a41-8e69-2c71b63650c1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:40.652370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6046672c-b9c8-4cbd-ba49-01ea13471b02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4de5916e45b245e7a53db9d0081478d4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:40.671855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6046672c-b9c8-4cbd-ba49-01ea13471b02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4de5916e45b245e7a53db9d0081478d4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:40.672581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6046672c-b9c8-4cbd-ba49-01ea13471b02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4de5916e45b245e7a53db9d0081478d4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:40.694928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6046672c-b9c8-4cbd-ba49-01ea13471b02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4de5916e45b245e7a53db9d0081478d4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:40.705791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6046672c-b9c8-4cbd-ba49-01ea13471b02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4de5916e45b245e7a53db9d0081478d4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:40.718176 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1388/2804] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:47:40 2022] DELETE /identity/v3/users/4de5916e45b245e7a53db9d0081478d4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:40.731013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825158fe-f178-4a41-8e69-2c71b63650c1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:40.816111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752d88b-466c-484a-a520-c659ab71fa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:40.817181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752d88b-466c-484a-a520-c659ab71fa75 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:40.817426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752d88b-466c-484a-a520-c659ab71fa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:40.817923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752d88b-466c-484a-a520-c659ab71fa75 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:40.818731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752d88b-466c-484a-a520-c659ab71fa75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:40.821747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752d88b-466c-484a-a520-c659ab71fa75 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:40.860675 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1417/2805] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:47:40 2022] POST /identity/v3/users => generated 296 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:47:40.862748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046672c-b9c8-4cbd-ba49-01ea13471b02 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:40.864755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6046672c-b9c8-4cbd-ba49-01ea13471b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:40.888101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046672c-b9c8-4cbd-ba49-01ea13471b02 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:40.893086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0d385-6bdc-47f4-81c1-cfb5817cdbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:40.893818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0d385-6bdc-47f4-81c1-cfb5817cdbcb admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:40.894162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0d385-6bdc-47f4-81c1-cfb5817cdbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:40.894498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0d385-6bdc-47f4-81c1-cfb5817cdbcb admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:40.895319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0d385-6bdc-47f4-81c1-cfb5817cdbcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:40.897033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0d385-6bdc-47f4-81c1-cfb5817cdbcb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:40.909114 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1389/2806] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:47:40.918351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752d88b-466c-484a-a520-c659ab71fa75 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:40.929455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752d88b-466c-484a-a520-c659ab71fa75 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:40.939542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d63182-e0e5-4065-b1e5-f5660f1653f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:40.940150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d63182-e0e5-4065-b1e5-f5660f1653f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:40.940433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d63182-e0e5-4065-b1e5-f5660f1653f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:40.941289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d63182-e0e5-4065-b1e5-f5660f1653f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:40.941947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d63182-e0e5-4065-b1e5-f5660f1653f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:40.943902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d63182-e0e5-4065-b1e5-f5660f1653f4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:40.957345 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1418/2807] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:47:40.962816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0d385-6bdc-47f4-81c1-cfb5817cdbcb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:40.979221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0d385-6bdc-47f4-81c1-cfb5817cdbcb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:40.987661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a21c2-5da5-4cd6-bb25-71556c4d2a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:40.988573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a21c2-5da5-4cd6-bb25-71556c4d2a77 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:40.991826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a21c2-5da5-4cd6-bb25-71556c4d2a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:40.991826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a21c2-5da5-4cd6-bb25-71556c4d2a77 admin admin] PATH_INFO: `/v3/projects/6c22feba19094a69a44bc897e8651dd5/users/e5ddd54acf46469193e6cd78c0cb2f4d/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:40.993683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d63182-e0e5-4065-b1e5-f5660f1653f4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:40.997086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-87d63182-e0e5-4065-b1e5-f5660f1653f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:41.025129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a21c2-5da5-4cd6-bb25-71556c4d2a77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c22feba19094a69a44bc897e8651dd5, user_id=e5ddd54acf46469193e6cd78c0cb2f4d, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:41.029778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a21c2-5da5-4cd6-bb25-71556c4d2a77 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:41.032234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d63182-e0e5-4065-b1e5-f5660f1653f4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:41.040432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b9134-4cb7-4553-a0cb-096683408d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:41.041219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b9134-4cb7-4553-a0cb-096683408d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:41.041869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b9134-4cb7-4553-a0cb-096683408d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:41.042955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b9134-4cb7-4553-a0cb-096683408d69 admin admin] PATH_INFO: `/v3/projects/1807a605329b401e8d20e1088b2919a1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:41.045150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b9134-4cb7-4553-a0cb-096683408d69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1807a605329b401e8d20e1088b2919a1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:41.047622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b9134-4cb7-4553-a0cb-096683408d69 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:41.052168 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1390/2808] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:47:40 2022] PUT /identity/v3/projects/6c22feba19094a69a44bc897e8651dd5/users/e5ddd54acf46469193e6cd78c0cb2f4d/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:41.066125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde99250-f5a3-40b4-a699-5ef496b452a4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:41.066465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde99250-f5a3-40b4-a699-5ef496b452a4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:41.066727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde99250-f5a3-40b4-a699-5ef496b452a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:41.104880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fde99250-f5a3-40b4-a699-5ef496b452a4 None None] MFA Rules not processed for user `e5ddd54acf46469193e6cd78c0cb2f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:41.106630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fde99250-f5a3-40b4-a699-5ef496b452a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:41.130072 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:41.151352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-438b9134-4cb7-4553-a0cb-096683408d69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1807a605329b401e8d20e1088b2919a1', 'request_id': 'req-438b9134-4cb7-4553-a0cb-096683408d69'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:41.167166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-438b9134-4cb7-4553-a0cb-096683408d69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1807a605329b401e8d20e1088b2919a1', 'request_id': 'req-438b9134-4cb7-4553-a0cb-096683408d69'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:41.181144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-438b9134-4cb7-4553-a0cb-096683408d69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1807a605329b401e8d20e1088b2919a1', 'request_id': 'req-438b9134-4cb7-4553-a0cb-096683408d69'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:41.200778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-438b9134-4cb7-4553-a0cb-096683408d69 admin admin] The token cache is being invalidate because project 1807a605329b401e8d20e1088b2919a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:47:41.201199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-438b9134-4cb7-4553-a0cb-096683408d69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:41.202606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-438b9134-4cb7-4553-a0cb-096683408d69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:41.203111 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:41.205305 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1419/2809] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:47:40 2022] DELETE /identity/v3/projects/1807a605329b401e8d20e1088b2919a1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:41.211837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a0f18-6f2d-4035-ba5c-6b8ad9923f65 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:41.212170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a0f18-6f2d-4035-ba5c-6b8ad9923f65 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:41.212507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a0f18-6f2d-4035-ba5c-6b8ad9923f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:41.224350 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1391/2810] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:47:41.229845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde99250-f5a3-40b4-a699-5ef496b452a4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:41.248650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1e0a0f18-6f2d-4035-ba5c-6b8ad9923f65 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:41.250763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1e0a0f18-6f2d-4035-ba5c-6b8ad9923f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:41.347569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde99250-f5a3-40b4-a699-5ef496b452a4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:41.384302 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1420/2811] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:47:41.394795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3dbcd-0a8c-4f5d-8ff9-2a15705b5fba None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:41.395315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3dbcd-0a8c-4f5d-8ff9-2a15705b5fba None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:41.396259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3dbcd-0a8c-4f5d-8ff9-2a15705b5fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:41.439203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d1f3dbcd-0a8c-4f5d-8ff9-2a15705b5fba None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:41.443840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d1f3dbcd-0a8c-4f5d-8ff9-2a15705b5fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:41.464835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e07745-7c70-4ae9-b25f-51697fdceb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:41.465890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e07745-7c70-4ae9-b25f-51697fdceb67 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:41.466427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e07745-7c70-4ae9-b25f-51697fdceb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:41.466991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e07745-7c70-4ae9-b25f-51697fdceb67 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:41.467807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e07745-7c70-4ae9-b25f-51697fdceb67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:41.469574 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1421/2812] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:41.470897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3dbcd-0a8c-4f5d-8ff9-2a15705b5fba None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:41.471352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e07745-7c70-4ae9-b25f-51697fdceb67 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:41.481460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3dbcd-0a8c-4f5d-8ff9-2a15705b5fba None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:41.487386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c49e7-26ff-4e8f-a9a3-485daa2da6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:41.488120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c49e7-26ff-4e8f-a9a3-485daa2da6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:41.488394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c49e7-26ff-4e8f-a9a3-485daa2da6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:41.488774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c49e7-26ff-4e8f-a9a3-485daa2da6e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:41.489535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c49e7-26ff-4e8f-a9a3-485daa2da6e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:47:41.489967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c49e7-26ff-4e8f-a9a3-485daa2da6e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:41.491665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c49e7-26ff-4e8f-a9a3-485daa2da6e7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:41.511437 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1422/2813] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:47:41.512749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c49e7-26ff-4e8f-a9a3-485daa2da6e7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:41.518303 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1392/2814] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:47:41 2022] POST /identity/v3/projects => generated 393 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:47:41.522294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e07745-7c70-4ae9-b25f-51697fdceb67 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:41.525910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d5e07745-7c70-4ae9-b25f-51697fdceb67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:41.531199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c49e7-26ff-4e8f-a9a3-485daa2da6e7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:41.666802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e07745-7c70-4ae9-b25f-51697fdceb67 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:41.680326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf44b35-b45f-4fe6-96fc-c0a35bcf1d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:41.681245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf44b35-b45f-4fe6-96fc-c0a35bcf1d6a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:41.682261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf44b35-b45f-4fe6-96fc-c0a35bcf1d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:41.682473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf44b35-b45f-4fe6-96fc-c0a35bcf1d6a admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:41.683760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf44b35-b45f-4fe6-96fc-c0a35bcf1d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:41.691582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf44b35-b45f-4fe6-96fc-c0a35bcf1d6a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:41.697484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3165635-f6da-4b38-8f32-9f179142ce31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:41.698345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3165635-f6da-4b38-8f32-9f179142ce31 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:41.698644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3165635-f6da-4b38-8f32-9f179142ce31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:41.698917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3165635-f6da-4b38-8f32-9f179142ce31 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:41.699596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3165635-f6da-4b38-8f32-9f179142ce31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:41.712394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3165635-f6da-4b38-8f32-9f179142ce31 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:41.743030 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1393/2815] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:47:41 2022] POST /identity/v3/users => generated 303 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:47:41.747451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf44b35-b45f-4fe6-96fc-c0a35bcf1d6a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:41.761120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf44b35-b45f-4fe6-96fc-c0a35bcf1d6a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:41.766666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054dc65-fc19-4f43-a3cf-deccc802101c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:41.767429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054dc65-fc19-4f43-a3cf-deccc802101c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:41.767881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054dc65-fc19-4f43-a3cf-deccc802101c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:41.768243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054dc65-fc19-4f43-a3cf-deccc802101c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:41.769167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054dc65-fc19-4f43-a3cf-deccc802101c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:41.770835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054dc65-fc19-4f43-a3cf-deccc802101c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:41.772190 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1423/2816] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:47:41 2022] POST /identity/v3/projects => generated 361 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:47:41.777287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3165635-f6da-4b38-8f32-9f179142ce31 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:41.790010 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1394/2817] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:47:41.791033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054dc65-fc19-4f43-a3cf-deccc802101c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:41.802382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054dc65-fc19-4f43-a3cf-deccc802101c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:41.808382 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:41.828019 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:41.876536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3165635-f6da-4b38-8f32-9f179142ce31 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:41.883994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b0a8c-63ee-48e2-949d-5e9ff1483a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:41.884931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b0a8c-63ee-48e2-949d-5e9ff1483a0f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:41.885405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b0a8c-63ee-48e2-949d-5e9ff1483a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:41.886729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b0a8c-63ee-48e2-949d-5e9ff1483a0f admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:41.887724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b0a8c-63ee-48e2-949d-5e9ff1483a0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:41.891416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b0a8c-63ee-48e2-949d-5e9ff1483a0f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:41.918987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90548e28-6719-426c-b53c-c654be0e4177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:41.919774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90548e28-6719-426c-b53c-c654be0e4177 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:41.920122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90548e28-6719-426c-b53c-c654be0e4177 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:41.920462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90548e28-6719-426c-b53c-c654be0e4177 admin admin] PATH_INFO: `/v3/projects/30bf59b58ac64c57bb4d7d8c78bf9f4a/users/44fc0d5602f04827bcb425a1d5ce46b2/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:41.929162 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1424/2818] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:47:41 2022] POST /identity/v3/users => generated 281 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:47:41.934137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b0a8c-63ee-48e2-949d-5e9ff1483a0f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:41.940838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90548e28-6719-426c-b53c-c654be0e4177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30bf59b58ac64c57bb4d7d8c78bf9f4a, user_id=44fc0d5602f04827bcb425a1d5ce46b2, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:41.943588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90548e28-6719-426c-b53c-c654be0e4177 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:41.945111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b0a8c-63ee-48e2-949d-5e9ff1483a0f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:41.951316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f66a5-7976-4195-8a9a-67c62cf285ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:41.952222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f66a5-7976-4195-8a9a-67c62cf285ab admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:41.952840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f66a5-7976-4195-8a9a-67c62cf285ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:41.953196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f66a5-7976-4195-8a9a-67c62cf285ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:41.954114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f66a5-7976-4195-8a9a-67c62cf285ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:41.955828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f66a5-7976-4195-8a9a-67c62cf285ab admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:41.959688 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1395/2819] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:47:41 2022] PUT /identity/v3/projects/30bf59b58ac64c57bb4d7d8c78bf9f4a/users/44fc0d5602f04827bcb425a1d5ce46b2/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:41.963424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90548e28-6719-426c-b53c-c654be0e4177 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:41.972565 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1425/2820] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:47:41.974598 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f66a5-7976-4195-8a9a-67c62cf285ab admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:41.985027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f66a5-7976-4195-8a9a-67c62cf285ab admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:42.053111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90548e28-6719-426c-b53c-c654be0e4177 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:42.061200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83775df0-7915-42bd-9600-0cd0a0b7304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:42.062004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83775df0-7915-42bd-9600-0cd0a0b7304f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:42.062323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83775df0-7915-42bd-9600-0cd0a0b7304f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:42.062678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83775df0-7915-42bd-9600-0cd0a0b7304f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:42.063150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e163d-9668-49ee-a1a7-4cfe52234a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:42.063338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83775df0-7915-42bd-9600-0cd0a0b7304f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:42.063962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e163d-9668-49ee-a1a7-4cfe52234a70 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:42.064385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e163d-9668-49ee-a1a7-4cfe52234a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:42.064770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e163d-9668-49ee-a1a7-4cfe52234a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:42.065286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83775df0-7915-42bd-9600-0cd0a0b7304f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:42.065702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e163d-9668-49ee-a1a7-4cfe52234a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:42.067649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e163d-9668-49ee-a1a7-4cfe52234a70 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:42.083228 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1426/2821] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:47:42.083427 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1396/2822] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:47:42.085455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83775df0-7915-42bd-9600-0cd0a0b7304f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:42.085727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e163d-9668-49ee-a1a7-4cfe52234a70 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:42.098252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e163d-9668-49ee-a1a7-4cfe52234a70 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:42.098486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83775df0-7915-42bd-9600-0cd0a0b7304f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:42.103525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b7011-d508-40db-82f4-2a72201eb441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:42.103693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145ad50-5088-4c4b-bcd8-9b782da1b816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:42.104584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b7011-d508-40db-82f4-2a72201eb441 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:42.104893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b7011-d508-40db-82f4-2a72201eb441 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:42.105325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b7011-d508-40db-82f4-2a72201eb441 admin admin] PATH_INFO: `/v3/projects/66dc51df763a4cc887b81e815490997d/users/0b8d05dd9f474f199cd0e6225dd3d93d/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:42.105696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145ad50-5088-4c4b-bcd8-9b782da1b816 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:42.105994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145ad50-5088-4c4b-bcd8-9b782da1b816 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:42.106317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145ad50-5088-4c4b-bcd8-9b782da1b816 admin admin] PATH_INFO: `/v3/projects/30bf59b58ac64c57bb4d7d8c78bf9f4a/users/44fc0d5602f04827bcb425a1d5ce46b2/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:42.108283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145ad50-5088-4c4b-bcd8-9b782da1b816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30bf59b58ac64c57bb4d7d8c78bf9f4a, user_id=44fc0d5602f04827bcb425a1d5ce46b2, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:42.112060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145ad50-5088-4c4b-bcd8-9b782da1b816 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:42.123630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b7011-d508-40db-82f4-2a72201eb441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66dc51df763a4cc887b81e815490997d, user_id=0b8d05dd9f474f199cd0e6225dd3d93d, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:42.126301 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1427/2823] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:47:42 2022] PUT /identity/v3/projects/30bf59b58ac64c57bb4d7d8c78bf9f4a/users/44fc0d5602f04827bcb425a1d5ce46b2/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:42.126839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b7011-d508-40db-82f4-2a72201eb441 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:42.141267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e78bca-6612-46e8-b675-c0750d826922 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:42.141556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e78bca-6612-46e8-b675-c0750d826922 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:42.141835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e78bca-6612-46e8-b675-c0750d826922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:42.144493 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1397/2824] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:47:42 2022] PUT /identity/v3/projects/66dc51df763a4cc887b81e815490997d/users/0b8d05dd9f474f199cd0e6225dd3d93d/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:42.156712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa6b05-d4a4-4441-9072-423e40b03f64 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:42.157001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa6b05-d4a4-4441-9072-423e40b03f64 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:42.157267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa6b05-d4a4-4441-9072-423e40b03f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:42.179178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b1e78bca-6612-46e8-b675-c0750d826922 None None] MFA Rules not processed for user `44fc0d5602f04827bcb425a1d5ce46b2`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:42.180759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b1e78bca-6612-46e8-b675-c0750d826922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:42.192413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6daa6b05-d4a4-4441-9072-423e40b03f64 None None] MFA Rules not processed for user `0b8d05dd9f474f199cd0e6225dd3d93d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:42.195204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6daa6b05-d4a4-4441-9072-423e40b03f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:42.257220 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:42.276123 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1428/2825] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:42 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:42.285721 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1398/2826] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:47:42.290311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e78bca-6612-46e8-b675-c0750d826922 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:42.290485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa6b05-d4a4-4441-9072-423e40b03f64 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:42.291841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b1e78bca-6612-46e8-b675-c0750d826922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:42.316301 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:42.367978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa6b05-d4a4-4441-9072-423e40b03f64 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:42.375097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fa866-8452-4415-84b1-a6cf848df6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:42.375294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e78bca-6612-46e8-b675-c0750d826922 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:42.375913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fa866-8452-4415-84b1-a6cf848df6e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:42.376135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fa866-8452-4415-84b1-a6cf848df6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:42.376407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fa866-8452-4415-84b1-a6cf848df6e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:42.377081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fa866-8452-4415-84b1-a6cf848df6e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:42.379052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fa866-8452-4415-84b1-a6cf848df6e8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:42.381532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cdd84f-6607-42d9-ab88-79358e4f2b80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:42.382198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdd84f-6607-42d9-ab88-79358e4f2b80 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:42.382551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdd84f-6607-42d9-ab88-79358e4f2b80 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:42.382868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdd84f-6607-42d9-ab88-79358e4f2b80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:42.393169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cdd84f-6607-42d9-ab88-79358e4f2b80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:42.394973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cdd84f-6607-42d9-ab88-79358e4f2b80 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:42.406545 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1429/2827] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:42 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:47:42.416832 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1399/2828] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:47:42 2022] POST /identity/v3/projects => generated 361 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:47:42.418225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fa866-8452-4415-84b1-a6cf848df6e8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:42.450542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cdd84f-6607-42d9-ab88-79358e4f2b80 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:42.480730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cdd84f-6607-42d9-ab88-79358e4f2b80 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:42.518678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fa866-8452-4415-84b1-a6cf848df6e8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:42.532827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f147b2c-12e1-4506-8c8a-ede88e5338be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:42.534037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f147b2c-12e1-4506-8c8a-ede88e5338be admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:42.534529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f147b2c-12e1-4506-8c8a-ede88e5338be admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:42.535010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f147b2c-12e1-4506-8c8a-ede88e5338be admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:42.536267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f147b2c-12e1-4506-8c8a-ede88e5338be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:42.539177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f147b2c-12e1-4506-8c8a-ede88e5338be admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:42.564908 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1400/2829] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:47:42 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:47:42.568862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f147b2c-12e1-4506-8c8a-ede88e5338be admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:42.569418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a345481-a768-4709-a37f-226170cd1087 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:42.570176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a345481-a768-4709-a37f-226170cd1087 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:42.570467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a345481-a768-4709-a37f-226170cd1087 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:42.570798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a345481-a768-4709-a37f-226170cd1087 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:42.572703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6a345481-a768-4709-a37f-226170cd1087 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:42.581237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f147b2c-12e1-4506-8c8a-ede88e5338be admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:42.586346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a7e7a-4c17-4e78-9c50-9aba9d3531a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:42.586769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a7e7a-4c17-4e78-9c50-9aba9d3531a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:42.587167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a7e7a-4c17-4e78-9c50-9aba9d3531a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:42.587672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a7e7a-4c17-4e78-9c50-9aba9d3531a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:42.588409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a7e7a-4c17-4e78-9c50-9aba9d3531a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:42.591152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a7e7a-4c17-4e78-9c50-9aba9d3531a0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:42.602630 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1401/2830] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:47:42.607251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a7e7a-4c17-4e78-9c50-9aba9d3531a0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:42.617738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a7e7a-4c17-4e78-9c50-9aba9d3531a0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:42.623118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8234be3-6ea1-439a-a3fe-bf4208ea9d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:42.623807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8234be3-6ea1-439a-a3fe-bf4208ea9d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:42.624089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8234be3-6ea1-439a-a3fe-bf4208ea9d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:42.624394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8234be3-6ea1-439a-a3fe-bf4208ea9d24 admin admin] PATH_INFO: `/v3/projects/d2ee75b06bfd498aa9d432b4d8ddd7a4/users/ac4adc65f78842ad8be1a630496e46be/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:42.642657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8234be3-6ea1-439a-a3fe-bf4208ea9d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ee75b06bfd498aa9d432b4d8ddd7a4, user_id=ac4adc65f78842ad8be1a630496e46be, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:42.645444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8234be3-6ea1-439a-a3fe-bf4208ea9d24 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:42.665181 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1402/2831] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:47:42 2022] PUT /identity/v3/projects/d2ee75b06bfd498aa9d432b4d8ddd7a4/users/ac4adc65f78842ad8be1a630496e46be/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:47:42.669217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a345481-a768-4709-a37f-226170cd1087 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:42.669886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8234be3-6ea1-439a-a3fe-bf4208ea9d24 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:42.671273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a345481-a768-4709-a37f-226170cd1087 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:42.686386 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1430/2832] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:42 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:47:42.707211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a345481-a768-4709-a37f-226170cd1087 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:42.723872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a345481-a768-4709-a37f-226170cd1087 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:42.757602 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:42.804972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8234be3-6ea1-439a-a3fe-bf4208ea9d24 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:42.812063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70824a54-d388-474f-b219-2adb080155d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:42.813010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70824a54-d388-474f-b219-2adb080155d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:42.813392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70824a54-d388-474f-b219-2adb080155d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:42.814136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70824a54-d388-474f-b219-2adb080155d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:42.815148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70824a54-d388-474f-b219-2adb080155d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:42.817633 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:42.818252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70824a54-d388-474f-b219-2adb080155d2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:42.838602 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1403/2833] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:47:42.839920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70824a54-d388-474f-b219-2adb080155d2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:42.871176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70824a54-d388-474f-b219-2adb080155d2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:42.871337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba3ca0-f238-4008-9481-c7286d747848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:42.871940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba3ca0-f238-4008-9481-c7286d747848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:42.872219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba3ca0-f238-4008-9481-c7286d747848 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:42.872489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba3ca0-f238-4008-9481-c7286d747848 admin admin] PATH_INFO: `/v3/users/e5ddd54acf46469193e6cd78c0cb2f4d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:42.873776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba3ca0-f238-4008-9481-c7286d747848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5ddd54acf46469193e6cd78c0cb2f4d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:42.876113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615db094-21dd-48e3-8463-e7fc65d4b1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:42.876713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba3ca0-f238-4008-9481-c7286d747848 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:42.876853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615db094-21dd-48e3-8463-e7fc65d4b1aa admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:42.877073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615db094-21dd-48e3-8463-e7fc65d4b1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:42.877349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615db094-21dd-48e3-8463-e7fc65d4b1aa admin admin] PATH_INFO: `/v3/projects/d2ee75b06bfd498aa9d432b4d8ddd7a4/users/ac4adc65f78842ad8be1a630496e46be/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:42.879607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615db094-21dd-48e3-8463-e7fc65d4b1aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ee75b06bfd498aa9d432b4d8ddd7a4, user_id=ac4adc65f78842ad8be1a630496e46be, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:42.882097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615db094-21dd-48e3-8463-e7fc65d4b1aa admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:42.893368 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1404/2834] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:47:42 2022] PUT /identity/v3/projects/d2ee75b06bfd498aa9d432b4d8ddd7a4/users/ac4adc65f78842ad8be1a630496e46be/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:42.904499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e662c8c-be09-4eef-913f-e85672efdfaf None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:42.905057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e662c8c-be09-4eef-913f-e85672efdfaf None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:42.905380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e662c8c-be09-4eef-913f-e85672efdfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:42.941578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6dba3ca0-f238-4008-9481-c7286d747848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5ddd54acf46469193e6cd78c0cb2f4d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:42.942367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6dba3ca0-f238-4008-9481-c7286d747848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5ddd54acf46469193e6cd78c0cb2f4d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:42.950693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8e662c8c-be09-4eef-913f-e85672efdfaf None None] MFA Rules not processed for user `ac4adc65f78842ad8be1a630496e46be`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:42.950943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6dba3ca0-f238-4008-9481-c7286d747848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5ddd54acf46469193e6cd78c0cb2f4d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:42.952689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8e662c8c-be09-4eef-913f-e85672efdfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:42.964888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6dba3ca0-f238-4008-9481-c7286d747848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5ddd54acf46469193e6cd78c0cb2f4d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:42.972472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6dba3ca0-f238-4008-9481-c7286d747848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5ddd54acf46469193e6cd78c0cb2f4d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:42.980263 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1431/2835] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:47:42 2022] DELETE /identity/v3/users/e5ddd54acf46469193e6cd78c0cb2f4d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:42.984537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44d697-cb18-4017-8690-6aa54571b9de None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:42.985021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44d697-cb18-4017-8690-6aa54571b9de None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:42.985712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44d697-cb18-4017-8690-6aa54571b9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:43.010180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ad44d697-cb18-4017-8690-6aa54571b9de None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:43.012815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ad44d697-cb18-4017-8690-6aa54571b9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:43.051423 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1405/2836] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:42 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:47:43.066139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e662c8c-be09-4eef-913f-e85672efdfaf None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:43.067631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8e662c8c-be09-4eef-913f-e85672efdfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:43.112155 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1432/2837] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:47:43.126401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44d697-cb18-4017-8690-6aa54571b9de None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:43.126401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ad44d697-cb18-4017-8690-6aa54571b9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:43.157448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e662c8c-be09-4eef-913f-e85672efdfaf None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:43.192781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44d697-cb18-4017-8690-6aa54571b9de None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:43.194541 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:43.197668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c4040-8912-4ffe-aad1-c9110dd4fff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:43.199177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c4040-8912-4ffe-aad1-c9110dd4fff7 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:43.199456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c4040-8912-4ffe-aad1-c9110dd4fff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:43.199725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c4040-8912-4ffe-aad1-c9110dd4fff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:43.210045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c4040-8912-4ffe-aad1-c9110dd4fff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:43.211735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c4040-8912-4ffe-aad1-c9110dd4fff7 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:43.222790 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1433/2838] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:47:43.228794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56645472-ccbf-4e28-a16e-865db44a72d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:43.229581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56645472-ccbf-4e28-a16e-865db44a72d0 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:43.230028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56645472-ccbf-4e28-a16e-865db44a72d0 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:43.230397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56645472-ccbf-4e28-a16e-865db44a72d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:43.303975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56645472-ccbf-4e28-a16e-865db44a72d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:43.306666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56645472-ccbf-4e28-a16e-865db44a72d0 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:43.329169 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1406/2839] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:43 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:47:43.643658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c4040-8912-4ffe-aad1-c9110dd4fff7 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:43.645599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-470c4040-8912-4ffe-aad1-c9110dd4fff7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:43.659120 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:43.665483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c4040-8912-4ffe-aad1-c9110dd4fff7 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:43.679691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896e0b8-5665-4015-abea-8f2c38012d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:43.680700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896e0b8-5665-4015-abea-8f2c38012d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:43.681468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896e0b8-5665-4015-abea-8f2c38012d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:43.682032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896e0b8-5665-4015-abea-8f2c38012d0e admin admin] PATH_INFO: `/v3/projects/6c22feba19094a69a44bc897e8651dd5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:43.684549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896e0b8-5665-4015-abea-8f2c38012d0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c22feba19094a69a44bc897e8651dd5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:43.687902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896e0b8-5665-4015-abea-8f2c38012d0e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:43.752353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d896e0b8-5665-4015-abea-8f2c38012d0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c22feba19094a69a44bc897e8651dd5', 'request_id': 'req-d896e0b8-5665-4015-abea-8f2c38012d0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:43.766825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d896e0b8-5665-4015-abea-8f2c38012d0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c22feba19094a69a44bc897e8651dd5', 'request_id': 'req-d896e0b8-5665-4015-abea-8f2c38012d0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:43.773881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d896e0b8-5665-4015-abea-8f2c38012d0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c22feba19094a69a44bc897e8651dd5', 'request_id': 'req-d896e0b8-5665-4015-abea-8f2c38012d0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:43.786980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d896e0b8-5665-4015-abea-8f2c38012d0e admin admin] The token cache is being invalidate because project 6c22feba19094a69a44bc897e8651dd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:47:43.787268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d896e0b8-5665-4015-abea-8f2c38012d0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:43.787968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d896e0b8-5665-4015-abea-8f2c38012d0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:43.789749 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1434/2840] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:47:43 2022] DELETE /identity/v3/projects/6c22feba19094a69a44bc897e8651dd5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:43.794427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56645472-ccbf-4e28-a16e-865db44a72d0 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:43.806167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56645472-ccbf-4e28-a16e-865db44a72d0 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:43.882000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c4f60-c52d-4dd2-abe5-c6fc8e72cb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:43.883136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c4f60-c52d-4dd2-abe5-c6fc8e72cb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:43.883419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c4f60-c52d-4dd2-abe5-c6fc8e72cb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:43.883690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c4f60-c52d-4dd2-abe5-c6fc8e72cb60 admin admin] PATH_INFO: `/v3/users/44fc0d5602f04827bcb425a1d5ce46b2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:43.885228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c4f60-c52d-4dd2-abe5-c6fc8e72cb60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44fc0d5602f04827bcb425a1d5ce46b2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:43.887867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c4f60-c52d-4dd2-abe5-c6fc8e72cb60 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:43.982405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6e5c4f60-c52d-4dd2-abe5-c6fc8e72cb60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44fc0d5602f04827bcb425a1d5ce46b2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:43.994885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6e5c4f60-c52d-4dd2-abe5-c6fc8e72cb60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44fc0d5602f04827bcb425a1d5ce46b2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:43.995609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6e5c4f60-c52d-4dd2-abe5-c6fc8e72cb60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44fc0d5602f04827bcb425a1d5ce46b2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:44.017735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896e0b8-5665-4015-abea-8f2c38012d0e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:44.019481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d896e0b8-5665-4015-abea-8f2c38012d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:44.030645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6e5c4f60-c52d-4dd2-abe5-c6fc8e72cb60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44fc0d5602f04827bcb425a1d5ce46b2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:44.033226 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:44.036190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896e0b8-5665-4015-abea-8f2c38012d0e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:44.041912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf97c9d-2f88-421c-b83f-a6b85767d334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:44.042639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf97c9d-2f88-421c-b83f-a6b85767d334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:44.042921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf97c9d-2f88-421c-b83f-a6b85767d334 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:44.043239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf97c9d-2f88-421c-b83f-a6b85767d334 admin admin] PATH_INFO: `/v3/users/0b8d05dd9f474f199cd0e6225dd3d93d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:44.044873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf97c9d-2f88-421c-b83f-a6b85767d334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b8d05dd9f474f199cd0e6225dd3d93d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:44.046906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf97c9d-2f88-421c-b83f-a6b85767d334 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:44.050465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6e5c4f60-c52d-4dd2-abe5-c6fc8e72cb60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44fc0d5602f04827bcb425a1d5ce46b2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:44.062590 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1407/2841] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:47:43 2022] DELETE /identity/v3/users/44fc0d5602f04827bcb425a1d5ce46b2 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:44.115974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cdf97c9d-2f88-421c-b83f-a6b85767d334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b8d05dd9f474f199cd0e6225dd3d93d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:44.118508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cdf97c9d-2f88-421c-b83f-a6b85767d334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b8d05dd9f474f199cd0e6225dd3d93d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:44.133160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cdf97c9d-2f88-421c-b83f-a6b85767d334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b8d05dd9f474f199cd0e6225dd3d93d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:44.157154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cdf97c9d-2f88-421c-b83f-a6b85767d334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b8d05dd9f474f199cd0e6225dd3d93d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:44.167073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cdf97c9d-2f88-421c-b83f-a6b85767d334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b8d05dd9f474f199cd0e6225dd3d93d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:44.179954 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1435/2842] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:47:44 2022] DELETE /identity/v3/users/0b8d05dd9f474f199cd0e6225dd3d93d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:44.183214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55b727-c563-4ac4-a396-ebd8e45d5682 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:44.183509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55b727-c563-4ac4-a396-ebd8e45d5682 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:44.184267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55b727-c563-4ac4-a396-ebd8e45d5682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:44.217690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6a55b727-c563-4ac4-a396-ebd8e45d5682 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:44.219166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6a55b727-c563-4ac4-a396-ebd8e45d5682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:44.284744 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1408/2843] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:44.291349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf97c9d-2f88-421c-b83f-a6b85767d334 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:44.294028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cdf97c9d-2f88-421c-b83f-a6b85767d334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:44.354956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf97c9d-2f88-421c-b83f-a6b85767d334 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:44.358844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb5e0f-8010-4c86-b4a7-802f1a8a5251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:44.359455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb5e0f-8010-4c86-b4a7-802f1a8a5251 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:44.359732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb5e0f-8010-4c86-b4a7-802f1a8a5251 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:44.359999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb5e0f-8010-4c86-b4a7-802f1a8a5251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:44.369207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb5e0f-8010-4c86-b4a7-802f1a8a5251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:44.371152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb5e0f-8010-4c86-b4a7-802f1a8a5251 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:44.381559 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1436/2844] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:47:44.382459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55b727-c563-4ac4-a396-ebd8e45d5682 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:44.384023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6a55b727-c563-4ac4-a396-ebd8e45d5682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:44.405828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55b727-c563-4ac4-a396-ebd8e45d5682 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:44.410999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8e1db-6ee1-4d2a-b460-7b1576541e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:44.411634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8e1db-6ee1-4d2a-b460-7b1576541e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:44.411915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8e1db-6ee1-4d2a-b460-7b1576541e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:44.412263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8e1db-6ee1-4d2a-b460-7b1576541e7c admin admin] PATH_INFO: `/v3/projects/30bf59b58ac64c57bb4d7d8c78bf9f4a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:44.413510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8e1db-6ee1-4d2a-b460-7b1576541e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=30bf59b58ac64c57bb4d7d8c78bf9f4a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:44.415327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8e1db-6ee1-4d2a-b460-7b1576541e7c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:44.466536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bba8e1db-6ee1-4d2a-b460-7b1576541e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30bf59b58ac64c57bb4d7d8c78bf9f4a', 'request_id': 'req-bba8e1db-6ee1-4d2a-b460-7b1576541e7c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:44.474128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bba8e1db-6ee1-4d2a-b460-7b1576541e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30bf59b58ac64c57bb4d7d8c78bf9f4a', 'request_id': 'req-bba8e1db-6ee1-4d2a-b460-7b1576541e7c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:44.480394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bba8e1db-6ee1-4d2a-b460-7b1576541e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30bf59b58ac64c57bb4d7d8c78bf9f4a', 'request_id': 'req-bba8e1db-6ee1-4d2a-b460-7b1576541e7c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:44.492632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bba8e1db-6ee1-4d2a-b460-7b1576541e7c admin admin] The token cache is being invalidate because project 30bf59b58ac64c57bb4d7d8c78bf9f4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:47:44.492930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bba8e1db-6ee1-4d2a-b460-7b1576541e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:44.493595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bba8e1db-6ee1-4d2a-b460-7b1576541e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:44.495107 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1409/2845] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:47:44 2022] DELETE /identity/v3/projects/30bf59b58ac64c57bb4d7d8c78bf9f4a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:47:44.501697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a906e-c86d-4f18-8f90-8abecea33cd3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:44.501994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a906e-c86d-4f18-8f90-8abecea33cd3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:44.502332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a906e-c86d-4f18-8f90-8abecea33cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:44.510218 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:44.524977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-921a906e-c86d-4f18-8f90-8abecea33cd3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:44.526196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-921a906e-c86d-4f18-8f90-8abecea33cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:44.593216 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1437/2846] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:44.601406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febee548-1d5b-4f56-b1fa-c848568360c8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:44.602045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febee548-1d5b-4f56-b1fa-c848568360c8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:44.602045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febee548-1d5b-4f56-b1fa-c848568360c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:44.624922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-febee548-1d5b-4f56-b1fa-c848568360c8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:44.626229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-febee548-1d5b-4f56-b1fa-c848568360c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:44.635540 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1410/2847] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:44.640093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a906e-c86d-4f18-8f90-8abecea33cd3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:44.663650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a906e-c86d-4f18-8f90-8abecea33cd3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:44.669976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234a5be-bc85-4cab-8c76-9691c132a7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:44.670624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234a5be-bc85-4cab-8c76-9691c132a7af admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:44.670918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234a5be-bc85-4cab-8c76-9691c132a7af admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:44.671172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234a5be-bc85-4cab-8c76-9691c132a7af admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:44.671811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234a5be-bc85-4cab-8c76-9691c132a7af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:47:44.672115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234a5be-bc85-4cab-8c76-9691c132a7af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:44.673857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234a5be-bc85-4cab-8c76-9691c132a7af admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:44.685497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febee548-1d5b-4f56-b1fa-c848568360c8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:44.687152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-febee548-1d5b-4f56-b1fa-c848568360c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:44.688692 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1438/2848] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:47:44.693449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234a5be-bc85-4cab-8c76-9691c132a7af admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:44.702260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febee548-1d5b-4f56-b1fa-c848568360c8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:44.704529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234a5be-bc85-4cab-8c76-9691c132a7af admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:44.707064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf12c5-c895-4ff2-ba57-d42552e768cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:44.707946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf12c5-c895-4ff2-ba57-d42552e768cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:44.708227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf12c5-c895-4ff2-ba57-d42552e768cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:44.708493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf12c5-c895-4ff2-ba57-d42552e768cb admin admin] PATH_INFO: `/v3/projects/66dc51df763a4cc887b81e815490997d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:44.709715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf12c5-c895-4ff2-ba57-d42552e768cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=66dc51df763a4cc887b81e815490997d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:44.710909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658974f-3b14-48a7-abe2-6e8fb3bb1ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:44.711600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf12c5-c895-4ff2-ba57-d42552e768cb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:44.711912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658974f-3b14-48a7-abe2-6e8fb3bb1ecd admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:44.712197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658974f-3b14-48a7-abe2-6e8fb3bb1ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:44.712458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658974f-3b14-48a7-abe2-6e8fb3bb1ecd admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:44.713220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658974f-3b14-48a7-abe2-6e8fb3bb1ecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:44.715661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658974f-3b14-48a7-abe2-6e8fb3bb1ecd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:44.744292 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1439/2849] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:47:44 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:47:44.748740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658974f-3b14-48a7-abe2-6e8fb3bb1ecd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:44.765738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dabf12c5-c895-4ff2-ba57-d42552e768cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66dc51df763a4cc887b81e815490997d', 'request_id': 'req-dabf12c5-c895-4ff2-ba57-d42552e768cb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:44.777512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dabf12c5-c895-4ff2-ba57-d42552e768cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66dc51df763a4cc887b81e815490997d', 'request_id': 'req-dabf12c5-c895-4ff2-ba57-d42552e768cb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:44.783744 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:44.788157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dabf12c5-c895-4ff2-ba57-d42552e768cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66dc51df763a4cc887b81e815490997d', 'request_id': 'req-dabf12c5-c895-4ff2-ba57-d42552e768cb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:44.802006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dabf12c5-c895-4ff2-ba57-d42552e768cb admin admin] The token cache is being invalidate because project 66dc51df763a4cc887b81e815490997d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:47:44.803160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dabf12c5-c895-4ff2-ba57-d42552e768cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:44.803732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dabf12c5-c895-4ff2-ba57-d42552e768cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:44.805402 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1411/2850] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:47:44 2022] DELETE /identity/v3/projects/66dc51df763a4cc887b81e815490997d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:44.809491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf12c5-c895-4ff2-ba57-d42552e768cb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:44.811030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dabf12c5-c895-4ff2-ba57-d42552e768cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:44.828333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658974f-3b14-48a7-abe2-6e8fb3bb1ecd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:44.892321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639c25a-ac06-4dab-b157-27813b3d841e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:44.892543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf12c5-c895-4ff2-ba57-d42552e768cb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:44.892996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639c25a-ac06-4dab-b157-27813b3d841e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:44.893271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639c25a-ac06-4dab-b157-27813b3d841e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:44.893540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639c25a-ac06-4dab-b157-27813b3d841e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:44.894247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639c25a-ac06-4dab-b157-27813b3d841e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:44.896101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639c25a-ac06-4dab-b157-27813b3d841e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:44.897662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3ff3b-71a0-4a78-b86d-1440cd7124a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:44.898360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3ff3b-71a0-4a78-b86d-1440cd7124a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:44.898702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3ff3b-71a0-4a78-b86d-1440cd7124a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:44.899042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3ff3b-71a0-4a78-b86d-1440cd7124a4 admin admin] PATH_INFO: `/v3/users/ac4adc65f78842ad8be1a630496e46be` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:44.900440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3ff3b-71a0-4a78-b86d-1440cd7124a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac4adc65f78842ad8be1a630496e46be)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:44.902535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3ff3b-71a0-4a78-b86d-1440cd7124a4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:44.928326 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1440/2851] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:47:44 2022] POST /identity/v3/users => generated 300 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:47:44.934817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639c25a-ac06-4dab-b157-27813b3d841e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:44.936633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2639c25a-ac06-4dab-b157-27813b3d841e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:44.946093 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:44.951913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639c25a-ac06-4dab-b157-27813b3d841e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:44.961987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599edf07-21f0-49e9-8a53-8b84d0973d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:44.962611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599edf07-21f0-49e9-8a53-8b84d0973d9c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:44.964508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599edf07-21f0-49e9-8a53-8b84d0973d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:44.964816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599edf07-21f0-49e9-8a53-8b84d0973d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:44.965568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599edf07-21f0-49e9-8a53-8b84d0973d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:44.967150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599edf07-21f0-49e9-8a53-8b84d0973d9c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:44.980905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-77e3ff3b-71a0-4a78-b86d-1440cd7124a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac4adc65f78842ad8be1a630496e46be'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:44.985331 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1441/2852] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:47:44.998621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599edf07-21f0-49e9-8a53-8b84d0973d9c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:45.003474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-77e3ff3b-71a0-4a78-b86d-1440cd7124a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac4adc65f78842ad8be1a630496e46be'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:45.008525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-77e3ff3b-71a0-4a78-b86d-1440cd7124a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac4adc65f78842ad8be1a630496e46be'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:45.012145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599edf07-21f0-49e9-8a53-8b84d0973d9c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:45.019380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f2f5a-eee2-4276-9b98-ed28d287b945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:45.019970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f2f5a-eee2-4276-9b98-ed28d287b945 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:45.020075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f2f5a-eee2-4276-9b98-ed28d287b945 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:45.020285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f2f5a-eee2-4276-9b98-ed28d287b945 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:45.020976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f2f5a-eee2-4276-9b98-ed28d287b945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:45.022717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f2f5a-eee2-4276-9b98-ed28d287b945 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:45.028933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-77e3ff3b-71a0-4a78-b86d-1440cd7124a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac4adc65f78842ad8be1a630496e46be'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:45.035271 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1442/2853] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:47:45.037408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-77e3ff3b-71a0-4a78-b86d-1440cd7124a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac4adc65f78842ad8be1a630496e46be'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:45.039238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f2f5a-eee2-4276-9b98-ed28d287b945 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:45.041071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5f6f2f5a-eee2-4276-9b98-ed28d287b945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:45.046097 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1412/2854] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:47:44 2022] DELETE /identity/v3/users/ac4adc65f78842ad8be1a630496e46be => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:47:45.055705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f2f5a-eee2-4276-9b98-ed28d287b945 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:45.116545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fc250-0b56-4868-a85b-7a541511c298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:45.117331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fc250-0b56-4868-a85b-7a541511c298 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:45.117608 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fc250-0b56-4868-a85b-7a541511c298 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:45.117878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fc250-0b56-4868-a85b-7a541511c298 admin admin] PATH_INFO: `/v3/projects/88b07115475c40b7b0a90812dd28a21d/users/df6d32e2f49c48a6a8778c0d7e9f8c5e/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:45.133429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fc250-0b56-4868-a85b-7a541511c298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b07115475c40b7b0a90812dd28a21d, user_id=df6d32e2f49c48a6a8778c0d7e9f8c5e, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:45.136760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fc250-0b56-4868-a85b-7a541511c298 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:45.150027 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1443/2855] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:47:45 2022] PUT /identity/v3/projects/88b07115475c40b7b0a90812dd28a21d/users/df6d32e2f49c48a6a8778c0d7e9f8c5e/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:47:45.155907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50e35b-35db-4055-9dec-4fe7a4906124 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:45.156240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50e35b-35db-4055-9dec-4fe7a4906124 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:45.156516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50e35b-35db-4055-9dec-4fe7a4906124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:45.176460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ba50e35b-35db-4055-9dec-4fe7a4906124 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:45.177726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ba50e35b-35db-4055-9dec-4fe7a4906124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:45.262079 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1413/2856] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:45.271343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fc250-0b56-4868-a85b-7a541511c298 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:45.273281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-251fc250-0b56-4868-a85b-7a541511c298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:45.345440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fc250-0b56-4868-a85b-7a541511c298 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:45.349983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55072ca0-1083-4220-8387-26dab55e5fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:45.350254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55072ca0-1083-4220-8387-26dab55e5fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:45.350508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55072ca0-1083-4220-8387-26dab55e5fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:45.350781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55072ca0-1083-4220-8387-26dab55e5fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:45.362256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55072ca0-1083-4220-8387-26dab55e5fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:45.365420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55072ca0-1083-4220-8387-26dab55e5fa7 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:45.377269 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1444/2857] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:47:45.443623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50e35b-35db-4055-9dec-4fe7a4906124 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:45.445501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ba50e35b-35db-4055-9dec-4fe7a4906124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:45.468840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50e35b-35db-4055-9dec-4fe7a4906124 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:45.477806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ae006-5c6b-49c5-b173-df1e3d4547f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:45.478526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ae006-5c6b-49c5-b173-df1e3d4547f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:45.479101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ae006-5c6b-49c5-b173-df1e3d4547f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:45.480069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ae006-5c6b-49c5-b173-df1e3d4547f9 admin admin] PATH_INFO: `/v3/projects/d2ee75b06bfd498aa9d432b4d8ddd7a4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:45.481849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ae006-5c6b-49c5-b173-df1e3d4547f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2ee75b06bfd498aa9d432b4d8ddd7a4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:45.484217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ae006-5c6b-49c5-b173-df1e3d4547f9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:45.487123 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:45.576051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-540ae006-5c6b-49c5-b173-df1e3d4547f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2ee75b06bfd498aa9d432b4d8ddd7a4', 'request_id': 'req-540ae006-5c6b-49c5-b173-df1e3d4547f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:45.585933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-540ae006-5c6b-49c5-b173-df1e3d4547f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2ee75b06bfd498aa9d432b4d8ddd7a4', 'request_id': 'req-540ae006-5c6b-49c5-b173-df1e3d4547f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:45.595723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-540ae006-5c6b-49c5-b173-df1e3d4547f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2ee75b06bfd498aa9d432b4d8ddd7a4', 'request_id': 'req-540ae006-5c6b-49c5-b173-df1e3d4547f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:45.612851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-540ae006-5c6b-49c5-b173-df1e3d4547f9 admin admin] The token cache is being invalidate because project d2ee75b06bfd498aa9d432b4d8ddd7a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:47:45.613232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-540ae006-5c6b-49c5-b173-df1e3d4547f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:45.614134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-540ae006-5c6b-49c5-b173-df1e3d4547f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:45.619525 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1414/2858] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:47:45 2022] DELETE /identity/v3/projects/d2ee75b06bfd498aa9d432b4d8ddd7a4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:45.621313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28ea25-cccb-4348-be75-07f1884b15c9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:45.621599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28ea25-cccb-4348-be75-07f1884b15c9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:45.621893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28ea25-cccb-4348-be75-07f1884b15c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:45.646279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ce28ea25-cccb-4348-be75-07f1884b15c9 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:45.647793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ce28ea25-cccb-4348-be75-07f1884b15c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:45.766251 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1445/2859] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:45.773567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a834282-0ac1-4cd0-b81c-c127d9be4993 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:45.773751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a834282-0ac1-4cd0-b81c-c127d9be4993 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:45.774001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a834282-0ac1-4cd0-b81c-c127d9be4993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:45.822223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1a834282-0ac1-4cd0-b81c-c127d9be4993 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:45.824670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1a834282-0ac1-4cd0-b81c-c127d9be4993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:45.835027 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1415/2860] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:45.840731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28ea25-cccb-4348-be75-07f1884b15c9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:45.852046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28ea25-cccb-4348-be75-07f1884b15c9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:45.858230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb7ce9-ef6b-4a15-b75d-e38b92aa2bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:45.859056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb7ce9-ef6b-4a15-b75d-e38b92aa2bdd admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:45.860715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb7ce9-ef6b-4a15-b75d-e38b92aa2bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:45.861165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb7ce9-ef6b-4a15-b75d-e38b92aa2bdd admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:45.862222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb7ce9-ef6b-4a15-b75d-e38b92aa2bdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:47:45.862769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb7ce9-ef6b-4a15-b75d-e38b92aa2bdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:45.864936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb7ce9-ef6b-4a15-b75d-e38b92aa2bdd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:45.867902 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:45.882888 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1446/2861] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:47:45.887587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a834282-0ac1-4cd0-b81c-c127d9be4993 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:45.907854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a834282-0ac1-4cd0-b81c-c127d9be4993 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:45.922495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e4691-bdb9-4756-8792-d8e4324b41cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:45.923048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e4691-bdb9-4756-8792-d8e4324b41cd admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:45.923325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e4691-bdb9-4756-8792-d8e4324b41cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:45.923597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e4691-bdb9-4756-8792-d8e4324b41cd admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:45.924282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e4691-bdb9-4756-8792-d8e4324b41cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:45.926156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e4691-bdb9-4756-8792-d8e4324b41cd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:45.979018 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1416/2862] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:47:45 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:47:45.981472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb7ce9-ef6b-4a15-b75d-e38b92aa2bdd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:46.007200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb7ce9-ef6b-4a15-b75d-e38b92aa2bdd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:46.165648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b7c02-77ba-4735-981e-3da6e4c3a607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:46.168322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b7c02-77ba-4735-981e-3da6e4c3a607 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:46.169954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b7c02-77ba-4735-981e-3da6e4c3a607 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:46.170252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b7c02-77ba-4735-981e-3da6e4c3a607 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:46.173117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b7c02-77ba-4735-981e-3da6e4c3a607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:46.177007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b7c02-77ba-4735-981e-3da6e4c3a607 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:46.234743 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1447/2863] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:47:45 2022] POST /identity/v3/users => generated 290 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:47:46.239182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e4691-bdb9-4756-8792-d8e4324b41cd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:46.256490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e4691-bdb9-4756-8792-d8e4324b41cd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:46.274063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da0224-4d74-4955-b45d-d3271d826542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:46.274945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da0224-4d74-4955-b45d-d3271d826542 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:46.275158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da0224-4d74-4955-b45d-d3271d826542 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:46.276862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da0224-4d74-4955-b45d-d3271d826542 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:46.278713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da0224-4d74-4955-b45d-d3271d826542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:46.282511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da0224-4d74-4955-b45d-d3271d826542 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:46.309439 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1417/2864] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:47:46.312625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b7c02-77ba-4735-981e-3da6e4c3a607 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:46.326198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b7c02-77ba-4735-981e-3da6e4c3a607 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:46.336174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba39db-22a9-4b23-be44-8de88f88c96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:46.337525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba39db-22a9-4b23-be44-8de88f88c96f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:46.337857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba39db-22a9-4b23-be44-8de88f88c96f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:46.340778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba39db-22a9-4b23-be44-8de88f88c96f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:46.341472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba39db-22a9-4b23-be44-8de88f88c96f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:46.345887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba39db-22a9-4b23-be44-8de88f88c96f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:46.372043 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1448/2865] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:47:46.376333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da0224-4d74-4955-b45d-d3271d826542 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:46.389845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da0224-4d74-4955-b45d-d3271d826542 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:46.396526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77287fee-ac3f-4842-9bd8-bb891a404d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:46.397354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77287fee-ac3f-4842-9bd8-bb891a404d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:46.397713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77287fee-ac3f-4842-9bd8-bb891a404d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:46.398240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77287fee-ac3f-4842-9bd8-bb891a404d9b admin admin] PATH_INFO: `/v3/projects/3f35436d476d4c72990abf1f1abb1939/users/760f7073c79049638b3482ca0f2b1b3e/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:46.418746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77287fee-ac3f-4842-9bd8-bb891a404d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f35436d476d4c72990abf1f1abb1939, user_id=760f7073c79049638b3482ca0f2b1b3e, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:46.422043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77287fee-ac3f-4842-9bd8-bb891a404d9b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:46.453051 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1418/2866] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:47:46 2022] PUT /identity/v3/projects/3f35436d476d4c72990abf1f1abb1939/users/760f7073c79049638b3482ca0f2b1b3e/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:47:46.531753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d84eda-f4e1-4a22-9679-3e4fa09b6236 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:46.531883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d84eda-f4e1-4a22-9679-3e4fa09b6236 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:46.532112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d84eda-f4e1-4a22-9679-3e4fa09b6236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:46.588062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-33d84eda-f4e1-4a22-9679-3e4fa09b6236 None None] MFA Rules not processed for user `760f7073c79049638b3482ca0f2b1b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:46.599623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-33d84eda-f4e1-4a22-9679-3e4fa09b6236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:46.719777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77287fee-ac3f-4842-9bd8-bb891a404d9b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:46.720211 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1449/2867] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:46.831601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77287fee-ac3f-4842-9bd8-bb891a404d9b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:46.840797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076b805-1cfb-4ae6-9ee4-799dc8898e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:46.841534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076b805-1cfb-4ae6-9ee4-799dc8898e29 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:46.848020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076b805-1cfb-4ae6-9ee4-799dc8898e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:46.852722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076b805-1cfb-4ae6-9ee4-799dc8898e29 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:46.853491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076b805-1cfb-4ae6-9ee4-799dc8898e29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:46.856231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076b805-1cfb-4ae6-9ee4-799dc8898e29 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:46.889894 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1419/2868] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:47:46 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:47:46.894157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d84eda-f4e1-4a22-9679-3e4fa09b6236 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:46.907052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d84eda-f4e1-4a22-9679-3e4fa09b6236 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:46.995456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250cc34-9d6e-497d-81c3-b66d7abb8886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:46.995841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250cc34-9d6e-497d-81c3-b66d7abb8886 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:46.996124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250cc34-9d6e-497d-81c3-b66d7abb8886 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:46.996403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250cc34-9d6e-497d-81c3-b66d7abb8886 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:46.997052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250cc34-9d6e-497d-81c3-b66d7abb8886 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:47.006673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250cc34-9d6e-497d-81c3-b66d7abb8886 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:47.021791 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:47.036215 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1450/2869] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:47:46 2022] POST /identity/v3/users => generated 296 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:47:47.040511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076b805-1cfb-4ae6-9ee4-799dc8898e29 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:47.066198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076b805-1cfb-4ae6-9ee4-799dc8898e29 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:47.070904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec18b9-0781-4713-a462-109d142fe4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:47.071314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec18b9-0781-4713-a462-109d142fe4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:47.072098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec18b9-0781-4713-a462-109d142fe4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:47.072098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec18b9-0781-4713-a462-109d142fe4b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:47.072627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec18b9-0781-4713-a462-109d142fe4b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:47.074850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec18b9-0781-4713-a462-109d142fe4b5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:47.089478 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1420/2870] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:47:47.090651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250cc34-9d6e-497d-81c3-b66d7abb8886 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:47.100964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250cc34-9d6e-497d-81c3-b66d7abb8886 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:47.106399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ed326-db7c-4975-bf0c-b5f377f3a27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:47.107133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ed326-db7c-4975-bf0c-b5f377f3a27f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:47.107472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ed326-db7c-4975-bf0c-b5f377f3a27f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:47.107811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ed326-db7c-4975-bf0c-b5f377f3a27f admin admin] PATH_INFO: `/v3/projects/0119a83d56ee4557957dafb1817503ce/users/2c505d35e5284c9cbd4e98ab6c163bfb/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:47.136940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ed326-db7c-4975-bf0c-b5f377f3a27f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0119a83d56ee4557957dafb1817503ce, user_id=2c505d35e5284c9cbd4e98ab6c163bfb, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:47.139971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ed326-db7c-4975-bf0c-b5f377f3a27f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:47.158224 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1451/2871] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:47:47 2022] PUT /identity/v3/projects/0119a83d56ee4557957dafb1817503ce/users/2c505d35e5284c9cbd4e98ab6c163bfb/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:47:47.162477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec18b9-0781-4713-a462-109d142fe4b5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:47.173690 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:47.188632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec18b9-0781-4713-a462-109d142fe4b5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:47.300278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bcd2a-6dfa-4bb9-b15e-21f9f473c010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:47.300908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bcd2a-6dfa-4bb9-b15e-21f9f473c010 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:47.301186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bcd2a-6dfa-4bb9-b15e-21f9f473c010 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:47.302052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bcd2a-6dfa-4bb9-b15e-21f9f473c010 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:47.306069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7bcd2a-6dfa-4bb9-b15e-21f9f473c010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:47.307719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7bcd2a-6dfa-4bb9-b15e-21f9f473c010 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:47.323653 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1421/2872] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:47:47.328432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ed326-db7c-4975-bf0c-b5f377f3a27f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:47.346703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ed326-db7c-4975-bf0c-b5f377f3a27f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:47.371388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb442302-f0ff-4438-b1d3-277825ae3f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:47.373782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb442302-f0ff-4438-b1d3-277825ae3f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:47.374922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb442302-f0ff-4438-b1d3-277825ae3f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:47.375408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb442302-f0ff-4438-b1d3-277825ae3f0d admin admin] PATH_INFO: `/v3/projects/0119a83d56ee4557957dafb1817503ce/users/2c505d35e5284c9cbd4e98ab6c163bfb/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:47.378683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb442302-f0ff-4438-b1d3-277825ae3f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0119a83d56ee4557957dafb1817503ce, user_id=2c505d35e5284c9cbd4e98ab6c163bfb, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:47.382357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb442302-f0ff-4438-b1d3-277825ae3f0d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:47.404890 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1452/2873] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:47:47 2022] PUT /identity/v3/projects/0119a83d56ee4557957dafb1817503ce/users/2c505d35e5284c9cbd4e98ab6c163bfb/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:47:47.416581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851dc20-6727-429c-89c2-7d01d1318f94 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:47.417321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851dc20-6727-429c-89c2-7d01d1318f94 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:47.417940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851dc20-6727-429c-89c2-7d01d1318f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:47.466983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d851dc20-6727-429c-89c2-7d01d1318f94 None None] MFA Rules not processed for user `2c505d35e5284c9cbd4e98ab6c163bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:47.468285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d851dc20-6727-429c-89c2-7d01d1318f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:47.627058 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1422/2874] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:47.643456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb442302-f0ff-4438-b1d3-277825ae3f0d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:47.647514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cb442302-f0ff-4438-b1d3-277825ae3f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:47.863871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb442302-f0ff-4438-b1d3-277825ae3f0d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:47.872761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea8228-7732-4abb-9a55-bd0d6ba7975c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:47.873832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea8228-7732-4abb-9a55-bd0d6ba7975c service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:47.874338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea8228-7732-4abb-9a55-bd0d6ba7975c service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:47.874860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea8228-7732-4abb-9a55-bd0d6ba7975c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:47.886960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea8228-7732-4abb-9a55-bd0d6ba7975c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:47.889611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea8228-7732-4abb-9a55-bd0d6ba7975c service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:47.901584 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1453/2875] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:47:47.979095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851dc20-6727-429c-89c2-7d01d1318f94 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:48.007016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851dc20-6727-429c-89c2-7d01d1318f94 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:48.036135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec538a74-af9c-4cca-9c15-8441b060b56a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:48.037229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec538a74-af9c-4cca-9c15-8441b060b56a service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:48.037566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec538a74-af9c-4cca-9c15-8441b060b56a service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:48.037839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec538a74-af9c-4cca-9c15-8441b060b56a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:48.045670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ec538a74-af9c-4cca-9c15-8441b060b56a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:48.184322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec538a74-af9c-4cca-9c15-8441b060b56a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:48.187911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec538a74-af9c-4cca-9c15-8441b060b56a service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:48.224328 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1423/2876] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:47:48.938365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea8228-7732-4abb-9a55-bd0d6ba7975c service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:49.119589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea8228-7732-4abb-9a55-bd0d6ba7975c service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:49.127087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e86ff6-0d8f-4b3d-8af3-f47f37aeac34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:49.127935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e86ff6-0d8f-4b3d-8af3-f47f37aeac34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:49.128376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e86ff6-0d8f-4b3d-8af3-f47f37aeac34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:49.128830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e86ff6-0d8f-4b3d-8af3-f47f37aeac34 admin admin] PATH_INFO: `/v3/users/760f7073c79049638b3482ca0f2b1b3e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:49.131226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e86ff6-0d8f-4b3d-8af3-f47f37aeac34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=760f7073c79049638b3482ca0f2b1b3e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:49.134355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e86ff6-0d8f-4b3d-8af3-f47f37aeac34 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:49.248155 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=3,keystone:SELECT=91,keystone:DELETE=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:49.253584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-88e86ff6-0d8f-4b3d-8af3-f47f37aeac34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '760f7073c79049638b3482ca0f2b1b3e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:49.254585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-88e86ff6-0d8f-4b3d-8af3-f47f37aeac34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '760f7073c79049638b3482ca0f2b1b3e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:49.272524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-88e86ff6-0d8f-4b3d-8af3-f47f37aeac34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '760f7073c79049638b3482ca0f2b1b3e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:49.296560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-88e86ff6-0d8f-4b3d-8af3-f47f37aeac34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '760f7073c79049638b3482ca0f2b1b3e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:49.318147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-88e86ff6-0d8f-4b3d-8af3-f47f37aeac34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '760f7073c79049638b3482ca0f2b1b3e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:49.332642 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1454/2877] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:47:48 2022] DELETE /identity/v3/users/760f7073c79049638b3482ca0f2b1b3e => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:49.335906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece568c-602a-44a4-8574-42f256c36194 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:49.336769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece568c-602a-44a4-8574-42f256c36194 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:49.337347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece568c-602a-44a4-8574-42f256c36194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:49.373098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2ece568c-602a-44a4-8574-42f256c36194 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:49.374560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2ece568c-602a-44a4-8574-42f256c36194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:49.400059 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:49.462936 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1424/2878] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:49.482421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e86ff6-0d8f-4b3d-8af3-f47f37aeac34 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:49.483968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-88e86ff6-0d8f-4b3d-8af3-f47f37aeac34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:49.633778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e86ff6-0d8f-4b3d-8af3-f47f37aeac34 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:49.642492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f4600-fe42-4963-8ec5-1807cf9c8003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:49.643129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f4600-fe42-4963-8ec5-1807cf9c8003 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:49.643402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f4600-fe42-4963-8ec5-1807cf9c8003 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:49.643673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f4600-fe42-4963-8ec5-1807cf9c8003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:49.671118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f4600-fe42-4963-8ec5-1807cf9c8003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:49.675825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f4600-fe42-4963-8ec5-1807cf9c8003 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:49.706243 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1455/2879] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:47:51.452113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b31dac-8dfa-49a9-a32f-8f0ec01b57de None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:51.452859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b31dac-8dfa-49a9-a32f-8f0ec01b57de None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:51.452859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b31dac-8dfa-49a9-a32f-8f0ec01b57de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:51.505840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b0b31dac-8dfa-49a9-a32f-8f0ec01b57de None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:51.508672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b0b31dac-8dfa-49a9-a32f-8f0ec01b57de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:51.723333 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1425/2880] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:47:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:51.768723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f4600-fe42-4963-8ec5-1807cf9c8003 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:51.770596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cd9f4600-fe42-4963-8ec5-1807cf9c8003 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:51.868082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f4600-fe42-4963-8ec5-1807cf9c8003 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:51.875222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988bbc7-350a-4814-8588-c7faf120173a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:51.875861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988bbc7-350a-4814-8588-c7faf120173a service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:51.876902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988bbc7-350a-4814-8588-c7faf120173a service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:51.877201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988bbc7-350a-4814-8588-c7faf120173a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:51.891707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988bbc7-350a-4814-8588-c7faf120173a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:51.896278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988bbc7-350a-4814-8588-c7faf120173a service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:51.943431 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1456/2881] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:47:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:47:52.067468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b31dac-8dfa-49a9-a32f-8f0ec01b57de None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:52.069326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b0b31dac-8dfa-49a9-a32f-8f0ec01b57de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:52.097242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b31dac-8dfa-49a9-a32f-8f0ec01b57de None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:52.118809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4407f53-ded4-4b01-ad95-5f0cb3c91875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:52.120184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4407f53-ded4-4b01-ad95-5f0cb3c91875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:52.121138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4407f53-ded4-4b01-ad95-5f0cb3c91875 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:52.121575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4407f53-ded4-4b01-ad95-5f0cb3c91875 admin admin] PATH_INFO: `/v3/projects/3f35436d476d4c72990abf1f1abb1939` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:52.126545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4407f53-ded4-4b01-ad95-5f0cb3c91875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f35436d476d4c72990abf1f1abb1939)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:52.129050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4407f53-ded4-4b01-ad95-5f0cb3c91875 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:52.253548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c4407f53-ded4-4b01-ad95-5f0cb3c91875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f35436d476d4c72990abf1f1abb1939', 'request_id': 'req-c4407f53-ded4-4b01-ad95-5f0cb3c91875'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:52.266534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c4407f53-ded4-4b01-ad95-5f0cb3c91875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f35436d476d4c72990abf1f1abb1939', 'request_id': 'req-c4407f53-ded4-4b01-ad95-5f0cb3c91875'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:52.276904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c4407f53-ded4-4b01-ad95-5f0cb3c91875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f35436d476d4c72990abf1f1abb1939', 'request_id': 'req-c4407f53-ded4-4b01-ad95-5f0cb3c91875'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:52.292307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c4407f53-ded4-4b01-ad95-5f0cb3c91875 admin admin] The token cache is being invalidate because project 3f35436d476d4c72990abf1f1abb1939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:47:52.292873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c4407f53-ded4-4b01-ad95-5f0cb3c91875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:52.293689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c4407f53-ded4-4b01-ad95-5f0cb3c91875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:52.295747 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1426/2882] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:47:52 2022] DELETE /identity/v3/projects/3f35436d476d4c72990abf1f1abb1939 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:52.299900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988bbc7-350a-4814-8588-c7faf120173a service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:52.321124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988bbc7-350a-4814-8588-c7faf120173a service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:52.460719 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:52.487977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced8734-5dec-467b-b074-53450256c3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:52.489038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced8734-5dec-467b-b074-53450256c3e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:52.489532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced8734-5dec-467b-b074-53450256c3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:52.490127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced8734-5dec-467b-b074-53450256c3e5 admin admin] PATH_INFO: `/v3/users/2c505d35e5284c9cbd4e98ab6c163bfb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:52.491772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced8734-5dec-467b-b074-53450256c3e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c505d35e5284c9cbd4e98ab6c163bfb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:52.494158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced8734-5dec-467b-b074-53450256c3e5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:52.631993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4407f53-ded4-4b01-ad95-5f0cb3c91875 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:52.635676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c4407f53-ded4-4b01-ad95-5f0cb3c91875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:52.653712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4ced8734-5dec-467b-b074-53450256c3e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c505d35e5284c9cbd4e98ab6c163bfb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:52.655359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4ced8734-5dec-467b-b074-53450256c3e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c505d35e5284c9cbd4e98ab6c163bfb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:52.667798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4ced8734-5dec-467b-b074-53450256c3e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c505d35e5284c9cbd4e98ab6c163bfb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:52.714138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4ced8734-5dec-467b-b074-53450256c3e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c505d35e5284c9cbd4e98ab6c163bfb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:52.738596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4ced8734-5dec-467b-b074-53450256c3e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c505d35e5284c9cbd4e98ab6c163bfb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:52.770634 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1457/2883] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:47:52 2022] DELETE /identity/v3/users/2c505d35e5284c9cbd4e98ab6c163bfb => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:52.789409 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:52.876978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4407f53-ded4-4b01-ad95-5f0cb3c91875 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:53.097738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee0d70-4e1d-4033-90fd-07f50da3a774 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:53.098934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee0d70-4e1d-4033-90fd-07f50da3a774 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:53.099536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee0d70-4e1d-4033-90fd-07f50da3a774 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:53.101996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee0d70-4e1d-4033-90fd-07f50da3a774 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:53.116288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3cee0d70-4e1d-4033-90fd-07f50da3a774 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:53.141697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee0d70-4e1d-4033-90fd-07f50da3a774 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:53.143498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee0d70-4e1d-4033-90fd-07f50da3a774 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:53.225728 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1427/2884] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:47:54.214868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced8734-5dec-467b-b074-53450256c3e5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:54.218317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4ced8734-5dec-467b-b074-53450256c3e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:54.397652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced8734-5dec-467b-b074-53450256c3e5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:54.405110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870629b9-5557-4675-be50-4c0ba0f57f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:54.405850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870629b9-5557-4675-be50-4c0ba0f57f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:54.406199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870629b9-5557-4675-be50-4c0ba0f57f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:54.406580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870629b9-5557-4675-be50-4c0ba0f57f87 admin admin] PATH_INFO: `/v3/projects/0119a83d56ee4557957dafb1817503ce` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:54.408247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870629b9-5557-4675-be50-4c0ba0f57f87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0119a83d56ee4557957dafb1817503ce)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:54.410889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870629b9-5557-4675-be50-4c0ba0f57f87 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:54.548910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-870629b9-5557-4675-be50-4c0ba0f57f87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0119a83d56ee4557957dafb1817503ce', 'request_id': 'req-870629b9-5557-4675-be50-4c0ba0f57f87'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:54.561846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-870629b9-5557-4675-be50-4c0ba0f57f87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0119a83d56ee4557957dafb1817503ce', 'request_id': 'req-870629b9-5557-4675-be50-4c0ba0f57f87'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:54.580881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-870629b9-5557-4675-be50-4c0ba0f57f87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0119a83d56ee4557957dafb1817503ce', 'request_id': 'req-870629b9-5557-4675-be50-4c0ba0f57f87'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:54.606291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-870629b9-5557-4675-be50-4c0ba0f57f87 admin admin] The token cache is being invalidate because project 0119a83d56ee4557957dafb1817503ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:47:54.606577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-870629b9-5557-4675-be50-4c0ba0f57f87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:54.607913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-870629b9-5557-4675-be50-4c0ba0f57f87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:47:54.613190 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1458/2885] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:47:54 2022] DELETE /identity/v3/projects/0119a83d56ee4557957dafb1817503ce => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:54.618279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab84a1-e95e-4ba0-8cdb-bd51afdccb1c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:54.618782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab84a1-e95e-4ba0-8cdb-bd51afdccb1c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:54.618867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab84a1-e95e-4ba0-8cdb-bd51afdccb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:54.701606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c2ab84a1-e95e-4ba0-8cdb-bd51afdccb1c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:54.710105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c2ab84a1-e95e-4ba0-8cdb-bd51afdccb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:54.962826 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1428/2886] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:54.971290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0147b-1928-4acb-8767-17e2bd308315 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:54.971580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0147b-1928-4acb-8767-17e2bd308315 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:54.971884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0147b-1928-4acb-8767-17e2bd308315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:54.987779 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:55.006341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-50b0147b-1928-4acb-8767-17e2bd308315 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:55.009278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-50b0147b-1928-4acb-8767-17e2bd308315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:55.032805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab84a1-e95e-4ba0-8cdb-bd51afdccb1c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:55.039348 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1459/2887] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:55.047136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab84a1-e95e-4ba0-8cdb-bd51afdccb1c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:55.070208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dab963-258e-49cd-847c-e5303522eca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:55.070847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dab963-258e-49cd-847c-e5303522eca6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:55.071113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dab963-258e-49cd-847c-e5303522eca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:55.071387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dab963-258e-49cd-847c-e5303522eca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:55.072188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dab963-258e-49cd-847c-e5303522eca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:47:55.072478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dab963-258e-49cd-847c-e5303522eca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:55.074675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dab963-258e-49cd-847c-e5303522eca6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:55.118117 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1429/2888] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:47:55.122550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0147b-1928-4acb-8767-17e2bd308315 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:55.136935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0147b-1928-4acb-8767-17e2bd308315 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:55.158608 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4152d-8847-4485-a045-196f70c2101c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:55.159241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4152d-8847-4485-a045-196f70c2101c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:55.159522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4152d-8847-4485-a045-196f70c2101c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:55.159798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4152d-8847-4485-a045-196f70c2101c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:55.160445 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4152d-8847-4485-a045-196f70c2101c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:55.162494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4152d-8847-4485-a045-196f70c2101c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:55.253692 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1460/2889] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:47:55 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:47:55.255873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dab963-258e-49cd-847c-e5303522eca6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:55.270528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dab963-258e-49cd-847c-e5303522eca6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:55.459567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d21ee-6036-4940-9ed1-6048c8a38eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:55.461029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d21ee-6036-4940-9ed1-6048c8a38eeb admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:55.461420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d21ee-6036-4940-9ed1-6048c8a38eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:55.461692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d21ee-6036-4940-9ed1-6048c8a38eeb admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:55.462334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d21ee-6036-4940-9ed1-6048c8a38eeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:55.464699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d21ee-6036-4940-9ed1-6048c8a38eeb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:55.493423 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:47:55.523394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4152d-8847-4485-a045-196f70c2101c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:55.525791 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1430/2890] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:47:55 2022] POST /identity/v3/users => generated 288 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:47:55.539551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4152d-8847-4485-a045-196f70c2101c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:55.548292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a92b5-7e67-42c7-8eba-3482efcd9db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:55.549096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a92b5-7e67-42c7-8eba-3482efcd9db1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:55.549342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a92b5-7e67-42c7-8eba-3482efcd9db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:55.549786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a92b5-7e67-42c7-8eba-3482efcd9db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:55.550624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a92b5-7e67-42c7-8eba-3482efcd9db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:55.556751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a92b5-7e67-42c7-8eba-3482efcd9db1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:55.593855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d21ee-6036-4940-9ed1-6048c8a38eeb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:55.601180 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1461/2891] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:47:55.615842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d21ee-6036-4940-9ed1-6048c8a38eeb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:55.630005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f656c27-700c-4f8f-9b89-6d92e531d854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:55.630859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f656c27-700c-4f8f-9b89-6d92e531d854 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:55.631149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f656c27-700c-4f8f-9b89-6d92e531d854 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:55.631415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f656c27-700c-4f8f-9b89-6d92e531d854 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:55.632093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f656c27-700c-4f8f-9b89-6d92e531d854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:55.637253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f656c27-700c-4f8f-9b89-6d92e531d854 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:55.671135 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1431/2892] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:47:55.672488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a92b5-7e67-42c7-8eba-3482efcd9db1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:55.706090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a92b5-7e67-42c7-8eba-3482efcd9db1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:55.734622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0d49f-e50b-41a3-a12c-2d0af39d126b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:55.735330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0d49f-e50b-41a3-a12c-2d0af39d126b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:55.735602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0d49f-e50b-41a3-a12c-2d0af39d126b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:55.735879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0d49f-e50b-41a3-a12c-2d0af39d126b admin admin] PATH_INFO: `/v3/projects/a63e4f22c26846348aac6e673d7b8ff3/users/25b6ed4eb7894a8da99f20eb19c8af50/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:55.786077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4795f-c324-4910-b3f8-e975b88c91d5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:55.786953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4795f-c324-4910-b3f8-e975b88c91d5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:55.787438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4795f-c324-4910-b3f8-e975b88c91d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:55.805174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0d49f-e50b-41a3-a12c-2d0af39d126b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63e4f22c26846348aac6e673d7b8ff3, user_id=25b6ed4eb7894a8da99f20eb19c8af50, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:55.810964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0d49f-e50b-41a3-a12c-2d0af39d126b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:55.842067 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1462/2893] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:47:55 2022] PUT /identity/v3/projects/a63e4f22c26846348aac6e673d7b8ff3/users/25b6ed4eb7894a8da99f20eb19c8af50/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:47:55.843611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc5719-3ed7-4ec2-b288-b5095c0c7352 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:55.843905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc5719-3ed7-4ec2-b288-b5095c0c7352 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:55.844187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc5719-3ed7-4ec2-b288-b5095c0c7352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:55.863391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7bb4795f-c324-4910-b3f8-e975b88c91d5 None None] MFA Rules not processed for user `df6d32e2f49c48a6a8778c0d7e9f8c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:55.869203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7bb4795f-c324-4910-b3f8-e975b88c91d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:55.893738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-94dc5719-3ed7-4ec2-b288-b5095c0c7352 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:47:55.894991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-94dc5719-3ed7-4ec2-b288-b5095c0c7352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:56.049998 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1463/2894] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:56.130698 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1432/2895] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:47:55 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:47:56.163894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc5719-3ed7-4ec2-b288-b5095c0c7352 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:56.165465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-94dc5719-3ed7-4ec2-b288-b5095c0c7352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:56.379560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc5719-3ed7-4ec2-b288-b5095c0c7352 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:56.394186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b769b-da26-4840-9bda-11bec10952ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:56.396729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4795f-c324-4910-b3f8-e975b88c91d5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:56.398866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7bb4795f-c324-4910-b3f8-e975b88c91d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:56.418579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b769b-da26-4840-9bda-11bec10952ba service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:56.418865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b769b-da26-4840-9bda-11bec10952ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:56.419148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b769b-da26-4840-9bda-11bec10952ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:56.462253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b769b-da26-4840-9bda-11bec10952ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:56.464658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b769b-da26-4840-9bda-11bec10952ba service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:56.506137 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1464/2896] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:47:56.656939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4795f-c324-4910-b3f8-e975b88c91d5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:56.673943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a3537-6ba2-4c8e-ba61-a8104e8145e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:56.674756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a3537-6ba2-4c8e-ba61-a8104e8145e1 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:56.675364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a3537-6ba2-4c8e-ba61-a8104e8145e1 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:56.675364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a3537-6ba2-4c8e-ba61-a8104e8145e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:56.709969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a3537-6ba2-4c8e-ba61-a8104e8145e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:56.711678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a3537-6ba2-4c8e-ba61-a8104e8145e1 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:56.763933 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1433/2897] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:56 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:47:57.121369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b769b-da26-4840-9bda-11bec10952ba service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:57.123873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e09b769b-da26-4840-9bda-11bec10952ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:57.151757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b769b-da26-4840-9bda-11bec10952ba service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:57.159966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cd309-75f3-418e-a880-0654ef8b40e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:57.160857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd309-75f3-418e-a880-0654ef8b40e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:57.161297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd309-75f3-418e-a880-0654ef8b40e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:57.161725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd309-75f3-418e-a880-0654ef8b40e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:57.166922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-997cd309-75f3-418e-a880-0654ef8b40e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:57.196300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cd309-75f3-418e-a880-0654ef8b40e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:57.198112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cd309-75f3-418e-a880-0654ef8b40e9 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:57.217443 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1465/2898] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:47:58.679894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a3537-6ba2-4c8e-ba61-a8104e8145e1 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:47:58.704900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a3537-6ba2-4c8e-ba61-a8104e8145e1 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:47:58.733488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014f1ce-a458-40b9-9f4a-dc9a5213ae6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:47:58.734319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014f1ce-a458-40b9-9f4a-dc9a5213ae6e service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:47:58.734787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014f1ce-a458-40b9-9f4a-dc9a5213ae6e service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:47:58.735215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014f1ce-a458-40b9-9f4a-dc9a5213ae6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:47:58.741494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b014f1ce-a458-40b9-9f4a-dc9a5213ae6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:47:58.783073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014f1ce-a458-40b9-9f4a-dc9a5213ae6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:47:58.798850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014f1ce-a458-40b9-9f4a-dc9a5213ae6e service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:47:58.840262 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1434/2899] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:47:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:03.355102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa775171-fa42-4bc1-8bd1-6f4a7b6647fa None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:03.356232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa775171-fa42-4bc1-8bd1-6f4a7b6647fa None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:03.356784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa775171-fa42-4bc1-8bd1-6f4a7b6647fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:03.413863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-aa775171-fa42-4bc1-8bd1-6f4a7b6647fa None None] MFA Rules not processed for user `5a076b2be9774abf8188efe4c2060dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:03.415579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-aa775171-fa42-4bc1-8bd1-6f4a7b6647fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:03.501265 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:03.661635 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1466/2900] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:03.674480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75088aa-b453-4ccf-8a8b-9292bc10c08e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:03.676079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75088aa-b453-4ccf-8a8b-9292bc10c08e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:03.676748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75088aa-b453-4ccf-8a8b-9292bc10c08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:03.689594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa775171-fa42-4bc1-8bd1-6f4a7b6647fa None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:03.709912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa775171-fa42-4bc1-8bd1-6f4a7b6647fa None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:03.720375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bc1d4-3867-4eef-8c23-4d57d570fe72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:03.721395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bc1d4-3867-4eef-8c23-4d57d570fe72 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:03.721786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bc1d4-3867-4eef-8c23-4d57d570fe72 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:03.722054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bc1d4-3867-4eef-8c23-4d57d570fe72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:03.734334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4f7bc1d4-3867-4eef-8c23-4d57d570fe72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:03.756327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c75088aa-b453-4ccf-8a8b-9292bc10c08e None None] MFA Rules not processed for user `5a076b2be9774abf8188efe4c2060dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:03.766120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c75088aa-b453-4ccf-8a8b-9292bc10c08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:03.773593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7bc1d4-3867-4eef-8c23-4d57d570fe72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:03.775036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7bc1d4-3867-4eef-8c23-4d57d570fe72 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:03.811836 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1467/2901] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:48:03.821118 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1435/2902] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:08.000096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bc1d4-3867-4eef-8c23-4d57d570fe72 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:08.001574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4f7bc1d4-3867-4eef-8c23-4d57d570fe72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:08.024806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bc1d4-3867-4eef-8c23-4d57d570fe72 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:08.038877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d133a5-1698-42e2-8ea3-acf9cbdd9570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:08.039531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d133a5-1698-42e2-8ea3-acf9cbdd9570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:08.039807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d133a5-1698-42e2-8ea3-acf9cbdd9570 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:08.040089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d133a5-1698-42e2-8ea3-acf9cbdd9570 admin admin] PATH_INFO: `/v3/users/df6d32e2f49c48a6a8778c0d7e9f8c5e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:08.047887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d133a5-1698-42e2-8ea3-acf9cbdd9570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df6d32e2f49c48a6a8778c0d7e9f8c5e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:08.050310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d133a5-1698-42e2-8ea3-acf9cbdd9570 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:08.140144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-21d133a5-1698-42e2-8ea3-acf9cbdd9570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df6d32e2f49c48a6a8778c0d7e9f8c5e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:08.140968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-21d133a5-1698-42e2-8ea3-acf9cbdd9570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df6d32e2f49c48a6a8778c0d7e9f8c5e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:08.162134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-21d133a5-1698-42e2-8ea3-acf9cbdd9570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df6d32e2f49c48a6a8778c0d7e9f8c5e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:08.192407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-21d133a5-1698-42e2-8ea3-acf9cbdd9570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df6d32e2f49c48a6a8778c0d7e9f8c5e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:08.200518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-21d133a5-1698-42e2-8ea3-acf9cbdd9570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df6d32e2f49c48a6a8778c0d7e9f8c5e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:08.226024 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1468/2903] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:48:07 2022] DELETE /identity/v3/users/df6d32e2f49c48a6a8778c0d7e9f8c5e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:48:08.585722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75088aa-b453-4ccf-8a8b-9292bc10c08e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:08.610937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75088aa-b453-4ccf-8a8b-9292bc10c08e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:08.677831 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:08.787154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7396a-9335-4c29-ac4e-cd2704aaf13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:08.791080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7396a-9335-4c29-ac4e-cd2704aaf13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:08.791080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7396a-9335-4c29-ac4e-cd2704aaf13b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:08.791080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7396a-9335-4c29-ac4e-cd2704aaf13b admin admin] PATH_INFO: `/v3/projects/88b07115475c40b7b0a90812dd28a21d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:08.802555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7396a-9335-4c29-ac4e-cd2704aaf13b admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b07115475c40b7b0a90812dd28a21d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:08.807073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7396a-9335-4c29-ac4e-cd2704aaf13b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:08.943102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36c7396a-9335-4c29-ac4e-cd2704aaf13b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b07115475c40b7b0a90812dd28a21d', 'request_id': 'req-36c7396a-9335-4c29-ac4e-cd2704aaf13b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:08.969041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36c7396a-9335-4c29-ac4e-cd2704aaf13b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b07115475c40b7b0a90812dd28a21d', 'request_id': 'req-36c7396a-9335-4c29-ac4e-cd2704aaf13b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:08.985608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36c7396a-9335-4c29-ac4e-cd2704aaf13b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b07115475c40b7b0a90812dd28a21d', 'request_id': 'req-36c7396a-9335-4c29-ac4e-cd2704aaf13b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:09.043078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36c7396a-9335-4c29-ac4e-cd2704aaf13b admin admin] The token cache is being invalidate because project 88b07115475c40b7b0a90812dd28a21d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:48:09.043558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36c7396a-9335-4c29-ac4e-cd2704aaf13b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:09.047259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36c7396a-9335-4c29-ac4e-cd2704aaf13b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:09.053792 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1436/2904] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:48:08 2022] DELETE /identity/v3/projects/88b07115475c40b7b0a90812dd28a21d => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:48:09.059090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e768a3-1aa8-40d2-8e23-9f15ec35d3ec None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:09.059581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e768a3-1aa8-40d2-8e23-9f15ec35d3ec None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:09.059713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e768a3-1aa8-40d2-8e23-9f15ec35d3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:09.098329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-41e768a3-1aa8-40d2-8e23-9f15ec35d3ec None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:09.099576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-41e768a3-1aa8-40d2-8e23-9f15ec35d3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:09.279366 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1469/2905] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:09.288229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78fb5f-8107-494f-b61b-305af02527f0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:09.288545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78fb5f-8107-494f-b61b-305af02527f0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:09.288903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78fb5f-8107-494f-b61b-305af02527f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:09.336236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3e78fb5f-8107-494f-b61b-305af02527f0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:09.337645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3e78fb5f-8107-494f-b61b-305af02527f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:09.358259 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1437/2906] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:09.362670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e768a3-1aa8-40d2-8e23-9f15ec35d3ec None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:09.381910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e768a3-1aa8-40d2-8e23-9f15ec35d3ec None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:09.395997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f4319-f122-4f26-8d13-7cb480fa3159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:09.396631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f4319-f122-4f26-8d13-7cb480fa3159 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:09.396906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f4319-f122-4f26-8d13-7cb480fa3159 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:09.397195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f4319-f122-4f26-8d13-7cb480fa3159 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:09.397829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f4319-f122-4f26-8d13-7cb480fa3159 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:48:09.398129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f4319-f122-4f26-8d13-7cb480fa3159 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:09.399712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f4319-f122-4f26-8d13-7cb480fa3159 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:09.426287 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1470/2907] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:48:09.430531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78fb5f-8107-494f-b61b-305af02527f0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:09.454388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78fb5f-8107-494f-b61b-305af02527f0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:09.461850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e4059-71a1-4b58-a9e4-7c72c0a75121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:09.463778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e4059-71a1-4b58-a9e4-7c72c0a75121 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:09.464227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e4059-71a1-4b58-a9e4-7c72c0a75121 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:09.464698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e4059-71a1-4b58-a9e4-7c72c0a75121 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:09.466597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e4059-71a1-4b58-a9e4-7c72c0a75121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:09.469558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e4059-71a1-4b58-a9e4-7c72c0a75121 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:09.524245 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1438/2908] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:48:09 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:48:09.529187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f4319-f122-4f26-8d13-7cb480fa3159 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:09.539859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f4319-f122-4f26-8d13-7cb480fa3159 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:09.586819 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:09.667944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9a80e-005d-450e-896e-f0e9d044d107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:09.668676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9a80e-005d-450e-896e-f0e9d044d107 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:09.668964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9a80e-005d-450e-896e-f0e9d044d107 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:09.670454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9a80e-005d-450e-896e-f0e9d044d107 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:09.671179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9a80e-005d-450e-896e-f0e9d044d107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:09.674293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9a80e-005d-450e-896e-f0e9d044d107 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:09.709119 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1471/2909] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:48:09 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:48:09.713889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e4059-71a1-4b58-a9e4-7c72c0a75121 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:09.725931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e4059-71a1-4b58-a9e4-7c72c0a75121 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:09.733204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084ea9c-dd5a-4c9a-9afe-a10ccc126d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:09.734099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084ea9c-dd5a-4c9a-9afe-a10ccc126d05 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:09.734639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084ea9c-dd5a-4c9a-9afe-a10ccc126d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:09.735138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084ea9c-dd5a-4c9a-9afe-a10ccc126d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:09.736101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084ea9c-dd5a-4c9a-9afe-a10ccc126d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:09.738882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084ea9c-dd5a-4c9a-9afe-a10ccc126d05 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:09.754196 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1439/2910] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:48:09.758334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9a80e-005d-450e-896e-f0e9d044d107 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:09.774328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9a80e-005d-450e-896e-f0e9d044d107 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:09.783600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d319a-1e47-474c-ac78-217031b04acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:09.784756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d319a-1e47-474c-ac78-217031b04acf admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:09.785448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d319a-1e47-474c-ac78-217031b04acf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:09.785969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d319a-1e47-474c-ac78-217031b04acf admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:09.786834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d319a-1e47-474c-ac78-217031b04acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:09.788916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d319a-1e47-474c-ac78-217031b04acf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:09.805513 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1472/2911] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:48:09.811315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084ea9c-dd5a-4c9a-9afe-a10ccc126d05 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:09.839610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084ea9c-dd5a-4c9a-9afe-a10ccc126d05 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:09.853724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205998f-da41-4581-85a9-9a07c0a8e46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:09.855523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205998f-da41-4581-85a9-9a07c0a8e46c admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:09.856073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205998f-da41-4581-85a9-9a07c0a8e46c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:09.856818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205998f-da41-4581-85a9-9a07c0a8e46c admin admin] PATH_INFO: `/v3/projects/064db7c919624508be7e6b87e78e9213/users/c181218ac3f34e0cb5863b58aef66a9f/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:09.886542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205998f-da41-4581-85a9-9a07c0a8e46c admin admin] RBAC: Authorizing `identity:create_grant(project_id=064db7c919624508be7e6b87e78e9213, user_id=c181218ac3f34e0cb5863b58aef66a9f, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:09.891918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205998f-da41-4581-85a9-9a07c0a8e46c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:09.928309 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1440/2912] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:48:09 2022] PUT /identity/v3/projects/064db7c919624508be7e6b87e78e9213/users/c181218ac3f34e0cb5863b58aef66a9f/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:48:09.939397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073eb332-6ba5-4cf0-a822-25c053028f45 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:09.939922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073eb332-6ba5-4cf0-a822-25c053028f45 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:09.940298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073eb332-6ba5-4cf0-a822-25c053028f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:10.039428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-073eb332-6ba5-4cf0-a822-25c053028f45 None None] MFA Rules not processed for user `c181218ac3f34e0cb5863b58aef66a9f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:10.042385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-073eb332-6ba5-4cf0-a822-25c053028f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:10.221625 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1473/2913] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:10.237490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205998f-da41-4581-85a9-9a07c0a8e46c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:10.239270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4205998f-da41-4581-85a9-9a07c0a8e46c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:10.370976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205998f-da41-4581-85a9-9a07c0a8e46c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:10.385642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c824d3-79c7-4565-909c-0b787346571c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:10.386431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c824d3-79c7-4565-909c-0b787346571c service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:10.386776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c824d3-79c7-4565-909c-0b787346571c service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:10.387114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c824d3-79c7-4565-909c-0b787346571c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:10.406853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c824d3-79c7-4565-909c-0b787346571c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:10.408403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c824d3-79c7-4565-909c-0b787346571c service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:10.443167 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1441/2914] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:10.713571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc23ef-4e8b-4b72-ae2b-e0245e37cfdf None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:10.713960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc23ef-4e8b-4b72-ae2b-e0245e37cfdf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:10.714114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc23ef-4e8b-4b72-ae2b-e0245e37cfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:10.747221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e4bc23ef-4e8b-4b72-ae2b-e0245e37cfdf None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:10.748653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e4bc23ef-4e8b-4b72-ae2b-e0245e37cfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:10.825921 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1474/2915] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:48:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:10.851566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c824d3-79c7-4565-909c-0b787346571c service glance] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:10.859895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-84c824d3-79c7-4565-909c-0b787346571c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:10.894737 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:11.126751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c824d3-79c7-4565-909c-0b787346571c service glance] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:11.142291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef6afc-6aa4-475e-8ea8-eb1dbf90c67d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:11.142922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef6afc-6aa4-475e-8ea8-eb1dbf90c67d service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:11.143274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef6afc-6aa4-475e-8ea8-eb1dbf90c67d service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:11.143553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef6afc-6aa4-475e-8ea8-eb1dbf90c67d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:11.161238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef6afc-6aa4-475e-8ea8-eb1dbf90c67d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:11.162833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef6afc-6aa4-475e-8ea8-eb1dbf90c67d service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:11.174239 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1442/2916] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:48:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:48:15.162475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602ad8c-2de0-4029-8936-88e33122c044 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:15.162938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602ad8c-2de0-4029-8936-88e33122c044 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:15.163045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602ad8c-2de0-4029-8936-88e33122c044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:15.206473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d602ad8c-2de0-4029-8936-88e33122c044 None None] MFA Rules not processed for user `25b6ed4eb7894a8da99f20eb19c8af50`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:15.208213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d602ad8c-2de0-4029-8936-88e33122c044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:15.256770 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:15.350767 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1475/2917] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:16.438536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef6afc-6aa4-475e-8ea8-eb1dbf90c67d service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:16.440106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-80ef6afc-6aa4-475e-8ea8-eb1dbf90c67d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:16.571144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef6afc-6aa4-475e-8ea8-eb1dbf90c67d service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:16.582311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5d02e-b77e-4f09-b513-4c9aa5d12b60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:16.583150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5d02e-b77e-4f09-b513-4c9aa5d12b60 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:16.583463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5d02e-b77e-4f09-b513-4c9aa5d12b60 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:16.583782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5d02e-b77e-4f09-b513-4c9aa5d12b60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:16.625498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5d02e-b77e-4f09-b513-4c9aa5d12b60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:16.629866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5d02e-b77e-4f09-b513-4c9aa5d12b60 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:16.652482 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1443/2918] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:16.789948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a0d0d-6490-45ce-a11d-78c748a6feb9 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:16.790427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a0d0d-6490-45ce-a11d-78c748a6feb9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:16.790602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a0d0d-6490-45ce-a11d-78c748a6feb9 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:16.791998 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1476/2919] 10.222.0.16 () {54 vars in 921 bytes} [Fri Sep 30 09:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:48:16.803584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cb212-1d1d-4b3e-8e14-f202ee60049f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:16.804176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cb212-1d1d-4b3e-8e14-f202ee60049f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:16.804640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cb212-1d1d-4b3e-8e14-f202ee60049f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:16.880117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bc2cb212-1d1d-4b3e-8e14-f202ee60049f None None] MFA Rules not processed for user `aa607111024540d1a09b01dfd1e5e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:16.885866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bc2cb212-1d1d-4b3e-8e14-f202ee60049f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:16.931560 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1444/2920] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 09:48:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:16.943351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a0d0d-6490-45ce-a11d-78c748a6feb9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:16.945807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-712a0d0d-6490-45ce-a11d-78c748a6feb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:17.080458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a0d0d-6490-45ce-a11d-78c748a6feb9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:17.086604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dddf7b-4faf-4f79-bbf7-220fe270113b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:17.087417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dddf7b-4faf-4f79-bbf7-220fe270113b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:17.087804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dddf7b-4faf-4f79-bbf7-220fe270113b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:17.088456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dddf7b-4faf-4f79-bbf7-220fe270113b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:17.101560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dddf7b-4faf-4f79-bbf7-220fe270113b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:17.110048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dddf7b-4faf-4f79-bbf7-220fe270113b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:17.135984 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1477/2921] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:17.353444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cb212-1d1d-4b3e-8e14-f202ee60049f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:17.354943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bc2cb212-1d1d-4b3e-8e14-f202ee60049f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:17.559858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cb212-1d1d-4b3e-8e14-f202ee60049f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:17.575088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44043fd8-e967-4a9a-9a2b-8233e6175a70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:17.576565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44043fd8-e967-4a9a-9a2b-8233e6175a70 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:17.577266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44043fd8-e967-4a9a-9a2b-8233e6175a70 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:17.577266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44043fd8-e967-4a9a-9a2b-8233e6175a70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:17.583385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-44043fd8-e967-4a9a-9a2b-8233e6175a70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:17.609043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44043fd8-e967-4a9a-9a2b-8233e6175a70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:17.614578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44043fd8-e967-4a9a-9a2b-8233e6175a70 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:17.651461 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1445/2922] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:22.622457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dddf7b-4faf-4f79-bbf7-220fe270113b service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:22.624159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-40dddf7b-4faf-4f79-bbf7-220fe270113b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:22.640388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dddf7b-4faf-4f79-bbf7-220fe270113b service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:22.647837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495564cf-46a7-42a7-bdba-5d40ddf72de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:22.650369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495564cf-46a7-42a7-bdba-5d40ddf72de4 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:22.650831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495564cf-46a7-42a7-bdba-5d40ddf72de4 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:22.651396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495564cf-46a7-42a7-bdba-5d40ddf72de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:22.653669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-495564cf-46a7-42a7-bdba-5d40ddf72de4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:22.669702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495564cf-46a7-42a7-bdba-5d40ddf72de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:22.672901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495564cf-46a7-42a7-bdba-5d40ddf72de4 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:22.688187 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1478/2923] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:23.522332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44043fd8-e967-4a9a-9a2b-8233e6175a70 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:23.524459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-44043fd8-e967-4a9a-9a2b-8233e6175a70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:23.537129 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:23.542046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44043fd8-e967-4a9a-9a2b-8233e6175a70 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:23.557857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e22e3-8745-4775-a7ff-52cfea889d83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:23.558919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e22e3-8745-4775-a7ff-52cfea889d83 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:23.559436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e22e3-8745-4775-a7ff-52cfea889d83 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:23.560935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e22e3-8745-4775-a7ff-52cfea889d83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:23.564107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bf1e22e3-8745-4775-a7ff-52cfea889d83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:23.581267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e22e3-8745-4775-a7ff-52cfea889d83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:23.583240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e22e3-8745-4775-a7ff-52cfea889d83 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:23.600525 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1446/2924] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:25.273264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79706a6d-e051-43cc-a44d-f50a4c3985c0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:25.273809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79706a6d-e051-43cc-a44d-f50a4c3985c0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:25.273809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79706a6d-e051-43cc-a44d-f50a4c3985c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:25.318279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-79706a6d-e051-43cc-a44d-f50a4c3985c0 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:25.323968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-79706a6d-e051-43cc-a44d-f50a4c3985c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:25.363534 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1479/2925] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 09:48:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:25.406907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e22e3-8745-4775-a7ff-52cfea889d83 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:25.425699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e22e3-8745-4775-a7ff-52cfea889d83 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:25.433770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3683df-2567-45b3-beb3-13f2751cdaf3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:25.434389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3683df-2567-45b3-beb3-13f2751cdaf3 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:25.434661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3683df-2567-45b3-beb3-13f2751cdaf3 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:25.434926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3683df-2567-45b3-beb3-13f2751cdaf3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:25.446572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3683df-2567-45b3-beb3-13f2751cdaf3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:25.448480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3683df-2567-45b3-beb3-13f2751cdaf3 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:25.465682 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1447/2926] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:48:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:48:30.377707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79706a6d-e051-43cc-a44d-f50a4c3985c0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:30.392698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79706a6d-e051-43cc-a44d-f50a4c3985c0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:30.406165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b7005-67a9-4e7f-bfbf-54d518e49b85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:30.406816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b7005-67a9-4e7f-bfbf-54d518e49b85 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:30.407097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b7005-67a9-4e7f-bfbf-54d518e49b85 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:30.407373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b7005-67a9-4e7f-bfbf-54d518e49b85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:30.409989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a41b7005-67a9-4e7f-bfbf-54d518e49b85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:30.513927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b7005-67a9-4e7f-bfbf-54d518e49b85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:30.516992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b7005-67a9-4e7f-bfbf-54d518e49b85 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:30.531427 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1480/2927] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:35.458112 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=11 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:36.917213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3683df-2567-45b3-beb3-13f2751cdaf3 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:36.918804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cd3683df-2567-45b3-beb3-13f2751cdaf3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:37.034456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3683df-2567-45b3-beb3-13f2751cdaf3 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:37.043363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665afd3-aff5-41c9-a23f-616e4f2a5c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:37.044065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665afd3-aff5-41c9-a23f-616e4f2a5c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:37.044348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665afd3-aff5-41c9-a23f-616e4f2a5c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:37.044766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665afd3-aff5-41c9-a23f-616e4f2a5c52 admin admin] PATH_INFO: `/v3/users/19a3a87ab66d4abda69fea9d490ccea6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:37.046131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665afd3-aff5-41c9-a23f-616e4f2a5c52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19a3a87ab66d4abda69fea9d490ccea6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:37.048201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665afd3-aff5-41c9-a23f-616e4f2a5c52 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:37.136225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d665afd3-aff5-41c9-a23f-616e4f2a5c52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19a3a87ab66d4abda69fea9d490ccea6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:37.151240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d665afd3-aff5-41c9-a23f-616e4f2a5c52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19a3a87ab66d4abda69fea9d490ccea6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:37.152688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d665afd3-aff5-41c9-a23f-616e4f2a5c52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19a3a87ab66d4abda69fea9d490ccea6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:37.166771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d665afd3-aff5-41c9-a23f-616e4f2a5c52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19a3a87ab66d4abda69fea9d490ccea6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:37.175323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d665afd3-aff5-41c9-a23f-616e4f2a5c52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19a3a87ab66d4abda69fea9d490ccea6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:37.183136 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1448/2928] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:48:36 2022] DELETE /identity/v3/users/19a3a87ab66d4abda69fea9d490ccea6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:48:37.187667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f541b-887b-4d94-85c9-caa5b2410a33 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:37.188921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f541b-887b-4d94-85c9-caa5b2410a33 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:37.189251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f541b-887b-4d94-85c9-caa5b2410a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:37.216508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e85f541b-887b-4d94-85c9-caa5b2410a33 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:37.218142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e85f541b-887b-4d94-85c9-caa5b2410a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:37.259167 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:37.284780 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1481/2929] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:37.293645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665afd3-aff5-41c9-a23f-616e4f2a5c52 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:37.295204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d665afd3-aff5-41c9-a23f-616e4f2a5c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:37.362677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665afd3-aff5-41c9-a23f-616e4f2a5c52 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:37.366676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38d1b6-cbbf-4410-bf69-2492d7ce3dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:37.368065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d1b6-cbbf-4410-bf69-2492d7ce3dfe service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:37.368729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d1b6-cbbf-4410-bf69-2492d7ce3dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:37.369253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d1b6-cbbf-4410-bf69-2492d7ce3dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:37.380784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38d1b6-cbbf-4410-bf69-2492d7ce3dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:37.382879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38d1b6-cbbf-4410-bf69-2492d7ce3dfe service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:37.394036 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1449/2930] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:37.623884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f541b-887b-4d94-85c9-caa5b2410a33 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:37.626092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e85f541b-887b-4d94-85c9-caa5b2410a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:37.654064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f541b-887b-4d94-85c9-caa5b2410a33 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:37.664258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0dde2-101c-439c-a8bf-7eb0cafa1064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:37.665254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0dde2-101c-439c-a8bf-7eb0cafa1064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:37.665527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0dde2-101c-439c-a8bf-7eb0cafa1064 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:37.665951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0dde2-101c-439c-a8bf-7eb0cafa1064 admin admin] PATH_INFO: `/v3/projects/67464f4e5013444597325caeee103d9e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:37.667492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0dde2-101c-439c-a8bf-7eb0cafa1064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67464f4e5013444597325caeee103d9e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:37.669902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0dde2-101c-439c-a8bf-7eb0cafa1064 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:37.702560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38d1b6-cbbf-4410-bf69-2492d7ce3dfe service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:37.704112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3b38d1b6-cbbf-4410-bf69-2492d7ce3dfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:37.751393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7af0dde2-101c-439c-a8bf-7eb0cafa1064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67464f4e5013444597325caeee103d9e', 'request_id': 'req-7af0dde2-101c-439c-a8bf-7eb0cafa1064'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:37.758984 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:37.777637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7af0dde2-101c-439c-a8bf-7eb0cafa1064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67464f4e5013444597325caeee103d9e', 'request_id': 'req-7af0dde2-101c-439c-a8bf-7eb0cafa1064'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:37.801254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7af0dde2-101c-439c-a8bf-7eb0cafa1064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67464f4e5013444597325caeee103d9e', 'request_id': 'req-7af0dde2-101c-439c-a8bf-7eb0cafa1064'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:37.847447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7af0dde2-101c-439c-a8bf-7eb0cafa1064 admin admin] The token cache is being invalidate because project 67464f4e5013444597325caeee103d9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:48:37.848817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7af0dde2-101c-439c-a8bf-7eb0cafa1064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:37.853087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7af0dde2-101c-439c-a8bf-7eb0cafa1064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:37.859124 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1482/2931] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:48:37 2022] DELETE /identity/v3/projects/67464f4e5013444597325caeee103d9e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:48:37.861499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672e4ad-4548-4a4c-8f9d-e46194b4d6a3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:37.861877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672e4ad-4548-4a4c-8f9d-e46194b4d6a3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:37.862749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672e4ad-4548-4a4c-8f9d-e46194b4d6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:37.863297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38d1b6-cbbf-4410-bf69-2492d7ce3dfe service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:37.901795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b672e4ad-4548-4a4c-8f9d-e46194b4d6a3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:37.904353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b672e4ad-4548-4a4c-8f9d-e46194b4d6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:37.978455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e950b2-03d2-4b07-a61f-60f3cbe12cd8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:37.979131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e950b2-03d2-4b07-a61f-60f3cbe12cd8 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:37.979423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e950b2-03d2-4b07-a61f-60f3cbe12cd8 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:37.979696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e950b2-03d2-4b07-a61f-60f3cbe12cd8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:37.983095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b3e950b2-03d2-4b07-a61f-60f3cbe12cd8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:38.005225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e950b2-03d2-4b07-a61f-60f3cbe12cd8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:38.007387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e950b2-03d2-4b07-a61f-60f3cbe12cd8 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:38.033134 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1483/2932] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:38.033134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672e4ad-4548-4a4c-8f9d-e46194b4d6a3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:38.033134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b672e4ad-4548-4a4c-8f9d-e46194b4d6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:38.045872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672e4ad-4548-4a4c-8f9d-e46194b4d6a3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:38.046723 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1450/2933] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:38.048004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc4a16-1191-45aa-8352-6f82fe2e93df None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:38.048288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc4a16-1191-45aa-8352-6f82fe2e93df None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:38.048559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc4a16-1191-45aa-8352-6f82fe2e93df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:38.051373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21875a-ceac-461d-a812-0d5c78164d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:38.052101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21875a-ceac-461d-a812-0d5c78164d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:38.052567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21875a-ceac-461d-a812-0d5c78164d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:38.052936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21875a-ceac-461d-a812-0d5c78164d06 admin admin] PATH_INFO: `/v3/users/ff5f171b2faf41988fc81c9a26404f0e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:38.055933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21875a-ceac-461d-a812-0d5c78164d06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff5f171b2faf41988fc81c9a26404f0e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:38.058019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21875a-ceac-461d-a812-0d5c78164d06 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:38.101422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-72dc4a16-1191-45aa-8352-6f82fe2e93df None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:38.104629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-72dc4a16-1191-45aa-8352-6f82fe2e93df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:38.118311 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1451/2934] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:38.122936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc4a16-1191-45aa-8352-6f82fe2e93df None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:38.146943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc4a16-1191-45aa-8352-6f82fe2e93df None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:38.153798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9dc6e0-48b1-4498-b4be-67ca22be936d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:38.155077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dc6e0-48b1-4498-b4be-67ca22be936d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:38.156291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dc6e0-48b1-4498-b4be-67ca22be936d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:38.156781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dc6e0-48b1-4498-b4be-67ca22be936d admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:38.157602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9dc6e0-48b1-4498-b4be-67ca22be936d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:48:38.158296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9dc6e0-48b1-4498-b4be-67ca22be936d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:38.163243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9dc6e0-48b1-4498-b4be-67ca22be936d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:38.193301 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1452/2935] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:48:38.199459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9dc6e0-48b1-4498-b4be-67ca22be936d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:38.208879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cc21875a-ceac-461d-a812-0d5c78164d06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff5f171b2faf41988fc81c9a26404f0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:38.209899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cc21875a-ceac-461d-a812-0d5c78164d06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff5f171b2faf41988fc81c9a26404f0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:38.211783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9dc6e0-48b1-4498-b4be-67ca22be936d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:38.218009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab971d5-2d67-4911-b92d-5f7b00fae904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:38.218872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab971d5-2d67-4911-b92d-5f7b00fae904 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:38.219174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab971d5-2d67-4911-b92d-5f7b00fae904 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:38.219534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab971d5-2d67-4911-b92d-5f7b00fae904 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:38.220288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab971d5-2d67-4911-b92d-5f7b00fae904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:38.222824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab971d5-2d67-4911-b92d-5f7b00fae904 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:38.227464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cc21875a-ceac-461d-a812-0d5c78164d06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff5f171b2faf41988fc81c9a26404f0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:38.239949 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:38.266342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cc21875a-ceac-461d-a812-0d5c78164d06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff5f171b2faf41988fc81c9a26404f0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:38.277755 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1453/2936] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:48:38 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:48:38.279043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab971d5-2d67-4911-b92d-5f7b00fae904 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:38.282021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5ab971d5-2d67-4911-b92d-5f7b00fae904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:38.287464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cc21875a-ceac-461d-a812-0d5c78164d06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff5f171b2faf41988fc81c9a26404f0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:38.308922 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1484/2937] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:48:38 2022] DELETE /identity/v3/users/ff5f171b2faf41988fc81c9a26404f0e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:48:38.435915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab971d5-2d67-4911-b92d-5f7b00fae904 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:38.458077 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:38.509734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a29ffa-fe0d-43b7-9b6c-e8ecc4941360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:38.510365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a29ffa-fe0d-43b7-9b6c-e8ecc4941360 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:38.510641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a29ffa-fe0d-43b7-9b6c-e8ecc4941360 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:38.510966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a29ffa-fe0d-43b7-9b6c-e8ecc4941360 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:38.511596 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a29ffa-fe0d-43b7-9b6c-e8ecc4941360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:38.514513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a29ffa-fe0d-43b7-9b6c-e8ecc4941360 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:38.548048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21875a-ceac-461d-a812-0d5c78164d06 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:38.548301 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1454/2938] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:48:38 2022] POST /identity/v3/users => generated 288 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:48:38.561321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21875a-ceac-461d-a812-0d5c78164d06 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:38.566718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a746680-7a8e-411d-ab7f-cd5518c0f4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:38.567619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a746680-7a8e-411d-ab7f-cd5518c0f4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:38.567963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a746680-7a8e-411d-ab7f-cd5518c0f4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:38.568655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a746680-7a8e-411d-ab7f-cd5518c0f4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:38.569370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a746680-7a8e-411d-ab7f-cd5518c0f4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:38.571772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a746680-7a8e-411d-ab7f-cd5518c0f4c3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:38.584850 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1485/2939] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:48:38.589612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a29ffa-fe0d-43b7-9b6c-e8ecc4941360 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:38.600739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a29ffa-fe0d-43b7-9b6c-e8ecc4941360 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:38.606370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d02b6-fe05-44ea-8ccb-eeb42c590f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:38.607064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d02b6-fe05-44ea-8ccb-eeb42c590f79 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:38.607413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d02b6-fe05-44ea-8ccb-eeb42c590f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:38.607767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d02b6-fe05-44ea-8ccb-eeb42c590f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:38.608629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d02b6-fe05-44ea-8ccb-eeb42c590f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:38.610430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d02b6-fe05-44ea-8ccb-eeb42c590f79 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:38.625604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a746680-7a8e-411d-ab7f-cd5518c0f4c3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:38.635477 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1455/2940] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:48:38.640621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a746680-7a8e-411d-ab7f-cd5518c0f4c3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:38.645563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cafd46-f61d-465c-8824-620ad77abf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:38.646216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cafd46-f61d-465c-8824-620ad77abf5c admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:38.646491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cafd46-f61d-465c-8824-620ad77abf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:38.646762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cafd46-f61d-465c-8824-620ad77abf5c admin admin] PATH_INFO: `/v3/projects/64a4ad4460cb47768a9a66c8af7103ce/users/1d44116e5c9a42b2bb8e5c22347a8799/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:38.666184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cafd46-f61d-465c-8824-620ad77abf5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a4ad4460cb47768a9a66c8af7103ce, user_id=1d44116e5c9a42b2bb8e5c22347a8799, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:38.669050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cafd46-f61d-465c-8824-620ad77abf5c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:38.689255 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1486/2941] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:48:38 2022] PUT /identity/v3/projects/64a4ad4460cb47768a9a66c8af7103ce/users/1d44116e5c9a42b2bb8e5c22347a8799/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:48:38.696899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c19867-9d32-4df3-b32f-724826b24cc4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:38.697338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c19867-9d32-4df3-b32f-724826b24cc4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:38.697705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c19867-9d32-4df3-b32f-724826b24cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:38.729923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-01c19867-9d32-4df3-b32f-724826b24cc4 None None] MFA Rules not processed for user `1d44116e5c9a42b2bb8e5c22347a8799`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:38.731483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-01c19867-9d32-4df3-b32f-724826b24cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:38.827467 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1456/2942] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:39.592536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cafd46-f61d-465c-8824-620ad77abf5c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:39.593092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c19867-9d32-4df3-b32f-724826b24cc4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:39.594263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-01c19867-9d32-4df3-b32f-724826b24cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:39.595491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-79cafd46-f61d-465c-8824-620ad77abf5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:39.810247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c19867-9d32-4df3-b32f-724826b24cc4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:39.815378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22bb06-40fd-49eb-8322-36e2c239500d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:39.816116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22bb06-40fd-49eb-8322-36e2c239500d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:39.816320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22bb06-40fd-49eb-8322-36e2c239500d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:39.816524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22bb06-40fd-49eb-8322-36e2c239500d admin admin] PATH_INFO: `/v3/projects/8c55a5240efd4e47aea471ef9e3c7d45` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:39.817747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22bb06-40fd-49eb-8322-36e2c239500d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c55a5240efd4e47aea471ef9e3c7d45)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:39.819628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22bb06-40fd-49eb-8322-36e2c239500d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:39.835960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cafd46-f61d-465c-8824-620ad77abf5c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:39.860546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd7952-ea7c-4e15-a667-f29db85d6358 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:39.861314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd7952-ea7c-4e15-a667-f29db85d6358 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:39.861593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd7952-ea7c-4e15-a667-f29db85d6358 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:39.861909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd7952-ea7c-4e15-a667-f29db85d6358 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:39.880277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd7952-ea7c-4e15-a667-f29db85d6358 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:39.881457 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:39.900459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd7952-ea7c-4e15-a667-f29db85d6358 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:39.952544 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1487/2943] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:39.954623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fe22bb06-40fd-49eb-8322-36e2c239500d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c55a5240efd4e47aea471ef9e3c7d45', 'request_id': 'req-fe22bb06-40fd-49eb-8322-36e2c239500d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:39.963575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fe22bb06-40fd-49eb-8322-36e2c239500d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c55a5240efd4e47aea471ef9e3c7d45', 'request_id': 'req-fe22bb06-40fd-49eb-8322-36e2c239500d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:39.977386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fe22bb06-40fd-49eb-8322-36e2c239500d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c55a5240efd4e47aea471ef9e3c7d45', 'request_id': 'req-fe22bb06-40fd-49eb-8322-36e2c239500d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:40.004083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fe22bb06-40fd-49eb-8322-36e2c239500d admin admin] The token cache is being invalidate because project 8c55a5240efd4e47aea471ef9e3c7d45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:48:40.004522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fe22bb06-40fd-49eb-8322-36e2c239500d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:40.005511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fe22bb06-40fd-49eb-8322-36e2c239500d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:40.016037 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1457/2944] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:48:39 2022] DELETE /identity/v3/projects/8c55a5240efd4e47aea471ef9e3c7d45 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:48:40.021702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb74755-b485-4707-9be6-4c7aee471968 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:40.022206 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb74755-b485-4707-9be6-4c7aee471968 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:40.022634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb74755-b485-4707-9be6-4c7aee471968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:40.053612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2eb74755-b485-4707-9be6-4c7aee471968 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:40.057798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2eb74755-b485-4707-9be6-4c7aee471968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:40.255240 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1488/2945] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:48:40.263134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70561ae7-ecf3-4a69-be14-e9c27ddee5d8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:40.263609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70561ae7-ecf3-4a69-be14-e9c27ddee5d8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:40.264047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70561ae7-ecf3-4a69-be14-e9c27ddee5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:40.311251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667c519-cf22-492e-8db5-8c3f2ef325a7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:40.311544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667c519-cf22-492e-8db5-8c3f2ef325a7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:40.312486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667c519-cf22-492e-8db5-8c3f2ef325a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:40.349903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b667c519-cf22-492e-8db5-8c3f2ef325a7 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:40.351145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b667c519-cf22-492e-8db5-8c3f2ef325a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:40.352248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-70561ae7-ecf3-4a69-be14-e9c27ddee5d8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:40.356671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-70561ae7-ecf3-4a69-be14-e9c27ddee5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:40.390351 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1458/2946] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:40.391887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70561ae7-ecf3-4a69-be14-e9c27ddee5d8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:40.411839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70561ae7-ecf3-4a69-be14-e9c27ddee5d8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:40.412907 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:40.425282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfdf5b-3ff9-47f4-8913-25c1590d9ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:40.426156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfdf5b-3ff9-47f4-8913-25c1590d9ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:40.426542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfdf5b-3ff9-47f4-8913-25c1590d9ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:40.426918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfdf5b-3ff9-47f4-8913-25c1590d9ed4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:40.427697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedfdf5b-3ff9-47f4-8913-25c1590d9ed4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:48:40.430756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedfdf5b-3ff9-47f4-8913-25c1590d9ed4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:40.435726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedfdf5b-3ff9-47f4-8913-25c1590d9ed4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:40.519124 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1459/2947] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:48:40.520614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfdf5b-3ff9-47f4-8913-25c1590d9ed4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:40.534118 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1489/2948] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 09:48:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:48:40.550016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667c519-cf22-492e-8db5-8c3f2ef325a7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:40.552279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b667c519-cf22-492e-8db5-8c3f2ef325a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:40.560496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfdf5b-3ff9-47f4-8913-25c1590d9ed4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:40.581232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562e8a3-3392-4302-b5ca-02b2f3a7e825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:40.583632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562e8a3-3392-4302-b5ca-02b2f3a7e825 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:40.584030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562e8a3-3392-4302-b5ca-02b2f3a7e825 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:40.584414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562e8a3-3392-4302-b5ca-02b2f3a7e825 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:40.585229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562e8a3-3392-4302-b5ca-02b2f3a7e825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:40.590501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562e8a3-3392-4302-b5ca-02b2f3a7e825 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:40.689362 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1460/2949] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:48:40 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:48:40.692919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562e8a3-3392-4302-b5ca-02b2f3a7e825 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:40.755094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667c519-cf22-492e-8db5-8c3f2ef325a7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:40.767782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562e8a3-3392-4302-b5ca-02b2f3a7e825 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:40.790570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb225c-5c17-4579-96c1-ee9f8f99010e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:40.792264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb225c-5c17-4579-96c1-ee9f8f99010e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:40.793703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb225c-5c17-4579-96c1-ee9f8f99010e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:40.794144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb225c-5c17-4579-96c1-ee9f8f99010e admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:40.796162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb225c-5c17-4579-96c1-ee9f8f99010e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:40.798614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb225c-5c17-4579-96c1-ee9f8f99010e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:40.863583 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1461/2950] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:48:40 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:48:40.867536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb225c-5c17-4579-96c1-ee9f8f99010e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:40.893328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb225c-5c17-4579-96c1-ee9f8f99010e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:40.902869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0fb55-8a43-438c-983f-d9fbcfe0766a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:40.906081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0fb55-8a43-438c-983f-d9fbcfe0766a service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:40.906520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0fb55-8a43-438c-983f-d9fbcfe0766a service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:40.906903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0fb55-8a43-438c-983f-d9fbcfe0766a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:40.907263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7f0a3-a3cc-4be7-bc0b-75b83dc82cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:40.909535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7f0a3-a3cc-4be7-bc0b-75b83dc82cad admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:40.909822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7f0a3-a3cc-4be7-bc0b-75b83dc82cad admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:40.910096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7f0a3-a3cc-4be7-bc0b-75b83dc82cad admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:40.910759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7f0a3-a3cc-4be7-bc0b-75b83dc82cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:40.915612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7f0a3-a3cc-4be7-bc0b-75b83dc82cad admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:40.954523 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1462/2951] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:48:40.966908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7f0a3-a3cc-4be7-bc0b-75b83dc82cad admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:41.000413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7f0a3-a3cc-4be7-bc0b-75b83dc82cad admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:41.016919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c48363-e247-46e3-ba9b-4b8b3f97bedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:41.016919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c48363-e247-46e3-ba9b-4b8b3f97bedc admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:41.016919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c48363-e247-46e3-ba9b-4b8b3f97bedc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:41.016919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c48363-e247-46e3-ba9b-4b8b3f97bedc admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:41.017498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c48363-e247-46e3-ba9b-4b8b3f97bedc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:41.017951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c48363-e247-46e3-ba9b-4b8b3f97bedc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:41.047888 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1463/2952] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:48:41.052218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c48363-e247-46e3-ba9b-4b8b3f97bedc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:41.077406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c48363-e247-46e3-ba9b-4b8b3f97bedc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:41.090849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6064d-2cc1-432c-bd13-e33233a30df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:41.091583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6064d-2cc1-432c-bd13-e33233a30df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:41.092011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6064d-2cc1-432c-bd13-e33233a30df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:41.092437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6064d-2cc1-432c-bd13-e33233a30df9 admin admin] PATH_INFO: `/v3/projects/86832fed25514bc385749c1a02b08fbe/users/960e2646c3174ad084c85b6de1e01822/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:41.122055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0fb55-8a43-438c-983f-d9fbcfe0766a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:41.123668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0fb55-8a43-438c-983f-d9fbcfe0766a service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:41.140842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6064d-2cc1-432c-bd13-e33233a30df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86832fed25514bc385749c1a02b08fbe, user_id=960e2646c3174ad084c85b6de1e01822, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:41.143527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6064d-2cc1-432c-bd13-e33233a30df9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:41.156144 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1490/2953] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:48:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 09:48:41.198976 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1464/2954] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:48:41 2022] PUT /identity/v3/projects/86832fed25514bc385749c1a02b08fbe/users/960e2646c3174ad084c85b6de1e01822/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:48:41.205096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ee0c0-d81a-47e5-8c14-07897b98cdca None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:41.205675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ee0c0-d81a-47e5-8c14-07897b98cdca None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:41.206646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ee0c0-d81a-47e5-8c14-07897b98cdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:41.241263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-971ee0c0-d81a-47e5-8c14-07897b98cdca None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:41.247331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-971ee0c0-d81a-47e5-8c14-07897b98cdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:41.282482 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:41.359535 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1491/2955] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:48:41.361777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6064d-2cc1-432c-bd13-e33233a30df9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:41.364651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-06e6064d-2cc1-432c-bd13-e33233a30df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:41.370716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ee0c0-d81a-47e5-8c14-07897b98cdca None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:41.376522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-971ee0c0-d81a-47e5-8c14-07897b98cdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:41.385026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6064d-2cc1-432c-bd13-e33233a30df9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:41.401373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657575ab-f65a-4f06-b895-76adf5b47032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:41.402235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657575ab-f65a-4f06-b895-76adf5b47032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:41.402429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657575ab-f65a-4f06-b895-76adf5b47032 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:41.402706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657575ab-f65a-4f06-b895-76adf5b47032 admin admin] PATH_INFO: `/v3/users/c181218ac3f34e0cb5863b58aef66a9f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:41.404139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657575ab-f65a-4f06-b895-76adf5b47032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c181218ac3f34e0cb5863b58aef66a9f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:41.406079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657575ab-f65a-4f06-b895-76adf5b47032 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:41.426812 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=6,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:41.488475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ee0c0-d81a-47e5-8c14-07897b98cdca None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:41.492928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66b6af-a4dc-494a-9f1b-827411abd366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:41.493736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66b6af-a4dc-494a-9f1b-827411abd366 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:41.494004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66b6af-a4dc-494a-9f1b-827411abd366 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:41.494281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66b6af-a4dc-494a-9f1b-827411abd366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:41.495520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-657575ab-f65a-4f06-b895-76adf5b47032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c181218ac3f34e0cb5863b58aef66a9f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:41.517918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-657575ab-f65a-4f06-b895-76adf5b47032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c181218ac3f34e0cb5863b58aef66a9f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:41.519141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-657575ab-f65a-4f06-b895-76adf5b47032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c181218ac3f34e0cb5863b58aef66a9f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:41.525837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b66b6af-a4dc-494a-9f1b-827411abd366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:41.526232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b66b6af-a4dc-494a-9f1b-827411abd366 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:41.546306 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1492/2956] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:41.551298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-657575ab-f65a-4f06-b895-76adf5b47032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c181218ac3f34e0cb5863b58aef66a9f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:41.562264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-657575ab-f65a-4f06-b895-76adf5b47032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c181218ac3f34e0cb5863b58aef66a9f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:41.573574 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1465/2957] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:48:41 2022] DELETE /identity/v3/users/c181218ac3f34e0cb5863b58aef66a9f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:48:41.575270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80451c-1015-4120-95f2-4e63f644f605 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:41.575859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80451c-1015-4120-95f2-4e63f644f605 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:41.576131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80451c-1015-4120-95f2-4e63f644f605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:41.602982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3b80451c-1015-4120-95f2-4e63f644f605 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:41.604632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3b80451c-1015-4120-95f2-4e63f644f605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:41.738906 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1493/2958] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:41.824680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657575ab-f65a-4f06-b895-76adf5b47032 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:41.827236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-657575ab-f65a-4f06-b895-76adf5b47032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:41.966842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657575ab-f65a-4f06-b895-76adf5b47032 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:41.992125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20273421-3ef1-43fb-b801-fd852524b105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:41.993033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20273421-3ef1-43fb-b801-fd852524b105 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:41.993492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20273421-3ef1-43fb-b801-fd852524b105 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:41.993936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20273421-3ef1-43fb-b801-fd852524b105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:42.025394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20273421-3ef1-43fb-b801-fd852524b105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:42.027052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20273421-3ef1-43fb-b801-fd852524b105 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:42.079674 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1466/2959] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:42.906196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80451c-1015-4120-95f2-4e63f644f605 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:42.909906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3b80451c-1015-4120-95f2-4e63f644f605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:42.940647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80451c-1015-4120-95f2-4e63f644f605 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:42.954539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e93dd-63c7-4560-8731-4b81b44a7175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:42.956473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e93dd-63c7-4560-8731-4b81b44a7175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:42.958278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e93dd-63c7-4560-8731-4b81b44a7175 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:42.958945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e93dd-63c7-4560-8731-4b81b44a7175 admin admin] PATH_INFO: `/v3/projects/064db7c919624508be7e6b87e78e9213` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:42.970711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e93dd-63c7-4560-8731-4b81b44a7175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=064db7c919624508be7e6b87e78e9213)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:42.972995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e93dd-63c7-4560-8731-4b81b44a7175 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:43.073549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-db1e93dd-63c7-4560-8731-4b81b44a7175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '064db7c919624508be7e6b87e78e9213', 'request_id': 'req-db1e93dd-63c7-4560-8731-4b81b44a7175'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:43.081946 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:43.090426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-db1e93dd-63c7-4560-8731-4b81b44a7175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '064db7c919624508be7e6b87e78e9213', 'request_id': 'req-db1e93dd-63c7-4560-8731-4b81b44a7175'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:43.102227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-db1e93dd-63c7-4560-8731-4b81b44a7175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '064db7c919624508be7e6b87e78e9213', 'request_id': 'req-db1e93dd-63c7-4560-8731-4b81b44a7175'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:43.135330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-db1e93dd-63c7-4560-8731-4b81b44a7175 admin admin] The token cache is being invalidate because project 064db7c919624508be7e6b87e78e9213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:48:43.137795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-db1e93dd-63c7-4560-8731-4b81b44a7175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:43.139557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-db1e93dd-63c7-4560-8731-4b81b44a7175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:43.144259 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1494/2960] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:48:42 2022] DELETE /identity/v3/projects/064db7c919624508be7e6b87e78e9213 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:48:43.149287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a2542-02b4-4094-827c-34cce513c18d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:43.149791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a2542-02b4-4094-827c-34cce513c18d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:43.149903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a2542-02b4-4094-827c-34cce513c18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:43.190266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5f6a2542-02b4-4094-827c-34cce513c18d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:43.191591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5f6a2542-02b4-4094-827c-34cce513c18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:43.352452 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1467/2961] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:43.360159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1b7ab-9f18-49db-8073-39851ad0aca2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:43.360441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1b7ab-9f18-49db-8073-39851ad0aca2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:43.360742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1b7ab-9f18-49db-8073-39851ad0aca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:43.384995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b6e1b7ab-9f18-49db-8073-39851ad0aca2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:43.386410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b6e1b7ab-9f18-49db-8073-39851ad0aca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:43.400494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a2542-02b4-4094-827c-34cce513c18d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:43.401236 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1495/2962] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:43.412489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a2542-02b4-4094-827c-34cce513c18d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:43.418755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2eedc-2bb4-475b-ab03-419548423fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:43.419625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2eedc-2bb4-475b-ab03-419548423fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:43.419967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2eedc-2bb4-475b-ab03-419548423fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:43.420473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2eedc-2bb4-475b-ab03-419548423fd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:43.421661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2eedc-2bb4-475b-ab03-419548423fd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:48:43.422041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2eedc-2bb4-475b-ab03-419548423fd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:43.424096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2eedc-2bb4-475b-ab03-419548423fd7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:43.456080 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1468/2963] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:48:43.460340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1b7ab-9f18-49db-8073-39851ad0aca2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:43.470363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1b7ab-9f18-49db-8073-39851ad0aca2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:43.502368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113985f-da97-4ad7-8c01-6baf539b7d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:43.503097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113985f-da97-4ad7-8c01-6baf539b7d06 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:43.503475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113985f-da97-4ad7-8c01-6baf539b7d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:43.504180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113985f-da97-4ad7-8c01-6baf539b7d06 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:43.504626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113985f-da97-4ad7-8c01-6baf539b7d06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:43.506628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113985f-da97-4ad7-8c01-6baf539b7d06 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:43.599185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2eedc-2bb4-475b-ab03-419548423fd7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:43.599611 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1496/2964] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:48:43 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:48:43.618920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2eedc-2bb4-475b-ab03-419548423fd7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:43.656025 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:43.749458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc57eb9-a384-4adc-8806-27c14be8bf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:43.750098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc57eb9-a384-4adc-8806-27c14be8bf78 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:43.750446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc57eb9-a384-4adc-8806-27c14be8bf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:43.750627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc57eb9-a384-4adc-8806-27c14be8bf78 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:43.751264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc57eb9-a384-4adc-8806-27c14be8bf78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:43.753274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc57eb9-a384-4adc-8806-27c14be8bf78 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:43.795063 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1469/2965] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:48:43 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:48:43.799335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113985f-da97-4ad7-8c01-6baf539b7d06 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:43.813886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113985f-da97-4ad7-8c01-6baf539b7d06 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:43.837591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86039d61-b822-4cf3-898d-4e551d340db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:43.838265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86039d61-b822-4cf3-898d-4e551d340db9 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:43.838537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86039d61-b822-4cf3-898d-4e551d340db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:43.838806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86039d61-b822-4cf3-898d-4e551d340db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:43.839473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86039d61-b822-4cf3-898d-4e551d340db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:43.841148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86039d61-b822-4cf3-898d-4e551d340db9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:43.872316 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1497/2966] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:48:43.876485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc57eb9-a384-4adc-8806-27c14be8bf78 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:43.895187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc57eb9-a384-4adc-8806-27c14be8bf78 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:43.910380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791c9ed-fbc9-4360-b648-645a81a8b437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:43.916176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791c9ed-fbc9-4360-b648-645a81a8b437 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:43.917093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791c9ed-fbc9-4360-b648-645a81a8b437 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:43.917531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791c9ed-fbc9-4360-b648-645a81a8b437 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:43.918571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791c9ed-fbc9-4360-b648-645a81a8b437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:43.920340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791c9ed-fbc9-4360-b648-645a81a8b437 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:43.974076 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1470/2967] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:48:43.975489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86039d61-b822-4cf3-898d-4e551d340db9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:44.010325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86039d61-b822-4cf3-898d-4e551d340db9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:44.017842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8027d11-5a8b-4588-8553-76abefd5e09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:44.018822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8027d11-5a8b-4588-8553-76abefd5e09b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:44.019261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8027d11-5a8b-4588-8553-76abefd5e09b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:44.019704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8027d11-5a8b-4588-8553-76abefd5e09b admin admin] PATH_INFO: `/v3/projects/185c590c912b41d59af8284d784179a0/users/f33a618447b7460298236440b04cca66/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:44.053983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8027d11-5a8b-4588-8553-76abefd5e09b admin admin] RBAC: Authorizing `identity:create_grant(project_id=185c590c912b41d59af8284d784179a0, user_id=f33a618447b7460298236440b04cca66, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:44.057075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8027d11-5a8b-4588-8553-76abefd5e09b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:44.086546 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1498/2968] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:48:43 2022] PUT /identity/v3/projects/185c590c912b41d59af8284d784179a0/users/f33a618447b7460298236440b04cca66/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:48:44.099125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26bb37-a4aa-4304-b1bb-8d56bb609a1b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:44.100282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26bb37-a4aa-4304-b1bb-8d56bb609a1b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:44.100758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26bb37-a4aa-4304-b1bb-8d56bb609a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:44.151132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ba26bb37-a4aa-4304-b1bb-8d56bb609a1b None None] MFA Rules not processed for user `f33a618447b7460298236440b04cca66`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:44.152574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ba26bb37-a4aa-4304-b1bb-8d56bb609a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:44.269572 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1471/2969] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:44.282101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8027d11-5a8b-4588-8553-76abefd5e09b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:44.284627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b8027d11-5a8b-4588-8553-76abefd5e09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:44.405680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8027d11-5a8b-4588-8553-76abefd5e09b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:44.409934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11f126-9707-40ff-989d-f7a8a97040aa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:44.410945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11f126-9707-40ff-989d-f7a8a97040aa service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:44.411239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11f126-9707-40ff-989d-f7a8a97040aa service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:44.412461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11f126-9707-40ff-989d-f7a8a97040aa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:44.427487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11f126-9707-40ff-989d-f7a8a97040aa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:44.429208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11f126-9707-40ff-989d-f7a8a97040aa service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:44.446228 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1499/2970] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:48:44.931611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26bb37-a4aa-4304-b1bb-8d56bb609a1b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:44.933555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ba26bb37-a4aa-4304-b1bb-8d56bb609a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:45.155827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26bb37-a4aa-4304-b1bb-8d56bb609a1b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:45.162777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde6458-f103-4d95-ba39-dd2d4072550a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:45.164317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde6458-f103-4d95-ba39-dd2d4072550a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:45.166407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde6458-f103-4d95-ba39-dd2d4072550a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:45.166902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde6458-f103-4d95-ba39-dd2d4072550a admin admin] PATH_INFO: `/v3/users/1d44116e5c9a42b2bb8e5c22347a8799` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:45.168642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde6458-f103-4d95-ba39-dd2d4072550a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d44116e5c9a42b2bb8e5c22347a8799)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:45.171154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde6458-f103-4d95-ba39-dd2d4072550a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:45.232018 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:45.261058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bdde6458-f103-4d95-ba39-dd2d4072550a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d44116e5c9a42b2bb8e5c22347a8799'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:45.276141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bdde6458-f103-4d95-ba39-dd2d4072550a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d44116e5c9a42b2bb8e5c22347a8799'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:45.277237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bdde6458-f103-4d95-ba39-dd2d4072550a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d44116e5c9a42b2bb8e5c22347a8799'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:45.297965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bdde6458-f103-4d95-ba39-dd2d4072550a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d44116e5c9a42b2bb8e5c22347a8799'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:45.308859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bdde6458-f103-4d95-ba39-dd2d4072550a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d44116e5c9a42b2bb8e5c22347a8799'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:45.321824 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1472/2971] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:48:44 2022] DELETE /identity/v3/users/1d44116e5c9a42b2bb8e5c22347a8799 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:48:45.323545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8569f5-73d5-4360-a155-3230ac4b4bff None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:45.324008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8569f5-73d5-4360-a155-3230ac4b4bff None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:45.324226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8569f5-73d5-4360-a155-3230ac4b4bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:45.345309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ff8569f5-73d5-4360-a155-3230ac4b4bff None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:45.346526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ff8569f5-73d5-4360-a155-3230ac4b4bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:45.469479 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1500/2972] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:45.496276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde6458-f103-4d95-ba39-dd2d4072550a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:45.500010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bdde6458-f103-4d95-ba39-dd2d4072550a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:45.637122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde6458-f103-4d95-ba39-dd2d4072550a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:45.642642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124024c-de39-4b0e-bbf0-1f072bb273d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:45.643391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124024c-de39-4b0e-bbf0-1f072bb273d8 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:45.644215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124024c-de39-4b0e-bbf0-1f072bb273d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:45.644215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124024c-de39-4b0e-bbf0-1f072bb273d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:45.657118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124024c-de39-4b0e-bbf0-1f072bb273d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:45.658988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124024c-de39-4b0e-bbf0-1f072bb273d8 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:45.674251 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1473/2973] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:45.716219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcacb7e-1c63-4b77-8384-c821835e7399 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:45.718034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcacb7e-1c63-4b77-8384-c821835e7399 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:45.718563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcacb7e-1c63-4b77-8384-c821835e7399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:45.752813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3fcacb7e-1c63-4b77-8384-c821835e7399 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:45.755385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3fcacb7e-1c63-4b77-8384-c821835e7399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:45.800741 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:45.923138 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1501/2974] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:48:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:45.942563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124024c-de39-4b0e-bbf0-1f072bb273d8 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:45.944102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d124024c-de39-4b0e-bbf0-1f072bb273d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:46.143429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124024c-de39-4b0e-bbf0-1f072bb273d8 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:46.163248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760c670-cddf-4450-853b-23597bf2d8d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:46.164451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760c670-cddf-4450-853b-23597bf2d8d9 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:46.164761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760c670-cddf-4450-853b-23597bf2d8d9 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:46.165239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760c670-cddf-4450-853b-23597bf2d8d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:46.194712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760c670-cddf-4450-853b-23597bf2d8d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:46.196549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760c670-cddf-4450-853b-23597bf2d8d9 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:46.241290 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1474/2975] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:48:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:48:47.707478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcacb7e-1c63-4b77-8384-c821835e7399 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:47.709812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3fcacb7e-1c63-4b77-8384-c821835e7399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:47.737900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcacb7e-1c63-4b77-8384-c821835e7399 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:47.752040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754ea3a-ac44-40d9-a542-4ee0fe24d1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:47.753104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754ea3a-ac44-40d9-a542-4ee0fe24d1cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:47.753633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754ea3a-ac44-40d9-a542-4ee0fe24d1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:47.755740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754ea3a-ac44-40d9-a542-4ee0fe24d1cd admin admin] PATH_INFO: `/v3/projects/64a4ad4460cb47768a9a66c8af7103ce` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:47.757367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754ea3a-ac44-40d9-a542-4ee0fe24d1cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=64a4ad4460cb47768a9a66c8af7103ce)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:47.760693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754ea3a-ac44-40d9-a542-4ee0fe24d1cd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:47.933955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c754ea3a-ac44-40d9-a542-4ee0fe24d1cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64a4ad4460cb47768a9a66c8af7103ce', 'request_id': 'req-c754ea3a-ac44-40d9-a542-4ee0fe24d1cd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:47.949769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c754ea3a-ac44-40d9-a542-4ee0fe24d1cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64a4ad4460cb47768a9a66c8af7103ce', 'request_id': 'req-c754ea3a-ac44-40d9-a542-4ee0fe24d1cd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:47.957502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c754ea3a-ac44-40d9-a542-4ee0fe24d1cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64a4ad4460cb47768a9a66c8af7103ce', 'request_id': 'req-c754ea3a-ac44-40d9-a542-4ee0fe24d1cd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:47.986453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c754ea3a-ac44-40d9-a542-4ee0fe24d1cd admin admin] The token cache is being invalidate because project 64a4ad4460cb47768a9a66c8af7103ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:48:47.986752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c754ea3a-ac44-40d9-a542-4ee0fe24d1cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:47.987485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c754ea3a-ac44-40d9-a542-4ee0fe24d1cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:47.989246 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1502/2976] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:48:47 2022] DELETE /identity/v3/projects/64a4ad4460cb47768a9a66c8af7103ce => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:48:47.996103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f9fe2-2b38-4f88-8c76-7b937b25e367 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:47.996972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f9fe2-2b38-4f88-8c76-7b937b25e367 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:47.997406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f9fe2-2b38-4f88-8c76-7b937b25e367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:48.037927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-218f9fe2-2b38-4f88-8c76-7b937b25e367 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:48.039737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-218f9fe2-2b38-4f88-8c76-7b937b25e367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:48.145421 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:48.155790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec3a71-1051-4b70-8734-32615d5994a4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:48.156372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec3a71-1051-4b70-8734-32615d5994a4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:48.156837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec3a71-1051-4b70-8734-32615d5994a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:48.187230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c0ec3a71-1051-4b70-8734-32615d5994a4 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:48.188663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c0ec3a71-1051-4b70-8734-32615d5994a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:48.195925 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1475/2977] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:48.197499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c91db9-8521-4213-a4e0-985bb9d6e7e2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:48.197858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c91db9-8521-4213-a4e0-985bb9d6e7e2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:48.198393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c91db9-8521-4213-a4e0-985bb9d6e7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:48.228088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a5c91db9-8521-4213-a4e0-985bb9d6e7e2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:48.229487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a5c91db9-8521-4213-a4e0-985bb9d6e7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:48.243751 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1476/2978] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:48.246702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c91db9-8521-4213-a4e0-985bb9d6e7e2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:48.259034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c91db9-8521-4213-a4e0-985bb9d6e7e2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:48.269161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f610dca-6795-4cf6-8884-f315c9e4b946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:48.270255 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f610dca-6795-4cf6-8884-f315c9e4b946 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:48.270640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f610dca-6795-4cf6-8884-f315c9e4b946 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:48.271013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f610dca-6795-4cf6-8884-f315c9e4b946 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:48.272702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f610dca-6795-4cf6-8884-f315c9e4b946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:48:48.274180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f610dca-6795-4cf6-8884-f315c9e4b946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:48.276979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f610dca-6795-4cf6-8884-f315c9e4b946 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:48.286319 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1503/2979] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:48:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:48:48.297727 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1477/2980] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:48:48.299731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f610dca-6795-4cf6-8884-f315c9e4b946 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:48.306073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec3a71-1051-4b70-8734-32615d5994a4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:48.308824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c0ec3a71-1051-4b70-8734-32615d5994a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:48.318572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f610dca-6795-4cf6-8884-f315c9e4b946 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:48.328004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19caf69-e3c1-4470-9dbb-a1ed4d48c171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:48.329059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19caf69-e3c1-4470-9dbb-a1ed4d48c171 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:48.329440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19caf69-e3c1-4470-9dbb-a1ed4d48c171 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:48.329828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19caf69-e3c1-4470-9dbb-a1ed4d48c171 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:48.331094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19caf69-e3c1-4470-9dbb-a1ed4d48c171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:48.333959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19caf69-e3c1-4470-9dbb-a1ed4d48c171 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:48.383966 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1478/2981] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:48:48 2022] POST /identity/v3/projects => generated 391 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:48:48.385016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19caf69-e3c1-4470-9dbb-a1ed4d48c171 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:48.410690 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:48.439603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec3a71-1051-4b70-8734-32615d5994a4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:48.480842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19caf69-e3c1-4470-9dbb-a1ed4d48c171 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:48.486449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce428684-ee0c-4f3a-bfff-536952b11f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:48.487487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce428684-ee0c-4f3a-bfff-536952b11f03 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:48.488173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce428684-ee0c-4f3a-bfff-536952b11f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:48.488173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce428684-ee0c-4f3a-bfff-536952b11f03 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:48.489011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce428684-ee0c-4f3a-bfff-536952b11f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:48.491016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce428684-ee0c-4f3a-bfff-536952b11f03 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:48.531214 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1479/2982] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:48:48 2022] POST /identity/v3/users => generated 296 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:48:48.544533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce428684-ee0c-4f3a-bfff-536952b11f03 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:48.562125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce428684-ee0c-4f3a-bfff-536952b11f03 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:48.578078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effd353-816d-453c-9bd0-454b628d71b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:48.581444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effd353-816d-453c-9bd0-454b628d71b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:48.581865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effd353-816d-453c-9bd0-454b628d71b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:48.582985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effd353-816d-453c-9bd0-454b628d71b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:48.583811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effd353-816d-453c-9bd0-454b628d71b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:48.586548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effd353-816d-453c-9bd0-454b628d71b2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:48.604468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97388eb6-0e50-48b0-8e3e-270c91adcdb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:48.607198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97388eb6-0e50-48b0-8e3e-270c91adcdb2 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:48.607605 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97388eb6-0e50-48b0-8e3e-270c91adcdb2 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:48.607981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97388eb6-0e50-48b0-8e3e-270c91adcdb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:48.619515 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1480/2983] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:48:48.620741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effd353-816d-453c-9bd0-454b628d71b2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:48.655440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effd353-816d-453c-9bd0-454b628d71b2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:48.666198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b285c7-2d91-40f1-a0ee-a18942515cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:48.666980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b285c7-2d91-40f1-a0ee-a18942515cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:48.667382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b285c7-2d91-40f1-a0ee-a18942515cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:48.667756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b285c7-2d91-40f1-a0ee-a18942515cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:48.668529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b285c7-2d91-40f1-a0ee-a18942515cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:48.670293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b285c7-2d91-40f1-a0ee-a18942515cb2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:48.705580 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1481/2984] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:48:48.711881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b285c7-2d91-40f1-a0ee-a18942515cb2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:48.731949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97388eb6-0e50-48b0-8e3e-270c91adcdb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:48.736824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b285c7-2d91-40f1-a0ee-a18942515cb2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:48.740528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97388eb6-0e50-48b0-8e3e-270c91adcdb2 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:48.744514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d11bd-afc4-44a1-9cea-b7ed130c955f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:48.745378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d11bd-afc4-44a1-9cea-b7ed130c955f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:48.745784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d11bd-afc4-44a1-9cea-b7ed130c955f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:48.746160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d11bd-afc4-44a1-9cea-b7ed130c955f admin admin] PATH_INFO: `/v3/projects/9be53460a8c44b6e9310b98ea7efd75c/users/e6162fbf250e4c668fb8669cb8affc19/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:48.754709 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1504/2985] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:48:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:48:48.785572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d11bd-afc4-44a1-9cea-b7ed130c955f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be53460a8c44b6e9310b98ea7efd75c, user_id=e6162fbf250e4c668fb8669cb8affc19, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:48.788577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d11bd-afc4-44a1-9cea-b7ed130c955f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:48.820365 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1482/2986] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:48:48 2022] PUT /identity/v3/projects/9be53460a8c44b6e9310b98ea7efd75c/users/e6162fbf250e4c668fb8669cb8affc19/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:48:48.821938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b3fd8-eed9-4827-b9c9-ebb246414182 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:48.822371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b3fd8-eed9-4827-b9c9-ebb246414182 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:48.823314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b3fd8-eed9-4827-b9c9-ebb246414182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:48.876157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7d4b3fd8-eed9-4827-b9c9-ebb246414182 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:48.879026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7d4b3fd8-eed9-4827-b9c9-ebb246414182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:49.012929 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1505/2987] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:49.063674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d11bd-afc4-44a1-9cea-b7ed130c955f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:49.065330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-341d11bd-afc4-44a1-9cea-b7ed130c955f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:49.223496 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:49.259348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d11bd-afc4-44a1-9cea-b7ed130c955f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:49.274815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e098d-578d-407f-8180-b5b326c61996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:49.275453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e098d-578d-407f-8180-b5b326c61996 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:49.275720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e098d-578d-407f-8180-b5b326c61996 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:49.275993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e098d-578d-407f-8180-b5b326c61996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:49.313837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e098d-578d-407f-8180-b5b326c61996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:49.320875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e098d-578d-407f-8180-b5b326c61996 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:49.346945 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1483/2988] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:51.099312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6ce96-dba3-4b69-acb0-5dd0d1676568 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:51.099856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6ce96-dba3-4b69-acb0-5dd0d1676568 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:51.101704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6ce96-dba3-4b69-acb0-5dd0d1676568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:51.149600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-35d6ce96-dba3-4b69-acb0-5dd0d1676568 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:51.150856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-35d6ce96-dba3-4b69-acb0-5dd0d1676568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:51.229497 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:51.264938 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1506/2989] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:48:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:51.279102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e098d-578d-407f-8180-b5b326c61996 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:51.508730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e098d-578d-407f-8180-b5b326c61996 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:51.537302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86022751-d94f-4bde-89a4-95a71658cb1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:51.537945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86022751-d94f-4bde-89a4-95a71658cb1a service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:51.538755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86022751-d94f-4bde-89a4-95a71658cb1a service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:51.539747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86022751-d94f-4bde-89a4-95a71658cb1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:51.565933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86022751-d94f-4bde-89a4-95a71658cb1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:51.569036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86022751-d94f-4bde-89a4-95a71658cb1a service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:51.588757 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1484/2990] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:48:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:48:52.630946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80803a6d-f601-43a8-bc0a-ffcb7ac81267 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:52.632526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80803a6d-f601-43a8-bc0a-ffcb7ac81267 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:52.633529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80803a6d-f601-43a8-bc0a-ffcb7ac81267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:52.681764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-80803a6d-f601-43a8-bc0a-ffcb7ac81267 None None] MFA Rules not processed for user `f33a618447b7460298236440b04cca66`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:52.683023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-80803a6d-f601-43a8-bc0a-ffcb7ac81267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:52.949805 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1507/2991] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:55.522327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bab99-debf-43c7-9ed2-b1adbb43c02f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:55.523572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bab99-debf-43c7-9ed2-b1adbb43c02f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:55.524019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bab99-debf-43c7-9ed2-b1adbb43c02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:55.585744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f43bab99-debf-43c7-9ed2-b1adbb43c02f None None] MFA Rules not processed for user `f33a618447b7460298236440b04cca66`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:55.586991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f43bab99-debf-43c7-9ed2-b1adbb43c02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:55.624483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf54bcc-bd0c-48a2-a828-ea432117eb8f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:55.625110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf54bcc-bd0c-48a2-a828-ea432117eb8f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:55.625489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf54bcc-bd0c-48a2-a828-ea432117eb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:55.639136 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1485/2992] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:55.692904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cbf54bcc-bd0c-48a2-a828-ea432117eb8f None None] MFA Rules not processed for user `960e2646c3174ad084c85b6de1e01822`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:55.694399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cbf54bcc-bd0c-48a2-a828-ea432117eb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:55.825667 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1508/2993] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:48:55.837477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eafd27-c2ed-47e6-bd93-6e35db1d4a41 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:55.837711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eafd27-c2ed-47e6-bd93-6e35db1d4a41 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:55.837987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eafd27-c2ed-47e6-bd93-6e35db1d4a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:55.868495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-46eafd27-c2ed-47e6-bd93-6e35db1d4a41 None None] MFA Rules not processed for user `960e2646c3174ad084c85b6de1e01822`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:55.870151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-46eafd27-c2ed-47e6-bd93-6e35db1d4a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:55.878553 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1486/2994] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:56.165934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf54bcc-bd0c-48a2-a828-ea432117eb8f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:56.167689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cbf54bcc-bd0c-48a2-a828-ea432117eb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:56.186583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf54bcc-bd0c-48a2-a828-ea432117eb8f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:56.197731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c89c35-aca9-4ff2-aafc-83e0bb1deb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:56.199908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c89c35-aca9-4ff2-aafc-83e0bb1deb68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:56.200263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c89c35-aca9-4ff2-aafc-83e0bb1deb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:56.201417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c89c35-aca9-4ff2-aafc-83e0bb1deb68 admin admin] PATH_INFO: `/v3/users/25b6ed4eb7894a8da99f20eb19c8af50` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:56.203081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c89c35-aca9-4ff2-aafc-83e0bb1deb68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25b6ed4eb7894a8da99f20eb19c8af50)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:56.206192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c89c35-aca9-4ff2-aafc-83e0bb1deb68 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:56.291642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84c89c35-aca9-4ff2-aafc-83e0bb1deb68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25b6ed4eb7894a8da99f20eb19c8af50'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:56.293444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84c89c35-aca9-4ff2-aafc-83e0bb1deb68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25b6ed4eb7894a8da99f20eb19c8af50'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:56.305552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84c89c35-aca9-4ff2-aafc-83e0bb1deb68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25b6ed4eb7894a8da99f20eb19c8af50'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:56.323321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84c89c35-aca9-4ff2-aafc-83e0bb1deb68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25b6ed4eb7894a8da99f20eb19c8af50'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:56.327410 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:56.342462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84c89c35-aca9-4ff2-aafc-83e0bb1deb68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25b6ed4eb7894a8da99f20eb19c8af50'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:56.360709 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1509/2995] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:48:56 2022] DELETE /identity/v3/users/25b6ed4eb7894a8da99f20eb19c8af50 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:48:56.750776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eafd27-c2ed-47e6-bd93-6e35db1d4a41 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:56.768060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eafd27-c2ed-47e6-bd93-6e35db1d4a41 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:56.938415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c89c35-aca9-4ff2-aafc-83e0bb1deb68 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:56.941809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-84c89c35-aca9-4ff2-aafc-83e0bb1deb68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:56.954008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c2b12-1b79-4511-a4b4-b7fd138368bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:56.957250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c2b12-1b79-4511-a4b4-b7fd138368bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:56.959769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c2b12-1b79-4511-a4b4-b7fd138368bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:56.960835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c2b12-1b79-4511-a4b4-b7fd138368bf admin admin] PATH_INFO: `/v3/projects/a63e4f22c26846348aac6e673d7b8ff3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:56.966094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c2b12-1b79-4511-a4b4-b7fd138368bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a63e4f22c26846348aac6e673d7b8ff3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:56.972283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c2b12-1b79-4511-a4b4-b7fd138368bf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:57.102624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-766c2b12-1b79-4511-a4b4-b7fd138368bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a63e4f22c26846348aac6e673d7b8ff3', 'request_id': 'req-766c2b12-1b79-4511-a4b4-b7fd138368bf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:57.111246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-766c2b12-1b79-4511-a4b4-b7fd138368bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a63e4f22c26846348aac6e673d7b8ff3', 'request_id': 'req-766c2b12-1b79-4511-a4b4-b7fd138368bf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:57.122600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-766c2b12-1b79-4511-a4b4-b7fd138368bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a63e4f22c26846348aac6e673d7b8ff3', 'request_id': 'req-766c2b12-1b79-4511-a4b4-b7fd138368bf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:57.124572 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:57.144085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-766c2b12-1b79-4511-a4b4-b7fd138368bf admin admin] The token cache is being invalidate because project a63e4f22c26846348aac6e673d7b8ff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:48:57.144482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-766c2b12-1b79-4511-a4b4-b7fd138368bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:57.145459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-766c2b12-1b79-4511-a4b4-b7fd138368bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:48:57.148657 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1487/2996] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:48:56 2022] DELETE /identity/v3/projects/a63e4f22c26846348aac6e673d7b8ff3 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:48:57.153726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3f2ed-7fe7-41ca-a1a5-1f28c84e3421 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:57.154295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3f2ed-7fe7-41ca-a1a5-1f28c84e3421 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:57.154822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3f2ed-7fe7-41ca-a1a5-1f28c84e3421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:57.186363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-92e3f2ed-7fe7-41ca-a1a5-1f28c84e3421 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:57.188111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-92e3f2ed-7fe7-41ca-a1a5-1f28c84e3421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:57.223397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c89c35-aca9-4ff2-aafc-83e0bb1deb68 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:57.292689 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1488/2997] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:48:57.297494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ac74e-7e2d-4418-af02-0309de951313 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:57.297783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ac74e-7e2d-4418-af02-0309de951313 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:57.298059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ac74e-7e2d-4418-af02-0309de951313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:57.329408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2e6ac74e-7e2d-4418-af02-0309de951313 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:57.331071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2e6ac74e-7e2d-4418-af02-0309de951313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:57.345685 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1489/2998] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:57.347389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ac74e-7e2d-4418-af02-0309de951313 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:57.360724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ac74e-7e2d-4418-af02-0309de951313 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:57.367001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817296b0-10b3-490c-a566-9078523df70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:57.367618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817296b0-10b3-490c-a566-9078523df70f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:57.368018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817296b0-10b3-490c-a566-9078523df70f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:57.368340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817296b0-10b3-490c-a566-9078523df70f admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:57.369875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817296b0-10b3-490c-a566-9078523df70f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:48:57.370183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817296b0-10b3-490c-a566-9078523df70f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:57.371110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a72923-f962-4df3-bcae-1bbe1663334b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:57.371728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a72923-f962-4df3-bcae-1bbe1663334b service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:57.371851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817296b0-10b3-490c-a566-9078523df70f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:57.372041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a72923-f962-4df3-bcae-1bbe1663334b service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:57.372257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a72923-f962-4df3-bcae-1bbe1663334b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:57.379334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-03a72923-f962-4df3-bcae-1bbe1663334b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:57.394185 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1490/2999] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:48:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:48:57.396117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817296b0-10b3-490c-a566-9078523df70f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:57.408594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817296b0-10b3-490c-a566-9078523df70f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:57.415708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2f580-7bc0-4562-8ab3-90b3dabc616f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:57.416334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2f580-7bc0-4562-8ab3-90b3dabc616f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:57.416591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2f580-7bc0-4562-8ab3-90b3dabc616f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:57.416892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2f580-7bc0-4562-8ab3-90b3dabc616f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:57.417531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2f580-7bc0-4562-8ab3-90b3dabc616f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:57.420123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2f580-7bc0-4562-8ab3-90b3dabc616f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:57.457815 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1491/3000] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:48:57 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:48:57.465605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2f580-7bc0-4562-8ab3-90b3dabc616f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:57.490068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a72923-f962-4df3-bcae-1bbe1663334b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:57.491763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a72923-f962-4df3-bcae-1bbe1663334b service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:57.518684 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1510/3001] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:57.668666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2f580-7bc0-4562-8ab3-90b3dabc616f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:57.682228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e7055-7180-4810-9df1-13d8de5964fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:57.683880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e7055-7180-4810-9df1-13d8de5964fc admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:57.684344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e7055-7180-4810-9df1-13d8de5964fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:57.684826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e7055-7180-4810-9df1-13d8de5964fc admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:57.685482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e7055-7180-4810-9df1-13d8de5964fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:57.687442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e7055-7180-4810-9df1-13d8de5964fc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:57.747009 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1492/3002] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:48:57 2022] POST /identity/v3/users => generated 294 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:48:57.751126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a72923-f962-4df3-bcae-1bbe1663334b service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:57.777036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a72923-f962-4df3-bcae-1bbe1663334b service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:57.790838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11ea89-9dc9-40b6-85b5-dfef07dca3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:57.792639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11ea89-9dc9-40b6-85b5-dfef07dca3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:57.794626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11ea89-9dc9-40b6-85b5-dfef07dca3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:57.794907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11ea89-9dc9-40b6-85b5-dfef07dca3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:57.796526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11ea89-9dc9-40b6-85b5-dfef07dca3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:57.801143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11ea89-9dc9-40b6-85b5-dfef07dca3f8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:57.851896 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1511/3003] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:48:57.855440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e7055-7180-4810-9df1-13d8de5964fc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:57.880085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e7055-7180-4810-9df1-13d8de5964fc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:57.898281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ca810-0f46-40a6-ba15-367f32d5c15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:57.899124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ca810-0f46-40a6-ba15-367f32d5c15a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:57.899584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ca810-0f46-40a6-ba15-367f32d5c15a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:57.899871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ca810-0f46-40a6-ba15-367f32d5c15a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:57.900537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ca810-0f46-40a6-ba15-367f32d5c15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:57.905421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ca810-0f46-40a6-ba15-367f32d5c15a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:57.951936 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1493/3004] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:48:57.953284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11ea89-9dc9-40b6-85b5-dfef07dca3f8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:57.967465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11ea89-9dc9-40b6-85b5-dfef07dca3f8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:57.994075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3b773-05cb-4a96-b97b-470f46b66e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:58.007963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b773-05cb-4a96-b97b-470f46b66e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:58.016594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b773-05cb-4a96-b97b-470f46b66e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:58.017477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b773-05cb-4a96-b97b-470f46b66e68 admin admin] PATH_INFO: `/v3/projects/0b5f7799c113423691f454c397bc132f/users/60a8a6bc8f4d448ab7934341383e769f/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:58.057950 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:58.073586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3b773-05cb-4a96-b97b-470f46b66e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b5f7799c113423691f454c397bc132f, user_id=60a8a6bc8f4d448ab7934341383e769f, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:58.084280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3b773-05cb-4a96-b97b-470f46b66e68 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:58.130792 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1512/3005] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:48:57 2022] PUT /identity/v3/projects/0b5f7799c113423691f454c397bc132f/users/60a8a6bc8f4d448ab7934341383e769f/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:48:58.137275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ca7d4-7ae8-4bd4-90e5-cba9aea3a6c4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:58.137812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ca7d4-7ae8-4bd4-90e5-cba9aea3a6c4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:58.138440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ca7d4-7ae8-4bd4-90e5-cba9aea3a6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:58.184156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0a4ca7d4-7ae8-4bd4-90e5-cba9aea3a6c4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:48:58.185416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0a4ca7d4-7ae8-4bd4-90e5-cba9aea3a6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:58.270890 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:48:58.359989 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1494/3006] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:48:58.382957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3b773-05cb-4a96-b97b-470f46b66e68 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:58.385195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-84a3b773-05cb-4a96-b97b-470f46b66e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:58.482155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3b773-05cb-4a96-b97b-470f46b66e68 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:58.486531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe880c4-102a-4b23-8a47-7843f5f7b5f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:58.487567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe880c4-102a-4b23-8a47-7843f5f7b5f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:58.488091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe880c4-102a-4b23-8a47-7843f5f7b5f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:58.488513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe880c4-102a-4b23-8a47-7843f5f7b5f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:58.502222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe880c4-102a-4b23-8a47-7843f5f7b5f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:58.504873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe880c4-102a-4b23-8a47-7843f5f7b5f6 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:58.524402 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1513/3007] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:48:59.339490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ca7d4-7ae8-4bd4-90e5-cba9aea3a6c4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:48:59.341716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0a4ca7d4-7ae8-4bd4-90e5-cba9aea3a6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:59.363615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ca7d4-7ae8-4bd4-90e5-cba9aea3a6c4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:48:59.384093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93885c34-041b-4b53-a883-d42ca49ffb8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:48:59.384980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93885c34-041b-4b53-a883-d42ca49ffb8c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:48:59.385417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93885c34-041b-4b53-a883-d42ca49ffb8c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:48:59.387004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93885c34-041b-4b53-a883-d42ca49ffb8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:48:59.394318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-93885c34-041b-4b53-a883-d42ca49ffb8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:48:59.432486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93885c34-041b-4b53-a883-d42ca49ffb8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:48:59.433962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93885c34-041b-4b53-a883-d42ca49ffb8c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:48:59.457898 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1495/3008] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:48:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:49:02.559476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe880c4-102a-4b23-8a47-7843f5f7b5f6 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:02.560930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4fe880c4-102a-4b23-8a47-7843f5f7b5f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:02.583542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe880c4-102a-4b23-8a47-7843f5f7b5f6 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:02.597793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4b992-de57-413f-b475-1c8d1388a09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:02.599045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4b992-de57-413f-b475-1c8d1388a09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:02.599334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4b992-de57-413f-b475-1c8d1388a09f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:02.599820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4b992-de57-413f-b475-1c8d1388a09f admin admin] PATH_INFO: `/v3/users/22e55fa3cbc34ea19c099f2859dd7ab5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:02.601715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4b992-de57-413f-b475-1c8d1388a09f admin admin] RBAC: Authorizing `identity:delete_user(user_id=22e55fa3cbc34ea19c099f2859dd7ab5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:02.604292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4b992-de57-413f-b475-1c8d1388a09f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:02.705978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fee4b992-de57-413f-b475-1c8d1388a09f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22e55fa3cbc34ea19c099f2859dd7ab5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:02.711505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fee4b992-de57-413f-b475-1c8d1388a09f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22e55fa3cbc34ea19c099f2859dd7ab5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:02.729796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fee4b992-de57-413f-b475-1c8d1388a09f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22e55fa3cbc34ea19c099f2859dd7ab5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:02.764521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fee4b992-de57-413f-b475-1c8d1388a09f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22e55fa3cbc34ea19c099f2859dd7ab5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:02.782447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fee4b992-de57-413f-b475-1c8d1388a09f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22e55fa3cbc34ea19c099f2859dd7ab5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:02.813379 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1514/3009] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:49:02 2022] DELETE /identity/v3/users/22e55fa3cbc34ea19c099f2859dd7ab5 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:49:02.818607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb6d4d-d4d0-448f-96d5-afb86fabbcd5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:02.820310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb6d4d-d4d0-448f-96d5-afb86fabbcd5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:02.820771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb6d4d-d4d0-448f-96d5-afb86fabbcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:02.857917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8feb6d4d-d4d0-448f-96d5-afb86fabbcd5 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:49:02.859140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8feb6d4d-d4d0-448f-96d5-afb86fabbcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:03.009898 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1496/3010] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:49:03.148314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4b992-de57-413f-b475-1c8d1388a09f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:03.150284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fee4b992-de57-413f-b475-1c8d1388a09f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:03.304873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4b992-de57-413f-b475-1c8d1388a09f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:03.309965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26766a18-4017-47ac-b438-48a85c951f80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:03.311037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26766a18-4017-47ac-b438-48a85c951f80 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:03.311551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26766a18-4017-47ac-b438-48a85c951f80 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:03.311990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26766a18-4017-47ac-b438-48a85c951f80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:03.328226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26766a18-4017-47ac-b438-48a85c951f80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:03.330097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26766a18-4017-47ac-b438-48a85c951f80 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:03.342646 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1515/3011] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:49:03.724451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb6d4d-d4d0-448f-96d5-afb86fabbcd5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:03.728279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8feb6d4d-d4d0-448f-96d5-afb86fabbcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:03.930572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb6d4d-d4d0-448f-96d5-afb86fabbcd5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:03.938075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f2585-c0f9-4be0-9f22-e186a469aa1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:03.939255 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f2585-c0f9-4be0-9f22-e186a469aa1e service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:03.939783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f2585-c0f9-4be0-9f22-e186a469aa1e service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:03.940461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f2585-c0f9-4be0-9f22-e186a469aa1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:03.942761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-061f2585-c0f9-4be0-9f22-e186a469aa1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:04.079105 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:49:04.082233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f2585-c0f9-4be0-9f22-e186a469aa1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:04.084248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f2585-c0f9-4be0-9f22-e186a469aa1e service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:04.105006 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1497/3012] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:49:03 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:49:05.170321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26766a18-4017-47ac-b438-48a85c951f80 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:05.172481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-26766a18-4017-47ac-b438-48a85c951f80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:05.222780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26766a18-4017-47ac-b438-48a85c951f80 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:05.235874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0b15e-cd17-48fc-a471-046957e771c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:05.238685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0b15e-cd17-48fc-a471-046957e771c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:05.239227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0b15e-cd17-48fc-a471-046957e771c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:05.240408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0b15e-cd17-48fc-a471-046957e771c9 admin admin] PATH_INFO: `/v3/projects/bf5fd568163342f09d7d60e01ffd65aa` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:05.243947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0b15e-cd17-48fc-a471-046957e771c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf5fd568163342f09d7d60e01ffd65aa)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:05.247309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0b15e-cd17-48fc-a471-046957e771c9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:05.254491 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:49:05.362746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-09e0b15e-cd17-48fc-a471-046957e771c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf5fd568163342f09d7d60e01ffd65aa', 'request_id': 'req-09e0b15e-cd17-48fc-a471-046957e771c9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:05.381916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-09e0b15e-cd17-48fc-a471-046957e771c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf5fd568163342f09d7d60e01ffd65aa', 'request_id': 'req-09e0b15e-cd17-48fc-a471-046957e771c9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:05.392512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-09e0b15e-cd17-48fc-a471-046957e771c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf5fd568163342f09d7d60e01ffd65aa', 'request_id': 'req-09e0b15e-cd17-48fc-a471-046957e771c9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:05.426463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-09e0b15e-cd17-48fc-a471-046957e771c9 admin admin] The token cache is being invalidate because project bf5fd568163342f09d7d60e01ffd65aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:49:05.429726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-09e0b15e-cd17-48fc-a471-046957e771c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:05.436483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-09e0b15e-cd17-48fc-a471-046957e771c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:05.442414 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1516/3013] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:49:05 2022] DELETE /identity/v3/projects/bf5fd568163342f09d7d60e01ffd65aa => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:49:05.446239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f2585-c0f9-4be0-9f22-e186a469aa1e service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:05.460462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f2585-c0f9-4be0-9f22-e186a469aa1e service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:05.650733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23745f32-3a20-4895-a666-3ca46cf09b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:05.654956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23745f32-3a20-4895-a666-3ca46cf09b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:05.658998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23745f32-3a20-4895-a666-3ca46cf09b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:05.659702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23745f32-3a20-4895-a666-3ca46cf09b6e admin admin] PATH_INFO: `/v3/users/56aa8cc730e9434399e2a86196d2cf32` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:05.669865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23745f32-3a20-4895-a666-3ca46cf09b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=56aa8cc730e9434399e2a86196d2cf32)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:05.675413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23745f32-3a20-4895-a666-3ca46cf09b6e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:05.802200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-23745f32-3a20-4895-a666-3ca46cf09b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56aa8cc730e9434399e2a86196d2cf32'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:05.831021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-23745f32-3a20-4895-a666-3ca46cf09b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56aa8cc730e9434399e2a86196d2cf32'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:05.831908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-23745f32-3a20-4895-a666-3ca46cf09b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56aa8cc730e9434399e2a86196d2cf32'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:05.883152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-23745f32-3a20-4895-a666-3ca46cf09b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56aa8cc730e9434399e2a86196d2cf32'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:05.894557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-23745f32-3a20-4895-a666-3ca46cf09b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56aa8cc730e9434399e2a86196d2cf32'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:05.905930 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1498/3014] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:49:05 2022] DELETE /identity/v3/users/56aa8cc730e9434399e2a86196d2cf32 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:49:07.777722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0b15e-cd17-48fc-a471-046957e771c9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:07.779546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-09e0b15e-cd17-48fc-a471-046957e771c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:07.805291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0b15e-cd17-48fc-a471-046957e771c9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:07.954808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb5975-a8e9-49e3-807d-2ec332dfb74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:07.955461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb5975-a8e9-49e3-807d-2ec332dfb74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:07.955739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb5975-a8e9-49e3-807d-2ec332dfb74d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:07.956005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb5975-a8e9-49e3-807d-2ec332dfb74d admin admin] PATH_INFO: `/v3/projects/3f131a57649f410380d5e4e9ac51bd28` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:07.962641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb5975-a8e9-49e3-807d-2ec332dfb74d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f131a57649f410380d5e4e9ac51bd28)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:07.965356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb5975-a8e9-49e3-807d-2ec332dfb74d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:08.072163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a5eb5975-a8e9-49e3-807d-2ec332dfb74d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f131a57649f410380d5e4e9ac51bd28', 'request_id': 'req-a5eb5975-a8e9-49e3-807d-2ec332dfb74d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:08.092771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a5eb5975-a8e9-49e3-807d-2ec332dfb74d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f131a57649f410380d5e4e9ac51bd28', 'request_id': 'req-a5eb5975-a8e9-49e3-807d-2ec332dfb74d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:08.101079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a5eb5975-a8e9-49e3-807d-2ec332dfb74d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f131a57649f410380d5e4e9ac51bd28', 'request_id': 'req-a5eb5975-a8e9-49e3-807d-2ec332dfb74d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:08.117162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a5eb5975-a8e9-49e3-807d-2ec332dfb74d admin admin] The token cache is being invalidate because project 3f131a57649f410380d5e4e9ac51bd28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:49:08.117810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a5eb5975-a8e9-49e3-807d-2ec332dfb74d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:08.118734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a5eb5975-a8e9-49e3-807d-2ec332dfb74d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:08.121872 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1517/3015] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:49:07 2022] DELETE /identity/v3/projects/3f131a57649f410380d5e4e9ac51bd28 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:49:08.126626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c727b59-0f99-4748-a0fd-89e469fd6bff None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:08.127142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c727b59-0f99-4748-a0fd-89e469fd6bff None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:08.127142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c727b59-0f99-4748-a0fd-89e469fd6bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:08.171594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4c727b59-0f99-4748-a0fd-89e469fd6bff None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:49:08.172971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4c727b59-0f99-4748-a0fd-89e469fd6bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:08.300981 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1499/3016] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:49:08.301786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2f09e-57d1-4cb0-947c-e166fb2c9ccc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:08.302073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2f09e-57d1-4cb0-947c-e166fb2c9ccc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:08.302353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2f09e-57d1-4cb0-947c-e166fb2c9ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:08.358858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-99c2f09e-57d1-4cb0-947c-e166fb2c9ccc None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:49:08.362718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-99c2f09e-57d1-4cb0-947c-e166fb2c9ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:08.397822 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1518/3017] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:49:08.401838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c727b59-0f99-4748-a0fd-89e469fd6bff None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:08.415394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c727b59-0f99-4748-a0fd-89e469fd6bff None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:08.432645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e261a7-41ca-4fe8-939a-ea007b64a38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:08.433490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e261a7-41ca-4fe8-939a-ea007b64a38a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:08.433915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e261a7-41ca-4fe8-939a-ea007b64a38a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:08.434197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e261a7-41ca-4fe8-939a-ea007b64a38a admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:08.434860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e261a7-41ca-4fe8-939a-ea007b64a38a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:49:08.435158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e261a7-41ca-4fe8-939a-ea007b64a38a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:08.437810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e261a7-41ca-4fe8-939a-ea007b64a38a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:08.483640 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1500/3018] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:49:08.488738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2f09e-57d1-4cb0-947c-e166fb2c9ccc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:08.506974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2f09e-57d1-4cb0-947c-e166fb2c9ccc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:08.516236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bb8dd-e540-4e8d-addb-31be9eebbd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:08.528832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bb8dd-e540-4e8d-addb-31be9eebbd4b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:08.529385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bb8dd-e540-4e8d-addb-31be9eebbd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:08.529816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bb8dd-e540-4e8d-addb-31be9eebbd4b admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:08.530844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623bb8dd-e540-4e8d-addb-31be9eebbd4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:08.540950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623bb8dd-e540-4e8d-addb-31be9eebbd4b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:08.589365 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:49:08.618452 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1519/3019] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:49:08 2022] POST /identity/v3/projects => generated 395 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:49:08.619722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e261a7-41ca-4fe8-939a-ea007b64a38a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:08.625764 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:49:08.634901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e261a7-41ca-4fe8-939a-ea007b64a38a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:08.645639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb4c64-c3e2-41cd-b838-07b09f20304e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:08.646008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb4c64-c3e2-41cd-b838-07b09f20304e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:08.646289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb4c64-c3e2-41cd-b838-07b09f20304e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:08.675518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4deb4c64-c3e2-41cd-b838-07b09f20304e None None] MFA Rules not processed for user `5ee27b6e2411469d9ef72ad8a7e6491f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:49:08.677116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4deb4c64-c3e2-41cd-b838-07b09f20304e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:08.763438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61afaad-2f15-4951-9fb5-80f9697addaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:08.764203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61afaad-2f15-4951-9fb5-80f9697addaf admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:08.764489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61afaad-2f15-4951-9fb5-80f9697addaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:08.764884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61afaad-2f15-4951-9fb5-80f9697addaf admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:08.765466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61afaad-2f15-4951-9fb5-80f9697addaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:08.769556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61afaad-2f15-4951-9fb5-80f9697addaf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:08.810856 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1501/3020] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:49:08 2022] POST /identity/v3/users => generated 298 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:49:08.814422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61afaad-2f15-4951-9fb5-80f9697addaf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:08.819667 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1520/3021] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:49:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:49:08.825840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61afaad-2f15-4951-9fb5-80f9697addaf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:08.831529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64da1de-04ce-4822-b506-cb94f166a83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:08.832125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64da1de-04ce-4822-b506-cb94f166a83b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:08.832408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64da1de-04ce-4822-b506-cb94f166a83b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:08.832704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64da1de-04ce-4822-b506-cb94f166a83b admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:08.833430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64da1de-04ce-4822-b506-cb94f166a83b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:08.835671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64da1de-04ce-4822-b506-cb94f166a83b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:08.863928 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1502/3022] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:49:08.867835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb4c64-c3e2-41cd-b838-07b09f20304e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:08.887770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb4c64-c3e2-41cd-b838-07b09f20304e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:08.896353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029d512-9e31-4c94-ad41-8e594f905374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:08.897895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029d512-9e31-4c94-ad41-8e594f905374 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:08.898410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029d512-9e31-4c94-ad41-8e594f905374 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:08.898913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029d512-9e31-4c94-ad41-8e594f905374 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:08.900005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029d512-9e31-4c94-ad41-8e594f905374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:08.902879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029d512-9e31-4c94-ad41-8e594f905374 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:08.924833 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1521/3023] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:49:08.930102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64da1de-04ce-4822-b506-cb94f166a83b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:08.986142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64da1de-04ce-4822-b506-cb94f166a83b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:09.006703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2734b-8be6-435f-b344-d969f4b50112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:09.010400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2734b-8be6-435f-b344-d969f4b50112 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:09.013628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2734b-8be6-435f-b344-d969f4b50112 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:09.014834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2734b-8be6-435f-b344-d969f4b50112 admin admin] PATH_INFO: `/v3/projects/5a4b169ebe854d8fbad33c208207f0b5/users/54396be2ed794cf586c219ddf1b06521/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:09.070091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2734b-8be6-435f-b344-d969f4b50112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4b169ebe854d8fbad33c208207f0b5, user_id=54396be2ed794cf586c219ddf1b06521, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:09.076523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2734b-8be6-435f-b344-d969f4b50112 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:09.124642 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1503/3024] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:49:08 2022] PUT /identity/v3/projects/5a4b169ebe854d8fbad33c208207f0b5/users/54396be2ed794cf586c219ddf1b06521/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:49:09.132320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cae03-e99f-4055-ad36-8cb8d89c5880 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:09.133075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cae03-e99f-4055-ad36-8cb8d89c5880 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:09.133574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cae03-e99f-4055-ad36-8cb8d89c5880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:09.270966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2e4cae03-e99f-4055-ad36-8cb8d89c5880 None None] MFA Rules not processed for user `54396be2ed794cf586c219ddf1b06521`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:49:09.275780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2e4cae03-e99f-4055-ad36-8cb8d89c5880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:09.456643 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1522/3025] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:49:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:49:09.461631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2734b-8be6-435f-b344-d969f4b50112 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:09.578481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2734b-8be6-435f-b344-d969f4b50112 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:09.584423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28a643-1c83-4b06-bf8a-ed8249b097c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:09.586298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28a643-1c83-4b06-bf8a-ed8249b097c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:09.586298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28a643-1c83-4b06-bf8a-ed8249b097c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:09.586298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28a643-1c83-4b06-bf8a-ed8249b097c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:09.586669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28a643-1c83-4b06-bf8a-ed8249b097c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:09.589033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28a643-1c83-4b06-bf8a-ed8249b097c3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:09.660067 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1504/3026] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:49:09 2022] POST /identity/v3/projects => generated 395 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:49:09.683803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cae03-e99f-4055-ad36-8cb8d89c5880 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:09.701062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cae03-e99f-4055-ad36-8cb8d89c5880 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:09.827585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2d3bb-d915-4ad0-b35f-744b8c5c5a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:09.829156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2d3bb-d915-4ad0-b35f-744b8c5c5a6e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:09.829819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2d3bb-d915-4ad0-b35f-744b8c5c5a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:09.830413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2d3bb-d915-4ad0-b35f-744b8c5c5a6e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:09.831588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2d3bb-d915-4ad0-b35f-744b8c5c5a6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:09.835361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2d3bb-d915-4ad0-b35f-744b8c5c5a6e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:09.896210 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1523/3027] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:49:09 2022] POST /identity/v3/users => generated 304 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:49:09.900019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28a643-1c83-4b06-bf8a-ed8249b097c3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:09.914623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28a643-1c83-4b06-bf8a-ed8249b097c3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:09.933259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaceed76-4750-4bc7-9fc0-639b862bc064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:09.934023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaceed76-4750-4bc7-9fc0-639b862bc064 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:09.934365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaceed76-4750-4bc7-9fc0-639b862bc064 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:09.934698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaceed76-4750-4bc7-9fc0-639b862bc064 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:09.935356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaceed76-4750-4bc7-9fc0-639b862bc064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:09.939029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaceed76-4750-4bc7-9fc0-639b862bc064 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:09.952050 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1505/3028] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:49:09.956252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2d3bb-d915-4ad0-b35f-744b8c5c5a6e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:09.973002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2d3bb-d915-4ad0-b35f-744b8c5c5a6e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:09.980930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a5aa6-fdf2-49ee-a8bc-d3bba9f45689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:09.982041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a5aa6-fdf2-49ee-a8bc-d3bba9f45689 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:09.982573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a5aa6-fdf2-49ee-a8bc-d3bba9f45689 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:09.983067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a5aa6-fdf2-49ee-a8bc-d3bba9f45689 admin admin] PATH_INFO: `/v3/projects/ae91ad494625486598717ce0dad1fdf6/users/adad109bb87e42af879f27385da88671/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:09.988716 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:49:10.035098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a5aa6-fdf2-49ee-a8bc-d3bba9f45689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae91ad494625486598717ce0dad1fdf6, user_id=adad109bb87e42af879f27385da88671, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:10.038722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a5aa6-fdf2-49ee-a8bc-d3bba9f45689 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:10.067942 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1524/3029] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:49:09 2022] PUT /identity/v3/projects/ae91ad494625486598717ce0dad1fdf6/users/adad109bb87e42af879f27385da88671/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:49:10.072336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaceed76-4750-4bc7-9fc0-639b862bc064 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:10.087389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaceed76-4750-4bc7-9fc0-639b862bc064 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:10.163776 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:49:10.342009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1452ea6-4be7-4b9b-9224-0afa1e3d3798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:10.343740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1452ea6-4be7-4b9b-9224-0afa1e3d3798 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:10.345954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1452ea6-4be7-4b9b-9224-0afa1e3d3798 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:10.346499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1452ea6-4be7-4b9b-9224-0afa1e3d3798 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:10.347709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1452ea6-4be7-4b9b-9224-0afa1e3d3798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:10.349617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1452ea6-4be7-4b9b-9224-0afa1e3d3798 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:10.364925 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1506/3030] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:49:10.369325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a5aa6-fdf2-49ee-a8bc-d3bba9f45689 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:10.383156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a5aa6-fdf2-49ee-a8bc-d3bba9f45689 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:10.394793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f43f6c-ec7f-4637-8c85-1152e319316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:10.395837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f43f6c-ec7f-4637-8c85-1152e319316a admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:10.396354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f43f6c-ec7f-4637-8c85-1152e319316a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:10.397169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f43f6c-ec7f-4637-8c85-1152e319316a admin admin] PATH_INFO: `/v3/projects/ae91ad494625486598717ce0dad1fdf6/users/adad109bb87e42af879f27385da88671/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:10.399997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f43f6c-ec7f-4637-8c85-1152e319316a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae91ad494625486598717ce0dad1fdf6, user_id=adad109bb87e42af879f27385da88671, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:10.403372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f43f6c-ec7f-4637-8c85-1152e319316a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:10.426116 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1525/3031] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:49:10 2022] PUT /identity/v3/projects/ae91ad494625486598717ce0dad1fdf6/users/adad109bb87e42af879f27385da88671/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:49:10.427190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a3dd1-f8a6-4835-87e6-90ad235328ab None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:10.427502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a3dd1-f8a6-4835-87e6-90ad235328ab None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:10.427776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a3dd1-f8a6-4835-87e6-90ad235328ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:10.508406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9b2a3dd1-f8a6-4835-87e6-90ad235328ab None None] MFA Rules not processed for user `adad109bb87e42af879f27385da88671`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:49:10.510621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9b2a3dd1-f8a6-4835-87e6-90ad235328ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:10.657422 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1507/3032] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:49:10 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:49:10.707085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f43f6c-ec7f-4637-8c85-1152e319316a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:10.711420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e6f43f6c-ec7f-4637-8c85-1152e319316a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:10.814762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f43f6c-ec7f-4637-8c85-1152e319316a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:10.824231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d09dba-86bb-4e67-8fe7-491fa64ea7d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:10.825625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d09dba-86bb-4e67-8fe7-491fa64ea7d6 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:10.826075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d09dba-86bb-4e67-8fe7-491fa64ea7d6 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:10.826530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d09dba-86bb-4e67-8fe7-491fa64ea7d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:10.839212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d09dba-86bb-4e67-8fe7-491fa64ea7d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:10.841833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d09dba-86bb-4e67-8fe7-491fa64ea7d6 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:10.866393 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1526/3033] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:49:10 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:49:11.451630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a3dd1-f8a6-4835-87e6-90ad235328ab None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:11.453095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9b2a3dd1-f8a6-4835-87e6-90ad235328ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:11.481876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a3dd1-f8a6-4835-87e6-90ad235328ab None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:11.489269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581ec50-3124-45ff-bcc4-7db1572211b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:11.490174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581ec50-3124-45ff-bcc4-7db1572211b7 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:11.491265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581ec50-3124-45ff-bcc4-7db1572211b7 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:11.491727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581ec50-3124-45ff-bcc4-7db1572211b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:11.607659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581ec50-3124-45ff-bcc4-7db1572211b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:11.610969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581ec50-3124-45ff-bcc4-7db1572211b7 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:11.679461 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1508/3034] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:49:11 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:49:11.701109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d09dba-86bb-4e67-8fe7-491fa64ea7d6 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:11.847218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d09dba-86bb-4e67-8fe7-491fa64ea7d6 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:11.869575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17775d1b-9374-4fc0-95d3-13af06dfe637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:11.870859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17775d1b-9374-4fc0-95d3-13af06dfe637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:11.872924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17775d1b-9374-4fc0-95d3-13af06dfe637 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:11.873634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17775d1b-9374-4fc0-95d3-13af06dfe637 admin admin] PATH_INFO: `/v3/users/54396be2ed794cf586c219ddf1b06521` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:11.876097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17775d1b-9374-4fc0-95d3-13af06dfe637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54396be2ed794cf586c219ddf1b06521)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:11.879453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17775d1b-9374-4fc0-95d3-13af06dfe637 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:11.997857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-17775d1b-9374-4fc0-95d3-13af06dfe637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54396be2ed794cf586c219ddf1b06521'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:12.003604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-17775d1b-9374-4fc0-95d3-13af06dfe637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54396be2ed794cf586c219ddf1b06521'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:12.027765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-17775d1b-9374-4fc0-95d3-13af06dfe637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54396be2ed794cf586c219ddf1b06521'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:12.034233 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:49:12.080182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-17775d1b-9374-4fc0-95d3-13af06dfe637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54396be2ed794cf586c219ddf1b06521'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:12.101189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-17775d1b-9374-4fc0-95d3-13af06dfe637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54396be2ed794cf586c219ddf1b06521'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:12.123212 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1527/3035] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:49:11 2022] DELETE /identity/v3/users/54396be2ed794cf586c219ddf1b06521 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:49:12.124186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800ebb1-5834-4261-bb1b-0a68990bb307 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:12.124475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800ebb1-5834-4261-bb1b-0a68990bb307 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:12.124846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800ebb1-5834-4261-bb1b-0a68990bb307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:12.167735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6800ebb1-5834-4261-bb1b-0a68990bb307 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:49:12.169025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6800ebb1-5834-4261-bb1b-0a68990bb307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:12.286272 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:49:12.330693 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1509/3036] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:49:12.372433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17775d1b-9374-4fc0-95d3-13af06dfe637 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:12.374376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-17775d1b-9374-4fc0-95d3-13af06dfe637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:12.490686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17775d1b-9374-4fc0-95d3-13af06dfe637 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:12.494951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc2628-a8e5-45b2-9593-789597799761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:12.496421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc2628-a8e5-45b2-9593-789597799761 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:12.496966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc2628-a8e5-45b2-9593-789597799761 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:12.497419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc2628-a8e5-45b2-9593-789597799761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:12.510647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc2628-a8e5-45b2-9593-789597799761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:12.512375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc2628-a8e5-45b2-9593-789597799761 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:12.526275 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1528/3037] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:49:14.322616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800ebb1-5834-4261-bb1b-0a68990bb307 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:14.324321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6800ebb1-5834-4261-bb1b-0a68990bb307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:14.352883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800ebb1-5834-4261-bb1b-0a68990bb307 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:14.370080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa98ba8-3476-463d-86a4-2bd362be8102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:14.371022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa98ba8-3476-463d-86a4-2bd362be8102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:14.371538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa98ba8-3476-463d-86a4-2bd362be8102 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:14.372051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa98ba8-3476-463d-86a4-2bd362be8102 admin admin] PATH_INFO: `/v3/projects/5a4b169ebe854d8fbad33c208207f0b5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:14.373749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa98ba8-3476-463d-86a4-2bd362be8102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4b169ebe854d8fbad33c208207f0b5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:14.376045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa98ba8-3476-463d-86a4-2bd362be8102 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:14.513529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ffa98ba8-3476-463d-86a4-2bd362be8102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4b169ebe854d8fbad33c208207f0b5', 'request_id': 'req-ffa98ba8-3476-463d-86a4-2bd362be8102'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:14.527152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ffa98ba8-3476-463d-86a4-2bd362be8102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4b169ebe854d8fbad33c208207f0b5', 'request_id': 'req-ffa98ba8-3476-463d-86a4-2bd362be8102'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:14.540837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ffa98ba8-3476-463d-86a4-2bd362be8102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4b169ebe854d8fbad33c208207f0b5', 'request_id': 'req-ffa98ba8-3476-463d-86a4-2bd362be8102'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:14.567062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ffa98ba8-3476-463d-86a4-2bd362be8102 admin admin] The token cache is being invalidate because project 5a4b169ebe854d8fbad33c208207f0b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:49:14.567390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ffa98ba8-3476-463d-86a4-2bd362be8102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:14.567964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ffa98ba8-3476-463d-86a4-2bd362be8102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:14.570124 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1510/3038] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:49:14 2022] DELETE /identity/v3/projects/5a4b169ebe854d8fbad33c208207f0b5 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:49:14.575595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc2628-a8e5-45b2-9593-789597799761 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:14.589101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc2628-a8e5-45b2-9593-789597799761 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:14.776659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbbd78-0551-4de1-a36f-ffff9eaee276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:14.777608 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbbd78-0551-4de1-a36f-ffff9eaee276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:14.778735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbbd78-0551-4de1-a36f-ffff9eaee276 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:14.779810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbbd78-0551-4de1-a36f-ffff9eaee276 admin admin] PATH_INFO: `/v3/users/adad109bb87e42af879f27385da88671` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:14.781936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbbd78-0551-4de1-a36f-ffff9eaee276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adad109bb87e42af879f27385da88671)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:14.786928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbbd78-0551-4de1-a36f-ffff9eaee276 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:14.900077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-18fbbd78-0551-4de1-a36f-ffff9eaee276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adad109bb87e42af879f27385da88671'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:14.901330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-18fbbd78-0551-4de1-a36f-ffff9eaee276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adad109bb87e42af879f27385da88671'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:14.921571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-18fbbd78-0551-4de1-a36f-ffff9eaee276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adad109bb87e42af879f27385da88671'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:14.957255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-18fbbd78-0551-4de1-a36f-ffff9eaee276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adad109bb87e42af879f27385da88671'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:14.975257 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:49:14.982909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-18fbbd78-0551-4de1-a36f-ffff9eaee276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adad109bb87e42af879f27385da88671'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:14.992654 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1529/3039] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:49:14 2022] DELETE /identity/v3/users/adad109bb87e42af879f27385da88671 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:49:15.697023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40931da2-3cee-444a-99f4-f50a7eab3043 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:15.697873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40931da2-3cee-444a-99f4-f50a7eab3043 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:15.698362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40931da2-3cee-444a-99f4-f50a7eab3043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:15.803564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-40931da2-3cee-444a-99f4-f50a7eab3043 None None] MFA Rules not processed for user `e6162fbf250e4c668fb8669cb8affc19`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:49:15.804847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-40931da2-3cee-444a-99f4-f50a7eab3043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:16.059631 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1511/3040] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:49:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:49:16.073123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb729e-eb77-49e4-972e-657cf7d10051 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:16.073689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb729e-eb77-49e4-972e-657cf7d10051 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:16.073978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb729e-eb77-49e4-972e-657cf7d10051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:16.113492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-61fb729e-eb77-49e4-972e-657cf7d10051 None None] MFA Rules not processed for user `e6162fbf250e4c668fb8669cb8affc19`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:49:16.114733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-61fb729e-eb77-49e4-972e-657cf7d10051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:16.137792 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1530/3041] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:49:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:49:17.003582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40931da2-3cee-444a-99f4-f50a7eab3043 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:17.005782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-40931da2-3cee-444a-99f4-f50a7eab3043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:17.112893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb729e-eb77-49e4-972e-657cf7d10051 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:17.114951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-61fb729e-eb77-49e4-972e-657cf7d10051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:17.314716 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:49:17.334380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40931da2-3cee-444a-99f4-f50a7eab3043 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:17.356394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb729e-eb77-49e4-972e-657cf7d10051 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:17.357319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdf369-5db1-459e-94de-492cab41ca95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:17.358281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdf369-5db1-459e-94de-492cab41ca95 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:17.358716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdf369-5db1-459e-94de-492cab41ca95 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:17.359161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdf369-5db1-459e-94de-492cab41ca95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:17.375668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d675d-8264-4ee0-99f7-554b9a3f3351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:17.376677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d675d-8264-4ee0-99f7-554b9a3f3351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:17.377194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d675d-8264-4ee0-99f7-554b9a3f3351 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:17.377570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d675d-8264-4ee0-99f7-554b9a3f3351 admin admin] PATH_INFO: `/v3/projects/ae91ad494625486598717ce0dad1fdf6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:17.381201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdf369-5db1-459e-94de-492cab41ca95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:17.382238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d675d-8264-4ee0-99f7-554b9a3f3351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae91ad494625486598717ce0dad1fdf6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:17.383588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdf369-5db1-459e-94de-492cab41ca95 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:17.386738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d675d-8264-4ee0-99f7-554b9a3f3351 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:17.427832 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1512/3042] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:49:17 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:49:17.530356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-db4d675d-8264-4ee0-99f7-554b9a3f3351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae91ad494625486598717ce0dad1fdf6', 'request_id': 'req-db4d675d-8264-4ee0-99f7-554b9a3f3351'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:17.556526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-db4d675d-8264-4ee0-99f7-554b9a3f3351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae91ad494625486598717ce0dad1fdf6', 'request_id': 'req-db4d675d-8264-4ee0-99f7-554b9a3f3351'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:17.570123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-db4d675d-8264-4ee0-99f7-554b9a3f3351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae91ad494625486598717ce0dad1fdf6', 'request_id': 'req-db4d675d-8264-4ee0-99f7-554b9a3f3351'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:17.589951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-db4d675d-8264-4ee0-99f7-554b9a3f3351 admin admin] The token cache is being invalidate because project ae91ad494625486598717ce0dad1fdf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:49:17.590581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-db4d675d-8264-4ee0-99f7-554b9a3f3351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:17.591710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-db4d675d-8264-4ee0-99f7-554b9a3f3351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:49:17.594087 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1531/3043] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:49:17 2022] DELETE /identity/v3/projects/ae91ad494625486598717ce0dad1fdf6 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:49:17.599047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c1c24-1246-4f1d-baba-5cc4b8d4e82a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:17.599256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c1c24-1246-4f1d-baba-5cc4b8d4e82a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:17.600321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c1c24-1246-4f1d-baba-5cc4b8d4e82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:17.654304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6e7c1c24-1246-4f1d-baba-5cc4b8d4e82a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:49:17.659940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6e7c1c24-1246-4f1d-baba-5cc4b8d4e82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:17.874016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df872fc9-d1e1-4203-83e1-1c29096f84f5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:17.874676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df872fc9-d1e1-4203-83e1-1c29096f84f5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:17.874815 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1513/3044] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:49:17.874944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df872fc9-d1e1-4203-83e1-1c29096f84f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:17.924034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-df872fc9-d1e1-4203-83e1-1c29096f84f5 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:49:17.928658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-df872fc9-d1e1-4203-83e1-1c29096f84f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:17.954239 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1532/3045] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:49:17.964439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c1c24-1246-4f1d-baba-5cc4b8d4e82a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:17.978420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c1c24-1246-4f1d-baba-5cc4b8d4e82a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:17.984090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8c5b2-8f2e-4c54-ac1c-1cb2ade9ae1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:17.984763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8c5b2-8f2e-4c54-ac1c-1cb2ade9ae1a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:17.985043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8c5b2-8f2e-4c54-ac1c-1cb2ade9ae1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:17.985316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8c5b2-8f2e-4c54-ac1c-1cb2ade9ae1a admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:17.986029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8c5b2-8f2e-4c54-ac1c-1cb2ade9ae1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:49:17.986335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8c5b2-8f2e-4c54-ac1c-1cb2ade9ae1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:17.988484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8c5b2-8f2e-4c54-ac1c-1cb2ade9ae1a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:18.031221 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1514/3046] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:49:18.031894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df872fc9-d1e1-4203-83e1-1c29096f84f5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:18.046070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df872fc9-d1e1-4203-83e1-1c29096f84f5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:18.060215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be21d85-1eda-43a0-a1a7-babbdb28f916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:18.060872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be21d85-1eda-43a0-a1a7-babbdb28f916 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:18.061149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be21d85-1eda-43a0-a1a7-babbdb28f916 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:18.061812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be21d85-1eda-43a0-a1a7-babbdb28f916 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:18.062456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be21d85-1eda-43a0-a1a7-babbdb28f916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:18.069171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be21d85-1eda-43a0-a1a7-babbdb28f916 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:18.155756 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1533/3047] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:49:18 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:49:18.161518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8c5b2-8f2e-4c54-ac1c-1cb2ade9ae1a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:18.178878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8c5b2-8f2e-4c54-ac1c-1cb2ade9ae1a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:18.328825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622a0ce-1d72-44d5-8470-2bc2926a9ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:18.329649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622a0ce-1d72-44d5-8470-2bc2926a9ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:18.329979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622a0ce-1d72-44d5-8470-2bc2926a9ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:18.331278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622a0ce-1d72-44d5-8470-2bc2926a9ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:18.331936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622a0ce-1d72-44d5-8470-2bc2926a9ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:18.337886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622a0ce-1d72-44d5-8470-2bc2926a9ab1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:18.392922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be21d85-1eda-43a0-a1a7-babbdb28f916 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:18.395739 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1515/3048] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:49:18 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:49:18.411600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be21d85-1eda-43a0-a1a7-babbdb28f916 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:18.433089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8d56f-f2e5-46d2-a01e-7879ebf4d2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:18.434168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8d56f-f2e5-46d2-a01e-7879ebf4d2bf admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:18.435029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8d56f-f2e5-46d2-a01e-7879ebf4d2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:18.435534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8d56f-f2e5-46d2-a01e-7879ebf4d2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:18.438238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8d56f-f2e5-46d2-a01e-7879ebf4d2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:18.447112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8d56f-f2e5-46d2-a01e-7879ebf4d2bf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:18.498428 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1534/3049] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:49:18.502227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622a0ce-1d72-44d5-8470-2bc2926a9ab1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:18.516569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622a0ce-1d72-44d5-8470-2bc2926a9ab1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:18.525730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef39555-7556-4026-b259-d3528e5feac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:18.527272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef39555-7556-4026-b259-d3528e5feac1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:18.528902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef39555-7556-4026-b259-d3528e5feac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:18.530119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef39555-7556-4026-b259-d3528e5feac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:18.531984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef39555-7556-4026-b259-d3528e5feac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:18.536103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef39555-7556-4026-b259-d3528e5feac1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:18.567052 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1516/3050] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:49:18.568653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8d56f-f2e5-46d2-a01e-7879ebf4d2bf admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:18.585375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8d56f-f2e5-46d2-a01e-7879ebf4d2bf admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:18.599224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a9d4b-7fb4-4941-a16a-a8c9ed40c39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:18.601548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a9d4b-7fb4-4941-a16a-a8c9ed40c39c admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:18.601895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a9d4b-7fb4-4941-a16a-a8c9ed40c39c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:18.602299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a9d4b-7fb4-4941-a16a-a8c9ed40c39c admin admin] PATH_INFO: `/v3/projects/3c68c720baec4dbebfffb04fc215c5e4/users/0838c8bf3b6f430e8c951b10dcebbb04/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:18.639341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a9d4b-7fb4-4941-a16a-a8c9ed40c39c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c68c720baec4dbebfffb04fc215c5e4, user_id=0838c8bf3b6f430e8c951b10dcebbb04, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:18.644110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a9d4b-7fb4-4941-a16a-a8c9ed40c39c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:18.676766 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1535/3051] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:49:18 2022] PUT /identity/v3/projects/3c68c720baec4dbebfffb04fc215c5e4/users/0838c8bf3b6f430e8c951b10dcebbb04/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:49:18.678986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2fa88-6734-44f9-b53c-095df531d920 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:18.679512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2fa88-6734-44f9-b53c-095df531d920 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:18.681004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2fa88-6734-44f9-b53c-095df531d920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:18.723936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-30a2fa88-6734-44f9-b53c-095df531d920 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:49:18.731113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-30a2fa88-6734-44f9-b53c-095df531d920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:18.912651 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:49:18.977454 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1517/3052] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:49:19.027012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a9d4b-7fb4-4941-a16a-a8c9ed40c39c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:19.029043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-905a9d4b-7fb4-4941-a16a-a8c9ed40c39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:19.076563 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:49:19.265201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a9d4b-7fb4-4941-a16a-a8c9ed40c39c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:19.279533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6338a-dffd-4ee0-b752-4b6dc571206c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:19.280171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6338a-dffd-4ee0-b752-4b6dc571206c service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:19.280448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6338a-dffd-4ee0-b752-4b6dc571206c service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:19.280796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6338a-dffd-4ee0-b752-4b6dc571206c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:19.325816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6338a-dffd-4ee0-b752-4b6dc571206c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:19.327289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6338a-dffd-4ee0-b752-4b6dc571206c service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:19.384547 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1536/3053] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:49:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:49:19.984199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fb40f-e174-45fc-b1f6-8b01a6ac8d6b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:19.984736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fb40f-e174-45fc-b1f6-8b01a6ac8d6b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:19.984965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fb40f-e174-45fc-b1f6-8b01a6ac8d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:20.067578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7f8fb40f-e174-45fc-b1f6-8b01a6ac8d6b None None] MFA Rules not processed for user `60a8a6bc8f4d448ab7934341383e769f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:49:20.072663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7f8fb40f-e174-45fc-b1f6-8b01a6ac8d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:20.333063 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1518/3054] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:49:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:49:21.082592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6338a-dffd-4ee0-b752-4b6dc571206c service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:21.085316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1ad6338a-dffd-4ee0-b752-4b6dc571206c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:21.496492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6338a-dffd-4ee0-b752-4b6dc571206c service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:21.526624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b658192-a865-4510-86a8-d52463adab0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:21.528987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b658192-a865-4510-86a8-d52463adab0f service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:21.529459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b658192-a865-4510-86a8-d52463adab0f service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:21.532063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b658192-a865-4510-86a8-d52463adab0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:21.570085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b658192-a865-4510-86a8-d52463adab0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:21.578035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b658192-a865-4510-86a8-d52463adab0f service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:21.617774 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1537/3055] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:49:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:49:23.105351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fb40f-e174-45fc-b1f6-8b01a6ac8d6b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:23.106823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7f8fb40f-e174-45fc-b1f6-8b01a6ac8d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:23.249289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fb40f-e174-45fc-b1f6-8b01a6ac8d6b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:23.266034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd60e60-2dfe-4f9d-96cb-7eabfd44f60c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:23.266678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd60e60-2dfe-4f9d-96cb-7eabfd44f60c service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:23.266956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd60e60-2dfe-4f9d-96cb-7eabfd44f60c service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:23.267229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd60e60-2dfe-4f9d-96cb-7eabfd44f60c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:23.273744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0bd60e60-2dfe-4f9d-96cb-7eabfd44f60c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:23.457815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd60e60-2dfe-4f9d-96cb-7eabfd44f60c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:23.460917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd60e60-2dfe-4f9d-96cb-7eabfd44f60c service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:23.486959 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1519/3056] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:49:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:49:27.747705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee44c89-9ee3-4f4d-9aa1-91cbe5fa73e6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:27.748303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee44c89-9ee3-4f4d-9aa1-91cbe5fa73e6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:27.748303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee44c89-9ee3-4f4d-9aa1-91cbe5fa73e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:27.823426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5ee44c89-9ee3-4f4d-9aa1-91cbe5fa73e6 None None] MFA Rules not processed for user `7fca17ba092e44f1a37b108778dc7a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:49:27.825207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5ee44c89-9ee3-4f4d-9aa1-91cbe5fa73e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:27.950721 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1538/3057] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:49:27 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:49:31.084577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f06272-fa97-44a6-ac12-a266088523f9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:31.085773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f06272-fa97-44a6-ac12-a266088523f9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:31.086418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f06272-fa97-44a6-ac12-a266088523f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:31.153512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f0f06272-fa97-44a6-ac12-a266088523f9 None None] MFA Rules not processed for user `0838c8bf3b6f430e8c951b10dcebbb04`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:49:31.155202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f0f06272-fa97-44a6-ac12-a266088523f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:31.234976 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:49:31.320388 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1520/3058] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:49:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:49:31.321393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309614a-da4e-42cf-9e60-34913f6a94e5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:31.321393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309614a-da4e-42cf-9e60-34913f6a94e5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:31.321893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309614a-da4e-42cf-9e60-34913f6a94e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:31.349196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2309614a-da4e-42cf-9e60-34913f6a94e5 None None] MFA Rules not processed for user `0838c8bf3b6f430e8c951b10dcebbb04`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:49:31.351101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2309614a-da4e-42cf-9e60-34913f6a94e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:31.366422 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1539/3059] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:49:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:49:33.118380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f06272-fa97-44a6-ac12-a266088523f9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:33.120594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f0f06272-fa97-44a6-ac12-a266088523f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:33.163630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f06272-fa97-44a6-ac12-a266088523f9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:33.186662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314aa2f-6291-48db-9987-1f86dbb896ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:33.187136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314aa2f-6291-48db-9987-1f86dbb896ef service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:33.187412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314aa2f-6291-48db-9987-1f86dbb896ef service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:33.187684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314aa2f-6291-48db-9987-1f86dbb896ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:33.212390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314aa2f-6291-48db-9987-1f86dbb896ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:33.215065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314aa2f-6291-48db-9987-1f86dbb896ef service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:33.253658 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1521/3060] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:49:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:49:41.342866 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:49:41.443170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dab0c-783e-4747-a6c9-2c8dfdd3da92 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:41.443170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dab0c-783e-4747-a6c9-2c8dfdd3da92 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:41.443170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dab0c-783e-4747-a6c9-2c8dfdd3da92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:41.477832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5e4dab0c-783e-4747-a6c9-2c8dfdd3da92 None None] MFA Rules not processed for user `960e2646c3174ad084c85b6de1e01822`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:49:41.479235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5e4dab0c-783e-4747-a6c9-2c8dfdd3da92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:41.547637 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1540/3061] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:49:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:49:43.230879 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=20 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:49:46.654253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff9b4a-5400-4de9-9e41-1e22c5d04ee2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:46.655535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff9b4a-5400-4de9-9e41-1e22c5d04ee2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:46.655875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff9b4a-5400-4de9-9e41-1e22c5d04ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:46.708799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-63ff9b4a-5400-4de9-9e41-1e22c5d04ee2 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:49:46.710558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-63ff9b4a-5400-4de9-9e41-1e22c5d04ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:46.851183 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1522/3062] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:49:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:49:46.881982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4dab0c-783e-4747-a6c9-2c8dfdd3da92 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:49:46.883607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5e4dab0c-783e-4747-a6c9-2c8dfdd3da92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:49:47.003320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4dab0c-783e-4747-a6c9-2c8dfdd3da92 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:49:47.019040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e48123-0fe7-4cf6-bc91-4602d29d203a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:49:47.019729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e48123-0fe7-4cf6-bc91-4602d29d203a service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:49:47.020514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e48123-0fe7-4cf6-bc91-4602d29d203a service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:49:47.020842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e48123-0fe7-4cf6-bc91-4602d29d203a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:49:47.046498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e48123-0fe7-4cf6-bc91-4602d29d203a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:49:47.049356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e48123-0fe7-4cf6-bc91-4602d29d203a service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:49:47.084320 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1541/3063] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:49:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:49:56.839167 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=25 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:49:57.066214 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=57 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:02.928345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff9b4a-5400-4de9-9e41-1e22c5d04ee2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:02.930450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-63ff9b4a-5400-4de9-9e41-1e22c5d04ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:03.027120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff9b4a-5400-4de9-9e41-1e22c5d04ee2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:03.037720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d7755-f2db-49c9-808c-8424a4b527d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:03.038732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d7755-f2db-49c9-808c-8424a4b527d9 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:03.039224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d7755-f2db-49c9-808c-8424a4b527d9 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:03.039691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d7755-f2db-49c9-808c-8424a4b527d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:03.042075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-480d7755-f2db-49c9-808c-8424a4b527d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:03.061657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d7755-f2db-49c9-808c-8424a4b527d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:03.066664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d7755-f2db-49c9-808c-8424a4b527d9 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:03.090102 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1523/3064] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:03.127844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e48123-0fe7-4cf6-bc91-4602d29d203a service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:03.134588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-08e48123-0fe7-4cf6-bc91-4602d29d203a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:03.159975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e48123-0fe7-4cf6-bc91-4602d29d203a service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:03.177126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95539232-8746-4945-971a-9314a72584c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:03.180166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95539232-8746-4945-971a-9314a72584c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:03.180166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95539232-8746-4945-971a-9314a72584c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:03.180166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95539232-8746-4945-971a-9314a72584c9 admin admin] PATH_INFO: `/v3/users/e6162fbf250e4c668fb8669cb8affc19` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:03.181360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95539232-8746-4945-971a-9314a72584c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6162fbf250e4c668fb8669cb8affc19)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:03.183263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95539232-8746-4945-971a-9314a72584c9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:03.248986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-95539232-8746-4945-971a-9314a72584c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6162fbf250e4c668fb8669cb8affc19'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:03.250235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-95539232-8746-4945-971a-9314a72584c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6162fbf250e4c668fb8669cb8affc19'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:03.264488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-95539232-8746-4945-971a-9314a72584c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6162fbf250e4c668fb8669cb8affc19'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:03.288553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-95539232-8746-4945-971a-9314a72584c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6162fbf250e4c668fb8669cb8affc19'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:03.296711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-95539232-8746-4945-971a-9314a72584c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6162fbf250e4c668fb8669cb8affc19'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:03.308452 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1542/3065] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:50:03 2022] DELETE /identity/v3/users/e6162fbf250e4c668fb8669cb8affc19 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:03.674672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d7755-f2db-49c9-808c-8424a4b527d9 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:03.693305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d7755-f2db-49c9-808c-8424a4b527d9 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:03.878700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bbb27-a15f-42a1-b263-a325e6fdd5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:03.879348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bbb27-a15f-42a1-b263-a325e6fdd5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:03.879621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bbb27-a15f-42a1-b263-a325e6fdd5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:03.879891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bbb27-a15f-42a1-b263-a325e6fdd5d7 admin admin] PATH_INFO: `/v3/projects/9be53460a8c44b6e9310b98ea7efd75c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:03.882210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82bbb27-a15f-42a1-b263-a325e6fdd5d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9be53460a8c44b6e9310b98ea7efd75c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:03.901770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82bbb27-a15f-42a1-b263-a325e6fdd5d7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:04.063736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b82bbb27-a15f-42a1-b263-a325e6fdd5d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9be53460a8c44b6e9310b98ea7efd75c', 'request_id': 'req-b82bbb27-a15f-42a1-b263-a325e6fdd5d7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:04.083385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b82bbb27-a15f-42a1-b263-a325e6fdd5d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9be53460a8c44b6e9310b98ea7efd75c', 'request_id': 'req-b82bbb27-a15f-42a1-b263-a325e6fdd5d7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:04.092286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b82bbb27-a15f-42a1-b263-a325e6fdd5d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9be53460a8c44b6e9310b98ea7efd75c', 'request_id': 'req-b82bbb27-a15f-42a1-b263-a325e6fdd5d7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:04.125701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b82bbb27-a15f-42a1-b263-a325e6fdd5d7 admin admin] The token cache is being invalidate because project 9be53460a8c44b6e9310b98ea7efd75c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:50:04.126320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b82bbb27-a15f-42a1-b263-a325e6fdd5d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:04.127445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b82bbb27-a15f-42a1-b263-a325e6fdd5d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:04.132799 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1524/3066] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:50:03 2022] DELETE /identity/v3/projects/9be53460a8c44b6e9310b98ea7efd75c => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:04.137599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c0f48-1f7a-4fbf-8af3-821d381bbe46 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:04.138451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c0f48-1f7a-4fbf-8af3-821d381bbe46 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:04.138895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c0f48-1f7a-4fbf-8af3-821d381bbe46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:04.187224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6a9c0f48-1f7a-4fbf-8af3-821d381bbe46 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:04.188946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6a9c0f48-1f7a-4fbf-8af3-821d381bbe46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:04.375750 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1543/3067] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:04.383770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f50d2-5354-4005-82bf-dca36219ed6c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:04.384304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f50d2-5354-4005-82bf-dca36219ed6c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:04.384782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f50d2-5354-4005-82bf-dca36219ed6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:04.442660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-100f50d2-5354-4005-82bf-dca36219ed6c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:04.451192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-100f50d2-5354-4005-82bf-dca36219ed6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:04.497225 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1525/3068] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:04.502216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c0f48-1f7a-4fbf-8af3-821d381bbe46 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:04.517454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c0f48-1f7a-4fbf-8af3-821d381bbe46 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:04.526907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4469de-f168-4151-800d-ea5cfdf9ea75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:04.527547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4469de-f168-4151-800d-ea5cfdf9ea75 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:04.528862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4469de-f168-4151-800d-ea5cfdf9ea75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:04.529552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4469de-f168-4151-800d-ea5cfdf9ea75 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:04.532989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4469de-f168-4151-800d-ea5cfdf9ea75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:50:04.533638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4469de-f168-4151-800d-ea5cfdf9ea75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:04.536144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4469de-f168-4151-800d-ea5cfdf9ea75 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:04.573866 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1544/3069] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:50:04.574141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f50d2-5354-4005-82bf-dca36219ed6c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:04.589383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f50d2-5354-4005-82bf-dca36219ed6c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:04.609880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adec92-bc60-4c86-8258-67ef6aea2bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:04.614346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adec92-bc60-4c86-8258-67ef6aea2bae admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:04.614927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adec92-bc60-4c86-8258-67ef6aea2bae admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:04.615204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adec92-bc60-4c86-8258-67ef6aea2bae admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:04.615886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adec92-bc60-4c86-8258-67ef6aea2bae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:04.621673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adec92-bc60-4c86-8258-67ef6aea2bae admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:04.661209 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:04.716968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4469de-f168-4151-800d-ea5cfdf9ea75 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:04.724215 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1526/3070] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:50:04 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:50:04.743283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4469de-f168-4151-800d-ea5cfdf9ea75 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:04.932185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0705592-8072-4a19-b0f7-f0153dabc7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:04.932853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0705592-8072-4a19-b0f7-f0153dabc7e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:04.933137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0705592-8072-4a19-b0f7-f0153dabc7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:04.933411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0705592-8072-4a19-b0f7-f0153dabc7e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:04.934055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0705592-8072-4a19-b0f7-f0153dabc7e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:04.935971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0705592-8072-4a19-b0f7-f0153dabc7e7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:04.960181 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:04.994696 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1545/3071] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:50:04 2022] POST /identity/v3/users => generated 291 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:50:05.000117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adec92-bc60-4c86-8258-67ef6aea2bae admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:05.032312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adec92-bc60-4c86-8258-67ef6aea2bae admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:05.058881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2a6b1-ebba-45f7-8e64-795fa833c3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:05.063635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2a6b1-ebba-45f7-8e64-795fa833c3ae admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:05.064030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2a6b1-ebba-45f7-8e64-795fa833c3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:05.064591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2a6b1-ebba-45f7-8e64-795fa833c3ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:05.067868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2a6b1-ebba-45f7-8e64-795fa833c3ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:05.071907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2a6b1-ebba-45f7-8e64-795fa833c3ae admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:05.130536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0705592-8072-4a19-b0f7-f0153dabc7e7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:05.137858 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1527/3072] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:50:05.142143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0705592-8072-4a19-b0f7-f0153dabc7e7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:05.167370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c97ce5-14d9-4fd9-baa7-49acbb2b3271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:05.167924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c97ce5-14d9-4fd9-baa7-49acbb2b3271 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:05.173093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c97ce5-14d9-4fd9-baa7-49acbb2b3271 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:05.174101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c97ce5-14d9-4fd9-baa7-49acbb2b3271 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:05.175058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c97ce5-14d9-4fd9-baa7-49acbb2b3271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:05.180526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c97ce5-14d9-4fd9-baa7-49acbb2b3271 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:05.225553 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1546/3073] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:50:05.229769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2a6b1-ebba-45f7-8e64-795fa833c3ae admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:05.245039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2a6b1-ebba-45f7-8e64-795fa833c3ae admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:05.267442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17682656-911d-4995-bae3-eadbe32f7265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:05.268134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17682656-911d-4995-bae3-eadbe32f7265 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:05.268418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17682656-911d-4995-bae3-eadbe32f7265 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:05.275254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17682656-911d-4995-bae3-eadbe32f7265 admin admin] PATH_INFO: `/v3/projects/581cbc55e00b45ff9e0c69583c601723/users/2e1c470f3d6847cba3f51eac8fd20472/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:05.342746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17682656-911d-4995-bae3-eadbe32f7265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=581cbc55e00b45ff9e0c69583c601723, user_id=2e1c470f3d6847cba3f51eac8fd20472, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:05.353450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17682656-911d-4995-bae3-eadbe32f7265 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:05.396292 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1528/3074] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:50:05 2022] PUT /identity/v3/projects/581cbc55e00b45ff9e0c69583c601723/users/2e1c470f3d6847cba3f51eac8fd20472/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:05.402524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2212292-20af-4f0c-8e41-7863fe1f5931 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:05.402812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2212292-20af-4f0c-8e41-7863fe1f5931 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:05.403082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2212292-20af-4f0c-8e41-7863fe1f5931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:05.437569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a2212292-20af-4f0c-8e41-7863fe1f5931 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:05.438736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a2212292-20af-4f0c-8e41-7863fe1f5931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:05.572559 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1547/3075] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:05.633440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17682656-911d-4995-bae3-eadbe32f7265 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:05.635209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-17682656-911d-4995-bae3-eadbe32f7265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:05.765591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17682656-911d-4995-bae3-eadbe32f7265 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:05.773072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760ec10-2781-4d70-b616-5b756bf78796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:05.774085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760ec10-2781-4d70-b616-5b756bf78796 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:05.774587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760ec10-2781-4d70-b616-5b756bf78796 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:05.775092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760ec10-2781-4d70-b616-5b756bf78796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:05.790917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760ec10-2781-4d70-b616-5b756bf78796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:05.792893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760ec10-2781-4d70-b616-5b756bf78796 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:05.809231 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1529/3076] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:14.976887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2212292-20af-4f0c-8e41-7863fe1f5931 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:14.978936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a2212292-20af-4f0c-8e41-7863fe1f5931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:15.008344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2212292-20af-4f0c-8e41-7863fe1f5931 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:15.024857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab1d3c-7603-43b5-9028-a4584097fa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:15.025506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab1d3c-7603-43b5-9028-a4584097fa8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:15.025780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab1d3c-7603-43b5-9028-a4584097fa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:15.026056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab1d3c-7603-43b5-9028-a4584097fa8b admin admin] PATH_INFO: `/v3/users/60a8a6bc8f4d448ab7934341383e769f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:15.030365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab1d3c-7603-43b5-9028-a4584097fa8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=60a8a6bc8f4d448ab7934341383e769f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:15.032320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab1d3c-7603-43b5-9028-a4584097fa8b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:15.163094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-aeab1d3c-7603-43b5-9028-a4584097fa8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60a8a6bc8f4d448ab7934341383e769f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:15.164446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-aeab1d3c-7603-43b5-9028-a4584097fa8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60a8a6bc8f4d448ab7934341383e769f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:15.193287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-aeab1d3c-7603-43b5-9028-a4584097fa8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60a8a6bc8f4d448ab7934341383e769f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:15.233970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-aeab1d3c-7603-43b5-9028-a4584097fa8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60a8a6bc8f4d448ab7934341383e769f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:15.250701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-aeab1d3c-7603-43b5-9028-a4584097fa8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60a8a6bc8f4d448ab7934341383e769f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:15.266597 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1548/3077] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:50:14 2022] DELETE /identity/v3/users/60a8a6bc8f4d448ab7934341383e769f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:15.663269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760ec10-2781-4d70-b616-5b756bf78796 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:15.675531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1760ec10-2781-4d70-b616-5b756bf78796 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:15.849354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760ec10-2781-4d70-b616-5b756bf78796 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:15.963041 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:15.974375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab1d3c-7603-43b5-9028-a4584097fa8b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:15.976479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-aeab1d3c-7603-43b5-9028-a4584097fa8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:16.009400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0d837-0d0c-4c58-ba5a-0a620eccde57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:16.010694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0d837-0d0c-4c58-ba5a-0a620eccde57 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:16.013678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0d837-0d0c-4c58-ba5a-0a620eccde57 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:16.014714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0d837-0d0c-4c58-ba5a-0a620eccde57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:16.021211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9af0d837-0d0c-4c58-ba5a-0a620eccde57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:16.092707 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:16.115017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab1d3c-7603-43b5-9028-a4584097fa8b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:16.130124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffcc20-2ea1-41d8-bc41-04a6dc5b9ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:16.130852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffcc20-2ea1-41d8-bc41-04a6dc5b9ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:16.131194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffcc20-2ea1-41d8-bc41-04a6dc5b9ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:16.131527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffcc20-2ea1-41d8-bc41-04a6dc5b9ba6 admin admin] PATH_INFO: `/v3/projects/0b5f7799c113423691f454c397bc132f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:16.133134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffcc20-2ea1-41d8-bc41-04a6dc5b9ba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b5f7799c113423691f454c397bc132f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:16.135090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffcc20-2ea1-41d8-bc41-04a6dc5b9ba6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:16.153474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af0d837-0d0c-4c58-ba5a-0a620eccde57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:16.155301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af0d837-0d0c-4c58-ba5a-0a620eccde57 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:16.171814 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1530/3078] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:16.250515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5bffcc20-2ea1-41d8-bc41-04a6dc5b9ba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b5f7799c113423691f454c397bc132f', 'request_id': 'req-5bffcc20-2ea1-41d8-bc41-04a6dc5b9ba6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:16.264570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5bffcc20-2ea1-41d8-bc41-04a6dc5b9ba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b5f7799c113423691f454c397bc132f', 'request_id': 'req-5bffcc20-2ea1-41d8-bc41-04a6dc5b9ba6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:16.275957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5bffcc20-2ea1-41d8-bc41-04a6dc5b9ba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b5f7799c113423691f454c397bc132f', 'request_id': 'req-5bffcc20-2ea1-41d8-bc41-04a6dc5b9ba6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:16.312625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5bffcc20-2ea1-41d8-bc41-04a6dc5b9ba6 admin admin] The token cache is being invalidate because project 0b5f7799c113423691f454c397bc132f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:50:16.312912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5bffcc20-2ea1-41d8-bc41-04a6dc5b9ba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:16.315776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5bffcc20-2ea1-41d8-bc41-04a6dc5b9ba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:16.325656 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1549/3079] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:50:15 2022] DELETE /identity/v3/projects/0b5f7799c113423691f454c397bc132f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:16.327674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7253200-15c3-41e9-a0c7-68adf0440787 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:16.327962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7253200-15c3-41e9-a0c7-68adf0440787 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:16.328239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7253200-15c3-41e9-a0c7-68adf0440787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:16.385679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c7253200-15c3-41e9-a0c7-68adf0440787 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:16.388309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c7253200-15c3-41e9-a0c7-68adf0440787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:16.595281 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1531/3080] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:16.603499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6783d1-1089-478b-8dff-98fd446737be None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:16.603765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6783d1-1089-478b-8dff-98fd446737be None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:16.604053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6783d1-1089-478b-8dff-98fd446737be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:16.636280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cb6783d1-1089-478b-8dff-98fd446737be None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:16.638560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cb6783d1-1089-478b-8dff-98fd446737be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:16.662809 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1550/3081] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:16.666769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7253200-15c3-41e9-a0c7-68adf0440787 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:16.690549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7253200-15c3-41e9-a0c7-68adf0440787 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:16.695956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845471de-75bd-4662-866e-9bc8fa8c93ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:16.696881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845471de-75bd-4662-866e-9bc8fa8c93ab admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:16.697227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845471de-75bd-4662-866e-9bc8fa8c93ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:16.697599 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845471de-75bd-4662-866e-9bc8fa8c93ab admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:16.698333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845471de-75bd-4662-866e-9bc8fa8c93ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:50:16.698699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845471de-75bd-4662-866e-9bc8fa8c93ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:16.702274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845471de-75bd-4662-866e-9bc8fa8c93ab admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:16.723155 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1532/3082] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:50:16.729484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6783d1-1089-478b-8dff-98fd446737be None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:16.745995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6783d1-1089-478b-8dff-98fd446737be None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:16.759394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c802657-b4ba-4ccb-a243-4cfaf37179f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:16.760088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c802657-b4ba-4ccb-a243-4cfaf37179f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:16.760431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c802657-b4ba-4ccb-a243-4cfaf37179f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:16.760897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c802657-b4ba-4ccb-a243-4cfaf37179f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:16.763601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c802657-b4ba-4ccb-a243-4cfaf37179f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:16.765965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c802657-b4ba-4ccb-a243-4cfaf37179f2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:16.809959 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1551/3083] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:50:16 2022] POST /identity/v3/projects => generated 395 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:50:16.813958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845471de-75bd-4662-866e-9bc8fa8c93ab admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:16.828079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845471de-75bd-4662-866e-9bc8fa8c93ab admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:16.996080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ff32c-6c48-4e02-92f3-e2d48866aa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:16.996970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ff32c-6c48-4e02-92f3-e2d48866aa04 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:16.997351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ff32c-6c48-4e02-92f3-e2d48866aa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:16.998107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ff32c-6c48-4e02-92f3-e2d48866aa04 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:16.998856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ff32c-6c48-4e02-92f3-e2d48866aa04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:17.000957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ff32c-6c48-4e02-92f3-e2d48866aa04 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:17.056953 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1533/3084] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:50:16 2022] POST /identity/v3/users => generated 298 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:50:17.060809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c802657-b4ba-4ccb-a243-4cfaf37179f2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:17.077812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c802657-b4ba-4ccb-a243-4cfaf37179f2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:17.091436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7d55e-da92-4b7b-a02d-946cbcc92032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:17.092756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7d55e-da92-4b7b-a02d-946cbcc92032 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:17.093686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7d55e-da92-4b7b-a02d-946cbcc92032 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:17.094204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7d55e-da92-4b7b-a02d-946cbcc92032 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:17.095282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7d55e-da92-4b7b-a02d-946cbcc92032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:17.097466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7d55e-da92-4b7b-a02d-946cbcc92032 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:17.116023 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1552/3085] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:50:17.124741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ff32c-6c48-4e02-92f3-e2d48866aa04 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:17.142758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ff32c-6c48-4e02-92f3-e2d48866aa04 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:17.150156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d992c2-79b8-4fc7-81eb-b66350d99089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:17.150631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d992c2-79b8-4fc7-81eb-b66350d99089 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:17.150912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d992c2-79b8-4fc7-81eb-b66350d99089 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:17.151184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d992c2-79b8-4fc7-81eb-b66350d99089 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:17.151839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d992c2-79b8-4fc7-81eb-b66350d99089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:17.153479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d992c2-79b8-4fc7-81eb-b66350d99089 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:17.155142 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:17.171517 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1534/3086] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:50:17.177125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7d55e-da92-4b7b-a02d-946cbcc92032 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:17.194446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7d55e-da92-4b7b-a02d-946cbcc92032 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:17.201758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940777e6-ab03-4106-8f5a-ee4cd914c4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:17.202439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940777e6-ab03-4106-8f5a-ee4cd914c4db admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:17.202724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940777e6-ab03-4106-8f5a-ee4cd914c4db admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:17.203001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940777e6-ab03-4106-8f5a-ee4cd914c4db admin admin] PATH_INFO: `/v3/projects/8927677202684c43a9e8717dcd5a50e8/users/31b61b5ce77f42288e3437e8f11f452f/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:17.230482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940777e6-ab03-4106-8f5a-ee4cd914c4db admin admin] RBAC: Authorizing `identity:create_grant(project_id=8927677202684c43a9e8717dcd5a50e8, user_id=31b61b5ce77f42288e3437e8f11f452f, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:17.233496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940777e6-ab03-4106-8f5a-ee4cd914c4db admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:17.288669 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1553/3087] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:50:17 2022] PUT /identity/v3/projects/8927677202684c43a9e8717dcd5a50e8/users/31b61b5ce77f42288e3437e8f11f452f/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:17.290523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1fca7-eedd-49e1-ae9c-3f19bcbff380 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:17.290978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1fca7-eedd-49e1-ae9c-3f19bcbff380 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:17.291296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1fca7-eedd-49e1-ae9c-3f19bcbff380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:17.366704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-65d1fca7-eedd-49e1-ae9c-3f19bcbff380 None None] MFA Rules not processed for user `31b61b5ce77f42288e3437e8f11f452f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:17.371836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-65d1fca7-eedd-49e1-ae9c-3f19bcbff380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:17.599626 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1535/3088] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:17.755853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940777e6-ab03-4106-8f5a-ee4cd914c4db admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:17.762507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-940777e6-ab03-4106-8f5a-ee4cd914c4db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:17.948493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940777e6-ab03-4106-8f5a-ee4cd914c4db admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:17.961837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a021cf2-d9ae-4ec9-9aa1-9aee9ac035a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:17.963458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a021cf2-d9ae-4ec9-9aa1-9aee9ac035a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:17.963744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a021cf2-d9ae-4ec9-9aa1-9aee9ac035a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:17.964020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a021cf2-d9ae-4ec9-9aa1-9aee9ac035a1 admin admin] PATH_INFO: `/v3/users/0838c8bf3b6f430e8c951b10dcebbb04` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:17.966800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a021cf2-d9ae-4ec9-9aa1-9aee9ac035a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0838c8bf3b6f430e8c951b10dcebbb04)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:17.970322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a021cf2-d9ae-4ec9-9aa1-9aee9ac035a1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:18.022903 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:18.070108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a021cf2-d9ae-4ec9-9aa1-9aee9ac035a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0838c8bf3b6f430e8c951b10dcebbb04'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:18.070840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a021cf2-d9ae-4ec9-9aa1-9aee9ac035a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0838c8bf3b6f430e8c951b10dcebbb04'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:18.084736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a021cf2-d9ae-4ec9-9aa1-9aee9ac035a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0838c8bf3b6f430e8c951b10dcebbb04'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:18.107201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a021cf2-d9ae-4ec9-9aa1-9aee9ac035a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0838c8bf3b6f430e8c951b10dcebbb04'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:18.141069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a021cf2-d9ae-4ec9-9aa1-9aee9ac035a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0838c8bf3b6f430e8c951b10dcebbb04'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:18.168884 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1554/3089] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:50:17 2022] DELETE /identity/v3/users/0838c8bf3b6f430e8c951b10dcebbb04 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:18.488477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1fca7-eedd-49e1-ae9c-3f19bcbff380 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:18.514299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1fca7-eedd-49e1-ae9c-3f19bcbff380 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:18.705466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a021cf2-d9ae-4ec9-9aa1-9aee9ac035a1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:18.708320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1a021cf2-d9ae-4ec9-9aa1-9aee9ac035a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:18.728177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdef192-fcb2-4686-85cc-8a2a8cfdef20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:18.728880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdef192-fcb2-4686-85cc-8a2a8cfdef20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:18.729164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdef192-fcb2-4686-85cc-8a2a8cfdef20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:18.729440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdef192-fcb2-4686-85cc-8a2a8cfdef20 admin admin] PATH_INFO: `/v3/projects/3c68c720baec4dbebfffb04fc215c5e4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:18.733111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdef192-fcb2-4686-85cc-8a2a8cfdef20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c68c720baec4dbebfffb04fc215c5e4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:18.735095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdef192-fcb2-4686-85cc-8a2a8cfdef20 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:18.871790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a021cf2-d9ae-4ec9-9aa1-9aee9ac035a1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:18.875579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cfdef192-fcb2-4686-85cc-8a2a8cfdef20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c68c720baec4dbebfffb04fc215c5e4', 'request_id': 'req-cfdef192-fcb2-4686-85cc-8a2a8cfdef20'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:18.897399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cfdef192-fcb2-4686-85cc-8a2a8cfdef20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c68c720baec4dbebfffb04fc215c5e4', 'request_id': 'req-cfdef192-fcb2-4686-85cc-8a2a8cfdef20'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:18.924671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cfdef192-fcb2-4686-85cc-8a2a8cfdef20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c68c720baec4dbebfffb04fc215c5e4', 'request_id': 'req-cfdef192-fcb2-4686-85cc-8a2a8cfdef20'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:18.948872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cfdef192-fcb2-4686-85cc-8a2a8cfdef20 admin admin] The token cache is being invalidate because project 3c68c720baec4dbebfffb04fc215c5e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:50:18.949708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cfdef192-fcb2-4686-85cc-8a2a8cfdef20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:18.953067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cfdef192-fcb2-4686-85cc-8a2a8cfdef20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:18.961181 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1536/3090] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:50:18 2022] DELETE /identity/v3/projects/3c68c720baec4dbebfffb04fc215c5e4 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:18.962833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdef192-fcb2-4686-85cc-8a2a8cfdef20 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:18.969819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cfdef192-fcb2-4686-85cc-8a2a8cfdef20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:19.005011 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:19.030958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc8a2e-ccc6-4f18-bd76-731870c9d716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:19.031592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc8a2e-ccc6-4f18-bd76-731870c9d716 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:19.031881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc8a2e-ccc6-4f18-bd76-731870c9d716 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:19.032593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc8a2e-ccc6-4f18-bd76-731870c9d716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:19.037501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c0dc8a2e-ccc6-4f18-bd76-731870c9d716 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:19.111454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdef192-fcb2-4686-85cc-8a2a8cfdef20 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:19.124122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48bc8b-06df-4f13-9e4b-e7710cb32b59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:19.126722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48bc8b-06df-4f13-9e4b-e7710cb32b59 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:19.127135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48bc8b-06df-4f13-9e4b-e7710cb32b59 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:19.128198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48bc8b-06df-4f13-9e4b-e7710cb32b59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:19.131041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dd48bc8b-06df-4f13-9e4b-e7710cb32b59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:19.210934 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:19.233718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc8a2e-ccc6-4f18-bd76-731870c9d716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:19.235326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc8a2e-ccc6-4f18-bd76-731870c9d716 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:19.256483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48bc8b-06df-4f13-9e4b-e7710cb32b59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:19.258821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48bc8b-06df-4f13-9e4b-e7710cb32b59 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:19.265402 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1555/3091] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:50:19.266607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352328-b8d3-43fd-80d2-fc947efb4fff None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:19.266996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352328-b8d3-43fd-80d2-fc947efb4fff None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:19.267143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352328-b8d3-43fd-80d2-fc947efb4fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:19.284693 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1537/3092] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:18 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:19.298969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48bc8b-06df-4f13-9e4b-e7710cb32b59 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:19.301157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dd48bc8b-06df-4f13-9e4b-e7710cb32b59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:19.322621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48bc8b-06df-4f13-9e4b-e7710cb32b59 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:19.342643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d0352328-b8d3-43fd-80d2-fc947efb4fff None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:19.344058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d0352328-b8d3-43fd-80d2-fc947efb4fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:19.357490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c4936-9471-4d95-b7e4-3eb3b9534c48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:19.358137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c4936-9471-4d95-b7e4-3eb3b9534c48 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:19.358417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c4936-9471-4d95-b7e4-3eb3b9534c48 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:19.358692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c4936-9471-4d95-b7e4-3eb3b9534c48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:19.362416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b05c4936-9471-4d95-b7e4-3eb3b9534c48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:19.381748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c4936-9471-4d95-b7e4-3eb3b9534c48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:19.386238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c4936-9471-4d95-b7e4-3eb3b9534c48 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:19.420326 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1538/3093] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:19.498678 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1556/3094] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:19.574965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadc241-da8e-4eb1-8364-f4c491d55ca7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:19.575501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadc241-da8e-4eb1-8364-f4c491d55ca7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:19.575501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadc241-da8e-4eb1-8364-f4c491d55ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:19.613614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0cadc241-da8e-4eb1-8364-f4c491d55ca7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:19.616464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0cadc241-da8e-4eb1-8364-f4c491d55ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:19.643757 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1539/3095] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:19.645061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0352328-b8d3-43fd-80d2-fc947efb4fff None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:19.663179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0352328-b8d3-43fd-80d2-fc947efb4fff None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:19.682625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048362ee-97d7-4e98-823b-af306ed06ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:19.683404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048362ee-97d7-4e98-823b-af306ed06ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:19.683687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048362ee-97d7-4e98-823b-af306ed06ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:19.683963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048362ee-97d7-4e98-823b-af306ed06ce7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:19.684897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048362ee-97d7-4e98-823b-af306ed06ce7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:50:19.685226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048362ee-97d7-4e98-823b-af306ed06ce7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:19.690909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048362ee-97d7-4e98-823b-af306ed06ce7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:19.756323 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1557/3096] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:50:19.757652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadc241-da8e-4eb1-8364-f4c491d55ca7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:19.770439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadc241-da8e-4eb1-8364-f4c491d55ca7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:19.780560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b455a-9da4-47fc-b01c-a7b5845c03f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:19.781260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b455a-9da4-47fc-b01c-a7b5845c03f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:19.781465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b455a-9da4-47fc-b01c-a7b5845c03f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:19.781728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b455a-9da4-47fc-b01c-a7b5845c03f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:19.782425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b455a-9da4-47fc-b01c-a7b5845c03f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:19.784505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b455a-9da4-47fc-b01c-a7b5845c03f9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:19.854190 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1540/3097] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:50:19 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:50:19.858812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048362ee-97d7-4e98-823b-af306ed06ce7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:19.870475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048362ee-97d7-4e98-823b-af306ed06ce7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:20.013155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ea503-32c2-4870-a2f6-b974706a5f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:20.014246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ea503-32c2-4870-a2f6-b974706a5f9c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:20.014246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ea503-32c2-4870-a2f6-b974706a5f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:20.014246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ea503-32c2-4870-a2f6-b974706a5f9c admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:20.014956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ea503-32c2-4870-a2f6-b974706a5f9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:20.019985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ea503-32c2-4870-a2f6-b974706a5f9c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:20.074850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b455a-9da4-47fc-b01c-a7b5845c03f9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:20.075730 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1558/3098] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:50:19 2022] POST /identity/v3/users => generated 291 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:50:20.088974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b455a-9da4-47fc-b01c-a7b5845c03f9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:20.103497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a661dc3-8b6c-469e-bffe-57288a7c0df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:20.104132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a661dc3-8b6c-469e-bffe-57288a7c0df2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:20.104412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a661dc3-8b6c-469e-bffe-57288a7c0df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:20.104711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a661dc3-8b6c-469e-bffe-57288a7c0df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:20.105420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a661dc3-8b6c-469e-bffe-57288a7c0df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:20.107991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a661dc3-8b6c-469e-bffe-57288a7c0df2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:20.135054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ea503-32c2-4870-a2f6-b974706a5f9c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:20.142252 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1541/3099] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:50:20.152151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ea503-32c2-4870-a2f6-b974706a5f9c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:20.168389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b8aca-58e0-483d-bdb2-d2f8923fdd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:20.169046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b8aca-58e0-483d-bdb2-d2f8923fdd84 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:20.169329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b8aca-58e0-483d-bdb2-d2f8923fdd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:20.169603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b8aca-58e0-483d-bdb2-d2f8923fdd84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:20.170263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b8aca-58e0-483d-bdb2-d2f8923fdd84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:20.182837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b8aca-58e0-483d-bdb2-d2f8923fdd84 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:20.226269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a661dc3-8b6c-469e-bffe-57288a7c0df2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:20.228321 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1559/3100] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:50:20.253487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a661dc3-8b6c-469e-bffe-57288a7c0df2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:20.348841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ed98b-6f68-43f4-b8c0-c3684795d3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:20.350597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ed98b-6f68-43f4-b8c0-c3684795d3ab admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:20.351059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ed98b-6f68-43f4-b8c0-c3684795d3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:20.352114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ed98b-6f68-43f4-b8c0-c3684795d3ab admin admin] PATH_INFO: `/v3/projects/7f8809e3172b48528850e4487456abe2/users/663ceebb712748baa870315121a013d9/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:20.398351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ed98b-6f68-43f4-b8c0-c3684795d3ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8809e3172b48528850e4487456abe2, user_id=663ceebb712748baa870315121a013d9, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:20.409893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ed98b-6f68-43f4-b8c0-c3684795d3ab admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:20.513545 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1542/3101] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:50:20 2022] PUT /identity/v3/projects/7f8809e3172b48528850e4487456abe2/users/663ceebb712748baa870315121a013d9/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:20.532709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc6e4a-cce0-423e-a05d-a0ceca2678e0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:20.532709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc6e4a-cce0-423e-a05d-a0ceca2678e0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:20.532709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc6e4a-cce0-423e-a05d-a0ceca2678e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:20.640535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-20dc6e4a-cce0-423e-a05d-a0ceca2678e0 None None] MFA Rules not processed for user `663ceebb712748baa870315121a013d9`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:20.642028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-20dc6e4a-cce0-423e-a05d-a0ceca2678e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:20.860081 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:20.968779 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1560/3102] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:21.317764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ed98b-6f68-43f4-b8c0-c3684795d3ab admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:21.319636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0a7ed98b-6f68-43f4-b8c0-c3684795d3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:21.323113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc6e4a-cce0-423e-a05d-a0ceca2678e0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:21.437771 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:21.546953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc6e4a-cce0-423e-a05d-a0ceca2678e0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:21.564241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d954b2-c7a1-4988-8140-7e927508a420 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:21.565784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d954b2-c7a1-4988-8140-7e927508a420 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:21.566314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d954b2-c7a1-4988-8140-7e927508a420 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:21.566926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d954b2-c7a1-4988-8140-7e927508a420 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:21.579557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d954b2-c7a1-4988-8140-7e927508a420 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:21.582744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d954b2-c7a1-4988-8140-7e927508a420 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:21.621611 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1561/3103] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:21.622863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ed98b-6f68-43f4-b8c0-c3684795d3ab admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:21.642173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d9b0f-8275-4a25-83af-e013239a1140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:21.643489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d9b0f-8275-4a25-83af-e013239a1140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:21.646411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d9b0f-8275-4a25-83af-e013239a1140 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:21.646690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d9b0f-8275-4a25-83af-e013239a1140 admin admin] PATH_INFO: `/v3/users/31b61b5ce77f42288e3437e8f11f452f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:21.653342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d9b0f-8275-4a25-83af-e013239a1140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31b61b5ce77f42288e3437e8f11f452f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:21.655624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d9b0f-8275-4a25-83af-e013239a1140 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:21.716146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d954b2-c7a1-4988-8140-7e927508a420 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:21.741223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d954b2-c7a1-4988-8140-7e927508a420 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:21.754298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7823690-c670-49ae-8710-4da03ddc96b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:21.755581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7823690-c670-49ae-8710-4da03ddc96b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:21.755870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7823690-c670-49ae-8710-4da03ddc96b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:21.756143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7823690-c670-49ae-8710-4da03ddc96b6 admin admin] PATH_INFO: `/v3/users/663ceebb712748baa870315121a013d9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:21.761412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7823690-c670-49ae-8710-4da03ddc96b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=663ceebb712748baa870315121a013d9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:21.765497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7823690-c670-49ae-8710-4da03ddc96b6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:21.845337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-858d9b0f-8275-4a25-83af-e013239a1140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31b61b5ce77f42288e3437e8f11f452f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:21.864451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-858d9b0f-8275-4a25-83af-e013239a1140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31b61b5ce77f42288e3437e8f11f452f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:21.867872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-858d9b0f-8275-4a25-83af-e013239a1140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31b61b5ce77f42288e3437e8f11f452f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:21.886797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b7823690-c670-49ae-8710-4da03ddc96b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '663ceebb712748baa870315121a013d9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:21.887766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b7823690-c670-49ae-8710-4da03ddc96b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '663ceebb712748baa870315121a013d9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:21.901074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-858d9b0f-8275-4a25-83af-e013239a1140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31b61b5ce77f42288e3437e8f11f452f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:21.909003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b7823690-c670-49ae-8710-4da03ddc96b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '663ceebb712748baa870315121a013d9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:21.939507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-858d9b0f-8275-4a25-83af-e013239a1140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31b61b5ce77f42288e3437e8f11f452f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:21.947872 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1543/3104] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:50:21 2022] DELETE /identity/v3/users/31b61b5ce77f42288e3437e8f11f452f => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:21.952992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f71f2e-530f-4cda-9aa6-b0da3a518b18 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:21.953276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f71f2e-530f-4cda-9aa6-b0da3a518b18 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:21.953697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f71f2e-530f-4cda-9aa6-b0da3a518b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:21.956252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b7823690-c670-49ae-8710-4da03ddc96b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '663ceebb712748baa870315121a013d9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:21.977428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b7823690-c670-49ae-8710-4da03ddc96b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '663ceebb712748baa870315121a013d9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:21.988658 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1562/3105] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:50:21 2022] DELETE /identity/v3/users/663ceebb712748baa870315121a013d9 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:21.994087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-09f71f2e-530f-4cda-9aa6-b0da3a518b18 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:21.994355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab20f8d-dded-43b3-a8f2-80c9da6e4edd None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:21.995228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab20f8d-dded-43b3-a8f2-80c9da6e4edd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:21.995704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab20f8d-dded-43b3-a8f2-80c9da6e4edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:21.999678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-09f71f2e-530f-4cda-9aa6-b0da3a518b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:22.051557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5ab20f8d-dded-43b3-a8f2-80c9da6e4edd None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:22.052557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5ab20f8d-dded-43b3-a8f2-80c9da6e4edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:22.084004 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:22.183421 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1544/3106] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:22.204368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f71f2e-530f-4cda-9aa6-b0da3a518b18 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:22.207430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-09f71f2e-530f-4cda-9aa6-b0da3a518b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:22.238129 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1563/3107] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:22.264449 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:22.264992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab20f8d-dded-43b3-a8f2-80c9da6e4edd None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:22.267758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5ab20f8d-dded-43b3-a8f2-80c9da6e4edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:22.325760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f71f2e-530f-4cda-9aa6-b0da3a518b18 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:22.337749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d2a12-032a-4aa1-8788-1eb2a6b7c3b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:22.338282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d2a12-032a-4aa1-8788-1eb2a6b7c3b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:22.338620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d2a12-032a-4aa1-8788-1eb2a6b7c3b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:22.338956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d2a12-032a-4aa1-8788-1eb2a6b7c3b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:22.360635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d2a12-032a-4aa1-8788-1eb2a6b7c3b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:22.363601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d2a12-032a-4aa1-8788-1eb2a6b7c3b5 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:22.377485 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1545/3108] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:50:22.433221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab20f8d-dded-43b3-a8f2-80c9da6e4edd None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:22.439913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c7302-949e-41ac-84b7-c8109c39b01b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:22.440628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c7302-949e-41ac-84b7-c8109c39b01b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:22.440987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c7302-949e-41ac-84b7-c8109c39b01b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:22.441326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c7302-949e-41ac-84b7-c8109c39b01b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:22.461394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c7302-949e-41ac-84b7-c8109c39b01b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:22.463370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c7302-949e-41ac-84b7-c8109c39b01b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:22.477228 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1564/3109] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:22.659703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fc91d-a7e0-48ee-b91c-f15ef5b8aa4a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:22.660089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fc91d-a7e0-48ee-b91c-f15ef5b8aa4a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:22.660369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fc91d-a7e0-48ee-b91c-f15ef5b8aa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:22.698753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-051fc91d-a7e0-48ee-b91c-f15ef5b8aa4a None None] MFA Rules not processed for user `2e1c470f3d6847cba3f51eac8fd20472`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:22.700289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-051fc91d-a7e0-48ee-b91c-f15ef5b8aa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:22.841054 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1546/3110] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:22.903970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c7302-949e-41ac-84b7-c8109c39b01b service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:22.905846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-334c7302-949e-41ac-84b7-c8109c39b01b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:23.091803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c7302-949e-41ac-84b7-c8109c39b01b service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:23.100015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c446b2-0552-4445-b5e8-5abf7ef0634f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:23.100695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c446b2-0552-4445-b5e8-5abf7ef0634f service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:23.101372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c446b2-0552-4445-b5e8-5abf7ef0634f service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:23.101809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c446b2-0552-4445-b5e8-5abf7ef0634f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:23.114352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c446b2-0552-4445-b5e8-5abf7ef0634f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:23.117033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c446b2-0552-4445-b5e8-5abf7ef0634f service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:23.132392 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1565/3111] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:23.217354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fc91d-a7e0-48ee-b91c-f15ef5b8aa4a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:23.219053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-051fc91d-a7e0-48ee-b91c-f15ef5b8aa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:23.247375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fc91d-a7e0-48ee-b91c-f15ef5b8aa4a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:23.271160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1fe0e-dd29-48aa-8332-792bf0c0c5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:23.276646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1fe0e-dd29-48aa-8332-792bf0c0c5ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:23.276981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1fe0e-dd29-48aa-8332-792bf0c0c5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:23.277313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1fe0e-dd29-48aa-8332-792bf0c0c5ad admin admin] PATH_INFO: `/v3/projects/8927677202684c43a9e8717dcd5a50e8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:23.287198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1fe0e-dd29-48aa-8332-792bf0c0c5ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=8927677202684c43a9e8717dcd5a50e8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:23.292023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1fe0e-dd29-48aa-8332-792bf0c0c5ad admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:23.293615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c446b2-0552-4445-b5e8-5abf7ef0634f service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:23.296413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-34c446b2-0552-4445-b5e8-5abf7ef0634f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:23.328753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c446b2-0552-4445-b5e8-5abf7ef0634f service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:23.348423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1dad3-5393-40d0-b8d2-54b3b860a260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:23.349100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1dad3-5393-40d0-b8d2-54b3b860a260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:23.349377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1dad3-5393-40d0-b8d2-54b3b860a260 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:23.349646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1dad3-5393-40d0-b8d2-54b3b860a260 admin admin] PATH_INFO: `/v3/projects/7f8809e3172b48528850e4487456abe2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:23.358049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1dad3-5393-40d0-b8d2-54b3b860a260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f8809e3172b48528850e4487456abe2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:23.360988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1dad3-5393-40d0-b8d2-54b3b860a260 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:23.384307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-60c1fe0e-dd29-48aa-8332-792bf0c0c5ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8927677202684c43a9e8717dcd5a50e8', 'request_id': 'req-60c1fe0e-dd29-48aa-8332-792bf0c0c5ad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:23.405596 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-60c1fe0e-dd29-48aa-8332-792bf0c0c5ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8927677202684c43a9e8717dcd5a50e8', 'request_id': 'req-60c1fe0e-dd29-48aa-8332-792bf0c0c5ad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:23.422633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-60c1fe0e-dd29-48aa-8332-792bf0c0c5ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8927677202684c43a9e8717dcd5a50e8', 'request_id': 'req-60c1fe0e-dd29-48aa-8332-792bf0c0c5ad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:23.435385 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:23.450547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-60c1fe0e-dd29-48aa-8332-792bf0c0c5ad admin admin] The token cache is being invalidate because project 8927677202684c43a9e8717dcd5a50e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:50:23.451140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-60c1fe0e-dd29-48aa-8332-792bf0c0c5ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:23.452417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-60c1fe0e-dd29-48aa-8332-792bf0c0c5ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:23.460727 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1547/3112] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:50:23 2022] DELETE /identity/v3/projects/8927677202684c43a9e8717dcd5a50e8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:23.464957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e8937-060a-416e-bd20-8a9602bd6fad None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:23.465361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e8937-060a-416e-bd20-8a9602bd6fad None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:23.465722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e8937-060a-416e-bd20-8a9602bd6fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:23.470183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46c1dad3-5393-40d0-b8d2-54b3b860a260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f8809e3172b48528850e4487456abe2', 'request_id': 'req-46c1dad3-5393-40d0-b8d2-54b3b860a260'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:23.486934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46c1dad3-5393-40d0-b8d2-54b3b860a260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f8809e3172b48528850e4487456abe2', 'request_id': 'req-46c1dad3-5393-40d0-b8d2-54b3b860a260'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:23.504508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46c1dad3-5393-40d0-b8d2-54b3b860a260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f8809e3172b48528850e4487456abe2', 'request_id': 'req-46c1dad3-5393-40d0-b8d2-54b3b860a260'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:23.518151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-db8e8937-060a-416e-bd20-8a9602bd6fad None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:23.520278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-db8e8937-060a-416e-bd20-8a9602bd6fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:23.530590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46c1dad3-5393-40d0-b8d2-54b3b860a260 admin admin] The token cache is being invalidate because project 7f8809e3172b48528850e4487456abe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:50:23.530848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46c1dad3-5393-40d0-b8d2-54b3b860a260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:23.533698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46c1dad3-5393-40d0-b8d2-54b3b860a260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:23.536695 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1566/3113] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:50:23 2022] DELETE /identity/v3/projects/7f8809e3172b48528850e4487456abe2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:23.543044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115eef86-d1d5-46e6-8222-cda79e5b73f9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:23.545450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115eef86-d1d5-46e6-8222-cda79e5b73f9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:23.545833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115eef86-d1d5-46e6-8222-cda79e5b73f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:23.575358 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:23.591280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-115eef86-d1d5-46e6-8222-cda79e5b73f9 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:23.592670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-115eef86-d1d5-46e6-8222-cda79e5b73f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:23.637824 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1548/3114] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:23.639638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec175f60-05c9-4417-a0b8-1f738fbab09e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:23.640091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec175f60-05c9-4417-a0b8-1f738fbab09e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:23.640736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec175f60-05c9-4417-a0b8-1f738fbab09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:23.666324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ec175f60-05c9-4417-a0b8-1f738fbab09e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:23.672657 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1567/3115] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:50:23.674789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ec175f60-05c9-4417-a0b8-1f738fbab09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:23.676210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9d848-4473-4d88-80d2-fe0c4f4a1e96 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:23.676492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9d848-4473-4d88-80d2-fe0c4f4a1e96 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:23.676789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9d848-4473-4d88-80d2-fe0c4f4a1e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:23.692137 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1549/3116] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:23.694646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec175f60-05c9-4417-a0b8-1f738fbab09e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:23.720447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec175f60-05c9-4417-a0b8-1f738fbab09e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:23.730912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e6e9d848-4473-4d88-80d2-fe0c4f4a1e96 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:23.732744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e6e9d848-4473-4d88-80d2-fe0c4f4a1e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:23.740720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0bbb4-ae84-4e22-839f-7c4dd0081b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:23.741565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0bbb4-ae84-4e22-839f-7c4dd0081b69 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:23.741878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0bbb4-ae84-4e22-839f-7c4dd0081b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:23.742152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0bbb4-ae84-4e22-839f-7c4dd0081b69 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:23.742826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0bbb4-ae84-4e22-839f-7c4dd0081b69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:50:23.743094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0bbb4-ae84-4e22-839f-7c4dd0081b69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:23.751042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0bbb4-ae84-4e22-839f-7c4dd0081b69 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:23.753076 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1568/3117] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:23.755123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9d848-4473-4d88-80d2-fe0c4f4a1e96 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:23.773119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9d848-4473-4d88-80d2-fe0c4f4a1e96 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:23.783229 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1550/3118] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:50:23.785219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0bbb4-ae84-4e22-839f-7c4dd0081b69 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:23.788302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db68cc-9ad0-43b2-949c-cd09ec46f168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:23.789194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db68cc-9ad0-43b2-949c-cd09ec46f168 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:23.789637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db68cc-9ad0-43b2-949c-cd09ec46f168 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:23.790069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db68cc-9ad0-43b2-949c-cd09ec46f168 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:23.791120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db68cc-9ad0-43b2-949c-cd09ec46f168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:50:23.791606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db68cc-9ad0-43b2-949c-cd09ec46f168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:23.794465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db68cc-9ad0-43b2-949c-cd09ec46f168 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:23.800436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0bbb4-ae84-4e22-839f-7c4dd0081b69 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:23.820659 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1569/3119] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:50:23.822167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db68cc-9ad0-43b2-949c-cd09ec46f168 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:23.826307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9864eb-06d0-4802-a110-dade03516328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:23.826934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9864eb-06d0-4802-a110-dade03516328 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:23.827212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9864eb-06d0-4802-a110-dade03516328 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:23.827460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9864eb-06d0-4802-a110-dade03516328 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:23.828091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9864eb-06d0-4802-a110-dade03516328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:23.829974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9864eb-06d0-4802-a110-dade03516328 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:23.838715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db68cc-9ad0-43b2-949c-cd09ec46f168 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:23.847242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a94dd-4117-4303-8ccf-9cc8f76882fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:23.848119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a94dd-4117-4303-8ccf-9cc8f76882fc admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:23.848468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a94dd-4117-4303-8ccf-9cc8f76882fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:23.848910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a94dd-4117-4303-8ccf-9cc8f76882fc admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:23.849932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a94dd-4117-4303-8ccf-9cc8f76882fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:23.853176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a94dd-4117-4303-8ccf-9cc8f76882fc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:23.895225 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1551/3120] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:50:23 2022] POST /identity/v3/projects => generated 401 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:50:23.899843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9864eb-06d0-4802-a110-dade03516328 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:23.914553 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1570/3121] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:50:23 2022] POST /identity/v3/projects => generated 397 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:50:23.918288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a94dd-4117-4303-8ccf-9cc8f76882fc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:24.076423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9864eb-06d0-4802-a110-dade03516328 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:24.080084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a94dd-4117-4303-8ccf-9cc8f76882fc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:24.088333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194a4b7-5845-4a1c-9ab7-a7ae43a7e391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:24.089006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194a4b7-5845-4a1c-9ab7-a7ae43a7e391 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:24.089315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194a4b7-5845-4a1c-9ab7-a7ae43a7e391 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:24.089589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194a4b7-5845-4a1c-9ab7-a7ae43a7e391 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:24.089973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06930168-5bb4-4100-9313-954e4694af8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:24.090374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194a4b7-5845-4a1c-9ab7-a7ae43a7e391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:24.091048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06930168-5bb4-4100-9313-954e4694af8b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:24.092756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194a4b7-5845-4a1c-9ab7-a7ae43a7e391 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:24.092978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06930168-5bb4-4100-9313-954e4694af8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:24.094071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06930168-5bb4-4100-9313-954e4694af8b admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:24.094816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06930168-5bb4-4100-9313-954e4694af8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:24.098460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06930168-5bb4-4100-9313-954e4694af8b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:24.126593 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1552/3122] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:50:23 2022] POST /identity/v3/users => generated 301 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:50:24.131516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06930168-5bb4-4100-9313-954e4694af8b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:24.157054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06930168-5bb4-4100-9313-954e4694af8b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:24.158484 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1571/3123] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:50:23 2022] POST /identity/v3/users => generated 299 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:50:24.161128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194a4b7-5845-4a1c-9ab7-a7ae43a7e391 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:24.163093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cfdd5-8b39-4e34-837e-ed972bae0486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:24.163863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cfdd5-8b39-4e34-837e-ed972bae0486 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:24.164234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cfdd5-8b39-4e34-837e-ed972bae0486 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:24.164615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cfdd5-8b39-4e34-837e-ed972bae0486 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:24.165366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cfdd5-8b39-4e34-837e-ed972bae0486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:24.167177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cfdd5-8b39-4e34-837e-ed972bae0486 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:24.186244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194a4b7-5845-4a1c-9ab7-a7ae43a7e391 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:24.195308 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1553/3124] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:50:24.196937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cfdd5-8b39-4e34-837e-ed972bae0486 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:24.208287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3561b02-a7af-4c7f-ad1a-26750e93466c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:24.209915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3561b02-a7af-4c7f-ad1a-26750e93466c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:24.210862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3561b02-a7af-4c7f-ad1a-26750e93466c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:24.211856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3561b02-a7af-4c7f-ad1a-26750e93466c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:24.216915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3561b02-a7af-4c7f-ad1a-26750e93466c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:24.219142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3561b02-a7af-4c7f-ad1a-26750e93466c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:24.237740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cfdd5-8b39-4e34-837e-ed972bae0486 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:24.251895 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1572/3125] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:50:24.254696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3561b02-a7af-4c7f-ad1a-26750e93466c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:24.258577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb126eac-df7b-4de8-a0e5-7d1a153f0680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:24.271326 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:24.277403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb126eac-df7b-4de8-a0e5-7d1a153f0680 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:24.279006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb126eac-df7b-4de8-a0e5-7d1a153f0680 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:24.281173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb126eac-df7b-4de8-a0e5-7d1a153f0680 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:24.284194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb126eac-df7b-4de8-a0e5-7d1a153f0680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:24.289406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb126eac-df7b-4de8-a0e5-7d1a153f0680 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:24.289660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3561b02-a7af-4c7f-ad1a-26750e93466c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:24.311563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feec443-aa66-4ca3-8540-1190605f5f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:24.312314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feec443-aa66-4ca3-8540-1190605f5f9f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:24.312643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feec443-aa66-4ca3-8540-1190605f5f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:24.312924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feec443-aa66-4ca3-8540-1190605f5f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:24.313577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feec443-aa66-4ca3-8540-1190605f5f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:24.315961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feec443-aa66-4ca3-8540-1190605f5f9f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:24.341852 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1573/3126] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:50:24.346643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feec443-aa66-4ca3-8540-1190605f5f9f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:24.372590 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1554/3127] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:50:24.373780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb126eac-df7b-4de8-a0e5-7d1a153f0680 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:24.378603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feec443-aa66-4ca3-8540-1190605f5f9f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:24.408510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb126eac-df7b-4de8-a0e5-7d1a153f0680 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:24.416013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921ed75-7bc3-4406-8c30-e07119d7f297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:24.417213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921ed75-7bc3-4406-8c30-e07119d7f297 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:24.417701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921ed75-7bc3-4406-8c30-e07119d7f297 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:24.418193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921ed75-7bc3-4406-8c30-e07119d7f297 admin admin] PATH_INFO: `/v3/projects/ea5df79cbd0e4724906b44b817d92ff0/users/79a274a674314f949bab08edb7b8bbeb/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:24.422990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3df925-3733-4994-b77a-1edc7ae00841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:24.423676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3df925-3733-4994-b77a-1edc7ae00841 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:24.424482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3df925-3733-4994-b77a-1edc7ae00841 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:24.424857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3df925-3733-4994-b77a-1edc7ae00841 admin admin] PATH_INFO: `/v3/projects/35fb232a74c14bdfbd1f006f2f5fe642/users/73c991fc5d0843528570b3f8bf9fa269/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:24.451671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921ed75-7bc3-4406-8c30-e07119d7f297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea5df79cbd0e4724906b44b817d92ff0, user_id=79a274a674314f949bab08edb7b8bbeb, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:24.459357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921ed75-7bc3-4406-8c30-e07119d7f297 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:24.468833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3df925-3733-4994-b77a-1edc7ae00841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35fb232a74c14bdfbd1f006f2f5fe642, user_id=73c991fc5d0843528570b3f8bf9fa269, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:24.473147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3df925-3733-4994-b77a-1edc7ae00841 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:24.493977 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1574/3128] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:50:24 2022] PUT /identity/v3/projects/ea5df79cbd0e4724906b44b817d92ff0/users/79a274a674314f949bab08edb7b8bbeb/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:24.508140 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1555/3129] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:50:24 2022] PUT /identity/v3/projects/35fb232a74c14bdfbd1f006f2f5fe642/users/73c991fc5d0843528570b3f8bf9fa269/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:24.517023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6792d-3358-47c5-a20f-e9f9f46773c0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:24.517309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6792d-3358-47c5-a20f-e9f9f46773c0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:24.518859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e26f5b-d016-4ee4-a63f-90fcda0363da None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:24.519005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6792d-3358-47c5-a20f-e9f9f46773c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:24.519367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e26f5b-d016-4ee4-a63f-90fcda0363da None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:24.520040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e26f5b-d016-4ee4-a63f-90fcda0363da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:24.591602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d2e26f5b-d016-4ee4-a63f-90fcda0363da None None] MFA Rules not processed for user `73c991fc5d0843528570b3f8bf9fa269`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:24.597615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d2e26f5b-d016-4ee4-a63f-90fcda0363da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:24.640286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b4d6792d-3358-47c5-a20f-e9f9f46773c0 None None] MFA Rules not processed for user `79a274a674314f949bab08edb7b8bbeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:24.670043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b4d6792d-3358-47c5-a20f-e9f9f46773c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:24.675457 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:24.827599 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1556/3130] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:24 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:50:24.842250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e26f5b-d016-4ee4-a63f-90fcda0363da None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:24.845234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d2e26f5b-d016-4ee4-a63f-90fcda0363da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:24.904783 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1575/3131] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:24.919913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6792d-3358-47c5-a20f-e9f9f46773c0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:24.929946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b4d6792d-3358-47c5-a20f-e9f9f46773c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:25.008758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e26f5b-d016-4ee4-a63f-90fcda0363da None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:25.014938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3abd3a-e108-46d6-a786-7a8164f83492 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:25.016773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3abd3a-e108-46d6-a786-7a8164f83492 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:25.016773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3abd3a-e108-46d6-a786-7a8164f83492 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:25.016773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3abd3a-e108-46d6-a786-7a8164f83492 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:25.034075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3abd3a-e108-46d6-a786-7a8164f83492 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:25.037097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3abd3a-e108-46d6-a786-7a8164f83492 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:25.055595 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1557/3132] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:24 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:25.139336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3abd3a-e108-46d6-a786-7a8164f83492 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:25.150484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6792d-3358-47c5-a20f-e9f9f46773c0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:25.172132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e23c6-c81c-4656-b900-eb097a7aa97f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:25.174735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e23c6-c81c-4656-b900-eb097a7aa97f service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:25.175029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e23c6-c81c-4656-b900-eb097a7aa97f service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:25.175316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e23c6-c81c-4656-b900-eb097a7aa97f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:25.242305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e23c6-c81c-4656-b900-eb097a7aa97f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:25.244014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e23c6-c81c-4656-b900-eb097a7aa97f service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:25.288813 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1576/3133] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:24 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:25.357397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3abd3a-e108-46d6-a786-7a8164f83492 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:25.364910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b809ca-d0de-404c-9ada-f8fcd0e36e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:25.365563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b809ca-d0de-404c-9ada-f8fcd0e36e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:25.365845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b809ca-d0de-404c-9ada-f8fcd0e36e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:25.366275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b809ca-d0de-404c-9ada-f8fcd0e36e2c admin admin] PATH_INFO: `/v3/users/73c991fc5d0843528570b3f8bf9fa269` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:25.367455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b809ca-d0de-404c-9ada-f8fcd0e36e2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c991fc5d0843528570b3f8bf9fa269)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:25.369488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b809ca-d0de-404c-9ada-f8fcd0e36e2c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:25.413625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96ef27-b69a-4cef-851c-64a563303e15 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:25.413933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96ef27-b69a-4cef-851c-64a563303e15 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:25.414798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96ef27-b69a-4cef-851c-64a563303e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:25.469676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4c96ef27-b69a-4cef-851c-64a563303e15 None None] MFA Rules not processed for user `79a274a674314f949bab08edb7b8bbeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:25.477786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4c96ef27-b69a-4cef-851c-64a563303e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:25.498821 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1577/3134] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:25 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:25.506039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c6b809ca-d0de-404c-9ada-f8fcd0e36e2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c991fc5d0843528570b3f8bf9fa269'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:25.509280 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:25.522510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c6b809ca-d0de-404c-9ada-f8fcd0e36e2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c991fc5d0843528570b3f8bf9fa269'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:25.523151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c6b809ca-d0de-404c-9ada-f8fcd0e36e2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c991fc5d0843528570b3f8bf9fa269'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:25.547426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c6b809ca-d0de-404c-9ada-f8fcd0e36e2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c991fc5d0843528570b3f8bf9fa269'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:25.570151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c6b809ca-d0de-404c-9ada-f8fcd0e36e2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c991fc5d0843528570b3f8bf9fa269'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:25.582900 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1558/3135] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:50:25 2022] DELETE /identity/v3/users/73c991fc5d0843528570b3f8bf9fa269 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:25.587358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f55e9-9e36-4d15-b0f0-942e18579bbf None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:25.588573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f55e9-9e36-4d15-b0f0-942e18579bbf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:25.589418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f55e9-9e36-4d15-b0f0-942e18579bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:25.623367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-970f55e9-9e36-4d15-b0f0-942e18579bbf None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:25.625066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-970f55e9-9e36-4d15-b0f0-942e18579bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:25.702036 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:25.771497 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1578/3136] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:25.782902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b809ca-d0de-404c-9ada-f8fcd0e36e2c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:25.785385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c6b809ca-d0de-404c-9ada-f8fcd0e36e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:25.960386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b809ca-d0de-404c-9ada-f8fcd0e36e2c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:25.965204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439665f-3552-459c-9217-9f5eb07df0a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:25.966197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439665f-3552-459c-9217-9f5eb07df0a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:25.966653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439665f-3552-459c-9217-9f5eb07df0a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:25.967092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439665f-3552-459c-9217-9f5eb07df0a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:25.980815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439665f-3552-459c-9217-9f5eb07df0a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:25.982530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439665f-3552-459c-9217-9f5eb07df0a7 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:25.996000 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1559/3137] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:26.480310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f55e9-9e36-4d15-b0f0-942e18579bbf None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:26.484893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-970f55e9-9e36-4d15-b0f0-942e18579bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:26.531660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439665f-3552-459c-9217-9f5eb07df0a7 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:26.533329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0439665f-3552-459c-9217-9f5eb07df0a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:26.542112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f55e9-9e36-4d15-b0f0-942e18579bbf None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:26.557291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439665f-3552-459c-9217-9f5eb07df0a7 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:26.561202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c70fb-d21f-4c23-abf3-775c34d6fddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:26.563345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c70fb-d21f-4c23-abf3-775c34d6fddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:26.566171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c70fb-d21f-4c23-abf3-775c34d6fddb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:26.566455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c70fb-d21f-4c23-abf3-775c34d6fddb admin admin] PATH_INFO: `/v3/users/79a274a674314f949bab08edb7b8bbeb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:26.571260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c70fb-d21f-4c23-abf3-775c34d6fddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=79a274a674314f949bab08edb7b8bbeb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:26.576211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c70fb-d21f-4c23-abf3-775c34d6fddb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:26.592041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682cd36-6b1b-49ea-a240-ca7dab83f883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:26.592167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682cd36-6b1b-49ea-a240-ca7dab83f883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:26.593107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682cd36-6b1b-49ea-a240-ca7dab83f883 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:26.593107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682cd36-6b1b-49ea-a240-ca7dab83f883 admin admin] PATH_INFO: `/v3/projects/35fb232a74c14bdfbd1f006f2f5fe642` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:26.594162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682cd36-6b1b-49ea-a240-ca7dab83f883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35fb232a74c14bdfbd1f006f2f5fe642)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:26.596151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682cd36-6b1b-49ea-a240-ca7dab83f883 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:26.681622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b96c70fb-d21f-4c23-abf3-775c34d6fddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79a274a674314f949bab08edb7b8bbeb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:26.682420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b96c70fb-d21f-4c23-abf3-775c34d6fddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79a274a674314f949bab08edb7b8bbeb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:26.692077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b96c70fb-d21f-4c23-abf3-775c34d6fddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79a274a674314f949bab08edb7b8bbeb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:26.694802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6682cd36-6b1b-49ea-a240-ca7dab83f883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35fb232a74c14bdfbd1f006f2f5fe642', 'request_id': 'req-6682cd36-6b1b-49ea-a240-ca7dab83f883'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:26.726656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b96c70fb-d21f-4c23-abf3-775c34d6fddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79a274a674314f949bab08edb7b8bbeb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:26.726859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6682cd36-6b1b-49ea-a240-ca7dab83f883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35fb232a74c14bdfbd1f006f2f5fe642', 'request_id': 'req-6682cd36-6b1b-49ea-a240-ca7dab83f883'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:26.737897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b96c70fb-d21f-4c23-abf3-775c34d6fddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79a274a674314f949bab08edb7b8bbeb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:26.745377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6682cd36-6b1b-49ea-a240-ca7dab83f883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35fb232a74c14bdfbd1f006f2f5fe642', 'request_id': 'req-6682cd36-6b1b-49ea-a240-ca7dab83f883'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:26.753182 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1579/3138] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:50:26 2022] DELETE /identity/v3/users/79a274a674314f949bab08edb7b8bbeb => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:26.762383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402a10d-ce39-4e11-983c-f20055d08ed0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:26.765280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402a10d-ce39-4e11-983c-f20055d08ed0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:26.765647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402a10d-ce39-4e11-983c-f20055d08ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:26.780964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6682cd36-6b1b-49ea-a240-ca7dab83f883 admin admin] The token cache is being invalidate because project 35fb232a74c14bdfbd1f006f2f5fe642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:50:26.781411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6682cd36-6b1b-49ea-a240-ca7dab83f883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:26.782236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6682cd36-6b1b-49ea-a240-ca7dab83f883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:26.784452 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1560/3139] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:50:26 2022] DELETE /identity/v3/projects/35fb232a74c14bdfbd1f006f2f5fe642 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:26.789757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608c39c-1b89-4b05-82b1-793b82eb11fa None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:26.790258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608c39c-1b89-4b05-82b1-793b82eb11fa None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:26.790768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608c39c-1b89-4b05-82b1-793b82eb11fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:26.793323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6402a10d-ce39-4e11-983c-f20055d08ed0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:26.794801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6402a10d-ce39-4e11-983c-f20055d08ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:26.818523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a608c39c-1b89-4b05-82b1-793b82eb11fa None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:26.819908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a608c39c-1b89-4b05-82b1-793b82eb11fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:26.946991 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1580/3140] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:50:26.970486 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:26.993121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402a10d-ce39-4e11-983c-f20055d08ed0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:26.994799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6402a10d-ce39-4e11-983c-f20055d08ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:27.008963 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1561/3141] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:27.015350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f6197-91d2-484e-9d0d-66367e25118e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:27.015870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f6197-91d2-484e-9d0d-66367e25118e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:27.016486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f6197-91d2-484e-9d0d-66367e25118e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:27.061582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8b1f6197-91d2-484e-9d0d-66367e25118e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:27.063175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8b1f6197-91d2-484e-9d0d-66367e25118e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:27.075565 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1562/3142] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:50:27.079725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f6197-91d2-484e-9d0d-66367e25118e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:27.105868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f6197-91d2-484e-9d0d-66367e25118e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:27.122477 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:27.124560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d006952-763d-487e-97fa-aef2a190d0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:27.125289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d006952-763d-487e-97fa-aef2a190d0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:27.125570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d006952-763d-487e-97fa-aef2a190d0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:27.127664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d006952-763d-487e-97fa-aef2a190d0f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:27.129110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d006952-763d-487e-97fa-aef2a190d0f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:50:27.129434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d006952-763d-487e-97fa-aef2a190d0f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:27.133827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402a10d-ce39-4e11-983c-f20055d08ed0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:27.134298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d006952-763d-487e-97fa-aef2a190d0f0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:27.145287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40da6eb-da05-4dfb-8eae-a97f9ab31cd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:27.146449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40da6eb-da05-4dfb-8eae-a97f9ab31cd8 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:27.146957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40da6eb-da05-4dfb-8eae-a97f9ab31cd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:27.147447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40da6eb-da05-4dfb-8eae-a97f9ab31cd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:27.173398 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1563/3143] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:50:27.177113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d006952-763d-487e-97fa-aef2a190d0f0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:27.179393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40da6eb-da05-4dfb-8eae-a97f9ab31cd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:27.183168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40da6eb-da05-4dfb-8eae-a97f9ab31cd8 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:27.207670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d006952-763d-487e-97fa-aef2a190d0f0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:27.213486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1c6a5-2476-4ca9-90f0-9fa64aa04993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:27.214179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1c6a5-2476-4ca9-90f0-9fa64aa04993 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:27.214455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1c6a5-2476-4ca9-90f0-9fa64aa04993 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:27.214725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1c6a5-2476-4ca9-90f0-9fa64aa04993 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:27.215359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1c6a5-2476-4ca9-90f0-9fa64aa04993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:27.218212 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1581/3144] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:50:27.220312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1c6a5-2476-4ca9-90f0-9fa64aa04993 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:27.288206 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40da6eb-da05-4dfb-8eae-a97f9ab31cd8 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:27.293057 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1564/3145] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:50:27 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:50:27.305291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40da6eb-da05-4dfb-8eae-a97f9ab31cd8 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:27.473326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c1aba-7e84-40de-8448-ee963c43d71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:27.477412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c1aba-7e84-40de-8448-ee963c43d71c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:27.477961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c1aba-7e84-40de-8448-ee963c43d71c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:27.478456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c1aba-7e84-40de-8448-ee963c43d71c admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:27.479461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c1aba-7e84-40de-8448-ee963c43d71c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:27.483530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c1aba-7e84-40de-8448-ee963c43d71c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:27.544171 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1582/3146] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:50:27 2022] POST /identity/v3/users => generated 286 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:50:27.545554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1c6a5-2476-4ca9-90f0-9fa64aa04993 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:27.569106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1c6a5-2476-4ca9-90f0-9fa64aa04993 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:27.587606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a94bd-c21a-4fb0-96ac-8c77c5f348f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:27.588472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a94bd-c21a-4fb0-96ac-8c77c5f348f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:27.588941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a94bd-c21a-4fb0-96ac-8c77c5f348f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:27.589387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a94bd-c21a-4fb0-96ac-8c77c5f348f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:27.590281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a94bd-c21a-4fb0-96ac-8c77c5f348f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:27.593538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a94bd-c21a-4fb0-96ac-8c77c5f348f9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:27.622802 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1565/3147] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:50:27.625201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c1aba-7e84-40de-8448-ee963c43d71c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:27.642523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c1aba-7e84-40de-8448-ee963c43d71c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:27.668935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec81f0-4515-4a77-96ec-a82ed133d574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:27.669446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec81f0-4515-4a77-96ec-a82ed133d574 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:27.669731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec81f0-4515-4a77-96ec-a82ed133d574 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:27.670052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec81f0-4515-4a77-96ec-a82ed133d574 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:27.670716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec81f0-4515-4a77-96ec-a82ed133d574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:27.672356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec81f0-4515-4a77-96ec-a82ed133d574 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:27.717682 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1583/3148] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:50:27.718043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a94bd-c21a-4fb0-96ac-8c77c5f348f9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:27.734804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a94bd-c21a-4fb0-96ac-8c77c5f348f9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:27.747523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0290e-32af-4aa0-a3d8-c995edca230d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:27.748215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0290e-32af-4aa0-a3d8-c995edca230d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:27.748492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0290e-32af-4aa0-a3d8-c995edca230d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:27.748797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0290e-32af-4aa0-a3d8-c995edca230d admin admin] PATH_INFO: `/v3/projects/f9de8f4dfc48422cba1d1fe9399d94d9/users/690ab28dc5164c25bff55313e5656d24/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:27.783868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0290e-32af-4aa0-a3d8-c995edca230d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9de8f4dfc48422cba1d1fe9399d94d9, user_id=690ab28dc5164c25bff55313e5656d24, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:27.786745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0290e-32af-4aa0-a3d8-c995edca230d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:27.816780 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1566/3149] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:50:27 2022] PUT /identity/v3/projects/f9de8f4dfc48422cba1d1fe9399d94d9/users/690ab28dc5164c25bff55313e5656d24/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:50:27.829535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16732f5-40f3-4925-9bc7-2d8a97865e46 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:27.830029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16732f5-40f3-4925-9bc7-2d8a97865e46 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:27.830703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16732f5-40f3-4925-9bc7-2d8a97865e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:27.883948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e16732f5-40f3-4925-9bc7-2d8a97865e46 None None] MFA Rules not processed for user `690ab28dc5164c25bff55313e5656d24`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:27.885694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e16732f5-40f3-4925-9bc7-2d8a97865e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:28.054670 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1584/3150] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:28.075818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0290e-32af-4aa0-a3d8-c995edca230d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:28.078534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-54c0290e-32af-4aa0-a3d8-c995edca230d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:28.247494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0290e-32af-4aa0-a3d8-c995edca230d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:28.263208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a9aea-6b72-4bb7-80b2-2cc2bfe35033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:28.263914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a9aea-6b72-4bb7-80b2-2cc2bfe35033 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:28.264492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a9aea-6b72-4bb7-80b2-2cc2bfe35033 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:28.264807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a9aea-6b72-4bb7-80b2-2cc2bfe35033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:28.280551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a9aea-6b72-4bb7-80b2-2cc2bfe35033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:28.283185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a9aea-6b72-4bb7-80b2-2cc2bfe35033 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:28.308776 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1567/3151] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:28.851957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16732f5-40f3-4925-9bc7-2d8a97865e46 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:28.854309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e16732f5-40f3-4925-9bc7-2d8a97865e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:29.022450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16732f5-40f3-4925-9bc7-2d8a97865e46 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:29.030026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f587c8e-2570-4463-8d3a-ba6bbbfd8a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:29.031391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f587c8e-2570-4463-8d3a-ba6bbbfd8a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:29.032324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f587c8e-2570-4463-8d3a-ba6bbbfd8a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:29.032866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f587c8e-2570-4463-8d3a-ba6bbbfd8a0b admin admin] PATH_INFO: `/v3/projects/ea5df79cbd0e4724906b44b817d92ff0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:29.037730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f587c8e-2570-4463-8d3a-ba6bbbfd8a0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea5df79cbd0e4724906b44b817d92ff0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:29.051134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f587c8e-2570-4463-8d3a-ba6bbbfd8a0b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:29.053623 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:29.133410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4f587c8e-2570-4463-8d3a-ba6bbbfd8a0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea5df79cbd0e4724906b44b817d92ff0', 'request_id': 'req-4f587c8e-2570-4463-8d3a-ba6bbbfd8a0b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:29.144478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4f587c8e-2570-4463-8d3a-ba6bbbfd8a0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea5df79cbd0e4724906b44b817d92ff0', 'request_id': 'req-4f587c8e-2570-4463-8d3a-ba6bbbfd8a0b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:29.156517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4f587c8e-2570-4463-8d3a-ba6bbbfd8a0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea5df79cbd0e4724906b44b817d92ff0', 'request_id': 'req-4f587c8e-2570-4463-8d3a-ba6bbbfd8a0b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:29.196053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4f587c8e-2570-4463-8d3a-ba6bbbfd8a0b admin admin] The token cache is being invalidate because project ea5df79cbd0e4724906b44b817d92ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:50:29.198429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4f587c8e-2570-4463-8d3a-ba6bbbfd8a0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:29.200732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4f587c8e-2570-4463-8d3a-ba6bbbfd8a0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:29.207390 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1585/3152] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:50:28 2022] DELETE /identity/v3/projects/ea5df79cbd0e4724906b44b817d92ff0 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:29.214460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a0757-ba97-4e48-9bb6-16f72bdb1583 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:29.215042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a0757-ba97-4e48-9bb6-16f72bdb1583 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:29.215374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a0757-ba97-4e48-9bb6-16f72bdb1583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:29.270511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-829a0757-ba97-4e48-9bb6-16f72bdb1583 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:29.273918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-829a0757-ba97-4e48-9bb6-16f72bdb1583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:29.496124 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:29.554472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f587c8e-2570-4463-8d3a-ba6bbbfd8a0b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:29.555932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4f587c8e-2570-4463-8d3a-ba6bbbfd8a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:29.585963 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1568/3153] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:29.586660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f587c8e-2570-4463-8d3a-ba6bbbfd8a0b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:29.591396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef902d-c35f-457d-adf6-48eb8f2a2517 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:29.591986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef902d-c35f-457d-adf6-48eb8f2a2517 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:29.592365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef902d-c35f-457d-adf6-48eb8f2a2517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:29.605996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee75138-3dd3-47fd-baee-29ec1dc92121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:29.606663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee75138-3dd3-47fd-baee-29ec1dc92121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:29.606945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee75138-3dd3-47fd-baee-29ec1dc92121 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:29.607284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee75138-3dd3-47fd-baee-29ec1dc92121 admin admin] PATH_INFO: `/v3/users/690ab28dc5164c25bff55313e5656d24` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:29.610789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee75138-3dd3-47fd-baee-29ec1dc92121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=690ab28dc5164c25bff55313e5656d24)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:29.620043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee75138-3dd3-47fd-baee-29ec1dc92121 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:29.640177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1bef902d-c35f-457d-adf6-48eb8f2a2517 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:29.641719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1bef902d-c35f-457d-adf6-48eb8f2a2517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:29.666667 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1569/3154] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:50:29.670660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef902d-c35f-457d-adf6-48eb8f2a2517 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:29.694513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef902d-c35f-457d-adf6-48eb8f2a2517 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:29.714069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e6fc9-6279-4946-80f2-9a43bc4383a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:29.717450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e6fc9-6279-4946-80f2-9a43bc4383a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:29.717450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e6fc9-6279-4946-80f2-9a43bc4383a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:29.727458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e6fc9-6279-4946-80f2-9a43bc4383a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:29.754473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e6fc9-6279-4946-80f2-9a43bc4383a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:50:29.754807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e6fc9-6279-4946-80f2-9a43bc4383a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:29.764237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e6fc9-6279-4946-80f2-9a43bc4383a5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:29.807133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ee75138-3dd3-47fd-baee-29ec1dc92121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '690ab28dc5164c25bff55313e5656d24'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:29.818565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ee75138-3dd3-47fd-baee-29ec1dc92121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '690ab28dc5164c25bff55313e5656d24'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:29.828961 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1570/3155] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:50:29.837763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e6fc9-6279-4946-80f2-9a43bc4383a5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:29.841217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ee75138-3dd3-47fd-baee-29ec1dc92121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '690ab28dc5164c25bff55313e5656d24'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:29.844986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-588e6fc9-6279-4946-80f2-9a43bc4383a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:29.882287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e6fc9-6279-4946-80f2-9a43bc4383a5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:29.889264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ee75138-3dd3-47fd-baee-29ec1dc92121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '690ab28dc5164c25bff55313e5656d24'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:29.905023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f8152-2489-4d56-b45f-e32647a5ae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:29.905490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f8152-2489-4d56-b45f-e32647a5ae7a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:29.905780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f8152-2489-4d56-b45f-e32647a5ae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:29.906150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f8152-2489-4d56-b45f-e32647a5ae7a admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:29.906688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f8152-2489-4d56-b45f-e32647a5ae7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:29.907208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ee75138-3dd3-47fd-baee-29ec1dc92121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '690ab28dc5164c25bff55313e5656d24'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:29.929445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f8152-2489-4d56-b45f-e32647a5ae7a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:29.931346 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1586/3156] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:50:29 2022] DELETE /identity/v3/users/690ab28dc5164c25bff55313e5656d24 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:29.935989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6bf2-5d96-4197-907c-e1aca06fe856 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:29.936357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6bf2-5d96-4197-907c-e1aca06fe856 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:29.936793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6bf2-5d96-4197-907c-e1aca06fe856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:29.993424 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1571/3157] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:50:29 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:50:29.997294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f8152-2489-4d56-b45f-e32647a5ae7a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:29.999543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-51cf6bf2-5d96-4197-907c-e1aca06fe856 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:30.007641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-51cf6bf2-5d96-4197-907c-e1aca06fe856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:30.134199 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1587/3158] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:50:30.144916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf6bf2-5d96-4197-907c-e1aca06fe856 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:30.146650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-51cf6bf2-5d96-4197-907c-e1aca06fe856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:30.151521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f8152-2489-4d56-b45f-e32647a5ae7a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:30.152980 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:30.162871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da017d5a-95a8-4ab5-b240-c6f338a02d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:30.163621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da017d5a-95a8-4ab5-b240-c6f338a02d22 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:30.163928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da017d5a-95a8-4ab5-b240-c6f338a02d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:30.164238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da017d5a-95a8-4ab5-b240-c6f338a02d22 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:30.165039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da017d5a-95a8-4ab5-b240-c6f338a02d22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:30.167630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da017d5a-95a8-4ab5-b240-c6f338a02d22 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:30.199014 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1572/3159] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:50:29 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:50:30.203107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da017d5a-95a8-4ab5-b240-c6f338a02d22 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:30.223724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da017d5a-95a8-4ab5-b240-c6f338a02d22 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:30.237364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c7a75-360f-402a-8457-34c729426398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:30.238094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c7a75-360f-402a-8457-34c729426398 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:30.238374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c7a75-360f-402a-8457-34c729426398 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:30.238692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c7a75-360f-402a-8457-34c729426398 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:30.239466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c7a75-360f-402a-8457-34c729426398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:30.240956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c7a75-360f-402a-8457-34c729426398 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:30.245150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf6bf2-5d96-4197-907c-e1aca06fe856 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:30.251983 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1573/3160] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:50:30.256511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c7a75-360f-402a-8457-34c729426398 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:30.257904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b6561-6c44-4608-8fd1-e88cd8781308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:30.258523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b6561-6c44-4608-8fd1-e88cd8781308 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:30.258850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b6561-6c44-4608-8fd1-e88cd8781308 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:30.259070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b6561-6c44-4608-8fd1-e88cd8781308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:30.268293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c7a75-360f-402a-8457-34c729426398 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:30.274237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303af8db-5bb1-4b4c-944e-67b1caf61e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:30.274833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303af8db-5bb1-4b4c-944e-67b1caf61e30 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:30.275815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303af8db-5bb1-4b4c-944e-67b1caf61e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:30.276534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303af8db-5bb1-4b4c-944e-67b1caf61e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:30.278000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303af8db-5bb1-4b4c-944e-67b1caf61e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:30.281333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b6561-6c44-4608-8fd1-e88cd8781308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:30.281701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303af8db-5bb1-4b4c-944e-67b1caf61e30 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:30.284021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b6561-6c44-4608-8fd1-e88cd8781308 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:30.297001 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1574/3161] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:50:30.302466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303af8db-5bb1-4b4c-944e-67b1caf61e30 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:30.307756 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1588/3162] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:50:30.316316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303af8db-5bb1-4b4c-944e-67b1caf61e30 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:30.333067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938bbed-02f3-4f51-bade-db3ff811c8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:30.333743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938bbed-02f3-4f51-bade-db3ff811c8df admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:30.334019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938bbed-02f3-4f51-bade-db3ff811c8df admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:30.334290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938bbed-02f3-4f51-bade-db3ff811c8df admin admin] PATH_INFO: `/v3/projects/1cb19ecfa4ee40a096eb01f8357afe03/users/1601a65c979846cda98c3cd501a71d71/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:30.367935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938bbed-02f3-4f51-bade-db3ff811c8df admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb19ecfa4ee40a096eb01f8357afe03, user_id=1601a65c979846cda98c3cd501a71d71, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:30.372982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938bbed-02f3-4f51-bade-db3ff811c8df admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:30.411619 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1575/3163] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:50:30 2022] PUT /identity/v3/projects/1cb19ecfa4ee40a096eb01f8357afe03/users/1601a65c979846cda98c3cd501a71d71/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:50:30.411853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea50b3-2956-4a39-b7e7-1088b0c39785 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:30.411853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea50b3-2956-4a39-b7e7-1088b0c39785 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:30.411853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea50b3-2956-4a39-b7e7-1088b0c39785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:30.466877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f0ea50b3-2956-4a39-b7e7-1088b0c39785 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:30.468415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f0ea50b3-2956-4a39-b7e7-1088b0c39785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:30.644393 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1589/3164] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:30.694719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938bbed-02f3-4f51-bade-db3ff811c8df admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:30.904148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938bbed-02f3-4f51-bade-db3ff811c8df admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:30.928900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55f306-5bc2-4bb4-b655-ea1216a9898e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:30.929529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55f306-5bc2-4bb4-b655-ea1216a9898e service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:30.930338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55f306-5bc2-4bb4-b655-ea1216a9898e service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:30.930610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55f306-5bc2-4bb4-b655-ea1216a9898e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:30.971601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55f306-5bc2-4bb4-b655-ea1216a9898e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:30.975895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55f306-5bc2-4bb4-b655-ea1216a9898e service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:31.012752 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1576/3165] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:31.196486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea50b3-2956-4a39-b7e7-1088b0c39785 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:31.199116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f0ea50b3-2956-4a39-b7e7-1088b0c39785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:31.461721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea50b3-2956-4a39-b7e7-1088b0c39785 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:31.476982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315073a-09ae-4d88-a266-2f8f342b76cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:31.479867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315073a-09ae-4d88-a266-2f8f342b76cf service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:31.480416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315073a-09ae-4d88-a266-2f8f342b76cf service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:31.481136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315073a-09ae-4d88-a266-2f8f342b76cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:31.487562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5315073a-09ae-4d88-a266-2f8f342b76cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:31.526117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315073a-09ae-4d88-a266-2f8f342b76cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:31.530139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315073a-09ae-4d88-a266-2f8f342b76cf service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:31.567661 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1590/3166] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:31.640749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ea219-44e3-4f93-8242-88b30553189c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:31.641351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ea219-44e3-4f93-8242-88b30553189c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:31.641843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ea219-44e3-4f93-8242-88b30553189c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:31.651930 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:31.717161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-807ea219-44e3-4f93-8242-88b30553189c None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:31.718960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-807ea219-44e3-4f93-8242-88b30553189c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:31.772986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315073a-09ae-4d88-a266-2f8f342b76cf service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:31.774557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5315073a-09ae-4d88-a266-2f8f342b76cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:31.800466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315073a-09ae-4d88-a266-2f8f342b76cf service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:31.812837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0dcf9-639e-478c-ba85-747a10314b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:31.814246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0dcf9-639e-478c-ba85-747a10314b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:31.814246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0dcf9-639e-478c-ba85-747a10314b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:31.814510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0dcf9-639e-478c-ba85-747a10314b3e admin admin] PATH_INFO: `/v3/projects/f9de8f4dfc48422cba1d1fe9399d94d9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:31.819612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0dcf9-639e-478c-ba85-747a10314b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9de8f4dfc48422cba1d1fe9399d94d9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:31.821979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0dcf9-639e-478c-ba85-747a10314b3e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:31.851621 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:31.855239 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1577/3167] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:50:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:50:31.873195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ea219-44e3-4f93-8242-88b30553189c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:31.874889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-807ea219-44e3-4f93-8242-88b30553189c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:31.927292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-19f0dcf9-639e-478c-ba85-747a10314b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9de8f4dfc48422cba1d1fe9399d94d9', 'request_id': 'req-19f0dcf9-639e-478c-ba85-747a10314b3e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:31.944754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-19f0dcf9-639e-478c-ba85-747a10314b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9de8f4dfc48422cba1d1fe9399d94d9', 'request_id': 'req-19f0dcf9-639e-478c-ba85-747a10314b3e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:31.968038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-19f0dcf9-639e-478c-ba85-747a10314b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9de8f4dfc48422cba1d1fe9399d94d9', 'request_id': 'req-19f0dcf9-639e-478c-ba85-747a10314b3e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:31.987993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-19f0dcf9-639e-478c-ba85-747a10314b3e admin admin] The token cache is being invalidate because project f9de8f4dfc48422cba1d1fe9399d94d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:50:31.988760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-19f0dcf9-639e-478c-ba85-747a10314b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:31.989547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-19f0dcf9-639e-478c-ba85-747a10314b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:31.992400 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1591/3168] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:50:31 2022] DELETE /identity/v3/projects/f9de8f4dfc48422cba1d1fe9399d94d9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:31.998126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e4354-ddae-4e22-82ec-a98338907cf3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:31.998761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e4354-ddae-4e22-82ec-a98338907cf3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:31.999134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e4354-ddae-4e22-82ec-a98338907cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:32.048145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ac8e4354-ddae-4e22-82ec-a98338907cf3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:32.051359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ac8e4354-ddae-4e22-82ec-a98338907cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:32.110214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ea219-44e3-4f93-8242-88b30553189c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:32.164082 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1592/3169] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:32.175935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c58e7-39dd-4fad-b935-d71d0a85008f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:32.176250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c58e7-39dd-4fad-b935-d71d0a85008f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:32.176503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c58e7-39dd-4fad-b935-d71d0a85008f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:32.245952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9b3c58e7-39dd-4fad-b935-d71d0a85008f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:32.248140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9b3c58e7-39dd-4fad-b935-d71d0a85008f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:32.270389 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1593/3170] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:32.271512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c58e7-39dd-4fad-b935-d71d0a85008f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:32.313620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c58e7-39dd-4fad-b935-d71d0a85008f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:32.321410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda8d23-e789-405f-8840-906b264a9868 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:32.322045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda8d23-e789-405f-8840-906b264a9868 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:32.322334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda8d23-e789-405f-8840-906b264a9868 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:32.322834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda8d23-e789-405f-8840-906b264a9868 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:32.325898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ecda8d23-e789-405f-8840-906b264a9868 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:32.334305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2659cc-f94b-46cc-bccd-e6315e06e729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:32.337101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2659cc-f94b-46cc-bccd-e6315e06e729 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:32.337377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2659cc-f94b-46cc-bccd-e6315e06e729 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:32.337656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2659cc-f94b-46cc-bccd-e6315e06e729 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:32.338320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2659cc-f94b-46cc-bccd-e6315e06e729 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:50:32.338621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2659cc-f94b-46cc-bccd-e6315e06e729 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:32.346229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2659cc-f94b-46cc-bccd-e6315e06e729 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:32.370164 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1594/3171] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:50:32.371380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2659cc-f94b-46cc-bccd-e6315e06e729 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:32.376333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ac2659cc-f94b-46cc-bccd-e6315e06e729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:32.420521 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:32.439725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2659cc-f94b-46cc-bccd-e6315e06e729 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:32.449199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda8d23-e789-405f-8840-906b264a9868 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:32.451818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda8d23-e789-405f-8840-906b264a9868 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:32.457421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485eb0c-fd1d-4eae-aa52-002e839b9f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:32.458289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485eb0c-fd1d-4eae-aa52-002e839b9f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:32.458775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485eb0c-fd1d-4eae-aa52-002e839b9f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:32.459053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485eb0c-fd1d-4eae-aa52-002e839b9f49 admin admin] PATH_INFO: `/v3/users/2e1c470f3d6847cba3f51eac8fd20472` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:32.461112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485eb0c-fd1d-4eae-aa52-002e839b9f49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e1c470f3d6847cba3f51eac8fd20472)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:32.464924 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1578/3172] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:50:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:50:32.466020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda8d23-e789-405f-8840-906b264a9868 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:32.468993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485eb0c-fd1d-4eae-aa52-002e839b9f49 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:32.489387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda8d23-e789-405f-8840-906b264a9868 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:32.495687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350704b-30c7-4313-80a4-42a2e4091d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:32.496963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350704b-30c7-4313-80a4-42a2e4091d1a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:32.497757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350704b-30c7-4313-80a4-42a2e4091d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:32.499277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350704b-30c7-4313-80a4-42a2e4091d1a admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:32.499605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350704b-30c7-4313-80a4-42a2e4091d1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:32.503322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350704b-30c7-4313-80a4-42a2e4091d1a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:32.554939 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1579/3173] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:50:32 2022] POST /identity/v3/projects => generated 405 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:50:32.561151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350704b-30c7-4313-80a4-42a2e4091d1a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:32.640143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f485eb0c-fd1d-4eae-aa52-002e839b9f49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e1c470f3d6847cba3f51eac8fd20472'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:32.641017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f485eb0c-fd1d-4eae-aa52-002e839b9f49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e1c470f3d6847cba3f51eac8fd20472'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:32.655565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f485eb0c-fd1d-4eae-aa52-002e839b9f49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e1c470f3d6847cba3f51eac8fd20472'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:32.701505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f485eb0c-fd1d-4eae-aa52-002e839b9f49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e1c470f3d6847cba3f51eac8fd20472'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:32.705853 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:32.717885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f485eb0c-fd1d-4eae-aa52-002e839b9f49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e1c470f3d6847cba3f51eac8fd20472'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:32.741611 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1595/3174] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:50:32 2022] DELETE /identity/v3/users/2e1c470f3d6847cba3f51eac8fd20472 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:32.764124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350704b-30c7-4313-80a4-42a2e4091d1a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:32.891410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3626075-0cb5-4755-b015-1e177653255b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:32.893169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626075-0cb5-4755-b015-1e177653255b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:32.893704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626075-0cb5-4755-b015-1e177653255b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:32.894633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626075-0cb5-4755-b015-1e177653255b admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:32.895590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3626075-0cb5-4755-b015-1e177653255b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:32.897888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3626075-0cb5-4755-b015-1e177653255b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:32.994126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485eb0c-fd1d-4eae-aa52-002e839b9f49 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:32.995573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f485eb0c-fd1d-4eae-aa52-002e839b9f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:33.007301 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1580/3175] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:50:32 2022] POST /identity/v3/users => generated 303 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:50:33.024121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485eb0c-fd1d-4eae-aa52-002e839b9f49 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:33.033503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab71d6-6a2b-4bc2-a5d1-786478aa8e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:33.034134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab71d6-6a2b-4bc2-a5d1-786478aa8e14 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:33.034561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab71d6-6a2b-4bc2-a5d1-786478aa8e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:33.034841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab71d6-6a2b-4bc2-a5d1-786478aa8e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:33.035490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab71d6-6a2b-4bc2-a5d1-786478aa8e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:33.050231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab71d6-6a2b-4bc2-a5d1-786478aa8e14 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:33.088298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3626075-0cb5-4755-b015-1e177653255b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:33.088756 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1596/3176] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:50:33.106364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3626075-0cb5-4755-b015-1e177653255b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:33.131274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a074cf3-5e1a-41e2-a825-0e08b6cb7643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:33.132249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a074cf3-5e1a-41e2-a825-0e08b6cb7643 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:33.132751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a074cf3-5e1a-41e2-a825-0e08b6cb7643 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:33.133205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a074cf3-5e1a-41e2-a825-0e08b6cb7643 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:33.135280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a074cf3-5e1a-41e2-a825-0e08b6cb7643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:33.138187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a074cf3-5e1a-41e2-a825-0e08b6cb7643 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:33.160032 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1581/3177] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:50:33.163967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab71d6-6a2b-4bc2-a5d1-786478aa8e14 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:33.178229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab71d6-6a2b-4bc2-a5d1-786478aa8e14 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:33.213376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330474e0-be3e-4de9-a356-bb5adb3e26fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:33.222279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330474e0-be3e-4de9-a356-bb5adb3e26fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:33.226837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330474e0-be3e-4de9-a356-bb5adb3e26fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:33.232779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330474e0-be3e-4de9-a356-bb5adb3e26fb admin admin] PATH_INFO: `/v3/projects/43d1352114d0465d85285996aba6e16a/users/3bc4deea39c244058a192827793f719f/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:33.275637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330474e0-be3e-4de9-a356-bb5adb3e26fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=43d1352114d0465d85285996aba6e16a, user_id=3bc4deea39c244058a192827793f719f, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:33.282281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330474e0-be3e-4de9-a356-bb5adb3e26fb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:33.306697 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1597/3178] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:50:33 2022] PUT /identity/v3/projects/43d1352114d0465d85285996aba6e16a/users/3bc4deea39c244058a192827793f719f/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:33.313458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b75fb-9db5-4510-9ab2-b28af47aefc4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:33.314129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b75fb-9db5-4510-9ab2-b28af47aefc4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:33.317007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b75fb-9db5-4510-9ab2-b28af47aefc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:33.374867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d30b75fb-9db5-4510-9ab2-b28af47aefc4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:33.376799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d30b75fb-9db5-4510-9ab2-b28af47aefc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:33.502546 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:33.555143 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1582/3179] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:33.561435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330474e0-be3e-4de9-a356-bb5adb3e26fb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:33.563445 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-330474e0-be3e-4de9-a356-bb5adb3e26fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:33.583950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b75fb-9db5-4510-9ab2-b28af47aefc4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:33.585766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d30b75fb-9db5-4510-9ab2-b28af47aefc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:33.620749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330474e0-be3e-4de9-a356-bb5adb3e26fb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:33.650814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784771c5-9163-40ae-95a8-91b80bc2744a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:33.653883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784771c5-9163-40ae-95a8-91b80bc2744a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:33.658142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784771c5-9163-40ae-95a8-91b80bc2744a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:33.660419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784771c5-9163-40ae-95a8-91b80bc2744a admin admin] PATH_INFO: `/v3/projects/581cbc55e00b45ff9e0c69583c601723` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:33.664811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784771c5-9163-40ae-95a8-91b80bc2744a admin admin] RBAC: Authorizing `identity:delete_project(project_id=581cbc55e00b45ff9e0c69583c601723)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:33.678794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784771c5-9163-40ae-95a8-91b80bc2744a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:33.763258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b75fb-9db5-4510-9ab2-b28af47aefc4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:33.770981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7512e-1a25-4192-8043-6a319595332a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:33.771753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7512e-1a25-4192-8043-6a319595332a service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:33.772258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7512e-1a25-4192-8043-6a319595332a service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:33.772642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7512e-1a25-4192-8043-6a319595332a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:33.793814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7512e-1a25-4192-8043-6a319595332a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:33.796025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7512e-1a25-4192-8043-6a319595332a service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:33.821578 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1583/3180] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:33.834800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7512e-1a25-4192-8043-6a319595332a service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:33.840149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fcb7512e-1a25-4192-8043-6a319595332a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:33.941004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-784771c5-9163-40ae-95a8-91b80bc2744a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '581cbc55e00b45ff9e0c69583c601723', 'request_id': 'req-784771c5-9163-40ae-95a8-91b80bc2744a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:33.978751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7512e-1a25-4192-8043-6a319595332a service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:33.980766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-784771c5-9163-40ae-95a8-91b80bc2744a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '581cbc55e00b45ff9e0c69583c601723', 'request_id': 'req-784771c5-9163-40ae-95a8-91b80bc2744a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:34.011812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-784771c5-9163-40ae-95a8-91b80bc2744a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '581cbc55e00b45ff9e0c69583c601723', 'request_id': 'req-784771c5-9163-40ae-95a8-91b80bc2744a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:34.069200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-784771c5-9163-40ae-95a8-91b80bc2744a admin admin] The token cache is being invalidate because project 581cbc55e00b45ff9e0c69583c601723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:50:34.069536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-784771c5-9163-40ae-95a8-91b80bc2744a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:34.076933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-784771c5-9163-40ae-95a8-91b80bc2744a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:50:34.079687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b5bae-2ada-4df5-a2f8-07f4f2676591 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:34.080910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b5bae-2ada-4df5-a2f8-07f4f2676591 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:34.081605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b5bae-2ada-4df5-a2f8-07f4f2676591 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:34.082110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b5bae-2ada-4df5-a2f8-07f4f2676591 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:34.085066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c68b5bae-2ada-4df5-a2f8-07f4f2676591 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:34.094052 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1598/3181] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:50:33 2022] DELETE /identity/v3/projects/581cbc55e00b45ff9e0c69583c601723 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:34.096155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f5aca-d5bf-4c9e-8301-da2338f07e31 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:34.096441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f5aca-d5bf-4c9e-8301-da2338f07e31 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:34.096742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f5aca-d5bf-4c9e-8301-da2338f07e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:34.109717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b5bae-2ada-4df5-a2f8-07f4f2676591 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:34.112894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b5bae-2ada-4df5-a2f8-07f4f2676591 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:34.151127 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1584/3182] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:34.177503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e44f5aca-d5bf-4c9e-8301-da2338f07e31 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:34.179608 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e44f5aca-d5bf-4c9e-8301-da2338f07e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:34.308719 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1599/3183] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:34.314378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804adda-5468-4244-a4b5-a8c5d3a8c1fe None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:34.314769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804adda-5468-4244-a4b5-a8c5d3a8c1fe None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:34.315144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804adda-5468-4244-a4b5-a8c5d3a8c1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:34.350521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6804adda-5468-4244-a4b5-a8c5d3a8c1fe None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:34.353934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6804adda-5468-4244-a4b5-a8c5d3a8c1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:34.378361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f5aca-d5bf-4c9e-8301-da2338f07e31 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:34.386813 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1585/3184] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:34.391678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f5aca-d5bf-4c9e-8301-da2338f07e31 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:34.398366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16779917-7361-436b-9be6-5d31c16dfd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:34.399262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16779917-7361-436b-9be6-5d31c16dfd4a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:34.399594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16779917-7361-436b-9be6-5d31c16dfd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:34.399963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16779917-7361-436b-9be6-5d31c16dfd4a admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:34.400745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16779917-7361-436b-9be6-5d31c16dfd4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:50:34.401146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16779917-7361-436b-9be6-5d31c16dfd4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:34.403134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16779917-7361-436b-9be6-5d31c16dfd4a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:34.426471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804adda-5468-4244-a4b5-a8c5d3a8c1fe None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:34.443167 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1600/3185] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:50:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:50:34.443393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804adda-5468-4244-a4b5-a8c5d3a8c1fe None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:34.457428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b04c94-7d1f-42b4-8922-3d391a7d78d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:34.459084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b04c94-7d1f-42b4-8922-3d391a7d78d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:34.460772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b04c94-7d1f-42b4-8922-3d391a7d78d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:34.461156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b04c94-7d1f-42b4-8922-3d391a7d78d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:34.463295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b04c94-7d1f-42b4-8922-3d391a7d78d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:34.467234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b04c94-7d1f-42b4-8922-3d391a7d78d2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:34.509047 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:34.535672 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1586/3186] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:50:34 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:50:34.540408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16779917-7361-436b-9be6-5d31c16dfd4a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:34.556516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16779917-7361-436b-9be6-5d31c16dfd4a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:34.623906 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:34.770389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77934e-54e1-4388-b58d-0c41bfa7e088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:34.771821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77934e-54e1-4388-b58d-0c41bfa7e088 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:34.772653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77934e-54e1-4388-b58d-0c41bfa7e088 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:34.773088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77934e-54e1-4388-b58d-0c41bfa7e088 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:34.773913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77934e-54e1-4388-b58d-0c41bfa7e088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:34.776924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77934e-54e1-4388-b58d-0c41bfa7e088 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:34.844686 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1601/3187] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:50:34 2022] POST /identity/v3/users => generated 286 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:50:34.847543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b04c94-7d1f-42b4-8922-3d391a7d78d2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:34.911124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b04c94-7d1f-42b4-8922-3d391a7d78d2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:34.947072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cd38b-8bfb-4237-ae7a-a31436a250c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:34.947702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cd38b-8bfb-4237-ae7a-a31436a250c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:34.956476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cd38b-8bfb-4237-ae7a-a31436a250c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:34.956935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cd38b-8bfb-4237-ae7a-a31436a250c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:34.957682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cd38b-8bfb-4237-ae7a-a31436a250c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:34.962663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cd38b-8bfb-4237-ae7a-a31436a250c9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:34.996717 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1587/3188] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:50:35.003269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77934e-54e1-4388-b58d-0c41bfa7e088 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:35.037668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77934e-54e1-4388-b58d-0c41bfa7e088 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:35.064184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d05645-c560-4e61-aa61-9181a2d1afdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:35.071173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d05645-c560-4e61-aa61-9181a2d1afdb admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:35.071595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d05645-c560-4e61-aa61-9181a2d1afdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:35.072187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d05645-c560-4e61-aa61-9181a2d1afdb admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:35.075097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d05645-c560-4e61-aa61-9181a2d1afdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:35.079249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d05645-c560-4e61-aa61-9181a2d1afdb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:35.097622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cd38b-8bfb-4237-ae7a-a31436a250c9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:35.111698 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1602/3189] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:50:35.118903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cd38b-8bfb-4237-ae7a-a31436a250c9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:35.125846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0ffbe-1b5f-4b5b-a11b-313c5fd7313e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:35.128101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0ffbe-1b5f-4b5b-a11b-313c5fd7313e admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:35.128492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0ffbe-1b5f-4b5b-a11b-313c5fd7313e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:35.129056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0ffbe-1b5f-4b5b-a11b-313c5fd7313e admin admin] PATH_INFO: `/v3/projects/075aac38e8984d64918f205b57b7b38a/users/783bd6b663c945e1a577ff47cbc4bcea/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:35.159548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0ffbe-1b5f-4b5b-a11b-313c5fd7313e admin admin] RBAC: Authorizing `identity:create_grant(project_id=075aac38e8984d64918f205b57b7b38a, user_id=783bd6b663c945e1a577ff47cbc4bcea, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:35.168942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0ffbe-1b5f-4b5b-a11b-313c5fd7313e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:35.202100 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1588/3190] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:50:35 2022] PUT /identity/v3/projects/075aac38e8984d64918f205b57b7b38a/users/783bd6b663c945e1a577ff47cbc4bcea/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:50:35.214540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c952ec8-48af-436d-9c1b-a025cda78476 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:35.214923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c952ec8-48af-436d-9c1b-a025cda78476 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:35.215290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c952ec8-48af-436d-9c1b-a025cda78476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:35.289216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1c952ec8-48af-436d-9c1b-a025cda78476 None None] MFA Rules not processed for user `783bd6b663c945e1a577ff47cbc4bcea`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:35.293701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1c952ec8-48af-436d-9c1b-a025cda78476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:35.511617 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1603/3191] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:35.513652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76936f8c-2a06-4324-90d6-957e04b1db10 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:35.513760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76936f8c-2a06-4324-90d6-957e04b1db10 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:35.513989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76936f8c-2a06-4324-90d6-957e04b1db10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:35.578907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-76936f8c-2a06-4324-90d6-957e04b1db10 None None] MFA Rules not processed for user `783bd6b663c945e1a577ff47cbc4bcea`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:35.579731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-76936f8c-2a06-4324-90d6-957e04b1db10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:35.627682 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1589/3192] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:35.865740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c952ec8-48af-436d-9c1b-a025cda78476 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:35.867399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1c952ec8-48af-436d-9c1b-a025cda78476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:36.285963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c952ec8-48af-436d-9c1b-a025cda78476 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:36.302785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d3198-d362-4991-8612-190e36ce1b75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:36.303988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d3198-d362-4991-8612-190e36ce1b75 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:36.317027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d3198-d362-4991-8612-190e36ce1b75 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:36.321796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d3198-d362-4991-8612-190e36ce1b75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:36.349476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d3198-d362-4991-8612-190e36ce1b75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:36.355376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d3198-d362-4991-8612-190e36ce1b75 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:36.394621 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1604/3193] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:36.879114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcefcfe-811c-453c-afb0-075ea6661bc4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:36.879890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcefcfe-811c-453c-afb0-075ea6661bc4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:36.881817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcefcfe-811c-453c-afb0-075ea6661bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:36.908904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5fcefcfe-811c-453c-afb0-075ea6661bc4 None None] MFA Rules not processed for user `783bd6b663c945e1a577ff47cbc4bcea`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:36.910169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5fcefcfe-811c-453c-afb0-075ea6661bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:36.936565 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1590/3194] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:41.183664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d3198-d362-4991-8612-190e36ce1b75 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:41.186682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-210d3198-d362-4991-8612-190e36ce1b75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:41.225361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d3198-d362-4991-8612-190e36ce1b75 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:41.250069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088eec94-623c-4ff0-9478-897589280d91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:41.252926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088eec94-623c-4ff0-9478-897589280d91 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:41.253222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088eec94-623c-4ff0-9478-897589280d91 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:41.255976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088eec94-623c-4ff0-9478-897589280d91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:41.261116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-088eec94-623c-4ff0-9478-897589280d91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:41.325598 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:41.442373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088eec94-623c-4ff0-9478-897589280d91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:41.444227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088eec94-623c-4ff0-9478-897589280d91 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:41.477180 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1605/3195] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:41 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:46.544207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcefcfe-811c-453c-afb0-075ea6661bc4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:46.549896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5fcefcfe-811c-453c-afb0-075ea6661bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:46.789827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcefcfe-811c-453c-afb0-075ea6661bc4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:46.798805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b7625-b4c0-4c9e-aacf-453f9487daae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:46.806475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b7625-b4c0-4c9e-aacf-453f9487daae service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:46.807017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b7625-b4c0-4c9e-aacf-453f9487daae service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:46.808533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b7625-b4c0-4c9e-aacf-453f9487daae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:46.817119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-686b7625-b4c0-4c9e-aacf-453f9487daae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:46.940371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b7625-b4c0-4c9e-aacf-453f9487daae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:46.942072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b7625-b4c0-4c9e-aacf-453f9487daae service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:47.042719 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1591/3196] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:47.226003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088eec94-623c-4ff0-9478-897589280d91 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:47.255806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088eec94-623c-4ff0-9478-897589280d91 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:47.266076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43a020-82e0-486d-a785-110de2bc9d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:47.267390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43a020-82e0-486d-a785-110de2bc9d32 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:47.268582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43a020-82e0-486d-a785-110de2bc9d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:47.269554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43a020-82e0-486d-a785-110de2bc9d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:47.276122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2c43a020-82e0-486d-a785-110de2bc9d32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:47.291520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43a020-82e0-486d-a785-110de2bc9d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:47.293243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43a020-82e0-486d-a785-110de2bc9d32 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:47.312945 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1606/3197] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:48.884792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b755f7e-4e82-401d-900e-dfcce0e12d63 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:48.885269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b755f7e-4e82-401d-900e-dfcce0e12d63 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:48.885376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b755f7e-4e82-401d-900e-dfcce0e12d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:48.984518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9b755f7e-4e82-401d-900e-dfcce0e12d63 None None] MFA Rules not processed for user `1601a65c979846cda98c3cd501a71d71`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:48.986897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9b755f7e-4e82-401d-900e-dfcce0e12d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:49.171321 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1592/3198] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:49.183886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c698fbb-00df-4801-b57e-8ae27d8d4701 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:49.184393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c698fbb-00df-4801-b57e-8ae27d8d4701 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:49.184773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c698fbb-00df-4801-b57e-8ae27d8d4701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:49.242435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7c698fbb-00df-4801-b57e-8ae27d8d4701 None None] MFA Rules not processed for user `1601a65c979846cda98c3cd501a71d71`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:49.247149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7c698fbb-00df-4801-b57e-8ae27d8d4701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:49.279331 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1607/3199] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:49.905367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b755f7e-4e82-401d-900e-dfcce0e12d63 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:49.933878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b755f7e-4e82-401d-900e-dfcce0e12d63 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:49.965603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52f00f-cd71-451b-b3fc-a65b997f4b3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:49.967290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52f00f-cd71-451b-b3fc-a65b997f4b3c service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:49.967766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52f00f-cd71-451b-b3fc-a65b997f4b3c service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:49.968208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52f00f-cd71-451b-b3fc-a65b997f4b3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:49.997265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52f00f-cd71-451b-b3fc-a65b997f4b3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:50.006887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52f00f-cd71-451b-b3fc-a65b997f4b3c service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:50.021212 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:50:50.031333 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1593/3200] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:52.434420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa84bf-d148-4bca-8367-4cc026e732b3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:52.435008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa84bf-d148-4bca-8367-4cc026e732b3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:52.435008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa84bf-d148-4bca-8367-4cc026e732b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:52.529727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fafa84bf-d148-4bca-8367-4cc026e732b3 None None] MFA Rules not processed for user `3bc4deea39c244058a192827793f719f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:52.535931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fafa84bf-d148-4bca-8367-4cc026e732b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:52.766149 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1608/3201] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:52 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:52.785999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52f00f-cd71-451b-b3fc-a65b997f4b3c service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:52.816843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52f00f-cd71-451b-b3fc-a65b997f4b3c service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:52.850471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ccf73-99fb-4d1e-84f6-519cf0c9d28f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:52.851102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ccf73-99fb-4d1e-84f6-519cf0c9d28f service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:52.851503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ccf73-99fb-4d1e-84f6-519cf0c9d28f service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:52.851871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ccf73-99fb-4d1e-84f6-519cf0c9d28f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:52.889992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ccf73-99fb-4d1e-84f6-519cf0c9d28f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:52.896433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ccf73-99fb-4d1e-84f6-519cf0c9d28f service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:52.956532 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1594/3202] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:52 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:50:57.567138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5da49-5182-4d43-ba69-379030c2cbe2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:57.568135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5da49-5182-4d43-ba69-379030c2cbe2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:57.568706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5da49-5182-4d43-ba69-379030c2cbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:57.602138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-29a5da49-5182-4d43-ba69-379030c2cbe2 None None] MFA Rules not processed for user `960e2646c3174ad084c85b6de1e01822`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:50:57.606581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-29a5da49-5182-4d43-ba69-379030c2cbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:57.785912 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1609/3203] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:50:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:50:59.679739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ccf73-99fb-4d1e-84f6-519cf0c9d28f service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:50:59.681410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3b2ccf73-99fb-4d1e-84f6-519cf0c9d28f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:59.826995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ccf73-99fb-4d1e-84f6-519cf0c9d28f service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:50:59.838293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8b4af-c111-4a74-9f1a-4bab257516e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:50:59.838917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8b4af-c111-4a74-9f1a-4bab257516e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:50:59.839191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8b4af-c111-4a74-9f1a-4bab257516e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:50:59.839458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8b4af-c111-4a74-9f1a-4bab257516e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:50:59.842171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-85f8b4af-c111-4a74-9f1a-4bab257516e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:50:59.865477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8b4af-c111-4a74-9f1a-4bab257516e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:50:59.884296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8b4af-c111-4a74-9f1a-4bab257516e8 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:50:59.902955 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1595/3204] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:50:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:51:02.085195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5da49-5182-4d43-ba69-379030c2cbe2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:02.086783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-29a5da49-5182-4d43-ba69-379030c2cbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:02.150397 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:51:02.211299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5da49-5182-4d43-ba69-379030c2cbe2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:02.216792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6dc45-25da-4087-9693-468e4960fa44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:02.217809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6dc45-25da-4087-9693-468e4960fa44 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:02.218693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6dc45-25da-4087-9693-468e4960fa44 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:02.219474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6dc45-25da-4087-9693-468e4960fa44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:02.225312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-77a6dc45-25da-4087-9693-468e4960fa44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:02.239187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6dc45-25da-4087-9693-468e4960fa44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:02.241680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6dc45-25da-4087-9693-468e4960fa44 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:02.258420 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1610/3205] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:51:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:51:03.055737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d04142-5d52-4f8f-8822-5403b99cad8e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:03.056523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d04142-5d52-4f8f-8822-5403b99cad8e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:03.057051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d04142-5d52-4f8f-8822-5403b99cad8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:03.114152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-59d04142-5d52-4f8f-8822-5403b99cad8e None None] MFA Rules not processed for user `960e2646c3174ad084c85b6de1e01822`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:51:03.117756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-59d04142-5d52-4f8f-8822-5403b99cad8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:03.139297 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1596/3206] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:51:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:51:03.385471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239218b5-edfc-4825-a1fb-5b4580303c68 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:03.386105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239218b5-edfc-4825-a1fb-5b4580303c68 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:03.386105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239218b5-edfc-4825-a1fb-5b4580303c68 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:03.387840 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1611/3207] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:51:03.399635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c25fcc-7941-48b9-ae53-5164a0db5dc9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:03.400022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c25fcc-7941-48b9-ae53-5164a0db5dc9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:03.400239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c25fcc-7941-48b9-ae53-5164a0db5dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:03.458343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d9c25fcc-7941-48b9-ae53-5164a0db5dc9 None None] MFA Rules not processed for user `a9b0fd833b134a089433cd2985caba80`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:51:03.466551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d9c25fcc-7941-48b9-ae53-5164a0db5dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:03.502317 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1597/3208] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:51:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:51:03.510302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239218b5-edfc-4825-a1fb-5b4580303c68 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:03.528898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239218b5-edfc-4825-a1fb-5b4580303c68 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:03.538859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b5289-ea2e-4e9f-a658-6e35bfd6035c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:03.539975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b5289-ea2e-4e9f-a658-6e35bfd6035c service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:03.540668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b5289-ea2e-4e9f-a658-6e35bfd6035c service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:03.541314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b5289-ea2e-4e9f-a658-6e35bfd6035c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:03.553722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b5289-ea2e-4e9f-a658-6e35bfd6035c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:03.555853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b5289-ea2e-4e9f-a658-6e35bfd6035c service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:03.583248 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1612/3209] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:51:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:51:13.426534 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=27 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:51:13.562334 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=25 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:51:15.087636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c25fcc-7941-48b9-ae53-5164a0db5dc9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:15.089742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d9c25fcc-7941-48b9-ae53-5164a0db5dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:15.266345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c25fcc-7941-48b9-ae53-5164a0db5dc9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:15.278019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49929c80-f3ef-42a8-b633-f47f52e4d01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:15.279924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49929c80-f3ef-42a8-b633-f47f52e4d01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:15.280430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49929c80-f3ef-42a8-b633-f47f52e4d01f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:15.281129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49929c80-f3ef-42a8-b633-f47f52e4d01f admin admin] PATH_INFO: `/v3/users/3bc4deea39c244058a192827793f719f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:15.282537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49929c80-f3ef-42a8-b633-f47f52e4d01f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bc4deea39c244058a192827793f719f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:15.286768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49929c80-f3ef-42a8-b633-f47f52e4d01f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:15.372486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49929c80-f3ef-42a8-b633-f47f52e4d01f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bc4deea39c244058a192827793f719f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:51:15.399162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49929c80-f3ef-42a8-b633-f47f52e4d01f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bc4deea39c244058a192827793f719f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:51:15.400948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49929c80-f3ef-42a8-b633-f47f52e4d01f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bc4deea39c244058a192827793f719f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:51:15.419327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49929c80-f3ef-42a8-b633-f47f52e4d01f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bc4deea39c244058a192827793f719f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:51:15.429434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49929c80-f3ef-42a8-b633-f47f52e4d01f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bc4deea39c244058a192827793f719f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:51:15.437898 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1598/3210] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:51:15 2022] DELETE /identity/v3/users/3bc4deea39c244058a192827793f719f => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:51:15.817409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b5289-ea2e-4e9f-a658-6e35bfd6035c service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:15.839058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b5289-ea2e-4e9f-a658-6e35bfd6035c service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:16.009433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03d1d3-d444-47a7-9f18-475d6f148eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:16.010102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03d1d3-d444-47a7-9f18-475d6f148eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:16.010402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03d1d3-d444-47a7-9f18-475d6f148eac admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:16.010675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03d1d3-d444-47a7-9f18-475d6f148eac admin admin] PATH_INFO: `/v3/projects/43d1352114d0465d85285996aba6e16a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:16.013326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03d1d3-d444-47a7-9f18-475d6f148eac admin admin] RBAC: Authorizing `identity:delete_project(project_id=43d1352114d0465d85285996aba6e16a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:16.016023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03d1d3-d444-47a7-9f18-475d6f148eac admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:16.120801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9a03d1d3-d444-47a7-9f18-475d6f148eac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43d1352114d0465d85285996aba6e16a', 'request_id': 'req-9a03d1d3-d444-47a7-9f18-475d6f148eac'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:51:16.139968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9a03d1d3-d444-47a7-9f18-475d6f148eac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43d1352114d0465d85285996aba6e16a', 'request_id': 'req-9a03d1d3-d444-47a7-9f18-475d6f148eac'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:51:16.148760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9a03d1d3-d444-47a7-9f18-475d6f148eac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43d1352114d0465d85285996aba6e16a', 'request_id': 'req-9a03d1d3-d444-47a7-9f18-475d6f148eac'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:51:16.164494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9a03d1d3-d444-47a7-9f18-475d6f148eac admin admin] The token cache is being invalidate because project 43d1352114d0465d85285996aba6e16a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:51:16.165111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9a03d1d3-d444-47a7-9f18-475d6f148eac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:51:16.166550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9a03d1d3-d444-47a7-9f18-475d6f148eac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:51:16.169119 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1613/3211] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:51:15 2022] DELETE /identity/v3/projects/43d1352114d0465d85285996aba6e16a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:51:16.176185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accf168-1330-41c2-9e65-5195a417bde0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:16.177349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accf168-1330-41c2-9e65-5195a417bde0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:16.177835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accf168-1330-41c2-9e65-5195a417bde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:16.250370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8accf168-1330-41c2-9e65-5195a417bde0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:51:16.251118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8accf168-1330-41c2-9e65-5195a417bde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:16.279167 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:51:16.325962 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1599/3212] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:51:16.327711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c6f98-9d76-4bfb-bda9-7f90acbb3b49 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:16.328079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c6f98-9d76-4bfb-bda9-7f90acbb3b49 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:16.328449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c6f98-9d76-4bfb-bda9-7f90acbb3b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:16.349395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2e4c6f98-9d76-4bfb-bda9-7f90acbb3b49 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:51:16.350759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2e4c6f98-9d76-4bfb-bda9-7f90acbb3b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:16.363883 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1614/3213] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:51:16.365046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accf168-1330-41c2-9e65-5195a417bde0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:16.376227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accf168-1330-41c2-9e65-5195a417bde0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:16.380982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb46dd-82b2-4114-b693-471ac7a10846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:16.381588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb46dd-82b2-4114-b693-471ac7a10846 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:16.382016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb46dd-82b2-4114-b693-471ac7a10846 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:16.382293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb46dd-82b2-4114-b693-471ac7a10846 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:16.382944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb46dd-82b2-4114-b693-471ac7a10846 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:51:16.383248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb46dd-82b2-4114-b693-471ac7a10846 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:16.384869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb46dd-82b2-4114-b693-471ac7a10846 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:16.397094 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1600/3214] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:51:16.401814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c6f98-9d76-4bfb-bda9-7f90acbb3b49 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:16.411677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c6f98-9d76-4bfb-bda9-7f90acbb3b49 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:16.416299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a85b0-349f-4117-b375-ba75f89a42ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:16.416922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a85b0-349f-4117-b375-ba75f89a42ae admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:16.417202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a85b0-349f-4117-b375-ba75f89a42ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:16.417472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a85b0-349f-4117-b375-ba75f89a42ae admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:16.418097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a85b0-349f-4117-b375-ba75f89a42ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:16.420003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a85b0-349f-4117-b375-ba75f89a42ae admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:16.449067 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1615/3215] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:51:16 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:51:16.453634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb46dd-82b2-4114-b693-471ac7a10846 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:16.464304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb46dd-82b2-4114-b693-471ac7a10846 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:16.524429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aebf7a-f904-4d51-a20e-5c08ab46fec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:16.525070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aebf7a-f904-4d51-a20e-5c08ab46fec3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:16.525350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aebf7a-f904-4d51-a20e-5c08ab46fec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:16.525622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aebf7a-f904-4d51-a20e-5c08ab46fec3 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:16.526246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aebf7a-f904-4d51-a20e-5c08ab46fec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:16.528265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aebf7a-f904-4d51-a20e-5c08ab46fec3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:16.556265 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1601/3216] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:51:16 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:51:16.560237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a85b0-349f-4117-b375-ba75f89a42ae admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:16.577091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a85b0-349f-4117-b375-ba75f89a42ae admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:16.582890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8ec3a-1a75-4873-a161-ee9670b554d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:16.583743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8ec3a-1a75-4873-a161-ee9670b554d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:16.584072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8ec3a-1a75-4873-a161-ee9670b554d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:16.584516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8ec3a-1a75-4873-a161-ee9670b554d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:16.586358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8ec3a-1a75-4873-a161-ee9670b554d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:16.587600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8ec3a-1a75-4873-a161-ee9670b554d7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:16.599807 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1616/3217] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:51:16.606011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aebf7a-f904-4d51-a20e-5c08ab46fec3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:16.622844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aebf7a-f904-4d51-a20e-5c08ab46fec3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:16.636425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fda59-527e-4301-b004-db10ec4de496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:16.637537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fda59-527e-4301-b004-db10ec4de496 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:16.638100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fda59-527e-4301-b004-db10ec4de496 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:16.638878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fda59-527e-4301-b004-db10ec4de496 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:16.641080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73fda59-527e-4301-b004-db10ec4de496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:16.643333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73fda59-527e-4301-b004-db10ec4de496 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:16.662638 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1602/3218] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:51:16.663896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8ec3a-1a75-4873-a161-ee9670b554d7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:16.676933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8ec3a-1a75-4873-a161-ee9670b554d7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:16.682459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7a70d-222c-48d8-a67a-2734e4ca8bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:16.683670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7a70d-222c-48d8-a67a-2734e4ca8bf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:16.684288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7a70d-222c-48d8-a67a-2734e4ca8bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:16.685148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7a70d-222c-48d8-a67a-2734e4ca8bf7 admin admin] PATH_INFO: `/v3/projects/c0a3b6c14bd54870baca1b0abe00e7e3/users/f62cb46f8ce646fba20437110b7fad90/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:16.714958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7a70d-222c-48d8-a67a-2734e4ca8bf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a3b6c14bd54870baca1b0abe00e7e3, user_id=f62cb46f8ce646fba20437110b7fad90, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:16.718546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7a70d-222c-48d8-a67a-2734e4ca8bf7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:16.738049 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1617/3219] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:51:16 2022] PUT /identity/v3/projects/c0a3b6c14bd54870baca1b0abe00e7e3/users/f62cb46f8ce646fba20437110b7fad90/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:51:16.744239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b65553-089f-4882-b352-5b222bbad4c2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:16.744582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b65553-089f-4882-b352-5b222bbad4c2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:16.744915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b65553-089f-4882-b352-5b222bbad4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:16.768878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b9b65553-089f-4882-b352-5b222bbad4c2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:51:16.770637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b9b65553-089f-4882-b352-5b222bbad4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:16.850913 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1603/3220] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:51:16.861376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7a70d-222c-48d8-a67a-2734e4ca8bf7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:16.863266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-97e7a70d-222c-48d8-a67a-2734e4ca8bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:16.895629 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:51:16.932166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7a70d-222c-48d8-a67a-2734e4ca8bf7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:16.935873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2eab3-df39-46ef-a300-a35c79813945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:16.936573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2eab3-df39-46ef-a300-a35c79813945 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:16.937053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2eab3-df39-46ef-a300-a35c79813945 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:16.937288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2eab3-df39-46ef-a300-a35c79813945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:16.951947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2eab3-df39-46ef-a300-a35c79813945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:16.955131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2eab3-df39-46ef-a300-a35c79813945 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:16.981459 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1618/3221] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:51:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:51:17.649251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed599af3-f2b7-40b3-9e58-621659b6c99a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:17.650161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed599af3-f2b7-40b3-9e58-621659b6c99a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:17.650589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed599af3-f2b7-40b3-9e58-621659b6c99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:17.700887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ed599af3-f2b7-40b3-9e58-621659b6c99a None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:51:17.705281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ed599af3-f2b7-40b3-9e58-621659b6c99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:17.794042 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:51:17.853931 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1604/3222] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:51:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:51:17.866390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2eab3-df39-46ef-a300-a35c79813945 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:17.867889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d2b2eab3-df39-46ef-a300-a35c79813945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:18.050684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2eab3-df39-46ef-a300-a35c79813945 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:18.071542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a3bd1-f53c-46b8-ae75-75bce0e427e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:18.072457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a3bd1-f53c-46b8-ae75-75bce0e427e3 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:18.073219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a3bd1-f53c-46b8-ae75-75bce0e427e3 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:18.073765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a3bd1-f53c-46b8-ae75-75bce0e427e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:18.085384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a3bd1-f53c-46b8-ae75-75bce0e427e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:18.087672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a3bd1-f53c-46b8-ae75-75bce0e427e3 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:18.099467 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1619/3223] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:51:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:51:27.840993 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=9 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:51:28.095047 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=46 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:51:29.252858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18476ed-76c0-41c4-9584-72fa83b33317 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:29.253519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18476ed-76c0-41c4-9584-72fa83b33317 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:29.253600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18476ed-76c0-41c4-9584-72fa83b33317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:29.351805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a18476ed-76c0-41c4-9584-72fa83b33317 None None] MFA Rules not processed for user `f62cb46f8ce646fba20437110b7fad90`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:51:29.353372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a18476ed-76c0-41c4-9584-72fa83b33317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:29.546539 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1605/3224] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:51:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:51:29.758568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a3bd1-f53c-46b8-ae75-75bce0e427e3 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:29.760517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-af4a3bd1-f53c-46b8-ae75-75bce0e427e3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:29.978230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a3bd1-f53c-46b8-ae75-75bce0e427e3 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:29.999287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3388979-d8a9-4ca5-9052-725dd921df4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:30.000856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3388979-d8a9-4ca5-9052-725dd921df4e service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:30.001136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3388979-d8a9-4ca5-9052-725dd921df4e service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:30.001406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3388979-d8a9-4ca5-9052-725dd921df4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:30.030007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3388979-d8a9-4ca5-9052-725dd921df4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:30.032879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3388979-d8a9-4ca5-9052-725dd921df4e service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:30.057061 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1620/3225] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:51:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:51:30.753730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df085e40-e401-41c7-bb09-f7dcf5d405aa None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:30.754635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df085e40-e401-41c7-bb09-f7dcf5d405aa None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:30.755125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df085e40-e401-41c7-bb09-f7dcf5d405aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:30.833846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-df085e40-e401-41c7-bb09-f7dcf5d405aa None None] MFA Rules not processed for user `960e2646c3174ad084c85b6de1e01822`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:51:30.840518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-df085e40-e401-41c7-bb09-f7dcf5d405aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:31.059867 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1606/3226] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:51:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:51:35.106612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d118e0-f10a-445e-895e-5f6558e1faa5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:35.107106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d118e0-f10a-445e-895e-5f6558e1faa5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:35.107339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d118e0-f10a-445e-895e-5f6558e1faa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:35.146409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-67d118e0-f10a-445e-895e-5f6558e1faa5 None None] MFA Rules not processed for user `f62cb46f8ce646fba20437110b7fad90`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:51:35.147667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-67d118e0-f10a-445e-895e-5f6558e1faa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:35.180767 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1621/3227] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:51:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:51:40.532402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df085e40-e401-41c7-bb09-f7dcf5d405aa None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:40.532402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-df085e40-e401-41c7-bb09-f7dcf5d405aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:40.548889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df085e40-e401-41c7-bb09-f7dcf5d405aa None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:40.555512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da9fde-df1c-4e9a-8c67-93828ed6a041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:40.556458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da9fde-df1c-4e9a-8c67-93828ed6a041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:40.557416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da9fde-df1c-4e9a-8c67-93828ed6a041 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:40.557923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da9fde-df1c-4e9a-8c67-93828ed6a041 admin admin] PATH_INFO: `/v3/users/783bd6b663c945e1a577ff47cbc4bcea` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:40.559460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da9fde-df1c-4e9a-8c67-93828ed6a041 admin admin] RBAC: Authorizing `identity:delete_user(user_id=783bd6b663c945e1a577ff47cbc4bcea)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:40.562472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da9fde-df1c-4e9a-8c67-93828ed6a041 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:40.673963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-81da9fde-df1c-4e9a-8c67-93828ed6a041 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '783bd6b663c945e1a577ff47cbc4bcea'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:51:40.689278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-81da9fde-df1c-4e9a-8c67-93828ed6a041 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '783bd6b663c945e1a577ff47cbc4bcea'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:51:40.690063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-81da9fde-df1c-4e9a-8c67-93828ed6a041 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '783bd6b663c945e1a577ff47cbc4bcea'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:51:40.724489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-81da9fde-df1c-4e9a-8c67-93828ed6a041 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '783bd6b663c945e1a577ff47cbc4bcea'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:51:40.741248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-81da9fde-df1c-4e9a-8c67-93828ed6a041 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '783bd6b663c945e1a577ff47cbc4bcea'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:51:40.766254 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1607/3228] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:51:40 2022] DELETE /identity/v3/users/783bd6b663c945e1a577ff47cbc4bcea => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:51:40.770381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4fe07-2103-44ec-a90e-d0c07077e8ab None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:40.771307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4fe07-2103-44ec-a90e-d0c07077e8ab None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:40.771771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4fe07-2103-44ec-a90e-d0c07077e8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:40.814754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-acc4fe07-2103-44ec-a90e-d0c07077e8ab None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:51:40.816638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-acc4fe07-2103-44ec-a90e-d0c07077e8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:41.008921 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1622/3229] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:51:41.013576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da9fde-df1c-4e9a-8c67-93828ed6a041 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:41.015121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-81da9fde-df1c-4e9a-8c67-93828ed6a041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:41.031674 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:51:41.102703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da9fde-df1c-4e9a-8c67-93828ed6a041 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:41.109234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f232a95-b035-4074-a688-c510e64d20b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:41.110324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f232a95-b035-4074-a688-c510e64d20b1 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:41.111077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f232a95-b035-4074-a688-c510e64d20b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:41.111669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f232a95-b035-4074-a688-c510e64d20b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:41.137566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f232a95-b035-4074-a688-c510e64d20b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:41.142505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f232a95-b035-4074-a688-c510e64d20b1 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:41.220252 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1608/3230] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:51:42.905868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4fe07-2103-44ec-a90e-d0c07077e8ab None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:42.908504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-acc4fe07-2103-44ec-a90e-d0c07077e8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:42.936392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4fe07-2103-44ec-a90e-d0c07077e8ab None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:42.945453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04be6b8-86f2-4a40-9949-7924934592ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:42.946439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04be6b8-86f2-4a40-9949-7924934592ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:42.946882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04be6b8-86f2-4a40-9949-7924934592ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:42.947309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04be6b8-86f2-4a40-9949-7924934592ca admin admin] PATH_INFO: `/v3/projects/075aac38e8984d64918f205b57b7b38a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:42.949434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04be6b8-86f2-4a40-9949-7924934592ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=075aac38e8984d64918f205b57b7b38a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:42.951711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04be6b8-86f2-4a40-9949-7924934592ca admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:43.121520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b04be6b8-86f2-4a40-9949-7924934592ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '075aac38e8984d64918f205b57b7b38a', 'request_id': 'req-b04be6b8-86f2-4a40-9949-7924934592ca'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:51:43.131940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b04be6b8-86f2-4a40-9949-7924934592ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '075aac38e8984d64918f205b57b7b38a', 'request_id': 'req-b04be6b8-86f2-4a40-9949-7924934592ca'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:51:43.144278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b04be6b8-86f2-4a40-9949-7924934592ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '075aac38e8984d64918f205b57b7b38a', 'request_id': 'req-b04be6b8-86f2-4a40-9949-7924934592ca'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:51:43.183080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b04be6b8-86f2-4a40-9949-7924934592ca admin admin] The token cache is being invalidate because project 075aac38e8984d64918f205b57b7b38a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:51:43.183730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b04be6b8-86f2-4a40-9949-7924934592ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:51:43.186578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b04be6b8-86f2-4a40-9949-7924934592ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:51:43.191590 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1623/3231] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:51:42 2022] DELETE /identity/v3/projects/075aac38e8984d64918f205b57b7b38a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:51:43.198353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd4b07-4bd1-4319-97a1-9e1954e193db None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:43.199543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd4b07-4bd1-4319-97a1-9e1954e193db None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:43.199969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd4b07-4bd1-4319-97a1-9e1954e193db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:43.258808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-12fd4b07-4bd1-4319-97a1-9e1954e193db None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:51:43.261966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-12fd4b07-4bd1-4319-97a1-9e1954e193db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:43.413684 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1609/3232] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:51:43.416419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64dd6e-cf9b-447e-b323-6b9ed2a66ca6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:43.417104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64dd6e-cf9b-447e-b323-6b9ed2a66ca6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:43.417628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64dd6e-cf9b-447e-b323-6b9ed2a66ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:43.434115 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:51:43.476913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cc64dd6e-cf9b-447e-b323-6b9ed2a66ca6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:51:43.481441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cc64dd6e-cf9b-447e-b323-6b9ed2a66ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:43.502746 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1624/3233] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:51:43.507652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd4b07-4bd1-4319-97a1-9e1954e193db None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:43.528173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd4b07-4bd1-4319-97a1-9e1954e193db None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:43.543045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169a08b-c816-485a-a6e2-9b8680d36760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:43.543752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169a08b-c816-485a-a6e2-9b8680d36760 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:43.543943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169a08b-c816-485a-a6e2-9b8680d36760 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:43.544223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169a08b-c816-485a-a6e2-9b8680d36760 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:43.545519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169a08b-c816-485a-a6e2-9b8680d36760 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:51:43.546399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169a08b-c816-485a-a6e2-9b8680d36760 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:43.548998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169a08b-c816-485a-a6e2-9b8680d36760 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:43.569044 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1610/3234] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:51:43.569254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64dd6e-cf9b-447e-b323-6b9ed2a66ca6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:43.582389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64dd6e-cf9b-447e-b323-6b9ed2a66ca6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:43.596808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215e3f3-3cdf-4632-83d1-47b3b35b647f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:43.597436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215e3f3-3cdf-4632-83d1-47b3b35b647f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:43.597710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215e3f3-3cdf-4632-83d1-47b3b35b647f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:43.600940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215e3f3-3cdf-4632-83d1-47b3b35b647f admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:43.601639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215e3f3-3cdf-4632-83d1-47b3b35b647f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:43.603551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215e3f3-3cdf-4632-83d1-47b3b35b647f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:43.683934 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1625/3235] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:51:43 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:51:43.701119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169a08b-c816-485a-a6e2-9b8680d36760 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:43.704487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169a08b-c816-485a-a6e2-9b8680d36760 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:43.854907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69394cb5-cce5-419d-9a6c-5c4f446276ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:43.855628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69394cb5-cce5-419d-9a6c-5c4f446276ed admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:43.855983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69394cb5-cce5-419d-9a6c-5c4f446276ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:43.856333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69394cb5-cce5-419d-9a6c-5c4f446276ed admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:43.857078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69394cb5-cce5-419d-9a6c-5c4f446276ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:43.862840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69394cb5-cce5-419d-9a6c-5c4f446276ed admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:43.907111 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1611/3236] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:51:43 2022] POST /identity/v3/users => generated 283 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:51:43.911583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215e3f3-3cdf-4632-83d1-47b3b35b647f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:43.930280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215e3f3-3cdf-4632-83d1-47b3b35b647f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:43.945057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929fdef-571b-4605-aa06-4280646b6035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:43.949199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929fdef-571b-4605-aa06-4280646b6035 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:43.949482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929fdef-571b-4605-aa06-4280646b6035 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:43.949754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929fdef-571b-4605-aa06-4280646b6035 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:43.950421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929fdef-571b-4605-aa06-4280646b6035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:43.955045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929fdef-571b-4605-aa06-4280646b6035 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:43.988442 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1626/3237] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:51:43.991169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69394cb5-cce5-419d-9a6c-5c4f446276ed admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:44.007926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69394cb5-cce5-419d-9a6c-5c4f446276ed admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:44.016017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19a559-9038-4cdd-b4e7-f9ac2577c6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:44.017331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19a559-9038-4cdd-b4e7-f9ac2577c6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:44.017826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19a559-9038-4cdd-b4e7-f9ac2577c6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:44.018310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19a559-9038-4cdd-b4e7-f9ac2577c6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:44.019172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19a559-9038-4cdd-b4e7-f9ac2577c6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:44.021032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19a559-9038-4cdd-b4e7-f9ac2577c6c6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:44.047846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929fdef-571b-4605-aa06-4280646b6035 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:44.059646 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1612/3238] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:51:44.065477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929fdef-571b-4605-aa06-4280646b6035 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:44.079218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26917ba8-2b47-441c-8915-af8bf7a67e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:44.080235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26917ba8-2b47-441c-8915-af8bf7a67e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:44.080747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26917ba8-2b47-441c-8915-af8bf7a67e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:44.081245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26917ba8-2b47-441c-8915-af8bf7a67e50 admin admin] PATH_INFO: `/v3/projects/e7da88c09a3d4e6790442c1787f2ff65/users/b4a7050533994b60aa3f7bb63b732dd5/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:44.119043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26917ba8-2b47-441c-8915-af8bf7a67e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7da88c09a3d4e6790442c1787f2ff65, user_id=b4a7050533994b60aa3f7bb63b732dd5, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:44.121980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26917ba8-2b47-441c-8915-af8bf7a67e50 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:44.162041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a7c4a-195b-4c9e-833b-cf9e968bacc4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:44.162328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a7c4a-195b-4c9e-833b-cf9e968bacc4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:44.162605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a7c4a-195b-4c9e-833b-cf9e968bacc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:44.165254 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1627/3239] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:51:44 2022] PUT /identity/v3/projects/e7da88c09a3d4e6790442c1787f2ff65/users/b4a7050533994b60aa3f7bb63b732dd5/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:51:44.191641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-671a7c4a-195b-4c9e-833b-cf9e968bacc4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:51:44.192964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-671a7c4a-195b-4c9e-833b-cf9e968bacc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:44.206525 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:51:44.369186 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1613/3240] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:51:44.382664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26917ba8-2b47-441c-8915-af8bf7a67e50 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:44.384378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-26917ba8-2b47-441c-8915-af8bf7a67e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:44.473449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26917ba8-2b47-441c-8915-af8bf7a67e50 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:44.478952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5da15-5814-4612-83e9-04fd7a4a02bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:44.479809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5da15-5814-4612-83e9-04fd7a4a02bd service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:44.480116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5da15-5814-4612-83e9-04fd7a4a02bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:44.480366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5da15-5814-4612-83e9-04fd7a4a02bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:44.495120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5da15-5814-4612-83e9-04fd7a4a02bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:44.496545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5da15-5814-4612-83e9-04fd7a4a02bd service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:44.507988 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1628/3241] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:51:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:51:48.072140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a7c4a-195b-4c9e-833b-cf9e968bacc4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:48.073616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-671a7c4a-195b-4c9e-833b-cf9e968bacc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:48.102974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a7c4a-195b-4c9e-833b-cf9e968bacc4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:48.117992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700a00c-a13c-4e6c-9fc5-f6f6955f53ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:48.118622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700a00c-a13c-4e6c-9fc5-f6f6955f53ec service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:48.118902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700a00c-a13c-4e6c-9fc5-f6f6955f53ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:48.119175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700a00c-a13c-4e6c-9fc5-f6f6955f53ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:48.124416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5700a00c-a13c-4e6c-9fc5-f6f6955f53ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:48.167927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700a00c-a13c-4e6c-9fc5-f6f6955f53ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:48.170051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700a00c-a13c-4e6c-9fc5-f6f6955f53ec service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:48.211793 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1614/3242] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:51:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:51:53.000902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189b7a0-4197-4b7a-a632-f734e8407716 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:53.001781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189b7a0-4197-4b7a-a632-f734e8407716 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:53.002196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189b7a0-4197-4b7a-a632-f734e8407716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:53.056637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a189b7a0-4197-4b7a-a632-f734e8407716 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:51:53.063041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a189b7a0-4197-4b7a-a632-f734e8407716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:53.248497 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1629/3243] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 09:51:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:51:53.265056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab1950-e408-428e-b4e2-9f4839e3f93f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:53.265958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab1950-e408-428e-b4e2-9f4839e3f93f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:53.266428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab1950-e408-428e-b4e2-9f4839e3f93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:53.283707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189b7a0-4197-4b7a-a632-f734e8407716 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:53.285324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a189b7a0-4197-4b7a-a632-f734e8407716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:53.311577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-88ab1950-e408-428e-b4e2-9f4839e3f93f None None] MFA Rules not processed for user `b4a7050533994b60aa3f7bb63b732dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:51:53.314120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-88ab1950-e408-428e-b4e2-9f4839e3f93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:53.387006 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:51:53.415163 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1615/3244] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:51:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:51:53.429376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066792bc-8da2-4d62-ac76-a7bee0d4ca5a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:53.430043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066792bc-8da2-4d62-ac76-a7bee0d4ca5a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:53.430611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066792bc-8da2-4d62-ac76-a7bee0d4ca5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:53.437396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189b7a0-4197-4b7a-a632-f734e8407716 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:53.451511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449fdc4-74cc-447a-84bf-07895a0bf8bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:53.452948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449fdc4-74cc-447a-84bf-07895a0bf8bf service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:53.454730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-066792bc-8da2-4d62-ac76-a7bee0d4ca5a None None] MFA Rules not processed for user `b4a7050533994b60aa3f7bb63b732dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:51:53.455152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449fdc4-74cc-447a-84bf-07895a0bf8bf service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:53.455539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449fdc4-74cc-447a-84bf-07895a0bf8bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:53.456451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-066792bc-8da2-4d62-ac76-a7bee0d4ca5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:53.469975 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1616/3245] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:51:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:51:53.479142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449fdc4-74cc-447a-84bf-07895a0bf8bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:53.481854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449fdc4-74cc-447a-84bf-07895a0bf8bf service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:53.493389 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1630/3246] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:51:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:51:54.096370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066792bc-8da2-4d62-ac76-a7bee0d4ca5a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:54.101116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-066792bc-8da2-4d62-ac76-a7bee0d4ca5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:54.294453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066792bc-8da2-4d62-ac76-a7bee0d4ca5a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:54.301924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8425116-f325-4111-a9d2-43d7fe59c66c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:54.302559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8425116-f325-4111-a9d2-43d7fe59c66c service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:54.302835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8425116-f325-4111-a9d2-43d7fe59c66c service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:54.303367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8425116-f325-4111-a9d2-43d7fe59c66c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:54.314205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8425116-f325-4111-a9d2-43d7fe59c66c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:54.315962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8425116-f325-4111-a9d2-43d7fe59c66c service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:54.326767 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1617/3247] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:51:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:51:55.060393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a415e-d2ae-4d29-a995-26cdee41c938 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:55.060393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a415e-d2ae-4d29-a995-26cdee41c938 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:55.060828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a415e-d2ae-4d29-a995-26cdee41c938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:55.108961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d40a415e-d2ae-4d29-a995-26cdee41c938 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:51:55.110304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d40a415e-d2ae-4d29-a995-26cdee41c938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:55.131936 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1631/3248] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 09:51:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:51:55.141325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8425116-f325-4111-a9d2-43d7fe59c66c service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:55.163823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8425116-f325-4111-a9d2-43d7fe59c66c service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:55.181587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe8e9f-5faf-4d9d-9059-32435c48484a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:55.182605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe8e9f-5faf-4d9d-9059-32435c48484a service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:55.183095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe8e9f-5faf-4d9d-9059-32435c48484a service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:55.183565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe8e9f-5faf-4d9d-9059-32435c48484a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:55.200808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe8e9f-5faf-4d9d-9059-32435c48484a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:55.203385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe8e9f-5faf-4d9d-9059-32435c48484a service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:55.213846 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:51:55.224951 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1618/3249] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:51:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:51:56.976182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bde864-09ca-4b29-b924-44fefb032639 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:56.977313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bde864-09ca-4b29-b924-44fefb032639 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:56.977822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bde864-09ca-4b29-b924-44fefb032639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:57.011230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f7bde864-09ca-4b29-b924-44fefb032639 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:51:57.013163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f7bde864-09ca-4b29-b924-44fefb032639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:57.036243 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1632/3250] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 09:51:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:51:57.040537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe8e9f-5faf-4d9d-9059-32435c48484a service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:51:57.057720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe8e9f-5faf-4d9d-9059-32435c48484a service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:51:57.075831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e923dc5-c28f-459a-aa0b-9c18e315d26d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:51:57.076537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e923dc5-c28f-459a-aa0b-9c18e315d26d service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:57.077004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e923dc5-c28f-459a-aa0b-9c18e315d26d service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:57.077373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e923dc5-c28f-459a-aa0b-9c18e315d26d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:57.100489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e923dc5-c28f-459a-aa0b-9c18e315d26d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:51:57.102550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e923dc5-c28f-459a-aa0b-9c18e315d26d service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:51:57.132909 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1619/3251] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:51:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:51:58.909841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60be8f-fe77-4549-9ef9-2f6266a1a7d0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:51:58.910666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60be8f-fe77-4549-9ef9-2f6266a1a7d0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:51:58.910666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60be8f-fe77-4549-9ef9-2f6266a1a7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:51:58.951348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ea60be8f-fe77-4549-9ef9-2f6266a1a7d0 None None] MFA Rules not processed for user `1601a65c979846cda98c3cd501a71d71`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:51:58.953688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ea60be8f-fe77-4549-9ef9-2f6266a1a7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:51:59.162063 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1633/3252] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:51:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:06.887790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e923dc5-c28f-459a-aa0b-9c18e315d26d service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:06.890601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5e923dc5-c28f-459a-aa0b-9c18e315d26d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:06.906814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e923dc5-c28f-459a-aa0b-9c18e315d26d service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:06.922051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32165a-bc77-4a7f-a000-9b9a83ad3d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:06.925464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32165a-bc77-4a7f-a000-9b9a83ad3d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:06.925751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32165a-bc77-4a7f-a000-9b9a83ad3d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:06.926027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32165a-bc77-4a7f-a000-9b9a83ad3d7a admin admin] PATH_INFO: `/v3/users/5ee27b6e2411469d9ef72ad8a7e6491f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:06.929406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32165a-bc77-4a7f-a000-9b9a83ad3d7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee27b6e2411469d9ef72ad8a7e6491f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:06.931510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32165a-bc77-4a7f-a000-9b9a83ad3d7a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:07.017131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7d32165a-bc77-4a7f-a000-9b9a83ad3d7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee27b6e2411469d9ef72ad8a7e6491f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:07.028720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7d32165a-bc77-4a7f-a000-9b9a83ad3d7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee27b6e2411469d9ef72ad8a7e6491f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:07.029760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7d32165a-bc77-4a7f-a000-9b9a83ad3d7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee27b6e2411469d9ef72ad8a7e6491f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:07.060673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7d32165a-bc77-4a7f-a000-9b9a83ad3d7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee27b6e2411469d9ef72ad8a7e6491f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:07.069767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7d32165a-bc77-4a7f-a000-9b9a83ad3d7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee27b6e2411469d9ef72ad8a7e6491f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:07.076898 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1620/3253] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:52:06 2022] DELETE /identity/v3/users/5ee27b6e2411469d9ef72ad8a7e6491f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:07.477904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60be8f-fe77-4549-9ef9-2f6266a1a7d0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:07.502025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60be8f-fe77-4549-9ef9-2f6266a1a7d0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:07.589218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893af972-c1d2-4810-9e9a-d2ccbe9b7645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:07.589937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893af972-c1d2-4810-9e9a-d2ccbe9b7645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:07.590290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893af972-c1d2-4810-9e9a-d2ccbe9b7645 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:07.590633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893af972-c1d2-4810-9e9a-d2ccbe9b7645 admin admin] PATH_INFO: `/v3/projects/9d60b9eb66be48ebb98ba6b49e826f17` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:07.591997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893af972-c1d2-4810-9e9a-d2ccbe9b7645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d60b9eb66be48ebb98ba6b49e826f17)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:07.595167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893af972-c1d2-4810-9e9a-d2ccbe9b7645 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:07.654857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-893af972-c1d2-4810-9e9a-d2ccbe9b7645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d60b9eb66be48ebb98ba6b49e826f17', 'request_id': 'req-893af972-c1d2-4810-9e9a-d2ccbe9b7645'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:07.666745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-893af972-c1d2-4810-9e9a-d2ccbe9b7645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d60b9eb66be48ebb98ba6b49e826f17', 'request_id': 'req-893af972-c1d2-4810-9e9a-d2ccbe9b7645'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:07.679284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-893af972-c1d2-4810-9e9a-d2ccbe9b7645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d60b9eb66be48ebb98ba6b49e826f17', 'request_id': 'req-893af972-c1d2-4810-9e9a-d2ccbe9b7645'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:07.690729 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:07.695427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-893af972-c1d2-4810-9e9a-d2ccbe9b7645 admin admin] The token cache is being invalidate because project 9d60b9eb66be48ebb98ba6b49e826f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:52:07.696014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-893af972-c1d2-4810-9e9a-d2ccbe9b7645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:07.697610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-893af972-c1d2-4810-9e9a-d2ccbe9b7645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:07.701533 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1634/3254] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:52:07 2022] DELETE /identity/v3/projects/9d60b9eb66be48ebb98ba6b49e826f17 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:07.705839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32165a-bc77-4a7f-a000-9b9a83ad3d7a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:07.707978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7d32165a-bc77-4a7f-a000-9b9a83ad3d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:07.728506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32165a-bc77-4a7f-a000-9b9a83ad3d7a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:07.834399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79634cb-883f-4638-9cd0-f249f09cbd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:07.835428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79634cb-883f-4638-9cd0-f249f09cbd87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:07.835934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79634cb-883f-4638-9cd0-f249f09cbd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:07.836405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79634cb-883f-4638-9cd0-f249f09cbd87 admin admin] PATH_INFO: `/v3/users/305a124029ac42f09ff8f24040cc4126` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:07.838171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79634cb-883f-4638-9cd0-f249f09cbd87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=305a124029ac42f09ff8f24040cc4126)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:07.840975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79634cb-883f-4638-9cd0-f249f09cbd87 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:07.943522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a79634cb-883f-4638-9cd0-f249f09cbd87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '305a124029ac42f09ff8f24040cc4126'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:07.959368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a79634cb-883f-4638-9cd0-f249f09cbd87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '305a124029ac42f09ff8f24040cc4126'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:07.961354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a79634cb-883f-4638-9cd0-f249f09cbd87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '305a124029ac42f09ff8f24040cc4126'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:07.968077 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:07.979234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a79634cb-883f-4638-9cd0-f249f09cbd87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '305a124029ac42f09ff8f24040cc4126'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:07.989594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a79634cb-883f-4638-9cd0-f249f09cbd87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '305a124029ac42f09ff8f24040cc4126'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:07.996335 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1621/3255] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:52:07 2022] DELETE /identity/v3/users/305a124029ac42f09ff8f24040cc4126 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:08.425270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893af972-c1d2-4810-9e9a-d2ccbe9b7645 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:08.426616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-893af972-c1d2-4810-9e9a-d2ccbe9b7645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:08.439466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893af972-c1d2-4810-9e9a-d2ccbe9b7645 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:08.506720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fae4e6-8d87-4e72-b6d6-989e8e90726a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:08.507359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fae4e6-8d87-4e72-b6d6-989e8e90726a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:08.507359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fae4e6-8d87-4e72-b6d6-989e8e90726a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:08.507555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fae4e6-8d87-4e72-b6d6-989e8e90726a admin admin] PATH_INFO: `/v3/projects/56e8c36cdf674f20b27c88c70b1c071e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:08.508642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fae4e6-8d87-4e72-b6d6-989e8e90726a admin admin] RBAC: Authorizing `identity:delete_project(project_id=56e8c36cdf674f20b27c88c70b1c071e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:08.510720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fae4e6-8d87-4e72-b6d6-989e8e90726a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:08.570733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11fae4e6-8d87-4e72-b6d6-989e8e90726a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e8c36cdf674f20b27c88c70b1c071e', 'request_id': 'req-11fae4e6-8d87-4e72-b6d6-989e8e90726a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:08.584775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11fae4e6-8d87-4e72-b6d6-989e8e90726a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e8c36cdf674f20b27c88c70b1c071e', 'request_id': 'req-11fae4e6-8d87-4e72-b6d6-989e8e90726a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:08.590795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11fae4e6-8d87-4e72-b6d6-989e8e90726a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e8c36cdf674f20b27c88c70b1c071e', 'request_id': 'req-11fae4e6-8d87-4e72-b6d6-989e8e90726a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:08.604143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11fae4e6-8d87-4e72-b6d6-989e8e90726a admin admin] The token cache is being invalidate because project 56e8c36cdf674f20b27c88c70b1c071e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:52:08.604429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11fae4e6-8d87-4e72-b6d6-989e8e90726a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:08.605249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11fae4e6-8d87-4e72-b6d6-989e8e90726a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:08.606850 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1635/3256] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:52:08 2022] DELETE /identity/v3/projects/56e8c36cdf674f20b27c88c70b1c071e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:08.612012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d137975-1c76-4cb0-b055-6dce8836a6f5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:08.612366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d137975-1c76-4cb0-b055-6dce8836a6f5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:08.612744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d137975-1c76-4cb0-b055-6dce8836a6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:08.635868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7d137975-1c76-4cb0-b055-6dce8836a6f5 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:08.637285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7d137975-1c76-4cb0-b055-6dce8836a6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:08.711790 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1622/3257] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:08.720590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1597ac-a8e3-4f42-8b18-0410c3e2b8a7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:08.721147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1597ac-a8e3-4f42-8b18-0410c3e2b8a7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:08.721515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1597ac-a8e3-4f42-8b18-0410c3e2b8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:08.752007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1e1597ac-a8e3-4f42-8b18-0410c3e2b8a7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:08.754574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1e1597ac-a8e3-4f42-8b18-0410c3e2b8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:08.766898 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1636/3258] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:08.772284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d137975-1c76-4cb0-b055-6dce8836a6f5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:08.782289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d137975-1c76-4cb0-b055-6dce8836a6f5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:08.786867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26417c19-e4c1-4b76-ae7a-4e7efbd8d139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:08.787477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26417c19-e4c1-4b76-ae7a-4e7efbd8d139 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:08.787750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26417c19-e4c1-4b76-ae7a-4e7efbd8d139 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:08.788015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26417c19-e4c1-4b76-ae7a-4e7efbd8d139 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:08.788687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26417c19-e4c1-4b76-ae7a-4e7efbd8d139 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:52:08.788983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26417c19-e4c1-4b76-ae7a-4e7efbd8d139 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:08.790585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26417c19-e4c1-4b76-ae7a-4e7efbd8d139 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:08.802688 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1623/3259] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:08.807723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1597ac-a8e3-4f42-8b18-0410c3e2b8a7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:08.817905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1597ac-a8e3-4f42-8b18-0410c3e2b8a7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:08.824958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd27a8-417a-4542-b135-0b7354d3fff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:08.825570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd27a8-417a-4542-b135-0b7354d3fff4 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:08.825842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd27a8-417a-4542-b135-0b7354d3fff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:08.826383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd27a8-417a-4542-b135-0b7354d3fff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:08.827978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd27a8-417a-4542-b135-0b7354d3fff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:08.830091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd27a8-417a-4542-b135-0b7354d3fff4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:08.861542 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1637/3260] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:52:08 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:52:08.865673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26417c19-e4c1-4b76-ae7a-4e7efbd8d139 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:08.878461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26417c19-e4c1-4b76-ae7a-4e7efbd8d139 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:08.962192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35449b7c-7ac6-42e2-8246-6910538ab271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:08.962947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35449b7c-7ac6-42e2-8246-6910538ab271 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:08.963504 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35449b7c-7ac6-42e2-8246-6910538ab271 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:08.963885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35449b7c-7ac6-42e2-8246-6910538ab271 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:08.964695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35449b7c-7ac6-42e2-8246-6910538ab271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:08.966880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35449b7c-7ac6-42e2-8246-6910538ab271 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:08.996695 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1624/3261] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:52:08 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:52:09.001133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd27a8-417a-4542-b135-0b7354d3fff4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:09.016914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd27a8-417a-4542-b135-0b7354d3fff4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:09.052844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566d2f1-1d23-47b7-b3e2-1488324076dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:09.054855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566d2f1-1d23-47b7-b3e2-1488324076dc admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:09.055143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566d2f1-1d23-47b7-b3e2-1488324076dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:09.057219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566d2f1-1d23-47b7-b3e2-1488324076dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:09.063479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566d2f1-1d23-47b7-b3e2-1488324076dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:09.068332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566d2f1-1d23-47b7-b3e2-1488324076dc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:09.103749 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1638/3262] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:52:09.106478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35449b7c-7ac6-42e2-8246-6910538ab271 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:09.121802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35449b7c-7ac6-42e2-8246-6910538ab271 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:09.127982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f19b2f-0d7f-48ea-8770-2d1ddc94b5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:09.129020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f19b2f-0d7f-48ea-8770-2d1ddc94b5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:09.129599 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f19b2f-0d7f-48ea-8770-2d1ddc94b5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:09.130018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f19b2f-0d7f-48ea-8770-2d1ddc94b5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:09.131288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f19b2f-0d7f-48ea-8770-2d1ddc94b5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:09.134787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f19b2f-0d7f-48ea-8770-2d1ddc94b5d5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:09.155825 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1625/3263] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:52:09.160143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566d2f1-1d23-47b7-b3e2-1488324076dc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:09.172895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566d2f1-1d23-47b7-b3e2-1488324076dc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:09.182661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea788a-25f5-42b9-b1f5-a89d8aaf4cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:09.183992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea788a-25f5-42b9-b1f5-a89d8aaf4cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:09.184276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea788a-25f5-42b9-b1f5-a89d8aaf4cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:09.184560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea788a-25f5-42b9-b1f5-a89d8aaf4cf6 admin admin] PATH_INFO: `/v3/projects/db1c90bfed9143959a05aeb202b54c65/users/66dd6264f85d4dbe801abf983995a895/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:09.214610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea788a-25f5-42b9-b1f5-a89d8aaf4cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db1c90bfed9143959a05aeb202b54c65, user_id=66dd6264f85d4dbe801abf983995a895, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:09.218811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea788a-25f5-42b9-b1f5-a89d8aaf4cf6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:09.238350 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1639/3264] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:52:09 2022] PUT /identity/v3/projects/db1c90bfed9143959a05aeb202b54c65/users/66dd6264f85d4dbe801abf983995a895/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:52:09.313881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaeb6be-a591-41dd-a9d8-aadf202510d2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:09.314054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaeb6be-a591-41dd-a9d8-aadf202510d2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:09.314329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaeb6be-a591-41dd-a9d8-aadf202510d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:09.347416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2eaeb6be-a591-41dd-a9d8-aadf202510d2 None None] MFA Rules not processed for user `66dd6264f85d4dbe801abf983995a895`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:09.349056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2eaeb6be-a591-41dd-a9d8-aadf202510d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:09.422397 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:09.484865 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1626/3265] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:09.489913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea788a-25f5-42b9-b1f5-a89d8aaf4cf6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:09.550932 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:09.616087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea788a-25f5-42b9-b1f5-a89d8aaf4cf6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:09.622109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f89a75-3f72-43c3-819c-bbf86157b0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:09.623048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f89a75-3f72-43c3-819c-bbf86157b0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:09.623525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f89a75-3f72-43c3-819c-bbf86157b0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:09.624979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f89a75-3f72-43c3-819c-bbf86157b0c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:09.625988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f89a75-3f72-43c3-819c-bbf86157b0c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:09.628311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f89a75-3f72-43c3-819c-bbf86157b0c6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:09.679007 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1640/3266] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:52:09 2022] POST /identity/v3/projects => generated 375 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:52:09.680973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaeb6be-a591-41dd-a9d8-aadf202510d2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:09.705368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaeb6be-a591-41dd-a9d8-aadf202510d2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:09.777879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ac659-13dd-4d77-9efc-a2bfca3fc230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:09.778782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ac659-13dd-4d77-9efc-a2bfca3fc230 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:09.778912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ac659-13dd-4d77-9efc-a2bfca3fc230 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:09.779279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ac659-13dd-4d77-9efc-a2bfca3fc230 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:09.780077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ac659-13dd-4d77-9efc-a2bfca3fc230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:09.782129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ac659-13dd-4d77-9efc-a2bfca3fc230 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:09.812714 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1627/3267] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:52:09 2022] POST /identity/v3/users => generated 294 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:52:09.815148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f89a75-3f72-43c3-819c-bbf86157b0c6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:09.828326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f89a75-3f72-43c3-819c-bbf86157b0c6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:09.833720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc9b4a-663a-4435-b21e-06108d417f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:09.834258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc9b4a-663a-4435-b21e-06108d417f1f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:09.834537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc9b4a-663a-4435-b21e-06108d417f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:09.834804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc9b4a-663a-4435-b21e-06108d417f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:09.835447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc9b4a-663a-4435-b21e-06108d417f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:09.837076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc9b4a-663a-4435-b21e-06108d417f1f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:09.849651 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1641/3268] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:52:09.853683 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ac659-13dd-4d77-9efc-a2bfca3fc230 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:09.864680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ac659-13dd-4d77-9efc-a2bfca3fc230 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:09.872117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff04a77-8f4b-4ee6-b424-ea0dbf2faa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:09.873448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff04a77-8f4b-4ee6-b424-ea0dbf2faa9f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:09.874441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff04a77-8f4b-4ee6-b424-ea0dbf2faa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:09.874880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff04a77-8f4b-4ee6-b424-ea0dbf2faa9f admin admin] PATH_INFO: `/v3/projects/81d2a6454e3043879a94c4959ea6d065/users/eee23759b02f4a2facac82113dbe6b17/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:09.898338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff04a77-8f4b-4ee6-b424-ea0dbf2faa9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d2a6454e3043879a94c4959ea6d065, user_id=eee23759b02f4a2facac82113dbe6b17, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:09.901077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff04a77-8f4b-4ee6-b424-ea0dbf2faa9f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:09.926621 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1628/3269] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:52:09 2022] PUT /identity/v3/projects/81d2a6454e3043879a94c4959ea6d065/users/eee23759b02f4a2facac82113dbe6b17/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:09.930809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc9b4a-663a-4435-b21e-06108d417f1f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:09.941792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc9b4a-663a-4435-b21e-06108d417f1f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:10.007333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b7b1c-a6ff-43d1-a706-bd496e3cc2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:10.008088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b7b1c-a6ff-43d1-a706-bd496e3cc2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:10.008468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b7b1c-a6ff-43d1-a706-bd496e3cc2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:10.008848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b7b1c-a6ff-43d1-a706-bd496e3cc2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:10.009582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b7b1c-a6ff-43d1-a706-bd496e3cc2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:10.011241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b7b1c-a6ff-43d1-a706-bd496e3cc2f7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:10.026427 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1642/3270] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:52:10.027680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff04a77-8f4b-4ee6-b424-ea0dbf2faa9f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:10.039383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff04a77-8f4b-4ee6-b424-ea0dbf2faa9f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:10.045262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e15745-8788-46b2-9f76-3a549d60e969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:10.046976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e15745-8788-46b2-9f76-3a549d60e969 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:10.047400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e15745-8788-46b2-9f76-3a549d60e969 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:10.047739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e15745-8788-46b2-9f76-3a549d60e969 admin admin] PATH_INFO: `/v3/projects/81d2a6454e3043879a94c4959ea6d065/users/eee23759b02f4a2facac82113dbe6b17/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:10.049992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e15745-8788-46b2-9f76-3a549d60e969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d2a6454e3043879a94c4959ea6d065, user_id=eee23759b02f4a2facac82113dbe6b17, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:10.052890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e15745-8788-46b2-9f76-3a549d60e969 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:10.064833 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1629/3271] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:52:10 2022] PUT /identity/v3/projects/81d2a6454e3043879a94c4959ea6d065/users/eee23759b02f4a2facac82113dbe6b17/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:10.075133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988372f-a3b6-45a9-b36f-ff588d38fdb4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:10.075485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988372f-a3b6-45a9-b36f-ff588d38fdb4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:10.075815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988372f-a3b6-45a9-b36f-ff588d38fdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:10.111217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e988372f-a3b6-45a9-b36f-ff588d38fdb4 None None] MFA Rules not processed for user `eee23759b02f4a2facac82113dbe6b17`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:10.112518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e988372f-a3b6-45a9-b36f-ff588d38fdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:10.205397 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1643/3272] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:10.215997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644a657-6ffd-4c00-b015-ded3fb8c0b96 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:10.216275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644a657-6ffd-4c00-b015-ded3fb8c0b96 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:10.216544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644a657-6ffd-4c00-b015-ded3fb8c0b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:10.237331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d644a657-6ffd-4c00-b015-ded3fb8c0b96 None None] MFA Rules not processed for user `66dd6264f85d4dbe801abf983995a895`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:10.238533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d644a657-6ffd-4c00-b015-ded3fb8c0b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:10.294885 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1630/3273] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:10.306353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988372f-a3b6-45a9-b36f-ff588d38fdb4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:10.311561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e988372f-a3b6-45a9-b36f-ff588d38fdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:10.318952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644a657-6ffd-4c00-b015-ded3fb8c0b96 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:10.320404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d644a657-6ffd-4c00-b015-ded3fb8c0b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:10.334849 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:10.354073 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:10.382010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644a657-6ffd-4c00-b015-ded3fb8c0b96 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:10.385569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bae0a5-77af-43f4-9e85-8393401f3ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:10.386168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bae0a5-77af-43f4-9e85-8393401f3ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:10.386445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bae0a5-77af-43f4-9e85-8393401f3ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:10.386745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bae0a5-77af-43f4-9e85-8393401f3ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:10.388451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f5bae0a5-77af-43f4-9e85-8393401f3ef7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:10.391757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988372f-a3b6-45a9-b36f-ff588d38fdb4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:10.398162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c3d7a-01b2-47b0-b3f9-7b13ee93356a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:10.399068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c3d7a-01b2-47b0-b3f9-7b13ee93356a service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:10.399531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c3d7a-01b2-47b0-b3f9-7b13ee93356a service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:10.399973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c3d7a-01b2-47b0-b3f9-7b13ee93356a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:10.409692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c3d7a-01b2-47b0-b3f9-7b13ee93356a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:10.411274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c3d7a-01b2-47b0-b3f9-7b13ee93356a service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:10.421608 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1644/3274] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:52:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:52:10.466979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bae0a5-77af-43f4-9e85-8393401f3ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:10.469299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bae0a5-77af-43f4-9e85-8393401f3ef7 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:10.484809 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1631/3275] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:52:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:52:12.314054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889998c6-a677-4f92-8436-7651993f8dd5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:12.314570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889998c6-a677-4f92-8436-7651993f8dd5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:12.314893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889998c6-a677-4f92-8436-7651993f8dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:12.358874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-889998c6-a677-4f92-8436-7651993f8dd5 None None] MFA Rules not processed for user `b4a7050533994b60aa3f7bb63b732dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:12.361805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-889998c6-a677-4f92-8436-7651993f8dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:12.458423 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1645/3276] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:13.566307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bae0a5-77af-43f4-9e85-8393401f3ef7 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:13.567905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f5bae0a5-77af-43f4-9e85-8393401f3ef7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:13.710052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bae0a5-77af-43f4-9e85-8393401f3ef7 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:13.727155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947eaac8-7ce4-4dba-8f5f-985e16580378 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:13.727796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947eaac8-7ce4-4dba-8f5f-985e16580378 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:13.728164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947eaac8-7ce4-4dba-8f5f-985e16580378 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:13.728449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947eaac8-7ce4-4dba-8f5f-985e16580378 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:13.733608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-947eaac8-7ce4-4dba-8f5f-985e16580378 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:13.769437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947eaac8-7ce4-4dba-8f5f-985e16580378 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:13.773986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947eaac8-7ce4-4dba-8f5f-985e16580378 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:13.789247 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1632/3277] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:52:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:52:14.070686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad3433-8b31-42ef-beb3-378ba151f92f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:14.071998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad3433-8b31-42ef-beb3-378ba151f92f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:14.072824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad3433-8b31-42ef-beb3-378ba151f92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:14.145848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-56ad3433-8b31-42ef-beb3-378ba151f92f None None] MFA Rules not processed for user `b4a7050533994b60aa3f7bb63b732dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:14.147408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-56ad3433-8b31-42ef-beb3-378ba151f92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:14.161309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eba4e4-36fa-4334-bd38-fd204c5f5987 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:14.161817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eba4e4-36fa-4334-bd38-fd204c5f5987 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:14.162307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eba4e4-36fa-4334-bd38-fd204c5f5987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:14.178748 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1646/3278] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:14.237702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-52eba4e4-36fa-4334-bd38-fd204c5f5987 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:14.239302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-52eba4e4-36fa-4334-bd38-fd204c5f5987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:14.372029 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1633/3279] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 09:52:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:14.388519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad3433-8b31-42ef-beb3-378ba151f92f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:14.391906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-56ad3433-8b31-42ef-beb3-378ba151f92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:14.548536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad3433-8b31-42ef-beb3-378ba151f92f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:14.558648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b746eff-75ae-41b1-8419-20c7f9cc3ba3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:14.559286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b746eff-75ae-41b1-8419-20c7f9cc3ba3 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:14.559565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b746eff-75ae-41b1-8419-20c7f9cc3ba3 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:14.559833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b746eff-75ae-41b1-8419-20c7f9cc3ba3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:14.569893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b746eff-75ae-41b1-8419-20c7f9cc3ba3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:14.571627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b746eff-75ae-41b1-8419-20c7f9cc3ba3 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:14.584974 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1647/3280] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:52:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:52:15.203479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c57d2-380a-4fa1-920e-0bc1390222ac None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:15.203989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c57d2-380a-4fa1-920e-0bc1390222ac None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:15.204260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c57d2-380a-4fa1-920e-0bc1390222ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:15.235177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3a0c57d2-380a-4fa1-920e-0bc1390222ac None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:15.236411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3a0c57d2-380a-4fa1-920e-0bc1390222ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:15.244105 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1634/3281] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 09:52:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:15.258885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b746eff-75ae-41b1-8419-20c7f9cc3ba3 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:15.272637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b746eff-75ae-41b1-8419-20c7f9cc3ba3 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:15.277959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1467b4-f8cf-4c42-a144-bd86eb208cfc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:15.278566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1467b4-f8cf-4c42-a144-bd86eb208cfc service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:15.278842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1467b4-f8cf-4c42-a144-bd86eb208cfc service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:15.279138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1467b4-f8cf-4c42-a144-bd86eb208cfc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:15.289561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1467b4-f8cf-4c42-a144-bd86eb208cfc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:15.291618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1467b4-f8cf-4c42-a144-bd86eb208cfc service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:15.304231 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1648/3282] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:52:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:52:15.887159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926f678-efee-465f-b91d-a73bdf078350 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:15.887941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926f678-efee-465f-b91d-a73bdf078350 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:15.888670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926f678-efee-465f-b91d-a73bdf078350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:15.906060 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:15.914198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8926f678-efee-465f-b91d-a73bdf078350 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:15.915781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8926f678-efee-465f-b91d-a73bdf078350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:15.926195 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1635/3283] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 09:52:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:15.947967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1467b4-f8cf-4c42-a144-bd86eb208cfc service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:15.965176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1467b4-f8cf-4c42-a144-bd86eb208cfc service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:15.973149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63ed98-c805-4d2e-a74a-e9588fd89873 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:15.974171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63ed98-c805-4d2e-a74a-e9588fd89873 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:15.974644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63ed98-c805-4d2e-a74a-e9588fd89873 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:15.975158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63ed98-c805-4d2e-a74a-e9588fd89873 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:15.985304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63ed98-c805-4d2e-a74a-e9588fd89873 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:15.987249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63ed98-c805-4d2e-a74a-e9588fd89873 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:16.010090 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1649/3284] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:52:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:52:16.152016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926f678-efee-465f-b91d-a73bdf078350 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:16.153611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8926f678-efee-465f-b91d-a73bdf078350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:16.175339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926f678-efee-465f-b91d-a73bdf078350 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:16.183221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465deca-5d2b-4ac2-9d70-785571be3f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:16.184273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465deca-5d2b-4ac2-9d70-785571be3f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:16.184898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465deca-5d2b-4ac2-9d70-785571be3f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:16.185384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465deca-5d2b-4ac2-9d70-785571be3f6f admin admin] PATH_INFO: `/v3/users/f33a618447b7460298236440b04cca66` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:16.186971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465deca-5d2b-4ac2-9d70-785571be3f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f33a618447b7460298236440b04cca66)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:16.205814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465deca-5d2b-4ac2-9d70-785571be3f6f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:16.291714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7465deca-5d2b-4ac2-9d70-785571be3f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f33a618447b7460298236440b04cca66'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:16.302822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7465deca-5d2b-4ac2-9d70-785571be3f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f33a618447b7460298236440b04cca66'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:16.302822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7465deca-5d2b-4ac2-9d70-785571be3f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f33a618447b7460298236440b04cca66'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:16.320677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7465deca-5d2b-4ac2-9d70-785571be3f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f33a618447b7460298236440b04cca66'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:16.332509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7465deca-5d2b-4ac2-9d70-785571be3f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f33a618447b7460298236440b04cca66'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:16.339942 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1636/3285] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:52:16 2022] DELETE /identity/v3/users/f33a618447b7460298236440b04cca66 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:16.344268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d5def-789d-47be-8698-dbc789a6d5ec None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:16.344822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d5def-789d-47be-8698-dbc789a6d5ec None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:16.345330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d5def-789d-47be-8698-dbc789a6d5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:16.361182 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:16.371362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4a0d5def-789d-47be-8698-dbc789a6d5ec None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:16.372904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4a0d5def-789d-47be-8698-dbc789a6d5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:16.435082 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1650/3286] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:16.445400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465deca-5d2b-4ac2-9d70-785571be3f6f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:16.446950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7465deca-5d2b-4ac2-9d70-785571be3f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:16.508938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465deca-5d2b-4ac2-9d70-785571be3f6f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:16.512858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e826e-3880-4511-b71c-24910d23ff02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:16.513473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e826e-3880-4511-b71c-24910d23ff02 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:16.513816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e826e-3880-4511-b71c-24910d23ff02 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:16.514094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e826e-3880-4511-b71c-24910d23ff02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:16.524195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e826e-3880-4511-b71c-24910d23ff02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:16.525649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e826e-3880-4511-b71c-24910d23ff02 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:16.535293 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1637/3287] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:52:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:52:16.737253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d5def-789d-47be-8698-dbc789a6d5ec None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:16.739600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4a0d5def-789d-47be-8698-dbc789a6d5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:16.760493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d5def-789d-47be-8698-dbc789a6d5ec None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:16.766920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6a185-f8c6-426e-a902-44b870f793f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:16.769850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6a185-f8c6-426e-a902-44b870f793f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:16.770369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6a185-f8c6-426e-a902-44b870f793f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:16.770814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6a185-f8c6-426e-a902-44b870f793f8 admin admin] PATH_INFO: `/v3/projects/185c590c912b41d59af8284d784179a0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:16.772515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6a185-f8c6-426e-a902-44b870f793f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=185c590c912b41d59af8284d784179a0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:16.774780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6a185-f8c6-426e-a902-44b870f793f8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:16.909464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-74e6a185-f8c6-426e-a902-44b870f793f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '185c590c912b41d59af8284d784179a0', 'request_id': 'req-74e6a185-f8c6-426e-a902-44b870f793f8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:16.925135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-74e6a185-f8c6-426e-a902-44b870f793f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '185c590c912b41d59af8284d784179a0', 'request_id': 'req-74e6a185-f8c6-426e-a902-44b870f793f8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:16.941759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-74e6a185-f8c6-426e-a902-44b870f793f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '185c590c912b41d59af8284d784179a0', 'request_id': 'req-74e6a185-f8c6-426e-a902-44b870f793f8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:16.973777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-74e6a185-f8c6-426e-a902-44b870f793f8 admin admin] The token cache is being invalidate because project 185c590c912b41d59af8284d784179a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:52:16.974798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-74e6a185-f8c6-426e-a902-44b870f793f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:16.975734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-74e6a185-f8c6-426e-a902-44b870f793f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:16.978061 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1651/3288] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:52:16 2022] DELETE /identity/v3/projects/185c590c912b41d59af8284d784179a0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:16.983308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186771e-496b-4efb-a656-69f46702ab35 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:16.983621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186771e-496b-4efb-a656-69f46702ab35 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:16.983905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186771e-496b-4efb-a656-69f46702ab35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:17.010763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d186771e-496b-4efb-a656-69f46702ab35 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:17.012008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d186771e-496b-4efb-a656-69f46702ab35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:17.116118 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1638/3289] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:17.126366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ec3dd-2881-4465-8fce-70c52d5de2ac None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:17.128053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ec3dd-2881-4465-8fce-70c52d5de2ac None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:17.128522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ec3dd-2881-4465-8fce-70c52d5de2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:17.160465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c69ec3dd-2881-4465-8fce-70c52d5de2ac None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:17.161815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c69ec3dd-2881-4465-8fce-70c52d5de2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:17.175600 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1652/3290] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:17.181261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186771e-496b-4efb-a656-69f46702ab35 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:17.196807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186771e-496b-4efb-a656-69f46702ab35 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:17.204833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72489af5-b2ba-4f6f-a097-6c2c655553c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:17.205766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72489af5-b2ba-4f6f-a097-6c2c655553c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:17.206269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72489af5-b2ba-4f6f-a097-6c2c655553c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:17.207143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72489af5-b2ba-4f6f-a097-6c2c655553c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:17.207996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72489af5-b2ba-4f6f-a097-6c2c655553c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:52:17.208510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72489af5-b2ba-4f6f-a097-6c2c655553c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:17.219050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72489af5-b2ba-4f6f-a097-6c2c655553c8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:17.237884 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1639/3291] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:17.239227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ec3dd-2881-4465-8fce-70c52d5de2ac None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:17.252921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ec3dd-2881-4465-8fce-70c52d5de2ac None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:17.259554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56ff04-3408-4fc3-81b7-57959d8fcbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:17.261321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56ff04-3408-4fc3-81b7-57959d8fcbcb admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:17.261637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56ff04-3408-4fc3-81b7-57959d8fcbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:17.261964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56ff04-3408-4fc3-81b7-57959d8fcbcb admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:17.265670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56ff04-3408-4fc3-81b7-57959d8fcbcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:17.267874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56ff04-3408-4fc3-81b7-57959d8fcbcb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:17.308918 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1653/3292] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:52:17 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:52:17.309925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72489af5-b2ba-4f6f-a097-6c2c655553c8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:17.317005 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:17.335131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72489af5-b2ba-4f6f-a097-6c2c655553c8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:17.423541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13eeb6-2831-445a-8ef7-3d45a4ebe7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:17.424867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13eeb6-2831-445a-8ef7-3d45a4ebe7ea admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:17.425975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13eeb6-2831-445a-8ef7-3d45a4ebe7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:17.426492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13eeb6-2831-445a-8ef7-3d45a4ebe7ea admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:17.427853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13eeb6-2831-445a-8ef7-3d45a4ebe7ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:17.431088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13eeb6-2831-445a-8ef7-3d45a4ebe7ea admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:17.465306 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1640/3293] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:52:17 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:52:17.469388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56ff04-3408-4fc3-81b7-57959d8fcbcb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:17.486469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56ff04-3408-4fc3-81b7-57959d8fcbcb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:17.500152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517156df-e9a4-4b9a-85e9-723e3e07a4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:17.501311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517156df-e9a4-4b9a-85e9-723e3e07a4fe admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:17.501809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517156df-e9a4-4b9a-85e9-723e3e07a4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:17.502318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517156df-e9a4-4b9a-85e9-723e3e07a4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:17.503198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517156df-e9a4-4b9a-85e9-723e3e07a4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:17.505014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517156df-e9a4-4b9a-85e9-723e3e07a4fe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:17.517504 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1654/3294] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:52:17.521233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13eeb6-2831-445a-8ef7-3d45a4ebe7ea admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:17.535653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13eeb6-2831-445a-8ef7-3d45a4ebe7ea admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:17.543825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e9943-49b2-4a24-9ed1-eb1ee7394df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:17.544450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e9943-49b2-4a24-9ed1-eb1ee7394df1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:17.544782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e9943-49b2-4a24-9ed1-eb1ee7394df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:17.545052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e9943-49b2-4a24-9ed1-eb1ee7394df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:17.546234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e9943-49b2-4a24-9ed1-eb1ee7394df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:17.548706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e9943-49b2-4a24-9ed1-eb1ee7394df1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:17.567160 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1641/3295] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:52:17.577136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517156df-e9a4-4b9a-85e9-723e3e07a4fe admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:17.597993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517156df-e9a4-4b9a-85e9-723e3e07a4fe admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:17.604871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d7cf0-3fc8-4322-8fab-f4e965318b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:17.605519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d7cf0-3fc8-4322-8fab-f4e965318b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:17.605799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d7cf0-3fc8-4322-8fab-f4e965318b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:17.606069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d7cf0-3fc8-4322-8fab-f4e965318b2d admin admin] PATH_INFO: `/v3/projects/556a7c61caaf427da6b5691caacc2de6/users/75c97f1dae6b436b97ae73876f97efbd/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:17.660042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d7cf0-3fc8-4322-8fab-f4e965318b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=556a7c61caaf427da6b5691caacc2de6, user_id=75c97f1dae6b436b97ae73876f97efbd, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:17.665161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d7cf0-3fc8-4322-8fab-f4e965318b2d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:17.687271 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1655/3296] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:52:17 2022] PUT /identity/v3/projects/556a7c61caaf427da6b5691caacc2de6/users/75c97f1dae6b436b97ae73876f97efbd/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:17.697943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e4b01-30d3-45a0-b6d2-30a6a0d4eca5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:17.698366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e4b01-30d3-45a0-b6d2-30a6a0d4eca5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:17.698712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e4b01-30d3-45a0-b6d2-30a6a0d4eca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:17.736172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-204e4b01-30d3-45a0-b6d2-30a6a0d4eca5 None None] MFA Rules not processed for user `75c97f1dae6b436b97ae73876f97efbd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:17.738270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-204e4b01-30d3-45a0-b6d2-30a6a0d4eca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:17.887347 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1642/3297] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:17.929599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d7cf0-3fc8-4322-8fab-f4e965318b2d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:17.931517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d67d7cf0-3fc8-4322-8fab-f4e965318b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:17.981401 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:18.070348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d7cf0-3fc8-4322-8fab-f4e965318b2d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:18.077931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31280f9b-09a1-4cfa-8b25-5c92dd23e19c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:18.078547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31280f9b-09a1-4cfa-8b25-5c92dd23e19c service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:18.078827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31280f9b-09a1-4cfa-8b25-5c92dd23e19c service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:18.079263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31280f9b-09a1-4cfa-8b25-5c92dd23e19c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:18.092362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31280f9b-09a1-4cfa-8b25-5c92dd23e19c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:18.095698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31280f9b-09a1-4cfa-8b25-5c92dd23e19c service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:18.137228 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1656/3298] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:52:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:52:19.548867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e4b01-30d3-45a0-b6d2-30a6a0d4eca5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:19.643192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e4b01-30d3-45a0-b6d2-30a6a0d4eca5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:19.656887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f141ab-08e5-4a5e-9857-ce33f186cbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:19.657541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f141ab-08e5-4a5e-9857-ce33f186cbb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:19.657820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f141ab-08e5-4a5e-9857-ce33f186cbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:19.658226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f141ab-08e5-4a5e-9857-ce33f186cbb9 admin admin] PATH_INFO: `/v3/users/75c97f1dae6b436b97ae73876f97efbd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:19.663313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f141ab-08e5-4a5e-9857-ce33f186cbb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75c97f1dae6b436b97ae73876f97efbd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:19.665207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f141ab-08e5-4a5e-9857-ce33f186cbb9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:19.680201 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:19.740047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f8f141ab-08e5-4a5e-9857-ce33f186cbb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75c97f1dae6b436b97ae73876f97efbd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:19.775462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f8f141ab-08e5-4a5e-9857-ce33f186cbb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75c97f1dae6b436b97ae73876f97efbd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:19.776076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f8f141ab-08e5-4a5e-9857-ce33f186cbb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75c97f1dae6b436b97ae73876f97efbd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:19.794870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f8f141ab-08e5-4a5e-9857-ce33f186cbb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75c97f1dae6b436b97ae73876f97efbd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:19.823198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f8f141ab-08e5-4a5e-9857-ce33f186cbb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75c97f1dae6b436b97ae73876f97efbd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:19.831116 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1643/3299] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:52:19 2022] DELETE /identity/v3/users/75c97f1dae6b436b97ae73876f97efbd => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:19.835751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd776a3-d413-4f8b-86a4-d0ac41cfbaf9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:19.836311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd776a3-d413-4f8b-86a4-d0ac41cfbaf9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:19.836311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd776a3-d413-4f8b-86a4-d0ac41cfbaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:19.860436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-dfd776a3-d413-4f8b-86a4-d0ac41cfbaf9 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:19.862644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dfd776a3-d413-4f8b-86a4-d0ac41cfbaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:19.971507 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1657/3300] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:19.989646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f141ab-08e5-4a5e-9857-ce33f186cbb9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:19.991825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f8f141ab-08e5-4a5e-9857-ce33f186cbb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:20.059685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f141ab-08e5-4a5e-9857-ce33f186cbb9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:20.063930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3f102-cfbe-4e25-8f19-a1a7a3d6c0d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:20.064633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3f102-cfbe-4e25-8f19-a1a7a3d6c0d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:20.064902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3f102-cfbe-4e25-8f19-a1a7a3d6c0d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:20.065202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3f102-cfbe-4e25-8f19-a1a7a3d6c0d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:20.086101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3f102-cfbe-4e25-8f19-a1a7a3d6c0d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:20.087555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3f102-cfbe-4e25-8f19-a1a7a3d6c0d3 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:20.099660 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1644/3301] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:52:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:52:20.814225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd776a3-d413-4f8b-86a4-d0ac41cfbaf9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:20.820663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dfd776a3-d413-4f8b-86a4-d0ac41cfbaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:20.854015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd776a3-d413-4f8b-86a4-d0ac41cfbaf9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:20.872995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2ff1e-3e40-4f2a-a2d1-f6f24f60ef21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:20.873974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2ff1e-3e40-4f2a-a2d1-f6f24f60ef21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:20.874248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2ff1e-3e40-4f2a-a2d1-f6f24f60ef21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:20.874611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2ff1e-3e40-4f2a-a2d1-f6f24f60ef21 admin admin] PATH_INFO: `/v3/projects/556a7c61caaf427da6b5691caacc2de6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:20.878245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2ff1e-3e40-4f2a-a2d1-f6f24f60ef21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=556a7c61caaf427da6b5691caacc2de6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:20.880236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2ff1e-3e40-4f2a-a2d1-f6f24f60ef21 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:20.944769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82c2ff1e-3e40-4f2a-a2d1-f6f24f60ef21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '556a7c61caaf427da6b5691caacc2de6', 'request_id': 'req-82c2ff1e-3e40-4f2a-a2d1-f6f24f60ef21'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:20.957454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82c2ff1e-3e40-4f2a-a2d1-f6f24f60ef21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '556a7c61caaf427da6b5691caacc2de6', 'request_id': 'req-82c2ff1e-3e40-4f2a-a2d1-f6f24f60ef21'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:20.964296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82c2ff1e-3e40-4f2a-a2d1-f6f24f60ef21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '556a7c61caaf427da6b5691caacc2de6', 'request_id': 'req-82c2ff1e-3e40-4f2a-a2d1-f6f24f60ef21'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:21.013472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82c2ff1e-3e40-4f2a-a2d1-f6f24f60ef21 admin admin] The token cache is being invalidate because project 556a7c61caaf427da6b5691caacc2de6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:52:21.017139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82c2ff1e-3e40-4f2a-a2d1-f6f24f60ef21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:21.019644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82c2ff1e-3e40-4f2a-a2d1-f6f24f60ef21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:21.024861 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1658/3302] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:52:20 2022] DELETE /identity/v3/projects/556a7c61caaf427da6b5691caacc2de6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:21.027411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a3429-f2b5-46ba-a94c-01813a40f379 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:21.028238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a3429-f2b5-46ba-a94c-01813a40f379 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:21.028725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a3429-f2b5-46ba-a94c-01813a40f379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:21.033188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2ff1e-3e40-4f2a-a2d1-f6f24f60ef21 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:21.035677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-82c2ff1e-3e40-4f2a-a2d1-f6f24f60ef21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:21.055968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e28a3429-f2b5-46ba-a94c-01813a40f379 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:21.057525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e28a3429-f2b5-46ba-a94c-01813a40f379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:21.147351 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:21.184961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2ff1e-3e40-4f2a-a2d1-f6f24f60ef21 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:21.192162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51148d-213c-4234-8ed2-8142b9890967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:21.192827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51148d-213c-4234-8ed2-8142b9890967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:21.193243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51148d-213c-4234-8ed2-8142b9890967 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:21.193669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51148d-213c-4234-8ed2-8142b9890967 admin admin] PATH_INFO: `/v3/users/7fca17ba092e44f1a37b108778dc7a0d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:21.194828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51148d-213c-4234-8ed2-8142b9890967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fca17ba092e44f1a37b108778dc7a0d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:21.196925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51148d-213c-4234-8ed2-8142b9890967 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:21.214250 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1645/3303] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:21.224259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d166f9f-259b-4bd8-b302-df59cfb4b437 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:21.224786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d166f9f-259b-4bd8-b302-df59cfb4b437 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:21.225522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d166f9f-259b-4bd8-b302-df59cfb4b437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:21.277856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1d166f9f-259b-4bd8-b302-df59cfb4b437 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:21.279512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1d166f9f-259b-4bd8-b302-df59cfb4b437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:21.289533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6c51148d-213c-4234-8ed2-8142b9890967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fca17ba092e44f1a37b108778dc7a0d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:21.289721 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1646/3304] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:21.290369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6c51148d-213c-4234-8ed2-8142b9890967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fca17ba092e44f1a37b108778dc7a0d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:21.293808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d166f9f-259b-4bd8-b302-df59cfb4b437 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:21.302959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6c51148d-213c-4234-8ed2-8142b9890967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fca17ba092e44f1a37b108778dc7a0d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:21.314847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d166f9f-259b-4bd8-b302-df59cfb4b437 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:21.322186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000282e-fd9f-4d70-b415-09d5951a6f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:21.323066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000282e-fd9f-4d70-b415-09d5951a6f7e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:21.323409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000282e-fd9f-4d70-b415-09d5951a6f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:21.323743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000282e-fd9f-4d70-b415-09d5951a6f7e admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:21.324465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000282e-fd9f-4d70-b415-09d5951a6f7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:52:21.325111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000282e-fd9f-4d70-b415-09d5951a6f7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:21.327419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000282e-fd9f-4d70-b415-09d5951a6f7e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:21.340008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6c51148d-213c-4234-8ed2-8142b9890967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fca17ba092e44f1a37b108778dc7a0d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:21.345555 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1647/3305] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:52:21.351946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6c51148d-213c-4234-8ed2-8142b9890967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fca17ba092e44f1a37b108778dc7a0d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:21.353343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000282e-fd9f-4d70-b415-09d5951a6f7e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:21.355224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3000282e-fd9f-4d70-b415-09d5951a6f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:21.364388 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1659/3306] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:52:21 2022] DELETE /identity/v3/users/7fca17ba092e44f1a37b108778dc7a0d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:52:21.369925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000282e-fd9f-4d70-b415-09d5951a6f7e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:21.380925 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:21.448567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5b86c-f4b8-4e41-adfe-19bf08bd85fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:21.452825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5b86c-f4b8-4e41-adfe-19bf08bd85fd admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:21.452825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5b86c-f4b8-4e41-adfe-19bf08bd85fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:21.452825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5b86c-f4b8-4e41-adfe-19bf08bd85fd admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:21.452825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5b86c-f4b8-4e41-adfe-19bf08bd85fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:21.453549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5b86c-f4b8-4e41-adfe-19bf08bd85fd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:21.521314 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1648/3307] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:52:21 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:52:21.524990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51148d-213c-4234-8ed2-8142b9890967 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:21.537170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51148d-213c-4234-8ed2-8142b9890967 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:21.610817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bd06a-053d-4408-bf4b-315f3c324b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:21.611573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bd06a-053d-4408-bf4b-315f3c324b0a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:21.611858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bd06a-053d-4408-bf4b-315f3c324b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:21.612130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bd06a-053d-4408-bf4b-315f3c324b0a admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:21.612805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bd06a-053d-4408-bf4b-315f3c324b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:21.614746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bd06a-053d-4408-bf4b-315f3c324b0a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:21.651955 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1660/3308] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:52:21 2022] POST /identity/v3/users => generated 291 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:52:21.653556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5b86c-f4b8-4e41-adfe-19bf08bd85fd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:21.664801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5b86c-f4b8-4e41-adfe-19bf08bd85fd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:21.681774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb8d82-33b5-477b-8614-e5d1425a45be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:21.692260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb8d82-33b5-477b-8614-e5d1425a45be admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:21.692955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb8d82-33b5-477b-8614-e5d1425a45be admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:21.693632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb8d82-33b5-477b-8614-e5d1425a45be admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:21.694337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb8d82-33b5-477b-8614-e5d1425a45be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:21.696407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb8d82-33b5-477b-8614-e5d1425a45be admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:21.726105 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1649/3309] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:52:21.729918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bd06a-053d-4408-bf4b-315f3c324b0a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:21.742215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bd06a-053d-4408-bf4b-315f3c324b0a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:21.748192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac38a2-308f-4af9-ab60-767f710b96bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:21.752215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac38a2-308f-4af9-ab60-767f710b96bb admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:21.752215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac38a2-308f-4af9-ab60-767f710b96bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:21.752215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac38a2-308f-4af9-ab60-767f710b96bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:21.752215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac38a2-308f-4af9-ab60-767f710b96bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:21.753775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb8d82-33b5-477b-8614-e5d1425a45be admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:21.756303 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5fdb8d82-33b5-477b-8614-e5d1425a45be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:21.757252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac38a2-308f-4af9-ab60-767f710b96bb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:21.773870 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1661/3310] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:52:21.777724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb8d82-33b5-477b-8614-e5d1425a45be admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:21.779824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac38a2-308f-4af9-ab60-767f710b96bb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:21.784399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdddf3-0601-4477-ac30-2aaeb9b5d803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:21.785237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdddf3-0601-4477-ac30-2aaeb9b5d803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:21.785584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdddf3-0601-4477-ac30-2aaeb9b5d803 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:21.785944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdddf3-0601-4477-ac30-2aaeb9b5d803 admin admin] PATH_INFO: `/v3/projects/c3c7a238cf594e1d8e3812fa3fc49259` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:21.787258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdddf3-0601-4477-ac30-2aaeb9b5d803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c7a238cf594e1d8e3812fa3fc49259)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:21.789517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdddf3-0601-4477-ac30-2aaeb9b5d803 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:21.793430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac38a2-308f-4af9-ab60-767f710b96bb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:21.799326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8907c-e4e9-41ed-a3ba-d8803133d479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:21.800139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8907c-e4e9-41ed-a3ba-d8803133d479 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:21.800419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8907c-e4e9-41ed-a3ba-d8803133d479 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:21.800723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8907c-e4e9-41ed-a3ba-d8803133d479 admin admin] PATH_INFO: `/v3/projects/d860a42bb7804eff89447661d4150383/users/c26f9d3b86a0437099ccab2a856e6238/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:21.818773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8907c-e4e9-41ed-a3ba-d8803133d479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d860a42bb7804eff89447661d4150383, user_id=c26f9d3b86a0437099ccab2a856e6238, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:21.821869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8907c-e4e9-41ed-a3ba-d8803133d479 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:21.841271 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1662/3311] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:52:21 2022] PUT /identity/v3/projects/d860a42bb7804eff89447661d4150383/users/c26f9d3b86a0437099ccab2a856e6238/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:21.843433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720637b-cf58-43b3-b83e-1a14f3c32af6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:21.843724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720637b-cf58-43b3-b83e-1a14f3c32af6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:21.844515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720637b-cf58-43b3-b83e-1a14f3c32af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:21.854268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0bdddf3-0601-4477-ac30-2aaeb9b5d803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c7a238cf594e1d8e3812fa3fc49259', 'request_id': 'req-e0bdddf3-0601-4477-ac30-2aaeb9b5d803'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:21.875002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0bdddf3-0601-4477-ac30-2aaeb9b5d803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c7a238cf594e1d8e3812fa3fc49259', 'request_id': 'req-e0bdddf3-0601-4477-ac30-2aaeb9b5d803'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:21.875800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d720637b-cf58-43b3-b83e-1a14f3c32af6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:21.877199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d720637b-cf58-43b3-b83e-1a14f3c32af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:21.882271 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:21.885881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0bdddf3-0601-4477-ac30-2aaeb9b5d803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c7a238cf594e1d8e3812fa3fc49259', 'request_id': 'req-e0bdddf3-0601-4477-ac30-2aaeb9b5d803'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:21.909564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0bdddf3-0601-4477-ac30-2aaeb9b5d803 admin admin] The token cache is being invalidate because project c3c7a238cf594e1d8e3812fa3fc49259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:52:21.910520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0bdddf3-0601-4477-ac30-2aaeb9b5d803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:21.912744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0bdddf3-0601-4477-ac30-2aaeb9b5d803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:21.915524 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1650/3312] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:52:21 2022] DELETE /identity/v3/projects/c3c7a238cf594e1d8e3812fa3fc49259 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:21.919507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdddf3-0601-4477-ac30-2aaeb9b5d803 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:21.930064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e0bdddf3-0601-4477-ac30-2aaeb9b5d803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:21.971410 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1663/3313] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:21.981280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720637b-cf58-43b3-b83e-1a14f3c32af6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:21.984022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d720637b-cf58-43b3-b83e-1a14f3c32af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:22.055747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdddf3-0601-4477-ac30-2aaeb9b5d803 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:22.061806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076528f-9bd1-4b20-a8e4-0a218ac05855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:22.062451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076528f-9bd1-4b20-a8e4-0a218ac05855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:22.062727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076528f-9bd1-4b20-a8e4-0a218ac05855 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:22.063162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076528f-9bd1-4b20-a8e4-0a218ac05855 admin admin] PATH_INFO: `/v3/users/5856ac6dc0f844489e69cc75104a62df` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:22.064564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076528f-9bd1-4b20-a8e4-0a218ac05855 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5856ac6dc0f844489e69cc75104a62df)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:22.068089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076528f-9bd1-4b20-a8e4-0a218ac05855 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:22.070778 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:22.088379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720637b-cf58-43b3-b83e-1a14f3c32af6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:22.104178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdbfcc-cb78-4e0b-95c5-37537ade2c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:22.104816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdbfcc-cb78-4e0b-95c5-37537ade2c5c service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:22.105098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdbfcc-cb78-4e0b-95c5-37537ade2c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:22.105370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdbfcc-cb78-4e0b-95c5-37537ade2c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:22.122287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdbfcc-cb78-4e0b-95c5-37537ade2c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:22.123904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdbfcc-cb78-4e0b-95c5-37537ade2c5c service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:22.136020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f076528f-9bd1-4b20-a8e4-0a218ac05855 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5856ac6dc0f844489e69cc75104a62df'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:22.137330 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1664/3314] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:52:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:52:22.147237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f076528f-9bd1-4b20-a8e4-0a218ac05855 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5856ac6dc0f844489e69cc75104a62df'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:22.148210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f076528f-9bd1-4b20-a8e4-0a218ac05855 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5856ac6dc0f844489e69cc75104a62df'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:22.170832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f076528f-9bd1-4b20-a8e4-0a218ac05855 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5856ac6dc0f844489e69cc75104a62df'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:22.180759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f076528f-9bd1-4b20-a8e4-0a218ac05855 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5856ac6dc0f844489e69cc75104a62df'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:22.192254 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1651/3315] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:52:21 2022] DELETE /identity/v3/users/5856ac6dc0f844489e69cc75104a62df => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:22.525488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdbfcc-cb78-4e0b-95c5-37537ade2c5c service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:22.538799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdbfcc-cb78-4e0b-95c5-37537ade2c5c service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:22.620968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca318180-e1a5-42ad-a8c6-96877f56f3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:22.621318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca318180-e1a5-42ad-a8c6-96877f56f3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:22.621598 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca318180-e1a5-42ad-a8c6-96877f56f3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:22.621876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca318180-e1a5-42ad-a8c6-96877f56f3f2 admin admin] PATH_INFO: `/v3/projects/c94313db12764911b03cce95cbb3ec48` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:22.623192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca318180-e1a5-42ad-a8c6-96877f56f3f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c94313db12764911b03cce95cbb3ec48)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:22.626212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca318180-e1a5-42ad-a8c6-96877f56f3f2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:22.700662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ca318180-e1a5-42ad-a8c6-96877f56f3f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c94313db12764911b03cce95cbb3ec48', 'request_id': 'req-ca318180-e1a5-42ad-a8c6-96877f56f3f2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:22.706185 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:22.709439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ca318180-e1a5-42ad-a8c6-96877f56f3f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c94313db12764911b03cce95cbb3ec48', 'request_id': 'req-ca318180-e1a5-42ad-a8c6-96877f56f3f2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:22.717178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ca318180-e1a5-42ad-a8c6-96877f56f3f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c94313db12764911b03cce95cbb3ec48', 'request_id': 'req-ca318180-e1a5-42ad-a8c6-96877f56f3f2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:22.730687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ca318180-e1a5-42ad-a8c6-96877f56f3f2 admin admin] The token cache is being invalidate because project c94313db12764911b03cce95cbb3ec48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:52:22.730974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ca318180-e1a5-42ad-a8c6-96877f56f3f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:22.731628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ca318180-e1a5-42ad-a8c6-96877f56f3f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:22.733791 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1665/3316] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:52:22 2022] DELETE /identity/v3/projects/c94313db12764911b03cce95cbb3ec48 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:22.740395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7a6f7-c133-4cfb-b339-06f52b6e5e6f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:22.740749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7a6f7-c133-4cfb-b339-06f52b6e5e6f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:22.741058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7a6f7-c133-4cfb-b339-06f52b6e5e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:22.763213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f4d7a6f7-c133-4cfb-b339-06f52b6e5e6f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:22.764429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f4d7a6f7-c133-4cfb-b339-06f52b6e5e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:22.842212 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1652/3317] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:52:22.849913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfc37b-bf52-4990-9a61-8e45fcb28f8d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:22.850199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfc37b-bf52-4990-9a61-8e45fcb28f8d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:22.850470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfc37b-bf52-4990-9a61-8e45fcb28f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:22.871727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b4dfc37b-bf52-4990-9a61-8e45fcb28f8d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:22.872975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b4dfc37b-bf52-4990-9a61-8e45fcb28f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:22.881713 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1666/3318] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:22.886109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7a6f7-c133-4cfb-b339-06f52b6e5e6f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:22.895955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7a6f7-c133-4cfb-b339-06f52b6e5e6f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:22.901544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f25af-2516-43ef-9889-139a39d712ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:22.902162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f25af-2516-43ef-9889-139a39d712ee admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:22.902443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f25af-2516-43ef-9889-139a39d712ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:22.902714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f25af-2516-43ef-9889-139a39d712ee admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:22.903388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f25af-2516-43ef-9889-139a39d712ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:52:22.903677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f25af-2516-43ef-9889-139a39d712ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:22.906084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f25af-2516-43ef-9889-139a39d712ee admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:22.925333 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1653/3319] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:22.930033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfc37b-bf52-4990-9a61-8e45fcb28f8d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:22.942662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfc37b-bf52-4990-9a61-8e45fcb28f8d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:22.948261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015a10b-db9d-4ed6-8c44-995404b02aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:22.949038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015a10b-db9d-4ed6-8c44-995404b02aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:22.949587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015a10b-db9d-4ed6-8c44-995404b02aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:22.950267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015a10b-db9d-4ed6-8c44-995404b02aa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:22.951229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015a10b-db9d-4ed6-8c44-995404b02aa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:22.953497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015a10b-db9d-4ed6-8c44-995404b02aa3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:22.988053 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1667/3320] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:52:22 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:52:22.992713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f25af-2516-43ef-9889-139a39d712ee admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:23.009194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f25af-2516-43ef-9889-139a39d712ee admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:23.081256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9c187-050b-4f8f-aa79-34a8e79da808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:23.081915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9c187-050b-4f8f-aa79-34a8e79da808 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:23.082158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9c187-050b-4f8f-aa79-34a8e79da808 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:23.082431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9c187-050b-4f8f-aa79-34a8e79da808 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:23.083081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9c187-050b-4f8f-aa79-34a8e79da808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:23.085109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9c187-050b-4f8f-aa79-34a8e79da808 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:23.107537 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:23.118087 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1654/3321] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:52:22 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:52:23.121727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015a10b-db9d-4ed6-8c44-995404b02aa3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:23.135150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015a10b-db9d-4ed6-8c44-995404b02aa3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:23.141577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8a546-3d76-4c24-9a6d-11a284e3703d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:23.142499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8a546-3d76-4c24-9a6d-11a284e3703d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:23.142960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8a546-3d76-4c24-9a6d-11a284e3703d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:23.143501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8a546-3d76-4c24-9a6d-11a284e3703d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:23.144306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8a546-3d76-4c24-9a6d-11a284e3703d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:23.146128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8a546-3d76-4c24-9a6d-11a284e3703d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:23.164014 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1668/3322] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:52:23.164854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9c187-050b-4f8f-aa79-34a8e79da808 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:23.178069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9c187-050b-4f8f-aa79-34a8e79da808 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:23.183246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bde68e-737f-45de-adfe-c7aea19b9e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:23.184154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bde68e-737f-45de-adfe-c7aea19b9e8b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:23.184436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bde68e-737f-45de-adfe-c7aea19b9e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:23.184788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bde68e-737f-45de-adfe-c7aea19b9e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:23.185661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bde68e-737f-45de-adfe-c7aea19b9e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:23.188577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bde68e-737f-45de-adfe-c7aea19b9e8b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:23.203153 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1655/3323] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:52:23.207412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8a546-3d76-4c24-9a6d-11a284e3703d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:23.219162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8a546-3d76-4c24-9a6d-11a284e3703d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:23.225453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c10b11-da88-4d57-a62b-34386bf3d206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:23.226477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c10b11-da88-4d57-a62b-34386bf3d206 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:23.226906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c10b11-da88-4d57-a62b-34386bf3d206 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:23.227339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c10b11-da88-4d57-a62b-34386bf3d206 admin admin] PATH_INFO: `/v3/projects/db58bb49625c4fa5b3f620972b18eb4d/users/192c98ff437a4728b7421333f20f46b1/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:23.246777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c10b11-da88-4d57-a62b-34386bf3d206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db58bb49625c4fa5b3f620972b18eb4d, user_id=192c98ff437a4728b7421333f20f46b1, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:23.249619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c10b11-da88-4d57-a62b-34386bf3d206 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:23.297405 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1669/3324] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:52:23 2022] PUT /identity/v3/projects/db58bb49625c4fa5b3f620972b18eb4d/users/192c98ff437a4728b7421333f20f46b1/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:23.299164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56883bab-f964-400c-9d47-6708ed69e450 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:23.299693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56883bab-f964-400c-9d47-6708ed69e450 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:23.300228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56883bab-f964-400c-9d47-6708ed69e450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:23.339916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-56883bab-f964-400c-9d47-6708ed69e450 None None] MFA Rules not processed for user `192c98ff437a4728b7421333f20f46b1`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:23.341338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-56883bab-f964-400c-9d47-6708ed69e450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:23.418255 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1656/3325] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:52:23.422644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c10b11-da88-4d57-a62b-34386bf3d206 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:23.502455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c10b11-da88-4d57-a62b-34386bf3d206 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:23.508739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc798c-07c5-4fa5-b1bb-f2e491efb9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:23.509256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc798c-07c5-4fa5-b1bb-f2e491efb9ae admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:23.509513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc798c-07c5-4fa5-b1bb-f2e491efb9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:23.509786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc798c-07c5-4fa5-b1bb-f2e491efb9ae admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:23.510986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc798c-07c5-4fa5-b1bb-f2e491efb9ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:23.513196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc798c-07c5-4fa5-b1bb-f2e491efb9ae admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:23.549605 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1670/3326] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:52:23 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:52:23.553851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56883bab-f964-400c-9d47-6708ed69e450 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:23.568244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56883bab-f964-400c-9d47-6708ed69e450 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:23.649982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f9125-263e-40ca-9fac-affd35c5703f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:23.650277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f9125-263e-40ca-9fac-affd35c5703f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:23.650656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f9125-263e-40ca-9fac-affd35c5703f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:23.651023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f9125-263e-40ca-9fac-affd35c5703f admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:23.651768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f9125-263e-40ca-9fac-affd35c5703f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:23.654450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f9125-263e-40ca-9fac-affd35c5703f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:23.683777 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1657/3327] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:52:23 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:52:23.687745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc798c-07c5-4fa5-b1bb-f2e491efb9ae admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:23.699282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc798c-07c5-4fa5-b1bb-f2e491efb9ae admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:23.705393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457780e-9c7e-4d07-bc8a-13082d09eaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:23.706103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457780e-9c7e-4d07-bc8a-13082d09eaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:23.706453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457780e-9c7e-4d07-bc8a-13082d09eaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:23.707350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457780e-9c7e-4d07-bc8a-13082d09eaa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:23.707464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457780e-9c7e-4d07-bc8a-13082d09eaa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:23.709342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457780e-9c7e-4d07-bc8a-13082d09eaa7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:23.722902 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1671/3328] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:52:23.727292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f9125-263e-40ca-9fac-affd35c5703f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:23.740544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f9125-263e-40ca-9fac-affd35c5703f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:23.746522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff471f2-c415-4478-bbe7-4e52b2686c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:23.747130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff471f2-c415-4478-bbe7-4e52b2686c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:23.747478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff471f2-c415-4478-bbe7-4e52b2686c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:23.747824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff471f2-c415-4478-bbe7-4e52b2686c4f admin admin] PATH_INFO: `/v3/projects/c37954edda5c45dabb16724cb56a162d/users/c72b228b4f1948c69e676634528babaf/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:23.770232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff471f2-c415-4478-bbe7-4e52b2686c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c37954edda5c45dabb16724cb56a162d, user_id=c72b228b4f1948c69e676634528babaf, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:23.774445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff471f2-c415-4478-bbe7-4e52b2686c4f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:23.808139 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1658/3329] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:52:23 2022] PUT /identity/v3/projects/c37954edda5c45dabb16724cb56a162d/users/c72b228b4f1948c69e676634528babaf/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:52:23.813111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457780e-9c7e-4d07-bc8a-13082d09eaa7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:23.828417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457780e-9c7e-4d07-bc8a-13082d09eaa7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:23.907358 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:23.938262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac038c52-11ac-4211-88d0-da5ad1acd03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:23.941097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac038c52-11ac-4211-88d0-da5ad1acd03d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:23.941398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac038c52-11ac-4211-88d0-da5ad1acd03d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:23.941676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac038c52-11ac-4211-88d0-da5ad1acd03d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:23.943018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac038c52-11ac-4211-88d0-da5ad1acd03d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:23.949653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac038c52-11ac-4211-88d0-da5ad1acd03d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:23.964651 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1672/3330] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:52:23.967286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff471f2-c415-4478-bbe7-4e52b2686c4f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:23.980705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff471f2-c415-4478-bbe7-4e52b2686c4f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:23.986750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b7018-d274-4870-ae06-1c0de76bd168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:23.987388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b7018-d274-4870-ae06-1c0de76bd168 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:23.987673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b7018-d274-4870-ae06-1c0de76bd168 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:23.991127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b7018-d274-4870-ae06-1c0de76bd168 admin admin] PATH_INFO: `/v3/projects/c37954edda5c45dabb16724cb56a162d/users/c72b228b4f1948c69e676634528babaf/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:23.992796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b7018-d274-4870-ae06-1c0de76bd168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c37954edda5c45dabb16724cb56a162d, user_id=c72b228b4f1948c69e676634528babaf, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:23.995709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b7018-d274-4870-ae06-1c0de76bd168 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:24.012670 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1659/3331] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:52:23 2022] PUT /identity/v3/projects/c37954edda5c45dabb16724cb56a162d/users/c72b228b4f1948c69e676634528babaf/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:24.020835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a0f46-c0fa-4103-bd33-481a31bb1c93 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:24.021195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a0f46-c0fa-4103-bd33-481a31bb1c93 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:24.021563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a0f46-c0fa-4103-bd33-481a31bb1c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:24.069891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d19a0f46-c0fa-4103-bd33-481a31bb1c93 None None] MFA Rules not processed for user `c72b228b4f1948c69e676634528babaf`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:24.072018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d19a0f46-c0fa-4103-bd33-481a31bb1c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:24.162552 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1673/3332] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:24.169308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b7018-d274-4870-ae06-1c0de76bd168 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:24.182813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b7018-d274-4870-ae06-1c0de76bd168 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:24.188999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ba072-c2c0-460f-b2f8-8aa780f7723f tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72b228b4f1948c69e676634528babaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37954edda5c45dabb16724cb56a162d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:24.189787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ba072-c2c0-460f-b2f8-8aa780f7723f tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:24.190176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ba072-c2c0-460f-b2f8-8aa780f7723f tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:24.190595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ba072-c2c0-460f-b2f8-8aa780f7723f tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:24.191356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ba072-c2c0-460f-b2f8-8aa780f7723f tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:52:24.191725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ba072-c2c0-460f-b2f8-8aa780f7723f tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:24.193548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ba072-c2c0-460f-b2f8-8aa780f7723f tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:24.207387 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1660/3333] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:52:24.211473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a0f46-c0fa-4103-bd33-481a31bb1c93 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:24.222461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a0f46-c0fa-4103-bd33-481a31bb1c93 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:24.230160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06277ce2-825a-4c63-97ad-838b53ea5023 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72b228b4f1948c69e676634528babaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37954edda5c45dabb16724cb56a162d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:24.231026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06277ce2-825a-4c63-97ad-838b53ea5023 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:24.231418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06277ce2-825a-4c63-97ad-838b53ea5023 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:24.231762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06277ce2-825a-4c63-97ad-838b53ea5023 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:24.233509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06277ce2-825a-4c63-97ad-838b53ea5023 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:24.235715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06277ce2-825a-4c63-97ad-838b53ea5023 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:24.270798 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1674/3334] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:52:24 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:52:24.274956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ba072-c2c0-460f-b2f8-8aa780f7723f tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:24.289391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ba072-c2c0-460f-b2f8-8aa780f7723f tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:24.315205 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:24.388442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6643567-1c58-4f5d-ae67-fb51d3a06b29 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72b228b4f1948c69e676634528babaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37954edda5c45dabb16724cb56a162d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:24.389700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6643567-1c58-4f5d-ae67-fb51d3a06b29 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:24.390016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6643567-1c58-4f5d-ae67-fb51d3a06b29 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:24.390410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6643567-1c58-4f5d-ae67-fb51d3a06b29 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:24.391085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6643567-1c58-4f5d-ae67-fb51d3a06b29 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:52:24.391394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6643567-1c58-4f5d-ae67-fb51d3a06b29 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:24.393175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6643567-1c58-4f5d-ae67-fb51d3a06b29 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:24.405939 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1661/3335] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:24.417489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06277ce2-825a-4c63-97ad-838b53ea5023 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:24.419240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-06277ce2-825a-4c63-97ad-838b53ea5023 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:24.568221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06277ce2-825a-4c63-97ad-838b53ea5023 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:24.574837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba4be9-2eb4-4f0c-a6d5-26b3f1b55372 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:24.575683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba4be9-2eb4-4f0c-a6d5-26b3f1b55372 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:24.575957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba4be9-2eb4-4f0c-a6d5-26b3f1b55372 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:24.576223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba4be9-2eb4-4f0c-a6d5-26b3f1b55372 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:24.593001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba4be9-2eb4-4f0c-a6d5-26b3f1b55372 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:24.594644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba4be9-2eb4-4f0c-a6d5-26b3f1b55372 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:24.625096 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1675/3336] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:52:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:52:24.630702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50418695-0ef1-44d0-a710-be61205a643b None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:24.630986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50418695-0ef1-44d0-a710-be61205a643b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:24.631256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50418695-0ef1-44d0-a710-be61205a643b None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:24.633277 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1662/3337] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:52:24.638369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba4be9-2eb4-4f0c-a6d5-26b3f1b55372 service nova] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:52:24.650935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba4be9-2eb4-4f0c-a6d5-26b3f1b55372 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:24.662743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba4be9-2eb4-4f0c-a6d5-26b3f1b55372 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:24.671045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a59e88-008c-40f8-b16d-25436d58f5b9 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72b228b4f1948c69e676634528babaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37954edda5c45dabb16724cb56a162d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:24.671885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a59e88-008c-40f8-b16d-25436d58f5b9 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:24.672165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a59e88-008c-40f8-b16d-25436d58f5b9 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:24.672426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a59e88-008c-40f8-b16d-25436d58f5b9 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] PATH_INFO: `/v3/projects/140d44aa00354f19b7d726b0e0d956a8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:24.673684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a59e88-008c-40f8-b16d-25436d58f5b9 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorizing `identity:get_project(project_id=140d44aa00354f19b7d726b0e0d956a8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:24.676019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a59e88-008c-40f8-b16d-25436d58f5b9 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:24.677971 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1676/3338] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:52:24 2022] GET /identity/v3/projects/140d44aa00354f19b7d726b0e0d956a8 => generated 369 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:24.727550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727564-eea3-4f5a-bf42-27b0ccf134d8 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:24.727855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727564-eea3-4f5a-bf42-27b0ccf134d8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:24.729890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727564-eea3-4f5a-bf42-27b0ccf134d8 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:24.729890 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1663/3339] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:52:24.734976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a59e88-008c-40f8-b16d-25436d58f5b9 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:52:24.736995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e5a59e88-008c-40f8-b16d-25436d58f5b9 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:24.757106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a59e88-008c-40f8-b16d-25436d58f5b9 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:24.768520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a59e88-008c-40f8-b16d-25436d58f5b9 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:24.773700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676a3b6-8d94-45f5-8ee1-33343c0480ce tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72b228b4f1948c69e676634528babaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37954edda5c45dabb16724cb56a162d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:24.774483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676a3b6-8d94-45f5-8ee1-33343c0480ce tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:24.774770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676a3b6-8d94-45f5-8ee1-33343c0480ce tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:24.775038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676a3b6-8d94-45f5-8ee1-33343c0480ce tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] PATH_INFO: `/v3/projects/140d44aa00354f19b7d726b0e0d956a8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:24.776422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676a3b6-8d94-45f5-8ee1-33343c0480ce tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorizing `identity:get_project(project_id=140d44aa00354f19b7d726b0e0d956a8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:24.778494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676a3b6-8d94-45f5-8ee1-33343c0480ce tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:24.780515 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1677/3340] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:52:24 2022] GET /identity/v3/projects/140d44aa00354f19b7d726b0e0d956a8 => generated 369 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:24.895580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9727564-eea3-4f5a-bf42-27b0ccf134d8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:24.897926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b9727564-eea3-4f5a-bf42-27b0ccf134d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:24.967117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9727564-eea3-4f5a-bf42-27b0ccf134d8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:24.971922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa0868-ba11-47e2-a642-3c58ae3f668d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:24.972694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa0868-ba11-47e2-a642-3c58ae3f668d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:24.973033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa0868-ba11-47e2-a642-3c58ae3f668d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:24.973363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa0868-ba11-47e2-a642-3c58ae3f668d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:24.975897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e9fa0868-ba11-47e2-a642-3c58ae3f668d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:24.997041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa0868-ba11-47e2-a642-3c58ae3f668d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:24.998523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa0868-ba11-47e2-a642-3c58ae3f668d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:25.011939 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1664/3341] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:52:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:52:25.363263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fe302-2287-4965-9147-04fe446bff6c None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:25.363715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fe302-2287-4965-9147-04fe446bff6c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:25.363805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fe302-2287-4965-9147-04fe446bff6c None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:25.365402 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1678/3342] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:52:25.370982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa0868-ba11-47e2-a642-3c58ae3f668d service neutron] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:52:25.384747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa0868-ba11-47e2-a642-3c58ae3f668d service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:25.401193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa0868-ba11-47e2-a642-3c58ae3f668d service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:25.407447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c8978-32e1-4a09-9b72-4c6dcd31f069 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72b228b4f1948c69e676634528babaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37954edda5c45dabb16724cb56a162d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:25.408184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c8978-32e1-4a09-9b72-4c6dcd31f069 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:25.408561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c8978-32e1-4a09-9b72-4c6dcd31f069 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:25.408997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c8978-32e1-4a09-9b72-4c6dcd31f069 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] PATH_INFO: `/v3/projects/140d44aa00354f19b7d726b0e0d956a8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:25.410513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c8978-32e1-4a09-9b72-4c6dcd31f069 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorizing `identity:get_project(project_id=140d44aa00354f19b7d726b0e0d956a8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:25.413457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c8978-32e1-4a09-9b72-4c6dcd31f069 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:25.427520 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1665/3343] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:52:25 2022] GET /identity/v3/projects/140d44aa00354f19b7d726b0e0d956a8 => generated 369 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:25.450813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fe302-2287-4965-9147-04fe446bff6c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:25.465659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fe302-2287-4965-9147-04fe446bff6c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:25.471834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74970f5d-1841-4b5f-9e05-4a9b9b4a44ef tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72b228b4f1948c69e676634528babaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37954edda5c45dabb16724cb56a162d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:25.472512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74970f5d-1841-4b5f-9e05-4a9b9b4a44ef tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:25.474689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74970f5d-1841-4b5f-9e05-4a9b9b4a44ef tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:25.474689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74970f5d-1841-4b5f-9e05-4a9b9b4a44ef tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] PATH_INFO: `/v3/projects/140d44aa00354f19b7d726b0e0d956a8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:25.474689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74970f5d-1841-4b5f-9e05-4a9b9b4a44ef tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorizing `identity:delete_project(project_id=140d44aa00354f19b7d726b0e0d956a8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:25.476108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74970f5d-1841-4b5f-9e05-4a9b9b4a44ef tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:25.497857 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:25.534364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-74970f5d-1841-4b5f-9e05-4a9b9b4a44ef tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '140d44aa00354f19b7d726b0e0d956a8', 'request_id': 'req-74970f5d-1841-4b5f-9e05-4a9b9b4a44ef'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:25.545120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-74970f5d-1841-4b5f-9e05-4a9b9b4a44ef tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '140d44aa00354f19b7d726b0e0d956a8', 'request_id': 'req-74970f5d-1841-4b5f-9e05-4a9b9b4a44ef'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:25.555594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-74970f5d-1841-4b5f-9e05-4a9b9b4a44ef tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '140d44aa00354f19b7d726b0e0d956a8', 'request_id': 'req-74970f5d-1841-4b5f-9e05-4a9b9b4a44ef'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:25.569681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-74970f5d-1841-4b5f-9e05-4a9b9b4a44ef tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] The token cache is being invalidate because project 140d44aa00354f19b7d726b0e0d956a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:52:25.570191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-74970f5d-1841-4b5f-9e05-4a9b9b4a44ef tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:25.570871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-74970f5d-1841-4b5f-9e05-4a9b9b4a44ef tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:25.572477 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1679/3344] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:52:25 2022] DELETE /identity/v3/projects/140d44aa00354f19b7d726b0e0d956a8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:25.597339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e099079-37f1-432c-9567-9d3819aa9190 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:25.597727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e099079-37f1-432c-9567-9d3819aa9190 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:25.598208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e099079-37f1-432c-9567-9d3819aa9190 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:25.599753 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1666/3345] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:52:25.605515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74970f5d-1841-4b5f-9e05-4a9b9b4a44ef tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:52:25.613458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-74970f5d-1841-4b5f-9e05-4a9b9b4a44ef tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:25.746300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07f5e3-057a-4782-a9a8-a7de36b4b195 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:25.746564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07f5e3-057a-4782-a9a8-a7de36b4b195 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:25.746840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07f5e3-057a-4782-a9a8-a7de36b4b195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:25.787924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74970f5d-1841-4b5f-9e05-4a9b9b4a44ef tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:25.788254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5b07f5e3-057a-4782-a9a8-a7de36b4b195 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:25.789457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-74970f5d-1841-4b5f-9e05-4a9b9b4a44ef tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:25.789580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5b07f5e3-057a-4782-a9a8-a7de36b4b195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:25.861383 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1667/3346] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:52:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:52:25.871041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74970f5d-1841-4b5f-9e05-4a9b9b4a44ef tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:25.877318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07f5e3-057a-4782-a9a8-a7de36b4b195 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:25.878036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de000ea3-1031-4dd7-8950-e02fff567e7b tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72b228b4f1948c69e676634528babaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37954edda5c45dabb16724cb56a162d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:25.878616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de000ea3-1031-4dd7-8950-e02fff567e7b tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:25.878932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de000ea3-1031-4dd7-8950-e02fff567e7b tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:25.880002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de000ea3-1031-4dd7-8950-e02fff567e7b tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] PATH_INFO: `/v3/projects/db58bb49625c4fa5b3f620972b18eb4d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:25.881132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5b07f5e3-057a-4782-a9a8-a7de36b4b195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:25.881243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de000ea3-1031-4dd7-8950-e02fff567e7b tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorizing `identity:get_project(project_id=db58bb49625c4fa5b3f620972b18eb4d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:25.884489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de000ea3-1031-4dd7-8950-e02fff567e7b tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:25.888338 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1680/3347] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:52:25 2022] GET /identity/v3/projects/db58bb49625c4fa5b3f620972b18eb4d => generated 373 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:25.911005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de000ea3-1031-4dd7-8950-e02fff567e7b tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:25.921366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de000ea3-1031-4dd7-8950-e02fff567e7b tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:25.926498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f885d6e-fa18-423b-b0d7-e90314fdf982 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72b228b4f1948c69e676634528babaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37954edda5c45dabb16724cb56a162d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:25.927917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f885d6e-fa18-423b-b0d7-e90314fdf982 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:25.927917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f885d6e-fa18-423b-b0d7-e90314fdf982 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:25.927917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f885d6e-fa18-423b-b0d7-e90314fdf982 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:25.928289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f885d6e-fa18-423b-b0d7-e90314fdf982 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:52:25.928593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f885d6e-fa18-423b-b0d7-e90314fdf982 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:25.930470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f885d6e-fa18-423b-b0d7-e90314fdf982 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:25.943462 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1681/3348] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:52:25.947427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f885d6e-fa18-423b-b0d7-e90314fdf982 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:25.970880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f885d6e-fa18-423b-b0d7-e90314fdf982 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:25.978415 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:25.984322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee773c-3b29-4028-9980-0dbe3628a720 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72b228b4f1948c69e676634528babaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37954edda5c45dabb16724cb56a162d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:25.984989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee773c-3b29-4028-9980-0dbe3628a720 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:25.985263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee773c-3b29-4028-9980-0dbe3628a720 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:25.985684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee773c-3b29-4028-9980-0dbe3628a720 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:25.987749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee773c-3b29-4028-9980-0dbe3628a720 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:25.989878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee773c-3b29-4028-9980-0dbe3628a720 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:26.009650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07f5e3-057a-4782-a9a8-a7de36b4b195 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:26.016220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e025c-2705-4da9-ae8f-5bf7686e5c0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:26.017159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e025c-2705-4da9-ae8f-5bf7686e5c0f service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:26.018109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e025c-2705-4da9-ae8f-5bf7686e5c0f service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:26.018890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e025c-2705-4da9-ae8f-5bf7686e5c0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:26.029567 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1682/3349] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:52:25 2022] POST /identity/v3/projects => generated 371 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:52:26.031260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee773c-3b29-4028-9980-0dbe3628a720 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:26.031911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e025c-2705-4da9-ae8f-5bf7686e5c0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:26.034305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e025c-2705-4da9-ae8f-5bf7686e5c0f service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:26.038848 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:26.049145 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1668/3350] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:52:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:52:26.169455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee773c-3b29-4028-9980-0dbe3628a720 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:26.175770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739f972-137d-43b2-9312-db8e1f114bc9 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72b228b4f1948c69e676634528babaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37954edda5c45dabb16724cb56a162d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:26.177000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739f972-137d-43b2-9312-db8e1f114bc9 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:26.177431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739f972-137d-43b2-9312-db8e1f114bc9 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:26.177846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739f972-137d-43b2-9312-db8e1f114bc9 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:26.178647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739f972-137d-43b2-9312-db8e1f114bc9 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:52:26.179097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739f972-137d-43b2-9312-db8e1f114bc9 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:26.180887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739f972-137d-43b2-9312-db8e1f114bc9 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:26.223384 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1683/3351] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:26.269454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261145a-86ec-499c-bd1c-f1ab931ee22a None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:26.269744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261145a-86ec-499c-bd1c-f1ab931ee22a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:26.270072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261145a-86ec-499c-bd1c-f1ab931ee22a None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:26.273994 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1669/3352] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:52:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:52:26.280453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739f972-137d-43b2-9312-db8e1f114bc9 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:52:26.453119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739f972-137d-43b2-9312-db8e1f114bc9 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:26.468296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739f972-137d-43b2-9312-db8e1f114bc9 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:26.475081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01a970-e742-4b65-95d3-4da552029a23 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72b228b4f1948c69e676634528babaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37954edda5c45dabb16724cb56a162d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:26.476076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01a970-e742-4b65-95d3-4da552029a23 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:26.476703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01a970-e742-4b65-95d3-4da552029a23 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:26.477150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01a970-e742-4b65-95d3-4da552029a23 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] PATH_INFO: `/v3/projects/a2cdc5b363534b749a1ddaf6ff3e23ea` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:26.479509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01a970-e742-4b65-95d3-4da552029a23 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorizing `identity:get_project(project_id=a2cdc5b363534b749a1ddaf6ff3e23ea)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:26.482813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01a970-e742-4b65-95d3-4da552029a23 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:26.497621 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1684/3353] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:52:26 2022] GET /identity/v3/projects/a2cdc5b363534b749a1ddaf6ff3e23ea => generated 371 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:26.874875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774a9e6-6696-4f2c-bba3-a11460683c0a None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:26.875417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774a9e6-6696-4f2c-bba3-a11460683c0a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:26.875542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774a9e6-6696-4f2c-bba3-a11460683c0a None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:26.877062 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1670/3354] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:52:26.885446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01a970-e742-4b65-95d3-4da552029a23 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:52:26.912379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01a970-e742-4b65-95d3-4da552029a23 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:26.924914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01a970-e742-4b65-95d3-4da552029a23 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:26.933525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d05495-0e74-48ca-bd4e-efd6d3e9114c tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72b228b4f1948c69e676634528babaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37954edda5c45dabb16724cb56a162d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:26.934721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d05495-0e74-48ca-bd4e-efd6d3e9114c tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:26.935066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d05495-0e74-48ca-bd4e-efd6d3e9114c tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:26.935347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d05495-0e74-48ca-bd4e-efd6d3e9114c tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] PATH_INFO: `/v3/projects/a2cdc5b363534b749a1ddaf6ff3e23ea` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:26.937194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d05495-0e74-48ca-bd4e-efd6d3e9114c tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorizing `identity:get_project(project_id=a2cdc5b363534b749a1ddaf6ff3e23ea)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:26.939669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d05495-0e74-48ca-bd4e-efd6d3e9114c tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:26.953444 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1685/3355] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:52:26 2022] GET /identity/v3/projects/a2cdc5b363534b749a1ddaf6ff3e23ea => generated 371 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:52:27.002050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774a9e6-6696-4f2c-bba3-a11460683c0a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:27.022838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774a9e6-6696-4f2c-bba3-a11460683c0a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:27.054788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7656d-dab5-4653-b24a-60fa0edf1c2d tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72b228b4f1948c69e676634528babaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37954edda5c45dabb16724cb56a162d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:27.055419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7656d-dab5-4653-b24a-60fa0edf1c2d tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:27.057916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7656d-dab5-4653-b24a-60fa0edf1c2d tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:27.058331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7656d-dab5-4653-b24a-60fa0edf1c2d tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:27.059204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7656d-dab5-4653-b24a-60fa0edf1c2d tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:52:27.059510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7656d-dab5-4653-b24a-60fa0edf1c2d tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:27.061199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7656d-dab5-4653-b24a-60fa0edf1c2d tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:27.144105 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1671/3356] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:27.145466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d05495-0e74-48ca-bd4e-efd6d3e9114c tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:27.195026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d05495-0e74-48ca-bd4e-efd6d3e9114c tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:27.203950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f45cc2-2626-455e-8c56-52424bd19240 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72b228b4f1948c69e676634528babaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37954edda5c45dabb16724cb56a162d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:27.204569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f45cc2-2626-455e-8c56-52424bd19240 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:27.204805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f45cc2-2626-455e-8c56-52424bd19240 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:27.205121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f45cc2-2626-455e-8c56-52424bd19240 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:27.205784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f45cc2-2626-455e-8c56-52424bd19240 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:27.208696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f45cc2-2626-455e-8c56-52424bd19240 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:27.249030 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1686/3357] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:52:27 2022] POST /identity/v3/users => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:52:27.254152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7656d-dab5-4653-b24a-60fa0edf1c2d tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:27.278913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7656d-dab5-4653-b24a-60fa0edf1c2d tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:27.287902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c4af1-0e16-4c42-956d-9a5519f686ab tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72b228b4f1948c69e676634528babaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37954edda5c45dabb16724cb56a162d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:27.288458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c4af1-0e16-4c42-956d-9a5519f686ab tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:27.288773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c4af1-0e16-4c42-956d-9a5519f686ab tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:27.289085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c4af1-0e16-4c42-956d-9a5519f686ab tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:27.289750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c4af1-0e16-4c42-956d-9a5519f686ab tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:52:27.290046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c4af1-0e16-4c42-956d-9a5519f686ab tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:27.291938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c4af1-0e16-4c42-956d-9a5519f686ab tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:27.323732 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1672/3358] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:52:27.348145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a3bf2-3794-4978-a358-d4c0ff476fa3 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:27.349028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a3bf2-3794-4978-a358-d4c0ff476fa3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:27.350133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a3bf2-3794-4978-a358-d4c0ff476fa3 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:27.352695 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1687/3359] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:52:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:52:27.359331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c4af1-0e16-4c42-956d-9a5519f686ab tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:52:27.363127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2e3c4af1-0e16-4c42-956d-9a5519f686ab tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:27.385425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c4af1-0e16-4c42-956d-9a5519f686ab tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:27.404980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c4af1-0e16-4c42-956d-9a5519f686ab tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:27.424413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb164db3-6dcf-4927-a658-835ac39a5431 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72b228b4f1948c69e676634528babaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37954edda5c45dabb16724cb56a162d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:27.425358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb164db3-6dcf-4927-a658-835ac39a5431 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:27.425855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb164db3-6dcf-4927-a658-835ac39a5431 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:27.426312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb164db3-6dcf-4927-a658-835ac39a5431 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] PATH_INFO: `/v3/projects/a2cdc5b363534b749a1ddaf6ff3e23ea` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:27.429539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb164db3-6dcf-4927-a658-835ac39a5431 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorizing `identity:get_project(project_id=a2cdc5b363534b749a1ddaf6ff3e23ea)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:27.432231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb164db3-6dcf-4927-a658-835ac39a5431 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:27.436916 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1673/3360] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:52:27 2022] GET /identity/v3/projects/a2cdc5b363534b749a1ddaf6ff3e23ea => generated 371 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:27.663715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f766b0-f315-4e1f-8b2d-d38cfd611916 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:27.667855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f766b0-f315-4e1f-8b2d-d38cfd611916 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:27.668493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f766b0-f315-4e1f-8b2d-d38cfd611916 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:27.670522 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1688/3361] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:52:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:52:27.678840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb164db3-6dcf-4927-a658-835ac39a5431 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:52:27.701876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb164db3-6dcf-4927-a658-835ac39a5431 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:27.730475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb164db3-6dcf-4927-a658-835ac39a5431 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:27.746325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdd7d5-7ef1-4741-a5b3-856320b30484 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72b228b4f1948c69e676634528babaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37954edda5c45dabb16724cb56a162d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:27.747978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdd7d5-7ef1-4741-a5b3-856320b30484 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:27.748264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdd7d5-7ef1-4741-a5b3-856320b30484 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:27.748565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdd7d5-7ef1-4741-a5b3-856320b30484 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] PATH_INFO: `/v3/projects/a2cdc5b363534b749a1ddaf6ff3e23ea` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:27.753640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbdd7d5-7ef1-4741-a5b3-856320b30484 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorizing `identity:get_project(project_id=a2cdc5b363534b749a1ddaf6ff3e23ea)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:27.761027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbdd7d5-7ef1-4741-a5b3-856320b30484 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:27.767649 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1674/3362] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:52:27 2022] GET /identity/v3/projects/a2cdc5b363534b749a1ddaf6ff3e23ea => generated 371 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:27.823882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f766b0-f315-4e1f-8b2d-d38cfd611916 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:27.843609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f766b0-f315-4e1f-8b2d-d38cfd611916 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:27.848773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510bd2d1-8a77-43c3-ad81-19da708aceac tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72b228b4f1948c69e676634528babaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37954edda5c45dabb16724cb56a162d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:27.849691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bd2d1-8a77-43c3-ad81-19da708aceac tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:27.850128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bd2d1-8a77-43c3-ad81-19da708aceac tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:27.850558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bd2d1-8a77-43c3-ad81-19da708aceac tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] PATH_INFO: `/v3/users/84c5a6c004e0400a83de1c373a25b013` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:27.895946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510bd2d1-8a77-43c3-ad81-19da708aceac tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorizing `identity:delete_user(user_id=84c5a6c004e0400a83de1c373a25b013)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:27.898120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510bd2d1-8a77-43c3-ad81-19da708aceac tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:27.982889 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:27.990363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-510bd2d1-8a77-43c3-ad81-19da708aceac tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84c5a6c004e0400a83de1c373a25b013'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:27.991337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-510bd2d1-8a77-43c3-ad81-19da708aceac tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84c5a6c004e0400a83de1c373a25b013'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:28.005273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-510bd2d1-8a77-43c3-ad81-19da708aceac tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84c5a6c004e0400a83de1c373a25b013'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:28.032157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-510bd2d1-8a77-43c3-ad81-19da708aceac tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84c5a6c004e0400a83de1c373a25b013'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:28.040734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-510bd2d1-8a77-43c3-ad81-19da708aceac tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84c5a6c004e0400a83de1c373a25b013'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:28.056620 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1689/3363] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:52:27 2022] DELETE /identity/v3/users/84c5a6c004e0400a83de1c373a25b013 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:28.062507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdd7d5-7ef1-4741-a5b3-856320b30484 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:28.065436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2bbdd7d5-7ef1-4741-a5b3-856320b30484 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:28.083973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdd7d5-7ef1-4741-a5b3-856320b30484 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:28.236347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fe9fe-9077-4543-89f5-10a9de9487f0 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72b228b4f1948c69e676634528babaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37954edda5c45dabb16724cb56a162d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:28.237186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fe9fe-9077-4543-89f5-10a9de9487f0 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:28.237562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fe9fe-9077-4543-89f5-10a9de9487f0 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:28.237931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fe9fe-9077-4543-89f5-10a9de9487f0 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] PATH_INFO: `/v3/projects/a2cdc5b363534b749a1ddaf6ff3e23ea` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:28.239257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fe9fe-9077-4543-89f5-10a9de9487f0 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a2cdc5b363534b749a1ddaf6ff3e23ea)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:28.241398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fe9fe-9077-4543-89f5-10a9de9487f0 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:28.360759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3c2fe9fe-9077-4543-89f5-10a9de9487f0 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2cdc5b363534b749a1ddaf6ff3e23ea', 'request_id': 'req-3c2fe9fe-9077-4543-89f5-10a9de9487f0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:28.381711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3c2fe9fe-9077-4543-89f5-10a9de9487f0 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2cdc5b363534b749a1ddaf6ff3e23ea', 'request_id': 'req-3c2fe9fe-9077-4543-89f5-10a9de9487f0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:28.394979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3c2fe9fe-9077-4543-89f5-10a9de9487f0 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2cdc5b363534b749a1ddaf6ff3e23ea', 'request_id': 'req-3c2fe9fe-9077-4543-89f5-10a9de9487f0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:28.424486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3c2fe9fe-9077-4543-89f5-10a9de9487f0 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] The token cache is being invalidate because project a2cdc5b363534b749a1ddaf6ff3e23ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:52:28.425209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3c2fe9fe-9077-4543-89f5-10a9de9487f0 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:28.427114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3c2fe9fe-9077-4543-89f5-10a9de9487f0 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:28.429517 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1675/3364] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:52:28 2022] DELETE /identity/v3/projects/a2cdc5b363534b749a1ddaf6ff3e23ea => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:28.449284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79ae24-cab3-4ba8-abf6-6d61d9347ec1 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:28.449866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79ae24-cab3-4ba8-abf6-6d61d9347ec1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:28.450726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79ae24-cab3-4ba8-abf6-6d61d9347ec1 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:28.452661 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1690/3365] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:52:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:52:28.458081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fe9fe-9077-4543-89f5-10a9de9487f0 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:52:28.460695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3c2fe9fe-9077-4543-89f5-10a9de9487f0 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:28.535510 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:28.714275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fe9fe-9077-4543-89f5-10a9de9487f0 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:28.716586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3c2fe9fe-9077-4543-89f5-10a9de9487f0 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:28.843189 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fe9fe-9077-4543-89f5-10a9de9487f0 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:28.850832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1d317-17f8-459b-8ce3-33392a7e7e9e tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72b228b4f1948c69e676634528babaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37954edda5c45dabb16724cb56a162d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:28.851618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1d317-17f8-459b-8ce3-33392a7e7e9e tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:28.852131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1d317-17f8-459b-8ce3-33392a7e7e9e tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:28.852513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1d317-17f8-459b-8ce3-33392a7e7e9e tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] PATH_INFO: `/v3/projects/db58bb49625c4fa5b3f620972b18eb4d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:28.853951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1d317-17f8-459b-8ce3-33392a7e7e9e tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorizing `identity:get_project(project_id=db58bb49625c4fa5b3f620972b18eb4d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:28.856405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1d317-17f8-459b-8ce3-33392a7e7e9e tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:28.873248 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1676/3366] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:52:28 2022] GET /identity/v3/projects/db58bb49625c4fa5b3f620972b18eb4d => generated 373 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:52:29.200456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd11f75-8820-4ea9-a55c-07a6eb5a4436 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:29.201134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd11f75-8820-4ea9-a55c-07a6eb5a4436 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:29.201232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd11f75-8820-4ea9-a55c-07a6eb5a4436 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:29.203178 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1691/3367] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:52:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:52:29.209381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1d317-17f8-459b-8ce3-33392a7e7e9e tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:52:29.213133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a8d1d317-17f8-459b-8ce3-33392a7e7e9e tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:29.236450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1d317-17f8-459b-8ce3-33392a7e7e9e tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:29.250415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1d317-17f8-459b-8ce3-33392a7e7e9e tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:29.265667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30597fd7-a61a-4698-8a66-04a8250cba63 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72b228b4f1948c69e676634528babaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37954edda5c45dabb16724cb56a162d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:29.266341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30597fd7-a61a-4698-8a66-04a8250cba63 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:29.266627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30597fd7-a61a-4698-8a66-04a8250cba63 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:29.266905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30597fd7-a61a-4698-8a66-04a8250cba63 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] PATH_INFO: `/v3/projects/db58bb49625c4fa5b3f620972b18eb4d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:29.269375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30597fd7-a61a-4698-8a66-04a8250cba63 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorizing `identity:get_project(project_id=db58bb49625c4fa5b3f620972b18eb4d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:29.271691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30597fd7-a61a-4698-8a66-04a8250cba63 tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:29.275928 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1677/3368] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:52:29 2022] GET /identity/v3/projects/db58bb49625c4fa5b3f620972b18eb4d => generated 373 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:29.982712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef2fcf-f31c-45a7-8637-d2ec96a38f09 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:29.983064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef2fcf-f31c-45a7-8637-d2ec96a38f09 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:29.983366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef2fcf-f31c-45a7-8637-d2ec96a38f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:30.053714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d5ef2fcf-f31c-45a7-8637-d2ec96a38f09 None None] MFA Rules not processed for user `c26f9d3b86a0437099ccab2a856e6238`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:30.055231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d5ef2fcf-f31c-45a7-8637-d2ec96a38f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:30.174128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadc362-0803-46a3-bad4-ce524710186c None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:30.174554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadc362-0803-46a3-bad4-ce524710186c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:30.174979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadc362-0803-46a3-bad4-ce524710186c None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:30.176750 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1678/3369] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:52:30.184920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadc362-0803-46a3-bad4-ce524710186c None None] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:52:30.194713 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1692/3370] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:30.232642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadc362-0803-46a3-bad4-ce524710186c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:30.258238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadc362-0803-46a3-bad4-ce524710186c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:30.266796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15734d-fc70-4159-a7f8-65920bf9a92c tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c72b228b4f1948c69e676634528babaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37954edda5c45dabb16724cb56a162d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:30.267589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15734d-fc70-4159-a7f8-65920bf9a92c tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:30.267958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15734d-fc70-4159-a7f8-65920bf9a92c tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:30.268340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15734d-fc70-4159-a7f8-65920bf9a92c tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] PATH_INFO: `/v3/projects/db58bb49625c4fa5b3f620972b18eb4d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:30.269642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15734d-fc70-4159-a7f8-65920bf9a92c tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorizing `identity:get_project(project_id=db58bb49625c4fa5b3f620972b18eb4d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:30.271785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15734d-fc70-4159-a7f8-65920bf9a92c tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:30.287164 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1679/3371] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:52:30 2022] GET /identity/v3/projects/db58bb49625c4fa5b3f620972b18eb4d => generated 373 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:30.412491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef2fcf-f31c-45a7-8637-d2ec96a38f09 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:30.427046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef2fcf-f31c-45a7-8637-d2ec96a38f09 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:30.441108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ce15f-2436-4b68-bd8a-97b44140821e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:30.442078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ce15f-2436-4b68-bd8a-97b44140821e service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:30.442557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ce15f-2436-4b68-bd8a-97b44140821e service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:30.442979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ce15f-2436-4b68-bd8a-97b44140821e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:30.458494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ce15f-2436-4b68-bd8a-97b44140821e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:30.462805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ce15f-2436-4b68-bd8a-97b44140821e service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:30.511449 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1693/3372] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:52:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:52:30.896403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15734d-fc70-4159-a7f8-65920bf9a92c tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:30.899701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fa15734d-fc70-4159-a7f8-65920bf9a92c tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:31.189575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15734d-fc70-4159-a7f8-65920bf9a92c tempest-QuotasAdminTestJSON-76747099 tempest-QuotasAdminTestJSON-76747099-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:31.201043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a172900-35b3-4d24-961f-0975ca1f63cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:31.202932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a172900-35b3-4d24-961f-0975ca1f63cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:31.203396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a172900-35b3-4d24-961f-0975ca1f63cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:31.204025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a172900-35b3-4d24-961f-0975ca1f63cc admin admin] PATH_INFO: `/v3/users/192c98ff437a4728b7421333f20f46b1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:31.206437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a172900-35b3-4d24-961f-0975ca1f63cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=192c98ff437a4728b7421333f20f46b1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:31.209028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a172900-35b3-4d24-961f-0975ca1f63cc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:31.319010 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:31.324406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4a172900-35b3-4d24-961f-0975ca1f63cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '192c98ff437a4728b7421333f20f46b1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:31.328243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070097bc-b7b6-4583-ab40-439782ca071f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:31.328533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070097bc-b7b6-4583-ab40-439782ca071f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:31.328854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070097bc-b7b6-4583-ab40-439782ca071f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:31.343229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4a172900-35b3-4d24-961f-0975ca1f63cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '192c98ff437a4728b7421333f20f46b1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:31.344384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4a172900-35b3-4d24-961f-0975ca1f63cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '192c98ff437a4728b7421333f20f46b1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:31.374305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-070097bc-b7b6-4583-ab40-439782ca071f None None] MFA Rules not processed for user `c26f9d3b86a0437099ccab2a856e6238`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:31.375535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-070097bc-b7b6-4583-ab40-439782ca071f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:31.379883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4a172900-35b3-4d24-961f-0975ca1f63cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '192c98ff437a4728b7421333f20f46b1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:31.394592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4a172900-35b3-4d24-961f-0975ca1f63cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '192c98ff437a4728b7421333f20f46b1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:31.405868 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1694/3373] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:31.408594 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1680/3374] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:52:30 2022] DELETE /identity/v3/users/192c98ff437a4728b7421333f20f46b1 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:31.412903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c6638-47f3-4d5f-bf6c-24c4e48b8153 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:31.413401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c6638-47f3-4d5f-bf6c-24c4e48b8153 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:31.413748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c6638-47f3-4d5f-bf6c-24c4e48b8153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:31.453251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-793c6638-47f3-4d5f-bf6c-24c4e48b8153 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:31.457570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-793c6638-47f3-4d5f-bf6c-24c4e48b8153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:31.545163 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1695/3375] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:52:31.557329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a172900-35b3-4d24-961f-0975ca1f63cc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:31.561444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4a172900-35b3-4d24-961f-0975ca1f63cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:31.701213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a172900-35b3-4d24-961f-0975ca1f63cc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:31.713564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684440a4-6125-4eee-ad0c-f8469bd8177c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:31.716432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684440a4-6125-4eee-ad0c-f8469bd8177c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:31.718630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684440a4-6125-4eee-ad0c-f8469bd8177c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:31.719381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684440a4-6125-4eee-ad0c-f8469bd8177c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:31.750342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684440a4-6125-4eee-ad0c-f8469bd8177c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:31.755984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684440a4-6125-4eee-ad0c-f8469bd8177c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:31.792653 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1681/3376] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:52:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:52:32.372297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c6638-47f3-4d5f-bf6c-24c4e48b8153 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:32.374395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-793c6638-47f3-4d5f-bf6c-24c4e48b8153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:32.396904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c6638-47f3-4d5f-bf6c-24c4e48b8153 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:32.413232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e257b0-ee15-4bd0-93e4-660d62374fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:32.414788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e257b0-ee15-4bd0-93e4-660d62374fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:32.415227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e257b0-ee15-4bd0-93e4-660d62374fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:32.415719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e257b0-ee15-4bd0-93e4-660d62374fc9 admin admin] PATH_INFO: `/v3/projects/db58bb49625c4fa5b3f620972b18eb4d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:32.418980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e257b0-ee15-4bd0-93e4-660d62374fc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db58bb49625c4fa5b3f620972b18eb4d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:32.421565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e257b0-ee15-4bd0-93e4-660d62374fc9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:32.535498 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:32.577610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-23e257b0-ee15-4bd0-93e4-660d62374fc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db58bb49625c4fa5b3f620972b18eb4d', 'request_id': 'req-23e257b0-ee15-4bd0-93e4-660d62374fc9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:32.589671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-23e257b0-ee15-4bd0-93e4-660d62374fc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db58bb49625c4fa5b3f620972b18eb4d', 'request_id': 'req-23e257b0-ee15-4bd0-93e4-660d62374fc9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:32.604472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-23e257b0-ee15-4bd0-93e4-660d62374fc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db58bb49625c4fa5b3f620972b18eb4d', 'request_id': 'req-23e257b0-ee15-4bd0-93e4-660d62374fc9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:32.634530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-23e257b0-ee15-4bd0-93e4-660d62374fc9 admin admin] The token cache is being invalidate because project db58bb49625c4fa5b3f620972b18eb4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:52:32.636799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-23e257b0-ee15-4bd0-93e4-660d62374fc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:32.639941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-23e257b0-ee15-4bd0-93e4-660d62374fc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:32.643920 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1696/3377] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:52:32 2022] DELETE /identity/v3/projects/db58bb49625c4fa5b3f620972b18eb4d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:32.647883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684440a4-6125-4eee-ad0c-f8469bd8177c service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:32.663145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684440a4-6125-4eee-ad0c-f8469bd8177c service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:32.812862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480fc52-663d-4dd1-be6c-f617fd6af114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:32.814138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480fc52-663d-4dd1-be6c-f617fd6af114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:32.815452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480fc52-663d-4dd1-be6c-f617fd6af114 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:32.816037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480fc52-663d-4dd1-be6c-f617fd6af114 admin admin] PATH_INFO: `/v3/users/c72b228b4f1948c69e676634528babaf` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:32.818052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480fc52-663d-4dd1-be6c-f617fd6af114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c72b228b4f1948c69e676634528babaf)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:32.820341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480fc52-663d-4dd1-be6c-f617fd6af114 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:32.898586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5480fc52-663d-4dd1-be6c-f617fd6af114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c72b228b4f1948c69e676634528babaf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:32.908864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5480fc52-663d-4dd1-be6c-f617fd6af114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c72b228b4f1948c69e676634528babaf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:32.909583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5480fc52-663d-4dd1-be6c-f617fd6af114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c72b228b4f1948c69e676634528babaf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:32.941576 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:32.944766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5480fc52-663d-4dd1-be6c-f617fd6af114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c72b228b4f1948c69e676634528babaf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:32.958514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5480fc52-663d-4dd1-be6c-f617fd6af114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c72b228b4f1948c69e676634528babaf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:32.969746 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1682/3378] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:52:32 2022] DELETE /identity/v3/users/c72b228b4f1948c69e676634528babaf => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:33.816756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e257b0-ee15-4bd0-93e4-660d62374fc9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:33.818358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-23e257b0-ee15-4bd0-93e4-660d62374fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:34.006053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e257b0-ee15-4bd0-93e4-660d62374fc9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:34.159252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e940f17-798b-45c9-b106-5f24ea8a4783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:34.160192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e940f17-798b-45c9-b106-5f24ea8a4783 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:34.160666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e940f17-798b-45c9-b106-5f24ea8a4783 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:34.161078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e940f17-798b-45c9-b106-5f24ea8a4783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:34.163213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0e940f17-798b-45c9-b106-5f24ea8a4783 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:34.216464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480fc52-663d-4dd1-be6c-f617fd6af114 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:34.218050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5480fc52-663d-4dd1-be6c-f617fd6af114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:34.275519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e940f17-798b-45c9-b106-5f24ea8a4783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:34.280570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e940f17-798b-45c9-b106-5f24ea8a4783 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:34.299797 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1697/3379] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:52:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:52:34.407111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480fc52-663d-4dd1-be6c-f617fd6af114 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:34.423706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8421deb-5659-4dc6-bc70-d26fbee4788e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:34.424630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8421deb-5659-4dc6-bc70-d26fbee4788e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:34.424933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8421deb-5659-4dc6-bc70-d26fbee4788e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:34.426413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8421deb-5659-4dc6-bc70-d26fbee4788e admin admin] PATH_INFO: `/v3/projects/c37954edda5c45dabb16724cb56a162d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:34.429219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8421deb-5659-4dc6-bc70-d26fbee4788e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c37954edda5c45dabb16724cb56a162d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:34.432322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8421deb-5659-4dc6-bc70-d26fbee4788e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:34.527287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b8421deb-5659-4dc6-bc70-d26fbee4788e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c37954edda5c45dabb16724cb56a162d', 'request_id': 'req-b8421deb-5659-4dc6-bc70-d26fbee4788e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:34.542100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b8421deb-5659-4dc6-bc70-d26fbee4788e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c37954edda5c45dabb16724cb56a162d', 'request_id': 'req-b8421deb-5659-4dc6-bc70-d26fbee4788e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:34.554737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b8421deb-5659-4dc6-bc70-d26fbee4788e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c37954edda5c45dabb16724cb56a162d', 'request_id': 'req-b8421deb-5659-4dc6-bc70-d26fbee4788e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:34.583054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b8421deb-5659-4dc6-bc70-d26fbee4788e admin admin] The token cache is being invalidate because project c37954edda5c45dabb16724cb56a162d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:52:34.583365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b8421deb-5659-4dc6-bc70-d26fbee4788e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:34.584467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b8421deb-5659-4dc6-bc70-d26fbee4788e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:34.592932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199dd39c-2e31-4415-8748-df998638472b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:34.593403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199dd39c-2e31-4415-8748-df998638472b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:34.595195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199dd39c-2e31-4415-8748-df998638472b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:34.601163 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1683/3380] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:52:34 2022] DELETE /identity/v3/projects/c37954edda5c45dabb16724cb56a162d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:34.662001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-199dd39c-2e31-4415-8748-df998638472b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:34.663250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-199dd39c-2e31-4415-8748-df998638472b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:34.693275 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:34.856583 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1698/3381] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:52:34.866597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3d504-c094-45de-aae9-d2da4d60e095 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:34.867045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3d504-c094-45de-aae9-d2da4d60e095 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:34.867154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3d504-c094-45de-aae9-d2da4d60e095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:35.048118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7fe3d504-c094-45de-aae9-d2da4d60e095 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:35.062808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7fe3d504-c094-45de-aae9-d2da4d60e095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:35.119848 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1684/3382] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:35.120014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199dd39c-2e31-4415-8748-df998638472b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:35.141803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199dd39c-2e31-4415-8748-df998638472b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:35.161358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0c7e3-9857-4734-96c1-05a1d299c7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:35.161984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0c7e3-9857-4734-96c1-05a1d299c7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:35.162265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0c7e3-9857-4734-96c1-05a1d299c7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:35.162531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0c7e3-9857-4734-96c1-05a1d299c7d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:35.163174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0c7e3-9857-4734-96c1-05a1d299c7d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:52:35.163477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0c7e3-9857-4734-96c1-05a1d299c7d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:35.179146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0c7e3-9857-4734-96c1-05a1d299c7d2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:35.216390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3d504-c094-45de-aae9-d2da4d60e095 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:35.216589 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1699/3383] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:35.242752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3d504-c094-45de-aae9-d2da4d60e095 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:35.288215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735f01d-4966-4c2a-a818-e8c747a74987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:35.288880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735f01d-4966-4c2a-a818-e8c747a74987 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:35.289209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735f01d-4966-4c2a-a818-e8c747a74987 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:35.289652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735f01d-4966-4c2a-a818-e8c747a74987 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:35.292265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735f01d-4966-4c2a-a818-e8c747a74987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:35.294448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735f01d-4966-4c2a-a818-e8c747a74987 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:35.386993 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1685/3384] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:52:35 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:52:35.391308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0c7e3-9857-4734-96c1-05a1d299c7d2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:35.408316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0c7e3-9857-4734-96c1-05a1d299c7d2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:35.602607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669a7f6-f48f-4110-8ff9-4d30179cd856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:35.603695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669a7f6-f48f-4110-8ff9-4d30179cd856 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:35.607745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669a7f6-f48f-4110-8ff9-4d30179cd856 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:35.609048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669a7f6-f48f-4110-8ff9-4d30179cd856 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:35.610814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669a7f6-f48f-4110-8ff9-4d30179cd856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:35.614725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669a7f6-f48f-4110-8ff9-4d30179cd856 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:35.689055 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1700/3385] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:52:35 2022] POST /identity/v3/users => generated 291 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:52:35.693081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735f01d-4966-4c2a-a818-e8c747a74987 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:35.715015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735f01d-4966-4c2a-a818-e8c747a74987 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:35.726873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7087a-e1ff-442e-84e6-1c6206a30314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:35.727720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7087a-e1ff-442e-84e6-1c6206a30314 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:35.728150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7087a-e1ff-442e-84e6-1c6206a30314 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:35.728570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7087a-e1ff-442e-84e6-1c6206a30314 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:35.737985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7087a-e1ff-442e-84e6-1c6206a30314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:35.746849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7087a-e1ff-442e-84e6-1c6206a30314 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:35.799966 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1686/3386] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:52:35.801016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669a7f6-f48f-4110-8ff9-4d30179cd856 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:35.828697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669a7f6-f48f-4110-8ff9-4d30179cd856 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:35.835471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c22f08-5968-4915-b20c-83ec2d8c620e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:35.846189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c22f08-5968-4915-b20c-83ec2d8c620e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:35.848807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c22f08-5968-4915-b20c-83ec2d8c620e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:35.849569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c22f08-5968-4915-b20c-83ec2d8c620e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:35.851168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c22f08-5968-4915-b20c-83ec2d8c620e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:35.855392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c22f08-5968-4915-b20c-83ec2d8c620e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:35.877186 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1701/3387] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:52:35.881653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7087a-e1ff-442e-84e6-1c6206a30314 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:35.902799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7087a-e1ff-442e-84e6-1c6206a30314 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:35.910320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2cd39-56e8-4b6c-b61d-6e967c1786db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:35.910865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2cd39-56e8-4b6c-b61d-6e967c1786db admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:35.911236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2cd39-56e8-4b6c-b61d-6e967c1786db admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:35.911522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2cd39-56e8-4b6c-b61d-6e967c1786db admin admin] PATH_INFO: `/v3/projects/744a47e4c98045fd8ed48d48ca525893/users/d9e31e21d48c42958a284b7319d72bfd/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:35.975843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2cd39-56e8-4b6c-b61d-6e967c1786db admin admin] RBAC: Authorizing `identity:create_grant(project_id=744a47e4c98045fd8ed48d48ca525893, user_id=d9e31e21d48c42958a284b7319d72bfd, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:35.982770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2cd39-56e8-4b6c-b61d-6e967c1786db admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:36.025420 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1687/3388] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:52:35 2022] PUT /identity/v3/projects/744a47e4c98045fd8ed48d48ca525893/users/d9e31e21d48c42958a284b7319d72bfd/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:36.151146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414d546-2f46-4053-913a-245f4edf2d6d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:36.151672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414d546-2f46-4053-913a-245f4edf2d6d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:36.152125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414d546-2f46-4053-913a-245f4edf2d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:36.282481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7414d546-2f46-4053-913a-245f4edf2d6d None None] MFA Rules not processed for user `d9e31e21d48c42958a284b7319d72bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:36.283730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7414d546-2f46-4053-913a-245f4edf2d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:36.523285 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1702/3389] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:52:36.527987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2cd39-56e8-4b6c-b61d-6e967c1786db admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:36.577053 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:36.704919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2cd39-56e8-4b6c-b61d-6e967c1786db admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:36.713445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269997d3-fbba-41d9-8023-de656f1e334f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:36.716633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269997d3-fbba-41d9-8023-de656f1e334f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:36.717164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269997d3-fbba-41d9-8023-de656f1e334f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:36.718200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269997d3-fbba-41d9-8023-de656f1e334f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:36.719424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269997d3-fbba-41d9-8023-de656f1e334f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:36.722031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269997d3-fbba-41d9-8023-de656f1e334f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:36.772815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414d546-2f46-4053-913a-245f4edf2d6d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:36.772980 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1688/3390] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:52:36 2022] POST /identity/v3/projects => generated 381 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:52:36.794090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414d546-2f46-4053-913a-245f4edf2d6d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:36.807518 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:36.924093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6191b6-720b-453a-b118-6c94188a7ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:36.924762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6191b6-720b-453a-b118-6c94188a7ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:36.925024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6191b6-720b-453a-b118-6c94188a7ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:36.925290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6191b6-720b-453a-b118-6c94188a7ae8 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:36.926098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6191b6-720b-453a-b118-6c94188a7ae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:36.930739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6191b6-720b-453a-b118-6c94188a7ae8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:36.998124 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1703/3391] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:52:36 2022] POST /identity/v3/users => generated 297 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:52:37.001146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269997d3-fbba-41d9-8023-de656f1e334f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:37.030364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269997d3-fbba-41d9-8023-de656f1e334f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:37.061863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eaaa04-cf48-4c9a-914c-1852f9a808de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:37.062729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaaa04-cf48-4c9a-914c-1852f9a808de admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:37.067411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaaa04-cf48-4c9a-914c-1852f9a808de admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:37.068465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaaa04-cf48-4c9a-914c-1852f9a808de admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:37.073394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eaaa04-cf48-4c9a-914c-1852f9a808de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:37.081485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eaaa04-cf48-4c9a-914c-1852f9a808de admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:37.140690 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1689/3392] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:52:37.147166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6191b6-720b-453a-b118-6c94188a7ae8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:37.163196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6191b6-720b-453a-b118-6c94188a7ae8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:37.177321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28493364-7924-45e4-b7c8-529b9a052f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:37.180322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28493364-7924-45e4-b7c8-529b9a052f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:37.180827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28493364-7924-45e4-b7c8-529b9a052f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:37.181246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28493364-7924-45e4-b7c8-529b9a052f41 admin admin] PATH_INFO: `/v3/projects/ee06494de532420880b66899a8882c13/users/3d0486f7b9a04b9992050004465f201c/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:37.238761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28493364-7924-45e4-b7c8-529b9a052f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee06494de532420880b66899a8882c13, user_id=3d0486f7b9a04b9992050004465f201c, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:37.241758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28493364-7924-45e4-b7c8-529b9a052f41 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:37.283782 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1704/3393] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:52:37 2022] PUT /identity/v3/projects/ee06494de532420880b66899a8882c13/users/3d0486f7b9a04b9992050004465f201c/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:37.284122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eaaa04-cf48-4c9a-914c-1852f9a808de admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:37.297622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eaaa04-cf48-4c9a-914c-1852f9a808de admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:37.433442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d61b1e-9908-4327-a2c3-fe310c30ecb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:37.434070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d61b1e-9908-4327-a2c3-fe310c30ecb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:37.434347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d61b1e-9908-4327-a2c3-fe310c30ecb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:37.434633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d61b1e-9908-4327-a2c3-fe310c30ecb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:37.435300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d61b1e-9908-4327-a2c3-fe310c30ecb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:37.437502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d61b1e-9908-4327-a2c3-fe310c30ecb3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:37.469227 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1690/3394] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:52:37.473679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28493364-7924-45e4-b7c8-529b9a052f41 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:37.499464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28493364-7924-45e4-b7c8-529b9a052f41 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:37.509489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8ef94-c6c6-4ed9-99b0-d1ee278640a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:37.510173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8ef94-c6c6-4ed9-99b0-d1ee278640a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:37.510454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8ef94-c6c6-4ed9-99b0-d1ee278640a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:37.510731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8ef94-c6c6-4ed9-99b0-d1ee278640a8 admin admin] PATH_INFO: `/v3/projects/ee06494de532420880b66899a8882c13/users/3d0486f7b9a04b9992050004465f201c/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:37.513559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8ef94-c6c6-4ed9-99b0-d1ee278640a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee06494de532420880b66899a8882c13, user_id=3d0486f7b9a04b9992050004465f201c, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:37.516289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8ef94-c6c6-4ed9-99b0-d1ee278640a8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:37.539987 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1705/3395] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:52:37 2022] PUT /identity/v3/projects/ee06494de532420880b66899a8882c13/users/3d0486f7b9a04b9992050004465f201c/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:37.550753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6535b-338d-451a-a636-71bade48c3d4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:37.551309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6535b-338d-451a-a636-71bade48c3d4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:37.551309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6535b-338d-451a-a636-71bade48c3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:37.591384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cef6535b-338d-451a-a636-71bade48c3d4 None None] MFA Rules not processed for user `3d0486f7b9a04b9992050004465f201c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:37.593937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cef6535b-338d-451a-a636-71bade48c3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:37.820252 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1691/3396] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:37 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:38.050289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8ef94-c6c6-4ed9-99b0-d1ee278640a8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:38.051983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-adc8ef94-c6c6-4ed9-99b0-d1ee278640a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:38.112644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266b91f-10b3-4cfc-bae8-10d4d3521e0c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:38.112880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266b91f-10b3-4cfc-bae8-10d4d3521e0c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:38.113165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266b91f-10b3-4cfc-bae8-10d4d3521e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:38.128645 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:38.169110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d266b91f-10b3-4cfc-bae8-10d4d3521e0c None None] MFA Rules not processed for user `b4a7050533994b60aa3f7bb63b732dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:38.170365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d266b91f-10b3-4cfc-bae8-10d4d3521e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:38.245180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8ef94-c6c6-4ed9-99b0-d1ee278640a8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:38.259398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63718ff-0682-4dca-bebc-570755b551df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:38.261213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63718ff-0682-4dca-bebc-570755b551df service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:38.261491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63718ff-0682-4dca-bebc-570755b551df service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:38.261762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63718ff-0682-4dca-bebc-570755b551df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:38.286923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63718ff-0682-4dca-bebc-570755b551df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:38.313244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63718ff-0682-4dca-bebc-570755b551df service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:38.341597 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1692/3397] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:38.346536 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1706/3398] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:52:38 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:52:38.370931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06294726-8708-466b-b4a2-54254d254dfc None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:38.371217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06294726-8708-466b-b4a2-54254d254dfc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:38.371495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06294726-8708-466b-b4a2-54254d254dfc None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:38.373163 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1693/3399] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:52:38.379908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63718ff-0682-4dca-bebc-570755b551df service nova] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:52:38.396931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63718ff-0682-4dca-bebc-570755b551df service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:38.409140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63718ff-0682-4dca-bebc-570755b551df service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:38.414895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6e2e3-9e75-4c6c-b9e1-d3c38d3eb48e tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d0486f7b9a04b9992050004465f201c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee06494de532420880b66899a8882c13', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:38.415525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6e2e3-9e75-4c6c-b9e1-d3c38d3eb48e tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:38.415800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6e2e3-9e75-4c6c-b9e1-d3c38d3eb48e tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:38.416149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6e2e3-9e75-4c6c-b9e1-d3c38d3eb48e tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] PATH_INFO: `/v3/projects/744a47e4c98045fd8ed48d48ca525893` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:38.417339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6e2e3-9e75-4c6c-b9e1-d3c38d3eb48e tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: Authorizing `identity:get_project(project_id=744a47e4c98045fd8ed48d48ca525893)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:38.434038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6e2e3-9e75-4c6c-b9e1-d3c38d3eb48e tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:38.437054 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1707/3400] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:52:38 2022] GET /identity/v3/projects/744a47e4c98045fd8ed48d48ca525893 => generated 381 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:38.480222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d8245-16e8-494e-aab7-1b41eaf98c57 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:38.480506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d8245-16e8-494e-aab7-1b41eaf98c57 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:38.480819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d8245-16e8-494e-aab7-1b41eaf98c57 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:38.482266 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1694/3401] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:52:38.489453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6e2e3-9e75-4c6c-b9e1-d3c38d3eb48e tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:52:38.510693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6e2e3-9e75-4c6c-b9e1-d3c38d3eb48e tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:38.535567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6e2e3-9e75-4c6c-b9e1-d3c38d3eb48e tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:38.543542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37f709-85fb-472e-88f7-781feddbb775 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d0486f7b9a04b9992050004465f201c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee06494de532420880b66899a8882c13', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:38.544184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37f709-85fb-472e-88f7-781feddbb775 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:38.544993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37f709-85fb-472e-88f7-781feddbb775 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:38.545281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37f709-85fb-472e-88f7-781feddbb775 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] PATH_INFO: `/v3/projects/744a47e4c98045fd8ed48d48ca525893` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:38.546999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37f709-85fb-472e-88f7-781feddbb775 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: Authorizing `identity:get_project(project_id=744a47e4c98045fd8ed48d48ca525893)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:38.550107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37f709-85fb-472e-88f7-781feddbb775 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:38.552659 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1708/3402] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:52:38 2022] GET /identity/v3/projects/744a47e4c98045fd8ed48d48ca525893 => generated 381 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:38.653634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae8a5b-5aa8-4d3f-b3d9-5e57acc01ea6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:38.654066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae8a5b-5aa8-4d3f-b3d9-5e57acc01ea6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:38.654197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae8a5b-5aa8-4d3f-b3d9-5e57acc01ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:38.689696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-13ae8a5b-5aa8-4d3f-b3d9-5e57acc01ea6 None None] MFA Rules not processed for user `d9e31e21d48c42958a284b7319d72bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:38.691191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-13ae8a5b-5aa8-4d3f-b3d9-5e57acc01ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:38.815749 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1695/3403] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:38.935311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37f709-85fb-472e-88f7-781feddbb775 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:38.958425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37f709-85fb-472e-88f7-781feddbb775 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:38.965934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51060c3-a63c-47cc-89ae-0c658a0334fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:38.971592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51060c3-a63c-47cc-89ae-0c658a0334fa service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:38.972120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51060c3-a63c-47cc-89ae-0c658a0334fa service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:38.972521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51060c3-a63c-47cc-89ae-0c658a0334fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:38.992918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51060c3-a63c-47cc-89ae-0c658a0334fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:38.994710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51060c3-a63c-47cc-89ae-0c658a0334fa service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:39.027359 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1709/3404] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:52:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:52:40.156559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13579d19-af4a-463d-8c04-22a5ad484ca4 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:40.157423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13579d19-af4a-463d-8c04-22a5ad484ca4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:40.157853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13579d19-af4a-463d-8c04-22a5ad484ca4 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:40.159355 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1696/3405] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:52:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:52:40.167161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51060c3-a63c-47cc-89ae-0c658a0334fa service nova] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:52:40.186007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51060c3-a63c-47cc-89ae-0c658a0334fa service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:40.219826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51060c3-a63c-47cc-89ae-0c658a0334fa service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:40.236996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c0bde-9410-4564-b5ce-9569da006868 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d0486f7b9a04b9992050004465f201c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee06494de532420880b66899a8882c13', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:40.237725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c0bde-9410-4564-b5ce-9569da006868 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:40.238130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c0bde-9410-4564-b5ce-9569da006868 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:40.238334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c0bde-9410-4564-b5ce-9569da006868 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] PATH_INFO: `/v3/projects/744a47e4c98045fd8ed48d48ca525893` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:40.242292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c0bde-9410-4564-b5ce-9569da006868 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: Authorizing `identity:get_project(project_id=744a47e4c98045fd8ed48d48ca525893)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:40.246191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c0bde-9410-4564-b5ce-9569da006868 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:40.264147 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1710/3406] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:52:40 2022] GET /identity/v3/projects/744a47e4c98045fd8ed48d48ca525893 => generated 381 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:40.444381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cbf17-e8f4-43b5-91fb-9c57a56c7598 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:40.444829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cbf17-e8f4-43b5-91fb-9c57a56c7598 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:40.445378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cbf17-e8f4-43b5-91fb-9c57a56c7598 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:40.446829 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1697/3407] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:52:40.454542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c0bde-9410-4564-b5ce-9569da006868 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:52:40.479653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c0bde-9410-4564-b5ce-9569da006868 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:40.488308 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:40.496802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c0bde-9410-4564-b5ce-9569da006868 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:40.502476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df5899-2b2d-471e-94b8-23c6ee761c81 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d0486f7b9a04b9992050004465f201c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee06494de532420880b66899a8882c13', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:40.503433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df5899-2b2d-471e-94b8-23c6ee761c81 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:40.503942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df5899-2b2d-471e-94b8-23c6ee761c81 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:40.504438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df5899-2b2d-471e-94b8-23c6ee761c81 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] PATH_INFO: `/v3/projects/744a47e4c98045fd8ed48d48ca525893` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:40.506466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df5899-2b2d-471e-94b8-23c6ee761c81 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: Authorizing `identity:get_project(project_id=744a47e4c98045fd8ed48d48ca525893)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:40.508814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df5899-2b2d-471e-94b8-23c6ee761c81 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:40.519949 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1711/3408] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:52:40 2022] GET /identity/v3/projects/744a47e4c98045fd8ed48d48ca525893 => generated 381 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:40.556017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573b67d-39cf-4ea4-9a78-1bbc97618128 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:40.556299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573b67d-39cf-4ea4-9a78-1bbc97618128 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:40.556570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573b67d-39cf-4ea4-9a78-1bbc97618128 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:40.557941 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1698/3409] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:52:40.563293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df5899-2b2d-471e-94b8-23c6ee761c81 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:52:40.565228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-02df5899-2b2d-471e-94b8-23c6ee761c81 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:40.589746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df5899-2b2d-471e-94b8-23c6ee761c81 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:40.612125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df5899-2b2d-471e-94b8-23c6ee761c81 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:40.617521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912092a-3ab3-4911-a307-fd889c8307df tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d0486f7b9a04b9992050004465f201c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee06494de532420880b66899a8882c13', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:40.618288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912092a-3ab3-4911-a307-fd889c8307df tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:40.618569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912092a-3ab3-4911-a307-fd889c8307df tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:40.618876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912092a-3ab3-4911-a307-fd889c8307df tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] PATH_INFO: `/v3/projects/744a47e4c98045fd8ed48d48ca525893` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:40.620293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912092a-3ab3-4911-a307-fd889c8307df tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: Authorizing `identity:get_project(project_id=744a47e4c98045fd8ed48d48ca525893)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:40.624117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912092a-3ab3-4911-a307-fd889c8307df tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:40.626178 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1712/3410] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:52:40 2022] GET /identity/v3/projects/744a47e4c98045fd8ed48d48ca525893 => generated 381 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:40.738114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4e9a8-99b4-452c-9d40-9a4c038a02f6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:40.738568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4e9a8-99b4-452c-9d40-9a4c038a02f6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:40.738844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4e9a8-99b4-452c-9d40-9a4c038a02f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:40.769375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e0b4e9a8-99b4-452c-9d40-9a4c038a02f6 None None] MFA Rules not processed for user `d9e31e21d48c42958a284b7319d72bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:40.770714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e0b4e9a8-99b4-452c-9d40-9a4c038a02f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:40.777766 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1699/3411] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:41.454649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55558618-833c-4d07-997d-156fc394f753 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:41.455513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55558618-833c-4d07-997d-156fc394f753 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:41.455940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55558618-833c-4d07-997d-156fc394f753 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:41.457741 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1713/3412] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:52:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:52:41.463040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4e9a8-99b4-452c-9d40-9a4c038a02f6 None None] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:52:41.479709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4e9a8-99b4-452c-9d40-9a4c038a02f6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:41.492358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4e9a8-99b4-452c-9d40-9a4c038a02f6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:41.497812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7d570-0b51-45b4-810a-fdd1c2f3795e tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d0486f7b9a04b9992050004465f201c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee06494de532420880b66899a8882c13', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:41.498942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7d570-0b51-45b4-810a-fdd1c2f3795e tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:41.499654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7d570-0b51-45b4-810a-fdd1c2f3795e tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:41.500141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7d570-0b51-45b4-810a-fdd1c2f3795e tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] PATH_INFO: `/v3/projects/744a47e4c98045fd8ed48d48ca525893` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:41.502067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7d570-0b51-45b4-810a-fdd1c2f3795e tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: Authorizing `identity:get_project(project_id=744a47e4c98045fd8ed48d48ca525893)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:41.504650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7d570-0b51-45b4-810a-fdd1c2f3795e tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:41.519418 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1700/3413] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:52:41 2022] GET /identity/v3/projects/744a47e4c98045fd8ed48d48ca525893 => generated 381 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:41.619420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00371f-3e7c-4f5d-a121-2e129f8f38cb None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:41.619702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00371f-3e7c-4f5d-a121-2e129f8f38cb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:41.620168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00371f-3e7c-4f5d-a121-2e129f8f38cb None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:41.622052 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1714/3414] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:52:41.627979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7d570-0b51-45b4-810a-fdd1c2f3795e tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:52:41.643326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7d570-0b51-45b4-810a-fdd1c2f3795e tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:41.656732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7d570-0b51-45b4-810a-fdd1c2f3795e tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:41.664994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36864688-6c67-4c0c-bc04-9adb4761b798 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d0486f7b9a04b9992050004465f201c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee06494de532420880b66899a8882c13', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:41.666054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36864688-6c67-4c0c-bc04-9adb4761b798 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:41.666563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36864688-6c67-4c0c-bc04-9adb4761b798 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:41.667042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36864688-6c67-4c0c-bc04-9adb4761b798 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] PATH_INFO: `/v3/projects/744a47e4c98045fd8ed48d48ca525893` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:41.668705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36864688-6c67-4c0c-bc04-9adb4761b798 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: Authorizing `identity:get_project(project_id=744a47e4c98045fd8ed48d48ca525893)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:41.671577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36864688-6c67-4c0c-bc04-9adb4761b798 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:41.696116 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1701/3415] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:52:41 2022] GET /identity/v3/projects/744a47e4c98045fd8ed48d48ca525893 => generated 381 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:41.770733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6794013-6cca-4606-a3ef-22f199c9fdb8 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:41.771297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6794013-6cca-4606-a3ef-22f199c9fdb8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:41.771712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6794013-6cca-4606-a3ef-22f199c9fdb8 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:41.773614 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1715/3416] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:52:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:52:41.780218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36864688-6c67-4c0c-bc04-9adb4761b798 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:52:41.812644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36864688-6c67-4c0c-bc04-9adb4761b798 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:41.833953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36864688-6c67-4c0c-bc04-9adb4761b798 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:41.839714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef9a5f-1fd5-4cd5-9f57-bf20545a43c6 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d0486f7b9a04b9992050004465f201c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee06494de532420880b66899a8882c13', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:41.840731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef9a5f-1fd5-4cd5-9f57-bf20545a43c6 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:41.841226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef9a5f-1fd5-4cd5-9f57-bf20545a43c6 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:41.841751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef9a5f-1fd5-4cd5-9f57-bf20545a43c6 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] PATH_INFO: `/v3/projects/744a47e4c98045fd8ed48d48ca525893` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:41.853616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef9a5f-1fd5-4cd5-9f57-bf20545a43c6 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: Authorizing `identity:get_project(project_id=744a47e4c98045fd8ed48d48ca525893)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:41.860894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef9a5f-1fd5-4cd5-9f57-bf20545a43c6 tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:41.867357 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1702/3417] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:52:41 2022] GET /identity/v3/projects/744a47e4c98045fd8ed48d48ca525893 => generated 381 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:41.977333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59587e-09a3-4446-80f0-97efc6edc5b9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:41.977847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59587e-09a3-4446-80f0-97efc6edc5b9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:41.978293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59587e-09a3-4446-80f0-97efc6edc5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:42.005210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6e59587e-09a3-4446-80f0-97efc6edc5b9 None None] MFA Rules not processed for user `d9e31e21d48c42958a284b7319d72bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:42.006596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6e59587e-09a3-4446-80f0-97efc6edc5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:42.016465 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1716/3418] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:42.906404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689c409-001f-40a6-97c2-b28fe67d73b8 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:42.907740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689c409-001f-40a6-97c2-b28fe67d73b8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:42.908171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689c409-001f-40a6-97c2-b28fe67d73b8 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:42.911387 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1703/3419] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:52:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:52:42.925149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59587e-09a3-4446-80f0-97efc6edc5b9 None None] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 09:52:42.941817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59587e-09a3-4446-80f0-97efc6edc5b9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:42.963674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59587e-09a3-4446-80f0-97efc6edc5b9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:42.971573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0e205-51a8-4efc-9907-6dffdf07932c tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d0486f7b9a04b9992050004465f201c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee06494de532420880b66899a8882c13', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:42.985385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0e205-51a8-4efc-9907-6dffdf07932c tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:42.985944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0e205-51a8-4efc-9907-6dffdf07932c tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:42.987331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0e205-51a8-4efc-9907-6dffdf07932c tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] PATH_INFO: `/v3/projects/744a47e4c98045fd8ed48d48ca525893` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:42.991025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0e205-51a8-4efc-9907-6dffdf07932c tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: Authorizing `identity:get_project(project_id=744a47e4c98045fd8ed48d48ca525893)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:42.996126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0e205-51a8-4efc-9907-6dffdf07932c tempest-QuotasAdminNegativeTest-806834736 tempest-QuotasAdminNegativeTest-806834736-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:42.999568 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1717/3420] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 09:52:42 2022] GET /identity/v3/projects/744a47e4c98045fd8ed48d48ca525893 => generated 381 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:43.194085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689c409-001f-40a6-97c2-b28fe67d73b8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:43.341094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689c409-001f-40a6-97c2-b28fe67d73b8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:43.348943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd11398-5766-4b2e-83b9-2e333a4304fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:43.350358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd11398-5766-4b2e-83b9-2e333a4304fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:43.351030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd11398-5766-4b2e-83b9-2e333a4304fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:43.351462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd11398-5766-4b2e-83b9-2e333a4304fc admin admin] PATH_INFO: `/v3/users/d9e31e21d48c42958a284b7319d72bfd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:43.353417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd11398-5766-4b2e-83b9-2e333a4304fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9e31e21d48c42958a284b7319d72bfd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:43.355496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd11398-5766-4b2e-83b9-2e333a4304fc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:43.392130 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:43.427166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3dd11398-5766-4b2e-83b9-2e333a4304fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9e31e21d48c42958a284b7319d72bfd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:43.437916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3dd11398-5766-4b2e-83b9-2e333a4304fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9e31e21d48c42958a284b7319d72bfd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:43.438823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3dd11398-5766-4b2e-83b9-2e333a4304fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9e31e21d48c42958a284b7319d72bfd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:43.457463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3dd11398-5766-4b2e-83b9-2e333a4304fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9e31e21d48c42958a284b7319d72bfd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:43.466058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3dd11398-5766-4b2e-83b9-2e333a4304fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9e31e21d48c42958a284b7319d72bfd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:43.474320 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1704/3421] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:52:43 2022] DELETE /identity/v3/users/d9e31e21d48c42958a284b7319d72bfd => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:43.478501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc48638-6b82-4f6b-a7c3-6ad411b8c7a4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:43.481221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc48638-6b82-4f6b-a7c3-6ad411b8c7a4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:43.481221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc48638-6b82-4f6b-a7c3-6ad411b8c7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:43.507962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4fc48638-6b82-4f6b-a7c3-6ad411b8c7a4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:43.510000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4fc48638-6b82-4f6b-a7c3-6ad411b8c7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:43.611726 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1718/3422] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:43.645069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd11398-5766-4b2e-83b9-2e333a4304fc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:43.646637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3dd11398-5766-4b2e-83b9-2e333a4304fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:43.792740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd11398-5766-4b2e-83b9-2e333a4304fc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:43.799160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053760a9-f423-4aa5-b6a9-8f5c80c71ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:43.799883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053760a9-f423-4aa5-b6a9-8f5c80c71ceb service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:43.800223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053760a9-f423-4aa5-b6a9-8f5c80c71ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:43.800559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053760a9-f423-4aa5-b6a9-8f5c80c71ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:43.829546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053760a9-f423-4aa5-b6a9-8f5c80c71ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:43.831720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053760a9-f423-4aa5-b6a9-8f5c80c71ceb service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:43.847142 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1705/3423] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:52:45.346773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc48638-6b82-4f6b-a7c3-6ad411b8c7a4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:45.348935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4fc48638-6b82-4f6b-a7c3-6ad411b8c7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:45.365849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc48638-6b82-4f6b-a7c3-6ad411b8c7a4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:45.376256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183d1ca-f7de-4a58-99c7-a28710708b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:45.377207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183d1ca-f7de-4a58-99c7-a28710708b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:45.377893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183d1ca-f7de-4a58-99c7-a28710708b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:45.378610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183d1ca-f7de-4a58-99c7-a28710708b16 admin admin] PATH_INFO: `/v3/projects/744a47e4c98045fd8ed48d48ca525893` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:45.380197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183d1ca-f7de-4a58-99c7-a28710708b16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=744a47e4c98045fd8ed48d48ca525893)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:45.383441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183d1ca-f7de-4a58-99c7-a28710708b16 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:45.453124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8183d1ca-f7de-4a58-99c7-a28710708b16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '744a47e4c98045fd8ed48d48ca525893', 'request_id': 'req-8183d1ca-f7de-4a58-99c7-a28710708b16'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:45.464184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8183d1ca-f7de-4a58-99c7-a28710708b16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '744a47e4c98045fd8ed48d48ca525893', 'request_id': 'req-8183d1ca-f7de-4a58-99c7-a28710708b16'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:45.470958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8183d1ca-f7de-4a58-99c7-a28710708b16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '744a47e4c98045fd8ed48d48ca525893', 'request_id': 'req-8183d1ca-f7de-4a58-99c7-a28710708b16'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:45.485231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8183d1ca-f7de-4a58-99c7-a28710708b16 admin admin] The token cache is being invalidate because project 744a47e4c98045fd8ed48d48ca525893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:52:45.485867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8183d1ca-f7de-4a58-99c7-a28710708b16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:45.486739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8183d1ca-f7de-4a58-99c7-a28710708b16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:45.494434 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1719/3424] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:52:45 2022] DELETE /identity/v3/projects/744a47e4c98045fd8ed48d48ca525893 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:45.494751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053760a9-f423-4aa5-b6a9-8f5c80c71ceb service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:45.513866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053760a9-f423-4aa5-b6a9-8f5c80c71ceb service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:45.612480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f01c2b-cd5f-45b3-83bf-e3402aabd811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:45.613444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f01c2b-cd5f-45b3-83bf-e3402aabd811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:45.614786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f01c2b-cd5f-45b3-83bf-e3402aabd811 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:45.615246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f01c2b-cd5f-45b3-83bf-e3402aabd811 admin admin] PATH_INFO: `/v3/users/3d0486f7b9a04b9992050004465f201c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:45.616957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f01c2b-cd5f-45b3-83bf-e3402aabd811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d0486f7b9a04b9992050004465f201c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:45.619162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f01c2b-cd5f-45b3-83bf-e3402aabd811 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:45.678731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e7f01c2b-cd5f-45b3-83bf-e3402aabd811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d0486f7b9a04b9992050004465f201c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:45.680722 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:45.698826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e7f01c2b-cd5f-45b3-83bf-e3402aabd811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d0486f7b9a04b9992050004465f201c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:45.699580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e7f01c2b-cd5f-45b3-83bf-e3402aabd811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d0486f7b9a04b9992050004465f201c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:45.720013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e7f01c2b-cd5f-45b3-83bf-e3402aabd811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d0486f7b9a04b9992050004465f201c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:45.731468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e7f01c2b-cd5f-45b3-83bf-e3402aabd811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d0486f7b9a04b9992050004465f201c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:45.741708 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1706/3425] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:52:45 2022] DELETE /identity/v3/users/3d0486f7b9a04b9992050004465f201c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:46.067640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183d1ca-f7de-4a58-99c7-a28710708b16 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:46.069190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8183d1ca-f7de-4a58-99c7-a28710708b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:46.084363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183d1ca-f7de-4a58-99c7-a28710708b16 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:46.142708 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:46.149960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22afb7-64f1-4ffe-9283-960e3a058f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:46.150684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22afb7-64f1-4ffe-9283-960e3a058f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:46.151159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22afb7-64f1-4ffe-9283-960e3a058f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:46.151623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22afb7-64f1-4ffe-9283-960e3a058f73 admin admin] PATH_INFO: `/v3/projects/ee06494de532420880b66899a8882c13` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:46.153471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22afb7-64f1-4ffe-9283-960e3a058f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee06494de532420880b66899a8882c13)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:46.156268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22afb7-64f1-4ffe-9283-960e3a058f73 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:46.215204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a22afb7-64f1-4ffe-9283-960e3a058f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee06494de532420880b66899a8882c13', 'request_id': 'req-1a22afb7-64f1-4ffe-9283-960e3a058f73'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:46.226316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a22afb7-64f1-4ffe-9283-960e3a058f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee06494de532420880b66899a8882c13', 'request_id': 'req-1a22afb7-64f1-4ffe-9283-960e3a058f73'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:46.245499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a22afb7-64f1-4ffe-9283-960e3a058f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee06494de532420880b66899a8882c13', 'request_id': 'req-1a22afb7-64f1-4ffe-9283-960e3a058f73'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:46.260552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a22afb7-64f1-4ffe-9283-960e3a058f73 admin admin] The token cache is being invalidate because project ee06494de532420880b66899a8882c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:52:46.260964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a22afb7-64f1-4ffe-9283-960e3a058f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:46.262243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a22afb7-64f1-4ffe-9283-960e3a058f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:52:46.268818 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1720/3426] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:52:46 2022] DELETE /identity/v3/projects/ee06494de532420880b66899a8882c13 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:46.270498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83657445-236c-4f3d-af48-0217a75ebbb0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:46.270787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83657445-236c-4f3d-af48-0217a75ebbb0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:46.271081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83657445-236c-4f3d-af48-0217a75ebbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:46.297523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-83657445-236c-4f3d-af48-0217a75ebbb0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:46.298914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-83657445-236c-4f3d-af48-0217a75ebbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:46.380994 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1707/3427] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:46.389311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98832d9-df91-44a6-bb9c-65bc5447f203 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:46.389743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98832d9-df91-44a6-bb9c-65bc5447f203 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:46.390015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98832d9-df91-44a6-bb9c-65bc5447f203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:46.413478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d98832d9-df91-44a6-bb9c-65bc5447f203 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:46.414831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d98832d9-df91-44a6-bb9c-65bc5447f203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:46.429724 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1721/3428] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:46.433628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83657445-236c-4f3d-af48-0217a75ebbb0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:46.443678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83657445-236c-4f3d-af48-0217a75ebbb0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:46.452791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d68eb3-2ba9-4abe-b34e-fa3238563d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:46.453568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d68eb3-2ba9-4abe-b34e-fa3238563d2d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:46.453852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d68eb3-2ba9-4abe-b34e-fa3238563d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:46.454127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d68eb3-2ba9-4abe-b34e-fa3238563d2d admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:46.454786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d68eb3-2ba9-4abe-b34e-fa3238563d2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:52:46.455088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d68eb3-2ba9-4abe-b34e-fa3238563d2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:46.456801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d68eb3-2ba9-4abe-b34e-fa3238563d2d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:46.472643 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1708/3429] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:52:46.474829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98832d9-df91-44a6-bb9c-65bc5447f203 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:46.484841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98832d9-df91-44a6-bb9c-65bc5447f203 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:46.489520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0986ea5-a159-4e05-a2b1-35bee764b7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:46.490118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0986ea5-a159-4e05-a2b1-35bee764b7f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:46.490450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0986ea5-a159-4e05-a2b1-35bee764b7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:46.490728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0986ea5-a159-4e05-a2b1-35bee764b7f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:46.491355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0986ea5-a159-4e05-a2b1-35bee764b7f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:46.493519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0986ea5-a159-4e05-a2b1-35bee764b7f6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:46.532529 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1722/3430] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:52:46 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:52:46.533802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d68eb3-2ba9-4abe-b34e-fa3238563d2d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:46.545123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d68eb3-2ba9-4abe-b34e-fa3238563d2d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:46.612418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fec82-0d10-445f-9548-85ad4d3ad7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:46.613174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fec82-0d10-445f-9548-85ad4d3ad7bd admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:46.613459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fec82-0d10-445f-9548-85ad4d3ad7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:46.613734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fec82-0d10-445f-9548-85ad4d3ad7bd admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:46.614374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22fec82-0d10-445f-9548-85ad4d3ad7bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:46.616397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22fec82-0d10-445f-9548-85ad4d3ad7bd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:46.642135 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1709/3431] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:52:46 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:52:46.645634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0986ea5-a159-4e05-a2b1-35bee764b7f6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:46.657900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0986ea5-a159-4e05-a2b1-35bee764b7f6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:46.663383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b032479-5b5b-4109-a4d8-8fcded5ee740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:46.664038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b032479-5b5b-4109-a4d8-8fcded5ee740 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:46.664317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b032479-5b5b-4109-a4d8-8fcded5ee740 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:46.664584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b032479-5b5b-4109-a4d8-8fcded5ee740 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:46.665376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b032479-5b5b-4109-a4d8-8fcded5ee740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:46.666873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b032479-5b5b-4109-a4d8-8fcded5ee740 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:46.677670 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1723/3432] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:52:46.681908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fec82-0d10-445f-9548-85ad4d3ad7bd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:46.692573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fec82-0d10-445f-9548-85ad4d3ad7bd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:46.697740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ef712-0dc2-4bcd-aa0f-4196b6275de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:46.698345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ef712-0dc2-4bcd-aa0f-4196b6275de6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:46.698625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ef712-0dc2-4bcd-aa0f-4196b6275de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:46.698897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ef712-0dc2-4bcd-aa0f-4196b6275de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:46.699537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ef712-0dc2-4bcd-aa0f-4196b6275de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:46.701409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ef712-0dc2-4bcd-aa0f-4196b6275de6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:46.713013 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1710/3433] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:52:46.718604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b032479-5b5b-4109-a4d8-8fcded5ee740 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:46.728999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b032479-5b5b-4109-a4d8-8fcded5ee740 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:46.734199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1ca2c-1a5c-4d50-9efd-3b76d1b624ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:46.734887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1ca2c-1a5c-4d50-9efd-3b76d1b624ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:46.735170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1ca2c-1a5c-4d50-9efd-3b76d1b624ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:46.735447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1ca2c-1a5c-4d50-9efd-3b76d1b624ac admin admin] PATH_INFO: `/v3/projects/468da09853c74cd992e566ab3a0a9737/users/5fea1c05839b494494f90ae2c0a67792/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:46.752530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1ca2c-1a5c-4d50-9efd-3b76d1b624ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=468da09853c74cd992e566ab3a0a9737, user_id=5fea1c05839b494494f90ae2c0a67792, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:46.755542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1ca2c-1a5c-4d50-9efd-3b76d1b624ac admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:46.769413 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1724/3434] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:52:46 2022] PUT /identity/v3/projects/468da09853c74cd992e566ab3a0a9737/users/5fea1c05839b494494f90ae2c0a67792/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:46.779761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e67b83-6e15-460f-a9fa-4094e11c10a0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:46.780537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e67b83-6e15-460f-a9fa-4094e11c10a0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:46.780914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e67b83-6e15-460f-a9fa-4094e11c10a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:46.809441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-76e67b83-6e15-460f-a9fa-4094e11c10a0 None None] MFA Rules not processed for user `5fea1c05839b494494f90ae2c0a67792`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:46.810706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-76e67b83-6e15-460f-a9fa-4094e11c10a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:46.829424 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:46.875972 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1711/3435] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:46.880362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1ca2c-1a5c-4d50-9efd-3b76d1b624ac admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:46.947518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1ca2c-1a5c-4d50-9efd-3b76d1b624ac admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:46.953131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e253ec2-029d-4695-a9ae-feec88f439f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:46.953736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e253ec2-029d-4695-a9ae-feec88f439f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:46.954013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e253ec2-029d-4695-a9ae-feec88f439f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:46.954307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e253ec2-029d-4695-a9ae-feec88f439f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:46.954931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e253ec2-029d-4695-a9ae-feec88f439f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:46.956830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e253ec2-029d-4695-a9ae-feec88f439f7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:46.990337 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1725/3436] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:52:46 2022] POST /identity/v3/projects => generated 393 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:52:46.991585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e67b83-6e15-460f-a9fa-4094e11c10a0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:47.004258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e67b83-6e15-460f-a9fa-4094e11c10a0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:47.069803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a7656-bd52-4b3a-b975-8a355eb78869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:47.071780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7656-bd52-4b3a-b975-8a355eb78869 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:47.072911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7656-bd52-4b3a-b975-8a355eb78869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:47.073185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7656-bd52-4b3a-b975-8a355eb78869 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:47.074010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a7656-bd52-4b3a-b975-8a355eb78869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:47.077465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a7656-bd52-4b3a-b975-8a355eb78869 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:47.111391 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1712/3437] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:52:46 2022] POST /identity/v3/users => generated 303 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:52:47.118316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e253ec2-029d-4695-a9ae-feec88f439f7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:47.132178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e253ec2-029d-4695-a9ae-feec88f439f7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:47.138018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afaafd-3bdf-4c00-a7a7-9ad011660b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:47.138692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afaafd-3bdf-4c00-a7a7-9ad011660b0f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:47.138910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afaafd-3bdf-4c00-a7a7-9ad011660b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:47.139282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afaafd-3bdf-4c00-a7a7-9ad011660b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:47.139996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afaafd-3bdf-4c00-a7a7-9ad011660b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:47.141648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afaafd-3bdf-4c00-a7a7-9ad011660b0f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:47.144057 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:47.156642 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1726/3438] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:52:47.160060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a7656-bd52-4b3a-b975-8a355eb78869 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:47.172141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a7656-bd52-4b3a-b975-8a355eb78869 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:47.177368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b691f-5c96-4e79-ba28-6cc20b4ffb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:47.178020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b691f-5c96-4e79-ba28-6cc20b4ffb42 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:47.178325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b691f-5c96-4e79-ba28-6cc20b4ffb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:47.178602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b691f-5c96-4e79-ba28-6cc20b4ffb42 admin admin] PATH_INFO: `/v3/projects/51ff2162c5414528aa7f9cf8a804a32a/users/28831574e59c4e088deaac7b8008b2f2/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:47.195838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b691f-5c96-4e79-ba28-6cc20b4ffb42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ff2162c5414528aa7f9cf8a804a32a, user_id=28831574e59c4e088deaac7b8008b2f2, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:47.198600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b691f-5c96-4e79-ba28-6cc20b4ffb42 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:47.213504 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1713/3439] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:52:47 2022] PUT /identity/v3/projects/51ff2162c5414528aa7f9cf8a804a32a/users/28831574e59c4e088deaac7b8008b2f2/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:47.221675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afaafd-3bdf-4c00-a7a7-9ad011660b0f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:47.231550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afaafd-3bdf-4c00-a7a7-9ad011660b0f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:47.293607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a578973-c352-4e9c-89af-4b6fd64f69be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:47.294223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a578973-c352-4e9c-89af-4b6fd64f69be admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:47.294591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a578973-c352-4e9c-89af-4b6fd64f69be admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:47.294942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a578973-c352-4e9c-89af-4b6fd64f69be admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:47.295727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a578973-c352-4e9c-89af-4b6fd64f69be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:47.297412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a578973-c352-4e9c-89af-4b6fd64f69be admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:47.307739 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1727/3440] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:52:47.312533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b691f-5c96-4e79-ba28-6cc20b4ffb42 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:47.324123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b691f-5c96-4e79-ba28-6cc20b4ffb42 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:47.329768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4f991-ed65-4d55-bba6-6cbaeaaf3639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:47.330422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4f991-ed65-4d55-bba6-6cbaeaaf3639 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:47.330694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4f991-ed65-4d55-bba6-6cbaeaaf3639 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:47.330960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4f991-ed65-4d55-bba6-6cbaeaaf3639 admin admin] PATH_INFO: `/v3/projects/51ff2162c5414528aa7f9cf8a804a32a/users/28831574e59c4e088deaac7b8008b2f2/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:47.332886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4f991-ed65-4d55-bba6-6cbaeaaf3639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ff2162c5414528aa7f9cf8a804a32a, user_id=28831574e59c4e088deaac7b8008b2f2, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:47.335518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4f991-ed65-4d55-bba6-6cbaeaaf3639 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:47.355859 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1714/3441] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:52:47 2022] PUT /identity/v3/projects/51ff2162c5414528aa7f9cf8a804a32a/users/28831574e59c4e088deaac7b8008b2f2/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:52:47.357676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc425e98-2a5a-4e64-97f8-f76579df01a4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:47.358693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc425e98-2a5a-4e64-97f8-f76579df01a4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:47.359067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc425e98-2a5a-4e64-97f8-f76579df01a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:47.390706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fc425e98-2a5a-4e64-97f8-f76579df01a4 None None] MFA Rules not processed for user `28831574e59c4e088deaac7b8008b2f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:47.391841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fc425e98-2a5a-4e64-97f8-f76579df01a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:47.497619 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1728/3442] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:47 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:47.500359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae040181-a9e7-4d8f-8466-c6914a555bee None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:47.500565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae040181-a9e7-4d8f-8466-c6914a555bee None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:47.500877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae040181-a9e7-4d8f-8466-c6914a555bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:47.527053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ae040181-a9e7-4d8f-8466-c6914a555bee None None] MFA Rules not processed for user `5fea1c05839b494494f90ae2c0a67792`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:47.528265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ae040181-a9e7-4d8f-8466-c6914a555bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:47.601406 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1715/3443] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:47.839980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc425e98-2a5a-4e64-97f8-f76579df01a4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:47.845101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fc425e98-2a5a-4e64-97f8-f76579df01a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:47.955482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc425e98-2a5a-4e64-97f8-f76579df01a4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:47.980550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b8c0f-0063-4e81-8cd2-6433f76433f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:47.981209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b8c0f-0063-4e81-8cd2-6433f76433f7 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:47.981488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b8c0f-0063-4e81-8cd2-6433f76433f7 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:47.981756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b8c0f-0063-4e81-8cd2-6433f76433f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:47.991202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b8c0f-0063-4e81-8cd2-6433f76433f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:47.993098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b8c0f-0063-4e81-8cd2-6433f76433f7 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:48.005419 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1729/3444] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:52:47 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:52:50.688997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbe115-51b4-4172-8825-9dcc53f01734 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:50.690021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbe115-51b4-4172-8825-9dcc53f01734 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:50.690499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbe115-51b4-4172-8825-9dcc53f01734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:50.737884 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:50.790510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-71bbe115-51b4-4172-8825-9dcc53f01734 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:50.791977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-71bbe115-51b4-4172-8825-9dcc53f01734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:50.911537 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1716/3445] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 09:52:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:50.941746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b8c0f-0063-4e81-8cd2-6433f76433f7 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:50.945169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-530b8c0f-0063-4e81-8cd2-6433f76433f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:50.952330 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:51.127603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b8c0f-0063-4e81-8cd2-6433f76433f7 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:51.132917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a77a5-75be-4fe8-ab74-bd75e9c460d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:51.133514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a77a5-75be-4fe8-ab74-bd75e9c460d5 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:51.133820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a77a5-75be-4fe8-ab74-bd75e9c460d5 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:51.134090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a77a5-75be-4fe8-ab74-bd75e9c460d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:51.143224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a77a5-75be-4fe8-ab74-bd75e9c460d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:51.144812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a77a5-75be-4fe8-ab74-bd75e9c460d5 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:51.153190 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1730/3446] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:52:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:52:52.663843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378cbc9-7943-4a88-9761-66de20b868f4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:52.664393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378cbc9-7943-4a88-9761-66de20b868f4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:52.664393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378cbc9-7943-4a88-9761-66de20b868f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:52.684466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0378cbc9-7943-4a88-9761-66de20b868f4 None None] MFA Rules not processed for user `960e2646c3174ad084c85b6de1e01822`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:52.685712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0378cbc9-7943-4a88-9761-66de20b868f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:52.753954 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1717/3447] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:54.044426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a77a5-75be-4fe8-ab74-bd75e9c460d5 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:54.046936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c05a77a5-75be-4fe8-ab74-bd75e9c460d5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:54.064138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a77a5-75be-4fe8-ab74-bd75e9c460d5 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:54.071084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70208f97-d7aa-49ec-8c67-65e5e532297a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:54.071904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70208f97-d7aa-49ec-8c67-65e5e532297a service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:54.072165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70208f97-d7aa-49ec-8c67-65e5e532297a service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:54.072572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70208f97-d7aa-49ec-8c67-65e5e532297a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:54.082696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70208f97-d7aa-49ec-8c67-65e5e532297a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:54.084262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70208f97-d7aa-49ec-8c67-65e5e532297a service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:54.096250 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1731/3448] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:52:54 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:52:54.959313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378cbc9-7943-4a88-9761-66de20b868f4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:54.975136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378cbc9-7943-4a88-9761-66de20b868f4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:54.981077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536b644-522d-43be-9266-a5d13d8db161 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:54.981694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536b644-522d-43be-9266-a5d13d8db161 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:54.981969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536b644-522d-43be-9266-a5d13d8db161 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:54.982247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536b644-522d-43be-9266-a5d13d8db161 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:54.984519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c536b644-522d-43be-9266-a5d13d8db161 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:54.997261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536b644-522d-43be-9266-a5d13d8db161 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:54.999432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536b644-522d-43be-9266-a5d13d8db161 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:55.011843 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1718/3449] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:52:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:52:55.796285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474e174-7a8c-416c-8a37-916fd102655a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:55.796754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474e174-7a8c-416c-8a37-916fd102655a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:55.796904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474e174-7a8c-416c-8a37-916fd102655a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:55.816349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b474e174-7a8c-416c-8a37-916fd102655a None None] MFA Rules not processed for user `c26f9d3b86a0437099ccab2a856e6238`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:55.817500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b474e174-7a8c-416c-8a37-916fd102655a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:55.871982 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1732/3450] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:57.708506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536b644-522d-43be-9266-a5d13d8db161 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:57.710739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c536b644-522d-43be-9266-a5d13d8db161 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:57.802162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536b644-522d-43be-9266-a5d13d8db161 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:57.813984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7317da-a16e-45e5-9561-061801da50e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:57.814680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7317da-a16e-45e5-9561-061801da50e0 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:57.815169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7317da-a16e-45e5-9561-061801da50e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:57.815647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7317da-a16e-45e5-9561-061801da50e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:57.818080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8a7317da-a16e-45e5-9561-061801da50e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:57.835632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7317da-a16e-45e5-9561-061801da50e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:57.837910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7317da-a16e-45e5-9561-061801da50e0 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:57.855910 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1719/3451] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:52:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:52:58.291643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecb394-8009-4e5e-b8ae-65629a711b3d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:58.292200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecb394-8009-4e5e-b8ae-65629a711b3d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:58.292200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecb394-8009-4e5e-b8ae-65629a711b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:58.315323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b3ecb394-8009-4e5e-b8ae-65629a711b3d None None] MFA Rules not processed for user `b4a7050533994b60aa3f7bb63b732dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:52:58.316554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b3ecb394-8009-4e5e-b8ae-65629a711b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:58.441211 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1733/3452] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:52:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:52:59.269843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7317da-a16e-45e5-9561-061801da50e0 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:59.287605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7317da-a16e-45e5-9561-061801da50e0 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:59.296972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d439f4d-5e8e-4b85-b47f-2f0123b34cf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:59.297702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d439f4d-5e8e-4b85-b47f-2f0123b34cf2 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:59.297987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d439f4d-5e8e-4b85-b47f-2f0123b34cf2 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:59.298264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d439f4d-5e8e-4b85-b47f-2f0123b34cf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:59.300439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2d439f4d-5e8e-4b85-b47f-2f0123b34cf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:59.324759 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:59.377324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d439f4d-5e8e-4b85-b47f-2f0123b34cf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:59.378903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d439f4d-5e8e-4b85-b47f-2f0123b34cf2 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:59.390162 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1720/3453] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:52:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:52:59.622000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecb394-8009-4e5e-b8ae-65629a711b3d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:52:59.652153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecb394-8009-4e5e-b8ae-65629a711b3d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:52:59.674607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc000a09-e87f-4a6f-a9a1-6e09b0ade1af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:52:59.676013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc000a09-e87f-4a6f-a9a1-6e09b0ade1af service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:52:59.676553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc000a09-e87f-4a6f-a9a1-6e09b0ade1af service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:52:59.678491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc000a09-e87f-4a6f-a9a1-6e09b0ade1af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:52:59.681148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fc000a09-e87f-4a6f-a9a1-6e09b0ade1af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:52:59.726966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc000a09-e87f-4a6f-a9a1-6e09b0ade1af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:52:59.728570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc000a09-e87f-4a6f-a9a1-6e09b0ade1af service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:52:59.734110 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:52:59.755864 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1734/3454] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:52:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:53:04.460245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d439f4d-5e8e-4b85-b47f-2f0123b34cf2 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:04.471621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d439f4d-5e8e-4b85-b47f-2f0123b34cf2 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:04.475940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20dd7b-485d-4d41-96f1-9074fd01b48d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:04.476770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20dd7b-485d-4d41-96f1-9074fd01b48d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:04.477262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20dd7b-485d-4d41-96f1-9074fd01b48d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:04.477854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20dd7b-485d-4d41-96f1-9074fd01b48d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:04.480229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9b20dd7b-485d-4d41-96f1-9074fd01b48d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:04.496787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20dd7b-485d-4d41-96f1-9074fd01b48d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:04.500474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20dd7b-485d-4d41-96f1-9074fd01b48d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:04.518017 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1721/3455] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:53:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:53:04.668776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162623c1-b56f-4dd6-ac28-da57f6130e4c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:04.669329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162623c1-b56f-4dd6-ac28-da57f6130e4c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:04.669543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162623c1-b56f-4dd6-ac28-da57f6130e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:04.689285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-162623c1-b56f-4dd6-ac28-da57f6130e4c None None] MFA Rules not processed for user `1601a65c979846cda98c3cd501a71d71`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:53:04.690477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-162623c1-b56f-4dd6-ac28-da57f6130e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:04.749392 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1735/3456] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:53:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:53:05.621599 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20dd7b-485d-4d41-96f1-9074fd01b48d service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:05.639670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20dd7b-485d-4d41-96f1-9074fd01b48d service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:05.646919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14964c-73a2-47ac-b9e8-9bcf0468bcff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:05.647817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14964c-73a2-47ac-b9e8-9bcf0468bcff service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:05.660704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14964c-73a2-47ac-b9e8-9bcf0468bcff service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:05.663187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14964c-73a2-47ac-b9e8-9bcf0468bcff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:05.665294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1e14964c-73a2-47ac-b9e8-9bcf0468bcff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:05.736756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14964c-73a2-47ac-b9e8-9bcf0468bcff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:05.738675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14964c-73a2-47ac-b9e8-9bcf0468bcff service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:05.751734 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1722/3457] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:53:05 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:53:14.740587 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=26 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:53:15.745976 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=53 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:53:15.968913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65037e-d5d3-4e30-ba3b-a4ab14440790 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:15.969427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65037e-d5d3-4e30-ba3b-a4ab14440790 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:15.969427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65037e-d5d3-4e30-ba3b-a4ab14440790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:16.001894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bc65037e-d5d3-4e30-ba3b-a4ab14440790 None None] MFA Rules not processed for user `b4a7050533994b60aa3f7bb63b732dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:53:16.004102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bc65037e-d5d3-4e30-ba3b-a4ab14440790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:16.011679 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1736/3458] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:53:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:53:24.942529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14964c-73a2-47ac-b9e8-9bcf0468bcff service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:24.959019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14964c-73a2-47ac-b9e8-9bcf0468bcff service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:24.967815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d503a1-c003-4582-a3c7-67363ec2ad96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:24.969150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d503a1-c003-4582-a3c7-67363ec2ad96 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:24.969433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d503a1-c003-4582-a3c7-67363ec2ad96 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:24.969710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d503a1-c003-4582-a3c7-67363ec2ad96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:24.971666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f8d503a1-c003-4582-a3c7-67363ec2ad96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:24.986620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d503a1-c003-4582-a3c7-67363ec2ad96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:24.988435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d503a1-c003-4582-a3c7-67363ec2ad96 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:25.002304 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1723/3459] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:53:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:53:25.991250 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:53:32.520186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e8077-3d3d-4fc1-81dc-7ec270faeba9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:32.520691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e8077-3d3d-4fc1-81dc-7ec270faeba9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:32.520691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e8077-3d3d-4fc1-81dc-7ec270faeba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:32.573910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f32e8077-3d3d-4fc1-81dc-7ec270faeba9 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:53:32.575141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f32e8077-3d3d-4fc1-81dc-7ec270faeba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:32.592256 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1737/3460] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:53:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:53:32.646609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d503a1-c003-4582-a3c7-67363ec2ad96 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:32.678498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d503a1-c003-4582-a3c7-67363ec2ad96 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:32.690498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1176d6a-7f25-4b25-965e-cd7e202f02c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:32.692390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1176d6a-7f25-4b25-965e-cd7e202f02c1 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:32.692985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1176d6a-7f25-4b25-965e-cd7e202f02c1 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:32.694862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1176d6a-7f25-4b25-965e-cd7e202f02c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:32.712897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1176d6a-7f25-4b25-965e-cd7e202f02c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:32.714408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1176d6a-7f25-4b25-965e-cd7e202f02c1 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:32.728353 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1724/3461] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:53:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:53:38.570549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e8077-3d3d-4fc1-81dc-7ec270faeba9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:38.572201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f32e8077-3d3d-4fc1-81dc-7ec270faeba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:38.720816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e8077-3d3d-4fc1-81dc-7ec270faeba9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:38.733608 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df03006-25b6-46a1-9e26-904f78dd751e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:38.734359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df03006-25b6-46a1-9e26-904f78dd751e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:38.734804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df03006-25b6-46a1-9e26-904f78dd751e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:38.735614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df03006-25b6-46a1-9e26-904f78dd751e admin admin] PATH_INFO: `/v3/users/1601a65c979846cda98c3cd501a71d71` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:38.738146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df03006-25b6-46a1-9e26-904f78dd751e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1601a65c979846cda98c3cd501a71d71)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:38.744102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df03006-25b6-46a1-9e26-904f78dd751e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:38.865182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2df03006-25b6-46a1-9e26-904f78dd751e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1601a65c979846cda98c3cd501a71d71'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:38.865182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2df03006-25b6-46a1-9e26-904f78dd751e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1601a65c979846cda98c3cd501a71d71'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:38.883134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2df03006-25b6-46a1-9e26-904f78dd751e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1601a65c979846cda98c3cd501a71d71'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:38.910002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2df03006-25b6-46a1-9e26-904f78dd751e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1601a65c979846cda98c3cd501a71d71'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:38.918806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2df03006-25b6-46a1-9e26-904f78dd751e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1601a65c979846cda98c3cd501a71d71'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:38.927711 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1738/3462] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:53:38 2022] DELETE /identity/v3/users/1601a65c979846cda98c3cd501a71d71 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:53:39.587220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1176d6a-7f25-4b25-965e-cd7e202f02c1 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:39.603764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1176d6a-7f25-4b25-965e-cd7e202f02c1 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:39.753384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341d11d-1782-4cea-84f8-7ec791b01480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:39.754434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341d11d-1782-4cea-84f8-7ec791b01480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:39.754894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341d11d-1782-4cea-84f8-7ec791b01480 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:39.755394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341d11d-1782-4cea-84f8-7ec791b01480 admin admin] PATH_INFO: `/v3/projects/1cb19ecfa4ee40a096eb01f8357afe03` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:39.758343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341d11d-1782-4cea-84f8-7ec791b01480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb19ecfa4ee40a096eb01f8357afe03)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:39.760966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341d11d-1782-4cea-84f8-7ec791b01480 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:39.850924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3341d11d-1782-4cea-84f8-7ec791b01480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb19ecfa4ee40a096eb01f8357afe03', 'request_id': 'req-3341d11d-1782-4cea-84f8-7ec791b01480'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:39.865932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3341d11d-1782-4cea-84f8-7ec791b01480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb19ecfa4ee40a096eb01f8357afe03', 'request_id': 'req-3341d11d-1782-4cea-84f8-7ec791b01480'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:39.877888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3341d11d-1782-4cea-84f8-7ec791b01480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb19ecfa4ee40a096eb01f8357afe03', 'request_id': 'req-3341d11d-1782-4cea-84f8-7ec791b01480'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:39.893358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3341d11d-1782-4cea-84f8-7ec791b01480 admin admin] The token cache is being invalidate because project 1cb19ecfa4ee40a096eb01f8357afe03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:53:39.893995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3341d11d-1782-4cea-84f8-7ec791b01480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:39.894912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3341d11d-1782-4cea-84f8-7ec791b01480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:39.901105 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1725/3463] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:53:39 2022] DELETE /identity/v3/projects/1cb19ecfa4ee40a096eb01f8357afe03 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:53:39.902448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa6a04-df38-46f6-a80b-cd6efef37025 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:39.902918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa6a04-df38-46f6-a80b-cd6efef37025 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:39.903002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa6a04-df38-46f6-a80b-cd6efef37025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:39.929752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-41aa6a04-df38-46f6-a80b-cd6efef37025 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:53:39.930985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-41aa6a04-df38-46f6-a80b-cd6efef37025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:40.129572 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1739/3464] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:53:40.138156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd484baa-2ef4-49c9-aca4-be2c59a86079 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:40.138771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd484baa-2ef4-49c9-aca4-be2c59a86079 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:40.139200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd484baa-2ef4-49c9-aca4-be2c59a86079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:40.166718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dd484baa-2ef4-49c9-aca4-be2c59a86079 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:53:40.171084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dd484baa-2ef4-49c9-aca4-be2c59a86079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:40.184684 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1726/3465] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:53:40.186833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa6a04-df38-46f6-a80b-cd6efef37025 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:40.200405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa6a04-df38-46f6-a80b-cd6efef37025 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:40.218191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7d292-1e19-44ff-9ff5-27722b9172dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:40.218842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7d292-1e19-44ff-9ff5-27722b9172dd admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:40.219113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7d292-1e19-44ff-9ff5-27722b9172dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:40.219384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7d292-1e19-44ff-9ff5-27722b9172dd admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:40.220053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7d292-1e19-44ff-9ff5-27722b9172dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:53:40.220350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7d292-1e19-44ff-9ff5-27722b9172dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:40.222004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7d292-1e19-44ff-9ff5-27722b9172dd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:40.244095 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:53:40.251605 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1740/3466] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:53:40.253167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd484baa-2ef4-49c9-aca4-be2c59a86079 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:40.269831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd484baa-2ef4-49c9-aca4-be2c59a86079 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:40.274947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4d6ee-e792-44bf-8980-d2d2ca7dc65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:40.275783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4d6ee-e792-44bf-8980-d2d2ca7dc65b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:40.276922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4d6ee-e792-44bf-8980-d2d2ca7dc65b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:40.277365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4d6ee-e792-44bf-8980-d2d2ca7dc65b admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:40.278168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4d6ee-e792-44bf-8980-d2d2ca7dc65b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:40.280880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4d6ee-e792-44bf-8980-d2d2ca7dc65b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:40.315750 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1727/3467] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:53:40 2022] POST /identity/v3/projects => generated 397 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:53:40.319372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7d292-1e19-44ff-9ff5-27722b9172dd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:40.336866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7d292-1e19-44ff-9ff5-27722b9172dd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:40.438972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d3bc0-a789-41a9-b77b-32cfe5ee5ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:40.440173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d3bc0-a789-41a9-b77b-32cfe5ee5ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:40.443100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d3bc0-a789-41a9-b77b-32cfe5ee5ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:40.444167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d3bc0-a789-41a9-b77b-32cfe5ee5ce5 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:40.446177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d3bc0-a789-41a9-b77b-32cfe5ee5ce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:40.452355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d3bc0-a789-41a9-b77b-32cfe5ee5ce5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:40.507221 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1741/3468] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:53:40 2022] POST /identity/v3/users => generated 299 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:53:40.509274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4d6ee-e792-44bf-8980-d2d2ca7dc65b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:40.525388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4d6ee-e792-44bf-8980-d2d2ca7dc65b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:40.540501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63f57a-ab39-4889-a8c3-c64e296e3e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:40.541185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63f57a-ab39-4889-a8c3-c64e296e3e4d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:40.541463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63f57a-ab39-4889-a8c3-c64e296e3e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:40.541735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63f57a-ab39-4889-a8c3-c64e296e3e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:40.542795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63f57a-ab39-4889-a8c3-c64e296e3e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:40.544548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63f57a-ab39-4889-a8c3-c64e296e3e4d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:40.583524 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1728/3469] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:53:40.584840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d3bc0-a789-41a9-b77b-32cfe5ee5ce5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:40.603956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d3bc0-a789-41a9-b77b-32cfe5ee5ce5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:40.614326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab759b-c98b-42d1-b39d-274211954b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:40.614948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab759b-c98b-42d1-b39d-274211954b06 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:40.615227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab759b-c98b-42d1-b39d-274211954b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:40.615498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab759b-c98b-42d1-b39d-274211954b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:40.620976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab759b-c98b-42d1-b39d-274211954b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:40.622856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab759b-c98b-42d1-b39d-274211954b06 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:40.653492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63f57a-ab39-4889-a8c3-c64e296e3e4d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:40.654061 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1742/3470] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:53:40.672064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63f57a-ab39-4889-a8c3-c64e296e3e4d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:40.682516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881275a-24a0-47fc-8b74-37e312fca2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:40.683184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881275a-24a0-47fc-8b74-37e312fca2d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:40.683709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881275a-24a0-47fc-8b74-37e312fca2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:40.684121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881275a-24a0-47fc-8b74-37e312fca2d5 admin admin] PATH_INFO: `/v3/projects/0a6ef5c205c94e6e93d221479e40e3ed/users/2c9fe8a9c72c44d78f68f90c4f5a43f6/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:40.729211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881275a-24a0-47fc-8b74-37e312fca2d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6ef5c205c94e6e93d221479e40e3ed, user_id=2c9fe8a9c72c44d78f68f90c4f5a43f6, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:40.734245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881275a-24a0-47fc-8b74-37e312fca2d5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:40.779440 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:53:40.809026 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1729/3471] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:53:40 2022] PUT /identity/v3/projects/0a6ef5c205c94e6e93d221479e40e3ed/users/2c9fe8a9c72c44d78f68f90c4f5a43f6/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:53:40.814523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa43ed1-612b-4a75-afd4-efd750cc1fff None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:40.814807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa43ed1-612b-4a75-afd4-efd750cc1fff None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:40.815079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa43ed1-612b-4a75-afd4-efd750cc1fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:40.852660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1aa43ed1-612b-4a75-afd4-efd750cc1fff None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:53:40.853366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1aa43ed1-612b-4a75-afd4-efd750cc1fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:41.010023 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1743/3472] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:53:41.051653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881275a-24a0-47fc-8b74-37e312fca2d5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:41.053770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b881275a-24a0-47fc-8b74-37e312fca2d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:41.184164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881275a-24a0-47fc-8b74-37e312fca2d5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:41.190368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41080f3-c770-4073-b803-7920da290fce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:41.191002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41080f3-c770-4073-b803-7920da290fce service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:41.191280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41080f3-c770-4073-b803-7920da290fce service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:41.191549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41080f3-c770-4073-b803-7920da290fce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:41.210849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41080f3-c770-4073-b803-7920da290fce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:41.212290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41080f3-c770-4073-b803-7920da290fce service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:41.230982 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1730/3473] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:53:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:53:43.290878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa43ed1-612b-4a75-afd4-efd750cc1fff None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:43.293447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1aa43ed1-612b-4a75-afd4-efd750cc1fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:43.323541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa43ed1-612b-4a75-afd4-efd750cc1fff None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:43.351389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a6edd-881d-416b-8007-0f85a1960867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:43.352529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a6edd-881d-416b-8007-0f85a1960867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:43.353713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a6edd-881d-416b-8007-0f85a1960867 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:43.353993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a6edd-881d-416b-8007-0f85a1960867 admin admin] PATH_INFO: `/v3/users/66dd6264f85d4dbe801abf983995a895` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:43.358439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a6edd-881d-416b-8007-0f85a1960867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66dd6264f85d4dbe801abf983995a895)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:43.364989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a6edd-881d-416b-8007-0f85a1960867 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:43.505305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6c9a6edd-881d-416b-8007-0f85a1960867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66dd6264f85d4dbe801abf983995a895'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:43.506417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6c9a6edd-881d-416b-8007-0f85a1960867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66dd6264f85d4dbe801abf983995a895'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:43.518027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6c9a6edd-881d-416b-8007-0f85a1960867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66dd6264f85d4dbe801abf983995a895'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:43.534031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6c9a6edd-881d-416b-8007-0f85a1960867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66dd6264f85d4dbe801abf983995a895'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:43.537567 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:53:43.546606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6c9a6edd-881d-416b-8007-0f85a1960867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66dd6264f85d4dbe801abf983995a895'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:43.555058 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1744/3474] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:53:43 2022] DELETE /identity/v3/users/66dd6264f85d4dbe801abf983995a895 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:53:43.561384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f96479-cfda-4857-b431-7c0c57548a8b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:43.561877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f96479-cfda-4857-b431-7c0c57548a8b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:43.561987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f96479-cfda-4857-b431-7c0c57548a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:43.585266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f1f96479-cfda-4857-b431-7c0c57548a8b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:53:43.586500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f1f96479-cfda-4857-b431-7c0c57548a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:43.731639 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1731/3475] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:53:43.753144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a6edd-881d-416b-8007-0f85a1960867 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:43.754915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6c9a6edd-881d-416b-8007-0f85a1960867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:43.901461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a6edd-881d-416b-8007-0f85a1960867 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:43.910817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e09b4c-6417-42f5-8b6f-dd609025293b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:43.945548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e09b4c-6417-42f5-8b6f-dd609025293b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:43.946934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e09b4c-6417-42f5-8b6f-dd609025293b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:43.948465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e09b4c-6417-42f5-8b6f-dd609025293b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:43.986118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e09b4c-6417-42f5-8b6f-dd609025293b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:43.991265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e09b4c-6417-42f5-8b6f-dd609025293b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:44.027907 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1745/3476] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:53:44.152477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f96479-cfda-4857-b431-7c0c57548a8b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:44.155548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f1f96479-cfda-4857-b431-7c0c57548a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:44.355364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f96479-cfda-4857-b431-7c0c57548a8b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:44.377987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31dbc7-ad3e-4a2a-96b6-0908475db406 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:44.378847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31dbc7-ad3e-4a2a-96b6-0908475db406 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:44.379276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31dbc7-ad3e-4a2a-96b6-0908475db406 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:44.380174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31dbc7-ad3e-4a2a-96b6-0908475db406 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:44.386241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fa31dbc7-ad3e-4a2a-96b6-0908475db406 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:44.413848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31dbc7-ad3e-4a2a-96b6-0908475db406 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:44.415996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31dbc7-ad3e-4a2a-96b6-0908475db406 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:44.444653 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1732/3477] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:53:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:53:44.585388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e09b4c-6417-42f5-8b6f-dd609025293b service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:44.588895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a7e09b4c-6417-42f5-8b6f-dd609025293b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:44.610844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e09b4c-6417-42f5-8b6f-dd609025293b service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:44.617495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c448b87-3638-479a-bcc7-6fe0f2225ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:44.618850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c448b87-3638-479a-bcc7-6fe0f2225ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:44.619299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c448b87-3638-479a-bcc7-6fe0f2225ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:44.619754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c448b87-3638-479a-bcc7-6fe0f2225ff7 admin admin] PATH_INFO: `/v3/projects/db1c90bfed9143959a05aeb202b54c65` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:44.621244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c448b87-3638-479a-bcc7-6fe0f2225ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db1c90bfed9143959a05aeb202b54c65)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:44.624192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c448b87-3638-479a-bcc7-6fe0f2225ff7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:44.729719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3c448b87-3638-479a-bcc7-6fe0f2225ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db1c90bfed9143959a05aeb202b54c65', 'request_id': 'req-3c448b87-3638-479a-bcc7-6fe0f2225ff7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:44.753189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3c448b87-3638-479a-bcc7-6fe0f2225ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db1c90bfed9143959a05aeb202b54c65', 'request_id': 'req-3c448b87-3638-479a-bcc7-6fe0f2225ff7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:44.768034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3c448b87-3638-479a-bcc7-6fe0f2225ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db1c90bfed9143959a05aeb202b54c65', 'request_id': 'req-3c448b87-3638-479a-bcc7-6fe0f2225ff7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:44.789371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3c448b87-3638-479a-bcc7-6fe0f2225ff7 admin admin] The token cache is being invalidate because project db1c90bfed9143959a05aeb202b54c65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:53:44.790046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3c448b87-3638-479a-bcc7-6fe0f2225ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:44.793506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3c448b87-3638-479a-bcc7-6fe0f2225ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:44.801342 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1746/3478] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:53:44 2022] DELETE /identity/v3/projects/db1c90bfed9143959a05aeb202b54c65 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:53:44.801752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31dbc7-ad3e-4a2a-96b6-0908475db406 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:44.813820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31dbc7-ad3e-4a2a-96b6-0908475db406 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:44.852429 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:53:44.902577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de5e2a-9f0f-4004-bbca-28a0595ae869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:44.903222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de5e2a-9f0f-4004-bbca-28a0595ae869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:44.903502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de5e2a-9f0f-4004-bbca-28a0595ae869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:44.903775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de5e2a-9f0f-4004-bbca-28a0595ae869 admin admin] PATH_INFO: `/v3/users/eee23759b02f4a2facac82113dbe6b17` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:44.909392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de5e2a-9f0f-4004-bbca-28a0595ae869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eee23759b02f4a2facac82113dbe6b17)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:44.911344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de5e2a-9f0f-4004-bbca-28a0595ae869 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:45.023884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-18de5e2a-9f0f-4004-bbca-28a0595ae869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eee23759b02f4a2facac82113dbe6b17'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:45.038946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-18de5e2a-9f0f-4004-bbca-28a0595ae869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eee23759b02f4a2facac82113dbe6b17'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:45.039722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-18de5e2a-9f0f-4004-bbca-28a0595ae869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eee23759b02f4a2facac82113dbe6b17'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:45.085439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-18de5e2a-9f0f-4004-bbca-28a0595ae869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eee23759b02f4a2facac82113dbe6b17'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:45.140415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-18de5e2a-9f0f-4004-bbca-28a0595ae869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eee23759b02f4a2facac82113dbe6b17'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:45.168576 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1733/3479] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:53:44 2022] DELETE /identity/v3/users/eee23759b02f4a2facac82113dbe6b17 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:53:45.249301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c448b87-3638-479a-bcc7-6fe0f2225ff7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:45.251489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3c448b87-3638-479a-bcc7-6fe0f2225ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:45.335700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c448b87-3638-479a-bcc7-6fe0f2225ff7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:45.507555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf286190-239a-410e-8c5f-716b738995e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:45.508213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf286190-239a-410e-8c5f-716b738995e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:45.508500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf286190-239a-410e-8c5f-716b738995e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:45.508787 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf286190-239a-410e-8c5f-716b738995e8 admin admin] PATH_INFO: `/v3/users/f62cb46f8ce646fba20437110b7fad90` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:45.511206 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf286190-239a-410e-8c5f-716b738995e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f62cb46f8ce646fba20437110b7fad90)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:45.517400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf286190-239a-410e-8c5f-716b738995e8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:45.565754 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:53:45.624642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cf286190-239a-410e-8c5f-716b738995e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f62cb46f8ce646fba20437110b7fad90'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:45.625304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cf286190-239a-410e-8c5f-716b738995e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f62cb46f8ce646fba20437110b7fad90'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:45.647596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cf286190-239a-410e-8c5f-716b738995e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f62cb46f8ce646fba20437110b7fad90'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:45.675987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cf286190-239a-410e-8c5f-716b738995e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f62cb46f8ce646fba20437110b7fad90'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:45.692423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cf286190-239a-410e-8c5f-716b738995e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f62cb46f8ce646fba20437110b7fad90'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:45.711658 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1747/3480] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:53:45 2022] DELETE /identity/v3/users/f62cb46f8ce646fba20437110b7fad90 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:53:46.255216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de5e2a-9f0f-4004-bbca-28a0595ae869 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:46.258289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-18de5e2a-9f0f-4004-bbca-28a0595ae869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:46.290086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de5e2a-9f0f-4004-bbca-28a0595ae869 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:46.437420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5e0af-773b-43f7-a169-59b0abeb4110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:46.438691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5e0af-773b-43f7-a169-59b0abeb4110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:46.440075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5e0af-773b-43f7-a169-59b0abeb4110 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:46.440929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5e0af-773b-43f7-a169-59b0abeb4110 admin admin] PATH_INFO: `/v3/projects/81d2a6454e3043879a94c4959ea6d065` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:46.445918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5e0af-773b-43f7-a169-59b0abeb4110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81d2a6454e3043879a94c4959ea6d065)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:46.447958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5e0af-773b-43f7-a169-59b0abeb4110 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:46.541678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf286190-239a-410e-8c5f-716b738995e8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:46.543535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cf286190-239a-410e-8c5f-716b738995e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:46.569168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-47f5e0af-773b-43f7-a169-59b0abeb4110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81d2a6454e3043879a94c4959ea6d065', 'request_id': 'req-47f5e0af-773b-43f7-a169-59b0abeb4110'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:46.575713 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:53:46.576539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf286190-239a-410e-8c5f-716b738995e8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:46.582727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-47f5e0af-773b-43f7-a169-59b0abeb4110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81d2a6454e3043879a94c4959ea6d065', 'request_id': 'req-47f5e0af-773b-43f7-a169-59b0abeb4110'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:46.597549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-47f5e0af-773b-43f7-a169-59b0abeb4110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81d2a6454e3043879a94c4959ea6d065', 'request_id': 'req-47f5e0af-773b-43f7-a169-59b0abeb4110'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:46.630077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-47f5e0af-773b-43f7-a169-59b0abeb4110 admin admin] The token cache is being invalidate because project 81d2a6454e3043879a94c4959ea6d065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:53:46.632162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-47f5e0af-773b-43f7-a169-59b0abeb4110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:46.633685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-47f5e0af-773b-43f7-a169-59b0abeb4110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:46.639840 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1734/3481] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:53:46 2022] DELETE /identity/v3/projects/81d2a6454e3043879a94c4959ea6d065 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:53:46.643891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d165c6-1641-4928-bed6-04b2d79388a6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:46.644806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d165c6-1641-4928-bed6-04b2d79388a6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:46.645186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d165c6-1641-4928-bed6-04b2d79388a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:46.706702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-11d165c6-1641-4928-bed6-04b2d79388a6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:53:46.708136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-11d165c6-1641-4928-bed6-04b2d79388a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:46.729315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4230a-0c56-4a59-a201-a3c516ca3814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:46.729996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4230a-0c56-4a59-a201-a3c516ca3814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:46.730276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4230a-0c56-4a59-a201-a3c516ca3814 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:46.734257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4230a-0c56-4a59-a201-a3c516ca3814 admin admin] PATH_INFO: `/v3/projects/c0a3b6c14bd54870baca1b0abe00e7e3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:46.736767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4230a-0c56-4a59-a201-a3c516ca3814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0a3b6c14bd54870baca1b0abe00e7e3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:46.739004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4230a-0c56-4a59-a201-a3c516ca3814 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:46.882930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ada4230a-0c56-4a59-a201-a3c516ca3814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0a3b6c14bd54870baca1b0abe00e7e3', 'request_id': 'req-ada4230a-0c56-4a59-a201-a3c516ca3814'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:46.902472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ada4230a-0c56-4a59-a201-a3c516ca3814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0a3b6c14bd54870baca1b0abe00e7e3', 'request_id': 'req-ada4230a-0c56-4a59-a201-a3c516ca3814'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:46.933126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ada4230a-0c56-4a59-a201-a3c516ca3814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0a3b6c14bd54870baca1b0abe00e7e3', 'request_id': 'req-ada4230a-0c56-4a59-a201-a3c516ca3814'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:46.962297 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1735/3482] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:53:46.981012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f3a7b-9d85-4b0e-a478-958ef2702524 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:46.984270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f3a7b-9d85-4b0e-a478-958ef2702524 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:46.985825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f3a7b-9d85-4b0e-a478-958ef2702524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:46.987923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ada4230a-0c56-4a59-a201-a3c516ca3814 admin admin] The token cache is being invalidate because project c0a3b6c14bd54870baca1b0abe00e7e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:53:46.988276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ada4230a-0c56-4a59-a201-a3c516ca3814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:46.989506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ada4230a-0c56-4a59-a201-a3c516ca3814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:46.991194 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1748/3483] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:53:46 2022] DELETE /identity/v3/projects/c0a3b6c14bd54870baca1b0abe00e7e3 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:53:46.996284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf69b0-267a-4497-a5f5-e7e2afc3ed55 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:46.996575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf69b0-267a-4497-a5f5-e7e2afc3ed55 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:46.996878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf69b0-267a-4497-a5f5-e7e2afc3ed55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:47.037749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-625f3a7b-9d85-4b0e-a478-958ef2702524 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:53:47.038991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-625f3a7b-9d85-4b0e-a478-958ef2702524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:47.056118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b5cf69b0-267a-4497-a5f5-e7e2afc3ed55 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:53:47.058941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b5cf69b0-267a-4497-a5f5-e7e2afc3ed55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:47.156639 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:53:47.300766 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1736/3484] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:53:47.301883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f3a7b-9d85-4b0e-a478-958ef2702524 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:47.303147 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1749/3485] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:53:47.311657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90cad5-ac29-4830-be92-20f3b048b4c9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:47.311956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90cad5-ac29-4830-be92-20f3b048b4c9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:47.312230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90cad5-ac29-4830-be92-20f3b048b4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:47.321377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f3a7b-9d85-4b0e-a478-958ef2702524 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:47.328348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f54868-3a38-47df-804a-e9af653f3016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:47.329015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f54868-3a38-47df-804a-e9af653f3016 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:47.329432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f54868-3a38-47df-804a-e9af653f3016 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:47.329707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f54868-3a38-47df-804a-e9af653f3016 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:47.330375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f54868-3a38-47df-804a-e9af653f3016 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:53:47.330683 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f54868-3a38-47df-804a-e9af653f3016 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:47.332292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f54868-3a38-47df-804a-e9af653f3016 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:47.351639 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1737/3486] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:53:47.353586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f54868-3a38-47df-804a-e9af653f3016 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:47.361129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9d90cad5-ac29-4830-be92-20f3b048b4c9 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:53:47.362529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9d90cad5-ac29-4830-be92-20f3b048b4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:47.367667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f54868-3a38-47df-804a-e9af653f3016 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:47.376455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd3e36-0c71-468b-906f-58b03c2e10d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:47.377298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd3e36-0c71-468b-906f-58b03c2e10d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:47.377851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd3e36-0c71-468b-906f-58b03c2e10d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:47.378257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd3e36-0c71-468b-906f-58b03c2e10d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:47.378979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd3e36-0c71-468b-906f-58b03c2e10d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:47.382066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd3e36-0c71-468b-906f-58b03c2e10d7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:47.389820 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1750/3487] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:53:47.394503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90cad5-ac29-4830-be92-20f3b048b4c9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:47.411562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90cad5-ac29-4830-be92-20f3b048b4c9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:47.427875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0659c6-244d-43c8-805c-13d55e7723ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:47.428942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0659c6-244d-43c8-805c-13d55e7723ae admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:47.429223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0659c6-244d-43c8-805c-13d55e7723ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:47.429492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0659c6-244d-43c8-805c-13d55e7723ae admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:47.430151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0659c6-244d-43c8-805c-13d55e7723ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:53:47.430453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0659c6-244d-43c8-805c-13d55e7723ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:47.432040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0659c6-244d-43c8-805c-13d55e7723ae admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:47.453326 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1738/3488] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:53:47 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:53:47.454261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd3e36-0c71-468b-906f-58b03c2e10d7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:47.458743 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1751/3489] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:53:47.462788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0659c6-244d-43c8-805c-13d55e7723ae admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:47.483106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0659c6-244d-43c8-805c-13d55e7723ae admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:47.606858 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:53:47.663422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbe235-4d0d-47cc-9791-93539b2ed315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:47.666624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbe235-4d0d-47cc-9791-93539b2ed315 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:47.668268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbe235-4d0d-47cc-9791-93539b2ed315 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:47.669962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbe235-4d0d-47cc-9791-93539b2ed315 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:47.673382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dbe235-4d0d-47cc-9791-93539b2ed315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:47.683452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dbe235-4d0d-47cc-9791-93539b2ed315 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:47.686848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd3e36-0c71-468b-906f-58b03c2e10d7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:47.691907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9d434-1085-4432-ba27-9a9a5b0385a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:47.692532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9d434-1085-4432-ba27-9a9a5b0385a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:47.692912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9d434-1085-4432-ba27-9a9a5b0385a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:47.693433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9d434-1085-4432-ba27-9a9a5b0385a0 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:47.694923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9d434-1085-4432-ba27-9a9a5b0385a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:47.697102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9d434-1085-4432-ba27-9a9a5b0385a0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:47.728593 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1739/3490] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:53:47 2022] POST /identity/v3/users => generated 291 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:53:47.733545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9d434-1085-4432-ba27-9a9a5b0385a0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:47.762305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9d434-1085-4432-ba27-9a9a5b0385a0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:47.779324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cc14f-3117-4522-bbcd-1d2784d58b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:47.782781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cc14f-3117-4522-bbcd-1d2784d58b84 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:47.783079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cc14f-3117-4522-bbcd-1d2784d58b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:47.783363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cc14f-3117-4522-bbcd-1d2784d58b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:47.784105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1cc14f-3117-4522-bbcd-1d2784d58b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:47.789392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1cc14f-3117-4522-bbcd-1d2784d58b84 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:47.820174 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1740/3491] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:53:47.825598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cc14f-3117-4522-bbcd-1d2784d58b84 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:47.835741 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1752/3492] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:53:47 2022] POST /identity/v3/projects => generated 365 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:53:47.840376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbe235-4d0d-47cc-9791-93539b2ed315 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:47.850422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cc14f-3117-4522-bbcd-1d2784d58b84 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:48.012472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbe235-4d0d-47cc-9791-93539b2ed315 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:48.013302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57a6b1-415f-4ab3-994b-a36c07d2e294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:48.014484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57a6b1-415f-4ab3-994b-a36c07d2e294 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:48.014769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57a6b1-415f-4ab3-994b-a36c07d2e294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:48.015040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57a6b1-415f-4ab3-994b-a36c07d2e294 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:48.017495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57a6b1-415f-4ab3-994b-a36c07d2e294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:48.022882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57a6b1-415f-4ab3-994b-a36c07d2e294 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:48.025601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f058df9-20b5-411c-bdfb-c319edfc319d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:48.026367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058df9-20b5-411c-bdfb-c319edfc319d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:48.026808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058df9-20b5-411c-bdfb-c319edfc319d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:48.027265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058df9-20b5-411c-bdfb-c319edfc319d admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:48.028311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f058df9-20b5-411c-bdfb-c319edfc319d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:48.039246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f058df9-20b5-411c-bdfb-c319edfc319d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:48.056671 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1741/3493] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:53:48.057686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57a6b1-415f-4ab3-994b-a36c07d2e294 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:48.079976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57a6b1-415f-4ab3-994b-a36c07d2e294 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:48.085575 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1753/3494] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:53:47 2022] POST /identity/v3/users => generated 283 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:53:48.089964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f058df9-20b5-411c-bdfb-c319edfc319d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:48.100440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de0ad7-fb37-45aa-b8ac-90bcb526ad36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:48.102241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de0ad7-fb37-45aa-b8ac-90bcb526ad36 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:48.102656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de0ad7-fb37-45aa-b8ac-90bcb526ad36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:48.102959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de0ad7-fb37-45aa-b8ac-90bcb526ad36 admin admin] PATH_INFO: `/v3/projects/2a2088d20a3a468c92136e5f3cd9cffb/users/60912bd5bfdf451ea7348b8372ba1a5a/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:48.116192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f058df9-20b5-411c-bdfb-c319edfc319d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:48.134222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522662e-26bc-48ee-aae4-a87443dde592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:48.134843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522662e-26bc-48ee-aae4-a87443dde592 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:48.135426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522662e-26bc-48ee-aae4-a87443dde592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:48.135932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522662e-26bc-48ee-aae4-a87443dde592 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:48.136521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522662e-26bc-48ee-aae4-a87443dde592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:48.139917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522662e-26bc-48ee-aae4-a87443dde592 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:48.150323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de0ad7-fb37-45aa-b8ac-90bcb526ad36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2088d20a3a468c92136e5f3cd9cffb, user_id=60912bd5bfdf451ea7348b8372ba1a5a, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:48.161144 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1754/3495] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:53:48.174099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de0ad7-fb37-45aa-b8ac-90bcb526ad36 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:48.174315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522662e-26bc-48ee-aae4-a87443dde592 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:48.186241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522662e-26bc-48ee-aae4-a87443dde592 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:48.195320 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1742/3496] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:53:48 2022] PUT /identity/v3/projects/2a2088d20a3a468c92136e5f3cd9cffb/users/60912bd5bfdf451ea7348b8372ba1a5a/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:53:48.207258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c5626-1fbe-4fb6-9f82-79060f2fced8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:48.208153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c5626-1fbe-4fb6-9f82-79060f2fced8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:48.208153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c5626-1fbe-4fb6-9f82-79060f2fced8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:48.224211 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:53:48.255344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-637c5626-1fbe-4fb6-9f82-79060f2fced8 None None] MFA Rules not processed for user `60912bd5bfdf451ea7348b8372ba1a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:53:48.257629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-637c5626-1fbe-4fb6-9f82-79060f2fced8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:48.374045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375630aa-8cec-4415-93a0-92509ae43a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:48.374541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375630aa-8cec-4415-93a0-92509ae43a02 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:48.375005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375630aa-8cec-4415-93a0-92509ae43a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:48.375561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375630aa-8cec-4415-93a0-92509ae43a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:48.376535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375630aa-8cec-4415-93a0-92509ae43a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:48.387020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375630aa-8cec-4415-93a0-92509ae43a02 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:48.424780 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1755/3497] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:53:48.428946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375630aa-8cec-4415-93a0-92509ae43a02 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:48.453554 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1743/3498] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:53:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:53:48.458353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c5626-1fbe-4fb6-9f82-79060f2fced8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:48.466318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375630aa-8cec-4415-93a0-92509ae43a02 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:48.486659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87ac50-a3ba-4fc0-afe6-85cee824f6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:48.487341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87ac50-a3ba-4fc0-afe6-85cee824f6ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:48.487622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87ac50-a3ba-4fc0-afe6-85cee824f6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:48.487900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87ac50-a3ba-4fc0-afe6-85cee824f6ad admin admin] PATH_INFO: `/v3/projects/bd22a349f1954652832a5cc6c80869a5/users/869dff6689f7401a92705cda198b5b54/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:48.496659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c5626-1fbe-4fb6-9f82-79060f2fced8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:48.508772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87ac50-a3ba-4fc0-afe6-85cee824f6ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd22a349f1954652832a5cc6c80869a5, user_id=869dff6689f7401a92705cda198b5b54, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:48.511667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87ac50-a3ba-4fc0-afe6-85cee824f6ad admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:48.512188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1077a-cfe8-472d-aeeb-99aca4195232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:48.512935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1077a-cfe8-472d-aeeb-99aca4195232 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:48.513218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1077a-cfe8-472d-aeeb-99aca4195232 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:48.514180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1077a-cfe8-472d-aeeb-99aca4195232 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:48.519162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1077a-cfe8-472d-aeeb-99aca4195232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:48.522392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1077a-cfe8-472d-aeeb-99aca4195232 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:48.558532 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1756/3499] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:53:48 2022] PUT /identity/v3/projects/bd22a349f1954652832a5cc6c80869a5/users/869dff6689f7401a92705cda198b5b54/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:53:48.561352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22d479-68a0-4143-b0ee-a924e887fcc6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:48.563011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22d479-68a0-4143-b0ee-a924e887fcc6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:48.563391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22d479-68a0-4143-b0ee-a924e887fcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:48.592802 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1744/3500] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:53:48 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:53:48.597479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1077a-cfe8-472d-aeeb-99aca4195232 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:48.615633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0b22d479-68a0-4143-b0ee-a924e887fcc6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:53:48.618412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0b22d479-68a0-4143-b0ee-a924e887fcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:48.643996 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:53:48.767519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1077a-cfe8-472d-aeeb-99aca4195232 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:48.774821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c850dd-707e-43f6-932c-3290c3f02327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:48.775967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c850dd-707e-43f6-932c-3290c3f02327 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:48.776419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c850dd-707e-43f6-932c-3290c3f02327 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:48.776907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c850dd-707e-43f6-932c-3290c3f02327 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:48.785615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c850dd-707e-43f6-932c-3290c3f02327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:48.785615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c850dd-707e-43f6-932c-3290c3f02327 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:48.821080 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1745/3501] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:53:48 2022] POST /identity/v3/users => generated 297 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:53:48.837734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c850dd-707e-43f6-932c-3290c3f02327 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:48.847406 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1757/3502] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:53:48.883027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c850dd-707e-43f6-932c-3290c3f02327 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:48.890042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff5b0a-87af-4b6a-8bc3-c17669b22dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:48.890829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff5b0a-87af-4b6a-8bc3-c17669b22dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:48.891212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff5b0a-87af-4b6a-8bc3-c17669b22dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:48.892168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff5b0a-87af-4b6a-8bc3-c17669b22dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:48.893171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff5b0a-87af-4b6a-8bc3-c17669b22dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:48.895020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff5b0a-87af-4b6a-8bc3-c17669b22dc7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:48.916187 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1746/3503] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:53:48.920881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22d479-68a0-4143-b0ee-a924e887fcc6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:48.942380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22d479-68a0-4143-b0ee-a924e887fcc6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:48.955898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84610aed-4824-485f-8be5-1f4521aff77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:48.957139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84610aed-4824-485f-8be5-1f4521aff77b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:48.957139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84610aed-4824-485f-8be5-1f4521aff77b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:48.957364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84610aed-4824-485f-8be5-1f4521aff77b admin admin] PATH_INFO: `/v3/projects/99f7d49016d24b0c8188d759d99ba16f/users/f7b327cf288848e2b241c128f627b194/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:49.007710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff5b0a-87af-4b6a-8bc3-c17669b22dc7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:49.011814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4eff5b0a-87af-4b6a-8bc3-c17669b22dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:49.024029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84610aed-4824-485f-8be5-1f4521aff77b admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f7d49016d24b0c8188d759d99ba16f, user_id=f7b327cf288848e2b241c128f627b194, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:49.032344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84610aed-4824-485f-8be5-1f4521aff77b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:49.059312 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1758/3504] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:53:48 2022] PUT /identity/v3/projects/99f7d49016d24b0c8188d759d99ba16f/users/f7b327cf288848e2b241c128f627b194/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:53:49.064455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84610aed-4824-485f-8be5-1f4521aff77b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:49.234820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff5b0a-87af-4b6a-8bc3-c17669b22dc7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:49.378777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84610aed-4824-485f-8be5-1f4521aff77b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:49.399606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7645571-0038-4c2f-81da-d7a1f6cd4198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:49.400044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7645571-0038-4c2f-81da-d7a1f6cd4198 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:49.400318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7645571-0038-4c2f-81da-d7a1f6cd4198 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:49.400592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7645571-0038-4c2f-81da-d7a1f6cd4198 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:49.401262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7645571-0038-4c2f-81da-d7a1f6cd4198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:49.402858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7645571-0038-4c2f-81da-d7a1f6cd4198 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:49.410164 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:53:49.431649 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1759/3505] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:53:49.439448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7645571-0038-4c2f-81da-d7a1f6cd4198 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:49.461862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e1dc6-e25f-40d0-b65a-fdc4f283024d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:49.462690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e1dc6-e25f-40d0-b65a-fdc4f283024d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:49.462813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e1dc6-e25f-40d0-b65a-fdc4f283024d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:49.463029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e1dc6-e25f-40d0-b65a-fdc4f283024d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:49.484536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7645571-0038-4c2f-81da-d7a1f6cd4198 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:49.510899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e1dc6-e25f-40d0-b65a-fdc4f283024d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:49.512340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e1dc6-e25f-40d0-b65a-fdc4f283024d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:49.523251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914bf907-cccd-4eff-8138-409d5de0f242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:49.524014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bf907-cccd-4eff-8138-409d5de0f242 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:49.524301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bf907-cccd-4eff-8138-409d5de0f242 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:49.524714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bf907-cccd-4eff-8138-409d5de0f242 admin admin] PATH_INFO: `/v3/projects/99f7d49016d24b0c8188d759d99ba16f/users/f7b327cf288848e2b241c128f627b194/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:49.535122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bf907-cccd-4eff-8138-409d5de0f242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f7d49016d24b0c8188d759d99ba16f, user_id=f7b327cf288848e2b241c128f627b194, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:49.549958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bf907-cccd-4eff-8138-409d5de0f242 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:49.555142 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1747/3506] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:53:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:53:49.594538 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1760/3507] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:53:49 2022] PUT /identity/v3/projects/99f7d49016d24b0c8188d759d99ba16f/users/f7b327cf288848e2b241c128f627b194/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:53:49.605289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd0187-69a6-4d9f-9fe6-2cb49fec00e0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:49.605572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd0187-69a6-4d9f-9fe6-2cb49fec00e0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:49.605920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd0187-69a6-4d9f-9fe6-2cb49fec00e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:49.744103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-45bd0187-69a6-4d9f-9fe6-2cb49fec00e0 None None] MFA Rules not processed for user `f7b327cf288848e2b241c128f627b194`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:53:49.745539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-45bd0187-69a6-4d9f-9fe6-2cb49fec00e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:49.878235 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:53:50.010991 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1748/3508] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:53:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:53:50.030230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437d734-347b-43f2-a9ce-34b1cd77c519 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:50.030845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437d734-347b-43f2-a9ce-34b1cd77c519 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:50.031573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437d734-347b-43f2-a9ce-34b1cd77c519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:50.091002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3437d734-347b-43f2-a9ce-34b1cd77c519 None None] MFA Rules not processed for user `60912bd5bfdf451ea7348b8372ba1a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:53:50.093972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3437d734-347b-43f2-a9ce-34b1cd77c519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:50.337575 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1761/3509] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:53:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:53:51.135881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd0187-69a6-4d9f-9fe6-2cb49fec00e0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:51.137414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-45bd0187-69a6-4d9f-9fe6-2cb49fec00e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:51.292452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd0187-69a6-4d9f-9fe6-2cb49fec00e0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:51.308585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8b655-2f9b-48a5-8c6a-257a09780742 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:51.309401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8b655-2f9b-48a5-8c6a-257a09780742 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:51.309685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8b655-2f9b-48a5-8c6a-257a09780742 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:51.309955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8b655-2f9b-48a5-8c6a-257a09780742 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:51.327846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8b655-2f9b-48a5-8c6a-257a09780742 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:51.330148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8b655-2f9b-48a5-8c6a-257a09780742 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:51.350618 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1749/3510] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:53:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:53:52.242428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e2fb7-b843-457b-a133-65fd0002f738 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:52.243061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e2fb7-b843-457b-a133-65fd0002f738 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:52.243632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e2fb7-b843-457b-a133-65fd0002f738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:52.338053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-160e2fb7-b843-457b-a133-65fd0002f738 None None] MFA Rules not processed for user `960e2646c3174ad084c85b6de1e01822`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:53:52.348840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-160e2fb7-b843-457b-a133-65fd0002f738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:52.562101 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1762/3511] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:53:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:53:54.430921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8b655-2f9b-48a5-8c6a-257a09780742 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:54.433738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d7a8b655-2f9b-48a5-8c6a-257a09780742 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:54.674953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135837f9-4b60-41ed-817c-6ba6072dd437 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:54.675463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135837f9-4b60-41ed-817c-6ba6072dd437 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:54.675576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135837f9-4b60-41ed-817c-6ba6072dd437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:54.677611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8b655-2f9b-48a5-8c6a-257a09780742 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:54.707875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2b205-cb7f-4111-af5e-0b404b749284 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:54.708496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2b205-cb7f-4111-af5e-0b404b749284 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:54.708801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2b205-cb7f-4111-af5e-0b404b749284 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:54.709075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2b205-cb7f-4111-af5e-0b404b749284 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:54.718949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7cc2b205-cb7f-4111-af5e-0b404b749284 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:54.762062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2b205-cb7f-4111-af5e-0b404b749284 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:54.764182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2b205-cb7f-4111-af5e-0b404b749284 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:54.773445 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-135837f9-4b60-41ed-817c-6ba6072dd437 None None] MFA Rules not processed for user `2c9fe8a9c72c44d78f68f90c4f5a43f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:53:54.776061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-135837f9-4b60-41ed-817c-6ba6072dd437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:54.800630 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1750/3512] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:53:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:53:55.021477 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1763/3513] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:53:54 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:53:55.033787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b6f6c-3b36-41c2-97a7-c5ef922feaa5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:55.034175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b6f6c-3b36-41c2-97a7-c5ef922feaa5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:55.034525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b6f6c-3b36-41c2-97a7-c5ef922feaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:55.093523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-479b6f6c-3b36-41c2-97a7-c5ef922feaa5 None None] MFA Rules not processed for user `2c9fe8a9c72c44d78f68f90c4f5a43f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:53:55.094898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-479b6f6c-3b36-41c2-97a7-c5ef922feaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:55.109057 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1751/3514] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:53:55 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:53:56.526703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135837f9-4b60-41ed-817c-6ba6072dd437 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:56.551630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135837f9-4b60-41ed-817c-6ba6072dd437 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:56.594932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d82fc-3d7b-4e0c-a0c0-b5362c5ab18c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:56.598920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d82fc-3d7b-4e0c-a0c0-b5362c5ab18c service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:56.599402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d82fc-3d7b-4e0c-a0c0-b5362c5ab18c service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:56.601006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d82fc-3d7b-4e0c-a0c0-b5362c5ab18c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:56.630420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d82fc-3d7b-4e0c-a0c0-b5362c5ab18c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:56.632219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d82fc-3d7b-4e0c-a0c0-b5362c5ab18c service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:56.678306 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1764/3515] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:53:56 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:53:56.990715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7bca2-e76f-4092-939d-584e4f34daa3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:56.991673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7bca2-e76f-4092-939d-584e4f34daa3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:56.992209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7bca2-e76f-4092-939d-584e4f34daa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:57.032748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-91c7bca2-e76f-4092-939d-584e4f34daa3 None None] MFA Rules not processed for user `b4a7050533994b60aa3f7bb63b732dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:53:57.035711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-91c7bca2-e76f-4092-939d-584e4f34daa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:57.094832 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:53:57.109485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d82fc-3d7b-4e0c-a0c0-b5362c5ab18c service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:57.129749 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:53:57.218267 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1752/3516] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:53:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:53:57.334233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d82fc-3d7b-4e0c-a0c0-b5362c5ab18c service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:57.343959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec718c5a-330d-4db0-9d20-e00e67a1c2d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:57.345594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec718c5a-330d-4db0-9d20-e00e67a1c2d2 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:57.349009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec718c5a-330d-4db0-9d20-e00e67a1c2d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:57.349472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec718c5a-330d-4db0-9d20-e00e67a1c2d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:57.353361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ec718c5a-330d-4db0-9d20-e00e67a1c2d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:57.392786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec718c5a-330d-4db0-9d20-e00e67a1c2d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:57.394510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec718c5a-330d-4db0-9d20-e00e67a1c2d2 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:57.422734 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1765/3517] 10.222.0.16 () {60 vars in 1396 bytes} [Fri Sep 30 09:53:57 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:53:59.273260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7bca2-e76f-4092-939d-584e4f34daa3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:53:59.275178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-91c7bca2-e76f-4092-939d-584e4f34daa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:53:59.490005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7bca2-e76f-4092-939d-584e4f34daa3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:53:59.506313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666e8d5-18c2-4a83-910e-63e4c7b32f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:53:59.506313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666e8d5-18c2-4a83-910e-63e4c7b32f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:53:59.506313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666e8d5-18c2-4a83-910e-63e4c7b32f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:53:59.506313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666e8d5-18c2-4a83-910e-63e4c7b32f46 admin admin] PATH_INFO: `/v3/users/c26f9d3b86a0437099ccab2a856e6238` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:53:59.506671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666e8d5-18c2-4a83-910e-63e4c7b32f46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c26f9d3b86a0437099ccab2a856e6238)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:53:59.507373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666e8d5-18c2-4a83-910e-63e4c7b32f46 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:53:59.647300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a666e8d5-18c2-4a83-910e-63e4c7b32f46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c26f9d3b86a0437099ccab2a856e6238'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:59.670375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a666e8d5-18c2-4a83-910e-63e4c7b32f46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c26f9d3b86a0437099ccab2a856e6238'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:59.671021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a666e8d5-18c2-4a83-910e-63e4c7b32f46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c26f9d3b86a0437099ccab2a856e6238'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:59.708370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a666e8d5-18c2-4a83-910e-63e4c7b32f46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c26f9d3b86a0437099ccab2a856e6238'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:59.735676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a666e8d5-18c2-4a83-910e-63e4c7b32f46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c26f9d3b86a0437099ccab2a856e6238'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:53:59.759891 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1753/3518] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:53:59 2022] DELETE /identity/v3/users/c26f9d3b86a0437099ccab2a856e6238 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:54:02.381613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec718c5a-330d-4db0-9d20-e00e67a1c2d2 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:02.401161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec718c5a-330d-4db0-9d20-e00e67a1c2d2 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:02.620003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a33ff-0744-440d-bf1b-2446b726242b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:02.624038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a33ff-0744-440d-bf1b-2446b726242b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:02.625215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a33ff-0744-440d-bf1b-2446b726242b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:02.625743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a33ff-0744-440d-bf1b-2446b726242b admin admin] PATH_INFO: `/v3/projects/d860a42bb7804eff89447661d4150383` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:02.629220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a33ff-0744-440d-bf1b-2446b726242b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d860a42bb7804eff89447661d4150383)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:02.633397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a33ff-0744-440d-bf1b-2446b726242b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:02.808509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-200a33ff-0744-440d-bf1b-2446b726242b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd860a42bb7804eff89447661d4150383', 'request_id': 'req-200a33ff-0744-440d-bf1b-2446b726242b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:02.835271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-200a33ff-0744-440d-bf1b-2446b726242b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd860a42bb7804eff89447661d4150383', 'request_id': 'req-200a33ff-0744-440d-bf1b-2446b726242b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:02.847886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-200a33ff-0744-440d-bf1b-2446b726242b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd860a42bb7804eff89447661d4150383', 'request_id': 'req-200a33ff-0744-440d-bf1b-2446b726242b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:02.869117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-200a33ff-0744-440d-bf1b-2446b726242b admin admin] The token cache is being invalidate because project d860a42bb7804eff89447661d4150383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:54:02.869502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-200a33ff-0744-440d-bf1b-2446b726242b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:02.870219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-200a33ff-0744-440d-bf1b-2446b726242b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:02.872254 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1766/3519] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:54:02 2022] DELETE /identity/v3/projects/d860a42bb7804eff89447661d4150383 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:54:02.877836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2938ed-3b2d-4cef-9b43-a4977605d893 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:02.878345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2938ed-3b2d-4cef-9b43-a4977605d893 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:02.878773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2938ed-3b2d-4cef-9b43-a4977605d893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:02.921882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7e2938ed-3b2d-4cef-9b43-a4977605d893 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:54:02.924016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7e2938ed-3b2d-4cef-9b43-a4977605d893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:03.062997 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1754/3520] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:54:03.070630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82276c-67eb-4707-b16b-170bab15e066 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:03.070927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82276c-67eb-4707-b16b-170bab15e066 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:03.071223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82276c-67eb-4707-b16b-170bab15e066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:03.132774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-aa82276c-67eb-4707-b16b-170bab15e066 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:54:03.136732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-aa82276c-67eb-4707-b16b-170bab15e066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:03.158435 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1767/3521] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:54:03.160761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2938ed-3b2d-4cef-9b43-a4977605d893 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:03.166435 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:54:03.178358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2938ed-3b2d-4cef-9b43-a4977605d893 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:03.189654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a139fb3-c7ab-4b18-9c42-3a2935def35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:03.194859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a139fb3-c7ab-4b18-9c42-3a2935def35a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:03.196541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a139fb3-c7ab-4b18-9c42-3a2935def35a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:03.197065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a139fb3-c7ab-4b18-9c42-3a2935def35a admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:03.202303 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a139fb3-c7ab-4b18-9c42-3a2935def35a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:54:03.203162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a139fb3-c7ab-4b18-9c42-3a2935def35a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:03.207340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a139fb3-c7ab-4b18-9c42-3a2935def35a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:03.239343 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1755/3522] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:54:03.243365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82276c-67eb-4707-b16b-170bab15e066 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:03.256323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82276c-67eb-4707-b16b-170bab15e066 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:03.262806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a711ad-c474-41fe-8e35-475e2c000ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:03.263827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a711ad-c474-41fe-8e35-475e2c000ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:03.264395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a711ad-c474-41fe-8e35-475e2c000ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:03.264942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a711ad-c474-41fe-8e35-475e2c000ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:03.266195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a711ad-c474-41fe-8e35-475e2c000ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:03.268823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a711ad-c474-41fe-8e35-475e2c000ad2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:03.320139 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1768/3523] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:54:03 2022] POST /identity/v3/projects => generated 359 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:54:03.323836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a139fb3-c7ab-4b18-9c42-3a2935def35a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:03.344855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a139fb3-c7ab-4b18-9c42-3a2935def35a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:03.485463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b84cd6-131a-42f3-b4d1-a920a46ceb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:03.488433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b84cd6-131a-42f3-b4d1-a920a46ceb98 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:03.488847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b84cd6-131a-42f3-b4d1-a920a46ceb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:03.489253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b84cd6-131a-42f3-b4d1-a920a46ceb98 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:03.490219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b84cd6-131a-42f3-b4d1-a920a46ceb98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:03.498612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b84cd6-131a-42f3-b4d1-a920a46ceb98 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:03.545644 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1756/3524] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:54:03 2022] POST /identity/v3/users => generated 280 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:54:03.552039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a711ad-c474-41fe-8e35-475e2c000ad2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:03.570018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a711ad-c474-41fe-8e35-475e2c000ad2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:03.575807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7f50a-a477-4035-8adf-d40403b36603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:03.577996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7f50a-a477-4035-8adf-d40403b36603 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:03.578596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7f50a-a477-4035-8adf-d40403b36603 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:03.579071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7f50a-a477-4035-8adf-d40403b36603 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:03.579958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7f50a-a477-4035-8adf-d40403b36603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:03.581862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7f50a-a477-4035-8adf-d40403b36603 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:03.599203 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1769/3525] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:54:03.602671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b84cd6-131a-42f3-b4d1-a920a46ceb98 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:03.619349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b84cd6-131a-42f3-b4d1-a920a46ceb98 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:03.633604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f76af-298c-4c19-8318-2f7a2f4d90e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:03.634335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f76af-298c-4c19-8318-2f7a2f4d90e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:03.634682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f76af-298c-4c19-8318-2f7a2f4d90e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:03.635026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f76af-298c-4c19-8318-2f7a2f4d90e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:03.635685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f76af-298c-4c19-8318-2f7a2f4d90e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:03.639661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f76af-298c-4c19-8318-2f7a2f4d90e1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:03.674630 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1757/3526] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:54:03.675577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7f50a-a477-4035-8adf-d40403b36603 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:03.681796 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:54:03.691011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7f50a-a477-4035-8adf-d40403b36603 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:03.715715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6dd4c-168e-45c5-a4a1-f2158642c074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:03.716986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6dd4c-168e-45c5-a4a1-f2158642c074 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:03.719972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6dd4c-168e-45c5-a4a1-f2158642c074 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:03.720364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6dd4c-168e-45c5-a4a1-f2158642c074 admin admin] PATH_INFO: `/v3/projects/76d2238f4cbc4d1786114113f4841857/users/5c06c0b7cb5e49a3be23226d2f855da1/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:03.783375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6dd4c-168e-45c5-a4a1-f2158642c074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d2238f4cbc4d1786114113f4841857, user_id=5c06c0b7cb5e49a3be23226d2f855da1, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:03.791497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6dd4c-168e-45c5-a4a1-f2158642c074 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:03.829496 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1770/3527] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:54:03 2022] PUT /identity/v3/projects/76d2238f4cbc4d1786114113f4841857/users/5c06c0b7cb5e49a3be23226d2f855da1/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:54:03.833118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b60d0-5e68-4228-a2c1-1f40b3a01a9b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:03.833609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b60d0-5e68-4228-a2c1-1f40b3a01a9b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:03.834034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b60d0-5e68-4228-a2c1-1f40b3a01a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:03.907474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7c6b60d0-5e68-4228-a2c1-1f40b3a01a9b None None] MFA Rules not processed for user `5c06c0b7cb5e49a3be23226d2f855da1`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:54:03.908757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7c6b60d0-5e68-4228-a2c1-1f40b3a01a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:04.083526 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1758/3528] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:54:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:54:04.090657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6dd4c-168e-45c5-a4a1-f2158642c074 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:04.092558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3ce6dd4c-168e-45c5-a4a1-f2158642c074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:04.287982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6dd4c-168e-45c5-a4a1-f2158642c074 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:04.304526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfaac64-ba13-439c-b488-8756e464ccc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:04.305180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfaac64-ba13-439c-b488-8756e464ccc6 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:04.305460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfaac64-ba13-439c-b488-8756e464ccc6 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:04.305732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfaac64-ba13-439c-b488-8756e464ccc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:04.331649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfaac64-ba13-439c-b488-8756e464ccc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:04.337500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfaac64-ba13-439c-b488-8756e464ccc6 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:04.374353 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1771/3529] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:54:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:54:04.510731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b60d0-5e68-4228-a2c1-1f40b3a01a9b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:04.710979 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:54:04.718704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b60d0-5e68-4228-a2c1-1f40b3a01a9b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:04.730878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88238d3d-4277-47d8-86d7-2e0e22c9001a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:04.731612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88238d3d-4277-47d8-86d7-2e0e22c9001a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:04.732539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88238d3d-4277-47d8-86d7-2e0e22c9001a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:04.736012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88238d3d-4277-47d8-86d7-2e0e22c9001a admin admin] PATH_INFO: `/v3/users/5c06c0b7cb5e49a3be23226d2f855da1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:04.745945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88238d3d-4277-47d8-86d7-2e0e22c9001a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c06c0b7cb5e49a3be23226d2f855da1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:04.766424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88238d3d-4277-47d8-86d7-2e0e22c9001a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:04.927318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-88238d3d-4277-47d8-86d7-2e0e22c9001a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c06c0b7cb5e49a3be23226d2f855da1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:04.964418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-88238d3d-4277-47d8-86d7-2e0e22c9001a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c06c0b7cb5e49a3be23226d2f855da1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:04.965143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-88238d3d-4277-47d8-86d7-2e0e22c9001a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c06c0b7cb5e49a3be23226d2f855da1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:05.016314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-88238d3d-4277-47d8-86d7-2e0e22c9001a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c06c0b7cb5e49a3be23226d2f855da1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:05.040042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-88238d3d-4277-47d8-86d7-2e0e22c9001a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c06c0b7cb5e49a3be23226d2f855da1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:05.064693 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1759/3530] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:54:04 2022] DELETE /identity/v3/users/5c06c0b7cb5e49a3be23226d2f855da1 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:54:05.071698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5215d-1066-4d48-a790-4741c82fbd4e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:05.073133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5215d-1066-4d48-a790-4741c82fbd4e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:05.073545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5215d-1066-4d48-a790-4741c82fbd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:05.156361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1ab5215d-1066-4d48-a790-4741c82fbd4e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:54:05.158639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1ab5215d-1066-4d48-a790-4741c82fbd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:05.345504 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1772/3531] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:54:05.387480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88238d3d-4277-47d8-86d7-2e0e22c9001a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:05.392827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-88238d3d-4277-47d8-86d7-2e0e22c9001a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:05.611635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88238d3d-4277-47d8-86d7-2e0e22c9001a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:05.626158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a6974-9e43-4b39-873b-9be4a422c825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:05.626798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a6974-9e43-4b39-873b-9be4a422c825 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:05.627071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a6974-9e43-4b39-873b-9be4a422c825 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:05.627333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a6974-9e43-4b39-873b-9be4a422c825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:05.651849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a6974-9e43-4b39-873b-9be4a422c825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:05.654372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a6974-9e43-4b39-873b-9be4a422c825 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:05.672812 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1760/3532] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:54:06.602773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e14fc-a564-4308-9868-42f8c89d294f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:06.604474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e14fc-a564-4308-9868-42f8c89d294f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:06.604876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e14fc-a564-4308-9868-42f8c89d294f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:06.669202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-413e14fc-a564-4308-9868-42f8c89d294f None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:54:06.672003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-413e14fc-a564-4308-9868-42f8c89d294f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:06.774325 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1773/3533] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:54:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:54:06.789361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a6974-9e43-4b39-873b-9be4a422c825 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:06.791754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1d4a6974-9e43-4b39-873b-9be4a422c825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:06.896191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a6974-9e43-4b39-873b-9be4a422c825 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:06.908687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722a6ac-f2b8-4851-be29-24607b137526 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:06.909352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722a6ac-f2b8-4851-be29-24607b137526 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:06.909592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722a6ac-f2b8-4851-be29-24607b137526 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:06.909857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722a6ac-f2b8-4851-be29-24607b137526 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:06.932689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722a6ac-f2b8-4851-be29-24607b137526 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:06.934596 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722a6ac-f2b8-4851-be29-24607b137526 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:06.963896 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1761/3534] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:54:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:54:09.045479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e14fc-a564-4308-9868-42f8c89d294f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:09.047629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-413e14fc-a564-4308-9868-42f8c89d294f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:09.087616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e14fc-a564-4308-9868-42f8c89d294f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:09.117081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b61bf-a646-4164-89a4-7e7ca616c1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:09.118071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b61bf-a646-4164-89a4-7e7ca616c1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:09.118495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b61bf-a646-4164-89a4-7e7ca616c1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:09.118929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b61bf-a646-4164-89a4-7e7ca616c1a0 admin admin] PATH_INFO: `/v3/projects/76d2238f4cbc4d1786114113f4841857` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:09.124398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b61bf-a646-4164-89a4-7e7ca616c1a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d2238f4cbc4d1786114113f4841857)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:09.133420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b61bf-a646-4164-89a4-7e7ca616c1a0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:09.146608 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:54:09.334628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c94b61bf-a646-4164-89a4-7e7ca616c1a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d2238f4cbc4d1786114113f4841857', 'request_id': 'req-c94b61bf-a646-4164-89a4-7e7ca616c1a0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:09.356163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c94b61bf-a646-4164-89a4-7e7ca616c1a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d2238f4cbc4d1786114113f4841857', 'request_id': 'req-c94b61bf-a646-4164-89a4-7e7ca616c1a0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:09.371627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c94b61bf-a646-4164-89a4-7e7ca616c1a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d2238f4cbc4d1786114113f4841857', 'request_id': 'req-c94b61bf-a646-4164-89a4-7e7ca616c1a0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:09.420496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c94b61bf-a646-4164-89a4-7e7ca616c1a0 admin admin] The token cache is being invalidate because project 76d2238f4cbc4d1786114113f4841857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:54:09.420824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c94b61bf-a646-4164-89a4-7e7ca616c1a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:09.425094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c94b61bf-a646-4164-89a4-7e7ca616c1a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:09.429715 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1774/3535] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:54:09 2022] DELETE /identity/v3/projects/76d2238f4cbc4d1786114113f4841857 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:54:09.434629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b660db-fc74-45db-8839-21edfa33a0b6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:09.435821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b660db-fc74-45db-8839-21edfa33a0b6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:09.436258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b660db-fc74-45db-8839-21edfa33a0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:09.487505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c5b660db-fc74-45db-8839-21edfa33a0b6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:54:09.488948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c5b660db-fc74-45db-8839-21edfa33a0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:09.497266 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:54:09.750063 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1762/3536] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:54:09.763013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21ff8e-6534-45e7-a676-40cfacc59a3e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:09.763013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21ff8e-6534-45e7-a676-40cfacc59a3e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:09.763772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21ff8e-6534-45e7-a676-40cfacc59a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:09.837192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8b21ff8e-6534-45e7-a676-40cfacc59a3e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:54:09.838511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8b21ff8e-6534-45e7-a676-40cfacc59a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:09.885526 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1775/3537] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:54:09.887612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b660db-fc74-45db-8839-21edfa33a0b6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:09.915890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b660db-fc74-45db-8839-21edfa33a0b6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:09.949699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aef49a-d3b8-48c6-a7b6-78a4cbfe9971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:09.950499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aef49a-d3b8-48c6-a7b6-78a4cbfe9971 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:09.951125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aef49a-d3b8-48c6-a7b6-78a4cbfe9971 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:09.952672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aef49a-d3b8-48c6-a7b6-78a4cbfe9971 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:09.954363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aef49a-d3b8-48c6-a7b6-78a4cbfe9971 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:54:09.965295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aef49a-d3b8-48c6-a7b6-78a4cbfe9971 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:09.967528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aef49a-d3b8-48c6-a7b6-78a4cbfe9971 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:10.043502 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1763/3538] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:54:10.049488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21ff8e-6534-45e7-a676-40cfacc59a3e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:10.064286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21ff8e-6534-45e7-a676-40cfacc59a3e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:10.081827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646e1f7-affd-46a9-a23b-a99de2f2d027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:10.086427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646e1f7-affd-46a9-a23b-a99de2f2d027 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:10.088940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646e1f7-affd-46a9-a23b-a99de2f2d027 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:10.089416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646e1f7-affd-46a9-a23b-a99de2f2d027 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:10.092017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646e1f7-affd-46a9-a23b-a99de2f2d027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:10.112228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646e1f7-affd-46a9-a23b-a99de2f2d027 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:10.243705 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1776/3539] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:54:10 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:54:10.248214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aef49a-d3b8-48c6-a7b6-78a4cbfe9971 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:10.266028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aef49a-d3b8-48c6-a7b6-78a4cbfe9971 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:10.496913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a22db-5108-4c3b-8b56-87eb8d9b08f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:10.498621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a22db-5108-4c3b-8b56-87eb8d9b08f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:10.499126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a22db-5108-4c3b-8b56-87eb8d9b08f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:10.499611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a22db-5108-4c3b-8b56-87eb8d9b08f4 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:10.500481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a22db-5108-4c3b-8b56-87eb8d9b08f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:10.510855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a22db-5108-4c3b-8b56-87eb8d9b08f4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:10.590841 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1764/3540] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:54:10 2022] POST /identity/v3/users => generated 289 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:54:10.595649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646e1f7-affd-46a9-a23b-a99de2f2d027 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:10.626468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646e1f7-affd-46a9-a23b-a99de2f2d027 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:10.648003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d75e3-7921-48cc-9cec-b3a054cda2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:10.648808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d75e3-7921-48cc-9cec-b3a054cda2bf admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:10.649328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d75e3-7921-48cc-9cec-b3a054cda2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:10.649816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d75e3-7921-48cc-9cec-b3a054cda2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:10.650845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d75e3-7921-48cc-9cec-b3a054cda2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:10.653219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d75e3-7921-48cc-9cec-b3a054cda2bf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:10.691609 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1777/3541] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:54:10.695812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a22db-5108-4c3b-8b56-87eb8d9b08f4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:10.711149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a22db-5108-4c3b-8b56-87eb8d9b08f4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:10.737713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffaa9e5-c740-42eb-8ad6-7b3dc782238b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:10.738595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffaa9e5-c740-42eb-8ad6-7b3dc782238b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:10.738984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffaa9e5-c740-42eb-8ad6-7b3dc782238b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:10.739361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffaa9e5-c740-42eb-8ad6-7b3dc782238b admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:10.740269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffaa9e5-c740-42eb-8ad6-7b3dc782238b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:10.742145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffaa9e5-c740-42eb-8ad6-7b3dc782238b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:10.790379 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1765/3542] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:54:10.795254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d75e3-7921-48cc-9cec-b3a054cda2bf admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:10.821683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d75e3-7921-48cc-9cec-b3a054cda2bf admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:10.855058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e38df1-32e0-4ead-8a14-af90e4d1e9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:10.855991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e38df1-32e0-4ead-8a14-af90e4d1e9a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:10.858416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e38df1-32e0-4ead-8a14-af90e4d1e9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:10.858866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e38df1-32e0-4ead-8a14-af90e4d1e9a8 admin admin] PATH_INFO: `/v3/projects/ee6a3a7c62ec4313ae9a0b358716b772/users/18dcc5a7fa5e4d41b0d50cffb5972d58/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:10.917711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e38df1-32e0-4ead-8a14-af90e4d1e9a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6a3a7c62ec4313ae9a0b358716b772, user_id=18dcc5a7fa5e4d41b0d50cffb5972d58, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:10.917711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e38df1-32e0-4ead-8a14-af90e4d1e9a8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:10.963011 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1778/3543] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:54:10 2022] PUT /identity/v3/projects/ee6a3a7c62ec4313ae9a0b358716b772/users/18dcc5a7fa5e4d41b0d50cffb5972d58/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:54:10.968870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373147cb-8db8-4a73-927b-17fc397b540f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:10.969295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373147cb-8db8-4a73-927b-17fc397b540f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:10.969675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373147cb-8db8-4a73-927b-17fc397b540f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:11.017937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-373147cb-8db8-4a73-927b-17fc397b540f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:54:11.019381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-373147cb-8db8-4a73-927b-17fc397b540f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:11.227348 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1766/3544] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:54:11.247632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e38df1-32e0-4ead-8a14-af90e4d1e9a8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:11.250829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-38e38df1-32e0-4ead-8a14-af90e4d1e9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:11.485268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e38df1-32e0-4ead-8a14-af90e4d1e9a8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:11.501362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f0c9e-81f3-4f70-9268-2fc15b131a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:11.502335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f0c9e-81f3-4f70-9268-2fc15b131a7b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:11.502930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f0c9e-81f3-4f70-9268-2fc15b131a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:11.503504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f0c9e-81f3-4f70-9268-2fc15b131a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:11.531227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f0c9e-81f3-4f70-9268-2fc15b131a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:11.535626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f0c9e-81f3-4f70-9268-2fc15b131a7b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:11.579728 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1779/3545] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:54:15.617579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373147cb-8db8-4a73-927b-17fc397b540f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:15.620718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-373147cb-8db8-4a73-927b-17fc397b540f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:15.659661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373147cb-8db8-4a73-927b-17fc397b540f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:15.672308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67cd679-e0cf-475f-bf0a-b172b3a8a25d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:15.673470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67cd679-e0cf-475f-bf0a-b172b3a8a25d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:15.675237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67cd679-e0cf-475f-bf0a-b172b3a8a25d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:15.675688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67cd679-e0cf-475f-bf0a-b172b3a8a25d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:15.681840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e67cd679-e0cf-475f-bf0a-b172b3a8a25d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:15.717589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67cd679-e0cf-475f-bf0a-b172b3a8a25d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:15.719139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67cd679-e0cf-475f-bf0a-b172b3a8a25d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:15.748024 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1767/3546] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:54:17.767556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f0c9e-81f3-4f70-9268-2fc15b131a7b service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:17.769110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a37f0c9e-81f3-4f70-9268-2fc15b131a7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:17.873564 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:54:17.998594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f0c9e-81f3-4f70-9268-2fc15b131a7b service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:18.018887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535611ee-f93e-410d-aafe-1bd3ed8ca45e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:18.020110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535611ee-f93e-410d-aafe-1bd3ed8ca45e service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:18.020367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535611ee-f93e-410d-aafe-1bd3ed8ca45e service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:18.020661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535611ee-f93e-410d-aafe-1bd3ed8ca45e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:18.024199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-535611ee-f93e-410d-aafe-1bd3ed8ca45e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:18.174556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535611ee-f93e-410d-aafe-1bd3ed8ca45e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:18.177778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535611ee-f93e-410d-aafe-1bd3ed8ca45e service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:18.211912 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1780/3547] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:54:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:54:19.069727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7225d6f-5c33-428c-9d84-67dc696f7adf None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:19.070608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7225d6f-5c33-428c-9d84-67dc696f7adf None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:19.070608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7225d6f-5c33-428c-9d84-67dc696f7adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:19.079762 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:54:19.183873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f7225d6f-5c33-428c-9d84-67dc696f7adf None None] MFA Rules not processed for user `869dff6689f7401a92705cda198b5b54`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:54:19.194245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f7225d6f-5c33-428c-9d84-67dc696f7adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:19.434719 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1768/3548] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:54:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:54:20.914730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535611ee-f93e-410d-aafe-1bd3ed8ca45e service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:20.916977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-535611ee-f93e-410d-aafe-1bd3ed8ca45e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:20.949886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535611ee-f93e-410d-aafe-1bd3ed8ca45e service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:20.967909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0956354-ebbc-4e4b-90c7-f7a094308255 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:20.970480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0956354-ebbc-4e4b-90c7-f7a094308255 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:20.970972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0956354-ebbc-4e4b-90c7-f7a094308255 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:20.974402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0956354-ebbc-4e4b-90c7-f7a094308255 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:21.005324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0956354-ebbc-4e4b-90c7-f7a094308255 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:21.008889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0956354-ebbc-4e4b-90c7-f7a094308255 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:21.059119 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1781/3549] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:54:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:54:21.241817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1592f-e76e-4717-8881-8b06fa6322bf None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:21.242417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1592f-e76e-4717-8881-8b06fa6322bf None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:21.242417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1592f-e76e-4717-8881-8b06fa6322bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:21.291329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-66b1592f-e76e-4717-8881-8b06fa6322bf None None] MFA Rules not processed for user `60912bd5bfdf451ea7348b8372ba1a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:54:21.293616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-66b1592f-e76e-4717-8881-8b06fa6322bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:21.371181 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1769/3550] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:54:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:54:22.739740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8ade7-84bc-4f4c-a607-137cae565209 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:22.740214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8ade7-84bc-4f4c-a607-137cae565209 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:22.740482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8ade7-84bc-4f4c-a607-137cae565209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:22.781720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bbe8ade7-84bc-4f4c-a607-137cae565209 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:54:22.782956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bbe8ade7-84bc-4f4c-a607-137cae565209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:22.931776 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1782/3551] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 09:54:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:54:22.951478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1592f-e76e-4717-8881-8b06fa6322bf None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:22.952972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-66b1592f-e76e-4717-8881-8b06fa6322bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:23.089409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1592f-e76e-4717-8881-8b06fa6322bf None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:23.097218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784f147-4e07-47aa-b00e-cf21aee92e99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:23.099359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784f147-4e07-47aa-b00e-cf21aee92e99 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:23.100912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784f147-4e07-47aa-b00e-cf21aee92e99 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:23.101376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784f147-4e07-47aa-b00e-cf21aee92e99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:23.114970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784f147-4e07-47aa-b00e-cf21aee92e99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:23.116529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784f147-4e07-47aa-b00e-cf21aee92e99 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:23.143987 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1770/3552] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:54:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:54:26.800427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59002ff1-4867-492d-9ec8-c9435c97a678 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:26.800913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59002ff1-4867-492d-9ec8-c9435c97a678 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:26.800997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59002ff1-4867-492d-9ec8-c9435c97a678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:26.857792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-59002ff1-4867-492d-9ec8-c9435c97a678 None None] MFA Rules not processed for user `18dcc5a7fa5e4d41b0d50cffb5972d58`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:54:26.865475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-59002ff1-4867-492d-9ec8-c9435c97a678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:26.955880 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:54:26.983099 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1783/3553] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:54:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:54:26.994708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8af69d-989f-4b26-824c-ec1113e7916f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:26.995180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8af69d-989f-4b26-824c-ec1113e7916f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:26.995290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8af69d-989f-4b26-824c-ec1113e7916f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:27.062339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7a8af69d-989f-4b26-824c-ec1113e7916f None None] MFA Rules not processed for user `18dcc5a7fa5e4d41b0d50cffb5972d58`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:54:27.064346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7a8af69d-989f-4b26-824c-ec1113e7916f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:27.079115 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1771/3554] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:54:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:54:27.551368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59002ff1-4867-492d-9ec8-c9435c97a678 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:27.577672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59002ff1-4867-492d-9ec8-c9435c97a678 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:27.587150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4800bff-ee7c-48f0-8570-5eeda66dd633 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:27.587771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4800bff-ee7c-48f0-8570-5eeda66dd633 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:27.588050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4800bff-ee7c-48f0-8570-5eeda66dd633 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:27.588325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4800bff-ee7c-48f0-8570-5eeda66dd633 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:27.598960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4800bff-ee7c-48f0-8570-5eeda66dd633 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:27.600839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4800bff-ee7c-48f0-8570-5eeda66dd633 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:27.624148 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1784/3555] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:54:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:54:28.510548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8af69d-989f-4b26-824c-ec1113e7916f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:28.526233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8af69d-989f-4b26-824c-ec1113e7916f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:28.536672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f9fdd-1aa8-4c32-8561-d0278f002f1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:28.537278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f9fdd-1aa8-4c32-8561-d0278f002f1b service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:28.537553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f9fdd-1aa8-4c32-8561-d0278f002f1b service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:28.537819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f9fdd-1aa8-4c32-8561-d0278f002f1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:28.539571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ce3f9fdd-1aa8-4c32-8561-d0278f002f1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:28.557198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f9fdd-1aa8-4c32-8561-d0278f002f1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:28.558906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f9fdd-1aa8-4c32-8561-d0278f002f1b service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:28.570298 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1772/3556] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:54:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:54:30.119348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ade15-61df-4eb9-b71e-44c8373433a7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:30.119824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ade15-61df-4eb9-b71e-44c8373433a7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:30.119959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ade15-61df-4eb9-b71e-44c8373433a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:30.162145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c71ade15-61df-4eb9-b71e-44c8373433a7 None None] MFA Rules not processed for user `869dff6689f7401a92705cda198b5b54`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:54:30.163402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c71ade15-61df-4eb9-b71e-44c8373433a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:30.195833 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1785/3557] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:54:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:54:38.566338 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:54:40.148370 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=16 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:54:41.361089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f9fdd-1aa8-4c32-8561-d0278f002f1b service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:41.369095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ce3f9fdd-1aa8-4c32-8561-d0278f002f1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:41.405522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f9fdd-1aa8-4c32-8561-d0278f002f1b service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:41.421567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03699f-3363-4152-8713-4f0961018578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:41.425254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03699f-3363-4152-8713-4f0961018578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:41.426093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03699f-3363-4152-8713-4f0961018578 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:41.429656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03699f-3363-4152-8713-4f0961018578 admin admin] PATH_INFO: `/v3/users/5a076b2be9774abf8188efe4c2060dc3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:41.431395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03699f-3363-4152-8713-4f0961018578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a076b2be9774abf8188efe4c2060dc3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:41.433582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03699f-3363-4152-8713-4f0961018578 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:41.553734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ce03699f-3363-4152-8713-4f0961018578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a076b2be9774abf8188efe4c2060dc3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:41.563845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ce03699f-3363-4152-8713-4f0961018578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a076b2be9774abf8188efe4c2060dc3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:41.564744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ce03699f-3363-4152-8713-4f0961018578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a076b2be9774abf8188efe4c2060dc3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:41.602798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ce03699f-3363-4152-8713-4f0961018578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a076b2be9774abf8188efe4c2060dc3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:41.634156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ce03699f-3363-4152-8713-4f0961018578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a076b2be9774abf8188efe4c2060dc3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:41.646316 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1773/3558] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:54:41 2022] DELETE /identity/v3/users/5a076b2be9774abf8188efe4c2060dc3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:54:42.192855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a394bbf-ed91-4ef9-8ca2-f1725fb8f0b4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:42.193379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a394bbf-ed91-4ef9-8ca2-f1725fb8f0b4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:42.193585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a394bbf-ed91-4ef9-8ca2-f1725fb8f0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:42.213466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6a394bbf-ed91-4ef9-8ca2-f1725fb8f0b4 None None] MFA Rules not processed for user `b4a7050533994b60aa3f7bb63b732dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:54:42.214965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6a394bbf-ed91-4ef9-8ca2-f1725fb8f0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:42.281926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03699f-3363-4152-8713-4f0961018578 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:42.283136 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1786/3559] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:54:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:54:42.284447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ce03699f-3363-4152-8713-4f0961018578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:42.404139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03699f-3363-4152-8713-4f0961018578 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:42.409445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12761f-b018-4e9e-a07a-dcf1c7326292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:42.410195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12761f-b018-4e9e-a07a-dcf1c7326292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:42.410599 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12761f-b018-4e9e-a07a-dcf1c7326292 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:42.410972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12761f-b018-4e9e-a07a-dcf1c7326292 admin admin] PATH_INFO: `/v3/projects/ce591c889212491bbf17238d4f4a4f8f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:42.412245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12761f-b018-4e9e-a07a-dcf1c7326292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce591c889212491bbf17238d4f4a4f8f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:42.414578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12761f-b018-4e9e-a07a-dcf1c7326292 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:42.510698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d12761f-b018-4e9e-a07a-dcf1c7326292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce591c889212491bbf17238d4f4a4f8f', 'request_id': 'req-1d12761f-b018-4e9e-a07a-dcf1c7326292'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:42.520376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d12761f-b018-4e9e-a07a-dcf1c7326292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce591c889212491bbf17238d4f4a4f8f', 'request_id': 'req-1d12761f-b018-4e9e-a07a-dcf1c7326292'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:42.536005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d12761f-b018-4e9e-a07a-dcf1c7326292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce591c889212491bbf17238d4f4a4f8f', 'request_id': 'req-1d12761f-b018-4e9e-a07a-dcf1c7326292'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:42.550127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d12761f-b018-4e9e-a07a-dcf1c7326292 admin admin] The token cache is being invalidate because project ce591c889212491bbf17238d4f4a4f8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:54:42.550416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d12761f-b018-4e9e-a07a-dcf1c7326292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:42.551238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d12761f-b018-4e9e-a07a-dcf1c7326292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:42.553138 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1774/3560] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:54:42 2022] DELETE /identity/v3/projects/ce591c889212491bbf17238d4f4a4f8f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:54:42.556979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a394bbf-ed91-4ef9-8ca2-f1725fb8f0b4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:42.571385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a394bbf-ed91-4ef9-8ca2-f1725fb8f0b4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:42.699767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbd8b9-b537-4ef2-a26d-d4a5f0787ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:42.701442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbd8b9-b537-4ef2-a26d-d4a5f0787ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:42.701736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbd8b9-b537-4ef2-a26d-d4a5f0787ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:42.702101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbd8b9-b537-4ef2-a26d-d4a5f0787ce2 admin admin] PATH_INFO: `/v3/users/c6e64eff1f724a2bab363ab940fd9e95` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:42.704671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbd8b9-b537-4ef2-a26d-d4a5f0787ce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e64eff1f724a2bab363ab940fd9e95)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:42.707607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbd8b9-b537-4ef2-a26d-d4a5f0787ce2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:42.782443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c4fbd8b9-b537-4ef2-a26d-d4a5f0787ce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e64eff1f724a2bab363ab940fd9e95'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:42.783127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c4fbd8b9-b537-4ef2-a26d-d4a5f0787ce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e64eff1f724a2bab363ab940fd9e95'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:42.793533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c4fbd8b9-b537-4ef2-a26d-d4a5f0787ce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e64eff1f724a2bab363ab940fd9e95'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:42.809221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c4fbd8b9-b537-4ef2-a26d-d4a5f0787ce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e64eff1f724a2bab363ab940fd9e95'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:42.817815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c4fbd8b9-b537-4ef2-a26d-d4a5f0787ce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e64eff1f724a2bab363ab940fd9e95'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:42.829279 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1787/3561] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:54:42 2022] DELETE /identity/v3/users/c6e64eff1f724a2bab363ab940fd9e95 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:54:43.382929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12761f-b018-4e9e-a07a-dcf1c7326292 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:43.385975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1d12761f-b018-4e9e-a07a-dcf1c7326292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:43.420764 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:54:43.460733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12761f-b018-4e9e-a07a-dcf1c7326292 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:43.595260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea23bea-9cb7-40f0-a40f-8a900988c339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:43.596292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea23bea-9cb7-40f0-a40f-8a900988c339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:43.596799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea23bea-9cb7-40f0-a40f-8a900988c339 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:43.597287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea23bea-9cb7-40f0-a40f-8a900988c339 admin admin] PATH_INFO: `/v3/projects/43a06af1f9f04458ba3917aa0db18e12` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:43.600311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea23bea-9cb7-40f0-a40f-8a900988c339 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43a06af1f9f04458ba3917aa0db18e12)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:43.603595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea23bea-9cb7-40f0-a40f-8a900988c339 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:43.692361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3ea23bea-9cb7-40f0-a40f-8a900988c339 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43a06af1f9f04458ba3917aa0db18e12', 'request_id': 'req-3ea23bea-9cb7-40f0-a40f-8a900988c339'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:43.716899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3ea23bea-9cb7-40f0-a40f-8a900988c339 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43a06af1f9f04458ba3917aa0db18e12', 'request_id': 'req-3ea23bea-9cb7-40f0-a40f-8a900988c339'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:43.732108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3ea23bea-9cb7-40f0-a40f-8a900988c339 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43a06af1f9f04458ba3917aa0db18e12', 'request_id': 'req-3ea23bea-9cb7-40f0-a40f-8a900988c339'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:43.759153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3ea23bea-9cb7-40f0-a40f-8a900988c339 admin admin] The token cache is being invalidate because project 43a06af1f9f04458ba3917aa0db18e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:54:43.759640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3ea23bea-9cb7-40f0-a40f-8a900988c339 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:43.761869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3ea23bea-9cb7-40f0-a40f-8a900988c339 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:54:43.764268 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1775/3562] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:54:43 2022] DELETE /identity/v3/projects/43a06af1f9f04458ba3917aa0db18e12 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:54:43.769651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb587914-1621-4b81-ba8f-11be38353046 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:43.770710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb587914-1621-4b81-ba8f-11be38353046 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:43.771239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb587914-1621-4b81-ba8f-11be38353046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:43.802529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bb587914-1621-4b81-ba8f-11be38353046 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:54:43.805043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bb587914-1621-4b81-ba8f-11be38353046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:43.830653 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:54:43.896648 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1788/3563] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:54:43.901533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8af93-3979-4f8e-961b-9fbcaf0cca7a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:43.902155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8af93-3979-4f8e-961b-9fbcaf0cca7a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:43.902634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8af93-3979-4f8e-961b-9fbcaf0cca7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:43.956715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8af8af93-3979-4f8e-961b-9fbcaf0cca7a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:54:43.958486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8af8af93-3979-4f8e-961b-9fbcaf0cca7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:43.970784 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1776/3564] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:54:43.975838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb587914-1621-4b81-ba8f-11be38353046 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:43.992064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb587914-1621-4b81-ba8f-11be38353046 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:43.998966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b419c-d2a4-4ff4-8b32-a9effcc295ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:44.000666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b419c-d2a4-4ff4-8b32-a9effcc295ad admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:44.001215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b419c-d2a4-4ff4-8b32-a9effcc295ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:44.001808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b419c-d2a4-4ff4-8b32-a9effcc295ad admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:44.002770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b419c-d2a4-4ff4-8b32-a9effcc295ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:54:44.003142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b419c-d2a4-4ff4-8b32-a9effcc295ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:44.004937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b419c-d2a4-4ff4-8b32-a9effcc295ad admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:44.020240 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1789/3565] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:54:44.024838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8af93-3979-4f8e-961b-9fbcaf0cca7a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:44.036262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8af93-3979-4f8e-961b-9fbcaf0cca7a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:44.043348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1600db-f133-47f1-8614-c3735c613947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:44.045519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1600db-f133-47f1-8614-c3735c613947 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:44.046156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1600db-f133-47f1-8614-c3735c613947 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:44.046898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1600db-f133-47f1-8614-c3735c613947 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:44.047888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1600db-f133-47f1-8614-c3735c613947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:44.054339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1600db-f133-47f1-8614-c3735c613947 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:44.117423 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1777/3566] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:54:44 2022] POST /identity/v3/projects => generated 397 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:54:44.121357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b419c-d2a4-4ff4-8b32-a9effcc295ad admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:44.135606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b419c-d2a4-4ff4-8b32-a9effcc295ad admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:44.231291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d73b7-45ac-42a1-b8e7-947ce89aef14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:44.231947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d73b7-45ac-42a1-b8e7-947ce89aef14 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:44.232410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d73b7-45ac-42a1-b8e7-947ce89aef14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:44.232699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d73b7-45ac-42a1-b8e7-947ce89aef14 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:44.233332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d73b7-45ac-42a1-b8e7-947ce89aef14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:44.235793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d73b7-45ac-42a1-b8e7-947ce89aef14 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:44.261630 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1790/3567] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:54:44 2022] POST /identity/v3/users => generated 299 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:54:44.266872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1600db-f133-47f1-8614-c3735c613947 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:44.279034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1600db-f133-47f1-8614-c3735c613947 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:44.283909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa49dc-86c7-47cf-a088-382a5ea5a969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:44.284530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa49dc-86c7-47cf-a088-382a5ea5a969 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:44.284831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa49dc-86c7-47cf-a088-382a5ea5a969 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:44.285285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa49dc-86c7-47cf-a088-382a5ea5a969 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:44.285945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa49dc-86c7-47cf-a088-382a5ea5a969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:44.287554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa49dc-86c7-47cf-a088-382a5ea5a969 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:44.298601 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1778/3568] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:54:44.302809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d73b7-45ac-42a1-b8e7-947ce89aef14 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:44.314334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d73b7-45ac-42a1-b8e7-947ce89aef14 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:44.319872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ee027-1beb-4190-8392-49cb0b796e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:44.320472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ee027-1beb-4190-8392-49cb0b796e2a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:44.320777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ee027-1beb-4190-8392-49cb0b796e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:44.321042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ee027-1beb-4190-8392-49cb0b796e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:44.321678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ee027-1beb-4190-8392-49cb0b796e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:44.323232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ee027-1beb-4190-8392-49cb0b796e2a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:44.341102 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1791/3569] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:54:44.341447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa49dc-86c7-47cf-a088-382a5ea5a969 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:44.355098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa49dc-86c7-47cf-a088-382a5ea5a969 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:44.361160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f1f04-052b-4b49-a0fd-356028e5a811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:44.361897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f1f04-052b-4b49-a0fd-356028e5a811 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:44.362242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f1f04-052b-4b49-a0fd-356028e5a811 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:44.362601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f1f04-052b-4b49-a0fd-356028e5a811 admin admin] PATH_INFO: `/v3/projects/6c1010b173ae464195e2c04b6c417d70/users/4e7945103e674992b91ee745472499c7/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:44.384549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f1f04-052b-4b49-a0fd-356028e5a811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c1010b173ae464195e2c04b6c417d70, user_id=4e7945103e674992b91ee745472499c7, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:44.387641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f1f04-052b-4b49-a0fd-356028e5a811 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:44.413200 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1779/3570] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:54:44 2022] PUT /identity/v3/projects/6c1010b173ae464195e2c04b6c417d70/users/4e7945103e674992b91ee745472499c7/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:54:44.419566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99070cf8-1871-408a-a092-d83ff500cf50 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:44.419952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99070cf8-1871-408a-a092-d83ff500cf50 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:44.420307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99070cf8-1871-408a-a092-d83ff500cf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:44.447766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-99070cf8-1871-408a-a092-d83ff500cf50 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:54:44.448541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-99070cf8-1871-408a-a092-d83ff500cf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:44.546077 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1792/3571] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:54:44.567853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f1f04-052b-4b49-a0fd-356028e5a811 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:44.570543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-204f1f04-052b-4b49-a0fd-356028e5a811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:44.651545 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:54:44.703096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f1f04-052b-4b49-a0fd-356028e5a811 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:44.712107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d2524-90f4-48f5-b8c5-933fafe2ab53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:44.712763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d2524-90f4-48f5-b8c5-933fafe2ab53 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:44.713046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d2524-90f4-48f5-b8c5-933fafe2ab53 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:44.716922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d2524-90f4-48f5-b8c5-933fafe2ab53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:44.754711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d2524-90f4-48f5-b8c5-933fafe2ab53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:44.756162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d2524-90f4-48f5-b8c5-933fafe2ab53 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:44.792635 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1780/3572] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:54:45.753959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88a2de-912f-4211-97fb-14fab430f05b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:45.754481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88a2de-912f-4211-97fb-14fab430f05b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:45.754481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88a2de-912f-4211-97fb-14fab430f05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:45.796570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-db88a2de-912f-4211-97fb-14fab430f05b None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:54:45.801184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-db88a2de-912f-4211-97fb-14fab430f05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:45.858791 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:54:45.917187 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1793/3573] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:54:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:54:45.943850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d2524-90f4-48f5-b8c5-933fafe2ab53 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:45.946132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-826d2524-90f4-48f5-b8c5-933fafe2ab53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:46.036284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d2524-90f4-48f5-b8c5-933fafe2ab53 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:46.045813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6555c9-b3a6-49ad-802c-6c02c141e59e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:46.046750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6555c9-b3a6-49ad-802c-6c02c141e59e service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:46.047221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6555c9-b3a6-49ad-802c-6c02c141e59e service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:46.047676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6555c9-b3a6-49ad-802c-6c02c141e59e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:46.069167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6555c9-b3a6-49ad-802c-6c02c141e59e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:46.076428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6555c9-b3a6-49ad-802c-6c02c141e59e service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:46.114215 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1781/3574] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:54:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:54:46.408619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bde8a5-69db-4e29-a2f5-49591a67052c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:46.408909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bde8a5-69db-4e29-a2f5-49591a67052c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:46.409184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bde8a5-69db-4e29-a2f5-49591a67052c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:46.498765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-16bde8a5-69db-4e29-a2f5-49591a67052c None None] MFA Rules not processed for user `60912bd5bfdf451ea7348b8372ba1a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:54:46.515796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-16bde8a5-69db-4e29-a2f5-49591a67052c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:46.870698 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1794/3575] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:54:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:54:54.877973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6555c9-b3a6-49ad-802c-6c02c141e59e service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:54:54.893862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6555c9-b3a6-49ad-802c-6c02c141e59e service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:54:54.906855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cc401-8892-4961-b0a8-df5cf9dd4f33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:54:54.907940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cc401-8892-4961-b0a8-df5cf9dd4f33 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:54:54.908446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cc401-8892-4961-b0a8-df5cf9dd4f33 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:54:54.908964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cc401-8892-4961-b0a8-df5cf9dd4f33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:54:54.926533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-437cc401-8892-4961-b0a8-df5cf9dd4f33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:54:54.961360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cc401-8892-4961-b0a8-df5cf9dd4f33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:54:54.964886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cc401-8892-4961-b0a8-df5cf9dd4f33 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:54:54.997567 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1782/3576] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:54:56.829705 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=36 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:55:00.034393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eaacf-a433-4c61-8c2f-9c69fabb5954 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:00.034951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eaacf-a433-4c61-8c2f-9c69fabb5954 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:00.035166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eaacf-a433-4c61-8c2f-9c69fabb5954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:00.064514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-427eaacf-a433-4c61-8c2f-9c69fabb5954 None None] MFA Rules not processed for user `18dcc5a7fa5e4d41b0d50cffb5972d58`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:55:00.067238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-427eaacf-a433-4c61-8c2f-9c69fabb5954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:00.216317 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1795/3577] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:55:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:55:02.251926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cc401-8892-4961-b0a8-df5cf9dd4f33 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:02.254445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-437cc401-8892-4961-b0a8-df5cf9dd4f33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:02.299641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cc401-8892-4961-b0a8-df5cf9dd4f33 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:02.319042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3f3aa-3185-4bbd-a7a7-8f1a55148d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:02.319972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3f3aa-3185-4bbd-a7a7-8f1a55148d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:02.320407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3f3aa-3185-4bbd-a7a7-8f1a55148d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:02.321022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3f3aa-3185-4bbd-a7a7-8f1a55148d0c admin admin] PATH_INFO: `/v3/users/2c9fe8a9c72c44d78f68f90c4f5a43f6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:02.322401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3f3aa-3185-4bbd-a7a7-8f1a55148d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c9fe8a9c72c44d78f68f90c4f5a43f6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:02.329278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3f3aa-3185-4bbd-a7a7-8f1a55148d0c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:02.530590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49d3f3aa-3185-4bbd-a7a7-8f1a55148d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c9fe8a9c72c44d78f68f90c4f5a43f6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:02.549052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49d3f3aa-3185-4bbd-a7a7-8f1a55148d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c9fe8a9c72c44d78f68f90c4f5a43f6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:02.549810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49d3f3aa-3185-4bbd-a7a7-8f1a55148d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c9fe8a9c72c44d78f68f90c4f5a43f6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:02.596290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49d3f3aa-3185-4bbd-a7a7-8f1a55148d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c9fe8a9c72c44d78f68f90c4f5a43f6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:02.613298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49d3f3aa-3185-4bbd-a7a7-8f1a55148d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c9fe8a9c72c44d78f68f90c4f5a43f6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:02.630676 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1783/3578] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:55:02 2022] DELETE /identity/v3/users/2c9fe8a9c72c44d78f68f90c4f5a43f6 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:55:03.244022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427eaacf-a433-4c61-8c2f-9c69fabb5954 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:03.280722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427eaacf-a433-4c61-8c2f-9c69fabb5954 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:03.464878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb570e-fd48-4267-9d92-7633de69db83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:03.465658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb570e-fd48-4267-9d92-7633de69db83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:03.465942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb570e-fd48-4267-9d92-7633de69db83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:03.466227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb570e-fd48-4267-9d92-7633de69db83 admin admin] PATH_INFO: `/v3/projects/0a6ef5c205c94e6e93d221479e40e3ed` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:03.469107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb570e-fd48-4267-9d92-7633de69db83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a6ef5c205c94e6e93d221479e40e3ed)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:03.471059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb570e-fd48-4267-9d92-7633de69db83 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:03.552115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-45cb570e-fd48-4267-9d92-7633de69db83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6ef5c205c94e6e93d221479e40e3ed', 'request_id': 'req-45cb570e-fd48-4267-9d92-7633de69db83'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:03.562121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-45cb570e-fd48-4267-9d92-7633de69db83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6ef5c205c94e6e93d221479e40e3ed', 'request_id': 'req-45cb570e-fd48-4267-9d92-7633de69db83'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:03.573142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-45cb570e-fd48-4267-9d92-7633de69db83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6ef5c205c94e6e93d221479e40e3ed', 'request_id': 'req-45cb570e-fd48-4267-9d92-7633de69db83'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:03.590860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-45cb570e-fd48-4267-9d92-7633de69db83 admin admin] The token cache is being invalidate because project 0a6ef5c205c94e6e93d221479e40e3ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:55:03.591355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-45cb570e-fd48-4267-9d92-7633de69db83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:03.592448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-45cb570e-fd48-4267-9d92-7633de69db83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:03.598821 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1796/3579] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:55:03 2022] DELETE /identity/v3/projects/0a6ef5c205c94e6e93d221479e40e3ed => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:55:03.600676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc65277-43a5-4523-9e21-b9ac0a9697ee None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:03.601138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc65277-43a5-4523-9e21-b9ac0a9697ee None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:03.601138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc65277-43a5-4523-9e21-b9ac0a9697ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:03.647748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5cc65277-43a5-4523-9e21-b9ac0a9697ee None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:55:03.650782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5cc65277-43a5-4523-9e21-b9ac0a9697ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:03.706053 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:55:03.835502 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1784/3580] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:55:03.836959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000b68a-65e0-45e0-87b9-2592c8d138e7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:03.837325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000b68a-65e0-45e0-87b9-2592c8d138e7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:03.837676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000b68a-65e0-45e0-87b9-2592c8d138e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:03.864020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e000b68a-65e0-45e0-87b9-2592c8d138e7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:55:03.865834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e000b68a-65e0-45e0-87b9-2592c8d138e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:03.878317 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1797/3581] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:55:03.882400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc65277-43a5-4523-9e21-b9ac0a9697ee None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:03.893705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc65277-43a5-4523-9e21-b9ac0a9697ee None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:03.904021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd231f4-975a-4d34-a42a-9250317c5393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:03.904906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd231f4-975a-4d34-a42a-9250317c5393 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:03.905188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd231f4-975a-4d34-a42a-9250317c5393 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:03.905456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd231f4-975a-4d34-a42a-9250317c5393 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:03.906110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd231f4-975a-4d34-a42a-9250317c5393 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:55:03.906407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd231f4-975a-4d34-a42a-9250317c5393 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:03.907990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd231f4-975a-4d34-a42a-9250317c5393 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:03.950815 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1785/3582] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:55:03.951830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000b68a-65e0-45e0-87b9-2592c8d138e7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:03.965187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000b68a-65e0-45e0-87b9-2592c8d138e7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:03.971767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef83348-7d0b-4d34-a69e-4ad5e7d74df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:03.973482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef83348-7d0b-4d34-a69e-4ad5e7d74df1 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:03.974151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef83348-7d0b-4d34-a69e-4ad5e7d74df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:03.974592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef83348-7d0b-4d34-a69e-4ad5e7d74df1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:03.975757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef83348-7d0b-4d34-a69e-4ad5e7d74df1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:03.979668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef83348-7d0b-4d34-a69e-4ad5e7d74df1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:04.036491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd231f4-975a-4d34-a42a-9250317c5393 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:04.044634 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1798/3583] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:55:03 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:55:04.049119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd231f4-975a-4d34-a42a-9250317c5393 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:04.256792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca9e39-b234-48f8-8652-c71a9f1133e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:04.257412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca9e39-b234-48f8-8652-c71a9f1133e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:04.257685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca9e39-b234-48f8-8652-c71a9f1133e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:04.257953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca9e39-b234-48f8-8652-c71a9f1133e9 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:04.258591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca9e39-b234-48f8-8652-c71a9f1133e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:04.260469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca9e39-b234-48f8-8652-c71a9f1133e9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:04.351204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef83348-7d0b-4d34-a69e-4ad5e7d74df1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:04.361675 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1786/3584] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:55:04 2022] POST /identity/v3/users => generated 288 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:55:04.367375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef83348-7d0b-4d34-a69e-4ad5e7d74df1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:04.384667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28cd94-32fc-48aa-8b59-3033ab17bba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:04.385360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28cd94-32fc-48aa-8b59-3033ab17bba6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:04.385940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28cd94-32fc-48aa-8b59-3033ab17bba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:04.386460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28cd94-32fc-48aa-8b59-3033ab17bba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:04.388047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28cd94-32fc-48aa-8b59-3033ab17bba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:04.389830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28cd94-32fc-48aa-8b59-3033ab17bba6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:04.395057 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:55:04.424373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca9e39-b234-48f8-8652-c71a9f1133e9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:04.436720 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1799/3585] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:55:04.440533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca9e39-b234-48f8-8652-c71a9f1133e9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:04.453644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf2deb-b169-4adc-9b17-762ddf1cef5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:04.454515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf2deb-b169-4adc-9b17-762ddf1cef5f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:04.454794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf2deb-b169-4adc-9b17-762ddf1cef5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:04.455118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf2deb-b169-4adc-9b17-762ddf1cef5f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:04.455820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf2deb-b169-4adc-9b17-762ddf1cef5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:04.459302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf2deb-b169-4adc-9b17-762ddf1cef5f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:04.483735 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1787/3586] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:55:04.488039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28cd94-32fc-48aa-8b59-3033ab17bba6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:04.504026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28cd94-32fc-48aa-8b59-3033ab17bba6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:04.517498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21a4fb-f511-48dc-8343-6937ef7096c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:04.518788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21a4fb-f511-48dc-8343-6937ef7096c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:04.519077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21a4fb-f511-48dc-8343-6937ef7096c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:04.519349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21a4fb-f511-48dc-8343-6937ef7096c6 admin admin] PATH_INFO: `/v3/projects/ce900c0ab99047bc97aae82156c0f4f0/users/b6bb092e5df84a378019856b329ef7bb/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:04.544860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21a4fb-f511-48dc-8343-6937ef7096c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce900c0ab99047bc97aae82156c0f4f0, user_id=b6bb092e5df84a378019856b329ef7bb, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:04.549371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21a4fb-f511-48dc-8343-6937ef7096c6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:04.582819 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1800/3587] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:55:04 2022] PUT /identity/v3/projects/ce900c0ab99047bc97aae82156c0f4f0/users/b6bb092e5df84a378019856b329ef7bb/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:55:04.584900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb8b04-b19e-4985-baa1-5fb3b3b94b40 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:04.585364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb8b04-b19e-4985-baa1-5fb3b3b94b40 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:04.585871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb8b04-b19e-4985-baa1-5fb3b3b94b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:04.614840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-abdb8b04-b19e-4985-baa1-5fb3b3b94b40 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:55:04.623791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-abdb8b04-b19e-4985-baa1-5fb3b3b94b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:04.862928 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1788/3588] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:55:04.895464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21a4fb-f511-48dc-8343-6937ef7096c6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:04.898890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2f21a4fb-f511-48dc-8343-6937ef7096c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:05.117484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21a4fb-f511-48dc-8343-6937ef7096c6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:05.142191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84290ac6-be41-40f8-bf56-95fe4363ef07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:05.145741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84290ac6-be41-40f8-bf56-95fe4363ef07 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:05.147727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84290ac6-be41-40f8-bf56-95fe4363ef07 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:05.148006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84290ac6-be41-40f8-bf56-95fe4363ef07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:05.186471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84290ac6-be41-40f8-bf56-95fe4363ef07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:05.192569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84290ac6-be41-40f8-bf56-95fe4363ef07 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:05.239119 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1801/3589] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:55:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:55:05.991532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d36b7-925f-45eb-b7e8-f1a9418e13eb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:05.993685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d36b7-925f-45eb-b7e8-f1a9418e13eb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:05.994112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d36b7-925f-45eb-b7e8-f1a9418e13eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:06.071243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f26d36b7-925f-45eb-b7e8-f1a9418e13eb None None] MFA Rules not processed for user `4e7945103e674992b91ee745472499c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:55:06.072757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f26d36b7-925f-45eb-b7e8-f1a9418e13eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:06.116883 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:55:06.302233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd744c4-da2d-4a99-a34b-f95bfdaf7dd4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:06.302834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd744c4-da2d-4a99-a34b-f95bfdaf7dd4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:06.302961 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1789/3590] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:55:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:55:06.303548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd744c4-da2d-4a99-a34b-f95bfdaf7dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:06.356729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1fd744c4-da2d-4a99-a34b-f95bfdaf7dd4 None None] MFA Rules not processed for user `4e7945103e674992b91ee745472499c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:55:06.358356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1fd744c4-da2d-4a99-a34b-f95bfdaf7dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:06.380687 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1802/3591] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:55:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:55:06.893279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d36b7-925f-45eb-b7e8-f1a9418e13eb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:06.895087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f26d36b7-925f-45eb-b7e8-f1a9418e13eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:07.190202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d36b7-925f-45eb-b7e8-f1a9418e13eb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:07.222310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b83d8-3bee-4c71-a5ae-354fcad2d308 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:07.222831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b83d8-3bee-4c71-a5ae-354fcad2d308 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:07.223120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b83d8-3bee-4c71-a5ae-354fcad2d308 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:07.223397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b83d8-3bee-4c71-a5ae-354fcad2d308 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:07.259977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b83d8-3bee-4c71-a5ae-354fcad2d308 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:07.274685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b83d8-3bee-4c71-a5ae-354fcad2d308 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:07.308496 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1790/3592] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:55:06 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:55:14.156158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd744c4-da2d-4a99-a34b-f95bfdaf7dd4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:14.158986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1fd744c4-da2d-4a99-a34b-f95bfdaf7dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:14.211097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b83d8-3bee-4c71-a5ae-354fcad2d308 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:14.212567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-865b83d8-3bee-4c71-a5ae-354fcad2d308 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:14.238457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b83d8-3bee-4c71-a5ae-354fcad2d308 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:14.250085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a6281-0869-4344-97d6-fde524457f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:14.251084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6281-0869-4344-97d6-fde524457f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:14.252072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6281-0869-4344-97d6-fde524457f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:14.252547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6281-0869-4344-97d6-fde524457f44 admin admin] PATH_INFO: `/v3/users/960e2646c3174ad084c85b6de1e01822` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:14.253957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a6281-0869-4344-97d6-fde524457f44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=960e2646c3174ad084c85b6de1e01822)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:14.260293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a6281-0869-4344-97d6-fde524457f44 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:14.326801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd744c4-da2d-4a99-a34b-f95bfdaf7dd4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:14.344678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9fd17-35a0-4f15-9e7e-6eb561c6f21c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:14.346821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9fd17-35a0-4f15-9e7e-6eb561c6f21c service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:14.348297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9fd17-35a0-4f15-9e7e-6eb561c6f21c service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:14.349405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9fd17-35a0-4f15-9e7e-6eb561c6f21c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:14.354465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4fb9fd17-35a0-4f15-9e7e-6eb561c6f21c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:14.377421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ec0a6281-0869-4344-97d6-fde524457f44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '960e2646c3174ad084c85b6de1e01822'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:14.392426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9fd17-35a0-4f15-9e7e-6eb561c6f21c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:14.395828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ec0a6281-0869-4344-97d6-fde524457f44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '960e2646c3174ad084c85b6de1e01822'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:14.409254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ec0a6281-0869-4344-97d6-fde524457f44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '960e2646c3174ad084c85b6de1e01822'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:14.410590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9fd17-35a0-4f15-9e7e-6eb561c6f21c service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:14.468635 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1803/3593] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:55:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:55:14.471938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ec0a6281-0869-4344-97d6-fde524457f44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '960e2646c3174ad084c85b6de1e01822'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:14.495714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ec0a6281-0869-4344-97d6-fde524457f44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '960e2646c3174ad084c85b6de1e01822'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:14.508894 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1791/3594] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:55:14 2022] DELETE /identity/v3/users/960e2646c3174ad084c85b6de1e01822 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:55:16.015780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9fd17-35a0-4f15-9e7e-6eb561c6f21c service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:16.067627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9fd17-35a0-4f15-9e7e-6eb561c6f21c service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:16.242181 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:55:16.257384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c679cc-356d-403a-8183-cee6342b02be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:16.268289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c679cc-356d-403a-8183-cee6342b02be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:16.269004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c679cc-356d-403a-8183-cee6342b02be admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:16.269525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c679cc-356d-403a-8183-cee6342b02be admin admin] PATH_INFO: `/v3/projects/86832fed25514bc385749c1a02b08fbe` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:16.271108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c679cc-356d-403a-8183-cee6342b02be admin admin] RBAC: Authorizing `identity:delete_project(project_id=86832fed25514bc385749c1a02b08fbe)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:16.273590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c679cc-356d-403a-8183-cee6342b02be admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:16.342457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1c679cc-356d-403a-8183-cee6342b02be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86832fed25514bc385749c1a02b08fbe', 'request_id': 'req-b1c679cc-356d-403a-8183-cee6342b02be'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:16.357079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1c679cc-356d-403a-8183-cee6342b02be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86832fed25514bc385749c1a02b08fbe', 'request_id': 'req-b1c679cc-356d-403a-8183-cee6342b02be'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:16.371524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1c679cc-356d-403a-8183-cee6342b02be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86832fed25514bc385749c1a02b08fbe', 'request_id': 'req-b1c679cc-356d-403a-8183-cee6342b02be'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:16.387467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1c679cc-356d-403a-8183-cee6342b02be admin admin] The token cache is being invalidate because project 86832fed25514bc385749c1a02b08fbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:55:16.387833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1c679cc-356d-403a-8183-cee6342b02be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:16.388507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1c679cc-356d-403a-8183-cee6342b02be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:16.395326 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1804/3595] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:55:16 2022] DELETE /identity/v3/projects/86832fed25514bc385749c1a02b08fbe => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:55:16.396987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ac9a2-a807-4233-8949-fd086ff063bf None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:16.397459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ac9a2-a807-4233-8949-fd086ff063bf None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:16.397675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ac9a2-a807-4233-8949-fd086ff063bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:16.426935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7e1ac9a2-a807-4233-8949-fd086ff063bf None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:55:16.428438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7e1ac9a2-a807-4233-8949-fd086ff063bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:16.467662 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:55:16.572093 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1792/3596] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:55:16.573257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67ce84-48ad-4601-b9de-3b862d7aaa66 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:16.574278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67ce84-48ad-4601-b9de-3b862d7aaa66 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:16.574714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67ce84-48ad-4601-b9de-3b862d7aaa66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:16.616643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6d67ce84-48ad-4601-b9de-3b862d7aaa66 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:55:16.617904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6d67ce84-48ad-4601-b9de-3b862d7aaa66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:16.654619 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1805/3597] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:55:16.658101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ac9a2-a807-4233-8949-fd086ff063bf None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:16.674785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ac9a2-a807-4233-8949-fd086ff063bf None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:16.685898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110625d-8e49-4d35-8e68-ab4cbe76fb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:16.686608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110625d-8e49-4d35-8e68-ab4cbe76fb87 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:16.686883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110625d-8e49-4d35-8e68-ab4cbe76fb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:16.687150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110625d-8e49-4d35-8e68-ab4cbe76fb87 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:16.691202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110625d-8e49-4d35-8e68-ab4cbe76fb87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:55:16.691532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110625d-8e49-4d35-8e68-ab4cbe76fb87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:16.700253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110625d-8e49-4d35-8e68-ab4cbe76fb87 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:16.722861 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1793/3598] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:55:16.727243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67ce84-48ad-4601-b9de-3b862d7aaa66 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:16.742915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67ce84-48ad-4601-b9de-3b862d7aaa66 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:16.753707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5e456-7a25-43c1-b2cf-8b3643764ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:16.755573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5e456-7a25-43c1-b2cf-8b3643764ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:16.755862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5e456-7a25-43c1-b2cf-8b3643764ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:16.757139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5e456-7a25-43c1-b2cf-8b3643764ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:16.757811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5e456-7a25-43c1-b2cf-8b3643764ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:16.763801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5e456-7a25-43c1-b2cf-8b3643764ca7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:16.831524 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1806/3599] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:55:16 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:55:16.835319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110625d-8e49-4d35-8e68-ab4cbe76fb87 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:16.850082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110625d-8e49-4d35-8e68-ab4cbe76fb87 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:16.926904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb85e6f-53b7-40a9-8795-2e3f1b4053e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:16.927583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb85e6f-53b7-40a9-8795-2e3f1b4053e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:16.927873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb85e6f-53b7-40a9-8795-2e3f1b4053e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:16.928184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb85e6f-53b7-40a9-8795-2e3f1b4053e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:16.928905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb85e6f-53b7-40a9-8795-2e3f1b4053e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:16.930977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb85e6f-53b7-40a9-8795-2e3f1b4053e7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:16.978781 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1794/3600] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:55:16 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:55:16.983415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5e456-7a25-43c1-b2cf-8b3643764ca7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:17.021552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5e456-7a25-43c1-b2cf-8b3643764ca7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:17.033043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69092a89-bf13-4c7b-8279-eadbc7cbba2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:17.033753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69092a89-bf13-4c7b-8279-eadbc7cbba2a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:17.034230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69092a89-bf13-4c7b-8279-eadbc7cbba2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:17.034621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69092a89-bf13-4c7b-8279-eadbc7cbba2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:17.035451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69092a89-bf13-4c7b-8279-eadbc7cbba2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:17.042171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69092a89-bf13-4c7b-8279-eadbc7cbba2a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:17.086183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb85e6f-53b7-40a9-8795-2e3f1b4053e7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:17.090730 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1807/3601] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:55:17.109047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb85e6f-53b7-40a9-8795-2e3f1b4053e7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:17.130002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ae01d-cca4-443a-bce6-ae3719d91d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:17.131470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ae01d-cca4-443a-bce6-ae3719d91d0c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:17.132083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ae01d-cca4-443a-bce6-ae3719d91d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:17.134772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ae01d-cca4-443a-bce6-ae3719d91d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:17.136591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ae01d-cca4-443a-bce6-ae3719d91d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:17.140750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ae01d-cca4-443a-bce6-ae3719d91d0c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:17.165603 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1795/3602] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:55:17.169901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69092a89-bf13-4c7b-8279-eadbc7cbba2a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:17.183160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69092a89-bf13-4c7b-8279-eadbc7cbba2a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:17.189041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387a10b-1653-4cda-acb4-90346aa58ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:17.189971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387a10b-1653-4cda-acb4-90346aa58ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:17.190669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387a10b-1653-4cda-acb4-90346aa58ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:17.191285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387a10b-1653-4cda-acb4-90346aa58ee6 admin admin] PATH_INFO: `/v3/projects/8cebaec8d08f423f84daed734043d403/users/df38bba9885247a4912244fe62c42650/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:17.217797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387a10b-1653-4cda-acb4-90346aa58ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cebaec8d08f423f84daed734043d403, user_id=df38bba9885247a4912244fe62c42650, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:17.222991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387a10b-1653-4cda-acb4-90346aa58ee6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:17.243248 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1808/3603] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:55:17 2022] PUT /identity/v3/projects/8cebaec8d08f423f84daed734043d403/users/df38bba9885247a4912244fe62c42650/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:55:17.248472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7aca4f-0688-4638-9f71-ea02c1b957c7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:17.249134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7aca4f-0688-4638-9f71-ea02c1b957c7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:17.250250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7aca4f-0688-4638-9f71-ea02c1b957c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:17.290524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1e7aca4f-0688-4638-9f71-ea02c1b957c7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:55:17.293179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1e7aca4f-0688-4638-9f71-ea02c1b957c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:17.406251 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1796/3604] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:55:17.441946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387a10b-1653-4cda-acb4-90346aa58ee6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:17.443864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9387a10b-1653-4cda-acb4-90346aa58ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:17.537089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387a10b-1653-4cda-acb4-90346aa58ee6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:17.542820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a043c-8cb5-42f2-be9a-41969241fb51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:17.544241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a043c-8cb5-42f2-be9a-41969241fb51 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:17.544939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a043c-8cb5-42f2-be9a-41969241fb51 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:17.545435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a043c-8cb5-42f2-be9a-41969241fb51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:17.564585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a043c-8cb5-42f2-be9a-41969241fb51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:17.567043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a043c-8cb5-42f2-be9a-41969241fb51 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:17.582441 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1809/3605] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:55:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:55:23.711554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f1a1b-6305-4f59-b047-2b6005279fd9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:23.712583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f1a1b-6305-4f59-b047-2b6005279fd9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:23.713095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f1a1b-6305-4f59-b047-2b6005279fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:23.759326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a39f1a1b-6305-4f59-b047-2b6005279fd9 None None] MFA Rules not processed for user `60912bd5bfdf451ea7348b8372ba1a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:55:23.763154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a39f1a1b-6305-4f59-b047-2b6005279fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:23.803854 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:55:23.907927 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1797/3606] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:55:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:55:24.506541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0badc-0072-4712-83a5-672f170c7099 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:24.506541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0badc-0072-4712-83a5-672f170c7099 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:24.506541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0badc-0072-4712-83a5-672f170c7099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:24.560010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1ff0badc-0072-4712-83a5-672f170c7099 None None] MFA Rules not processed for user `b6bb092e5df84a378019856b329ef7bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:55:24.561552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1ff0badc-0072-4712-83a5-672f170c7099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:24.582678 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:55:24.633041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089f353-e8ef-4242-a1db-f67e93977dc9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:24.636394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089f353-e8ef-4242-a1db-f67e93977dc9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:24.636898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089f353-e8ef-4242-a1db-f67e93977dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:24.694136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c089f353-e8ef-4242-a1db-f67e93977dc9 None None] MFA Rules not processed for user `df38bba9885247a4912244fe62c42650`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:55:24.695367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c089f353-e8ef-4242-a1db-f67e93977dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:24.789017 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1810/3607] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:55:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:55:24.799427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c52a6d-1fa6-45f1-ba0c-c416142935f6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:24.800125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c52a6d-1fa6-45f1-ba0c-c416142935f6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:24.800553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c52a6d-1fa6-45f1-ba0c-c416142935f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:24.867704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b1c52a6d-1fa6-45f1-ba0c-c416142935f6 None None] MFA Rules not processed for user `b6bb092e5df84a378019856b329ef7bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:55:24.868964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b1c52a6d-1fa6-45f1-ba0c-c416142935f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:24.890953 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1798/3608] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:55:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:55:24.895774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089f353-e8ef-4242-a1db-f67e93977dc9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:24.916443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089f353-e8ef-4242-a1db-f67e93977dc9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:24.928072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900d0e0-aa32-4925-ac31-8d9c61923f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:24.928960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900d0e0-aa32-4925-ac31-8d9c61923f1f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:24.929787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900d0e0-aa32-4925-ac31-8d9c61923f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:24.930237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900d0e0-aa32-4925-ac31-8d9c61923f1f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:24.932319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900d0e0-aa32-4925-ac31-8d9c61923f1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:24.932941 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1811/3609] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:55:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:55:24.937181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900d0e0-aa32-4925-ac31-8d9c61923f1f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:25.027054 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1799/3610] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:55:24 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:55:25.032710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c52a6d-1fa6-45f1-ba0c-c416142935f6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:25.056962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c52a6d-1fa6-45f1-ba0c-c416142935f6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:25.086584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900d0e0-aa32-4925-ac31-8d9c61923f1f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:25.089114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5900d0e0-aa32-4925-ac31-8d9c61923f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:25.209716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a790f4-269e-46f1-8fb1-d8d08c4ee66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:25.210337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a790f4-269e-46f1-8fb1-d8d08c4ee66f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:25.210615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a790f4-269e-46f1-8fb1-d8d08c4ee66f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:25.210881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a790f4-269e-46f1-8fb1-d8d08c4ee66f admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:25.211519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a790f4-269e-46f1-8fb1-d8d08c4ee66f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:25.217620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a790f4-269e-46f1-8fb1-d8d08c4ee66f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:25.267080 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1812/3611] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:55:25 2022] POST /identity/v3/users => generated 295 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:55:25.269793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a790f4-269e-46f1-8fb1-d8d08c4ee66f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:25.272924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900d0e0-aa32-4925-ac31-8d9c61923f1f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:25.293802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a790f4-269e-46f1-8fb1-d8d08c4ee66f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:25.298289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f468d-518d-481f-9fd1-2ef620475c39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:25.298929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f468d-518d-481f-9fd1-2ef620475c39 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:25.299207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f468d-518d-481f-9fd1-2ef620475c39 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:25.299477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f468d-518d-481f-9fd1-2ef620475c39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:25.306308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccfa86-d80a-4a40-9a00-9def48dee873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:25.306887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccfa86-d80a-4a40-9a00-9def48dee873 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:25.307175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccfa86-d80a-4a40-9a00-9def48dee873 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:25.307443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccfa86-d80a-4a40-9a00-9def48dee873 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:25.325745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccfa86-d80a-4a40-9a00-9def48dee873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:25.326758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccfa86-d80a-4a40-9a00-9def48dee873 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:25.350613 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1813/3612] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:55:25.354664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccfa86-d80a-4a40-9a00-9def48dee873 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:25.378133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccfa86-d80a-4a40-9a00-9def48dee873 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:25.378642 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:55:25.400034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8ca00-917e-4cda-b710-5388184dbfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:25.400743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8ca00-917e-4cda-b710-5388184dbfd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:25.401196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8ca00-917e-4cda-b710-5388184dbfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:25.401471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8ca00-917e-4cda-b710-5388184dbfd6 admin admin] PATH_INFO: `/v3/projects/291887ae95d64ec89ba2975df7daeb2a/users/1b60805d3ba4446e8df25fddb6d7f831/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:25.432519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8ca00-917e-4cda-b710-5388184dbfd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=291887ae95d64ec89ba2975df7daeb2a, user_id=1b60805d3ba4446e8df25fddb6d7f831, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:25.434046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f468d-518d-481f-9fd1-2ef620475c39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:25.435259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8ca00-917e-4cda-b710-5388184dbfd6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:25.435990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f468d-518d-481f-9fd1-2ef620475c39 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:25.469586 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1814/3613] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:55:25 2022] PUT /identity/v3/projects/291887ae95d64ec89ba2975df7daeb2a/users/1b60805d3ba4446e8df25fddb6d7f831/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:55:25.472178 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1800/3614] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:55:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:55:25.473319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8ca00-917e-4cda-b710-5388184dbfd6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:25.578012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f452a36-dd39-42ff-b14e-bab7c768962a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:25.578771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f452a36-dd39-42ff-b14e-bab7c768962a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:25.579266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f452a36-dd39-42ff-b14e-bab7c768962a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:25.611612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7f452a36-dd39-42ff-b14e-bab7c768962a None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:55:25.614378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7f452a36-dd39-42ff-b14e-bab7c768962a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:25.706661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8ca00-917e-4cda-b710-5388184dbfd6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:25.724301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b63d00-3ded-4659-87a8-975935d4d778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:25.724984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b63d00-3ded-4659-87a8-975935d4d778 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:25.725264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b63d00-3ded-4659-87a8-975935d4d778 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:25.725536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b63d00-3ded-4659-87a8-975935d4d778 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:25.726201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b63d00-3ded-4659-87a8-975935d4d778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:25.727816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b63d00-3ded-4659-87a8-975935d4d778 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:25.762552 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1801/3615] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:55:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:55:25.765982 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:55:25.778642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f452a36-dd39-42ff-b14e-bab7c768962a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:25.780285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7f452a36-dd39-42ff-b14e-bab7c768962a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:25.811059 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1815/3616] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:55:25.812094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b63d00-3ded-4659-87a8-975935d4d778 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:25.889947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b63d00-3ded-4659-87a8-975935d4d778 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:25.915348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a946e78-6f29-474e-ac7b-8e74de907099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:25.916305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a946e78-6f29-474e-ac7b-8e74de907099 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:25.916781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a946e78-6f29-474e-ac7b-8e74de907099 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:25.917201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a946e78-6f29-474e-ac7b-8e74de907099 admin admin] PATH_INFO: `/v3/projects/291887ae95d64ec89ba2975df7daeb2a/users/1b60805d3ba4446e8df25fddb6d7f831/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:25.924333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a946e78-6f29-474e-ac7b-8e74de907099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=291887ae95d64ec89ba2975df7daeb2a, user_id=1b60805d3ba4446e8df25fddb6d7f831, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:25.941804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a946e78-6f29-474e-ac7b-8e74de907099 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:25.963695 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1816/3617] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:55:25 2022] PUT /identity/v3/projects/291887ae95d64ec89ba2975df7daeb2a/users/1b60805d3ba4446e8df25fddb6d7f831/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:55:26.017714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f452a36-dd39-42ff-b14e-bab7c768962a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:26.139753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0eb9b8-a194-4f44-b71e-ae0472c221f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:26.140483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0eb9b8-a194-4f44-b71e-ae0472c221f5 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:26.140883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0eb9b8-a194-4f44-b71e-ae0472c221f5 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:26.141946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0eb9b8-a194-4f44-b71e-ae0472c221f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:26.166040 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:55:26.221578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0eb9b8-a194-4f44-b71e-ae0472c221f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:26.223624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0eb9b8-a194-4f44-b71e-ae0472c221f5 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:26.258425 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1802/3618] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:55:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 09:55:32.968314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a946e78-6f29-474e-ac7b-8e74de907099 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:32.970833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0a946e78-6f29-474e-ac7b-8e74de907099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:33.132503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a946e78-6f29-474e-ac7b-8e74de907099 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:33.138592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294cfea-76cc-4231-96e9-0c747c582fe5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:33.139532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294cfea-76cc-4231-96e9-0c747c582fe5 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:33.139654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294cfea-76cc-4231-96e9-0c747c582fe5 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:33.139912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294cfea-76cc-4231-96e9-0c747c582fe5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:33.153898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4294cfea-76cc-4231-96e9-0c747c582fe5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:33.170988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294cfea-76cc-4231-96e9-0c747c582fe5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:33.172677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294cfea-76cc-4231-96e9-0c747c582fe5 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:33.212073 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1817/3619] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:55:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:55:36.234030 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=19 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:55:36.493150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0eb9b8-a194-4f44-b71e-ae0472c221f5 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:36.495551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5a0eb9b8-a194-4f44-b71e-ae0472c221f5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:36.558924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0eb9b8-a194-4f44-b71e-ae0472c221f5 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:36.584849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e068cc-37ca-422b-8ded-8fd986d5b5ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:36.586064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e068cc-37ca-422b-8ded-8fd986d5b5ef service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:36.586622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e068cc-37ca-422b-8ded-8fd986d5b5ef service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:36.587177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e068cc-37ca-422b-8ded-8fd986d5b5ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:36.593886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c0e068cc-37ca-422b-8ded-8fd986d5b5ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:36.648218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e068cc-37ca-422b-8ded-8fd986d5b5ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:36.650339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e068cc-37ca-422b-8ded-8fd986d5b5ef service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:36.701383 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1803/3620] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:55:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:55:41.438625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672a176-55ae-44f0-abc2-b921a1fd6b25 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:41.439191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672a176-55ae-44f0-abc2-b921a1fd6b25 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:41.439191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672a176-55ae-44f0-abc2-b921a1fd6b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:41.473700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0672a176-55ae-44f0-abc2-b921a1fd6b25 None None] MFA Rules not processed for user `1b60805d3ba4446e8df25fddb6d7f831`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:55:41.474001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0672a176-55ae-44f0-abc2-b921a1fd6b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:41.555068 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1818/3621] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:55:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:55:41.567893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e068cc-37ca-422b-8ded-8fd986d5b5ef service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:41.569395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c0e068cc-37ca-422b-8ded-8fd986d5b5ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:41.655717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e068cc-37ca-422b-8ded-8fd986d5b5ef service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:41.659358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9193409-9a22-4259-837b-8c98b292e23f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:41.659975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9193409-9a22-4259-837b-8c98b292e23f service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:41.660250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9193409-9a22-4259-837b-8c98b292e23f service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:41.660518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9193409-9a22-4259-837b-8c98b292e23f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:41.782794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9193409-9a22-4259-837b-8c98b292e23f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:41.784483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9193409-9a22-4259-837b-8c98b292e23f service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:41.806662 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1804/3622] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:55:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:55:48.736940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00af16-4130-4b65-8b58-54aa89cea9f1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:48.737880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00af16-4130-4b65-8b58-54aa89cea9f1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:48.738156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00af16-4130-4b65-8b58-54aa89cea9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:48.768977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1a00af16-4130-4b65-8b58-54aa89cea9f1 None None] MFA Rules not processed for user `60912bd5bfdf451ea7348b8372ba1a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:55:48.771189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1a00af16-4130-4b65-8b58-54aa89cea9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:48.894677 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1819/3623] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:55:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:55:51.681076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a0451-9e5a-4413-b226-6fa560d524e3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:51.681967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a0451-9e5a-4413-b226-6fa560d524e3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:51.682399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a0451-9e5a-4413-b226-6fa560d524e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:51.712416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-408a0451-9e5a-4413-b226-6fa560d524e3 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:55:51.716153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-408a0451-9e5a-4413-b226-6fa560d524e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:51.728453 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1805/3624] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 09:55:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:55:51.757953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00af16-4130-4b65-8b58-54aa89cea9f1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:51.773278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00af16-4130-4b65-8b58-54aa89cea9f1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:51.781301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62e2cf-439c-4d27-860d-d40bb81d19d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:51.783080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62e2cf-439c-4d27-860d-d40bb81d19d8 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:51.784284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62e2cf-439c-4d27-860d-d40bb81d19d8 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:51.784666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62e2cf-439c-4d27-860d-d40bb81d19d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:51.793601 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:55:51.801142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62e2cf-439c-4d27-860d-d40bb81d19d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:51.802751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62e2cf-439c-4d27-860d-d40bb81d19d8 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:51.814878 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1820/3625] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:55:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:55:57.292661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a0451-9e5a-4413-b226-6fa560d524e3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:57.295141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-408a0451-9e5a-4413-b226-6fa560d524e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:57.387613 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a0451-9e5a-4413-b226-6fa560d524e3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:57.396731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4087ab-4583-4066-85d4-fd4489368c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:57.397370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4087ab-4583-4066-85d4-fd4489368c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:57.397649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4087ab-4583-4066-85d4-fd4489368c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:57.397915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4087ab-4583-4066-85d4-fd4489368c3d admin admin] PATH_INFO: `/v3/users/4e7945103e674992b91ee745472499c7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:57.399419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4087ab-4583-4066-85d4-fd4489368c3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e7945103e674992b91ee745472499c7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:57.401346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4087ab-4583-4066-85d4-fd4489368c3d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:57.447068 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:55:57.461391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd4087ab-4583-4066-85d4-fd4489368c3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e7945103e674992b91ee745472499c7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:57.470379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd4087ab-4583-4066-85d4-fd4489368c3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e7945103e674992b91ee745472499c7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:57.471197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd4087ab-4583-4066-85d4-fd4489368c3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e7945103e674992b91ee745472499c7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:57.485432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd4087ab-4583-4066-85d4-fd4489368c3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e7945103e674992b91ee745472499c7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:57.494661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd4087ab-4583-4066-85d4-fd4489368c3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e7945103e674992b91ee745472499c7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:57.502066 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1806/3626] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:55:57 2022] DELETE /identity/v3/users/4e7945103e674992b91ee745472499c7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:55:57.720909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62e2cf-439c-4d27-860d-d40bb81d19d8 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:57.732096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62e2cf-439c-4d27-860d-d40bb81d19d8 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:57.849178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efc608-b438-4cf8-889b-c843fcc983c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:57.850194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efc608-b438-4cf8-889b-c843fcc983c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:57.850580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efc608-b438-4cf8-889b-c843fcc983c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:57.850949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efc608-b438-4cf8-889b-c843fcc983c5 admin admin] PATH_INFO: `/v3/projects/6c1010b173ae464195e2c04b6c417d70` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:57.852985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efc608-b438-4cf8-889b-c843fcc983c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c1010b173ae464195e2c04b6c417d70)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:57.855686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efc608-b438-4cf8-889b-c843fcc983c5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:57.928995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-53efc608-b438-4cf8-889b-c843fcc983c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c1010b173ae464195e2c04b6c417d70', 'request_id': 'req-53efc608-b438-4cf8-889b-c843fcc983c5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:57.941663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-53efc608-b438-4cf8-889b-c843fcc983c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c1010b173ae464195e2c04b6c417d70', 'request_id': 'req-53efc608-b438-4cf8-889b-c843fcc983c5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:57.950270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-53efc608-b438-4cf8-889b-c843fcc983c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c1010b173ae464195e2c04b6c417d70', 'request_id': 'req-53efc608-b438-4cf8-889b-c843fcc983c5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:57.978483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-53efc608-b438-4cf8-889b-c843fcc983c5 admin admin] The token cache is being invalidate because project 6c1010b173ae464195e2c04b6c417d70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:55:57.978779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-53efc608-b438-4cf8-889b-c843fcc983c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:57.990875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-53efc608-b438-4cf8-889b-c843fcc983c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:57.995565 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1821/3627] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:55:57 2022] DELETE /identity/v3/projects/6c1010b173ae464195e2c04b6c417d70 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:55:58.003577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d8564-c2c3-4e68-b5fc-6648d93a054c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:58.003970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d8564-c2c3-4e68-b5fc-6648d93a054c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:58.004175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d8564-c2c3-4e68-b5fc-6648d93a054c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:58.048548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-033d8564-c2c3-4e68-b5fc-6648d93a054c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:55:58.050719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-033d8564-c2c3-4e68-b5fc-6648d93a054c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:58.179472 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1807/3628] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:55:58.188695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d507eb-8711-4b16-a18d-7c750633c41e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:58.188983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d507eb-8711-4b16-a18d-7c750633c41e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:58.189304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d507eb-8711-4b16-a18d-7c750633c41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:58.227084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c6d507eb-8711-4b16-a18d-7c750633c41e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:55:58.228585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c6d507eb-8711-4b16-a18d-7c750633c41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:58.245775 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1822/3629] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:55:58.246978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d8564-c2c3-4e68-b5fc-6648d93a054c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:58.265558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d8564-c2c3-4e68-b5fc-6648d93a054c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:58.273691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3ec19-c925-45e9-81ef-6182836c1566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:58.274322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3ec19-c925-45e9-81ef-6182836c1566 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:58.275157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3ec19-c925-45e9-81ef-6182836c1566 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:58.275157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3ec19-c925-45e9-81ef-6182836c1566 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:58.275509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3ec19-c925-45e9-81ef-6182836c1566 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:55:58.275813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3ec19-c925-45e9-81ef-6182836c1566 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:58.280225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3ec19-c925-45e9-81ef-6182836c1566 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:58.306937 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1808/3630] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:55:58.311992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d507eb-8711-4b16-a18d-7c750633c41e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:58.325233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d507eb-8711-4b16-a18d-7c750633c41e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:58.337124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ead764-7670-4814-a5f2-d6fb8bcf64fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:58.337732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ead764-7670-4814-a5f2-d6fb8bcf64fe admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:58.338224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ead764-7670-4814-a5f2-d6fb8bcf64fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:58.338707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ead764-7670-4814-a5f2-d6fb8bcf64fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:58.339860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ead764-7670-4814-a5f2-d6fb8bcf64fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:58.343069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ead764-7670-4814-a5f2-d6fb8bcf64fe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:58.406758 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1823/3631] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:55:58 2022] POST /identity/v3/projects => generated 405 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:55:58.410971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3ec19-c925-45e9-81ef-6182836c1566 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:58.425366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3ec19-c925-45e9-81ef-6182836c1566 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:58.520250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27dd40-8575-4598-b028-a0ed27de7007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:58.523975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27dd40-8575-4598-b028-a0ed27de7007 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:58.524811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27dd40-8575-4598-b028-a0ed27de7007 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:58.525262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27dd40-8575-4598-b028-a0ed27de7007 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:58.526159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27dd40-8575-4598-b028-a0ed27de7007 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:58.529388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27dd40-8575-4598-b028-a0ed27de7007 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:58.607544 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1809/3632] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:55:58 2022] POST /identity/v3/users => generated 303 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:55:58.609008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ead764-7670-4814-a5f2-d6fb8bcf64fe admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:58.627712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ead764-7670-4814-a5f2-d6fb8bcf64fe admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:58.633219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb53f66-0ac0-4684-a9bb-11fe8a1e27e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:58.634325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb53f66-0ac0-4684-a9bb-11fe8a1e27e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:58.635039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb53f66-0ac0-4684-a9bb-11fe8a1e27e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:58.635903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb53f66-0ac0-4684-a9bb-11fe8a1e27e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:58.638037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb53f66-0ac0-4684-a9bb-11fe8a1e27e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:58.639887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb53f66-0ac0-4684-a9bb-11fe8a1e27e1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:58.657307 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1824/3633] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:55:58.659249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27dd40-8575-4598-b028-a0ed27de7007 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:58.684467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27dd40-8575-4598-b028-a0ed27de7007 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:58.691102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e42799-c28d-46c1-a6ef-6ddd032a6c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:58.692309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e42799-c28d-46c1-a6ef-6ddd032a6c7c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:58.692815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e42799-c28d-46c1-a6ef-6ddd032a6c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:58.693338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e42799-c28d-46c1-a6ef-6ddd032a6c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:58.695194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e42799-c28d-46c1-a6ef-6ddd032a6c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:58.697803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e42799-c28d-46c1-a6ef-6ddd032a6c7c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:58.722694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb53f66-0ac0-4684-a9bb-11fe8a1e27e1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:58.724589 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1810/3634] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:55:58.740682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb53f66-0ac0-4684-a9bb-11fe8a1e27e1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:58.749173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512990d-5098-42ed-884c-dad2ee89e9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:58.750067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512990d-5098-42ed-884c-dad2ee89e9d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:58.750542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512990d-5098-42ed-884c-dad2ee89e9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:58.751565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512990d-5098-42ed-884c-dad2ee89e9d3 admin admin] PATH_INFO: `/v3/projects/74a6fc0df7814673ae887215b5b41305/users/837f1e6c28364ca5baa52b20c0e5904b/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:58.771629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512990d-5098-42ed-884c-dad2ee89e9d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a6fc0df7814673ae887215b5b41305, user_id=837f1e6c28364ca5baa52b20c0e5904b, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:58.774783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512990d-5098-42ed-884c-dad2ee89e9d3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:58.801447 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1825/3635] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:55:58 2022] PUT /identity/v3/projects/74a6fc0df7814673ae887215b5b41305/users/837f1e6c28364ca5baa52b20c0e5904b/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:55:58.806686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae29132-5c7c-4456-9741-1f7da0bf2213 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:58.806977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae29132-5c7c-4456-9741-1f7da0bf2213 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:58.807251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae29132-5c7c-4456-9741-1f7da0bf2213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:58.836408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cae29132-5c7c-4456-9741-1f7da0bf2213 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:55:58.838380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cae29132-5c7c-4456-9741-1f7da0bf2213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:58.854779 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:55:58.915550 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1811/3636] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:55:58.926531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512990d-5098-42ed-884c-dad2ee89e9d3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:58.928644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2512990d-5098-42ed-884c-dad2ee89e9d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:58.951624 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:55:58.994222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512990d-5098-42ed-884c-dad2ee89e9d3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:59.006181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0fb7a-85e4-42d0-a932-138f82a404e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:59.006986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0fb7a-85e4-42d0-a932-138f82a404e3 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:59.007117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0fb7a-85e4-42d0-a932-138f82a404e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:59.007400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0fb7a-85e4-42d0-a932-138f82a404e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:59.019232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0fb7a-85e4-42d0-a932-138f82a404e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:59.020762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0fb7a-85e4-42d0-a932-138f82a404e3 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:59.033717 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1826/3637] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:55:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:55:59.821954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae29132-5c7c-4456-9741-1f7da0bf2213 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:55:59.825355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cae29132-5c7c-4456-9741-1f7da0bf2213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:55:59.841911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae29132-5c7c-4456-9741-1f7da0bf2213 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:55:59.850387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3c9c9-82fc-408f-b709-a4e49c66fb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:55:59.851490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3c9c9-82fc-408f-b709-a4e49c66fb79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:55:59.853653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3c9c9-82fc-408f-b709-a4e49c66fb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:55:59.854088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3c9c9-82fc-408f-b709-a4e49c66fb79 admin admin] PATH_INFO: `/v3/users/5fea1c05839b494494f90ae2c0a67792` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:55:59.855831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3c9c9-82fc-408f-b709-a4e49c66fb79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fea1c05839b494494f90ae2c0a67792)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:55:59.858184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3c9c9-82fc-408f-b709-a4e49c66fb79 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:55:59.918395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eeb3c9c9-82fc-408f-b709-a4e49c66fb79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fea1c05839b494494f90ae2c0a67792'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:59.929296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eeb3c9c9-82fc-408f-b709-a4e49c66fb79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fea1c05839b494494f90ae2c0a67792'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:59.930161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eeb3c9c9-82fc-408f-b709-a4e49c66fb79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fea1c05839b494494f90ae2c0a67792'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:59.947202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eeb3c9c9-82fc-408f-b709-a4e49c66fb79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fea1c05839b494494f90ae2c0a67792'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:55:59.983821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eeb3c9c9-82fc-408f-b709-a4e49c66fb79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fea1c05839b494494f90ae2c0a67792'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:00.001326 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1812/3638] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:55:59 2022] DELETE /identity/v3/users/5fea1c05839b494494f90ae2c0a67792 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:56:00.002981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dc38d-dbc9-4fe9-baa3-7d2c14ae3303 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:00.003448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dc38d-dbc9-4fe9-baa3-7d2c14ae3303 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:00.003546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dc38d-dbc9-4fe9-baa3-7d2c14ae3303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:00.045678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b52dc38d-dbc9-4fe9-baa3-7d2c14ae3303 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:00.047663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b52dc38d-dbc9-4fe9-baa3-7d2c14ae3303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:00.161052 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1827/3639] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:56:00.188245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3c9c9-82fc-408f-b709-a4e49c66fb79 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:00.190305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eeb3c9c9-82fc-408f-b709-a4e49c66fb79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:00.317052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3c9c9-82fc-408f-b709-a4e49c66fb79 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:00.324973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e7c4d-1170-490d-8c76-5d71fbd2c401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:00.325785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e7c4d-1170-490d-8c76-5d71fbd2c401 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:00.326098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e7c4d-1170-490d-8c76-5d71fbd2c401 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:00.326388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e7c4d-1170-490d-8c76-5d71fbd2c401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:00.339085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e7c4d-1170-490d-8c76-5d71fbd2c401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:00.352804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e7c4d-1170-490d-8c76-5d71fbd2c401 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:00.379313 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1813/3640] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:56:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:56:02.535040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52dc38d-dbc9-4fe9-baa3-7d2c14ae3303 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:02.539913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b52dc38d-dbc9-4fe9-baa3-7d2c14ae3303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:02.562736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52dc38d-dbc9-4fe9-baa3-7d2c14ae3303 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:02.577807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faa38b-ee06-47f0-9c66-c0a0a9ee9bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:02.578692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faa38b-ee06-47f0-9c66-c0a0a9ee9bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:02.578877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faa38b-ee06-47f0-9c66-c0a0a9ee9bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:02.580526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faa38b-ee06-47f0-9c66-c0a0a9ee9bd1 admin admin] PATH_INFO: `/v3/projects/468da09853c74cd992e566ab3a0a9737` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:02.583573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48faa38b-ee06-47f0-9c66-c0a0a9ee9bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=468da09853c74cd992e566ab3a0a9737)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:02.592418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48faa38b-ee06-47f0-9c66-c0a0a9ee9bd1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:02.703546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-48faa38b-ee06-47f0-9c66-c0a0a9ee9bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '468da09853c74cd992e566ab3a0a9737', 'request_id': 'req-48faa38b-ee06-47f0-9c66-c0a0a9ee9bd1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:02.731458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-48faa38b-ee06-47f0-9c66-c0a0a9ee9bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '468da09853c74cd992e566ab3a0a9737', 'request_id': 'req-48faa38b-ee06-47f0-9c66-c0a0a9ee9bd1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:02.745312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-48faa38b-ee06-47f0-9c66-c0a0a9ee9bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '468da09853c74cd992e566ab3a0a9737', 'request_id': 'req-48faa38b-ee06-47f0-9c66-c0a0a9ee9bd1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:02.786388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-48faa38b-ee06-47f0-9c66-c0a0a9ee9bd1 admin admin] The token cache is being invalidate because project 468da09853c74cd992e566ab3a0a9737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:56:02.787136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-48faa38b-ee06-47f0-9c66-c0a0a9ee9bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:02.788161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-48faa38b-ee06-47f0-9c66-c0a0a9ee9bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:02.791417 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1828/3641] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:56:02 2022] DELETE /identity/v3/projects/468da09853c74cd992e566ab3a0a9737 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:56:02.795482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e7c4d-1170-490d-8c76-5d71fbd2c401 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:02.805400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e7c4d-1170-490d-8c76-5d71fbd2c401 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:02.900055 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:02.965772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8275e-001b-48e2-8fee-4332351e0cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:02.966440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8275e-001b-48e2-8fee-4332351e0cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:02.966960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8275e-001b-48e2-8fee-4332351e0cad admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:02.967212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8275e-001b-48e2-8fee-4332351e0cad admin admin] PATH_INFO: `/v3/users/28831574e59c4e088deaac7b8008b2f2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:02.969761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8275e-001b-48e2-8fee-4332351e0cad admin admin] RBAC: Authorizing `identity:delete_user(user_id=28831574e59c4e088deaac7b8008b2f2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:02.971721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8275e-001b-48e2-8fee-4332351e0cad admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:03.100297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ff8275e-001b-48e2-8fee-4332351e0cad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28831574e59c4e088deaac7b8008b2f2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:03.120172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ff8275e-001b-48e2-8fee-4332351e0cad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28831574e59c4e088deaac7b8008b2f2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:03.124100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ff8275e-001b-48e2-8fee-4332351e0cad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28831574e59c4e088deaac7b8008b2f2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:03.147671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ff8275e-001b-48e2-8fee-4332351e0cad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28831574e59c4e088deaac7b8008b2f2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:03.159133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ff8275e-001b-48e2-8fee-4332351e0cad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28831574e59c4e088deaac7b8008b2f2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:03.170379 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1814/3642] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:56:02 2022] DELETE /identity/v3/users/28831574e59c4e088deaac7b8008b2f2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:56:04.986373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faa38b-ee06-47f0-9c66-c0a0a9ee9bd1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:04.988548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-48faa38b-ee06-47f0-9c66-c0a0a9ee9bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:05.033181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faa38b-ee06-47f0-9c66-c0a0a9ee9bd1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:05.156649 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:05.197914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3782427-e104-49df-a62c-4ce9dcec5015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:05.198720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3782427-e104-49df-a62c-4ce9dcec5015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:05.199133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3782427-e104-49df-a62c-4ce9dcec5015 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:05.199413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3782427-e104-49df-a62c-4ce9dcec5015 admin admin] PATH_INFO: `/v3/projects/51ff2162c5414528aa7f9cf8a804a32a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:05.201337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3782427-e104-49df-a62c-4ce9dcec5015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51ff2162c5414528aa7f9cf8a804a32a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:05.203277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3782427-e104-49df-a62c-4ce9dcec5015 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:05.410999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f3782427-e104-49df-a62c-4ce9dcec5015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ff2162c5414528aa7f9cf8a804a32a', 'request_id': 'req-f3782427-e104-49df-a62c-4ce9dcec5015'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:05.436210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f3782427-e104-49df-a62c-4ce9dcec5015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ff2162c5414528aa7f9cf8a804a32a', 'request_id': 'req-f3782427-e104-49df-a62c-4ce9dcec5015'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:05.451551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f3782427-e104-49df-a62c-4ce9dcec5015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ff2162c5414528aa7f9cf8a804a32a', 'request_id': 'req-f3782427-e104-49df-a62c-4ce9dcec5015'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:05.476942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f3782427-e104-49df-a62c-4ce9dcec5015 admin admin] The token cache is being invalidate because project 51ff2162c5414528aa7f9cf8a804a32a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:56:05.477576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f3782427-e104-49df-a62c-4ce9dcec5015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:05.478760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f3782427-e104-49df-a62c-4ce9dcec5015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:05.481368 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1829/3643] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:56:04 2022] DELETE /identity/v3/projects/51ff2162c5414528aa7f9cf8a804a32a => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:56:05.486255 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2d550-0d75-4fd9-9a43-dabd3b2fd09d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:05.487109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2d550-0d75-4fd9-9a43-dabd3b2fd09d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:05.487631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2d550-0d75-4fd9-9a43-dabd3b2fd09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:05.536512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-95f2d550-0d75-4fd9-9a43-dabd3b2fd09d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:05.540582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-95f2d550-0d75-4fd9-9a43-dabd3b2fd09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:05.751885 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1815/3644] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:05.762459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64979fe4-037e-4470-97a9-ee96507b71f2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:05.762859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64979fe4-037e-4470-97a9-ee96507b71f2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:05.763150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64979fe4-037e-4470-97a9-ee96507b71f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:05.856564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-64979fe4-037e-4470-97a9-ee96507b71f2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:05.861004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-64979fe4-037e-4470-97a9-ee96507b71f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:05.896479 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1830/3645] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:05.897452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2d550-0d75-4fd9-9a43-dabd3b2fd09d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:05.920749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2d550-0d75-4fd9-9a43-dabd3b2fd09d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:05.938392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4a24f-3a8b-4114-82de-28abea563fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:05.939051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4a24f-3a8b-4114-82de-28abea563fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:05.939341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4a24f-3a8b-4114-82de-28abea563fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:05.941142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4a24f-3a8b-4114-82de-28abea563fb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:05.943180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4a24f-3a8b-4114-82de-28abea563fb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:56:05.944826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4a24f-3a8b-4114-82de-28abea563fb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:05.947840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4a24f-3a8b-4114-82de-28abea563fb9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:05.974368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64979fe4-037e-4470-97a9-ee96507b71f2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:05.982950 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1816/3646] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:56:05.987509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64979fe4-037e-4470-97a9-ee96507b71f2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:06.005452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b14b95-32b2-48f0-962a-ae4436cffa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:06.006260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b14b95-32b2-48f0-962a-ae4436cffa7d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:06.007032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b14b95-32b2-48f0-962a-ae4436cffa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:06.007032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b14b95-32b2-48f0-962a-ae4436cffa7d admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:06.007417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b14b95-32b2-48f0-962a-ae4436cffa7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:06.009353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b14b95-32b2-48f0-962a-ae4436cffa7d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:06.093575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4a24f-3a8b-4114-82de-28abea563fb9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:06.100745 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1831/3647] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:56:05 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:56:06.106796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4a24f-3a8b-4114-82de-28abea563fb9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:06.190146 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:06.232124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d3ea6-7ceb-461f-b762-ec7d2228c3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:06.235089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d3ea6-7ceb-461f-b762-ec7d2228c3be admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:06.235643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d3ea6-7ceb-461f-b762-ec7d2228c3be admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:06.235643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d3ea6-7ceb-461f-b762-ec7d2228c3be admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:06.238167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d3ea6-7ceb-461f-b762-ec7d2228c3be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:06.241995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d3ea6-7ceb-461f-b762-ec7d2228c3be admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:06.304269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b14b95-32b2-48f0-962a-ae4436cffa7d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:06.327071 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1817/3648] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:56:06 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:56:06.331407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b14b95-32b2-48f0-962a-ae4436cffa7d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:06.353296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b46be-6e26-49be-893b-c30fdf38d490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:06.354043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b46be-6e26-49be-893b-c30fdf38d490 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:06.356107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b46be-6e26-49be-893b-c30fdf38d490 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:06.359278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b46be-6e26-49be-893b-c30fdf38d490 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:06.360085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b46be-6e26-49be-893b-c30fdf38d490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:06.372656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b46be-6e26-49be-893b-c30fdf38d490 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:06.432287 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1832/3649] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:56:06.437722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d3ea6-7ceb-461f-b762-ec7d2228c3be admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:06.465243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d3ea6-7ceb-461f-b762-ec7d2228c3be admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:06.506760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d730ee-85c3-442c-975f-e4c9de3c9a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:06.508194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d730ee-85c3-442c-975f-e4c9de3c9a5a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:06.508194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d730ee-85c3-442c-975f-e4c9de3c9a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:06.511983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d730ee-85c3-442c-975f-e4c9de3c9a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:06.513751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d730ee-85c3-442c-975f-e4c9de3c9a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:06.519368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d730ee-85c3-442c-975f-e4c9de3c9a5a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:06.551120 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1818/3650] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:56:06.555063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b46be-6e26-49be-893b-c30fdf38d490 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:06.590722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b46be-6e26-49be-893b-c30fdf38d490 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:06.622175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc7110-1619-46b9-8de9-7b6ba87b30c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:06.622862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc7110-1619-46b9-8de9-7b6ba87b30c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:06.623254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc7110-1619-46b9-8de9-7b6ba87b30c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:06.623388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc7110-1619-46b9-8de9-7b6ba87b30c4 admin admin] PATH_INFO: `/v3/projects/602fcfa04a7e428c81e2e5129cb8c641/users/24bd7adec54c44f9a941628f5adcc7a7/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:06.669120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc7110-1619-46b9-8de9-7b6ba87b30c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=602fcfa04a7e428c81e2e5129cb8c641, user_id=24bd7adec54c44f9a941628f5adcc7a7, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:06.675188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc7110-1619-46b9-8de9-7b6ba87b30c4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:06.710355 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1833/3651] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:56:06 2022] PUT /identity/v3/projects/602fcfa04a7e428c81e2e5129cb8c641/users/24bd7adec54c44f9a941628f5adcc7a7/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:56:06.717758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995df373-3b73-45d4-90b6-84b09ae8134d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:06.718226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995df373-3b73-45d4-90b6-84b09ae8134d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:06.718625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995df373-3b73-45d4-90b6-84b09ae8134d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:06.758832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-995df373-3b73-45d4-90b6-84b09ae8134d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:06.760449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-995df373-3b73-45d4-90b6-84b09ae8134d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:07.012841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc7110-1619-46b9-8de9-7b6ba87b30c4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:07.015095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-11fc7110-1619-46b9-8de9-7b6ba87b30c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:07.031644 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1819/3652] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:56:07.048485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc7110-1619-46b9-8de9-7b6ba87b30c4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:07.053115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995df373-3b73-45d4-90b6-84b09ae8134d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:07.057569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-995df373-3b73-45d4-90b6-84b09ae8134d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:07.066621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa5d49-b29e-442a-8735-f371fff60773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:07.068856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa5d49-b29e-442a-8735-f371fff60773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:07.069333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa5d49-b29e-442a-8735-f371fff60773 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:07.070979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa5d49-b29e-442a-8735-f371fff60773 admin admin] PATH_INFO: `/v3/users/18dcc5a7fa5e4d41b0d50cffb5972d58` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:07.074923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa5d49-b29e-442a-8735-f371fff60773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18dcc5a7fa5e4d41b0d50cffb5972d58)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:07.081244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa5d49-b29e-442a-8735-f371fff60773 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:07.177110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2aa5d49-b29e-442a-8735-f371fff60773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18dcc5a7fa5e4d41b0d50cffb5972d58'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:07.178830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2aa5d49-b29e-442a-8735-f371fff60773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18dcc5a7fa5e4d41b0d50cffb5972d58'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:07.198471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2aa5d49-b29e-442a-8735-f371fff60773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18dcc5a7fa5e4d41b0d50cffb5972d58'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:07.218549 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=80,keystone:DELETE=16,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:07.227406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2aa5d49-b29e-442a-8735-f371fff60773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18dcc5a7fa5e4d41b0d50cffb5972d58'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:07.251492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2aa5d49-b29e-442a-8735-f371fff60773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18dcc5a7fa5e4d41b0d50cffb5972d58'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:07.263811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995df373-3b73-45d4-90b6-84b09ae8134d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:07.271288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80890330-2569-473d-8460-70fcbf2ca086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:07.272423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80890330-2569-473d-8460-70fcbf2ca086 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:07.272840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80890330-2569-473d-8460-70fcbf2ca086 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:07.273163 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1834/3653] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:56:07 2022] DELETE /identity/v3/users/18dcc5a7fa5e4d41b0d50cffb5972d58 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:56:07.273338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80890330-2569-473d-8460-70fcbf2ca086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:07.275900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-80890330-2569-473d-8460-70fcbf2ca086 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:07.293833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80890330-2569-473d-8460-70fcbf2ca086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:07.295367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80890330-2569-473d-8460-70fcbf2ca086 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:07.307338 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1820/3654] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:56:07.362632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbafdc-ba2e-423a-83ee-6d0f0bcac860 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:07.363277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbafdc-ba2e-423a-83ee-6d0f0bcac860 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:07.364445 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbafdc-ba2e-423a-83ee-6d0f0bcac860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:07.390213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b8cbafdc-ba2e-423a-83ee-6d0f0bcac860 None None] MFA Rules not processed for user `60912bd5bfdf451ea7348b8372ba1a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:07.391772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b8cbafdc-ba2e-423a-83ee-6d0f0bcac860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:07.522591 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1835/3655] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:07.976075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80890330-2569-473d-8460-70fcbf2ca086 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:07.977532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-80890330-2569-473d-8460-70fcbf2ca086 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:07.999549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80890330-2569-473d-8460-70fcbf2ca086 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:08.101276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb616b65-d5a2-4f43-8010-8dd15dee78ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:08.102968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb616b65-d5a2-4f43-8010-8dd15dee78ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:08.103631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb616b65-d5a2-4f43-8010-8dd15dee78ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:08.104053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb616b65-d5a2-4f43-8010-8dd15dee78ee admin admin] PATH_INFO: `/v3/projects/ee6a3a7c62ec4313ae9a0b358716b772` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:08.106562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb616b65-d5a2-4f43-8010-8dd15dee78ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee6a3a7c62ec4313ae9a0b358716b772)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:08.109046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb616b65-d5a2-4f43-8010-8dd15dee78ee admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:08.116762 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:08.193381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cb616b65-d5a2-4f43-8010-8dd15dee78ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee6a3a7c62ec4313ae9a0b358716b772', 'request_id': 'req-cb616b65-d5a2-4f43-8010-8dd15dee78ee'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:08.203898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cb616b65-d5a2-4f43-8010-8dd15dee78ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee6a3a7c62ec4313ae9a0b358716b772', 'request_id': 'req-cb616b65-d5a2-4f43-8010-8dd15dee78ee'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:08.212705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cb616b65-d5a2-4f43-8010-8dd15dee78ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee6a3a7c62ec4313ae9a0b358716b772', 'request_id': 'req-cb616b65-d5a2-4f43-8010-8dd15dee78ee'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:08.228122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cb616b65-d5a2-4f43-8010-8dd15dee78ee admin admin] The token cache is being invalidate because project ee6a3a7c62ec4313ae9a0b358716b772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:56:08.228122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cb616b65-d5a2-4f43-8010-8dd15dee78ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:08.229443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cb616b65-d5a2-4f43-8010-8dd15dee78ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:08.232550 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1821/3656] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:56:07 2022] DELETE /identity/v3/projects/ee6a3a7c62ec4313ae9a0b358716b772 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:56:08.237537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680dfde-cd49-45ac-8ef3-c1ccc0e0d599 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:08.238025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680dfde-cd49-45ac-8ef3-c1ccc0e0d599 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:08.238112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680dfde-cd49-45ac-8ef3-c1ccc0e0d599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:08.288408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c680dfde-cd49-45ac-8ef3-c1ccc0e0d599 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:08.289863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c680dfde-cd49-45ac-8ef3-c1ccc0e0d599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:08.481062 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1836/3657] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:08.488494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89703d-400a-4860-bd66-350b60a909f0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:08.488897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89703d-400a-4860-bd66-350b60a909f0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:08.489238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89703d-400a-4860-bd66-350b60a909f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:08.515553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2a89703d-400a-4860-bd66-350b60a909f0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:08.517208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2a89703d-400a-4860-bd66-350b60a909f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:08.550932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680dfde-cd49-45ac-8ef3-c1ccc0e0d599 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:08.555167 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1822/3658] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:08.562276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680dfde-cd49-45ac-8ef3-c1ccc0e0d599 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:08.586026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76389fa7-8b97-4f15-8427-fa01152883c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:08.586968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76389fa7-8b97-4f15-8427-fa01152883c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:08.587402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76389fa7-8b97-4f15-8427-fa01152883c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:08.587901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76389fa7-8b97-4f15-8427-fa01152883c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:08.588776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76389fa7-8b97-4f15-8427-fa01152883c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:56:08.590075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76389fa7-8b97-4f15-8427-fa01152883c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:08.592181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76389fa7-8b97-4f15-8427-fa01152883c7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:08.630261 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1837/3659] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:56:08.631653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89703d-400a-4860-bd66-350b60a909f0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:08.658902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89703d-400a-4860-bd66-350b60a909f0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:08.675991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736462d0-7aa1-473b-9a7e-7dd2ff6a212d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:08.676707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736462d0-7aa1-473b-9a7e-7dd2ff6a212d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:08.676931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736462d0-7aa1-473b-9a7e-7dd2ff6a212d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:08.677203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736462d0-7aa1-473b-9a7e-7dd2ff6a212d admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:08.678295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736462d0-7aa1-473b-9a7e-7dd2ff6a212d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:08.679751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736462d0-7aa1-473b-9a7e-7dd2ff6a212d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:08.760677 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1823/3660] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:56:08 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:56:08.765151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76389fa7-8b97-4f15-8427-fa01152883c7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:08.780011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76389fa7-8b97-4f15-8427-fa01152883c7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:08.884397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4cfa9-f156-44c1-a34c-3caff688ac6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:08.885458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4cfa9-f156-44c1-a34c-3caff688ac6c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:08.887980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4cfa9-f156-44c1-a34c-3caff688ac6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:08.889710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4cfa9-f156-44c1-a34c-3caff688ac6c admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:08.890381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4cfa9-f156-44c1-a34c-3caff688ac6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:08.895650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4cfa9-f156-44c1-a34c-3caff688ac6c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:08.946009 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1838/3661] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:56:08 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:56:08.951609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736462d0-7aa1-473b-9a7e-7dd2ff6a212d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:08.971709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736462d0-7aa1-473b-9a7e-7dd2ff6a212d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:08.979555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87847954-3e2d-4a49-a3d8-92a7ec090b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:08.980896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87847954-3e2d-4a49-a3d8-92a7ec090b85 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:08.981421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87847954-3e2d-4a49-a3d8-92a7ec090b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:08.981763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87847954-3e2d-4a49-a3d8-92a7ec090b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:08.982754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87847954-3e2d-4a49-a3d8-92a7ec090b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:08.985177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87847954-3e2d-4a49-a3d8-92a7ec090b85 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:09.006893 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1824/3662] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:56:09.008772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4cfa9-f156-44c1-a34c-3caff688ac6c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:09.021072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4cfa9-f156-44c1-a34c-3caff688ac6c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:09.027027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc4db6-e7f7-4406-abc9-d2479d92d3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:09.028048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc4db6-e7f7-4406-abc9-d2479d92d3fb admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:09.028545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc4db6-e7f7-4406-abc9-d2479d92d3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:09.029101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc4db6-e7f7-4406-abc9-d2479d92d3fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:09.030024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc4db6-e7f7-4406-abc9-d2479d92d3fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:09.032166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc4db6-e7f7-4406-abc9-d2479d92d3fb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:09.034280 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:09.051496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87847954-3e2d-4a49-a3d8-92a7ec090b85 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:09.052592 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1839/3663] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:56:09.067280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87847954-3e2d-4a49-a3d8-92a7ec090b85 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:09.074901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be85e2-89f4-48da-9240-8635168520be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:09.076375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be85e2-89f4-48da-9240-8635168520be admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:09.076995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be85e2-89f4-48da-9240-8635168520be admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:09.077618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be85e2-89f4-48da-9240-8635168520be admin admin] PATH_INFO: `/v3/projects/488b287ec4434a1e9a2886a047187a46/users/3b97b83ebcf242d0abd55dfbb15ab066/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:09.100016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be85e2-89f4-48da-9240-8635168520be admin admin] RBAC: Authorizing `identity:create_grant(project_id=488b287ec4434a1e9a2886a047187a46, user_id=3b97b83ebcf242d0abd55dfbb15ab066, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:09.103479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be85e2-89f4-48da-9240-8635168520be admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:09.142486 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1825/3664] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:56:09 2022] PUT /identity/v3/projects/488b287ec4434a1e9a2886a047187a46/users/3b97b83ebcf242d0abd55dfbb15ab066/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:56:09.143329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bb242-4828-4eb4-84ca-296b42afde42 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:09.143617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bb242-4828-4eb4-84ca-296b42afde42 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:09.143893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bb242-4828-4eb4-84ca-296b42afde42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:09.169955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ef5bb242-4828-4eb4-84ca-296b42afde42 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:09.171961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ef5bb242-4828-4eb4-84ca-296b42afde42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:09.256337 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1840/3665] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:09.266957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be85e2-89f4-48da-9240-8635168520be admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:09.269828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d7be85e2-89f4-48da-9240-8635168520be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:09.371178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be85e2-89f4-48da-9240-8635168520be admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:09.392936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a67f96-8e4c-4e5b-a5f9-547945146c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:09.393871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a67f96-8e4c-4e5b-a5f9-547945146c3d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:09.394482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a67f96-8e4c-4e5b-a5f9-547945146c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:09.394916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a67f96-8e4c-4e5b-a5f9-547945146c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:09.410895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a67f96-8e4c-4e5b-a5f9-547945146c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:09.412686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a67f96-8e4c-4e5b-a5f9-547945146c3d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:09.446038 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1826/3666] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:56:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:56:11.199937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3cf62-ebe0-4d51-a74e-ab35008b1c8a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:11.200936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3cf62-ebe0-4d51-a74e-ab35008b1c8a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:11.201495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3cf62-ebe0-4d51-a74e-ab35008b1c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:11.231409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-89b3cf62-ebe0-4d51-a74e-ab35008b1c8a None None] MFA Rules not processed for user `837f1e6c28364ca5baa52b20c0e5904b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:11.233004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-89b3cf62-ebe0-4d51-a74e-ab35008b1c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:11.326987 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1841/3667] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:11 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:11.331764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a67f96-8e4c-4e5b-a5f9-547945146c3d service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:11.334347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-17a67f96-8e4c-4e5b-a5f9-547945146c3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:11.351391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a67f96-8e4c-4e5b-a5f9-547945146c3d service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:11.357262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2848647-95f9-4464-8ca9-d64db97ff41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:11.358173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2848647-95f9-4464-8ca9-d64db97ff41f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:11.358661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2848647-95f9-4464-8ca9-d64db97ff41f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:11.359133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2848647-95f9-4464-8ca9-d64db97ff41f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:11.360881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2848647-95f9-4464-8ca9-d64db97ff41f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:11.363142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2848647-95f9-4464-8ca9-d64db97ff41f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:11.398830 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1827/3668] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:56:11 2022] POST /identity/v3/projects => generated 403 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:56:11.402774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3cf62-ebe0-4d51-a74e-ab35008b1c8a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:11.414966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3cf62-ebe0-4d51-a74e-ab35008b1c8a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:11.482810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b4f4f-f599-469e-ad7c-b82add0190bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:11.483418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b4f4f-f599-469e-ad7c-b82add0190bb admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:11.483696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b4f4f-f599-469e-ad7c-b82add0190bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:11.483966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b4f4f-f599-469e-ad7c-b82add0190bb admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:11.485201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b4f4f-f599-469e-ad7c-b82add0190bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:11.487143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b4f4f-f599-469e-ad7c-b82add0190bb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:11.517297 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1842/3669] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:56:11 2022] POST /identity/v3/users => generated 302 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:56:11.520914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2848647-95f9-4464-8ca9-d64db97ff41f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:11.534218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2848647-95f9-4464-8ca9-d64db97ff41f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:11.539920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a68d2-61f2-4b68-9525-d176c739bb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:11.541010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a68d2-61f2-4b68-9525-d176c739bb2d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:11.541267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a68d2-61f2-4b68-9525-d176c739bb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:11.541610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a68d2-61f2-4b68-9525-d176c739bb2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:11.543001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a68d2-61f2-4b68-9525-d176c739bb2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:11.544814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a68d2-61f2-4b68-9525-d176c739bb2d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:11.553962 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:11.566233 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1828/3670] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:56:11.567049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b4f4f-f599-469e-ad7c-b82add0190bb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:11.582108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b4f4f-f599-469e-ad7c-b82add0190bb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:11.587871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee636fc-3178-4c71-949b-bcb40a10b9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:11.590083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee636fc-3178-4c71-949b-bcb40a10b9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:11.590283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee636fc-3178-4c71-949b-bcb40a10b9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:11.590492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee636fc-3178-4c71-949b-bcb40a10b9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:11.591136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee636fc-3178-4c71-949b-bcb40a10b9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:11.593002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee636fc-3178-4c71-949b-bcb40a10b9f2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:11.606903 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1843/3671] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:56:11.610953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a68d2-61f2-4b68-9525-d176c739bb2d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:11.621586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a68d2-61f2-4b68-9525-d176c739bb2d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:11.626890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f7abf-3e85-4ac8-8da0-43c738792536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:11.627543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f7abf-3e85-4ac8-8da0-43c738792536 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:11.627820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f7abf-3e85-4ac8-8da0-43c738792536 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:11.628753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f7abf-3e85-4ac8-8da0-43c738792536 admin admin] PATH_INFO: `/v3/projects/fd2feaa2204441cda3b435507ca4865e/users/2208703cb8f84555854ae47fb6084a20/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:11.648213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f7abf-3e85-4ac8-8da0-43c738792536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2feaa2204441cda3b435507ca4865e, user_id=2208703cb8f84555854ae47fb6084a20, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:11.651368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f7abf-3e85-4ac8-8da0-43c738792536 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:11.668976 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1829/3672] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:56:11 2022] PUT /identity/v3/projects/fd2feaa2204441cda3b435507ca4865e/users/2208703cb8f84555854ae47fb6084a20/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:56:21.601481 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:21.664559 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:23.555952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d842674-ea93-4ffe-b56d-cfde6f1da72c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:23.556534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d842674-ea93-4ffe-b56d-cfde6f1da72c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:23.559264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d842674-ea93-4ffe-b56d-cfde6f1da72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:23.625513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4d842674-ea93-4ffe-b56d-cfde6f1da72c None None] MFA Rules not processed for user `24bd7adec54c44f9a941628f5adcc7a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:23.627303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4d842674-ea93-4ffe-b56d-cfde6f1da72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:23.758908 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1844/3673] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:23.759736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f7abf-3e85-4ac8-8da0-43c738792536 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:23.762776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1a2f7abf-3e85-4ac8-8da0-43c738792536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:23.931959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f7abf-3e85-4ac8-8da0-43c738792536 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:23.945914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15295ab2-78dd-4327-8b6c-ed6d4d8cd29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:23.946726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15295ab2-78dd-4327-8b6c-ed6d4d8cd29f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:23.947789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15295ab2-78dd-4327-8b6c-ed6d4d8cd29f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:23.949966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15295ab2-78dd-4327-8b6c-ed6d4d8cd29f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:23.951029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15295ab2-78dd-4327-8b6c-ed6d4d8cd29f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:23.955880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15295ab2-78dd-4327-8b6c-ed6d4d8cd29f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:24.003282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d842674-ea93-4ffe-b56d-cfde6f1da72c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:24.004742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4d842674-ea93-4ffe-b56d-cfde6f1da72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:24.020500 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1830/3674] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:56:23 2022] POST /identity/v3/projects => generated 385 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:56:24.021656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15295ab2-78dd-4327-8b6c-ed6d4d8cd29f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:24.033821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d842674-ea93-4ffe-b56d-cfde6f1da72c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:24.144844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15295ab2-78dd-4327-8b6c-ed6d4d8cd29f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:24.152872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b88807-b4d8-4cf7-938d-6595a30a9878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:24.153621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b88807-b4d8-4cf7-938d-6595a30a9878 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:24.154316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b88807-b4d8-4cf7-938d-6595a30a9878 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:24.154316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b88807-b4d8-4cf7-938d-6595a30a9878 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:24.154996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b88807-b4d8-4cf7-938d-6595a30a9878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:24.157012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b88807-b4d8-4cf7-938d-6595a30a9878 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:24.176391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a229aa-1f70-4001-a65e-c2fd9e51a0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:24.178973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a229aa-1f70-4001-a65e-c2fd9e51a0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:24.180726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a229aa-1f70-4001-a65e-c2fd9e51a0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:24.181039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a229aa-1f70-4001-a65e-c2fd9e51a0e8 admin admin] PATH_INFO: `/v3/users/b4a7050533994b60aa3f7bb63b732dd5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:24.186264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a229aa-1f70-4001-a65e-c2fd9e51a0e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4a7050533994b60aa3f7bb63b732dd5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:24.191317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a229aa-1f70-4001-a65e-c2fd9e51a0e8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:24.213221 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1831/3675] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:56:24 2022] POST /identity/v3/users => generated 299 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:56:24.225558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b88807-b4d8-4cf7-938d-6595a30a9878 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:24.238404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b88807-b4d8-4cf7-938d-6595a30a9878 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:24.255166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b923855-62a4-47d5-987d-2798113970f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:24.256069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b923855-62a4-47d5-987d-2798113970f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:24.256426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b923855-62a4-47d5-987d-2798113970f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:24.256780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b923855-62a4-47d5-987d-2798113970f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:24.258183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b923855-62a4-47d5-987d-2798113970f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:24.262498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b923855-62a4-47d5-987d-2798113970f1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:24.290953 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1832/3676] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:56:24.295904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b923855-62a4-47d5-987d-2798113970f1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:24.303026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76a229aa-1f70-4001-a65e-c2fd9e51a0e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4a7050533994b60aa3f7bb63b732dd5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:24.307197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76a229aa-1f70-4001-a65e-c2fd9e51a0e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4a7050533994b60aa3f7bb63b732dd5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:24.314283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b923855-62a4-47d5-987d-2798113970f1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:24.324013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716f8dd-a6d6-4c84-a668-78da4f2c15bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:24.327417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716f8dd-a6d6-4c84-a668-78da4f2c15bb admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:24.327887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716f8dd-a6d6-4c84-a668-78da4f2c15bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:24.328820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716f8dd-a6d6-4c84-a668-78da4f2c15bb admin admin] PATH_INFO: `/v3/projects/2626db7e3350492584f8e0853e2286d9/users/ab1d0b2474a84091b327ca04a247bc1d/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:24.338227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76a229aa-1f70-4001-a65e-c2fd9e51a0e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4a7050533994b60aa3f7bb63b732dd5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:24.356066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716f8dd-a6d6-4c84-a668-78da4f2c15bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2626db7e3350492584f8e0853e2286d9, user_id=ab1d0b2474a84091b327ca04a247bc1d, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:24.365823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716f8dd-a6d6-4c84-a668-78da4f2c15bb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:24.372315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76a229aa-1f70-4001-a65e-c2fd9e51a0e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4a7050533994b60aa3f7bb63b732dd5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:24.388582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76a229aa-1f70-4001-a65e-c2fd9e51a0e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4a7050533994b60aa3f7bb63b732dd5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:24.405360 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1845/3677] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:56:24 2022] DELETE /identity/v3/users/b4a7050533994b60aa3f7bb63b732dd5 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:56:24.429482 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1833/3678] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:56:24 2022] PUT /identity/v3/projects/2626db7e3350492584f8e0853e2286d9/users/ab1d0b2474a84091b327ca04a247bc1d/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:56:24.433545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a229aa-1f70-4001-a65e-c2fd9e51a0e8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:24.465587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-76a229aa-1f70-4001-a65e-c2fd9e51a0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:24.491101 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:24.672187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a229aa-1f70-4001-a65e-c2fd9e51a0e8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:24.680040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30b211-0506-4aad-b9ba-995513faa92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:24.680899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30b211-0506-4aad-b9ba-995513faa92c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:24.689250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30b211-0506-4aad-b9ba-995513faa92c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:24.689788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30b211-0506-4aad-b9ba-995513faa92c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:24.690681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30b211-0506-4aad-b9ba-995513faa92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:24.692529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30b211-0506-4aad-b9ba-995513faa92c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:24.723558 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1846/3679] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:56:24.728414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716f8dd-a6d6-4c84-a668-78da4f2c15bb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:24.797815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30b211-0506-4aad-b9ba-995513faa92c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:24.799826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6d30b211-0506-4aad-b9ba-995513faa92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:24.824583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30b211-0506-4aad-b9ba-995513faa92c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:24.827283 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:24.843341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243916d8-6467-4f4d-9ae3-cd586f292e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:24.843995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243916d8-6467-4f4d-9ae3-cd586f292e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:24.844273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243916d8-6467-4f4d-9ae3-cd586f292e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:24.844539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243916d8-6467-4f4d-9ae3-cd586f292e47 admin admin] PATH_INFO: `/v3/projects/e7da88c09a3d4e6790442c1787f2ff65` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:24.845723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243916d8-6467-4f4d-9ae3-cd586f292e47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7da88c09a3d4e6790442c1787f2ff65)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:24.847636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243916d8-6467-4f4d-9ae3-cd586f292e47 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:24.872465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716f8dd-a6d6-4c84-a668-78da4f2c15bb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:24.889311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927714ed-6b3c-47c0-8ad6-a1be452af48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:24.890420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927714ed-6b3c-47c0-8ad6-a1be452af48f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:24.890900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927714ed-6b3c-47c0-8ad6-a1be452af48f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:24.891394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927714ed-6b3c-47c0-8ad6-a1be452af48f admin admin] PATH_INFO: `/v3/projects/2626db7e3350492584f8e0853e2286d9/users/ab1d0b2474a84091b327ca04a247bc1d/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:24.899614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927714ed-6b3c-47c0-8ad6-a1be452af48f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2626db7e3350492584f8e0853e2286d9, user_id=ab1d0b2474a84091b327ca04a247bc1d, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:24.903450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927714ed-6b3c-47c0-8ad6-a1be452af48f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:24.957917 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1834/3680] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:56:24 2022] PUT /identity/v3/projects/2626db7e3350492584f8e0853e2286d9/users/ab1d0b2474a84091b327ca04a247bc1d/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:56:24.958426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-243916d8-6467-4f4d-9ae3-cd586f292e47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7da88c09a3d4e6790442c1787f2ff65', 'request_id': 'req-243916d8-6467-4f4d-9ae3-cd586f292e47'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:24.976940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-243916d8-6467-4f4d-9ae3-cd586f292e47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7da88c09a3d4e6790442c1787f2ff65', 'request_id': 'req-243916d8-6467-4f4d-9ae3-cd586f292e47'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:24.986601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-243916d8-6467-4f4d-9ae3-cd586f292e47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7da88c09a3d4e6790442c1787f2ff65', 'request_id': 'req-243916d8-6467-4f4d-9ae3-cd586f292e47'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:25.011648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-243916d8-6467-4f4d-9ae3-cd586f292e47 admin admin] The token cache is being invalidate because project e7da88c09a3d4e6790442c1787f2ff65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:56:25.012259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-243916d8-6467-4f4d-9ae3-cd586f292e47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:25.013645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-243916d8-6467-4f4d-9ae3-cd586f292e47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:25.020086 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1847/3681] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:56:24 2022] DELETE /identity/v3/projects/e7da88c09a3d4e6790442c1787f2ff65 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:56:25.022001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75329888-e739-4939-8c65-84bf7cab48c4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:25.022530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75329888-e739-4939-8c65-84bf7cab48c4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:25.023063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75329888-e739-4939-8c65-84bf7cab48c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:25.050353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-75329888-e739-4939-8c65-84bf7cab48c4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:25.052863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-75329888-e739-4939-8c65-84bf7cab48c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:25.205713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc03afc-07f0-4529-b5dc-2f320c78f28a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:25.206051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc03afc-07f0-4529-b5dc-2f320c78f28a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:25.206268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc03afc-07f0-4529-b5dc-2f320c78f28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:25.209284 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1835/3682] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:25.268446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bcc03afc-07f0-4529-b5dc-2f320c78f28a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:25.279447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bcc03afc-07f0-4529-b5dc-2f320c78f28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:25.315215 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1848/3683] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:25.317768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75329888-e739-4939-8c65-84bf7cab48c4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:25.334522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75329888-e739-4939-8c65-84bf7cab48c4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:25.354000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd55397-1083-4223-9b73-11ccf8a81340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:25.358362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd55397-1083-4223-9b73-11ccf8a81340 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:25.358694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd55397-1083-4223-9b73-11ccf8a81340 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:25.358968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd55397-1083-4223-9b73-11ccf8a81340 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:25.364206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd55397-1083-4223-9b73-11ccf8a81340 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:56:25.364698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd55397-1083-4223-9b73-11ccf8a81340 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:25.366610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd55397-1083-4223-9b73-11ccf8a81340 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:25.405764 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1836/3684] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:56:25.407284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc03afc-07f0-4529-b5dc-2f320c78f28a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:25.421013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc03afc-07f0-4529-b5dc-2f320c78f28a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:25.436961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d2917-9a7f-4749-9536-aa92690a87e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:25.437596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d2917-9a7f-4749-9536-aa92690a87e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:25.437878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d2917-9a7f-4749-9536-aa92690a87e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:25.438139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d2917-9a7f-4749-9536-aa92690a87e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:25.438791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d2917-9a7f-4749-9536-aa92690a87e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:25.445204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d2917-9a7f-4749-9536-aa92690a87e6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:25.531840 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1849/3685] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:56:25 2022] POST /identity/v3/projects => generated 401 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:56:25.533370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd55397-1083-4223-9b73-11ccf8a81340 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:25.558134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd55397-1083-4223-9b73-11ccf8a81340 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:25.713408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed394f88-fe20-4787-8268-de2eab3dfa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:25.714423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed394f88-fe20-4787-8268-de2eab3dfa09 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:25.714705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed394f88-fe20-4787-8268-de2eab3dfa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:25.715060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed394f88-fe20-4787-8268-de2eab3dfa09 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:25.717245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed394f88-fe20-4787-8268-de2eab3dfa09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:25.719768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed394f88-fe20-4787-8268-de2eab3dfa09 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:25.768964 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1837/3686] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:56:25 2022] POST /identity/v3/users => generated 301 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:56:25.772942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d2917-9a7f-4749-9536-aa92690a87e6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:25.788062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d2917-9a7f-4749-9536-aa92690a87e6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:25.810145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230f9b1-2c96-442a-b591-366b6c97c2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:25.812426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230f9b1-2c96-442a-b591-366b6c97c2cc admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:25.812942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230f9b1-2c96-442a-b591-366b6c97c2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:25.816021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230f9b1-2c96-442a-b591-366b6c97c2cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:25.816972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230f9b1-2c96-442a-b591-366b6c97c2cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:25.822884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230f9b1-2c96-442a-b591-366b6c97c2cc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:25.854373 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1850/3687] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:56:25.855728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed394f88-fe20-4787-8268-de2eab3dfa09 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:25.868957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed394f88-fe20-4787-8268-de2eab3dfa09 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:25.883952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e81610-e0ce-4b8d-a1f0-2ffab1a2391b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:25.885024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e81610-e0ce-4b8d-a1f0-2ffab1a2391b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:25.885984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e81610-e0ce-4b8d-a1f0-2ffab1a2391b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:25.886464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e81610-e0ce-4b8d-a1f0-2ffab1a2391b admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:25.887302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e81610-e0ce-4b8d-a1f0-2ffab1a2391b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:25.889099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e81610-e0ce-4b8d-a1f0-2ffab1a2391b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:25.906887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a73ae7-1512-43b3-b58e-ac291a05fc30 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:25.907251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a73ae7-1512-43b3-b58e-ac291a05fc30 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:25.907572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a73ae7-1512-43b3-b58e-ac291a05fc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:25.918224 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1838/3688] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:56:25.923058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e81610-e0ce-4b8d-a1f0-2ffab1a2391b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:25.952790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e81610-e0ce-4b8d-a1f0-2ffab1a2391b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:25.963977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74235add-fdf4-4b01-b7da-b1501c0f52b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:25.964550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74235add-fdf4-4b01-b7da-b1501c0f52b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:25.964900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74235add-fdf4-4b01-b7da-b1501c0f52b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:25.965091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c1a73ae7-1512-43b3-b58e-ac291a05fc30 None None] MFA Rules not processed for user `b6bb092e5df84a378019856b329ef7bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:25.965232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74235add-fdf4-4b01-b7da-b1501c0f52b4 admin admin] PATH_INFO: `/v3/projects/120d6a31928c4bc3a69ecbccb2c3f1a7/users/1a94a228057b49a991d1f8531b7220eb/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:25.966361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c1a73ae7-1512-43b3-b58e-ac291a05fc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:26.002239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74235add-fdf4-4b01-b7da-b1501c0f52b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=120d6a31928c4bc3a69ecbccb2c3f1a7, user_id=1a94a228057b49a991d1f8531b7220eb, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:26.004953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74235add-fdf4-4b01-b7da-b1501c0f52b4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:26.031019 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1839/3689] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:56:25 2022] PUT /identity/v3/projects/120d6a31928c4bc3a69ecbccb2c3f1a7/users/1a94a228057b49a991d1f8531b7220eb/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:56:26.044256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c70010-2129-453b-af9f-48da7461b20c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:26.044802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c70010-2129-453b-af9f-48da7461b20c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:26.045174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c70010-2129-453b-af9f-48da7461b20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:26.100941 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:26.109714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-84c70010-2129-453b-af9f-48da7461b20c None None] MFA Rules not processed for user `1a94a228057b49a991d1f8531b7220eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:26.110992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-84c70010-2129-453b-af9f-48da7461b20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:26.115673 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:26.131258 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1851/3690] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:26.242464 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1840/3691] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:26 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:27.068072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a73ae7-1512-43b3-b58e-ac291a05fc30 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:27.090237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a73ae7-1512-43b3-b58e-ac291a05fc30 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:27.274285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1449641-0f12-4083-b7c6-d908705d853c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:27.274837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1449641-0f12-4083-b7c6-d908705d853c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:27.274837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1449641-0f12-4083-b7c6-d908705d853c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:27.289346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a1724-b41d-4475-b7bd-d53323757201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:27.290011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a1724-b41d-4475-b7bd-d53323757201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:27.290336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a1724-b41d-4475-b7bd-d53323757201 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:27.290550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a1724-b41d-4475-b7bd-d53323757201 admin admin] PATH_INFO: `/v3/users/1a94a228057b49a991d1f8531b7220eb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:27.293225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a1724-b41d-4475-b7bd-d53323757201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a94a228057b49a991d1f8531b7220eb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:27.301902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a1724-b41d-4475-b7bd-d53323757201 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:27.414453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-029a1724-b41d-4475-b7bd-d53323757201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a94a228057b49a991d1f8531b7220eb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:27.417610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-029a1724-b41d-4475-b7bd-d53323757201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a94a228057b49a991d1f8531b7220eb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:27.436057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b1449641-0f12-4083-b7c6-d908705d853c None None] MFA Rules not processed for user `2208703cb8f84555854ae47fb6084a20`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:27.441295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b1449641-0f12-4083-b7c6-d908705d853c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:27.444765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-029a1724-b41d-4475-b7bd-d53323757201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a94a228057b49a991d1f8531b7220eb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:27.489299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-029a1724-b41d-4475-b7bd-d53323757201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a94a228057b49a991d1f8531b7220eb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:27.513890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-029a1724-b41d-4475-b7bd-d53323757201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a94a228057b49a991d1f8531b7220eb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:27.534530 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1852/3692] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:56:27 2022] DELETE /identity/v3/users/1a94a228057b49a991d1f8531b7220eb => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:56:27.546107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37e2e2-4572-456e-8580-1a2b546ad191 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:27.546390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37e2e2-4572-456e-8580-1a2b546ad191 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:27.546659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37e2e2-4572-456e-8580-1a2b546ad191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:27.616399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-dd37e2e2-4572-456e-8580-1a2b546ad191 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:27.617719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dd37e2e2-4572-456e-8580-1a2b546ad191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:27.710920 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1841/3693] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:27 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:27.723607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf13e3-402d-45c9-ba64-8df414651bea None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:27.723815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf13e3-402d-45c9-ba64-8df414651bea None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:27.724098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf13e3-402d-45c9-ba64-8df414651bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:27.765226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-afaf13e3-402d-45c9-ba64-8df414651bea None None] MFA Rules not processed for user `837f1e6c28364ca5baa52b20c0e5904b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:27.768139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-afaf13e3-402d-45c9-ba64-8df414651bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:27.803425 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1853/3694] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:27.815238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37e2e2-4572-456e-8580-1a2b546ad191 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:27.816182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dd37e2e2-4572-456e-8580-1a2b546ad191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:27.844462 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:27.922884 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1842/3695] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:27 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:27.989872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37e2e2-4572-456e-8580-1a2b546ad191 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:27.998934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdaa6c6-a85b-4acc-b441-0a0bf98c51d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:27.999960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaa6c6-a85b-4acc-b441-0a0bf98c51d8 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:28.000350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaa6c6-a85b-4acc-b441-0a0bf98c51d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:28.000852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaa6c6-a85b-4acc-b441-0a0bf98c51d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:28.015179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdaa6c6-a85b-4acc-b441-0a0bf98c51d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:28.016898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdaa6c6-a85b-4acc-b441-0a0bf98c51d8 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:28.037056 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1854/3696] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:56:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:56:28.396982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf13e3-402d-45c9-ba64-8df414651bea None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:28.398745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-afaf13e3-402d-45c9-ba64-8df414651bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:28.437805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf13e3-402d-45c9-ba64-8df414651bea None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:28.443503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f61815-03e6-4c02-bdd0-4fa29939e6b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:28.444583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f61815-03e6-4c02-bdd0-4fa29939e6b3 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:28.445133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f61815-03e6-4c02-bdd0-4fa29939e6b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:28.445478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f61815-03e6-4c02-bdd0-4fa29939e6b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:28.447423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-23f61815-03e6-4c02-bdd0-4fa29939e6b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:28.466386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f61815-03e6-4c02-bdd0-4fa29939e6b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:28.467941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f61815-03e6-4c02-bdd0-4fa29939e6b3 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:28.479474 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1843/3697] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:56:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:56:28.509619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdaa6c6-a85b-4acc-b441-0a0bf98c51d8 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:28.511693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bfdaa6c6-a85b-4acc-b441-0a0bf98c51d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:28.532066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdaa6c6-a85b-4acc-b441-0a0bf98c51d8 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:28.537629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56444d-38d3-4555-a9b7-699febefa804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:28.538264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56444d-38d3-4555-a9b7-699febefa804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:28.538543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56444d-38d3-4555-a9b7-699febefa804 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:28.538817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56444d-38d3-4555-a9b7-699febefa804 admin admin] PATH_INFO: `/v3/projects/120d6a31928c4bc3a69ecbccb2c3f1a7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:28.539946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56444d-38d3-4555-a9b7-699febefa804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=120d6a31928c4bc3a69ecbccb2c3f1a7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:28.542021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56444d-38d3-4555-a9b7-699febefa804 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:28.685352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3d56444d-38d3-4555-a9b7-699febefa804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '120d6a31928c4bc3a69ecbccb2c3f1a7', 'request_id': 'req-3d56444d-38d3-4555-a9b7-699febefa804'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:28.699502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3d56444d-38d3-4555-a9b7-699febefa804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '120d6a31928c4bc3a69ecbccb2c3f1a7', 'request_id': 'req-3d56444d-38d3-4555-a9b7-699febefa804'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:28.713769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3d56444d-38d3-4555-a9b7-699febefa804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '120d6a31928c4bc3a69ecbccb2c3f1a7', 'request_id': 'req-3d56444d-38d3-4555-a9b7-699febefa804'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:28.751710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f61815-03e6-4c02-bdd0-4fa29939e6b3 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:28.754651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-23f61815-03e6-4c02-bdd0-4fa29939e6b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:28.767550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3d56444d-38d3-4555-a9b7-699febefa804 admin admin] The token cache is being invalidate because project 120d6a31928c4bc3a69ecbccb2c3f1a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:56:28.770002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3d56444d-38d3-4555-a9b7-699febefa804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:28.772712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3d56444d-38d3-4555-a9b7-699febefa804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:56:28.796584 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1855/3698] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:56:28 2022] DELETE /identity/v3/projects/120d6a31928c4bc3a69ecbccb2c3f1a7 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:56:28.811369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80387cbb-35a2-44d5-8bac-0814639ac652 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:28.812010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80387cbb-35a2-44d5-8bac-0814639ac652 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:28.813666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80387cbb-35a2-44d5-8bac-0814639ac652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:28.819632 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:28.885218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-80387cbb-35a2-44d5-8bac-0814639ac652 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:28.888813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-80387cbb-35a2-44d5-8bac-0814639ac652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:28.969275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f61815-03e6-4c02-bdd0-4fa29939e6b3 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:29.012204 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1856/3699] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:29.020204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab10aef-dd8c-46d0-94e3-8fa3bac5cc60 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:29.020703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab10aef-dd8c-46d0-94e3-8fa3bac5cc60 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:29.021051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab10aef-dd8c-46d0-94e3-8fa3bac5cc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:29.075573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bab10aef-dd8c-46d0-94e3-8fa3bac5cc60 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:29.077407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bab10aef-dd8c-46d0-94e3-8fa3bac5cc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:29.092402 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1857/3700] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:56:29.094877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab10aef-dd8c-46d0-94e3-8fa3bac5cc60 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:29.121991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab10aef-dd8c-46d0-94e3-8fa3bac5cc60 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:29.136100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f007b2-ecd2-46c6-a93e-3ad229682466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:29.136773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f007b2-ecd2-46c6-a93e-3ad229682466 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:29.139586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f007b2-ecd2-46c6-a93e-3ad229682466 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:29.139886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f007b2-ecd2-46c6-a93e-3ad229682466 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:29.140576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f007b2-ecd2-46c6-a93e-3ad229682466 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:56:29.140912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f007b2-ecd2-46c6-a93e-3ad229682466 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:29.142534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f007b2-ecd2-46c6-a93e-3ad229682466 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:29.147587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86060935-5bc4-45f1-8921-f516a2eadb3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:29.148342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86060935-5bc4-45f1-8921-f516a2eadb3b service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:29.148876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86060935-5bc4-45f1-8921-f516a2eadb3b service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:29.149264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86060935-5bc4-45f1-8921-f516a2eadb3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:29.151390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-86060935-5bc4-45f1-8921-f516a2eadb3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:29.179243 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1858/3701] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:56:29.180379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f007b2-ecd2-46c6-a93e-3ad229682466 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:29.202065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f007b2-ecd2-46c6-a93e-3ad229682466 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:29.216969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc321a-7231-471c-a6f8-759fecc5c37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:29.217812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc321a-7231-471c-a6f8-759fecc5c37c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:29.218124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc321a-7231-471c-a6f8-759fecc5c37c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:29.218400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc321a-7231-471c-a6f8-759fecc5c37c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:29.219041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc321a-7231-471c-a6f8-759fecc5c37c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:29.222882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc321a-7231-471c-a6f8-759fecc5c37c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:29.246295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86060935-5bc4-45f1-8921-f516a2eadb3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:29.249122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86060935-5bc4-45f1-8921-f516a2eadb3b service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:29.270205 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1844/3702] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:56:28 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:56:29.281056 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:29.294886 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1859/3703] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:56:29 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:56:29.296499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86060935-5bc4-45f1-8921-f516a2eadb3b service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:29.317773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86060935-5bc4-45f1-8921-f516a2eadb3b service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:29.441097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506e37c-9a4d-4880-b2d6-a17c8e63c43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:29.441734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506e37c-9a4d-4880-b2d6-a17c8e63c43c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:29.441979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506e37c-9a4d-4880-b2d6-a17c8e63c43c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:29.442379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506e37c-9a4d-4880-b2d6-a17c8e63c43c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:29.443159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506e37c-9a4d-4880-b2d6-a17c8e63c43c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:29.446667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506e37c-9a4d-4880-b2d6-a17c8e63c43c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:29.460881 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:29.497153 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1845/3704] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:56:29 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:56:29.502033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc321a-7231-471c-a6f8-759fecc5c37c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:29.516452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc321a-7231-471c-a6f8-759fecc5c37c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:29.535903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b2d6f-673a-494a-bbb5-70251e07de4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:29.537078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b2d6f-673a-494a-bbb5-70251e07de4e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:29.538024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b2d6f-673a-494a-bbb5-70251e07de4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:29.538024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b2d6f-673a-494a-bbb5-70251e07de4e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:29.538925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b2d6f-673a-494a-bbb5-70251e07de4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:29.542758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b2d6f-673a-494a-bbb5-70251e07de4e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:29.572522 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1860/3705] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:56:29.578016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506e37c-9a4d-4880-b2d6-a17c8e63c43c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:29.600244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506e37c-9a4d-4880-b2d6-a17c8e63c43c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:29.614112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447d63b-9f78-4130-964e-5d5e980153e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:29.617991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447d63b-9f78-4130-964e-5d5e980153e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:29.618399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447d63b-9f78-4130-964e-5d5e980153e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:29.619597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447d63b-9f78-4130-964e-5d5e980153e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:29.621516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447d63b-9f78-4130-964e-5d5e980153e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:29.627717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447d63b-9f78-4130-964e-5d5e980153e9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:29.660683 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1846/3706] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:56:29.664536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b2d6f-673a-494a-bbb5-70251e07de4e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:29.681009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b2d6f-673a-494a-bbb5-70251e07de4e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:29.709743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca959ba-1036-4518-a58e-7a7dfdfba021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:29.710697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca959ba-1036-4518-a58e-7a7dfdfba021 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:29.711046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca959ba-1036-4518-a58e-7a7dfdfba021 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:29.711552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca959ba-1036-4518-a58e-7a7dfdfba021 admin admin] PATH_INFO: `/v3/projects/fedeab6fbc7449468380dac88a387269/users/2d9048d76a5e47318a5a3990191d254b/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:29.768455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca959ba-1036-4518-a58e-7a7dfdfba021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fedeab6fbc7449468380dac88a387269, user_id=2d9048d76a5e47318a5a3990191d254b, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:29.771372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca959ba-1036-4518-a58e-7a7dfdfba021 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:29.824417 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1861/3707] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:56:29 2022] PUT /identity/v3/projects/fedeab6fbc7449468380dac88a387269/users/2d9048d76a5e47318a5a3990191d254b/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:56:29.829708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd6f7e-d1ba-40e4-8a7a-01c034cf8d47 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:29.830643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd6f7e-d1ba-40e4-8a7a-01c034cf8d47 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:29.830905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd6f7e-d1ba-40e4-8a7a-01c034cf8d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:29.866811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4ebd6f7e-d1ba-40e4-8a7a-01c034cf8d47 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:29.867970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4ebd6f7e-d1ba-40e4-8a7a-01c034cf8d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:29.966571 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1847/3708] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:29.999495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca959ba-1036-4518-a58e-7a7dfdfba021 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:30.001298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bca959ba-1036-4518-a58e-7a7dfdfba021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:30.188294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca959ba-1036-4518-a58e-7a7dfdfba021 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:30.195263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625a154-0dcd-4f0b-aeea-88cf9025bd45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:30.195890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625a154-0dcd-4f0b-aeea-88cf9025bd45 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:30.196303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625a154-0dcd-4f0b-aeea-88cf9025bd45 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:30.196420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625a154-0dcd-4f0b-aeea-88cf9025bd45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:30.220228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625a154-0dcd-4f0b-aeea-88cf9025bd45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:30.221716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625a154-0dcd-4f0b-aeea-88cf9025bd45 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:30.241583 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1862/3709] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:56:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:56:30.609062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475a1e6-eadf-4145-9e3d-bb09d71ec203 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:30.610073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475a1e6-eadf-4145-9e3d-bb09d71ec203 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:30.610539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475a1e6-eadf-4145-9e3d-bb09d71ec203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:30.640723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9475a1e6-eadf-4145-9e3d-bb09d71ec203 None None] MFA Rules not processed for user `df38bba9885247a4912244fe62c42650`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:30.642862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9475a1e6-eadf-4145-9e3d-bb09d71ec203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:30.781733 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1848/3710] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:30.792683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2912f-426d-4d82-bf0e-9f6aba1a23de None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:30.793517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2912f-426d-4d82-bf0e-9f6aba1a23de None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:30.793990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2912f-426d-4d82-bf0e-9f6aba1a23de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:30.853804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1dd2912f-426d-4d82-bf0e-9f6aba1a23de None None] MFA Rules not processed for user `df38bba9885247a4912244fe62c42650`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:30.855137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1dd2912f-426d-4d82-bf0e-9f6aba1a23de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:30.887855 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1863/3711] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:33.991069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e08e2-0dd5-4e96-8c48-d89e5847a524 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:33.991581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e08e2-0dd5-4e96-8c48-d89e5847a524 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:33.991581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e08e2-0dd5-4e96-8c48-d89e5847a524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:34.050328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ec7e08e2-0dd5-4e96-8c48-d89e5847a524 None None] MFA Rules not processed for user `3b97b83ebcf242d0abd55dfbb15ab066`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:34.051587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ec7e08e2-0dd5-4e96-8c48-d89e5847a524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:34.195321 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1849/3712] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:36.940129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2912f-426d-4d82-bf0e-9f6aba1a23de None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:36.942230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1dd2912f-426d-4d82-bf0e-9f6aba1a23de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:37.103088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2912f-426d-4d82-bf0e-9f6aba1a23de None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:37.117886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86495e5b-e281-4056-bcc8-bc74c59376a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:37.118511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86495e5b-e281-4056-bcc8-bc74c59376a8 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:37.118950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86495e5b-e281-4056-bcc8-bc74c59376a8 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:37.119229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86495e5b-e281-4056-bcc8-bc74c59376a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:37.138009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86495e5b-e281-4056-bcc8-bc74c59376a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:37.148784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86495e5b-e281-4056-bcc8-bc74c59376a8 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:37.176957 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1864/3713] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:56:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:56:40.235117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f79b6a-f337-4aea-a045-548cf2e06ed8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:40.236006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f79b6a-f337-4aea-a045-548cf2e06ed8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:40.236390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f79b6a-f337-4aea-a045-548cf2e06ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:40.309921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c4f79b6a-f337-4aea-a045-548cf2e06ed8 None None] MFA Rules not processed for user `3b97b83ebcf242d0abd55dfbb15ab066`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:40.314902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c4f79b6a-f337-4aea-a045-548cf2e06ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:40.350182 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1850/3714] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:43.663876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86495e5b-e281-4056-bcc8-bc74c59376a8 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:43.681862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86495e5b-e281-4056-bcc8-bc74c59376a8 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:43.696719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3075ce4-7a58-461e-b803-05aeb0f3682b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:43.701203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3075ce4-7a58-461e-b803-05aeb0f3682b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:43.701915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3075ce4-7a58-461e-b803-05aeb0f3682b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:43.702501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3075ce4-7a58-461e-b803-05aeb0f3682b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:43.709031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b3075ce4-7a58-461e-b803-05aeb0f3682b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:43.742993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3075ce4-7a58-461e-b803-05aeb0f3682b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:43.746346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3075ce4-7a58-461e-b803-05aeb0f3682b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:43.772113 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1865/3715] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:56:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:56:47.271882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498fc43-5799-49f9-ac57-45a7c2e0aa20 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:47.272380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498fc43-5799-49f9-ac57-45a7c2e0aa20 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:47.272464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498fc43-5799-49f9-ac57-45a7c2e0aa20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:47.350610 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:47.379084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1498fc43-5799-49f9-ac57-45a7c2e0aa20 None None] MFA Rules not processed for user `2d9048d76a5e47318a5a3990191d254b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:47.380302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1498fc43-5799-49f9-ac57-45a7c2e0aa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:47.542581 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1851/3716] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:47.816739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98750df4-ded5-488c-9d2e-a1f8e8c89466 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:47.817205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98750df4-ded5-488c-9d2e-a1f8e8c89466 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:47.817302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98750df4-ded5-488c-9d2e-a1f8e8c89466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:47.907443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-98750df4-ded5-488c-9d2e-a1f8e8c89466 None None] MFA Rules not processed for user `ab1d0b2474a84091b327ca04a247bc1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:47.910625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-98750df4-ded5-488c-9d2e-a1f8e8c89466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:47.921334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498fc43-5799-49f9-ac57-45a7c2e0aa20 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:47.942717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498fc43-5799-49f9-ac57-45a7c2e0aa20 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:47.959352 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:56:47.969137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a6d79-6130-4af8-838f-8411420517db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:47.970641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a6d79-6130-4af8-838f-8411420517db service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:47.971841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a6d79-6130-4af8-838f-8411420517db service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:47.972404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a6d79-6130-4af8-838f-8411420517db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:47.982440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a6d79-6130-4af8-838f-8411420517db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:47.984302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a6d79-6130-4af8-838f-8411420517db service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:47.998206 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1852/3717] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:56:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:56:48.089877 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1866/3718] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:48.458368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a6d79-6130-4af8-838f-8411420517db service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:56:48.481591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a6d79-6130-4af8-838f-8411420517db service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:56:48.491314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fdd48-384d-4520-a090-e1bc27642957 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:56:48.495341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fdd48-384d-4520-a090-e1bc27642957 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:48.496192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fdd48-384d-4520-a090-e1bc27642957 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:48.496727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fdd48-384d-4520-a090-e1bc27642957 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:48.500128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9b1fdd48-384d-4520-a090-e1bc27642957 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:48.648522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1fdd48-384d-4520-a090-e1bc27642957 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:56:48.659833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1fdd48-384d-4520-a090-e1bc27642957 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:56:48.697832 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1853/3719] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:56:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:56:57.497677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448fdb9-ade0-4e80-9c82-3dfbb48e6f94 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:57.498913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448fdb9-ade0-4e80-9c82-3dfbb48e6f94 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:57.499383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448fdb9-ade0-4e80-9c82-3dfbb48e6f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:57.541286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c448fdb9-ade0-4e80-9c82-3dfbb48e6f94 None None] MFA Rules not processed for user `24bd7adec54c44f9a941628f5adcc7a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:57.543377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c448fdb9-ade0-4e80-9c82-3dfbb48e6f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:57.551523 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1867/3720] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:56:58.531891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8324147-716b-4408-83f4-6aaf131bab21 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:56:58.532835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8324147-716b-4408-83f4-6aaf131bab21 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:56:58.533110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8324147-716b-4408-83f4-6aaf131bab21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:56:58.554518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d8324147-716b-4408-83f4-6aaf131bab21 None None] MFA Rules not processed for user `2d9048d76a5e47318a5a3990191d254b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:56:58.556448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d8324147-716b-4408-83f4-6aaf131bab21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:56:58.566783 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1854/3721] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:56:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:57:05.269366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448fdb9-ade0-4e80-9c82-3dfbb48e6f94 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:05.271330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c448fdb9-ade0-4e80-9c82-3dfbb48e6f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:05.296495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448fdb9-ade0-4e80-9c82-3dfbb48e6f94 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:05.305363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06769e-3b25-412d-93ae-045816d76bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:05.306059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06769e-3b25-412d-93ae-045816d76bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:05.306273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06769e-3b25-412d-93ae-045816d76bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:05.308011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06769e-3b25-412d-93ae-045816d76bb9 admin admin] PATH_INFO: `/v3/users/869dff6689f7401a92705cda198b5b54` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:05.309970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06769e-3b25-412d-93ae-045816d76bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=869dff6689f7401a92705cda198b5b54)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:05.312649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06769e-3b25-412d-93ae-045816d76bb9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:05.458744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a06769e-3b25-412d-93ae-045816d76bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '869dff6689f7401a92705cda198b5b54'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:05.460143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a06769e-3b25-412d-93ae-045816d76bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '869dff6689f7401a92705cda198b5b54'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:05.477679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a06769e-3b25-412d-93ae-045816d76bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '869dff6689f7401a92705cda198b5b54'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:05.507960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a06769e-3b25-412d-93ae-045816d76bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '869dff6689f7401a92705cda198b5b54'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:05.524115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a06769e-3b25-412d-93ae-045816d76bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '869dff6689f7401a92705cda198b5b54'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:05.536902 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1868/3722] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:57:05 2022] DELETE /identity/v3/users/869dff6689f7401a92705cda198b5b54 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:57:06.680967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8324147-716b-4408-83f4-6aaf131bab21 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:06.700899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8324147-716b-4408-83f4-6aaf131bab21 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:06.850124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a493cce-d172-444c-b540-24ef335931d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:06.850948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a493cce-d172-444c-b540-24ef335931d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:06.854022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a493cce-d172-444c-b540-24ef335931d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:06.854573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a493cce-d172-444c-b540-24ef335931d6 admin admin] PATH_INFO: `/v3/projects/bd22a349f1954652832a5cc6c80869a5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:06.856018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a493cce-d172-444c-b540-24ef335931d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd22a349f1954652832a5cc6c80869a5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:06.858772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a493cce-d172-444c-b540-24ef335931d6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:06.896691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06769e-3b25-412d-93ae-045816d76bb9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:06.898975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1a06769e-3b25-412d-93ae-045816d76bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:06.951794 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:07.036800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a493cce-d172-444c-b540-24ef335931d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd22a349f1954652832a5cc6c80869a5', 'request_id': 'req-0a493cce-d172-444c-b540-24ef335931d6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:07.049413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a493cce-d172-444c-b540-24ef335931d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd22a349f1954652832a5cc6c80869a5', 'request_id': 'req-0a493cce-d172-444c-b540-24ef335931d6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:07.060750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a493cce-d172-444c-b540-24ef335931d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd22a349f1954652832a5cc6c80869a5', 'request_id': 'req-0a493cce-d172-444c-b540-24ef335931d6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:07.078426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a493cce-d172-444c-b540-24ef335931d6 admin admin] The token cache is being invalidate because project bd22a349f1954652832a5cc6c80869a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:57:07.079000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a493cce-d172-444c-b540-24ef335931d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:07.079841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a493cce-d172-444c-b540-24ef335931d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:07.082109 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1855/3723] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:57:06 2022] DELETE /identity/v3/projects/bd22a349f1954652832a5cc6c80869a5 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:57:07.086893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165160d2-64ac-4075-8189-3f4e7ef8f886 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:07.087482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165160d2-64ac-4075-8189-3f4e7ef8f886 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:07.088173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165160d2-64ac-4075-8189-3f4e7ef8f886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:07.124209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-165160d2-64ac-4075-8189-3f4e7ef8f886 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:07.126913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-165160d2-64ac-4075-8189-3f4e7ef8f886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:07.130654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06769e-3b25-412d-93ae-045816d76bb9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:07.149216 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:07.212135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb168c8-96eb-444f-8bae-74c8278d349c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:07.213225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb168c8-96eb-444f-8bae-74c8278d349c service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:07.213613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb168c8-96eb-444f-8bae-74c8278d349c service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:07.214143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb168c8-96eb-444f-8bae-74c8278d349c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:07.216515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6fb168c8-96eb-444f-8bae-74c8278d349c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:07.230681 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1856/3724] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:57:07.238904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168a283-3716-43b0-ae0f-4e930db4d1e1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:07.239550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168a283-3716-43b0-ae0f-4e930db4d1e1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:07.239990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168a283-3716-43b0-ae0f-4e930db4d1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:07.279746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6168a283-3716-43b0-ae0f-4e930db4d1e1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:07.284319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6168a283-3716-43b0-ae0f-4e930db4d1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:07.305776 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1857/3725] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:57:07.310638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168a283-3716-43b0-ae0f-4e930db4d1e1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:07.318554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb168c8-96eb-444f-8bae-74c8278d349c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:07.324013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb168c8-96eb-444f-8bae-74c8278d349c service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:07.334447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168a283-3716-43b0-ae0f-4e930db4d1e1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:07.347046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292bd1e-d011-4cdf-a7f4-1760232fb38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:07.347936 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1869/3726] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:57:06 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:57:07.348429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292bd1e-d011-4cdf-a7f4-1760232fb38a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:07.348737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292bd1e-d011-4cdf-a7f4-1760232fb38a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:07.349128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292bd1e-d011-4cdf-a7f4-1760232fb38a admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:07.349911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292bd1e-d011-4cdf-a7f4-1760232fb38a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:57:07.350111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292bd1e-d011-4cdf-a7f4-1760232fb38a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:07.351664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292bd1e-d011-4cdf-a7f4-1760232fb38a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:07.367799 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1858/3727] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:57:07.372448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb168c8-96eb-444f-8bae-74c8278d349c service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:07.387857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb168c8-96eb-444f-8bae-74c8278d349c service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:07.406404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208ede7-49db-4920-af95-82a711e6e538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:07.408194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208ede7-49db-4920-af95-82a711e6e538 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:07.408479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208ede7-49db-4920-af95-82a711e6e538 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:07.408779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208ede7-49db-4920-af95-82a711e6e538 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:07.410708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208ede7-49db-4920-af95-82a711e6e538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:07.414645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208ede7-49db-4920-af95-82a711e6e538 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:07.455217 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1870/3728] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:57:07 2022] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:57:07.460850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292bd1e-d011-4cdf-a7f4-1760232fb38a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:07.476014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292bd1e-d011-4cdf-a7f4-1760232fb38a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:07.550450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d294f-5cc9-4f6c-ad86-b70c33ed8eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:07.550809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d294f-5cc9-4f6c-ad86-b70c33ed8eac admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:07.551390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d294f-5cc9-4f6c-ad86-b70c33ed8eac admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:07.551919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d294f-5cc9-4f6c-ad86-b70c33ed8eac admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:07.553208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d294f-5cc9-4f6c-ad86-b70c33ed8eac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:07.555487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d294f-5cc9-4f6c-ad86-b70c33ed8eac admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:07.601599 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1859/3729] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:57:07 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:57:07.602071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208ede7-49db-4920-af95-82a711e6e538 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:07.615856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208ede7-49db-4920-af95-82a711e6e538 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:07.640573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74efa32-8f44-4e07-8e29-ca2349001739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:07.642119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74efa32-8f44-4e07-8e29-ca2349001739 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:07.643370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74efa32-8f44-4e07-8e29-ca2349001739 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:07.643722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74efa32-8f44-4e07-8e29-ca2349001739 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:07.645062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74efa32-8f44-4e07-8e29-ca2349001739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:07.646768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74efa32-8f44-4e07-8e29-ca2349001739 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:07.679341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d294f-5cc9-4f6c-ad86-b70c33ed8eac admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:07.691421 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1871/3730] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:57:07.695695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d294f-5cc9-4f6c-ad86-b70c33ed8eac admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:07.713085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445c7b0-e711-4121-978b-62456e2813dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:07.714572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445c7b0-e711-4121-978b-62456e2813dd admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:07.717043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445c7b0-e711-4121-978b-62456e2813dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:07.718875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445c7b0-e711-4121-978b-62456e2813dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:07.721811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445c7b0-e711-4121-978b-62456e2813dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:07.727186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445c7b0-e711-4121-978b-62456e2813dd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:07.766341 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1860/3731] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:57:07.767007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74efa32-8f44-4e07-8e29-ca2349001739 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:07.792221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74efa32-8f44-4e07-8e29-ca2349001739 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:07.810029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29421b46-39af-4a6f-8f32-7b73e8fbc900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:07.811233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29421b46-39af-4a6f-8f32-7b73e8fbc900 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:07.811621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29421b46-39af-4a6f-8f32-7b73e8fbc900 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:07.812177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29421b46-39af-4a6f-8f32-7b73e8fbc900 admin admin] PATH_INFO: `/v3/projects/1e09a5f6f6e24b4daaffc7578681610c/users/b3485c6515d64172a375290063a9406f/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:07.836211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29421b46-39af-4a6f-8f32-7b73e8fbc900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e09a5f6f6e24b4daaffc7578681610c, user_id=b3485c6515d64172a375290063a9406f, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:07.839472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29421b46-39af-4a6f-8f32-7b73e8fbc900 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:07.875157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dabc1d-6eb6-4cbb-9d7c-7cd4d3d0f9f1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:07.875585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dabc1d-6eb6-4cbb-9d7c-7cd4d3d0f9f1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:07.876097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dabc1d-6eb6-4cbb-9d7c-7cd4d3d0f9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:07.886965 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1872/3732] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:57:07 2022] PUT /identity/v3/projects/1e09a5f6f6e24b4daaffc7578681610c/users/b3485c6515d64172a375290063a9406f/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:57:07.894300 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:07.903004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e0dabc1d-6eb6-4cbb-9d7c-7cd4d3d0f9f1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:07.907067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e0dabc1d-6eb6-4cbb-9d7c-7cd4d3d0f9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:08.038727 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1861/3733] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:57:08.055151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29421b46-39af-4a6f-8f32-7b73e8fbc900 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:08.057459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-29421b46-39af-4a6f-8f32-7b73e8fbc900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:08.178855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29421b46-39af-4a6f-8f32-7b73e8fbc900 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:08.193298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d916e23-030e-4262-881a-1c19dcf0482b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:08.196012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d916e23-030e-4262-881a-1c19dcf0482b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:08.197067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d916e23-030e-4262-881a-1c19dcf0482b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:08.199081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d916e23-030e-4262-881a-1c19dcf0482b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:08.234475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d916e23-030e-4262-881a-1c19dcf0482b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:08.239731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d916e23-030e-4262-881a-1c19dcf0482b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:08.319281 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1873/3734] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:57:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:57:18.017413 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=24 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:18.295440 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:22.348767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ab36e-cfad-4bc0-bed3-c0c672857751 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:22.349227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ab36e-cfad-4bc0-bed3-c0c672857751 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:22.349325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ab36e-cfad-4bc0-bed3-c0c672857751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:22.407163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f03ab36e-cfad-4bc0-bed3-c0c672857751 None None] MFA Rules not processed for user `b3485c6515d64172a375290063a9406f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:22.408714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f03ab36e-cfad-4bc0-bed3-c0c672857751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:22.524573 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1862/3735] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:57:22.715393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d916e23-030e-4262-881a-1c19dcf0482b service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:22.717695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8d916e23-030e-4262-881a-1c19dcf0482b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:22.825183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d916e23-030e-4262-881a-1c19dcf0482b service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:22.830809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11d19a-fe0e-435a-8a0f-f7b1e179aa49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:22.831680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11d19a-fe0e-435a-8a0f-f7b1e179aa49 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:22.832497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11d19a-fe0e-435a-8a0f-f7b1e179aa49 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:22.832497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11d19a-fe0e-435a-8a0f-f7b1e179aa49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:22.842891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11d19a-fe0e-435a-8a0f-f7b1e179aa49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:22.845179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11d19a-fe0e-435a-8a0f-f7b1e179aa49 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:22.855975 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1874/3736] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:57:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:57:24.891298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ab36e-cfad-4bc0-bed3-c0c672857751 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:24.892988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f03ab36e-cfad-4bc0-bed3-c0c672857751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:24.914204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ab36e-cfad-4bc0-bed3-c0c672857751 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:24.923286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c565bb6-5962-4f8a-92b6-942b7d152cc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:24.923916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c565bb6-5962-4f8a-92b6-942b7d152cc8 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:24.924367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c565bb6-5962-4f8a-92b6-942b7d152cc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:24.924850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c565bb6-5962-4f8a-92b6-942b7d152cc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:24.930730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1c565bb6-5962-4f8a-92b6-942b7d152cc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:24.949403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c565bb6-5962-4f8a-92b6-942b7d152cc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:24.950853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c565bb6-5962-4f8a-92b6-942b7d152cc8 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:24.965654 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1863/3737] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:57:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:57:29.232616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d4b5d-89ba-4b86-bb01-1bed12b07e50 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:29.233128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d4b5d-89ba-4b86-bb01-1bed12b07e50 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:29.233215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d4b5d-89ba-4b86-bb01-1bed12b07e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:29.255269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8c0d4b5d-89ba-4b86-bb01-1bed12b07e50 None None] MFA Rules not processed for user `b3485c6515d64172a375290063a9406f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:29.256509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8c0d4b5d-89ba-4b86-bb01-1bed12b07e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:29.277520 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1875/3738] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:57:34.938240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c565bb6-5962-4f8a-92b6-942b7d152cc8 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:34.951258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c565bb6-5962-4f8a-92b6-942b7d152cc8 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:34.957507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec82fb2-2993-492b-bb88-898e6a2d2a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:34.958339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec82fb2-2993-492b-bb88-898e6a2d2a52 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:34.958788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec82fb2-2993-492b-bb88-898e6a2d2a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:34.959209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec82fb2-2993-492b-bb88-898e6a2d2a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:34.964301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1ec82fb2-2993-492b-bb88-898e6a2d2a52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:35.001249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec82fb2-2993-492b-bb88-898e6a2d2a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:35.007081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec82fb2-2993-492b-bb88-898e6a2d2a52 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:35.030564 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1864/3739] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:57:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:57:35.599804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d4b5d-89ba-4b86-bb01-1bed12b07e50 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:35.601389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8c0d4b5d-89ba-4b86-bb01-1bed12b07e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:35.627957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d4b5d-89ba-4b86-bb01-1bed12b07e50 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:35.637084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c23575-a50f-4b19-a57c-c2086de1b043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:35.637823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c23575-a50f-4b19-a57c-c2086de1b043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:35.638321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c23575-a50f-4b19-a57c-c2086de1b043 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:35.638792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c23575-a50f-4b19-a57c-c2086de1b043 admin admin] PATH_INFO: `/v3/users/60912bd5bfdf451ea7348b8372ba1a5a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:35.640212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c23575-a50f-4b19-a57c-c2086de1b043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60912bd5bfdf451ea7348b8372ba1a5a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:35.642498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c23575-a50f-4b19-a57c-c2086de1b043 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:35.732556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-71c23575-a50f-4b19-a57c-c2086de1b043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60912bd5bfdf451ea7348b8372ba1a5a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:35.733633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-71c23575-a50f-4b19-a57c-c2086de1b043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60912bd5bfdf451ea7348b8372ba1a5a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:35.752509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-71c23575-a50f-4b19-a57c-c2086de1b043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60912bd5bfdf451ea7348b8372ba1a5a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:35.769942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-71c23575-a50f-4b19-a57c-c2086de1b043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60912bd5bfdf451ea7348b8372ba1a5a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:35.806395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-71c23575-a50f-4b19-a57c-c2086de1b043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60912bd5bfdf451ea7348b8372ba1a5a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:35.815876 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1876/3740] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:57:35 2022] DELETE /identity/v3/users/60912bd5bfdf451ea7348b8372ba1a5a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:57:35.820426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc79b2-6ed3-4b52-afb3-5826b48cb1a6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:35.820815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc79b2-6ed3-4b52-afb3-5826b48cb1a6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:35.821882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc79b2-6ed3-4b52-afb3-5826b48cb1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:35.845690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-54dc79b2-6ed3-4b52-afb3-5826b48cb1a6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:35.847810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-54dc79b2-6ed3-4b52-afb3-5826b48cb1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:35.969396 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1865/3741] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:57:35.975313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c23575-a50f-4b19-a57c-c2086de1b043 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:35.977310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-71c23575-a50f-4b19-a57c-c2086de1b043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:36.077937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c23575-a50f-4b19-a57c-c2086de1b043 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:36.082422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7e927-33cf-488b-9166-410decf30267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:36.083230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7e927-33cf-488b-9166-410decf30267 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:36.083545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7e927-33cf-488b-9166-410decf30267 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:36.084033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7e927-33cf-488b-9166-410decf30267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:36.091225 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:36.095137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7e927-33cf-488b-9166-410decf30267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:36.098007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7e927-33cf-488b-9166-410decf30267 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:36.110414 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1877/3742] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:57:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:57:36.491125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc79b2-6ed3-4b52-afb3-5826b48cb1a6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:36.492781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-54dc79b2-6ed3-4b52-afb3-5826b48cb1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:36.505602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc79b2-6ed3-4b52-afb3-5826b48cb1a6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:36.510721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2b76d-1c62-4771-b9c7-26329d0d36cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:36.511355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2b76d-1c62-4771-b9c7-26329d0d36cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:36.511809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2b76d-1c62-4771-b9c7-26329d0d36cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:36.512247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2b76d-1c62-4771-b9c7-26329d0d36cd admin admin] PATH_INFO: `/v3/projects/2a2088d20a3a468c92136e5f3cd9cffb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:36.513425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2b76d-1c62-4771-b9c7-26329d0d36cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a2088d20a3a468c92136e5f3cd9cffb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:36.515542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2b76d-1c62-4771-b9c7-26329d0d36cd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:36.609947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7eb2b76d-1c62-4771-b9c7-26329d0d36cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a2088d20a3a468c92136e5f3cd9cffb', 'request_id': 'req-7eb2b76d-1c62-4771-b9c7-26329d0d36cd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:36.621474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7eb2b76d-1c62-4771-b9c7-26329d0d36cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a2088d20a3a468c92136e5f3cd9cffb', 'request_id': 'req-7eb2b76d-1c62-4771-b9c7-26329d0d36cd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:36.626625 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:36.628652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7eb2b76d-1c62-4771-b9c7-26329d0d36cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a2088d20a3a468c92136e5f3cd9cffb', 'request_id': 'req-7eb2b76d-1c62-4771-b9c7-26329d0d36cd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:36.656653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7eb2b76d-1c62-4771-b9c7-26329d0d36cd admin admin] The token cache is being invalidate because project 2a2088d20a3a468c92136e5f3cd9cffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:57:36.657153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7eb2b76d-1c62-4771-b9c7-26329d0d36cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:36.657818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7eb2b76d-1c62-4771-b9c7-26329d0d36cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:36.660146 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1866/3743] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:57:36 2022] DELETE /identity/v3/projects/2a2088d20a3a468c92136e5f3cd9cffb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:57:36.664084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7e927-33cf-488b-9166-410decf30267 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:36.674784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7e927-33cf-488b-9166-410decf30267 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:36.750574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8e0d2-591b-41a5-8b6a-bffcee722c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:36.751559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8e0d2-591b-41a5-8b6a-bffcee722c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:36.751559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8e0d2-591b-41a5-8b6a-bffcee722c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:36.751794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8e0d2-591b-41a5-8b6a-bffcee722c9b admin admin] PATH_INFO: `/v3/users/f7b327cf288848e2b241c128f627b194` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:36.753170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8e0d2-591b-41a5-8b6a-bffcee722c9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7b327cf288848e2b241c128f627b194)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:36.755101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8e0d2-591b-41a5-8b6a-bffcee722c9b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:36.817119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-67d8e0d2-591b-41a5-8b6a-bffcee722c9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7b327cf288848e2b241c128f627b194'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:36.817703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-67d8e0d2-591b-41a5-8b6a-bffcee722c9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7b327cf288848e2b241c128f627b194'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:36.829282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-67d8e0d2-591b-41a5-8b6a-bffcee722c9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7b327cf288848e2b241c128f627b194'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:36.844388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-67d8e0d2-591b-41a5-8b6a-bffcee722c9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7b327cf288848e2b241c128f627b194'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:36.853300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-67d8e0d2-591b-41a5-8b6a-bffcee722c9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7b327cf288848e2b241c128f627b194'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:36.862279 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1878/3744] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:57:36 2022] DELETE /identity/v3/users/f7b327cf288848e2b241c128f627b194 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:57:36.923121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2b76d-1c62-4771-b9c7-26329d0d36cd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:36.924980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7eb2b76d-1c62-4771-b9c7-26329d0d36cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:36.939987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2b76d-1c62-4771-b9c7-26329d0d36cd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:37.026434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4c870-e24e-422a-850f-7591b073c7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:37.027194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4c870-e24e-422a-850f-7591b073c7c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:37.028043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4c870-e24e-422a-850f-7591b073c7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:37.028428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4c870-e24e-422a-850f-7591b073c7c5 admin admin] PATH_INFO: `/v3/users/837f1e6c28364ca5baa52b20c0e5904b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:37.030584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4c870-e24e-422a-850f-7591b073c7c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=837f1e6c28364ca5baa52b20c0e5904b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:37.033961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4c870-e24e-422a-850f-7591b073c7c5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:37.091916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8e0d2-591b-41a5-8b6a-bffcee722c9b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:37.094426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-67d8e0d2-591b-41a5-8b6a-bffcee722c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:37.111992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e2c4c870-e24e-422a-850f-7591b073c7c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '837f1e6c28364ca5baa52b20c0e5904b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:37.123192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8e0d2-591b-41a5-8b6a-bffcee722c9b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:37.125686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e2c4c870-e24e-422a-850f-7591b073c7c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '837f1e6c28364ca5baa52b20c0e5904b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:37.126423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e2c4c870-e24e-422a-850f-7591b073c7c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '837f1e6c28364ca5baa52b20c0e5904b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:37.132063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d27238-1edc-4bda-9d3d-341951a4a030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:37.133908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d27238-1edc-4bda-9d3d-341951a4a030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:37.134950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d27238-1edc-4bda-9d3d-341951a4a030 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:37.135690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d27238-1edc-4bda-9d3d-341951a4a030 admin admin] PATH_INFO: `/v3/projects/99f7d49016d24b0c8188d759d99ba16f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:37.137630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d27238-1edc-4bda-9d3d-341951a4a030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99f7d49016d24b0c8188d759d99ba16f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:37.140230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d27238-1edc-4bda-9d3d-341951a4a030 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:37.142866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e2c4c870-e24e-422a-850f-7591b073c7c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '837f1e6c28364ca5baa52b20c0e5904b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:37.151145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e2c4c870-e24e-422a-850f-7591b073c7c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '837f1e6c28364ca5baa52b20c0e5904b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:37.159239 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1867/3745] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:57:36 2022] DELETE /identity/v3/users/837f1e6c28364ca5baa52b20c0e5904b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:57:37.209943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-99d27238-1edc-4bda-9d3d-341951a4a030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99f7d49016d24b0c8188d759d99ba16f', 'request_id': 'req-99d27238-1edc-4bda-9d3d-341951a4a030'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:37.226231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-99d27238-1edc-4bda-9d3d-341951a4a030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99f7d49016d24b0c8188d759d99ba16f', 'request_id': 'req-99d27238-1edc-4bda-9d3d-341951a4a030'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:37.234270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-99d27238-1edc-4bda-9d3d-341951a4a030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99f7d49016d24b0c8188d759d99ba16f', 'request_id': 'req-99d27238-1edc-4bda-9d3d-341951a4a030'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:37.236458 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:37.251221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-99d27238-1edc-4bda-9d3d-341951a4a030 admin admin] The token cache is being invalidate because project 99f7d49016d24b0c8188d759d99ba16f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:57:37.252189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-99d27238-1edc-4bda-9d3d-341951a4a030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:37.253218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-99d27238-1edc-4bda-9d3d-341951a4a030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:37.259053 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1879/3746] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:57:37 2022] DELETE /identity/v3/projects/99f7d49016d24b0c8188d759d99ba16f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:57:37.260202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d376169-9c12-494a-8b30-ee960be4c5f6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:37.260467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d376169-9c12-494a-8b30-ee960be4c5f6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:37.260786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d376169-9c12-494a-8b30-ee960be4c5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:37.285444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4d376169-9c12-494a-8b30-ee960be4c5f6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:37.286690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4d376169-9c12-494a-8b30-ee960be4c5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:37.381518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d27238-1edc-4bda-9d3d-341951a4a030 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:37.382997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-99d27238-1edc-4bda-9d3d-341951a4a030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:37.417581 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1868/3747] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:57:37.425690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1497522-d8c8-4d3b-90c8-d1ef1ee5c9cb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:37.426041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1497522-d8c8-4d3b-90c8-d1ef1ee5c9cb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:37.426320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1497522-d8c8-4d3b-90c8-d1ef1ee5c9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:37.441982 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:37.451610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d1497522-d8c8-4d3b-90c8-d1ef1ee5c9cb None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:37.453447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d1497522-d8c8-4d3b-90c8-d1ef1ee5c9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:37.474222 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1869/3748] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:57:37.475533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1497522-d8c8-4d3b-90c8-d1ef1ee5c9cb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:37.491085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1497522-d8c8-4d3b-90c8-d1ef1ee5c9cb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:37.499333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70408228-cff9-4a91-a24c-6d31aa1b8b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:37.500163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70408228-cff9-4a91-a24c-6d31aa1b8b9c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:37.500621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70408228-cff9-4a91-a24c-6d31aa1b8b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:37.500936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70408228-cff9-4a91-a24c-6d31aa1b8b9c admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:37.501586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70408228-cff9-4a91-a24c-6d31aa1b8b9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:57:37.501880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70408228-cff9-4a91-a24c-6d31aa1b8b9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:37.503509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70408228-cff9-4a91-a24c-6d31aa1b8b9c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:37.506991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d27238-1edc-4bda-9d3d-341951a4a030 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:37.515503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0b586-1639-4e61-b668-c606c1eaa2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:37.516306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0b586-1639-4e61-b668-c606c1eaa2fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:37.516717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0b586-1639-4e61-b668-c606c1eaa2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:37.517089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0b586-1639-4e61-b668-c606c1eaa2fe admin admin] PATH_INFO: `/v3/projects/74a6fc0df7814673ae887215b5b41305` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:37.518298 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1870/3749] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:57:37.519009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0b586-1639-4e61-b668-c606c1eaa2fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=74a6fc0df7814673ae887215b5b41305)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:37.521214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0b586-1639-4e61-b668-c606c1eaa2fe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:37.522526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70408228-cff9-4a91-a24c-6d31aa1b8b9c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:37.536210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70408228-cff9-4a91-a24c-6d31aa1b8b9c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:37.542123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a024f-0e7c-4ade-8127-1b789837fc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:37.543188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a024f-0e7c-4ade-8127-1b789837fc22 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:37.543589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a024f-0e7c-4ade-8127-1b789837fc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:37.543987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a024f-0e7c-4ade-8127-1b789837fc22 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:37.544804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a024f-0e7c-4ade-8127-1b789837fc22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:37.547059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a024f-0e7c-4ade-8127-1b789837fc22 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:37.601819 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1871/3750] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:57:37 2022] POST /identity/v3/projects => generated 403 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:57:37.602738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2aa0b586-1639-4e61-b668-c606c1eaa2fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a6fc0df7814673ae887215b5b41305', 'request_id': 'req-2aa0b586-1639-4e61-b668-c606c1eaa2fe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:37.605524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a024f-0e7c-4ade-8127-1b789837fc22 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:37.618659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2aa0b586-1639-4e61-b668-c606c1eaa2fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a6fc0df7814673ae887215b5b41305', 'request_id': 'req-2aa0b586-1639-4e61-b668-c606c1eaa2fe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:37.627957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2aa0b586-1639-4e61-b668-c606c1eaa2fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a6fc0df7814673ae887215b5b41305', 'request_id': 'req-2aa0b586-1639-4e61-b668-c606c1eaa2fe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:37.642537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2aa0b586-1639-4e61-b668-c606c1eaa2fe admin admin] The token cache is being invalidate because project 74a6fc0df7814673ae887215b5b41305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:57:37.642913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2aa0b586-1639-4e61-b668-c606c1eaa2fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:37.643616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2aa0b586-1639-4e61-b668-c606c1eaa2fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:37.645528 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1880/3751] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:57:37 2022] DELETE /identity/v3/projects/74a6fc0df7814673ae887215b5b41305 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:57:37.649400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0b586-1639-4e61-b668-c606c1eaa2fe admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:37.651043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2aa0b586-1639-4e61-b668-c606c1eaa2fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:37.747869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a024f-0e7c-4ade-8127-1b789837fc22 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:37.758702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fc652-5698-4490-addb-a187cb27ebc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:37.759494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fc652-5698-4490-addb-a187cb27ebc4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:37.759768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fc652-5698-4490-addb-a187cb27ebc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:37.760103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fc652-5698-4490-addb-a187cb27ebc4 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:37.760800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fc652-5698-4490-addb-a187cb27ebc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:37.762921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fc652-5698-4490-addb-a187cb27ebc4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:37.793573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0b586-1639-4e61-b668-c606c1eaa2fe admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:37.794377 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1872/3752] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:57:37 2022] POST /identity/v3/users => generated 302 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:57:37.797840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fc652-5698-4490-addb-a187cb27ebc4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:37.802109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7e7fc652-5698-4490-addb-a187cb27ebc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:37.804991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c98bd-3ecc-4c18-b004-20a1a082bba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:37.804991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c98bd-3ecc-4c18-b004-20a1a082bba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:37.805352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c98bd-3ecc-4c18-b004-20a1a082bba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:37.806215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c98bd-3ecc-4c18-b004-20a1a082bba6 admin admin] PATH_INFO: `/v3/users/2208703cb8f84555854ae47fb6084a20` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:37.807622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c98bd-3ecc-4c18-b004-20a1a082bba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2208703cb8f84555854ae47fb6084a20)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:37.809950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c98bd-3ecc-4c18-b004-20a1a082bba6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:37.823771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fc652-5698-4490-addb-a187cb27ebc4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:37.832739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e077579-5ba2-42cf-b90c-3747fb9414db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:37.833698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e077579-5ba2-42cf-b90c-3747fb9414db admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:37.834193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e077579-5ba2-42cf-b90c-3747fb9414db admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:37.835755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e077579-5ba2-42cf-b90c-3747fb9414db admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:37.837041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e077579-5ba2-42cf-b90c-3747fb9414db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:37.839221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e077579-5ba2-42cf-b90c-3747fb9414db admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:37.858058 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:37.866023 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1873/3753] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:57:37.871234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e077579-5ba2-42cf-b90c-3747fb9414db admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:37.890579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e077579-5ba2-42cf-b90c-3747fb9414db admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:37.891488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-be2c98bd-3ecc-4c18-b004-20a1a082bba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2208703cb8f84555854ae47fb6084a20'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:37.892831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-be2c98bd-3ecc-4c18-b004-20a1a082bba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2208703cb8f84555854ae47fb6084a20'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:37.898576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc6b75-dbb5-49ed-a00f-3df5b9cf6157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:37.899704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc6b75-dbb5-49ed-a00f-3df5b9cf6157 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:37.900115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc6b75-dbb5-49ed-a00f-3df5b9cf6157 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:37.900350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc6b75-dbb5-49ed-a00f-3df5b9cf6157 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:37.901846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc6b75-dbb5-49ed-a00f-3df5b9cf6157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:37.902550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-be2c98bd-3ecc-4c18-b004-20a1a082bba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2208703cb8f84555854ae47fb6084a20'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:37.904564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc6b75-dbb5-49ed-a00f-3df5b9cf6157 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:37.925346 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1874/3754] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:57:37.929780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc6b75-dbb5-49ed-a00f-3df5b9cf6157 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:37.933724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-acdc6b75-dbb5-49ed-a00f-3df5b9cf6157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:37.936770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-be2c98bd-3ecc-4c18-b004-20a1a082bba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2208703cb8f84555854ae47fb6084a20'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:37.946412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-be2c98bd-3ecc-4c18-b004-20a1a082bba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2208703cb8f84555854ae47fb6084a20'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:37.956827 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1881/3755] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:57:37 2022] DELETE /identity/v3/users/2208703cb8f84555854ae47fb6084a20 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:57:37.958106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc6b75-dbb5-49ed-a00f-3df5b9cf6157 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:38.023735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc7542-a8b4-4d6d-a96b-cfe9428d88a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:38.024992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc7542-a8b4-4d6d-a96b-cfe9428d88a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:38.025614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc7542-a8b4-4d6d-a96b-cfe9428d88a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:38.025614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc7542-a8b4-4d6d-a96b-cfe9428d88a8 admin admin] PATH_INFO: `/v3/projects/352f8f767e1e42adbbc7ce17dde55a86/users/90b9902b5edc4107bde6f852a5fc4c6d/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:38.061004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc7542-a8b4-4d6d-a96b-cfe9428d88a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=352f8f767e1e42adbbc7ce17dde55a86, user_id=90b9902b5edc4107bde6f852a5fc4c6d, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:38.061940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc7542-a8b4-4d6d-a96b-cfe9428d88a8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:38.098535 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1875/3756] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:57:37 2022] PUT /identity/v3/projects/352f8f767e1e42adbbc7ce17dde55a86/users/90b9902b5edc4107bde6f852a5fc4c6d/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:57:38.110950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00de87-f4fd-4508-962f-a36c3a3a8692 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:38.111251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00de87-f4fd-4508-962f-a36c3a3a8692 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:38.111513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00de87-f4fd-4508-962f-a36c3a3a8692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:38.162469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4f00de87-f4fd-4508-962f-a36c3a3a8692 None None] MFA Rules not processed for user `90b9902b5edc4107bde6f852a5fc4c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:38.163704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4f00de87-f4fd-4508-962f-a36c3a3a8692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:38.238743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc7542-a8b4-4d6d-a96b-cfe9428d88a8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:38.240552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-55bc7542-a8b4-4d6d-a96b-cfe9428d88a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:38.266072 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:38.282357 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1882/3757] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:38 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:57:38.286888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00de87-f4fd-4508-962f-a36c3a3a8692 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:38.344286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc7542-a8b4-4d6d-a96b-cfe9428d88a8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:38.349456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b756fd-7461-42e2-8bbf-485b70da2e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:38.350164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b756fd-7461-42e2-8bbf-485b70da2e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:38.350508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b756fd-7461-42e2-8bbf-485b70da2e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:38.351263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b756fd-7461-42e2-8bbf-485b70da2e67 admin admin] PATH_INFO: `/v3/projects/fd2feaa2204441cda3b435507ca4865e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:38.352250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b756fd-7461-42e2-8bbf-485b70da2e67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd2feaa2204441cda3b435507ca4865e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:38.355174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b756fd-7461-42e2-8bbf-485b70da2e67 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:38.376999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00de87-f4fd-4508-962f-a36c3a3a8692 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:38.382575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4ac79-50ae-453f-aa41-7f86d69f4cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:38.383432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4ac79-50ae-453f-aa41-7f86d69f4cba admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:38.383432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4ac79-50ae-453f-aa41-7f86d69f4cba admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:38.383830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4ac79-50ae-453f-aa41-7f86d69f4cba admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:38.385066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4ac79-50ae-453f-aa41-7f86d69f4cba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:38.387934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4ac79-50ae-453f-aa41-7f86d69f4cba admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:38.447401 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1883/3758] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:57:38 2022] POST /identity/v3/projects => generated 403 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:57:38.451281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4ac79-50ae-453f-aa41-7f86d69f4cba admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:38.451469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-42b756fd-7461-42e2-8bbf-485b70da2e67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd2feaa2204441cda3b435507ca4865e', 'request_id': 'req-42b756fd-7461-42e2-8bbf-485b70da2e67'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:38.464324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-42b756fd-7461-42e2-8bbf-485b70da2e67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd2feaa2204441cda3b435507ca4865e', 'request_id': 'req-42b756fd-7461-42e2-8bbf-485b70da2e67'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:38.471091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-42b756fd-7461-42e2-8bbf-485b70da2e67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd2feaa2204441cda3b435507ca4865e', 'request_id': 'req-42b756fd-7461-42e2-8bbf-485b70da2e67'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:38.475635 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:38.483716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-42b756fd-7461-42e2-8bbf-485b70da2e67 admin admin] The token cache is being invalidate because project fd2feaa2204441cda3b435507ca4865e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:57:38.484015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-42b756fd-7461-42e2-8bbf-485b70da2e67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:38.484833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-42b756fd-7461-42e2-8bbf-485b70da2e67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:38.486821 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1876/3759] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:57:38 2022] DELETE /identity/v3/projects/fd2feaa2204441cda3b435507ca4865e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:57:38.495655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bc99d-f4f3-4b77-9885-520bc8c6bb06 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:38.495952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bc99d-f4f3-4b77-9885-520bc8c6bb06 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:38.496229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bc99d-f4f3-4b77-9885-520bc8c6bb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:38.517139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3f5bc99d-f4f3-4b77-9885-520bc8c6bb06 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:38.518344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3f5bc99d-f4f3-4b77-9885-520bc8c6bb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:38.528823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4ac79-50ae-453f-aa41-7f86d69f4cba admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:38.591612 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1877/3760] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:57:38.592747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9330da-c9ff-45ff-b923-6231e5858763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:38.593337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9330da-c9ff-45ff-b923-6231e5858763 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:38.594115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9330da-c9ff-45ff-b923-6231e5858763 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:38.594453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9330da-c9ff-45ff-b923-6231e5858763 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:38.595042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9330da-c9ff-45ff-b923-6231e5858763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:38.596992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9330da-c9ff-45ff-b923-6231e5858763 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:38.600530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207357d4-b162-41f9-9563-7ae4196f66a0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:38.601091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207357d4-b162-41f9-9563-7ae4196f66a0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:38.601368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207357d4-b162-41f9-9563-7ae4196f66a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:38.622349 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1884/3761] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:57:38 2022] POST /identity/v3/users => generated 308 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:57:38.626037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9330da-c9ff-45ff-b923-6231e5858763 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:38.627236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-207357d4-b162-41f9-9563-7ae4196f66a0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:38.627760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5c9330da-c9ff-45ff-b923-6231e5858763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:38.628543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-207357d4-b162-41f9-9563-7ae4196f66a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:38.636839 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1878/3762] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:57:38.640951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207357d4-b162-41f9-9563-7ae4196f66a0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:38.642371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9330da-c9ff-45ff-b923-6231e5858763 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:38.647988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49604916-fb27-4439-baa2-d5f305f50bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:38.648844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49604916-fb27-4439-baa2-d5f305f50bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:38.651116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207357d4-b162-41f9-9563-7ae4196f66a0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:38.652743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49604916-fb27-4439-baa2-d5f305f50bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:38.653134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49604916-fb27-4439-baa2-d5f305f50bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:38.653895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49604916-fb27-4439-baa2-d5f305f50bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:38.655583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49604916-fb27-4439-baa2-d5f305f50bf0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:38.656309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f290e-2822-4eb5-98c8-5c4c864dfadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:38.657016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f290e-2822-4eb5-98c8-5c4c864dfadf admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:38.657361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f290e-2822-4eb5-98c8-5c4c864dfadf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:38.657696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f290e-2822-4eb5-98c8-5c4c864dfadf admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:38.658415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f290e-2822-4eb5-98c8-5c4c864dfadf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:57:38.658783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f290e-2822-4eb5-98c8-5c4c864dfadf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:38.660420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f290e-2822-4eb5-98c8-5c4c864dfadf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:38.670801 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1885/3763] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:57:38.671852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49604916-fb27-4439-baa2-d5f305f50bf0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:38.677060 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1879/3764] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:57:38.678013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f290e-2822-4eb5-98c8-5c4c864dfadf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:38.683562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49604916-fb27-4439-baa2-d5f305f50bf0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:38.688461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1beda-8a90-4a6c-b121-85195a9ea880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:38.689000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f290e-2822-4eb5-98c8-5c4c864dfadf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:38.689440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1beda-8a90-4a6c-b121-85195a9ea880 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:38.689721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1beda-8a90-4a6c-b121-85195a9ea880 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:38.690067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1beda-8a90-4a6c-b121-85195a9ea880 admin admin] PATH_INFO: `/v3/projects/ae0052e3a1eb4303aef0806d5b47806f/users/bdabb3240f81498ea2a1393c36b5111d/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:38.694396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae37303-7781-4afb-9fa1-e430bf1cc4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:38.694963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae37303-7781-4afb-9fa1-e430bf1cc4a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:38.695239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae37303-7781-4afb-9fa1-e430bf1cc4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:38.695508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae37303-7781-4afb-9fa1-e430bf1cc4a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:38.696146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae37303-7781-4afb-9fa1-e430bf1cc4a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:38.698099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae37303-7781-4afb-9fa1-e430bf1cc4a3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:38.707285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1beda-8a90-4a6c-b121-85195a9ea880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae0052e3a1eb4303aef0806d5b47806f, user_id=bdabb3240f81498ea2a1393c36b5111d, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:38.709958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1beda-8a90-4a6c-b121-85195a9ea880 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:38.725514 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1886/3765] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:57:38 2022] PUT /identity/v3/projects/ae0052e3a1eb4303aef0806d5b47806f/users/bdabb3240f81498ea2a1393c36b5111d/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:57:38.730072 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1880/3766] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:57:38 2022] POST /identity/v3/projects => generated 359 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:57:38.730438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1beda-8a90-4a6c-b121-85195a9ea880 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:38.733899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae37303-7781-4afb-9fa1-e430bf1cc4a3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:38.739891 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:38.801597 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1beda-8a90-4a6c-b121-85195a9ea880 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:38.803332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae37303-7781-4afb-9fa1-e430bf1cc4a3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:38.806961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafbcc9-d63b-4532-9df4-c39365ebc389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:38.807658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafbcc9-d63b-4532-9df4-c39365ebc389 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:38.807958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafbcc9-d63b-4532-9df4-c39365ebc389 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:38.808229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafbcc9-d63b-4532-9df4-c39365ebc389 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:38.808828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cec79-ac58-4075-935b-1f717247ae3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:38.808970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafbcc9-d63b-4532-9df4-c39365ebc389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:38.809429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cec79-ac58-4075-935b-1f717247ae3e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:38.809706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cec79-ac58-4075-935b-1f717247ae3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:38.809981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cec79-ac58-4075-935b-1f717247ae3e admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:38.810522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafbcc9-d63b-4532-9df4-c39365ebc389 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:38.810680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8cec79-ac58-4075-935b-1f717247ae3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:38.812448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8cec79-ac58-4075-935b-1f717247ae3e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:38.820692 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1887/3767] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:57:38.826145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafbcc9-d63b-4532-9df4-c39365ebc389 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:38.839420 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1881/3768] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:57:38 2022] POST /identity/v3/users => generated 280 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:57:38.839625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafbcc9-d63b-4532-9df4-c39365ebc389 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:38.840436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cec79-ac58-4075-935b-1f717247ae3e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:38.842134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055fbac-c293-4b8c-af82-b1d79f245e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:38.842774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055fbac-c293-4b8c-af82-b1d79f245e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:38.843049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055fbac-c293-4b8c-af82-b1d79f245e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:38.843353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055fbac-c293-4b8c-af82-b1d79f245e3f admin admin] PATH_INFO: `/v3/projects/ae0052e3a1eb4303aef0806d5b47806f/users/bdabb3240f81498ea2a1393c36b5111d/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:38.845634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055fbac-c293-4b8c-af82-b1d79f245e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae0052e3a1eb4303aef0806d5b47806f, user_id=bdabb3240f81498ea2a1393c36b5111d, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:38.848815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055fbac-c293-4b8c-af82-b1d79f245e3f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:38.849787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cec79-ac58-4075-935b-1f717247ae3e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:38.854695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1e484-40c1-49c2-8de9-96d9c858d5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:38.855281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1e484-40c1-49c2-8de9-96d9c858d5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:38.855532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1e484-40c1-49c2-8de9-96d9c858d5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:38.855799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1e484-40c1-49c2-8de9-96d9c858d5d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:38.856420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1e484-40c1-49c2-8de9-96d9c858d5d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:38.857995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1e484-40c1-49c2-8de9-96d9c858d5d4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:38.859478 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1888/3769] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:57:38 2022] PUT /identity/v3/projects/ae0052e3a1eb4303aef0806d5b47806f/users/bdabb3240f81498ea2a1393c36b5111d/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:57:38.868776 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1882/3770] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:57:38.871387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0adda0-4a6c-4bbe-aef5-cc2dad3a33f5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:38.871846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0adda0-4a6c-4bbe-aef5-cc2dad3a33f5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:38.872308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0adda0-4a6c-4bbe-aef5-cc2dad3a33f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:38.872457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1e484-40c1-49c2-8de9-96d9c858d5d4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:38.880941 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:38.882393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1e484-40c1-49c2-8de9-96d9c858d5d4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:38.905579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bb0adda0-4a6c-4bbe-aef5-cc2dad3a33f5 None None] MFA Rules not processed for user `bdabb3240f81498ea2a1393c36b5111d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:38.906933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bb0adda0-4a6c-4bbe-aef5-cc2dad3a33f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:38.967280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40234ee-d1a4-4685-9130-21f93ff85106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:38.967895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40234ee-d1a4-4685-9130-21f93ff85106 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:38.968169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40234ee-d1a4-4685-9130-21f93ff85106 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:38.968438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40234ee-d1a4-4685-9130-21f93ff85106 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:38.969135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40234ee-d1a4-4685-9130-21f93ff85106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:38.970697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40234ee-d1a4-4685-9130-21f93ff85106 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:38.981225 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1883/3771] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:57:38.985054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40234ee-d1a4-4685-9130-21f93ff85106 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:38.992665 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1889/3772] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:38 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:57:38.999263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40234ee-d1a4-4685-9130-21f93ff85106 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:39.004626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6154fbf-5e90-4d6e-aa1a-b739e81ce885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:39.005343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6154fbf-5e90-4d6e-aa1a-b739e81ce885 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:39.005722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6154fbf-5e90-4d6e-aa1a-b739e81ce885 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:39.005838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0adda0-4a6c-4bbe-aef5-cc2dad3a33f5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:39.006191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6154fbf-5e90-4d6e-aa1a-b739e81ce885 admin admin] PATH_INFO: `/v3/projects/0bc64c49f7c14bc2ab900351ca5bb445/users/395bda08964d49579b39e16a6dae2927/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:39.007283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bb0adda0-4a6c-4bbe-aef5-cc2dad3a33f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:39.028197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6154fbf-5e90-4d6e-aa1a-b739e81ce885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc64c49f7c14bc2ab900351ca5bb445, user_id=395bda08964d49579b39e16a6dae2927, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:39.031861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6154fbf-5e90-4d6e-aa1a-b739e81ce885 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:39.049441 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1884/3773] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:57:38 2022] PUT /identity/v3/projects/0bc64c49f7c14bc2ab900351ca5bb445/users/395bda08964d49579b39e16a6dae2927/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:57:39.061145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf18c4-a094-4dbb-9867-7f6c64d3ca53 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:39.061793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf18c4-a094-4dbb-9867-7f6c64d3ca53 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:39.061793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf18c4-a094-4dbb-9867-7f6c64d3ca53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:39.094706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0adda0-4a6c-4bbe-aef5-cc2dad3a33f5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:39.099633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c2cf18c4-a094-4dbb-9867-7f6c64d3ca53 None None] MFA Rules not processed for user `395bda08964d49579b39e16a6dae2927`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:39.100851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c2cf18c4-a094-4dbb-9867-7f6c64d3ca53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:39.158263 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:39.180391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806909a1-ecf9-4cd9-ab51-06cde3855782 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:39.182107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806909a1-ecf9-4cd9-ab51-06cde3855782 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:39.182468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806909a1-ecf9-4cd9-ab51-06cde3855782 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:39.182801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806909a1-ecf9-4cd9-ab51-06cde3855782 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:39.190982 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1885/3774] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:57:39.222770 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:39.262502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806909a1-ecf9-4cd9-ab51-06cde3855782 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:39.265374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806909a1-ecf9-4cd9-ab51-06cde3855782 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:39.275343 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1890/3775] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:57:39 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:57:39.380394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf18c4-a094-4dbb-9867-7f6c64d3ca53 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:39.459768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf18c4-a094-4dbb-9867-7f6c64d3ca53 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:39.472323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3f7ce-6380-450b-9ec1-9989b34cbf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:39.472880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3f7ce-6380-450b-9ec1-9989b34cbf6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:39.473194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3f7ce-6380-450b-9ec1-9989b34cbf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:39.473478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3f7ce-6380-450b-9ec1-9989b34cbf6a admin admin] PATH_INFO: `/v3/users/395bda08964d49579b39e16a6dae2927` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:39.474665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3f7ce-6380-450b-9ec1-9989b34cbf6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=395bda08964d49579b39e16a6dae2927)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:39.484222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3f7ce-6380-450b-9ec1-9989b34cbf6a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:39.551001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-01e3f7ce-6380-450b-9ec1-9989b34cbf6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '395bda08964d49579b39e16a6dae2927'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:39.561069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-01e3f7ce-6380-450b-9ec1-9989b34cbf6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '395bda08964d49579b39e16a6dae2927'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:39.561903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-01e3f7ce-6380-450b-9ec1-9989b34cbf6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '395bda08964d49579b39e16a6dae2927'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:39.582269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-01e3f7ce-6380-450b-9ec1-9989b34cbf6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '395bda08964d49579b39e16a6dae2927'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:39.592752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-01e3f7ce-6380-450b-9ec1-9989b34cbf6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '395bda08964d49579b39e16a6dae2927'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:39.603051 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1886/3776] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:57:39 2022] DELETE /identity/v3/users/395bda08964d49579b39e16a6dae2927 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:57:39.607396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfad015-c1a7-43f5-b2cc-78ac344b1b21 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:39.607683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfad015-c1a7-43f5-b2cc-78ac344b1b21 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:39.607957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfad015-c1a7-43f5-b2cc-78ac344b1b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:39.636366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5cfad015-c1a7-43f5-b2cc-78ac344b1b21 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:39.636366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5cfad015-c1a7-43f5-b2cc-78ac344b1b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:39.701403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3f7ce-6380-450b-9ec1-9989b34cbf6a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:39.703194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-01e3f7ce-6380-450b-9ec1-9989b34cbf6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:39.719940 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1891/3777] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:57:39.737791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfad015-c1a7-43f5-b2cc-78ac344b1b21 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:39.739911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5cfad015-c1a7-43f5-b2cc-78ac344b1b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:39.812051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfad015-c1a7-43f5-b2cc-78ac344b1b21 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:39.816989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3827c-4d4d-43b7-a74b-55e4c419d9a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:39.817301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3827c-4d4d-43b7-a74b-55e4c419d9a9 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:39.817784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3827c-4d4d-43b7-a74b-55e4c419d9a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:39.818163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3827c-4d4d-43b7-a74b-55e4c419d9a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:39.828701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3827c-4d4d-43b7-a74b-55e4c419d9a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:39.829376 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:39.830297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3827c-4d4d-43b7-a74b-55e4c419d9a9 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:39.838036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3f7ce-6380-450b-9ec1-9989b34cbf6a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:39.841469 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1892/3778] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:57:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:57:39.849484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2caff-f524-4ca5-ae90-a122543e75f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:39.850316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2caff-f524-4ca5-ae90-a122543e75f2 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:39.850667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2caff-f524-4ca5-ae90-a122543e75f2 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:39.851019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2caff-f524-4ca5-ae90-a122543e75f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:39.852984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-baf2caff-f524-4ca5-ae90-a122543e75f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:39.941838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2caff-f524-4ca5-ae90-a122543e75f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:39.943585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2caff-f524-4ca5-ae90-a122543e75f2 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:39.955332 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1887/3779] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:57:39 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:57:39.975774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3827c-4d4d-43b7-a74b-55e4c419d9a9 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:39.978497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-30d3827c-4d4d-43b7-a74b-55e4c419d9a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:39.997418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3827c-4d4d-43b7-a74b-55e4c419d9a9 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:40.003194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2030197-4860-453c-9a89-54af329578ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:40.003838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2030197-4860-453c-9a89-54af329578ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:40.004488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2030197-4860-453c-9a89-54af329578ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:40.004776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2030197-4860-453c-9a89-54af329578ec admin admin] PATH_INFO: `/v3/users/90b9902b5edc4107bde6f852a5fc4c6d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:40.006195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2030197-4860-453c-9a89-54af329578ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=90b9902b5edc4107bde6f852a5fc4c6d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:40.008150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2030197-4860-453c-9a89-54af329578ec admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:40.067205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2030197-4860-453c-9a89-54af329578ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90b9902b5edc4107bde6f852a5fc4c6d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:40.068202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2030197-4860-453c-9a89-54af329578ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90b9902b5edc4107bde6f852a5fc4c6d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:40.078276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2030197-4860-453c-9a89-54af329578ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90b9902b5edc4107bde6f852a5fc4c6d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:40.083844 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:40.096919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2030197-4860-453c-9a89-54af329578ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90b9902b5edc4107bde6f852a5fc4c6d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:40.105667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2030197-4860-453c-9a89-54af329578ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90b9902b5edc4107bde6f852a5fc4c6d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:40.112543 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1893/3780] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:57:39 2022] DELETE /identity/v3/users/90b9902b5edc4107bde6f852a5fc4c6d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:57:40.119503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ef882-bcc2-4b2a-ba1c-e5daf616aa17 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:40.119999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ef882-bcc2-4b2a-ba1c-e5daf616aa17 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:40.120308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ef882-bcc2-4b2a-ba1c-e5daf616aa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:40.147791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-806ef882-bcc2-4b2a-ba1c-e5daf616aa17 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:40.149766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-806ef882-bcc2-4b2a-ba1c-e5daf616aa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:40.174200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2030197-4860-453c-9a89-54af329578ec admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:40.175763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d2030197-4860-453c-9a89-54af329578ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:40.266441 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1888/3781] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:57:40.278987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ef882-bcc2-4b2a-ba1c-e5daf616aa17 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:40.281043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-806ef882-bcc2-4b2a-ba1c-e5daf616aa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:40.291750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2030197-4860-453c-9a89-54af329578ec admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:40.297923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15673d8-8833-4bac-9f11-06e65d844d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:40.299537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15673d8-8833-4bac-9f11-06e65d844d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:40.299537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15673d8-8833-4bac-9f11-06e65d844d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:40.299537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15673d8-8833-4bac-9f11-06e65d844d4a admin admin] PATH_INFO: `/v3/projects/0bc64c49f7c14bc2ab900351ca5bb445` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:40.300538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15673d8-8833-4bac-9f11-06e65d844d4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bc64c49f7c14bc2ab900351ca5bb445)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:40.303020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15673d8-8833-4bac-9f11-06e65d844d4a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:40.373607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d15673d8-8833-4bac-9f11-06e65d844d4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bc64c49f7c14bc2ab900351ca5bb445', 'request_id': 'req-d15673d8-8833-4bac-9f11-06e65d844d4a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:40.378395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ef882-bcc2-4b2a-ba1c-e5daf616aa17 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:40.394469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d15673d8-8833-4bac-9f11-06e65d844d4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bc64c49f7c14bc2ab900351ca5bb445', 'request_id': 'req-d15673d8-8833-4bac-9f11-06e65d844d4a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:40.411260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d15673d8-8833-4bac-9f11-06e65d844d4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bc64c49f7c14bc2ab900351ca5bb445', 'request_id': 'req-d15673d8-8833-4bac-9f11-06e65d844d4a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:40.429319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d15673d8-8833-4bac-9f11-06e65d844d4a admin admin] The token cache is being invalidate because project 0bc64c49f7c14bc2ab900351ca5bb445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:57:40.429597 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d15673d8-8833-4bac-9f11-06e65d844d4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:40.430284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d15673d8-8833-4bac-9f11-06e65d844d4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:40.431964 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1894/3782] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:57:40 2022] DELETE /identity/v3/projects/0bc64c49f7c14bc2ab900351ca5bb445 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:57:40.438104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b1862-fa99-44ba-9eac-2d8fa0e48d68 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:40.438612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b1862-fa99-44ba-9eac-2d8fa0e48d68 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:40.439158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b1862-fa99-44ba-9eac-2d8fa0e48d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:40.464943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-734b1862-fa99-44ba-9eac-2d8fa0e48d68 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:40.468431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-734b1862-fa99-44ba-9eac-2d8fa0e48d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:40.515536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b844cfd-7157-4451-8b69-55d1d0ca8018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:40.517139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b844cfd-7157-4451-8b69-55d1d0ca8018 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:40.517711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b844cfd-7157-4451-8b69-55d1d0ca8018 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:40.518193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b844cfd-7157-4451-8b69-55d1d0ca8018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:40.521793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2b844cfd-7157-4451-8b69-55d1d0ca8018 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:40.539074 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:40.603817 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1895/3783] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:57:40.617116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417e773-20b0-4296-8b78-f2eae4484b13 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:40.617472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417e773-20b0-4296-8b78-f2eae4484b13 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:40.617863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417e773-20b0-4296-8b78-f2eae4484b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:40.632005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b844cfd-7157-4451-8b69-55d1d0ca8018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:40.634317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b844cfd-7157-4451-8b69-55d1d0ca8018 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:40.645349 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1889/3784] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:57:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:57:40.645566 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:40.654873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9417e773-20b0-4296-8b78-f2eae4484b13 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:40.656483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9417e773-20b0-4296-8b78-f2eae4484b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:40.667218 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1896/3785] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:57:40.672230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b844cfd-7157-4451-8b69-55d1d0ca8018 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:40.687728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b844cfd-7157-4451-8b69-55d1d0ca8018 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:40.692887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c42a9-52b2-4d17-a15a-ca4956293915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:40.693529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c42a9-52b2-4d17-a15a-ca4956293915 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:40.694101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c42a9-52b2-4d17-a15a-ca4956293915 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:40.694101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c42a9-52b2-4d17-a15a-ca4956293915 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:40.694690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c42a9-52b2-4d17-a15a-ca4956293915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:57:40.694989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c42a9-52b2-4d17-a15a-ca4956293915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:40.697258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c42a9-52b2-4d17-a15a-ca4956293915 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:40.724521 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1890/3786] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:57:40.729192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417e773-20b0-4296-8b78-f2eae4484b13 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:40.739675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417e773-20b0-4296-8b78-f2eae4484b13 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:40.747070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c9305-1d51-4d82-8dab-46ab0ca77d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:40.747756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c9305-1d51-4d82-8dab-46ab0ca77d00 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:40.748328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c9305-1d51-4d82-8dab-46ab0ca77d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:40.748720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c9305-1d51-4d82-8dab-46ab0ca77d00 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:40.749489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c9305-1d51-4d82-8dab-46ab0ca77d00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:40.752838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c9305-1d51-4d82-8dab-46ab0ca77d00 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:40.826195 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1897/3787] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:57:40 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:57:40.830971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c42a9-52b2-4d17-a15a-ca4956293915 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:40.845370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c42a9-52b2-4d17-a15a-ca4956293915 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:40.956545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac026604-3c6e-4f9d-81e9-113f393d2137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:40.957415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac026604-3c6e-4f9d-81e9-113f393d2137 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:40.957768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac026604-3c6e-4f9d-81e9-113f393d2137 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:40.958122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac026604-3c6e-4f9d-81e9-113f393d2137 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:40.959851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac026604-3c6e-4f9d-81e9-113f393d2137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:40.962835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac026604-3c6e-4f9d-81e9-113f393d2137 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:40.996745 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1891/3788] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:57:40 2022] POST /identity/v3/users => generated 284 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:57:41.002273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c9305-1d51-4d82-8dab-46ab0ca77d00 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:41.017572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c9305-1d51-4d82-8dab-46ab0ca77d00 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:41.024170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d77762-8d36-4702-8619-b79b1cb0da55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:41.025523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d77762-8d36-4702-8619-b79b1cb0da55 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:41.025902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d77762-8d36-4702-8619-b79b1cb0da55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:41.026144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d77762-8d36-4702-8619-b79b1cb0da55 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:41.026802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d77762-8d36-4702-8619-b79b1cb0da55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:41.028565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d77762-8d36-4702-8619-b79b1cb0da55 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:41.045233 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1898/3789] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:57:41.046087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac026604-3c6e-4f9d-81e9-113f393d2137 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:41.060563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac026604-3c6e-4f9d-81e9-113f393d2137 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:41.066316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626b091-4d69-4656-951f-d865de18c9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:41.067317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626b091-4d69-4656-951f-d865de18c9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:41.067701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626b091-4d69-4656-951f-d865de18c9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:41.068066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626b091-4d69-4656-951f-d865de18c9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:41.069813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626b091-4d69-4656-951f-d865de18c9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:41.073054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626b091-4d69-4656-951f-d865de18c9f7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:41.090480 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1892/3790] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:57:41.092189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d77762-8d36-4702-8619-b79b1cb0da55 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:41.110908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d77762-8d36-4702-8619-b79b1cb0da55 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:41.119020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5d982-d0b9-4319-9d84-fbd08f52b66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:41.120407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5d982-d0b9-4319-9d84-fbd08f52b66d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:41.120973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5d982-d0b9-4319-9d84-fbd08f52b66d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:41.121487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5d982-d0b9-4319-9d84-fbd08f52b66d admin admin] PATH_INFO: `/v3/projects/ea7cba26600d4af5bce9086c597f89b9/users/18fa2091f09c4ca89f6b143973fe443d/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:41.142388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5d982-d0b9-4319-9d84-fbd08f52b66d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea7cba26600d4af5bce9086c597f89b9, user_id=18fa2091f09c4ca89f6b143973fe443d, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:41.146006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5d982-d0b9-4319-9d84-fbd08f52b66d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:41.178485 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1899/3791] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:57:41 2022] PUT /identity/v3/projects/ea7cba26600d4af5bce9086c597f89b9/users/18fa2091f09c4ca89f6b143973fe443d/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:57:41.182874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf0835-f6f6-44f2-a244-47d327fad7f0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:41.183510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf0835-f6f6-44f2-a244-47d327fad7f0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:41.183510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf0835-f6f6-44f2-a244-47d327fad7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:41.220945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5d982-d0b9-4319-9d84-fbd08f52b66d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:41.223174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-05a5d982-d0b9-4319-9d84-fbd08f52b66d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:41.282489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fddf0835-f6f6-44f2-a244-47d327fad7f0 None None] MFA Rules not processed for user `18fa2091f09c4ca89f6b143973fe443d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:41.284052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fddf0835-f6f6-44f2-a244-47d327fad7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:41.355005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5d982-d0b9-4319-9d84-fbd08f52b66d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:41.360981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d2fbc-5876-4715-af29-74368feff9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:41.361608 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d2fbc-5876-4715-af29-74368feff9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:41.361886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d2fbc-5876-4715-af29-74368feff9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:41.362156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d2fbc-5876-4715-af29-74368feff9f8 admin admin] PATH_INFO: `/v3/projects/352f8f767e1e42adbbc7ce17dde55a86` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:41.363401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d2fbc-5876-4715-af29-74368feff9f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=352f8f767e1e42adbbc7ce17dde55a86)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:41.365436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d2fbc-5876-4715-af29-74368feff9f8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:41.393146 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1893/3792] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:57:41.403003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf0835-f6f6-44f2-a244-47d327fad7f0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:41.404785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fddf0835-f6f6-44f2-a244-47d327fad7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:41.410279 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:41.439229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec5d2fbc-5876-4715-af29-74368feff9f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '352f8f767e1e42adbbc7ce17dde55a86', 'request_id': 'req-ec5d2fbc-5876-4715-af29-74368feff9f8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:41.451349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec5d2fbc-5876-4715-af29-74368feff9f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '352f8f767e1e42adbbc7ce17dde55a86', 'request_id': 'req-ec5d2fbc-5876-4715-af29-74368feff9f8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:41.458947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec5d2fbc-5876-4715-af29-74368feff9f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '352f8f767e1e42adbbc7ce17dde55a86', 'request_id': 'req-ec5d2fbc-5876-4715-af29-74368feff9f8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:41.477489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec5d2fbc-5876-4715-af29-74368feff9f8 admin admin] The token cache is being invalidate because project 352f8f767e1e42adbbc7ce17dde55a86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:57:41.478483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec5d2fbc-5876-4715-af29-74368feff9f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:41.479427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec5d2fbc-5876-4715-af29-74368feff9f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:41.482263 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1900/3793] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:57:41 2022] DELETE /identity/v3/projects/352f8f767e1e42adbbc7ce17dde55a86 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:57:41.486307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d2fbc-5876-4715-af29-74368feff9f8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:41.488974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ec5d2fbc-5876-4715-af29-74368feff9f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:41.517178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf0835-f6f6-44f2-a244-47d327fad7f0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:41.545950 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:41.615628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf47a9-c942-43d7-84d2-24ba60e50e9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:41.615986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d2fbc-5876-4715-af29-74368feff9f8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:41.619148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf47a9-c942-43d7-84d2-24ba60e50e9b service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:41.619584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf47a9-c942-43d7-84d2-24ba60e50e9b service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:41.620036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf47a9-c942-43d7-84d2-24ba60e50e9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:41.624784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1edf47a9-c942-43d7-84d2-24ba60e50e9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:41.627719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b86756-1347-41ca-86c5-3f6540ba0c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:41.631992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b86756-1347-41ca-86c5-3f6540ba0c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:41.632578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b86756-1347-41ca-86c5-3f6540ba0c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:41.633302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b86756-1347-41ca-86c5-3f6540ba0c89 admin admin] PATH_INFO: `/v3/users/bdabb3240f81498ea2a1393c36b5111d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:41.636550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b86756-1347-41ca-86c5-3f6540ba0c89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdabb3240f81498ea2a1393c36b5111d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:41.639556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b86756-1347-41ca-86c5-3f6540ba0c89 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:41.728880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf47a9-c942-43d7-84d2-24ba60e50e9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:41.735252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf47a9-c942-43d7-84d2-24ba60e50e9b service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:41.752337 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1894/3794] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:57:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:57:41.754970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-91b86756-1347-41ca-86c5-3f6540ba0c89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdabb3240f81498ea2a1393c36b5111d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:41.755845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-91b86756-1347-41ca-86c5-3f6540ba0c89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdabb3240f81498ea2a1393c36b5111d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:41.770408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-91b86756-1347-41ca-86c5-3f6540ba0c89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdabb3240f81498ea2a1393c36b5111d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:41.794322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-91b86756-1347-41ca-86c5-3f6540ba0c89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdabb3240f81498ea2a1393c36b5111d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:41.804355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-91b86756-1347-41ca-86c5-3f6540ba0c89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdabb3240f81498ea2a1393c36b5111d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:41.819447 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1901/3795] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:57:41 2022] DELETE /identity/v3/users/bdabb3240f81498ea2a1393c36b5111d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:57:42.665364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf47a9-c942-43d7-84d2-24ba60e50e9b service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:42.698463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf47a9-c942-43d7-84d2-24ba60e50e9b service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:42.761714 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:42.780833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06d4fa-5211-4b6a-8904-5825c990fcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:42.781939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06d4fa-5211-4b6a-8904-5825c990fcd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:42.782170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06d4fa-5211-4b6a-8904-5825c990fcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:42.782504 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06d4fa-5211-4b6a-8904-5825c990fcd3 admin admin] PATH_INFO: `/v3/projects/ae0052e3a1eb4303aef0806d5b47806f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:42.784907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06d4fa-5211-4b6a-8904-5825c990fcd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae0052e3a1eb4303aef0806d5b47806f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:42.787202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06d4fa-5211-4b6a-8904-5825c990fcd3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:42.871808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9d06d4fa-5211-4b6a-8904-5825c990fcd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae0052e3a1eb4303aef0806d5b47806f', 'request_id': 'req-9d06d4fa-5211-4b6a-8904-5825c990fcd3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:42.884894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9d06d4fa-5211-4b6a-8904-5825c990fcd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae0052e3a1eb4303aef0806d5b47806f', 'request_id': 'req-9d06d4fa-5211-4b6a-8904-5825c990fcd3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:42.898901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9d06d4fa-5211-4b6a-8904-5825c990fcd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae0052e3a1eb4303aef0806d5b47806f', 'request_id': 'req-9d06d4fa-5211-4b6a-8904-5825c990fcd3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:42.917328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9d06d4fa-5211-4b6a-8904-5825c990fcd3 admin admin] The token cache is being invalidate because project ae0052e3a1eb4303aef0806d5b47806f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:57:42.917828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9d06d4fa-5211-4b6a-8904-5825c990fcd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:42.918711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9d06d4fa-5211-4b6a-8904-5825c990fcd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:42.921126 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1895/3796] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:57:42 2022] DELETE /identity/v3/projects/ae0052e3a1eb4303aef0806d5b47806f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:57:42.926197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a59c59-ba19-458a-9dba-21ec4f8d0dbc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:42.929163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a59c59-ba19-458a-9dba-21ec4f8d0dbc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:42.929645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a59c59-ba19-458a-9dba-21ec4f8d0dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:42.964645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d8a59c59-ba19-458a-9dba-21ec4f8d0dbc None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:42.965693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d8a59c59-ba19-458a-9dba-21ec4f8d0dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:43.061331 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1902/3797] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:57:43.069371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454a174-b673-4459-b526-52eff430cb76 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:43.070926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454a174-b673-4459-b526-52eff430cb76 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:43.071245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454a174-b673-4459-b526-52eff430cb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:43.105005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2454a174-b673-4459-b526-52eff430cb76 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:43.108710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2454a174-b673-4459-b526-52eff430cb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:43.126872 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1896/3798] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:57:43.127068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a59c59-ba19-458a-9dba-21ec4f8d0dbc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:43.143343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a59c59-ba19-458a-9dba-21ec4f8d0dbc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:43.148734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f17c07-eb3a-4b06-8c2f-07f14fa43dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:43.150259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f17c07-eb3a-4b06-8c2f-07f14fa43dfc admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:43.150801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f17c07-eb3a-4b06-8c2f-07f14fa43dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:43.151407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f17c07-eb3a-4b06-8c2f-07f14fa43dfc admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:43.152530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f17c07-eb3a-4b06-8c2f-07f14fa43dfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:57:43.153030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f17c07-eb3a-4b06-8c2f-07f14fa43dfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:43.154907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f17c07-eb3a-4b06-8c2f-07f14fa43dfc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:43.172639 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1903/3799] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:57:43.176663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454a174-b673-4459-b526-52eff430cb76 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:43.197824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454a174-b673-4459-b526-52eff430cb76 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:43.208965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96358c-7a6d-48e0-a80f-dcdde8b71add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:43.209771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96358c-7a6d-48e0-a80f-dcdde8b71add admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:43.210046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96358c-7a6d-48e0-a80f-dcdde8b71add admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:43.210310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96358c-7a6d-48e0-a80f-dcdde8b71add admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:43.211216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96358c-7a6d-48e0-a80f-dcdde8b71add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:43.214684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96358c-7a6d-48e0-a80f-dcdde8b71add admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:43.280644 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1897/3800] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:57:43 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:57:43.282378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f17c07-eb3a-4b06-8c2f-07f14fa43dfc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:43.303084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f17c07-eb3a-4b06-8c2f-07f14fa43dfc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:43.377143 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:43.401044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98494239-b005-45e9-a3ba-d2685c16f425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:43.401814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98494239-b005-45e9-a3ba-d2685c16f425 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:43.402135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98494239-b005-45e9-a3ba-d2685c16f425 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:43.402535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98494239-b005-45e9-a3ba-d2685c16f425 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:43.403236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98494239-b005-45e9-a3ba-d2685c16f425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:43.405296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98494239-b005-45e9-a3ba-d2685c16f425 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:43.430338 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1904/3801] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:57:43 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:57:43.434452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96358c-7a6d-48e0-a80f-dcdde8b71add admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:43.445420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96358c-7a6d-48e0-a80f-dcdde8b71add admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:43.450982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d933d-3c12-4120-937d-abf20049265a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:43.451723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d933d-3c12-4120-937d-abf20049265a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:43.452068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d933d-3c12-4120-937d-abf20049265a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:43.452401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d933d-3c12-4120-937d-abf20049265a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:43.453089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d933d-3c12-4120-937d-abf20049265a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:43.454713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d933d-3c12-4120-937d-abf20049265a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:43.467803 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1898/3802] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:57:43.471604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98494239-b005-45e9-a3ba-d2685c16f425 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:43.483236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98494239-b005-45e9-a3ba-d2685c16f425 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:43.488655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6498d8b-cb8f-497e-9eda-dd12d4de767b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:43.489279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6498d8b-cb8f-497e-9eda-dd12d4de767b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:43.489731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6498d8b-cb8f-497e-9eda-dd12d4de767b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:43.490004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6498d8b-cb8f-497e-9eda-dd12d4de767b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:43.490651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6498d8b-cb8f-497e-9eda-dd12d4de767b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:43.492290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6498d8b-cb8f-497e-9eda-dd12d4de767b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:43.505017 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1905/3803] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:57:43.509513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d933d-3c12-4120-937d-abf20049265a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:43.520697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d933d-3c12-4120-937d-abf20049265a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:43.526519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84ba2a-c80d-4834-9071-89ce84b6b6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:43.527308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84ba2a-c80d-4834-9071-89ce84b6b6f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:43.527617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84ba2a-c80d-4834-9071-89ce84b6b6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:43.527953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84ba2a-c80d-4834-9071-89ce84b6b6f1 admin admin] PATH_INFO: `/v3/projects/eb539a23b2f44844aa6c131816f1a1d8/users/19dfdd10f1fc4f8882ccab3d85607ded/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:43.548330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84ba2a-c80d-4834-9071-89ce84b6b6f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb539a23b2f44844aa6c131816f1a1d8, user_id=19dfdd10f1fc4f8882ccab3d85607ded, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:43.551316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84ba2a-c80d-4834-9071-89ce84b6b6f1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:43.566531 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1899/3804] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:57:43 2022] PUT /identity/v3/projects/eb539a23b2f44844aa6c131816f1a1d8/users/19dfdd10f1fc4f8882ccab3d85607ded/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:57:43.572104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303182f-6946-41e8-9b89-eba7c7c06b4d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:43.572486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303182f-6946-41e8-9b89-eba7c7c06b4d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:43.572898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303182f-6946-41e8-9b89-eba7c7c06b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:43.594750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0303182f-6946-41e8-9b89-eba7c7c06b4d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:43.596108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0303182f-6946-41e8-9b89-eba7c7c06b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:43.670381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84ba2a-c80d-4834-9071-89ce84b6b6f1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:43.673246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6a84ba2a-c80d-4834-9071-89ce84b6b6f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:43.679428 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1906/3805] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:57:43.686238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303182f-6946-41e8-9b89-eba7c7c06b4d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:43.687775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0303182f-6946-41e8-9b89-eba7c7c06b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:43.712426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84ba2a-c80d-4834-9071-89ce84b6b6f1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:43.718920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f614872-0a54-424e-9f21-cf34c6ed3d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:43.719652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f614872-0a54-424e-9f21-cf34c6ed3d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:43.719979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f614872-0a54-424e-9f21-cf34c6ed3d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:43.720322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f614872-0a54-424e-9f21-cf34c6ed3d14 admin admin] PATH_INFO: `/v3/users/b6bb092e5df84a378019856b329ef7bb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:43.721651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f614872-0a54-424e-9f21-cf34c6ed3d14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6bb092e5df84a378019856b329ef7bb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:43.724262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f614872-0a54-424e-9f21-cf34c6ed3d14 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:43.792146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303182f-6946-41e8-9b89-eba7c7c06b4d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:43.800223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ed421-1498-4a58-875f-5c2c9bc9d772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:43.801560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ed421-1498-4a58-875f-5c2c9bc9d772 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:43.802060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ed421-1498-4a58-875f-5c2c9bc9d772 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:43.802599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ed421-1498-4a58-875f-5c2c9bc9d772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:43.816773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ed421-1498-4a58-875f-5c2c9bc9d772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:43.817382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2f614872-0a54-424e-9f21-cf34c6ed3d14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6bb092e5df84a378019856b329ef7bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:43.818376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ed421-1498-4a58-875f-5c2c9bc9d772 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:43.828975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2f614872-0a54-424e-9f21-cf34c6ed3d14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6bb092e5df84a378019856b329ef7bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:43.829835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2f614872-0a54-424e-9f21-cf34c6ed3d14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6bb092e5df84a378019856b329ef7bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:43.834551 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1907/3806] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:57:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:57:43.850049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2f614872-0a54-424e-9f21-cf34c6ed3d14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6bb092e5df84a378019856b329ef7bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:43.855396 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=79,keystone:DELETE=17,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:43.861407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2f614872-0a54-424e-9f21-cf34c6ed3d14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6bb092e5df84a378019856b329ef7bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:43.871233 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1900/3807] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:57:43 2022] DELETE /identity/v3/users/b6bb092e5df84a378019856b329ef7bb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:57:44.564718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ed421-1498-4a58-875f-5c2c9bc9d772 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:44.588094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ed421-1498-4a58-875f-5c2c9bc9d772 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:44.819774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499836e-a111-4eb3-ae87-b1c0e1658f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:44.819774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499836e-a111-4eb3-ae87-b1c0e1658f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:44.819774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499836e-a111-4eb3-ae87-b1c0e1658f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:44.819774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499836e-a111-4eb3-ae87-b1c0e1658f03 admin admin] PATH_INFO: `/v3/projects/ce900c0ab99047bc97aae82156c0f4f0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:44.820405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499836e-a111-4eb3-ae87-b1c0e1658f03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce900c0ab99047bc97aae82156c0f4f0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:44.820405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499836e-a111-4eb3-ae87-b1c0e1658f03 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:44.820405 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:44.893722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a499836e-a111-4eb3-ae87-b1c0e1658f03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce900c0ab99047bc97aae82156c0f4f0', 'request_id': 'req-a499836e-a111-4eb3-ae87-b1c0e1658f03'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:44.902887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a499836e-a111-4eb3-ae87-b1c0e1658f03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce900c0ab99047bc97aae82156c0f4f0', 'request_id': 'req-a499836e-a111-4eb3-ae87-b1c0e1658f03'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:44.926730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a499836e-a111-4eb3-ae87-b1c0e1658f03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce900c0ab99047bc97aae82156c0f4f0', 'request_id': 'req-a499836e-a111-4eb3-ae87-b1c0e1658f03'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:44.940420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a499836e-a111-4eb3-ae87-b1c0e1658f03 admin admin] The token cache is being invalidate because project ce900c0ab99047bc97aae82156c0f4f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:57:44.940760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a499836e-a111-4eb3-ae87-b1c0e1658f03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:44.941425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a499836e-a111-4eb3-ae87-b1c0e1658f03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:57:44.945580 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1908/3808] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:57:44 2022] DELETE /identity/v3/projects/ce900c0ab99047bc97aae82156c0f4f0 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:57:44.950309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d517f12-6fc5-4d89-bc4e-9b15fc095410 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:44.951129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d517f12-6fc5-4d89-bc4e-9b15fc095410 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:44.951561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d517f12-6fc5-4d89-bc4e-9b15fc095410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:44.974836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1d517f12-6fc5-4d89-bc4e-9b15fc095410 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:44.976297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1d517f12-6fc5-4d89-bc4e-9b15fc095410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:45.058025 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1901/3809] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:57:45.065524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5395a-fbc4-4c00-a4d8-ee0ba58eead8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:45.065775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5395a-fbc4-4c00-a4d8-ee0ba58eead8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:45.066370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5395a-fbc4-4c00-a4d8-ee0ba58eead8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:45.097004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-79e5395a-fbc4-4c00-a4d8-ee0ba58eead8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:45.098291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-79e5395a-fbc4-4c00-a4d8-ee0ba58eead8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:45.112074 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1909/3810] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:57:45.115657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d517f12-6fc5-4d89-bc4e-9b15fc095410 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:45.134791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d517f12-6fc5-4d89-bc4e-9b15fc095410 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:45.139988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a85dd-e974-4887-a992-c021d85d0b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:45.140628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a85dd-e974-4887-a992-c021d85d0b8a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:45.140924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a85dd-e974-4887-a992-c021d85d0b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:45.141196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a85dd-e974-4887-a992-c021d85d0b8a admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:45.141855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a85dd-e974-4887-a992-c021d85d0b8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:57:45.142160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a85dd-e974-4887-a992-c021d85d0b8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:45.143866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a85dd-e974-4887-a992-c021d85d0b8a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:45.158111 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1902/3811] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:57:45.162361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5395a-fbc4-4c00-a4d8-ee0ba58eead8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:45.176555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5395a-fbc4-4c00-a4d8-ee0ba58eead8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:45.184886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95480d11-88b7-4237-be8d-9aebbf66b603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:45.186439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95480d11-88b7-4237-be8d-9aebbf66b603 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:45.186992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95480d11-88b7-4237-be8d-9aebbf66b603 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:45.187480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95480d11-88b7-4237-be8d-9aebbf66b603 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:45.188396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95480d11-88b7-4237-be8d-9aebbf66b603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:45.191687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95480d11-88b7-4237-be8d-9aebbf66b603 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:45.248651 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1910/3812] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:57:45 2022] POST /identity/v3/projects => generated 371 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:57:45.252709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a85dd-e974-4887-a992-c021d85d0b8a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:45.277299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a85dd-e974-4887-a992-c021d85d0b8a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:45.388685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc857b-830e-49ec-a3de-91f818881b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:45.389388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc857b-830e-49ec-a3de-91f818881b90 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:45.389702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc857b-830e-49ec-a3de-91f818881b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:45.389970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc857b-830e-49ec-a3de-91f818881b90 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:45.390598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc857b-830e-49ec-a3de-91f818881b90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:45.393072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc857b-830e-49ec-a3de-91f818881b90 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:45.424453 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1903/3813] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:57:45 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:57:45.426201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95480d11-88b7-4237-be8d-9aebbf66b603 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:45.439273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95480d11-88b7-4237-be8d-9aebbf66b603 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:45.445760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e02457-8c68-4a37-bebc-156133385ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:45.447908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e02457-8c68-4a37-bebc-156133385ebc admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:45.447908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e02457-8c68-4a37-bebc-156133385ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:45.447908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e02457-8c68-4a37-bebc-156133385ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:45.448470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e02457-8c68-4a37-bebc-156133385ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:45.450357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e02457-8c68-4a37-bebc-156133385ebc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:45.463633 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1911/3814] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:57:45.467332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc857b-830e-49ec-a3de-91f818881b90 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:45.479098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc857b-830e-49ec-a3de-91f818881b90 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:45.484675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf57225-a390-4a9d-9a49-46654a0720c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:45.485650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf57225-a390-4a9d-9a49-46654a0720c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:45.485887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf57225-a390-4a9d-9a49-46654a0720c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:45.486550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf57225-a390-4a9d-9a49-46654a0720c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:45.487393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf57225-a390-4a9d-9a49-46654a0720c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:45.489354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf57225-a390-4a9d-9a49-46654a0720c5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:45.504028 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1904/3815] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:57:45.508121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e02457-8c68-4a37-bebc-156133385ebc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:45.519919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e02457-8c68-4a37-bebc-156133385ebc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:45.525748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e169b-345b-469c-99b2-217e3c1a8daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:45.527032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e169b-345b-469c-99b2-217e3c1a8daa admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:45.527601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e169b-345b-469c-99b2-217e3c1a8daa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:45.527873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e169b-345b-469c-99b2-217e3c1a8daa admin admin] PATH_INFO: `/v3/projects/7f4a03dcec3b488094aacc6639505d0a/users/20a722795d0b421c982c9de2df532c6d/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:45.551934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e169b-345b-469c-99b2-217e3c1a8daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4a03dcec3b488094aacc6639505d0a, user_id=20a722795d0b421c982c9de2df532c6d, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:45.559961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e169b-345b-469c-99b2-217e3c1a8daa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:45.594579 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1912/3816] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:57:45 2022] PUT /identity/v3/projects/7f4a03dcec3b488094aacc6639505d0a/users/20a722795d0b421c982c9de2df532c6d/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:57:45.596630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe447b-d7e4-4628-9bf6-b0b73091bfee None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:45.596926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe447b-d7e4-4628-9bf6-b0b73091bfee None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:45.597200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe447b-d7e4-4628-9bf6-b0b73091bfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:45.661926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7abe447b-d7e4-4628-9bf6-b0b73091bfee None None] MFA Rules not processed for user `20a722795d0b421c982c9de2df532c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:45.663072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7abe447b-d7e4-4628-9bf6-b0b73091bfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:45.801429 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:45.835137 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1905/3817] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:57:45.847095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34206a-5a11-47a4-9198-c4d2cb5ed106 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:45.847520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34206a-5a11-47a4-9198-c4d2cb5ed106 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:45.847860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34206a-5a11-47a4-9198-c4d2cb5ed106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:45.886749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9b34206a-5a11-47a4-9198-c4d2cb5ed106 None None] MFA Rules not processed for user `20a722795d0b421c982c9de2df532c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:45.889948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9b34206a-5a11-47a4-9198-c4d2cb5ed106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:45.901009 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1913/3818] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:57:45.926598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe447b-d7e4-4628-9bf6-b0b73091bfee None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:45.929330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7abe447b-d7e4-4628-9bf6-b0b73091bfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:46.061317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe447b-d7e4-4628-9bf6-b0b73091bfee None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:46.075251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0976047-d083-43e6-ba6a-cccee970a3e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:46.076345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0976047-d083-43e6-ba6a-cccee970a3e2 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:46.077203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0976047-d083-43e6-ba6a-cccee970a3e2 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:46.078149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0976047-d083-43e6-ba6a-cccee970a3e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:46.092307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0976047-d083-43e6-ba6a-cccee970a3e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:46.094656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0976047-d083-43e6-ba6a-cccee970a3e2 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:46.128320 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1906/3819] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:57:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:57:51.951340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde7073-3853-4858-8ff7-2a2acbbb9c00 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:51.951813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde7073-3853-4858-8ff7-2a2acbbb9c00 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:51.952660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde7073-3853-4858-8ff7-2a2acbbb9c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:52.062497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-edde7073-3853-4858-8ff7-2a2acbbb9c00 None None] MFA Rules not processed for user `19dfdd10f1fc4f8882ccab3d85607ded`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:52.070747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-edde7073-3853-4858-8ff7-2a2acbbb9c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:52.261304 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1914/3820] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:57:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:57:52.265936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0976047-d083-43e6-ba6a-cccee970a3e2 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:52.268847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b0976047-d083-43e6-ba6a-cccee970a3e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:52.453878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0976047-d083-43e6-ba6a-cccee970a3e2 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:52.469424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e141760-4e46-457f-9e40-7a32d81d7d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:52.470448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e141760-4e46-457f-9e40-7a32d81d7d2b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:52.470960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e141760-4e46-457f-9e40-7a32d81d7d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:52.471731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e141760-4e46-457f-9e40-7a32d81d7d2b admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:52.472989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e141760-4e46-457f-9e40-7a32d81d7d2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:52.475571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e141760-4e46-457f-9e40-7a32d81d7d2b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:52.545078 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1907/3821] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:57:52 2022] POST /identity/v3/projects => generated 383 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:57:52.549136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde7073-3853-4858-8ff7-2a2acbbb9c00 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:52.565956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde7073-3853-4858-8ff7-2a2acbbb9c00 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:52.580697 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:52.698696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56738f-bf95-4a09-b8ad-7a94ef1ebf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:52.699501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56738f-bf95-4a09-b8ad-7a94ef1ebf84 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:52.700253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56738f-bf95-4a09-b8ad-7a94ef1ebf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:52.700649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56738f-bf95-4a09-b8ad-7a94ef1ebf84 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:52.701408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56738f-bf95-4a09-b8ad-7a94ef1ebf84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:52.704149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56738f-bf95-4a09-b8ad-7a94ef1ebf84 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:52.743329 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1915/3822] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:57:52 2022] POST /identity/v3/users => generated 298 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:57:52.747502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e141760-4e46-457f-9e40-7a32d81d7d2b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:52.773547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e141760-4e46-457f-9e40-7a32d81d7d2b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:52.784897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1f1c5-d223-4708-9b17-c12256bb1372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:52.786750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1f1c5-d223-4708-9b17-c12256bb1372 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:52.789031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1f1c5-d223-4708-9b17-c12256bb1372 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:52.792127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1f1c5-d223-4708-9b17-c12256bb1372 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:52.796436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1f1c5-d223-4708-9b17-c12256bb1372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:52.802147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1f1c5-d223-4708-9b17-c12256bb1372 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:52.842130 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1908/3823] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:57:52.843398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56738f-bf95-4a09-b8ad-7a94ef1ebf84 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:52.859223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56738f-bf95-4a09-b8ad-7a94ef1ebf84 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:52.864909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc60b2-d752-401c-99f3-1b4ac91ec73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:52.865968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc60b2-d752-401c-99f3-1b4ac91ec73b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:52.866483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc60b2-d752-401c-99f3-1b4ac91ec73b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:52.866998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc60b2-d752-401c-99f3-1b4ac91ec73b admin admin] PATH_INFO: `/v3/projects/b187ddd38697408e8cbb04a52399fe8a/users/309b93488561435d8bc1f3dfc65d2ea6/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:52.921899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc60b2-d752-401c-99f3-1b4ac91ec73b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b187ddd38697408e8cbb04a52399fe8a, user_id=309b93488561435d8bc1f3dfc65d2ea6, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:52.929469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc60b2-d752-401c-99f3-1b4ac91ec73b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:52.956290 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1916/3824] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:57:52 2022] PUT /identity/v3/projects/b187ddd38697408e8cbb04a52399fe8a/users/309b93488561435d8bc1f3dfc65d2ea6/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:57:52.963146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1f1c5-d223-4708-9b17-c12256bb1372 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:52.975754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1f1c5-d223-4708-9b17-c12256bb1372 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:53.053229 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:57:53.073852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e2113-c682-46a2-ab26-bc1d778bea28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:53.074637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e2113-c682-46a2-ab26-bc1d778bea28 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:53.075044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e2113-c682-46a2-ab26-bc1d778bea28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:53.075820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e2113-c682-46a2-ab26-bc1d778bea28 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:53.076959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e2113-c682-46a2-ab26-bc1d778bea28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:53.078434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e2113-c682-46a2-ab26-bc1d778bea28 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:53.097698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc60b2-d752-401c-99f3-1b4ac91ec73b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:53.104733 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1909/3825] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:57:53.112381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc60b2-d752-401c-99f3-1b4ac91ec73b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:53.120275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb79bf-a6f0-417d-8a6e-f70fbb4fa1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:53.121134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb79bf-a6f0-417d-8a6e-f70fbb4fa1c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:53.121508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb79bf-a6f0-417d-8a6e-f70fbb4fa1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:53.121871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb79bf-a6f0-417d-8a6e-f70fbb4fa1c6 admin admin] PATH_INFO: `/v3/projects/b187ddd38697408e8cbb04a52399fe8a/users/309b93488561435d8bc1f3dfc65d2ea6/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:53.124934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb79bf-a6f0-417d-8a6e-f70fbb4fa1c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b187ddd38697408e8cbb04a52399fe8a, user_id=309b93488561435d8bc1f3dfc65d2ea6, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:53.131710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb79bf-a6f0-417d-8a6e-f70fbb4fa1c6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:53.152078 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1917/3826] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:57:53 2022] PUT /identity/v3/projects/b187ddd38697408e8cbb04a52399fe8a/users/309b93488561435d8bc1f3dfc65d2ea6/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:57:55.118382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1138a-5456-4fa9-b42d-c7fb82c15d70 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:55.119215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1138a-5456-4fa9-b42d-c7fb82c15d70 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:55.119693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1138a-5456-4fa9-b42d-c7fb82c15d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:55.156487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7be1138a-5456-4fa9-b42d-c7fb82c15d70 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:57:55.159404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7be1138a-5456-4fa9-b42d-c7fb82c15d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:55.277272 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1910/3827] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:57:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:57:55.358284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb79bf-a6f0-417d-8a6e-f70fbb4fa1c6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:57:55.360122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-06fb79bf-a6f0-417d-8a6e-f70fbb4fa1c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:57:55.529045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb79bf-a6f0-417d-8a6e-f70fbb4fa1c6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:57:55.538628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e05e21-b051-4821-8768-14eafdbdc235 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:57:55.539262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e05e21-b051-4821-8768-14eafdbdc235 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:57:55.539572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e05e21-b051-4821-8768-14eafdbdc235 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:57:55.539844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e05e21-b051-4821-8768-14eafdbdc235 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:57:55.559821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e05e21-b051-4821-8768-14eafdbdc235 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:57:55.561461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e05e21-b051-4821-8768-14eafdbdc235 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:57:55.580426 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1918/3828] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:57:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:58:00.239806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1138a-5456-4fa9-b42d-c7fb82c15d70 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:00.458050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1138a-5456-4fa9-b42d-c7fb82c15d70 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:00.481131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c54d0-f27e-4f58-a859-6b5da7510e54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:00.484031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c54d0-f27e-4f58-a859-6b5da7510e54 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:00.484031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c54d0-f27e-4f58-a859-6b5da7510e54 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:00.484031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c54d0-f27e-4f58-a859-6b5da7510e54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:00.488749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4a1c54d0-f27e-4f58-a859-6b5da7510e54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:00.517503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c54d0-f27e-4f58-a859-6b5da7510e54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:00.519079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c54d0-f27e-4f58-a859-6b5da7510e54 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:00.552806 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1911/3829] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:58:00.836459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18222d-e077-4c5e-9f4a-41d3cc56bf0c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:00.837104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18222d-e077-4c5e-9f4a-41d3cc56bf0c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:00.837104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18222d-e077-4c5e-9f4a-41d3cc56bf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:00.949406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fc18222d-e077-4c5e-9f4a-41d3cc56bf0c None None] MFA Rules not processed for user `309b93488561435d8bc1f3dfc65d2ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:00.950586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fc18222d-e077-4c5e-9f4a-41d3cc56bf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:01.104080 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:01.206341 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1919/3830] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:01.219522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c54d0-f27e-4f58-a859-6b5da7510e54 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:01.221678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4a1c54d0-f27e-4f58-a859-6b5da7510e54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:01.424540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c54d0-f27e-4f58-a859-6b5da7510e54 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:01.428789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b6308-aa44-4ba0-95b1-f26b2b2aad9d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:01.429410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b6308-aa44-4ba0-95b1-f26b2b2aad9d service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:01.429685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b6308-aa44-4ba0-95b1-f26b2b2aad9d service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:01.430479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b6308-aa44-4ba0-95b1-f26b2b2aad9d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:01.438884 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:01.442218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b6308-aa44-4ba0-95b1-f26b2b2aad9d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:01.443791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b6308-aa44-4ba0-95b1-f26b2b2aad9d service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:01.455791 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1912/3831] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:58:02.281133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18222d-e077-4c5e-9f4a-41d3cc56bf0c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:02.283532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fc18222d-e077-4c5e-9f4a-41d3cc56bf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:02.618748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18222d-e077-4c5e-9f4a-41d3cc56bf0c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:02.624199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9765be4-16e5-4d8f-8e8b-776a2ab1eb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:02.625352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9765be4-16e5-4d8f-8e8b-776a2ab1eb4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:02.625839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9765be4-16e5-4d8f-8e8b-776a2ab1eb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:02.626299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9765be4-16e5-4d8f-8e8b-776a2ab1eb4c admin admin] PATH_INFO: `/v3/users/18fa2091f09c4ca89f6b143973fe443d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:02.627831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9765be4-16e5-4d8f-8e8b-776a2ab1eb4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=18fa2091f09c4ca89f6b143973fe443d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:02.629974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9765be4-16e5-4d8f-8e8b-776a2ab1eb4c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:02.735482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f9765be4-16e5-4d8f-8e8b-776a2ab1eb4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18fa2091f09c4ca89f6b143973fe443d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:02.737008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f9765be4-16e5-4d8f-8e8b-776a2ab1eb4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18fa2091f09c4ca89f6b143973fe443d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:02.752131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f9765be4-16e5-4d8f-8e8b-776a2ab1eb4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18fa2091f09c4ca89f6b143973fe443d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:02.786620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f9765be4-16e5-4d8f-8e8b-776a2ab1eb4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18fa2091f09c4ca89f6b143973fe443d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:02.806272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f9765be4-16e5-4d8f-8e8b-776a2ab1eb4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18fa2091f09c4ca89f6b143973fe443d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:02.818426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cef2ba-216d-446b-8d65-d4468e560453 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:02.819005 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1920/3832] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:02 2022] DELETE /identity/v3/users/18fa2091f09c4ca89f6b143973fe443d => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:58:02.819576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cef2ba-216d-446b-8d65-d4468e560453 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:02.820023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cef2ba-216d-446b-8d65-d4468e560453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:02.873734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-56cef2ba-216d-446b-8d65-d4468e560453 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:02.881574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-56cef2ba-216d-446b-8d65-d4468e560453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:03.108975 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1913/3833] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:03.202547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9765be4-16e5-4d8f-8e8b-776a2ab1eb4c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:03.205122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f9765be4-16e5-4d8f-8e8b-776a2ab1eb4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:03.368201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9765be4-16e5-4d8f-8e8b-776a2ab1eb4c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:03.378978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74005ee3-8bd1-42e7-ba74-9df500f46b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:03.382146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74005ee3-8bd1-42e7-ba74-9df500f46b3d service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:03.385511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74005ee3-8bd1-42e7-ba74-9df500f46b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:03.386066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74005ee3-8bd1-42e7-ba74-9df500f46b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:03.412259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74005ee3-8bd1-42e7-ba74-9df500f46b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:03.414124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74005ee3-8bd1-42e7-ba74-9df500f46b3d service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:03.447531 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:03.475898 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1921/3834] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:58:04.388450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cef2ba-216d-446b-8d65-d4468e560453 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:04.391013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-56cef2ba-216d-446b-8d65-d4468e560453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:04.417350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cef2ba-216d-446b-8d65-d4468e560453 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:04.431045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d2918-53fc-4e2b-9758-b838460abb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:04.436052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d2918-53fc-4e2b-9758-b838460abb50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:04.436660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d2918-53fc-4e2b-9758-b838460abb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:04.437166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d2918-53fc-4e2b-9758-b838460abb50 admin admin] PATH_INFO: `/v3/projects/ea7cba26600d4af5bce9086c597f89b9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:04.438634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d2918-53fc-4e2b-9758-b838460abb50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea7cba26600d4af5bce9086c597f89b9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:04.444749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d2918-53fc-4e2b-9758-b838460abb50 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:04.580911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d9d2918-53fc-4e2b-9758-b838460abb50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea7cba26600d4af5bce9086c597f89b9', 'request_id': 'req-1d9d2918-53fc-4e2b-9758-b838460abb50'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:04.598363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d9d2918-53fc-4e2b-9758-b838460abb50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea7cba26600d4af5bce9086c597f89b9', 'request_id': 'req-1d9d2918-53fc-4e2b-9758-b838460abb50'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:04.614162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d9d2918-53fc-4e2b-9758-b838460abb50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea7cba26600d4af5bce9086c597f89b9', 'request_id': 'req-1d9d2918-53fc-4e2b-9758-b838460abb50'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:04.646546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d9d2918-53fc-4e2b-9758-b838460abb50 admin admin] The token cache is being invalidate because project ea7cba26600d4af5bce9086c597f89b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:04.647006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d9d2918-53fc-4e2b-9758-b838460abb50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:04.649059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d9d2918-53fc-4e2b-9758-b838460abb50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:04.655558 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1914/3835] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:04 2022] DELETE /identity/v3/projects/ea7cba26600d4af5bce9086c597f89b9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:58:04.662106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb4209-fd88-4ded-86a4-654535e19007 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:04.662846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb4209-fd88-4ded-86a4-654535e19007 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:04.662846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb4209-fd88-4ded-86a4-654535e19007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:04.702990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-09fb4209-fd88-4ded-86a4-654535e19007 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:04.706085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-09fb4209-fd88-4ded-86a4-654535e19007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:04.863195 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1922/3836] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:04.873019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c585bb-1322-4f24-9fb3-ff406d6a52ad None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:04.873515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c585bb-1322-4f24-9fb3-ff406d6a52ad None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:04.873976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c585bb-1322-4f24-9fb3-ff406d6a52ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:04.983955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-29c585bb-1322-4f24-9fb3-ff406d6a52ad None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:04.992910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-29c585bb-1322-4f24-9fb3-ff406d6a52ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:05.057839 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1915/3837] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:05.060733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb4209-fd88-4ded-86a4-654535e19007 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:05.091012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb4209-fd88-4ded-86a4-654535e19007 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:05.113554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34082cbb-fb09-4d30-a5b0-b848db120774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:05.125587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34082cbb-fb09-4d30-a5b0-b848db120774 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:05.126217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34082cbb-fb09-4d30-a5b0-b848db120774 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:05.126742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34082cbb-fb09-4d30-a5b0-b848db120774 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:05.127717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34082cbb-fb09-4d30-a5b0-b848db120774 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:58:05.131702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34082cbb-fb09-4d30-a5b0-b848db120774 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:05.137724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34082cbb-fb09-4d30-a5b0-b848db120774 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:05.236933 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1923/3838] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:05.238018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c585bb-1322-4f24-9fb3-ff406d6a52ad None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:05.345985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c585bb-1322-4f24-9fb3-ff406d6a52ad None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:05.406249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45de072-024b-4655-9883-63a816c6ff6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:05.407794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45de072-024b-4655-9883-63a816c6ff6f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:05.408302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45de072-024b-4655-9883-63a816c6ff6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:05.408833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45de072-024b-4655-9883-63a816c6ff6f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:05.411559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45de072-024b-4655-9883-63a816c6ff6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:05.419128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45de072-024b-4655-9883-63a816c6ff6f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:05.527376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34082cbb-fb09-4d30-a5b0-b848db120774 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:05.535781 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1916/3839] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:58:05 2022] POST /identity/v3/projects => generated 385 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:05.539943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34082cbb-fb09-4d30-a5b0-b848db120774 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:05.880510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9bb75-f956-4a42-bb5c-9d7cdfee1e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:05.881245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9bb75-f956-4a42-bb5c-9d7cdfee1e6d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:05.881362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9bb75-f956-4a42-bb5c-9d7cdfee1e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:05.881641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9bb75-f956-4a42-bb5c-9d7cdfee1e6d admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:05.882282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9bb75-f956-4a42-bb5c-9d7cdfee1e6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:05.906321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9bb75-f956-4a42-bb5c-9d7cdfee1e6d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:06.007734 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1924/3840] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:58:05 2022] POST /identity/v3/users => generated 293 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:06.013127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45de072-024b-4655-9883-63a816c6ff6f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:06.027805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45de072-024b-4655-9883-63a816c6ff6f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:06.071667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce60fb-dee0-4f0f-8bab-9ffd53a235b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:06.072484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce60fb-dee0-4f0f-8bab-9ffd53a235b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:06.078950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce60fb-dee0-4f0f-8bab-9ffd53a235b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:06.079750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce60fb-dee0-4f0f-8bab-9ffd53a235b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:06.083591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce60fb-dee0-4f0f-8bab-9ffd53a235b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:06.088330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce60fb-dee0-4f0f-8bab-9ffd53a235b8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:06.132143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9bb75-f956-4a42-bb5c-9d7cdfee1e6d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:06.133846 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1917/3841] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:06.159528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9bb75-f956-4a42-bb5c-9d7cdfee1e6d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:06.184733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da121a5-579a-4d9e-9e22-9349f1d58ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:06.186822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da121a5-579a-4d9e-9e22-9349f1d58ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:06.190257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da121a5-579a-4d9e-9e22-9349f1d58ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:06.190750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da121a5-579a-4d9e-9e22-9349f1d58ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:06.194074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da121a5-579a-4d9e-9e22-9349f1d58ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:06.196490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da121a5-579a-4d9e-9e22-9349f1d58ae6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:06.210987 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1925/3842] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:06.215601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce60fb-dee0-4f0f-8bab-9ffd53a235b8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:06.240024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce60fb-dee0-4f0f-8bab-9ffd53a235b8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:06.247070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc56882-d2be-4a6f-99a5-6b9139083e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:06.248272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc56882-d2be-4a6f-99a5-6b9139083e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:06.248747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc56882-d2be-4a6f-99a5-6b9139083e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:06.249136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc56882-d2be-4a6f-99a5-6b9139083e7f admin admin] PATH_INFO: `/v3/projects/437f19c0e1a943a09576b767d827971f/users/2820fcec3f464c34968230696a5d4332/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:06.349084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc56882-d2be-4a6f-99a5-6b9139083e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=437f19c0e1a943a09576b767d827971f, user_id=2820fcec3f464c34968230696a5d4332, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:06.353236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc56882-d2be-4a6f-99a5-6b9139083e7f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:06.386105 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1918/3843] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:06 2022] PUT /identity/v3/projects/437f19c0e1a943a09576b767d827971f/users/2820fcec3f464c34968230696a5d4332/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:06.388395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254b9f9-5dcb-42e2-9b40-9ae532d6a7d0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:06.389254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254b9f9-5dcb-42e2-9b40-9ae532d6a7d0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:06.389254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254b9f9-5dcb-42e2-9b40-9ae532d6a7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:06.426866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f254b9f9-5dcb-42e2-9b40-9ae532d6a7d0 None None] MFA Rules not processed for user `2820fcec3f464c34968230696a5d4332`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:06.428791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f254b9f9-5dcb-42e2-9b40-9ae532d6a7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:06.563122 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:06.590914 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1926/3844] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:06.591587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc56882-d2be-4a6f-99a5-6b9139083e7f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:06.624518 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:06.712823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc56882-d2be-4a6f-99a5-6b9139083e7f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:06.721170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca9451-bc2a-4ec2-800e-c146d79602bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:06.722949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca9451-bc2a-4ec2-800e-c146d79602bf admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:06.723464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca9451-bc2a-4ec2-800e-c146d79602bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:06.724943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca9451-bc2a-4ec2-800e-c146d79602bf admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:06.725832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca9451-bc2a-4ec2-800e-c146d79602bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:06.729610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca9451-bc2a-4ec2-800e-c146d79602bf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:06.876230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254b9f9-5dcb-42e2-9b40-9ae532d6a7d0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:06.884835 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1919/3845] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:58:06 2022] POST /identity/v3/projects => generated 385 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:58:06.908240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254b9f9-5dcb-42e2-9b40-9ae532d6a7d0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:07.062571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a1b16-0f1e-4fd9-b1c0-68e7ba7775b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:07.063651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a1b16-0f1e-4fd9-b1c0-68e7ba7775b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:07.064056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a1b16-0f1e-4fd9-b1c0-68e7ba7775b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:07.064795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a1b16-0f1e-4fd9-b1c0-68e7ba7775b9 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:07.066745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a1b16-0f1e-4fd9-b1c0-68e7ba7775b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:07.071690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a1b16-0f1e-4fd9-b1c0-68e7ba7775b9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:07.159525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca9451-bc2a-4ec2-800e-c146d79602bf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:07.174584 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1927/3846] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:58:06 2022] POST /identity/v3/users => generated 299 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:07.177251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca9451-bc2a-4ec2-800e-c146d79602bf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:07.184006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfcb26-a1d1-427f-9de8-d125e61af6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:07.185163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfcb26-a1d1-427f-9de8-d125e61af6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:07.186424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfcb26-a1d1-427f-9de8-d125e61af6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:07.186919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfcb26-a1d1-427f-9de8-d125e61af6c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:07.187863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfcb26-a1d1-427f-9de8-d125e61af6c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:07.193161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfcb26-a1d1-427f-9de8-d125e61af6c3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:07.215157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a1b16-0f1e-4fd9-b1c0-68e7ba7775b9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:07.230683 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1920/3847] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:07.232241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a1b16-0f1e-4fd9-b1c0-68e7ba7775b9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:07.245407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181b69a-4a3b-4335-ba80-3fe5058329ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:07.246248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181b69a-4a3b-4335-ba80-3fe5058329ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:07.246627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181b69a-4a3b-4335-ba80-3fe5058329ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:07.247004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181b69a-4a3b-4335-ba80-3fe5058329ca admin admin] PATH_INFO: `/v3/projects/676fb01902194976b983ddb8478f556a/users/064aba15ed64413490ada4bacec76fda/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:07.286351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181b69a-4a3b-4335-ba80-3fe5058329ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=676fb01902194976b983ddb8478f556a, user_id=064aba15ed64413490ada4bacec76fda, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:07.290021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181b69a-4a3b-4335-ba80-3fe5058329ca admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:07.314955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfcb26-a1d1-427f-9de8-d125e61af6c3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:07.337433 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1928/3848] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:07 2022] PUT /identity/v3/projects/676fb01902194976b983ddb8478f556a/users/064aba15ed64413490ada4bacec76fda/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:07.337904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfcb26-a1d1-427f-9de8-d125e61af6c3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:07.419585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6e673-c5ad-4d42-b011-7190836c537a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:07.420441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6e673-c5ad-4d42-b011-7190836c537a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:07.420741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6e673-c5ad-4d42-b011-7190836c537a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:07.421135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6e673-c5ad-4d42-b011-7190836c537a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:07.422035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6e673-c5ad-4d42-b011-7190836c537a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:07.424742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6e673-c5ad-4d42-b011-7190836c537a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:07.452460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181b69a-4a3b-4335-ba80-3fe5058329ca admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:07.463377 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1921/3849] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:07.466544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181b69a-4a3b-4335-ba80-3fe5058329ca admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:07.471400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05459aa5-168c-464a-a07e-6446c7136f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:07.472239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05459aa5-168c-464a-a07e-6446c7136f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:07.472617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05459aa5-168c-464a-a07e-6446c7136f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:07.473290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05459aa5-168c-464a-a07e-6446c7136f51 admin admin] PATH_INFO: `/v3/projects/676fb01902194976b983ddb8478f556a/users/064aba15ed64413490ada4bacec76fda/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:07.478399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05459aa5-168c-464a-a07e-6446c7136f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=676fb01902194976b983ddb8478f556a, user_id=064aba15ed64413490ada4bacec76fda, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:07.481487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05459aa5-168c-464a-a07e-6446c7136f51 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:07.507242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebafd1-30d7-4528-993d-66eb5e158c1b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:07.507524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebafd1-30d7-4528-993d-66eb5e158c1b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:07.507798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebafd1-30d7-4528-993d-66eb5e158c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:07.508033 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1929/3850] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:07 2022] PUT /identity/v3/projects/676fb01902194976b983ddb8478f556a/users/064aba15ed64413490ada4bacec76fda/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:07.553294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-55ebafd1-30d7-4528-993d-66eb5e158c1b None None] MFA Rules not processed for user `064aba15ed64413490ada4bacec76fda`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:07.555961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-55ebafd1-30d7-4528-993d-66eb5e158c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:07.686879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05459aa5-168c-464a-a07e-6446c7136f51 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:07.698372 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1922/3851] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:58:07.700173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05459aa5-168c-464a-a07e-6446c7136f51 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:07.705332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781b61c-0db9-4a67-a4af-65fa8cb99264 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064aba15ed64413490ada4bacec76fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676fb01902194976b983ddb8478f556a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:07.706185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781b61c-0db9-4a67-a4af-65fa8cb99264 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:07.706885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781b61c-0db9-4a67-a4af-65fa8cb99264 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:07.707157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781b61c-0db9-4a67-a4af-65fa8cb99264 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:07.707805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781b61c-0db9-4a67-a4af-65fa8cb99264 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:07.708824 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-f781b61c-0db9-4a67-a4af-65fa8cb99264 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:58:07.708824 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 09:58:07.708824 n-d-master-1 devstack@keystone.service[82079]: Sep 30 09:58:07.709762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781b61c-0db9-4a67-a4af-65fa8cb99264 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:07.747342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebafd1-30d7-4528-993d-66eb5e158c1b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:07.757947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebafd1-30d7-4528-993d-66eb5e158c1b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:07.758965 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1930/3852] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:58:07 2022] POST /identity/v3/services => generated 287 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:07.769748 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:07.777916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8ff27-8dee-4573-ad31-767f4c0b3488 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064aba15ed64413490ada4bacec76fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676fb01902194976b983ddb8478f556a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:07.780363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8ff27-8dee-4573-ad31-767f4c0b3488 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:07.780851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8ff27-8dee-4573-ad31-767f4c0b3488 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:07.781232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8ff27-8dee-4573-ad31-767f4c0b3488 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:07.782214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8ff27-8dee-4573-ad31-767f4c0b3488 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:07.788461 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-8ac8ff27-8dee-4573-ad31-767f4c0b3488 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:58:07.788461 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 09:58:07.788461 n-d-master-1 devstack@keystone.service[82080]: Sep 30 09:58:07.790748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8ff27-8dee-4573-ad31-767f4c0b3488 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:07.826966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-8ac8ff27-8dee-4573-ad31-767f4c0b3488 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 30 09:58:07.826966 n-d-master-1 devstack@keystone.service[82080]: Failed validating 'type' in schema['properties']['enabled']: Sep 30 09:58:07.826966 n-d-master-1 devstack@keystone.service[82080]: {'enum': [True, False, None], 'type': 'boolean'} Sep 30 09:58:07.826966 n-d-master-1 devstack@keystone.service[82080]: On instance['enabled']: Sep 30 09:58:07.826966 n-d-master-1 devstack@keystone.service[82080]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 30 09:58:07.826966 n-d-master-1 devstack@keystone.service[82080]: Failed validating 'type' in schema['properties']['enabled']: Sep 30 09:58:07.826966 n-d-master-1 devstack@keystone.service[82080]: {'enum': [True, False, None], 'type': 'boolean'} Sep 30 09:58:07.826966 n-d-master-1 devstack@keystone.service[82080]: On instance['enabled']: Sep 30 09:58:07.826966 n-d-master-1 devstack@keystone.service[82080]: 'False' Sep 30 09:58:07.826966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:07.826966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 30 09:58:07.826966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 30 09:58:07.826966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 30 09:58:07.826966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise error Sep 30 09:58:07.826966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Sep 30 09:58:07.826966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:58:07.826966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 30 09:58:07.826966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 30 09:58:07.826966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:58:07.826966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application On instance['enabled']: Sep 30 09:58:07.826966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application 'False' Sep 30 09:58:07.826966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:58:07.826966 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:58:07.834108 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:58:07.834108 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:07.834108 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:58:07.834108 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:58:07.834108 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:58:07.834108 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:58:07.834108 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:58:07.834108 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:58:07.834108 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:58:07.834108 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:58:07.834108 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:58:07.834108 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:58:07.834108 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Sep 30 09:58:07.834108 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Sep 30 09:58:07.834108 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 30 09:58:07.834108 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 30 09:58:07.834108 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 30 09:58:07.836260 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 30 09:58:07.836260 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 30 09:58:07.836260 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:58:07.836260 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 30 09:58:07.836260 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 30 09:58:07.836260 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:58:07.836260 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application On instance['enabled']: Sep 30 09:58:07.836260 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application 'False' Sep 30 09:58:07.836260 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:58:07.836260 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1923/3853] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Sep 30 09:58:07 2022] POST /identity/v3/endpoints => generated 283 bytes in 82 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 30 09:58:07.839143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781b61c-0db9-4a67-a4af-65fa8cb99264 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:07.861748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781b61c-0db9-4a67-a4af-65fa8cb99264 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:07.868025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4766d9-89e6-41f5-a592-606437f7bebf tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064aba15ed64413490ada4bacec76fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676fb01902194976b983ddb8478f556a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:07.869071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4766d9-89e6-41f5-a592-606437f7bebf tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:07.869641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4766d9-89e6-41f5-a592-606437f7bebf tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:07.870820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4766d9-89e6-41f5-a592-606437f7bebf tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:07.871973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4766d9-89e6-41f5-a592-606437f7bebf tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:07.873366 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-ea4766d9-89e6-41f5-a592-606437f7bebf tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:58:07.873366 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 09:58:07.873366 n-d-master-1 devstack@keystone.service[82079]: Sep 30 09:58:07.874831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4766d9-89e6-41f5-a592-606437f7bebf tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:07.886825 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-ea4766d9-89e6-41f5-a592-606437f7bebf tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 30 09:58:07.886825 n-d-master-1 devstack@keystone.service[82079]: Failed validating 'type' in schema['properties']['enabled']: Sep 30 09:58:07.886825 n-d-master-1 devstack@keystone.service[82079]: {'enum': [True, False, None], 'type': 'boolean'} Sep 30 09:58:07.886825 n-d-master-1 devstack@keystone.service[82079]: On instance['enabled']: Sep 30 09:58:07.886825 n-d-master-1 devstack@keystone.service[82079]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 30 09:58:07.886825 n-d-master-1 devstack@keystone.service[82079]: Failed validating 'type' in schema['properties']['enabled']: Sep 30 09:58:07.886825 n-d-master-1 devstack@keystone.service[82079]: {'enum': [True, False, None], 'type': 'boolean'} Sep 30 09:58:07.886825 n-d-master-1 devstack@keystone.service[82079]: On instance['enabled']: Sep 30 09:58:07.886825 n-d-master-1 devstack@keystone.service[82079]: 'True' Sep 30 09:58:07.886825 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:07.886825 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 30 09:58:07.886825 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 30 09:58:07.886825 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 30 09:58:07.886825 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise error Sep 30 09:58:07.886825 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Sep 30 09:58:07.886825 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:07.886825 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 30 09:58:07.886825 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 30 09:58:07.886825 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:07.886825 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application On instance['enabled']: Sep 30 09:58:07.886825 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application 'True' Sep 30 09:58:07.886825 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:07.886825 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:58:07.889620 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:07.889620 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:07.889620 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:58:07.889620 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:58:07.889620 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:58:07.889620 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:58:07.889620 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:58:07.889620 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:58:07.889620 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:58:07.889620 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:58:07.889620 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:58:07.889620 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:58:07.889620 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Sep 30 09:58:07.889620 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Sep 30 09:58:07.889620 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 30 09:58:07.889620 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 30 09:58:07.889620 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 30 09:58:07.890916 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 30 09:58:07.890916 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 30 09:58:07.890916 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:07.890916 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 30 09:58:07.890916 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 30 09:58:07.890916 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:07.890916 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application On instance['enabled']: Sep 30 09:58:07.890916 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application 'True' Sep 30 09:58:07.890916 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:07.900341 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1931/3854] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Sep 30 09:58:07 2022] POST /identity/v3/endpoints => generated 281 bytes in 61 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 30 09:58:07.901249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8ff27-8dee-4573-ad31-767f4c0b3488 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:07.917990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8ff27-8dee-4573-ad31-767f4c0b3488 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:07.930299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1bceb3-bd23-485a-8a5f-f2c521d469ab tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064aba15ed64413490ada4bacec76fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676fb01902194976b983ddb8478f556a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:07.931201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bceb3-bd23-485a-8a5f-f2c521d469ab tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:07.931657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bceb3-bd23-485a-8a5f-f2c521d469ab tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:07.932113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bceb3-bd23-485a-8a5f-f2c521d469ab tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:07.932983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1bceb3-bd23-485a-8a5f-f2c521d469ab tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:07.934740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1bceb3-bd23-485a-8a5f-f2c521d469ab tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:07.989604 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-cd1bceb3-bd23-485a-8a5f-f2c521d469ab tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-174267493. To ensure interoperability, identifiers should be a valid uuid. Sep 30 09:58:07.989604 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 30 09:58:07.989604 n-d-master-1 devstack@keystone.service[82080]: Sep 30 09:58:08.049842 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1924/3855] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Sep 30 09:58:07 2022] POST /identity/v3/endpoints => generated 358 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:58:08.051107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4766d9-89e6-41f5-a592-606437f7bebf tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:08.076675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4766d9-89e6-41f5-a592-606437f7bebf tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:08.129885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d24512-8a16-4980-ba6f-5afdc51eeb94 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064aba15ed64413490ada4bacec76fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676fb01902194976b983ddb8478f556a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:08.131736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d24512-8a16-4980-ba6f-5afdc51eeb94 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:08.132193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d24512-8a16-4980-ba6f-5afdc51eeb94 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:08.132570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d24512-8a16-4980-ba6f-5afdc51eeb94 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] PATH_INFO: `/v3/regions/tempest-region-174267493` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:08.134557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d24512-8a16-4980-ba6f-5afdc51eeb94 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-174267493)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:08.138525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d24512-8a16-4980-ba6f-5afdc51eeb94 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:08.146796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1bceb3-bd23-485a-8a5f-f2c521d469ab tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:08.149586 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1932/3856] 10.222.0.16 () {58 vars in 1203 bytes} [Fri Sep 30 09:58:08 2022] GET /identity/v3/regions/tempest-region-174267493 => generated 178 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:08.168353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1bceb3-bd23-485a-8a5f-f2c521d469ab tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:08.181011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8eaac-a0a6-4b73-a489-653840258a3f tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064aba15ed64413490ada4bacec76fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676fb01902194976b983ddb8478f556a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:08.181957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8eaac-a0a6-4b73-a489-653840258a3f tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:08.182245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8eaac-a0a6-4b73-a489-653840258a3f tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:08.182572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8eaac-a0a6-4b73-a489-653840258a3f tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] PATH_INFO: `/v3/endpoints/3912d101f3f84f6c9e3962d169869c4c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:08.202280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8eaac-a0a6-4b73-a489-653840258a3f tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=3912d101f3f84f6c9e3962d169869c4c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:08.203375 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-6ab8eaac-a0a6-4b73-a489-653840258a3f tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:58:08.203375 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 09:58:08.203375 n-d-master-1 devstack@keystone.service[82080]: Sep 30 09:58:08.204464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8eaac-a0a6-4b73-a489-653840258a3f tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:08.222401 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-6ab8eaac-a0a6-4b73-a489-653840258a3f tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 30 09:58:08.222401 n-d-master-1 devstack@keystone.service[82080]: Failed validating 'type' in schema['properties']['enabled']: Sep 30 09:58:08.222401 n-d-master-1 devstack@keystone.service[82080]: {'enum': [True, False, None], 'type': 'boolean'} Sep 30 09:58:08.222401 n-d-master-1 devstack@keystone.service[82080]: On instance['enabled']: Sep 30 09:58:08.222401 n-d-master-1 devstack@keystone.service[82080]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 30 09:58:08.222401 n-d-master-1 devstack@keystone.service[82080]: Failed validating 'type' in schema['properties']['enabled']: Sep 30 09:58:08.222401 n-d-master-1 devstack@keystone.service[82080]: {'enum': [True, False, None], 'type': 'boolean'} Sep 30 09:58:08.222401 n-d-master-1 devstack@keystone.service[82080]: On instance['enabled']: Sep 30 09:58:08.222401 n-d-master-1 devstack@keystone.service[82080]: 'False' Sep 30 09:58:08.222401 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:08.222401 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 30 09:58:08.222401 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 30 09:58:08.222401 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 30 09:58:08.222401 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise error Sep 30 09:58:08.222401 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Sep 30 09:58:08.222401 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:58:08.222401 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 30 09:58:08.222401 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 30 09:58:08.222401 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:58:08.222401 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application On instance['enabled']: Sep 30 09:58:08.222401 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application 'False' Sep 30 09:58:08.222401 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:58:08.222401 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:58:08.224290 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:58:08.224290 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:08.224290 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:58:08.224290 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:58:08.224290 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:58:08.224290 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:58:08.224290 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:58:08.224290 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:58:08.224290 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:58:08.224290 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:58:08.224290 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:58:08.224290 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:58:08.224290 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Sep 30 09:58:08.224290 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Sep 30 09:58:08.224290 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 30 09:58:08.224290 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 30 09:58:08.224290 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 30 09:58:08.225458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 30 09:58:08.225458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 30 09:58:08.225458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:58:08.225458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 30 09:58:08.225458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 30 09:58:08.225458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:58:08.225458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application On instance['enabled']: Sep 30 09:58:08.225458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application 'False' Sep 30 09:58:08.225458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:58:08.225458 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1925/3857] 10.222.0.16 () {60 vars in 1255 bytes} [Fri Sep 30 09:58:08 2022] PATCH /identity/v3/endpoints/3912d101f3f84f6c9e3962d169869c4c => generated 283 bytes in 78 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Sep 30 09:58:08.229436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d24512-8a16-4980-ba6f-5afdc51eeb94 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:08.245720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d24512-8a16-4980-ba6f-5afdc51eeb94 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:08.269477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839fcec-5226-4d8f-9a1e-95d50ed15593 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064aba15ed64413490ada4bacec76fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676fb01902194976b983ddb8478f556a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:08.278443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839fcec-5226-4d8f-9a1e-95d50ed15593 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:08.280669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839fcec-5226-4d8f-9a1e-95d50ed15593 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:08.281005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839fcec-5226-4d8f-9a1e-95d50ed15593 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] PATH_INFO: `/v3/endpoints/3912d101f3f84f6c9e3962d169869c4c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:08.283818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839fcec-5226-4d8f-9a1e-95d50ed15593 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=3912d101f3f84f6c9e3962d169869c4c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:08.285436 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-8839fcec-5226-4d8f-9a1e-95d50ed15593 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:58:08.285436 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 09:58:08.285436 n-d-master-1 devstack@keystone.service[82079]: Sep 30 09:58:08.289981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839fcec-5226-4d8f-9a1e-95d50ed15593 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:08.360070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8839fcec-5226-4d8f-9a1e-95d50ed15593 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '3912d101f3f84f6c9e3962d169869c4c', 'request_id': 'req-8839fcec-5226-4d8f-9a1e-95d50ed15593'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:08.399498 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1933/3858] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Sep 30 09:58:08 2022] DELETE /identity/v3/endpoints/3912d101f3f84f6c9e3962d169869c4c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:08.401052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8eaac-a0a6-4b73-a489-653840258a3f tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:08.420912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8eaac-a0a6-4b73-a489-653840258a3f tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:08.471572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd1b69-d16a-46e6-a207-d65463d1aea0 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064aba15ed64413490ada4bacec76fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676fb01902194976b983ddb8478f556a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:08.472852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd1b69-d16a-46e6-a207-d65463d1aea0 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:08.473183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd1b69-d16a-46e6-a207-d65463d1aea0 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:08.473464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd1b69-d16a-46e6-a207-d65463d1aea0 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] PATH_INFO: `/v3/regions/tempest-region-174267493` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:08.474588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd1b69-d16a-46e6-a207-d65463d1aea0 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-174267493)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:08.476193 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-14bd1b69-d16a-46e6-a207-d65463d1aea0 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:58:08.476193 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 09:58:08.476193 n-d-master-1 devstack@keystone.service[82080]: Sep 30 09:58:08.479406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd1b69-d16a-46e6-a207-d65463d1aea0 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:08.547614 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1926/3859] 10.222.0.16 () {58 vars in 1206 bytes} [Fri Sep 30 09:58:08 2022] DELETE /identity/v3/regions/tempest-region-174267493 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:08.548987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839fcec-5226-4d8f-9a1e-95d50ed15593 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:08.568022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839fcec-5226-4d8f-9a1e-95d50ed15593 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:08.616776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea6207-507e-4a5a-93b6-eccd01e9a3d8 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064aba15ed64413490ada4bacec76fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676fb01902194976b983ddb8478f556a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:08.617611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea6207-507e-4a5a-93b6-eccd01e9a3d8 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:08.618021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea6207-507e-4a5a-93b6-eccd01e9a3d8 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:08.618304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea6207-507e-4a5a-93b6-eccd01e9a3d8 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:08.623175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea6207-507e-4a5a-93b6-eccd01e9a3d8 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:08.627612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea6207-507e-4a5a-93b6-eccd01e9a3d8 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:08.687346 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-d6ea6207-507e-4a5a-93b6-eccd01e9a3d8 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-94601450. To ensure interoperability, identifiers should be a valid uuid. Sep 30 09:58:08.687346 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 30 09:58:08.687346 n-d-master-1 devstack@keystone.service[82079]: Sep 30 09:58:08.758873 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1934/3860] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Sep 30 09:58:08 2022] POST /identity/v3/endpoints => generated 355 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:08.764034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd1b69-d16a-46e6-a207-d65463d1aea0 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:08.796625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd1b69-d16a-46e6-a207-d65463d1aea0 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:08.829869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0888da5-41ea-4b97-b464-08f4d47ae64e tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064aba15ed64413490ada4bacec76fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676fb01902194976b983ddb8478f556a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:08.830760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0888da5-41ea-4b97-b464-08f4d47ae64e tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:08.831207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0888da5-41ea-4b97-b464-08f4d47ae64e tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:08.832677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0888da5-41ea-4b97-b464-08f4d47ae64e tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] PATH_INFO: `/v3/regions/tempest-region-94601450` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:08.833444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0888da5-41ea-4b97-b464-08f4d47ae64e tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-94601450)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:08.834957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0888da5-41ea-4b97-b464-08f4d47ae64e tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:08.845157 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1927/3861] 10.222.0.16 () {58 vars in 1200 bytes} [Fri Sep 30 09:58:08 2022] GET /identity/v3/regions/tempest-region-94601450 => generated 176 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:08.848108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea6207-507e-4a5a-93b6-eccd01e9a3d8 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:08.871522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea6207-507e-4a5a-93b6-eccd01e9a3d8 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:08.891848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15019ebc-6321-4a8b-bcf4-1819d5ca700d tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064aba15ed64413490ada4bacec76fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676fb01902194976b983ddb8478f556a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:08.892672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15019ebc-6321-4a8b-bcf4-1819d5ca700d tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:08.893079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15019ebc-6321-4a8b-bcf4-1819d5ca700d tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:08.893451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15019ebc-6321-4a8b-bcf4-1819d5ca700d tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] PATH_INFO: `/v3/endpoints/37b3734ba83f4c9fbc127ca4dcd08bee` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:08.905375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15019ebc-6321-4a8b-bcf4-1819d5ca700d tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=37b3734ba83f4c9fbc127ca4dcd08bee)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:08.906702 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-15019ebc-6321-4a8b-bcf4-1819d5ca700d tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:58:08.906702 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 09:58:08.906702 n-d-master-1 devstack@keystone.service[82079]: Sep 30 09:58:08.908269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15019ebc-6321-4a8b-bcf4-1819d5ca700d tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:08.940075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-15019ebc-6321-4a8b-bcf4-1819d5ca700d tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 30 09:58:08.940075 n-d-master-1 devstack@keystone.service[82079]: Failed validating 'type' in schema['properties']['enabled']: Sep 30 09:58:08.940075 n-d-master-1 devstack@keystone.service[82079]: {'enum': [True, False, None], 'type': 'boolean'} Sep 30 09:58:08.940075 n-d-master-1 devstack@keystone.service[82079]: On instance['enabled']: Sep 30 09:58:08.940075 n-d-master-1 devstack@keystone.service[82079]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 30 09:58:08.940075 n-d-master-1 devstack@keystone.service[82079]: Failed validating 'type' in schema['properties']['enabled']: Sep 30 09:58:08.940075 n-d-master-1 devstack@keystone.service[82079]: {'enum': [True, False, None], 'type': 'boolean'} Sep 30 09:58:08.940075 n-d-master-1 devstack@keystone.service[82079]: On instance['enabled']: Sep 30 09:58:08.940075 n-d-master-1 devstack@keystone.service[82079]: 'True' Sep 30 09:58:08.940075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:08.940075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 30 09:58:08.940075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 30 09:58:08.940075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 30 09:58:08.940075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise error Sep 30 09:58:08.940075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Sep 30 09:58:08.940075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:08.940075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 30 09:58:08.940075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 30 09:58:08.940075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:08.940075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application On instance['enabled']: Sep 30 09:58:08.940075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application 'True' Sep 30 09:58:08.940075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:08.940075 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:58:08.942130 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:08.942130 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:08.942130 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:58:08.942130 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:58:08.942130 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:58:08.942130 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:58:08.942130 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:58:08.942130 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:58:08.942130 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:58:08.942130 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:58:08.942130 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:58:08.942130 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:58:08.942130 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Sep 30 09:58:08.942130 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Sep 30 09:58:08.942130 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 30 09:58:08.942130 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 30 09:58:08.942130 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 30 09:58:08.943270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 30 09:58:08.943270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 30 09:58:08.943270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:08.943270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 30 09:58:08.943270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 30 09:58:08.943270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:08.943270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application On instance['enabled']: Sep 30 09:58:08.943270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application 'True' Sep 30 09:58:08.943270 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:08.947663 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1935/3862] 10.222.0.16 () {60 vars in 1255 bytes} [Fri Sep 30 09:58:08 2022] PATCH /identity/v3/endpoints/37b3734ba83f4c9fbc127ca4dcd08bee => generated 281 bytes in 100 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 30 09:58:08.952465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0888da5-41ea-4b97-b464-08f4d47ae64e tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:08.966317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0888da5-41ea-4b97-b464-08f4d47ae64e tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:08.972427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ed18c-7054-4e42-99ef-d6aba2feff02 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064aba15ed64413490ada4bacec76fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676fb01902194976b983ddb8478f556a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:08.973573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ed18c-7054-4e42-99ef-d6aba2feff02 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:08.974048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ed18c-7054-4e42-99ef-d6aba2feff02 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:08.974664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ed18c-7054-4e42-99ef-d6aba2feff02 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] PATH_INFO: `/v3/endpoints/37b3734ba83f4c9fbc127ca4dcd08bee` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:08.976151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ed18c-7054-4e42-99ef-d6aba2feff02 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=37b3734ba83f4c9fbc127ca4dcd08bee)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:08.978075 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-a76ed18c-7054-4e42-99ef-d6aba2feff02 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:58:08.978075 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 09:58:08.978075 n-d-master-1 devstack@keystone.service[82080]: Sep 30 09:58:08.979687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ed18c-7054-4e42-99ef-d6aba2feff02 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:08.997392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a76ed18c-7054-4e42-99ef-d6aba2feff02 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '37b3734ba83f4c9fbc127ca4dcd08bee', 'request_id': 'req-a76ed18c-7054-4e42-99ef-d6aba2feff02'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:09.022413 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1928/3863] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Sep 30 09:58:08 2022] DELETE /identity/v3/endpoints/37b3734ba83f4c9fbc127ca4dcd08bee => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:09.026804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15019ebc-6321-4a8b-bcf4-1819d5ca700d tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:09.034807 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=8,keystone:DELETE=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:09.042764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15019ebc-6321-4a8b-bcf4-1819d5ca700d tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:09.131508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ed6de-9aed-4084-94ab-c7eb9e048c76 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064aba15ed64413490ada4bacec76fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676fb01902194976b983ddb8478f556a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:09.132577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ed6de-9aed-4084-94ab-c7eb9e048c76 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:09.136777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ed6de-9aed-4084-94ab-c7eb9e048c76 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:09.136777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ed6de-9aed-4084-94ab-c7eb9e048c76 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] PATH_INFO: `/v3/regions/tempest-region-94601450` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:09.136777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ed6de-9aed-4084-94ab-c7eb9e048c76 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-94601450)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:09.136777 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-075ed6de-9aed-4084-94ab-c7eb9e048c76 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:58:09.136777 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 09:58:09.136777 n-d-master-1 devstack@keystone.service[82079]: Sep 30 09:58:09.147847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ed6de-9aed-4084-94ab-c7eb9e048c76 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:09.191751 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1936/3864] 10.222.0.16 () {58 vars in 1203 bytes} [Fri Sep 30 09:58:09 2022] DELETE /identity/v3/regions/tempest-region-94601450 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:09.194726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ed18c-7054-4e42-99ef-d6aba2feff02 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:09.207618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ed18c-7054-4e42-99ef-d6aba2feff02 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:09.231485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75b188-5f0b-4976-91af-71ba71052133 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064aba15ed64413490ada4bacec76fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '676fb01902194976b983ddb8478f556a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:09.232171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75b188-5f0b-4976-91af-71ba71052133 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:09.232440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75b188-5f0b-4976-91af-71ba71052133 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:09.233097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75b188-5f0b-4976-91af-71ba71052133 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] PATH_INFO: `/v3/services/5d864661b81b49a5bb8328270c767517` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:09.234586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75b188-5f0b-4976-91af-71ba71052133 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorizing `identity:delete_service(service_id=5d864661b81b49a5bb8328270c767517)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:09.236648 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-ae75b188-5f0b-4976-91af-71ba71052133 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:58:09.236648 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 09:58:09.236648 n-d-master-1 devstack@keystone.service[82080]: Sep 30 09:58:09.237808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75b188-5f0b-4976-91af-71ba71052133 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:09.274480 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1929/3865] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:09 2022] DELETE /identity/v3/services/5d864661b81b49a5bb8328270c767517 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:09.276036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ed6de-9aed-4084-94ab-c7eb9e048c76 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:09.412630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ed6de-9aed-4084-94ab-c7eb9e048c76 tempest-EndpointsNegativeTestJSON-633458418 tempest-EndpointsNegativeTestJSON-633458418-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:09.437608 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8471836-f75d-4fdd-b2cf-d38f350d9ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:09.439507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8471836-f75d-4fdd-b2cf-d38f350d9ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:09.439788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8471836-f75d-4fdd-b2cf-d38f350d9ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:09.440058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8471836-f75d-4fdd-b2cf-d38f350d9ff4 admin admin] PATH_INFO: `/v3/users/2820fcec3f464c34968230696a5d4332` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:09.442423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8471836-f75d-4fdd-b2cf-d38f350d9ff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2820fcec3f464c34968230696a5d4332)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:09.445124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8471836-f75d-4fdd-b2cf-d38f350d9ff4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:09.593425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a8471836-f75d-4fdd-b2cf-d38f350d9ff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2820fcec3f464c34968230696a5d4332'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:09.596177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a8471836-f75d-4fdd-b2cf-d38f350d9ff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2820fcec3f464c34968230696a5d4332'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:09.611419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a8471836-f75d-4fdd-b2cf-d38f350d9ff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2820fcec3f464c34968230696a5d4332'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:09.629283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a8471836-f75d-4fdd-b2cf-d38f350d9ff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2820fcec3f464c34968230696a5d4332'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:09.638305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a8471836-f75d-4fdd-b2cf-d38f350d9ff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2820fcec3f464c34968230696a5d4332'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:09.648267 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1937/3866] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:09 2022] DELETE /identity/v3/users/2820fcec3f464c34968230696a5d4332 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:58:09.650730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d880c9d-6aa4-4e11-8d0f-c925860f6bd7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:09.651408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d880c9d-6aa4-4e11-8d0f-c925860f6bd7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:09.652050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d880c9d-6aa4-4e11-8d0f-c925860f6bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:09.691722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1d880c9d-6aa4-4e11-8d0f-c925860f6bd7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:09.693022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1d880c9d-6aa4-4e11-8d0f-c925860f6bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:09.788004 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1930/3867] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:58:09.800493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8471836-f75d-4fdd-b2cf-d38f350d9ff4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:09.802422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a8471836-f75d-4fdd-b2cf-d38f350d9ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:09.878320 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:09.932953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8471836-f75d-4fdd-b2cf-d38f350d9ff4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:09.936654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134c230-5a01-498b-b7d0-f9255f9d0ca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:09.937261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134c230-5a01-498b-b7d0-f9255f9d0ca3 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:09.937534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134c230-5a01-498b-b7d0-f9255f9d0ca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:09.937801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134c230-5a01-498b-b7d0-f9255f9d0ca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:09.948879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134c230-5a01-498b-b7d0-f9255f9d0ca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:09.950655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134c230-5a01-498b-b7d0-f9255f9d0ca3 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:09.969366 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1938/3868] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:58:10.860993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d880c9d-6aa4-4e11-8d0f-c925860f6bd7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:10.862581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1d880c9d-6aa4-4e11-8d0f-c925860f6bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:10.887590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134c230-5a01-498b-b7d0-f9255f9d0ca3 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:10.889249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3134c230-5a01-498b-b7d0-f9255f9d0ca3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:10.893703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d880c9d-6aa4-4e11-8d0f-c925860f6bd7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:10.913771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620cdcc-70fd-458f-9870-7f6a8659e745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:10.915056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620cdcc-70fd-458f-9870-7f6a8659e745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:10.915503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620cdcc-70fd-458f-9870-7f6a8659e745 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:10.916553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620cdcc-70fd-458f-9870-7f6a8659e745 admin admin] PATH_INFO: `/v3/projects/437f19c0e1a943a09576b767d827971f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:10.920276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620cdcc-70fd-458f-9870-7f6a8659e745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=437f19c0e1a943a09576b767d827971f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:10.925449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620cdcc-70fd-458f-9870-7f6a8659e745 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:10.958443 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:10.961963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134c230-5a01-498b-b7d0-f9255f9d0ca3 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:10.988322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc749c9-9d12-4bc0-a2d8-5a249b32ee7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:10.991541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc749c9-9d12-4bc0-a2d8-5a249b32ee7e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:10.992193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc749c9-9d12-4bc0-a2d8-5a249b32ee7e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:11.015355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc749c9-9d12-4bc0-a2d8-5a249b32ee7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:11.022152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4dc749c9-9d12-4bc0-a2d8-5a249b32ee7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:11.060804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5620cdcc-70fd-458f-9870-7f6a8659e745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '437f19c0e1a943a09576b767d827971f', 'request_id': 'req-5620cdcc-70fd-458f-9870-7f6a8659e745'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:11.075902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc749c9-9d12-4bc0-a2d8-5a249b32ee7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:11.078538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5620cdcc-70fd-458f-9870-7f6a8659e745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '437f19c0e1a943a09576b767d827971f', 'request_id': 'req-5620cdcc-70fd-458f-9870-7f6a8659e745'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:11.093754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc749c9-9d12-4bc0-a2d8-5a249b32ee7e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:11.096117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5620cdcc-70fd-458f-9870-7f6a8659e745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '437f19c0e1a943a09576b767d827971f', 'request_id': 'req-5620cdcc-70fd-458f-9870-7f6a8659e745'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:11.136014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5620cdcc-70fd-458f-9870-7f6a8659e745 admin admin] The token cache is being invalidate because project 437f19c0e1a943a09576b767d827971f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:11.136415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5620cdcc-70fd-458f-9870-7f6a8659e745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:11.138471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5620cdcc-70fd-458f-9870-7f6a8659e745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:11.143085 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1931/3869] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:10 2022] DELETE /identity/v3/projects/437f19c0e1a943a09576b767d827971f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:11.149426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620cdcc-70fd-458f-9870-7f6a8659e745 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:11.153199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5620cdcc-70fd-458f-9870-7f6a8659e745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:11.202267 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1939/3870] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:58:11.376465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620cdcc-70fd-458f-9870-7f6a8659e745 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:11.382902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431be8c2-9eab-45eb-aa66-9a65118bd4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:11.384503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431be8c2-9eab-45eb-aa66-9a65118bd4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:11.385114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431be8c2-9eab-45eb-aa66-9a65118bd4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:11.385114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431be8c2-9eab-45eb-aa66-9a65118bd4ac admin admin] PATH_INFO: `/v3/users/064aba15ed64413490ada4bacec76fda` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:11.386359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431be8c2-9eab-45eb-aa66-9a65118bd4ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=064aba15ed64413490ada4bacec76fda)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:11.388302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431be8c2-9eab-45eb-aa66-9a65118bd4ac admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:11.504776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-431be8c2-9eab-45eb-aa66-9a65118bd4ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '064aba15ed64413490ada4bacec76fda'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:11.522311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-431be8c2-9eab-45eb-aa66-9a65118bd4ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '064aba15ed64413490ada4bacec76fda'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:11.523295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-431be8c2-9eab-45eb-aa66-9a65118bd4ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '064aba15ed64413490ada4bacec76fda'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:11.544366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-431be8c2-9eab-45eb-aa66-9a65118bd4ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '064aba15ed64413490ada4bacec76fda'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:11.555989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-431be8c2-9eab-45eb-aa66-9a65118bd4ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '064aba15ed64413490ada4bacec76fda'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:11.566193 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1932/3871] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:11 2022] DELETE /identity/v3/users/064aba15ed64413490ada4bacec76fda => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:12.315390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc749c9-9d12-4bc0-a2d8-5a249b32ee7e service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:12.334683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc749c9-9d12-4bc0-a2d8-5a249b32ee7e service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:12.590801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc17fb-afd6-44c2-a95b-84bfb678c7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:12.591754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc17fb-afd6-44c2-a95b-84bfb678c7ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:12.594833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc17fb-afd6-44c2-a95b-84bfb678c7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:12.597696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc17fb-afd6-44c2-a95b-84bfb678c7ab admin admin] PATH_INFO: `/v3/projects/676fb01902194976b983ddb8478f556a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:12.604324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc17fb-afd6-44c2-a95b-84bfb678c7ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=676fb01902194976b983ddb8478f556a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:12.610945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc17fb-afd6-44c2-a95b-84bfb678c7ab admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:12.797266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f5fc17fb-afd6-44c2-a95b-84bfb678c7ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '676fb01902194976b983ddb8478f556a', 'request_id': 'req-f5fc17fb-afd6-44c2-a95b-84bfb678c7ab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:12.813517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f5fc17fb-afd6-44c2-a95b-84bfb678c7ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '676fb01902194976b983ddb8478f556a', 'request_id': 'req-f5fc17fb-afd6-44c2-a95b-84bfb678c7ab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:12.823994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f5fc17fb-afd6-44c2-a95b-84bfb678c7ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '676fb01902194976b983ddb8478f556a', 'request_id': 'req-f5fc17fb-afd6-44c2-a95b-84bfb678c7ab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:12.871042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f5fc17fb-afd6-44c2-a95b-84bfb678c7ab admin admin] The token cache is being invalidate because project 676fb01902194976b983ddb8478f556a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:12.871640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f5fc17fb-afd6-44c2-a95b-84bfb678c7ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:12.872496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f5fc17fb-afd6-44c2-a95b-84bfb678c7ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:12.874494 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1940/3872] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:12 2022] DELETE /identity/v3/projects/676fb01902194976b983ddb8478f556a => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:12.879984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6040f2a-409a-4d5f-b7c2-6115f8455a51 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:12.881307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6040f2a-409a-4d5f-b7c2-6115f8455a51 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:12.881769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6040f2a-409a-4d5f-b7c2-6115f8455a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:12.942257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f6040f2a-409a-4d5f-b7c2-6115f8455a51 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:12.943768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f6040f2a-409a-4d5f-b7c2-6115f8455a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:12.971031 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:13.165112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7772070-e464-4838-9b73-46a86ed92e30 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:13.165631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7772070-e464-4838-9b73-46a86ed92e30 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:13.166552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7772070-e464-4838-9b73-46a86ed92e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:13.169115 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1933/3873] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:13.210026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a7772070-e464-4838-9b73-46a86ed92e30 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:13.212883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a7772070-e464-4838-9b73-46a86ed92e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:13.228476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6040f2a-409a-4d5f-b7c2-6115f8455a51 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:13.234371 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1941/3874] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:13.243283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6040f2a-409a-4d5f-b7c2-6115f8455a51 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:13.249550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7c4d0-7eca-41a6-9233-bd9fbb3fa312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:13.250594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7c4d0-7eca-41a6-9233-bd9fbb3fa312 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:13.250937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7c4d0-7eca-41a6-9233-bd9fbb3fa312 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:13.251425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7c4d0-7eca-41a6-9233-bd9fbb3fa312 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:13.253089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7c4d0-7eca-41a6-9233-bd9fbb3fa312 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:58:13.253457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7c4d0-7eca-41a6-9233-bd9fbb3fa312 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:13.255121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7c4d0-7eca-41a6-9233-bd9fbb3fa312 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:13.276966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7772070-e464-4838-9b73-46a86ed92e30 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:13.285054 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1934/3875] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:13.290675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7772070-e464-4838-9b73-46a86ed92e30 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:13.295932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d5575-9774-41d6-90b9-c5722ffac212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:13.296713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d5575-9774-41d6-90b9-c5722ffac212 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:13.297108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d5575-9774-41d6-90b9-c5722ffac212 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:13.297475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d5575-9774-41d6-90b9-c5722ffac212 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:13.298338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d5575-9774-41d6-90b9-c5722ffac212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:13.301224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d5575-9774-41d6-90b9-c5722ffac212 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:13.351399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7c4d0-7eca-41a6-9233-bd9fbb3fa312 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:13.360053 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1942/3876] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:58:13 2022] POST /identity/v3/projects => generated 387 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:58:13.366044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7c4d0-7eca-41a6-9233-bd9fbb3fa312 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:13.531726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14c007-f95e-445b-89a5-f896564d3966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:13.531726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14c007-f95e-445b-89a5-f896564d3966 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:13.531726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14c007-f95e-445b-89a5-f896564d3966 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:13.531726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14c007-f95e-445b-89a5-f896564d3966 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:13.532355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14c007-f95e-445b-89a5-f896564d3966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:13.533613 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14c007-f95e-445b-89a5-f896564d3966 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:13.614427 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1935/3877] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:58:13 2022] POST /identity/v3/users => generated 294 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:13.619713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d5575-9774-41d6-90b9-c5722ffac212 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:13.674200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d5575-9774-41d6-90b9-c5722ffac212 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:13.684333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c00c3f-f46c-4e0c-b816-1828e409a642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:13.685023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c00c3f-f46c-4e0c-b816-1828e409a642 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:13.685308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c00c3f-f46c-4e0c-b816-1828e409a642 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:13.685581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c00c3f-f46c-4e0c-b816-1828e409a642 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:13.686598 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c00c3f-f46c-4e0c-b816-1828e409a642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:13.701309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c00c3f-f46c-4e0c-b816-1828e409a642 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:13.733739 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1943/3878] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:13.745832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14c007-f95e-445b-89a5-f896564d3966 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:13.783596 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14c007-f95e-445b-89a5-f896564d3966 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:13.804754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c42fc-e9a2-4ade-aa8b-a67413052af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:13.806540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c42fc-e9a2-4ade-aa8b-a67413052af6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:13.807045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c42fc-e9a2-4ade-aa8b-a67413052af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:13.807566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c42fc-e9a2-4ade-aa8b-a67413052af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:13.808701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c42fc-e9a2-4ade-aa8b-a67413052af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:13.810771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c42fc-e9a2-4ade-aa8b-a67413052af6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:13.866688 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1936/3879] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:13.867855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c00c3f-f46c-4e0c-b816-1828e409a642 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:13.888731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c00c3f-f46c-4e0c-b816-1828e409a642 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:13.897762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4258e-ae99-446b-b191-cb2636a27e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:13.897762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4258e-ae99-446b-b191-cb2636a27e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:13.897762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4258e-ae99-446b-b191-cb2636a27e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:13.897762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4258e-ae99-446b-b191-cb2636a27e05 admin admin] PATH_INFO: `/v3/projects/0d21b03ab63642f09234fa3f9056cdb8/users/58840a7469c04ab590f23c30fe98d3ce/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:13.900064 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:13.962646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4258e-ae99-446b-b191-cb2636a27e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d21b03ab63642f09234fa3f9056cdb8, user_id=58840a7469c04ab590f23c30fe98d3ce, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:13.980013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4258e-ae99-446b-b191-cb2636a27e05 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:14.010729 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1944/3880] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:13 2022] PUT /identity/v3/projects/0d21b03ab63642f09234fa3f9056cdb8/users/58840a7469c04ab590f23c30fe98d3ce/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:14.130236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae321a-e043-4e46-bcaa-67516fecb787 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:14.130798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae321a-e043-4e46-bcaa-67516fecb787 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:14.130798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae321a-e043-4e46-bcaa-67516fecb787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:14.168156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-eeae321a-e043-4e46-bcaa-67516fecb787 None None] MFA Rules not processed for user `58840a7469c04ab590f23c30fe98d3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:14.172915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eeae321a-e043-4e46-bcaa-67516fecb787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:14.262337 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1937/3881] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:58:14.262942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4258e-ae99-446b-b191-cb2636a27e05 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:14.431852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4258e-ae99-446b-b191-cb2636a27e05 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:14.437038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c88af-c7a2-452f-8677-de78bb6165d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:14.437779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c88af-c7a2-452f-8677-de78bb6165d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:14.438167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c88af-c7a2-452f-8677-de78bb6165d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:14.438546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c88af-c7a2-452f-8677-de78bb6165d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:14.439287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c88af-c7a2-452f-8677-de78bb6165d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:14.448035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c88af-c7a2-452f-8677-de78bb6165d7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:14.493089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae321a-e043-4e46-bcaa-67516fecb787 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:14.493596 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1945/3882] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:58:14 2022] POST /identity/v3/projects => generated 389 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:14.508925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae321a-e043-4e46-bcaa-67516fecb787 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:14.529657 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:14.621900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32489fa2-7927-4a8f-b6fa-10a537cf844d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:14.622760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32489fa2-7927-4a8f-b6fa-10a537cf844d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:14.623238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32489fa2-7927-4a8f-b6fa-10a537cf844d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:14.623678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32489fa2-7927-4a8f-b6fa-10a537cf844d admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:14.624484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32489fa2-7927-4a8f-b6fa-10a537cf844d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:14.626728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32489fa2-7927-4a8f-b6fa-10a537cf844d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:14.679673 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1938/3883] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:58:14 2022] POST /identity/v3/users => generated 301 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:14.683738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c88af-c7a2-452f-8677-de78bb6165d7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:14.705125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c88af-c7a2-452f-8677-de78bb6165d7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:14.723834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005f23c-809f-4b3d-ade5-a95274ecb6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:14.725405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005f23c-809f-4b3d-ade5-a95274ecb6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:14.727898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005f23c-809f-4b3d-ade5-a95274ecb6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:14.728791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005f23c-809f-4b3d-ade5-a95274ecb6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:14.733141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005f23c-809f-4b3d-ade5-a95274ecb6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:14.741219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005f23c-809f-4b3d-ade5-a95274ecb6a0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:14.779227 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1946/3884] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:14.780333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32489fa2-7927-4a8f-b6fa-10a537cf844d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:14.823194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32489fa2-7927-4a8f-b6fa-10a537cf844d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:14.833358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d21ef-a0b2-460d-ac34-b621637093b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:14.834074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d21ef-a0b2-460d-ac34-b621637093b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:14.834348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d21ef-a0b2-460d-ac34-b621637093b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:14.835258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d21ef-a0b2-460d-ac34-b621637093b7 admin admin] PATH_INFO: `/v3/projects/de264fc026304adcb5bb620851dd80e3/users/88a07ab272784deea09a67cebe62cf85/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:14.883222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d21ef-a0b2-460d-ac34-b621637093b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de264fc026304adcb5bb620851dd80e3, user_id=88a07ab272784deea09a67cebe62cf85, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:14.886176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d21ef-a0b2-460d-ac34-b621637093b7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:14.937676 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1939/3885] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:14 2022] PUT /identity/v3/projects/de264fc026304adcb5bb620851dd80e3/users/88a07ab272784deea09a67cebe62cf85/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:58:14.941653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005f23c-809f-4b3d-ade5-a95274ecb6a0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:14.972318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005f23c-809f-4b3d-ade5-a95274ecb6a0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:15.183985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e33c5-4b32-4e95-abee-120b9c44707e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:15.185714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e33c5-4b32-4e95-abee-120b9c44707e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:15.186171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e33c5-4b32-4e95-abee-120b9c44707e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:15.186610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e33c5-4b32-4e95-abee-120b9c44707e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:15.187435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e33c5-4b32-4e95-abee-120b9c44707e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:15.189248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e33c5-4b32-4e95-abee-120b9c44707e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:15.209879 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1947/3886] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:15.214843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d21ef-a0b2-460d-ac34-b621637093b7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:15.234282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d21ef-a0b2-460d-ac34-b621637093b7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:15.259725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd418dc-b263-47bd-90f4-ece3e0653968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:15.260573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd418dc-b263-47bd-90f4-ece3e0653968 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:15.262184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd418dc-b263-47bd-90f4-ece3e0653968 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:15.262824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd418dc-b263-47bd-90f4-ece3e0653968 admin admin] PATH_INFO: `/v3/projects/de264fc026304adcb5bb620851dd80e3/users/88a07ab272784deea09a67cebe62cf85/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:15.278933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd418dc-b263-47bd-90f4-ece3e0653968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de264fc026304adcb5bb620851dd80e3, user_id=88a07ab272784deea09a67cebe62cf85, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:15.282013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd418dc-b263-47bd-90f4-ece3e0653968 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:15.313577 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1940/3887] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:15 2022] PUT /identity/v3/projects/de264fc026304adcb5bb620851dd80e3/users/88a07ab272784deea09a67cebe62cf85/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:15.329669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78271ee-9f46-49ca-8308-1a0801d08e32 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:15.330109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78271ee-9f46-49ca-8308-1a0801d08e32 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:15.330492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78271ee-9f46-49ca-8308-1a0801d08e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:15.411712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d78271ee-9f46-49ca-8308-1a0801d08e32 None None] MFA Rules not processed for user `88a07ab272784deea09a67cebe62cf85`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:15.419235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d78271ee-9f46-49ca-8308-1a0801d08e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:15.522991 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:15.599370 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1948/3888] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:15 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:58:15.604460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd418dc-b263-47bd-90f4-ece3e0653968 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:15.616017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd418dc-b263-47bd-90f4-ece3e0653968 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:15.625124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b2a6f-370a-4043-b10b-e4874f2c18d1 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a07ab272784deea09a67cebe62cf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de264fc026304adcb5bb620851dd80e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:15.625771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b2a6f-370a-4043-b10b-e4874f2c18d1 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:15.626060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b2a6f-370a-4043-b10b-e4874f2c18d1 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:15.626335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b2a6f-370a-4043-b10b-e4874f2c18d1 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] PATH_INFO: `/v3/projects/0d21b03ab63642f09234fa3f9056cdb8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:15.629198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b2a6f-370a-4043-b10b-e4874f2c18d1 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorizing `identity:get_project(project_id=0d21b03ab63642f09234fa3f9056cdb8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:15.631573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b2a6f-370a-4043-b10b-e4874f2c18d1 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:15.640436 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1941/3889] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 09:58:15 2022] GET /identity/v3/projects/0d21b03ab63642f09234fa3f9056cdb8 => generated 387 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:15.641889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78271ee-9f46-49ca-8308-1a0801d08e32 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:15.652902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78271ee-9f46-49ca-8308-1a0801d08e32 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:15.658856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab0018-266c-45f6-9def-ed083b8d04c2 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a07ab272784deea09a67cebe62cf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de264fc026304adcb5bb620851dd80e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:15.659478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab0018-266c-45f6-9def-ed083b8d04c2 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:15.659760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab0018-266c-45f6-9def-ed083b8d04c2 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:15.660616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab0018-266c-45f6-9def-ed083b8d04c2 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:15.661298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab0018-266c-45f6-9def-ed083b8d04c2 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:15.663281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab0018-266c-45f6-9def-ed083b8d04c2 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:15.729486 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1949/3890] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Sep 30 09:58:15 2022] POST /identity/v3/projects => generated 339 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:58:15.729927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b2a6f-370a-4043-b10b-e4874f2c18d1 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:15.741035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b2a6f-370a-4043-b10b-e4874f2c18d1 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:15.832026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377a599-01b0-4506-93a9-2b608df2b15b tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a07ab272784deea09a67cebe62cf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de264fc026304adcb5bb620851dd80e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:15.832638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377a599-01b0-4506-93a9-2b608df2b15b tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:15.832939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377a599-01b0-4506-93a9-2b608df2b15b tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:15.833219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377a599-01b0-4506-93a9-2b608df2b15b tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:15.833880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377a599-01b0-4506-93a9-2b608df2b15b tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:15.834892 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-7377a599-01b0-4506-93a9-2b608df2b15b tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:58:15.834892 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 09:58:15.834892 n-d-master-1 devstack@keystone.service[82080]: Sep 30 09:58:15.836078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377a599-01b0-4506-93a9-2b608df2b15b tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:15.854984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fc3c5-3c23-4406-87ef-6eb4e054ddb6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:15.855273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fc3c5-3c23-4406-87ef-6eb4e054ddb6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:15.858472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fc3c5-3c23-4406-87ef-6eb4e054ddb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:15.876571 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1942/3891] 10.222.0.16 () {58 vars in 1131 bytes} [Fri Sep 30 09:58:15 2022] GET /identity/v3/projects => generated 7300 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:15.880876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377a599-01b0-4506-93a9-2b608df2b15b tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:15.890048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-334fc3c5-3c23-4406-87ef-6eb4e054ddb6 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:15.891642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-334fc3c5-3c23-4406-87ef-6eb4e054ddb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:15.902214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377a599-01b0-4506-93a9-2b608df2b15b tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:15.909245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f214677-197c-44b9-b06a-bb25150fabec tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a07ab272784deea09a67cebe62cf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de264fc026304adcb5bb620851dd80e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:15.910027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f214677-197c-44b9-b06a-bb25150fabec tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:15.910414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f214677-197c-44b9-b06a-bb25150fabec tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:15.910794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f214677-197c-44b9-b06a-bb25150fabec tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] PATH_INFO: `/v3/projects/0d21b03ab63642f09234fa3f9056cdb8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:15.912177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f214677-197c-44b9-b06a-bb25150fabec tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorizing `identity:get_project(project_id=0d21b03ab63642f09234fa3f9056cdb8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:15.914894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f214677-197c-44b9-b06a-bb25150fabec tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:15.917584 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1943/3892] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 09:58:15 2022] GET /identity/v3/projects/0d21b03ab63642f09234fa3f9056cdb8 => generated 387 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:15.931393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f214677-197c-44b9-b06a-bb25150fabec tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:15.955674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f214677-197c-44b9-b06a-bb25150fabec tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:15.966847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e84788-65f3-4d47-a1e1-ad30b6ef8cd9 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a07ab272784deea09a67cebe62cf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de264fc026304adcb5bb620851dd80e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:15.967648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e84788-65f3-4d47-a1e1-ad30b6ef8cd9 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:15.968535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e84788-65f3-4d47-a1e1-ad30b6ef8cd9 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:15.969302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e84788-65f3-4d47-a1e1-ad30b6ef8cd9 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] PATH_INFO: `/v3/projects/5591bd19d1b24fd782ed4867d3a4244c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:15.970718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e84788-65f3-4d47-a1e1-ad30b6ef8cd9 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorizing `identity:get_project(project_id=5591bd19d1b24fd782ed4867d3a4244c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:15.973688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e84788-65f3-4d47-a1e1-ad30b6ef8cd9 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:15.977364 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1944/3893] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 09:58:15 2022] GET /identity/v3/projects/5591bd19d1b24fd782ed4867d3a4244c => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:15.987510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e84788-65f3-4d47-a1e1-ad30b6ef8cd9 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:15.991949 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1950/3894] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:58:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:58:16.002946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e84788-65f3-4d47-a1e1-ad30b6ef8cd9 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:16.007550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fc3c5-3c23-4406-87ef-6eb4e054ddb6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:16.009918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5af0ae-7d8c-4e10-8606-37f474a3f1ea tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a07ab272784deea09a67cebe62cf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de264fc026304adcb5bb620851dd80e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:16.010547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-334fc3c5-3c23-4406-87ef-6eb4e054ddb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:16.010796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5af0ae-7d8c-4e10-8606-37f474a3f1ea tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:16.011144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5af0ae-7d8c-4e10-8606-37f474a3f1ea tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:16.011487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5af0ae-7d8c-4e10-8606-37f474a3f1ea tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:16.012365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5af0ae-7d8c-4e10-8606-37f474a3f1ea tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:16.014474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5af0ae-7d8c-4e10-8606-37f474a3f1ea tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:16.047116 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1945/3895] 10.222.0.16 () {58 vars in 1131 bytes} [Fri Sep 30 09:58:15 2022] GET /identity/v3/projects => generated 7300 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:16.055230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5af0ae-7d8c-4e10-8606-37f474a3f1ea tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:16.082258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5af0ae-7d8c-4e10-8606-37f474a3f1ea tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:16.095962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24635d7-768b-42c0-aa5b-74e661535e8e tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a07ab272784deea09a67cebe62cf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de264fc026304adcb5bb620851dd80e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:16.096585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24635d7-768b-42c0-aa5b-74e661535e8e tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:16.096886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24635d7-768b-42c0-aa5b-74e661535e8e tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:16.097159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24635d7-768b-42c0-aa5b-74e661535e8e tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:16.097829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24635d7-768b-42c0-aa5b-74e661535e8e tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:58:16.098204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24635d7-768b-42c0-aa5b-74e661535e8e tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:16.100270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24635d7-768b-42c0-aa5b-74e661535e8e tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:16.151813 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1946/3896] 10.222.0.16 () {58 vars in 1166 bytes} [Fri Sep 30 09:58:16 2022] GET /identity/v3/projects?domain_id=default => generated 6969 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:16.157587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24635d7-768b-42c0-aa5b-74e661535e8e tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:16.178507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24635d7-768b-42c0-aa5b-74e661535e8e tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:16.191721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62d5ef-4aa1-40f7-a9c0-a6847a21880a tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a07ab272784deea09a67cebe62cf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de264fc026304adcb5bb620851dd80e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:16.192334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62d5ef-4aa1-40f7-a9c0-a6847a21880a tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:16.192628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62d5ef-4aa1-40f7-a9c0-a6847a21880a tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:16.192908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62d5ef-4aa1-40f7-a9c0-a6847a21880a tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:16.193554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62d5ef-4aa1-40f7-a9c0-a6847a21880a tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:16.195988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62d5ef-4aa1-40f7-a9c0-a6847a21880a tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:16.200084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fc3c5-3c23-4406-87ef-6eb4e054ddb6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:16.211440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9173151-3735-40ec-87e8-e5e8849e42ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:16.212058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9173151-3735-40ec-87e8-e5e8849e42ca service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:16.212335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9173151-3735-40ec-87e8-e5e8849e42ca service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:16.212623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9173151-3735-40ec-87e8-e5e8849e42ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:16.233673 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1947/3897] 10.222.0.16 () {58 vars in 1131 bytes} [Fri Sep 30 09:58:16 2022] GET /identity/v3/projects => generated 7300 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:16.238093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9173151-3735-40ec-87e8-e5e8849e42ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:16.239804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9173151-3735-40ec-87e8-e5e8849e42ca service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:16.241591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62d5ef-4aa1-40f7-a9c0-a6847a21880a tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:16.250997 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1951/3898] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:58:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 09:58:16.258481 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:16.270126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62d5ef-4aa1-40f7-a9c0-a6847a21880a tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:16.281676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df7d32-d513-45f6-9f75-c470c245e1b3 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a07ab272784deea09a67cebe62cf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de264fc026304adcb5bb620851dd80e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:16.282419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df7d32-d513-45f6-9f75-c470c245e1b3 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:16.282775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df7d32-d513-45f6-9f75-c470c245e1b3 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:16.283164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df7d32-d513-45f6-9f75-c470c245e1b3 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:16.287878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df7d32-d513-45f6-9f75-c470c245e1b3 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:58:16.288457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df7d32-d513-45f6-9f75-c470c245e1b3 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:16.291042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df7d32-d513-45f6-9f75-c470c245e1b3 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:16.347809 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1948/3899] 10.222.0.16 () {58 vars in 1166 bytes} [Fri Sep 30 09:58:16 2022] GET /identity/v3/projects?domain_id=default => generated 6969 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:16.352430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9173151-3735-40ec-87e8-e5e8849e42ca service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:16.377279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9173151-3735-40ec-87e8-e5e8849e42ca service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:16.392868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb52bc-1c24-4bb4-9748-e1ff81fff698 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a07ab272784deea09a67cebe62cf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de264fc026304adcb5bb620851dd80e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:16.393506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb52bc-1c24-4bb4-9748-e1ff81fff698 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:16.393789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb52bc-1c24-4bb4-9748-e1ff81fff698 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:16.394067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb52bc-1c24-4bb4-9748-e1ff81fff698 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:16.394712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb52bc-1c24-4bb4-9748-e1ff81fff698 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:16.405819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb52bc-1c24-4bb4-9748-e1ff81fff698 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:16.484088 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1952/3900] 10.222.0.16 () {58 vars in 1131 bytes} [Fri Sep 30 09:58:16 2022] GET /identity/v3/projects => generated 7300 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:16.488014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df7d32-d513-45f6-9f75-c470c245e1b3 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:16.506164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df7d32-d513-45f6-9f75-c470c245e1b3 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:16.511601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a23ef9-a7e6-4eda-b5f1-36b9fe4fd38d tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a07ab272784deea09a67cebe62cf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de264fc026304adcb5bb620851dd80e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:16.512216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a23ef9-a7e6-4eda-b5f1-36b9fe4fd38d tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:16.512494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a23ef9-a7e6-4eda-b5f1-36b9fe4fd38d tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:16.512879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a23ef9-a7e6-4eda-b5f1-36b9fe4fd38d tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:16.513560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a23ef9-a7e6-4eda-b5f1-36b9fe4fd38d tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-180815696) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:58:16.513864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a23ef9-a7e6-4eda-b5f1-36b9fe4fd38d tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:16.516336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a23ef9-a7e6-4eda-b5f1-36b9fe4fd38d tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:16.557670 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1949/3901] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 09:58:16 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-180815696 => generated 534 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:16.562480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb52bc-1c24-4bb4-9748-e1ff81fff698 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:16.580301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb52bc-1c24-4bb4-9748-e1ff81fff698 tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:16.597299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b4a9c-18b1-4c1b-bc0b-f9a33f89b6cd tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a07ab272784deea09a67cebe62cf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de264fc026304adcb5bb620851dd80e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:16.602013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b4a9c-18b1-4c1b-bc0b-f9a33f89b6cd tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:16.602360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b4a9c-18b1-4c1b-bc0b-f9a33f89b6cd tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:16.602607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b4a9c-18b1-4c1b-bc0b-f9a33f89b6cd tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] PATH_INFO: `/v3/projects/5591bd19d1b24fd782ed4867d3a4244c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:16.604630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b4a9c-18b1-4c1b-bc0b-f9a33f89b6cd tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5591bd19d1b24fd782ed4867d3a4244c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:16.608585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b4a9c-18b1-4c1b-bc0b-f9a33f89b6cd tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:16.650434 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:16.740982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fe7b4a9c-18b1-4c1b-bc0b-f9a33f89b6cd tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5591bd19d1b24fd782ed4867d3a4244c', 'request_id': 'req-fe7b4a9c-18b1-4c1b-bc0b-f9a33f89b6cd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:16.761198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fe7b4a9c-18b1-4c1b-bc0b-f9a33f89b6cd tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5591bd19d1b24fd782ed4867d3a4244c', 'request_id': 'req-fe7b4a9c-18b1-4c1b-bc0b-f9a33f89b6cd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:16.777621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fe7b4a9c-18b1-4c1b-bc0b-f9a33f89b6cd tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5591bd19d1b24fd782ed4867d3a4244c', 'request_id': 'req-fe7b4a9c-18b1-4c1b-bc0b-f9a33f89b6cd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:16.817626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fe7b4a9c-18b1-4c1b-bc0b-f9a33f89b6cd tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] The token cache is being invalidate because project 5591bd19d1b24fd782ed4867d3a4244c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:16.818008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fe7b4a9c-18b1-4c1b-bc0b-f9a33f89b6cd tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:16.819839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fe7b4a9c-18b1-4c1b-bc0b-f9a33f89b6cd tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:16.829196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a23ef9-a7e6-4eda-b5f1-36b9fe4fd38d tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:16.831003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-71a23ef9-a7e6-4eda-b5f1-36b9fe4fd38d tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:16.834060 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1953/3902] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:16 2022] DELETE /identity/v3/projects/5591bd19d1b24fd782ed4867d3a4244c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:58:16.973681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a23ef9-a7e6-4eda-b5f1-36b9fe4fd38d tempest-ListProjectsStaticTestJSON-1350725251 tempest-ListProjectsStaticTestJSON-1350725251-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:17.112303 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22584f1f-3b3a-4cca-88d1-f5b1b00a89e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:17.113543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22584f1f-3b3a-4cca-88d1-f5b1b00a89e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:17.114192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22584f1f-3b3a-4cca-88d1-f5b1b00a89e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:17.114521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22584f1f-3b3a-4cca-88d1-f5b1b00a89e5 admin admin] PATH_INFO: `/v3/users/58840a7469c04ab590f23c30fe98d3ce` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:17.115679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22584f1f-3b3a-4cca-88d1-f5b1b00a89e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58840a7469c04ab590f23c30fe98d3ce)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:17.118460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22584f1f-3b3a-4cca-88d1-f5b1b00a89e5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:17.241599 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-22584f1f-3b3a-4cca-88d1-f5b1b00a89e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58840a7469c04ab590f23c30fe98d3ce'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:17.257083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-22584f1f-3b3a-4cca-88d1-f5b1b00a89e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58840a7469c04ab590f23c30fe98d3ce'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:17.258228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-22584f1f-3b3a-4cca-88d1-f5b1b00a89e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58840a7469c04ab590f23c30fe98d3ce'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:17.294045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-22584f1f-3b3a-4cca-88d1-f5b1b00a89e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58840a7469c04ab590f23c30fe98d3ce'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:17.308639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-22584f1f-3b3a-4cca-88d1-f5b1b00a89e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58840a7469c04ab590f23c30fe98d3ce'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:17.319106 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1950/3903] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:16 2022] DELETE /identity/v3/users/58840a7469c04ab590f23c30fe98d3ce => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:17.323524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9137e35-5ca2-4d7c-91f8-44ae7b8e652c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:17.323868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9137e35-5ca2-4d7c-91f8-44ae7b8e652c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:17.324077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9137e35-5ca2-4d7c-91f8-44ae7b8e652c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:17.365799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e9137e35-5ca2-4d7c-91f8-44ae7b8e652c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:17.367081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e9137e35-5ca2-4d7c-91f8-44ae7b8e652c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:17.505929 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1954/3904] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:17.513109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22584f1f-3b3a-4cca-88d1-f5b1b00a89e5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:17.514567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-22584f1f-3b3a-4cca-88d1-f5b1b00a89e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:17.525630 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:17.638506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22584f1f-3b3a-4cca-88d1-f5b1b00a89e5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:17.643342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436d826-4b32-43ae-8c4b-791e8de2fc42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:17.644069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436d826-4b32-43ae-8c4b-791e8de2fc42 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:17.644351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436d826-4b32-43ae-8c4b-791e8de2fc42 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:17.645404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436d826-4b32-43ae-8c4b-791e8de2fc42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:17.658095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436d826-4b32-43ae-8c4b-791e8de2fc42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:17.660019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436d826-4b32-43ae-8c4b-791e8de2fc42 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:17.683387 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1951/3905] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:58:18.362527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9137e35-5ca2-4d7c-91f8-44ae7b8e652c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:18.364788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e9137e35-5ca2-4d7c-91f8-44ae7b8e652c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:18.404806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9137e35-5ca2-4d7c-91f8-44ae7b8e652c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:18.427640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980f56c-7c3e-4ca7-a8fb-40e388141794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:18.428298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980f56c-7c3e-4ca7-a8fb-40e388141794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:18.428572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980f56c-7c3e-4ca7-a8fb-40e388141794 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:18.428888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980f56c-7c3e-4ca7-a8fb-40e388141794 admin admin] PATH_INFO: `/v3/projects/0d21b03ab63642f09234fa3f9056cdb8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:18.430089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980f56c-7c3e-4ca7-a8fb-40e388141794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d21b03ab63642f09234fa3f9056cdb8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:18.432002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980f56c-7c3e-4ca7-a8fb-40e388141794 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:18.598770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f980f56c-7c3e-4ca7-a8fb-40e388141794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d21b03ab63642f09234fa3f9056cdb8', 'request_id': 'req-f980f56c-7c3e-4ca7-a8fb-40e388141794'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:18.628627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f980f56c-7c3e-4ca7-a8fb-40e388141794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d21b03ab63642f09234fa3f9056cdb8', 'request_id': 'req-f980f56c-7c3e-4ca7-a8fb-40e388141794'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:18.653656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f980f56c-7c3e-4ca7-a8fb-40e388141794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d21b03ab63642f09234fa3f9056cdb8', 'request_id': 'req-f980f56c-7c3e-4ca7-a8fb-40e388141794'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:18.678001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f980f56c-7c3e-4ca7-a8fb-40e388141794 admin admin] The token cache is being invalidate because project 0d21b03ab63642f09234fa3f9056cdb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:18.678293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f980f56c-7c3e-4ca7-a8fb-40e388141794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:18.680438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f980f56c-7c3e-4ca7-a8fb-40e388141794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:18.686842 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1955/3906] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:18 2022] DELETE /identity/v3/projects/0d21b03ab63642f09234fa3f9056cdb8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:18.690942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436d826-4b32-43ae-8c4b-791e8de2fc42 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:18.702568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436d826-4b32-43ae-8c4b-791e8de2fc42 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:18.853452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634b83f-8f36-490a-9cb0-e8f60e0ae64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:18.854098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634b83f-8f36-490a-9cb0-e8f60e0ae64b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:18.854371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634b83f-8f36-490a-9cb0-e8f60e0ae64b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:18.854651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634b83f-8f36-490a-9cb0-e8f60e0ae64b admin admin] PATH_INFO: `/v3/users/88a07ab272784deea09a67cebe62cf85` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:18.855833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634b83f-8f36-490a-9cb0-e8f60e0ae64b admin admin] RBAC: Authorizing `identity:delete_user(user_id=88a07ab272784deea09a67cebe62cf85)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:18.857892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634b83f-8f36-490a-9cb0-e8f60e0ae64b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:18.928545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3634b83f-8f36-490a-9cb0-e8f60e0ae64b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88a07ab272784deea09a67cebe62cf85'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:18.944453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3634b83f-8f36-490a-9cb0-e8f60e0ae64b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88a07ab272784deea09a67cebe62cf85'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:18.953156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3634b83f-8f36-490a-9cb0-e8f60e0ae64b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88a07ab272784deea09a67cebe62cf85'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:18.975968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3634b83f-8f36-490a-9cb0-e8f60e0ae64b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88a07ab272784deea09a67cebe62cf85'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:18.988102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3634b83f-8f36-490a-9cb0-e8f60e0ae64b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88a07ab272784deea09a67cebe62cf85'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:18.998901 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1952/3907] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:18 2022] DELETE /identity/v3/users/88a07ab272784deea09a67cebe62cf85 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:19.627741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980f56c-7c3e-4ca7-a8fb-40e388141794 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:19.630120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f980f56c-7c3e-4ca7-a8fb-40e388141794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:19.661795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980f56c-7c3e-4ca7-a8fb-40e388141794 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:19.731719 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:19.800871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722506c6-e333-478f-95d2-0b43c4104cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:19.801447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722506c6-e333-478f-95d2-0b43c4104cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:19.801768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722506c6-e333-478f-95d2-0b43c4104cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:19.802044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722506c6-e333-478f-95d2-0b43c4104cb5 admin admin] PATH_INFO: `/v3/projects/de264fc026304adcb5bb620851dd80e3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:19.805093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722506c6-e333-478f-95d2-0b43c4104cb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de264fc026304adcb5bb620851dd80e3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:19.807374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722506c6-e333-478f-95d2-0b43c4104cb5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:19.926792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-722506c6-e333-478f-95d2-0b43c4104cb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de264fc026304adcb5bb620851dd80e3', 'request_id': 'req-722506c6-e333-478f-95d2-0b43c4104cb5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:19.937724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-722506c6-e333-478f-95d2-0b43c4104cb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de264fc026304adcb5bb620851dd80e3', 'request_id': 'req-722506c6-e333-478f-95d2-0b43c4104cb5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:19.944625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-722506c6-e333-478f-95d2-0b43c4104cb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de264fc026304adcb5bb620851dd80e3', 'request_id': 'req-722506c6-e333-478f-95d2-0b43c4104cb5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:19.969009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-722506c6-e333-478f-95d2-0b43c4104cb5 admin admin] The token cache is being invalidate because project de264fc026304adcb5bb620851dd80e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:19.969575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-722506c6-e333-478f-95d2-0b43c4104cb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:19.972483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-722506c6-e333-478f-95d2-0b43c4104cb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:19.979262 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1956/3908] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:19 2022] DELETE /identity/v3/projects/de264fc026304adcb5bb620851dd80e3 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:19.984174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c4e9e-1e8e-4d81-85f9-07d3b60d73cc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:19.985037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c4e9e-1e8e-4d81-85f9-07d3b60d73cc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:19.985490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c4e9e-1e8e-4d81-85f9-07d3b60d73cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:20.009069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ae5c4e9e-1e8e-4d81-85f9-07d3b60d73cc None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:20.010290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ae5c4e9e-1e8e-4d81-85f9-07d3b60d73cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:20.041992 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:20.112773 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1953/3909] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:20.120052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbfe55-0390-495f-a7b9-843dd6a94198 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:20.120331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbfe55-0390-495f-a7b9-843dd6a94198 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:20.120631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbfe55-0390-495f-a7b9-843dd6a94198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:20.161219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8adbfe55-0390-495f-a7b9-843dd6a94198 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:20.162457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8adbfe55-0390-495f-a7b9-843dd6a94198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:20.187006 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1957/3910] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:20.188691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c4e9e-1e8e-4d81-85f9-07d3b60d73cc None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:20.200670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c4e9e-1e8e-4d81-85f9-07d3b60d73cc None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:20.208402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261431c-5db2-42aa-aa14-2fd4bd8edc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:20.209061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261431c-5db2-42aa-aa14-2fd4bd8edc0a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:20.209352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261431c-5db2-42aa-aa14-2fd4bd8edc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:20.209613 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261431c-5db2-42aa-aa14-2fd4bd8edc0a admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:20.210281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261431c-5db2-42aa-aa14-2fd4bd8edc0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:58:20.210583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261431c-5db2-42aa-aa14-2fd4bd8edc0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:20.212915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261431c-5db2-42aa-aa14-2fd4bd8edc0a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:20.230322 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1954/3911] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:20.231077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbfe55-0390-495f-a7b9-843dd6a94198 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:20.253444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbfe55-0390-495f-a7b9-843dd6a94198 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:20.259279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b657c9-c2f6-403d-a113-b5f97efe92a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:20.260092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b657c9-c2f6-403d-a113-b5f97efe92a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:20.260826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b657c9-c2f6-403d-a113-b5f97efe92a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:20.261255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b657c9-c2f6-403d-a113-b5f97efe92a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:20.262627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b657c9-c2f6-403d-a113-b5f97efe92a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:20.265113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b657c9-c2f6-403d-a113-b5f97efe92a9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:20.302987 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1958/3912] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:58:20 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:20.307327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261431c-5db2-42aa-aa14-2fd4bd8edc0a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:20.320290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261431c-5db2-42aa-aa14-2fd4bd8edc0a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:20.416465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b438a-8548-4188-ac95-38e1afc4183b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:20.417251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b438a-8548-4188-ac95-38e1afc4183b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:20.417630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b438a-8548-4188-ac95-38e1afc4183b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:20.418126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b438a-8548-4188-ac95-38e1afc4183b admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:20.418903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b438a-8548-4188-ac95-38e1afc4183b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:20.421149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b438a-8548-4188-ac95-38e1afc4183b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:20.453831 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1955/3913] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:58:20 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:20.455085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b657c9-c2f6-403d-a113-b5f97efe92a9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:20.469068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b657c9-c2f6-403d-a113-b5f97efe92a9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:20.475201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46373259-3dca-4ad9-8a7a-e77c7687786b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:20.475932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46373259-3dca-4ad9-8a7a-e77c7687786b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:20.476994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46373259-3dca-4ad9-8a7a-e77c7687786b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:20.477368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46373259-3dca-4ad9-8a7a-e77c7687786b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:20.478123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46373259-3dca-4ad9-8a7a-e77c7687786b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:20.480187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46373259-3dca-4ad9-8a7a-e77c7687786b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:20.495817 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1959/3914] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:58:20.497181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b438a-8548-4188-ac95-38e1afc4183b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:20.509999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b438a-8548-4188-ac95-38e1afc4183b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:20.515044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab987f-76f0-4c08-a09e-d6267ee39d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:20.515819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab987f-76f0-4c08-a09e-d6267ee39d6a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:20.516190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab987f-76f0-4c08-a09e-d6267ee39d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:20.516523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab987f-76f0-4c08-a09e-d6267ee39d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:20.517269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab987f-76f0-4c08-a09e-d6267ee39d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:20.519246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab987f-76f0-4c08-a09e-d6267ee39d6a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:20.535717 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1956/3915] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:20.537108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46373259-3dca-4ad9-8a7a-e77c7687786b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:20.548580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46373259-3dca-4ad9-8a7a-e77c7687786b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:20.553631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9d093-f365-4861-b743-255e8c27d0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:20.554445 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9d093-f365-4861-b743-255e8c27d0da admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:20.554954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9d093-f365-4861-b743-255e8c27d0da admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:20.555298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9d093-f365-4861-b743-255e8c27d0da admin admin] PATH_INFO: `/v3/projects/e005a945fd8748949209e18a8ae0091f/users/d4d24af3e12f460382e345cd89fdec55/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:20.574082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9d093-f365-4861-b743-255e8c27d0da admin admin] RBAC: Authorizing `identity:create_grant(project_id=e005a945fd8748949209e18a8ae0091f, user_id=d4d24af3e12f460382e345cd89fdec55, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:20.579332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9d093-f365-4861-b743-255e8c27d0da admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:20.605184 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1960/3916] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:20 2022] PUT /identity/v3/projects/e005a945fd8748949209e18a8ae0091f/users/d4d24af3e12f460382e345cd89fdec55/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:20.618199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8b28c-0765-4e90-9aca-dffa8e23bafd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:20.618486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8b28c-0765-4e90-9aca-dffa8e23bafd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:20.618755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8b28c-0765-4e90-9aca-dffa8e23bafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:20.656733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b7e8b28c-0765-4e90-9aca-dffa8e23bafd None None] MFA Rules not processed for user `d4d24af3e12f460382e345cd89fdec55`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:20.658027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b7e8b28c-0765-4e90-9aca-dffa8e23bafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:20.746676 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1957/3917] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:20.748124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9d093-f365-4861-b743-255e8c27d0da admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:20.857485 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:20.870432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9d093-f365-4861-b743-255e8c27d0da admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:20.876853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc39e7-ac95-46b2-8b33-2b41f962918d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:20.877459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc39e7-ac95-46b2-8b33-2b41f962918d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:20.877798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc39e7-ac95-46b2-8b33-2b41f962918d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:20.877987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc39e7-ac95-46b2-8b33-2b41f962918d admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:20.878621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc39e7-ac95-46b2-8b33-2b41f962918d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:20.880746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc39e7-ac95-46b2-8b33-2b41f962918d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:20.912151 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1961/3918] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:58:20 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:20.922009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8b28c-0765-4e90-9aca-dffa8e23bafd None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:20.940102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8b28c-0765-4e90-9aca-dffa8e23bafd None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:20.980769 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:21.049978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ea607-7412-48af-960e-45d4bab6e761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:21.050646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ea607-7412-48af-960e-45d4bab6e761 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:21.051274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ea607-7412-48af-960e-45d4bab6e761 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:21.051274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ea607-7412-48af-960e-45d4bab6e761 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:21.051884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ea607-7412-48af-960e-45d4bab6e761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:21.060230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ea607-7412-48af-960e-45d4bab6e761 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:21.110852 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1958/3919] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:58:20 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:21.112417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc39e7-ac95-46b2-8b33-2b41f962918d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:21.126617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc39e7-ac95-46b2-8b33-2b41f962918d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:21.133580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fe2c6-7f94-4188-bf9a-d81c9d7d5669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:21.134443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fe2c6-7f94-4188-bf9a-d81c9d7d5669 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:21.134798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fe2c6-7f94-4188-bf9a-d81c9d7d5669 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:21.135141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fe2c6-7f94-4188-bf9a-d81c9d7d5669 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:21.135864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3fe2c6-7f94-4188-bf9a-d81c9d7d5669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:21.137945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3fe2c6-7f94-4188-bf9a-d81c9d7d5669 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:21.156506 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1962/3920] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:21.157790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ea607-7412-48af-960e-45d4bab6e761 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:21.173351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ea607-7412-48af-960e-45d4bab6e761 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:21.186621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef431cb0-f7d2-49ce-ba32-af995efbbdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:21.187744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef431cb0-f7d2-49ce-ba32-af995efbbdbe admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:21.188034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef431cb0-f7d2-49ce-ba32-af995efbbdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:21.188317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef431cb0-f7d2-49ce-ba32-af995efbbdbe admin admin] PATH_INFO: `/v3/projects/80303d7b21ca4eceae1bc21f5624ab4f/users/044fc347e7064b9bb7214c6364867af6/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:21.211246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef431cb0-f7d2-49ce-ba32-af995efbbdbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=80303d7b21ca4eceae1bc21f5624ab4f, user_id=044fc347e7064b9bb7214c6364867af6, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:21.215146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef431cb0-f7d2-49ce-ba32-af995efbbdbe admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:21.239471 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1959/3921] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:21 2022] PUT /identity/v3/projects/80303d7b21ca4eceae1bc21f5624ab4f/users/044fc347e7064b9bb7214c6364867af6/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:58:21.241365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fe2c6-7f94-4188-bf9a-d81c9d7d5669 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:21.257452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fe2c6-7f94-4188-bf9a-d81c9d7d5669 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:21.334256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86236e10-5e5e-4603-af01-b4a238efc85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:21.335178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86236e10-5e5e-4603-af01-b4a238efc85d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:21.335616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86236e10-5e5e-4603-af01-b4a238efc85d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:21.336065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86236e10-5e5e-4603-af01-b4a238efc85d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:21.336868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86236e10-5e5e-4603-af01-b4a238efc85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:21.338508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86236e10-5e5e-4603-af01-b4a238efc85d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:21.352773 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1963/3922] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:21.354005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef431cb0-f7d2-49ce-ba32-af995efbbdbe admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:21.365934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef431cb0-f7d2-49ce-ba32-af995efbbdbe admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:21.371542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7ac12-0a00-4ec1-a4cf-9438f703a5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:21.372333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7ac12-0a00-4ec1-a4cf-9438f703a5c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:21.372767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7ac12-0a00-4ec1-a4cf-9438f703a5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:21.373152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7ac12-0a00-4ec1-a4cf-9438f703a5c2 admin admin] PATH_INFO: `/v3/projects/80303d7b21ca4eceae1bc21f5624ab4f/users/044fc347e7064b9bb7214c6364867af6/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:21.375199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7ac12-0a00-4ec1-a4cf-9438f703a5c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80303d7b21ca4eceae1bc21f5624ab4f, user_id=044fc347e7064b9bb7214c6364867af6, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:21.377967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7ac12-0a00-4ec1-a4cf-9438f703a5c2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:21.391155 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1960/3923] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:21 2022] PUT /identity/v3/projects/80303d7b21ca4eceae1bc21f5624ab4f/users/044fc347e7064b9bb7214c6364867af6/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:21.401810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8fd41-d105-40f1-ae17-7004e16233eb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:21.402103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8fd41-d105-40f1-ae17-7004e16233eb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:21.402376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8fd41-d105-40f1-ae17-7004e16233eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:21.434365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-22b8fd41-d105-40f1-ae17-7004e16233eb None None] MFA Rules not processed for user `044fc347e7064b9bb7214c6364867af6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:21.435922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-22b8fd41-d105-40f1-ae17-7004e16233eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:21.529236 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1964/3924] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:21.533435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7ac12-0a00-4ec1-a4cf-9438f703a5c2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:21.545351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7ac12-0a00-4ec1-a4cf-9438f703a5c2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:21.551429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d26a4-a9d3-4120-96c3-1d85584814c2 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044fc347e7064b9bb7214c6364867af6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80303d7b21ca4eceae1bc21f5624ab4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:21.552506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d26a4-a9d3-4120-96c3-1d85584814c2 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:21.552924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d26a4-a9d3-4120-96c3-1d85584814c2 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:21.554190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d26a4-a9d3-4120-96c3-1d85584814c2 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:21.555603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d26a4-a9d3-4120-96c3-1d85584814c2 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:21.557792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d26a4-a9d3-4120-96c3-1d85584814c2 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:21.597022 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1961/3925] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:58:21 2022] POST /identity/v3/projects => generated 334 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:21.598469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8fd41-d105-40f1-ae17-7004e16233eb None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:21.611756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8fd41-d105-40f1-ae17-7004e16233eb None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:21.671656 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:21.692222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07445b0-d7de-4869-89cf-d74b0d8be159 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044fc347e7064b9bb7214c6364867af6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80303d7b21ca4eceae1bc21f5624ab4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:21.692965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07445b0-d7de-4869-89cf-d74b0d8be159 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:21.693307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07445b0-d7de-4869-89cf-d74b0d8be159 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:21.693588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07445b0-d7de-4869-89cf-d74b0d8be159 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:21.694321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07445b0-d7de-4869-89cf-d74b0d8be159 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:21.696907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07445b0-d7de-4869-89cf-d74b0d8be159 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:21.752922 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1965/3926] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Sep 30 09:58:21 2022] POST /identity/v3/projects => generated 332 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:21.755407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d26a4-a9d3-4120-96c3-1d85584814c2 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:21.769298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d26a4-a9d3-4120-96c3-1d85584814c2 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:21.891377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e5244-3711-4064-a002-808bd50770f0 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044fc347e7064b9bb7214c6364867af6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80303d7b21ca4eceae1bc21f5624ab4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:21.892364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e5244-3711-4064-a002-808bd50770f0 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:21.892741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e5244-3711-4064-a002-808bd50770f0 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:21.892937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e5244-3711-4064-a002-808bd50770f0 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:21.893567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e5244-3711-4064-a002-808bd50770f0 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:21.895925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e5244-3711-4064-a002-808bd50770f0 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:21.897981 n-d-master-1 devstack@keystone.service[82080]: WARNING keystone.server.flask.common [None req-a95e5244-3711-4064-a002-808bd50770f0 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 30 09:58:21.945708 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1962/3927] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:58:21 2022] POST /identity/v3/projects => generated 358 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:21.949946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07445b0-d7de-4869-89cf-d74b0d8be159 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:21.963844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07445b0-d7de-4869-89cf-d74b0d8be159 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:22.037318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39f344-c44c-4d3c-a6b1-4f58f2fd9588 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044fc347e7064b9bb7214c6364867af6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80303d7b21ca4eceae1bc21f5624ab4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:22.038047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39f344-c44c-4d3c-a6b1-4f58f2fd9588 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:22.038407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39f344-c44c-4d3c-a6b1-4f58f2fd9588 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:22.041056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39f344-c44c-4d3c-a6b1-4f58f2fd9588 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:22.042091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39f344-c44c-4d3c-a6b1-4f58f2fd9588 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:22.044427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39f344-c44c-4d3c-a6b1-4f58f2fd9588 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:22.068739 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1966/3928] 10.222.0.16 () {58 vars in 1131 bytes} [Fri Sep 30 09:58:21 2022] GET /identity/v3/projects => generated 7937 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:22.075125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e5244-3711-4064-a002-808bd50770f0 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:22.091724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e5244-3711-4064-a002-808bd50770f0 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:22.096798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08149e5-8df9-46f0-87b3-3165a988d595 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044fc347e7064b9bb7214c6364867af6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80303d7b21ca4eceae1bc21f5624ab4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:22.097426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08149e5-8df9-46f0-87b3-3165a988d595 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:22.097705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08149e5-8df9-46f0-87b3-3165a988d595 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:22.097987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08149e5-8df9-46f0-87b3-3165a988d595 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:22.098661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08149e5-8df9-46f0-87b3-3165a988d595 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:58:22.098963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08149e5-8df9-46f0-87b3-3165a988d595 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:22.101076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08149e5-8df9-46f0-87b3-3165a988d595 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:22.125923 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1963/3929] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Sep 30 09:58:22 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:22.127569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39f344-c44c-4d3c-a6b1-4f58f2fd9588 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:22.140559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39f344-c44c-4d3c-a6b1-4f58f2fd9588 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:22.145556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b656db-7aec-4b9c-be3c-3c80dd3f46f6 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044fc347e7064b9bb7214c6364867af6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80303d7b21ca4eceae1bc21f5624ab4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:22.146269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b656db-7aec-4b9c-be3c-3c80dd3f46f6 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:22.146655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b656db-7aec-4b9c-be3c-3c80dd3f46f6 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:22.147027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b656db-7aec-4b9c-be3c-3c80dd3f46f6 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:22.147800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b656db-7aec-4b9c-be3c-3c80dd3f46f6 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: Adding query filter params (parent_id=c004e1dee4dd43a99dd3353f120c2518) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:58:22.148278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b656db-7aec-4b9c-be3c-3c80dd3f46f6 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:22.150208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b656db-7aec-4b9c-be3c-3c80dd3f46f6 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:22.173735 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1967/3930] 10.222.0.16 () {58 vars in 1216 bytes} [Fri Sep 30 09:58:22 2022] GET /identity/v3/projects?parent_id=c004e1dee4dd43a99dd3353f120c2518 => generated 498 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:22.178589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08149e5-8df9-46f0-87b3-3165a988d595 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:22.192640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08149e5-8df9-46f0-87b3-3165a988d595 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:22.200796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cda3ac-49ce-474b-8876-fb8355c8387b tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044fc347e7064b9bb7214c6364867af6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80303d7b21ca4eceae1bc21f5624ab4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:22.201562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cda3ac-49ce-474b-8876-fb8355c8387b tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:22.201974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cda3ac-49ce-474b-8876-fb8355c8387b tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:22.202345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cda3ac-49ce-474b-8876-fb8355c8387b tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] PATH_INFO: `/v3/projects/bf49c6b9fddb4164b8f43cea835aeeb6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:22.203611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cda3ac-49ce-474b-8876-fb8355c8387b tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bf49c6b9fddb4164b8f43cea835aeeb6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:22.205650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cda3ac-49ce-474b-8876-fb8355c8387b tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:22.222087 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:22.277810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-88cda3ac-49ce-474b-8876-fb8355c8387b tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf49c6b9fddb4164b8f43cea835aeeb6', 'request_id': 'req-88cda3ac-49ce-474b-8876-fb8355c8387b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:22.287868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-88cda3ac-49ce-474b-8876-fb8355c8387b tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf49c6b9fddb4164b8f43cea835aeeb6', 'request_id': 'req-88cda3ac-49ce-474b-8876-fb8355c8387b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:22.299930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-88cda3ac-49ce-474b-8876-fb8355c8387b tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf49c6b9fddb4164b8f43cea835aeeb6', 'request_id': 'req-88cda3ac-49ce-474b-8876-fb8355c8387b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:22.314903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-88cda3ac-49ce-474b-8876-fb8355c8387b tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] The token cache is being invalidate because project bf49c6b9fddb4164b8f43cea835aeeb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:22.314903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-88cda3ac-49ce-474b-8876-fb8355c8387b tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:22.314903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-88cda3ac-49ce-474b-8876-fb8355c8387b tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:22.316125 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1964/3931] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:22 2022] DELETE /identity/v3/projects/bf49c6b9fddb4164b8f43cea835aeeb6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:22.320706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b656db-7aec-4b9c-be3c-3c80dd3f46f6 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:22.327891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a2b656db-7aec-4b9c-be3c-3c80dd3f46f6 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:22.344512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b656db-7aec-4b9c-be3c-3c80dd3f46f6 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:22.417708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef12a3-b098-4f87-b83a-651c912d1b02 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044fc347e7064b9bb7214c6364867af6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80303d7b21ca4eceae1bc21f5624ab4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:22.418744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef12a3-b098-4f87-b83a-651c912d1b02 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:22.419224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef12a3-b098-4f87-b83a-651c912d1b02 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:22.419777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef12a3-b098-4f87-b83a-651c912d1b02 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] PATH_INFO: `/v3/projects/c004e1dee4dd43a99dd3353f120c2518` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:22.421460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef12a3-b098-4f87-b83a-651c912d1b02 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c004e1dee4dd43a99dd3353f120c2518)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:22.423612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef12a3-b098-4f87-b83a-651c912d1b02 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:22.505422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46ef12a3-b098-4f87-b83a-651c912d1b02 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c004e1dee4dd43a99dd3353f120c2518', 'request_id': 'req-46ef12a3-b098-4f87-b83a-651c912d1b02'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:22.515970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46ef12a3-b098-4f87-b83a-651c912d1b02 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c004e1dee4dd43a99dd3353f120c2518', 'request_id': 'req-46ef12a3-b098-4f87-b83a-651c912d1b02'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:22.517694 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:22.528092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46ef12a3-b098-4f87-b83a-651c912d1b02 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c004e1dee4dd43a99dd3353f120c2518', 'request_id': 'req-46ef12a3-b098-4f87-b83a-651c912d1b02'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:22.546012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46ef12a3-b098-4f87-b83a-651c912d1b02 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] The token cache is being invalidate because project c004e1dee4dd43a99dd3353f120c2518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:22.546379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46ef12a3-b098-4f87-b83a-651c912d1b02 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:22.547217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46ef12a3-b098-4f87-b83a-651c912d1b02 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:22.552060 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1968/3932] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:22 2022] DELETE /identity/v3/projects/c004e1dee4dd43a99dd3353f120c2518 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:22.557013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cda3ac-49ce-474b-8876-fb8355c8387b tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:22.567308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cda3ac-49ce-474b-8876-fb8355c8387b tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:22.654055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0c597-86a9-4068-a275-a318035d780c tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044fc347e7064b9bb7214c6364867af6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80303d7b21ca4eceae1bc21f5624ab4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:22.654868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0c597-86a9-4068-a275-a318035d780c tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:22.655317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0c597-86a9-4068-a275-a318035d780c tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:22.655681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0c597-86a9-4068-a275-a318035d780c tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] PATH_INFO: `/v3/projects/04404506060c47d6aa75992530b66257` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:22.656891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0c597-86a9-4068-a275-a318035d780c tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: Authorizing `identity:delete_project(project_id=04404506060c47d6aa75992530b66257)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:22.658975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0c597-86a9-4068-a275-a318035d780c tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:22.719557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ef0c597-86a9-4068-a275-a318035d780c tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04404506060c47d6aa75992530b66257', 'request_id': 'req-5ef0c597-86a9-4068-a275-a318035d780c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:22.731674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ef0c597-86a9-4068-a275-a318035d780c tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04404506060c47d6aa75992530b66257', 'request_id': 'req-5ef0c597-86a9-4068-a275-a318035d780c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:22.739702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ef0c597-86a9-4068-a275-a318035d780c tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04404506060c47d6aa75992530b66257', 'request_id': 'req-5ef0c597-86a9-4068-a275-a318035d780c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:22.758475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ef0c597-86a9-4068-a275-a318035d780c tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] The token cache is being invalidate because project 04404506060c47d6aa75992530b66257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:22.758865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ef0c597-86a9-4068-a275-a318035d780c tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:22.761374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ef0c597-86a9-4068-a275-a318035d780c tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:22.763165 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1965/3933] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:22 2022] DELETE /identity/v3/projects/04404506060c47d6aa75992530b66257 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:22.766977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef12a3-b098-4f87-b83a-651c912d1b02 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:22.768450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-46ef12a3-b098-4f87-b83a-651c912d1b02 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:22.856272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef12a3-b098-4f87-b83a-651c912d1b02 tempest-ListProjectsTestJSON-427668356 tempest-ListProjectsTestJSON-427668356-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:22.956235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a901dae-9d0b-4bcc-8346-2648b4c4a401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:22.958395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a901dae-9d0b-4bcc-8346-2648b4c4a401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:22.961277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a901dae-9d0b-4bcc-8346-2648b4c4a401 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:22.963168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a901dae-9d0b-4bcc-8346-2648b4c4a401 admin admin] PATH_INFO: `/v3/users/d4d24af3e12f460382e345cd89fdec55` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:22.967529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a901dae-9d0b-4bcc-8346-2648b4c4a401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4d24af3e12f460382e345cd89fdec55)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:22.969923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a901dae-9d0b-4bcc-8346-2648b4c4a401 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:23.047887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a901dae-9d0b-4bcc-8346-2648b4c4a401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4d24af3e12f460382e345cd89fdec55'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:23.048440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a901dae-9d0b-4bcc-8346-2648b4c4a401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4d24af3e12f460382e345cd89fdec55'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:23.073887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a901dae-9d0b-4bcc-8346-2648b4c4a401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4d24af3e12f460382e345cd89fdec55'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:23.095342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a901dae-9d0b-4bcc-8346-2648b4c4a401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4d24af3e12f460382e345cd89fdec55'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:23.106723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a901dae-9d0b-4bcc-8346-2648b4c4a401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4d24af3e12f460382e345cd89fdec55'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:23.113149 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1969/3934] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:22 2022] DELETE /identity/v3/users/d4d24af3e12f460382e345cd89fdec55 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:23.117917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e709a35-c2b7-42e0-859c-fa32dce724a9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:23.118434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e709a35-c2b7-42e0-859c-fa32dce724a9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:23.118434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e709a35-c2b7-42e0-859c-fa32dce724a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:23.138342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8e709a35-c2b7-42e0-859c-fa32dce724a9 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:23.139842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8e709a35-c2b7-42e0-859c-fa32dce724a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:23.174436 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:23.217438 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1966/3935] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:23.229056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a901dae-9d0b-4bcc-8346-2648b4c4a401 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:23.230616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0a901dae-9d0b-4bcc-8346-2648b4c4a401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:23.246518 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:23.303899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a901dae-9d0b-4bcc-8346-2648b4c4a401 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:23.307501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bad5a8-2046-4a2f-a899-0149cba07fe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:23.308104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bad5a8-2046-4a2f-a899-0149cba07fe7 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:23.308378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bad5a8-2046-4a2f-a899-0149cba07fe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:23.308699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bad5a8-2046-4a2f-a899-0149cba07fe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:23.320685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bad5a8-2046-4a2f-a899-0149cba07fe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:23.322339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bad5a8-2046-4a2f-a899-0149cba07fe7 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:23.334295 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1970/3936] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:58:23.636877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e709a35-c2b7-42e0-859c-fa32dce724a9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:23.638595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8e709a35-c2b7-42e0-859c-fa32dce724a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:23.661089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e709a35-c2b7-42e0-859c-fa32dce724a9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:23.667753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67cfbc-5ebc-428c-9678-5c1726f61492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:23.668139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67cfbc-5ebc-428c-9678-5c1726f61492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:23.668339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67cfbc-5ebc-428c-9678-5c1726f61492 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:23.668628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67cfbc-5ebc-428c-9678-5c1726f61492 admin admin] PATH_INFO: `/v3/projects/e005a945fd8748949209e18a8ae0091f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:23.670457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67cfbc-5ebc-428c-9678-5c1726f61492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e005a945fd8748949209e18a8ae0091f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:23.672672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67cfbc-5ebc-428c-9678-5c1726f61492 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:23.736173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4d67cfbc-5ebc-428c-9678-5c1726f61492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e005a945fd8748949209e18a8ae0091f', 'request_id': 'req-4d67cfbc-5ebc-428c-9678-5c1726f61492'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:23.746003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4d67cfbc-5ebc-428c-9678-5c1726f61492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e005a945fd8748949209e18a8ae0091f', 'request_id': 'req-4d67cfbc-5ebc-428c-9678-5c1726f61492'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:23.753879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4d67cfbc-5ebc-428c-9678-5c1726f61492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e005a945fd8748949209e18a8ae0091f', 'request_id': 'req-4d67cfbc-5ebc-428c-9678-5c1726f61492'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:23.771271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4d67cfbc-5ebc-428c-9678-5c1726f61492 admin admin] The token cache is being invalidate because project e005a945fd8748949209e18a8ae0091f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:23.771680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4d67cfbc-5ebc-428c-9678-5c1726f61492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:23.772343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4d67cfbc-5ebc-428c-9678-5c1726f61492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:23.775255 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1967/3937] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:23 2022] DELETE /identity/v3/projects/e005a945fd8748949209e18a8ae0091f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:23.779410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bad5a8-2046-4a2f-a899-0149cba07fe7 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:23.790868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bad5a8-2046-4a2f-a899-0149cba07fe7 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:23.871447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a6f31-b21e-480e-bd5c-d97d4f85efd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:23.872088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a6f31-b21e-480e-bd5c-d97d4f85efd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:23.872364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a6f31-b21e-480e-bd5c-d97d4f85efd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:23.872774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a6f31-b21e-480e-bd5c-d97d4f85efd9 admin admin] PATH_INFO: `/v3/users/044fc347e7064b9bb7214c6364867af6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:23.873973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a6f31-b21e-480e-bd5c-d97d4f85efd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=044fc347e7064b9bb7214c6364867af6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:23.875915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a6f31-b21e-480e-bd5c-d97d4f85efd9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:23.937233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fb4a6f31-b21e-480e-bd5c-d97d4f85efd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '044fc347e7064b9bb7214c6364867af6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:23.940380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fb4a6f31-b21e-480e-bd5c-d97d4f85efd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '044fc347e7064b9bb7214c6364867af6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:23.949331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fb4a6f31-b21e-480e-bd5c-d97d4f85efd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '044fc347e7064b9bb7214c6364867af6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:23.965629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fb4a6f31-b21e-480e-bd5c-d97d4f85efd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '044fc347e7064b9bb7214c6364867af6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:23.973767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fb4a6f31-b21e-480e-bd5c-d97d4f85efd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '044fc347e7064b9bb7214c6364867af6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:23.988108 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1971/3938] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:23 2022] DELETE /identity/v3/users/044fc347e7064b9bb7214c6364867af6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:58:24.326643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67cfbc-5ebc-428c-9678-5c1726f61492 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:24.328344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4d67cfbc-5ebc-428c-9678-5c1726f61492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:24.344511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67cfbc-5ebc-428c-9678-5c1726f61492 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:24.426331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625d2a3-dd8b-440b-ba8d-cecb02e5e8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:24.427286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625d2a3-dd8b-440b-ba8d-cecb02e5e8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:24.427574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625d2a3-dd8b-440b-ba8d-cecb02e5e8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:24.427846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625d2a3-dd8b-440b-ba8d-cecb02e5e8fc admin admin] PATH_INFO: `/v3/projects/80303d7b21ca4eceae1bc21f5624ab4f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:24.429334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625d2a3-dd8b-440b-ba8d-cecb02e5e8fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=80303d7b21ca4eceae1bc21f5624ab4f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:24.431635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625d2a3-dd8b-440b-ba8d-cecb02e5e8fc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:24.491485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f625d2a3-dd8b-440b-ba8d-cecb02e5e8fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80303d7b21ca4eceae1bc21f5624ab4f', 'request_id': 'req-f625d2a3-dd8b-440b-ba8d-cecb02e5e8fc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:24.502617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f625d2a3-dd8b-440b-ba8d-cecb02e5e8fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80303d7b21ca4eceae1bc21f5624ab4f', 'request_id': 'req-f625d2a3-dd8b-440b-ba8d-cecb02e5e8fc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:24.504576 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:24.513093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f625d2a3-dd8b-440b-ba8d-cecb02e5e8fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80303d7b21ca4eceae1bc21f5624ab4f', 'request_id': 'req-f625d2a3-dd8b-440b-ba8d-cecb02e5e8fc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:24.529528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f625d2a3-dd8b-440b-ba8d-cecb02e5e8fc admin admin] The token cache is being invalidate because project 80303d7b21ca4eceae1bc21f5624ab4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:24.529867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f625d2a3-dd8b-440b-ba8d-cecb02e5e8fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:24.530602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f625d2a3-dd8b-440b-ba8d-cecb02e5e8fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:24.533051 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1968/3939] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:24 2022] DELETE /identity/v3/projects/80303d7b21ca4eceae1bc21f5624ab4f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:24.539434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272105b-553b-42fb-b992-3745a3be0389 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:24.540339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272105b-553b-42fb-b992-3745a3be0389 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:24.541272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272105b-553b-42fb-b992-3745a3be0389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:24.565255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f272105b-553b-42fb-b992-3745a3be0389 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:24.567027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f272105b-553b-42fb-b992-3745a3be0389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:24.609977 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:24.655022 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1972/3940] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:24.663093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c92ad-2fd9-428a-86de-d124151a7e67 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:24.663553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c92ad-2fd9-428a-86de-d124151a7e67 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:24.664430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c92ad-2fd9-428a-86de-d124151a7e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:24.690828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-337c92ad-2fd9-428a-86de-d124151a7e67 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:24.692225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-337c92ad-2fd9-428a-86de-d124151a7e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:24.701569 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1969/3941] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:24.706010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272105b-553b-42fb-b992-3745a3be0389 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:24.718662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272105b-553b-42fb-b992-3745a3be0389 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:24.725288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e96125-4c5e-4a44-9e14-adf3c38c6398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:24.726041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e96125-4c5e-4a44-9e14-adf3c38c6398 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:24.727390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e96125-4c5e-4a44-9e14-adf3c38c6398 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:24.727867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e96125-4c5e-4a44-9e14-adf3c38c6398 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:24.728800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e96125-4c5e-4a44-9e14-adf3c38c6398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:58:24.729188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e96125-4c5e-4a44-9e14-adf3c38c6398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:24.731010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e96125-4c5e-4a44-9e14-adf3c38c6398 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:24.751144 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1973/3942] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:24.752380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c92ad-2fd9-428a-86de-d124151a7e67 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:24.765583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c92ad-2fd9-428a-86de-d124151a7e67 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:24.770802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee16a05-d480-4216-8ba1-5145bb925883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:24.771554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee16a05-d480-4216-8ba1-5145bb925883 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:24.771947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee16a05-d480-4216-8ba1-5145bb925883 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:24.772287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee16a05-d480-4216-8ba1-5145bb925883 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:24.773621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee16a05-d480-4216-8ba1-5145bb925883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:24.776046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee16a05-d480-4216-8ba1-5145bb925883 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:24.814113 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1970/3943] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:58:24 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:24.815340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e96125-4c5e-4a44-9e14-adf3c38c6398 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:24.828051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e96125-4c5e-4a44-9e14-adf3c38c6398 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:24.900528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f0b9b-cdf2-41cf-9448-5da9ff7a4be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:24.901372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f0b9b-cdf2-41cf-9448-5da9ff7a4be0 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:24.901658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f0b9b-cdf2-41cf-9448-5da9ff7a4be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:24.901937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f0b9b-cdf2-41cf-9448-5da9ff7a4be0 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:24.902591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f0b9b-cdf2-41cf-9448-5da9ff7a4be0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:24.905050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f0b9b-cdf2-41cf-9448-5da9ff7a4be0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:24.940037 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1974/3944] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:58:24 2022] POST /identity/v3/users => generated 284 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:58:24.943963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee16a05-d480-4216-8ba1-5145bb925883 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:24.955707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee16a05-d480-4216-8ba1-5145bb925883 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:24.963471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e3fd4-fc5b-47de-9966-7e449e9dab8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:24.964134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e3fd4-fc5b-47de-9966-7e449e9dab8f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:24.964413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e3fd4-fc5b-47de-9966-7e449e9dab8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:24.964753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e3fd4-fc5b-47de-9966-7e449e9dab8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:24.965572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e3fd4-fc5b-47de-9966-7e449e9dab8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:24.967355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e3fd4-fc5b-47de-9966-7e449e9dab8f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:24.985226 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1971/3945] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:24.987227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f0b9b-cdf2-41cf-9448-5da9ff7a4be0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:24.999843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f0b9b-cdf2-41cf-9448-5da9ff7a4be0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:25.006341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3ef01-6137-445a-9968-53dbb5e252e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:25.007867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3ef01-6137-445a-9968-53dbb5e252e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:25.008775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3ef01-6137-445a-9968-53dbb5e252e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:25.010307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3ef01-6137-445a-9968-53dbb5e252e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:25.010307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3ef01-6137-445a-9968-53dbb5e252e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:25.011984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3ef01-6137-445a-9968-53dbb5e252e5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:25.029221 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1975/3946] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:25.031061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e3fd4-fc5b-47de-9966-7e449e9dab8f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:25.042587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e3fd4-fc5b-47de-9966-7e449e9dab8f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:25.048234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2080e7-40fb-483d-8821-80f55eb267da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:25.049368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2080e7-40fb-483d-8821-80f55eb267da admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:25.049720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2080e7-40fb-483d-8821-80f55eb267da admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:25.050060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2080e7-40fb-483d-8821-80f55eb267da admin admin] PATH_INFO: `/v3/projects/9b86c1b561034e719263a8e916935d1b/users/ecc776908f8548aebc421df8c83bd401/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:25.070421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2080e7-40fb-483d-8821-80f55eb267da admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b86c1b561034e719263a8e916935d1b, user_id=ecc776908f8548aebc421df8c83bd401, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:25.074211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2080e7-40fb-483d-8821-80f55eb267da admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:25.090478 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1972/3947] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:25 2022] PUT /identity/v3/projects/9b86c1b561034e719263a8e916935d1b/users/ecc776908f8548aebc421df8c83bd401/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:25.104008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3678e68-1e8f-4646-9a52-43622a4bbbed None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:25.104008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3678e68-1e8f-4646-9a52-43622a4bbbed None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:25.104008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3678e68-1e8f-4646-9a52-43622a4bbbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:25.139167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e3678e68-1e8f-4646-9a52-43622a4bbbed None None] MFA Rules not processed for user `ecc776908f8548aebc421df8c83bd401`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:25.141233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e3678e68-1e8f-4646-9a52-43622a4bbbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:25.252818 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1976/3948] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:25.257188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2080e7-40fb-483d-8821-80f55eb267da admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:25.342697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2080e7-40fb-483d-8821-80f55eb267da admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:25.347724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a053b4-52d9-4075-a22d-d1312076ab35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:25.348719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a053b4-52d9-4075-a22d-d1312076ab35 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:25.348864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a053b4-52d9-4075-a22d-d1312076ab35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:25.349180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a053b4-52d9-4075-a22d-d1312076ab35 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:25.349978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a053b4-52d9-4075-a22d-d1312076ab35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:25.352839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a053b4-52d9-4075-a22d-d1312076ab35 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:25.389648 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1973/3949] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:58:25 2022] POST /identity/v3/projects => generated 367 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:58:25.390733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3678e68-1e8f-4646-9a52-43622a4bbbed None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:25.407384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3678e68-1e8f-4646-9a52-43622a4bbbed None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:25.438061 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:25.483841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971cb29-09ea-413b-935c-fe6a5a6b1c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:25.484836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971cb29-09ea-413b-935c-fe6a5a6b1c8d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:25.485175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971cb29-09ea-413b-935c-fe6a5a6b1c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:25.485511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971cb29-09ea-413b-935c-fe6a5a6b1c8d admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:25.486230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2971cb29-09ea-413b-935c-fe6a5a6b1c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:25.488646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2971cb29-09ea-413b-935c-fe6a5a6b1c8d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:25.520680 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1977/3950] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:58:25 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:25.524639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a053b4-52d9-4075-a22d-d1312076ab35 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:25.535785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a053b4-52d9-4075-a22d-d1312076ab35 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:25.542202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c396aa2-93b0-4866-a7eb-4ef36f491aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:25.542665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c396aa2-93b0-4866-a7eb-4ef36f491aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:25.542942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c396aa2-93b0-4866-a7eb-4ef36f491aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:25.543213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c396aa2-93b0-4866-a7eb-4ef36f491aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:25.544278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c396aa2-93b0-4866-a7eb-4ef36f491aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:25.545873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c396aa2-93b0-4866-a7eb-4ef36f491aa3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:25.562212 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1974/3951] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:25.566538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971cb29-09ea-413b-935c-fe6a5a6b1c8d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:25.581924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971cb29-09ea-413b-935c-fe6a5a6b1c8d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:25.589036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd37870-2644-4be1-81ce-a4b9600ea80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:25.589768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd37870-2644-4be1-81ce-a4b9600ea80a admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:25.590086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd37870-2644-4be1-81ce-a4b9600ea80a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:25.590361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd37870-2644-4be1-81ce-a4b9600ea80a admin admin] PATH_INFO: `/v3/projects/9ff624cd5ffd49f382a0964490870abf/users/556408a80c7748ee9886144ce48ace39/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:25.609850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd37870-2644-4be1-81ce-a4b9600ea80a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ff624cd5ffd49f382a0964490870abf, user_id=556408a80c7748ee9886144ce48ace39, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:25.612743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd37870-2644-4be1-81ce-a4b9600ea80a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:25.629475 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1978/3952] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:25 2022] PUT /identity/v3/projects/9ff624cd5ffd49f382a0964490870abf/users/556408a80c7748ee9886144ce48ace39/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:25.634049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c396aa2-93b0-4866-a7eb-4ef36f491aa3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:25.647369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c396aa2-93b0-4866-a7eb-4ef36f491aa3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:25.710079 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:25.719751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8981a81-94db-4bd6-9d23-d76091b73df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:25.720756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8981a81-94db-4bd6-9d23-d76091b73df1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:25.721196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8981a81-94db-4bd6-9d23-d76091b73df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:25.721615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8981a81-94db-4bd6-9d23-d76091b73df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:25.722595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8981a81-94db-4bd6-9d23-d76091b73df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:25.724271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8981a81-94db-4bd6-9d23-d76091b73df1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:25.736673 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1975/3953] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:25.740892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd37870-2644-4be1-81ce-a4b9600ea80a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:25.754863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd37870-2644-4be1-81ce-a4b9600ea80a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:25.760544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f9415-e800-4a94-87cb-0087c6917bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:25.761392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f9415-e800-4a94-87cb-0087c6917bb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:25.761690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f9415-e800-4a94-87cb-0087c6917bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:25.761936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f9415-e800-4a94-87cb-0087c6917bb8 admin admin] PATH_INFO: `/v3/projects/9ff624cd5ffd49f382a0964490870abf/users/556408a80c7748ee9886144ce48ace39/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:25.763939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f9415-e800-4a94-87cb-0087c6917bb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ff624cd5ffd49f382a0964490870abf, user_id=556408a80c7748ee9886144ce48ace39, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:25.766845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f9415-e800-4a94-87cb-0087c6917bb8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:25.782339 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1979/3954] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:25 2022] PUT /identity/v3/projects/9ff624cd5ffd49f382a0964490870abf/users/556408a80c7748ee9886144ce48ace39/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:25.794028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a8a0c-fac9-4c52-9dac-cd1702243ddd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:25.794695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a8a0c-fac9-4c52-9dac-cd1702243ddd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:25.794975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a8a0c-fac9-4c52-9dac-cd1702243ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:25.879343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-140a8a0c-fac9-4c52-9dac-cd1702243ddd None None] MFA Rules not processed for user `556408a80c7748ee9886144ce48ace39`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:25.880904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-140a8a0c-fac9-4c52-9dac-cd1702243ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:25.970340 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1976/3955] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:25.974902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f9415-e800-4a94-87cb-0087c6917bb8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:25.991635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f9415-e800-4a94-87cb-0087c6917bb8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:25.997216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34bfe3-6935-45f4-aab8-8fe34b56b667 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:25.998143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34bfe3-6935-45f4-aab8-8fe34b56b667 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:25.998513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34bfe3-6935-45f4-aab8-8fe34b56b667 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:25.998829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34bfe3-6935-45f4-aab8-8fe34b56b667 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:25.999643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34bfe3-6935-45f4-aab8-8fe34b56b667 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:26.001757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34bfe3-6935-45f4-aab8-8fe34b56b667 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:26.035337 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1980/3956] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Sep 30 09:58:25 2022] POST /identity/v3/projects => generated 328 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:26.036412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a8a0c-fac9-4c52-9dac-cd1702243ddd None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:26.046337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a8a0c-fac9-4c52-9dac-cd1702243ddd None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:26.110539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeae050-7c10-40a5-b8c3-3eab220ab837 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:26.111306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeae050-7c10-40a5-b8c3-3eab220ab837 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:26.111684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeae050-7c10-40a5-b8c3-3eab220ab837 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:26.112032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeae050-7c10-40a5-b8c3-3eab220ab837 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:26.112833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeae050-7c10-40a5-b8c3-3eab220ab837 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:26.115944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeae050-7c10-40a5-b8c3-3eab220ab837 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:26.143183 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1977/3957] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:58:26 2022] POST /identity/v3/users => generated 413 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:58:26.147399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34bfe3-6935-45f4-aab8-8fe34b56b667 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:26.158722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34bfe3-6935-45f4-aab8-8fe34b56b667 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:26.163724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21a596-ef13-4e68-bae2-d13d0593e390 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:26.164440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21a596-ef13-4e68-bae2-d13d0593e390 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:26.164850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21a596-ef13-4e68-bae2-d13d0593e390 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:26.165191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21a596-ef13-4e68-bae2-d13d0593e390 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:26.166012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21a596-ef13-4e68-bae2-d13d0593e390 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:26.167084 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-3d21a596-ef13-4e68-bae2-d13d0593e390 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:58:26.167084 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 09:58:26.167084 n-d-master-1 devstack@keystone.service[82079]: Sep 30 09:58:26.168145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21a596-ef13-4e68-bae2-d13d0593e390 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:26.188713 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1981/3958] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 09:58:26 2022] POST /identity/v3/roles => generated 244 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:26.190000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeae050-7c10-40a5-b8c3-3eab220ab837 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:26.202113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeae050-7c10-40a5-b8c3-3eab220ab837 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:26.206967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aeaa6e-88e1-4da1-859d-392df570c152 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:26.207598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeaa6e-88e1-4da1-859d-392df570c152 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:26.207877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeaa6e-88e1-4da1-859d-392df570c152 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:26.208119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeaa6e-88e1-4da1-859d-392df570c152 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:26.208805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aeaa6e-88e1-4da1-859d-392df570c152 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:26.209796 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-85aeaa6e-88e1-4da1-859d-392df570c152 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:58:26.209796 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 09:58:26.209796 n-d-master-1 devstack@keystone.service[82080]: Sep 30 09:58:26.210722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aeaa6e-88e1-4da1-859d-392df570c152 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:26.228754 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1978/3959] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 09:58:26 2022] POST /identity/v3/roles => generated 247 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:58:26.232982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21a596-ef13-4e68-bae2-d13d0593e390 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:26.246690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21a596-ef13-4e68-bae2-d13d0593e390 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:26.252260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b6615-3403-43f9-8e40-5e9db70fe640 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:26.253188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b6615-3403-43f9-8e40-5e9db70fe640 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:26.253473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b6615-3403-43f9-8e40-5e9db70fe640 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:26.253837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b6615-3403-43f9-8e40-5e9db70fe640 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects/b3b4c56345284b1b9eb72e1d48c702bc/users/8e0079a35c374c439e34d0ddc179cb84/roles/50b947c367ee4aec870f61bb49d9e4b5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:26.285609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b6615-3403-43f9-8e40-5e9db70fe640 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b3b4c56345284b1b9eb72e1d48c702bc, user_id=8e0079a35c374c439e34d0ddc179cb84, role_id=50b947c367ee4aec870f61bb49d9e4b5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:26.289443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b6615-3403-43f9-8e40-5e9db70fe640 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:26.306237 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1982/3960] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:26 2022] PUT /identity/v3/projects/b3b4c56345284b1b9eb72e1d48c702bc/users/8e0079a35c374c439e34d0ddc179cb84/roles/50b947c367ee4aec870f61bb49d9e4b5 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:26.310659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aeaa6e-88e1-4da1-859d-392df570c152 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:26.323514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aeaa6e-88e1-4da1-859d-392df570c152 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:26.387640 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:26.400984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc8c79-2ce8-42e7-a6c5-5a39f5a5867b tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:26.401792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc8c79-2ce8-42e7-a6c5-5a39f5a5867b tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:26.402192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc8c79-2ce8-42e7-a6c5-5a39f5a5867b tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:26.402568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc8c79-2ce8-42e7-a6c5-5a39f5a5867b tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects/b3b4c56345284b1b9eb72e1d48c702bc/users/8e0079a35c374c439e34d0ddc179cb84/roles/9302c847b8ce4cbd86bd6184b5d9021d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:26.404968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc8c79-2ce8-42e7-a6c5-5a39f5a5867b tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b3b4c56345284b1b9eb72e1d48c702bc, user_id=8e0079a35c374c439e34d0ddc179cb84, role_id=9302c847b8ce4cbd86bd6184b5d9021d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:26.408003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc8c79-2ce8-42e7-a6c5-5a39f5a5867b tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:26.429343 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1979/3961] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:26 2022] PUT /identity/v3/projects/b3b4c56345284b1b9eb72e1d48c702bc/users/8e0079a35c374c439e34d0ddc179cb84/roles/9302c847b8ce4cbd86bd6184b5d9021d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:26.431024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b6615-3403-43f9-8e40-5e9db70fe640 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:26.448117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b6615-3403-43f9-8e40-5e9db70fe640 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:26.524622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78851695-353b-45f7-a091-6d2273b4be7c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:26.525557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78851695-353b-45f7-a091-6d2273b4be7c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:26.526066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78851695-353b-45f7-a091-6d2273b4be7c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:26.526337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78851695-353b-45f7-a091-6d2273b4be7c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:26.526993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78851695-353b-45f7-a091-6d2273b4be7c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:26.528056 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-78851695-353b-45f7-a091-6d2273b4be7c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:58:26.528056 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 09:58:26.528056 n-d-master-1 devstack@keystone.service[82079]: Sep 30 09:58:26.529495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78851695-353b-45f7-a091-6d2273b4be7c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:26.575620 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1983/3962] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:26 2022] GET /identity/v3/users => generated 8904 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:58:26.581424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57c6e6-bdd1-480a-b61c-bda65d252491 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:26.582005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57c6e6-bdd1-480a-b61c-bda65d252491 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:26.582306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57c6e6-bdd1-480a-b61c-bda65d252491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:26.625257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ef57c6e6-bdd1-480a-b61c-bda65d252491 None None] MFA Rules not processed for user `8e0079a35c374c439e34d0ddc179cb84`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:26.626537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ef57c6e6-bdd1-480a-b61c-bda65d252491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:26.702506 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1980/3963] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:26 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:58:26.713727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c6a43-c6e6-4485-9a9d-e75ec67cf2a2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:26.714088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c6a43-c6e6-4485-9a9d-e75ec67cf2a2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:26.714422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c6a43-c6e6-4485-9a9d-e75ec67cf2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:26.737518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-608c6a43-c6e6-4485-9a9d-e75ec67cf2a2 None None] MFA Rules not processed for user `8e0079a35c374c439e34d0ddc179cb84`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:26.738851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-608c6a43-c6e6-4485-9a9d-e75ec67cf2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:26.751282 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1984/3964] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:26 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:26.753358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57c6e6-bdd1-480a-b61c-bda65d252491 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:26.765228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57c6e6-bdd1-480a-b61c-bda65d252491 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:26.769536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e1b7e-92e7-412d-94f0-53a605458891 tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e0079a35c374c439e34d0ddc179cb84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3b4c56345284b1b9eb72e1d48c702bc', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1486251239', 'tempest-NotDelegatedRole-1895520951'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:26.770159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e1b7e-92e7-412d-94f0-53a605458891 tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:26.770440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e1b7e-92e7-412d-94f0-53a605458891 tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:26.770712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e1b7e-92e7-412d-94f0-53a605458891 tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:26.771398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e1b7e-92e7-412d-94f0-53a605458891 tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] RBAC: Authorizing `identity:create_trust()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:26.772533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e1b7e-92e7-412d-94f0-53a605458891 tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:26.869624 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1981/3965] 10.222.0.16 () {60 vars in 1174 bytes} [Fri Sep 30 09:58:26 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:26.873854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c6a43-c6e6-4485-9a9d-e75ec67cf2a2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:26.887108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c6a43-c6e6-4485-9a9d-e75ec67cf2a2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:26.892812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642b144-0441-4a11-8dcc-2392413455c3 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:26.894407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642b144-0441-4a11-8dcc-2392413455c3 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:26.894691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642b144-0441-4a11-8dcc-2392413455c3 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:26.894965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642b144-0441-4a11-8dcc-2392413455c3 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:26.895600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642b144-0441-4a11-8dcc-2392413455c3 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:26.896633 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-8642b144-0441-4a11-8dcc-2392413455c3 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:58:26.896633 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 09:58:26.896633 n-d-master-1 devstack@keystone.service[82079]: Sep 30 09:58:26.897509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642b144-0441-4a11-8dcc-2392413455c3 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:26.908295 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1985/3966] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Sep 30 09:58:26 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:26.909438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e1b7e-92e7-412d-94f0-53a605458891 tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:26.923896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e1b7e-92e7-412d-94f0-53a605458891 tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:26.936260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7212f-9744-41ac-b5ef-53c392cc00cb tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e0079a35c374c439e34d0ddc179cb84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3b4c56345284b1b9eb72e1d48c702bc', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1486251239', 'tempest-NotDelegatedRole-1895520951'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:26.937058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7212f-9744-41ac-b5ef-53c392cc00cb tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:26.937430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7212f-9744-41ac-b5ef-53c392cc00cb tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:26.938095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7212f-9744-41ac-b5ef-53c392cc00cb tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] PATH_INFO: `/v3/OS-TRUST/trusts/7b533e74df0342ab8542e4c9b3abae79` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:26.951264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7212f-9744-41ac-b5ef-53c392cc00cb tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] RBAC: Authorizing `identity:delete_trust(trust_id=7b533e74df0342ab8542e4c9b3abae79)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:26.953806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7212f-9744-41ac-b5ef-53c392cc00cb tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:26.980970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f1a7212f-9744-41ac-b5ef-53c392cc00cb tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7b533e74df0342ab8542e4c9b3abae79', 'request_id': 'req-f1a7212f-9744-41ac-b5ef-53c392cc00cb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:26.981921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f1a7212f-9744-41ac-b5ef-53c392cc00cb tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '7b533e74df0342ab8542e4c9b3abae79', 'request_id': 'req-f1a7212f-9744-41ac-b5ef-53c392cc00cb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:26.995923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f1a7212f-9744-41ac-b5ef-53c392cc00cb tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7b533e74df0342ab8542e4c9b3abae79', 'request_id': 'req-f1a7212f-9744-41ac-b5ef-53c392cc00cb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:27.003278 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1982/3967] 10.222.0.16 () {58 vars in 1254 bytes} [Fri Sep 30 09:58:26 2022] DELETE /identity/v3/OS-TRUST/trusts/7b533e74df0342ab8542e4c9b3abae79 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:58:27.007501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642b144-0441-4a11-8dcc-2392413455c3 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:27.009512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8642b144-0441-4a11-8dcc-2392413455c3 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:27.017831 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:27.026146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642b144-0441-4a11-8dcc-2392413455c3 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:27.031460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d2d72-26fb-48ce-b891-b00cad670059 tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e0079a35c374c439e34d0ddc179cb84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3b4c56345284b1b9eb72e1d48c702bc', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1486251239', 'tempest-NotDelegatedRole-1895520951'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:27.032214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d2d72-26fb-48ce-b891-b00cad670059 tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:27.032563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d2d72-26fb-48ce-b891-b00cad670059 tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:27.032933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d2d72-26fb-48ce-b891-b00cad670059 tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] PATH_INFO: `/v3/OS-TRUST/trusts/7b533e74df0342ab8542e4c9b3abae79` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:27.061991 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-846d2d72-26fb-48ce-b891-b00cad670059 tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] Could not find trust: 7b533e74df0342ab8542e4c9b3abae79.: keystone.exception.TrustNotFound: Could not find trust: 7b533e74df0342ab8542e4c9b3abae79. Sep 30 09:58:27.061991 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:27.061991 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:58:27.061991 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:58:27.061991 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:58:27.061991 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:58:27.061991 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:58:27.061991 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:58:27.061991 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:58:27.061991 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:58:27.061991 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:58:27.061991 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:58:27.061991 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 30 09:58:27.061991 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 30 09:58:27.061991 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 30 09:58:27.063409 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 30 09:58:27.063409 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 30 09:58:27.063409 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 30 09:58:27.063409 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 30 09:58:27.063409 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 30 09:58:27.063409 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:58:27.063409 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:58:27.063409 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 30 09:58:27.063409 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 30 09:58:27.063409 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 30 09:58:27.063409 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 30 09:58:27.063409 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 7b533e74df0342ab8542e4c9b3abae79. Sep 30 09:58:27.063409 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:27.064429 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1986/3968] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Sep 30 09:58:27 2022] GET /identity/v3/OS-TRUST/trusts/7b533e74df0342ab8542e4c9b3abae79 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 09:58:27.067919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7212f-9744-41ac-b5ef-53c392cc00cb tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:27.069525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f1a7212f-9744-41ac-b5ef-53c392cc00cb tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:27.086066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7212f-9744-41ac-b5ef-53c392cc00cb tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:27.090873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1294b-4b93-4283-b2b6-98b039bb0036 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:27.091630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1294b-4b93-4283-b2b6-98b039bb0036 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:27.091980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1294b-4b93-4283-b2b6-98b039bb0036 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:27.092321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1294b-4b93-4283-b2b6-98b039bb0036 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles/9302c847b8ce4cbd86bd6184b5d9021d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:27.093837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1294b-4b93-4283-b2b6-98b039bb0036 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9302c847b8ce4cbd86bd6184b5d9021d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:27.094930 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-90b1294b-4b93-4283-b2b6-98b039bb0036 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:58:27.094930 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 09:58:27.094930 n-d-master-1 devstack@keystone.service[82080]: Sep 30 09:58:27.095996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1294b-4b93-4283-b2b6-98b039bb0036 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:27.122438 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:27.162081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-90b1294b-4b93-4283-b2b6-98b039bb0036 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invalidating the token cache because role 9302c847b8ce4cbd86bd6184b5d9021d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:27.162355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-90b1294b-4b93-4283-b2b6-98b039bb0036 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:27.163034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-90b1294b-4b93-4283-b2b6-98b039bb0036 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:27.164944 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1983/3969] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:27 2022] DELETE /identity/v3/roles/9302c847b8ce4cbd86bd6184b5d9021d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:27.169541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d2d72-26fb-48ce-b891-b00cad670059 tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:27.173912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-846d2d72-26fb-48ce-b891-b00cad670059 tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:27.195841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d2d72-26fb-48ce-b891-b00cad670059 tempest-TrustsV3TestJSON-837529997 tempest-user-147644828] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:27.269418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fec559-9bb2-4bd8-806e-5f2fe01e6493 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:27.270742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fec559-9bb2-4bd8-806e-5f2fe01e6493 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:27.270742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fec559-9bb2-4bd8-806e-5f2fe01e6493 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:27.270742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fec559-9bb2-4bd8-806e-5f2fe01e6493 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles/50b947c367ee4aec870f61bb49d9e4b5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:27.272063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fec559-9bb2-4bd8-806e-5f2fe01e6493 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_role(role_id=50b947c367ee4aec870f61bb49d9e4b5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:27.272898 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-86fec559-9bb2-4bd8-806e-5f2fe01e6493 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:58:27.272898 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 09:58:27.272898 n-d-master-1 devstack@keystone.service[82079]: Sep 30 09:58:27.274422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fec559-9bb2-4bd8-806e-5f2fe01e6493 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:27.372975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-86fec559-9bb2-4bd8-806e-5f2fe01e6493 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invalidating the token cache because role 50b947c367ee4aec870f61bb49d9e4b5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:27.373379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-86fec559-9bb2-4bd8-806e-5f2fe01e6493 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:27.374285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-86fec559-9bb2-4bd8-806e-5f2fe01e6493 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:27.376215 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1987/3970] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:27 2022] DELETE /identity/v3/roles/50b947c367ee4aec870f61bb49d9e4b5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:27.381185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1294b-4b93-4283-b2b6-98b039bb0036 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:27.393010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1294b-4b93-4283-b2b6-98b039bb0036 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:27.482390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649b9b3-6789-4009-be36-072b8b7c9f6c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:27.483409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649b9b3-6789-4009-be36-072b8b7c9f6c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:27.483409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649b9b3-6789-4009-be36-072b8b7c9f6c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:27.483611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649b9b3-6789-4009-be36-072b8b7c9f6c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/users/8e0079a35c374c439e34d0ddc179cb84` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:27.486496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649b9b3-6789-4009-be36-072b8b7c9f6c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8e0079a35c374c439e34d0ddc179cb84)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:27.489037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649b9b3-6789-4009-be36-072b8b7c9f6c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:27.556746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0649b9b3-6789-4009-be36-072b8b7c9f6c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e0079a35c374c439e34d0ddc179cb84'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:27.580295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0649b9b3-6789-4009-be36-072b8b7c9f6c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e0079a35c374c439e34d0ddc179cb84'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:27.581436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0649b9b3-6789-4009-be36-072b8b7c9f6c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e0079a35c374c439e34d0ddc179cb84'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:27.602990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0649b9b3-6789-4009-be36-072b8b7c9f6c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e0079a35c374c439e34d0ddc179cb84'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:27.611638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0649b9b3-6789-4009-be36-072b8b7c9f6c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e0079a35c374c439e34d0ddc179cb84'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:27.620092 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1984/3971] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:27 2022] DELETE /identity/v3/users/8e0079a35c374c439e34d0ddc179cb84 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:27.624426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fec559-9bb2-4bd8-806e-5f2fe01e6493 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:27.625893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-86fec559-9bb2-4bd8-806e-5f2fe01e6493 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:27.639151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fec559-9bb2-4bd8-806e-5f2fe01e6493 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:27.734127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57819d7f-0d09-4463-8cf5-6d5fa6426df7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:27.734982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57819d7f-0d09-4463-8cf5-6d5fa6426df7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:27.735482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57819d7f-0d09-4463-8cf5-6d5fa6426df7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:27.736034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57819d7f-0d09-4463-8cf5-6d5fa6426df7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects/b3b4c56345284b1b9eb72e1d48c702bc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:27.737381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57819d7f-0d09-4463-8cf5-6d5fa6426df7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b3b4c56345284b1b9eb72e1d48c702bc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:27.739599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57819d7f-0d09-4463-8cf5-6d5fa6426df7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:27.813170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-57819d7f-0d09-4463-8cf5-6d5fa6426df7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b4c56345284b1b9eb72e1d48c702bc', 'request_id': 'req-57819d7f-0d09-4463-8cf5-6d5fa6426df7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:27.821759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-57819d7f-0d09-4463-8cf5-6d5fa6426df7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b4c56345284b1b9eb72e1d48c702bc', 'request_id': 'req-57819d7f-0d09-4463-8cf5-6d5fa6426df7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:27.824263 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:27.829948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-57819d7f-0d09-4463-8cf5-6d5fa6426df7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b4c56345284b1b9eb72e1d48c702bc', 'request_id': 'req-57819d7f-0d09-4463-8cf5-6d5fa6426df7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:27.843343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-57819d7f-0d09-4463-8cf5-6d5fa6426df7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] The token cache is being invalidate because project b3b4c56345284b1b9eb72e1d48c702bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:27.843628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-57819d7f-0d09-4463-8cf5-6d5fa6426df7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:27.844574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-57819d7f-0d09-4463-8cf5-6d5fa6426df7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:27.846180 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1988/3972] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:27 2022] DELETE /identity/v3/projects/b3b4c56345284b1b9eb72e1d48c702bc => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:27.851927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649b9b3-6789-4009-be36-072b8b7c9f6c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:27.853904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0649b9b3-6789-4009-be36-072b8b7c9f6c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:27.883476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649b9b3-6789-4009-be36-072b8b7c9f6c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:27.955308 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:27.963536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b6263-f95a-4fe7-b931-6637c71ae135 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:27.964193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b6263-f95a-4fe7-b931-6637c71ae135 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:27.964461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b6263-f95a-4fe7-b931-6637c71ae135 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:27.965086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b6263-f95a-4fe7-b931-6637c71ae135 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:27.966649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b6263-f95a-4fe7-b931-6637c71ae135 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:27.968648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b6263-f95a-4fe7-b931-6637c71ae135 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:28.006241 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1985/3973] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Sep 30 09:58:27 2022] POST /identity/v3/projects => generated 329 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:28.012100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57819d7f-0d09-4463-8cf5-6d5fa6426df7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:28.013645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-57819d7f-0d09-4463-8cf5-6d5fa6426df7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:28.030039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57819d7f-0d09-4463-8cf5-6d5fa6426df7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:28.095329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b6263-f95a-4fe7-b931-6637c71ae135 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:28.097187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-926b6263-f95a-4fe7-b931-6637c71ae135 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:28.098694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a1c9f-aec9-4598-bd5a-75e8fde6067a tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:28.099314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a1c9f-aec9-4598-bd5a-75e8fde6067a tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:28.099585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a1c9f-aec9-4598-bd5a-75e8fde6067a tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:28.099863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a1c9f-aec9-4598-bd5a-75e8fde6067a tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:28.100505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a1c9f-aec9-4598-bd5a-75e8fde6067a tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:28.103250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a1c9f-aec9-4598-bd5a-75e8fde6067a tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:28.129100 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1989/3974] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:58:28 2022] POST /identity/v3/users => generated 413 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:28.133295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a1c9f-aec9-4598-bd5a-75e8fde6067a tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:28.143362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a1c9f-aec9-4598-bd5a-75e8fde6067a tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:28.148184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2b505-86b7-494d-acdd-b4aeebbd0a73 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:28.148932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2b505-86b7-494d-acdd-b4aeebbd0a73 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:28.149214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2b505-86b7-494d-acdd-b4aeebbd0a73 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:28.149487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2b505-86b7-494d-acdd-b4aeebbd0a73 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:28.150145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2b505-86b7-494d-acdd-b4aeebbd0a73 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:28.152402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2b505-86b7-494d-acdd-b4aeebbd0a73 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:28.167869 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1990/3975] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 09:58:28 2022] POST /identity/v3/roles => generated 244 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:58:28.171861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2b505-86b7-494d-acdd-b4aeebbd0a73 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:28.184408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2b505-86b7-494d-acdd-b4aeebbd0a73 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:28.189738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911d9c9-68ef-42ef-9b46-bd91fd0cd32f tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:28.189937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b6263-f95a-4fe7-b931-6637c71ae135 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:28.190338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911d9c9-68ef-42ef-9b46-bd91fd0cd32f tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:28.190622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911d9c9-68ef-42ef-9b46-bd91fd0cd32f tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:28.190901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911d9c9-68ef-42ef-9b46-bd91fd0cd32f tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:28.191559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911d9c9-68ef-42ef-9b46-bd91fd0cd32f tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:28.193181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911d9c9-68ef-42ef-9b46-bd91fd0cd32f tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:28.195782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9d70a-4e5f-4a43-9dde-a518ef73517c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:28.196395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9d70a-4e5f-4a43-9dde-a518ef73517c service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:28.196872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9d70a-4e5f-4a43-9dde-a518ef73517c service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:28.197336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9d70a-4e5f-4a43-9dde-a518ef73517c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:28.200375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4ca9d70a-4e5f-4a43-9dde-a518ef73517c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:28.209703 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1991/3976] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 09:58:28 2022] POST /identity/v3/roles => generated 247 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:58:28.213639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911d9c9-68ef-42ef-9b46-bd91fd0cd32f tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:28.223386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911d9c9-68ef-42ef-9b46-bd91fd0cd32f tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:28.228873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3dcc6-e4cb-43a1-8a6d-10fbd6b3fb7a tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:28.229517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3dcc6-e4cb-43a1-8a6d-10fbd6b3fb7a tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:28.229816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3dcc6-e4cb-43a1-8a6d-10fbd6b3fb7a tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:28.230111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3dcc6-e4cb-43a1-8a6d-10fbd6b3fb7a tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects/995849120e2141109fb702c633aec617/users/02ce7a70b8c14d72b8210e99ec16afe8/roles/035bacf46b244b6bb77dcfa7635c381f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:28.251489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3dcc6-e4cb-43a1-8a6d-10fbd6b3fb7a tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_grant(project_id=995849120e2141109fb702c633aec617, user_id=02ce7a70b8c14d72b8210e99ec16afe8, role_id=035bacf46b244b6bb77dcfa7635c381f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:28.254204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3dcc6-e4cb-43a1-8a6d-10fbd6b3fb7a tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:28.268570 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1992/3977] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:28 2022] PUT /identity/v3/projects/995849120e2141109fb702c633aec617/users/02ce7a70b8c14d72b8210e99ec16afe8/roles/035bacf46b244b6bb77dcfa7635c381f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:58:28.273914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3dcc6-e4cb-43a1-8a6d-10fbd6b3fb7a tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:28.274572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca9d70a-4e5f-4a43-9dde-a518ef73517c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:28.276232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca9d70a-4e5f-4a43-9dde-a518ef73517c service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:28.297406 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1986/3978] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:58:28.348558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3dcc6-e4cb-43a1-8a6d-10fbd6b3fb7a tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:28.355138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965f304-9d80-473d-9182-18925aa13bc5 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:28.355807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965f304-9d80-473d-9182-18925aa13bc5 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:28.356084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965f304-9d80-473d-9182-18925aa13bc5 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:28.356357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965f304-9d80-473d-9182-18925aa13bc5 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects/995849120e2141109fb702c633aec617/users/02ce7a70b8c14d72b8210e99ec16afe8/roles/55e40a7c8ada46bb91576f986d5d8ab5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:28.358651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965f304-9d80-473d-9182-18925aa13bc5 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_grant(project_id=995849120e2141109fb702c633aec617, user_id=02ce7a70b8c14d72b8210e99ec16afe8, role_id=55e40a7c8ada46bb91576f986d5d8ab5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:28.361302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965f304-9d80-473d-9182-18925aa13bc5 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:28.378312 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1993/3979] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:28 2022] PUT /identity/v3/projects/995849120e2141109fb702c633aec617/users/02ce7a70b8c14d72b8210e99ec16afe8/roles/55e40a7c8ada46bb91576f986d5d8ab5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:28.379438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9d70a-4e5f-4a43-9dde-a518ef73517c service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:28.391446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9d70a-4e5f-4a43-9dde-a518ef73517c service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:28.466536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4319db2-fc32-4064-8652-620b2c6582b3 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:28.467262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4319db2-fc32-4064-8652-620b2c6582b3 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:28.467511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4319db2-fc32-4064-8652-620b2c6582b3 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:28.467784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4319db2-fc32-4064-8652-620b2c6582b3 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:28.468503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4319db2-fc32-4064-8652-620b2c6582b3 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:28.469627 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-e4319db2-fc32-4064-8652-620b2c6582b3 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 09:58:28.469627 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 09:58:28.469627 n-d-master-1 devstack@keystone.service[82080]: Sep 30 09:58:28.470843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4319db2-fc32-4064-8652-620b2c6582b3 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:28.481755 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:28.517872 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1987/3980] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:28 2022] GET /identity/v3/users => generated 8904 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:28.522746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913dfd9-7f6c-47ef-a597-645bdce200b1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:28.523627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913dfd9-7f6c-47ef-a597-645bdce200b1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:28.523961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913dfd9-7f6c-47ef-a597-645bdce200b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:28.560809 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=1,keystone:INSERT=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:28.565248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9913dfd9-7f6c-47ef-a597-645bdce200b1 None None] MFA Rules not processed for user `02ce7a70b8c14d72b8210e99ec16afe8`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:28.567957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9913dfd9-7f6c-47ef-a597-645bdce200b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:28.659446 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1994/3981] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:28 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:58:28.669832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fb24e-e66e-419e-859e-8748de39bb52 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:28.670182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fb24e-e66e-419e-859e-8748de39bb52 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:28.670330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fb24e-e66e-419e-859e-8748de39bb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:28.822553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65af70-4d79-431e-aafc-a8a91c4b5dbc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:28.822849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65af70-4d79-431e-aafc-a8a91c4b5dbc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:28.823256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65af70-4d79-431e-aafc-a8a91c4b5dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:28.849213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6e3fb24e-e66e-419e-859e-8748de39bb52 None None] MFA Rules not processed for user `02ce7a70b8c14d72b8210e99ec16afe8`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:28.850607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6e3fb24e-e66e-419e-859e-8748de39bb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:28.869593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1b65af70-4d79-431e-aafc-a8a91c4b5dbc None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:28.871032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1b65af70-4d79-431e-aafc-a8a91c4b5dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:28.874889 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1988/3982] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:28 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:28.876410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fb24e-e66e-419e-859e-8748de39bb52 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:28.886480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fb24e-e66e-419e-859e-8748de39bb52 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:28.897801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec73eeb-fbc7-4fe5-87fe-9cd7b659e5f8 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ce7a70b8c14d72b8210e99ec16afe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995849120e2141109fb702c633aec617', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2142312014', 'tempest-DelegatedRole-1123205989'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:28.899582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec73eeb-fbc7-4fe5-87fe-9cd7b659e5f8 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:28.900108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec73eeb-fbc7-4fe5-87fe-9cd7b659e5f8 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:28.900856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec73eeb-fbc7-4fe5-87fe-9cd7b659e5f8 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:28.902808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec73eeb-fbc7-4fe5-87fe-9cd7b659e5f8 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] RBAC: Authorizing `identity:create_trust()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:28.904058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec73eeb-fbc7-4fe5-87fe-9cd7b659e5f8 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:28.967890 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1995/3983] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:58:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:58:28.982312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65af70-4d79-431e-aafc-a8a91c4b5dbc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:28.984017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1b65af70-4d79-431e-aafc-a8a91c4b5dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:29.027459 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1989/3984] 10.222.0.16 () {60 vars in 1174 bytes} [Fri Sep 30 09:58:28 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:29.031722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec73eeb-fbc7-4fe5-87fe-9cd7b659e5f8 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:29.046716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec73eeb-fbc7-4fe5-87fe-9cd7b659e5f8 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:29.053462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b95801-bd11-48f1-ad96-745b122233ea tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ce7a70b8c14d72b8210e99ec16afe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995849120e2141109fb702c633aec617', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2142312014', 'tempest-DelegatedRole-1123205989'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:29.054086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b95801-bd11-48f1-ad96-745b122233ea tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:29.055062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b95801-bd11-48f1-ad96-745b122233ea tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:29.055336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b95801-bd11-48f1-ad96-745b122233ea tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:29.055999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b95801-bd11-48f1-ad96-745b122233ea tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:29.057731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b95801-bd11-48f1-ad96-745b122233ea tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:29.067493 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1990/3985] 10.222.0.16 () {58 vars in 1252 bytes} [Fri Sep 30 09:58:29 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=02ce7a70b8c14d72b8210e99ec16afe8 => generated 611 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:29.068992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b95801-bd11-48f1-ad96-745b122233ea tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:29.081131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b95801-bd11-48f1-ad96-745b122233ea tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:29.087510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e014d5-a17a-4f5a-bdd3-d1bc2229e313 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ce7a70b8c14d72b8210e99ec16afe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995849120e2141109fb702c633aec617', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2142312014', 'tempest-DelegatedRole-1123205989'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:29.088411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e014d5-a17a-4f5a-bdd3-d1bc2229e313 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:29.088893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e014d5-a17a-4f5a-bdd3-d1bc2229e313 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:29.089363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e014d5-a17a-4f5a-bdd3-d1bc2229e313 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] PATH_INFO: `/v3/OS-TRUST/trusts/64975d0aee254bdc9a1cd26bf4679426` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:29.098057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e014d5-a17a-4f5a-bdd3-d1bc2229e313 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] RBAC: Authorizing `identity:delete_trust(trust_id=64975d0aee254bdc9a1cd26bf4679426)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:29.099614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e014d5-a17a-4f5a-bdd3-d1bc2229e313 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:29.129864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d9e014d5-a17a-4f5a-bdd3-d1bc2229e313 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '64975d0aee254bdc9a1cd26bf4679426', 'request_id': 'req-d9e014d5-a17a-4f5a-bdd3-d1bc2229e313'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:29.131049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d9e014d5-a17a-4f5a-bdd3-d1bc2229e313 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '64975d0aee254bdc9a1cd26bf4679426', 'request_id': 'req-d9e014d5-a17a-4f5a-bdd3-d1bc2229e313'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:29.133657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65af70-4d79-431e-aafc-a8a91c4b5dbc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:29.143383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8a29a-dd0a-4055-8617-a1a55e1cfc8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:29.144959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8a29a-dd0a-4055-8617-a1a55e1cfc8f service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:29.145799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8a29a-dd0a-4055-8617-a1a55e1cfc8f service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:29.145799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8a29a-dd0a-4055-8617-a1a55e1cfc8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:29.146266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d9e014d5-a17a-4f5a-bdd3-d1bc2229e313 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '64975d0aee254bdc9a1cd26bf4679426', 'request_id': 'req-d9e014d5-a17a-4f5a-bdd3-d1bc2229e313'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:29.155471 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1991/3986] 10.222.0.16 () {58 vars in 1254 bytes} [Fri Sep 30 09:58:29 2022] DELETE /identity/v3/OS-TRUST/trusts/64975d0aee254bdc9a1cd26bf4679426 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:58:29.157985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8a29a-dd0a-4055-8617-a1a55e1cfc8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:29.159772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8a29a-dd0a-4055-8617-a1a55e1cfc8f service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:29.164685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e014d5-a17a-4f5a-bdd3-d1bc2229e313 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:29.166512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d9e014d5-a17a-4f5a-bdd3-d1bc2229e313 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:29.176985 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1996/3987] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:58:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 09:58:29.180199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e014d5-a17a-4f5a-bdd3-d1bc2229e313 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:29.184675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4cf42-c2b8-4974-82a0-95a4f52887d8 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ce7a70b8c14d72b8210e99ec16afe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995849120e2141109fb702c633aec617', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2142312014', 'tempest-DelegatedRole-1123205989'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:29.185304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4cf42-c2b8-4974-82a0-95a4f52887d8 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:29.185575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4cf42-c2b8-4974-82a0-95a4f52887d8 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:29.185840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4cf42-c2b8-4974-82a0-95a4f52887d8 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] PATH_INFO: `/v3/OS-TRUST/trusts/64975d0aee254bdc9a1cd26bf4679426` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:29.196716 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-5ae4cf42-c2b8-4974-82a0-95a4f52887d8 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] Could not find trust: 64975d0aee254bdc9a1cd26bf4679426.: keystone.exception.TrustNotFound: Could not find trust: 64975d0aee254bdc9a1cd26bf4679426. Sep 30 09:58:29.196716 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:29.196716 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:58:29.196716 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:58:29.196716 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:58:29.196716 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:58:29.196716 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:58:29.196716 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:58:29.196716 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:58:29.196716 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:58:29.196716 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:58:29.196716 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:58:29.196716 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 30 09:58:29.196716 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 30 09:58:29.196716 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 30 09:58:29.197862 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 30 09:58:29.197862 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 30 09:58:29.197862 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 30 09:58:29.197862 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 30 09:58:29.197862 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 30 09:58:29.197862 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:58:29.197862 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:58:29.197862 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 30 09:58:29.197862 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 30 09:58:29.197862 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 30 09:58:29.197862 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 30 09:58:29.197862 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 64975d0aee254bdc9a1cd26bf4679426. Sep 30 09:58:29.197862 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:58:29.197862 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1992/3988] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Sep 30 09:58:29 2022] GET /identity/v3/OS-TRUST/trusts/64975d0aee254bdc9a1cd26bf4679426 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 09:58:29.201903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8a29a-dd0a-4055-8617-a1a55e1cfc8f service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:29.217490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8a29a-dd0a-4055-8617-a1a55e1cfc8f service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:29.221639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bd598-5d68-48e6-9d6e-868671e9e7b1 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:29.222818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bd598-5d68-48e6-9d6e-868671e9e7b1 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:29.222818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bd598-5d68-48e6-9d6e-868671e9e7b1 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:29.222818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bd598-5d68-48e6-9d6e-868671e9e7b1 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles/55e40a7c8ada46bb91576f986d5d8ab5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:29.225274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bd598-5d68-48e6-9d6e-868671e9e7b1 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_role(role_id=55e40a7c8ada46bb91576f986d5d8ab5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:29.229264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bd598-5d68-48e6-9d6e-868671e9e7b1 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:29.269357 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:29.288281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f54bd598-5d68-48e6-9d6e-868671e9e7b1 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invalidating the token cache because role 55e40a7c8ada46bb91576f986d5d8ab5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:29.288629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f54bd598-5d68-48e6-9d6e-868671e9e7b1 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:29.289325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f54bd598-5d68-48e6-9d6e-868671e9e7b1 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:29.297039 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1997/3989] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:29 2022] DELETE /identity/v3/roles/55e40a7c8ada46bb91576f986d5d8ab5 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:29.298127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4cf42-c2b8-4974-82a0-95a4f52887d8 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:29.299900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5ae4cf42-c2b8-4974-82a0-95a4f52887d8 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:29.316891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4cf42-c2b8-4974-82a0-95a4f52887d8 tempest-TrustsV3TestJSON-1830367144 tempest-user-240498676] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:29.399067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b6631-f621-49ce-b92c-f6582c4eebb8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:29.399721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b6631-f621-49ce-b92c-f6582c4eebb8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:29.400067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b6631-f621-49ce-b92c-f6582c4eebb8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:29.400406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b6631-f621-49ce-b92c-f6582c4eebb8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles/035bacf46b244b6bb77dcfa7635c381f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:29.402646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b6631-f621-49ce-b92c-f6582c4eebb8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_role(role_id=035bacf46b244b6bb77dcfa7635c381f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:29.405126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b6631-f621-49ce-b92c-f6582c4eebb8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:29.455551 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:29.499934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-046b6631-f621-49ce-b92c-f6582c4eebb8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invalidating the token cache because role 035bacf46b244b6bb77dcfa7635c381f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:29.501112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-046b6631-f621-49ce-b92c-f6582c4eebb8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:29.502537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-046b6631-f621-49ce-b92c-f6582c4eebb8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:29.504969 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1993/3990] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:29 2022] DELETE /identity/v3/roles/035bacf46b244b6bb77dcfa7635c381f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:58:29.509594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bd598-5d68-48e6-9d6e-868671e9e7b1 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:29.522948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bd598-5d68-48e6-9d6e-868671e9e7b1 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:29.619037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4141e-3098-4e02-9ace-712ac10b6e57 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:29.620305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4141e-3098-4e02-9ace-712ac10b6e57 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:29.620610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4141e-3098-4e02-9ace-712ac10b6e57 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:29.620898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4141e-3098-4e02-9ace-712ac10b6e57 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/users/02ce7a70b8c14d72b8210e99ec16afe8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:29.622651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4141e-3098-4e02-9ace-712ac10b6e57 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_user(user_id=02ce7a70b8c14d72b8210e99ec16afe8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:29.625858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4141e-3098-4e02-9ace-712ac10b6e57 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:29.714983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1aa4141e-3098-4e02-9ace-712ac10b6e57 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02ce7a70b8c14d72b8210e99ec16afe8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:29.715731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1aa4141e-3098-4e02-9ace-712ac10b6e57 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02ce7a70b8c14d72b8210e99ec16afe8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:29.726091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1aa4141e-3098-4e02-9ace-712ac10b6e57 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02ce7a70b8c14d72b8210e99ec16afe8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:29.746917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1aa4141e-3098-4e02-9ace-712ac10b6e57 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02ce7a70b8c14d72b8210e99ec16afe8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:29.767214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1aa4141e-3098-4e02-9ace-712ac10b6e57 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02ce7a70b8c14d72b8210e99ec16afe8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:29.777480 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1998/3991] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:29 2022] DELETE /identity/v3/users/02ce7a70b8c14d72b8210e99ec16afe8 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:29.781411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b6631-f621-49ce-b92c-f6582c4eebb8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:29.785502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-046b6631-f621-49ce-b92c-f6582c4eebb8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:29.799524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b6631-f621-49ce-b92c-f6582c4eebb8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:29.882131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3ac78-d72c-4b33-abb0-921ad3d59344 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:29.883635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3ac78-d72c-4b33-abb0-921ad3d59344 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:29.884009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3ac78-d72c-4b33-abb0-921ad3d59344 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:29.884374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3ac78-d72c-4b33-abb0-921ad3d59344 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects/995849120e2141109fb702c633aec617` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:29.885643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3ac78-d72c-4b33-abb0-921ad3d59344 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_project(project_id=995849120e2141109fb702c633aec617)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:29.887637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3ac78-d72c-4b33-abb0-921ad3d59344 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:29.974820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f4c3ac78-d72c-4b33-abb0-921ad3d59344 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '995849120e2141109fb702c633aec617', 'request_id': 'req-f4c3ac78-d72c-4b33-abb0-921ad3d59344'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:29.984581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f4c3ac78-d72c-4b33-abb0-921ad3d59344 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '995849120e2141109fb702c633aec617', 'request_id': 'req-f4c3ac78-d72c-4b33-abb0-921ad3d59344'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:29.994847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f4c3ac78-d72c-4b33-abb0-921ad3d59344 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '995849120e2141109fb702c633aec617', 'request_id': 'req-f4c3ac78-d72c-4b33-abb0-921ad3d59344'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:30.009285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f4c3ac78-d72c-4b33-abb0-921ad3d59344 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] The token cache is being invalidate because project 995849120e2141109fb702c633aec617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:30.011192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f4c3ac78-d72c-4b33-abb0-921ad3d59344 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:30.012356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f4c3ac78-d72c-4b33-abb0-921ad3d59344 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:30.023322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4141e-3098-4e02-9ace-712ac10b6e57 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:30.025134 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1994/3992] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:29 2022] DELETE /identity/v3/projects/995849120e2141109fb702c633aec617 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:58:30.026090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1aa4141e-3098-4e02-9ace-712ac10b6e57 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:30.046441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4141e-3098-4e02-9ace-712ac10b6e57 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:30.137236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aaea28-f11c-48f3-a8db-bb0a30542bc4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:30.137943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aaea28-f11c-48f3-a8db-bb0a30542bc4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:30.138113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aaea28-f11c-48f3-a8db-bb0a30542bc4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:30.138388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aaea28-f11c-48f3-a8db-bb0a30542bc4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:30.139013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aaea28-f11c-48f3-a8db-bb0a30542bc4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:30.142909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aaea28-f11c-48f3-a8db-bb0a30542bc4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:30.168619 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:30.184154 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1999/3993] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Sep 30 09:58:30 2022] POST /identity/v3/projects => generated 328 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:30.185407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3ac78-d72c-4b33-abb0-921ad3d59344 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:30.186921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f4c3ac78-d72c-4b33-abb0-921ad3d59344 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:30.203140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3ac78-d72c-4b33-abb0-921ad3d59344 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:30.260569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cdfb2-47c0-475d-acda-74bfeab27de6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:30.263185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cdfb2-47c0-475d-acda-74bfeab27de6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:30.263185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cdfb2-47c0-475d-acda-74bfeab27de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:30.299660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2b8cdfb2-47c0-475d-acda-74bfeab27de6 None None] MFA Rules not processed for user `19dfdd10f1fc4f8882ccab3d85607ded`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:30.300916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2b8cdfb2-47c0-475d-acda-74bfeab27de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:30.307686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0a011-cc1d-416e-aa77-6fbeedc2afa8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:30.308574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0a011-cc1d-416e-aa77-6fbeedc2afa8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:30.308957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0a011-cc1d-416e-aa77-6fbeedc2afa8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:30.309297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0a011-cc1d-416e-aa77-6fbeedc2afa8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:30.310290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0a011-cc1d-416e-aa77-6fbeedc2afa8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:30.316340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0a011-cc1d-416e-aa77-6fbeedc2afa8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:30.359665 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1995/3994] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:58:30 2022] POST /identity/v3/users => generated 416 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:58:30.360735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0a011-cc1d-416e-aa77-6fbeedc2afa8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:30.373170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0a011-cc1d-416e-aa77-6fbeedc2afa8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:30.380753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685cb98-b516-4230-94a0-e4462c443a98 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:30.381633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685cb98-b516-4230-94a0-e4462c443a98 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:30.381994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685cb98-b516-4230-94a0-e4462c443a98 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:30.383048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685cb98-b516-4230-94a0-e4462c443a98 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:30.383896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685cb98-b516-4230-94a0-e4462c443a98 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:30.385592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685cb98-b516-4230-94a0-e4462c443a98 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:30.389506 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=8,keystone:UPDATE=1,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:30.414214 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2000/3995] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:58:30.414555 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1996/3996] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 09:58:30 2022] POST /identity/v3/roles => generated 244 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:30.418900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cdfb2-47c0-475d-acda-74bfeab27de6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:30.443331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cdfb2-47c0-475d-acda-74bfeab27de6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:30.453603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aac1b-88a4-4e35-86d8-e0be17ca912c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:30.455135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aac1b-88a4-4e35-86d8-e0be17ca912c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:30.456006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aac1b-88a4-4e35-86d8-e0be17ca912c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:30.457208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aac1b-88a4-4e35-86d8-e0be17ca912c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:30.458690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939aac1b-88a4-4e35-86d8-e0be17ca912c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:30.462926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939aac1b-88a4-4e35-86d8-e0be17ca912c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:30.495979 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2001/3997] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 09:58:30 2022] POST /identity/v3/roles => generated 247 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:30.502148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685cb98-b516-4230-94a0-e4462c443a98 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:30.514672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685cb98-b516-4230-94a0-e4462c443a98 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:30.519403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb8127-5464-45a4-bc99-7d8156aee43c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:30.520059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb8127-5464-45a4-bc99-7d8156aee43c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:30.520338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb8127-5464-45a4-bc99-7d8156aee43c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:30.520624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb8127-5464-45a4-bc99-7d8156aee43c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects/b550306afd584b12a79d5f3038480461/users/8191131254ef484c93f77d7f22f22729/roles/a52554712371497f8e4b71d575bdf37e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:30.540997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb8127-5464-45a4-bc99-7d8156aee43c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b550306afd584b12a79d5f3038480461, user_id=8191131254ef484c93f77d7f22f22729, role_id=a52554712371497f8e4b71d575bdf37e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:30.543830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb8127-5464-45a4-bc99-7d8156aee43c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:30.563516 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1997/3998] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:30 2022] PUT /identity/v3/projects/b550306afd584b12a79d5f3038480461/users/8191131254ef484c93f77d7f22f22729/roles/a52554712371497f8e4b71d575bdf37e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:30.564775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aac1b-88a4-4e35-86d8-e0be17ca912c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:30.577153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aac1b-88a4-4e35-86d8-e0be17ca912c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:30.655276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a54a9-ae03-45df-a048-e4aacf19d14a tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:30.657558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a54a9-ae03-45df-a048-e4aacf19d14a tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:30.657980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a54a9-ae03-45df-a048-e4aacf19d14a tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:30.658258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a54a9-ae03-45df-a048-e4aacf19d14a tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects/b550306afd584b12a79d5f3038480461/users/8191131254ef484c93f77d7f22f22729/roles/8f5c62e8db5a4261998e96a77537f62c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:30.661604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a54a9-ae03-45df-a048-e4aacf19d14a tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b550306afd584b12a79d5f3038480461, user_id=8191131254ef484c93f77d7f22f22729, role_id=8f5c62e8db5a4261998e96a77537f62c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:30.666704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a54a9-ae03-45df-a048-e4aacf19d14a tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:30.689243 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2002/3999] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:30 2022] PUT /identity/v3/projects/b550306afd584b12a79d5f3038480461/users/8191131254ef484c93f77d7f22f22729/roles/8f5c62e8db5a4261998e96a77537f62c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:30.691039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb8127-5464-45a4-bc99-7d8156aee43c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:30.704245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb8127-5464-45a4-bc99-7d8156aee43c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:30.779247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbf737-9d43-4d6e-8afd-df15320f24ca tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:30.779871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbf737-9d43-4d6e-8afd-df15320f24ca tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:30.780153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbf737-9d43-4d6e-8afd-df15320f24ca tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:30.780426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbf737-9d43-4d6e-8afd-df15320f24ca tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:30.781125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbf737-9d43-4d6e-8afd-df15320f24ca tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:30.782961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbf737-9d43-4d6e-8afd-df15320f24ca tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:30.818840 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1998/4000] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:30 2022] GET /identity/v3/users => generated 8907 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:30.824575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2ef0f-2acf-4df2-b961-fea5857ddc99 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:30.825021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2ef0f-2acf-4df2-b961-fea5857ddc99 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:30.825362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2ef0f-2acf-4df2-b961-fea5857ddc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:30.872908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-caf2ef0f-2acf-4df2-b961-fea5857ddc99 None None] MFA Rules not processed for user `8191131254ef484c93f77d7f22f22729`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:30.874923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-caf2ef0f-2acf-4df2-b961-fea5857ddc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:30.965786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c9599-21cd-4bd8-8cb8-b29c7f1c302d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:30.965991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c9599-21cd-4bd8-8cb8-b29c7f1c302d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:30.966250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c9599-21cd-4bd8-8cb8-b29c7f1c302d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:30.969568 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2003/4001] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:30 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:30.987878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2a5c9599-21cd-4bd8-8cb8-b29c7f1c302d None None] MFA Rules not processed for user `8191131254ef484c93f77d7f22f22729`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:30.989225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2a5c9599-21cd-4bd8-8cb8-b29c7f1c302d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:31.002537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2ef0f-2acf-4df2-b961-fea5857ddc99 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:31.013272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2ef0f-2acf-4df2-b961-fea5857ddc99 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:31.013925 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1999/4002] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:30 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:31.018036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea9ebb-70fb-410b-abfa-c6ae50bc4ca1 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8191131254ef484c93f77d7f22f22729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b550306afd584b12a79d5f3038480461', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1151157875', 'tempest-NotDelegatedRole-2116142621'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:31.018651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea9ebb-70fb-410b-abfa-c6ae50bc4ca1 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:31.018995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea9ebb-70fb-410b-abfa-c6ae50bc4ca1 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:31.019270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea9ebb-70fb-410b-abfa-c6ae50bc4ca1 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:31.019946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea9ebb-70fb-410b-abfa-c6ae50bc4ca1 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: Authorizing `identity:create_trust()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:31.021134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea9ebb-70fb-410b-abfa-c6ae50bc4ca1 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:31.027485 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:31.142369 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2004/4003] 10.222.0.16 () {60 vars in 1174 bytes} [Fri Sep 30 09:58:31 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:58:31.146705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c9599-21cd-4bd8-8cb8-b29c7f1c302d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:31.157923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c9599-21cd-4bd8-8cb8-b29c7f1c302d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:31.162566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785baf9-e605-41b7-84df-1286484c1564 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8191131254ef484c93f77d7f22f22729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b550306afd584b12a79d5f3038480461', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1151157875', 'tempest-NotDelegatedRole-2116142621'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:31.163282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785baf9-e605-41b7-84df-1286484c1564 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:31.164242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785baf9-e605-41b7-84df-1286484c1564 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:31.164505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785baf9-e605-41b7-84df-1286484c1564 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] PATH_INFO: `/v3/OS-TRUST/trusts/e591461c5c02483494fb4fbdceb844ff` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:31.172944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785baf9-e605-41b7-84df-1286484c1564 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: Authorizing `identity:get_trust(trust_id=e591461c5c02483494fb4fbdceb844ff)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:31.174619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785baf9-e605-41b7-84df-1286484c1564 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:31.192416 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2000/4004] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Sep 30 09:58:31 2022] GET /identity/v3/OS-TRUST/trusts/e591461c5c02483494fb4fbdceb844ff => generated 859 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:31.193926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea9ebb-70fb-410b-abfa-c6ae50bc4ca1 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:31.206243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea9ebb-70fb-410b-abfa-c6ae50bc4ca1 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:31.211988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476214e-656d-4922-b24c-4ef21a029d52 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8191131254ef484c93f77d7f22f22729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b550306afd584b12a79d5f3038480461', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1151157875', 'tempest-NotDelegatedRole-2116142621'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:31.212955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476214e-656d-4922-b24c-4ef21a029d52 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:31.213487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476214e-656d-4922-b24c-4ef21a029d52 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:31.213924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476214e-656d-4922-b24c-4ef21a029d52 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] PATH_INFO: `/v3/OS-TRUST/trusts/e591461c5c02483494fb4fbdceb844ff/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:31.232868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476214e-656d-4922-b24c-4ef21a029d52 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=e591461c5c02483494fb4fbdceb844ff)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:31.235692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476214e-656d-4922-b24c-4ef21a029d52 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:31.250366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785baf9-e605-41b7-84df-1286484c1564 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:31.255031 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2005/4005] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Sep 30 09:58:31 2022] GET /identity/v3/OS-TRUST/trusts/e591461c5c02483494fb4fbdceb844ff/roles => generated 371 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:31.261537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785baf9-e605-41b7-84df-1286484c1564 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:31.267149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae215c-fdaf-42f0-aa27-48b1d298363d tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8191131254ef484c93f77d7f22f22729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b550306afd584b12a79d5f3038480461', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1151157875', 'tempest-NotDelegatedRole-2116142621'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:31.267813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae215c-fdaf-42f0-aa27-48b1d298363d tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:31.268090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae215c-fdaf-42f0-aa27-48b1d298363d tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:31.268907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae215c-fdaf-42f0-aa27-48b1d298363d tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] PATH_INFO: `/v3/OS-TRUST/trusts/e591461c5c02483494fb4fbdceb844ff/roles/a52554712371497f8e4b71d575bdf37e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:31.279566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae215c-fdaf-42f0-aa27-48b1d298363d tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e591461c5c02483494fb4fbdceb844ff, role_id=a52554712371497f8e4b71d575bdf37e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:31.281281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae215c-fdaf-42f0-aa27-48b1d298363d tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:31.295422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476214e-656d-4922-b24c-4ef21a029d52 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:31.296295 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2001/4006] 10.222.0.16 () {58 vars in 1368 bytes} [Fri Sep 30 09:58:31 2022] GET /identity/v3/OS-TRUST/trusts/e591461c5c02483494fb4fbdceb844ff/roles/a52554712371497f8e4b71d575bdf37e => generated 244 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:31.316325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476214e-656d-4922-b24c-4ef21a029d52 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:31.321991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf502b-73c3-470f-88e6-7d312d49b107 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8191131254ef484c93f77d7f22f22729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b550306afd584b12a79d5f3038480461', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1151157875', 'tempest-NotDelegatedRole-2116142621'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:31.322660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf502b-73c3-470f-88e6-7d312d49b107 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:31.322943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf502b-73c3-470f-88e6-7d312d49b107 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:31.323219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf502b-73c3-470f-88e6-7d312d49b107 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] PATH_INFO: `/v3/OS-TRUST/trusts/e591461c5c02483494fb4fbdceb844ff/roles/a52554712371497f8e4b71d575bdf37e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:31.332289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf502b-73c3-470f-88e6-7d312d49b107 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e591461c5c02483494fb4fbdceb844ff, role_id=a52554712371497f8e4b71d575bdf37e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:31.341569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf502b-73c3-470f-88e6-7d312d49b107 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:31.350637 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2006/4007] 10.222.0.16 () {58 vars in 1369 bytes} [Fri Sep 30 09:58:31 2022] HEAD /identity/v3/OS-TRUST/trusts/e591461c5c02483494fb4fbdceb844ff/roles/a52554712371497f8e4b71d575bdf37e => generated 0 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Sep 30 09:58:31.356530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae215c-fdaf-42f0-aa27-48b1d298363d tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:31.369721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae215c-fdaf-42f0-aa27-48b1d298363d tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:31.386669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89314c53-0ed3-4941-a180-e55b4d059c3f tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8191131254ef484c93f77d7f22f22729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b550306afd584b12a79d5f3038480461', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1151157875', 'tempest-NotDelegatedRole-2116142621'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:31.387407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89314c53-0ed3-4941-a180-e55b4d059c3f tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:31.387683 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89314c53-0ed3-4941-a180-e55b4d059c3f tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:31.388005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89314c53-0ed3-4941-a180-e55b4d059c3f tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] PATH_INFO: `/v3/OS-TRUST/trusts/e591461c5c02483494fb4fbdceb844ff/roles/8f5c62e8db5a4261998e96a77537f62c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:31.398633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89314c53-0ed3-4941-a180-e55b4d059c3f tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e591461c5c02483494fb4fbdceb844ff, role_id=8f5c62e8db5a4261998e96a77537f62c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:31.400199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89314c53-0ed3-4941-a180-e55b4d059c3f tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:31.418416 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-89314c53-0ed3-4941-a180-e55b4d059c3f tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Could not find role: 8f5c62e8db5a4261998e96a77537f62c.: keystone.exception.RoleNotFound: Could not find role: 8f5c62e8db5a4261998e96a77537f62c. Sep 30 09:58:31.418416 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:31.418416 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:58:31.418416 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:58:31.418416 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:58:31.418416 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:58:31.418416 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:58:31.418416 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:58:31.418416 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:58:31.418416 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:58:31.418416 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:58:31.418416 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:58:31.418416 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 30 09:58:31.418416 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:58:31.418416 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 8f5c62e8db5a4261998e96a77537f62c. Sep 30 09:58:31.420820 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:58:31.423047 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2002/4008] 10.222.0.16 () {58 vars in 1368 bytes} [Fri Sep 30 09:58:31 2022] GET /identity/v3/OS-TRUST/trusts/e591461c5c02483494fb4fbdceb844ff/roles/8f5c62e8db5a4261998e96a77537f62c => generated 110 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 09:58:31.424999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf502b-73c3-470f-88e6-7d312d49b107 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:31.468390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf502b-73c3-470f-88e6-7d312d49b107 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:31.481636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1f2d0-04b9-4940-b1de-08385b322720 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8191131254ef484c93f77d7f22f22729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b550306afd584b12a79d5f3038480461', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1151157875', 'tempest-NotDelegatedRole-2116142621'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:31.482418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1f2d0-04b9-4940-b1de-08385b322720 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:31.482701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1f2d0-04b9-4940-b1de-08385b322720 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:31.482974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1f2d0-04b9-4940-b1de-08385b322720 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] PATH_INFO: `/v3/OS-TRUST/trusts/e591461c5c02483494fb4fbdceb844ff/roles/8f5c62e8db5a4261998e96a77537f62c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:31.491060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1f2d0-04b9-4940-b1de-08385b322720 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e591461c5c02483494fb4fbdceb844ff, role_id=8f5c62e8db5a4261998e96a77537f62c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:31.492802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1f2d0-04b9-4940-b1de-08385b322720 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:31.507782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-f8d1f2d0-04b9-4940-b1de-08385b322720 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Could not find role: 8f5c62e8db5a4261998e96a77537f62c.: keystone.exception.RoleNotFound: Could not find role: 8f5c62e8db5a4261998e96a77537f62c. Sep 30 09:58:31.507782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:31.507782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:58:31.507782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:58:31.507782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:58:31.507782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:58:31.507782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:58:31.507782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:58:31.507782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:58:31.507782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:58:31.507782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:58:31.507782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:58:31.507782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 30 09:58:31.507782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:58:31.507782 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 8f5c62e8db5a4261998e96a77537f62c. Sep 30 09:58:31.509235 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:31.509453 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2007/4009] 10.222.0.16 () {58 vars in 1369 bytes} [Fri Sep 30 09:58:31 2022] HEAD /identity/v3/OS-TRUST/trusts/e591461c5c02483494fb4fbdceb844ff/roles/8f5c62e8db5a4261998e96a77537f62c => generated 0 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Sep 30 09:58:31.513579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89314c53-0ed3-4941-a180-e55b4d059c3f tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:31.526665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89314c53-0ed3-4941-a180-e55b4d059c3f tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:31.531593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf2a2a-9482-471c-8471-268be3f73fd9 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8191131254ef484c93f77d7f22f22729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b550306afd584b12a79d5f3038480461', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1151157875', 'tempest-NotDelegatedRole-2116142621'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:31.532499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf2a2a-9482-471c-8471-268be3f73fd9 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:31.533090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf2a2a-9482-471c-8471-268be3f73fd9 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:31.533466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf2a2a-9482-471c-8471-268be3f73fd9 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] PATH_INFO: `/v3/OS-TRUST/trusts/e591461c5c02483494fb4fbdceb844ff` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:31.561217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf2a2a-9482-471c-8471-268be3f73fd9 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: Authorizing `identity:delete_trust(trust_id=e591461c5c02483494fb4fbdceb844ff)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:31.563287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf2a2a-9482-471c-8471-268be3f73fd9 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:31.600495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6abf2a2a-9482-471c-8471-268be3f73fd9 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e591461c5c02483494fb4fbdceb844ff', 'request_id': 'req-6abf2a2a-9482-471c-8471-268be3f73fd9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:31.602187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6abf2a2a-9482-471c-8471-268be3f73fd9 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'e591461c5c02483494fb4fbdceb844ff', 'request_id': 'req-6abf2a2a-9482-471c-8471-268be3f73fd9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:31.618333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6abf2a2a-9482-471c-8471-268be3f73fd9 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e591461c5c02483494fb4fbdceb844ff', 'request_id': 'req-6abf2a2a-9482-471c-8471-268be3f73fd9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:31.628657 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2003/4010] 10.222.0.16 () {58 vars in 1254 bytes} [Fri Sep 30 09:58:31 2022] DELETE /identity/v3/OS-TRUST/trusts/e591461c5c02483494fb4fbdceb844ff => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:31.641911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1f2d0-04b9-4940-b1de-08385b322720 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:31.644372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f8d1f2d0-04b9-4940-b1de-08385b322720 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:31.668983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1f2d0-04b9-4940-b1de-08385b322720 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:31.675478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8e442-5c90-4da4-9c60-46968ccd775f tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8191131254ef484c93f77d7f22f22729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b550306afd584b12a79d5f3038480461', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1151157875', 'tempest-NotDelegatedRole-2116142621'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:31.676484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8e442-5c90-4da4-9c60-46968ccd775f tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:31.676797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8e442-5c90-4da4-9c60-46968ccd775f tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:31.677072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8e442-5c90-4da4-9c60-46968ccd775f tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] PATH_INFO: `/v3/OS-TRUST/trusts/e591461c5c02483494fb4fbdceb844ff` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:31.688395 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-97d8e442-5c90-4da4-9c60-46968ccd775f tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Could not find trust: e591461c5c02483494fb4fbdceb844ff.: keystone.exception.TrustNotFound: Could not find trust: e591461c5c02483494fb4fbdceb844ff. Sep 30 09:58:31.688395 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:31.688395 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:58:31.688395 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:58:31.688395 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:58:31.688395 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:58:31.688395 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:58:31.688395 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:58:31.688395 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:58:31.688395 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:58:31.688395 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:58:31.688395 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:58:31.688395 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 30 09:58:31.688395 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 30 09:58:31.688395 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 30 09:58:31.689577 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 30 09:58:31.689577 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 30 09:58:31.689577 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 30 09:58:31.689577 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 30 09:58:31.689577 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 30 09:58:31.689577 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:58:31.689577 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:58:31.689577 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 30 09:58:31.689577 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 30 09:58:31.689577 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 30 09:58:31.689577 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 30 09:58:31.689577 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: e591461c5c02483494fb4fbdceb844ff. Sep 30 09:58:31.689577 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:31.693465 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2008/4011] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Sep 30 09:58:31 2022] GET /identity/v3/OS-TRUST/trusts/e591461c5c02483494fb4fbdceb844ff => generated 111 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 09:58:31.693653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf2a2a-9482-471c-8471-268be3f73fd9 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:31.699203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6abf2a2a-9482-471c-8471-268be3f73fd9 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:31.731716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf2a2a-9482-471c-8471-268be3f73fd9 tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:31.737283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd9659-1a92-47d7-a974-fcd3eb5000ec tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:31.738287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd9659-1a92-47d7-a974-fcd3eb5000ec tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:31.738739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd9659-1a92-47d7-a974-fcd3eb5000ec tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:31.739012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd9659-1a92-47d7-a974-fcd3eb5000ec tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles/8f5c62e8db5a4261998e96a77537f62c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:31.741256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd9659-1a92-47d7-a974-fcd3eb5000ec tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8f5c62e8db5a4261998e96a77537f62c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:31.743279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd9659-1a92-47d7-a974-fcd3eb5000ec tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:31.774911 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:31.805175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d6cd9659-1a92-47d7-a974-fcd3eb5000ec tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invalidating the token cache because role 8f5c62e8db5a4261998e96a77537f62c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:31.805571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d6cd9659-1a92-47d7-a974-fcd3eb5000ec tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:31.806145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d6cd9659-1a92-47d7-a974-fcd3eb5000ec tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:31.808154 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2004/4012] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:31 2022] DELETE /identity/v3/roles/8f5c62e8db5a4261998e96a77537f62c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:31.812764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8e442-5c90-4da4-9c60-46968ccd775f tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:31.815323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-97d8e442-5c90-4da4-9c60-46968ccd775f tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:31.835689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8e442-5c90-4da4-9c60-46968ccd775f tempest-TrustsV3TestJSON-668424271 tempest-user-1099118206] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:31.936758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d435bf2-e3c4-47bf-a0be-96048e5494f8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:31.938043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d435bf2-e3c4-47bf-a0be-96048e5494f8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:31.938413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d435bf2-e3c4-47bf-a0be-96048e5494f8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:31.938756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d435bf2-e3c4-47bf-a0be-96048e5494f8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles/a52554712371497f8e4b71d575bdf37e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:31.940524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d435bf2-e3c4-47bf-a0be-96048e5494f8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a52554712371497f8e4b71d575bdf37e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:31.942388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d435bf2-e3c4-47bf-a0be-96048e5494f8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:31.999625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d435bf2-e3c4-47bf-a0be-96048e5494f8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invalidating the token cache because role a52554712371497f8e4b71d575bdf37e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:32.001378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d435bf2-e3c4-47bf-a0be-96048e5494f8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:32.002946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d435bf2-e3c4-47bf-a0be-96048e5494f8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:32.008096 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2009/4013] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:31 2022] DELETE /identity/v3/roles/a52554712371497f8e4b71d575bdf37e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:58:32.012445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd9659-1a92-47d7-a974-fcd3eb5000ec tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:32.028967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd9659-1a92-47d7-a974-fcd3eb5000ec tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:32.177576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212d1dd-5091-4372-b02c-2db42c695248 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:32.178297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212d1dd-5091-4372-b02c-2db42c695248 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:32.178584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212d1dd-5091-4372-b02c-2db42c695248 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:32.179009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212d1dd-5091-4372-b02c-2db42c695248 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/users/8191131254ef484c93f77d7f22f22729` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:32.181236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212d1dd-5091-4372-b02c-2db42c695248 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8191131254ef484c93f77d7f22f22729)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:32.183344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212d1dd-5091-4372-b02c-2db42c695248 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:32.246013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2212d1dd-5091-4372-b02c-2db42c695248 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8191131254ef484c93f77d7f22f22729'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:32.257250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2212d1dd-5091-4372-b02c-2db42c695248 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8191131254ef484c93f77d7f22f22729'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:32.258338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2212d1dd-5091-4372-b02c-2db42c695248 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8191131254ef484c93f77d7f22f22729'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:32.281723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2212d1dd-5091-4372-b02c-2db42c695248 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8191131254ef484c93f77d7f22f22729'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:32.297539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2212d1dd-5091-4372-b02c-2db42c695248 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8191131254ef484c93f77d7f22f22729'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:32.306302 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2005/4014] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:32 2022] DELETE /identity/v3/users/8191131254ef484c93f77d7f22f22729 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:32.310575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d435bf2-e3c4-47bf-a0be-96048e5494f8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:32.312026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1d435bf2-e3c4-47bf-a0be-96048e5494f8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:32.320435 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:32.326507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d435bf2-e3c4-47bf-a0be-96048e5494f8 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:32.402690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a922eed-11d4-41f8-9a3f-382f686464d4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:32.403435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a922eed-11d4-41f8-9a3f-382f686464d4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:32.403785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a922eed-11d4-41f8-9a3f-382f686464d4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:32.404147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a922eed-11d4-41f8-9a3f-382f686464d4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects/b550306afd584b12a79d5f3038480461` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:32.405890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a922eed-11d4-41f8-9a3f-382f686464d4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b550306afd584b12a79d5f3038480461)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:32.407883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a922eed-11d4-41f8-9a3f-382f686464d4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:32.498479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7a922eed-11d4-41f8-9a3f-382f686464d4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b550306afd584b12a79d5f3038480461', 'request_id': 'req-7a922eed-11d4-41f8-9a3f-382f686464d4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:32.514734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7a922eed-11d4-41f8-9a3f-382f686464d4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b550306afd584b12a79d5f3038480461', 'request_id': 'req-7a922eed-11d4-41f8-9a3f-382f686464d4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:32.525227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7a922eed-11d4-41f8-9a3f-382f686464d4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b550306afd584b12a79d5f3038480461', 'request_id': 'req-7a922eed-11d4-41f8-9a3f-382f686464d4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:32.539900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7a922eed-11d4-41f8-9a3f-382f686464d4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] The token cache is being invalidate because project b550306afd584b12a79d5f3038480461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:32.540417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7a922eed-11d4-41f8-9a3f-382f686464d4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:32.541284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7a922eed-11d4-41f8-9a3f-382f686464d4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:32.543063 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2010/4015] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:32 2022] DELETE /identity/v3/projects/b550306afd584b12a79d5f3038480461 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:32.550578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212d1dd-5091-4372-b02c-2db42c695248 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:32.552920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2212d1dd-5091-4372-b02c-2db42c695248 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:32.569360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212d1dd-5091-4372-b02c-2db42c695248 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:32.635233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba86e8f-0d5b-43a0-8f58-ebbad0100099 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:32.636124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba86e8f-0d5b-43a0-8f58-ebbad0100099 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:32.636624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba86e8f-0d5b-43a0-8f58-ebbad0100099 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:32.637174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba86e8f-0d5b-43a0-8f58-ebbad0100099 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:32.638157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba86e8f-0d5b-43a0-8f58-ebbad0100099 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:32.640449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba86e8f-0d5b-43a0-8f58-ebbad0100099 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:32.653160 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:32.692041 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2006/4016] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Sep 30 09:58:32 2022] POST /identity/v3/projects => generated 328 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:32.697686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a922eed-11d4-41f8-9a3f-382f686464d4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:32.700035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7a922eed-11d4-41f8-9a3f-382f686464d4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:32.719375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba86e8f-0d5b-43a0-8f58-ebbad0100099 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:32.721251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4ba86e8f-0d5b-43a0-8f58-ebbad0100099 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:32.728352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a922eed-11d4-41f8-9a3f-382f686464d4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:32.815807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b959d9-130c-461e-ab52-bfcf69104044 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:32.816317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b959d9-130c-461e-ab52-bfcf69104044 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:32.816645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b959d9-130c-461e-ab52-bfcf69104044 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:32.816903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b959d9-130c-461e-ab52-bfcf69104044 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:32.817562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b959d9-130c-461e-ab52-bfcf69104044 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:32.820262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b959d9-130c-461e-ab52-bfcf69104044 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:32.831486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba86e8f-0d5b-43a0-8f58-ebbad0100099 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:32.839123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923e795-e051-4d95-93c4-f829b867ff9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:32.840535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923e795-e051-4d95-93c4-f829b867ff9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:32.841543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923e795-e051-4d95-93c4-f829b867ff9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:32.843745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923e795-e051-4d95-93c4-f829b867ff9c admin admin] PATH_INFO: `/v3/users/20a722795d0b421c982c9de2df532c6d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:32.845124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923e795-e051-4d95-93c4-f829b867ff9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=20a722795d0b421c982c9de2df532c6d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:32.848119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923e795-e051-4d95-93c4-f829b867ff9c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:32.852741 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2011/4017] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:58:32 2022] POST /identity/v3/users => generated 416 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:32.856705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b959d9-130c-461e-ab52-bfcf69104044 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:32.875227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b959d9-130c-461e-ab52-bfcf69104044 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:32.886586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb125204-e735-4771-8a11-9e0deb74389c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:32.887414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb125204-e735-4771-8a11-9e0deb74389c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:32.888423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb125204-e735-4771-8a11-9e0deb74389c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:32.888745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb125204-e735-4771-8a11-9e0deb74389c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:32.889549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb125204-e735-4771-8a11-9e0deb74389c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:32.894784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb125204-e735-4771-8a11-9e0deb74389c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:32.920129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8923e795-e051-4d95-93c4-f829b867ff9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20a722795d0b421c982c9de2df532c6d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:32.925973 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2012/4018] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 09:58:32 2022] POST /identity/v3/roles => generated 244 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:58:32.929857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8923e795-e051-4d95-93c4-f829b867ff9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20a722795d0b421c982c9de2df532c6d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:32.930840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8923e795-e051-4d95-93c4-f829b867ff9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20a722795d0b421c982c9de2df532c6d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:32.931106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb125204-e735-4771-8a11-9e0deb74389c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:32.949067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8923e795-e051-4d95-93c4-f829b867ff9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20a722795d0b421c982c9de2df532c6d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:32.949721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb125204-e735-4771-8a11-9e0deb74389c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:32.957675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8923e795-e051-4d95-93c4-f829b867ff9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20a722795d0b421c982c9de2df532c6d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:32.965367 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2007/4019] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:32 2022] DELETE /identity/v3/users/20a722795d0b421c982c9de2df532c6d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:32.969834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2ab78-37cd-47b4-8f32-c02af87d6959 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:32.971493 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:32.973363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2ab78-37cd-47b4-8f32-c02af87d6959 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:32.973688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2ab78-37cd-47b4-8f32-c02af87d6959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:33.006328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ccb2ab78-37cd-47b4-8f32-c02af87d6959 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:33.007633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ccb2ab78-37cd-47b4-8f32-c02af87d6959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:33.068403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c423cc-1b40-4676-b91e-3584935cb60d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:33.069206 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c423cc-1b40-4676-b91e-3584935cb60d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:33.069892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c423cc-1b40-4676-b91e-3584935cb60d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:33.070176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c423cc-1b40-4676-b91e-3584935cb60d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:33.070970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c423cc-1b40-4676-b91e-3584935cb60d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:33.072693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c423cc-1b40-4676-b91e-3584935cb60d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:33.103620 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2013/4020] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 09:58:32 2022] POST /identity/v3/roles => generated 245 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:33.104803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c423cc-1b40-4676-b91e-3584935cb60d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:33.106530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-31c423cc-1b40-4676-b91e-3584935cb60d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:33.121989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c423cc-1b40-4676-b91e-3584935cb60d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:33.123178 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2008/4021] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:58:33.127761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d33b1-57ba-412c-969c-ccf34c7f2b52 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:33.128528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d33b1-57ba-412c-969c-ccf34c7f2b52 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:33.128983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d33b1-57ba-412c-969c-ccf34c7f2b52 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:33.129272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d33b1-57ba-412c-969c-ccf34c7f2b52 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects/4db649da6b88469fbaba780c21ad162a/users/2f7aad1ab312429caba61e3a91d2a486/roles/689b7b5f63d247518209e1f99ceefcdc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:33.137479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2ab78-37cd-47b4-8f32-c02af87d6959 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:33.139034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ccb2ab78-37cd-47b4-8f32-c02af87d6959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:33.152439 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:33.190438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d33b1-57ba-412c-969c-ccf34c7f2b52 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4db649da6b88469fbaba780c21ad162a, user_id=2f7aad1ab312429caba61e3a91d2a486, role_id=689b7b5f63d247518209e1f99ceefcdc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:33.190438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d33b1-57ba-412c-969c-ccf34c7f2b52 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:33.225400 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2014/4022] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:33 2022] PUT /identity/v3/projects/4db649da6b88469fbaba780c21ad162a/users/2f7aad1ab312429caba61e3a91d2a486/roles/689b7b5f63d247518209e1f99ceefcdc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:33.234891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d33b1-57ba-412c-969c-ccf34c7f2b52 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:33.238303 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2ab78-37cd-47b4-8f32-c02af87d6959 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:33.333417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d4282-4903-4951-9c1c-8a0434fba9ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:33.334371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d4282-4903-4951-9c1c-8a0434fba9ad service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:33.334841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d4282-4903-4951-9c1c-8a0434fba9ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:33.335175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d4282-4903-4951-9c1c-8a0434fba9ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:33.391733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d33b1-57ba-412c-969c-ccf34c7f2b52 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:33.420768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ddd2c-3c57-44ea-80d4-98eaeea27bce tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:33.421629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ddd2c-3c57-44ea-80d4-98eaeea27bce tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:33.421915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ddd2c-3c57-44ea-80d4-98eaeea27bce tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:33.422190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ddd2c-3c57-44ea-80d4-98eaeea27bce tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects/4db649da6b88469fbaba780c21ad162a/users/2f7aad1ab312429caba61e3a91d2a486/roles/075341d0bf694995af5f5ef731856142` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:33.438313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ddd2c-3c57-44ea-80d4-98eaeea27bce tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4db649da6b88469fbaba780c21ad162a, user_id=2f7aad1ab312429caba61e3a91d2a486, role_id=075341d0bf694995af5f5ef731856142)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:33.441145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ddd2c-3c57-44ea-80d4-98eaeea27bce tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:33.457063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d4282-4903-4951-9c1c-8a0434fba9ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:33.461174 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2015/4023] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:33 2022] PUT /identity/v3/projects/4db649da6b88469fbaba780c21ad162a/users/2f7aad1ab312429caba61e3a91d2a486/roles/075341d0bf694995af5f5ef731856142 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:58:33.464774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d4282-4903-4951-9c1c-8a0434fba9ad service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:33.466554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ddd2c-3c57-44ea-80d4-98eaeea27bce tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:33.477491 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2009/4024] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:58:33.573794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a17d5b-e314-4831-adb4-1ebd718dffa5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:33.574448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a17d5b-e314-4831-adb4-1ebd718dffa5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:33.574448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a17d5b-e314-4831-adb4-1ebd718dffa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:33.600261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ddd2c-3c57-44ea-80d4-98eaeea27bce tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:33.606053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-83a17d5b-e314-4831-adb4-1ebd718dffa5 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:33.607417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-83a17d5b-e314-4831-adb4-1ebd718dffa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:33.607858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d533980-b2f9-47a3-82a1-34de57c2e5fd tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:33.608825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d533980-b2f9-47a3-82a1-34de57c2e5fd tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:33.609484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d533980-b2f9-47a3-82a1-34de57c2e5fd tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:33.609979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d533980-b2f9-47a3-82a1-34de57c2e5fd tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:33.611095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d533980-b2f9-47a3-82a1-34de57c2e5fd tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:33.613444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d533980-b2f9-47a3-82a1-34de57c2e5fd tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:33.662358 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2016/4025] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:33 2022] GET /identity/v3/users => generated 8630 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:33.668738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f1d0d-3d60-4ecb-89d0-d55358578987 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:33.669118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f1d0d-3d60-4ecb-89d0-d55358578987 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:33.671696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f1d0d-3d60-4ecb-89d0-d55358578987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:33.689043 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:33.727191 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2010/4026] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:58:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:58:33.728746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d78f1d0d-3d60-4ecb-89d0-d55358578987 None None] MFA Rules not processed for user `2f7aad1ab312429caba61e3a91d2a486`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:33.730483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d78f1d0d-3d60-4ecb-89d0-d55358578987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:33.742609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a17d5b-e314-4831-adb4-1ebd718dffa5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:33.744334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-83a17d5b-e314-4831-adb4-1ebd718dffa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:33.778094 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:33.873539 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2017/4027] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:33 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:58:33.886475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b75b8-1000-483c-90ca-2a96836a21d9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:33.886836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b75b8-1000-483c-90ca-2a96836a21d9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:33.887232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b75b8-1000-483c-90ca-2a96836a21d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:33.888801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a17d5b-e314-4831-adb4-1ebd718dffa5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:33.895646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd09be9-b4ab-48c6-9fff-ca7cdc176974 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:33.896624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd09be9-b4ab-48c6-9fff-ca7cdc176974 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:33.897100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd09be9-b4ab-48c6-9fff-ca7cdc176974 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:33.897916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd09be9-b4ab-48c6-9fff-ca7cdc176974 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:33.910718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd09be9-b4ab-48c6-9fff-ca7cdc176974 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:33.918680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-280b75b8-1000-483c-90ca-2a96836a21d9 None None] MFA Rules not processed for user `2f7aad1ab312429caba61e3a91d2a486`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:33.920221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-280b75b8-1000-483c-90ca-2a96836a21d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:33.930667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd09be9-b4ab-48c6-9fff-ca7cdc176974 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:33.937938 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2018/4028] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:33 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:33.949786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b75b8-1000-483c-90ca-2a96836a21d9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:33.953850 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2011/4029] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:58:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 09:58:33.974481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd09be9-b4ab-48c6-9fff-ca7cdc176974 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:33.977202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5dd09be9-b4ab-48c6-9fff-ca7cdc176974 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:33.982083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b75b8-1000-483c-90ca-2a96836a21d9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:34.000781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6612300-b53e-4a4d-96f4-e8d33cb324bb tempest-TrustsV3TestJSON-520226224 tempest-user-1750942685] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f7aad1ab312429caba61e3a91d2a486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4db649da6b88469fbaba780c21ad162a', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-85756536', 'tempest-DelegatedRole-1161389296'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:34.001671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6612300-b53e-4a4d-96f4-e8d33cb324bb tempest-TrustsV3TestJSON-520226224 tempest-user-1750942685] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:34.002017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6612300-b53e-4a4d-96f4-e8d33cb324bb tempest-TrustsV3TestJSON-520226224 tempest-user-1750942685] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:34.002349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6612300-b53e-4a4d-96f4-e8d33cb324bb tempest-TrustsV3TestJSON-520226224 tempest-user-1750942685] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:34.003081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6612300-b53e-4a4d-96f4-e8d33cb324bb tempest-TrustsV3TestJSON-520226224 tempest-user-1750942685] RBAC: Authorizing `identity:create_trust()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:34.004304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6612300-b53e-4a4d-96f4-e8d33cb324bb tempest-TrustsV3TestJSON-520226224 tempest-user-1750942685] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:34.144492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd09be9-b4ab-48c6-9fff-ca7cdc176974 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:34.155514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43de53-5c19-4e05-a34d-b966301bd3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:34.158291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43de53-5c19-4e05-a34d-b966301bd3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:34.158708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43de53-5c19-4e05-a34d-b966301bd3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:34.163890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43de53-5c19-4e05-a34d-b966301bd3ea admin admin] PATH_INFO: `/v3/projects/7f4a03dcec3b488094aacc6639505d0a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:34.165276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43de53-5c19-4e05-a34d-b966301bd3ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4a03dcec3b488094aacc6639505d0a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:34.175989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43de53-5c19-4e05-a34d-b966301bd3ea admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:34.242989 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-b6612300-b53e-4a4d-96f4-e8d33cb324bb tempest-TrustsV3TestJSON-520226224 tempest-user-1750942685] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 30 09:58:34.242989 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:34.242989 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Sep 30 09:58:34.242989 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Sep 30 09:58:34.242989 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Sep 30 09:58:34.242989 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Sep 30 09:58:34.242989 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Sep 30 09:58:34.242989 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:34.242989 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:58:34.242989 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:34.242989 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:34.242989 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Sep 30 09:58:34.242989 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Sep 30 09:58:34.242989 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Sep 30 09:58:34.244541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise ValueError(str(e)) Sep 30 09:58:34.244541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Sep 30 09:58:34.244541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:34.244541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 09:58:34.244541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:34.244541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:34.244541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:58:34.244541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:58:34.244541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:58:34.244541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:58:34.244541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:58:34.244541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:58:34.244541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:58:34.244541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:58:34.244541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:58:34.244541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:58:34.244541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Sep 30 09:58:34.244541 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Sep 30 09:58:34.245920 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Sep 30 09:58:34.245920 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Sep 30 09:58:34.245920 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Sep 30 09:58:34.245920 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Sep 30 09:58:34.245920 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 30 09:58:34.245920 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:34.245920 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2019/4030] 10.222.0.16 () {60 vars in 1174 bytes} [Fri Sep 30 09:58:33 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 296 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 30 09:58:34.249004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6612300-b53e-4a4d-96f4-e8d33cb324bb tempest-TrustsV3TestJSON-520226224 tempest-user-1750942685] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:34.269017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6612300-b53e-4a4d-96f4-e8d33cb324bb tempest-TrustsV3TestJSON-520226224 tempest-user-1750942685] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:34.282768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62135c4-780b-4568-90bd-072af991c3dc tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:34.284935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62135c4-780b-4568-90bd-072af991c3dc tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:34.285230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62135c4-780b-4568-90bd-072af991c3dc tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:34.288703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62135c4-780b-4568-90bd-072af991c3dc tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles/075341d0bf694995af5f5ef731856142` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:34.293336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62135c4-780b-4568-90bd-072af991c3dc tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_role(role_id=075341d0bf694995af5f5ef731856142)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:34.298587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62135c4-780b-4568-90bd-072af991c3dc tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:34.368998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a43de53-5c19-4e05-a34d-b966301bd3ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4a03dcec3b488094aacc6639505d0a', 'request_id': 'req-5a43de53-5c19-4e05-a34d-b966301bd3ea'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:34.381305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b62135c4-780b-4568-90bd-072af991c3dc tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invalidating the token cache because role 075341d0bf694995af5f5ef731856142 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:34.381772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b62135c4-780b-4568-90bd-072af991c3dc tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:34.383955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a43de53-5c19-4e05-a34d-b966301bd3ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4a03dcec3b488094aacc6639505d0a', 'request_id': 'req-5a43de53-5c19-4e05-a34d-b966301bd3ea'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:34.384534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b62135c4-780b-4568-90bd-072af991c3dc tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:34.389089 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2020/4031] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:34 2022] DELETE /identity/v3/roles/075341d0bf694995af5f5ef731856142 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:34.393317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62135c4-780b-4568-90bd-072af991c3dc tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:34.396573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b62135c4-780b-4568-90bd-072af991c3dc tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:34.404711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a43de53-5c19-4e05-a34d-b966301bd3ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4a03dcec3b488094aacc6639505d0a', 'request_id': 'req-5a43de53-5c19-4e05-a34d-b966301bd3ea'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:34.438094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a43de53-5c19-4e05-a34d-b966301bd3ea admin admin] The token cache is being invalidate because project 7f4a03dcec3b488094aacc6639505d0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:34.438719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a43de53-5c19-4e05-a34d-b966301bd3ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:34.441135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a43de53-5c19-4e05-a34d-b966301bd3ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:34.451444 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2012/4032] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:33 2022] DELETE /identity/v3/projects/7f4a03dcec3b488094aacc6639505d0a => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:34.453135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d6031-92d2-41dc-88e3-f296c81e225a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:34.453422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d6031-92d2-41dc-88e3-f296c81e225a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:34.453696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d6031-92d2-41dc-88e3-f296c81e225a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:34.477782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d97d6031-92d2-41dc-88e3-f296c81e225a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:34.479348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d97d6031-92d2-41dc-88e3-f296c81e225a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:34.504400 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:34.564430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62135c4-780b-4568-90bd-072af991c3dc tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:34.567667 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:34.577092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb1fa5-5f75-461c-8e4d-aefefa62ce2e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:34.579761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb1fa5-5f75-461c-8e4d-aefefa62ce2e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:34.579761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb1fa5-5f75-461c-8e4d-aefefa62ce2e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:34.579761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb1fa5-5f75-461c-8e4d-aefefa62ce2e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles/689b7b5f63d247518209e1f99ceefcdc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:34.585435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb1fa5-5f75-461c-8e4d-aefefa62ce2e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_role(role_id=689b7b5f63d247518209e1f99ceefcdc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:34.587301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb1fa5-5f75-461c-8e4d-aefefa62ce2e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:34.634908 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2013/4033] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:34.644065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea634b-7380-46a3-b501-6011428eff07 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:34.644348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea634b-7380-46a3-b501-6011428eff07 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:34.644720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea634b-7380-46a3-b501-6011428eff07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:34.684853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cfbb1fa5-5f75-461c-8e4d-aefefa62ce2e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invalidating the token cache because role 689b7b5f63d247518209e1f99ceefcdc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:34.685317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cfbb1fa5-5f75-461c-8e4d-aefefa62ce2e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:34.686755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cfbb1fa5-5f75-461c-8e4d-aefefa62ce2e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:34.691244 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2021/4034] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:34 2022] DELETE /identity/v3/roles/689b7b5f63d247518209e1f99ceefcdc => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:34.691843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-03ea634b-7380-46a3-b501-6011428eff07 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:34.693550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-03ea634b-7380-46a3-b501-6011428eff07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:34.696300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb1fa5-5f75-461c-8e4d-aefefa62ce2e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:34.698041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cfbb1fa5-5f75-461c-8e4d-aefefa62ce2e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:34.821456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb1fa5-5f75-461c-8e4d-aefefa62ce2e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:34.840209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff814dcf-d699-40f7-9418-0119fe0a2c8e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:34.842039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff814dcf-d699-40f7-9418-0119fe0a2c8e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:34.842925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff814dcf-d699-40f7-9418-0119fe0a2c8e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:34.844198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff814dcf-d699-40f7-9418-0119fe0a2c8e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/users/2f7aad1ab312429caba61e3a91d2a486` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:34.849554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff814dcf-d699-40f7-9418-0119fe0a2c8e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2f7aad1ab312429caba61e3a91d2a486)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:34.855461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff814dcf-d699-40f7-9418-0119fe0a2c8e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:34.958092 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2014/4035] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:34.962479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea634b-7380-46a3-b501-6011428eff07 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:35.000481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ff814dcf-d699-40f7-9418-0119fe0a2c8e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f7aad1ab312429caba61e3a91d2a486'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:35.001528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea634b-7380-46a3-b501-6011428eff07 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:35.002835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ff814dcf-d699-40f7-9418-0119fe0a2c8e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f7aad1ab312429caba61e3a91d2a486'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:35.017373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e58201-a415-4b58-90d5-ba2c63b50204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:35.018915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ff814dcf-d699-40f7-9418-0119fe0a2c8e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f7aad1ab312429caba61e3a91d2a486'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:35.019673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e58201-a415-4b58-90d5-ba2c63b50204 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:35.020175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e58201-a415-4b58-90d5-ba2c63b50204 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:35.021591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e58201-a415-4b58-90d5-ba2c63b50204 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:35.022469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e58201-a415-4b58-90d5-ba2c63b50204 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:58:35.024008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e58201-a415-4b58-90d5-ba2c63b50204 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:35.028594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e58201-a415-4b58-90d5-ba2c63b50204 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:35.053080 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2015/4036] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:35.054889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e58201-a415-4b58-90d5-ba2c63b50204 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:35.062473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ff814dcf-d699-40f7-9418-0119fe0a2c8e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f7aad1ab312429caba61e3a91d2a486'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:35.063384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-05e58201-a415-4b58-90d5-ba2c63b50204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:35.086244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ff814dcf-d699-40f7-9418-0119fe0a2c8e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f7aad1ab312429caba61e3a91d2a486'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:35.105311 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2022/4037] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:34 2022] DELETE /identity/v3/users/2f7aad1ab312429caba61e3a91d2a486 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:35.112496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff814dcf-d699-40f7-9418-0119fe0a2c8e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:35.112822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e58201-a415-4b58-90d5-ba2c63b50204 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:35.114766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ff814dcf-d699-40f7-9418-0119fe0a2c8e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:35.271982 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:35.370425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff814dcf-d699-40f7-9418-0119fe0a2c8e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:35.379616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016262fa-f28f-4db4-88da-320d46d0556a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:35.384383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016262fa-f28f-4db4-88da-320d46d0556a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:35.384805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016262fa-f28f-4db4-88da-320d46d0556a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:35.385689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016262fa-f28f-4db4-88da-320d46d0556a admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:35.386649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016262fa-f28f-4db4-88da-320d46d0556a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:35.390914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecca3f9-218c-4c1e-bfa8-a583a730f5d9 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:35.391798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecca3f9-218c-4c1e-bfa8-a583a730f5d9 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:35.394483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016262fa-f28f-4db4-88da-320d46d0556a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:35.395881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecca3f9-218c-4c1e-bfa8-a583a730f5d9 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:35.396399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecca3f9-218c-4c1e-bfa8-a583a730f5d9 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects/4db649da6b88469fbaba780c21ad162a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:35.400077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecca3f9-218c-4c1e-bfa8-a583a730f5d9 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4db649da6b88469fbaba780c21ad162a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:35.409642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecca3f9-218c-4c1e-bfa8-a583a730f5d9 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:35.475071 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2016/4038] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:58:35 2022] POST /identity/v3/projects => generated 373 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:35.480291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016262fa-f28f-4db4-88da-320d46d0556a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:35.527936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ecca3f9-218c-4c1e-bfa8-a583a730f5d9 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4db649da6b88469fbaba780c21ad162a', 'request_id': 'req-9ecca3f9-218c-4c1e-bfa8-a583a730f5d9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:35.542623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ecca3f9-218c-4c1e-bfa8-a583a730f5d9 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4db649da6b88469fbaba780c21ad162a', 'request_id': 'req-9ecca3f9-218c-4c1e-bfa8-a583a730f5d9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:35.551524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ecca3f9-218c-4c1e-bfa8-a583a730f5d9 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4db649da6b88469fbaba780c21ad162a', 'request_id': 'req-9ecca3f9-218c-4c1e-bfa8-a583a730f5d9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:35.576786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ecca3f9-218c-4c1e-bfa8-a583a730f5d9 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] The token cache is being invalidate because project 4db649da6b88469fbaba780c21ad162a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:35.580263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ecca3f9-218c-4c1e-bfa8-a583a730f5d9 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:35.581302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ecca3f9-218c-4c1e-bfa8-a583a730f5d9 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:35.593111 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2023/4039] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:35 2022] DELETE /identity/v3/projects/4db649da6b88469fbaba780c21ad162a => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:35.594483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecca3f9-218c-4c1e-bfa8-a583a730f5d9 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:35.601400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9ecca3f9-218c-4c1e-bfa8-a583a730f5d9 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:35.653826 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:35.677345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016262fa-f28f-4db4-88da-320d46d0556a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:35.754871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecca3f9-218c-4c1e-bfa8-a583a730f5d9 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:35.760860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c766a-eda6-4216-9981-17fb4f273750 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:35.761574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c766a-eda6-4216-9981-17fb4f273750 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:35.761929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c766a-eda6-4216-9981-17fb4f273750 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:35.762939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c766a-eda6-4216-9981-17fb4f273750 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:35.763705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c766a-eda6-4216-9981-17fb4f273750 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:35.765907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c766a-eda6-4216-9981-17fb4f273750 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:35.812559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e195ea-f7b2-4a18-ad43-c189ec24f083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:35.813908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e195ea-f7b2-4a18-ad43-c189ec24f083 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:35.814454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e195ea-f7b2-4a18-ad43-c189ec24f083 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:35.814788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e195ea-f7b2-4a18-ad43-c189ec24f083 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:35.816004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e195ea-f7b2-4a18-ad43-c189ec24f083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:35.819467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e195ea-f7b2-4a18-ad43-c189ec24f083 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:35.827047 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2024/4040] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Sep 30 09:58:35 2022] POST /identity/v3/projects => generated 329 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:35.831398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c766a-eda6-4216-9981-17fb4f273750 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:35.890006 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2017/4041] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:58:35 2022] POST /identity/v3/users => generated 287 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:35.903714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e195ea-f7b2-4a18-ad43-c189ec24f083 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:35.907292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b5e195ea-f7b2-4a18-ad43-c189ec24f083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:35.937545 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:35.978590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e195ea-f7b2-4a18-ad43-c189ec24f083 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:35.980773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c766a-eda6-4216-9981-17fb4f273750 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:35.992067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77c52b-add9-401f-a62e-0e7099c721a6 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:35.992982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77c52b-add9-401f-a62e-0e7099c721a6 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:35.993316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77c52b-add9-401f-a62e-0e7099c721a6 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:35.993711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77c52b-add9-401f-a62e-0e7099c721a6 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:35.994458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77c52b-add9-401f-a62e-0e7099c721a6 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:35.996671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77c52b-add9-401f-a62e-0e7099c721a6 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:36.037012 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2025/4042] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:58:35 2022] POST /identity/v3/users => generated 413 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:36.043336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77c52b-add9-401f-a62e-0e7099c721a6 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:36.065349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77c52b-add9-401f-a62e-0e7099c721a6 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:36.084708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9d36b-2bb4-43e9-9f8b-172e324f56bc tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:36.086000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9d36b-2bb4-43e9-9f8b-172e324f56bc tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:36.086329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9d36b-2bb4-43e9-9f8b-172e324f56bc tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:36.086609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9d36b-2bb4-43e9-9f8b-172e324f56bc tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:36.087289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9d36b-2bb4-43e9-9f8b-172e324f56bc tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:36.089147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9d36b-2bb4-43e9-9f8b-172e324f56bc tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:36.125384 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2026/4043] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 09:58:36 2022] POST /identity/v3/roles => generated 243 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:36.130690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9d36b-2bb4-43e9-9f8b-172e324f56bc tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:36.155880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9d36b-2bb4-43e9-9f8b-172e324f56bc tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:36.165851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be994817-661b-42f2-8a6d-7c11385bfb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:36.168515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d598cfb-2461-4a6b-8ebb-0e7b821bca55 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:36.169331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d598cfb-2461-4a6b-8ebb-0e7b821bca55 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:36.169470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be994817-661b-42f2-8a6d-7c11385bfb1c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:36.169664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d598cfb-2461-4a6b-8ebb-0e7b821bca55 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:36.169949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d598cfb-2461-4a6b-8ebb-0e7b821bca55 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:36.170619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d598cfb-2461-4a6b-8ebb-0e7b821bca55 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:36.172132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be994817-661b-42f2-8a6d-7c11385bfb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:36.172359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d598cfb-2461-4a6b-8ebb-0e7b821bca55 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:36.173620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be994817-661b-42f2-8a6d-7c11385bfb1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:36.175879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be994817-661b-42f2-8a6d-7c11385bfb1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:36.185069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be994817-661b-42f2-8a6d-7c11385bfb1c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:36.216816 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2027/4044] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 09:58:36 2022] POST /identity/v3/roles => generated 246 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:58:36.216816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d598cfb-2461-4a6b-8ebb-0e7b821bca55 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:36.230881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d598cfb-2461-4a6b-8ebb-0e7b821bca55 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:36.232181 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2018/4045] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:35 2022] GET /identity/v3/roles => generated 1891 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:36.236426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be994817-661b-42f2-8a6d-7c11385bfb1c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:36.243084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45834941-67a7-41f3-90e9-5cf6bc3b8f66 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:36.243774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45834941-67a7-41f3-90e9-5cf6bc3b8f66 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:36.244059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45834941-67a7-41f3-90e9-5cf6bc3b8f66 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:36.244334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45834941-67a7-41f3-90e9-5cf6bc3b8f66 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects/c0ec904a0f9946908c8da6c1e32ec9e1/users/0e5dcd8f2d1a4c9a97fe62379231f509/roles/3dd1ef86fe684e7e9d5d54de2e5bcb40` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:36.268535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45834941-67a7-41f3-90e9-5cf6bc3b8f66 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c0ec904a0f9946908c8da6c1e32ec9e1, user_id=0e5dcd8f2d1a4c9a97fe62379231f509, role_id=3dd1ef86fe684e7e9d5d54de2e5bcb40)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:36.270268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be994817-661b-42f2-8a6d-7c11385bfb1c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:36.271249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45834941-67a7-41f3-90e9-5cf6bc3b8f66 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:36.306881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0538d31-a51d-4d41-b1b0-64b6627ba32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:36.306881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0538d31-a51d-4d41-b1b0-64b6627ba32d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:36.306881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0538d31-a51d-4d41-b1b0-64b6627ba32d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:36.306881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0538d31-a51d-4d41-b1b0-64b6627ba32d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:36.308008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0538d31-a51d-4d41-b1b0-64b6627ba32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:36.316744 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2028/4046] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:36 2022] PUT /identity/v3/projects/c0ec904a0f9946908c8da6c1e32ec9e1/users/0e5dcd8f2d1a4c9a97fe62379231f509/roles/3dd1ef86fe684e7e9d5d54de2e5bcb40 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:58:36.317655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45834941-67a7-41f3-90e9-5cf6bc3b8f66 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:36.318823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0538d31-a51d-4d41-b1b0-64b6627ba32d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:36.355051 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2019/4047] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:36 2022] GET /identity/v3/roles => generated 1891 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:36.360274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0538d31-a51d-4d41-b1b0-64b6627ba32d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:36.388160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0538d31-a51d-4d41-b1b0-64b6627ba32d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:36.528028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45834941-67a7-41f3-90e9-5cf6bc3b8f66 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:36.553802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d86ba8-ae6d-4fd5-ba99-beed2d464615 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:36.555780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d86ba8-ae6d-4fd5-ba99-beed2d464615 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:36.556078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d86ba8-ae6d-4fd5-ba99-beed2d464615 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:36.556360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d86ba8-ae6d-4fd5-ba99-beed2d464615 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects/c0ec904a0f9946908c8da6c1e32ec9e1/users/0e5dcd8f2d1a4c9a97fe62379231f509/roles/1b572638ccf7483690197100950ecfd7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:36.559273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d86ba8-ae6d-4fd5-ba99-beed2d464615 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c0ec904a0f9946908c8da6c1e32ec9e1, user_id=0e5dcd8f2d1a4c9a97fe62379231f509, role_id=1b572638ccf7483690197100950ecfd7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:36.563801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d86ba8-ae6d-4fd5-ba99-beed2d464615 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:36.584763 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2029/4048] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:36 2022] PUT /identity/v3/projects/c0ec904a0f9946908c8da6c1e32ec9e1/users/0e5dcd8f2d1a4c9a97fe62379231f509/roles/1b572638ccf7483690197100950ecfd7 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:36.590047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d86ba8-ae6d-4fd5-ba99-beed2d464615 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:36.611964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306340ef-bc2e-427b-8432-67cb1561d8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:36.612762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306340ef-bc2e-427b-8432-67cb1561d8a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:36.613039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306340ef-bc2e-427b-8432-67cb1561d8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:36.613314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306340ef-bc2e-427b-8432-67cb1561d8a3 admin admin] PATH_INFO: `/v3/projects/84cd3c9bde864c2398adb20ebc7c3454/users/131fb75001434f6998555cde568935ec/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:36.646968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306340ef-bc2e-427b-8432-67cb1561d8a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84cd3c9bde864c2398adb20ebc7c3454, user_id=131fb75001434f6998555cde568935ec, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:36.650525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306340ef-bc2e-427b-8432-67cb1561d8a3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:36.675041 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:36.691357 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2020/4049] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:36 2022] PUT /identity/v3/projects/84cd3c9bde864c2398adb20ebc7c3454/users/131fb75001434f6998555cde568935ec/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:58:36.693360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed69e5-c0d1-42a1-8563-a27660d72e24 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:36.693575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed69e5-c0d1-42a1-8563-a27660d72e24 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:36.693907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed69e5-c0d1-42a1-8563-a27660d72e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:36.792661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d86ba8-ae6d-4fd5-ba99-beed2d464615 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:36.814138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bbed69e5-c0d1-42a1-8563-a27660d72e24 None None] MFA Rules not processed for user `131fb75001434f6998555cde568935ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:36.815999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bbed69e5-c0d1-42a1-8563-a27660d72e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:36.873805 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:36.983050 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2021/4050] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:37.001742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1b24c-3578-42a5-b45b-01dab94cb08f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:37.002075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1b24c-3578-42a5-b45b-01dab94cb08f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:37.002306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1b24c-3578-42a5-b45b-01dab94cb08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:37.034964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc55c9-2c97-4ed4-9e60-994287abff1c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:37.034964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc55c9-2c97-4ed4-9e60-994287abff1c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:37.034964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc55c9-2c97-4ed4-9e60-994287abff1c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:37.035761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc55c9-2c97-4ed4-9e60-994287abff1c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:37.038965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc55c9-2c97-4ed4-9e60-994287abff1c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:37.040405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc55c9-2c97-4ed4-9e60-994287abff1c tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:37.058312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-13b1b24c-3578-42a5-b45b-01dab94cb08f None None] MFA Rules not processed for user `131fb75001434f6998555cde568935ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:37.059612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-13b1b24c-3578-42a5-b45b-01dab94cb08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:37.092404 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2022/4051] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:37.108686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1b24c-3578-42a5-b45b-01dab94cb08f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:37.120903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-13b1b24c-3578-42a5-b45b-01dab94cb08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:37.165720 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2030/4052] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:36 2022] GET /identity/v3/users => generated 8905 bytes in 576 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:37.172883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14344b-c18a-4cf8-8fbf-35b6da2eb619 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:37.172883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14344b-c18a-4cf8-8fbf-35b6da2eb619 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:37.174407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14344b-c18a-4cf8-8fbf-35b6da2eb619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:37.304336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3b14344b-c18a-4cf8-8fbf-35b6da2eb619 None None] MFA Rules not processed for user `0e5dcd8f2d1a4c9a97fe62379231f509`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:37.306504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3b14344b-c18a-4cf8-8fbf-35b6da2eb619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:37.377387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1b24c-3578-42a5-b45b-01dab94cb08f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:37.409574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7047d3-f384-4fb1-816a-89b1255f4227 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:37.409574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7047d3-f384-4fb1-816a-89b1255f4227 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:37.409574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7047d3-f384-4fb1-816a-89b1255f4227 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:37.409574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7047d3-f384-4fb1-816a-89b1255f4227 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:37.436623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7047d3-f384-4fb1-816a-89b1255f4227 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:37.443065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7047d3-f384-4fb1-816a-89b1255f4227 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:37.506662 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2023/4053] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:58:37.521911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7047d3-f384-4fb1-816a-89b1255f4227 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:37.527855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8e7047d3-f384-4fb1-816a-89b1255f4227 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:37.560070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7047d3-f384-4fb1-816a-89b1255f4227 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:37.573155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7315e-94c7-4586-ba4b-d4414aa4af7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:37.573811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7315e-94c7-4586-ba4b-d4414aa4af7e service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:37.574185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7315e-94c7-4586-ba4b-d4414aa4af7e service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:37.574704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7315e-94c7-4586-ba4b-d4414aa4af7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:37.580506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5ef7315e-94c7-4586-ba4b-d4414aa4af7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:37.612236 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2031/4054] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:37 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:37.612860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7315e-94c7-4586-ba4b-d4414aa4af7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:37.614539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7315e-94c7-4586-ba4b-d4414aa4af7e service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:37.622817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1074c-03f0-45a5-b1c5-0843141ad75c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:37.623097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1074c-03f0-45a5-b1c5-0843141ad75c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:37.623426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1074c-03f0-45a5-b1c5-0843141ad75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:37.638191 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2024/4055] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 09:58:37.680700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4cf1074c-03f0-45a5-b1c5-0843141ad75c None None] MFA Rules not processed for user `0e5dcd8f2d1a4c9a97fe62379231f509`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:37.683185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4cf1074c-03f0-45a5-b1c5-0843141ad75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:37.698676 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2032/4056] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:37 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:58:37.705495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7315e-94c7-4586-ba4b-d4414aa4af7e service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:37.724515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7315e-94c7-4586-ba4b-d4414aa4af7e service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:37.732092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46688f2c-a37a-4b8f-910d-5d60456c1d24 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5dcd8f2d1a4c9a97fe62379231f509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ec904a0f9946908c8da6c1e32ec9e1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-719743673', 'tempest-NotDelegatedRole-329732813'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:37.734330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46688f2c-a37a-4b8f-910d-5d60456c1d24 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:37.736404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46688f2c-a37a-4b8f-910d-5d60456c1d24 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:37.736882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46688f2c-a37a-4b8f-910d-5d60456c1d24 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:37.737751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46688f2c-a37a-4b8f-910d-5d60456c1d24 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: Authorizing `identity:create_trust()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:37.740826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46688f2c-a37a-4b8f-910d-5d60456c1d24 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:37.883159 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:37.933834 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2025/4057] 10.222.0.16 () {60 vars in 1174 bytes} [Fri Sep 30 09:58:37 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:37.937778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1074c-03f0-45a5-b1c5-0843141ad75c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:37.956507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1074c-03f0-45a5-b1c5-0843141ad75c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:37.966220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95f41e-13bb-44f9-b925-2d826fa38b09 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5dcd8f2d1a4c9a97fe62379231f509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ec904a0f9946908c8da6c1e32ec9e1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-719743673', 'tempest-NotDelegatedRole-329732813'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:37.967680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95f41e-13bb-44f9-b925-2d826fa38b09 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:37.968245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95f41e-13bb-44f9-b925-2d826fa38b09 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:37.969145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95f41e-13bb-44f9-b925-2d826fa38b09 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] PATH_INFO: `/v3/OS-TRUST/trusts/c219f6fed9514b71b899cf4e0ff542dc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:37.978987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95f41e-13bb-44f9-b925-2d826fa38b09 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: Authorizing `identity:get_trust(trust_id=c219f6fed9514b71b899cf4e0ff542dc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:37.982999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95f41e-13bb-44f9-b925-2d826fa38b09 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:37.998709 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2033/4058] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Sep 30 09:58:37 2022] GET /identity/v3/OS-TRUST/trusts/c219f6fed9514b71b899cf4e0ff542dc => generated 833 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:38.002985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46688f2c-a37a-4b8f-910d-5d60456c1d24 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:38.022873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46688f2c-a37a-4b8f-910d-5d60456c1d24 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:38.034141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0577cd-5b25-45ea-97d1-2705d264736c tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5dcd8f2d1a4c9a97fe62379231f509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ec904a0f9946908c8da6c1e32ec9e1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-719743673', 'tempest-NotDelegatedRole-329732813'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:38.035909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0577cd-5b25-45ea-97d1-2705d264736c tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:38.036859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0577cd-5b25-45ea-97d1-2705d264736c tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:38.037704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0577cd-5b25-45ea-97d1-2705d264736c tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] PATH_INFO: `/v3/OS-TRUST/trusts/c219f6fed9514b71b899cf4e0ff542dc/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:38.065111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0577cd-5b25-45ea-97d1-2705d264736c tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=c219f6fed9514b71b899cf4e0ff542dc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:38.073530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0577cd-5b25-45ea-97d1-2705d264736c tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:38.100378 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2026/4059] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Sep 30 09:58:38 2022] GET /identity/v3/OS-TRUST/trusts/c219f6fed9514b71b899cf4e0ff542dc/roles => generated 370 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:38.105047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95f41e-13bb-44f9-b925-2d826fa38b09 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:38.135200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95f41e-13bb-44f9-b925-2d826fa38b09 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:38.161479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafcbb6-ffb1-4670-a8d0-1aa579cf7a7b tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5dcd8f2d1a4c9a97fe62379231f509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ec904a0f9946908c8da6c1e32ec9e1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-719743673', 'tempest-NotDelegatedRole-329732813'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:38.162559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafcbb6-ffb1-4670-a8d0-1aa579cf7a7b tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:38.162844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafcbb6-ffb1-4670-a8d0-1aa579cf7a7b tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:38.163119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafcbb6-ffb1-4670-a8d0-1aa579cf7a7b tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] PATH_INFO: `/v3/OS-TRUST/trusts/c219f6fed9514b71b899cf4e0ff542dc/roles/3dd1ef86fe684e7e9d5d54de2e5bcb40` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:38.173460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafcbb6-ffb1-4670-a8d0-1aa579cf7a7b tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: Authorizing `identity:get_role_for_trust(trust_id=c219f6fed9514b71b899cf4e0ff542dc, role_id=3dd1ef86fe684e7e9d5d54de2e5bcb40)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:38.174979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafcbb6-ffb1-4670-a8d0-1aa579cf7a7b tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:38.185417 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2034/4060] 10.222.0.16 () {58 vars in 1368 bytes} [Fri Sep 30 09:58:38 2022] GET /identity/v3/OS-TRUST/trusts/c219f6fed9514b71b899cf4e0ff542dc/roles/3dd1ef86fe684e7e9d5d54de2e5bcb40 => generated 243 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:38.192638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0577cd-5b25-45ea-97d1-2705d264736c tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:38.212248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0577cd-5b25-45ea-97d1-2705d264736c tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:38.219239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa66b1-1742-48fb-9586-2cfa01a528c1 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5dcd8f2d1a4c9a97fe62379231f509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ec904a0f9946908c8da6c1e32ec9e1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-719743673', 'tempest-NotDelegatedRole-329732813'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:38.220463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa66b1-1742-48fb-9586-2cfa01a528c1 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] REQUEST_METHOD: `HEAD` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:38.220892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa66b1-1742-48fb-9586-2cfa01a528c1 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:38.221270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa66b1-1742-48fb-9586-2cfa01a528c1 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] PATH_INFO: `/v3/OS-TRUST/trusts/c219f6fed9514b71b899cf4e0ff542dc/roles/3dd1ef86fe684e7e9d5d54de2e5bcb40` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:38.230728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa66b1-1742-48fb-9586-2cfa01a528c1 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: Authorizing `identity:get_role_for_trust(trust_id=c219f6fed9514b71b899cf4e0ff542dc, role_id=3dd1ef86fe684e7e9d5d54de2e5bcb40)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:38.232670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa66b1-1742-48fb-9586-2cfa01a528c1 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:38.241011 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2027/4061] 10.222.0.16 () {58 vars in 1369 bytes} [Fri Sep 30 09:58:38 2022] HEAD /identity/v3/OS-TRUST/trusts/c219f6fed9514b71b899cf4e0ff542dc/roles/3dd1ef86fe684e7e9d5d54de2e5bcb40 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:38.247252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafcbb6-ffb1-4670-a8d0-1aa579cf7a7b tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:38.267852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafcbb6-ffb1-4670-a8d0-1aa579cf7a7b tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:38.285450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fd610-bdfb-42b1-87a0-6469b612c8c1 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5dcd8f2d1a4c9a97fe62379231f509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ec904a0f9946908c8da6c1e32ec9e1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-719743673', 'tempest-NotDelegatedRole-329732813'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:38.286816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fd610-bdfb-42b1-87a0-6469b612c8c1 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:38.287340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fd610-bdfb-42b1-87a0-6469b612c8c1 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:38.289013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fd610-bdfb-42b1-87a0-6469b612c8c1 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] PATH_INFO: `/v3/OS-TRUST/trusts/c219f6fed9514b71b899cf4e0ff542dc/roles/1b572638ccf7483690197100950ecfd7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:38.300332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fd610-bdfb-42b1-87a0-6469b612c8c1 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: Authorizing `identity:get_role_for_trust(trust_id=c219f6fed9514b71b899cf4e0ff542dc, role_id=1b572638ccf7483690197100950ecfd7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:38.301824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fd610-bdfb-42b1-87a0-6469b612c8c1 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:38.322458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-ba1fd610-bdfb-42b1-87a0-6469b612c8c1 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Could not find role: 1b572638ccf7483690197100950ecfd7.: keystone.exception.RoleNotFound: Could not find role: 1b572638ccf7483690197100950ecfd7. Sep 30 09:58:38.322458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:38.322458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:58:38.322458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:58:38.322458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:58:38.322458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:58:38.322458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:58:38.322458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:58:38.322458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:58:38.322458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:58:38.322458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:58:38.322458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:58:38.322458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 30 09:58:38.322458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:58:38.322458 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 1b572638ccf7483690197100950ecfd7. Sep 30 09:58:38.324521 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:38.324521 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2035/4062] 10.222.0.16 () {58 vars in 1368 bytes} [Fri Sep 30 09:58:38 2022] GET /identity/v3/OS-TRUST/trusts/c219f6fed9514b71b899cf4e0ff542dc/roles/1b572638ccf7483690197100950ecfd7 => generated 110 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 09:58:38.328462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa66b1-1742-48fb-9586-2cfa01a528c1 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:38.347530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa66b1-1742-48fb-9586-2cfa01a528c1 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:38.357870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2c4dd-3702-4c75-ad10-d6e1e82007d3 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5dcd8f2d1a4c9a97fe62379231f509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ec904a0f9946908c8da6c1e32ec9e1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-719743673', 'tempest-NotDelegatedRole-329732813'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:38.360479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2c4dd-3702-4c75-ad10-d6e1e82007d3 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] REQUEST_METHOD: `HEAD` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:38.361086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2c4dd-3702-4c75-ad10-d6e1e82007d3 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:38.361748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2c4dd-3702-4c75-ad10-d6e1e82007d3 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] PATH_INFO: `/v3/OS-TRUST/trusts/c219f6fed9514b71b899cf4e0ff542dc/roles/1b572638ccf7483690197100950ecfd7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:38.371090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2c4dd-3702-4c75-ad10-d6e1e82007d3 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: Authorizing `identity:get_role_for_trust(trust_id=c219f6fed9514b71b899cf4e0ff542dc, role_id=1b572638ccf7483690197100950ecfd7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:38.373071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2c4dd-3702-4c75-ad10-d6e1e82007d3 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:38.391548 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-54c2c4dd-3702-4c75-ad10-d6e1e82007d3 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Could not find role: 1b572638ccf7483690197100950ecfd7.: keystone.exception.RoleNotFound: Could not find role: 1b572638ccf7483690197100950ecfd7. Sep 30 09:58:38.391548 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:38.391548 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:58:38.391548 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:58:38.391548 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:58:38.391548 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:58:38.391548 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:58:38.391548 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:58:38.391548 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:58:38.391548 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:58:38.391548 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:58:38.391548 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:58:38.391548 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 30 09:58:38.391548 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:58:38.391548 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 1b572638ccf7483690197100950ecfd7. Sep 30 09:58:38.393130 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:58:38.394917 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2028/4063] 10.222.0.16 () {58 vars in 1369 bytes} [Fri Sep 30 09:58:38 2022] HEAD /identity/v3/OS-TRUST/trusts/c219f6fed9514b71b899cf4e0ff542dc/roles/1b572638ccf7483690197100950ecfd7 => generated 0 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Sep 30 09:58:38.399508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fd610-bdfb-42b1-87a0-6469b612c8c1 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:38.416555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fd610-bdfb-42b1-87a0-6469b612c8c1 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:38.441902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0b034-a7ff-4464-b2a1-139ce6131890 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5dcd8f2d1a4c9a97fe62379231f509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ec904a0f9946908c8da6c1e32ec9e1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-719743673', 'tempest-NotDelegatedRole-329732813'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:38.443303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0b034-a7ff-4464-b2a1-139ce6131890 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:38.457309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0b034-a7ff-4464-b2a1-139ce6131890 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:38.458792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0b034-a7ff-4464-b2a1-139ce6131890 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] PATH_INFO: `/v3/OS-TRUST/trusts/c219f6fed9514b71b899cf4e0ff542dc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:38.477786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0b034-a7ff-4464-b2a1-139ce6131890 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: Authorizing `identity:delete_trust(trust_id=c219f6fed9514b71b899cf4e0ff542dc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:38.479713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0b034-a7ff-4464-b2a1-139ce6131890 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:38.513697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-25f0b034-a7ff-4464-b2a1-139ce6131890 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'c219f6fed9514b71b899cf4e0ff542dc', 'request_id': 'req-25f0b034-a7ff-4464-b2a1-139ce6131890'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:38.515071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-25f0b034-a7ff-4464-b2a1-139ce6131890 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'c219f6fed9514b71b899cf4e0ff542dc', 'request_id': 'req-25f0b034-a7ff-4464-b2a1-139ce6131890'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:38.542795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-25f0b034-a7ff-4464-b2a1-139ce6131890 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'c219f6fed9514b71b899cf4e0ff542dc', 'request_id': 'req-25f0b034-a7ff-4464-b2a1-139ce6131890'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:38.557295 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2036/4064] 10.222.0.16 () {58 vars in 1254 bytes} [Fri Sep 30 09:58:38 2022] DELETE /identity/v3/OS-TRUST/trusts/c219f6fed9514b71b899cf4e0ff542dc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:38.561595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2c4dd-3702-4c75-ad10-d6e1e82007d3 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:38.563923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-54c2c4dd-3702-4c75-ad10-d6e1e82007d3 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:38.587766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2c4dd-3702-4c75-ad10-d6e1e82007d3 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:38.612820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873ea54-a261-4f66-8f6d-082892964be9 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5dcd8f2d1a4c9a97fe62379231f509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ec904a0f9946908c8da6c1e32ec9e1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-719743673', 'tempest-NotDelegatedRole-329732813'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:38.613636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873ea54-a261-4f66-8f6d-082892964be9 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:38.613920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873ea54-a261-4f66-8f6d-082892964be9 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:38.614192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873ea54-a261-4f66-8f6d-082892964be9 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] PATH_INFO: `/v3/OS-TRUST/trusts/c219f6fed9514b71b899cf4e0ff542dc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:38.657886 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-2873ea54-a261-4f66-8f6d-082892964be9 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Could not find trust: c219f6fed9514b71b899cf4e0ff542dc.: keystone.exception.TrustNotFound: Could not find trust: c219f6fed9514b71b899cf4e0ff542dc. Sep 30 09:58:38.657886 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:38.657886 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:58:38.657886 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:58:38.657886 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:58:38.657886 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:58:38.657886 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:58:38.657886 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:58:38.657886 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:58:38.657886 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:58:38.657886 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:58:38.657886 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:58:38.657886 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 30 09:58:38.657886 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 30 09:58:38.657886 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 30 09:58:38.659543 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 30 09:58:38.659543 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 30 09:58:38.659543 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 30 09:58:38.659543 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 30 09:58:38.659543 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 30 09:58:38.659543 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:58:38.659543 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:58:38.659543 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 30 09:58:38.659543 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 30 09:58:38.659543 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 30 09:58:38.659543 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 30 09:58:38.659543 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: c219f6fed9514b71b899cf4e0ff542dc. Sep 30 09:58:38.659543 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:58:38.659543 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2029/4065] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Sep 30 09:58:38 2022] GET /identity/v3/OS-TRUST/trusts/c219f6fed9514b71b899cf4e0ff542dc => generated 111 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 09:58:38.669720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0b034-a7ff-4464-b2a1-139ce6131890 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:38.671333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-25f0b034-a7ff-4464-b2a1-139ce6131890 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:38.686441 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:38.713843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0b034-a7ff-4464-b2a1-139ce6131890 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:38.720928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f291d87-7f09-4cdc-8782-bc3d77950677 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:38.722288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f291d87-7f09-4cdc-8782-bc3d77950677 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:38.722596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f291d87-7f09-4cdc-8782-bc3d77950677 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:38.722849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f291d87-7f09-4cdc-8782-bc3d77950677 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles/1b572638ccf7483690197100950ecfd7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:38.724466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f291d87-7f09-4cdc-8782-bc3d77950677 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1b572638ccf7483690197100950ecfd7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:38.727558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f291d87-7f09-4cdc-8782-bc3d77950677 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:38.793091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1f291d87-7f09-4cdc-8782-bc3d77950677 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invalidating the token cache because role 1b572638ccf7483690197100950ecfd7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:38.806572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1f291d87-7f09-4cdc-8782-bc3d77950677 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:38.820225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1f291d87-7f09-4cdc-8782-bc3d77950677 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:38.823959 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2037/4066] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:38 2022] DELETE /identity/v3/roles/1b572638ccf7483690197100950ecfd7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:38.828499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873ea54-a261-4f66-8f6d-082892964be9 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:38.831684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2873ea54-a261-4f66-8f6d-082892964be9 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:38.888747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873ea54-a261-4f66-8f6d-082892964be9 tempest-TrustsV3TestJSON-1139681755 tempest-user-544536800] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:39.099184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5042c-d82f-4577-bb54-08d66f1c34c7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:39.104805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5042c-d82f-4577-bb54-08d66f1c34c7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:39.105075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5042c-d82f-4577-bb54-08d66f1c34c7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:39.105435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5042c-d82f-4577-bb54-08d66f1c34c7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles/3dd1ef86fe684e7e9d5d54de2e5bcb40` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:39.107315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5042c-d82f-4577-bb54-08d66f1c34c7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3dd1ef86fe684e7e9d5d54de2e5bcb40)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:39.109226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5042c-d82f-4577-bb54-08d66f1c34c7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:39.258384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b2b5042c-d82f-4577-bb54-08d66f1c34c7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invalidating the token cache because role 3dd1ef86fe684e7e9d5d54de2e5bcb40 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:39.258920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b2b5042c-d82f-4577-bb54-08d66f1c34c7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:39.261191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b2b5042c-d82f-4577-bb54-08d66f1c34c7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:39.267913 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2030/4067] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:38 2022] DELETE /identity/v3/roles/3dd1ef86fe684e7e9d5d54de2e5bcb40 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:39.271705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f291d87-7f09-4cdc-8782-bc3d77950677 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:39.293050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f291d87-7f09-4cdc-8782-bc3d77950677 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:39.465703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223048b-c333-4528-81fa-1a51338b8a04 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:39.468432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223048b-c333-4528-81fa-1a51338b8a04 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:39.468754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223048b-c333-4528-81fa-1a51338b8a04 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:39.470059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223048b-c333-4528-81fa-1a51338b8a04 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/users/0e5dcd8f2d1a4c9a97fe62379231f509` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:39.482780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223048b-c333-4528-81fa-1a51338b8a04 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0e5dcd8f2d1a4c9a97fe62379231f509)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:39.484975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223048b-c333-4528-81fa-1a51338b8a04 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:39.666658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9223048b-c333-4528-81fa-1a51338b8a04 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e5dcd8f2d1a4c9a97fe62379231f509'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:39.668070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9223048b-c333-4528-81fa-1a51338b8a04 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e5dcd8f2d1a4c9a97fe62379231f509'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:39.693230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9223048b-c333-4528-81fa-1a51338b8a04 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e5dcd8f2d1a4c9a97fe62379231f509'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:39.719624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9223048b-c333-4528-81fa-1a51338b8a04 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e5dcd8f2d1a4c9a97fe62379231f509'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:39.745610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9223048b-c333-4528-81fa-1a51338b8a04 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e5dcd8f2d1a4c9a97fe62379231f509'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:39.758310 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2038/4068] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:39 2022] DELETE /identity/v3/users/0e5dcd8f2d1a4c9a97fe62379231f509 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:39.763219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5042c-d82f-4577-bb54-08d66f1c34c7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:39.765003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b2b5042c-d82f-4577-bb54-08d66f1c34c7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:39.788593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5042c-d82f-4577-bb54-08d66f1c34c7 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:39.899149 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:39.947569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd1276-54ed-44a1-874f-8d1a17f4a47e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:39.949502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd1276-54ed-44a1-874f-8d1a17f4a47e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:39.952923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd1276-54ed-44a1-874f-8d1a17f4a47e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:39.955078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd1276-54ed-44a1-874f-8d1a17f4a47e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects/c0ec904a0f9946908c8da6c1e32ec9e1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:39.957292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd1276-54ed-44a1-874f-8d1a17f4a47e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c0ec904a0f9946908c8da6c1e32ec9e1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:39.962179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd1276-54ed-44a1-874f-8d1a17f4a47e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:40.065173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223048b-c333-4528-81fa-1a51338b8a04 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:40.066684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9223048b-c333-4528-81fa-1a51338b8a04 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:40.082728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7dbd1276-54ed-44a1-874f-8d1a17f4a47e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0ec904a0f9946908c8da6c1e32ec9e1', 'request_id': 'req-7dbd1276-54ed-44a1-874f-8d1a17f4a47e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:40.095718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7dbd1276-54ed-44a1-874f-8d1a17f4a47e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0ec904a0f9946908c8da6c1e32ec9e1', 'request_id': 'req-7dbd1276-54ed-44a1-874f-8d1a17f4a47e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:40.106272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7dbd1276-54ed-44a1-874f-8d1a17f4a47e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0ec904a0f9946908c8da6c1e32ec9e1', 'request_id': 'req-7dbd1276-54ed-44a1-874f-8d1a17f4a47e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:40.133470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7dbd1276-54ed-44a1-874f-8d1a17f4a47e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] The token cache is being invalidate because project c0ec904a0f9946908c8da6c1e32ec9e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:40.133470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7dbd1276-54ed-44a1-874f-8d1a17f4a47e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:40.134754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7dbd1276-54ed-44a1-874f-8d1a17f4a47e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:40.147522 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2031/4069] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:39 2022] DELETE /identity/v3/projects/c0ec904a0f9946908c8da6c1e32ec9e1 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:40.153841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd1276-54ed-44a1-874f-8d1a17f4a47e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:40.155257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7dbd1276-54ed-44a1-874f-8d1a17f4a47e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:40.173173 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:40.204878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223048b-c333-4528-81fa-1a51338b8a04 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:40.338110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a33c3e-07b0-4fd5-895b-ab1e17181787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:40.340163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a33c3e-07b0-4fd5-895b-ab1e17181787 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:40.340163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a33c3e-07b0-4fd5-895b-ab1e17181787 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:40.340163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a33c3e-07b0-4fd5-895b-ab1e17181787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:40.350436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-00a33c3e-07b0-4fd5-895b-ab1e17181787 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:40.381063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd1276-54ed-44a1-874f-8d1a17f4a47e tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:40.386335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a33c3e-07b0-4fd5-895b-ab1e17181787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:40.387880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a33c3e-07b0-4fd5-895b-ab1e17181787 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:40.407359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388af33e-a670-4546-a131-a0a402bd3f17 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:40.408077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388af33e-a670-4546-a131-a0a402bd3f17 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:40.408417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388af33e-a670-4546-a131-a0a402bd3f17 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:40.408838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388af33e-a670-4546-a131-a0a402bd3f17 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:40.409595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388af33e-a670-4546-a131-a0a402bd3f17 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:40.413150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388af33e-a670-4546-a131-a0a402bd3f17 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:40.421413 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2039/4070] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:58:40.527432 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2032/4071] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Sep 30 09:58:40 2022] POST /identity/v3/projects => generated 329 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:40.531487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a33c3e-07b0-4fd5-895b-ab1e17181787 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:40.582759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a33c3e-07b0-4fd5-895b-ab1e17181787 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:40.864401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88820e50-bb9f-4551-a6d3-55658c2f033b tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:40.865258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88820e50-bb9f-4551-a6d3-55658c2f033b tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:40.865775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88820e50-bb9f-4551-a6d3-55658c2f033b tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:40.866083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88820e50-bb9f-4551-a6d3-55658c2f033b tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:40.867156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88820e50-bb9f-4551-a6d3-55658c2f033b tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:40.869933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88820e50-bb9f-4551-a6d3-55658c2f033b tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:40.928805 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2040/4072] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:58:40 2022] POST /identity/v3/users => generated 413 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:40.968217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388af33e-a670-4546-a131-a0a402bd3f17 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:40.974153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388af33e-a670-4546-a131-a0a402bd3f17 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:40.997453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793b47f-5342-4fcf-8e80-6a881a72cf2d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:40.999153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793b47f-5342-4fcf-8e80-6a881a72cf2d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:40.999459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793b47f-5342-4fcf-8e80-6a881a72cf2d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:40.999745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793b47f-5342-4fcf-8e80-6a881a72cf2d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:41.009153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793b47f-5342-4fcf-8e80-6a881a72cf2d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:41.013713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793b47f-5342-4fcf-8e80-6a881a72cf2d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:41.059560 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2033/4073] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 09:58:40 2022] POST /identity/v3/roles => generated 243 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:41.061324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88820e50-bb9f-4551-a6d3-55658c2f033b tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:41.086024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88820e50-bb9f-4551-a6d3-55658c2f033b tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:41.102703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8f3e5-185a-4ce3-b427-1cac1f04abd4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:41.103332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8f3e5-185a-4ce3-b427-1cac1f04abd4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:41.105604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8f3e5-185a-4ce3-b427-1cac1f04abd4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:41.106466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8f3e5-185a-4ce3-b427-1cac1f04abd4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:41.107175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8f3e5-185a-4ce3-b427-1cac1f04abd4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:41.112856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8f3e5-185a-4ce3-b427-1cac1f04abd4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:41.161598 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2041/4074] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 09:58:41 2022] POST /identity/v3/roles => generated 247 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:41.164227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793b47f-5342-4fcf-8e80-6a881a72cf2d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:41.212591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793b47f-5342-4fcf-8e80-6a881a72cf2d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:41.234386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05599a7-6691-421e-bcbc-2f0af40a076d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:41.235915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05599a7-6691-421e-bcbc-2f0af40a076d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:41.236205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05599a7-6691-421e-bcbc-2f0af40a076d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:41.236723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05599a7-6691-421e-bcbc-2f0af40a076d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects/e59fa8e955df4ed9b5b9884e3f577d57/users/5d64b90786524de1b07cc1284ce1c27e/roles/633e8593a60e4ba3b7e6a5f5129d075c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:41.282822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05599a7-6691-421e-bcbc-2f0af40a076d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e59fa8e955df4ed9b5b9884e3f577d57, user_id=5d64b90786524de1b07cc1284ce1c27e, role_id=633e8593a60e4ba3b7e6a5f5129d075c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:41.285821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05599a7-6691-421e-bcbc-2f0af40a076d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:41.322771 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2034/4075] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:41 2022] PUT /identity/v3/projects/e59fa8e955df4ed9b5b9884e3f577d57/users/5d64b90786524de1b07cc1284ce1c27e/roles/633e8593a60e4ba3b7e6a5f5129d075c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:41.328762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8f3e5-185a-4ce3-b427-1cac1f04abd4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:41.355633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8f3e5-185a-4ce3-b427-1cac1f04abd4 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:41.653203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be322116-86f1-47f4-a0f5-6b1179a1f08b tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:41.657171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be322116-86f1-47f4-a0f5-6b1179a1f08b tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:41.657479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be322116-86f1-47f4-a0f5-6b1179a1f08b tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:41.657765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be322116-86f1-47f4-a0f5-6b1179a1f08b tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects/e59fa8e955df4ed9b5b9884e3f577d57/users/5d64b90786524de1b07cc1284ce1c27e/roles/0c6f3ed458a0456fa29a7a6df9106b3f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:41.665249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be322116-86f1-47f4-a0f5-6b1179a1f08b tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e59fa8e955df4ed9b5b9884e3f577d57, user_id=5d64b90786524de1b07cc1284ce1c27e, role_id=0c6f3ed458a0456fa29a7a6df9106b3f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:41.671180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be322116-86f1-47f4-a0f5-6b1179a1f08b tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:41.703354 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2042/4076] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:41 2022] PUT /identity/v3/projects/e59fa8e955df4ed9b5b9884e3f577d57/users/5d64b90786524de1b07cc1284ce1c27e/roles/0c6f3ed458a0456fa29a7a6df9106b3f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:41.712130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05599a7-6691-421e-bcbc-2f0af40a076d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:41.737903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05599a7-6691-421e-bcbc-2f0af40a076d tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:41.784996 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:41.934016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437f59a-4d16-4191-808d-af70abcedb53 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:41.935048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437f59a-4d16-4191-808d-af70abcedb53 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:41.935428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437f59a-4d16-4191-808d-af70abcedb53 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:41.935965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437f59a-4d16-4191-808d-af70abcedb53 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:41.937336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437f59a-4d16-4191-808d-af70abcedb53 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:41.942432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437f59a-4d16-4191-808d-af70abcedb53 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:42.040585 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2035/4077] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:41 2022] GET /identity/v3/users => generated 8905 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:58:42.043651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9268e0-01da-4573-83ca-f01066503f5a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:42.045029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9268e0-01da-4573-83ca-f01066503f5a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:42.045765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9268e0-01da-4573-83ca-f01066503f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:42.107821 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:42.180551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6e9268e0-01da-4573-83ca-f01066503f5a None None] MFA Rules not processed for user `5d64b90786524de1b07cc1284ce1c27e`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:42.182153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6e9268e0-01da-4573-83ca-f01066503f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:42.310316 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2043/4078] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:42 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:42.322562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998f24d-bab2-4eeb-bc3a-d3cf780080d8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:42.322910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998f24d-bab2-4eeb-bc3a-d3cf780080d8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:42.323210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998f24d-bab2-4eeb-bc3a-d3cf780080d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:42.374485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2998f24d-bab2-4eeb-bc3a-d3cf780080d8 None None] MFA Rules not processed for user `5d64b90786524de1b07cc1284ce1c27e`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:42.379626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2998f24d-bab2-4eeb-bc3a-d3cf780080d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:42.398604 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2036/4079] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:42 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:42.403094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9268e0-01da-4573-83ca-f01066503f5a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:42.421523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9268e0-01da-4573-83ca-f01066503f5a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:42.435836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4f92c-65a7-4e06-bbcf-e87eae660667 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d64b90786524de1b07cc1284ce1c27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59fa8e955df4ed9b5b9884e3f577d57', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-111697782', 'tempest-NotDelegatedRole-1807437887'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:42.436877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4f92c-65a7-4e06-bbcf-e87eae660667 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:42.437274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4f92c-65a7-4e06-bbcf-e87eae660667 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:42.437545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4f92c-65a7-4e06-bbcf-e87eae660667 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:42.438392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4f92c-65a7-4e06-bbcf-e87eae660667 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: Authorizing `identity:create_trust()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:42.439877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4f92c-65a7-4e06-bbcf-e87eae660667 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:42.626524 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2044/4080] 10.222.0.16 () {60 vars in 1174 bytes} [Fri Sep 30 09:58:42 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:42.631649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998f24d-bab2-4eeb-bc3a-d3cf780080d8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:42.655249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998f24d-bab2-4eeb-bc3a-d3cf780080d8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:42.677383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17483a9d-3a05-4f02-a609-048dc113c09d tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d64b90786524de1b07cc1284ce1c27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59fa8e955df4ed9b5b9884e3f577d57', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-111697782', 'tempest-NotDelegatedRole-1807437887'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:42.683718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17483a9d-3a05-4f02-a609-048dc113c09d tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:42.684225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17483a9d-3a05-4f02-a609-048dc113c09d tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:42.685991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17483a9d-3a05-4f02-a609-048dc113c09d tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] PATH_INFO: `/v3/OS-TRUST/trusts/a4397e2369c6465b9c6304006c4bad2f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:42.707340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17483a9d-3a05-4f02-a609-048dc113c09d tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: Authorizing `identity:get_trust(trust_id=a4397e2369c6465b9c6304006c4bad2f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:42.714742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17483a9d-3a05-4f02-a609-048dc113c09d tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:42.739430 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2037/4081] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Sep 30 09:58:42 2022] GET /identity/v3/OS-TRUST/trusts/a4397e2369c6465b9c6304006c4bad2f => generated 834 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:42.744263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4f92c-65a7-4e06-bbcf-e87eae660667 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:42.768592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4f92c-65a7-4e06-bbcf-e87eae660667 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:42.784753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592b58f-0ed9-4e2d-89d5-4ed8a802b045 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d64b90786524de1b07cc1284ce1c27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59fa8e955df4ed9b5b9884e3f577d57', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-111697782', 'tempest-NotDelegatedRole-1807437887'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:42.785849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592b58f-0ed9-4e2d-89d5-4ed8a802b045 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:42.786694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592b58f-0ed9-4e2d-89d5-4ed8a802b045 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:42.787290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592b58f-0ed9-4e2d-89d5-4ed8a802b045 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] PATH_INFO: `/v3/OS-TRUST/trusts/a4397e2369c6465b9c6304006c4bad2f/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:42.818690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592b58f-0ed9-4e2d-89d5-4ed8a802b045 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=a4397e2369c6465b9c6304006c4bad2f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:42.820644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592b58f-0ed9-4e2d-89d5-4ed8a802b045 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:42.856720 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2045/4082] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Sep 30 09:58:42 2022] GET /identity/v3/OS-TRUST/trusts/a4397e2369c6465b9c6304006c4bad2f/roles => generated 370 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:42.861213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17483a9d-3a05-4f02-a609-048dc113c09d tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:42.883604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17483a9d-3a05-4f02-a609-048dc113c09d tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:42.894458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae1ff4-7807-4461-8164-9a36801374ad tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d64b90786524de1b07cc1284ce1c27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59fa8e955df4ed9b5b9884e3f577d57', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-111697782', 'tempest-NotDelegatedRole-1807437887'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:42.895205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae1ff4-7807-4461-8164-9a36801374ad tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:42.895493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae1ff4-7807-4461-8164-9a36801374ad tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:42.897100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae1ff4-7807-4461-8164-9a36801374ad tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] PATH_INFO: `/v3/OS-TRUST/trusts/a4397e2369c6465b9c6304006c4bad2f/roles/633e8593a60e4ba3b7e6a5f5129d075c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:42.919000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae1ff4-7807-4461-8164-9a36801374ad tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a4397e2369c6465b9c6304006c4bad2f, role_id=633e8593a60e4ba3b7e6a5f5129d075c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:42.920852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae1ff4-7807-4461-8164-9a36801374ad tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:42.931943 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2038/4083] 10.222.0.16 () {58 vars in 1368 bytes} [Fri Sep 30 09:58:42 2022] GET /identity/v3/OS-TRUST/trusts/a4397e2369c6465b9c6304006c4bad2f/roles/633e8593a60e4ba3b7e6a5f5129d075c => generated 243 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:42.935907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592b58f-0ed9-4e2d-89d5-4ed8a802b045 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:42.956294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592b58f-0ed9-4e2d-89d5-4ed8a802b045 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:42.984085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4aab0-10e6-4b39-b1de-96565044f024 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d64b90786524de1b07cc1284ce1c27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59fa8e955df4ed9b5b9884e3f577d57', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-111697782', 'tempest-NotDelegatedRole-1807437887'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:42.984802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4aab0-10e6-4b39-b1de-96565044f024 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:42.987042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4aab0-10e6-4b39-b1de-96565044f024 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:42.987328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4aab0-10e6-4b39-b1de-96565044f024 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] PATH_INFO: `/v3/OS-TRUST/trusts/a4397e2369c6465b9c6304006c4bad2f/roles/633e8593a60e4ba3b7e6a5f5129d075c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:43.008678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4aab0-10e6-4b39-b1de-96565044f024 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a4397e2369c6465b9c6304006c4bad2f, role_id=633e8593a60e4ba3b7e6a5f5129d075c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:43.011871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4aab0-10e6-4b39-b1de-96565044f024 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:43.038175 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2046/4084] 10.222.0.16 () {58 vars in 1369 bytes} [Fri Sep 30 09:58:42 2022] HEAD /identity/v3/OS-TRUST/trusts/a4397e2369c6465b9c6304006c4bad2f/roles/633e8593a60e4ba3b7e6a5f5129d075c => generated 0 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Sep 30 09:58:43.042344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae1ff4-7807-4461-8164-9a36801374ad tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:43.071337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae1ff4-7807-4461-8164-9a36801374ad tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:43.083451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e20f1c-757c-41b6-be17-6a9d631c8dcd tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d64b90786524de1b07cc1284ce1c27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59fa8e955df4ed9b5b9884e3f577d57', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-111697782', 'tempest-NotDelegatedRole-1807437887'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:43.084247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e20f1c-757c-41b6-be17-6a9d631c8dcd tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:43.084460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e20f1c-757c-41b6-be17-6a9d631c8dcd tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:43.084810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e20f1c-757c-41b6-be17-6a9d631c8dcd tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] PATH_INFO: `/v3/OS-TRUST/trusts/a4397e2369c6465b9c6304006c4bad2f/roles/0c6f3ed458a0456fa29a7a6df9106b3f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:43.109982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e20f1c-757c-41b6-be17-6a9d631c8dcd tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a4397e2369c6465b9c6304006c4bad2f, role_id=0c6f3ed458a0456fa29a7a6df9106b3f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:43.111372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e20f1c-757c-41b6-be17-6a9d631c8dcd tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:43.139397 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-49e20f1c-757c-41b6-be17-6a9d631c8dcd tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Could not find role: 0c6f3ed458a0456fa29a7a6df9106b3f.: keystone.exception.RoleNotFound: Could not find role: 0c6f3ed458a0456fa29a7a6df9106b3f. Sep 30 09:58:43.139397 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:43.139397 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:58:43.139397 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:58:43.139397 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:58:43.139397 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:58:43.139397 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:58:43.139397 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:58:43.139397 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:58:43.139397 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:58:43.139397 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:58:43.139397 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:58:43.139397 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 30 09:58:43.139397 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:58:43.139397 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 0c6f3ed458a0456fa29a7a6df9106b3f. Sep 30 09:58:43.141057 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:58:43.147420 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2039/4085] 10.222.0.16 () {58 vars in 1368 bytes} [Fri Sep 30 09:58:43 2022] GET /identity/v3/OS-TRUST/trusts/a4397e2369c6465b9c6304006c4bad2f/roles/0c6f3ed458a0456fa29a7a6df9106b3f => generated 110 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 09:58:43.150770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4aab0-10e6-4b39-b1de-96565044f024 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:43.171030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4aab0-10e6-4b39-b1de-96565044f024 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:43.184520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e71537-5ef3-47f6-90a6-473e7349c63e tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d64b90786524de1b07cc1284ce1c27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59fa8e955df4ed9b5b9884e3f577d57', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-111697782', 'tempest-NotDelegatedRole-1807437887'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:43.190440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e71537-5ef3-47f6-90a6-473e7349c63e tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:43.191876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e71537-5ef3-47f6-90a6-473e7349c63e tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:43.192172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e71537-5ef3-47f6-90a6-473e7349c63e tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] PATH_INFO: `/v3/OS-TRUST/trusts/a4397e2369c6465b9c6304006c4bad2f/roles/0c6f3ed458a0456fa29a7a6df9106b3f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:43.222915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e71537-5ef3-47f6-90a6-473e7349c63e tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a4397e2369c6465b9c6304006c4bad2f, role_id=0c6f3ed458a0456fa29a7a6df9106b3f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:43.224759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e71537-5ef3-47f6-90a6-473e7349c63e tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:43.247950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-03e71537-5ef3-47f6-90a6-473e7349c63e tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Could not find role: 0c6f3ed458a0456fa29a7a6df9106b3f.: keystone.exception.RoleNotFound: Could not find role: 0c6f3ed458a0456fa29a7a6df9106b3f. Sep 30 09:58:43.247950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:43.247950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:58:43.247950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:58:43.247950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:58:43.247950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:58:43.247950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:58:43.247950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:58:43.247950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:58:43.247950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:58:43.247950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:58:43.247950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:58:43.247950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 30 09:58:43.247950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 09:58:43.247950 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 0c6f3ed458a0456fa29a7a6df9106b3f. Sep 30 09:58:43.249352 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:43.254517 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2047/4086] 10.222.0.16 () {58 vars in 1369 bytes} [Fri Sep 30 09:58:43 2022] HEAD /identity/v3/OS-TRUST/trusts/a4397e2369c6465b9c6304006c4bad2f/roles/0c6f3ed458a0456fa29a7a6df9106b3f => generated 0 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Sep 30 09:58:43.259076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e20f1c-757c-41b6-be17-6a9d631c8dcd tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:43.283216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e20f1c-757c-41b6-be17-6a9d631c8dcd tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:43.301093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effaccee-8f32-4478-8627-175501a75f63 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d64b90786524de1b07cc1284ce1c27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59fa8e955df4ed9b5b9884e3f577d57', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-111697782', 'tempest-NotDelegatedRole-1807437887'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:43.306500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effaccee-8f32-4478-8627-175501a75f63 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:43.306788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effaccee-8f32-4478-8627-175501a75f63 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:43.307074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effaccee-8f32-4478-8627-175501a75f63 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] PATH_INFO: `/v3/OS-TRUST/trusts/a4397e2369c6465b9c6304006c4bad2f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:43.337254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effaccee-8f32-4478-8627-175501a75f63 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: Authorizing `identity:delete_trust(trust_id=a4397e2369c6465b9c6304006c4bad2f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:43.338868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effaccee-8f32-4478-8627-175501a75f63 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:43.406988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-effaccee-8f32-4478-8627-175501a75f63 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a4397e2369c6465b9c6304006c4bad2f', 'request_id': 'req-effaccee-8f32-4478-8627-175501a75f63'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:43.408190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-effaccee-8f32-4478-8627-175501a75f63 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'a4397e2369c6465b9c6304006c4bad2f', 'request_id': 'req-effaccee-8f32-4478-8627-175501a75f63'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:43.424411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-effaccee-8f32-4478-8627-175501a75f63 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a4397e2369c6465b9c6304006c4bad2f', 'request_id': 'req-effaccee-8f32-4478-8627-175501a75f63'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:43.435421 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2040/4087] 10.222.0.16 () {58 vars in 1254 bytes} [Fri Sep 30 09:58:43 2022] DELETE /identity/v3/OS-TRUST/trusts/a4397e2369c6465b9c6304006c4bad2f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:43.439597 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e71537-5ef3-47f6-90a6-473e7349c63e tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:43.441493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-03e71537-5ef3-47f6-90a6-473e7349c63e tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:43.483354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e71537-5ef3-47f6-90a6-473e7349c63e tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:43.503638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d4be8-a050-474f-bcc7-07bc2fea9fb5 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d64b90786524de1b07cc1284ce1c27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59fa8e955df4ed9b5b9884e3f577d57', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-111697782', 'tempest-NotDelegatedRole-1807437887'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:43.504272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d4be8-a050-474f-bcc7-07bc2fea9fb5 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:43.504670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d4be8-a050-474f-bcc7-07bc2fea9fb5 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:43.505001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d4be8-a050-474f-bcc7-07bc2fea9fb5 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] PATH_INFO: `/v3/OS-TRUST/trusts/a4397e2369c6465b9c6304006c4bad2f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:43.521114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-826d4be8-a050-474f-bcc7-07bc2fea9fb5 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Could not find trust: a4397e2369c6465b9c6304006c4bad2f.: keystone.exception.TrustNotFound: Could not find trust: a4397e2369c6465b9c6304006c4bad2f. Sep 30 09:58:43.521114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:43.521114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:58:43.521114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:58:43.521114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:58:43.521114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:58:43.521114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:58:43.521114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:58:43.521114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:58:43.521114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:58:43.521114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:58:43.521114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:58:43.521114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 30 09:58:43.521114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 30 09:58:43.521114 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 30 09:58:43.523002 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 30 09:58:43.523002 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 30 09:58:43.523002 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 30 09:58:43.523002 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 30 09:58:43.523002 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 30 09:58:43.523002 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:58:43.523002 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:58:43.523002 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 30 09:58:43.523002 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 30 09:58:43.523002 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 30 09:58:43.523002 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 30 09:58:43.523002 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: a4397e2369c6465b9c6304006c4bad2f. Sep 30 09:58:43.523002 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:43.526480 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2048/4088] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Sep 30 09:58:43 2022] GET /identity/v3/OS-TRUST/trusts/a4397e2369c6465b9c6304006c4bad2f => generated 111 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 09:58:43.527119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effaccee-8f32-4478-8627-175501a75f63 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:43.531292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-effaccee-8f32-4478-8627-175501a75f63 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:43.563673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effaccee-8f32-4478-8627-175501a75f63 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:43.568738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c22b36-2e8f-4ac8-a46b-1b9d1aeca030 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:43.569429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c22b36-2e8f-4ac8-a46b-1b9d1aeca030 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:43.569740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c22b36-2e8f-4ac8-a46b-1b9d1aeca030 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:43.570005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c22b36-2e8f-4ac8-a46b-1b9d1aeca030 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles/0c6f3ed458a0456fa29a7a6df9106b3f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:43.573691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c22b36-2e8f-4ac8-a46b-1b9d1aeca030 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0c6f3ed458a0456fa29a7a6df9106b3f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:43.575305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c22b36-2e8f-4ac8-a46b-1b9d1aeca030 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:43.669279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c5c22b36-2e8f-4ac8-a46b-1b9d1aeca030 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invalidating the token cache because role 0c6f3ed458a0456fa29a7a6df9106b3f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:43.669517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c5c22b36-2e8f-4ac8-a46b-1b9d1aeca030 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:43.672445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c5c22b36-2e8f-4ac8-a46b-1b9d1aeca030 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:43.681931 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2041/4089] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:43 2022] DELETE /identity/v3/roles/0c6f3ed458a0456fa29a7a6df9106b3f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:58:43.682723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d4be8-a050-474f-bcc7-07bc2fea9fb5 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:43.684732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-826d4be8-a050-474f-bcc7-07bc2fea9fb5 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:43.735472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d4be8-a050-474f-bcc7-07bc2fea9fb5 tempest-TrustsV3TestJSON-1429459282 tempest-user-997439100] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:43.804701 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:43.954218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf75820-aaf2-43eb-8dc2-b7f2f5d29b63 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:43.954874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf75820-aaf2-43eb-8dc2-b7f2f5d29b63 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:43.955153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf75820-aaf2-43eb-8dc2-b7f2f5d29b63 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:43.955424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf75820-aaf2-43eb-8dc2-b7f2f5d29b63 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/roles/633e8593a60e4ba3b7e6a5f5129d075c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:43.957179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf75820-aaf2-43eb-8dc2-b7f2f5d29b63 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_role(role_id=633e8593a60e4ba3b7e6a5f5129d075c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:43.958778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf75820-aaf2-43eb-8dc2-b7f2f5d29b63 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:44.036762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2cf75820-aaf2-43eb-8dc2-b7f2f5d29b63 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invalidating the token cache because role 633e8593a60e4ba3b7e6a5f5129d075c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:44.037204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2cf75820-aaf2-43eb-8dc2-b7f2f5d29b63 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:44.045082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2cf75820-aaf2-43eb-8dc2-b7f2f5d29b63 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:44.047321 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2049/4090] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:43 2022] DELETE /identity/v3/roles/633e8593a60e4ba3b7e6a5f5129d075c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:44.051406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c22b36-2e8f-4ac8-a46b-1b9d1aeca030 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:44.071018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c22b36-2e8f-4ac8-a46b-1b9d1aeca030 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:44.280745 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:44.376917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf82b0f-d94b-4615-a058-dc32092fdbba tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:44.378053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf82b0f-d94b-4615-a058-dc32092fdbba tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:44.378517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf82b0f-d94b-4615-a058-dc32092fdbba tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:44.378974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf82b0f-d94b-4615-a058-dc32092fdbba tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/users/5d64b90786524de1b07cc1284ce1c27e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:44.383907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf82b0f-d94b-4615-a058-dc32092fdbba tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5d64b90786524de1b07cc1284ce1c27e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:44.387055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf82b0f-d94b-4615-a058-dc32092fdbba tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:44.493509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aaf82b0f-d94b-4615-a058-dc32092fdbba tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d64b90786524de1b07cc1284ce1c27e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:44.508774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aaf82b0f-d94b-4615-a058-dc32092fdbba tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d64b90786524de1b07cc1284ce1c27e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:44.510460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aaf82b0f-d94b-4615-a058-dc32092fdbba tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d64b90786524de1b07cc1284ce1c27e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:44.539495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aaf82b0f-d94b-4615-a058-dc32092fdbba tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d64b90786524de1b07cc1284ce1c27e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:44.557082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aaf82b0f-d94b-4615-a058-dc32092fdbba tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d64b90786524de1b07cc1284ce1c27e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:44.569302 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2042/4091] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:44 2022] DELETE /identity/v3/users/5d64b90786524de1b07cc1284ce1c27e => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:44.573257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf75820-aaf2-43eb-8dc2-b7f2f5d29b63 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:44.575233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2cf75820-aaf2-43eb-8dc2-b7f2f5d29b63 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:44.599865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf75820-aaf2-43eb-8dc2-b7f2f5d29b63 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:44.758863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb475d-dcf2-408d-b84e-463f94156591 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '556408a80c7748ee9886144ce48ace39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ff624cd5ffd49f382a0964490870abf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:44.759677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb475d-dcf2-408d-b84e-463f94156591 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:44.759966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb475d-dcf2-408d-b84e-463f94156591 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:44.760240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb475d-dcf2-408d-b84e-463f94156591 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] PATH_INFO: `/v3/projects/e59fa8e955df4ed9b5b9884e3f577d57` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:44.763100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb475d-dcf2-408d-b84e-463f94156591 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e59fa8e955df4ed9b5b9884e3f577d57)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:44.765054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb475d-dcf2-408d-b84e-463f94156591 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:44.905182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-39fb475d-dcf2-408d-b84e-463f94156591 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e59fa8e955df4ed9b5b9884e3f577d57', 'request_id': 'req-39fb475d-dcf2-408d-b84e-463f94156591'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:44.941076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-39fb475d-dcf2-408d-b84e-463f94156591 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e59fa8e955df4ed9b5b9884e3f577d57', 'request_id': 'req-39fb475d-dcf2-408d-b84e-463f94156591'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:44.962026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-39fb475d-dcf2-408d-b84e-463f94156591 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e59fa8e955df4ed9b5b9884e3f577d57', 'request_id': 'req-39fb475d-dcf2-408d-b84e-463f94156591'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:45.002100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-39fb475d-dcf2-408d-b84e-463f94156591 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] The token cache is being invalidate because project e59fa8e955df4ed9b5b9884e3f577d57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:45.002449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-39fb475d-dcf2-408d-b84e-463f94156591 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:45.003234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-39fb475d-dcf2-408d-b84e-463f94156591 tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:45.007582 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2050/4092] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:44 2022] DELETE /identity/v3/projects/e59fa8e955df4ed9b5b9884e3f577d57 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:45.014445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf82b0f-d94b-4615-a058-dc32092fdbba tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:45.016212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aaf82b0f-d94b-4615-a058-dc32092fdbba tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:45.212151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf82b0f-d94b-4615-a058-dc32092fdbba tempest-TrustsV3TestJSON-758386958 tempest-TrustsV3TestJSON-758386958-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:45.407473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0d445-7e79-484b-9a38-cb02a8169ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:45.408342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0d445-7e79-484b-9a38-cb02a8169ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:45.408902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0d445-7e79-484b-9a38-cb02a8169ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:45.409655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0d445-7e79-484b-9a38-cb02a8169ee1 admin admin] PATH_INFO: `/v3/users/ecc776908f8548aebc421df8c83bd401` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:45.422092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0d445-7e79-484b-9a38-cb02a8169ee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecc776908f8548aebc421df8c83bd401)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:45.424923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0d445-7e79-484b-9a38-cb02a8169ee1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:45.442824 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:45.548698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-70a0d445-7e79-484b-9a38-cb02a8169ee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecc776908f8548aebc421df8c83bd401'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:45.572470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-70a0d445-7e79-484b-9a38-cb02a8169ee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecc776908f8548aebc421df8c83bd401'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:45.573036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-70a0d445-7e79-484b-9a38-cb02a8169ee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecc776908f8548aebc421df8c83bd401'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:45.600294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-70a0d445-7e79-484b-9a38-cb02a8169ee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecc776908f8548aebc421df8c83bd401'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:45.615168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-70a0d445-7e79-484b-9a38-cb02a8169ee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecc776908f8548aebc421df8c83bd401'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:45.624830 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2043/4093] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:45 2022] DELETE /identity/v3/users/ecc776908f8548aebc421df8c83bd401 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:45.628967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e350fd-b26f-4ac7-9ba6-9e95327b3ff4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:45.629449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e350fd-b26f-4ac7-9ba6-9e95327b3ff4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:45.629551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e350fd-b26f-4ac7-9ba6-9e95327b3ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:45.665762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f6e350fd-b26f-4ac7-9ba6-9e95327b3ff4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:45.666982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f6e350fd-b26f-4ac7-9ba6-9e95327b3ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:45.688156 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:45.817260 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2051/4094] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:45.828328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0d445-7e79-484b-9a38-cb02a8169ee1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:45.829904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-70a0d445-7e79-484b-9a38-cb02a8169ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:46.028522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0d445-7e79-484b-9a38-cb02a8169ee1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:46.037379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443f591-380c-4cae-b5d0-f63d2da379b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:46.038037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443f591-380c-4cae-b5d0-f63d2da379b7 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:46.038326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443f591-380c-4cae-b5d0-f63d2da379b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:46.038697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443f591-380c-4cae-b5d0-f63d2da379b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:46.063010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443f591-380c-4cae-b5d0-f63d2da379b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:46.064861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443f591-380c-4cae-b5d0-f63d2da379b7 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:46.093930 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2044/4095] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:58:46.686361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e350fd-b26f-4ac7-9ba6-9e95327b3ff4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:46.688341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f6e350fd-b26f-4ac7-9ba6-9e95327b3ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:46.716453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e350fd-b26f-4ac7-9ba6-9e95327b3ff4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:46.737368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382a72f-5f45-4a1c-89f9-596c3743f5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:46.743054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382a72f-5f45-4a1c-89f9-596c3743f5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:46.743653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382a72f-5f45-4a1c-89f9-596c3743f5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:46.745733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382a72f-5f45-4a1c-89f9-596c3743f5f8 admin admin] PATH_INFO: `/v3/projects/9b86c1b561034e719263a8e916935d1b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:46.753072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382a72f-5f45-4a1c-89f9-596c3743f5f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b86c1b561034e719263a8e916935d1b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:46.761299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382a72f-5f45-4a1c-89f9-596c3743f5f8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:46.896706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5382a72f-5f45-4a1c-89f9-596c3743f5f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b86c1b561034e719263a8e916935d1b', 'request_id': 'req-5382a72f-5f45-4a1c-89f9-596c3743f5f8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:46.923282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5382a72f-5f45-4a1c-89f9-596c3743f5f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b86c1b561034e719263a8e916935d1b', 'request_id': 'req-5382a72f-5f45-4a1c-89f9-596c3743f5f8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:46.960410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5382a72f-5f45-4a1c-89f9-596c3743f5f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b86c1b561034e719263a8e916935d1b', 'request_id': 'req-5382a72f-5f45-4a1c-89f9-596c3743f5f8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:46.985554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5382a72f-5f45-4a1c-89f9-596c3743f5f8 admin admin] The token cache is being invalidate because project 9b86c1b561034e719263a8e916935d1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:46.988668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5382a72f-5f45-4a1c-89f9-596c3743f5f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:46.989753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5382a72f-5f45-4a1c-89f9-596c3743f5f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:46.994024 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2052/4096] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:46 2022] DELETE /identity/v3/projects/9b86c1b561034e719263a8e916935d1b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:46.997729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443f591-380c-4cae-b5d0-f63d2da379b7 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:47.012263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443f591-380c-4cae-b5d0-f63d2da379b7 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:47.114653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c02fec-e155-4213-b68b-be1c6a23608e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:47.116414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c02fec-e155-4213-b68b-be1c6a23608e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:47.117266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c02fec-e155-4213-b68b-be1c6a23608e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:47.118228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c02fec-e155-4213-b68b-be1c6a23608e admin admin] PATH_INFO: `/v3/users/556408a80c7748ee9886144ce48ace39` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:47.120069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c02fec-e155-4213-b68b-be1c6a23608e admin admin] RBAC: Authorizing `identity:delete_user(user_id=556408a80c7748ee9886144ce48ace39)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:47.122140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c02fec-e155-4213-b68b-be1c6a23608e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:47.185232 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:47.225386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-53c02fec-e155-4213-b68b-be1c6a23608e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '556408a80c7748ee9886144ce48ace39'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:47.238155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-53c02fec-e155-4213-b68b-be1c6a23608e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '556408a80c7748ee9886144ce48ace39'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:47.238979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-53c02fec-e155-4213-b68b-be1c6a23608e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '556408a80c7748ee9886144ce48ace39'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:47.287370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-53c02fec-e155-4213-b68b-be1c6a23608e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '556408a80c7748ee9886144ce48ace39'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:47.308089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-53c02fec-e155-4213-b68b-be1c6a23608e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '556408a80c7748ee9886144ce48ace39'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:47.320215 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2045/4097] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:46 2022] DELETE /identity/v3/users/556408a80c7748ee9886144ce48ace39 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:48.108703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382a72f-5f45-4a1c-89f9-596c3743f5f8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:48.111301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5382a72f-5f45-4a1c-89f9-596c3743f5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:48.189183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382a72f-5f45-4a1c-89f9-596c3743f5f8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:48.473999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ae03b-1fcb-40cf-94ee-bfc2ee78350a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:48.474682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ae03b-1fcb-40cf-94ee-bfc2ee78350a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:48.474961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ae03b-1fcb-40cf-94ee-bfc2ee78350a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:48.475359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ae03b-1fcb-40cf-94ee-bfc2ee78350a admin admin] PATH_INFO: `/v3/projects/9ff624cd5ffd49f382a0964490870abf` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:48.477539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ae03b-1fcb-40cf-94ee-bfc2ee78350a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ff624cd5ffd49f382a0964490870abf)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:48.479757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ae03b-1fcb-40cf-94ee-bfc2ee78350a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:48.690956 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:48.718588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e75ae03b-1fcb-40cf-94ee-bfc2ee78350a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ff624cd5ffd49f382a0964490870abf', 'request_id': 'req-e75ae03b-1fcb-40cf-94ee-bfc2ee78350a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:48.739886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e75ae03b-1fcb-40cf-94ee-bfc2ee78350a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ff624cd5ffd49f382a0964490870abf', 'request_id': 'req-e75ae03b-1fcb-40cf-94ee-bfc2ee78350a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:48.784783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e75ae03b-1fcb-40cf-94ee-bfc2ee78350a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ff624cd5ffd49f382a0964490870abf', 'request_id': 'req-e75ae03b-1fcb-40cf-94ee-bfc2ee78350a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:48.836443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e75ae03b-1fcb-40cf-94ee-bfc2ee78350a admin admin] The token cache is being invalidate because project 9ff624cd5ffd49f382a0964490870abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:48.836835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e75ae03b-1fcb-40cf-94ee-bfc2ee78350a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:48.842520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e75ae03b-1fcb-40cf-94ee-bfc2ee78350a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:48.848695 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2053/4098] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:48 2022] DELETE /identity/v3/projects/9ff624cd5ffd49f382a0964490870abf => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:48.854490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8729f-6a93-466f-afe4-14a8685af994 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:48.855157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8729f-6a93-466f-afe4-14a8685af994 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:48.855695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8729f-6a93-466f-afe4-14a8685af994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:48.895316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0ec8729f-6a93-466f-afe4-14a8685af994 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:48.897116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0ec8729f-6a93-466f-afe4-14a8685af994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:49.007674 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2046/4099] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:49.015052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471083a-4369-4ac0-86c0-647836d85056 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:49.015401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471083a-4369-4ac0-86c0-647836d85056 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:49.015808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471083a-4369-4ac0-86c0-647836d85056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:49.059953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9471083a-4369-4ac0-86c0-647836d85056 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:49.062794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9471083a-4369-4ac0-86c0-647836d85056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:49.078894 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2054/4100] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:49.083024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8729f-6a93-466f-afe4-14a8685af994 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:49.097151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8729f-6a93-466f-afe4-14a8685af994 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:49.103805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dc3d2-fa3d-4c6f-9500-8bb75580e5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:49.104821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dc3d2-fa3d-4c6f-9500-8bb75580e5ae admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:49.105669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dc3d2-fa3d-4c6f-9500-8bb75580e5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:49.107131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dc3d2-fa3d-4c6f-9500-8bb75580e5ae admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:49.108999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dc3d2-fa3d-4c6f-9500-8bb75580e5ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:58:49.111147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dc3d2-fa3d-4c6f-9500-8bb75580e5ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:49.118704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dc3d2-fa3d-4c6f-9500-8bb75580e5ae admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:49.158329 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2047/4101] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:58:49.163671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471083a-4369-4ac0-86c0-647836d85056 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:49.184354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471083a-4369-4ac0-86c0-647836d85056 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:49.197991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa147f3-a96d-4fae-9246-b3fd52df221e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:49.199204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa147f3-a96d-4fae-9246-b3fd52df221e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:49.199678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa147f3-a96d-4fae-9246-b3fd52df221e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:49.200155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa147f3-a96d-4fae-9246-b3fd52df221e admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:49.202377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa147f3-a96d-4fae-9246-b3fd52df221e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:49.208566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa147f3-a96d-4fae-9246-b3fd52df221e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:49.298622 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2055/4102] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:58:49 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:58:49.303695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dc3d2-fa3d-4c6f-9500-8bb75580e5ae admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:49.324549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dc3d2-fa3d-4c6f-9500-8bb75580e5ae admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:49.510675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b005e14-03bb-4796-b33e-f4ef292adda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:49.514376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b005e14-03bb-4796-b33e-f4ef292adda7 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:49.525679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b005e14-03bb-4796-b33e-f4ef292adda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:49.525679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b005e14-03bb-4796-b33e-f4ef292adda7 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:49.525679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b005e14-03bb-4796-b33e-f4ef292adda7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:49.526281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b005e14-03bb-4796-b33e-f4ef292adda7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:49.647094 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2048/4103] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:58:49 2022] POST /identity/v3/users => generated 287 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:49.652657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa147f3-a96d-4fae-9246-b3fd52df221e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:49.677809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa147f3-a96d-4fae-9246-b3fd52df221e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:49.700419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f895957-3ef8-4e97-9a51-225c2691ff06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:49.704425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f895957-3ef8-4e97-9a51-225c2691ff06 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:49.705883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f895957-3ef8-4e97-9a51-225c2691ff06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:49.707914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f895957-3ef8-4e97-9a51-225c2691ff06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:49.715226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f895957-3ef8-4e97-9a51-225c2691ff06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:49.721136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f895957-3ef8-4e97-9a51-225c2691ff06 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:49.768937 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2056/4104] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:49.772854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b005e14-03bb-4796-b33e-f4ef292adda7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:49.811795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b005e14-03bb-4796-b33e-f4ef292adda7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:49.830558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ddb1d-2972-4e1e-821a-5ac55926d2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:49.834216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ddb1d-2972-4e1e-821a-5ac55926d2bb admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:49.834713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ddb1d-2972-4e1e-821a-5ac55926d2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:49.836923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ddb1d-2972-4e1e-821a-5ac55926d2bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:49.839835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ddb1d-2972-4e1e-821a-5ac55926d2bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:49.846205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ddb1d-2972-4e1e-821a-5ac55926d2bb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:49.905702 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2049/4105] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:58:49.906971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f895957-3ef8-4e97-9a51-225c2691ff06 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:49.939529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f895957-3ef8-4e97-9a51-225c2691ff06 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:49.953290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104facc1-41f6-4881-940e-3034766c3739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:49.955600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104facc1-41f6-4881-940e-3034766c3739 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:49.956302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104facc1-41f6-4881-940e-3034766c3739 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:49.957121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104facc1-41f6-4881-940e-3034766c3739 admin admin] PATH_INFO: `/v3/projects/50feece4d9104b8fa2b0f9e8a2e5c67f/users/36c3f9f04e9f4290be586e3407a8f4c8/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:49.994512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104facc1-41f6-4881-940e-3034766c3739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50feece4d9104b8fa2b0f9e8a2e5c67f, user_id=36c3f9f04e9f4290be586e3407a8f4c8, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:49.997460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104facc1-41f6-4881-940e-3034766c3739 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:50.043845 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2057/4106] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:49 2022] PUT /identity/v3/projects/50feece4d9104b8fa2b0f9e8a2e5c67f/users/36c3f9f04e9f4290be586e3407a8f4c8/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:50.052384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b963996-051a-4dc8-8f2a-10b6fd9127f4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:50.052734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b963996-051a-4dc8-8f2a-10b6fd9127f4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:50.052941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b963996-051a-4dc8-8f2a-10b6fd9127f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:50.109660 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:50.127480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7b963996-051a-4dc8-8f2a-10b6fd9127f4 None None] MFA Rules not processed for user `36c3f9f04e9f4290be586e3407a8f4c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:50.136637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7b963996-051a-4dc8-8f2a-10b6fd9127f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:50.295005 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2050/4107] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:50.300243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104facc1-41f6-4881-940e-3034766c3739 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:50.321024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104facc1-41f6-4881-940e-3034766c3739 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:50.341478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab1486-57af-4915-aac3-7719f50fd1e7 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36c3f9f04e9f4290be586e3407a8f4c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50feece4d9104b8fa2b0f9e8a2e5c67f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:50.342446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab1486-57af-4915-aac3-7719f50fd1e7 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:50.343649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab1486-57af-4915-aac3-7719f50fd1e7 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:50.344391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab1486-57af-4915-aac3-7719f50fd1e7 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] PATH_INFO: `/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:50.345590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab1486-57af-4915-aac3-7719f50fd1e7 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=36c3f9f04e9f4290be586e3407a8f4c8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:50.348371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab1486-57af-4915-aac3-7719f50fd1e7 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:50.407697 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2058/4108] 10.222.0.16 () {60 vars in 1299 bytes} [Fri Sep 30 09:58:50 2022] POST /identity/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2 => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:50.409994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b963996-051a-4dc8-8f2a-10b6fd9127f4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:50.423045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b963996-051a-4dc8-8f2a-10b6fd9127f4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:50.439338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbc737-a959-4abd-9f4e-b07ea5620342 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36c3f9f04e9f4290be586e3407a8f4c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50feece4d9104b8fa2b0f9e8a2e5c67f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:50.440896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbc737-a959-4abd-9f4e-b07ea5620342 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:50.442107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbc737-a959-4abd-9f4e-b07ea5620342 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:50.442392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbc737-a959-4abd-9f4e-b07ea5620342 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] PATH_INFO: `/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2/985531d4509d486791a6a91ee31154cd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:50.445214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbc737-a959-4abd-9f4e-b07ea5620342 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=36c3f9f04e9f4290be586e3407a8f4c8, credential_id=985531d4509d486791a6a91ee31154cd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:50.446801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbc737-a959-4abd-9f4e-b07ea5620342 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:50.474709 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2051/4109] 10.222.0.16 () {58 vars in 1380 bytes} [Fri Sep 30 09:58:50 2022] DELETE /identity/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2/985531d4509d486791a6a91ee31154cd => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:50.480103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab1486-57af-4915-aac3-7719f50fd1e7 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:50.491175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab1486-57af-4915-aac3-7719f50fd1e7 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:50.496553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62072c05-af5f-4380-83bb-6d25a4488100 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36c3f9f04e9f4290be586e3407a8f4c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50feece4d9104b8fa2b0f9e8a2e5c67f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:50.497750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62072c05-af5f-4380-83bb-6d25a4488100 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:50.498188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62072c05-af5f-4380-83bb-6d25a4488100 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:50.498748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62072c05-af5f-4380-83bb-6d25a4488100 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] PATH_INFO: `/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:50.499790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62072c05-af5f-4380-83bb-6d25a4488100 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=36c3f9f04e9f4290be586e3407a8f4c8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:50.501691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62072c05-af5f-4380-83bb-6d25a4488100 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:50.545144 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2059/4110] 10.222.0.16 () {60 vars in 1299 bytes} [Fri Sep 30 09:58:50 2022] POST /identity/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2 => generated 367 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:50.549374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbc737-a959-4abd-9f4e-b07ea5620342 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:50.560339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbc737-a959-4abd-9f4e-b07ea5620342 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:50.565155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600b947-2378-4cc5-98f2-edbdce4b47a0 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36c3f9f04e9f4290be586e3407a8f4c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50feece4d9104b8fa2b0f9e8a2e5c67f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:50.565803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600b947-2378-4cc5-98f2-edbdce4b47a0 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:50.566108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600b947-2378-4cc5-98f2-edbdce4b47a0 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:50.566369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600b947-2378-4cc5-98f2-edbdce4b47a0 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] PATH_INFO: `/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2/299a728c3d7f45369d6afc5a8303d1e8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:50.568320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600b947-2378-4cc5-98f2-edbdce4b47a0 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=36c3f9f04e9f4290be586e3407a8f4c8, credential_id=299a728c3d7f45369d6afc5a8303d1e8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:50.569798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600b947-2378-4cc5-98f2-edbdce4b47a0 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:50.590226 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2052/4111] 10.222.0.16 () {58 vars in 1380 bytes} [Fri Sep 30 09:58:50 2022] DELETE /identity/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2/299a728c3d7f45369d6afc5a8303d1e8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:50.591501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62072c05-af5f-4380-83bb-6d25a4488100 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:50.603507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62072c05-af5f-4380-83bb-6d25a4488100 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:50.608841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ceec8-8515-4bcf-8c6f-95172bbb2e07 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36c3f9f04e9f4290be586e3407a8f4c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50feece4d9104b8fa2b0f9e8a2e5c67f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:50.611530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ceec8-8515-4bcf-8c6f-95172bbb2e07 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:50.612519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ceec8-8515-4bcf-8c6f-95172bbb2e07 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:50.613213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ceec8-8515-4bcf-8c6f-95172bbb2e07 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] PATH_INFO: `/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2/299a728c3d7f45369d6afc5a8303d1e8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:50.671735 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-0a1ceec8-8515-4bcf-8c6f-95172bbb2e07 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Could not find credential: d22ee3cbe05bb3eb3ab2a2481f631fce8b50f96e28b9c7b66de8a341e3dae781.: keystone.exception.CredentialNotFound: Could not find credential: d22ee3cbe05bb3eb3ab2a2481f631fce8b50f96e28b9c7b66de8a341e3dae781. Sep 30 09:58:50.671735 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:50.671735 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:58:50.671735 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:58:50.671735 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:58:50.671735 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:58:50.671735 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:58:50.671735 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:58:50.671735 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:58:50.671735 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:58:50.671735 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:58:50.671735 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:58:50.671735 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Sep 30 09:58:50.671735 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Sep 30 09:58:50.672973 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 30 09:58:50.672973 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 30 09:58:50.672973 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Sep 30 09:58:50.672973 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Sep 30 09:58:50.672973 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:58:50.672973 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:58:50.672973 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Sep 30 09:58:50.672973 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Sep 30 09:58:50.672973 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 09:58:50.672973 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 09:58:50.672973 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 09:58:50.672973 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 09:58:50.672973 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 09:58:50.672973 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 09:58:50.672973 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 09:58:50.672973 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 09:58:50.674203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 09:58:50.674203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 09:58:50.674203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 09:58:50.674203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 09:58:50.674203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 09:58:50.674203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 09:58:50.674203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Sep 30 09:58:50.674203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Sep 30 09:58:50.674203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Sep 30 09:58:50.674203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Sep 30 09:58:50.674203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Sep 30 09:58:50.674203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Sep 30 09:58:50.674203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: d22ee3cbe05bb3eb3ab2a2481f631fce8b50f96e28b9c7b66de8a341e3dae781. Sep 30 09:58:50.674203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:50.674203 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2060/4112] 10.222.0.16 () {58 vars in 1377 bytes} [Fri Sep 30 09:58:50 2022] GET /identity/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2/299a728c3d7f45369d6afc5a8303d1e8 => generated 148 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 09:58:50.680379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600b947-2378-4cc5-98f2-edbdce4b47a0 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:50.690237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600b947-2378-4cc5-98f2-edbdce4b47a0 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:50.695905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d696f-8b04-4c30-8d93-0d4eb69719fc tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36c3f9f04e9f4290be586e3407a8f4c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50feece4d9104b8fa2b0f9e8a2e5c67f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:50.697213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d696f-8b04-4c30-8d93-0d4eb69719fc tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:50.697499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d696f-8b04-4c30-8d93-0d4eb69719fc tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:50.697776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d696f-8b04-4c30-8d93-0d4eb69719fc tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] PATH_INFO: `/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:50.698403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d696f-8b04-4c30-8d93-0d4eb69719fc tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=36c3f9f04e9f4290be586e3407a8f4c8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:50.700262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d696f-8b04-4c30-8d93-0d4eb69719fc tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:50.722705 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2053/4113] 10.222.0.16 () {60 vars in 1299 bytes} [Fri Sep 30 09:58:50 2022] POST /identity/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2 => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:50.728133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ceec8-8515-4bcf-8c6f-95172bbb2e07 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:50.738358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ceec8-8515-4bcf-8c6f-95172bbb2e07 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:50.743410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012fb4e-6b5d-46d9-adc2-08fc711bc3f6 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36c3f9f04e9f4290be586e3407a8f4c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50feece4d9104b8fa2b0f9e8a2e5c67f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:50.744031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012fb4e-6b5d-46d9-adc2-08fc711bc3f6 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:50.744312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012fb4e-6b5d-46d9-adc2-08fc711bc3f6 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:50.744582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012fb4e-6b5d-46d9-adc2-08fc711bc3f6 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] PATH_INFO: `/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:50.745224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012fb4e-6b5d-46d9-adc2-08fc711bc3f6 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=36c3f9f04e9f4290be586e3407a8f4c8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:50.746715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012fb4e-6b5d-46d9-adc2-08fc711bc3f6 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:50.761453 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2061/4114] 10.222.0.16 () {60 vars in 1299 bytes} [Fri Sep 30 09:58:50 2022] POST /identity/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2 => generated 367 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:50.765796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d696f-8b04-4c30-8d93-0d4eb69719fc tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:50.776207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d696f-8b04-4c30-8d93-0d4eb69719fc tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:50.780333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e86085-986d-47ac-aee1-3b5db13fe69a tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36c3f9f04e9f4290be586e3407a8f4c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50feece4d9104b8fa2b0f9e8a2e5c67f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:50.780990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e86085-986d-47ac-aee1-3b5db13fe69a tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:50.781266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e86085-986d-47ac-aee1-3b5db13fe69a tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:50.781534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e86085-986d-47ac-aee1-3b5db13fe69a tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] PATH_INFO: `/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:50.782104 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e86085-986d-47ac-aee1-3b5db13fe69a tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=36c3f9f04e9f4290be586e3407a8f4c8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:50.783669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e86085-986d-47ac-aee1-3b5db13fe69a tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:50.795507 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2054/4115] 10.222.0.16 () {58 vars in 1278 bytes} [Fri Sep 30 09:58:50 2022] GET /identity/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2 => generated 865 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:50.800177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012fb4e-6b5d-46d9-adc2-08fc711bc3f6 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:50.812152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012fb4e-6b5d-46d9-adc2-08fc711bc3f6 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:50.822729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394086c3-5f6b-485c-b716-a29f9ad3afd7 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36c3f9f04e9f4290be586e3407a8f4c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50feece4d9104b8fa2b0f9e8a2e5c67f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:50.823409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394086c3-5f6b-485c-b716-a29f9ad3afd7 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:50.823695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394086c3-5f6b-485c-b716-a29f9ad3afd7 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:50.823973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394086c3-5f6b-485c-b716-a29f9ad3afd7 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] PATH_INFO: `/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2/6fd743fc1aef4f18be4b213e2b50d264` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:50.826182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394086c3-5f6b-485c-b716-a29f9ad3afd7 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=36c3f9f04e9f4290be586e3407a8f4c8, credential_id=6fd743fc1aef4f18be4b213e2b50d264)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:50.827638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394086c3-5f6b-485c-b716-a29f9ad3afd7 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:50.845709 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2062/4116] 10.222.0.16 () {58 vars in 1380 bytes} [Fri Sep 30 09:58:50 2022] DELETE /identity/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2/6fd743fc1aef4f18be4b213e2b50d264 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:50.850257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e86085-986d-47ac-aee1-3b5db13fe69a tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:50.861563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e86085-986d-47ac-aee1-3b5db13fe69a tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:50.876631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34336e64-a71f-4230-baa3-cbcee2cac60d tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36c3f9f04e9f4290be586e3407a8f4c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50feece4d9104b8fa2b0f9e8a2e5c67f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:50.877516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34336e64-a71f-4230-baa3-cbcee2cac60d tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:50.877803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34336e64-a71f-4230-baa3-cbcee2cac60d tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:50.878117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34336e64-a71f-4230-baa3-cbcee2cac60d tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] PATH_INFO: `/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2/29c571e413ca4bdcb44d805373d58580` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:50.880862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34336e64-a71f-4230-baa3-cbcee2cac60d tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=36c3f9f04e9f4290be586e3407a8f4c8, credential_id=29c571e413ca4bdcb44d805373d58580)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:50.886033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34336e64-a71f-4230-baa3-cbcee2cac60d tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:50.907739 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2055/4117] 10.222.0.16 () {58 vars in 1380 bytes} [Fri Sep 30 09:58:50 2022] DELETE /identity/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2/29c571e413ca4bdcb44d805373d58580 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:50.913013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394086c3-5f6b-485c-b716-a29f9ad3afd7 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:50.924955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394086c3-5f6b-485c-b716-a29f9ad3afd7 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:50.931336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca65c9b-323f-46b0-b56c-7a27a7e26a7f tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36c3f9f04e9f4290be586e3407a8f4c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50feece4d9104b8fa2b0f9e8a2e5c67f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:50.931985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca65c9b-323f-46b0-b56c-7a27a7e26a7f tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:50.932268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca65c9b-323f-46b0-b56c-7a27a7e26a7f tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:50.932544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca65c9b-323f-46b0-b56c-7a27a7e26a7f tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] PATH_INFO: `/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:50.933242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca65c9b-323f-46b0-b56c-7a27a7e26a7f tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=36c3f9f04e9f4290be586e3407a8f4c8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:50.934756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca65c9b-323f-46b0-b56c-7a27a7e26a7f tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:50.959082 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2063/4118] 10.222.0.16 () {60 vars in 1299 bytes} [Fri Sep 30 09:58:50 2022] POST /identity/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2 => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:50.964214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34336e64-a71f-4230-baa3-cbcee2cac60d tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:50.974848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34336e64-a71f-4230-baa3-cbcee2cac60d tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:50.980030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149aaaae-8c37-4608-9af2-c13278ee5cee tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36c3f9f04e9f4290be586e3407a8f4c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50feece4d9104b8fa2b0f9e8a2e5c67f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:50.980838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aaaae-8c37-4608-9af2-c13278ee5cee tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:50.981238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aaaae-8c37-4608-9af2-c13278ee5cee tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:50.981548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aaaae-8c37-4608-9af2-c13278ee5cee tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] PATH_INFO: `/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2/bcab246b10cc4967a02c89bd6fe24968` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:50.983526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149aaaae-8c37-4608-9af2-c13278ee5cee tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=36c3f9f04e9f4290be586e3407a8f4c8, credential_id=bcab246b10cc4967a02c89bd6fe24968)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:50.985153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149aaaae-8c37-4608-9af2-c13278ee5cee tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:50.990926 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2056/4119] 10.222.0.16 () {58 vars in 1377 bytes} [Fri Sep 30 09:58:50 2022] GET /identity/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2/bcab246b10cc4967a02c89bd6fe24968 => generated 367 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:50.992362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca65c9b-323f-46b0-b56c-7a27a7e26a7f tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:51.002310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca65c9b-323f-46b0-b56c-7a27a7e26a7f tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:51.006854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee810030-703f-43f3-98f5-e0dc610d16a7 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36c3f9f04e9f4290be586e3407a8f4c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50feece4d9104b8fa2b0f9e8a2e5c67f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:51.007565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee810030-703f-43f3-98f5-e0dc610d16a7 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:51.007870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee810030-703f-43f3-98f5-e0dc610d16a7 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:51.008148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee810030-703f-43f3-98f5-e0dc610d16a7 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] PATH_INFO: `/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2/bcab246b10cc4967a02c89bd6fe24968` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:51.010100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee810030-703f-43f3-98f5-e0dc610d16a7 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=36c3f9f04e9f4290be586e3407a8f4c8, credential_id=bcab246b10cc4967a02c89bd6fe24968)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:51.011661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee810030-703f-43f3-98f5-e0dc610d16a7 tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:51.030743 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2064/4120] 10.222.0.16 () {58 vars in 1380 bytes} [Fri Sep 30 09:58:50 2022] DELETE /identity/v3/users/36c3f9f04e9f4290be586e3407a8f4c8/credentials/OS-EC2/bcab246b10cc4967a02c89bd6fe24968 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:58:51.039749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149aaaae-8c37-4608-9af2-c13278ee5cee tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:51.127148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149aaaae-8c37-4608-9af2-c13278ee5cee tempest-EC2CredentialsTest-1279469360 tempest-EC2CredentialsTest-1279469360-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:51.132513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37861a3-6d69-461d-a2e0-9c16ad0ff3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:51.133307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37861a3-6d69-461d-a2e0-9c16ad0ff3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:51.133647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37861a3-6d69-461d-a2e0-9c16ad0ff3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:51.134002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37861a3-6d69-461d-a2e0-9c16ad0ff3ea admin admin] PATH_INFO: `/v3/users/36c3f9f04e9f4290be586e3407a8f4c8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:51.135302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37861a3-6d69-461d-a2e0-9c16ad0ff3ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c3f9f04e9f4290be586e3407a8f4c8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:51.138166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37861a3-6d69-461d-a2e0-9c16ad0ff3ea admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:51.173440 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:51.188583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c37861a3-6d69-461d-a2e0-9c16ad0ff3ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c3f9f04e9f4290be586e3407a8f4c8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:51.196972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c37861a3-6d69-461d-a2e0-9c16ad0ff3ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c3f9f04e9f4290be586e3407a8f4c8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:51.197757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c37861a3-6d69-461d-a2e0-9c16ad0ff3ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c3f9f04e9f4290be586e3407a8f4c8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:51.210917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c37861a3-6d69-461d-a2e0-9c16ad0ff3ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c3f9f04e9f4290be586e3407a8f4c8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:51.218267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c37861a3-6d69-461d-a2e0-9c16ad0ff3ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c3f9f04e9f4290be586e3407a8f4c8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:51.224085 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2057/4121] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:58:51 2022] DELETE /identity/v3/users/36c3f9f04e9f4290be586e3407a8f4c8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:51.229344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0268a0-2b9a-4236-8de2-6648d105c58d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:51.229625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0268a0-2b9a-4236-8de2-6648d105c58d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:51.229898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0268a0-2b9a-4236-8de2-6648d105c58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:51.252315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3d0268a0-2b9a-4236-8de2-6648d105c58d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:51.253572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3d0268a0-2b9a-4236-8de2-6648d105c58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:51.280097 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:DELETE=6,keystone:INSERT=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:51.317759 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2065/4122] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:58:51.327461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37861a3-6d69-461d-a2e0-9c16ad0ff3ea admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:51.328945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c37861a3-6d69-461d-a2e0-9c16ad0ff3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:51.388614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37861a3-6d69-461d-a2e0-9c16ad0ff3ea admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:51.392275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343d387-beff-4fa2-9ad1-2da667958827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:51.392915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343d387-beff-4fa2-9ad1-2da667958827 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:51.393196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343d387-beff-4fa2-9ad1-2da667958827 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:51.393467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343d387-beff-4fa2-9ad1-2da667958827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:51.404365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343d387-beff-4fa2-9ad1-2da667958827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:51.406085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343d387-beff-4fa2-9ad1-2da667958827 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:51.417143 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2058/4123] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:58:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:58:51.715477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0268a0-2b9a-4236-8de2-6648d105c58d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:51.721690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3d0268a0-2b9a-4236-8de2-6648d105c58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:51.749132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0268a0-2b9a-4236-8de2-6648d105c58d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:51.756568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee2e43-a010-4beb-8695-12324a0c04e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:51.757894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee2e43-a010-4beb-8695-12324a0c04e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:51.758151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee2e43-a010-4beb-8695-12324a0c04e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:51.758412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee2e43-a010-4beb-8695-12324a0c04e4 admin admin] PATH_INFO: `/v3/projects/50feece4d9104b8fa2b0f9e8a2e5c67f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:51.761828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee2e43-a010-4beb-8695-12324a0c04e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50feece4d9104b8fa2b0f9e8a2e5c67f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:51.764183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee2e43-a010-4beb-8695-12324a0c04e4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:51.823666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6ee2e43-a010-4beb-8695-12324a0c04e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50feece4d9104b8fa2b0f9e8a2e5c67f', 'request_id': 'req-f6ee2e43-a010-4beb-8695-12324a0c04e4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:51.834156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6ee2e43-a010-4beb-8695-12324a0c04e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50feece4d9104b8fa2b0f9e8a2e5c67f', 'request_id': 'req-f6ee2e43-a010-4beb-8695-12324a0c04e4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:51.842982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6ee2e43-a010-4beb-8695-12324a0c04e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50feece4d9104b8fa2b0f9e8a2e5c67f', 'request_id': 'req-f6ee2e43-a010-4beb-8695-12324a0c04e4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:51.858325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6ee2e43-a010-4beb-8695-12324a0c04e4 admin admin] The token cache is being invalidate because project 50feece4d9104b8fa2b0f9e8a2e5c67f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:58:51.858655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6ee2e43-a010-4beb-8695-12324a0c04e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:51.859411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6ee2e43-a010-4beb-8695-12324a0c04e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:51.861758 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2066/4124] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:58:51 2022] DELETE /identity/v3/projects/50feece4d9104b8fa2b0f9e8a2e5c67f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:51.867139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a15256-7f39-4561-8cee-d1b992319e57 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:51.867591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a15256-7f39-4561-8cee-d1b992319e57 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:51.867957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a15256-7f39-4561-8cee-d1b992319e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:51.889690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a5a15256-7f39-4561-8cee-d1b992319e57 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:51.891081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a5a15256-7f39-4561-8cee-d1b992319e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:51.966294 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2059/4125] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:58:51.974705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afae4d-2bac-4fab-91a8-7157cf3767a0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:51.975174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afae4d-2bac-4fab-91a8-7157cf3767a0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:51.976162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afae4d-2bac-4fab-91a8-7157cf3767a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:52.000136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-56afae4d-2bac-4fab-91a8-7157cf3767a0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:52.001708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-56afae4d-2bac-4fab-91a8-7157cf3767a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:52.011682 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2067/4126] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:52.016750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a15256-7f39-4561-8cee-d1b992319e57 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:52.028253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a15256-7f39-4561-8cee-d1b992319e57 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:52.035906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d35396-86a4-491e-9da3-11ecf87e3d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:52.036692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d35396-86a4-491e-9da3-11ecf87e3d27 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:52.037015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d35396-86a4-491e-9da3-11ecf87e3d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:52.037351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d35396-86a4-491e-9da3-11ecf87e3d27 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:52.038811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d35396-86a4-491e-9da3-11ecf87e3d27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:58:52.039224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d35396-86a4-491e-9da3-11ecf87e3d27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:52.040842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d35396-86a4-491e-9da3-11ecf87e3d27 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:52.059220 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2060/4127] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:58:52.060284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afae4d-2bac-4fab-91a8-7157cf3767a0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:52.070851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afae4d-2bac-4fab-91a8-7157cf3767a0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:52.076814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f94402-5827-4e23-9652-e28388fe83bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:52.077513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f94402-5827-4e23-9652-e28388fe83bb admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:52.077892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f94402-5827-4e23-9652-e28388fe83bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:52.078232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f94402-5827-4e23-9652-e28388fe83bb admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:52.078920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f94402-5827-4e23-9652-e28388fe83bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:52.082847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f94402-5827-4e23-9652-e28388fe83bb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:52.122602 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2068/4128] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:58:52 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:58:52.125560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d35396-86a4-491e-9da3-11ecf87e3d27 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:52.138376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d35396-86a4-491e-9da3-11ecf87e3d27 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:52.177740 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:52.211156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d715dd7-23f0-4384-94a9-8ae710345566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:52.211836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d715dd7-23f0-4384-94a9-8ae710345566 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:52.212119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d715dd7-23f0-4384-94a9-8ae710345566 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:52.212898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d715dd7-23f0-4384-94a9-8ae710345566 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:52.213245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d715dd7-23f0-4384-94a9-8ae710345566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:52.215479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d715dd7-23f0-4384-94a9-8ae710345566 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:52.246056 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2061/4129] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:58:52 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:58:52.250751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f94402-5827-4e23-9652-e28388fe83bb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:52.275532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f94402-5827-4e23-9652-e28388fe83bb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:52.285239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f80930-6d00-4400-83b6-cb82c30d58bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:52.286086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f80930-6d00-4400-83b6-cb82c30d58bb admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:52.286560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f80930-6d00-4400-83b6-cb82c30d58bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:52.287079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f80930-6d00-4400-83b6-cb82c30d58bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:52.287902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f80930-6d00-4400-83b6-cb82c30d58bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:52.291006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f80930-6d00-4400-83b6-cb82c30d58bb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:52.305601 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2069/4130] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:52.310594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d715dd7-23f0-4384-94a9-8ae710345566 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:52.323198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d715dd7-23f0-4384-94a9-8ae710345566 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:52.328504 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8397b4c-38a9-4a2b-aa8b-cd97333387cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:52.329130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8397b4c-38a9-4a2b-aa8b-cd97333387cd admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:52.329407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8397b4c-38a9-4a2b-aa8b-cd97333387cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:52.329702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8397b4c-38a9-4a2b-aa8b-cd97333387cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:52.330343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8397b4c-38a9-4a2b-aa8b-cd97333387cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:52.332230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8397b4c-38a9-4a2b-aa8b-cd97333387cd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:52.344980 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2062/4131] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:58:52.349832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f80930-6d00-4400-83b6-cb82c30d58bb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:52.362690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f80930-6d00-4400-83b6-cb82c30d58bb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:52.368347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd763c-3ef8-4b99-858e-9f53267a7da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:52.369256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd763c-3ef8-4b99-858e-9f53267a7da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:52.369530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd763c-3ef8-4b99-858e-9f53267a7da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:52.369804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd763c-3ef8-4b99-858e-9f53267a7da0 admin admin] PATH_INFO: `/v3/projects/8dcde50ba27c40528d71a09362f927b1/users/9d2e5574c117496cbb2a6569bb40cfbb/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:52.387005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd763c-3ef8-4b99-858e-9f53267a7da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dcde50ba27c40528d71a09362f927b1, user_id=9d2e5574c117496cbb2a6569bb40cfbb, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:52.389778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd763c-3ef8-4b99-858e-9f53267a7da0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:52.404772 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2070/4132] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:58:52 2022] PUT /identity/v3/projects/8dcde50ba27c40528d71a09362f927b1/users/9d2e5574c117496cbb2a6569bb40cfbb/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:58:52.417344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e372e7-f378-46de-9c40-63f53a852be6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:52.417688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e372e7-f378-46de-9c40-63f53a852be6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:52.417909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e372e7-f378-46de-9c40-63f53a852be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:52.447099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-45e372e7-f378-46de-9c40-63f53a852be6 None None] MFA Rules not processed for user `9d2e5574c117496cbb2a6569bb40cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:52.448338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-45e372e7-f378-46de-9c40-63f53a852be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:52.526851 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2063/4133] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:52.532462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd763c-3ef8-4b99-858e-9f53267a7da0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:52.543964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd763c-3ef8-4b99-858e-9f53267a7da0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:52.548316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78e403-36bf-4f11-9ce6-572f164f2b36 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d2e5574c117496cbb2a6569bb40cfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dcde50ba27c40528d71a09362f927b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:52.549041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78e403-36bf-4f11-9ce6-572f164f2b36 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:52.549320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78e403-36bf-4f11-9ce6-572f164f2b36 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:52.549591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78e403-36bf-4f11-9ce6-572f164f2b36 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] PATH_INFO: `/v3/users/9d2e5574c117496cbb2a6569bb40cfbb/password` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:52.596168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5e78e403-36bf-4f11-9ce6-572f164f2b36 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9d2e5574c117496cbb2a6569bb40cfbb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:52.605906 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2071/4134] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Sep 30 09:58:52 2022] POST /identity/v3/users/9d2e5574c117496cbb2a6569bb40cfbb/password => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:53.611671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2d95b-3ba3-4075-b454-72740266b1c7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:53.612518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2d95b-3ba3-4075-b454-72740266b1c7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:53.612987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2d95b-3ba3-4075-b454-72740266b1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:53.633140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d8c2d95b-3ba3-4075-b454-72740266b1c7 None None] MFA Rules not processed for user `9d2e5574c117496cbb2a6569bb40cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:53.634332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d8c2d95b-3ba3-4075-b454-72740266b1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:53.641951 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2064/4135] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:53 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:58:53.644400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76612803-0efc-494c-9e01-d478ce255912 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:53.644935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76612803-0efc-494c-9e01-d478ce255912 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:53.645048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76612803-0efc-494c-9e01-d478ce255912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:53.666638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-76612803-0efc-494c-9e01-d478ce255912 None None] MFA Rules not processed for user `9d2e5574c117496cbb2a6569bb40cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:53.668062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-76612803-0efc-494c-9e01-d478ce255912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:53.681758 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2072/4136] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:53.682564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2d95b-3ba3-4075-b454-72740266b1c7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:53.695412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2d95b-3ba3-4075-b454-72740266b1c7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:53.700417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe80e2-1397-4494-8e46-b4f5332ebc38 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d2e5574c117496cbb2a6569bb40cfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dcde50ba27c40528d71a09362f927b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:53.701265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe80e2-1397-4494-8e46-b4f5332ebc38 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:53.701556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe80e2-1397-4494-8e46-b4f5332ebc38 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:53.701825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe80e2-1397-4494-8e46-b4f5332ebc38 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] PATH_INFO: `/v3/users/9d2e5574c117496cbb2a6569bb40cfbb/password` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:53.781535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-1dbe80e2-1397-4494-8e46-b4f5332ebc38 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Sep 30 09:58:53.781535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:53.781535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:58:53.781535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:58:53.781535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:58:53.781535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:58:53.781535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:58:53.781535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:58:53.781535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:58:53.781535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:58:53.781535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:58:53.781535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:58:53.781535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 30 09:58:53.786560 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 30 09:58:53.786560 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Sep 30 09:58:53.786560 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Sep 30 09:58:53.786560 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:58:53.786560 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:58:53.786560 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:58:53.786560 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:58:53.786560 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Sep 30 09:58:53.786560 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Sep 30 09:58:53.786560 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Sep 30 09:58:53.786560 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Sep 30 09:58:53.786560 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Sep 30 09:58:53.786560 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Sep 30 09:58:53.786560 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Sep 30 09:58:53.786560 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:58:53.787726 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2065/4137] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Sep 30 09:58:53 2022] POST /identity/v3/users/9d2e5574c117496cbb2a6569bb40cfbb/password => generated 188 bytes in 101 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Sep 30 09:58:53.789913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76612803-0efc-494c-9e01-d478ce255912 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:53.802760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76612803-0efc-494c-9e01-d478ce255912 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:53.810186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047718a-560c-4e95-8e5a-c34bc547733f tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d2e5574c117496cbb2a6569bb40cfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dcde50ba27c40528d71a09362f927b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:53.811155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047718a-560c-4e95-8e5a-c34bc547733f tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:53.811454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047718a-560c-4e95-8e5a-c34bc547733f tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:53.811734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047718a-560c-4e95-8e5a-c34bc547733f tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] PATH_INFO: `/v3/users/9d2e5574c117496cbb2a6569bb40cfbb/password` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:53.828959 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=8,keystone:INSERT=5,keystone:UPDATE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:53.871664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-1047718a-560c-4e95-8e5a-c34bc547733f tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Sep 30 09:58:53.871664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:58:53.871664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:58:53.871664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:58:53.871664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:58:53.871664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:58:53.871664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:58:53.871664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:58:53.871664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:58:53.871664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:58:53.871664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:58:53.871664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:58:53.871664 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 30 09:58:53.873025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 30 09:58:53.873025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Sep 30 09:58:53.873025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Sep 30 09:58:53.873025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:58:53.873025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:58:53.873025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 09:58:53.873025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 09:58:53.873025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Sep 30 09:58:53.873025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Sep 30 09:58:53.873025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Sep 30 09:58:53.873025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Sep 30 09:58:53.873025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Sep 30 09:58:53.873025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Sep 30 09:58:53.873025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Sep 30 09:58:53.873025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 09:58:53.876688 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2073/4138] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Sep 30 09:58:53 2022] POST /identity/v3/users/9d2e5574c117496cbb2a6569bb40cfbb/password => generated 188 bytes in 87 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 30 09:58:53.878713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe80e2-1397-4494-8e46-b4f5332ebc38 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:53.889699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe80e2-1397-4494-8e46-b4f5332ebc38 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:53.894287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875e3f3-8706-4901-972c-e75cd4b88304 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d2e5574c117496cbb2a6569bb40cfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dcde50ba27c40528d71a09362f927b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:53.894913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875e3f3-8706-4901-972c-e75cd4b88304 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:53.895195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875e3f3-8706-4901-972c-e75cd4b88304 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:53.895468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875e3f3-8706-4901-972c-e75cd4b88304 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] PATH_INFO: `/v3/users/9d2e5574c117496cbb2a6569bb40cfbb/password` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:53.943190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b875e3f3-8706-4901-972c-e75cd4b88304 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9d2e5574c117496cbb2a6569bb40cfbb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:53.952296 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2066/4139] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Sep 30 09:58:53 2022] POST /identity/v3/users/9d2e5574c117496cbb2a6569bb40cfbb/password => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:54.958452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6e493-f8f2-4f97-826e-b911ea3e1ffa None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:54.959098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6e493-f8f2-4f97-826e-b911ea3e1ffa None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:54.959098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6e493-f8f2-4f97-826e-b911ea3e1ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:54.979882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a1c6e493-f8f2-4f97-826e-b911ea3e1ffa None None] MFA Rules not processed for user `9d2e5574c117496cbb2a6569bb40cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:54.981356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a1c6e493-f8f2-4f97-826e-b911ea3e1ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:54.985639 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2074/4140] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:54 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:58:54.990795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c23d55-0801-4ece-8bf2-980f41720cd7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:54.991383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c23d55-0801-4ece-8bf2-980f41720cd7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:54.991862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c23d55-0801-4ece-8bf2-980f41720cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:55.013824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-50c23d55-0801-4ece-8bf2-980f41720cd7 None None] MFA Rules not processed for user `9d2e5574c117496cbb2a6569bb40cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:55.015102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-50c23d55-0801-4ece-8bf2-980f41720cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:55.022061 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2067/4141] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:58:55.027076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6e493-f8f2-4f97-826e-b911ea3e1ffa None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:55.038013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6e493-f8f2-4f97-826e-b911ea3e1ffa None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:55.042074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1399a18-1d1f-439f-978c-af8a7e22372c tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d2e5574c117496cbb2a6569bb40cfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dcde50ba27c40528d71a09362f927b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:55.042735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1399a18-1d1f-439f-978c-af8a7e22372c tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:55.043031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1399a18-1d1f-439f-978c-af8a7e22372c tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:55.043303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1399a18-1d1f-439f-978c-af8a7e22372c tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] PATH_INFO: `/v3/users/9d2e5574c117496cbb2a6569bb40cfbb/password` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:55.089445 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1399a18-1d1f-439f-978c-af8a7e22372c tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9d2e5574c117496cbb2a6569bb40cfbb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:55.097901 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2075/4142] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Sep 30 09:58:55 2022] POST /identity/v3/users/9d2e5574c117496cbb2a6569bb40cfbb/password => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:55.817080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04949466-030b-4063-9c11-fb4731ccacad None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:55.817666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04949466-030b-4063-9c11-fb4731ccacad None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:55.818415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04949466-030b-4063-9c11-fb4731ccacad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:55.854959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-04949466-030b-4063-9c11-fb4731ccacad None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:55.856452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-04949466-030b-4063-9c11-fb4731ccacad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:55.909183 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:58:55.952758 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2068/4143] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:58:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:55.998080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1399a18-1d1f-439f-978c-af8a7e22372c tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:55.999902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d1399a18-1d1f-439f-978c-af8a7e22372c tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:56.102755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1e91f-1e59-4638-ae68-dc616a80ac42 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:56.103278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1e91f-1e59-4638-ae68-dc616a80ac42 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:56.103278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1e91f-1e59-4638-ae68-dc616a80ac42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:56.125224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1399a18-1d1f-439f-978c-af8a7e22372c tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:56.140702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f9848-7042-4eda-b68b-f126dbb40511 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:56.142027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f9848-7042-4eda-b68b-f126dbb40511 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:56.142502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f9848-7042-4eda-b68b-f126dbb40511 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:56.142889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f9848-7042-4eda-b68b-f126dbb40511 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:56.154675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b6b1e91f-1e59-4638-ae68-dc616a80ac42 None None] MFA Rules not processed for user `9d2e5574c117496cbb2a6569bb40cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:56.155574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f9848-7042-4eda-b68b-f126dbb40511 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:58:56.155910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b6b1e91f-1e59-4638-ae68-dc616a80ac42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:56.157644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f9848-7042-4eda-b68b-f126dbb40511 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:58:56.170493 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2069/4144] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:56 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 09:58:56.175267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b71111-b097-427c-a232-56e3394d109c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:56.175551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b71111-b097-427c-a232-56e3394d109c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:56.175823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b71111-b097-427c-a232-56e3394d109c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:56.191754 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2076/4145] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:58:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:58:56.224197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e0b71111-b097-427c-a232-56e3394d109c None None] MFA Rules not processed for user `9d2e5574c117496cbb2a6569bb40cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:56.225914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e0b71111-b097-427c-a232-56e3394d109c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:56.250027 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2070/4146] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:58:56.262667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f9848-7042-4eda-b68b-f126dbb40511 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:56.296980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f9848-7042-4eda-b68b-f126dbb40511 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:56.319741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4034a78-db43-4f69-bcf6-d8f05c40ba9b tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d2e5574c117496cbb2a6569bb40cfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dcde50ba27c40528d71a09362f927b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:56.320976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4034a78-db43-4f69-bcf6-d8f05c40ba9b tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:56.324374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4034a78-db43-4f69-bcf6-d8f05c40ba9b tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:56.326109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4034a78-db43-4f69-bcf6-d8f05c40ba9b tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] PATH_INFO: `/v3/users/9d2e5574c117496cbb2a6569bb40cfbb/password` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:56.436555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4034a78-db43-4f69-bcf6-d8f05c40ba9b tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9d2e5574c117496cbb2a6569bb40cfbb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:56.452785 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2077/4147] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Sep 30 09:58:56 2022] POST /identity/v3/users/9d2e5574c117496cbb2a6569bb40cfbb/password => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:58:57.456832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0c398-b2fa-49f7-9eb7-5d427e1ef6a8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:57.457970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0c398-b2fa-49f7-9eb7-5d427e1ef6a8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:57.458418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0c398-b2fa-49f7-9eb7-5d427e1ef6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:57.507371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c9e0c398-b2fa-49f7-9eb7-5d427e1ef6a8 None None] MFA Rules not processed for user `9d2e5574c117496cbb2a6569bb40cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:57.511149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c9e0c398-b2fa-49f7-9eb7-5d427e1ef6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:57.524138 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2071/4148] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:57 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:58:57.525092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4037dfb-36ae-43f5-877f-859c049dd3e4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:57.525542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4037dfb-36ae-43f5-877f-859c049dd3e4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:57.525905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4037dfb-36ae-43f5-877f-859c049dd3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:57.568388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d4037dfb-36ae-43f5-877f-859c049dd3e4 None None] MFA Rules not processed for user `9d2e5574c117496cbb2a6569bb40cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:57.571255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d4037dfb-36ae-43f5-877f-859c049dd3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:57.587890 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2078/4149] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:57.588321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0c398-b2fa-49f7-9eb7-5d427e1ef6a8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:58:57.622231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0c398-b2fa-49f7-9eb7-5d427e1ef6a8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:58:57.627961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ff734-38a9-4ae6-bd28-31ffd297b9f7 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d2e5574c117496cbb2a6569bb40cfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dcde50ba27c40528d71a09362f927b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:58:57.628679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ff734-38a9-4ae6-bd28-31ffd297b9f7 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:57.628963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ff734-38a9-4ae6-bd28-31ffd297b9f7 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:57.629238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ff734-38a9-4ae6-bd28-31ffd297b9f7 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] PATH_INFO: `/v3/users/9d2e5574c117496cbb2a6569bb40cfbb/password` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:57.701047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9a5ff734-38a9-4ae6-bd28-31ffd297b9f7 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9d2e5574c117496cbb2a6569bb40cfbb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:58:57.717266 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2072/4150] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Sep 30 09:58:57 2022] POST /identity/v3/users/9d2e5574c117496cbb2a6569bb40cfbb/password => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:58:58.722497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db2af7-d5e5-4fcc-9fbd-7af9768266ba None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:58.723139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db2af7-d5e5-4fcc-9fbd-7af9768266ba None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:58.723139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db2af7-d5e5-4fcc-9fbd-7af9768266ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:58.744195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-27db2af7-d5e5-4fcc-9fbd-7af9768266ba None None] MFA Rules not processed for user `9d2e5574c117496cbb2a6569bb40cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:58.745653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-27db2af7-d5e5-4fcc-9fbd-7af9768266ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:58.751712 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2079/4151] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:58 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:58:59.755191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2d2fc-288c-45a8-9848-6f6e8a7f1f6d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:59.755675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2d2fc-288c-45a8-9848-6f6e8a7f1f6d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:59.755771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2d2fc-288c-45a8-9848-6f6e8a7f1f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:59.776729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8db2d2fc-288c-45a8-9848-6f6e8a7f1f6d None None] MFA Rules not processed for user `9d2e5574c117496cbb2a6569bb40cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:59.777926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8db2d2fc-288c-45a8-9848-6f6e8a7f1f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:59.793189 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2073/4152] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:58:59.794736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5372d7e-4a6d-4cd5-8624-39e82671bf79 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:59.795235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5372d7e-4a6d-4cd5-8624-39e82671bf79 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:59.795565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5372d7e-4a6d-4cd5-8624-39e82671bf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:59.830739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e5372d7e-4a6d-4cd5-8624-39e82671bf79 None None] MFA Rules not processed for user `9d2e5574c117496cbb2a6569bb40cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:58:59.832456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e5372d7e-4a6d-4cd5-8624-39e82671bf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:58:59.837521 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2080/4153] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:59 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:58:59.841692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c74dbd-5bf5-485c-bf50-07eb7243058b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:59.841974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c74dbd-5bf5-485c-bf50-07eb7243058b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:59.842243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c74dbd-5bf5-485c-bf50-07eb7243058b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:58:59.939753 n-d-master-1 devstack@keystone.service[82080]: WARNING keystone.server.flask.application [None req-38c74dbd-5bf5-485c-bf50-07eb7243058b None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 30 09:58:59.941551 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2074/4154] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:59 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 101 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Sep 30 09:58:59.946411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3101c1-8a74-4c81-8015-627254299af7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:58:59.946836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3101c1-8a74-4c81-8015-627254299af7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:58:59.947205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3101c1-8a74-4c81-8015-627254299af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:00.002246 n-d-master-1 devstack@keystone.service[82079]: WARNING keystone.server.flask.application [None req-0b3101c1-8a74-4c81-8015-627254299af7 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 30 09:59:00.006616 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2081/4155] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:58:59 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 61 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Sep 30 09:59:00.011298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03aa85-49a7-4a06-9c6d-c64cb1b6ca71 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:00.011577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03aa85-49a7-4a06-9c6d-c64cb1b6ca71 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:00.011849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03aa85-49a7-4a06-9c6d-c64cb1b6ca71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:00.039278 n-d-master-1 devstack@keystone.service[82080]: WARNING keystone.server.flask.application [None req-8d03aa85-49a7-4a06-9c6d-c64cb1b6ca71 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 30 09:59:00.043581 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2075/4156] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:00 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 33 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Sep 30 09:59:02.838856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3101c1-8a74-4c81-8015-627254299af7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:02.840753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0b3101c1-8a74-4c81-8015-627254299af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:02.871828 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:UPDATE=3,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:02.966209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3101c1-8a74-4c81-8015-627254299af7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:02.977198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f982b3b-c3d2-469a-8e2f-f42532f581ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:02.977198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f982b3b-c3d2-469a-8e2f-f42532f581ba service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:02.977198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f982b3b-c3d2-469a-8e2f-f42532f581ba service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:02.977198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f982b3b-c3d2-469a-8e2f-f42532f581ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:02.977588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8f982b3b-c3d2-469a-8e2f-f42532f581ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:02.989539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f982b3b-c3d2-469a-8e2f-f42532f581ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:02.991357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f982b3b-c3d2-469a-8e2f-f42532f581ba service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:03.003871 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2082/4157] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:03.080748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03aa85-49a7-4a06-9c6d-c64cb1b6ca71 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:03.083271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8d03aa85-49a7-4a06-9c6d-c64cb1b6ca71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:03.125226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03aa85-49a7-4a06-9c6d-c64cb1b6ca71 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:03.144064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5841afc-440b-49b7-b4cc-7f8e4a512be6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:03.144867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5841afc-440b-49b7-b4cc-7f8e4a512be6 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:03.146087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5841afc-440b-49b7-b4cc-7f8e4a512be6 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:03.148020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5841afc-440b-49b7-b4cc-7f8e4a512be6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:03.150868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a5841afc-440b-49b7-b4cc-7f8e4a512be6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:03.257939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5841afc-440b-49b7-b4cc-7f8e4a512be6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:03.259544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5841afc-440b-49b7-b4cc-7f8e4a512be6 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:03.291945 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2076/4158] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:08.606499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06d140-94ec-4efa-ab0f-1a45106b65dc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:08.607026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06d140-94ec-4efa-ab0f-1a45106b65dc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:08.607271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06d140-94ec-4efa-ab0f-1a45106b65dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:08.633070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8f06d140-94ec-4efa-ab0f-1a45106b65dc None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:08.634855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8f06d140-94ec-4efa-ab0f-1a45106b65dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:08.644234 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2083/4159] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 09:59:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:08.665258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5841afc-440b-49b7-b4cc-7f8e4a512be6 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:08.680486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5841afc-440b-49b7-b4cc-7f8e4a512be6 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:08.701345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576bc32-6269-4050-9cb7-71c004a44143 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:08.701964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576bc32-6269-4050-9cb7-71c004a44143 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:08.702423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576bc32-6269-4050-9cb7-71c004a44143 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:08.702872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576bc32-6269-4050-9cb7-71c004a44143 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:08.714644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576bc32-6269-4050-9cb7-71c004a44143 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:08.716218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576bc32-6269-4050-9cb7-71c004a44143 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:08.729911 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2077/4160] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:59:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:59:09.792099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bfcaa-2e5a-4c8d-8c1d-b8e6bd38f8b8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:09.792751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bfcaa-2e5a-4c8d-8c1d-b8e6bd38f8b8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:09.792751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bfcaa-2e5a-4c8d-8c1d-b8e6bd38f8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:09.812777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8a8bfcaa-2e5a-4c8d-8c1d-b8e6bd38f8b8 None None] MFA Rules not processed for user `24bd7adec54c44f9a941628f5adcc7a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:09.813987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8a8bfcaa-2e5a-4c8d-8c1d-b8e6bd38f8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:09.887871 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2084/4161] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:10.231823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd343f1-f2f6-4f68-96a1-50cb1c37d4e8 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:10.233082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd343f1-f2f6-4f68-96a1-50cb1c37d4e8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:10.233082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd343f1-f2f6-4f68-96a1-50cb1c37d4e8 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:10.234498 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2078/4162] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 09:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 09:59:10.240278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ad58e-63b9-4dbc-896e-41a322588981 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:10.241657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ad58e-63b9-4dbc-896e-41a322588981 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:10.242167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ad58e-63b9-4dbc-896e-41a322588981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:10.292542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b17ad58e-63b9-4dbc-896e-41a322588981 None None] MFA Rules not processed for user `a9b0fd833b134a089433cd2985caba80`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:10.294419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b17ad58e-63b9-4dbc-896e-41a322588981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:10.355547 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2085/4163] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:59:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:59:10.378822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd343f1-f2f6-4f68-96a1-50cb1c37d4e8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:10.382456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8dd343f1-f2f6-4f68-96a1-50cb1c37d4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:10.411184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd343f1-f2f6-4f68-96a1-50cb1c37d4e8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:10.416041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03568cb2-5910-4bcd-9e20-c408c7150b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:10.416754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03568cb2-5910-4bcd-9e20-c408c7150b94 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:10.417095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03568cb2-5910-4bcd-9e20-c408c7150b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:10.417428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03568cb2-5910-4bcd-9e20-c408c7150b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:10.426099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03568cb2-5910-4bcd-9e20-c408c7150b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:10.427792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03568cb2-5910-4bcd-9e20-c408c7150b94 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:10.437967 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2079/4164] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:10.569179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb0d48-4524-4a5f-83b7-0a3232e40ce9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:10.569467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb0d48-4524-4a5f-83b7-0a3232e40ce9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:10.569806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb0d48-4524-4a5f-83b7-0a3232e40ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:10.591097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-dfdb0d48-4524-4a5f-83b7-0a3232e40ce9 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:10.592700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dfdb0d48-4524-4a5f-83b7-0a3232e40ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:10.605238 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2086/4165] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 09:59:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:10.617453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03568cb2-5910-4bcd-9e20-c408c7150b94 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:10.632174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03568cb2-5910-4bcd-9e20-c408c7150b94 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:10.637848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc0405-5bf5-467f-8961-3cf328933e43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:10.638745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc0405-5bf5-467f-8961-3cf328933e43 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:10.639309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc0405-5bf5-467f-8961-3cf328933e43 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:10.639827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc0405-5bf5-467f-8961-3cf328933e43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:10.649196 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:UPDATE=2,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:10.652057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc0405-5bf5-467f-8961-3cf328933e43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:10.654241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc0405-5bf5-467f-8961-3cf328933e43 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:10.673784 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2080/4166] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:59:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:59:10.696560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb0d48-4524-4a5f-83b7-0a3232e40ce9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:10.698172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dfdb0d48-4524-4a5f-83b7-0a3232e40ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:10.754190 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:10.830878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb0d48-4524-4a5f-83b7-0a3232e40ce9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:10.839397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c13c2-cacd-4414-8ccf-e9aa45ec13a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:10.840062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c13c2-cacd-4414-8ccf-e9aa45ec13a2 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:10.840336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c13c2-cacd-4414-8ccf-e9aa45ec13a2 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:10.840672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c13c2-cacd-4414-8ccf-e9aa45ec13a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:10.842577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7b0c13c2-cacd-4414-8ccf-e9aa45ec13a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:10.867105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c13c2-cacd-4414-8ccf-e9aa45ec13a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:10.869331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c13c2-cacd-4414-8ccf-e9aa45ec13a2 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:10.902319 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2087/4167] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:11.057032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194ef69-e9ce-4186-b2aa-3f3165beb15a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:11.057425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194ef69-e9ce-4186-b2aa-3f3165beb15a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:11.058267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194ef69-e9ce-4186-b2aa-3f3165beb15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:11.127642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfee5e-6a8a-49c0-b487-04e23675fa7e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:11.127923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfee5e-6a8a-49c0-b487-04e23675fa7e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:11.128359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfee5e-6a8a-49c0-b487-04e23675fa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:11.140928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3194ef69-e9ce-4186-b2aa-3f3165beb15a None None] MFA Rules not processed for user `9d2e5574c117496cbb2a6569bb40cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:11.142308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3194ef69-e9ce-4186-b2aa-3f3165beb15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:11.154461 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2081/4168] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:11 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:59:11.155747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194ef69-e9ce-4186-b2aa-3f3165beb15a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:11.173542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-abcfee5e-6a8a-49c0-b487-04e23675fa7e None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:11.174913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-abcfee5e-6a8a-49c0-b487-04e23675fa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:11.178777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194ef69-e9ce-4186-b2aa-3f3165beb15a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:11.186488 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2088/4169] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 09:59:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:11.192214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4429d-0d31-4c07-833d-65be8b62f384 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d2e5574c117496cbb2a6569bb40cfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dcde50ba27c40528d71a09362f927b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:11.192914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4429d-0d31-4c07-833d-65be8b62f384 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:11.193203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4429d-0d31-4c07-833d-65be8b62f384 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:11.193478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4429d-0d31-4c07-833d-65be8b62f384 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] PATH_INFO: `/v3/users/9d2e5574c117496cbb2a6569bb40cfbb/password` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:11.205449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfee5e-6a8a-49c0-b487-04e23675fa7e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:11.220985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfee5e-6a8a-49c0-b487-04e23675fa7e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:11.228307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9be9e-e1ad-42ae-813e-56a78831efde service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:11.228940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9be9e-e1ad-42ae-813e-56a78831efde service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:11.229233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9be9e-e1ad-42ae-813e-56a78831efde service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:11.229574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9be9e-e1ad-42ae-813e-56a78831efde service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:11.242543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9be9e-e1ad-42ae-813e-56a78831efde service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:11.244329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9be9e-e1ad-42ae-813e-56a78831efde service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:11.254962 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2089/4170] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:59:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 09:59:11.265738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-62f4429d-0d31-4c07-833d-65be8b62f384 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9d2e5574c117496cbb2a6569bb40cfbb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:11.278619 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2082/4171] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Sep 30 09:59:11 2022] POST /identity/v3/users/9d2e5574c117496cbb2a6569bb40cfbb/password => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:12.283783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c4862-74d1-4538-8e94-c438e831d15a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:12.284352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c4862-74d1-4538-8e94-c438e831d15a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:12.285241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c4862-74d1-4538-8e94-c438e831d15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:12.330023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d95c4862-74d1-4538-8e94-c438e831d15a None None] MFA Rules not processed for user `9d2e5574c117496cbb2a6569bb40cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:12.333232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d95c4862-74d1-4538-8e94-c438e831d15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:12.338646 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2090/4172] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:12 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:59:12.342902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2ab4e-01ce-48e3-952b-d9ad7b2529f1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:12.343422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2ab4e-01ce-48e3-952b-d9ad7b2529f1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:12.343616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2ab4e-01ce-48e3-952b-d9ad7b2529f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:12.438167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-02c2ab4e-01ce-48e3-952b-d9ad7b2529f1 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Sep 30 09:59:12.438167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 09:59:12.438167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 09:59:12.438167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 09:59:12.438167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 09:59:12.438167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 09:59:12.438167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 09:59:12.438167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 09:59:12.438167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 09:59:12.438167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 09:59:12.438167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 09:59:12.438167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 09:59:12.438167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 30 09:59:12.438167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 30 09:59:12.438167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Sep 30 09:59:12.438167 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Sep 30 09:59:12.439535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Sep 30 09:59:12.439535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Sep 30 09:59:12.439535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Sep 30 09:59:12.439535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Sep 30 09:59:12.439535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Sep 30 09:59:12.439535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Sep 30 09:59:12.439535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Sep 30 09:59:12.439535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Sep 30 09:59:12.439535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:59:12.439535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:59:12.439535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Sep 30 09:59:12.439535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Sep 30 09:59:12.439535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Sep 30 09:59:12.439535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.check_revocation(token) Sep 30 09:59:12.439535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:59:12.439535 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:59:12.440760 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Sep 30 09:59:12.440760 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Sep 30 09:59:12.440760 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:59:12.440760 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:59:12.440760 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Sep 30 09:59:12.440760 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Sep 30 09:59:12.440760 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 09:59:12.440760 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 09:59:12.440760 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Sep 30 09:59:12.440760 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Sep 30 09:59:12.440760 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Sep 30 09:59:12.440760 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 09:59:12.446541 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2083/4173] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:12 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 09:59:12.450622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b1160-0a50-44c5-ad9d-1f81937553e0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:12.450908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b1160-0a50-44c5-ad9d-1f81937553e0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:12.451944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b1160-0a50-44c5-ad9d-1f81937553e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:12.519290 n-d-master-1 devstack@keystone.service[82079]: WARNING keystone.server.flask.application [None req-381b1160-0a50-44c5-ad9d-1f81937553e0 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 30 09:59:12.521160 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2091/4174] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:12 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 71 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Sep 30 09:59:12.525912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1956c9f-831f-45bb-9a80-8ea503930734 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:12.527254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1956c9f-831f-45bb-9a80-8ea503930734 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:12.528005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1956c9f-831f-45bb-9a80-8ea503930734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:12.569974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e1956c9f-831f-45bb-9a80-8ea503930734 None None] MFA Rules not processed for user `9d2e5574c117496cbb2a6569bb40cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:12.571597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e1956c9f-831f-45bb-9a80-8ea503930734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:12.583613 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2084/4175] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:59:12.588359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b1160-0a50-44c5-ad9d-1f81937553e0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:12.601307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b1160-0a50-44c5-ad9d-1f81937553e0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:12.605617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bb646-08ad-4608-b7ba-c877acd3197c tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d2e5574c117496cbb2a6569bb40cfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dcde50ba27c40528d71a09362f927b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:12.606607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bb646-08ad-4608-b7ba-c877acd3197c tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:12.607145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bb646-08ad-4608-b7ba-c877acd3197c tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:12.607797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bb646-08ad-4608-b7ba-c877acd3197c tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] PATH_INFO: `/v3/users/9d2e5574c117496cbb2a6569bb40cfbb/password` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:12.666395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-753bb646-08ad-4608-b7ba-c877acd3197c tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9d2e5574c117496cbb2a6569bb40cfbb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:12.677624 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2092/4176] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Sep 30 09:59:12 2022] POST /identity/v3/users/9d2e5574c117496cbb2a6569bb40cfbb/password => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:13.683728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bccb9-3339-4d92-ba0a-39a1bcaa9b92 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:13.684646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bccb9-3339-4d92-ba0a-39a1bcaa9b92 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:13.685140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bccb9-3339-4d92-ba0a-39a1bcaa9b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:13.707700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4a4bccb9-3339-4d92-ba0a-39a1bcaa9b92 None None] MFA Rules not processed for user `9d2e5574c117496cbb2a6569bb40cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:13.710734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4a4bccb9-3339-4d92-ba0a-39a1bcaa9b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:13.715298 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2085/4177] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:13 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:59:13.719695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e438e4-ad30-4a40-9ad8-ed737ebb9a37 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:13.720516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e438e4-ad30-4a40-9ad8-ed737ebb9a37 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:13.721030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e438e4-ad30-4a40-9ad8-ed737ebb9a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:13.744113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-97e438e4-ad30-4a40-9ad8-ed737ebb9a37 None None] MFA Rules not processed for user `9d2e5574c117496cbb2a6569bb40cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:13.754516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-97e438e4-ad30-4a40-9ad8-ed737ebb9a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:13.763394 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2093/4178] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:13.767318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bccb9-3339-4d92-ba0a-39a1bcaa9b92 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:13.784866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bccb9-3339-4d92-ba0a-39a1bcaa9b92 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:13.793445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca0520-0175-4fbb-bb56-3561a9dede12 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d2e5574c117496cbb2a6569bb40cfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dcde50ba27c40528d71a09362f927b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:13.794509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca0520-0175-4fbb-bb56-3561a9dede12 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:13.795121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca0520-0175-4fbb-bb56-3561a9dede12 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:13.795605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca0520-0175-4fbb-bb56-3561a9dede12 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] PATH_INFO: `/v3/users/9d2e5574c117496cbb2a6569bb40cfbb/password` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:13.865276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6eca0520-0175-4fbb-bb56-3561a9dede12 tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9d2e5574c117496cbb2a6569bb40cfbb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:13.878668 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2086/4179] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Sep 30 09:59:13 2022] POST /identity/v3/users/9d2e5574c117496cbb2a6569bb40cfbb/password => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:14.884696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a26d51-99af-44ff-9f98-4229f7aaaf92 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:14.885343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a26d51-99af-44ff-9f98-4229f7aaaf92 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:14.885523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a26d51-99af-44ff-9f98-4229f7aaaf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:14.904578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-95a26d51-99af-44ff-9f98-4229f7aaaf92 None None] MFA Rules not processed for user `9d2e5574c117496cbb2a6569bb40cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:14.905808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-95a26d51-99af-44ff-9f98-4229f7aaaf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:14.914848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cd3fd-9d88-4e6a-9212-e3531f4d3e60 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:14.914848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cd3fd-9d88-4e6a-9212-e3531f4d3e60 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:14.914848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cd3fd-9d88-4e6a-9212-e3531f4d3e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:14.917064 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2094/4180] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:14 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:59:14.941230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7c9cd3fd-9d88-4e6a-9212-e3531f4d3e60 None None] MFA Rules not processed for user `9d2e5574c117496cbb2a6569bb40cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:14.942452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7c9cd3fd-9d88-4e6a-9212-e3531f4d3e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:14.950126 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2087/4181] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:59:14.954350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a26d51-99af-44ff-9f98-4229f7aaaf92 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:14.967784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a26d51-99af-44ff-9f98-4229f7aaaf92 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:14.974041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529650a-f4ec-480c-a58b-f082a8c869ec tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d2e5574c117496cbb2a6569bb40cfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dcde50ba27c40528d71a09362f927b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:14.975239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529650a-f4ec-480c-a58b-f082a8c869ec tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:14.975529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529650a-f4ec-480c-a58b-f082a8c869ec tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:14.975808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529650a-f4ec-480c-a58b-f082a8c869ec tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] PATH_INFO: `/v3/users/9d2e5574c117496cbb2a6569bb40cfbb/password` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:15.022746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d529650a-f4ec-480c-a58b-f082a8c869ec tempest-IdentityV3UsersTest-582226629 tempest-IdentityV3UsersTest-582226629-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9d2e5574c117496cbb2a6569bb40cfbb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:15.031961 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2095/4182] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Sep 30 09:59:14 2022] POST /identity/v3/users/9d2e5574c117496cbb2a6569bb40cfbb/password => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:16.038146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1f9cf-0b9e-47f0-a914-e32855193d87 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:16.039056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1f9cf-0b9e-47f0-a914-e32855193d87 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:16.039628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1f9cf-0b9e-47f0-a914-e32855193d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:16.060937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-80e1f9cf-0b9e-47f0-a914-e32855193d87 None None] MFA Rules not processed for user `9d2e5574c117496cbb2a6569bb40cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:16.062149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-80e1f9cf-0b9e-47f0-a914-e32855193d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:16.065357 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2088/4183] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:16 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 09:59:17.071880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09b952-161e-4859-8ffd-e7563abf99fd None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:17.072485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09b952-161e-4859-8ffd-e7563abf99fd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:17.072485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09b952-161e-4859-8ffd-e7563abf99fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:17.093126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6a09b952-161e-4859-8ffd-e7563abf99fd None None] MFA Rules not processed for user `9d2e5574c117496cbb2a6569bb40cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:17.094357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6a09b952-161e-4859-8ffd-e7563abf99fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:17.102504 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2096/4184] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:17.107974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1f9cf-0b9e-47f0-a914-e32855193d87 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:17.186533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1f9cf-0b9e-47f0-a914-e32855193d87 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:17.191215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1647a3b-e7cc-4761-afff-90f409043ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:17.191920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1647a3b-e7cc-4761-afff-90f409043ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:17.192338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1647a3b-e7cc-4761-afff-90f409043ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:17.192634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1647a3b-e7cc-4761-afff-90f409043ae9 admin admin] PATH_INFO: `/v3/users/9d2e5574c117496cbb2a6569bb40cfbb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:17.195057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1647a3b-e7cc-4761-afff-90f409043ae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d2e5574c117496cbb2a6569bb40cfbb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:17.197456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1647a3b-e7cc-4761-afff-90f409043ae9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:17.234558 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:UPDATE=4,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:17.257566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d1647a3b-e7cc-4761-afff-90f409043ae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d2e5574c117496cbb2a6569bb40cfbb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:17.265588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d1647a3b-e7cc-4761-afff-90f409043ae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d2e5574c117496cbb2a6569bb40cfbb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:17.266147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d1647a3b-e7cc-4761-afff-90f409043ae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d2e5574c117496cbb2a6569bb40cfbb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:17.279287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d1647a3b-e7cc-4761-afff-90f409043ae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d2e5574c117496cbb2a6569bb40cfbb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:17.286363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d1647a3b-e7cc-4761-afff-90f409043ae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d2e5574c117496cbb2a6569bb40cfbb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:17.292849 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2089/4185] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:59:17 2022] DELETE /identity/v3/users/9d2e5574c117496cbb2a6569bb40cfbb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:17.297338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7652a-94b1-4061-bd75-3fe563e410dd None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:17.297650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7652a-94b1-4061-bd75-3fe563e410dd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:17.297923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7652a-94b1-4061-bd75-3fe563e410dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:17.317538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-70e7652a-94b1-4061-bd75-3fe563e410dd None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:17.319400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-70e7652a-94b1-4061-bd75-3fe563e410dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:17.359801 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:UPDATE=3,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:17.406834 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2097/4186] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:59:17.417578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1647a3b-e7cc-4761-afff-90f409043ae9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:17.419395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d1647a3b-e7cc-4761-afff-90f409043ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:17.506857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1647a3b-e7cc-4761-afff-90f409043ae9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:17.510619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26c9c6-8df3-4091-bbaf-4c7f1e28f245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:17.511320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26c9c6-8df3-4091-bbaf-4c7f1e28f245 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:17.511661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26c9c6-8df3-4091-bbaf-4c7f1e28f245 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:17.512021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26c9c6-8df3-4091-bbaf-4c7f1e28f245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:17.524213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26c9c6-8df3-4091-bbaf-4c7f1e28f245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:17.525693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26c9c6-8df3-4091-bbaf-4c7f1e28f245 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:17.537785 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2090/4187] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:17.867292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7652a-94b1-4061-bd75-3fe563e410dd None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:17.869007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-70e7652a-94b1-4061-bd75-3fe563e410dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:17.887621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7652a-94b1-4061-bd75-3fe563e410dd None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:17.892527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65caf24-c232-43cf-a48d-74734040cc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:17.893343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65caf24-c232-43cf-a48d-74734040cc9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:17.893718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65caf24-c232-43cf-a48d-74734040cc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:17.894092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65caf24-c232-43cf-a48d-74734040cc9a admin admin] PATH_INFO: `/v3/projects/8dcde50ba27c40528d71a09362f927b1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:17.895547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65caf24-c232-43cf-a48d-74734040cc9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dcde50ba27c40528d71a09362f927b1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:17.898175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65caf24-c232-43cf-a48d-74734040cc9a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:17.974629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e65caf24-c232-43cf-a48d-74734040cc9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dcde50ba27c40528d71a09362f927b1', 'request_id': 'req-e65caf24-c232-43cf-a48d-74734040cc9a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:17.986430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e65caf24-c232-43cf-a48d-74734040cc9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dcde50ba27c40528d71a09362f927b1', 'request_id': 'req-e65caf24-c232-43cf-a48d-74734040cc9a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:17.996221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e65caf24-c232-43cf-a48d-74734040cc9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dcde50ba27c40528d71a09362f927b1', 'request_id': 'req-e65caf24-c232-43cf-a48d-74734040cc9a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:18.008986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e65caf24-c232-43cf-a48d-74734040cc9a admin admin] The token cache is being invalidate because project 8dcde50ba27c40528d71a09362f927b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:59:18.009397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e65caf24-c232-43cf-a48d-74734040cc9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:18.010158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e65caf24-c232-43cf-a48d-74734040cc9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:18.012015 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2098/4188] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:59:17 2022] DELETE /identity/v3/projects/8dcde50ba27c40528d71a09362f927b1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:18.016792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64026b30-330e-4889-9214-132d6e31c1d0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:18.017320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64026b30-330e-4889-9214-132d6e31c1d0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:18.018076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64026b30-330e-4889-9214-132d6e31c1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:18.040539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-64026b30-330e-4889-9214-132d6e31c1d0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:18.041877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-64026b30-330e-4889-9214-132d6e31c1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:18.118888 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2091/4189] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:18.127753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d08a2-5e80-4952-a7f9-b4beb1b2af78 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:18.128319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d08a2-5e80-4952-a7f9-b4beb1b2af78 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:18.128319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d08a2-5e80-4952-a7f9-b4beb1b2af78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:18.156110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-440d08a2-5e80-4952-a7f9-b4beb1b2af78 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:18.157966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-440d08a2-5e80-4952-a7f9-b4beb1b2af78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:18.169512 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2099/4190] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:18.174718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64026b30-330e-4889-9214-132d6e31c1d0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:18.193399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64026b30-330e-4889-9214-132d6e31c1d0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:18.207989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc5d75-afa8-4885-a842-39f04494ff08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:18.209491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc5d75-afa8-4885-a842-39f04494ff08 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:18.210069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc5d75-afa8-4885-a842-39f04494ff08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:18.210322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc5d75-afa8-4885-a842-39f04494ff08 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:18.210990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc5d75-afa8-4885-a842-39f04494ff08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:59:18.211521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc5d75-afa8-4885-a842-39f04494ff08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:18.213357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc5d75-afa8-4885-a842-39f04494ff08 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:18.232999 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2092/4191] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:59:18.233629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d08a2-5e80-4952-a7f9-b4beb1b2af78 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:18.250361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d08a2-5e80-4952-a7f9-b4beb1b2af78 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:18.260086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c064eac-9ce6-4ea8-b51f-e966e4c94c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:18.260935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c064eac-9ce6-4ea8-b51f-e966e4c94c4d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:18.261316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c064eac-9ce6-4ea8-b51f-e966e4c94c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:18.261700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c064eac-9ce6-4ea8-b51f-e966e4c94c4d admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:18.262427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c064eac-9ce6-4ea8-b51f-e966e4c94c4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:18.264936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c064eac-9ce6-4ea8-b51f-e966e4c94c4d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:18.310488 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2100/4192] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:59:18 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:59:18.314600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc5d75-afa8-4885-a842-39f04494ff08 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:18.327533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc5d75-afa8-4885-a842-39f04494ff08 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:18.364221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585876a-0b98-405f-8a37-a81d391cc2df None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:18.364891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585876a-0b98-405f-8a37-a81d391cc2df None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:18.365927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585876a-0b98-405f-8a37-a81d391cc2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:18.370748 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:18.418165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9585876a-0b98-405f-8a37-a81d391cc2df None None] MFA Rules not processed for user `3b97b83ebcf242d0abd55dfbb15ab066`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:18.419396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9585876a-0b98-405f-8a37-a81d391cc2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:18.451790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73884714-7949-401a-98db-cd3cf36cceb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:18.452734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73884714-7949-401a-98db-cd3cf36cceb9 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:18.453323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73884714-7949-401a-98db-cd3cf36cceb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:18.453754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73884714-7949-401a-98db-cd3cf36cceb9 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:18.454840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73884714-7949-401a-98db-cd3cf36cceb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:18.458234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73884714-7949-401a-98db-cd3cf36cceb9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:18.497991 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2093/4193] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:59:18 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:59:18.502374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73884714-7949-401a-98db-cd3cf36cceb9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:18.514984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73884714-7949-401a-98db-cd3cf36cceb9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:18.520639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f0f38-5ee8-482c-bf3d-d9961a881e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:18.521731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f0f38-5ee8-482c-bf3d-d9961a881e86 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:18.522187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f0f38-5ee8-482c-bf3d-d9961a881e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:18.522729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f0f38-5ee8-482c-bf3d-d9961a881e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:18.523715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f0f38-5ee8-482c-bf3d-d9961a881e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:18.525572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f0f38-5ee8-482c-bf3d-d9961a881e86 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:18.538052 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2101/4194] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:59:18.538449 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2094/4195] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:59:18.542115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585876a-0b98-405f-8a37-a81d391cc2df None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:18.554867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585876a-0b98-405f-8a37-a81d391cc2df None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:18.560620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278c27e-70da-4b9b-a440-e17d6ba959fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:18.561947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278c27e-70da-4b9b-a440-e17d6ba959fb admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:18.561947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278c27e-70da-4b9b-a440-e17d6ba959fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:18.561947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278c27e-70da-4b9b-a440-e17d6ba959fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:18.562701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278c27e-70da-4b9b-a440-e17d6ba959fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:18.564487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278c27e-70da-4b9b-a440-e17d6ba959fb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:18.575982 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2102/4196] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:59:18.580251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f0f38-5ee8-482c-bf3d-d9961a881e86 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:18.591357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f0f38-5ee8-482c-bf3d-d9961a881e86 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:18.596072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62323e7a-3e18-4525-9fd3-9455559f9643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:18.596763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62323e7a-3e18-4525-9fd3-9455559f9643 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:18.597041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62323e7a-3e18-4525-9fd3-9455559f9643 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:18.597308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62323e7a-3e18-4525-9fd3-9455559f9643 admin admin] PATH_INFO: `/v3/projects/91c3a5b7f0074c468c439db5ad8ace7a/users/111b421fd24440d7a851687360127c6f/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:18.613666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62323e7a-3e18-4525-9fd3-9455559f9643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c3a5b7f0074c468c439db5ad8ace7a, user_id=111b421fd24440d7a851687360127c6f, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:18.617525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62323e7a-3e18-4525-9fd3-9455559f9643 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:18.634133 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2095/4197] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:59:18 2022] PUT /identity/v3/projects/91c3a5b7f0074c468c439db5ad8ace7a/users/111b421fd24440d7a851687360127c6f/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:18.644451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16594f-4be3-407a-bee0-f4db4864ba37 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:18.644925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16594f-4be3-407a-bee0-f4db4864ba37 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:18.645293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16594f-4be3-407a-bee0-f4db4864ba37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:18.670569 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:18.684070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ea16594f-4be3-407a-bee0-f4db4864ba37 None None] MFA Rules not processed for user `111b421fd24440d7a851687360127c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:18.685451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ea16594f-4be3-407a-bee0-f4db4864ba37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:18.791894 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2103/4198] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:18.808069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62323e7a-3e18-4525-9fd3-9455559f9643 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:18.810860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-62323e7a-3e18-4525-9fd3-9455559f9643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:18.937671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62323e7a-3e18-4525-9fd3-9455559f9643 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:18.937671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c9da4-1f8c-49c1-a21f-13a270e5049d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:18.937671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c9da4-1f8c-49c1-a21f-13a270e5049d service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:18.937671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c9da4-1f8c-49c1-a21f-13a270e5049d service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:18.938110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c9da4-1f8c-49c1-a21f-13a270e5049d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:18.951068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c9da4-1f8c-49c1-a21f-13a270e5049d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:18.952755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c9da4-1f8c-49c1-a21f-13a270e5049d service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:18.967441 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2096/4199] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:19.195897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4e668-e9d3-4eed-86b2-2bfed1cc76a9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:19.196473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4e668-e9d3-4eed-86b2-2bfed1cc76a9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:19.196473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4e668-e9d3-4eed-86b2-2bfed1cc76a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:19.234271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6ae4e668-e9d3-4eed-86b2-2bfed1cc76a9 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:19.235779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6ae4e668-e9d3-4eed-86b2-2bfed1cc76a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:19.335070 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2104/4200] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:59:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:59:19.335809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c9da4-1f8c-49c1-a21f-13a270e5049d service glance] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:19.337328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-645c9da4-1f8c-49c1-a21f-13a270e5049d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:19.469849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c9da4-1f8c-49c1-a21f-13a270e5049d service glance] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:19.504799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9a718-11f1-48c3-b452-bad22acfe63a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:19.504799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9a718-11f1-48c3-b452-bad22acfe63a service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:19.504799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9a718-11f1-48c3-b452-bad22acfe63a service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:19.504799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9a718-11f1-48c3-b452-bad22acfe63a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:19.516804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9a718-11f1-48c3-b452-bad22acfe63a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:19.518661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9a718-11f1-48c3-b452-bad22acfe63a service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:19.540278 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2097/4201] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:59:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 09:59:19.924822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880f2f7-aefe-4c75-aff2-56b01a70ba00 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:19.925286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880f2f7-aefe-4c75-aff2-56b01a70ba00 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:19.925657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880f2f7-aefe-4c75-aff2-56b01a70ba00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:19.961260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b880f2f7-aefe-4c75-aff2-56b01a70ba00 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:19.962793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b880f2f7-aefe-4c75-aff2-56b01a70ba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:19.981887 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2105/4202] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:59:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:19.995892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9a718-11f1-48c3-b452-bad22acfe63a service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:20.017429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9a718-11f1-48c3-b452-bad22acfe63a service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:20.040249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52846f-aa83-4868-a6dc-40a8eee04a5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:20.040916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52846f-aa83-4868-a6dc-40a8eee04a5d service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:20.041198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52846f-aa83-4868-a6dc-40a8eee04a5d service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:20.041475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52846f-aa83-4868-a6dc-40a8eee04a5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:20.057373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52846f-aa83-4868-a6dc-40a8eee04a5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:20.058975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52846f-aa83-4868-a6dc-40a8eee04a5d service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:20.065505 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:20.093050 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2098/4203] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:59:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:59:20.660406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a393de-d96d-4b4d-9dad-e604712b458d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:20.661093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a393de-d96d-4b4d-9dad-e604712b458d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:20.661093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a393de-d96d-4b4d-9dad-e604712b458d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:20.694595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-19a393de-d96d-4b4d-9dad-e604712b458d None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:20.696492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-19a393de-d96d-4b4d-9dad-e604712b458d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:20.722841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52846f-aa83-4868-a6dc-40a8eee04a5d service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:20.723360 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2106/4204] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:59:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:20.757819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52846f-aa83-4868-a6dc-40a8eee04a5d service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:20.770234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e088cf0-9855-440d-ab63-912c0e70d662 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:20.793229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e088cf0-9855-440d-ab63-912c0e70d662 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:20.796424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e088cf0-9855-440d-ab63-912c0e70d662 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:20.798232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e088cf0-9855-440d-ab63-912c0e70d662 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:20.825154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e088cf0-9855-440d-ab63-912c0e70d662 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:20.829216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e088cf0-9855-440d-ab63-912c0e70d662 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:20.842161 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2099/4205] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:59:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:59:21.244816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a464a-9d04-43fc-b220-070042bf3b4b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:21.246066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a464a-9d04-43fc-b220-070042bf3b4b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:21.247602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a464a-9d04-43fc-b220-070042bf3b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:21.273145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-575a464a-9d04-43fc-b220-070042bf3b4b None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:21.275790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-575a464a-9d04-43fc-b220-070042bf3b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:21.284818 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2107/4206] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:59:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:21.298106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e088cf0-9855-440d-ab63-912c0e70d662 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:21.311614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e088cf0-9855-440d-ab63-912c0e70d662 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:21.324733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fe1f9-5e0c-4a05-8cf9-443f54a3f0aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:21.326071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fe1f9-5e0c-4a05-8cf9-443f54a3f0aa service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:21.326574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fe1f9-5e0c-4a05-8cf9-443f54a3f0aa service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:21.328732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fe1f9-5e0c-4a05-8cf9-443f54a3f0aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:21.341077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fe1f9-5e0c-4a05-8cf9-443f54a3f0aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:21.343014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fe1f9-5e0c-4a05-8cf9-443f54a3f0aa service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:21.359353 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2100/4207] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:59:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:59:21.599218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a464a-9d04-43fc-b220-070042bf3b4b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:21.603388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-575a464a-9d04-43fc-b220-070042bf3b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:21.722061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a464a-9d04-43fc-b220-070042bf3b4b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:21.728455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d661d-d8bb-4ac0-9b4b-2285e2f81e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:21.729162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d661d-d8bb-4ac0-9b4b-2285e2f81e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:21.729479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d661d-d8bb-4ac0-9b4b-2285e2f81e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:21.729999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d661d-d8bb-4ac0-9b4b-2285e2f81e8a admin admin] PATH_INFO: `/v3/users/b3485c6515d64172a375290063a9406f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:21.731223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d661d-d8bb-4ac0-9b4b-2285e2f81e8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3485c6515d64172a375290063a9406f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:21.733720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d661d-d8bb-4ac0-9b4b-2285e2f81e8a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:21.764811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a691b59-ba0b-4a19-98b1-79a4badb484e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:21.765383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a691b59-ba0b-4a19-98b1-79a4badb484e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:21.765383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a691b59-ba0b-4a19-98b1-79a4badb484e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:21.772157 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:21.792445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1a691b59-ba0b-4a19-98b1-79a4badb484e None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:21.794946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1a691b59-ba0b-4a19-98b1-79a4badb484e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:21.805475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bf6d661d-d8bb-4ac0-9b4b-2285e2f81e8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3485c6515d64172a375290063a9406f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:21.805718 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2101/4208] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:59:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:59:21.806615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bf6d661d-d8bb-4ac0-9b4b-2285e2f81e8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3485c6515d64172a375290063a9406f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:21.817844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bf6d661d-d8bb-4ac0-9b4b-2285e2f81e8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3485c6515d64172a375290063a9406f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:21.825060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a691b59-ba0b-4a19-98b1-79a4badb484e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:21.845585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a691b59-ba0b-4a19-98b1-79a4badb484e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:21.846242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bf6d661d-d8bb-4ac0-9b4b-2285e2f81e8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3485c6515d64172a375290063a9406f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:21.857207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bf6d661d-d8bb-4ac0-9b4b-2285e2f81e8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3485c6515d64172a375290063a9406f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:21.858439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a03143-c70a-4ac0-ace5-bab1d739619d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:21.859555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a03143-c70a-4ac0-ace5-bab1d739619d service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:21.859975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a03143-c70a-4ac0-ace5-bab1d739619d service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:21.860823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a03143-c70a-4ac0-ace5-bab1d739619d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:21.863813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-97a03143-c70a-4ac0-ace5-bab1d739619d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:21.866838 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2108/4209] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:59:21 2022] DELETE /identity/v3/users/b3485c6515d64172a375290063a9406f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:21.878111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a03143-c70a-4ac0-ace5-bab1d739619d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:21.879787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a03143-c70a-4ac0-ace5-bab1d739619d service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:21.900017 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2102/4210] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:59:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:59:22.149609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d661d-d8bb-4ac0-9b4b-2285e2f81e8a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:22.151417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bf6d661d-d8bb-4ac0-9b4b-2285e2f81e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:22.277663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce98991-2374-4d25-b096-67d781b71390 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:22.277947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce98991-2374-4d25-b096-67d781b71390 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:22.278215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce98991-2374-4d25-b096-67d781b71390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:22.300183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d661d-d8bb-4ac0-9b4b-2285e2f81e8a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:22.321601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fd42e-85ae-490d-92e0-f9e1da350519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:22.322723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fd42e-85ae-490d-92e0-f9e1da350519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:22.323361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6ce98991-2374-4d25-b096-67d781b71390 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:22.324030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fd42e-85ae-490d-92e0-f9e1da350519 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:22.324412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fd42e-85ae-490d-92e0-f9e1da350519 admin admin] PATH_INFO: `/v3/projects/1e09a5f6f6e24b4daaffc7578681610c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:22.325985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6ce98991-2374-4d25-b096-67d781b71390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:22.326652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2fd42e-85ae-490d-92e0-f9e1da350519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e09a5f6f6e24b4daaffc7578681610c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:22.328937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2fd42e-85ae-490d-92e0-f9e1da350519 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:22.409761 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2103/4211] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 09:59:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:22.418349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2c2fd42e-85ae-490d-92e0-f9e1da350519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e09a5f6f6e24b4daaffc7578681610c', 'request_id': 'req-2c2fd42e-85ae-490d-92e0-f9e1da350519'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:22.428742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2c2fd42e-85ae-490d-92e0-f9e1da350519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e09a5f6f6e24b4daaffc7578681610c', 'request_id': 'req-2c2fd42e-85ae-490d-92e0-f9e1da350519'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:22.430545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce98991-2374-4d25-b096-67d781b71390 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:22.432352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6ce98991-2374-4d25-b096-67d781b71390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:22.441169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2c2fd42e-85ae-490d-92e0-f9e1da350519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e09a5f6f6e24b4daaffc7578681610c', 'request_id': 'req-2c2fd42e-85ae-490d-92e0-f9e1da350519'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:22.454140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2c2fd42e-85ae-490d-92e0-f9e1da350519 admin admin] The token cache is being invalidate because project 1e09a5f6f6e24b4daaffc7578681610c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:59:22.454432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2c2fd42e-85ae-490d-92e0-f9e1da350519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:22.455112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2c2fd42e-85ae-490d-92e0-f9e1da350519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:22.460724 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2109/4212] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:59:22 2022] DELETE /identity/v3/projects/1e09a5f6f6e24b4daaffc7578681610c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:22.468416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58809c91-b467-4965-982a-45af4b4600a2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:22.469081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58809c91-b467-4965-982a-45af4b4600a2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:22.471247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58809c91-b467-4965-982a-45af4b4600a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:22.515568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-58809c91-b467-4965-982a-45af4b4600a2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:22.520229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-58809c91-b467-4965-982a-45af4b4600a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:22.573481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce98991-2374-4d25-b096-67d781b71390 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:22.590894 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:22.633314 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2110/4213] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:22.642461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ffd4a-67ae-4b6a-9248-43aacaddf776 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:22.643434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ffd4a-67ae-4b6a-9248-43aacaddf776 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:22.643981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ffd4a-67ae-4b6a-9248-43aacaddf776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:22.668884 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:22.671380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-969ffd4a-67ae-4b6a-9248-43aacaddf776 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:22.673233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-969ffd4a-67ae-4b6a-9248-43aacaddf776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:22.681267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a9ac7-c11e-404c-9fb0-1133fbb32c30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:22.682414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a9ac7-c11e-404c-9fb0-1133fbb32c30 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:22.685924 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2111/4214] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:59:22.686325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a9ac7-c11e-404c-9fb0-1133fbb32c30 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:22.688992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a9ac7-c11e-404c-9fb0-1133fbb32c30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:22.692918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1a5a9ac7-c11e-404c-9fb0-1133fbb32c30 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:22.699137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ffd4a-67ae-4b6a-9248-43aacaddf776 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:22.711312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ffd4a-67ae-4b6a-9248-43aacaddf776 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:22.716903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70427c-0d79-4628-9779-89cc3f75aa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:22.720007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70427c-0d79-4628-9779-89cc3f75aa71 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:22.720593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70427c-0d79-4628-9779-89cc3f75aa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:22.721309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70427c-0d79-4628-9779-89cc3f75aa71 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:22.722335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70427c-0d79-4628-9779-89cc3f75aa71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:59:22.723886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70427c-0d79-4628-9779-89cc3f75aa71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:22.726343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70427c-0d79-4628-9779-89cc3f75aa71 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:22.742556 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2112/4215] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:59:22.746977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70427c-0d79-4628-9779-89cc3f75aa71 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:22.760004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70427c-0d79-4628-9779-89cc3f75aa71 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:22.766135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6f6f4-1e28-4b35-aa76-e1b3b3d3c859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:22.766753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6f6f4-1e28-4b35-aa76-e1b3b3d3c859 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:22.767127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6f6f4-1e28-4b35-aa76-e1b3b3d3c859 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:22.767487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6f6f4-1e28-4b35-aa76-e1b3b3d3c859 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:22.768366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6f6f4-1e28-4b35-aa76-e1b3b3d3c859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:22.770810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6f6f4-1e28-4b35-aa76-e1b3b3d3c859 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:22.778615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a9ac7-c11e-404c-9fb0-1133fbb32c30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:22.780950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a9ac7-c11e-404c-9fb0-1133fbb32c30 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:22.792195 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2104/4216] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:59:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 09:59:22.817778 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2113/4217] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:59:22 2022] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:59:22.824888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a9ac7-c11e-404c-9fb0-1133fbb32c30 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:22.839397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a9ac7-c11e-404c-9fb0-1133fbb32c30 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:22.907632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbb953-1100-4a5b-9bfa-34323a3c19d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:22.908440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbb953-1100-4a5b-9bfa-34323a3c19d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:22.908819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbb953-1100-4a5b-9bfa-34323a3c19d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:22.909156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbb953-1100-4a5b-9bfa-34323a3c19d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:22.909922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbb953-1100-4a5b-9bfa-34323a3c19d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:22.916681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbb953-1100-4a5b-9bfa-34323a3c19d5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:22.955520 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2105/4218] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:59:22 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:59:22.956729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6f6f4-1e28-4b35-aa76-e1b3b3d3c859 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:22.971691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6f6f4-1e28-4b35-aa76-e1b3b3d3c859 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:22.979698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3274bc-4a6e-44fd-a341-4b69e279e148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:22.980404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3274bc-4a6e-44fd-a341-4b69e279e148 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:22.980712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3274bc-4a6e-44fd-a341-4b69e279e148 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:22.980984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3274bc-4a6e-44fd-a341-4b69e279e148 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:22.981613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3274bc-4a6e-44fd-a341-4b69e279e148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:22.983325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3274bc-4a6e-44fd-a341-4b69e279e148 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:22.995165 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2114/4219] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:59:22.999008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbb953-1100-4a5b-9bfa-34323a3c19d5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:23.010848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbb953-1100-4a5b-9bfa-34323a3c19d5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:23.018035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de974d-6a0a-47ea-bf0e-b479512356d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:23.018648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de974d-6a0a-47ea-bf0e-b479512356d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:23.018927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de974d-6a0a-47ea-bf0e-b479512356d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:23.019196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de974d-6a0a-47ea-bf0e-b479512356d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:23.019834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de974d-6a0a-47ea-bf0e-b479512356d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:23.021626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de974d-6a0a-47ea-bf0e-b479512356d6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:23.032648 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2106/4220] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:59:23.036515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3274bc-4a6e-44fd-a341-4b69e279e148 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:23.048868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3274bc-4a6e-44fd-a341-4b69e279e148 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:23.058662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b9ed1-d6a0-4143-890c-9affcffc044a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:23.059676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b9ed1-d6a0-4143-890c-9affcffc044a admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:23.060204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b9ed1-d6a0-4143-890c-9affcffc044a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:23.060499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b9ed1-d6a0-4143-890c-9affcffc044a admin admin] PATH_INFO: `/v3/projects/cf96c1aaeddc4581af91678ba48714db/users/14504cf57ea54b2ebb08444d5041e972/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:23.080093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b9ed1-d6a0-4143-890c-9affcffc044a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf96c1aaeddc4581af91678ba48714db, user_id=14504cf57ea54b2ebb08444d5041e972, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:23.084587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b9ed1-d6a0-4143-890c-9affcffc044a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:23.104247 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2115/4221] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:59:23 2022] PUT /identity/v3/projects/cf96c1aaeddc4581af91678ba48714db/users/14504cf57ea54b2ebb08444d5041e972/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:23.106066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7007be-be5f-4345-a518-e554e591d685 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:23.106372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7007be-be5f-4345-a518-e554e591d685 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:23.106646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7007be-be5f-4345-a518-e554e591d685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:23.137700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0c7007be-be5f-4345-a518-e554e591d685 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:23.139408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0c7007be-be5f-4345-a518-e554e591d685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:23.242879 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2107/4222] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:59:23.254414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b9ed1-d6a0-4143-890c-9affcffc044a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:23.260941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-107b9ed1-d6a0-4143-890c-9affcffc044a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:23.342300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b9ed1-d6a0-4143-890c-9affcffc044a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:23.348364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bda87a-d16e-42d5-8633-b6186cf1ab5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:23.349484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bda87a-d16e-42d5-8633-b6186cf1ab5e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:23.350542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bda87a-d16e-42d5-8633-b6186cf1ab5e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:23.350990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bda87a-d16e-42d5-8633-b6186cf1ab5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:23.368503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bda87a-d16e-42d5-8633-b6186cf1ab5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:23.370342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bda87a-d16e-42d5-8633-b6186cf1ab5e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:23.382619 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2116/4223] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:23.902662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f371f-a8ec-4f6d-830a-f9e0f7583cec None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:23.903193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f371f-a8ec-4f6d-830a-f9e0f7583cec None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:23.903302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f371f-a8ec-4f6d-830a-f9e0f7583cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:23.933400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7e3f371f-a8ec-4f6d-830a-f9e0f7583cec None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:23.935590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7e3f371f-a8ec-4f6d-830a-f9e0f7583cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:23.951025 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:23.997498 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2108/4224] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 09:59:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:24.011726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bda87a-d16e-42d5-8633-b6186cf1ab5e service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:24.013323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-93bda87a-d16e-42d5-8633-b6186cf1ab5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:24.123307 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:24.131542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bda87a-d16e-42d5-8633-b6186cf1ab5e service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:24.138799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83994b-88c4-4f8f-8853-d7846f9f1b10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:24.139487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83994b-88c4-4f8f-8853-d7846f9f1b10 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:24.139761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83994b-88c4-4f8f-8853-d7846f9f1b10 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:24.140026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83994b-88c4-4f8f-8853-d7846f9f1b10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:24.150821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83994b-88c4-4f8f-8853-d7846f9f1b10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:24.152849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83994b-88c4-4f8f-8853-d7846f9f1b10 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:24.164309 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2117/4225] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:59:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:59:24.371263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2055cdb-4e5b-46ee-a511-e084f3fa9192 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:24.371542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2055cdb-4e5b-46ee-a511-e084f3fa9192 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:24.371815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2055cdb-4e5b-46ee-a511-e084f3fa9192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:24.417922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e2055cdb-4e5b-46ee-a511-e084f3fa9192 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:24.419698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e2055cdb-4e5b-46ee-a511-e084f3fa9192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:24.432768 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2109/4226] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 09:59:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:59:24.453701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83994b-88c4-4f8f-8853-d7846f9f1b10 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:24.472983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83994b-88c4-4f8f-8853-d7846f9f1b10 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:24.482184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab1b49-7e3d-4386-9c2d-1fae7e463b66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:24.483188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab1b49-7e3d-4386-9c2d-1fae7e463b66 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:24.483649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab1b49-7e3d-4386-9c2d-1fae7e463b66 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:24.484082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab1b49-7e3d-4386-9c2d-1fae7e463b66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:24.502651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab1b49-7e3d-4386-9c2d-1fae7e463b66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:24.504415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab1b49-7e3d-4386-9c2d-1fae7e463b66 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:24.516659 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2118/4227] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:59:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:59:24.702190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d1d1c-ad60-4c84-b7d0-b19bf095a9d6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:24.702478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d1d1c-ad60-4c84-b7d0-b19bf095a9d6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:24.702752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d1d1c-ad60-4c84-b7d0-b19bf095a9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:24.759292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-100d1d1c-ad60-4c84-b7d0-b19bf095a9d6 None None] MFA Rules not processed for user `14504cf57ea54b2ebb08444d5041e972`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:24.762203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-100d1d1c-ad60-4c84-b7d0-b19bf095a9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:24.782552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c86dbe-364d-4971-95ae-885bfed86d3f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:24.783899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c86dbe-364d-4971-95ae-885bfed86d3f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:24.784177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c86dbe-364d-4971-95ae-885bfed86d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:24.819153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-84c86dbe-364d-4971-95ae-885bfed86d3f None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:24.822990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-84c86dbe-364d-4971-95ae-885bfed86d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:24.841198 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2119/4228] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 09:59:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:59:24.863075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c86dbe-364d-4971-95ae-885bfed86d3f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:24.886886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c86dbe-364d-4971-95ae-885bfed86d3f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:24.898114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8311ad-1702-4b3a-9ed7-251c814f0bf7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:24.898643 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2110/4229] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:24.899400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8311ad-1702-4b3a-9ed7-251c814f0bf7 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:24.900081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345586f-9896-4515-882b-0d055ac877c0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:24.900368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345586f-9896-4515-882b-0d055ac877c0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:24.901177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345586f-9896-4515-882b-0d055ac877c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:24.901654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8311ad-1702-4b3a-9ed7-251c814f0bf7 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:24.902150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8311ad-1702-4b3a-9ed7-251c814f0bf7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:24.915752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8311ad-1702-4b3a-9ed7-251c814f0bf7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:24.918155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8311ad-1702-4b3a-9ed7-251c814f0bf7 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:24.930226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4345586f-9896-4515-882b-0d055ac877c0 None None] MFA Rules not processed for user `14504cf57ea54b2ebb08444d5041e972`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:24.931595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4345586f-9896-4515-882b-0d055ac877c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:24.938606 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2120/4230] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:59:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 09:59:24.956686 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2111/4231] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:24.958389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d7737-ffc0-4051-bd6d-6a7b4b0d3617 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:24.959558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d7737-ffc0-4051-bd6d-6a7b4b0d3617 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:24.959935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d7737-ffc0-4051-bd6d-6a7b4b0d3617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:25.001128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e62d7737-ffc0-4051-bd6d-6a7b4b0d3617 None None] MFA Rules not processed for user `14504cf57ea54b2ebb08444d5041e972`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:25.002566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e62d7737-ffc0-4051-bd6d-6a7b4b0d3617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:25.034904 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2121/4232] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:25.054866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345586f-9896-4515-882b-0d055ac877c0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:25.056945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4345586f-9896-4515-882b-0d055ac877c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:25.203104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03e478-70da-40e5-95d0-f2d34eb559c7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:25.203382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03e478-70da-40e5-95d0-f2d34eb559c7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:25.203846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03e478-70da-40e5-95d0-f2d34eb559c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:25.214625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345586f-9896-4515-882b-0d055ac877c0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:25.221014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013afc4c-c69f-476d-9f4a-1095d3808a19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:25.221659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013afc4c-c69f-476d-9f4a-1095d3808a19 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:25.222065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013afc4c-c69f-476d-9f4a-1095d3808a19 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:25.222340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013afc4c-c69f-476d-9f4a-1095d3808a19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:25.231326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013afc4c-c69f-476d-9f4a-1095d3808a19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:25.234234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013afc4c-c69f-476d-9f4a-1095d3808a19 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:25.239470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5c03e478-70da-40e5-95d0-f2d34eb559c7 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:25.245197 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2112/4233] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:25.245679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5c03e478-70da-40e5-95d0-f2d34eb559c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:25.263919 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2122/4234] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 09:59:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:25.295563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013afc4c-c69f-476d-9f4a-1095d3808a19 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:25.315008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013afc4c-c69f-476d-9f4a-1095d3808a19 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:25.324504 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118465b-b0f6-4762-9939-9fbb858a524a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:25.325465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118465b-b0f6-4762-9939-9fbb858a524a service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:25.326146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118465b-b0f6-4762-9939-9fbb858a524a service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:25.326592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118465b-b0f6-4762-9939-9fbb858a524a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:25.347204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118465b-b0f6-4762-9939-9fbb858a524a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:25.348846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118465b-b0f6-4762-9939-9fbb858a524a service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:25.363512 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2113/4235] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:59:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:59:25.577474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6415b5-24ec-448c-aba1-efb3291cca15 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:25.577829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6415b5-24ec-448c-aba1-efb3291cca15 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:25.578174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6415b5-24ec-448c-aba1-efb3291cca15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:25.604487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9a6415b5-24ec-448c-aba1-efb3291cca15 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:25.605863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9a6415b5-24ec-448c-aba1-efb3291cca15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:25.625949 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2123/4236] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 09:59:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:25.634168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118465b-b0f6-4762-9939-9fbb858a524a service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:25.652706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118465b-b0f6-4762-9939-9fbb858a524a service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:25.661368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8bb27-42c8-4388-91ad-70dbfabf61b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:25.663770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8bb27-42c8-4388-91ad-70dbfabf61b0 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:25.664677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8bb27-42c8-4388-91ad-70dbfabf61b0 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:25.665320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8bb27-42c8-4388-91ad-70dbfabf61b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:25.681672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc8bb27-42c8-4388-91ad-70dbfabf61b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:25.683948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc8bb27-42c8-4388-91ad-70dbfabf61b0 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:25.691872 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:25.712103 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2114/4237] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:59:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:59:25.898884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c9db1-59ad-43ff-a730-8ba4af8425cd None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:25.899457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c9db1-59ad-43ff-a730-8ba4af8425cd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:25.899993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c9db1-59ad-43ff-a730-8ba4af8425cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:25.941915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-463c9db1-59ad-43ff-a730-8ba4af8425cd None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:25.943909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-463c9db1-59ad-43ff-a730-8ba4af8425cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:25.989113 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2124/4238] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 09:59:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:26.020461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8bb27-42c8-4388-91ad-70dbfabf61b0 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:26.033920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8bb27-42c8-4388-91ad-70dbfabf61b0 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:26.040434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab94992-19a9-46a7-bd70-836b87e9fc55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:26.057490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab94992-19a9-46a7-bd70-836b87e9fc55 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:26.058099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab94992-19a9-46a7-bd70-836b87e9fc55 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:26.058548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab94992-19a9-46a7-bd70-836b87e9fc55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:26.069314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab94992-19a9-46a7-bd70-836b87e9fc55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:26.071254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab94992-19a9-46a7-bd70-836b87e9fc55 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:26.080885 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2115/4239] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 09:59:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 09:59:26.245419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cbf19-486d-4f44-b3ef-4b195c11a2a7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:26.246916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cbf19-486d-4f44-b3ef-4b195c11a2a7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:26.247255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cbf19-486d-4f44-b3ef-4b195c11a2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:26.290865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab94992-19a9-46a7-bd70-836b87e9fc55 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:26.292889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0ab94992-19a9-46a7-bd70-836b87e9fc55 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:26.301934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b55cbf19-486d-4f44-b3ef-4b195c11a2a7 None None] MFA Rules not processed for user `14504cf57ea54b2ebb08444d5041e972`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:26.304152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b55cbf19-486d-4f44-b3ef-4b195c11a2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:26.310661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab94992-19a9-46a7-bd70-836b87e9fc55 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:26.312483 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2125/4240] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:26.332082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6da73-28a3-4994-ac6a-9287e0717f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:26.333221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6da73-28a3-4994-ac6a-9287e0717f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:26.334195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6da73-28a3-4994-ac6a-9287e0717f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:26.334685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6da73-28a3-4994-ac6a-9287e0717f3f admin admin] PATH_INFO: `/v3/users/111b421fd24440d7a851687360127c6f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:26.336284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6da73-28a3-4994-ac6a-9287e0717f3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=111b421fd24440d7a851687360127c6f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:26.342505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6da73-28a3-4994-ac6a-9287e0717f3f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:26.410220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6ae6da73-28a3-4994-ac6a-9287e0717f3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '111b421fd24440d7a851687360127c6f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:26.420174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6ae6da73-28a3-4994-ac6a-9287e0717f3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '111b421fd24440d7a851687360127c6f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:26.421358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6ae6da73-28a3-4994-ac6a-9287e0717f3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '111b421fd24440d7a851687360127c6f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:26.435771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6ae6da73-28a3-4994-ac6a-9287e0717f3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '111b421fd24440d7a851687360127c6f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:26.446474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6ae6da73-28a3-4994-ac6a-9287e0717f3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '111b421fd24440d7a851687360127c6f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:26.456701 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2116/4241] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:59:26 2022] DELETE /identity/v3/users/111b421fd24440d7a851687360127c6f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:26.460369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bcf73-66ab-43b1-8648-9ee4b8ea4892 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:26.460760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bcf73-66ab-43b1-8648-9ee4b8ea4892 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:26.461149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bcf73-66ab-43b1-8648-9ee4b8ea4892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:26.484527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-dc2bcf73-66ab-43b1-8648-9ee4b8ea4892 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:26.485784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dc2bcf73-66ab-43b1-8648-9ee4b8ea4892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:26.618130 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2126/4242] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:26.636418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6da73-28a3-4994-ac6a-9287e0717f3f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:26.638894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6ae6da73-28a3-4994-ac6a-9287e0717f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:26.712299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6da73-28a3-4994-ac6a-9287e0717f3f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:26.716936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08e532-f34b-4dd2-b877-a1faf2ee691f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:26.717655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08e532-f34b-4dd2-b877-a1faf2ee691f service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:26.718095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08e532-f34b-4dd2-b877-a1faf2ee691f service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:26.718465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08e532-f34b-4dd2-b877-a1faf2ee691f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:26.733490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08e532-f34b-4dd2-b877-a1faf2ee691f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:26.735503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08e532-f34b-4dd2-b877-a1faf2ee691f service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:26.747183 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2117/4243] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:27.329192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a713b-1683-4d6a-82a6-550f93791d28 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:27.329865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a713b-1683-4d6a-82a6-550f93791d28 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:27.329865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a713b-1683-4d6a-82a6-550f93791d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:27.385488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-850a713b-1683-4d6a-82a6-550f93791d28 None None] MFA Rules not processed for user `14504cf57ea54b2ebb08444d5041e972`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:27.387744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-850a713b-1683-4d6a-82a6-550f93791d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:27.505458 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2127/4244] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:27.926533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08e532-f34b-4dd2-b877-a1faf2ee691f service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:27.929734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-df08e532-f34b-4dd2-b877-a1faf2ee691f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:27.950527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08e532-f34b-4dd2-b877-a1faf2ee691f service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:27.966290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf29e86-c640-47d5-b221-9a4e3c819ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:27.967227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf29e86-c640-47d5-b221-9a4e3c819ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:27.967724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf29e86-c640-47d5-b221-9a4e3c819ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:27.968192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf29e86-c640-47d5-b221-9a4e3c819ee8 admin admin] PATH_INFO: `/v3/projects/91c3a5b7f0074c468c439db5ad8ace7a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:27.969618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf29e86-c640-47d5-b221-9a4e3c819ee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91c3a5b7f0074c468c439db5ad8ace7a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:27.971743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf29e86-c640-47d5-b221-9a4e3c819ee8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:28.104242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fcf29e86-c640-47d5-b221-9a4e3c819ee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91c3a5b7f0074c468c439db5ad8ace7a', 'request_id': 'req-fcf29e86-c640-47d5-b221-9a4e3c819ee8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:28.119865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fcf29e86-c640-47d5-b221-9a4e3c819ee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91c3a5b7f0074c468c439db5ad8ace7a', 'request_id': 'req-fcf29e86-c640-47d5-b221-9a4e3c819ee8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:28.122534 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:28.141320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fcf29e86-c640-47d5-b221-9a4e3c819ee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91c3a5b7f0074c468c439db5ad8ace7a', 'request_id': 'req-fcf29e86-c640-47d5-b221-9a4e3c819ee8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:28.184945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fcf29e86-c640-47d5-b221-9a4e3c819ee8 admin admin] The token cache is being invalidate because project 91c3a5b7f0074c468c439db5ad8ace7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:59:28.186318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fcf29e86-c640-47d5-b221-9a4e3c819ee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:28.188023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fcf29e86-c640-47d5-b221-9a4e3c819ee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:28.192130 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2118/4245] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:59:27 2022] DELETE /identity/v3/projects/91c3a5b7f0074c468c439db5ad8ace7a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:28.200322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89cdbb-adb1-4ab2-81c3-342e511b5bf2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:28.201983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89cdbb-adb1-4ab2-81c3-342e511b5bf2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:28.202310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89cdbb-adb1-4ab2-81c3-342e511b5bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:28.277749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1d89cdbb-adb1-4ab2-81c3-342e511b5bf2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:28.278895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1d89cdbb-adb1-4ab2-81c3-342e511b5bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:28.368986 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:28.431929 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2128/4246] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:28.432153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6632c-e16e-4bf0-bbc3-3fe99a025bfa None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:28.432507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6632c-e16e-4bf0-bbc3-3fe99a025bfa None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:28.432931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6632c-e16e-4bf0-bbc3-3fe99a025bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:28.478729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e7e6632c-e16e-4bf0-bbc3-3fe99a025bfa None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:28.480248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e7e6632c-e16e-4bf0-bbc3-3fe99a025bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:28.490247 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2119/4247] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:59:28.494800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89cdbb-adb1-4ab2-81c3-342e511b5bf2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:28.505580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89cdbb-adb1-4ab2-81c3-342e511b5bf2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:28.517425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cab76-1a38-4785-91d7-a4ffb9f970f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:28.518191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cab76-1a38-4785-91d7-a4ffb9f970f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:28.518532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cab76-1a38-4785-91d7-a4ffb9f970f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:28.518808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cab76-1a38-4785-91d7-a4ffb9f970f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:28.519812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cab76-1a38-4785-91d7-a4ffb9f970f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:59:28.520047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cab76-1a38-4785-91d7-a4ffb9f970f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:28.522419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cab76-1a38-4785-91d7-a4ffb9f970f8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:28.549336 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2129/4248] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:59:28.553545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6632c-e16e-4bf0-bbc3-3fe99a025bfa None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:28.566437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6632c-e16e-4bf0-bbc3-3fe99a025bfa None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:28.572550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0982506-0e00-4aea-9f57-3869471108a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:28.573402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0982506-0e00-4aea-9f57-3869471108a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:28.573847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0982506-0e00-4aea-9f57-3869471108a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:28.574266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0982506-0e00-4aea-9f57-3869471108a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:28.575039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0982506-0e00-4aea-9f57-3869471108a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:28.578230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0982506-0e00-4aea-9f57-3869471108a0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:28.637607 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2120/4249] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:59:28 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:59:28.641662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cab76-1a38-4785-91d7-a4ffb9f970f8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:28.655864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cab76-1a38-4785-91d7-a4ffb9f970f8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:28.812286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192b109-5523-45be-9399-7baf48db00c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:28.812941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192b109-5523-45be-9399-7baf48db00c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:28.813222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192b109-5523-45be-9399-7baf48db00c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:28.813493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192b109-5523-45be-9399-7baf48db00c3 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:28.815989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192b109-5523-45be-9399-7baf48db00c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:28.820460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192b109-5523-45be-9399-7baf48db00c3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:28.863692 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2130/4250] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:59:28 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:59:28.865951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0982506-0e00-4aea-9f57-3869471108a0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:28.878606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0982506-0e00-4aea-9f57-3869471108a0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:28.893816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13a912-b184-49cd-bdb7-a4eabb578011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:28.894455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13a912-b184-49cd-bdb7-a4eabb578011 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:28.894730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13a912-b184-49cd-bdb7-a4eabb578011 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:28.894996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13a912-b184-49cd-bdb7-a4eabb578011 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:28.895644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13a912-b184-49cd-bdb7-a4eabb578011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:28.900070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13a912-b184-49cd-bdb7-a4eabb578011 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:28.918198 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2121/4251] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:59:28.920290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192b109-5523-45be-9399-7baf48db00c3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:28.939342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192b109-5523-45be-9399-7baf48db00c3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:28.952830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bbd49-3a87-4a83-a7df-f102fcf4d674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:28.953582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bbd49-3a87-4a83-a7df-f102fcf4d674 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:28.953961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bbd49-3a87-4a83-a7df-f102fcf4d674 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:28.954329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bbd49-3a87-4a83-a7df-f102fcf4d674 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:28.955078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bbd49-3a87-4a83-a7df-f102fcf4d674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:28.966387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bbd49-3a87-4a83-a7df-f102fcf4d674 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:28.986691 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2131/4252] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:59:28.993026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13a912-b184-49cd-bdb7-a4eabb578011 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:29.009807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13a912-b184-49cd-bdb7-a4eabb578011 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:29.019739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e47aa-4edf-4cf5-b7c6-b55e99ce5c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:29.020470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e47aa-4edf-4cf5-b7c6-b55e99ce5c5c admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:29.020789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e47aa-4edf-4cf5-b7c6-b55e99ce5c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:29.022305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e47aa-4edf-4cf5-b7c6-b55e99ce5c5c admin admin] PATH_INFO: `/v3/projects/c04d88a286824c44a4381e62f89ada48/users/6fb9a69b42cf47268add9d4edee45528/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:29.049072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e47aa-4edf-4cf5-b7c6-b55e99ce5c5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04d88a286824c44a4381e62f89ada48, user_id=6fb9a69b42cf47268add9d4edee45528, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:29.052231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e47aa-4edf-4cf5-b7c6-b55e99ce5c5c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:29.078878 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2122/4253] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:59:28 2022] PUT /identity/v3/projects/c04d88a286824c44a4381e62f89ada48/users/6fb9a69b42cf47268add9d4edee45528/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:29.089759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49514836-9f18-4e0c-9c16-861a65ed5bbe None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:29.089973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49514836-9f18-4e0c-9c16-861a65ed5bbe None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:29.090419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49514836-9f18-4e0c-9c16-861a65ed5bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:29.151649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-49514836-9f18-4e0c-9c16-861a65ed5bbe None None] MFA Rules not processed for user `6fb9a69b42cf47268add9d4edee45528`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:29.152909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-49514836-9f18-4e0c-9c16-861a65ed5bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:29.289095 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2132/4254] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:29.293158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e47aa-4edf-4cf5-b7c6-b55e99ce5c5c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:29.429943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e47aa-4edf-4cf5-b7c6-b55e99ce5c5c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:29.440093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8fe3c-0c93-4546-b483-03681505f03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:29.440864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8fe3c-0c93-4546-b483-03681505f03e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:29.441149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8fe3c-0c93-4546-b483-03681505f03e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:29.441420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8fe3c-0c93-4546-b483-03681505f03e admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:29.442055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8fe3c-0c93-4546-b483-03681505f03e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:29.444046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8fe3c-0c93-4546-b483-03681505f03e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:29.506979 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2123/4255] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:59:29 2022] POST /identity/v3/projects => generated 377 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:59:29.510968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49514836-9f18-4e0c-9c16-861a65ed5bbe None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:29.536877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49514836-9f18-4e0c-9c16-861a65ed5bbe None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:29.636942 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:29.717614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51542539-4225-4ed9-86af-568202cc9643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:29.718737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51542539-4225-4ed9-86af-568202cc9643 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:29.719181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51542539-4225-4ed9-86af-568202cc9643 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:29.719994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51542539-4225-4ed9-86af-568202cc9643 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:29.721161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51542539-4225-4ed9-86af-568202cc9643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:29.724313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51542539-4225-4ed9-86af-568202cc9643 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:29.766247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8fe3c-0c93-4546-b483-03681505f03e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:29.767417 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2133/4256] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:59:29 2022] POST /identity/v3/users => generated 295 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:59:29.778478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8fe3c-0c93-4546-b483-03681505f03e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:29.786741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7f012-603a-4c1c-bb45-4278a2dff3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:29.787326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7f012-603a-4c1c-bb45-4278a2dff3cf admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:29.787604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7f012-603a-4c1c-bb45-4278a2dff3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:29.788022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7f012-603a-4c1c-bb45-4278a2dff3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:29.788556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7f012-603a-4c1c-bb45-4278a2dff3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:29.790477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7f012-603a-4c1c-bb45-4278a2dff3cf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:29.822076 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2124/4257] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:59:29.827790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51542539-4225-4ed9-86af-568202cc9643 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:29.868458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51542539-4225-4ed9-86af-568202cc9643 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:29.889472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c1d2d-b819-49f5-938b-16535fab1655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:29.890847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c1d2d-b819-49f5-938b-16535fab1655 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:29.894932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c1d2d-b819-49f5-938b-16535fab1655 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:29.897415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c1d2d-b819-49f5-938b-16535fab1655 admin admin] PATH_INFO: `/v3/projects/75f0d2789d944f43b8116812506503ad/users/1382fb4af56240748923e6703f3e0901/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:29.941017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c1d2d-b819-49f5-938b-16535fab1655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75f0d2789d944f43b8116812506503ad, user_id=1382fb4af56240748923e6703f3e0901, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:29.943794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c1d2d-b819-49f5-938b-16535fab1655 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:30.005054 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2134/4258] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:59:29 2022] PUT /identity/v3/projects/75f0d2789d944f43b8116812506503ad/users/1382fb4af56240748923e6703f3e0901/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:30.006216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7f012-603a-4c1c-bb45-4278a2dff3cf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:30.023336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7f012-603a-4c1c-bb45-4278a2dff3cf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:30.131916 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:30.141393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cad1b-ed00-4db3-b2ba-8c04dfe6c0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:30.142777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cad1b-ed00-4db3-b2ba-8c04dfe6c0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:30.143393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cad1b-ed00-4db3-b2ba-8c04dfe6c0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:30.144714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cad1b-ed00-4db3-b2ba-8c04dfe6c0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:30.146000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cad1b-ed00-4db3-b2ba-8c04dfe6c0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:30.148558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cad1b-ed00-4db3-b2ba-8c04dfe6c0f4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:30.166547 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2125/4259] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:59:30.170814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c1d2d-b819-49f5-938b-16535fab1655 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:30.181969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c1d2d-b819-49f5-938b-16535fab1655 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:30.187066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a658f0d-c2ee-43bb-96b2-4f55cf76c17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:30.187722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a658f0d-c2ee-43bb-96b2-4f55cf76c17f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:30.188054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a658f0d-c2ee-43bb-96b2-4f55cf76c17f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:30.188333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a658f0d-c2ee-43bb-96b2-4f55cf76c17f admin admin] PATH_INFO: `/v3/projects/75f0d2789d944f43b8116812506503ad/users/1382fb4af56240748923e6703f3e0901/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:30.190375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a658f0d-c2ee-43bb-96b2-4f55cf76c17f admin admin] RBAC: Authorizing `identity:create_grant(project_id=75f0d2789d944f43b8116812506503ad, user_id=1382fb4af56240748923e6703f3e0901, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:30.193746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a658f0d-c2ee-43bb-96b2-4f55cf76c17f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:30.205075 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2135/4260] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:59:30 2022] PUT /identity/v3/projects/75f0d2789d944f43b8116812506503ad/users/1382fb4af56240748923e6703f3e0901/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:30.217685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbd63c-db8a-4416-b754-8542032db084 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:30.218275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbd63c-db8a-4416-b754-8542032db084 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:30.218774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbd63c-db8a-4416-b754-8542032db084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:30.281792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fadbd63c-db8a-4416-b754-8542032db084 None None] MFA Rules not processed for user `1382fb4af56240748923e6703f3e0901`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:30.283290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fadbd63c-db8a-4416-b754-8542032db084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:30.390397 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2126/4261] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:30.396530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a658f0d-c2ee-43bb-96b2-4f55cf76c17f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:30.399394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2a658f0d-c2ee-43bb-96b2-4f55cf76c17f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:30.523724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a658f0d-c2ee-43bb-96b2-4f55cf76c17f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:30.529744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6511f-daf2-450e-8735-908b65dc35fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:30.531126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6511f-daf2-450e-8735-908b65dc35fb service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:30.531405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6511f-daf2-450e-8735-908b65dc35fb service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:30.531674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6511f-daf2-450e-8735-908b65dc35fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:30.550187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6511f-daf2-450e-8735-908b65dc35fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:30.551733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6511f-daf2-450e-8735-908b65dc35fb service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:30.580966 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2136/4262] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:33.373227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbd63c-db8a-4416-b754-8542032db084 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:33.512960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbd63c-db8a-4416-b754-8542032db084 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:33.523278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48619e91-00ee-4618-8dea-8835c38926e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:33.524910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48619e91-00ee-4618-8dea-8835c38926e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:33.528273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48619e91-00ee-4618-8dea-8835c38926e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:33.528863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48619e91-00ee-4618-8dea-8835c38926e0 admin admin] PATH_INFO: `/v3/users/6fb9a69b42cf47268add9d4edee45528` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:33.530878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48619e91-00ee-4618-8dea-8835c38926e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fb9a69b42cf47268add9d4edee45528)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:33.532928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48619e91-00ee-4618-8dea-8835c38926e0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:33.601140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-48619e91-00ee-4618-8dea-8835c38926e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fb9a69b42cf47268add9d4edee45528'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:33.610889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-48619e91-00ee-4618-8dea-8835c38926e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fb9a69b42cf47268add9d4edee45528'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:33.611635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-48619e91-00ee-4618-8dea-8835c38926e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fb9a69b42cf47268add9d4edee45528'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:33.628541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-48619e91-00ee-4618-8dea-8835c38926e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fb9a69b42cf47268add9d4edee45528'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:33.636862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-48619e91-00ee-4618-8dea-8835c38926e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fb9a69b42cf47268add9d4edee45528'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:33.637798 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:33.647017 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2127/4263] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:59:33 2022] DELETE /identity/v3/users/6fb9a69b42cf47268add9d4edee45528 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:33.655539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b465e1-ef1e-4d80-bc6b-9042cd6f50d5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:33.656071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b465e1-ef1e-4d80-bc6b-9042cd6f50d5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:33.656071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b465e1-ef1e-4d80-bc6b-9042cd6f50d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:33.701161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c3b465e1-ef1e-4d80-bc6b-9042cd6f50d5 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:33.702726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c3b465e1-ef1e-4d80-bc6b-9042cd6f50d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:33.773950 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2137/4264] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:59:33.783996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48619e91-00ee-4618-8dea-8835c38926e0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:33.785491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-48619e91-00ee-4618-8dea-8835c38926e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:33.855028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48619e91-00ee-4618-8dea-8835c38926e0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:33.858849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3957f-47a7-4f91-848b-f75f92815ebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:33.859462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3957f-47a7-4f91-848b-f75f92815ebd service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:33.859741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3957f-47a7-4f91-848b-f75f92815ebd service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:33.860012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3957f-47a7-4f91-848b-f75f92815ebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:33.872480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3957f-47a7-4f91-848b-f75f92815ebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:33.874089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3957f-47a7-4f91-848b-f75f92815ebd service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:33.886141 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2128/4265] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:34.344809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b465e1-ef1e-4d80-bc6b-9042cd6f50d5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:34.346266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c3b465e1-ef1e-4d80-bc6b-9042cd6f50d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:34.365930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b465e1-ef1e-4d80-bc6b-9042cd6f50d5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:34.371451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629437e0-dd29-49a0-bd4d-a10719c3a0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:34.372332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629437e0-dd29-49a0-bd4d-a10719c3a0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:34.372818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629437e0-dd29-49a0-bd4d-a10719c3a0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:34.373867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629437e0-dd29-49a0-bd4d-a10719c3a0c3 admin admin] PATH_INFO: `/v3/projects/c04d88a286824c44a4381e62f89ada48` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:34.375337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629437e0-dd29-49a0-bd4d-a10719c3a0c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c04d88a286824c44a4381e62f89ada48)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:34.377344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629437e0-dd29-49a0-bd4d-a10719c3a0c3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:34.406515 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:34.452353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-629437e0-dd29-49a0-bd4d-a10719c3a0c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c04d88a286824c44a4381e62f89ada48', 'request_id': 'req-629437e0-dd29-49a0-bd4d-a10719c3a0c3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:34.463587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-629437e0-dd29-49a0-bd4d-a10719c3a0c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c04d88a286824c44a4381e62f89ada48', 'request_id': 'req-629437e0-dd29-49a0-bd4d-a10719c3a0c3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:34.475480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-629437e0-dd29-49a0-bd4d-a10719c3a0c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c04d88a286824c44a4381e62f89ada48', 'request_id': 'req-629437e0-dd29-49a0-bd4d-a10719c3a0c3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:34.491042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-629437e0-dd29-49a0-bd4d-a10719c3a0c3 admin admin] The token cache is being invalidate because project c04d88a286824c44a4381e62f89ada48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:59:34.491042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-629437e0-dd29-49a0-bd4d-a10719c3a0c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:34.495309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-629437e0-dd29-49a0-bd4d-a10719c3a0c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:34.501797 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2138/4266] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:59:34 2022] DELETE /identity/v3/projects/c04d88a286824c44a4381e62f89ada48 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:34.503637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3957f-47a7-4f91-848b-f75f92815ebd service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:34.519608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3957f-47a7-4f91-848b-f75f92815ebd service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:34.631414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a73558-c290-46d6-890a-d28bd8927b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:34.632558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a73558-c290-46d6-890a-d28bd8927b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:34.632869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a73558-c290-46d6-890a-d28bd8927b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:34.633147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a73558-c290-46d6-890a-d28bd8927b67 admin admin] PATH_INFO: `/v3/users/1382fb4af56240748923e6703f3e0901` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:34.636196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a73558-c290-46d6-890a-d28bd8927b67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1382fb4af56240748923e6703f3e0901)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:34.643228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a73558-c290-46d6-890a-d28bd8927b67 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:34.748311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-69a73558-c290-46d6-890a-d28bd8927b67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1382fb4af56240748923e6703f3e0901'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:34.759859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-69a73558-c290-46d6-890a-d28bd8927b67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1382fb4af56240748923e6703f3e0901'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:34.760780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-69a73558-c290-46d6-890a-d28bd8927b67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1382fb4af56240748923e6703f3e0901'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:34.781179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-69a73558-c290-46d6-890a-d28bd8927b67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1382fb4af56240748923e6703f3e0901'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:34.790486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-69a73558-c290-46d6-890a-d28bd8927b67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1382fb4af56240748923e6703f3e0901'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:34.810880 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2129/4267] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:59:34 2022] DELETE /identity/v3/users/1382fb4af56240748923e6703f3e0901 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:34.860175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629437e0-dd29-49a0-bd4d-a10719c3a0c3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:34.862812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-629437e0-dd29-49a0-bd4d-a10719c3a0c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:34.878290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629437e0-dd29-49a0-bd4d-a10719c3a0c3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:34.973146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c02544-b574-45b0-b8fb-26cbb5581bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:34.974186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c02544-b574-45b0-b8fb-26cbb5581bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:34.974854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c02544-b574-45b0-b8fb-26cbb5581bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:34.975131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c02544-b574-45b0-b8fb-26cbb5581bb6 admin admin] PATH_INFO: `/v3/users/131fb75001434f6998555cde568935ec` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:34.976431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c02544-b574-45b0-b8fb-26cbb5581bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=131fb75001434f6998555cde568935ec)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:34.979036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c02544-b574-45b0-b8fb-26cbb5581bb6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:35.038013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-32c02544-b574-45b0-b8fb-26cbb5581bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '131fb75001434f6998555cde568935ec'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:35.039437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-32c02544-b574-45b0-b8fb-26cbb5581bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '131fb75001434f6998555cde568935ec'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:35.052059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-32c02544-b574-45b0-b8fb-26cbb5581bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '131fb75001434f6998555cde568935ec'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:35.072491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-32c02544-b574-45b0-b8fb-26cbb5581bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '131fb75001434f6998555cde568935ec'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:35.081469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-32c02544-b574-45b0-b8fb-26cbb5581bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '131fb75001434f6998555cde568935ec'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:35.089991 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2139/4268] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 09:59:34 2022] DELETE /identity/v3/users/131fb75001434f6998555cde568935ec => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:35.095127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d2515-1d92-435e-a477-cd61a07acf70 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:35.095634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d2515-1d92-435e-a477-cd61a07acf70 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:35.095970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d2515-1d92-435e-a477-cd61a07acf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:35.134029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f18d2515-1d92-435e-a477-cd61a07acf70 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:35.135555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f18d2515-1d92-435e-a477-cd61a07acf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:35.153006 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:35.225775 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2130/4269] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:35.232843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c02544-b574-45b0-b8fb-26cbb5581bb6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:35.235399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-32c02544-b574-45b0-b8fb-26cbb5581bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:35.281714 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:35.318688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c02544-b574-45b0-b8fb-26cbb5581bb6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:35.323260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b5832-a9b6-48df-a7db-395d92e6c510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:35.324011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b5832-a9b6-48df-a7db-395d92e6c510 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:35.324288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b5832-a9b6-48df-a7db-395d92e6c510 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:35.324552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b5832-a9b6-48df-a7db-395d92e6c510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:35.334888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b5832-a9b6-48df-a7db-395d92e6c510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:35.336312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b5832-a9b6-48df-a7db-395d92e6c510 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:35.345877 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2140/4270] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:35.659697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d2515-1d92-435e-a477-cd61a07acf70 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:35.662085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f18d2515-1d92-435e-a477-cd61a07acf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:35.677086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d2515-1d92-435e-a477-cd61a07acf70 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:35.682988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcade6-1cd9-4540-a31f-fb1ae5813857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:35.683701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcade6-1cd9-4540-a31f-fb1ae5813857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:35.684040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcade6-1cd9-4540-a31f-fb1ae5813857 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:35.684373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcade6-1cd9-4540-a31f-fb1ae5813857 admin admin] PATH_INFO: `/v3/projects/84cd3c9bde864c2398adb20ebc7c3454` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:35.685879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcade6-1cd9-4540-a31f-fb1ae5813857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84cd3c9bde864c2398adb20ebc7c3454)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:35.688042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcade6-1cd9-4540-a31f-fb1ae5813857 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:35.751163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-63dcade6-1cd9-4540-a31f-fb1ae5813857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84cd3c9bde864c2398adb20ebc7c3454', 'request_id': 'req-63dcade6-1cd9-4540-a31f-fb1ae5813857'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:35.763393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-63dcade6-1cd9-4540-a31f-fb1ae5813857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84cd3c9bde864c2398adb20ebc7c3454', 'request_id': 'req-63dcade6-1cd9-4540-a31f-fb1ae5813857'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:35.775352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-63dcade6-1cd9-4540-a31f-fb1ae5813857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84cd3c9bde864c2398adb20ebc7c3454', 'request_id': 'req-63dcade6-1cd9-4540-a31f-fb1ae5813857'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:35.793000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b5832-a9b6-48df-a7db-395d92e6c510 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:35.794456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9e9b5832-a9b6-48df-a7db-395d92e6c510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:35.794978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-63dcade6-1cd9-4540-a31f-fb1ae5813857 admin admin] The token cache is being invalidate because project 84cd3c9bde864c2398adb20ebc7c3454 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:59:35.795396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-63dcade6-1cd9-4540-a31f-fb1ae5813857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:35.796155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-63dcade6-1cd9-4540-a31f-fb1ae5813857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:35.798194 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2131/4271] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:59:35 2022] DELETE /identity/v3/projects/84cd3c9bde864c2398adb20ebc7c3454 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:35.802687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c261106-202f-4737-9fbc-4d9c59b0e615 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:35.803031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c261106-202f-4737-9fbc-4d9c59b0e615 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:35.803778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c261106-202f-4737-9fbc-4d9c59b0e615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:35.811900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b5832-a9b6-48df-a7db-395d92e6c510 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:35.855880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3c261106-202f-4737-9fbc-4d9c59b0e615 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:35.858285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3c261106-202f-4737-9fbc-4d9c59b0e615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:35.993299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1194970-3478-4649-bcab-34a72ce16344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:35.994742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1194970-3478-4649-bcab-34a72ce16344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:35.995363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1194970-3478-4649-bcab-34a72ce16344 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:35.996022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1194970-3478-4649-bcab-34a72ce16344 admin admin] PATH_INFO: `/v3/projects/75f0d2789d944f43b8116812506503ad` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:35.999008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1194970-3478-4649-bcab-34a72ce16344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75f0d2789d944f43b8116812506503ad)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:36.005353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1194970-3478-4649-bcab-34a72ce16344 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:36.045682 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2132/4272] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:59:36.055223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e5ea0-32ec-44b1-b5a0-44b353a382a8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:36.055862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e5ea0-32ec-44b1-b5a0-44b353a382a8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:36.057794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e5ea0-32ec-44b1-b5a0-44b353a382a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:36.129141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-334e5ea0-32ec-44b1-b5a0-44b353a382a8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:36.133041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-334e5ea0-32ec-44b1-b5a0-44b353a382a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:36.142320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1194970-3478-4649-bcab-34a72ce16344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75f0d2789d944f43b8116812506503ad', 'request_id': 'req-b1194970-3478-4649-bcab-34a72ce16344'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:36.153572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1194970-3478-4649-bcab-34a72ce16344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75f0d2789d944f43b8116812506503ad', 'request_id': 'req-b1194970-3478-4649-bcab-34a72ce16344'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:36.176375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1194970-3478-4649-bcab-34a72ce16344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75f0d2789d944f43b8116812506503ad', 'request_id': 'req-b1194970-3478-4649-bcab-34a72ce16344'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:36.200037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1194970-3478-4649-bcab-34a72ce16344 admin admin] The token cache is being invalidate because project 75f0d2789d944f43b8116812506503ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:59:36.213269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1194970-3478-4649-bcab-34a72ce16344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:36.215321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1194970-3478-4649-bcab-34a72ce16344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:36.222981 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2141/4273] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:59:35 2022] DELETE /identity/v3/projects/75f0d2789d944f43b8116812506503ad => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 09:59:36.225144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25189127-3e59-4c9a-8b81-0a52f3439535 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:36.225370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25189127-3e59-4c9a-8b81-0a52f3439535 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:36.225722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25189127-3e59-4c9a-8b81-0a52f3439535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:36.250042 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:36.309805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-25189127-3e59-4c9a-8b81-0a52f3439535 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:36.312016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-25189127-3e59-4c9a-8b81-0a52f3439535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:36.321268 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2133/4274] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:36.322107 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2142/4275] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:36.325198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e5ea0-32ec-44b1-b5a0-44b353a382a8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:36.330180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691e97e-242b-446c-87cf-06a77f4a3f5b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:36.330738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691e97e-242b-446c-87cf-06a77f4a3f5b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:36.331222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691e97e-242b-446c-87cf-06a77f4a3f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:36.340453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e5ea0-32ec-44b1-b5a0-44b353a382a8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:36.353020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355834a4-9e9e-477a-8fec-bc7c8e39400c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:36.353653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355834a4-9e9e-477a-8fec-bc7c8e39400c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:36.353930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355834a4-9e9e-477a-8fec-bc7c8e39400c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:36.354203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355834a4-9e9e-477a-8fec-bc7c8e39400c admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:36.354859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355834a4-9e9e-477a-8fec-bc7c8e39400c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:59:36.355164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355834a4-9e9e-477a-8fec-bc7c8e39400c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:36.357223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355834a4-9e9e-477a-8fec-bc7c8e39400c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:36.360960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9691e97e-242b-446c-87cf-06a77f4a3f5b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:36.363700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9691e97e-242b-446c-87cf-06a77f4a3f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:36.374365 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2143/4276] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:36.378821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691e97e-242b-446c-87cf-06a77f4a3f5b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:36.378966 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2134/4277] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:59:36.383597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355834a4-9e9e-477a-8fec-bc7c8e39400c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:36.391303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691e97e-242b-446c-87cf-06a77f4a3f5b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:36.394917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355834a4-9e9e-477a-8fec-bc7c8e39400c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:36.397488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9f78a-8ca6-4340-bce8-714d076e2302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:36.398605 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9f78a-8ca6-4340-bce8-714d076e2302 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:36.399363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9f78a-8ca6-4340-bce8-714d076e2302 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:36.400045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9f78a-8ca6-4340-bce8-714d076e2302 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:36.401046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9f78a-8ca6-4340-bce8-714d076e2302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:59:36.401575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9f78a-8ca6-4340-bce8-714d076e2302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:36.401944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3b8a3-1e67-4a6c-aa28-9cd804df1096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:36.402562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3b8a3-1e67-4a6c-aa28-9cd804df1096 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:36.402976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3b8a3-1e67-4a6c-aa28-9cd804df1096 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:36.403256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3b8a3-1e67-4a6c-aa28-9cd804df1096 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:36.403926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9f78a-8ca6-4340-bce8-714d076e2302 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:36.404904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3b8a3-1e67-4a6c-aa28-9cd804df1096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:36.406787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3b8a3-1e67-4a6c-aa28-9cd804df1096 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:36.421416 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2144/4278] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:59:36.432447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9f78a-8ca6-4340-bce8-714d076e2302 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:36.441201 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2135/4279] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:59:36 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:59:36.446127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9f78a-8ca6-4340-bce8-714d076e2302 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:36.455655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3b8a3-1e67-4a6c-aa28-9cd804df1096 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:36.487986 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:36.527056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943497f-cd74-499f-806a-c40c9d21dd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:36.527726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943497f-cd74-499f-806a-c40c9d21dd5f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:36.528100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943497f-cd74-499f-806a-c40c9d21dd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:36.528658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943497f-cd74-499f-806a-c40c9d21dd5f admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:36.529656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943497f-cd74-499f-806a-c40c9d21dd5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:36.531767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943497f-cd74-499f-806a-c40c9d21dd5f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:36.562760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3b8a3-1e67-4a6c-aa28-9cd804df1096 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:36.565347 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2145/4280] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:59:36 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:59:36.569526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943497f-cd74-499f-806a-c40c9d21dd5f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:36.571453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b31e7-e0c9-4065-9c9d-fd3e36cdd438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:36.572072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b31e7-e0c9-4065-9c9d-fd3e36cdd438 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:36.572346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b31e7-e0c9-4065-9c9d-fd3e36cdd438 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:36.572632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b31e7-e0c9-4065-9c9d-fd3e36cdd438 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:36.573261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b31e7-e0c9-4065-9c9d-fd3e36cdd438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:36.575235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b31e7-e0c9-4065-9c9d-fd3e36cdd438 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:36.600107 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2136/4281] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:59:36 2022] POST /identity/v3/users => generated 292 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:59:36.603746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b31e7-e0c9-4065-9c9d-fd3e36cdd438 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:36.619682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b31e7-e0c9-4065-9c9d-fd3e36cdd438 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:36.656977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943497f-cd74-499f-806a-c40c9d21dd5f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:36.662306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1541e-a3ee-4887-a33a-b2a01eb49702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:36.663054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1541e-a3ee-4887-a33a-b2a01eb49702 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:36.663440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1541e-a3ee-4887-a33a-b2a01eb49702 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:36.663823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1541e-a3ee-4887-a33a-b2a01eb49702 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:36.664559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1541e-a3ee-4887-a33a-b2a01eb49702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:36.666648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1541e-a3ee-4887-a33a-b2a01eb49702 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:36.695316 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2146/4282] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:59:36 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:59:36.699940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1541e-a3ee-4887-a33a-b2a01eb49702 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:36.705456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ae6c2-4284-4aa0-a6e3-2f612b9e8f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:36.707595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ae6c2-4284-4aa0-a6e3-2f612b9e8f7f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:36.709200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ae6c2-4284-4aa0-a6e3-2f612b9e8f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:36.709634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ae6c2-4284-4aa0-a6e3-2f612b9e8f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:36.711516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ae6c2-4284-4aa0-a6e3-2f612b9e8f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:36.713554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ae6c2-4284-4aa0-a6e3-2f612b9e8f7f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:36.715956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1541e-a3ee-4887-a33a-b2a01eb49702 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:36.723681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c2d0a-52d7-4659-8376-61bc045a924a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:36.724700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c2d0a-52d7-4659-8376-61bc045a924a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:36.725175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c2d0a-52d7-4659-8376-61bc045a924a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:36.725598 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c2d0a-52d7-4659-8376-61bc045a924a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:36.726517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c2d0a-52d7-4659-8376-61bc045a924a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:36.728336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c2d0a-52d7-4659-8376-61bc045a924a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:36.734933 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2137/4283] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:59:36.742688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ae6c2-4284-4aa0-a6e3-2f612b9e8f7f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:36.745781 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2147/4284] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:59:36.749722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c2d0a-52d7-4659-8376-61bc045a924a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:36.756633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ae6c2-4284-4aa0-a6e3-2f612b9e8f7f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:36.761635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c2d0a-52d7-4659-8376-61bc045a924a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:36.767570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1131cb-4e05-4ca2-8d82-ec7b87dec628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:36.768258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1131cb-4e05-4ca2-8d82-ec7b87dec628 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:36.769681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24173c-75ed-4b90-9e28-a81415dee374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:36.770268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24173c-75ed-4b90-9e28-a81415dee374 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:36.770552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24173c-75ed-4b90-9e28-a81415dee374 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:36.771348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24173c-75ed-4b90-9e28-a81415dee374 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:36.773063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24173c-75ed-4b90-9e28-a81415dee374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:36.774617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24173c-75ed-4b90-9e28-a81415dee374 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:36.777165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1131cb-4e05-4ca2-8d82-ec7b87dec628 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:36.777652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1131cb-4e05-4ca2-8d82-ec7b87dec628 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:36.779071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1131cb-4e05-4ca2-8d82-ec7b87dec628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:36.782991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1131cb-4e05-4ca2-8d82-ec7b87dec628 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:36.786580 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2148/4285] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:59:36.791361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24173c-75ed-4b90-9e28-a81415dee374 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:36.805958 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2138/4286] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 09:59:36.808019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24173c-75ed-4b90-9e28-a81415dee374 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:36.808198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1131cb-4e05-4ca2-8d82-ec7b87dec628 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:36.815852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264219f8-86d0-4e0e-b09c-64c7255e37a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:36.817295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264219f8-86d0-4e0e-b09c-64c7255e37a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:36.817681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264219f8-86d0-4e0e-b09c-64c7255e37a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:36.818379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264219f8-86d0-4e0e-b09c-64c7255e37a4 admin admin] PATH_INFO: `/v3/projects/b45042278742421f9e3cca748c87ce49/users/1fd4a1cb14594c29b909786d3b90f41f/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:36.822353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1131cb-4e05-4ca2-8d82-ec7b87dec628 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:36.830448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a6ca1-32e9-4acf-a565-07236042083b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:36.831204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a6ca1-32e9-4acf-a565-07236042083b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:36.831523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a6ca1-32e9-4acf-a565-07236042083b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:36.831800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a6ca1-32e9-4acf-a565-07236042083b admin admin] PATH_INFO: `/v3/projects/d0f664a30b5940ba8fcde6f93433e6bc/users/8bb9a3b41bbc4a11a1e50fb2f5de5c1d/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:36.841320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264219f8-86d0-4e0e-b09c-64c7255e37a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b45042278742421f9e3cca748c87ce49, user_id=1fd4a1cb14594c29b909786d3b90f41f, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:36.844996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264219f8-86d0-4e0e-b09c-64c7255e37a4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:36.855663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a6ca1-32e9-4acf-a565-07236042083b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0f664a30b5940ba8fcde6f93433e6bc, user_id=8bb9a3b41bbc4a11a1e50fb2f5de5c1d, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:36.858662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a6ca1-32e9-4acf-a565-07236042083b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:36.864476 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2149/4287] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:59:36 2022] PUT /identity/v3/projects/b45042278742421f9e3cca748c87ce49/users/1fd4a1cb14594c29b909786d3b90f41f/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:36.874695 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:36.875349 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2139/4288] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:59:36 2022] PUT /identity/v3/projects/d0f664a30b5940ba8fcde6f93433e6bc/users/8bb9a3b41bbc4a11a1e50fb2f5de5c1d/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:36.880634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fc389-4016-42dd-969f-55c35902506c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:36.881098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fc389-4016-42dd-969f-55c35902506c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:36.881621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fc389-4016-42dd-969f-55c35902506c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:36.890893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48691d80-84dc-403c-8850-24c3b332d849 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:36.891188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48691d80-84dc-403c-8850-24c3b332d849 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:36.891477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48691d80-84dc-403c-8850-24c3b332d849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:36.906734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-470fc389-4016-42dd-969f-55c35902506c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:36.908932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-470fc389-4016-42dd-969f-55c35902506c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:36.952657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-48691d80-84dc-403c-8850-24c3b332d849 None None] MFA Rules not processed for user `1fd4a1cb14594c29b909786d3b90f41f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:36.955062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-48691d80-84dc-403c-8850-24c3b332d849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:37.041440 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2140/4289] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:37.053178 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:37.071456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fc389-4016-42dd-969f-55c35902506c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:37.073939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-470fc389-4016-42dd-969f-55c35902506c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:37.102391 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2150/4290] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:59:37.117340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48691d80-84dc-403c-8850-24c3b332d849 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:37.139609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48691d80-84dc-403c-8850-24c3b332d849 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:37.147324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285eb45-3b2c-4b9f-a808-3d4d462fcaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:37.148123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285eb45-3b2c-4b9f-a808-3d4d462fcaeb admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:37.149085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285eb45-3b2c-4b9f-a808-3d4d462fcaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:37.149361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285eb45-3b2c-4b9f-a808-3d4d462fcaeb admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:37.150000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285eb45-3b2c-4b9f-a808-3d4d462fcaeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:37.152627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285eb45-3b2c-4b9f-a808-3d4d462fcaeb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:37.186840 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2151/4291] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:59:37 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 09:59:37.190678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285eb45-3b2c-4b9f-a808-3d4d462fcaeb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:37.212476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fc389-4016-42dd-969f-55c35902506c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:37.300901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a4a46-9b20-48bc-8b01-92084a69f03d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:37.301416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a4a46-9b20-48bc-8b01-92084a69f03d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:37.301698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a4a46-9b20-48bc-8b01-92084a69f03d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:37.301971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a4a46-9b20-48bc-8b01-92084a69f03d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:37.319873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285eb45-3b2c-4b9f-a808-3d4d462fcaeb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:37.325848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e917a-c0bb-42c6-8d15-bbbe1182f686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:37.327205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e917a-c0bb-42c6-8d15-bbbe1182f686 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:37.327433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a4a46-9b20-48bc-8b01-92084a69f03d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:37.327557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e917a-c0bb-42c6-8d15-bbbe1182f686 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:37.327920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e917a-c0bb-42c6-8d15-bbbe1182f686 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:37.328635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e917a-c0bb-42c6-8d15-bbbe1182f686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:37.328909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a4a46-9b20-48bc-8b01-92084a69f03d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:37.331055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e917a-c0bb-42c6-8d15-bbbe1182f686 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:37.352200 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2141/4292] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:37.360753 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2152/4293] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 09:59:37 2022] POST /identity/v3/users => generated 295 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:59:37.363242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a4a46-9b20-48bc-8b01-92084a69f03d service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:37.376190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a4a46-9b20-48bc-8b01-92084a69f03d service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:37.382932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd7b88-cf37-4387-bd2c-05cbe3596ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:37.383557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd7b88-cf37-4387-bd2c-05cbe3596ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:37.383843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd7b88-cf37-4387-bd2c-05cbe3596ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:37.384114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd7b88-cf37-4387-bd2c-05cbe3596ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:37.385041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd7b88-cf37-4387-bd2c-05cbe3596ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:37.386655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd7b88-cf37-4387-bd2c-05cbe3596ba5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:37.401420 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2142/4294] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:59:37.403169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e917a-c0bb-42c6-8d15-bbbe1182f686 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:37.413796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e917a-c0bb-42c6-8d15-bbbe1182f686 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:37.418771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9306a8e-be87-4024-a27e-d255f12a2456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:37.419515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9306a8e-be87-4024-a27e-d255f12a2456 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:37.419871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9306a8e-be87-4024-a27e-d255f12a2456 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:37.420235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9306a8e-be87-4024-a27e-d255f12a2456 admin admin] PATH_INFO: `/v3/projects/b0e4c55a25124932b3d7585a0fd4e92d/users/f3c2ea221b164e2c8190020dc8cabc24/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:37.436283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9306a8e-be87-4024-a27e-d255f12a2456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0e4c55a25124932b3d7585a0fd4e92d, user_id=f3c2ea221b164e2c8190020dc8cabc24, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:37.439078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9306a8e-be87-4024-a27e-d255f12a2456 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:37.464630 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2153/4295] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:59:37 2022] PUT /identity/v3/projects/b0e4c55a25124932b3d7585a0fd4e92d/users/f3c2ea221b164e2c8190020dc8cabc24/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:37.464915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd7b88-cf37-4387-bd2c-05cbe3596ba5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:37.471226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd7b88-cf37-4387-bd2c-05cbe3596ba5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:37.529224 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:37.545456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1722aba-2ac5-45e0-bbd6-a9eb26e283a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:37.546526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1722aba-2ac5-45e0-bbd6-a9eb26e283a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:37.546975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1722aba-2ac5-45e0-bbd6-a9eb26e283a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:37.547424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1722aba-2ac5-45e0-bbd6-a9eb26e283a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:37.548244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1722aba-2ac5-45e0-bbd6-a9eb26e283a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:37.550097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1722aba-2ac5-45e0-bbd6-a9eb26e283a4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:37.576915 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2143/4296] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 09:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 09:59:37.578163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9306a8e-be87-4024-a27e-d255f12a2456 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:37.590552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9306a8e-be87-4024-a27e-d255f12a2456 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:37.596912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d28760-1d1a-428d-8f8f-eec335196db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:37.597690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d28760-1d1a-428d-8f8f-eec335196db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:37.598079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d28760-1d1a-428d-8f8f-eec335196db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:37.598454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d28760-1d1a-428d-8f8f-eec335196db8 admin admin] PATH_INFO: `/v3/projects/b0e4c55a25124932b3d7585a0fd4e92d/users/f3c2ea221b164e2c8190020dc8cabc24/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:37.601289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d28760-1d1a-428d-8f8f-eec335196db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0e4c55a25124932b3d7585a0fd4e92d, user_id=f3c2ea221b164e2c8190020dc8cabc24, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:37.604036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d28760-1d1a-428d-8f8f-eec335196db8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:37.616942 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2154/4297] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 09:59:37 2022] PUT /identity/v3/projects/b0e4c55a25124932b3d7585a0fd4e92d/users/f3c2ea221b164e2c8190020dc8cabc24/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:37.629185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf5bc3-b6ec-4bb9-90ab-9cb5a41de458 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:37.629693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf5bc3-b6ec-4bb9-90ab-9cb5a41de458 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:37.630092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf5bc3-b6ec-4bb9-90ab-9cb5a41de458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:37.677451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c7cf5bc3-b6ec-4bb9-90ab-9cb5a41de458 None None] MFA Rules not processed for user `f3c2ea221b164e2c8190020dc8cabc24`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:37.679054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c7cf5bc3-b6ec-4bb9-90ab-9cb5a41de458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:37.769346 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2144/4298] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 09:59:37.782047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d28760-1d1a-428d-8f8f-eec335196db8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:37.784175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a1d28760-1d1a-428d-8f8f-eec335196db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:37.857129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d28760-1d1a-428d-8f8f-eec335196db8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:37.861208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f27c1-116f-4b38-86f4-8bd8b3541615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:37.862342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f27c1-116f-4b38-86f4-8bd8b3541615 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:37.862700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f27c1-116f-4b38-86f4-8bd8b3541615 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:37.863045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f27c1-116f-4b38-86f4-8bd8b3541615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:37.874376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f27c1-116f-4b38-86f4-8bd8b3541615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:37.875962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f27c1-116f-4b38-86f4-8bd8b3541615 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:37.888157 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2155/4299] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:47.766883 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=42 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:47.883440 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:INSERT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:49.409408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944200a5-2b63-474d-a738-dcc642ef7f8a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:49.409973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944200a5-2b63-474d-a738-dcc642ef7f8a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:49.409973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944200a5-2b63-474d-a738-dcc642ef7f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:49.466402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-944200a5-2b63-474d-a738-dcc642ef7f8a None None] MFA Rules not processed for user `8bb9a3b41bbc4a11a1e50fb2f5de5c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:49.470862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-944200a5-2b63-474d-a738-dcc642ef7f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:49.602754 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2145/4300] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:49.697669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5414890-e0ba-43b8-9472-0de3c5c46825 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:49.699855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5414890-e0ba-43b8-9472-0de3c5c46825 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:49.699855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5414890-e0ba-43b8-9472-0de3c5c46825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:49.741077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e5414890-e0ba-43b8-9472-0de3c5c46825 None None] MFA Rules not processed for user `8bb9a3b41bbc4a11a1e50fb2f5de5c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 09:59:49.743727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e5414890-e0ba-43b8-9472-0de3c5c46825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:49.765944 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2156/4301] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 09:59:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 09:59:49.851784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944200a5-2b63-474d-a738-dcc642ef7f8a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:49.853807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-944200a5-2b63-474d-a738-dcc642ef7f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:50.029533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944200a5-2b63-474d-a738-dcc642ef7f8a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:50.035597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483388b-e06a-4094-b0b0-ac3eda539431 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:50.036394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483388b-e06a-4094-b0b0-ac3eda539431 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:50.036748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483388b-e06a-4094-b0b0-ac3eda539431 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:50.037115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483388b-e06a-4094-b0b0-ac3eda539431 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:50.056882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483388b-e06a-4094-b0b0-ac3eda539431 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:50.060461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483388b-e06a-4094-b0b0-ac3eda539431 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:50.089099 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2146/4302] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:50.693336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5414890-e0ba-43b8-9472-0de3c5c46825 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:50.710944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5414890-e0ba-43b8-9472-0de3c5c46825 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:50.715962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a20527-10f5-454a-8510-3020537f5898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:50.716817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a20527-10f5-454a-8510-3020537f5898 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:50.717108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a20527-10f5-454a-8510-3020537f5898 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:50.717381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a20527-10f5-454a-8510-3020537f5898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:50.720339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-68a20527-10f5-454a-8510-3020537f5898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:50.750462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a20527-10f5-454a-8510-3020537f5898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:50.751931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a20527-10f5-454a-8510-3020537f5898 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:50.768120 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2157/4303] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:52.191137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483388b-e06a-4094-b0b0-ac3eda539431 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:52.194622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d483388b-e06a-4094-b0b0-ac3eda539431 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:52.313808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a20527-10f5-454a-8510-3020537f5898 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:52.337794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a20527-10f5-454a-8510-3020537f5898 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:52.345219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef88f7-440a-4d46-9305-4b70b240ca7a tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3c2ea221b164e2c8190020dc8cabc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0e4c55a25124932b3d7585a0fd4e92d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:52.346115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef88f7-440a-4d46-9305-4b70b240ca7a tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:52.346593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef88f7-440a-4d46-9305-4b70b240ca7a tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:52.347522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef88f7-440a-4d46-9305-4b70b240ca7a tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:52.348361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef88f7-440a-4d46-9305-4b70b240ca7a tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:59:52.349427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef88f7-440a-4d46-9305-4b70b240ca7a tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:52.352893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef88f7-440a-4d46-9305-4b70b240ca7a tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:52.368929 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2158/4304] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 09:59:52.372426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef88f7-440a-4d46-9305-4b70b240ca7a tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:52.381011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483388b-e06a-4094-b0b0-ac3eda539431 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:52.386733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b518e8-09d3-454b-bfab-5be8ca041cdf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:52.387283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b518e8-09d3-454b-bfab-5be8ca041cdf service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:52.387563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b518e8-09d3-454b-bfab-5be8ca041cdf service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:52.387882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b518e8-09d3-454b-bfab-5be8ca041cdf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:52.389048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef88f7-440a-4d46-9305-4b70b240ca7a tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:52.389662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-60b518e8-09d3-454b-bfab-5be8ca041cdf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:52.394410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cd51a-ee9c-4b05-8d41-6281605750f9 tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3c2ea221b164e2c8190020dc8cabc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0e4c55a25124932b3d7585a0fd4e92d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:52.395286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cd51a-ee9c-4b05-8d41-6281605750f9 tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:52.396170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cd51a-ee9c-4b05-8d41-6281605750f9 tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:52.397384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cd51a-ee9c-4b05-8d41-6281605750f9 tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:52.398247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292cd51a-ee9c-4b05-8d41-6281605750f9 tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:52.400342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292cd51a-ee9c-4b05-8d41-6281605750f9 tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:52.406395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b518e8-09d3-454b-bfab-5be8ca041cdf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:52.408778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b518e8-09d3-454b-bfab-5be8ca041cdf service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:52.430011 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2147/4305] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 09:59:52.454819 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2159/4306] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 09:59:52 2022] POST /identity/v3/projects => generated 348 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 09:59:52.460207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b518e8-09d3-454b-bfab-5be8ca041cdf service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:52.468928 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 09:59:52.476363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b518e8-09d3-454b-bfab-5be8ca041cdf service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:52.601840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85366e93-fd04-4b74-8397-97728460cccd tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3c2ea221b164e2c8190020dc8cabc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0e4c55a25124932b3d7585a0fd4e92d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:52.602664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85366e93-fd04-4b74-8397-97728460cccd tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:52.603041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85366e93-fd04-4b74-8397-97728460cccd tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:52.603392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85366e93-fd04-4b74-8397-97728460cccd tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:52.606638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85366e93-fd04-4b74-8397-97728460cccd tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 09:59:52.606974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85366e93-fd04-4b74-8397-97728460cccd tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:52.610791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85366e93-fd04-4b74-8397-97728460cccd tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:52.642506 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2148/4307] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 09:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 09:59:53.667055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cd51a-ee9c-4b05-8d41-6281605750f9 tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:53.679691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cd51a-ee9c-4b05-8d41-6281605750f9 tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:53.691016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571582d-3d8e-477e-96c1-9669c5628eeb tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3c2ea221b164e2c8190020dc8cabc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0e4c55a25124932b3d7585a0fd4e92d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:53.691665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571582d-3d8e-477e-96c1-9669c5628eeb tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:53.691946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571582d-3d8e-477e-96c1-9669c5628eeb tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:53.692807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571582d-3d8e-477e-96c1-9669c5628eeb tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] PATH_INFO: `/v3/projects/f8a2ca8392fc45d3a8dc06298da74fb5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:53.694467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571582d-3d8e-477e-96c1-9669c5628eeb tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f8a2ca8392fc45d3a8dc06298da74fb5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:53.696934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571582d-3d8e-477e-96c1-9669c5628eeb tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:53.772586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5571582d-3d8e-477e-96c1-9669c5628eeb tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a2ca8392fc45d3a8dc06298da74fb5', 'request_id': 'req-5571582d-3d8e-477e-96c1-9669c5628eeb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:53.803450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5571582d-3d8e-477e-96c1-9669c5628eeb tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a2ca8392fc45d3a8dc06298da74fb5', 'request_id': 'req-5571582d-3d8e-477e-96c1-9669c5628eeb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:53.821352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5571582d-3d8e-477e-96c1-9669c5628eeb tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a2ca8392fc45d3a8dc06298da74fb5', 'request_id': 'req-5571582d-3d8e-477e-96c1-9669c5628eeb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:53.852932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5571582d-3d8e-477e-96c1-9669c5628eeb tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] The token cache is being invalidate because project f8a2ca8392fc45d3a8dc06298da74fb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 09:59:53.853314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5571582d-3d8e-477e-96c1-9669c5628eeb tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:53.856757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5571582d-3d8e-477e-96c1-9669c5628eeb tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 09:59:53.860318 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2160/4308] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 09:59:53 2022] DELETE /identity/v3/projects/f8a2ca8392fc45d3a8dc06298da74fb5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 09:59:53.901744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85366e93-fd04-4b74-8397-97728460cccd tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 09:59:53.903575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-85366e93-fd04-4b74-8397-97728460cccd tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:54.087381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85366e93-fd04-4b74-8397-97728460cccd tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 09:59:54.174163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978ec1b-0696-422e-921c-d159d95447ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 09:59:54.175660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978ec1b-0696-422e-921c-d159d95447ea service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 09:59:54.176144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978ec1b-0696-422e-921c-d159d95447ea service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 09:59:54.176704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978ec1b-0696-422e-921c-d159d95447ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 09:59:54.179247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1978ec1b-0696-422e-921c-d159d95447ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 09:59:54.267282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978ec1b-0696-422e-921c-d159d95447ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 09:59:54.268743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978ec1b-0696-422e-921c-d159d95447ea service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 09:59:54.279661 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2149/4309] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 09:59:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:00:03.845015 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=51,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:04.275670 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:04.576122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571582d-3d8e-477e-96c1-9669c5628eeb tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:04.578295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5571582d-3d8e-477e-96c1-9669c5628eeb tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:04.710412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571582d-3d8e-477e-96c1-9669c5628eeb tempest-RoutersIpV6AdminTest-2140360953 tempest-RoutersIpV6AdminTest-2140360953-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:04.719296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ad58b-03f7-4a96-9309-e39375a13b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:04.720170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ad58b-03f7-4a96-9309-e39375a13b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:04.720687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ad58b-03f7-4a96-9309-e39375a13b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:04.721157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ad58b-03f7-4a96-9309-e39375a13b60 admin admin] PATH_INFO: `/v3/users/24bd7adec54c44f9a941628f5adcc7a7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:04.722696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ad58b-03f7-4a96-9309-e39375a13b60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24bd7adec54c44f9a941628f5adcc7a7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:04.725713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ad58b-03f7-4a96-9309-e39375a13b60 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:04.782623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b06ad58b-03f7-4a96-9309-e39375a13b60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24bd7adec54c44f9a941628f5adcc7a7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:04.783345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b06ad58b-03f7-4a96-9309-e39375a13b60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24bd7adec54c44f9a941628f5adcc7a7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:04.792826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b06ad58b-03f7-4a96-9309-e39375a13b60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24bd7adec54c44f9a941628f5adcc7a7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:04.809416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b06ad58b-03f7-4a96-9309-e39375a13b60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24bd7adec54c44f9a941628f5adcc7a7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:04.828639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b06ad58b-03f7-4a96-9309-e39375a13b60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24bd7adec54c44f9a941628f5adcc7a7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:04.839040 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2161/4310] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:00:04 2022] DELETE /identity/v3/users/24bd7adec54c44f9a941628f5adcc7a7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:00:05.370603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978ec1b-0696-422e-921c-d159d95447ea service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:05.405307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978ec1b-0696-422e-921c-d159d95447ea service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:05.538601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14257f-8c53-402e-a9dd-22cb6add390c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:05.539253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14257f-8c53-402e-a9dd-22cb6add390c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:05.539535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14257f-8c53-402e-a9dd-22cb6add390c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:05.539812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14257f-8c53-402e-a9dd-22cb6add390c admin admin] PATH_INFO: `/v3/projects/602fcfa04a7e428c81e2e5129cb8c641` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:05.540998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14257f-8c53-402e-a9dd-22cb6add390c admin admin] RBAC: Authorizing `identity:delete_project(project_id=602fcfa04a7e428c81e2e5129cb8c641)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:05.542892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14257f-8c53-402e-a9dd-22cb6add390c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:05.605114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af14257f-8c53-402e-a9dd-22cb6add390c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '602fcfa04a7e428c81e2e5129cb8c641', 'request_id': 'req-af14257f-8c53-402e-a9dd-22cb6add390c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:05.616587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af14257f-8c53-402e-a9dd-22cb6add390c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '602fcfa04a7e428c81e2e5129cb8c641', 'request_id': 'req-af14257f-8c53-402e-a9dd-22cb6add390c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:05.624183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af14257f-8c53-402e-a9dd-22cb6add390c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '602fcfa04a7e428c81e2e5129cb8c641', 'request_id': 'req-af14257f-8c53-402e-a9dd-22cb6add390c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:05.637229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af14257f-8c53-402e-a9dd-22cb6add390c admin admin] The token cache is being invalidate because project 602fcfa04a7e428c81e2e5129cb8c641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:00:05.637513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af14257f-8c53-402e-a9dd-22cb6add390c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:05.638256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af14257f-8c53-402e-a9dd-22cb6add390c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:05.643099 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2150/4311] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:00:05 2022] DELETE /identity/v3/projects/602fcfa04a7e428c81e2e5129cb8c641 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:00:05.646530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ad58b-03f7-4a96-9309-e39375a13b60 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:05.648660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b06ad58b-03f7-4a96-9309-e39375a13b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:05.664252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ad58b-03f7-4a96-9309-e39375a13b60 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:05.749382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6e51d-8b90-4205-a097-f7495a0bce26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:05.750494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6e51d-8b90-4205-a097-f7495a0bce26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:05.751420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6e51d-8b90-4205-a097-f7495a0bce26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:05.751900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6e51d-8b90-4205-a097-f7495a0bce26 admin admin] PATH_INFO: `/v3/users/ab1d0b2474a84091b327ca04a247bc1d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:05.753627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6e51d-8b90-4205-a097-f7495a0bce26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1d0b2474a84091b327ca04a247bc1d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:05.755854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6e51d-8b90-4205-a097-f7495a0bce26 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:05.798808 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:05.841173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-acb6e51d-8b90-4205-a097-f7495a0bce26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1d0b2474a84091b327ca04a247bc1d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:05.842148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-acb6e51d-8b90-4205-a097-f7495a0bce26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1d0b2474a84091b327ca04a247bc1d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:05.852726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-acb6e51d-8b90-4205-a097-f7495a0bce26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1d0b2474a84091b327ca04a247bc1d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:05.868425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-acb6e51d-8b90-4205-a097-f7495a0bce26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1d0b2474a84091b327ca04a247bc1d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:05.876647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-acb6e51d-8b90-4205-a097-f7495a0bce26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1d0b2474a84091b327ca04a247bc1d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:05.884421 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2162/4312] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:00:05 2022] DELETE /identity/v3/users/ab1d0b2474a84091b327ca04a247bc1d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:00:06.296677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14257f-8c53-402e-a9dd-22cb6add390c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:06.298350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-af14257f-8c53-402e-a9dd-22cb6add390c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:06.327825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14257f-8c53-402e-a9dd-22cb6add390c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:06.493935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0916c22-2ae4-4ddc-a0ee-23bb0e4ea3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:06.494836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0916c22-2ae4-4ddc-a0ee-23bb0e4ea3f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:06.494937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0916c22-2ae4-4ddc-a0ee-23bb0e4ea3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:06.495145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0916c22-2ae4-4ddc-a0ee-23bb0e4ea3f0 admin admin] PATH_INFO: `/v3/projects/2626db7e3350492584f8e0853e2286d9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:06.496492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0916c22-2ae4-4ddc-a0ee-23bb0e4ea3f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2626db7e3350492584f8e0853e2286d9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:06.498691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0916c22-2ae4-4ddc-a0ee-23bb0e4ea3f0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:06.607780 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:06.652117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0916c22-2ae4-4ddc-a0ee-23bb0e4ea3f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2626db7e3350492584f8e0853e2286d9', 'request_id': 'req-e0916c22-2ae4-4ddc-a0ee-23bb0e4ea3f0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:06.668560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0916c22-2ae4-4ddc-a0ee-23bb0e4ea3f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2626db7e3350492584f8e0853e2286d9', 'request_id': 'req-e0916c22-2ae4-4ddc-a0ee-23bb0e4ea3f0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:06.681777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0916c22-2ae4-4ddc-a0ee-23bb0e4ea3f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2626db7e3350492584f8e0853e2286d9', 'request_id': 'req-e0916c22-2ae4-4ddc-a0ee-23bb0e4ea3f0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:06.732183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0916c22-2ae4-4ddc-a0ee-23bb0e4ea3f0 admin admin] The token cache is being invalidate because project 2626db7e3350492584f8e0853e2286d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:00:06.733895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0916c22-2ae4-4ddc-a0ee-23bb0e4ea3f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:06.737073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0916c22-2ae4-4ddc-a0ee-23bb0e4ea3f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:06.745627 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2151/4313] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:00:06 2022] DELETE /identity/v3/projects/2626db7e3350492584f8e0853e2286d9 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:00:06.752102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaba180-35c3-4bb3-bcb0-9fa39013b950 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:06.752856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaba180-35c3-4bb3-bcb0-9fa39013b950 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:06.752988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaba180-35c3-4bb3-bcb0-9fa39013b950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:06.782094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5eaba180-35c3-4bb3-bcb0-9fa39013b950 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:06.783864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5eaba180-35c3-4bb3-bcb0-9fa39013b950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:06.901309 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2163/4314] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:06.908108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5c927-5710-48e8-9c03-aaa29b1d2ad1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:06.908640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5c927-5710-48e8-9c03-aaa29b1d2ad1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:06.908885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5c927-5710-48e8-9c03-aaa29b1d2ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:06.981942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fdf5c927-5710-48e8-9c03-aaa29b1d2ad1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:06.983156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fdf5c927-5710-48e8-9c03-aaa29b1d2ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:06.999385 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2152/4315] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:07.003960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaba180-35c3-4bb3-bcb0-9fa39013b950 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:07.018280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaba180-35c3-4bb3-bcb0-9fa39013b950 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:07.030742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e99e0c-bf56-487c-a866-a20a13a7e964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:07.032494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e99e0c-bf56-487c-a866-a20a13a7e964 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:07.032978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e99e0c-bf56-487c-a866-a20a13a7e964 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:07.033420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e99e0c-bf56-487c-a866-a20a13a7e964 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:07.034614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e99e0c-bf56-487c-a866-a20a13a7e964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:00:07.035113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e99e0c-bf56-487c-a866-a20a13a7e964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:07.040998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e99e0c-bf56-487c-a866-a20a13a7e964 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:07.057711 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2164/4316] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:00:07.061805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5c927-5710-48e8-9c03-aaa29b1d2ad1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:07.072048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5c927-5710-48e8-9c03-aaa29b1d2ad1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:07.076776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91886856-c3c2-4e6d-8fdf-f24528d1e9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:07.077257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91886856-c3c2-4e6d-8fdf-f24528d1e9d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:07.077531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91886856-c3c2-4e6d-8fdf-f24528d1e9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:07.077798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91886856-c3c2-4e6d-8fdf-f24528d1e9d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:07.079445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91886856-c3c2-4e6d-8fdf-f24528d1e9d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:07.080297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91886856-c3c2-4e6d-8fdf-f24528d1e9d1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:07.113285 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2153/4317] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:00:07 2022] POST /identity/v3/projects => generated 411 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:00:07.117500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e99e0c-bf56-487c-a866-a20a13a7e964 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:07.135092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e99e0c-bf56-487c-a866-a20a13a7e964 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:07.237187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376e14c-d43a-4340-b500-4fe358487b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:07.238077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376e14c-d43a-4340-b500-4fe358487b59 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:07.239876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376e14c-d43a-4340-b500-4fe358487b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:07.239876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376e14c-d43a-4340-b500-4fe358487b59 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:07.240192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b376e14c-d43a-4340-b500-4fe358487b59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:07.244652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b376e14c-d43a-4340-b500-4fe358487b59 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:07.276015 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2165/4318] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:00:07 2022] POST /identity/v3/users => generated 306 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:00:07.280214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91886856-c3c2-4e6d-8fdf-f24528d1e9d1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:07.294403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91886856-c3c2-4e6d-8fdf-f24528d1e9d1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:07.307774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0e397-3ee5-404f-b87c-4d39e1bd8607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:07.308897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0e397-3ee5-404f-b87c-4d39e1bd8607 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:07.308897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0e397-3ee5-404f-b87c-4d39e1bd8607 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:07.309143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0e397-3ee5-404f-b87c-4d39e1bd8607 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:07.309600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0e397-3ee5-404f-b87c-4d39e1bd8607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:07.311215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0e397-3ee5-404f-b87c-4d39e1bd8607 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:07.341372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376e14c-d43a-4340-b500-4fe358487b59 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:07.355370 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2154/4319] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:00:07.357832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376e14c-d43a-4340-b500-4fe358487b59 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:07.371413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61cd4d-9ae0-4c4f-a073-f696bbfca8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:07.371918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61cd4d-9ae0-4c4f-a073-f696bbfca8ea admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:07.372198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61cd4d-9ae0-4c4f-a073-f696bbfca8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:07.372466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61cd4d-9ae0-4c4f-a073-f696bbfca8ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:07.373610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61cd4d-9ae0-4c4f-a073-f696bbfca8ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:07.374733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61cd4d-9ae0-4c4f-a073-f696bbfca8ea admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:07.410289 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2166/4320] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:00:07.414579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0e397-3ee5-404f-b87c-4d39e1bd8607 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:07.424685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0e397-3ee5-404f-b87c-4d39e1bd8607 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:07.449186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddda7cf-1708-4367-a8d5-75504f9ca130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:07.451447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddda7cf-1708-4367-a8d5-75504f9ca130 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:07.453119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddda7cf-1708-4367-a8d5-75504f9ca130 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:07.453562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddda7cf-1708-4367-a8d5-75504f9ca130 admin admin] PATH_INFO: `/v3/projects/68f6ce3ab988464e954802e44aaf2ecf/users/ce5aed350c58448fab42cdffd677a413/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:07.490638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddda7cf-1708-4367-a8d5-75504f9ca130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f6ce3ab988464e954802e44aaf2ecf, user_id=ce5aed350c58448fab42cdffd677a413, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:07.496980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddda7cf-1708-4367-a8d5-75504f9ca130 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:07.523707 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2155/4321] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:00:07 2022] PUT /identity/v3/projects/68f6ce3ab988464e954802e44aaf2ecf/users/ce5aed350c58448fab42cdffd677a413/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:00:07.528975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d052cb-cc2b-47f1-b0e8-28d5d5110b92 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:07.529521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d052cb-cc2b-47f1-b0e8-28d5d5110b92 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:07.530100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d052cb-cc2b-47f1-b0e8-28d5d5110b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:07.542988 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:07.580058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-92d052cb-cc2b-47f1-b0e8-28d5d5110b92 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:07.581646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-92d052cb-cc2b-47f1-b0e8-28d5d5110b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:07.769343 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2167/4322] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:07.775940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddda7cf-1708-4367-a8d5-75504f9ca130 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:07.778308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9ddda7cf-1708-4367-a8d5-75504f9ca130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:07.863021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddda7cf-1708-4367-a8d5-75504f9ca130 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:07.868626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03d5ed-3673-49ed-97e5-a81427e192a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:07.869547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03d5ed-3673-49ed-97e5-a81427e192a0 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:07.870109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03d5ed-3673-49ed-97e5-a81427e192a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:07.870598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03d5ed-3673-49ed-97e5-a81427e192a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:07.887589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03d5ed-3673-49ed-97e5-a81427e192a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:07.889435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03d5ed-3673-49ed-97e5-a81427e192a0 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:07.903460 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2156/4323] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:00:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:00:08.437287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353a8de-2b78-41b2-a970-a7b7f2bc142d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:08.438009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353a8de-2b78-41b2-a970-a7b7f2bc142d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:08.438520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353a8de-2b78-41b2-a970-a7b7f2bc142d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:08.491683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6353a8de-2b78-41b2-a970-a7b7f2bc142d None None] MFA Rules not processed for user `8bb9a3b41bbc4a11a1e50fb2f5de5c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:08.492945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6353a8de-2b78-41b2-a970-a7b7f2bc142d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:08.596246 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2168/4324] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:09.209431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209afdb-8ee2-438f-ac97-cc47ffe12b4a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:09.210405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209afdb-8ee2-438f-ac97-cc47ffe12b4a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:09.210710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209afdb-8ee2-438f-ac97-cc47ffe12b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:09.248617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8209afdb-8ee2-438f-ac97-cc47ffe12b4a None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:09.250164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8209afdb-8ee2-438f-ac97-cc47ffe12b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:09.363718 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2157/4325] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 10:00:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:09.392234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353a8de-2b78-41b2-a970-a7b7f2bc142d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:09.393405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6353a8de-2b78-41b2-a970-a7b7f2bc142d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:09.518776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353a8de-2b78-41b2-a970-a7b7f2bc142d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:09.531533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d32c6e-794b-423a-9441-3431e7608d32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:09.534246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d32c6e-794b-423a-9441-3431e7608d32 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:09.534764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d32c6e-794b-423a-9441-3431e7608d32 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:09.535033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d32c6e-794b-423a-9441-3431e7608d32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:09.561572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d32c6e-794b-423a-9441-3431e7608d32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:09.564105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d32c6e-794b-423a-9441-3431e7608d32 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:09.583973 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2169/4326] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:00:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:00:16.478280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c85ef-e4d8-49ac-891f-72ac51718a23 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:16.478754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c85ef-e4d8-49ac-891f-72ac51718a23 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:16.478754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c85ef-e4d8-49ac-891f-72ac51718a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:16.489643 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:16.539938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d19c85ef-e4d8-49ac-891f-72ac51718a23 None None] MFA Rules not processed for user `ce5aed350c58448fab42cdffd677a413`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:16.541116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d19c85ef-e4d8-49ac-891f-72ac51718a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:16.686475 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2158/4327] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:16 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:16.697588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21ecb0-aefa-4afe-86c4-a4ca0ddb7fc2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:16.698201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21ecb0-aefa-4afe-86c4-a4ca0ddb7fc2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:16.698201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21ecb0-aefa-4afe-86c4-a4ca0ddb7fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:16.752863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ec21ecb0-aefa-4afe-86c4-a4ca0ddb7fc2 None None] MFA Rules not processed for user `ce5aed350c58448fab42cdffd677a413`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:16.755861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ec21ecb0-aefa-4afe-86c4-a4ca0ddb7fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:16.788745 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2170/4328] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:16 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:16.990606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c85ef-e4d8-49ac-891f-72ac51718a23 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:16.993067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d19c85ef-e4d8-49ac-891f-72ac51718a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:17.144016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c85ef-e4d8-49ac-891f-72ac51718a23 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:17.158082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774d1da-f67f-4e5e-92dc-3e6a156899b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:17.158082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774d1da-f67f-4e5e-92dc-3e6a156899b9 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:17.158410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774d1da-f67f-4e5e-92dc-3e6a156899b9 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:17.158556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774d1da-f67f-4e5e-92dc-3e6a156899b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:17.170131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774d1da-f67f-4e5e-92dc-3e6a156899b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:17.172144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774d1da-f67f-4e5e-92dc-3e6a156899b9 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:17.192573 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2159/4329] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:00:16 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:00:18.405709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3aa97a-cf65-4a88-b99f-d22e2b0ccbf9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:18.406667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3aa97a-cf65-4a88-b99f-d22e2b0ccbf9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:18.407389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3aa97a-cf65-4a88-b99f-d22e2b0ccbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:18.446310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4c3aa97a-cf65-4a88-b99f-d22e2b0ccbf9 None None] MFA Rules not processed for user `3b97b83ebcf242d0abd55dfbb15ab066`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:18.447793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4c3aa97a-cf65-4a88-b99f-d22e2b0ccbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:18.510117 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:18.555412 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2171/4330] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:27.182174 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=64 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:28.116980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774d1da-f67f-4e5e-92dc-3e6a156899b9 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:28.118571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9774d1da-f67f-4e5e-92dc-3e6a156899b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:28.305270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774d1da-f67f-4e5e-92dc-3e6a156899b9 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:28.311638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea22dd4-6ca7-4d98-9252-d2f2d9925169 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:28.312247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea22dd4-6ca7-4d98-9252-d2f2d9925169 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:28.312747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea22dd4-6ca7-4d98-9252-d2f2d9925169 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:28.313180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea22dd4-6ca7-4d98-9252-d2f2d9925169 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:28.315142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9ea22dd4-6ca7-4d98-9252-d2f2d9925169 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:28.346883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea22dd4-6ca7-4d98-9252-d2f2d9925169 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:28.348639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea22dd4-6ca7-4d98-9252-d2f2d9925169 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:28.360616 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2160/4331] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:00:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:00:28.540964 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:32.876326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3aa97a-cf65-4a88-b99f-d22e2b0ccbf9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:32.940434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3aa97a-cf65-4a88-b99f-d22e2b0ccbf9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:32.951990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a5760-8ff5-4359-9ffa-6240aa508827 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:32.952887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a5760-8ff5-4359-9ffa-6240aa508827 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:32.953303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a5760-8ff5-4359-9ffa-6240aa508827 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:32.953709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a5760-8ff5-4359-9ffa-6240aa508827 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:32.956076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-141a5760-8ff5-4359-9ffa-6240aa508827 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:32.995734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a5760-8ff5-4359-9ffa-6240aa508827 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:32.997444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a5760-8ff5-4359-9ffa-6240aa508827 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:33.015497 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2172/4332] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:00:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:00:33.682487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea22dd4-6ca7-4d98-9252-d2f2d9925169 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:33.684521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9ea22dd4-6ca7-4d98-9252-d2f2d9925169 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:33.702704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea22dd4-6ca7-4d98-9252-d2f2d9925169 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:33.707962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119a10d-87fb-4731-9be3-45ea10c9e395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:33.708593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119a10d-87fb-4731-9be3-45ea10c9e395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:33.708903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119a10d-87fb-4731-9be3-45ea10c9e395 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:33.709176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119a10d-87fb-4731-9be3-45ea10c9e395 admin admin] PATH_INFO: `/v3/users/19dfdd10f1fc4f8882ccab3d85607ded` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:33.710319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119a10d-87fb-4731-9be3-45ea10c9e395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19dfdd10f1fc4f8882ccab3d85607ded)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:33.712322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119a10d-87fb-4731-9be3-45ea10c9e395 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:33.761199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0119a10d-87fb-4731-9be3-45ea10c9e395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19dfdd10f1fc4f8882ccab3d85607ded'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:33.768979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0119a10d-87fb-4731-9be3-45ea10c9e395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19dfdd10f1fc4f8882ccab3d85607ded'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:33.769664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0119a10d-87fb-4731-9be3-45ea10c9e395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19dfdd10f1fc4f8882ccab3d85607ded'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:33.782162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0119a10d-87fb-4731-9be3-45ea10c9e395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19dfdd10f1fc4f8882ccab3d85607ded'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:33.789292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0119a10d-87fb-4731-9be3-45ea10c9e395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19dfdd10f1fc4f8882ccab3d85607ded'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:33.795391 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2161/4333] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:00:33 2022] DELETE /identity/v3/users/19dfdd10f1fc4f8882ccab3d85607ded => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:00:34.157063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a5760-8ff5-4359-9ffa-6240aa508827 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:34.185346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a5760-8ff5-4359-9ffa-6240aa508827 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:34.263890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cacd5-300a-450f-8f22-71ed0a2ea18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:34.264998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cacd5-300a-450f-8f22-71ed0a2ea18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:34.265472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cacd5-300a-450f-8f22-71ed0a2ea18c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:34.265844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cacd5-300a-450f-8f22-71ed0a2ea18c admin admin] PATH_INFO: `/v3/projects/eb539a23b2f44844aa6c131816f1a1d8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:34.267832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3cacd5-300a-450f-8f22-71ed0a2ea18c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb539a23b2f44844aa6c131816f1a1d8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:34.274012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3cacd5-300a-450f-8f22-71ed0a2ea18c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:34.336126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-df3cacd5-300a-450f-8f22-71ed0a2ea18c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb539a23b2f44844aa6c131816f1a1d8', 'request_id': 'req-df3cacd5-300a-450f-8f22-71ed0a2ea18c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:34.344947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-df3cacd5-300a-450f-8f22-71ed0a2ea18c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb539a23b2f44844aa6c131816f1a1d8', 'request_id': 'req-df3cacd5-300a-450f-8f22-71ed0a2ea18c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:34.354040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-df3cacd5-300a-450f-8f22-71ed0a2ea18c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb539a23b2f44844aa6c131816f1a1d8', 'request_id': 'req-df3cacd5-300a-450f-8f22-71ed0a2ea18c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:34.370596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-df3cacd5-300a-450f-8f22-71ed0a2ea18c admin admin] The token cache is being invalidate because project eb539a23b2f44844aa6c131816f1a1d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:00:34.370889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-df3cacd5-300a-450f-8f22-71ed0a2ea18c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:34.371561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-df3cacd5-300a-450f-8f22-71ed0a2ea18c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:34.373474 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2173/4334] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:00:34 2022] DELETE /identity/v3/projects/eb539a23b2f44844aa6c131816f1a1d8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:00:34.377258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119a10d-87fb-4731-9be3-45ea10c9e395 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:34.378853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0119a10d-87fb-4731-9be3-45ea10c9e395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:34.393597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119a10d-87fb-4731-9be3-45ea10c9e395 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:34.405296 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:34.462067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cd94d-61f7-488d-8c1f-3fb84b0e77fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:34.462698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cd94d-61f7-488d-8c1f-3fb84b0e77fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:34.462980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cd94d-61f7-488d-8c1f-3fb84b0e77fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:34.463267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cd94d-61f7-488d-8c1f-3fb84b0e77fb admin admin] PATH_INFO: `/v3/users/309b93488561435d8bc1f3dfc65d2ea6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:34.464401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806cd94d-61f7-488d-8c1f-3fb84b0e77fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=309b93488561435d8bc1f3dfc65d2ea6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:34.466348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806cd94d-61f7-488d-8c1f-3fb84b0e77fb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:34.514051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-806cd94d-61f7-488d-8c1f-3fb84b0e77fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '309b93488561435d8bc1f3dfc65d2ea6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:34.522340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-806cd94d-61f7-488d-8c1f-3fb84b0e77fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '309b93488561435d8bc1f3dfc65d2ea6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:34.523121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-806cd94d-61f7-488d-8c1f-3fb84b0e77fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '309b93488561435d8bc1f3dfc65d2ea6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:34.536539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-806cd94d-61f7-488d-8c1f-3fb84b0e77fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '309b93488561435d8bc1f3dfc65d2ea6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:34.544219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-806cd94d-61f7-488d-8c1f-3fb84b0e77fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '309b93488561435d8bc1f3dfc65d2ea6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:34.550310 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2162/4335] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:00:34 2022] DELETE /identity/v3/users/309b93488561435d8bc1f3dfc65d2ea6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:00:34.860151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cacd5-300a-450f-8f22-71ed0a2ea18c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:34.862540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-df3cacd5-300a-450f-8f22-71ed0a2ea18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:34.891753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cacd5-300a-450f-8f22-71ed0a2ea18c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:34.987561 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:35.014938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b1751-2d00-4df3-ae44-1efa341f08fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:35.015576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b1751-2d00-4df3-ae44-1efa341f08fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:35.015926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b1751-2d00-4df3-ae44-1efa341f08fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:35.016277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b1751-2d00-4df3-ae44-1efa341f08fd admin admin] PATH_INFO: `/v3/projects/b187ddd38697408e8cbb04a52399fe8a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:35.017929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b1751-2d00-4df3-ae44-1efa341f08fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b187ddd38697408e8cbb04a52399fe8a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:35.021781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b1751-2d00-4df3-ae44-1efa341f08fd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:35.189335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fe3b1751-2d00-4df3-ae44-1efa341f08fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b187ddd38697408e8cbb04a52399fe8a', 'request_id': 'req-fe3b1751-2d00-4df3-ae44-1efa341f08fd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:35.215062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fe3b1751-2d00-4df3-ae44-1efa341f08fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b187ddd38697408e8cbb04a52399fe8a', 'request_id': 'req-fe3b1751-2d00-4df3-ae44-1efa341f08fd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:35.227273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fe3b1751-2d00-4df3-ae44-1efa341f08fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b187ddd38697408e8cbb04a52399fe8a', 'request_id': 'req-fe3b1751-2d00-4df3-ae44-1efa341f08fd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:35.249669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fe3b1751-2d00-4df3-ae44-1efa341f08fd admin admin] The token cache is being invalidate because project b187ddd38697408e8cbb04a52399fe8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:00:35.250192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fe3b1751-2d00-4df3-ae44-1efa341f08fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:35.251091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fe3b1751-2d00-4df3-ae44-1efa341f08fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:35.256293 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2174/4336] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:00:34 2022] DELETE /identity/v3/projects/b187ddd38697408e8cbb04a52399fe8a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:00:35.266593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794d461-4302-408e-a01f-b7fea6d1d15a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:35.267598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794d461-4302-408e-a01f-b7fea6d1d15a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:35.270303 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794d461-4302-408e-a01f-b7fea6d1d15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:35.349091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c794d461-4302-408e-a01f-b7fea6d1d15a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:35.350569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c794d461-4302-408e-a01f-b7fea6d1d15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:35.470074 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2163/4337] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:00:35.474441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387957e-8fcc-4e47-b4fc-fa86b2bc7df4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:35.474876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387957e-8fcc-4e47-b4fc-fa86b2bc7df4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:35.475701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387957e-8fcc-4e47-b4fc-fa86b2bc7df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:35.527668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d387957e-8fcc-4e47-b4fc-fa86b2bc7df4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:35.530098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d387957e-8fcc-4e47-b4fc-fa86b2bc7df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:35.547661 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2175/4338] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:35.552962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794d461-4302-408e-a01f-b7fea6d1d15a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:35.588631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794d461-4302-408e-a01f-b7fea6d1d15a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:35.593207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88949fb-2a49-49bc-b5aa-6c266d309f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:35.593841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88949fb-2a49-49bc-b5aa-6c266d309f99 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:35.594120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88949fb-2a49-49bc-b5aa-6c266d309f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:35.594455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88949fb-2a49-49bc-b5aa-6c266d309f99 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:35.595046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88949fb-2a49-49bc-b5aa-6c266d309f99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:00:35.595418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88949fb-2a49-49bc-b5aa-6c266d309f99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:35.597802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88949fb-2a49-49bc-b5aa-6c266d309f99 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:35.617710 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2164/4339] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:00:35.623016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387957e-8fcc-4e47-b4fc-fa86b2bc7df4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:35.639571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387957e-8fcc-4e47-b4fc-fa86b2bc7df4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:35.648088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f34268-82e3-4345-921f-6a9aac4a4ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:35.648925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f34268-82e3-4345-921f-6a9aac4a4ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:35.650467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f34268-82e3-4345-921f-6a9aac4a4ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:35.654682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f34268-82e3-4345-921f-6a9aac4a4ee9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:35.659039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f34268-82e3-4345-921f-6a9aac4a4ee9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:35.663534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f34268-82e3-4345-921f-6a9aac4a4ee9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:35.710537 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2176/4340] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:00:35 2022] POST /identity/v3/projects => generated 371 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:00:35.714550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88949fb-2a49-49bc-b5aa-6c266d309f99 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:35.737802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88949fb-2a49-49bc-b5aa-6c266d309f99 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:35.751045 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:35.843236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce12d0-e35d-4917-a1bc-ef09e2eec839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:35.844165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce12d0-e35d-4917-a1bc-ef09e2eec839 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:35.844978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce12d0-e35d-4917-a1bc-ef09e2eec839 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:35.844978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce12d0-e35d-4917-a1bc-ef09e2eec839 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:35.858358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce12d0-e35d-4917-a1bc-ef09e2eec839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:35.864297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce12d0-e35d-4917-a1bc-ef09e2eec839 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:35.917940 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2165/4341] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:00:35 2022] POST /identity/v3/users => generated 286 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:00:35.922039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f34268-82e3-4345-921f-6a9aac4a4ee9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:35.947294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f34268-82e3-4345-921f-6a9aac4a4ee9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:35.969142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66250df5-341e-40d4-b4f9-b92b70461e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:35.969744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66250df5-341e-40d4-b4f9-b92b70461e76 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:35.970212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66250df5-341e-40d4-b4f9-b92b70461e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:35.970484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66250df5-341e-40d4-b4f9-b92b70461e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:35.973632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66250df5-341e-40d4-b4f9-b92b70461e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:35.979168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66250df5-341e-40d4-b4f9-b92b70461e76 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:35.993647 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2177/4342] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:00:35.998777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce12d0-e35d-4917-a1bc-ef09e2eec839 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:36.014155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce12d0-e35d-4917-a1bc-ef09e2eec839 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:36.021699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c2945-5777-4dbd-aa14-32e0358427d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:36.022596 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c2945-5777-4dbd-aa14-32e0358427d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:36.023074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c2945-5777-4dbd-aa14-32e0358427d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:36.024724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c2945-5777-4dbd-aa14-32e0358427d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:36.025600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c2945-5777-4dbd-aa14-32e0358427d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:36.027819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c2945-5777-4dbd-aa14-32e0358427d1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:36.042570 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2166/4343] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:00:36.046497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66250df5-341e-40d4-b4f9-b92b70461e76 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:36.060379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66250df5-341e-40d4-b4f9-b92b70461e76 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:36.084019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7860d62-5ec0-4dfe-82ef-fb5a1312a462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:36.084744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7860d62-5ec0-4dfe-82ef-fb5a1312a462 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:36.085025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7860d62-5ec0-4dfe-82ef-fb5a1312a462 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:36.085301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7860d62-5ec0-4dfe-82ef-fb5a1312a462 admin admin] PATH_INFO: `/v3/projects/dcb52035ad15415daffc887f327cc2e5/users/69c67692c5f74c1ba2ac61963da033e5/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:36.110674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7860d62-5ec0-4dfe-82ef-fb5a1312a462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb52035ad15415daffc887f327cc2e5, user_id=69c67692c5f74c1ba2ac61963da033e5, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:36.115271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7860d62-5ec0-4dfe-82ef-fb5a1312a462 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:36.150845 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2178/4344] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:00:36 2022] PUT /identity/v3/projects/dcb52035ad15415daffc887f327cc2e5/users/69c67692c5f74c1ba2ac61963da033e5/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:00:36.162853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77a121-87bd-4700-8d65-0b35e45ecb62 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:36.163134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77a121-87bd-4700-8d65-0b35e45ecb62 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:36.163414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77a121-87bd-4700-8d65-0b35e45ecb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:36.216177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7c77a121-87bd-4700-8d65-0b35e45ecb62 None None] MFA Rules not processed for user `69c67692c5f74c1ba2ac61963da033e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:36.223161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7c77a121-87bd-4700-8d65-0b35e45ecb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:36.306892 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2167/4345] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:36.585899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7860d62-5ec0-4dfe-82ef-fb5a1312a462 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:36.588848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e7860d62-5ec0-4dfe-82ef-fb5a1312a462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:36.694454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7860d62-5ec0-4dfe-82ef-fb5a1312a462 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:36.700078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa1e83-f022-424f-8b9d-b428ecd70e3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:36.700821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa1e83-f022-424f-8b9d-b428ecd70e3e service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:36.701166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa1e83-f022-424f-8b9d-b428ecd70e3e service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:36.701507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa1e83-f022-424f-8b9d-b428ecd70e3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:36.710594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa1e83-f022-424f-8b9d-b428ecd70e3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:36.712116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa1e83-f022-424f-8b9d-b428ecd70e3e service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:36.716719 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:36.724642 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2179/4346] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:00:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:00:37.051502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8803b58-5247-4967-951a-ed1e55c5085e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:37.051788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8803b58-5247-4967-951a-ed1e55c5085e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:37.052057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8803b58-5247-4967-951a-ed1e55c5085e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:37.077862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c8803b58-5247-4967-951a-ed1e55c5085e None None] MFA Rules not processed for user `8bb9a3b41bbc4a11a1e50fb2f5de5c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:37.079385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c8803b58-5247-4967-951a-ed1e55c5085e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:37.181190 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2168/4347] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:37.907788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa1e83-f022-424f-8b9d-b428ecd70e3e service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:38.012996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa1e83-f022-424f-8b9d-b428ecd70e3e service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:38.019659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c441d-5275-4b04-9b65-c28e58b46747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:38.021031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c441d-5275-4b04-9b65-c28e58b46747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:38.021320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c441d-5275-4b04-9b65-c28e58b46747 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:38.021598 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c441d-5275-4b04-9b65-c28e58b46747 admin admin] PATH_INFO: `/v3/users/69c67692c5f74c1ba2ac61963da033e5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:38.024015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c441d-5275-4b04-9b65-c28e58b46747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c67692c5f74c1ba2ac61963da033e5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:38.026331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c441d-5275-4b04-9b65-c28e58b46747 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:38.108098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b7c441d-5275-4b04-9b65-c28e58b46747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c67692c5f74c1ba2ac61963da033e5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:38.110420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b7c441d-5275-4b04-9b65-c28e58b46747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c67692c5f74c1ba2ac61963da033e5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:38.121500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b7c441d-5275-4b04-9b65-c28e58b46747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c67692c5f74c1ba2ac61963da033e5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:38.138860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b7c441d-5275-4b04-9b65-c28e58b46747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c67692c5f74c1ba2ac61963da033e5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:38.149951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b7c441d-5275-4b04-9b65-c28e58b46747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c67692c5f74c1ba2ac61963da033e5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:38.166121 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2180/4348] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:00:37 2022] DELETE /identity/v3/users/69c67692c5f74c1ba2ac61963da033e5 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:00:38.168075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dd761-f792-4a7c-8171-c59ec1d4b000 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:38.168075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dd761-f792-4a7c-8171-c59ec1d4b000 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:38.168627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dd761-f792-4a7c-8171-c59ec1d4b000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:38.196783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4c8dd761-f792-4a7c-8171-c59ec1d4b000 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:38.198707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4c8dd761-f792-4a7c-8171-c59ec1d4b000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:38.228095 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:38.320191 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2169/4349] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:38.328723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c441d-5275-4b04-9b65-c28e58b46747 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:38.330861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8b7c441d-5275-4b04-9b65-c28e58b46747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:38.412225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c441d-5275-4b04-9b65-c28e58b46747 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:38.421129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93590d5-d7ba-41e7-8ceb-c49bf79e1161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:38.421633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93590d5-d7ba-41e7-8ceb-c49bf79e1161 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:38.422008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93590d5-d7ba-41e7-8ceb-c49bf79e1161 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:38.422288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93590d5-d7ba-41e7-8ceb-c49bf79e1161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:38.436495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93590d5-d7ba-41e7-8ceb-c49bf79e1161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:38.438196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93590d5-d7ba-41e7-8ceb-c49bf79e1161 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:38.450392 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2181/4350] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:00:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:00:39.158782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8dd761-f792-4a7c-8171-c59ec1d4b000 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:39.161514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4c8dd761-f792-4a7c-8171-c59ec1d4b000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:39.189082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8dd761-f792-4a7c-8171-c59ec1d4b000 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:39.204635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf0532-4289-47d8-92f9-1dcaf9072968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:39.205527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf0532-4289-47d8-92f9-1dcaf9072968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:39.207849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf0532-4289-47d8-92f9-1dcaf9072968 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:39.208766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf0532-4289-47d8-92f9-1dcaf9072968 admin admin] PATH_INFO: `/v3/projects/dcb52035ad15415daffc887f327cc2e5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:39.210465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf0532-4289-47d8-92f9-1dcaf9072968 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcb52035ad15415daffc887f327cc2e5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:39.212404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf0532-4289-47d8-92f9-1dcaf9072968 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:39.274015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6acf0532-4289-47d8-92f9-1dcaf9072968 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcb52035ad15415daffc887f327cc2e5', 'request_id': 'req-6acf0532-4289-47d8-92f9-1dcaf9072968'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:39.283927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6acf0532-4289-47d8-92f9-1dcaf9072968 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcb52035ad15415daffc887f327cc2e5', 'request_id': 'req-6acf0532-4289-47d8-92f9-1dcaf9072968'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:39.295049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6acf0532-4289-47d8-92f9-1dcaf9072968 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcb52035ad15415daffc887f327cc2e5', 'request_id': 'req-6acf0532-4289-47d8-92f9-1dcaf9072968'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:39.313490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6acf0532-4289-47d8-92f9-1dcaf9072968 admin admin] The token cache is being invalidate because project dcb52035ad15415daffc887f327cc2e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:00:39.314139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6acf0532-4289-47d8-92f9-1dcaf9072968 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:39.314712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6acf0532-4289-47d8-92f9-1dcaf9072968 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:39.317029 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2170/4351] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:00:39 2022] DELETE /identity/v3/projects/dcb52035ad15415daffc887f327cc2e5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:00:39.323176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc2c6a-8af9-4962-9197-d071ac04330e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:39.323642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc2c6a-8af9-4962-9197-d071ac04330e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:39.324011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc2c6a-8af9-4962-9197-d071ac04330e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:39.363795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8dbc2c6a-8af9-4962-9197-d071ac04330e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:39.365668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8dbc2c6a-8af9-4962-9197-d071ac04330e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:39.389482 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:39.478338 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2182/4352] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:39.485863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31648b-c463-4ff7-aab6-35744890093c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:39.486149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31648b-c463-4ff7-aab6-35744890093c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:39.486424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31648b-c463-4ff7-aab6-35744890093c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:39.510535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-af31648b-c463-4ff7-aab6-35744890093c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:39.511760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-af31648b-c463-4ff7-aab6-35744890093c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:39.520173 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2171/4353] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:39.524619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc2c6a-8af9-4962-9197-d071ac04330e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:39.534939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc2c6a-8af9-4962-9197-d071ac04330e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:39.540124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38609a3-75e9-4a27-89c9-2d04430d1d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:39.540781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38609a3-75e9-4a27-89c9-2d04430d1d8d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:39.541061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38609a3-75e9-4a27-89c9-2d04430d1d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:39.541332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38609a3-75e9-4a27-89c9-2d04430d1d8d admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:39.541985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38609a3-75e9-4a27-89c9-2d04430d1d8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:00:39.542287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38609a3-75e9-4a27-89c9-2d04430d1d8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:39.543918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38609a3-75e9-4a27-89c9-2d04430d1d8d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:39.557415 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2183/4354] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:00:39.561924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31648b-c463-4ff7-aab6-35744890093c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:39.572064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31648b-c463-4ff7-aab6-35744890093c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:39.576860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2210e-a6f8-46ed-90ea-c2da905500e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:39.577473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2210e-a6f8-46ed-90ea-c2da905500e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:39.577746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2210e-a6f8-46ed-90ea-c2da905500e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:39.578014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2210e-a6f8-46ed-90ea-c2da905500e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:39.578645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2210e-a6f8-46ed-90ea-c2da905500e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:39.580671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2210e-a6f8-46ed-90ea-c2da905500e4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:39.609747 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2172/4355] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:00:39 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:00:39.614739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38609a3-75e9-4a27-89c9-2d04430d1d8d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:39.625232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38609a3-75e9-4a27-89c9-2d04430d1d8d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:39.694139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f71c75-66e1-439f-8e8f-01c4b3d61af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:39.694946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f71c75-66e1-439f-8e8f-01c4b3d61af5 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:39.695469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f71c75-66e1-439f-8e8f-01c4b3d61af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:39.695971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f71c75-66e1-439f-8e8f-01c4b3d61af5 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:39.697577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f71c75-66e1-439f-8e8f-01c4b3d61af5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:39.699708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f71c75-66e1-439f-8e8f-01c4b3d61af5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:39.722407 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2184/4356] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:00:39 2022] POST /identity/v3/users => generated 282 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:00:39.726592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2210e-a6f8-46ed-90ea-c2da905500e4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:39.738028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2210e-a6f8-46ed-90ea-c2da905500e4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:39.742943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43005f1-c7c5-4e0c-a455-2da68464da8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:39.743552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43005f1-c7c5-4e0c-a455-2da68464da8e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:39.743834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43005f1-c7c5-4e0c-a455-2da68464da8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:39.744125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43005f1-c7c5-4e0c-a455-2da68464da8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:39.744813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43005f1-c7c5-4e0c-a455-2da68464da8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:39.746388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43005f1-c7c5-4e0c-a455-2da68464da8e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:39.757084 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2173/4357] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:00:39.761032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f71c75-66e1-439f-8e8f-01c4b3d61af5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:39.771153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f71c75-66e1-439f-8e8f-01c4b3d61af5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:39.775815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd874b8d-4111-4000-befc-4dbfb0bb119e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:39.776379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd874b8d-4111-4000-befc-4dbfb0bb119e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:39.776699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd874b8d-4111-4000-befc-4dbfb0bb119e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:39.776974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd874b8d-4111-4000-befc-4dbfb0bb119e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:39.777611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd874b8d-4111-4000-befc-4dbfb0bb119e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:39.779208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd874b8d-4111-4000-befc-4dbfb0bb119e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:39.790307 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2185/4358] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:00:39.794620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43005f1-c7c5-4e0c-a455-2da68464da8e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:39.805513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43005f1-c7c5-4e0c-a455-2da68464da8e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:39.810132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fddb6-85e7-46a0-95b1-40597353acf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:39.810783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fddb6-85e7-46a0-95b1-40597353acf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:39.811058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fddb6-85e7-46a0-95b1-40597353acf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:39.811329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fddb6-85e7-46a0-95b1-40597353acf3 admin admin] PATH_INFO: `/v3/projects/4c4be7f7957749d5a232f9d0a47ec60c/users/76de66d46a57438f960c832cb8a70c2c/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:39.828415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fddb6-85e7-46a0-95b1-40597353acf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4be7f7957749d5a232f9d0a47ec60c, user_id=76de66d46a57438f960c832cb8a70c2c, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:39.831103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fddb6-85e7-46a0-95b1-40597353acf3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:39.844820 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2174/4359] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:00:39 2022] PUT /identity/v3/projects/4c4be7f7957749d5a232f9d0a47ec60c/users/76de66d46a57438f960c832cb8a70c2c/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:00:39.850435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbd591-ea86-4515-857b-c70f8273be35 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:39.850721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbd591-ea86-4515-857b-c70f8273be35 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:39.851013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbd591-ea86-4515-857b-c70f8273be35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:39.872483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-59bbd591-ea86-4515-857b-c70f8273be35 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:39.873803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-59bbd591-ea86-4515-857b-c70f8273be35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:39.946396 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2186/4360] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:39.959445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fddb6-85e7-46a0-95b1-40597353acf3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:39.961218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-257fddb6-85e7-46a0-95b1-40597353acf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:40.031067 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:40.050768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fddb6-85e7-46a0-95b1-40597353acf3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:40.056200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed580d-7c31-4ac7-8bd4-9a1113b2fc57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:40.056924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed580d-7c31-4ac7-8bd4-9a1113b2fc57 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:40.057203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed580d-7c31-4ac7-8bd4-9a1113b2fc57 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:40.058850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed580d-7c31-4ac7-8bd4-9a1113b2fc57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:40.073342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed580d-7c31-4ac7-8bd4-9a1113b2fc57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:40.075852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed580d-7c31-4ac7-8bd4-9a1113b2fc57 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:40.089237 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2175/4361] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:00:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:00:40.654668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b247cd-f466-4ce2-9149-d27797a3db82 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:40.655152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b247cd-f466-4ce2-9149-d27797a3db82 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:40.655152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b247cd-f466-4ce2-9149-d27797a3db82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:40.674619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-31b247cd-f466-4ce2-9149-d27797a3db82 None None] MFA Rules not processed for user `8bb9a3b41bbc4a11a1e50fb2f5de5c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:40.676853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-31b247cd-f466-4ce2-9149-d27797a3db82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:40.701998 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:40.758830 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2187/4362] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:42.259749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed580d-7c31-4ac7-8bd4-9a1113b2fc57 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:42.261996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-00ed580d-7c31-4ac7-8bd4-9a1113b2fc57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:42.464053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed580d-7c31-4ac7-8bd4-9a1113b2fc57 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:42.469242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d786e4-53f5-4a32-93c7-294914770dec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:42.469857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d786e4-53f5-4a32-93c7-294914770dec service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:42.470316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d786e4-53f5-4a32-93c7-294914770dec service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:42.470594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d786e4-53f5-4a32-93c7-294914770dec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:42.473633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-20d786e4-53f5-4a32-93c7-294914770dec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:42.514134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d786e4-53f5-4a32-93c7-294914770dec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:42.516069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d786e4-53f5-4a32-93c7-294914770dec service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:42.532730 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2176/4363] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:00:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:00:44.680887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e10532-4cfe-490a-9d56-41ea42825885 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:44.681376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e10532-4cfe-490a-9d56-41ea42825885 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:44.681482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e10532-4cfe-490a-9d56-41ea42825885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:44.717156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-35e10532-4cfe-490a-9d56-41ea42825885 None None] MFA Rules not processed for user `8bb9a3b41bbc4a11a1e50fb2f5de5c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:44.718944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-35e10532-4cfe-490a-9d56-41ea42825885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:44.730693 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2188/4364] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:46.432649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d786e4-53f5-4a32-93c7-294914770dec service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:46.435074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-20d786e4-53f5-4a32-93c7-294914770dec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:46.458483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d786e4-53f5-4a32-93c7-294914770dec service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:46.463716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ea1af-3b2b-4f5e-80e7-56a98f7ccf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:46.465409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ea1af-3b2b-4f5e-80e7-56a98f7ccf1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:46.465921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ea1af-3b2b-4f5e-80e7-56a98f7ccf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:46.466485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ea1af-3b2b-4f5e-80e7-56a98f7ccf1a admin admin] PATH_INFO: `/v3/users/1fd4a1cb14594c29b909786d3b90f41f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:46.468097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ea1af-3b2b-4f5e-80e7-56a98f7ccf1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fd4a1cb14594c29b909786d3b90f41f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:46.470569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ea1af-3b2b-4f5e-80e7-56a98f7ccf1a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:46.525278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-597ea1af-3b2b-4f5e-80e7-56a98f7ccf1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fd4a1cb14594c29b909786d3b90f41f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:46.533682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-597ea1af-3b2b-4f5e-80e7-56a98f7ccf1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fd4a1cb14594c29b909786d3b90f41f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:46.534691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-597ea1af-3b2b-4f5e-80e7-56a98f7ccf1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fd4a1cb14594c29b909786d3b90f41f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:46.550402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-597ea1af-3b2b-4f5e-80e7-56a98f7ccf1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fd4a1cb14594c29b909786d3b90f41f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:46.559184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-597ea1af-3b2b-4f5e-80e7-56a98f7ccf1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fd4a1cb14594c29b909786d3b90f41f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:46.566911 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2177/4365] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:00:46 2022] DELETE /identity/v3/users/1fd4a1cb14594c29b909786d3b90f41f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:00:46.571779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc6da8-fc4c-412e-9dab-d8cc45f2e3e3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:46.574251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc6da8-fc4c-412e-9dab-d8cc45f2e3e3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:46.574723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc6da8-fc4c-412e-9dab-d8cc45f2e3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:46.603857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d4fc6da8-fc4c-412e-9dab-d8cc45f2e3e3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:46.605578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d4fc6da8-fc4c-412e-9dab-d8cc45f2e3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:46.726932 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2189/4366] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:46.731897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108c902-d080-4e66-be0a-1cc7568631d7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:46.732183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108c902-d080-4e66-be0a-1cc7568631d7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:46.732457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108c902-d080-4e66-be0a-1cc7568631d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:46.753529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0108c902-d080-4e66-be0a-1cc7568631d7 None None] MFA Rules not processed for user `8bb9a3b41bbc4a11a1e50fb2f5de5c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:46.754761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0108c902-d080-4e66-be0a-1cc7568631d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:46.762188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc6da8-fc4c-412e-9dab-d8cc45f2e3e3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:46.763570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d4fc6da8-fc4c-412e-9dab-d8cc45f2e3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:46.821481 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:46.849485 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2178/4367] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:46.851452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc6da8-fc4c-412e-9dab-d8cc45f2e3e3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:46.865316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c148cb-7e43-4d3a-b4a5-814d9f963e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:46.867213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c148cb-7e43-4d3a-b4a5-814d9f963e9e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:46.868070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c148cb-7e43-4d3a-b4a5-814d9f963e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:46.868356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c148cb-7e43-4d3a-b4a5-814d9f963e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:46.889292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c148cb-7e43-4d3a-b4a5-814d9f963e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:46.890740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c148cb-7e43-4d3a-b4a5-814d9f963e9e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:46.908785 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2190/4368] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:00:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:00:47.842081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108c902-d080-4e66-be0a-1cc7568631d7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:47.843830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0108c902-d080-4e66-be0a-1cc7568631d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:47.890449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108c902-d080-4e66-be0a-1cc7568631d7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:47.904435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acea617-8ab6-4985-922b-783d1b1ef52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:47.906020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acea617-8ab6-4985-922b-783d1b1ef52d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:47.906431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acea617-8ab6-4985-922b-783d1b1ef52d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:47.906828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acea617-8ab6-4985-922b-783d1b1ef52d admin admin] PATH_INFO: `/v3/projects/b45042278742421f9e3cca748c87ce49` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:47.908237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acea617-8ab6-4985-922b-783d1b1ef52d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b45042278742421f9e3cca748c87ce49)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:47.930175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acea617-8ab6-4985-922b-783d1b1ef52d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:48.062750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6acea617-8ab6-4985-922b-783d1b1ef52d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b45042278742421f9e3cca748c87ce49', 'request_id': 'req-6acea617-8ab6-4985-922b-783d1b1ef52d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:48.079205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6acea617-8ab6-4985-922b-783d1b1ef52d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b45042278742421f9e3cca748c87ce49', 'request_id': 'req-6acea617-8ab6-4985-922b-783d1b1ef52d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:48.091127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6acea617-8ab6-4985-922b-783d1b1ef52d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b45042278742421f9e3cca748c87ce49', 'request_id': 'req-6acea617-8ab6-4985-922b-783d1b1ef52d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:48.111604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6acea617-8ab6-4985-922b-783d1b1ef52d admin admin] The token cache is being invalidate because project b45042278742421f9e3cca748c87ce49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:00:48.112166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6acea617-8ab6-4985-922b-783d1b1ef52d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:48.113813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6acea617-8ab6-4985-922b-783d1b1ef52d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:48.115815 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2179/4369] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:00:47 2022] DELETE /identity/v3/projects/b45042278742421f9e3cca748c87ce49 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:00:48.119838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c148cb-7e43-4d3a-b4a5-814d9f963e9e service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:48.131594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c148cb-7e43-4d3a-b4a5-814d9f963e9e service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:48.199520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cc8da-6002-4dba-b064-280e52de006f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:48.200321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cc8da-6002-4dba-b064-280e52de006f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:48.201565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cc8da-6002-4dba-b064-280e52de006f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:48.203014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cc8da-6002-4dba-b064-280e52de006f admin admin] PATH_INFO: `/v3/users/f3c2ea221b164e2c8190020dc8cabc24` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:48.204481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cc8da-6002-4dba-b064-280e52de006f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3c2ea221b164e2c8190020dc8cabc24)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:48.207025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cc8da-6002-4dba-b064-280e52de006f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:48.225356 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:48.271336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-136cc8da-6002-4dba-b064-280e52de006f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3c2ea221b164e2c8190020dc8cabc24'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:48.272165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-136cc8da-6002-4dba-b064-280e52de006f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3c2ea221b164e2c8190020dc8cabc24'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:48.281873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-136cc8da-6002-4dba-b064-280e52de006f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3c2ea221b164e2c8190020dc8cabc24'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:48.303082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-136cc8da-6002-4dba-b064-280e52de006f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3c2ea221b164e2c8190020dc8cabc24'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:48.314626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-136cc8da-6002-4dba-b064-280e52de006f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3c2ea221b164e2c8190020dc8cabc24'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:48.332288 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2191/4370] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:00:48 2022] DELETE /identity/v3/users/f3c2ea221b164e2c8190020dc8cabc24 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:00:48.787663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acea617-8ab6-4985-922b-783d1b1ef52d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:48.789155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6acea617-8ab6-4985-922b-783d1b1ef52d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:48.811549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acea617-8ab6-4985-922b-783d1b1ef52d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:48.907498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829cab4-9b5a-4660-8d80-c088ab61efe2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:48.907795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829cab4-9b5a-4660-8d80-c088ab61efe2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:48.908060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829cab4-9b5a-4660-8d80-c088ab61efe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:48.944086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5829cab4-9b5a-4660-8d80-c088ab61efe2 None None] MFA Rules not processed for user `8bb9a3b41bbc4a11a1e50fb2f5de5c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:48.944289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef47d2-48f2-4ee6-bef9-214caa481e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:48.945074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef47d2-48f2-4ee6-bef9-214caa481e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:48.945450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef47d2-48f2-4ee6-bef9-214caa481e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:48.945583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5829cab4-9b5a-4660-8d80-c088ab61efe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:48.945892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef47d2-48f2-4ee6-bef9-214caa481e38 admin admin] PATH_INFO: `/v3/projects/b0e4c55a25124932b3d7585a0fd4e92d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:48.948050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef47d2-48f2-4ee6-bef9-214caa481e38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0e4c55a25124932b3d7585a0fd4e92d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:48.952037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef47d2-48f2-4ee6-bef9-214caa481e38 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:49.041455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-46ef47d2-48f2-4ee6-bef9-214caa481e38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0e4c55a25124932b3d7585a0fd4e92d', 'request_id': 'req-46ef47d2-48f2-4ee6-bef9-214caa481e38'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:49.054199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-46ef47d2-48f2-4ee6-bef9-214caa481e38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0e4c55a25124932b3d7585a0fd4e92d', 'request_id': 'req-46ef47d2-48f2-4ee6-bef9-214caa481e38'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:49.067846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-46ef47d2-48f2-4ee6-bef9-214caa481e38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0e4c55a25124932b3d7585a0fd4e92d', 'request_id': 'req-46ef47d2-48f2-4ee6-bef9-214caa481e38'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:49.083142 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2192/4371] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:49.090403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-46ef47d2-48f2-4ee6-bef9-214caa481e38 admin admin] The token cache is being invalidate because project b0e4c55a25124932b3d7585a0fd4e92d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:00:49.091569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-46ef47d2-48f2-4ee6-bef9-214caa481e38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:49.092391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-46ef47d2-48f2-4ee6-bef9-214caa481e38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:49.098651 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2180/4372] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:00:48 2022] DELETE /identity/v3/projects/b0e4c55a25124932b3d7585a0fd4e92d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:00:49.100377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93881352-1b6d-49a6-88a7-e24117d35933 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:49.100377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93881352-1b6d-49a6-88a7-e24117d35933 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:49.100377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93881352-1b6d-49a6-88a7-e24117d35933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:49.137907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-93881352-1b6d-49a6-88a7-e24117d35933 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:49.140150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-93881352-1b6d-49a6-88a7-e24117d35933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:49.237683 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2193/4373] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:00:49.246706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647b0f-c288-4c50-af43-e9129c23bd8a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:49.247000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647b0f-c288-4c50-af43-e9129c23bd8a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:49.247256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647b0f-c288-4c50-af43-e9129c23bd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:49.271738 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:49.283703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-11647b0f-c288-4c50-af43-e9129c23bd8a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:49.287018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-11647b0f-c288-4c50-af43-e9129c23bd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:49.304158 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2181/4374] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:49.305253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93881352-1b6d-49a6-88a7-e24117d35933 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:49.327432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93881352-1b6d-49a6-88a7-e24117d35933 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:49.338763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed298f-1df9-45fc-82d5-77915bab1209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:49.341447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed298f-1df9-45fc-82d5-77915bab1209 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:49.342588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed298f-1df9-45fc-82d5-77915bab1209 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:49.343216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed298f-1df9-45fc-82d5-77915bab1209 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:49.344185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed298f-1df9-45fc-82d5-77915bab1209 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:00:49.344866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed298f-1df9-45fc-82d5-77915bab1209 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:49.347122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed298f-1df9-45fc-82d5-77915bab1209 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:49.376627 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2194/4375] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:00:49.377934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11647b0f-c288-4c50-af43-e9129c23bd8a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:49.389598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11647b0f-c288-4c50-af43-e9129c23bd8a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:49.396550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccab2ec-98df-4146-806b-8374fe95e02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:49.397545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccab2ec-98df-4146-806b-8374fe95e02a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:49.398152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccab2ec-98df-4146-806b-8374fe95e02a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:49.398627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccab2ec-98df-4146-806b-8374fe95e02a admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:49.400437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccab2ec-98df-4146-806b-8374fe95e02a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:49.404297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccab2ec-98df-4146-806b-8374fe95e02a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:49.448268 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2182/4376] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:00:49 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:00:49.449549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed298f-1df9-45fc-82d5-77915bab1209 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:49.464101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed298f-1df9-45fc-82d5-77915bab1209 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:49.505854 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:49.564132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b1cad-09e5-46f3-811f-cbc4ed5893b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:49.564818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b1cad-09e5-46f3-811f-cbc4ed5893b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:49.565147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b1cad-09e5-46f3-811f-cbc4ed5893b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:49.565467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b1cad-09e5-46f3-811f-cbc4ed5893b1 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:49.566100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b1cad-09e5-46f3-811f-cbc4ed5893b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:49.570505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b1cad-09e5-46f3-811f-cbc4ed5893b1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:49.596919 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2195/4377] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:00:49 2022] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:00:49.602155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccab2ec-98df-4146-806b-8374fe95e02a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:49.637102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccab2ec-98df-4146-806b-8374fe95e02a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:49.644123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06fe52-5f4a-4c77-9146-4eac3da632d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:49.644765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06fe52-5f4a-4c77-9146-4eac3da632d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:49.646380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06fe52-5f4a-4c77-9146-4eac3da632d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:49.646772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06fe52-5f4a-4c77-9146-4eac3da632d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:49.648122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06fe52-5f4a-4c77-9146-4eac3da632d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:49.651052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06fe52-5f4a-4c77-9146-4eac3da632d0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:49.687401 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2183/4378] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:00:49.688730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b1cad-09e5-46f3-811f-cbc4ed5893b1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:49.708306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b1cad-09e5-46f3-811f-cbc4ed5893b1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:49.715731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ddb52-d564-47fe-b37d-fae4fda87b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:49.716711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ddb52-d564-47fe-b37d-fae4fda87b8f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:49.717113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ddb52-d564-47fe-b37d-fae4fda87b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:49.717579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ddb52-d564-47fe-b37d-fae4fda87b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:49.718325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ddb52-d564-47fe-b37d-fae4fda87b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:49.723856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ddb52-d564-47fe-b37d-fae4fda87b8f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:49.765054 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2196/4379] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:00:49.766894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06fe52-5f4a-4c77-9146-4eac3da632d0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:49.790337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06fe52-5f4a-4c77-9146-4eac3da632d0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:49.797419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f591e-c3f3-4ddc-8dec-f2752c6170a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:49.798419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f591e-c3f3-4ddc-8dec-f2752c6170a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:49.798908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f591e-c3f3-4ddc-8dec-f2752c6170a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:49.799384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f591e-c3f3-4ddc-8dec-f2752c6170a5 admin admin] PATH_INFO: `/v3/projects/c2c4a5b727104217b6a80a51c51af579/users/d349ef435fd340dab632a1a0bf184c01/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:49.829204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f591e-c3f3-4ddc-8dec-f2752c6170a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c4a5b727104217b6a80a51c51af579, user_id=d349ef435fd340dab632a1a0bf184c01, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:49.833048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f591e-c3f3-4ddc-8dec-f2752c6170a5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:49.868758 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2184/4380] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:00:49 2022] PUT /identity/v3/projects/c2c4a5b727104217b6a80a51c51af579/users/d349ef435fd340dab632a1a0bf184c01/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:00:49.877633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16154afc-e125-4938-ae5b-8a635c672616 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:49.878764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16154afc-e125-4938-ae5b-8a635c672616 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:49.879120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16154afc-e125-4938-ae5b-8a635c672616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:49.963847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-16154afc-e125-4938-ae5b-8a635c672616 None None] MFA Rules not processed for user `d349ef435fd340dab632a1a0bf184c01`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:49.965878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-16154afc-e125-4938-ae5b-8a635c672616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:50.107718 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2197/4381] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:50.128408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3add367-0e7a-4f4b-9d3a-3fec11e557fd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:50.128935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3add367-0e7a-4f4b-9d3a-3fec11e557fd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:50.129023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3add367-0e7a-4f4b-9d3a-3fec11e557fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:50.169673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e3add367-0e7a-4f4b-9d3a-3fec11e557fd None None] MFA Rules not processed for user `8bb9a3b41bbc4a11a1e50fb2f5de5c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:50.171159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e3add367-0e7a-4f4b-9d3a-3fec11e557fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:50.231293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16154afc-e125-4938-ae5b-8a635c672616 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:50.234120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-16154afc-e125-4938-ae5b-8a635c672616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:50.372391 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2185/4382] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:50.405623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16154afc-e125-4938-ae5b-8a635c672616 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:50.412059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be781fa8-e0c2-43ac-a02d-c471b65dcf8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:50.414034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be781fa8-e0c2-43ac-a02d-c471b65dcf8a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:50.415376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be781fa8-e0c2-43ac-a02d-c471b65dcf8a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:50.416177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be781fa8-e0c2-43ac-a02d-c471b65dcf8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:50.445239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be781fa8-e0c2-43ac-a02d-c471b65dcf8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:50.446927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be781fa8-e0c2-43ac-a02d-c471b65dcf8a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:50.469036 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2198/4383] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:00:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:00:51.234654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3add367-0e7a-4f4b-9d3a-3fec11e557fd None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:51.236150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e3add367-0e7a-4f4b-9d3a-3fec11e557fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:51.433279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3add367-0e7a-4f4b-9d3a-3fec11e557fd None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:51.439136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c82fa-2c40-4090-bf5d-b15d34b38a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:51.439909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c82fa-2c40-4090-bf5d-b15d34b38a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:51.440189 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c82fa-2c40-4090-bf5d-b15d34b38a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:51.442061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c82fa-2c40-4090-bf5d-b15d34b38a8c admin admin] PATH_INFO: `/v3/users/14504cf57ea54b2ebb08444d5041e972` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:51.443935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c82fa-2c40-4090-bf5d-b15d34b38a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=14504cf57ea54b2ebb08444d5041e972)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:51.446199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c82fa-2c40-4090-bf5d-b15d34b38a8c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:51.545679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-366c82fa-2c40-4090-bf5d-b15d34b38a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14504cf57ea54b2ebb08444d5041e972'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:51.551370 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:51.562524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-366c82fa-2c40-4090-bf5d-b15d34b38a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14504cf57ea54b2ebb08444d5041e972'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:51.563616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-366c82fa-2c40-4090-bf5d-b15d34b38a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14504cf57ea54b2ebb08444d5041e972'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:51.601058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-366c82fa-2c40-4090-bf5d-b15d34b38a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14504cf57ea54b2ebb08444d5041e972'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:51.610874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-366c82fa-2c40-4090-bf5d-b15d34b38a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14504cf57ea54b2ebb08444d5041e972'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:51.623169 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2186/4384] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:00:51 2022] DELETE /identity/v3/users/14504cf57ea54b2ebb08444d5041e972 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:00:51.941637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be781fa8-e0c2-43ac-a02d-c471b65dcf8a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:51.977764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be781fa8-e0c2-43ac-a02d-c471b65dcf8a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:52.043476 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:52.087002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bdf70c-bdee-41f5-ad3f-93d48c31348b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:52.087709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdf70c-bdee-41f5-ad3f-93d48c31348b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:52.087990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdf70c-bdee-41f5-ad3f-93d48c31348b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:52.088258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdf70c-bdee-41f5-ad3f-93d48c31348b admin admin] PATH_INFO: `/v3/projects/cf96c1aaeddc4581af91678ba48714db` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:52.089463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bdf70c-bdee-41f5-ad3f-93d48c31348b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf96c1aaeddc4581af91678ba48714db)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:52.091371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bdf70c-bdee-41f5-ad3f-93d48c31348b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:52.167293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-89bdf70c-bdee-41f5-ad3f-93d48c31348b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf96c1aaeddc4581af91678ba48714db', 'request_id': 'req-89bdf70c-bdee-41f5-ad3f-93d48c31348b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:52.178503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-89bdf70c-bdee-41f5-ad3f-93d48c31348b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf96c1aaeddc4581af91678ba48714db', 'request_id': 'req-89bdf70c-bdee-41f5-ad3f-93d48c31348b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:52.188719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-89bdf70c-bdee-41f5-ad3f-93d48c31348b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf96c1aaeddc4581af91678ba48714db', 'request_id': 'req-89bdf70c-bdee-41f5-ad3f-93d48c31348b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:52.208289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-89bdf70c-bdee-41f5-ad3f-93d48c31348b admin admin] The token cache is being invalidate because project cf96c1aaeddc4581af91678ba48714db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:00:52.208660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-89bdf70c-bdee-41f5-ad3f-93d48c31348b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:52.209620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-89bdf70c-bdee-41f5-ad3f-93d48c31348b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:52.211290 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2199/4385] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:00:51 2022] DELETE /identity/v3/projects/cf96c1aaeddc4581af91678ba48714db => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:00:52.217081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1673b8b-402f-47c1-9672-c8d6321b6ac0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:52.217367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1673b8b-402f-47c1-9672-c8d6321b6ac0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:52.217647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1673b8b-402f-47c1-9672-c8d6321b6ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:52.271225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c1673b8b-402f-47c1-9672-c8d6321b6ac0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:52.275151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c1673b8b-402f-47c1-9672-c8d6321b6ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:52.368947 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2187/4386] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:52.377390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645994f6-a3dd-4ddf-9d04-77bbb1ca5678 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:52.377805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645994f6-a3dd-4ddf-9d04-77bbb1ca5678 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:52.378357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645994f6-a3dd-4ddf-9d04-77bbb1ca5678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:52.403697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-645994f6-a3dd-4ddf-9d04-77bbb1ca5678 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:52.405017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-645994f6-a3dd-4ddf-9d04-77bbb1ca5678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:52.414349 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2200/4387] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:52.418933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1673b8b-402f-47c1-9672-c8d6321b6ac0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:52.431759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1673b8b-402f-47c1-9672-c8d6321b6ac0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:52.436793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f1fe2-c5e9-4394-92dd-4b70dd795446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:52.437936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f1fe2-c5e9-4394-92dd-4b70dd795446 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:52.438225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f1fe2-c5e9-4394-92dd-4b70dd795446 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:52.438499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f1fe2-c5e9-4394-92dd-4b70dd795446 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:52.439169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f1fe2-c5e9-4394-92dd-4b70dd795446 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:00:52.439613 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f1fe2-c5e9-4394-92dd-4b70dd795446 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:52.442113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f1fe2-c5e9-4394-92dd-4b70dd795446 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:52.455654 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2188/4388] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:00:52.461337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645994f6-a3dd-4ddf-9d04-77bbb1ca5678 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:52.473699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645994f6-a3dd-4ddf-9d04-77bbb1ca5678 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:52.478795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358ce8a-ce2a-4eec-a9d6-8578808d1e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:52.479408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358ce8a-ce2a-4eec-a9d6-8578808d1e5c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:52.479690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358ce8a-ce2a-4eec-a9d6-8578808d1e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:52.479963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358ce8a-ce2a-4eec-a9d6-8578808d1e5c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:52.480611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358ce8a-ce2a-4eec-a9d6-8578808d1e5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:52.482532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358ce8a-ce2a-4eec-a9d6-8578808d1e5c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:52.514570 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2201/4389] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:00:52 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:00:52.519209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f1fe2-c5e9-4394-92dd-4b70dd795446 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:52.531124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f1fe2-c5e9-4394-92dd-4b70dd795446 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:52.611600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d474175-bda5-4e4e-9abe-23a34554ea7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:52.612826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d474175-bda5-4e4e-9abe-23a34554ea7b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:52.613606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d474175-bda5-4e4e-9abe-23a34554ea7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:52.614083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d474175-bda5-4e4e-9abe-23a34554ea7b admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:52.614899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d474175-bda5-4e4e-9abe-23a34554ea7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:52.617114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d474175-bda5-4e4e-9abe-23a34554ea7b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:52.671453 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2189/4390] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:00:52 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:00:52.672481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358ce8a-ce2a-4eec-a9d6-8578808d1e5c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:52.698076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358ce8a-ce2a-4eec-a9d6-8578808d1e5c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:52.710908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492369c-2457-4885-ac98-16cf5c52583c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:52.711814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492369c-2457-4885-ac98-16cf5c52583c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:52.712396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492369c-2457-4885-ac98-16cf5c52583c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:52.715614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492369c-2457-4885-ac98-16cf5c52583c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:52.716478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492369c-2457-4885-ac98-16cf5c52583c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:52.718640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492369c-2457-4885-ac98-16cf5c52583c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:52.740798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d474175-bda5-4e4e-9abe-23a34554ea7b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:52.749737 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2202/4391] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:00:52.757106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d474175-bda5-4e4e-9abe-23a34554ea7b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:52.762465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f4ec6-1d3f-4427-a7f0-e63dede547d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:52.763094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f4ec6-1d3f-4427-a7f0-e63dede547d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:52.763374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f4ec6-1d3f-4427-a7f0-e63dede547d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:52.763651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f4ec6-1d3f-4427-a7f0-e63dede547d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:52.764302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f4ec6-1d3f-4427-a7f0-e63dede547d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:52.765952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f4ec6-1d3f-4427-a7f0-e63dede547d6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:52.786162 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2190/4392] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:00:52.787994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492369c-2457-4885-ac98-16cf5c52583c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:52.803956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492369c-2457-4885-ac98-16cf5c52583c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:52.809451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77d101-4384-4005-a280-e4dacfedd1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:52.810360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77d101-4384-4005-a280-e4dacfedd1b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:52.810818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77d101-4384-4005-a280-e4dacfedd1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:52.811266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77d101-4384-4005-a280-e4dacfedd1b4 admin admin] PATH_INFO: `/v3/projects/d9e566f7de1a4a0eb7329a48c0501dfe/users/f8f5ca2ec5494895b01b85912a773916/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:52.834423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77d101-4384-4005-a280-e4dacfedd1b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e566f7de1a4a0eb7329a48c0501dfe, user_id=f8f5ca2ec5494895b01b85912a773916, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:52.839234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77d101-4384-4005-a280-e4dacfedd1b4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:52.859959 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2203/4393] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:00:52 2022] PUT /identity/v3/projects/d9e566f7de1a4a0eb7329a48c0501dfe/users/f8f5ca2ec5494895b01b85912a773916/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:00:52.866598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ceea4-b359-414b-a3fb-b8dd194bdf77 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:52.866891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ceea4-b359-414b-a3fb-b8dd194bdf77 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:52.867395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ceea4-b359-414b-a3fb-b8dd194bdf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:52.901349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-907ceea4-b359-414b-a3fb-b8dd194bdf77 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:52.903190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-907ceea4-b359-414b-a3fb-b8dd194bdf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:52.954735 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:53.027020 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2191/4394] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:53.080199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77d101-4384-4005-a280-e4dacfedd1b4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:53.082340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9a77d101-4384-4005-a280-e4dacfedd1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:53.151267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77d101-4384-4005-a280-e4dacfedd1b4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:53.156214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a0129-c712-4c41-8647-21504af62937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:53.157108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a0129-c712-4c41-8647-21504af62937 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:53.157597 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a0129-c712-4c41-8647-21504af62937 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:53.158058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a0129-c712-4c41-8647-21504af62937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:53.169847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a0129-c712-4c41-8647-21504af62937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:53.171513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a0129-c712-4c41-8647-21504af62937 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:53.184420 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2204/4395] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:00:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:00:54.101159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34259d0f-57dd-4068-aa2f-d5228b08396c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:54.101678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34259d0f-57dd-4068-aa2f-d5228b08396c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:54.101678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34259d0f-57dd-4068-aa2f-d5228b08396c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:54.143388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-34259d0f-57dd-4068-aa2f-d5228b08396c None None] MFA Rules not processed for user `8bb9a3b41bbc4a11a1e50fb2f5de5c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:54.146763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-34259d0f-57dd-4068-aa2f-d5228b08396c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:54.257174 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2192/4396] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:54.397279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7f946-8f83-4a91-be5a-a6f29655a930 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:54.398352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7f946-8f83-4a91-be5a-a6f29655a930 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:54.398818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7f946-8f83-4a91-be5a-a6f29655a930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:54.413754 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:54.461758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b6b7f946-8f83-4a91-be5a-a6f29655a930 None None] MFA Rules not processed for user `76de66d46a57438f960c832cb8a70c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:54.463469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b6b7f946-8f83-4a91-be5a-a6f29655a930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:54.622806 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2205/4397] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:54.633202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3460e70-5bcc-4d2f-a6da-2a48e2b52df8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:54.633489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3460e70-5bcc-4d2f-a6da-2a48e2b52df8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:54.633762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3460e70-5bcc-4d2f-a6da-2a48e2b52df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:54.693768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f3460e70-5bcc-4d2f-a6da-2a48e2b52df8 None None] MFA Rules not processed for user `76de66d46a57438f960c832cb8a70c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:54.695057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f3460e70-5bcc-4d2f-a6da-2a48e2b52df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:54.715907 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2193/4398] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:54.756420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2730d33-6884-4b8a-be16-64299fcea5c6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:54.757113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2730d33-6884-4b8a-be16-64299fcea5c6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:54.757613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2730d33-6884-4b8a-be16-64299fcea5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:54.790688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3460e70-5bcc-4d2f-a6da-2a48e2b52df8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:54.792174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f3460e70-5bcc-4d2f-a6da-2a48e2b52df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:54.816382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d2730d33-6884-4b8a-be16-64299fcea5c6 None None] MFA Rules not processed for user `f8f5ca2ec5494895b01b85912a773916`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:54.825787 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d2730d33-6884-4b8a-be16-64299fcea5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:54.970110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3460e70-5bcc-4d2f-a6da-2a48e2b52df8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:54.979999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db22be-aa92-4b89-93c3-7678672e1578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:54.981363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db22be-aa92-4b89-93c3-7678672e1578 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:54.981889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db22be-aa92-4b89-93c3-7678672e1578 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:54.987400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db22be-aa92-4b89-93c3-7678672e1578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:55.003433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db22be-aa92-4b89-93c3-7678672e1578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:55.005767 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2206/4399] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:55.006991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db22be-aa92-4b89-93c3-7678672e1578 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:55.015212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240b9eb-c659-4410-a908-dc52bd22bf13 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:55.015498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240b9eb-c659-4410-a908-dc52bd22bf13 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:55.015770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240b9eb-c659-4410-a908-dc52bd22bf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:55.019814 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2194/4400] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:00:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:00:55.058834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e240b9eb-c659-4410-a908-dc52bd22bf13 None None] MFA Rules not processed for user `f8f5ca2ec5494895b01b85912a773916`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:55.060069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e240b9eb-c659-4410-a908-dc52bd22bf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:55.083647 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2207/4401] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:57.068454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db22be-aa92-4b89-93c3-7678672e1578 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:57.070894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-51db22be-aa92-4b89-93c3-7678672e1578 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:57.097873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db22be-aa92-4b89-93c3-7678672e1578 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:57.111220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47565ea-614f-4a8b-a4c1-7895a0cfae17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:57.111875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47565ea-614f-4a8b-a4c1-7895a0cfae17 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:57.112768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47565ea-614f-4a8b-a4c1-7895a0cfae17 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:57.113169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47565ea-614f-4a8b-a4c1-7895a0cfae17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:57.137651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47565ea-614f-4a8b-a4c1-7895a0cfae17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:57.147520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47565ea-614f-4a8b-a4c1-7895a0cfae17 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:57.184702 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2195/4402] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:00:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:00:58.136381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbea46c-f794-41d2-bc73-3b35d1608679 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:58.136929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbea46c-f794-41d2-bc73-3b35d1608679 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:58.137006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbea46c-f794-41d2-bc73-3b35d1608679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:58.175822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ccbea46c-f794-41d2-bc73-3b35d1608679 None None] MFA Rules not processed for user `8bb9a3b41bbc4a11a1e50fb2f5de5c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:58.177305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ccbea46c-f794-41d2-bc73-3b35d1608679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:58.188770 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2208/4403] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:59.066656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47565ea-614f-4a8b-a4c1-7895a0cfae17 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:59.086048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47565ea-614f-4a8b-a4c1-7895a0cfae17 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:59.091790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25905087-6d63-4ed6-b8ba-7df0e641eefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:59.093032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25905087-6d63-4ed6-b8ba-7df0e641eefe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:59.093527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25905087-6d63-4ed6-b8ba-7df0e641eefe admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:59.094007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25905087-6d63-4ed6-b8ba-7df0e641eefe admin admin] PATH_INFO: `/v3/users/f8f5ca2ec5494895b01b85912a773916` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:59.095235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25905087-6d63-4ed6-b8ba-7df0e641eefe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8f5ca2ec5494895b01b85912a773916)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:59.097819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25905087-6d63-4ed6-b8ba-7df0e641eefe admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:59.129127 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:59.162972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-25905087-6d63-4ed6-b8ba-7df0e641eefe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8f5ca2ec5494895b01b85912a773916'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:59.175623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-25905087-6d63-4ed6-b8ba-7df0e641eefe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8f5ca2ec5494895b01b85912a773916'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:59.175623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-25905087-6d63-4ed6-b8ba-7df0e641eefe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8f5ca2ec5494895b01b85912a773916'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:59.194478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-25905087-6d63-4ed6-b8ba-7df0e641eefe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8f5ca2ec5494895b01b85912a773916'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:59.204218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-25905087-6d63-4ed6-b8ba-7df0e641eefe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8f5ca2ec5494895b01b85912a773916'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:59.216704 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2196/4404] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:00:59 2022] DELETE /identity/v3/users/f8f5ca2ec5494895b01b85912a773916 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:00:59.410783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbea46c-f794-41d2-bc73-3b35d1608679 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:59.422913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbea46c-f794-41d2-bc73-3b35d1608679 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:59.493366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2c6ad-1ab0-4df0-a5d4-c649372291a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:59.493996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2c6ad-1ab0-4df0-a5d4-c649372291a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:59.494272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2c6ad-1ab0-4df0-a5d4-c649372291a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:59.494540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2c6ad-1ab0-4df0-a5d4-c649372291a2 admin admin] PATH_INFO: `/v3/projects/d9e566f7de1a4a0eb7329a48c0501dfe` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:59.495659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2c6ad-1ab0-4df0-a5d4-c649372291a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9e566f7de1a4a0eb7329a48c0501dfe)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:59.497616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2c6ad-1ab0-4df0-a5d4-c649372291a2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:59.508758 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:00:59.547009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ec2c6ad-1ab0-4df0-a5d4-c649372291a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9e566f7de1a4a0eb7329a48c0501dfe', 'request_id': 'req-9ec2c6ad-1ab0-4df0-a5d4-c649372291a2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:59.556533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ec2c6ad-1ab0-4df0-a5d4-c649372291a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9e566f7de1a4a0eb7329a48c0501dfe', 'request_id': 'req-9ec2c6ad-1ab0-4df0-a5d4-c649372291a2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:59.563919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ec2c6ad-1ab0-4df0-a5d4-c649372291a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9e566f7de1a4a0eb7329a48c0501dfe', 'request_id': 'req-9ec2c6ad-1ab0-4df0-a5d4-c649372291a2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:59.575531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ec2c6ad-1ab0-4df0-a5d4-c649372291a2 admin admin] The token cache is being invalidate because project d9e566f7de1a4a0eb7329a48c0501dfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:00:59.575815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ec2c6ad-1ab0-4df0-a5d4-c649372291a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:59.576494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ec2c6ad-1ab0-4df0-a5d4-c649372291a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:00:59.578014 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2209/4405] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:00:59 2022] DELETE /identity/v3/projects/d9e566f7de1a4a0eb7329a48c0501dfe => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:00:59.584165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe59e7-17f8-4ce2-b258-40218756d72f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:59.584544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe59e7-17f8-4ce2-b258-40218756d72f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:59.584946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe59e7-17f8-4ce2-b258-40218756d72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:59.615785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8cbe59e7-17f8-4ce2-b258-40218756d72f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:59.617194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8cbe59e7-17f8-4ce2-b258-40218756d72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:59.685090 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2197/4406] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:00:59.693796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8950d8a-bede-44be-8933-6ab56915018c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:59.694432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8950d8a-bede-44be-8933-6ab56915018c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:59.694809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8950d8a-bede-44be-8933-6ab56915018c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:59.720450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c8950d8a-bede-44be-8933-6ab56915018c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:00:59.723464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c8950d8a-bede-44be-8933-6ab56915018c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:00:59.734808 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2210/4407] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:00:59.739343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe59e7-17f8-4ce2-b258-40218756d72f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:59.749062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe59e7-17f8-4ce2-b258-40218756d72f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:59.753743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b6b9a-4b17-40b0-8e14-f010cfa4f6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:59.754344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b6b9a-4b17-40b0-8e14-f010cfa4f6bb admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:59.754622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b6b9a-4b17-40b0-8e14-f010cfa4f6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:59.754893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b6b9a-4b17-40b0-8e14-f010cfa4f6bb admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:59.755548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b6b9a-4b17-40b0-8e14-f010cfa4f6bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:00:59.755854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b6b9a-4b17-40b0-8e14-f010cfa4f6bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:59.757477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b6b9a-4b17-40b0-8e14-f010cfa4f6bb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:59.770173 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2198/4408] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:00:59.774748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8950d8a-bede-44be-8933-6ab56915018c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:59.785495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8950d8a-bede-44be-8933-6ab56915018c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:59.790442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65d31a-9ade-4464-b9f3-a23cd9ab7456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:59.791078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65d31a-9ade-4464-b9f3-a23cd9ab7456 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:59.791527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65d31a-9ade-4464-b9f3-a23cd9ab7456 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:59.791803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65d31a-9ade-4464-b9f3-a23cd9ab7456 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:59.792460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65d31a-9ade-4464-b9f3-a23cd9ab7456 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:59.794437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65d31a-9ade-4464-b9f3-a23cd9ab7456 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:59.828888 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2211/4409] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:00:59 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:00:59.833252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b6b9a-4b17-40b0-8e14-f010cfa4f6bb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:59.846895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b6b9a-4b17-40b0-8e14-f010cfa4f6bb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:59.929419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb427ce8-43a3-4da2-a784-d96a335f8e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:59.930125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb427ce8-43a3-4da2-a784-d96a335f8e8b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:59.930499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb427ce8-43a3-4da2-a784-d96a335f8e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:59.930892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb427ce8-43a3-4da2-a784-d96a335f8e8b admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:59.931693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb427ce8-43a3-4da2-a784-d96a335f8e8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:59.933985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb427ce8-43a3-4da2-a784-d96a335f8e8b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:00:59.964646 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2199/4410] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:00:59 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:00:59.966084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65d31a-9ade-4464-b9f3-a23cd9ab7456 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:00:59.978118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65d31a-9ade-4464-b9f3-a23cd9ab7456 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:00:59.984574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89f1bf-f45b-4d75-820a-9ef5976876fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:00:59.985610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89f1bf-f45b-4d75-820a-9ef5976876fb admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:00:59.985610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89f1bf-f45b-4d75-820a-9ef5976876fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:00:59.985883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89f1bf-f45b-4d75-820a-9ef5976876fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:00:59.986536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89f1bf-f45b-4d75-820a-9ef5976876fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:00:59.989662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89f1bf-f45b-4d75-820a-9ef5976876fb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:00.002827 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2212/4411] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:00.007580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb427ce8-43a3-4da2-a784-d96a335f8e8b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:00.018349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb427ce8-43a3-4da2-a784-d96a335f8e8b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:00.023480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460a7a5-0678-43c6-8477-5c3c666bf3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:00.024082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460a7a5-0678-43c6-8477-5c3c666bf3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:00.024361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460a7a5-0678-43c6-8477-5c3c666bf3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:00.024659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460a7a5-0678-43c6-8477-5c3c666bf3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:00.025326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460a7a5-0678-43c6-8477-5c3c666bf3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:00.027123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460a7a5-0678-43c6-8477-5c3c666bf3f8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:00.042912 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2200/4412] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:00.044337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89f1bf-f45b-4d75-820a-9ef5976876fb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:00.055719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89f1bf-f45b-4d75-820a-9ef5976876fb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:00.060660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dca6f-6cc9-42c4-a40f-ea2b75013f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:00.061321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dca6f-6cc9-42c4-a40f-ea2b75013f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:00.061609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dca6f-6cc9-42c4-a40f-ea2b75013f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:00.061883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dca6f-6cc9-42c4-a40f-ea2b75013f89 admin admin] PATH_INFO: `/v3/projects/e1c6e4bbf4ae4830982b70a10f2d6dd1/users/d6b9451d958143bb8a48ada3c81b2033/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:00.078261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dca6f-6cc9-42c4-a40f-ea2b75013f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c6e4bbf4ae4830982b70a10f2d6dd1, user_id=d6b9451d958143bb8a48ada3c81b2033, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:00.081249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dca6f-6cc9-42c4-a40f-ea2b75013f89 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:00.095111 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2213/4413] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:01:00 2022] PUT /identity/v3/projects/e1c6e4bbf4ae4830982b70a10f2d6dd1/users/d6b9451d958143bb8a48ada3c81b2033/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:00.109262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4913ed9-9e84-4508-b70c-743a374dc038 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:00.109785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4913ed9-9e84-4508-b70c-743a374dc038 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:00.109785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4913ed9-9e84-4508-b70c-743a374dc038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:00.120524 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:00.142283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b4913ed9-9e84-4508-b70c-743a374dc038 None None] MFA Rules not processed for user `d6b9451d958143bb8a48ada3c81b2033`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:00.150497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b4913ed9-9e84-4508-b70c-743a374dc038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:00.244403 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2201/4414] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:00.249119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dca6f-6cc9-42c4-a40f-ea2b75013f89 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:00.320566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dca6f-6cc9-42c4-a40f-ea2b75013f89 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:00.325745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653931c2-fb04-40e2-ac5d-39f099258b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:00.326344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653931c2-fb04-40e2-ac5d-39f099258b21 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:00.326616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653931c2-fb04-40e2-ac5d-39f099258b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:00.327029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653931c2-fb04-40e2-ac5d-39f099258b21 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:00.327959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653931c2-fb04-40e2-ac5d-39f099258b21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:00.329883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653931c2-fb04-40e2-ac5d-39f099258b21 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:00.358443 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2214/4415] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:01:00 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:00.363472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4913ed9-9e84-4508-b70c-743a374dc038 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:00.375708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4913ed9-9e84-4508-b70c-743a374dc038 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:00.441615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361fb10-ce7f-4c67-8b13-6f15418028e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:00.442282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361fb10-ce7f-4c67-8b13-6f15418028e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:00.442511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361fb10-ce7f-4c67-8b13-6f15418028e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:00.442791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361fb10-ce7f-4c67-8b13-6f15418028e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:00.443438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361fb10-ce7f-4c67-8b13-6f15418028e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:00.445437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361fb10-ce7f-4c67-8b13-6f15418028e2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:00.469097 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2202/4416] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:01:00 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:00.474599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653931c2-fb04-40e2-ac5d-39f099258b21 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:00.486519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653931c2-fb04-40e2-ac5d-39f099258b21 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:00.492904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e3010-b2aa-4a87-b7e3-75508a41b167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:00.493516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e3010-b2aa-4a87-b7e3-75508a41b167 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:00.493931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e3010-b2aa-4a87-b7e3-75508a41b167 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:00.494218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e3010-b2aa-4a87-b7e3-75508a41b167 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:00.494872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e3010-b2aa-4a87-b7e3-75508a41b167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:00.496477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e3010-b2aa-4a87-b7e3-75508a41b167 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:00.512808 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2215/4417] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:00.516766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361fb10-ce7f-4c67-8b13-6f15418028e2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:00.528785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361fb10-ce7f-4c67-8b13-6f15418028e2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:00.533578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d904bb1-ea4f-447a-8463-aa77a968c048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:00.535457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d904bb1-ea4f-447a-8463-aa77a968c048 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:00.535745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d904bb1-ea4f-447a-8463-aa77a968c048 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:00.536021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d904bb1-ea4f-447a-8463-aa77a968c048 admin admin] PATH_INFO: `/v3/projects/7ea42bc2843f4e1399b3f41567557db1/users/063787bc7ba94a9bad0fa7f4ea2d63f6/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:00.552250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d904bb1-ea4f-447a-8463-aa77a968c048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ea42bc2843f4e1399b3f41567557db1, user_id=063787bc7ba94a9bad0fa7f4ea2d63f6, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:00.555097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d904bb1-ea4f-447a-8463-aa77a968c048 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:00.568373 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2203/4418] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:01:00 2022] PUT /identity/v3/projects/7ea42bc2843f4e1399b3f41567557db1/users/063787bc7ba94a9bad0fa7f4ea2d63f6/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:00.572786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e3010-b2aa-4a87-b7e3-75508a41b167 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:00.586033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e3010-b2aa-4a87-b7e3-75508a41b167 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:00.591160 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:00.656538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa9157-aa85-40ba-a1a6-ea17d66f3d0a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:00.657044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa9157-aa85-40ba-a1a6-ea17d66f3d0a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:00.657394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa9157-aa85-40ba-a1a6-ea17d66f3d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:00.679502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-01fa9157-aa85-40ba-a1a6-ea17d66f3d0a None None] MFA Rules not processed for user `8bb9a3b41bbc4a11a1e50fb2f5de5c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:00.679695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7b178-e1c9-464a-a682-6e0570cc725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:00.680316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7b178-e1c9-464a-a682-6e0570cc725e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:00.680429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7b178-e1c9-464a-a682-6e0570cc725e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:00.681007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-01fa9157-aa85-40ba-a1a6-ea17d66f3d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:00.681119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7b178-e1c9-464a-a682-6e0570cc725e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:00.681827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7b178-e1c9-464a-a682-6e0570cc725e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:00.683530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7b178-e1c9-464a-a682-6e0570cc725e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:00.701689 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2216/4419] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:00.704547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7b178-e1c9-464a-a682-6e0570cc725e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:00.717899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7b178-e1c9-464a-a682-6e0570cc725e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:00.725966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc9b95-bc30-4d51-8350-b0a2c5b99f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:00.726642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc9b95-bc30-4d51-8350-b0a2c5b99f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:00.727048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc9b95-bc30-4d51-8350-b0a2c5b99f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:00.727393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc9b95-bc30-4d51-8350-b0a2c5b99f0b admin admin] PATH_INFO: `/v3/projects/7ea42bc2843f4e1399b3f41567557db1/users/063787bc7ba94a9bad0fa7f4ea2d63f6/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:00.730278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc9b95-bc30-4d51-8350-b0a2c5b99f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ea42bc2843f4e1399b3f41567557db1, user_id=063787bc7ba94a9bad0fa7f4ea2d63f6, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:00.733633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc9b95-bc30-4d51-8350-b0a2c5b99f0b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:00.745967 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2217/4420] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:01:00 2022] PUT /identity/v3/projects/7ea42bc2843f4e1399b3f41567557db1/users/063787bc7ba94a9bad0fa7f4ea2d63f6/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:00.756360 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2204/4421] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:01:00.757879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3434b1-4af8-41c5-84a1-a9d3eb6c02ae None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:00.758173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3434b1-4af8-41c5-84a1-a9d3eb6c02ae None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:00.758451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3434b1-4af8-41c5-84a1-a9d3eb6c02ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:00.791055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3f3434b1-4af8-41c5-84a1-a9d3eb6c02ae None None] MFA Rules not processed for user `063787bc7ba94a9bad0fa7f4ea2d63f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:00.792347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3f3434b1-4af8-41c5-84a1-a9d3eb6c02ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:00.910429 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2218/4422] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:00.917974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa9157-aa85-40ba-a1a6-ea17d66f3d0a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:00.926563 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:01.006526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa9157-aa85-40ba-a1a6-ea17d66f3d0a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:01.012340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daea45-a87c-4ce2-9a8b-7c5ba7872b70 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063787bc7ba94a9bad0fa7f4ea2d63f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea42bc2843f4e1399b3f41567557db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:01.013029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daea45-a87c-4ce2-9a8b-7c5ba7872b70 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:01.013358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daea45-a87c-4ce2-9a8b-7c5ba7872b70 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:01.013645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daea45-a87c-4ce2-9a8b-7c5ba7872b70 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:01.014406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5daea45-a87c-4ce2-9a8b-7c5ba7872b70 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:01.016839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5daea45-a87c-4ce2-9a8b-7c5ba7872b70 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:01.072157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3434b1-4af8-41c5-84a1-a9d3eb6c02ae None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:01.073141 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2205/4423] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:01:00 2022] POST /identity/v3/projects => generated 350 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:01.089417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3434b1-4af8-41c5-84a1-a9d3eb6c02ae None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:01.178402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7ea77-3ff3-46b8-9e32-e6bc325fc3e3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063787bc7ba94a9bad0fa7f4ea2d63f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea42bc2843f4e1399b3f41567557db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:01.179350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7ea77-3ff3-46b8-9e32-e6bc325fc3e3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:01.179633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7ea77-3ff3-46b8-9e32-e6bc325fc3e3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:01.180225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7ea77-3ff3-46b8-9e32-e6bc325fc3e3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:01.180734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7ea77-3ff3-46b8-9e32-e6bc325fc3e3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:01.182812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7ea77-3ff3-46b8-9e32-e6bc325fc3e3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:01.224660 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2219/4424] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:01:01 2022] POST /identity/v3/projects => generated 351 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:01.227315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daea45-a87c-4ce2-9a8b-7c5ba7872b70 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:01.241605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daea45-a87c-4ce2-9a8b-7c5ba7872b70 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:01.345859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb07e4-0109-4d67-bbba-217078cd68f3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063787bc7ba94a9bad0fa7f4ea2d63f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea42bc2843f4e1399b3f41567557db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:01.347095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb07e4-0109-4d67-bbba-217078cd68f3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:01.347379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb07e4-0109-4d67-bbba-217078cd68f3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:01.348348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb07e4-0109-4d67-bbba-217078cd68f3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] PATH_INFO: `/v3/users/d6b9451d958143bb8a48ada3c81b2033` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:01.350250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb07e4-0109-4d67-bbba-217078cd68f3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorizing `identity:get_user(user_id=d6b9451d958143bb8a48ada3c81b2033)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:01.353456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb07e4-0109-4d67-bbba-217078cd68f3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:01.355323 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2206/4425] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Sep 30 10:01:01 2022] GET /identity/v3/users/d6b9451d958143bb8a48ada3c81b2033 => generated 287 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:01:01.360302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7ea77-3ff3-46b8-9e32-e6bc325fc3e3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:01.366628 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:01.378890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7ea77-3ff3-46b8-9e32-e6bc325fc3e3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:01.386540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63c1e5-8fe8-4207-840b-74a0d5f7712e tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063787bc7ba94a9bad0fa7f4ea2d63f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea42bc2843f4e1399b3f41567557db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:01.387168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63c1e5-8fe8-4207-840b-74a0d5f7712e tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:01.388991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63c1e5-8fe8-4207-840b-74a0d5f7712e tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:01.389279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63c1e5-8fe8-4207-840b-74a0d5f7712e tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:01.389955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63c1e5-8fe8-4207-840b-74a0d5f7712e tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:01.391855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63c1e5-8fe8-4207-840b-74a0d5f7712e tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:01.423364 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2220/4426] 10.222.0.16 () {60 vars in 1162 bytes} [Fri Sep 30 10:01:01 2022] POST /identity/v3/credentials => generated 430 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:01.427409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb07e4-0109-4d67-bbba-217078cd68f3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:01.441137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb07e4-0109-4d67-bbba-217078cd68f3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:01.446314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce66a2-4352-41e0-a1cb-6745f4580bcd tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063787bc7ba94a9bad0fa7f4ea2d63f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea42bc2843f4e1399b3f41567557db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:01.447593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce66a2-4352-41e0-a1cb-6745f4580bcd tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:01.447885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce66a2-4352-41e0-a1cb-6745f4580bcd tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:01.448163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce66a2-4352-41e0-a1cb-6745f4580bcd tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] PATH_INFO: `/v3/credentials/53ec230c876d3eb8a8160fb04920f00b9192bca7209e22dd954651da67c16e16` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:01.450680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce66a2-4352-41e0-a1cb-6745f4580bcd tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=53ec230c876d3eb8a8160fb04920f00b9192bca7209e22dd954651da67c16e16)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:01.453296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce66a2-4352-41e0-a1cb-6745f4580bcd tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:01.457128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce66a2-4352-41e0-a1cb-6745f4580bcd tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=53ec230c876d3eb8a8160fb04920f00b9192bca7209e22dd954651da67c16e16)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:01.459069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce66a2-4352-41e0-a1cb-6745f4580bcd tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:01.481493 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2207/4427] 10.222.0.16 () {60 vars in 1358 bytes} [Fri Sep 30 10:01:01 2022] PATCH /identity/v3/credentials/53ec230c876d3eb8a8160fb04920f00b9192bca7209e22dd954651da67c16e16 => generated 436 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:01:01.482711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63c1e5-8fe8-4207-840b-74a0d5f7712e tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:01.504472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63c1e5-8fe8-4207-840b-74a0d5f7712e tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:01.511263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bae0c7-2e05-42ed-9e36-eda9b8067d2e tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063787bc7ba94a9bad0fa7f4ea2d63f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea42bc2843f4e1399b3f41567557db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:01.511847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bae0c7-2e05-42ed-9e36-eda9b8067d2e tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:01.512131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bae0c7-2e05-42ed-9e36-eda9b8067d2e tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:01.512407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bae0c7-2e05-42ed-9e36-eda9b8067d2e tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] PATH_INFO: `/v3/credentials/53ec230c876d3eb8a8160fb04920f00b9192bca7209e22dd954651da67c16e16` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:01.514467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bae0c7-2e05-42ed-9e36-eda9b8067d2e tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=53ec230c876d3eb8a8160fb04920f00b9192bca7209e22dd954651da67c16e16)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:01.516194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bae0c7-2e05-42ed-9e36-eda9b8067d2e tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:01.519170 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2221/4428] 10.222.0.16 () {58 vars in 1335 bytes} [Fri Sep 30 10:01:01 2022] GET /identity/v3/credentials/53ec230c876d3eb8a8160fb04920f00b9192bca7209e22dd954651da67c16e16 => generated 436 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:01:01.524682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce66a2-4352-41e0-a1cb-6745f4580bcd tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:01.535871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce66a2-4352-41e0-a1cb-6745f4580bcd tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:01.542936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b431e8-25db-45a6-98a8-170f8b5d612f tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063787bc7ba94a9bad0fa7f4ea2d63f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea42bc2843f4e1399b3f41567557db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:01.543747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b431e8-25db-45a6-98a8-170f8b5d612f tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:01.544107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b431e8-25db-45a6-98a8-170f8b5d612f tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:01.545111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b431e8-25db-45a6-98a8-170f8b5d612f tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] PATH_INFO: `/v3/credentials/53ec230c876d3eb8a8160fb04920f00b9192bca7209e22dd954651da67c16e16` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:01.547323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b431e8-25db-45a6-98a8-170f8b5d612f tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=53ec230c876d3eb8a8160fb04920f00b9192bca7209e22dd954651da67c16e16)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:01.549214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b431e8-25db-45a6-98a8-170f8b5d612f tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:01.578944 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2208/4429] 10.222.0.16 () {58 vars in 1338 bytes} [Fri Sep 30 10:01:01 2022] DELETE /identity/v3/credentials/53ec230c876d3eb8a8160fb04920f00b9192bca7209e22dd954651da67c16e16 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:01.585716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bae0c7-2e05-42ed-9e36-eda9b8067d2e tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:01.596843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bae0c7-2e05-42ed-9e36-eda9b8067d2e tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:01.603987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0e6f4-47fd-4fc9-ab03-38380dc19464 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063787bc7ba94a9bad0fa7f4ea2d63f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea42bc2843f4e1399b3f41567557db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:01.604632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0e6f4-47fd-4fc9-ab03-38380dc19464 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:01.604934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0e6f4-47fd-4fc9-ab03-38380dc19464 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:01.605289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0e6f4-47fd-4fc9-ab03-38380dc19464 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:01.605864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0e6f4-47fd-4fc9-ab03-38380dc19464 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:01.607603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0e6f4-47fd-4fc9-ab03-38380dc19464 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:01.632211 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2222/4430] 10.222.0.16 () {60 vars in 1162 bytes} [Fri Sep 30 10:01:01 2022] POST /identity/v3/credentials => generated 429 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:01.633682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b431e8-25db-45a6-98a8-170f8b5d612f tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:01.645774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b431e8-25db-45a6-98a8-170f8b5d612f tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:01.651192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b75b1e-c1e3-47c3-80c3-27acc6dfdbb3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063787bc7ba94a9bad0fa7f4ea2d63f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea42bc2843f4e1399b3f41567557db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:01.652012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b75b1e-c1e3-47c3-80c3-27acc6dfdbb3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:01.652439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b75b1e-c1e3-47c3-80c3-27acc6dfdbb3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:01.652926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b75b1e-c1e3-47c3-80c3-27acc6dfdbb3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:01.653716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b75b1e-c1e3-47c3-80c3-27acc6dfdbb3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:01.655813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b75b1e-c1e3-47c3-80c3-27acc6dfdbb3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:01.682784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0e6f4-47fd-4fc9-ab03-38380dc19464 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:01.691298 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2209/4431] 10.222.0.16 () {60 vars in 1162 bytes} [Fri Sep 30 10:01:01 2022] POST /identity/v3/credentials => generated 431 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:01.695366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0e6f4-47fd-4fc9-ab03-38380dc19464 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:01.701172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7659b16-a47b-49f0-8742-9ccea002d9ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063787bc7ba94a9bad0fa7f4ea2d63f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea42bc2843f4e1399b3f41567557db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:01.701959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7659b16-a47b-49f0-8742-9ccea002d9ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:01.702409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7659b16-a47b-49f0-8742-9ccea002d9ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:01.702823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7659b16-a47b-49f0-8742-9ccea002d9ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:01.703566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7659b16-a47b-49f0-8742-9ccea002d9ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:01.705303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7659b16-a47b-49f0-8742-9ccea002d9ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:01.719268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7659b16-a47b-49f0-8742-9ccea002d9ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:01.721312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7659b16-a47b-49f0-8742-9ccea002d9ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:01.723821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7659b16-a47b-49f0-8742-9ccea002d9ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:01.725872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7659b16-a47b-49f0-8742-9ccea002d9ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:01.728295 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2223/4432] 10.222.0.16 () {58 vars in 1140 bytes} [Fri Sep 30 10:01:01 2022] GET /identity/v3/credentials => generated 945 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:01:01.732679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b75b1e-c1e3-47c3-80c3-27acc6dfdbb3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:01.749781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b75b1e-c1e3-47c3-80c3-27acc6dfdbb3 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:01.761618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb734a3-a3c7-40d0-b055-9e837bdf6aaa tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063787bc7ba94a9bad0fa7f4ea2d63f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea42bc2843f4e1399b3f41567557db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:01.762512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb734a3-a3c7-40d0-b055-9e837bdf6aaa tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:01.762939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb734a3-a3c7-40d0-b055-9e837bdf6aaa tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:01.763375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb734a3-a3c7-40d0-b055-9e837bdf6aaa tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] PATH_INFO: `/v3/credentials/435856f14ae8469fad21bced4d9d64b982231379931c31562de36699d15d7dd0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:01.765602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb734a3-a3c7-40d0-b055-9e837bdf6aaa tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=435856f14ae8469fad21bced4d9d64b982231379931c31562de36699d15d7dd0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:01.767486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb734a3-a3c7-40d0-b055-9e837bdf6aaa tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:01.790538 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2210/4433] 10.222.0.16 () {58 vars in 1338 bytes} [Fri Sep 30 10:01:01 2022] DELETE /identity/v3/credentials/435856f14ae8469fad21bced4d9d64b982231379931c31562de36699d15d7dd0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:01.791548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7659b16-a47b-49f0-8742-9ccea002d9ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:01.803316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7659b16-a47b-49f0-8742-9ccea002d9ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:01.809573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfe4fe-8bd4-4273-ad01-705b40b87d4f tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063787bc7ba94a9bad0fa7f4ea2d63f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea42bc2843f4e1399b3f41567557db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:01.810446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfe4fe-8bd4-4273-ad01-705b40b87d4f tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:01.810824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfe4fe-8bd4-4273-ad01-705b40b87d4f tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:01.811216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfe4fe-8bd4-4273-ad01-705b40b87d4f tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] PATH_INFO: `/v3/credentials/f91ed2e88de549fd723adf14d63574b3d7e4e611036290e35aa5a812de188ed2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:01.813291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bfe4fe-8bd4-4273-ad01-705b40b87d4f tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=f91ed2e88de549fd723adf14d63574b3d7e4e611036290e35aa5a812de188ed2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:01.817479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bfe4fe-8bd4-4273-ad01-705b40b87d4f tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:01.844860 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2224/4434] 10.222.0.16 () {58 vars in 1338 bytes} [Fri Sep 30 10:01:01 2022] DELETE /identity/v3/credentials/f91ed2e88de549fd723adf14d63574b3d7e4e611036290e35aa5a812de188ed2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:01:01.846986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb734a3-a3c7-40d0-b055-9e837bdf6aaa tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:01.859958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb734a3-a3c7-40d0-b055-9e837bdf6aaa tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:01.868203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ef30e-9ed9-4450-8d16-d15cc62c47ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063787bc7ba94a9bad0fa7f4ea2d63f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea42bc2843f4e1399b3f41567557db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:01.869298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ef30e-9ed9-4450-8d16-d15cc62c47ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:01.869802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ef30e-9ed9-4450-8d16-d15cc62c47ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:01.870287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ef30e-9ed9-4450-8d16-d15cc62c47ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] PATH_INFO: `/v3/projects/0ff35cae78b543b3a796542c3b3da71f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:01.871726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ef30e-9ed9-4450-8d16-d15cc62c47ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0ff35cae78b543b3a796542c3b3da71f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:01.873995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ef30e-9ed9-4450-8d16-d15cc62c47ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:01.937791 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:01.957323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-340ef30e-9ed9-4450-8d16-d15cc62c47ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ff35cae78b543b3a796542c3b3da71f', 'request_id': 'req-340ef30e-9ed9-4450-8d16-d15cc62c47ae'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:01.972550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-340ef30e-9ed9-4450-8d16-d15cc62c47ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ff35cae78b543b3a796542c3b3da71f', 'request_id': 'req-340ef30e-9ed9-4450-8d16-d15cc62c47ae'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:01.982429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-340ef30e-9ed9-4450-8d16-d15cc62c47ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ff35cae78b543b3a796542c3b3da71f', 'request_id': 'req-340ef30e-9ed9-4450-8d16-d15cc62c47ae'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:01.997981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-340ef30e-9ed9-4450-8d16-d15cc62c47ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] The token cache is being invalidate because project 0ff35cae78b543b3a796542c3b3da71f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:01:01.999260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-340ef30e-9ed9-4450-8d16-d15cc62c47ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:01.999790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-340ef30e-9ed9-4450-8d16-d15cc62c47ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:02.002091 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2211/4435] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:01:01 2022] DELETE /identity/v3/projects/0ff35cae78b543b3a796542c3b3da71f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:02.006722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfe4fe-8bd4-4273-ad01-705b40b87d4f tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:02.008711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-94bfe4fe-8bd4-4273-ad01-705b40b87d4f tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:02.024736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfe4fe-8bd4-4273-ad01-705b40b87d4f tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:02.093883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb65bc-f12d-4edd-a5df-45e21f1d53a8 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063787bc7ba94a9bad0fa7f4ea2d63f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea42bc2843f4e1399b3f41567557db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:02.094832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb65bc-f12d-4edd-a5df-45e21f1d53a8 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:02.095664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb65bc-f12d-4edd-a5df-45e21f1d53a8 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:02.095664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb65bc-f12d-4edd-a5df-45e21f1d53a8 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] PATH_INFO: `/v3/projects/ff1bbf306954497a8d8008fc08b162cb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:02.096877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb65bc-f12d-4edd-a5df-45e21f1d53a8 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ff1bbf306954497a8d8008fc08b162cb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:02.099222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb65bc-f12d-4edd-a5df-45e21f1d53a8 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:02.160216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cbeb65bc-f12d-4edd-a5df-45e21f1d53a8 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1bbf306954497a8d8008fc08b162cb', 'request_id': 'req-cbeb65bc-f12d-4edd-a5df-45e21f1d53a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:02.171044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cbeb65bc-f12d-4edd-a5df-45e21f1d53a8 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1bbf306954497a8d8008fc08b162cb', 'request_id': 'req-cbeb65bc-f12d-4edd-a5df-45e21f1d53a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:02.181276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cbeb65bc-f12d-4edd-a5df-45e21f1d53a8 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1bbf306954497a8d8008fc08b162cb', 'request_id': 'req-cbeb65bc-f12d-4edd-a5df-45e21f1d53a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:02.196121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cbeb65bc-f12d-4edd-a5df-45e21f1d53a8 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] The token cache is being invalidate because project ff1bbf306954497a8d8008fc08b162cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:01:02.196510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cbeb65bc-f12d-4edd-a5df-45e21f1d53a8 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:02.197646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cbeb65bc-f12d-4edd-a5df-45e21f1d53a8 tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:02.204556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ef30e-9ed9-4450-8d16-d15cc62c47ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:02.205121 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2225/4436] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:01:02 2022] DELETE /identity/v3/projects/ff1bbf306954497a8d8008fc08b162cb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:02.206347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-340ef30e-9ed9-4450-8d16-d15cc62c47ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:02.287674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ef30e-9ed9-4450-8d16-d15cc62c47ae tempest-CredentialsTestJSON-796551873 tempest-CredentialsTestJSON-796551873-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:02.381522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f42aea-d480-47dd-a87f-2d433c51aba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:02.383783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f42aea-d480-47dd-a87f-2d433c51aba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:02.385946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f42aea-d480-47dd-a87f-2d433c51aba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:02.386093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f42aea-d480-47dd-a87f-2d433c51aba3 admin admin] PATH_INFO: `/v3/users/d6b9451d958143bb8a48ada3c81b2033` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:02.387890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f42aea-d480-47dd-a87f-2d433c51aba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6b9451d958143bb8a48ada3c81b2033)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:02.391954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f42aea-d480-47dd-a87f-2d433c51aba3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:02.469603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a2f42aea-d480-47dd-a87f-2d433c51aba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6b9451d958143bb8a48ada3c81b2033'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:02.489618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a2f42aea-d480-47dd-a87f-2d433c51aba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6b9451d958143bb8a48ada3c81b2033'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:02.490736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a2f42aea-d480-47dd-a87f-2d433c51aba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6b9451d958143bb8a48ada3c81b2033'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:02.512582 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:02.514785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a2f42aea-d480-47dd-a87f-2d433c51aba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6b9451d958143bb8a48ada3c81b2033'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:02.525916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a2f42aea-d480-47dd-a87f-2d433c51aba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6b9451d958143bb8a48ada3c81b2033'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:02.534417 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2212/4437] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:01:02 2022] DELETE /identity/v3/users/d6b9451d958143bb8a48ada3c81b2033 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:02.539412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d485b-37c8-400a-8d85-2ac7d1df4e32 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:02.539906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d485b-37c8-400a-8d85-2ac7d1df4e32 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:02.540432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d485b-37c8-400a-8d85-2ac7d1df4e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:02.563233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ea8d485b-37c8-400a-8d85-2ac7d1df4e32 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:02.565345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ea8d485b-37c8-400a-8d85-2ac7d1df4e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:02.609288 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:02.645829 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2226/4438] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:01:02.677062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f42aea-d480-47dd-a87f-2d433c51aba3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:02.679159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a2f42aea-d480-47dd-a87f-2d433c51aba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:02.765956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f42aea-d480-47dd-a87f-2d433c51aba3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:02.770438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df0de4-a248-49d4-bfae-1d4d4f781849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:02.771197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df0de4-a248-49d4-bfae-1d4d4f781849 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:02.771561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df0de4-a248-49d4-bfae-1d4d4f781849 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:02.771922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df0de4-a248-49d4-bfae-1d4d4f781849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:02.783328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df0de4-a248-49d4-bfae-1d4d4f781849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:02.785238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df0de4-a248-49d4-bfae-1d4d4f781849 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:02.811054 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2213/4439] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:01:03.524520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d485b-37c8-400a-8d85-2ac7d1df4e32 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:03.526104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ea8d485b-37c8-400a-8d85-2ac7d1df4e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:03.544914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d485b-37c8-400a-8d85-2ac7d1df4e32 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:03.559931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d552c4-a3e9-415e-94e4-68a7e58b2223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:03.560487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d552c4-a3e9-415e-94e4-68a7e58b2223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:03.560800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d552c4-a3e9-415e-94e4-68a7e58b2223 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:03.561286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d552c4-a3e9-415e-94e4-68a7e58b2223 admin admin] PATH_INFO: `/v3/projects/e1c6e4bbf4ae4830982b70a10f2d6dd1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:03.562509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d552c4-a3e9-415e-94e4-68a7e58b2223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1c6e4bbf4ae4830982b70a10f2d6dd1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:03.564559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d552c4-a3e9-415e-94e4-68a7e58b2223 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:03.631526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f8d552c4-a3e9-415e-94e4-68a7e58b2223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1c6e4bbf4ae4830982b70a10f2d6dd1', 'request_id': 'req-f8d552c4-a3e9-415e-94e4-68a7e58b2223'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:03.639956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f8d552c4-a3e9-415e-94e4-68a7e58b2223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1c6e4bbf4ae4830982b70a10f2d6dd1', 'request_id': 'req-f8d552c4-a3e9-415e-94e4-68a7e58b2223'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:03.647906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f8d552c4-a3e9-415e-94e4-68a7e58b2223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1c6e4bbf4ae4830982b70a10f2d6dd1', 'request_id': 'req-f8d552c4-a3e9-415e-94e4-68a7e58b2223'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:03.663395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f8d552c4-a3e9-415e-94e4-68a7e58b2223 admin admin] The token cache is being invalidate because project e1c6e4bbf4ae4830982b70a10f2d6dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:01:03.663894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f8d552c4-a3e9-415e-94e4-68a7e58b2223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:03.665097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f8d552c4-a3e9-415e-94e4-68a7e58b2223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:03.669490 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2227/4440] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:01:03 2022] DELETE /identity/v3/projects/e1c6e4bbf4ae4830982b70a10f2d6dd1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:03.672354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df0de4-a248-49d4-bfae-1d4d4f781849 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:03.686772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df0de4-a248-49d4-bfae-1d4d4f781849 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:03.758778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6eabb-4af1-4957-8ac3-5c43bfe07c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:03.760192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6eabb-4af1-4957-8ac3-5c43bfe07c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:03.760823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6eabb-4af1-4957-8ac3-5c43bfe07c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:03.761225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6eabb-4af1-4957-8ac3-5c43bfe07c07 admin admin] PATH_INFO: `/v3/users/063787bc7ba94a9bad0fa7f4ea2d63f6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:03.762839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb6eabb-4af1-4957-8ac3-5c43bfe07c07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=063787bc7ba94a9bad0fa7f4ea2d63f6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:03.764560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb6eabb-4af1-4957-8ac3-5c43bfe07c07 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:03.828315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4cb6eabb-4af1-4957-8ac3-5c43bfe07c07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063787bc7ba94a9bad0fa7f4ea2d63f6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:03.838728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4cb6eabb-4af1-4957-8ac3-5c43bfe07c07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063787bc7ba94a9bad0fa7f4ea2d63f6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:03.839825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4cb6eabb-4af1-4957-8ac3-5c43bfe07c07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063787bc7ba94a9bad0fa7f4ea2d63f6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:03.858790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4cb6eabb-4af1-4957-8ac3-5c43bfe07c07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063787bc7ba94a9bad0fa7f4ea2d63f6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:03.871368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4cb6eabb-4af1-4957-8ac3-5c43bfe07c07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063787bc7ba94a9bad0fa7f4ea2d63f6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:03.873586 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:03.888771 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2214/4441] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:01:03 2022] DELETE /identity/v3/users/063787bc7ba94a9bad0fa7f4ea2d63f6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:03.906219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123f78f-8e84-4ab1-b182-2ad4c2dbd1c7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:03.906681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123f78f-8e84-4ab1-b182-2ad4c2dbd1c7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:03.906880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123f78f-8e84-4ab1-b182-2ad4c2dbd1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:03.953307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8123f78f-8e84-4ab1-b182-2ad4c2dbd1c7 None None] MFA Rules not processed for user `8bb9a3b41bbc4a11a1e50fb2f5de5c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:03.955124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8123f78f-8e84-4ab1-b182-2ad4c2dbd1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:04.024812 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2228/4442] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:01:05.156951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6eabb-4af1-4957-8ac3-5c43bfe07c07 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:05.159231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4cb6eabb-4af1-4957-8ac3-5c43bfe07c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:05.294504 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6eabb-4af1-4957-8ac3-5c43bfe07c07 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:05.303245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72dc390-bd4b-4203-a24b-dd3cf00aab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:05.303581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dc390-bd4b-4203-a24b-dd3cf00aab31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:05.303966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dc390-bd4b-4203-a24b-dd3cf00aab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:05.304506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dc390-bd4b-4203-a24b-dd3cf00aab31 admin admin] PATH_INFO: `/v3/projects/7ea42bc2843f4e1399b3f41567557db1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:05.306185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72dc390-bd4b-4203-a24b-dd3cf00aab31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ea42bc2843f4e1399b3f41567557db1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:05.308419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72dc390-bd4b-4203-a24b-dd3cf00aab31 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:05.381824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e72dc390-bd4b-4203-a24b-dd3cf00aab31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ea42bc2843f4e1399b3f41567557db1', 'request_id': 'req-e72dc390-bd4b-4203-a24b-dd3cf00aab31'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:05.391658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e72dc390-bd4b-4203-a24b-dd3cf00aab31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ea42bc2843f4e1399b3f41567557db1', 'request_id': 'req-e72dc390-bd4b-4203-a24b-dd3cf00aab31'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:05.400220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e72dc390-bd4b-4203-a24b-dd3cf00aab31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ea42bc2843f4e1399b3f41567557db1', 'request_id': 'req-e72dc390-bd4b-4203-a24b-dd3cf00aab31'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:05.414620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e72dc390-bd4b-4203-a24b-dd3cf00aab31 admin admin] The token cache is being invalidate because project 7ea42bc2843f4e1399b3f41567557db1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:01:05.415240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e72dc390-bd4b-4203-a24b-dd3cf00aab31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:05.418708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e72dc390-bd4b-4203-a24b-dd3cf00aab31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:05.424007 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2215/4443] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:01:05 2022] DELETE /identity/v3/projects/7ea42bc2843f4e1399b3f41567557db1 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:05.428980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc1e82-134a-400a-b112-2d087ddb9307 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:05.429834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc1e82-134a-400a-b112-2d087ddb9307 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:05.430288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc1e82-134a-400a-b112-2d087ddb9307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:05.482337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-30fc1e82-134a-400a-b112-2d087ddb9307 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:05.486910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-30fc1e82-134a-400a-b112-2d087ddb9307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:05.605440 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2229/4444] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:05.610378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe9ca1-585b-4700-9a1c-ae80d7b1d56c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:05.610692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe9ca1-585b-4700-9a1c-ae80d7b1d56c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:05.610971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe9ca1-585b-4700-9a1c-ae80d7b1d56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:05.664049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-68fe9ca1-585b-4700-9a1c-ae80d7b1d56c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:05.669318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-68fe9ca1-585b-4700-9a1c-ae80d7b1d56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:05.689613 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2216/4445] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:05.691690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc1e82-134a-400a-b112-2d087ddb9307 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:05.708568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc1e82-134a-400a-b112-2d087ddb9307 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:05.726226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130f567-95ff-4c5e-b4ce-918dbacb9888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:05.726869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130f567-95ff-4c5e-b4ce-918dbacb9888 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:05.727149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130f567-95ff-4c5e-b4ce-918dbacb9888 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:05.727592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130f567-95ff-4c5e-b4ce-918dbacb9888 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:05.728396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130f567-95ff-4c5e-b4ce-918dbacb9888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:01:05.728881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130f567-95ff-4c5e-b4ce-918dbacb9888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:05.730641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130f567-95ff-4c5e-b4ce-918dbacb9888 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:05.734675 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:05.760010 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2230/4446] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:01:05.761492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe9ca1-585b-4700-9a1c-ae80d7b1d56c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:05.777222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe9ca1-585b-4700-9a1c-ae80d7b1d56c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:05.787777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef6551-73a3-4996-b546-8b8ca257ce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:05.788549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef6551-73a3-4996-b546-8b8ca257ce57 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:05.788899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef6551-73a3-4996-b546-8b8ca257ce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:05.789271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef6551-73a3-4996-b546-8b8ca257ce57 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:05.792455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef6551-73a3-4996-b546-8b8ca257ce57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:05.794543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef6551-73a3-4996-b546-8b8ca257ce57 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:05.870274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130f567-95ff-4c5e-b4ce-918dbacb9888 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:05.885437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130f567-95ff-4c5e-b4ce-918dbacb9888 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:05.888723 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2217/4447] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:01:05 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:06.009835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e2755-4e3b-4f3c-b7f5-787940e06b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:06.011140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e2755-4e3b-4f3c-b7f5-787940e06b76 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:06.011490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e2755-4e3b-4f3c-b7f5-787940e06b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:06.011686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e2755-4e3b-4f3c-b7f5-787940e06b76 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:06.012337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e2755-4e3b-4f3c-b7f5-787940e06b76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:06.014469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e2755-4e3b-4f3c-b7f5-787940e06b76 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:06.060498 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2231/4448] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:01:05 2022] POST /identity/v3/users => generated 285 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:01:06.061780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef6551-73a3-4996-b546-8b8ca257ce57 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:06.078178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef6551-73a3-4996-b546-8b8ca257ce57 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:06.087632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8392787-17a3-4699-a956-4dee918215ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:06.088498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8392787-17a3-4699-a956-4dee918215ec admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:06.088889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8392787-17a3-4699-a956-4dee918215ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:06.095595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8392787-17a3-4699-a956-4dee918215ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:06.098659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8392787-17a3-4699-a956-4dee918215ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:06.100451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8392787-17a3-4699-a956-4dee918215ec admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:06.141612 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2218/4449] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:06.146716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e2755-4e3b-4f3c-b7f5-787940e06b76 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:06.175434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e2755-4e3b-4f3c-b7f5-787940e06b76 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:06.183153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd81ccd-aed8-4a91-ad19-75e895353e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:06.184030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd81ccd-aed8-4a91-ad19-75e895353e3a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:06.184467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd81ccd-aed8-4a91-ad19-75e895353e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:06.185452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd81ccd-aed8-4a91-ad19-75e895353e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:06.186688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd81ccd-aed8-4a91-ad19-75e895353e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:06.188486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd81ccd-aed8-4a91-ad19-75e895353e3a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:06.219932 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2232/4450] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:06.223780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8392787-17a3-4699-a956-4dee918215ec admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:06.237532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8392787-17a3-4699-a956-4dee918215ec admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:06.243742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15b47b-a1b1-4cd2-9b7b-11959677cc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:06.244410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15b47b-a1b1-4cd2-9b7b-11959677cc77 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:06.244712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15b47b-a1b1-4cd2-9b7b-11959677cc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:06.244984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15b47b-a1b1-4cd2-9b7b-11959677cc77 admin admin] PATH_INFO: `/v3/projects/8f17de3e7bdc403a8ad5aac13f3c2a0f/users/5cf3fb53836745bc991c2df845e8b310/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:06.267562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15b47b-a1b1-4cd2-9b7b-11959677cc77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f17de3e7bdc403a8ad5aac13f3c2a0f, user_id=5cf3fb53836745bc991c2df845e8b310, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:06.272810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15b47b-a1b1-4cd2-9b7b-11959677cc77 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:06.293849 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2219/4451] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:01:06 2022] PUT /identity/v3/projects/8f17de3e7bdc403a8ad5aac13f3c2a0f/users/5cf3fb53836745bc991c2df845e8b310/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:06.310963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a63e29-d64d-4f8e-8a74-64838037aeb3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:06.311191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a63e29-d64d-4f8e-8a74-64838037aeb3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:06.311768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a63e29-d64d-4f8e-8a74-64838037aeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:06.401938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-14a63e29-d64d-4f8e-8a74-64838037aeb3 None None] MFA Rules not processed for user `5cf3fb53836745bc991c2df845e8b310`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:06.403169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-14a63e29-d64d-4f8e-8a74-64838037aeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:06.507363 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2233/4452] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:06.512090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15b47b-a1b1-4cd2-9b7b-11959677cc77 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:06.528367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a63e29-d64d-4f8e-8a74-64838037aeb3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:06.529871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-14a63e29-d64d-4f8e-8a74-64838037aeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:06.554469 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:06.604876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15b47b-a1b1-4cd2-9b7b-11959677cc77 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:06.610711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde2272-237a-49a8-a93c-44830e8a655a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:06.613354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde2272-237a-49a8-a93c-44830e8a655a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:06.613645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde2272-237a-49a8-a93c-44830e8a655a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:06.613921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde2272-237a-49a8-a93c-44830e8a655a admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:06.614572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde2272-237a-49a8-a93c-44830e8a655a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:06.616726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde2272-237a-49a8-a93c-44830e8a655a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:06.625657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a63e29-d64d-4f8e-8a74-64838037aeb3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:06.633001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc7a87-76b3-4679-88eb-e55a1facbdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:06.634177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc7a87-76b3-4679-88eb-e55a1facbdd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:06.634459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc7a87-76b3-4679-88eb-e55a1facbdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:06.634732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc7a87-76b3-4679-88eb-e55a1facbdd8 admin admin] PATH_INFO: `/v3/users/d349ef435fd340dab632a1a0bf184c01` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:06.635950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc7a87-76b3-4679-88eb-e55a1facbdd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d349ef435fd340dab632a1a0bf184c01)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:06.639249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc7a87-76b3-4679-88eb-e55a1facbdd8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:06.642747 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:06.647136 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2220/4453] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:01:06 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:01:06.651222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde2272-237a-49a8-a93c-44830e8a655a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:06.707331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-42bc7a87-76b3-4679-88eb-e55a1facbdd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd349ef435fd340dab632a1a0bf184c01'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:06.708308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-42bc7a87-76b3-4679-88eb-e55a1facbdd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd349ef435fd340dab632a1a0bf184c01'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:06.716123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-42bc7a87-76b3-4679-88eb-e55a1facbdd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd349ef435fd340dab632a1a0bf184c01'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:06.729240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde2272-237a-49a8-a93c-44830e8a655a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:06.731371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-42bc7a87-76b3-4679-88eb-e55a1facbdd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd349ef435fd340dab632a1a0bf184c01'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:06.737861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fd6fa-5298-4965-a17e-748eb4381f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:06.738486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fd6fa-5298-4965-a17e-748eb4381f48 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:06.738760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fd6fa-5298-4965-a17e-748eb4381f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:06.739030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fd6fa-5298-4965-a17e-748eb4381f48 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:06.739664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fd6fa-5298-4965-a17e-748eb4381f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:06.741592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fd6fa-5298-4965-a17e-748eb4381f48 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:06.745015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-42bc7a87-76b3-4679-88eb-e55a1facbdd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd349ef435fd340dab632a1a0bf184c01'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:06.757075 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2234/4454] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:01:06 2022] DELETE /identity/v3/users/d349ef435fd340dab632a1a0bf184c01 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:06.758733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0a9e4-0755-46fc-a434-761767fedf30 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:06.759132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0a9e4-0755-46fc-a434-761767fedf30 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:06.759534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0a9e4-0755-46fc-a434-761767fedf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:06.770081 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2221/4455] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:01:06 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:01:06.773823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fd6fa-5298-4965-a17e-748eb4381f48 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:06.775667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0c1fd6fa-5298-4965-a17e-748eb4381f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:06.787514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-eff0a9e4-0755-46fc-a434-761767fedf30 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:06.789486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eff0a9e4-0755-46fc-a434-761767fedf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:06.790763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fd6fa-5298-4965-a17e-748eb4381f48 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:06.860361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d3d9a-c649-44ff-81d3-28ad3388e7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:06.862426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d3d9a-c649-44ff-81d3-28ad3388e7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:06.862818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d3d9a-c649-44ff-81d3-28ad3388e7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:06.863476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d3d9a-c649-44ff-81d3-28ad3388e7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:06.864306 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2235/4456] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:06.868358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d3d9a-c649-44ff-81d3-28ad3388e7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:06.870066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d3d9a-c649-44ff-81d3-28ad3388e7b5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:06.875353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0a9e4-0755-46fc-a434-761767fedf30 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:06.876967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eff0a9e4-0755-46fc-a434-761767fedf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:06.886176 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2222/4457] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:06.888287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d3d9a-c649-44ff-81d3-28ad3388e7b5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:06.902265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d3d9a-c649-44ff-81d3-28ad3388e7b5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:06.907406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e1ebe-7118-4adb-bce6-fa17e4c91767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:06.908069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e1ebe-7118-4adb-bce6-fa17e4c91767 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:06.908347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e1ebe-7118-4adb-bce6-fa17e4c91767 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:06.908681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e1ebe-7118-4adb-bce6-fa17e4c91767 admin admin] PATH_INFO: `/v3/projects/c53c51f58b15409898aee6d937a22eac/users/0cbaad4ea14e42529c2f79adf9cd295b/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:06.933989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e1ebe-7118-4adb-bce6-fa17e4c91767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c53c51f58b15409898aee6d937a22eac, user_id=0cbaad4ea14e42529c2f79adf9cd295b, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:06.937679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e1ebe-7118-4adb-bce6-fa17e4c91767 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:06.961142 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2223/4458] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:01:06 2022] PUT /identity/v3/projects/c53c51f58b15409898aee6d937a22eac/users/0cbaad4ea14e42529c2f79adf9cd295b/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:06.962440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e1ebe-7118-4adb-bce6-fa17e4c91767 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:06.966534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0a9e4-0755-46fc-a434-761767fedf30 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:06.980064 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:07.020782 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:07.047697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb380ef4-c8fb-430a-93a4-5bc0ace22df1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:07.048415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb380ef4-c8fb-430a-93a4-5bc0ace22df1 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:07.048721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb380ef4-c8fb-430a-93a4-5bc0ace22df1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:07.048995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb380ef4-c8fb-430a-93a4-5bc0ace22df1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:07.056321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e1ebe-7118-4adb-bce6-fa17e4c91767 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:07.060053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb380ef4-c8fb-430a-93a4-5bc0ace22df1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:07.061878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb380ef4-c8fb-430a-93a4-5bc0ace22df1 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:07.062949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619cd7a-94f1-44b1-8785-ef4e0443ab2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:07.064145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619cd7a-94f1-44b1-8785-ef4e0443ab2a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:07.064508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619cd7a-94f1-44b1-8785-ef4e0443ab2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:07.065612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619cd7a-94f1-44b1-8785-ef4e0443ab2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:07.066450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619cd7a-94f1-44b1-8785-ef4e0443ab2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:07.072320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619cd7a-94f1-44b1-8785-ef4e0443ab2a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:07.074984 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2236/4459] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:01:07.096697 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2224/4460] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:07.098032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb380ef4-c8fb-430a-93a4-5bc0ace22df1 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:07.108174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb380ef4-c8fb-430a-93a4-5bc0ace22df1 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:07.115946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa59a5-d070-4b91-a2b9-4ca8d6e794db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:07.117961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa59a5-d070-4b91-a2b9-4ca8d6e794db admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:07.117961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa59a5-d070-4b91-a2b9-4ca8d6e794db admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:07.117961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa59a5-d070-4b91-a2b9-4ca8d6e794db admin admin] PATH_INFO: `/v3/projects/c53c51f58b15409898aee6d937a22eac/users/0cbaad4ea14e42529c2f79adf9cd295b/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:07.122580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa59a5-d070-4b91-a2b9-4ca8d6e794db admin admin] RBAC: Authorizing `identity:create_grant(project_id=c53c51f58b15409898aee6d937a22eac, user_id=0cbaad4ea14e42529c2f79adf9cd295b, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:07.125952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa59a5-d070-4b91-a2b9-4ca8d6e794db admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:07.149353 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2237/4461] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:01:07 2022] PUT /identity/v3/projects/c53c51f58b15409898aee6d937a22eac/users/0cbaad4ea14e42529c2f79adf9cd295b/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:07.159867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2362880-dcfd-4e8b-9437-c76757c3db7a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:07.160152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2362880-dcfd-4e8b-9437-c76757c3db7a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:07.160412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2362880-dcfd-4e8b-9437-c76757c3db7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:07.191287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e2362880-dcfd-4e8b-9437-c76757c3db7a None None] MFA Rules not processed for user `0cbaad4ea14e42529c2f79adf9cd295b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:07.192519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e2362880-dcfd-4e8b-9437-c76757c3db7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:07.281576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa59a5-d070-4b91-a2b9-4ca8d6e794db admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:07.283391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-69fa59a5-d070-4b91-a2b9-4ca8d6e794db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:07.302755 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2225/4462] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:07.307271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2362880-dcfd-4e8b-9437-c76757c3db7a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:07.317855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2362880-dcfd-4e8b-9437-c76757c3db7a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:07.323812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b892139-08d0-4f18-99f3-505ce11309f6 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbaad4ea14e42529c2f79adf9cd295b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c53c51f58b15409898aee6d937a22eac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:07.324503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b892139-08d0-4f18-99f3-505ce11309f6 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:07.325019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b892139-08d0-4f18-99f3-505ce11309f6 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:07.325365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b892139-08d0-4f18-99f3-505ce11309f6 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:07.326301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b892139-08d0-4f18-99f3-505ce11309f6 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:07.328794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b892139-08d0-4f18-99f3-505ce11309f6 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:07.373233 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2226/4463] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:01:07 2022] POST /identity/v3/projects => generated 358 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:07.379072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b892139-08d0-4f18-99f3-505ce11309f6 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:07.409232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa59a5-d070-4b91-a2b9-4ca8d6e794db admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:07.465381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b892139-08d0-4f18-99f3-505ce11309f6 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:07.472614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099a788-5eb8-431b-a41e-b726f258235e tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbaad4ea14e42529c2f79adf9cd295b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c53c51f58b15409898aee6d937a22eac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:07.473269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099a788-5eb8-431b-a41e-b726f258235e tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:07.473547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099a788-5eb8-431b-a41e-b726f258235e tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:07.473814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099a788-5eb8-431b-a41e-b726f258235e tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:07.474452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099a788-5eb8-431b-a41e-b726f258235e tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:07.477029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099a788-5eb8-431b-a41e-b726f258235e tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:07.484640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f5517-60bc-4f31-8ae3-d8a4a6f8d26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:07.485260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f5517-60bc-4f31-8ae3-d8a4a6f8d26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:07.485541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f5517-60bc-4f31-8ae3-d8a4a6f8d26d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:07.485815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f5517-60bc-4f31-8ae3-d8a4a6f8d26d admin admin] PATH_INFO: `/v3/projects/c2c4a5b727104217b6a80a51c51af579` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:07.487701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f5517-60bc-4f31-8ae3-d8a4a6f8d26d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2c4a5b727104217b6a80a51c51af579)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:07.489826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f5517-60bc-4f31-8ae3-d8a4a6f8d26d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:07.503226 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:07.512876 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2227/4464] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:01:07 2022] POST /identity/v3/users => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:07.514301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099a788-5eb8-431b-a41e-b726f258235e tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:07.528981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099a788-5eb8-431b-a41e-b726f258235e tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:07.535626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e69ff-098d-4261-9b3c-fdf356440b85 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbaad4ea14e42529c2f79adf9cd295b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c53c51f58b15409898aee6d937a22eac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:07.536326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e69ff-098d-4261-9b3c-fdf356440b85 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:07.536721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e69ff-098d-4261-9b3c-fdf356440b85 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:07.537058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e69ff-098d-4261-9b3c-fdf356440b85 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:07.537829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e69ff-098d-4261-9b3c-fdf356440b85 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:01:07.538195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e69ff-098d-4261-9b3c-fdf356440b85 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:07.540408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e69ff-098d-4261-9b3c-fdf356440b85 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:07.552902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-770f5517-60bc-4f31-8ae3-d8a4a6f8d26d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2c4a5b727104217b6a80a51c51af579', 'request_id': 'req-770f5517-60bc-4f31-8ae3-d8a4a6f8d26d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:07.562854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-770f5517-60bc-4f31-8ae3-d8a4a6f8d26d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2c4a5b727104217b6a80a51c51af579', 'request_id': 'req-770f5517-60bc-4f31-8ae3-d8a4a6f8d26d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:07.571181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-770f5517-60bc-4f31-8ae3-d8a4a6f8d26d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2c4a5b727104217b6a80a51c51af579', 'request_id': 'req-770f5517-60bc-4f31-8ae3-d8a4a6f8d26d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:07.587333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-770f5517-60bc-4f31-8ae3-d8a4a6f8d26d admin admin] The token cache is being invalidate because project c2c4a5b727104217b6a80a51c51af579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:01:07.587889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-770f5517-60bc-4f31-8ae3-d8a4a6f8d26d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:07.589018 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2228/4465] 10.222.0.16 () {58 vars in 1157 bytes} [Fri Sep 30 10:01:07 2022] GET /identity/v3/users?domain_id=default => generated 7731 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:01:07.589248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-770f5517-60bc-4f31-8ae3-d8a4a6f8d26d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:07.593254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e69ff-098d-4261-9b3c-fdf356440b85 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:07.593691 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2238/4466] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:01:07 2022] DELETE /identity/v3/projects/c2c4a5b727104217b6a80a51c51af579 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:07.595298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-501e69ff-098d-4261-9b3c-fdf356440b85 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:07.599006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d02db-2334-4a47-b8be-a8147705cc48 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:07.599288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d02db-2334-4a47-b8be-a8147705cc48 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:07.599566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d02db-2334-4a47-b8be-a8147705cc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:07.609405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e69ff-098d-4261-9b3c-fdf356440b85 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:07.615347 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:07.644529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-656d02db-2334-4a47-b8be-a8147705cc48 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:07.645829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-656d02db-2334-4a47-b8be-a8147705cc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:07.673618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b295f2c-8258-41d3-84c3-fb6f2f9c558f tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbaad4ea14e42529c2f79adf9cd295b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c53c51f58b15409898aee6d937a22eac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:07.674335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b295f2c-8258-41d3-84c3-fb6f2f9c558f tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:07.674996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b295f2c-8258-41d3-84c3-fb6f2f9c558f tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:07.674996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b295f2c-8258-41d3-84c3-fb6f2f9c558f tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] PATH_INFO: `/v3/users/d60c87e0865544639d808aa8ac725107` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:07.689665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b295f2c-8258-41d3-84c3-fb6f2f9c558f tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] RBAC: Authorizing `identity:update_user(user_id=d60c87e0865544639d808aa8ac725107)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:07.691647 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-3b295f2c-8258-41d3-84c3-fb6f2f9c558f tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:01:07.691647 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:01:07.691647 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:01:07.692916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b295f2c-8258-41d3-84c3-fb6f2f9c558f tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:07.734660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3b295f2c-8258-41d3-84c3-fb6f2f9c558f tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd60c87e0865544639d808aa8ac725107'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:07.748305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3b295f2c-8258-41d3-84c3-fb6f2f9c558f tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Invalidating the token cache because user d60c87e0865544639d808aa8ac725107 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:01:07.748884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3b295f2c-8258-41d3-84c3-fb6f2f9c558f tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:07.750027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3b295f2c-8258-41d3-84c3-fb6f2f9c558f tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:07.758308 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2229/4467] 10.222.0.16 () {60 vars in 1244 bytes} [Fri Sep 30 10:01:07 2022] PATCH /identity/v3/users/d60c87e0865544639d808aa8ac725107 => generated 485 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:01:07.759727 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2239/4468] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:01:07.760260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12891c0c-284b-4060-bd59-8801d00b5eca None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:07.760914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12891c0c-284b-4060-bd59-8801d00b5eca None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:07.761304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93e5e4-e5cf-48de-b7a9-c050b3365e40 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:07.761422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12891c0c-284b-4060-bd59-8801d00b5eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:07.761600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93e5e4-e5cf-48de-b7a9-c050b3365e40 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:07.761875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93e5e4-e5cf-48de-b7a9-c050b3365e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:07.786320 n-d-master-1 devstack@keystone.service[82080]: WARNING keystone.auth.plugins.core [None req-12891c0c-284b-4060-bd59-8801d00b5eca None None] User is disabled: d60c87e0865544639d808aa8ac725107: AssertionError: User is disabled: d60c87e0865544639d808aa8ac725107 Sep 30 10:01:07.787344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7d93e5e4-e5cf-48de-b7a9-c050b3365e40 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:07.788576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7d93e5e4-e5cf-48de-b7a9-c050b3365e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:07.798259 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2240/4469] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:07.799023 n-d-master-1 devstack@keystone.service[82080]: WARNING keystone.server.flask.application [None req-12891c0c-284b-4060-bd59-8801d00b5eca None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 30 10:01:07.801174 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2230/4470] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:07 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 42 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Sep 30 10:01:07.803247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93e5e4-e5cf-48de-b7a9-c050b3365e40 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:07.805085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12891c0c-284b-4060-bd59-8801d00b5eca None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:07.807286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-12891c0c-284b-4060-bd59-8801d00b5eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:07.815277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93e5e4-e5cf-48de-b7a9-c050b3365e40 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:07.822825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808a547-47ad-4b5c-8e4a-1928084a8c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:07.823717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808a547-47ad-4b5c-8e4a-1928084a8c6d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:07.824021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808a547-47ad-4b5c-8e4a-1928084a8c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:07.824258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808a547-47ad-4b5c-8e4a-1928084a8c6d admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:07.825071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808a547-47ad-4b5c-8e4a-1928084a8c6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:01:07.825341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808a547-47ad-4b5c-8e4a-1928084a8c6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:07.827009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808a547-47ad-4b5c-8e4a-1928084a8c6d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:07.830214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12891c0c-284b-4060-bd59-8801d00b5eca None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:07.839005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1ae03-444b-4585-ba95-cb94361932a1 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbaad4ea14e42529c2f79adf9cd295b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c53c51f58b15409898aee6d937a22eac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:07.839721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1ae03-444b-4585-ba95-cb94361932a1 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:07.840007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1ae03-444b-4585-ba95-cb94361932a1 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:07.840282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1ae03-444b-4585-ba95-cb94361932a1 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] PATH_INFO: `/v3/users/d60c87e0865544639d808aa8ac725107` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:07.856214 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2241/4471] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:01:07.862967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808a547-47ad-4b5c-8e4a-1928084a8c6d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:07.882626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1ae03-444b-4585-ba95-cb94361932a1 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d60c87e0865544639d808aa8ac725107)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:07.884777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1ae03-444b-4585-ba95-cb94361932a1 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:07.893567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808a547-47ad-4b5c-8e4a-1928084a8c6d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:07.906205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc5b94-3bbe-4f7a-9a22-a295f7020e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:07.906822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc5b94-3bbe-4f7a-9a22-a295f7020e69 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:07.907154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc5b94-3bbe-4f7a-9a22-a295f7020e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:07.907363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc5b94-3bbe-4f7a-9a22-a295f7020e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:07.907991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc5b94-3bbe-4f7a-9a22-a295f7020e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:07.909964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc5b94-3bbe-4f7a-9a22-a295f7020e69 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:07.962677 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2242/4472] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:01:07 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:07.967094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc5b94-3bbe-4f7a-9a22-a295f7020e69 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:07.972221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ace1ae03-444b-4585-ba95-cb94361932a1 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd60c87e0865544639d808aa8ac725107'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:07.983352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ace1ae03-444b-4585-ba95-cb94361932a1 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd60c87e0865544639d808aa8ac725107'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:07.984263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ace1ae03-444b-4585-ba95-cb94361932a1 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd60c87e0865544639d808aa8ac725107'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:08.000572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ace1ae03-444b-4585-ba95-cb94361932a1 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd60c87e0865544639d808aa8ac725107'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:08.010844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ace1ae03-444b-4585-ba95-cb94361932a1 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd60c87e0865544639d808aa8ac725107'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:08.017607 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2231/4473] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:01:07 2022] DELETE /identity/v3/users/d60c87e0865544639d808aa8ac725107 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:01:08.023308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1ae03-444b-4585-ba95-cb94361932a1 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:08.025502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ace1ae03-444b-4585-ba95-cb94361932a1 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:08.057593 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:08.061732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc5b94-3bbe-4f7a-9a22-a295f7020e69 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:08.136749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1ae03-444b-4585-ba95-cb94361932a1 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:08.141859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094cb17-6dbf-4913-b8fa-65e9cbfcc757 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbaad4ea14e42529c2f79adf9cd295b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c53c51f58b15409898aee6d937a22eac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:08.142487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094cb17-6dbf-4913-b8fa-65e9cbfcc757 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:08.144266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094cb17-6dbf-4913-b8fa-65e9cbfcc757 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:08.144477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094cb17-6dbf-4913-b8fa-65e9cbfcc757 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] PATH_INFO: `/v3/projects/22c6d66df5ef48b78ffacec610bce481` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:08.145602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa37f7-5cf0-4e47-96d4-d74f5b8bcdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:08.146367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094cb17-6dbf-4913-b8fa-65e9cbfcc757 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] RBAC: Authorizing `identity:delete_project(project_id=22c6d66df5ef48b78ffacec610bce481)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:08.148796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa37f7-5cf0-4e47-96d4-d74f5b8bcdaa admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:08.149266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa37f7-5cf0-4e47-96d4-d74f5b8bcdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:08.150754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094cb17-6dbf-4913-b8fa-65e9cbfcc757 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:08.151161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa37f7-5cf0-4e47-96d4-d74f5b8bcdaa admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:08.152478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa37f7-5cf0-4e47-96d4-d74f5b8bcdaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:08.162179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa37f7-5cf0-4e47-96d4-d74f5b8bcdaa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:08.182325 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:08.190089 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2243/4474] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:01:07 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:01:08.202197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa37f7-5cf0-4e47-96d4-d74f5b8bcdaa admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:08.205812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3dfa37f7-5cf0-4e47-96d4-d74f5b8bcdaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:08.224382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa37f7-5cf0-4e47-96d4-d74f5b8bcdaa admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:08.231604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1094cb17-6dbf-4913-b8fa-65e9cbfcc757 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c6d66df5ef48b78ffacec610bce481', 'request_id': 'req-1094cb17-6dbf-4913-b8fa-65e9cbfcc757'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:08.241981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1094cb17-6dbf-4913-b8fa-65e9cbfcc757 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c6d66df5ef48b78ffacec610bce481', 'request_id': 'req-1094cb17-6dbf-4913-b8fa-65e9cbfcc757'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:08.251514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1094cb17-6dbf-4913-b8fa-65e9cbfcc757 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c6d66df5ef48b78ffacec610bce481', 'request_id': 'req-1094cb17-6dbf-4913-b8fa-65e9cbfcc757'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:08.274042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1094cb17-6dbf-4913-b8fa-65e9cbfcc757 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] The token cache is being invalidate because project 22c6d66df5ef48b78ffacec610bce481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:01:08.274414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1094cb17-6dbf-4913-b8fa-65e9cbfcc757 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:08.275393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1094cb17-6dbf-4913-b8fa-65e9cbfcc757 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:08.280655 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2232/4475] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:01:08 2022] DELETE /identity/v3/projects/22c6d66df5ef48b78ffacec610bce481 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:01:08.282846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094cb17-6dbf-4913-b8fa-65e9cbfcc757 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:08.285181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1094cb17-6dbf-4913-b8fa-65e9cbfcc757 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:08.312923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32300d12-8649-4e4e-ad79-11c2081ac1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:08.313672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32300d12-8649-4e4e-ad79-11c2081ac1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:08.313964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32300d12-8649-4e4e-ad79-11c2081ac1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:08.314240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32300d12-8649-4e4e-ad79-11c2081ac1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:08.314923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32300d12-8649-4e4e-ad79-11c2081ac1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:08.317120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32300d12-8649-4e4e-ad79-11c2081ac1d6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:08.328902 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2244/4476] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:08.333969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32300d12-8649-4e4e-ad79-11c2081ac1d6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:08.336252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-32300d12-8649-4e4e-ad79-11c2081ac1d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:08.351782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32300d12-8649-4e4e-ad79-11c2081ac1d6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:08.357778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cda97-0647-4aac-891b-07e981e2fbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:08.358395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cda97-0647-4aac-891b-07e981e2fbfd admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:08.358676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cda97-0647-4aac-891b-07e981e2fbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:08.358948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cda97-0647-4aac-891b-07e981e2fbfd admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:08.359588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cda97-0647-4aac-891b-07e981e2fbfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:08.361193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cda97-0647-4aac-891b-07e981e2fbfd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:08.372359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094cb17-6dbf-4913-b8fa-65e9cbfcc757 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:08.377748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b1d15-4641-40e4-959d-c5397af0d7f8 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbaad4ea14e42529c2f79adf9cd295b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c53c51f58b15409898aee6d937a22eac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:08.378388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b1d15-4641-40e4-959d-c5397af0d7f8 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:08.378772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b1d15-4641-40e4-959d-c5397af0d7f8 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:08.379046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b1d15-4641-40e4-959d-c5397af0d7f8 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:08.379689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b1d15-4641-40e4-959d-c5397af0d7f8 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:08.381629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b1d15-4641-40e4-959d-c5397af0d7f8 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:08.383252 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2245/4477] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:08.387717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cda97-0647-4aac-891b-07e981e2fbfd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:08.399633 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-ac8b1d15-4641-40e4-959d-c5397af0d7f8 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Could not find domain: e2933e736e094454952fbe3f37058bf7.: keystone.exception.DomainNotFound: Could not find domain: e2933e736e094454952fbe3f37058bf7. Sep 30 10:01:08.399633 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:01:08.399633 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 30 10:01:08.399633 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 30 10:01:08.399633 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 10:01:08.399633 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 10:01:08.399633 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 10:01:08.399633 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 10:01:08.399633 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e2933e736e094454952fbe3f37058bf7. Sep 30 10:01:08.399633 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:01:08.399633 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:01:08.399633 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:01:08.399633 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:01:08.399633 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:01:08.399633 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:01:08.399633 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:01:08.400667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:01:08.400667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:01:08.400667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:01:08.400667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:01:08.400667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:01:08.400667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:01:08.400667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:01:08.400667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 30 10:01:08.400667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 30 10:01:08.400667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:01:08.400667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:01:08.400667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 10:01:08.400667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 10:01:08.400667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 10:01:08.400667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 10:01:08.400667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Sep 30 10:01:08.400667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Sep 30 10:01:08.402139 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:01:08.402139 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:01:08.402139 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:01:08.402139 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:01:08.402139 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:01:08.402139 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:01:08.402139 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:01:08.402139 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 10:01:08.402139 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:01:08.402139 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:01:08.402139 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:01:08.402139 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:01:08.402139 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:01:08.402139 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:01:08.402139 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:01:08.402139 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:01:08.402139 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 30 10:01:08.405033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 10:01:08.405033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e2933e736e094454952fbe3f37058bf7. Sep 30 10:01:08.405033 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:01:08.405202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cda97-0647-4aac-891b-07e981e2fbfd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:08.405283 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2233/4478] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:01:08 2022] POST /identity/v3/users => generated 112 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:01:08.405620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b1d15-4641-40e4-959d-c5397af0d7f8 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:08.407413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6d31f-edc5-4072-96f3-7df297476bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:08.407560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ac8b1d15-4641-40e4-959d-c5397af0d7f8 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:08.409028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6d31f-edc5-4072-96f3-7df297476bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:08.409527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6d31f-edc5-4072-96f3-7df297476bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:08.410682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6d31f-edc5-4072-96f3-7df297476bb2 admin admin] PATH_INFO: `/v3/projects/65d76274dc3548d4a6acc495001fad12/users/6d1d3f5425734678b6fd67f9a675bbe0/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:08.423990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b1d15-4641-40e4-959d-c5397af0d7f8 tempest-UsersNegativeTest-619086675 tempest-UsersNegativeTest-619086675-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:08.429740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24fc7be-bd37-4c6c-a6e4-1d36b3b57f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:08.430752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fc7be-bd37-4c6c-a6e4-1d36b3b57f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:08.431176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fc7be-bd37-4c6c-a6e4-1d36b3b57f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:08.431388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6d31f-edc5-4072-96f3-7df297476bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d76274dc3548d4a6acc495001fad12, user_id=6d1d3f5425734678b6fd67f9a675bbe0, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:08.433046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fc7be-bd37-4c6c-a6e4-1d36b3b57f4e admin admin] PATH_INFO: `/v3/users/5cf3fb53836745bc991c2df845e8b310` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:08.436308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6d31f-edc5-4072-96f3-7df297476bb2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:08.437649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24fc7be-bd37-4c6c-a6e4-1d36b3b57f4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cf3fb53836745bc991c2df845e8b310)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:08.440321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24fc7be-bd37-4c6c-a6e4-1d36b3b57f4e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:08.452837 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2246/4479] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:01:08 2022] PUT /identity/v3/projects/65d76274dc3548d4a6acc495001fad12/users/6d1d3f5425734678b6fd67f9a675bbe0/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:01:08.465621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faf3ad-3d2f-442c-97ef-4ccb1c13d269 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:08.466014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faf3ad-3d2f-442c-97ef-4ccb1c13d269 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:08.466358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faf3ad-3d2f-442c-97ef-4ccb1c13d269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:08.501491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-67faf3ad-3d2f-442c-97ef-4ccb1c13d269 None None] MFA Rules not processed for user `6d1d3f5425734678b6fd67f9a675bbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:08.503544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-67faf3ad-3d2f-442c-97ef-4ccb1c13d269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:08.506564 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:08.521819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e24fc7be-bd37-4c6c-a6e4-1d36b3b57f4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cf3fb53836745bc991c2df845e8b310'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:08.531958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e24fc7be-bd37-4c6c-a6e4-1d36b3b57f4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cf3fb53836745bc991c2df845e8b310'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:08.533309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e24fc7be-bd37-4c6c-a6e4-1d36b3b57f4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cf3fb53836745bc991c2df845e8b310'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:08.548365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e24fc7be-bd37-4c6c-a6e4-1d36b3b57f4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cf3fb53836745bc991c2df845e8b310'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:08.556114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e24fc7be-bd37-4c6c-a6e4-1d36b3b57f4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cf3fb53836745bc991c2df845e8b310'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:08.563869 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2234/4480] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:01:08 2022] DELETE /identity/v3/users/5cf3fb53836745bc991c2df845e8b310 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:08.568516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03793a-df5a-491d-80eb-b0b831a52a84 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:08.568836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03793a-df5a-491d-80eb-b0b831a52a84 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:08.569114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03793a-df5a-491d-80eb-b0b831a52a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:08.587686 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2247/4481] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:01:08.603093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8d03793a-df5a-491d-80eb-b0b831a52a84 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:08.604314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8d03793a-df5a-491d-80eb-b0b831a52a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:08.608781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67faf3ad-3d2f-442c-97ef-4ccb1c13d269 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:08.610193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-67faf3ad-3d2f-442c-97ef-4ccb1c13d269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:08.677713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67faf3ad-3d2f-442c-97ef-4ccb1c13d269 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:08.681865 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:08.683836 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2235/4482] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:01:08.696249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03793a-df5a-491d-80eb-b0b831a52a84 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:08.697669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8d03793a-df5a-491d-80eb-b0b831a52a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:08.740353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35350ef3-5b47-476c-a6ca-e6e12cd01c20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:08.740991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35350ef3-5b47-476c-a6ca-e6e12cd01c20 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:08.741268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35350ef3-5b47-476c-a6ca-e6e12cd01c20 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:08.741537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35350ef3-5b47-476c-a6ca-e6e12cd01c20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:08.769752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03793a-df5a-491d-80eb-b0b831a52a84 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:08.773824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51885b96-3b9a-4ad2-ad8b-ffc8d772d9a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:08.774669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51885b96-3b9a-4ad2-ad8b-ffc8d772d9a1 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:08.775107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51885b96-3b9a-4ad2-ad8b-ffc8d772d9a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:08.775524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51885b96-3b9a-4ad2-ad8b-ffc8d772d9a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:08.790769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51885b96-3b9a-4ad2-ad8b-ffc8d772d9a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:08.792199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51885b96-3b9a-4ad2-ad8b-ffc8d772d9a1 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:08.802796 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2236/4483] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:01:08.807074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35350ef3-5b47-476c-a6ca-e6e12cd01c20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:08.808618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35350ef3-5b47-476c-a6ca-e6e12cd01c20 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:08.820079 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2248/4484] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:01:09.260915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51885b96-3b9a-4ad2-ad8b-ffc8d772d9a1 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:09.262642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-51885b96-3b9a-4ad2-ad8b-ffc8d772d9a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:09.290924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51885b96-3b9a-4ad2-ad8b-ffc8d772d9a1 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:09.301543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b8bc3-c770-46d4-a987-2f86a7fb8bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:09.303061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b8bc3-c770-46d4-a987-2f86a7fb8bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:09.303768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b8bc3-c770-46d4-a987-2f86a7fb8bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:09.307776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b8bc3-c770-46d4-a987-2f86a7fb8bd8 admin admin] PATH_INFO: `/v3/projects/8f17de3e7bdc403a8ad5aac13f3c2a0f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:09.311379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b8bc3-c770-46d4-a987-2f86a7fb8bd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f17de3e7bdc403a8ad5aac13f3c2a0f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:09.313326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b8bc3-c770-46d4-a987-2f86a7fb8bd8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:09.382795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d84b8bc3-c770-46d4-a987-2f86a7fb8bd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f17de3e7bdc403a8ad5aac13f3c2a0f', 'request_id': 'req-d84b8bc3-c770-46d4-a987-2f86a7fb8bd8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:09.385350 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:09.395174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d84b8bc3-c770-46d4-a987-2f86a7fb8bd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f17de3e7bdc403a8ad5aac13f3c2a0f', 'request_id': 'req-d84b8bc3-c770-46d4-a987-2f86a7fb8bd8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:09.403336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d84b8bc3-c770-46d4-a987-2f86a7fb8bd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f17de3e7bdc403a8ad5aac13f3c2a0f', 'request_id': 'req-d84b8bc3-c770-46d4-a987-2f86a7fb8bd8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:09.420328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d84b8bc3-c770-46d4-a987-2f86a7fb8bd8 admin admin] The token cache is being invalidate because project 8f17de3e7bdc403a8ad5aac13f3c2a0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:01:09.420947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d84b8bc3-c770-46d4-a987-2f86a7fb8bd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:09.422130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d84b8bc3-c770-46d4-a987-2f86a7fb8bd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:09.423997 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2237/4485] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:01:09 2022] DELETE /identity/v3/projects/8f17de3e7bdc403a8ad5aac13f3c2a0f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:09.428166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35350ef3-5b47-476c-a6ca-e6e12cd01c20 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:09.441782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35350ef3-5b47-476c-a6ca-e6e12cd01c20 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:09.513814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b408f-26c6-4a34-87eb-860c25648305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:09.514674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b408f-26c6-4a34-87eb-860c25648305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:09.514955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b408f-26c6-4a34-87eb-860c25648305 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:09.515278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b408f-26c6-4a34-87eb-860c25648305 admin admin] PATH_INFO: `/v3/users/0cbaad4ea14e42529c2f79adf9cd295b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:09.516700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b408f-26c6-4a34-87eb-860c25648305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cbaad4ea14e42529c2f79adf9cd295b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:09.519154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b408f-26c6-4a34-87eb-860c25648305 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:09.587063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-544b408f-26c6-4a34-87eb-860c25648305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cbaad4ea14e42529c2f79adf9cd295b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:09.587751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-544b408f-26c6-4a34-87eb-860c25648305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cbaad4ea14e42529c2f79adf9cd295b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:09.598226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-544b408f-26c6-4a34-87eb-860c25648305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cbaad4ea14e42529c2f79adf9cd295b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:09.608363 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:09.618499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-544b408f-26c6-4a34-87eb-860c25648305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cbaad4ea14e42529c2f79adf9cd295b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:09.630427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-544b408f-26c6-4a34-87eb-860c25648305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cbaad4ea14e42529c2f79adf9cd295b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:09.638289 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2249/4486] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:01:09 2022] DELETE /identity/v3/users/0cbaad4ea14e42529c2f79adf9cd295b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:10.903070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b8bc3-c770-46d4-a987-2f86a7fb8bd8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:10.905584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d84b8bc3-c770-46d4-a987-2f86a7fb8bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:10.948384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b8bc3-c770-46d4-a987-2f86a7fb8bd8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:11.155704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faead2d-91df-4b30-a64a-90554744483b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:11.156399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faead2d-91df-4b30-a64a-90554744483b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:11.156851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faead2d-91df-4b30-a64a-90554744483b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:11.157144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faead2d-91df-4b30-a64a-90554744483b admin admin] PATH_INFO: `/v3/projects/c53c51f58b15409898aee6d937a22eac` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:11.161691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faead2d-91df-4b30-a64a-90554744483b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c53c51f58b15409898aee6d937a22eac)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:11.163886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faead2d-91df-4b30-a64a-90554744483b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:11.232295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9faead2d-91df-4b30-a64a-90554744483b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c53c51f58b15409898aee6d937a22eac', 'request_id': 'req-9faead2d-91df-4b30-a64a-90554744483b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:11.249863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9faead2d-91df-4b30-a64a-90554744483b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c53c51f58b15409898aee6d937a22eac', 'request_id': 'req-9faead2d-91df-4b30-a64a-90554744483b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:11.260062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9faead2d-91df-4b30-a64a-90554744483b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c53c51f58b15409898aee6d937a22eac', 'request_id': 'req-9faead2d-91df-4b30-a64a-90554744483b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:11.279577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9faead2d-91df-4b30-a64a-90554744483b admin admin] The token cache is being invalidate because project c53c51f58b15409898aee6d937a22eac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:01:11.279577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9faead2d-91df-4b30-a64a-90554744483b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:11.280345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9faead2d-91df-4b30-a64a-90554744483b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:11.287271 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2238/4487] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:01:10 2022] DELETE /identity/v3/projects/c53c51f58b15409898aee6d937a22eac => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:11.288805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae28ec-6c0c-40ae-b0ed-148eab6f2714 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:11.289231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae28ec-6c0c-40ae-b0ed-148eab6f2714 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:11.289342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae28ec-6c0c-40ae-b0ed-148eab6f2714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:11.317805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-63ae28ec-6c0c-40ae-b0ed-148eab6f2714 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:11.319651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-63ae28ec-6c0c-40ae-b0ed-148eab6f2714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:11.456647 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2250/4488] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:11.464542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752486d-cf01-4b12-a972-414eaa60c1ac None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:11.464871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752486d-cf01-4b12-a972-414eaa60c1ac None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:11.465146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752486d-cf01-4b12-a972-414eaa60c1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:11.492904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9752486d-cf01-4b12-a972-414eaa60c1ac None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:11.494307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9752486d-cf01-4b12-a972-414eaa60c1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:11.503873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e38546-6783-4a44-bbb4-d942a2ff9713 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:11.504128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e38546-6783-4a44-bbb4-d942a2ff9713 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:11.504408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e38546-6783-4a44-bbb4-d942a2ff9713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:11.509635 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2239/4489] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:11.513912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752486d-cf01-4b12-a972-414eaa60c1ac None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:11.529266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752486d-cf01-4b12-a972-414eaa60c1ac None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:11.537353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32f43e-7226-479c-85a4-4295095601f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:11.538220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32f43e-7226-479c-85a4-4295095601f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:11.539567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32f43e-7226-479c-85a4-4295095601f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:11.539973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32f43e-7226-479c-85a4-4295095601f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:11.543776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32f43e-7226-479c-85a4-4295095601f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:01:11.544239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32f43e-7226-479c-85a4-4295095601f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:11.546755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32f43e-7226-479c-85a4-4295095601f7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:11.549743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d6e38546-6783-4a44-bbb4-d942a2ff9713 None None] MFA Rules not processed for user `8bb9a3b41bbc4a11a1e50fb2f5de5c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:11.551101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d6e38546-6783-4a44-bbb4-d942a2ff9713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:11.587924 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2240/4490] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:01:11.593033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32f43e-7226-479c-85a4-4295095601f7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:11.606753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32f43e-7226-479c-85a4-4295095601f7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:11.622395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6b12c-5b37-49a1-87ef-cba9cde5f59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:11.624046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6b12c-5b37-49a1-87ef-cba9cde5f59d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:11.624466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6b12c-5b37-49a1-87ef-cba9cde5f59d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:11.624992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6b12c-5b37-49a1-87ef-cba9cde5f59d admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:11.625874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6b12c-5b37-49a1-87ef-cba9cde5f59d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:11.644372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6b12c-5b37-49a1-87ef-cba9cde5f59d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:11.690907 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2241/4491] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:01:11 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:01:11.692001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6b12c-5b37-49a1-87ef-cba9cde5f59d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:11.704444 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2251/4492] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:01:11.751490 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:11.863698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6b12c-5b37-49a1-87ef-cba9cde5f59d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:11.870716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f1950-9dfe-473b-987e-7acf12159712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:11.871348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f1950-9dfe-473b-987e-7acf12159712 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:11.871631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f1950-9dfe-473b-987e-7acf12159712 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:11.871902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f1950-9dfe-473b-987e-7acf12159712 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:11.872542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f1950-9dfe-473b-987e-7acf12159712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:11.875007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f1950-9dfe-473b-987e-7acf12159712 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:11.932634 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2242/4493] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:01:11 2022] POST /identity/v3/users => generated 284 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:11.936312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e38546-6783-4a44-bbb4-d942a2ff9713 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:11.954363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e38546-6783-4a44-bbb4-d942a2ff9713 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:11.974013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dd8fc-6bd7-41b3-9f47-530d94bafca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:11.974919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dd8fc-6bd7-41b3-9f47-530d94bafca4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:11.975419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dd8fc-6bd7-41b3-9f47-530d94bafca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:11.975893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dd8fc-6bd7-41b3-9f47-530d94bafca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:11.976794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8dd8fc-6bd7-41b3-9f47-530d94bafca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:11.978637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8dd8fc-6bd7-41b3-9f47-530d94bafca4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:11.998492 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2252/4494] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:12.004064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f1950-9dfe-473b-987e-7acf12159712 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:12.025371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f1950-9dfe-473b-987e-7acf12159712 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:12.040406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebb14d-e9d8-4f7e-accd-44b22af1d036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:12.043404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebb14d-e9d8-4f7e-accd-44b22af1d036 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:12.043701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebb14d-e9d8-4f7e-accd-44b22af1d036 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:12.043973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebb14d-e9d8-4f7e-accd-44b22af1d036 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:12.046819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebb14d-e9d8-4f7e-accd-44b22af1d036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:12.053658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebb14d-e9d8-4f7e-accd-44b22af1d036 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:12.086347 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2243/4495] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:01:12.092195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dd8fc-6bd7-41b3-9f47-530d94bafca4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:12.107312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dd8fc-6bd7-41b3-9f47-530d94bafca4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:12.123249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82b873-8190-41dd-a9eb-7921cfe080bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:12.126875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82b873-8190-41dd-a9eb-7921cfe080bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:12.127507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82b873-8190-41dd-a9eb-7921cfe080bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:12.128184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82b873-8190-41dd-a9eb-7921cfe080bc admin admin] PATH_INFO: `/v3/projects/f11b65130927440990324c86d7b11299/users/410f9c8596db45799fde18915d269e35/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:12.164114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82b873-8190-41dd-a9eb-7921cfe080bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f11b65130927440990324c86d7b11299, user_id=410f9c8596db45799fde18915d269e35, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:12.167617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82b873-8190-41dd-a9eb-7921cfe080bc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:12.198060 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2253/4496] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:01:12 2022] PUT /identity/v3/projects/f11b65130927440990324c86d7b11299/users/410f9c8596db45799fde18915d269e35/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:12.210791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d3c72-2114-4188-a3d2-02b0bfc7c1da None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:12.211074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d3c72-2114-4188-a3d2-02b0bfc7c1da None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:12.211490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d3c72-2114-4188-a3d2-02b0bfc7c1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:12.257583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-978d3c72-2114-4188-a3d2-02b0bfc7c1da None None] MFA Rules not processed for user `410f9c8596db45799fde18915d269e35`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:12.261260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-978d3c72-2114-4188-a3d2-02b0bfc7c1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:12.383221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82b873-8190-41dd-a9eb-7921cfe080bc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:12.383890 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2244/4497] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:12.399489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d3c72-2114-4188-a3d2-02b0bfc7c1da None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:12.401187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-978d3c72-2114-4188-a3d2-02b0bfc7c1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:12.404451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82b873-8190-41dd-a9eb-7921cfe080bc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:12.420222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a3fa4-4ded-4572-af77-1847c552fcb2 tempest-TestApiDiscovery-572136804 tempest-TestApiDiscovery-572136804-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410f9c8596db45799fde18915d269e35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f11b65130927440990324c86d7b11299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:12.421906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a3fa4-4ded-4572-af77-1847c552fcb2 tempest-TestApiDiscovery-572136804 tempest-TestApiDiscovery-572136804-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:12.422351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a3fa4-4ded-4572-af77-1847c552fcb2 tempest-TestApiDiscovery-572136804 tempest-TestApiDiscovery-572136804-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:12.422956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a3fa4-4ded-4572-af77-1847c552fcb2 tempest-TestApiDiscovery-572136804 tempest-TestApiDiscovery-572136804-project] PATH_INFO: `/v3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:12.425358 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2254/4498] 10.222.0.16 () {58 vars in 1104 bytes} [Fri Sep 30 10:01:12 2022] GET /identity/v3 => generated 255 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:01:12.430998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a3fa4-4ded-4572-af77-1847c552fcb2 tempest-TestApiDiscovery-572136804 tempest-TestApiDiscovery-572136804-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:12.457437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a3fa4-4ded-4572-af77-1847c552fcb2 tempest-TestApiDiscovery-572136804 tempest-TestApiDiscovery-572136804-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:12.462216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b362d-34d2-40a1-a018-edd4f6b2fdb7 tempest-TestApiDiscovery-572136804 tempest-TestApiDiscovery-572136804-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410f9c8596db45799fde18915d269e35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f11b65130927440990324c86d7b11299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:12.462811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b362d-34d2-40a1-a018-edd4f6b2fdb7 tempest-TestApiDiscovery-572136804 tempest-TestApiDiscovery-572136804-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:12.463092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b362d-34d2-40a1-a018-edd4f6b2fdb7 tempest-TestApiDiscovery-572136804 tempest-TestApiDiscovery-572136804-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:12.463802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b362d-34d2-40a1-a018-edd4f6b2fdb7 tempest-TestApiDiscovery-572136804 tempest-TestApiDiscovery-572136804-project] PATH_INFO: `/v3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:12.466312 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2255/4499] 10.222.0.16 () {58 vars in 1104 bytes} [Fri Sep 30 10:01:12 2022] GET /identity/v3 => generated 255 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:01:12.469772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b362d-34d2-40a1-a018-edd4f6b2fdb7 tempest-TestApiDiscovery-572136804 tempest-TestApiDiscovery-572136804-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:12.485577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b362d-34d2-40a1-a018-edd4f6b2fdb7 tempest-TestApiDiscovery-572136804 tempest-TestApiDiscovery-572136804-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:12.500557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef224c-0c37-4e47-923e-919c4a73c868 tempest-TestApiDiscovery-572136804 tempest-TestApiDiscovery-572136804-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410f9c8596db45799fde18915d269e35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f11b65130927440990324c86d7b11299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:12.501351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef224c-0c37-4e47-923e-919c4a73c868 tempest-TestApiDiscovery-572136804 tempest-TestApiDiscovery-572136804-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:12.501826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef224c-0c37-4e47-923e-919c4a73c868 tempest-TestApiDiscovery-572136804 tempest-TestApiDiscovery-572136804-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:12.502310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef224c-0c37-4e47-923e-919c4a73c868 tempest-TestApiDiscovery-572136804 tempest-TestApiDiscovery-572136804-project] PATH_INFO: `/v3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:12.508816 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2256/4500] 10.222.0.16 () {58 vars in 1104 bytes} [Fri Sep 30 10:01:12 2022] GET /identity/v3 => generated 255 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:01:12.511641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c08c47-63ae-4ef6-a299-82b71add9bb2 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:12.514540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c08c47-63ae-4ef6-a299-82b71add9bb2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:12.515069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c08c47-63ae-4ef6-a299-82b71add9bb2 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:12.522823 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2257/4501] 10.222.0.16 () {56 vars in 895 bytes} [Fri Sep 30 10:01:12 2022] GET /identity/ => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 10:01:12.528588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e458e4-c8c9-4fe9-a66b-9469944c4233 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:12.529019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e458e4-c8c9-4fe9-a66b-9469944c4233 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:12.529552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e458e4-c8c9-4fe9-a66b-9469944c4233 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:12.534755 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2258/4502] 10.222.0.16 () {56 vars in 895 bytes} [Fri Sep 30 10:01:12 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 10:01:12.537091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e458e4-c8c9-4fe9-a66b-9469944c4233 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:12.545916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d3c72-2114-4188-a3d2-02b0bfc7c1da None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:12.556133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5cbe0-3b4d-47ba-a750-2994eb89cb15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:12.557191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5cbe0-3b4d-47ba-a750-2994eb89cb15 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:12.557499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5cbe0-3b4d-47ba-a750-2994eb89cb15 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:12.557777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5cbe0-3b4d-47ba-a750-2994eb89cb15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:12.559768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cea5cbe0-3b4d-47ba-a750-2994eb89cb15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:12.614410 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:12.620455 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:12.679487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea5cbe0-3b4d-47ba-a750-2994eb89cb15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:12.681551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea5cbe0-3b4d-47ba-a750-2994eb89cb15 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:12.697845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e458e4-c8c9-4fe9-a66b-9469944c4233 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:12.710255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2405d60-51fc-4ea3-a99c-84aead14009b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:12.711018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2405d60-51fc-4ea3-a99c-84aead14009b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:12.711574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2405d60-51fc-4ea3-a99c-84aead14009b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:12.711948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2405d60-51fc-4ea3-a99c-84aead14009b admin admin] PATH_INFO: `/v3/users/410f9c8596db45799fde18915d269e35` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:12.713251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2405d60-51fc-4ea3-a99c-84aead14009b admin admin] RBAC: Authorizing `identity:delete_user(user_id=410f9c8596db45799fde18915d269e35)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:12.715487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2405d60-51fc-4ea3-a99c-84aead14009b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:12.735409 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2245/4503] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:01:12.737718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29727542-9754-4933-9fcb-24d350d93bdc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:12.738021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29727542-9754-4933-9fcb-24d350d93bdc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:12.738825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29727542-9754-4933-9fcb-24d350d93bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:12.787480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-29727542-9754-4933-9fcb-24d350d93bdc None None] MFA Rules not processed for user `8bb9a3b41bbc4a11a1e50fb2f5de5c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:12.788921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-29727542-9754-4933-9fcb-24d350d93bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:12.816664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a2405d60-51fc-4ea3-a99c-84aead14009b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '410f9c8596db45799fde18915d269e35'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:12.818027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a2405d60-51fc-4ea3-a99c-84aead14009b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '410f9c8596db45799fde18915d269e35'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:12.836289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a2405d60-51fc-4ea3-a99c-84aead14009b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '410f9c8596db45799fde18915d269e35'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:12.876022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a2405d60-51fc-4ea3-a99c-84aead14009b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '410f9c8596db45799fde18915d269e35'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:12.882217 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2246/4504] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:12.899499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a2405d60-51fc-4ea3-a99c-84aead14009b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '410f9c8596db45799fde18915d269e35'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:12.909276 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2259/4505] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:01:12 2022] DELETE /identity/v3/users/410f9c8596db45799fde18915d269e35 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:12.919667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002352cd-dd48-43fa-b0d5-f499e138ab6f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:12.922363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002352cd-dd48-43fa-b0d5-f499e138ab6f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:12.922802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002352cd-dd48-43fa-b0d5-f499e138ab6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:12.951149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-002352cd-dd48-43fa-b0d5-f499e138ab6f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:12.953111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-002352cd-dd48-43fa-b0d5-f499e138ab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:13.076977 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2247/4506] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:13.094215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2405d60-51fc-4ea3-a99c-84aead14009b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:13.095687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a2405d60-51fc-4ea3-a99c-84aead14009b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:13.219178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2405d60-51fc-4ea3-a99c-84aead14009b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:13.224920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa6123-3483-470e-9672-5d192df6d1e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:13.225827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa6123-3483-470e-9672-5d192df6d1e5 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:13.226314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa6123-3483-470e-9672-5d192df6d1e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:13.226763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa6123-3483-470e-9672-5d192df6d1e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:13.241251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa6123-3483-470e-9672-5d192df6d1e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:13.243533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa6123-3483-470e-9672-5d192df6d1e5 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:13.278710 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2260/4507] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:01:14.199025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002352cd-dd48-43fa-b0d5-f499e138ab6f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:14.200586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-002352cd-dd48-43fa-b0d5-f499e138ab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:14.222638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002352cd-dd48-43fa-b0d5-f499e138ab6f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:14.228005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f21c19-7899-4697-8fb3-16f6bbc64527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:14.228708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f21c19-7899-4697-8fb3-16f6bbc64527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:14.228987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f21c19-7899-4697-8fb3-16f6bbc64527 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:14.229895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f21c19-7899-4697-8fb3-16f6bbc64527 admin admin] PATH_INFO: `/v3/projects/f11b65130927440990324c86d7b11299` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:14.230795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f21c19-7899-4697-8fb3-16f6bbc64527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f11b65130927440990324c86d7b11299)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:14.232588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f21c19-7899-4697-8fb3-16f6bbc64527 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:14.338147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f9f21c19-7899-4697-8fb3-16f6bbc64527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f11b65130927440990324c86d7b11299', 'request_id': 'req-f9f21c19-7899-4697-8fb3-16f6bbc64527'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:14.369242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f9f21c19-7899-4697-8fb3-16f6bbc64527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f11b65130927440990324c86d7b11299', 'request_id': 'req-f9f21c19-7899-4697-8fb3-16f6bbc64527'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:14.381818 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:14.383362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f9f21c19-7899-4697-8fb3-16f6bbc64527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f11b65130927440990324c86d7b11299', 'request_id': 'req-f9f21c19-7899-4697-8fb3-16f6bbc64527'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:14.411881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f9f21c19-7899-4697-8fb3-16f6bbc64527 admin admin] The token cache is being invalidate because project f11b65130927440990324c86d7b11299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:01:14.411881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f9f21c19-7899-4697-8fb3-16f6bbc64527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:14.412761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f9f21c19-7899-4697-8fb3-16f6bbc64527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:14.415615 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2248/4508] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:01:14 2022] DELETE /identity/v3/projects/f11b65130927440990324c86d7b11299 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:14.421537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d66d66-f2a5-4f00-ab0e-40a76be91eae None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:14.422069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d66d66-f2a5-4f00-ab0e-40a76be91eae None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:14.422188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d66d66-f2a5-4f00-ab0e-40a76be91eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:14.465522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-70d66d66-f2a5-4f00-ab0e-40a76be91eae None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:14.466851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-70d66d66-f2a5-4f00-ab0e-40a76be91eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:14.589860 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:14.604869 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2261/4509] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:14.614080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa79fe-9d87-4fa1-8ead-6c79c808bbc0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:14.614791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa79fe-9d87-4fa1-8ead-6c79c808bbc0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:14.615236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa79fe-9d87-4fa1-8ead-6c79c808bbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:14.681716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a8fa79fe-9d87-4fa1-8ead-6c79c808bbc0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:14.694310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a8fa79fe-9d87-4fa1-8ead-6c79c808bbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:14.726184 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2249/4510] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:14.727401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d66d66-f2a5-4f00-ab0e-40a76be91eae None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:14.741272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d66d66-f2a5-4f00-ab0e-40a76be91eae None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:14.754287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a2040-ee38-424d-944d-045c224a46b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:14.754924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a2040-ee38-424d-944d-045c224a46b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:14.755207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a2040-ee38-424d-944d-045c224a46b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:14.755488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a2040-ee38-424d-944d-045c224a46b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:14.756145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a2040-ee38-424d-944d-045c224a46b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:01:14.756450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a2040-ee38-424d-944d-045c224a46b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:14.769872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a2040-ee38-424d-944d-045c224a46b8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:14.783893 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2262/4511] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:01:14.788682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa79fe-9d87-4fa1-8ead-6c79c808bbc0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:14.806480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa79fe-9d87-4fa1-8ead-6c79c808bbc0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:14.812830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bf2cb-96c7-4e01-a1e8-4b64dd9419e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:14.813834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bf2cb-96c7-4e01-a1e8-4b64dd9419e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:14.814291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bf2cb-96c7-4e01-a1e8-4b64dd9419e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:14.815738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bf2cb-96c7-4e01-a1e8-4b64dd9419e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:14.816997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bf2cb-96c7-4e01-a1e8-4b64dd9419e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:14.819186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bf2cb-96c7-4e01-a1e8-4b64dd9419e5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:14.903448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a2040-ee38-424d-944d-045c224a46b8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:14.913117 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2250/4512] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:01:14 2022] POST /identity/v3/projects => generated 391 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:01:14.921109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a2040-ee38-424d-944d-045c224a46b8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:15.061338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b2325-8450-4ba6-90d4-b7e2d6b87b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:15.062119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b2325-8450-4ba6-90d4-b7e2d6b87b78 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:15.062469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b2325-8450-4ba6-90d4-b7e2d6b87b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:15.063948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b2325-8450-4ba6-90d4-b7e2d6b87b78 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:15.067396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b2325-8450-4ba6-90d4-b7e2d6b87b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:15.069505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b2325-8450-4ba6-90d4-b7e2d6b87b78 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:15.131987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bf2cb-96c7-4e01-a1e8-4b64dd9419e5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:15.138157 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2263/4513] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:01:14 2022] POST /identity/v3/users => generated 302 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:15.146702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bf2cb-96c7-4e01-a1e8-4b64dd9419e5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:15.152001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ffa67-2d06-453c-b9bf-1b93ebcdd00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:15.152969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ffa67-2d06-453c-b9bf-1b93ebcdd00b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:15.153448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ffa67-2d06-453c-b9bf-1b93ebcdd00b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:15.154014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ffa67-2d06-453c-b9bf-1b93ebcdd00b admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:15.154827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ffa67-2d06-453c-b9bf-1b93ebcdd00b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:15.159714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ffa67-2d06-453c-b9bf-1b93ebcdd00b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:15.172246 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2251/4514] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:15.177878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b2325-8450-4ba6-90d4-b7e2d6b87b78 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:15.190627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b2325-8450-4ba6-90d4-b7e2d6b87b78 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:15.202958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557a960-1530-4921-add6-db24223f5b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:15.204017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557a960-1530-4921-add6-db24223f5b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:15.204441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557a960-1530-4921-add6-db24223f5b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:15.204889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557a960-1530-4921-add6-db24223f5b72 admin admin] PATH_INFO: `/v3/projects/c7c4c51953af4b9ebec89af449cfa87e/users/8c260ddeb4ae4e10a9fb3bc3498c0185/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:15.239495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557a960-1530-4921-add6-db24223f5b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7c4c51953af4b9ebec89af449cfa87e, user_id=8c260ddeb4ae4e10a9fb3bc3498c0185, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:15.242965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557a960-1530-4921-add6-db24223f5b72 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:15.323278 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2264/4515] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:01:15 2022] PUT /identity/v3/projects/c7c4c51953af4b9ebec89af449cfa87e/users/8c260ddeb4ae4e10a9fb3bc3498c0185/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:15.325210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ffa67-2d06-453c-b9bf-1b93ebcdd00b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:15.343630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ffa67-2d06-453c-b9bf-1b93ebcdd00b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:15.525923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d4320-ab31-4b10-9e08-57b477fb5da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:15.526626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d4320-ab31-4b10-9e08-57b477fb5da6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:15.526971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d4320-ab31-4b10-9e08-57b477fb5da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:15.527303 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d4320-ab31-4b10-9e08-57b477fb5da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:15.528112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d4320-ab31-4b10-9e08-57b477fb5da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:15.532005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d4320-ab31-4b10-9e08-57b477fb5da6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:15.556879 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2252/4516] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:15.558756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557a960-1530-4921-add6-db24223f5b72 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:15.572677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557a960-1530-4921-add6-db24223f5b72 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:15.581199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbd4ce-87a6-46c0-96e4-d799664f005f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:15.581399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbd4ce-87a6-46c0-96e4-d799664f005f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:15.581597 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbd4ce-87a6-46c0-96e4-d799664f005f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:15.582086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbd4ce-87a6-46c0-96e4-d799664f005f admin admin] PATH_INFO: `/v3/projects/c7c4c51953af4b9ebec89af449cfa87e/users/8c260ddeb4ae4e10a9fb3bc3498c0185/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:15.584336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbd4ce-87a6-46c0-96e4-d799664f005f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7c4c51953af4b9ebec89af449cfa87e, user_id=8c260ddeb4ae4e10a9fb3bc3498c0185, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:15.587804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbd4ce-87a6-46c0-96e4-d799664f005f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:15.617771 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2265/4517] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:01:15 2022] PUT /identity/v3/projects/c7c4c51953af4b9ebec89af449cfa87e/users/8c260ddeb4ae4e10a9fb3bc3498c0185/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:15.629532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16487c4-fa7f-40da-8a4f-a7b412e170e0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:15.629832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16487c4-fa7f-40da-8a4f-a7b412e170e0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:15.630086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16487c4-fa7f-40da-8a4f-a7b412e170e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:15.673378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f16487c4-fa7f-40da-8a4f-a7b412e170e0 None None] MFA Rules not processed for user `8c260ddeb4ae4e10a9fb3bc3498c0185`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:15.675122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f16487c4-fa7f-40da-8a4f-a7b412e170e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:15.797938 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2253/4518] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:15 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:15.802949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbd4ce-87a6-46c0-96e4-d799664f005f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:15.945252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbd4ce-87a6-46c0-96e4-d799664f005f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:15.959628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08038dcf-c2ac-42bd-ad57-e404b55fcea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:15.961345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08038dcf-c2ac-42bd-ad57-e404b55fcea7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:15.961773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08038dcf-c2ac-42bd-ad57-e404b55fcea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:15.962239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08038dcf-c2ac-42bd-ad57-e404b55fcea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:15.963019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08038dcf-c2ac-42bd-ad57-e404b55fcea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:15.968870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08038dcf-c2ac-42bd-ad57-e404b55fcea7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:16.011990 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2266/4519] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:01:15 2022] POST /identity/v3/projects => generated 391 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:16.016030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16487c4-fa7f-40da-8a4f-a7b412e170e0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:16.035493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16487c4-fa7f-40da-8a4f-a7b412e170e0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:16.087322 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:16.217817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d853c-fcf6-4601-85e3-adf6d32c87ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:16.223597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d853c-fcf6-4601-85e3-adf6d32c87ce admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:16.224169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d853c-fcf6-4601-85e3-adf6d32c87ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:16.226427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d853c-fcf6-4601-85e3-adf6d32c87ce admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:16.228782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d853c-fcf6-4601-85e3-adf6d32c87ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:16.232211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d853c-fcf6-4601-85e3-adf6d32c87ce admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:16.290894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08038dcf-c2ac-42bd-ad57-e404b55fcea7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:16.292617 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2254/4520] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:01:16 2022] POST /identity/v3/users => generated 296 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:16.319529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08038dcf-c2ac-42bd-ad57-e404b55fcea7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:16.337250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340965a8-4661-4a32-bb4f-4de8afa8687d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:16.338128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340965a8-4661-4a32-bb4f-4de8afa8687d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:16.351822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340965a8-4661-4a32-bb4f-4de8afa8687d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:16.354347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340965a8-4661-4a32-bb4f-4de8afa8687d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:16.358177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340965a8-4661-4a32-bb4f-4de8afa8687d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:16.364859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340965a8-4661-4a32-bb4f-4de8afa8687d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:16.410879 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2267/4521] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:01:16.413073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d853c-fcf6-4601-85e3-adf6d32c87ce admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:16.430130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d853c-fcf6-4601-85e3-adf6d32c87ce admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:16.438281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2557713-7a66-42c1-a603-5fc7ab89e984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:16.439354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2557713-7a66-42c1-a603-5fc7ab89e984 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:16.440460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2557713-7a66-42c1-a603-5fc7ab89e984 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:16.440903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2557713-7a66-42c1-a603-5fc7ab89e984 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:16.441869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2557713-7a66-42c1-a603-5fc7ab89e984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:16.444397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2557713-7a66-42c1-a603-5fc7ab89e984 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:16.484142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340965a8-4661-4a32-bb4f-4de8afa8687d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:16.491995 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2255/4522] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:16.515046 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:16.528221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340965a8-4661-4a32-bb4f-4de8afa8687d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:16.545386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738b272-2ae7-4777-b183-bf22b4f1f5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:16.546898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738b272-2ae7-4777-b183-bf22b4f1f5b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:16.547829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738b272-2ae7-4777-b183-bf22b4f1f5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:16.548347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738b272-2ae7-4777-b183-bf22b4f1f5b7 admin admin] PATH_INFO: `/v3/projects/49c78895f0ec49ec82a03c64cce2134b/users/593d9285917647458c8498259ad479db/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:16.588200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738b272-2ae7-4777-b183-bf22b4f1f5b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c78895f0ec49ec82a03c64cce2134b, user_id=593d9285917647458c8498259ad479db, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:16.593302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738b272-2ae7-4777-b183-bf22b4f1f5b7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:16.619955 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2268/4523] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:01:16 2022] PUT /identity/v3/projects/49c78895f0ec49ec82a03c64cce2134b/users/593d9285917647458c8498259ad479db/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:01:16.633728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6fe99-4fd3-475e-8b0d-723f0841f5c8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:16.634317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6fe99-4fd3-475e-8b0d-723f0841f5c8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:16.634731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6fe99-4fd3-475e-8b0d-723f0841f5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:16.704903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-59e6fe99-4fd3-475e-8b0d-723f0841f5c8 None None] MFA Rules not processed for user `593d9285917647458c8498259ad479db`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:16.709717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-59e6fe99-4fd3-475e-8b0d-723f0841f5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:16.824741 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2256/4524] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:16.837070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738b272-2ae7-4777-b183-bf22b4f1f5b7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:16.839006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b738b272-2ae7-4777-b183-bf22b4f1f5b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:16.921824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738b272-2ae7-4777-b183-bf22b4f1f5b7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:16.927275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321bfb5-17c7-400d-a2f2-5fa9b58ec14a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:16.928720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321bfb5-17c7-400d-a2f2-5fa9b58ec14a service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:16.928720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321bfb5-17c7-400d-a2f2-5fa9b58ec14a service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:16.928720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321bfb5-17c7-400d-a2f2-5fa9b58ec14a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:17.034443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321bfb5-17c7-400d-a2f2-5fa9b58ec14a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:17.036495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321bfb5-17c7-400d-a2f2-5fa9b58ec14a service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:17.066763 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2269/4525] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:16 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:01:18.640264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6fe99-4fd3-475e-8b0d-723f0841f5c8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:18.717811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6fe99-4fd3-475e-8b0d-723f0841f5c8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:18.724549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf9f90-d4b0-46b0-afb6-aa63613e7ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:18.725519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf9f90-d4b0-46b0-afb6-aa63613e7ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:18.726065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf9f90-d4b0-46b0-afb6-aa63613e7ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:18.726604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf9f90-d4b0-46b0-afb6-aa63613e7ea4 admin admin] PATH_INFO: `/v3/users/8c260ddeb4ae4e10a9fb3bc3498c0185` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:18.728016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf9f90-d4b0-46b0-afb6-aa63613e7ea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c260ddeb4ae4e10a9fb3bc3498c0185)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:18.730944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf9f90-d4b0-46b0-afb6-aa63613e7ea4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:18.780484 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:18.796592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4baf9f90-d4b0-46b0-afb6-aa63613e7ea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c260ddeb4ae4e10a9fb3bc3498c0185'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:18.812269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4baf9f90-d4b0-46b0-afb6-aa63613e7ea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c260ddeb4ae4e10a9fb3bc3498c0185'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:18.824671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4baf9f90-d4b0-46b0-afb6-aa63613e7ea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c260ddeb4ae4e10a9fb3bc3498c0185'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:18.851601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4baf9f90-d4b0-46b0-afb6-aa63613e7ea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c260ddeb4ae4e10a9fb3bc3498c0185'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:18.876460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4baf9f90-d4b0-46b0-afb6-aa63613e7ea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c260ddeb4ae4e10a9fb3bc3498c0185'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:18.897430 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2257/4526] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:01:18 2022] DELETE /identity/v3/users/8c260ddeb4ae4e10a9fb3bc3498c0185 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:18.899308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad128dc-fc62-4720-977d-0a20838b6100 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:18.899784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad128dc-fc62-4720-977d-0a20838b6100 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:18.900052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad128dc-fc62-4720-977d-0a20838b6100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:18.959947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1ad128dc-fc62-4720-977d-0a20838b6100 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:18.959947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1ad128dc-fc62-4720-977d-0a20838b6100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:19.070616 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2270/4527] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:19.078390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf9f90-d4b0-46b0-afb6-aa63613e7ea4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:19.079803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4baf9f90-d4b0-46b0-afb6-aa63613e7ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:19.211603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf9f90-d4b0-46b0-afb6-aa63613e7ea4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:19.216107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98bf49-398b-4830-8be6-31ef678fa325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:19.217171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98bf49-398b-4830-8be6-31ef678fa325 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:19.217670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98bf49-398b-4830-8be6-31ef678fa325 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:19.218167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98bf49-398b-4830-8be6-31ef678fa325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:19.234587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98bf49-398b-4830-8be6-31ef678fa325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:19.235992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98bf49-398b-4830-8be6-31ef678fa325 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:19.268018 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2258/4528] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:01:20.064187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad128dc-fc62-4720-977d-0a20838b6100 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:20.066360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1ad128dc-fc62-4720-977d-0a20838b6100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:20.092495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad128dc-fc62-4720-977d-0a20838b6100 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:20.102196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3f527-5c02-40f7-89eb-9aa72c88971d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:20.102919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3f527-5c02-40f7-89eb-9aa72c88971d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:20.103269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3f527-5c02-40f7-89eb-9aa72c88971d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:20.103612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3f527-5c02-40f7-89eb-9aa72c88971d admin admin] PATH_INFO: `/v3/projects/c7c4c51953af4b9ebec89af449cfa87e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:20.112256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3f527-5c02-40f7-89eb-9aa72c88971d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7c4c51953af4b9ebec89af449cfa87e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:20.114438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3f527-5c02-40f7-89eb-9aa72c88971d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:20.150119 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:20.211522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82a3f527-5c02-40f7-89eb-9aa72c88971d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7c4c51953af4b9ebec89af449cfa87e', 'request_id': 'req-82a3f527-5c02-40f7-89eb-9aa72c88971d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:20.222564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82a3f527-5c02-40f7-89eb-9aa72c88971d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7c4c51953af4b9ebec89af449cfa87e', 'request_id': 'req-82a3f527-5c02-40f7-89eb-9aa72c88971d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:20.232020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82a3f527-5c02-40f7-89eb-9aa72c88971d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7c4c51953af4b9ebec89af449cfa87e', 'request_id': 'req-82a3f527-5c02-40f7-89eb-9aa72c88971d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:20.247750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82a3f527-5c02-40f7-89eb-9aa72c88971d admin admin] The token cache is being invalidate because project c7c4c51953af4b9ebec89af449cfa87e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:01:20.248034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82a3f527-5c02-40f7-89eb-9aa72c88971d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:20.249322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82a3f527-5c02-40f7-89eb-9aa72c88971d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:20.270672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98bf49-398b-4830-8be6-31ef678fa325 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:20.284005 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2271/4529] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:01:20 2022] DELETE /identity/v3/projects/c7c4c51953af4b9ebec89af449cfa87e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:20.289772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98bf49-398b-4830-8be6-31ef678fa325 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:20.463926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4ded8-19f1-415d-9bb3-74c5d6b08f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:20.464565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4ded8-19f1-415d-9bb3-74c5d6b08f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:20.465173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4ded8-19f1-415d-9bb3-74c5d6b08f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:20.465507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4ded8-19f1-415d-9bb3-74c5d6b08f6d admin admin] PATH_INFO: `/v3/users/593d9285917647458c8498259ad479db` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:20.466869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4ded8-19f1-415d-9bb3-74c5d6b08f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=593d9285917647458c8498259ad479db)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:20.470553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4ded8-19f1-415d-9bb3-74c5d6b08f6d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:20.571066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-66a4ded8-19f1-415d-9bb3-74c5d6b08f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '593d9285917647458c8498259ad479db'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:20.591322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-66a4ded8-19f1-415d-9bb3-74c5d6b08f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '593d9285917647458c8498259ad479db'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:20.592368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-66a4ded8-19f1-415d-9bb3-74c5d6b08f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '593d9285917647458c8498259ad479db'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:20.595200 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:20.623095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-66a4ded8-19f1-415d-9bb3-74c5d6b08f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '593d9285917647458c8498259ad479db'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:20.641434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-66a4ded8-19f1-415d-9bb3-74c5d6b08f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '593d9285917647458c8498259ad479db'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:20.663189 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2259/4530] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:01:20 2022] DELETE /identity/v3/users/593d9285917647458c8498259ad479db => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:21.330676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3f527-5c02-40f7-89eb-9aa72c88971d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:21.333674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-82a3f527-5c02-40f7-89eb-9aa72c88971d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:21.357947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3f527-5c02-40f7-89eb-9aa72c88971d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:21.435824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c4ffc-812f-4d0d-93d4-6c14f4f0fed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:21.436774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c4ffc-812f-4d0d-93d4-6c14f4f0fed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:21.437147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c4ffc-812f-4d0d-93d4-6c14f4f0fed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:21.437506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c4ffc-812f-4d0d-93d4-6c14f4f0fed7 admin admin] PATH_INFO: `/v3/projects/49c78895f0ec49ec82a03c64cce2134b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:21.441209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c4ffc-812f-4d0d-93d4-6c14f4f0fed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49c78895f0ec49ec82a03c64cce2134b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:21.443435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c4ffc-812f-4d0d-93d4-6c14f4f0fed7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:21.510231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-970c4ffc-812f-4d0d-93d4-6c14f4f0fed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49c78895f0ec49ec82a03c64cce2134b', 'request_id': 'req-970c4ffc-812f-4d0d-93d4-6c14f4f0fed7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:21.526505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-970c4ffc-812f-4d0d-93d4-6c14f4f0fed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49c78895f0ec49ec82a03c64cce2134b', 'request_id': 'req-970c4ffc-812f-4d0d-93d4-6c14f4f0fed7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:21.539115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-970c4ffc-812f-4d0d-93d4-6c14f4f0fed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49c78895f0ec49ec82a03c64cce2134b', 'request_id': 'req-970c4ffc-812f-4d0d-93d4-6c14f4f0fed7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:21.557728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-970c4ffc-812f-4d0d-93d4-6c14f4f0fed7 admin admin] The token cache is being invalidate because project 49c78895f0ec49ec82a03c64cce2134b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:01:21.557728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-970c4ffc-812f-4d0d-93d4-6c14f4f0fed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:21.559248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-970c4ffc-812f-4d0d-93d4-6c14f4f0fed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:21.566547 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2272/4531] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:01:21 2022] DELETE /identity/v3/projects/49c78895f0ec49ec82a03c64cce2134b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:21.568586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5cbf5-6948-42bc-a189-7a95c4db882b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:21.569471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5cbf5-6948-42bc-a189-7a95c4db882b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:21.569808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5cbf5-6948-42bc-a189-7a95c4db882b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:21.669144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dda5cbf5-6948-42bc-a189-7a95c4db882b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:21.671382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dda5cbf5-6948-42bc-a189-7a95c4db882b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:21.869020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e2499-c028-412c-bfb7-08c9833ea1a1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:21.869362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e2499-c028-412c-bfb7-08c9833ea1a1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:21.869655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e2499-c028-412c-bfb7-08c9833ea1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:21.870479 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2260/4532] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:01:21.895438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c71e2499-c028-412c-bfb7-08c9833ea1a1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:21.896701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c71e2499-c028-412c-bfb7-08c9833ea1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:21.906516 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2273/4533] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:21.931003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5cbf5-6948-42bc-a189-7a95c4db882b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:21.951032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5cbf5-6948-42bc-a189-7a95c4db882b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:21.966841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888eb81-bc31-4cf8-9e82-bdbf588c37f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:21.967538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888eb81-bc31-4cf8-9e82-bdbf588c37f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:21.967732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888eb81-bc31-4cf8-9e82-bdbf588c37f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:21.968001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888eb81-bc31-4cf8-9e82-bdbf588c37f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:21.968703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888eb81-bc31-4cf8-9e82-bdbf588c37f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:01:21.969112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888eb81-bc31-4cf8-9e82-bdbf588c37f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:21.971451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888eb81-bc31-4cf8-9e82-bdbf588c37f8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:22.015800 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2261/4534] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:01:22.017096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e2499-c028-412c-bfb7-08c9833ea1a1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:22.033547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e2499-c028-412c-bfb7-08c9833ea1a1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:22.054716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1cfb93-9663-4614-b347-2eecbcf4c664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:22.055353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cfb93-9663-4614-b347-2eecbcf4c664 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:22.057680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cfb93-9663-4614-b347-2eecbcf4c664 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:22.059274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cfb93-9663-4614-b347-2eecbcf4c664 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:22.059274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1cfb93-9663-4614-b347-2eecbcf4c664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:22.066611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1cfb93-9663-4614-b347-2eecbcf4c664 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:22.125924 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2274/4535] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:01:22 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:22.129763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888eb81-bc31-4cf8-9e82-bdbf588c37f8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:22.142067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888eb81-bc31-4cf8-9e82-bdbf588c37f8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:22.212924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181fadf-5f76-4772-aa67-9cde49e04ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:22.213788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181fadf-5f76-4772-aa67-9cde49e04ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:22.214364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181fadf-5f76-4772-aa67-9cde49e04ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:22.214641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181fadf-5f76-4772-aa67-9cde49e04ec4 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:22.215479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181fadf-5f76-4772-aa67-9cde49e04ec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:22.218526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181fadf-5f76-4772-aa67-9cde49e04ec4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:22.253218 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2262/4536] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:01:22 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:22.254578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1cfb93-9663-4614-b347-2eecbcf4c664 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:22.293825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1cfb93-9663-4614-b347-2eecbcf4c664 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:22.314417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b4fbf-bc9d-41ea-9a0f-27090e5dc4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:22.315719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b4fbf-bc9d-41ea-9a0f-27090e5dc4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:22.316205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b4fbf-bc9d-41ea-9a0f-27090e5dc4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:22.316877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b4fbf-bc9d-41ea-9a0f-27090e5dc4e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:22.318098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b4fbf-bc9d-41ea-9a0f-27090e5dc4e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:22.335369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b4fbf-bc9d-41ea-9a0f-27090e5dc4e1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:22.342218 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:22.358559 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2275/4537] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:01:22.363877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181fadf-5f76-4772-aa67-9cde49e04ec4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:22.376830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181fadf-5f76-4772-aa67-9cde49e04ec4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:22.395608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab509da7-588b-4788-88ed-8f03af134232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:22.396050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab509da7-588b-4788-88ed-8f03af134232 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:22.396376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab509da7-588b-4788-88ed-8f03af134232 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:22.396586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab509da7-588b-4788-88ed-8f03af134232 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:22.397312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab509da7-588b-4788-88ed-8f03af134232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:22.399521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab509da7-588b-4788-88ed-8f03af134232 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:22.434267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b4fbf-bc9d-41ea-9a0f-27090e5dc4e1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:22.440745 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2263/4538] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:22.453073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b4fbf-bc9d-41ea-9a0f-27090e5dc4e1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:22.463553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715643d7-25bc-439d-aff9-a87c92af8029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:22.465565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715643d7-25bc-439d-aff9-a87c92af8029 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:22.465814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715643d7-25bc-439d-aff9-a87c92af8029 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:22.466124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715643d7-25bc-439d-aff9-a87c92af8029 admin admin] PATH_INFO: `/v3/projects/b4df2f3e16e04ce5b45ccdfa4ebaa208/users/4c0cf2819ebb4b28bfe874988ab2b81a/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:22.504453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715643d7-25bc-439d-aff9-a87c92af8029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4df2f3e16e04ce5b45ccdfa4ebaa208, user_id=4c0cf2819ebb4b28bfe874988ab2b81a, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:22.507245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715643d7-25bc-439d-aff9-a87c92af8029 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:22.534640 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2276/4539] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:01:22 2022] PUT /identity/v3/projects/b4df2f3e16e04ce5b45ccdfa4ebaa208/users/4c0cf2819ebb4b28bfe874988ab2b81a/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:22.545812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940607b-e080-44a0-a01d-6a3447b8ce74 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:22.546092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940607b-e080-44a0-a01d-6a3447b8ce74 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:22.546363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940607b-e080-44a0-a01d-6a3447b8ce74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:22.608724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8940607b-e080-44a0-a01d-6a3447b8ce74 None None] MFA Rules not processed for user `4c0cf2819ebb4b28bfe874988ab2b81a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:22.608724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8940607b-e080-44a0-a01d-6a3447b8ce74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:22.641015 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:22.735303 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2264/4540] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:22.740356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715643d7-25bc-439d-aff9-a87c92af8029 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:22.902101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715643d7-25bc-439d-aff9-a87c92af8029 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:22.910234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc258d9-0118-4e14-9868-8fc1adc5e3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:22.911304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc258d9-0118-4e14-9868-8fc1adc5e3ba admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:22.912330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc258d9-0118-4e14-9868-8fc1adc5e3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:22.912927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc258d9-0118-4e14-9868-8fc1adc5e3ba admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:22.913796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc258d9-0118-4e14-9868-8fc1adc5e3ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:22.922874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc258d9-0118-4e14-9868-8fc1adc5e3ba admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:23.005497 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2277/4541] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:01:22 2022] POST /identity/v3/projects => generated 371 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:23.009828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940607b-e080-44a0-a01d-6a3447b8ce74 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:23.046119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940607b-e080-44a0-a01d-6a3447b8ce74 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:23.135048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc668707-d2c7-4eb4-bb25-fe41fc1271da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:23.136488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc668707-d2c7-4eb4-bb25-fe41fc1271da admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:23.136488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc668707-d2c7-4eb4-bb25-fe41fc1271da admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:23.136488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc668707-d2c7-4eb4-bb25-fe41fc1271da admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:23.137005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc668707-d2c7-4eb4-bb25-fe41fc1271da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:23.142053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc668707-d2c7-4eb4-bb25-fe41fc1271da admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:23.181518 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2265/4542] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:01:23 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:23.183470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc258d9-0118-4e14-9868-8fc1adc5e3ba admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:23.202016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc258d9-0118-4e14-9868-8fc1adc5e3ba admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:23.211545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f59512-69d5-4b49-9236-82e3d3e42b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:23.212328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f59512-69d5-4b49-9236-82e3d3e42b46 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:23.213155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f59512-69d5-4b49-9236-82e3d3e42b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:23.213585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f59512-69d5-4b49-9236-82e3d3e42b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:23.214602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f59512-69d5-4b49-9236-82e3d3e42b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:23.217447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f59512-69d5-4b49-9236-82e3d3e42b46 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:23.255456 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2278/4543] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:23.259402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc668707-d2c7-4eb4-bb25-fe41fc1271da admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:23.277091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc668707-d2c7-4eb4-bb25-fe41fc1271da admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:23.287205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9c3e9-4f44-4471-b2e9-e97ba2922abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:23.288093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9c3e9-4f44-4471-b2e9-e97ba2922abe admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:23.288527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9c3e9-4f44-4471-b2e9-e97ba2922abe admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:23.288973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9c3e9-4f44-4471-b2e9-e97ba2922abe admin admin] PATH_INFO: `/v3/projects/d6341ed0c7c043038ac39dee943aa6a1/users/c3b5c72236ae46e9ba0f37affa6eaf87/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:23.315298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9c3e9-4f44-4471-b2e9-e97ba2922abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6341ed0c7c043038ac39dee943aa6a1, user_id=c3b5c72236ae46e9ba0f37affa6eaf87, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:23.320128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9c3e9-4f44-4471-b2e9-e97ba2922abe admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:23.347531 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2266/4544] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:01:23 2022] PUT /identity/v3/projects/d6341ed0c7c043038ac39dee943aa6a1/users/c3b5c72236ae46e9ba0f37affa6eaf87/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:01:23.351379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f59512-69d5-4b49-9236-82e3d3e42b46 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:23.369368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f59512-69d5-4b49-9236-82e3d3e42b46 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:23.479206 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ea678-7a88-4362-8bb1-b9f611dc6890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:23.480072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ea678-7a88-4362-8bb1-b9f611dc6890 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:23.480592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ea678-7a88-4362-8bb1-b9f611dc6890 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:23.481194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ea678-7a88-4362-8bb1-b9f611dc6890 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:23.485225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ea678-7a88-4362-8bb1-b9f611dc6890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:23.487632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ea678-7a88-4362-8bb1-b9f611dc6890 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:23.505012 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2279/4545] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:23.505690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9c3e9-4f44-4471-b2e9-e97ba2922abe admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:23.530431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9c3e9-4f44-4471-b2e9-e97ba2922abe admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:23.534595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91679143-ac6f-44ba-b9c4-e318718f9f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:23.535273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91679143-ac6f-44ba-b9c4-e318718f9f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:23.535545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91679143-ac6f-44ba-b9c4-e318718f9f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:23.535809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91679143-ac6f-44ba-b9c4-e318718f9f58 admin admin] PATH_INFO: `/v3/projects/d6341ed0c7c043038ac39dee943aa6a1/users/c3b5c72236ae46e9ba0f37affa6eaf87/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:23.537798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91679143-ac6f-44ba-b9c4-e318718f9f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6341ed0c7c043038ac39dee943aa6a1, user_id=c3b5c72236ae46e9ba0f37affa6eaf87, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:23.540428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91679143-ac6f-44ba-b9c4-e318718f9f58 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:23.603573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ceed54-1d8e-4262-bbc4-e7bfd6c4538c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:23.604055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ceed54-1d8e-4262-bbc4-e7bfd6c4538c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:23.604440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ceed54-1d8e-4262-bbc4-e7bfd6c4538c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:23.608390 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2267/4546] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:01:23 2022] PUT /identity/v3/projects/d6341ed0c7c043038ac39dee943aa6a1/users/c3b5c72236ae46e9ba0f37affa6eaf87/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:01:23.729541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-21ceed54-1d8e-4262-bbc4-e7bfd6c4538c None None] MFA Rules not processed for user `c3b5c72236ae46e9ba0f37affa6eaf87`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:23.733156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-21ceed54-1d8e-4262-bbc4-e7bfd6c4538c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:23.785574 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:23.842340 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2280/4547] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:23.847169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91679143-ac6f-44ba-b9c4-e318718f9f58 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:23.863201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91679143-ac6f-44ba-b9c4-e318718f9f58 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:23.873904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c427a-304b-448b-998b-98ead607d15e tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b5c72236ae46e9ba0f37affa6eaf87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6341ed0c7c043038ac39dee943aa6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:23.875458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c427a-304b-448b-998b-98ead607d15e tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:23.875898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c427a-304b-448b-998b-98ead607d15e tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:23.876313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c427a-304b-448b-998b-98ead607d15e tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:23.877938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c427a-304b-448b-998b-98ead607d15e tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:01:23.878400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c427a-304b-448b-998b-98ead607d15e tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:23.880914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c427a-304b-448b-998b-98ead607d15e tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:23.899203 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2268/4548] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:01:23.901594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ceed54-1d8e-4262-bbc4-e7bfd6c4538c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:23.915742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ceed54-1d8e-4262-bbc4-e7bfd6c4538c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:23.929606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c6f7d-d390-42a3-bcfa-aff9163705dd tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b5c72236ae46e9ba0f37affa6eaf87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6341ed0c7c043038ac39dee943aa6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:23.930398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c6f7d-d390-42a3-bcfa-aff9163705dd tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:23.930779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c6f7d-d390-42a3-bcfa-aff9163705dd tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:23.931171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c6f7d-d390-42a3-bcfa-aff9163705dd tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:23.931938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c6f7d-d390-42a3-bcfa-aff9163705dd tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:23.934078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c6f7d-d390-42a3-bcfa-aff9163705dd tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:23.972165 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2281/4549] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:01:23 2022] POST /identity/v3/projects => generated 349 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:23.976685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c427a-304b-448b-998b-98ead607d15e tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:23.997909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c427a-304b-448b-998b-98ead607d15e tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:24.081461 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:24.100298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a6e96-347c-479c-863c-6d452500f88d tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b5c72236ae46e9ba0f37affa6eaf87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6341ed0c7c043038ac39dee943aa6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:24.101250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a6e96-347c-479c-863c-6d452500f88d tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:24.101623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a6e96-347c-479c-863c-6d452500f88d tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:24.102199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a6e96-347c-479c-863c-6d452500f88d tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:24.102922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a6e96-347c-479c-863c-6d452500f88d tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:01:24.103788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a6e96-347c-479c-863c-6d452500f88d tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:24.105771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a6e96-347c-479c-863c-6d452500f88d tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:24.119771 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2269/4550] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:01:24.134675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c6f7d-d390-42a3-bcfa-aff9163705dd tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:24.137290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fe9c6f7d-d390-42a3-bcfa-aff9163705dd tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:24.258553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c6f7d-d390-42a3-bcfa-aff9163705dd tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:24.263092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322ac33-ee39-4d9f-9364-024949c39de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:24.263885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322ac33-ee39-4d9f-9364-024949c39de0 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:24.264168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322ac33-ee39-4d9f-9364-024949c39de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:24.264440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322ac33-ee39-4d9f-9364-024949c39de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:24.275203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322ac33-ee39-4d9f-9364-024949c39de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:24.276791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322ac33-ee39-4d9f-9364-024949c39de0 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:24.287541 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2282/4551] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:01:24.324006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a6e96-347c-479c-863c-6d452500f88d tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:24.326080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f23a6e96-347c-479c-863c-6d452500f88d tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:24.450372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a6e96-347c-479c-863c-6d452500f88d tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:24.457059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f419c4-c256-40df-9160-2a94e261600a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:24.458003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f419c4-c256-40df-9160-2a94e261600a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:24.458283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f419c4-c256-40df-9160-2a94e261600a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:24.458553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f419c4-c256-40df-9160-2a94e261600a admin admin] PATH_INFO: `/v3/users/ce5aed350c58448fab42cdffd677a413` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:24.459690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f419c4-c256-40df-9160-2a94e261600a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce5aed350c58448fab42cdffd677a413)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:24.462402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f419c4-c256-40df-9160-2a94e261600a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:24.526670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-85f419c4-c256-40df-9160-2a94e261600a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce5aed350c58448fab42cdffd677a413'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:24.541713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-85f419c4-c256-40df-9160-2a94e261600a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce5aed350c58448fab42cdffd677a413'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:24.542710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-85f419c4-c256-40df-9160-2a94e261600a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce5aed350c58448fab42cdffd677a413'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:24.561619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-85f419c4-c256-40df-9160-2a94e261600a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce5aed350c58448fab42cdffd677a413'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:24.570862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-85f419c4-c256-40df-9160-2a94e261600a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce5aed350c58448fab42cdffd677a413'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:24.577422 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2270/4552] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:01:24 2022] DELETE /identity/v3/users/ce5aed350c58448fab42cdffd677a413 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:25.239954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322ac33-ee39-4d9f-9364-024949c39de0 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:25.253529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322ac33-ee39-4d9f-9364-024949c39de0 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:25.373697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011aeab1-5003-43c7-9864-c58f3d66658b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:25.375279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011aeab1-5003-43c7-9864-c58f3d66658b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:25.378215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011aeab1-5003-43c7-9864-c58f3d66658b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:25.378575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011aeab1-5003-43c7-9864-c58f3d66658b admin admin] PATH_INFO: `/v3/projects/68f6ce3ab988464e954802e44aaf2ecf` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:25.380223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011aeab1-5003-43c7-9864-c58f3d66658b admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f6ce3ab988464e954802e44aaf2ecf)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:25.385129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011aeab1-5003-43c7-9864-c58f3d66658b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:25.559999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-011aeab1-5003-43c7-9864-c58f3d66658b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f6ce3ab988464e954802e44aaf2ecf', 'request_id': 'req-011aeab1-5003-43c7-9864-c58f3d66658b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:25.562473 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:25.575994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-011aeab1-5003-43c7-9864-c58f3d66658b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f6ce3ab988464e954802e44aaf2ecf', 'request_id': 'req-011aeab1-5003-43c7-9864-c58f3d66658b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:25.585543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-011aeab1-5003-43c7-9864-c58f3d66658b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f6ce3ab988464e954802e44aaf2ecf', 'request_id': 'req-011aeab1-5003-43c7-9864-c58f3d66658b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:25.609625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-011aeab1-5003-43c7-9864-c58f3d66658b admin admin] The token cache is being invalidate because project 68f6ce3ab988464e954802e44aaf2ecf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:01:25.615231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-011aeab1-5003-43c7-9864-c58f3d66658b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:25.618048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-011aeab1-5003-43c7-9864-c58f3d66658b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:25.621300 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2283/4553] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:01:25 2022] DELETE /identity/v3/projects/68f6ce3ab988464e954802e44aaf2ecf => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:25.627559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b8233-cbda-4c76-938a-9ce29c22ce4d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:25.628188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b8233-cbda-4c76-938a-9ce29c22ce4d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:25.628373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b8233-cbda-4c76-938a-9ce29c22ce4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:25.672883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-377b8233-cbda-4c76-938a-9ce29c22ce4d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:25.678652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-377b8233-cbda-4c76-938a-9ce29c22ce4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:25.820271 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2271/4554] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:25.827908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25ee7d-24d4-4496-b16b-801c8c1f4fc6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:25.828215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25ee7d-24d4-4496-b16b-801c8c1f4fc6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:25.828565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25ee7d-24d4-4496-b16b-801c8c1f4fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:25.865022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-db25ee7d-24d4-4496-b16b-801c8c1f4fc6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:25.866541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-db25ee7d-24d4-4496-b16b-801c8c1f4fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:25.898088 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2284/4555] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:25.898903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b8233-cbda-4c76-938a-9ce29c22ce4d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:25.910790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b8233-cbda-4c76-938a-9ce29c22ce4d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:25.924261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e2ab7-6b0d-4942-87a4-87894a62d355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:25.924927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e2ab7-6b0d-4942-87a4-87894a62d355 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:25.925224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e2ab7-6b0d-4942-87a4-87894a62d355 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:25.925713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e2ab7-6b0d-4942-87a4-87894a62d355 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:25.926512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e2ab7-6b0d-4942-87a4-87894a62d355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:01:25.926779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e2ab7-6b0d-4942-87a4-87894a62d355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:25.928940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e2ab7-6b0d-4942-87a4-87894a62d355 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:25.931238 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:25.966506 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2272/4556] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:01:25.968329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25ee7d-24d4-4496-b16b-801c8c1f4fc6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:25.987860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25ee7d-24d4-4496-b16b-801c8c1f4fc6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:26.003180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808aa135-dbc0-4099-82a5-c4c6633693ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:26.004479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808aa135-dbc0-4099-82a5-c4c6633693ad admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:26.004840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808aa135-dbc0-4099-82a5-c4c6633693ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:26.005160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808aa135-dbc0-4099-82a5-c4c6633693ad admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:26.006663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808aa135-dbc0-4099-82a5-c4c6633693ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:26.015124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808aa135-dbc0-4099-82a5-c4c6633693ad admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:26.108452 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2285/4557] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:01:25 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:26.112981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e2ab7-6b0d-4942-87a4-87894a62d355 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:26.124877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e2ab7-6b0d-4942-87a4-87894a62d355 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:26.250438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250c5a1-6002-45f6-b9a6-fa8fd6619280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:26.251429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250c5a1-6002-45f6-b9a6-fa8fd6619280 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:26.253320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250c5a1-6002-45f6-b9a6-fa8fd6619280 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:26.253698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250c5a1-6002-45f6-b9a6-fa8fd6619280 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:26.254567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250c5a1-6002-45f6-b9a6-fa8fd6619280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:26.257250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250c5a1-6002-45f6-b9a6-fa8fd6619280 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:26.310058 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2273/4558] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:01:26 2022] POST /identity/v3/users => generated 294 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:26.314663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808aa135-dbc0-4099-82a5-c4c6633693ad admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:26.327953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808aa135-dbc0-4099-82a5-c4c6633693ad admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:26.335606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5897f4-4224-4f2a-885f-32b896774d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:26.336330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5897f4-4224-4f2a-885f-32b896774d86 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:26.338450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5897f4-4224-4f2a-885f-32b896774d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:26.338782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5897f4-4224-4f2a-885f-32b896774d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:26.339796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5897f4-4224-4f2a-885f-32b896774d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:26.343790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5897f4-4224-4f2a-885f-32b896774d86 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:26.388322 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2286/4559] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:01:26.389749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250c5a1-6002-45f6-b9a6-fa8fd6619280 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:26.404148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250c5a1-6002-45f6-b9a6-fa8fd6619280 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:26.411767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44cce3-8d1a-4607-9177-fc1356bb9bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:26.413467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44cce3-8d1a-4607-9177-fc1356bb9bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:26.413763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44cce3-8d1a-4607-9177-fc1356bb9bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:26.414042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44cce3-8d1a-4607-9177-fc1356bb9bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:26.414925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44cce3-8d1a-4607-9177-fc1356bb9bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:26.420941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44cce3-8d1a-4607-9177-fc1356bb9bc4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:26.448648 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2274/4560] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:26.450965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5897f4-4224-4f2a-885f-32b896774d86 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:26.464065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5897f4-4224-4f2a-885f-32b896774d86 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:26.470009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8718bc-1cee-4865-b129-58d3de8f5054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:26.470942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8718bc-1cee-4865-b129-58d3de8f5054 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:26.471291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8718bc-1cee-4865-b129-58d3de8f5054 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:26.471974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8718bc-1cee-4865-b129-58d3de8f5054 admin admin] PATH_INFO: `/v3/projects/f8963f2d684b4a389d9abafdec3ce426/users/8a8becc2eeef442a8c71cdfcd28a5bc9/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:26.492049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8718bc-1cee-4865-b129-58d3de8f5054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8963f2d684b4a389d9abafdec3ce426, user_id=8a8becc2eeef442a8c71cdfcd28a5bc9, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:26.497220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8718bc-1cee-4865-b129-58d3de8f5054 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:26.531522 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2287/4561] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:01:26 2022] PUT /identity/v3/projects/f8963f2d684b4a389d9abafdec3ce426/users/8a8becc2eeef442a8c71cdfcd28a5bc9/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:26.537565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d17a9-431e-4882-8478-4ed60a4e08d0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:26.537952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d17a9-431e-4882-8478-4ed60a4e08d0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:26.538321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d17a9-431e-4882-8478-4ed60a4e08d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:26.610088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3f2d17a9-431e-4882-8478-4ed60a4e08d0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:26.614602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3f2d17a9-431e-4882-8478-4ed60a4e08d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:26.728328 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2275/4562] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:26.789614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8718bc-1cee-4865-b129-58d3de8f5054 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:26.792926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2d8718bc-1cee-4865-b129-58d3de8f5054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:26.897564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8718bc-1cee-4865-b129-58d3de8f5054 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:26.902286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a760c4-615b-4829-a2f2-a93a7b39ca93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:26.903364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a760c4-615b-4829-a2f2-a93a7b39ca93 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:26.903810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a760c4-615b-4829-a2f2-a93a7b39ca93 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:26.904230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a760c4-615b-4829-a2f2-a93a7b39ca93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:26.924997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a760c4-615b-4829-a2f2-a93a7b39ca93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:26.936685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a760c4-615b-4829-a2f2-a93a7b39ca93 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:26.973502 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2288/4563] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:01:27.543336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb05ea2-d2ff-4265-b178-55b8670eb895 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:27.543607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb05ea2-d2ff-4265-b178-55b8670eb895 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:27.543881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb05ea2-d2ff-4265-b178-55b8670eb895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:27.601376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-efb05ea2-d2ff-4265-b178-55b8670eb895 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:27.602517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-efb05ea2-d2ff-4265-b178-55b8670eb895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:27.675260 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2276/4564] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:01:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:27.735112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a760c4-615b-4829-a2f2-a93a7b39ca93 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:27.737708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a1a760c4-615b-4829-a2f2-a93a7b39ca93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:27.845954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a760c4-615b-4829-a2f2-a93a7b39ca93 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:27.852971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c94c4-f290-4ad6-95e2-dff0b764325d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:27.853914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c94c4-f290-4ad6-95e2-dff0b764325d service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:27.854435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c94c4-f290-4ad6-95e2-dff0b764325d service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:27.854904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c94c4-f290-4ad6-95e2-dff0b764325d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:27.877365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c94c4-f290-4ad6-95e2-dff0b764325d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:27.880418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c94c4-f290-4ad6-95e2-dff0b764325d service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:27.892366 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2289/4565] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:01:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:01:29.315527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb05ea2-d2ff-4265-b178-55b8670eb895 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:29.317779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-efb05ea2-d2ff-4265-b178-55b8670eb895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:29.350010 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:29.503149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb05ea2-d2ff-4265-b178-55b8670eb895 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:29.519550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174fd65-8dba-45fd-ac89-178365fca07b tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b5c72236ae46e9ba0f37affa6eaf87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6341ed0c7c043038ac39dee943aa6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:29.521335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174fd65-8dba-45fd-ac89-178365fca07b tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:29.523874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174fd65-8dba-45fd-ac89-178365fca07b tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:29.524377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174fd65-8dba-45fd-ac89-178365fca07b tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] PATH_INFO: `/v3/projects/1cb513f0f5a24db8a700e6bd1366d4dc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:29.526610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174fd65-8dba-45fd-ac89-178365fca07b tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1cb513f0f5a24db8a700e6bd1366d4dc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:29.529711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174fd65-8dba-45fd-ac89-178365fca07b tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:29.646525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c174fd65-8dba-45fd-ac89-178365fca07b tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb513f0f5a24db8a700e6bd1366d4dc', 'request_id': 'req-c174fd65-8dba-45fd-ac89-178365fca07b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:29.664877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c174fd65-8dba-45fd-ac89-178365fca07b tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb513f0f5a24db8a700e6bd1366d4dc', 'request_id': 'req-c174fd65-8dba-45fd-ac89-178365fca07b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:29.676031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c174fd65-8dba-45fd-ac89-178365fca07b tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb513f0f5a24db8a700e6bd1366d4dc', 'request_id': 'req-c174fd65-8dba-45fd-ac89-178365fca07b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:29.698929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c174fd65-8dba-45fd-ac89-178365fca07b tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] The token cache is being invalidate because project 1cb513f0f5a24db8a700e6bd1366d4dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:01:29.699156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c174fd65-8dba-45fd-ac89-178365fca07b tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:29.701173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c174fd65-8dba-45fd-ac89-178365fca07b tempest-QuotasNegativeTest-401566867 tempest-QuotasNegativeTest-401566867-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:29.708020 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2277/4566] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:01:29 2022] DELETE /identity/v3/projects/1cb513f0f5a24db8a700e6bd1366d4dc => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:29.713857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c94c4-f290-4ad6-95e2-dff0b764325d service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:29.716078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-234c94c4-f290-4ad6-95e2-dff0b764325d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:29.743632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c94c4-f290-4ad6-95e2-dff0b764325d service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:29.770862 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:29.929758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a3de6-72d2-4292-b679-fa88271b1190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:29.930642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a3de6-72d2-4292-b679-fa88271b1190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:29.931072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a3de6-72d2-4292-b679-fa88271b1190 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:29.931630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a3de6-72d2-4292-b679-fa88271b1190 admin admin] PATH_INFO: `/v3/users/4c0cf2819ebb4b28bfe874988ab2b81a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:29.933691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a3de6-72d2-4292-b679-fa88271b1190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c0cf2819ebb4b28bfe874988ab2b81a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:29.937793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a3de6-72d2-4292-b679-fa88271b1190 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:30.057422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ef8a3de6-72d2-4292-b679-fa88271b1190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c0cf2819ebb4b28bfe874988ab2b81a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:30.058457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ef8a3de6-72d2-4292-b679-fa88271b1190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c0cf2819ebb4b28bfe874988ab2b81a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:30.082485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ef8a3de6-72d2-4292-b679-fa88271b1190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c0cf2819ebb4b28bfe874988ab2b81a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:30.125817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ef8a3de6-72d2-4292-b679-fa88271b1190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c0cf2819ebb4b28bfe874988ab2b81a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:30.147525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ef8a3de6-72d2-4292-b679-fa88271b1190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c0cf2819ebb4b28bfe874988ab2b81a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:30.172353 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2290/4567] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:01:29 2022] DELETE /identity/v3/users/4c0cf2819ebb4b28bfe874988ab2b81a => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:30.177312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309744dd-6821-4873-bf6d-5bc5699d61ac None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:30.177591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309744dd-6821-4873-bf6d-5bc5699d61ac None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:30.177861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309744dd-6821-4873-bf6d-5bc5699d61ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:30.213467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-309744dd-6821-4873-bf6d-5bc5699d61ac None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:30.214420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-309744dd-6821-4873-bf6d-5bc5699d61ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:30.380483 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2278/4568] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:30.390672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a3de6-72d2-4292-b679-fa88271b1190 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:30.392828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ef8a3de6-72d2-4292-b679-fa88271b1190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:30.570289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a3de6-72d2-4292-b679-fa88271b1190 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:30.581264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aac079-3506-44df-af53-06230fee0754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:30.581900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aac079-3506-44df-af53-06230fee0754 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:30.582179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aac079-3506-44df-af53-06230fee0754 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:30.582456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aac079-3506-44df-af53-06230fee0754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:30.606840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aac079-3506-44df-af53-06230fee0754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:30.612252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aac079-3506-44df-af53-06230fee0754 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:30.636529 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2291/4569] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:01:31.387401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309744dd-6821-4873-bf6d-5bc5699d61ac None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:31.390073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-309744dd-6821-4873-bf6d-5bc5699d61ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:31.415526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309744dd-6821-4873-bf6d-5bc5699d61ac None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:31.430743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb39c01-a62b-460a-8be5-1a4fc84ec4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:31.431756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb39c01-a62b-460a-8be5-1a4fc84ec4d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:31.432285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb39c01-a62b-460a-8be5-1a4fc84ec4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:31.432788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb39c01-a62b-460a-8be5-1a4fc84ec4d9 admin admin] PATH_INFO: `/v3/projects/b4df2f3e16e04ce5b45ccdfa4ebaa208` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:31.437758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb39c01-a62b-460a-8be5-1a4fc84ec4d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4df2f3e16e04ce5b45ccdfa4ebaa208)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:31.441458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb39c01-a62b-460a-8be5-1a4fc84ec4d9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:31.538749 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:31.559972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ecb39c01-a62b-460a-8be5-1a4fc84ec4d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4df2f3e16e04ce5b45ccdfa4ebaa208', 'request_id': 'req-ecb39c01-a62b-460a-8be5-1a4fc84ec4d9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:31.572330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ecb39c01-a62b-460a-8be5-1a4fc84ec4d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4df2f3e16e04ce5b45ccdfa4ebaa208', 'request_id': 'req-ecb39c01-a62b-460a-8be5-1a4fc84ec4d9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:31.584009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ecb39c01-a62b-460a-8be5-1a4fc84ec4d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4df2f3e16e04ce5b45ccdfa4ebaa208', 'request_id': 'req-ecb39c01-a62b-460a-8be5-1a4fc84ec4d9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:31.604169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ecb39c01-a62b-460a-8be5-1a4fc84ec4d9 admin admin] The token cache is being invalidate because project b4df2f3e16e04ce5b45ccdfa4ebaa208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:01:31.604668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ecb39c01-a62b-460a-8be5-1a4fc84ec4d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:31.605767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ecb39c01-a62b-460a-8be5-1a4fc84ec4d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:31.608030 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2279/4570] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:01:31 2022] DELETE /identity/v3/projects/b4df2f3e16e04ce5b45ccdfa4ebaa208 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:31.612818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aac079-3506-44df-af53-06230fee0754 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:31.629197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aac079-3506-44df-af53-06230fee0754 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:31.680012 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:31.762868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e6ddb-e3e3-4e24-8840-81f0b232d31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:31.763511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e6ddb-e3e3-4e24-8840-81f0b232d31e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:31.763791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e6ddb-e3e3-4e24-8840-81f0b232d31e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:31.764063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e6ddb-e3e3-4e24-8840-81f0b232d31e admin admin] PATH_INFO: `/v3/users/c3b5c72236ae46e9ba0f37affa6eaf87` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:31.767177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e6ddb-e3e3-4e24-8840-81f0b232d31e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3b5c72236ae46e9ba0f37affa6eaf87)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:31.770706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e6ddb-e3e3-4e24-8840-81f0b232d31e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:31.895400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a18e6ddb-e3e3-4e24-8840-81f0b232d31e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3b5c72236ae46e9ba0f37affa6eaf87'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:31.896962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a18e6ddb-e3e3-4e24-8840-81f0b232d31e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3b5c72236ae46e9ba0f37affa6eaf87'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:31.919269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a18e6ddb-e3e3-4e24-8840-81f0b232d31e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3b5c72236ae46e9ba0f37affa6eaf87'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:31.948005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a18e6ddb-e3e3-4e24-8840-81f0b232d31e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3b5c72236ae46e9ba0f37affa6eaf87'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:31.965810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a18e6ddb-e3e3-4e24-8840-81f0b232d31e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3b5c72236ae46e9ba0f37affa6eaf87'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:31.979646 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2292/4571] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:01:31 2022] DELETE /identity/v3/users/c3b5c72236ae46e9ba0f37affa6eaf87 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:01:32.623750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb39c01-a62b-460a-8be5-1a4fc84ec4d9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:32.625420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ecb39c01-a62b-460a-8be5-1a4fc84ec4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:32.691388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb39c01-a62b-460a-8be5-1a4fc84ec4d9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:32.877577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7b358-97ef-40f6-801f-5d166b3bcb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:32.878304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7b358-97ef-40f6-801f-5d166b3bcb3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:32.878835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7b358-97ef-40f6-801f-5d166b3bcb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:32.879788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7b358-97ef-40f6-801f-5d166b3bcb3b admin admin] PATH_INFO: `/v3/projects/d6341ed0c7c043038ac39dee943aa6a1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:32.882428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7b358-97ef-40f6-801f-5d166b3bcb3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6341ed0c7c043038ac39dee943aa6a1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:32.884971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7b358-97ef-40f6-801f-5d166b3bcb3b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:32.992906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3df7b358-97ef-40f6-801f-5d166b3bcb3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6341ed0c7c043038ac39dee943aa6a1', 'request_id': 'req-3df7b358-97ef-40f6-801f-5d166b3bcb3b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:33.010527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3df7b358-97ef-40f6-801f-5d166b3bcb3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6341ed0c7c043038ac39dee943aa6a1', 'request_id': 'req-3df7b358-97ef-40f6-801f-5d166b3bcb3b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:33.023844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3df7b358-97ef-40f6-801f-5d166b3bcb3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6341ed0c7c043038ac39dee943aa6a1', 'request_id': 'req-3df7b358-97ef-40f6-801f-5d166b3bcb3b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:33.058345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3df7b358-97ef-40f6-801f-5d166b3bcb3b admin admin] The token cache is being invalidate because project d6341ed0c7c043038ac39dee943aa6a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:01:33.059284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3df7b358-97ef-40f6-801f-5d166b3bcb3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:33.060069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3df7b358-97ef-40f6-801f-5d166b3bcb3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:33.062651 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2280/4572] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:01:32 2022] DELETE /identity/v3/projects/d6341ed0c7c043038ac39dee943aa6a1 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:33.067650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a28049-470d-40b5-9830-7f61dade6a13 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:33.068657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a28049-470d-40b5-9830-7f61dade6a13 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:33.069228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a28049-470d-40b5-9830-7f61dade6a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:33.108313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a5a28049-470d-40b5-9830-7f61dade6a13 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:33.109940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a5a28049-470d-40b5-9830-7f61dade6a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:33.270740 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2293/4573] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:33.279162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2d30f-1490-4022-8702-161ff075e6e2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:33.279788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2d30f-1490-4022-8702-161ff075e6e2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:33.280329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2d30f-1490-4022-8702-161ff075e6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:33.317749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5fb2d30f-1490-4022-8702-161ff075e6e2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:33.319349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5fb2d30f-1490-4022-8702-161ff075e6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:33.335872 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2281/4574] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:33.342842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a28049-470d-40b5-9830-7f61dade6a13 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:33.358853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a28049-470d-40b5-9830-7f61dade6a13 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:33.374315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf51e5-9466-4b38-994e-09ba4447020c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:33.375324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf51e5-9466-4b38-994e-09ba4447020c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:33.375870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf51e5-9466-4b38-994e-09ba4447020c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:33.376898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf51e5-9466-4b38-994e-09ba4447020c admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:33.377823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf51e5-9466-4b38-994e-09ba4447020c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:01:33.378789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf51e5-9466-4b38-994e-09ba4447020c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:33.383839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf51e5-9466-4b38-994e-09ba4447020c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:33.410496 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2294/4575] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:01:33.414925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2d30f-1490-4022-8702-161ff075e6e2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:33.441953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2d30f-1490-4022-8702-161ff075e6e2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:33.459296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04585a-06af-4205-af30-e647ee5d846e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:33.460316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04585a-06af-4205-af30-e647ee5d846e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:33.460998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04585a-06af-4205-af30-e647ee5d846e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:33.462323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04585a-06af-4205-af30-e647ee5d846e admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:33.463192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04585a-06af-4205-af30-e647ee5d846e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:33.467136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04585a-06af-4205-af30-e647ee5d846e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:33.544991 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2282/4576] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:01:33 2022] POST /identity/v3/projects => generated 405 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:33.551099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf51e5-9466-4b38-994e-09ba4447020c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:33.571334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf51e5-9466-4b38-994e-09ba4447020c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:33.641023 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:33.699837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a80b0-21eb-473e-9d25-b784b4e15228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:33.700515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a80b0-21eb-473e-9d25-b784b4e15228 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:33.700818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a80b0-21eb-473e-9d25-b784b4e15228 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:33.701085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a80b0-21eb-473e-9d25-b784b4e15228 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:33.701860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a80b0-21eb-473e-9d25-b784b4e15228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:33.704026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a80b0-21eb-473e-9d25-b784b4e15228 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:33.776349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04585a-06af-4205-af30-e647ee5d846e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:33.777666 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2295/4577] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:01:33 2022] POST /identity/v3/users => generated 303 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:33.794689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04585a-06af-4205-af30-e647ee5d846e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:33.809737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c640a-511e-456c-942c-7fb3b33a8531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:33.810707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c640a-511e-456c-942c-7fb3b33a8531 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:33.811170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c640a-511e-456c-942c-7fb3b33a8531 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:33.811635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c640a-511e-456c-942c-7fb3b33a8531 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:33.812472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c640a-511e-456c-942c-7fb3b33a8531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:33.815014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c640a-511e-456c-942c-7fb3b33a8531 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:33.847320 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2283/4578] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:33.851185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a80b0-21eb-473e-9d25-b784b4e15228 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:33.873532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a80b0-21eb-473e-9d25-b784b4e15228 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:33.885961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd80af-778b-4e41-8e35-efb347ab721f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:33.886604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd80af-778b-4e41-8e35-efb347ab721f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:33.886944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd80af-778b-4e41-8e35-efb347ab721f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:33.887245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd80af-778b-4e41-8e35-efb347ab721f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:33.888637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd80af-778b-4e41-8e35-efb347ab721f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:33.890774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd80af-778b-4e41-8e35-efb347ab721f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:33.914900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c640a-511e-456c-942c-7fb3b33a8531 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:33.915893 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2296/4579] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:33.928233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c640a-511e-456c-942c-7fb3b33a8531 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:33.948209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa69e4-1282-4f43-8db2-1a2ce491d78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:33.949931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa69e4-1282-4f43-8db2-1a2ce491d78e admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:33.950364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa69e4-1282-4f43-8db2-1a2ce491d78e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:33.950794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa69e4-1282-4f43-8db2-1a2ce491d78e admin admin] PATH_INFO: `/v3/projects/b8e713138cb949f697e83b26b32004bc/users/4279947dfd264989942f60302c1dd47e/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:33.976977 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:33.992566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa69e4-1282-4f43-8db2-1a2ce491d78e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e713138cb949f697e83b26b32004bc, user_id=4279947dfd264989942f60302c1dd47e, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:34.009638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa69e4-1282-4f43-8db2-1a2ce491d78e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:34.041290 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2284/4580] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:01:33 2022] PUT /identity/v3/projects/b8e713138cb949f697e83b26b32004bc/users/4279947dfd264989942f60302c1dd47e/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:34.056913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b0f7b-2b18-48f3-a805-52e68c2accc3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:34.057609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b0f7b-2b18-48f3-a805-52e68c2accc3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:34.057941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b0f7b-2b18-48f3-a805-52e68c2accc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:34.120270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-be3b0f7b-2b18-48f3-a805-52e68c2accc3 None None] MFA Rules not processed for user `4279947dfd264989942f60302c1dd47e`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:34.123166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-be3b0f7b-2b18-48f3-a805-52e68c2accc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:34.257685 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2297/4581] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:34 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:34.261898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa69e4-1282-4f43-8db2-1a2ce491d78e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:34.435543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa69e4-1282-4f43-8db2-1a2ce491d78e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:34.441880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796174a-edf2-4175-a9ae-2739ea6d6fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:34.442877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796174a-edf2-4175-a9ae-2739ea6d6fdc admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:34.443395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796174a-edf2-4175-a9ae-2739ea6d6fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:34.443979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796174a-edf2-4175-a9ae-2739ea6d6fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:34.444789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796174a-edf2-4175-a9ae-2739ea6d6fdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:34.445742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c26d8-f494-4b14-8dbc-a7be27e7fa37 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:34.446445 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c26d8-f494-4b14-8dbc-a7be27e7fa37 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:34.446880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c26d8-f494-4b14-8dbc-a7be27e7fa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:34.448090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796174a-edf2-4175-a9ae-2739ea6d6fdc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:34.493557 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2285/4582] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:01:34 2022] POST /identity/v3/projects => generated 407 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:34.501962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796174a-edf2-4175-a9ae-2739ea6d6fdc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:34.522471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ac3c26d8-f494-4b14-8dbc-a7be27e7fa37 None None] MFA Rules not processed for user `8bb9a3b41bbc4a11a1e50fb2f5de5c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:34.527122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ac3c26d8-f494-4b14-8dbc-a7be27e7fa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:34.655567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796174a-edf2-4175-a9ae-2739ea6d6fdc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:34.673965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9afde56-39dd-40d2-896f-1d96bd128a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:34.674613 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afde56-39dd-40d2-896f-1d96bd128a47 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:34.674893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afde56-39dd-40d2-896f-1d96bd128a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:34.675169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afde56-39dd-40d2-896f-1d96bd128a47 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:34.675826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9afde56-39dd-40d2-896f-1d96bd128a47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:34.677884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9afde56-39dd-40d2-896f-1d96bd128a47 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:34.761171 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2298/4583] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:34.808653 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2286/4584] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:01:34 2022] POST /identity/v3/users => generated 310 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:01:34.811049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c26d8-f494-4b14-8dbc-a7be27e7fa37 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:34.824470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c26d8-f494-4b14-8dbc-a7be27e7fa37 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:34.849425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea65e9-786e-4800-b524-78b5e90f2893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:34.850631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea65e9-786e-4800-b524-78b5e90f2893 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:34.850985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea65e9-786e-4800-b524-78b5e90f2893 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:34.851317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea65e9-786e-4800-b524-78b5e90f2893 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:34.852048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea65e9-786e-4800-b524-78b5e90f2893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:34.853750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea65e9-786e-4800-b524-78b5e90f2893 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:34.897177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9afde56-39dd-40d2-896f-1d96bd128a47 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:34.922975 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2299/4585] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:34.924131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9afde56-39dd-40d2-896f-1d96bd128a47 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:34.943381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32f376-7429-4f4c-bf02-68e325d8b753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:34.944164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32f376-7429-4f4c-bf02-68e325d8b753 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:34.944714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32f376-7429-4f4c-bf02-68e325d8b753 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:34.948737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32f376-7429-4f4c-bf02-68e325d8b753 admin admin] PATH_INFO: `/v3/projects/1d24b927234b43c79d0b680308a7fe71/users/ef50c50df3be4c47b8ae70118b61df7b/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:34.984399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32f376-7429-4f4c-bf02-68e325d8b753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d24b927234b43c79d0b680308a7fe71, user_id=ef50c50df3be4c47b8ae70118b61df7b, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:34.997249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32f376-7429-4f4c-bf02-68e325d8b753 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:35.035816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea65e9-786e-4800-b524-78b5e90f2893 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:35.036449 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2287/4586] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:01:34 2022] PUT /identity/v3/projects/1d24b927234b43c79d0b680308a7fe71/users/ef50c50df3be4c47b8ae70118b61df7b/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:35.048094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea65e9-786e-4800-b524-78b5e90f2893 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:35.102589 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:35.139519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfd4cd-ccea-4bf2-9ed3-61568206cfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:35.140836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfd4cd-ccea-4bf2-9ed3-61568206cfcc admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:35.141318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfd4cd-ccea-4bf2-9ed3-61568206cfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:35.142542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfd4cd-ccea-4bf2-9ed3-61568206cfcc admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:35.144255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfd4cd-ccea-4bf2-9ed3-61568206cfcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:35.146221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfd4cd-ccea-4bf2-9ed3-61568206cfcc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:35.167698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32f376-7429-4f4c-bf02-68e325d8b753 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:35.179403 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2300/4587] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:01:35.182998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32f376-7429-4f4c-bf02-68e325d8b753 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:35.188554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c6a8f-b931-409e-a789-fd677225a7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:35.190092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c6a8f-b931-409e-a789-fd677225a7c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:35.190594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c6a8f-b931-409e-a789-fd677225a7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:35.191462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c6a8f-b931-409e-a789-fd677225a7c1 admin admin] PATH_INFO: `/v3/projects/1d24b927234b43c79d0b680308a7fe71/users/ef50c50df3be4c47b8ae70118b61df7b/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:35.194301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c6a8f-b931-409e-a789-fd677225a7c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d24b927234b43c79d0b680308a7fe71, user_id=ef50c50df3be4c47b8ae70118b61df7b, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:35.198291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c6a8f-b931-409e-a789-fd677225a7c1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:35.239406 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2288/4588] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:01:35 2022] PUT /identity/v3/projects/1d24b927234b43c79d0b680308a7fe71/users/ef50c50df3be4c47b8ae70118b61df7b/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:35.242174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e9876-3d41-4d54-b7e8-8e85d7b23aa2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:35.242461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e9876-3d41-4d54-b7e8-8e85d7b23aa2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:35.242799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e9876-3d41-4d54-b7e8-8e85d7b23aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:35.284536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c76e9876-3d41-4d54-b7e8-8e85d7b23aa2 None None] MFA Rules not processed for user `ef50c50df3be4c47b8ae70118b61df7b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:35.285990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c76e9876-3d41-4d54-b7e8-8e85d7b23aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:35.430975 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2301/4589] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:35 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:35.437484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c6a8f-b931-409e-a789-fd677225a7c1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:35.440908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-223c6a8f-b931-409e-a789-fd677225a7c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:35.504460 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:35.578761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c6a8f-b931-409e-a789-fd677225a7c1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:35.589467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02273e-bd76-4bd0-9fe7-5307ac9d3ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:35.590818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02273e-bd76-4bd0-9fe7-5307ac9d3ace service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:35.591202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02273e-bd76-4bd0-9fe7-5307ac9d3ace service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:35.591586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02273e-bd76-4bd0-9fe7-5307ac9d3ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:35.789673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02273e-bd76-4bd0-9fe7-5307ac9d3ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:35.791174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02273e-bd76-4bd0-9fe7-5307ac9d3ace service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:35.824225 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2289/4590] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:35 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:01:37.132302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e9876-3d41-4d54-b7e8-8e85d7b23aa2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:37.134531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c76e9876-3d41-4d54-b7e8-8e85d7b23aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:37.379023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e9876-3d41-4d54-b7e8-8e85d7b23aa2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:37.404526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b6654-8854-4f35-b085-183f7dabe074 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:37.406055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b6654-8854-4f35-b085-183f7dabe074 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:37.408846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b6654-8854-4f35-b085-183f7dabe074 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:37.413483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b6654-8854-4f35-b085-183f7dabe074 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:37.451296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b6654-8854-4f35-b085-183f7dabe074 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:37.468196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b6654-8854-4f35-b085-183f7dabe074 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:37.519916 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2302/4591] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:37 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:01:43.372679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa716c4-1dd5-4b65-9495-396a24994b7c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:43.373229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa716c4-1dd5-4b65-9495-396a24994b7c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:43.373815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa716c4-1dd5-4b65-9495-396a24994b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:43.493709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ffa716c4-1dd5-4b65-9495-396a24994b7c None None] MFA Rules not processed for user `8a8becc2eeef442a8c71cdfcd28a5bc9`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:43.495279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ffa716c4-1dd5-4b65-9495-396a24994b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:43.749240 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2290/4592] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:43.757139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b6654-8854-4f35-b085-183f7dabe074 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:43.759267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5f4b6654-8854-4f35-b085-183f7dabe074 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:43.792634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b6654-8854-4f35-b085-183f7dabe074 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:43.809471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3dd2c2-46fb-45c1-9a74-5b5a255da7ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:43.810299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3dd2c2-46fb-45c1-9a74-5b5a255da7ad service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:43.810737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3dd2c2-46fb-45c1-9a74-5b5a255da7ad service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:43.811393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3dd2c2-46fb-45c1-9a74-5b5a255da7ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:43.833371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3dd2c2-46fb-45c1-9a74-5b5a255da7ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:43.835247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3dd2c2-46fb-45c1-9a74-5b5a255da7ad service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:43.885037 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2303/4593] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:01:48.061135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa716c4-1dd5-4b65-9495-396a24994b7c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:48.087720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa716c4-1dd5-4b65-9495-396a24994b7c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:48.103088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1727fb-3b8b-4404-bb23-7168cdd38532 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:48.104873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1727fb-3b8b-4404-bb23-7168cdd38532 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:48.105162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1727fb-3b8b-4404-bb23-7168cdd38532 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:48.105460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1727fb-3b8b-4404-bb23-7168cdd38532 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:48.109683 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ca1727fb-3b8b-4404-bb23-7168cdd38532 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:48.281011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1727fb-3b8b-4404-bb23-7168cdd38532 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:48.284860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1727fb-3b8b-4404-bb23-7168cdd38532 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:48.334518 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:48.339762 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2291/4594] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:01:51.952405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3dd2c2-46fb-45c1-9a74-5b5a255da7ad service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:51.970403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3dd2c2-46fb-45c1-9a74-5b5a255da7ad service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:52.006674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e574570-2ee2-4d37-a973-f73999a99389 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:52.012373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e574570-2ee2-4d37-a973-f73999a99389 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:52.012926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e574570-2ee2-4d37-a973-f73999a99389 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:52.013716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e574570-2ee2-4d37-a973-f73999a99389 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:52.022524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7e574570-2ee2-4d37-a973-f73999a99389 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:52.132999 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:52.228638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e574570-2ee2-4d37-a973-f73999a99389 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:52.230302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e574570-2ee2-4d37-a973-f73999a99389 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:52.262379 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2304/4595] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:01:54.945936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a1627-8ac9-4e27-9089-3d2b5ff50e63 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:54.946470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a1627-8ac9-4e27-9089-3d2b5ff50e63 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:54.946561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a1627-8ac9-4e27-9089-3d2b5ff50e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:54.975296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b22a1627-8ac9-4e27-9089-3d2b5ff50e63 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:54.976806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b22a1627-8ac9-4e27-9089-3d2b5ff50e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:55.101245 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2292/4596] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 10:01:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 30 10:01:55.111513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e574570-2ee2-4d37-a973-f73999a99389 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:55.113211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7e574570-2ee2-4d37-a973-f73999a99389 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:55.292075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e574570-2ee2-4d37-a973-f73999a99389 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:55.305120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d9e1f-ca03-4d74-9634-046ab543e2c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:55.305879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d9e1f-ca03-4d74-9634-046ab543e2c9 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:55.306164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d9e1f-ca03-4d74-9634-046ab543e2c9 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:55.306494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d9e1f-ca03-4d74-9634-046ab543e2c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:55.322752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d9e1f-ca03-4d74-9634-046ab543e2c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:55.324765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d9e1f-ca03-4d74-9634-046ab543e2c9 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:55.337004 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2305/4597] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:01:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:01:56.686910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b656b16-0a9e-4c0e-839e-b96968bd8c3d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:56.687440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b656b16-0a9e-4c0e-839e-b96968bd8c3d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:56.687440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b656b16-0a9e-4c0e-839e-b96968bd8c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:56.744980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3b656b16-0a9e-4c0e-839e-b96968bd8c3d None None] MFA Rules not processed for user `76de66d46a57438f960c832cb8a70c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:56.746658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3b656b16-0a9e-4c0e-839e-b96968bd8c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:56.859996 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2293/4598] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:57.277141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d9e1f-ca03-4d74-9634-046ab543e2c9 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:57.386789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d9e1f-ca03-4d74-9634-046ab543e2c9 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:57.400755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef0a69-44f9-4041-9c08-b67bc4b339fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:57.401747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef0a69-44f9-4041-9c08-b67bc4b339fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:57.402193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef0a69-44f9-4041-9c08-b67bc4b339fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:57.402772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef0a69-44f9-4041-9c08-b67bc4b339fb admin admin] PATH_INFO: `/v3/users/4279947dfd264989942f60302c1dd47e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:57.404728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef0a69-44f9-4041-9c08-b67bc4b339fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4279947dfd264989942f60302c1dd47e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:57.407199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef0a69-44f9-4041-9c08-b67bc4b339fb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:57.488781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-91ef0a69-44f9-4041-9c08-b67bc4b339fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4279947dfd264989942f60302c1dd47e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:57.489454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-91ef0a69-44f9-4041-9c08-b67bc4b339fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4279947dfd264989942f60302c1dd47e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:57.502781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-91ef0a69-44f9-4041-9c08-b67bc4b339fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4279947dfd264989942f60302c1dd47e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:57.514157 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:57.528166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-91ef0a69-44f9-4041-9c08-b67bc4b339fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4279947dfd264989942f60302c1dd47e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:57.539507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-91ef0a69-44f9-4041-9c08-b67bc4b339fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4279947dfd264989942f60302c1dd47e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:57.563708 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2306/4599] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:01:57 2022] DELETE /identity/v3/users/4279947dfd264989942f60302c1dd47e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:57.564981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cc1e3-1f55-4c19-a9ee-e80fcade2a87 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:57.565475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cc1e3-1f55-4c19-a9ee-e80fcade2a87 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:57.565981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cc1e3-1f55-4c19-a9ee-e80fcade2a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:57.592930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a94cc1e3-1f55-4c19-a9ee-e80fcade2a87 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:01:57.594788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a94cc1e3-1f55-4c19-a9ee-e80fcade2a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:57.716705 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2294/4600] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:01:57.738384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef0a69-44f9-4041-9c08-b67bc4b339fb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:57.740072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-91ef0a69-44f9-4041-9c08-b67bc4b339fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:57.865020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef0a69-44f9-4041-9c08-b67bc4b339fb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:57.869501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af0712-fd22-4284-8a1a-bfa03c22469b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:57.869983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af0712-fd22-4284-8a1a-bfa03c22469b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:57.870272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af0712-fd22-4284-8a1a-bfa03c22469b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:57.870546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af0712-fd22-4284-8a1a-bfa03c22469b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:57.884967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af0712-fd22-4284-8a1a-bfa03c22469b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:57.887058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af0712-fd22-4284-8a1a-bfa03c22469b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:57.905345 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2307/4601] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:01:57.910534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cc1e3-1f55-4c19-a9ee-e80fcade2a87 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:57.928434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cc1e3-1f55-4c19-a9ee-e80fcade2a87 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:57.936079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f1d6a-9545-4f00-acd8-43218cefb960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:57.937243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f1d6a-9545-4f00-acd8-43218cefb960 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:57.937790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f1d6a-9545-4f00-acd8-43218cefb960 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:57.939659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f1d6a-9545-4f00-acd8-43218cefb960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:57.942633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8d8f1d6a-9545-4f00-acd8-43218cefb960 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:57.962738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f1d6a-9545-4f00-acd8-43218cefb960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:57.964310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f1d6a-9545-4f00-acd8-43218cefb960 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:57.986361 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2295/4602] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:01:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:01:58.605515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af0712-fd22-4284-8a1a-bfa03c22469b service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:58.606978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-94af0712-fd22-4284-8a1a-bfa03c22469b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:01:58.631703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af0712-fd22-4284-8a1a-bfa03c22469b service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:58.640768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f84c3-04a2-4566-bb6c-2a3356b7f41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:58.645025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f84c3-04a2-4566-bb6c-2a3356b7f41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:58.645335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f84c3-04a2-4566-bb6c-2a3356b7f41d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:58.645611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f84c3-04a2-4566-bb6c-2a3356b7f41d admin admin] PATH_INFO: `/v3/projects/b8e713138cb949f697e83b26b32004bc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:58.649709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f84c3-04a2-4566-bb6c-2a3356b7f41d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e713138cb949f697e83b26b32004bc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:58.653574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f84c3-04a2-4566-bb6c-2a3356b7f41d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:58.798226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bb8f84c3-04a2-4566-bb6c-2a3356b7f41d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e713138cb949f697e83b26b32004bc', 'request_id': 'req-bb8f84c3-04a2-4566-bb6c-2a3356b7f41d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:58.818455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bb8f84c3-04a2-4566-bb6c-2a3356b7f41d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e713138cb949f697e83b26b32004bc', 'request_id': 'req-bb8f84c3-04a2-4566-bb6c-2a3356b7f41d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:58.836047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bb8f84c3-04a2-4566-bb6c-2a3356b7f41d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e713138cb949f697e83b26b32004bc', 'request_id': 'req-bb8f84c3-04a2-4566-bb6c-2a3356b7f41d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:58.853731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bb8f84c3-04a2-4566-bb6c-2a3356b7f41d admin admin] The token cache is being invalidate because project b8e713138cb949f697e83b26b32004bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:01:58.854032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bb8f84c3-04a2-4566-bb6c-2a3356b7f41d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:58.857047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bb8f84c3-04a2-4566-bb6c-2a3356b7f41d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:58.858650 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2308/4603] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:01:58 2022] DELETE /identity/v3/projects/b8e713138cb949f697e83b26b32004bc => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:01:58.863249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f1d6a-9545-4f00-acd8-43218cefb960 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:01:58.881717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f1d6a-9545-4f00-acd8-43218cefb960 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:01:58.963580 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:01:59.016179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75309ca9-960e-496a-87bc-3fee5372d6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:01:59.016965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75309ca9-960e-496a-87bc-3fee5372d6a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:01:59.017411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75309ca9-960e-496a-87bc-3fee5372d6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:01:59.017841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75309ca9-960e-496a-87bc-3fee5372d6a0 admin admin] PATH_INFO: `/v3/users/ef50c50df3be4c47b8ae70118b61df7b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:01:59.019041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75309ca9-960e-496a-87bc-3fee5372d6a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef50c50df3be4c47b8ae70118b61df7b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:01:59.021098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75309ca9-960e-496a-87bc-3fee5372d6a0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:01:59.129026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-75309ca9-960e-496a-87bc-3fee5372d6a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef50c50df3be4c47b8ae70118b61df7b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:59.143257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-75309ca9-960e-496a-87bc-3fee5372d6a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef50c50df3be4c47b8ae70118b61df7b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:59.144386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-75309ca9-960e-496a-87bc-3fee5372d6a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef50c50df3be4c47b8ae70118b61df7b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:59.182461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-75309ca9-960e-496a-87bc-3fee5372d6a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef50c50df3be4c47b8ae70118b61df7b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:59.192134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-75309ca9-960e-496a-87bc-3fee5372d6a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef50c50df3be4c47b8ae70118b61df7b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:01:59.206924 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2296/4604] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:01:58 2022] DELETE /identity/v3/users/ef50c50df3be4c47b8ae70118b61df7b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:02:00.301781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f84c3-04a2-4566-bb6c-2a3356b7f41d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:00.303422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bb8f84c3-04a2-4566-bb6c-2a3356b7f41d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:00.330281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f84c3-04a2-4566-bb6c-2a3356b7f41d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:00.408241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f0967-1348-425e-97ca-5906dd229aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:00.409399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f0967-1348-425e-97ca-5906dd229aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:00.410391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f0967-1348-425e-97ca-5906dd229aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:00.411464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f0967-1348-425e-97ca-5906dd229aa9 admin admin] PATH_INFO: `/v3/projects/1d24b927234b43c79d0b680308a7fe71` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:00.414338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f0967-1348-425e-97ca-5906dd229aa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d24b927234b43c79d0b680308a7fe71)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:00.417105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f0967-1348-425e-97ca-5906dd229aa9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:00.427064 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:02:00.539977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-741f0967-1348-425e-97ca-5906dd229aa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d24b927234b43c79d0b680308a7fe71', 'request_id': 'req-741f0967-1348-425e-97ca-5906dd229aa9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:00.552319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-741f0967-1348-425e-97ca-5906dd229aa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d24b927234b43c79d0b680308a7fe71', 'request_id': 'req-741f0967-1348-425e-97ca-5906dd229aa9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:00.563170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-741f0967-1348-425e-97ca-5906dd229aa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d24b927234b43c79d0b680308a7fe71', 'request_id': 'req-741f0967-1348-425e-97ca-5906dd229aa9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:00.587822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-741f0967-1348-425e-97ca-5906dd229aa9 admin admin] The token cache is being invalidate because project 1d24b927234b43c79d0b680308a7fe71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:02:00.588271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-741f0967-1348-425e-97ca-5906dd229aa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:00.588959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-741f0967-1348-425e-97ca-5906dd229aa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:00.590665 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2309/4605] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:02:00 2022] DELETE /identity/v3/projects/1d24b927234b43c79d0b680308a7fe71 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:02:00.598725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84c27f-defd-4c49-8c16-23277e7a63f4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:00.599288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84c27f-defd-4c49-8c16-23277e7a63f4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:00.599288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84c27f-defd-4c49-8c16-23277e7a63f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:00.655277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1d84c27f-defd-4c49-8c16-23277e7a63f4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:02:00.657152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1d84c27f-defd-4c49-8c16-23277e7a63f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:00.809181 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2297/4606] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:02:00.817497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a2aa9-8883-4776-bc2f-af64dae3955b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:00.819816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a2aa9-8883-4776-bc2f-af64dae3955b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:00.820470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a2aa9-8883-4776-bc2f-af64dae3955b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:00.900619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ca8a2aa9-8883-4776-bc2f-af64dae3955b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:02:00.908770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ca8a2aa9-8883-4776-bc2f-af64dae3955b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:00.939808 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2310/4607] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:02:00.944576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84c27f-defd-4c49-8c16-23277e7a63f4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:00.959728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84c27f-defd-4c49-8c16-23277e7a63f4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:00.978205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55107097-390d-4c12-80ff-7aef7ae36e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:00.978833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55107097-390d-4c12-80ff-7aef7ae36e85 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:00.979285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55107097-390d-4c12-80ff-7aef7ae36e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:00.979706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55107097-390d-4c12-80ff-7aef7ae36e85 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:00.980553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55107097-390d-4c12-80ff-7aef7ae36e85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:02:00.981032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55107097-390d-4c12-80ff-7aef7ae36e85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:00.982820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55107097-390d-4c12-80ff-7aef7ae36e85 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:00.997816 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2298/4608] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:02:01.003019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a2aa9-8883-4776-bc2f-af64dae3955b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:01.026213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a2aa9-8883-4776-bc2f-af64dae3955b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:01.042367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658e979-37ca-4d91-8115-1e1bae795f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:01.042994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658e979-37ca-4d91-8115-1e1bae795f92 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:01.043272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658e979-37ca-4d91-8115-1e1bae795f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:01.043537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658e979-37ca-4d91-8115-1e1bae795f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:01.044183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658e979-37ca-4d91-8115-1e1bae795f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:01.046705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658e979-37ca-4d91-8115-1e1bae795f92 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:01.105941 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2311/4609] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:02:01 2022] POST /identity/v3/projects => generated 399 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:02:01.110736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55107097-390d-4c12-80ff-7aef7ae36e85 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:01.122945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55107097-390d-4c12-80ff-7aef7ae36e85 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:01.218399 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:02:01.261506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7c4ec-9483-41ae-bb7a-45aabd4a2d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:01.263021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7c4ec-9483-41ae-bb7a-45aabd4a2d21 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:01.272675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7c4ec-9483-41ae-bb7a-45aabd4a2d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:01.273222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7c4ec-9483-41ae-bb7a-45aabd4a2d21 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:01.274046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7c4ec-9483-41ae-bb7a-45aabd4a2d21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:01.276153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7c4ec-9483-41ae-bb7a-45aabd4a2d21 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:01.318322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658e979-37ca-4d91-8115-1e1bae795f92 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:01.320968 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2299/4610] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:02:01 2022] POST /identity/v3/users => generated 300 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:02:01.353398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658e979-37ca-4d91-8115-1e1bae795f92 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:01.365661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c733e-338d-4433-8ab7-239b013a4897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:01.366627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c733e-338d-4433-8ab7-239b013a4897 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:01.366981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c733e-338d-4433-8ab7-239b013a4897 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:01.367368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c733e-338d-4433-8ab7-239b013a4897 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:01.368360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c733e-338d-4433-8ab7-239b013a4897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:01.374011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c733e-338d-4433-8ab7-239b013a4897 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:01.398013 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2312/4611] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:02:01.401807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7c4ec-9483-41ae-bb7a-45aabd4a2d21 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:01.411100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58eb9a-de7c-422f-97f5-a0e291c581d8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:01.413332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58eb9a-de7c-422f-97f5-a0e291c581d8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:01.415817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7c4ec-9483-41ae-bb7a-45aabd4a2d21 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:01.416372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58eb9a-de7c-422f-97f5-a0e291c581d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:01.441292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63f857-1dc0-456f-99e6-d2c999fc9cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:01.442011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63f857-1dc0-456f-99e6-d2c999fc9cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:01.442390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63f857-1dc0-456f-99e6-d2c999fc9cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:01.442762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63f857-1dc0-456f-99e6-d2c999fc9cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:01.443521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63f857-1dc0-456f-99e6-d2c999fc9cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:01.446875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63f857-1dc0-456f-99e6-d2c999fc9cf3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:01.464235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2a58eb9a-de7c-422f-97f5-a0e291c581d8 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:02:01.465574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2a58eb9a-de7c-422f-97f5-a0e291c581d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:01.467878 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2300/4612] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:02:01.469632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68af23-2b0f-416b-906c-091afaff7d5d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:01.470109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68af23-2b0f-416b-906c-091afaff7d5d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:01.470838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68af23-2b0f-416b-906c-091afaff7d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:01.518909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6b68af23-2b0f-416b-906c-091afaff7d5d None None] MFA Rules not processed for user `2d9048d76a5e47318a5a3990191d254b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:02:01.520408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6b68af23-2b0f-416b-906c-091afaff7d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:01.586740 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2313/4613] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:02:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:02:01.588194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58eb9a-de7c-422f-97f5-a0e291c581d8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:01.631295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58eb9a-de7c-422f-97f5-a0e291c581d8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:01.642998 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2301/4614] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:02:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:02:01.644797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68af23-2b0f-416b-906c-091afaff7d5d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:01.648965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6b68af23-2b0f-416b-906c-091afaff7d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:01.658723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb19376-97d7-4d07-9007-4937e2a2cd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:01.661518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb19376-97d7-4d07-9007-4937e2a2cd4c admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:01.661802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb19376-97d7-4d07-9007-4937e2a2cd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:01.669023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb19376-97d7-4d07-9007-4937e2a2cd4c admin admin] PATH_INFO: `/v3/projects/33115ec9197040be952e29ce9cdd023a/users/09302b0b4ac14135a3f6b56c319ddca5/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:01.752055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb19376-97d7-4d07-9007-4937e2a2cd4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=33115ec9197040be952e29ce9cdd023a, user_id=09302b0b4ac14135a3f6b56c319ddca5, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:01.755790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb19376-97d7-4d07-9007-4937e2a2cd4c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:01.795445 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2314/4615] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:02:01 2022] PUT /identity/v3/projects/33115ec9197040be952e29ce9cdd023a/users/09302b0b4ac14135a3f6b56c319ddca5/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:02:01.810443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295be94-2865-4b86-95a8-5e3a9d98aaae None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:01.810951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295be94-2865-4b86-95a8-5e3a9d98aaae None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:01.812078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295be94-2865-4b86-95a8-5e3a9d98aaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:01.869804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68af23-2b0f-416b-906c-091afaff7d5d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:01.877994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5295be94-2865-4b86-95a8-5e3a9d98aaae None None] MFA Rules not processed for user `09302b0b4ac14135a3f6b56c319ddca5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:02:01.880398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5295be94-2865-4b86-95a8-5e3a9d98aaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:01.947274 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:02:02.058145 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2315/4616] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:02:01 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:02:02.063739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295be94-2865-4b86-95a8-5e3a9d98aaae None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:02.066933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c3aad-028a-496b-99e1-11b25345ecb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:02.071376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c3aad-028a-496b-99e1-11b25345ecb7 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:02.072733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c3aad-028a-496b-99e1-11b25345ecb7 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:02.073137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c3aad-028a-496b-99e1-11b25345ecb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:02.124570 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:02:02.268581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c3aad-028a-496b-99e1-11b25345ecb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:02.271049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c3aad-028a-496b-99e1-11b25345ecb7 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:02.285213 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2302/4617] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:02:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:02:02.287733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295be94-2865-4b86-95a8-5e3a9d98aaae None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:02.339581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d3da2-b663-4c37-9a29-fd6601831215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:02.340455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d3da2-b663-4c37-9a29-fd6601831215 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:02.340455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d3da2-b663-4c37-9a29-fd6601831215 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:02.340794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d3da2-b663-4c37-9a29-fd6601831215 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:02.341398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d3da2-b663-4c37-9a29-fd6601831215 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:02.343485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d3da2-b663-4c37-9a29-fd6601831215 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:02.454606 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2316/4618] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:02:02 2022] POST /identity/v3/projects => generated 397 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:02:02.458890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c3aad-028a-496b-99e1-11b25345ecb7 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:02.487659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c3aad-028a-496b-99e1-11b25345ecb7 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:02.702394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41393d-375e-4314-84ca-a3af26a7e187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:02.705968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41393d-375e-4314-84ca-a3af26a7e187 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:02.706674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41393d-375e-4314-84ca-a3af26a7e187 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:02.707434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41393d-375e-4314-84ca-a3af26a7e187 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:02.709377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41393d-375e-4314-84ca-a3af26a7e187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:02.730611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41393d-375e-4314-84ca-a3af26a7e187 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:02.789827 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2303/4619] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:02:02 2022] POST /identity/v3/users => generated 305 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:02:02.793830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d3da2-b663-4c37-9a29-fd6601831215 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:02.809947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d3da2-b663-4c37-9a29-fd6601831215 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:02.830103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49cac9-7a2d-45d8-a3dc-d14efe76561d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:02.836342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49cac9-7a2d-45d8-a3dc-d14efe76561d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:02.837519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49cac9-7a2d-45d8-a3dc-d14efe76561d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:02.838545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49cac9-7a2d-45d8-a3dc-d14efe76561d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:02.839975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49cac9-7a2d-45d8-a3dc-d14efe76561d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:02.846454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49cac9-7a2d-45d8-a3dc-d14efe76561d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:02.886072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41393d-375e-4314-84ca-a3af26a7e187 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:02.890284 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2317/4620] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:02:02.902584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41393d-375e-4314-84ca-a3af26a7e187 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:02.914042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347afe2-dc4c-45a2-bfd1-1a6cfe4de71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:02.917031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347afe2-dc4c-45a2-bfd1-1a6cfe4de71b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:02.917598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347afe2-dc4c-45a2-bfd1-1a6cfe4de71b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:02.917962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347afe2-dc4c-45a2-bfd1-1a6cfe4de71b admin admin] PATH_INFO: `/v3/projects/773721e18ca846cb8e1372bb56b460d3/users/971047b94fab4ab5afcff6b8eb11352b/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:02.953295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347afe2-dc4c-45a2-bfd1-1a6cfe4de71b admin admin] RBAC: Authorizing `identity:create_grant(project_id=773721e18ca846cb8e1372bb56b460d3, user_id=971047b94fab4ab5afcff6b8eb11352b, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:02.965567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347afe2-dc4c-45a2-bfd1-1a6cfe4de71b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:02.998577 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2304/4621] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:02:02 2022] PUT /identity/v3/projects/773721e18ca846cb8e1372bb56b460d3/users/971047b94fab4ab5afcff6b8eb11352b/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:02:03.003075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49cac9-7a2d-45d8-a3dc-d14efe76561d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:03.018522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49cac9-7a2d-45d8-a3dc-d14efe76561d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:03.203424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5e690-5c8d-44cf-9317-6bf52020f3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:03.206936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5e690-5c8d-44cf-9317-6bf52020f3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:03.207391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5e690-5c8d-44cf-9317-6bf52020f3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:03.208146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5e690-5c8d-44cf-9317-6bf52020f3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:03.208995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5e690-5c8d-44cf-9317-6bf52020f3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:03.211805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5e690-5c8d-44cf-9317-6bf52020f3c0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:03.225782 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2318/4622] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:02:03.230618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347afe2-dc4c-45a2-bfd1-1a6cfe4de71b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:03.247275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347afe2-dc4c-45a2-bfd1-1a6cfe4de71b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:03.257113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f403e-b18d-490f-b29f-08ffd593d277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:03.258544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f403e-b18d-490f-b29f-08ffd593d277 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:03.258969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f403e-b18d-490f-b29f-08ffd593d277 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:03.259870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f403e-b18d-490f-b29f-08ffd593d277 admin admin] PATH_INFO: `/v3/projects/773721e18ca846cb8e1372bb56b460d3/users/971047b94fab4ab5afcff6b8eb11352b/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:03.267714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f403e-b18d-490f-b29f-08ffd593d277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=773721e18ca846cb8e1372bb56b460d3, user_id=971047b94fab4ab5afcff6b8eb11352b, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:03.272756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f403e-b18d-490f-b29f-08ffd593d277 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:03.294820 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2305/4623] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:02:03 2022] PUT /identity/v3/projects/773721e18ca846cb8e1372bb56b460d3/users/971047b94fab4ab5afcff6b8eb11352b/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:02:03.305751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff421ff1-f7cd-4d94-86ce-7984cfc7a779 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:03.306295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff421ff1-f7cd-4d94-86ce-7984cfc7a779 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:03.306739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff421ff1-f7cd-4d94-86ce-7984cfc7a779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:03.365798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ff421ff1-f7cd-4d94-86ce-7984cfc7a779 None None] MFA Rules not processed for user `971047b94fab4ab5afcff6b8eb11352b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:02:03.368761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ff421ff1-f7cd-4d94-86ce-7984cfc7a779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:03.416126 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:02:03.547016 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2319/4624] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:02:03 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:02:03.578981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f403e-b18d-490f-b29f-08ffd593d277 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:03.581069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-118f403e-b18d-490f-b29f-08ffd593d277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:03.765236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f403e-b18d-490f-b29f-08ffd593d277 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:03.775082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e21f1-6612-405c-ba5a-8d5b289afbd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:03.775723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e21f1-6612-405c-ba5a-8d5b289afbd0 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:03.777258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e21f1-6612-405c-ba5a-8d5b289afbd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:03.781142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e21f1-6612-405c-ba5a-8d5b289afbd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:03.826915 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:02:03.947870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e21f1-6612-405c-ba5a-8d5b289afbd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:03.949384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e21f1-6612-405c-ba5a-8d5b289afbd0 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:03.972062 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2306/4625] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:02:03 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:02:05.318120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff421ff1-f7cd-4d94-86ce-7984cfc7a779 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:05.319449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ff421ff1-f7cd-4d94-86ce-7984cfc7a779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:05.477009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff421ff1-f7cd-4d94-86ce-7984cfc7a779 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:05.487253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c68d8-b092-4d72-96f5-38a785857e17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:05.488263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c68d8-b092-4d72-96f5-38a785857e17 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:05.488833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c68d8-b092-4d72-96f5-38a785857e17 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:05.489396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c68d8-b092-4d72-96f5-38a785857e17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:05.502056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c68d8-b092-4d72-96f5-38a785857e17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:05.504261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c68d8-b092-4d72-96f5-38a785857e17 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:05.555977 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2320/4626] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:02:05 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:02:13.966560 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=19 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:02:15.510779 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=52 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:02:18.587175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e21f1-6612-405c-ba5a-8d5b289afbd0 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:18.588639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7e8e21f1-6612-405c-ba5a-8d5b289afbd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:18.742741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e21f1-6612-405c-ba5a-8d5b289afbd0 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:18.751909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228edd6-f4c5-465d-bd11-2b18342470cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:18.752581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228edd6-f4c5-465d-bd11-2b18342470cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:18.752882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228edd6-f4c5-465d-bd11-2b18342470cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:18.753216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228edd6-f4c5-465d-bd11-2b18342470cf admin admin] PATH_INFO: `/v3/users/8a8becc2eeef442a8c71cdfcd28a5bc9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:18.754281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228edd6-f4c5-465d-bd11-2b18342470cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a8becc2eeef442a8c71cdfcd28a5bc9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:18.756198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228edd6-f4c5-465d-bd11-2b18342470cf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:18.874215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9228edd6-f4c5-465d-bd11-2b18342470cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a8becc2eeef442a8c71cdfcd28a5bc9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:18.904802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9228edd6-f4c5-465d-bd11-2b18342470cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a8becc2eeef442a8c71cdfcd28a5bc9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:18.907096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9228edd6-f4c5-465d-bd11-2b18342470cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a8becc2eeef442a8c71cdfcd28a5bc9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:18.934569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9228edd6-f4c5-465d-bd11-2b18342470cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a8becc2eeef442a8c71cdfcd28a5bc9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:18.962279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9228edd6-f4c5-465d-bd11-2b18342470cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a8becc2eeef442a8c71cdfcd28a5bc9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:18.983097 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2307/4627] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:02:18 2022] DELETE /identity/v3/users/8a8becc2eeef442a8c71cdfcd28a5bc9 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:02:19.677701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c68d8-b092-4d72-96f5-38a785857e17 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:19.708183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c68d8-b092-4d72-96f5-38a785857e17 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:19.956328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa4d90-5be1-459d-ba8d-ee2df6bd2605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:19.957994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa4d90-5be1-459d-ba8d-ee2df6bd2605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:19.958321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa4d90-5be1-459d-ba8d-ee2df6bd2605 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:19.958742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa4d90-5be1-459d-ba8d-ee2df6bd2605 admin admin] PATH_INFO: `/v3/projects/f8963f2d684b4a389d9abafdec3ce426` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:19.959936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa4d90-5be1-459d-ba8d-ee2df6bd2605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8963f2d684b4a389d9abafdec3ce426)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:19.966263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa4d90-5be1-459d-ba8d-ee2df6bd2605 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:20.071721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b9aa4d90-5be1-459d-ba8d-ee2df6bd2605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8963f2d684b4a389d9abafdec3ce426', 'request_id': 'req-b9aa4d90-5be1-459d-ba8d-ee2df6bd2605'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:20.097707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b9aa4d90-5be1-459d-ba8d-ee2df6bd2605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8963f2d684b4a389d9abafdec3ce426', 'request_id': 'req-b9aa4d90-5be1-459d-ba8d-ee2df6bd2605'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:20.106623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b9aa4d90-5be1-459d-ba8d-ee2df6bd2605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8963f2d684b4a389d9abafdec3ce426', 'request_id': 'req-b9aa4d90-5be1-459d-ba8d-ee2df6bd2605'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:20.131906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b9aa4d90-5be1-459d-ba8d-ee2df6bd2605 admin admin] The token cache is being invalidate because project f8963f2d684b4a389d9abafdec3ce426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:02:20.132358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b9aa4d90-5be1-459d-ba8d-ee2df6bd2605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:20.133194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b9aa4d90-5be1-459d-ba8d-ee2df6bd2605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:20.135533 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2321/4628] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:02:19 2022] DELETE /identity/v3/projects/f8963f2d684b4a389d9abafdec3ce426 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:02:20.141316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea095c37-6348-4d4c-b1c9-2517b5902b82 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:20.141805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea095c37-6348-4d4c-b1c9-2517b5902b82 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:20.141805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea095c37-6348-4d4c-b1c9-2517b5902b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:20.195393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ea095c37-6348-4d4c-b1c9-2517b5902b82 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:02:20.196785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ea095c37-6348-4d4c-b1c9-2517b5902b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:20.373399 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2308/4629] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:02:20.381780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b4cf2-bfb4-42af-af9e-4b418538ca4f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:20.382294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b4cf2-bfb4-42af-af9e-4b418538ca4f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:20.382788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b4cf2-bfb4-42af-af9e-4b418538ca4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:20.431455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5f8b4cf2-bfb4-42af-af9e-4b418538ca4f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:02:20.435087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5f8b4cf2-bfb4-42af-af9e-4b418538ca4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:20.454469 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2322/4630] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:02:20.458954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea095c37-6348-4d4c-b1c9-2517b5902b82 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:20.477099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea095c37-6348-4d4c-b1c9-2517b5902b82 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:20.494390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1721c3-3dc7-4f0f-a321-91ad4cddb2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:20.496291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1721c3-3dc7-4f0f-a321-91ad4cddb2af admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:20.496790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1721c3-3dc7-4f0f-a321-91ad4cddb2af admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:20.497271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1721c3-3dc7-4f0f-a321-91ad4cddb2af admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:20.498095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1721c3-3dc7-4f0f-a321-91ad4cddb2af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:02:20.498642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1721c3-3dc7-4f0f-a321-91ad4cddb2af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:20.507693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1721c3-3dc7-4f0f-a321-91ad4cddb2af admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:20.541479 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2309/4631] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:02:20.546648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b4cf2-bfb4-42af-af9e-4b418538ca4f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:20.558610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b4cf2-bfb4-42af-af9e-4b418538ca4f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:20.594882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1954d-aba5-405e-ac42-f53693facbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:20.596732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1954d-aba5-405e-ac42-f53693facbb0 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:20.597840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1954d-aba5-405e-ac42-f53693facbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:20.599130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1954d-aba5-405e-ac42-f53693facbb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:20.602891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1954d-aba5-405e-ac42-f53693facbb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:20.606317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1954d-aba5-405e-ac42-f53693facbb0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:20.703680 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2323/4632] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:02:20 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:02:20.725411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1721c3-3dc7-4f0f-a321-91ad4cddb2af admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:20.738688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1721c3-3dc7-4f0f-a321-91ad4cddb2af admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:20.752863 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:02:20.905471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c10948-a9c5-4918-bed8-3dddaa60625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:20.906343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c10948-a9c5-4918-bed8-3dddaa60625b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:20.906912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c10948-a9c5-4918-bed8-3dddaa60625b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:20.907276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c10948-a9c5-4918-bed8-3dddaa60625b admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:20.908977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c10948-a9c5-4918-bed8-3dddaa60625b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:20.914608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c10948-a9c5-4918-bed8-3dddaa60625b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:20.988968 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2310/4633] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:02:20 2022] POST /identity/v3/users => generated 292 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:02:20.991262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1954d-aba5-405e-ac42-f53693facbb0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:21.011925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1954d-aba5-405e-ac42-f53693facbb0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:21.023954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad20e70-7196-4c1c-a186-6ab536aa3454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:21.024955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad20e70-7196-4c1c-a186-6ab536aa3454 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:21.025450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad20e70-7196-4c1c-a186-6ab536aa3454 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:21.027484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad20e70-7196-4c1c-a186-6ab536aa3454 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:21.028368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad20e70-7196-4c1c-a186-6ab536aa3454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:21.034225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad20e70-7196-4c1c-a186-6ab536aa3454 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:21.060779 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2324/4634] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:02:21.064913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c10948-a9c5-4918-bed8-3dddaa60625b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:21.076800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c10948-a9c5-4918-bed8-3dddaa60625b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:21.092194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2de08-e7a8-4aad-9179-02e345be69b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:21.092849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2de08-e7a8-4aad-9179-02e345be69b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:21.093123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2de08-e7a8-4aad-9179-02e345be69b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:21.094206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2de08-e7a8-4aad-9179-02e345be69b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:21.094697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2de08-e7a8-4aad-9179-02e345be69b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:21.101233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2de08-e7a8-4aad-9179-02e345be69b9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:21.144572 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2311/4635] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:02:21.148580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad20e70-7196-4c1c-a186-6ab536aa3454 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:21.167383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad20e70-7196-4c1c-a186-6ab536aa3454 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:21.184364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdb938-ccf4-4a2d-ab28-521da2c5a69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:21.185131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdb938-ccf4-4a2d-ab28-521da2c5a69b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:21.185411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdb938-ccf4-4a2d-ab28-521da2c5a69b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:21.185686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdb938-ccf4-4a2d-ab28-521da2c5a69b admin admin] PATH_INFO: `/v3/projects/3c84a7b4fecc420bb93364f4546ba269/users/d5559b87c3fb4fc1933a038eb3070193/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:21.246890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdb938-ccf4-4a2d-ab28-521da2c5a69b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c84a7b4fecc420bb93364f4546ba269, user_id=d5559b87c3fb4fc1933a038eb3070193, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:21.250146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdb938-ccf4-4a2d-ab28-521da2c5a69b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:21.287602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19f298-67de-42d5-8cea-ee89e7f8d138 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:21.289267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19f298-67de-42d5-8cea-ee89e7f8d138 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:21.289608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19f298-67de-42d5-8cea-ee89e7f8d138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:21.292583 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2325/4636] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:02:21 2022] PUT /identity/v3/projects/3c84a7b4fecc420bb93364f4546ba269/users/d5559b87c3fb4fc1933a038eb3070193/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:02:21.342449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ac19f298-67de-42d5-8cea-ee89e7f8d138 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:02:21.344381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ac19f298-67de-42d5-8cea-ee89e7f8d138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:21.459982 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2312/4637] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:02:21.471389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdb938-ccf4-4a2d-ab28-521da2c5a69b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:21.473592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ddfdb938-ccf4-4a2d-ab28-521da2c5a69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:21.542364 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:02:21.608110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdb938-ccf4-4a2d-ab28-521da2c5a69b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:21.621166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b47913-5699-4f0a-bdbb-09f2def0e82f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:21.622122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b47913-5699-4f0a-bdbb-09f2def0e82f service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:21.622549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b47913-5699-4f0a-bdbb-09f2def0e82f service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:21.622966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b47913-5699-4f0a-bdbb-09f2def0e82f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:21.651219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b47913-5699-4f0a-bdbb-09f2def0e82f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:21.652791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b47913-5699-4f0a-bdbb-09f2def0e82f service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:21.679074 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2326/4638] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:02:25.522846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19f298-67de-42d5-8cea-ee89e7f8d138 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:25.524559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ac19f298-67de-42d5-8cea-ee89e7f8d138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:25.540694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19f298-67de-42d5-8cea-ee89e7f8d138 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:25.545965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd683b6-5cc5-4aca-9c56-690642fb28f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:25.546636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd683b6-5cc5-4aca-9c56-690642fb28f2 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:25.547130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd683b6-5cc5-4aca-9c56-690642fb28f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:25.547488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd683b6-5cc5-4aca-9c56-690642fb28f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:25.549351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8cd683b6-5cc5-4aca-9c56-690642fb28f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:25.651683 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd683b6-5cc5-4aca-9c56-690642fb28f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:25.653589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd683b6-5cc5-4aca-9c56-690642fb28f2 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:25.672129 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2313/4639] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:02:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:02:27.720859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b47913-5699-4f0a-bdbb-09f2def0e82f service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:27.735460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b47913-5699-4f0a-bdbb-09f2def0e82f service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:27.747231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351eaab8-9830-4f28-901b-65fcac99456a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:27.748099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351eaab8-9830-4f28-901b-65fcac99456a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:27.748520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351eaab8-9830-4f28-901b-65fcac99456a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:27.748975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351eaab8-9830-4f28-901b-65fcac99456a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:27.754181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-351eaab8-9830-4f28-901b-65fcac99456a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:27.779901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351eaab8-9830-4f28-901b-65fcac99456a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:27.781866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351eaab8-9830-4f28-901b-65fcac99456a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:27.808185 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2327/4640] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:02:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:02:28.386667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd683b6-5cc5-4aca-9c56-690642fb28f2 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:28.388253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8cd683b6-5cc5-4aca-9c56-690642fb28f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:28.434136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd683b6-5cc5-4aca-9c56-690642fb28f2 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:28.441477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d5e5f-34b0-4d6f-a5f8-bff3bd87feda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:28.441868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d5e5f-34b0-4d6f-a5f8-bff3bd87feda admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:28.442146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d5e5f-34b0-4d6f-a5f8-bff3bd87feda admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:28.442423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d5e5f-34b0-4d6f-a5f8-bff3bd87feda admin admin] PATH_INFO: `/v3/users/09302b0b4ac14135a3f6b56c319ddca5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:28.443585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d5e5f-34b0-4d6f-a5f8-bff3bd87feda admin admin] RBAC: Authorizing `identity:delete_user(user_id=09302b0b4ac14135a3f6b56c319ddca5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:28.448798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d5e5f-34b0-4d6f-a5f8-bff3bd87feda admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:28.466735 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:02:28.570447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cf5d5e5f-34b0-4d6f-a5f8-bff3bd87feda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09302b0b4ac14135a3f6b56c319ddca5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:28.580617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cf5d5e5f-34b0-4d6f-a5f8-bff3bd87feda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09302b0b4ac14135a3f6b56c319ddca5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:28.581608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cf5d5e5f-34b0-4d6f-a5f8-bff3bd87feda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09302b0b4ac14135a3f6b56c319ddca5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:28.606570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cf5d5e5f-34b0-4d6f-a5f8-bff3bd87feda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09302b0b4ac14135a3f6b56c319ddca5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:28.636103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cf5d5e5f-34b0-4d6f-a5f8-bff3bd87feda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09302b0b4ac14135a3f6b56c319ddca5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:28.653636 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2314/4641] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:02:28 2022] DELETE /identity/v3/users/09302b0b4ac14135a3f6b56c319ddca5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:02:28.658893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b462c-83cf-4a85-ba06-f58a367e4708 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:28.659181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b462c-83cf-4a85-ba06-f58a367e4708 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:28.659459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b462c-83cf-4a85-ba06-f58a367e4708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:28.698437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-426b462c-83cf-4a85-ba06-f58a367e4708 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:02:28.699581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-426b462c-83cf-4a85-ba06-f58a367e4708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:28.831367 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2328/4642] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:02:28.844920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d5e5f-34b0-4d6f-a5f8-bff3bd87feda admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:28.848859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cf5d5e5f-34b0-4d6f-a5f8-bff3bd87feda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:28.966936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d5e5f-34b0-4d6f-a5f8-bff3bd87feda admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:28.982322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23079e-ddfe-4bbd-97be-467752a3a6d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:28.982863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23079e-ddfe-4bbd-97be-467752a3a6d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:28.983144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23079e-ddfe-4bbd-97be-467752a3a6d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:28.983477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23079e-ddfe-4bbd-97be-467752a3a6d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:29.002863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23079e-ddfe-4bbd-97be-467752a3a6d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:29.004309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23079e-ddfe-4bbd-97be-467752a3a6d3 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:29.024220 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2315/4643] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:02:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:02:29.768965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b462c-83cf-4a85-ba06-f58a367e4708 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:29.773275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-426b462c-83cf-4a85-ba06-f58a367e4708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:29.810838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b462c-83cf-4a85-ba06-f58a367e4708 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:29.824290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27642dfb-5d88-4fde-8c4b-fdc0b6188818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:29.826637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642dfb-5d88-4fde-8c4b-fdc0b6188818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:29.836560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642dfb-5d88-4fde-8c4b-fdc0b6188818 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:29.839020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642dfb-5d88-4fde-8c4b-fdc0b6188818 admin admin] PATH_INFO: `/v3/projects/33115ec9197040be952e29ce9cdd023a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:29.842617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27642dfb-5d88-4fde-8c4b-fdc0b6188818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33115ec9197040be952e29ce9cdd023a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:29.847735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27642dfb-5d88-4fde-8c4b-fdc0b6188818 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:29.944142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-27642dfb-5d88-4fde-8c4b-fdc0b6188818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33115ec9197040be952e29ce9cdd023a', 'request_id': 'req-27642dfb-5d88-4fde-8c4b-fdc0b6188818'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:29.961497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-27642dfb-5d88-4fde-8c4b-fdc0b6188818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33115ec9197040be952e29ce9cdd023a', 'request_id': 'req-27642dfb-5d88-4fde-8c4b-fdc0b6188818'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:29.974898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-27642dfb-5d88-4fde-8c4b-fdc0b6188818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33115ec9197040be952e29ce9cdd023a', 'request_id': 'req-27642dfb-5d88-4fde-8c4b-fdc0b6188818'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:30.026960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-27642dfb-5d88-4fde-8c4b-fdc0b6188818 admin admin] The token cache is being invalidate because project 33115ec9197040be952e29ce9cdd023a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:02:30.028801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-27642dfb-5d88-4fde-8c4b-fdc0b6188818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:30.029778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-27642dfb-5d88-4fde-8c4b-fdc0b6188818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:30.038784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23079e-ddfe-4bbd-97be-467752a3a6d3 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:30.052186 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2329/4644] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:02:29 2022] DELETE /identity/v3/projects/33115ec9197040be952e29ce9cdd023a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:02:30.058890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23079e-ddfe-4bbd-97be-467752a3a6d3 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:30.221326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d846342-8e60-4eb3-b8d6-fb9b622080ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:30.222286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d846342-8e60-4eb3-b8d6-fb9b622080ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:30.222286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d846342-8e60-4eb3-b8d6-fb9b622080ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:30.222475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d846342-8e60-4eb3-b8d6-fb9b622080ea admin admin] PATH_INFO: `/v3/users/971047b94fab4ab5afcff6b8eb11352b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:30.223493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d846342-8e60-4eb3-b8d6-fb9b622080ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=971047b94fab4ab5afcff6b8eb11352b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:30.225627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d846342-8e60-4eb3-b8d6-fb9b622080ea admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:30.321767 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:02:30.353301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d846342-8e60-4eb3-b8d6-fb9b622080ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971047b94fab4ab5afcff6b8eb11352b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:30.371166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d846342-8e60-4eb3-b8d6-fb9b622080ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971047b94fab4ab5afcff6b8eb11352b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:30.374016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d846342-8e60-4eb3-b8d6-fb9b622080ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971047b94fab4ab5afcff6b8eb11352b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:30.400968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d846342-8e60-4eb3-b8d6-fb9b622080ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971047b94fab4ab5afcff6b8eb11352b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:30.420091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d846342-8e60-4eb3-b8d6-fb9b622080ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971047b94fab4ab5afcff6b8eb11352b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:30.428243 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2316/4645] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:02:30 2022] DELETE /identity/v3/users/971047b94fab4ab5afcff6b8eb11352b => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:02:30.942899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27642dfb-5d88-4fde-8c4b-fdc0b6188818 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:30.946943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-27642dfb-5d88-4fde-8c4b-fdc0b6188818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:31.016564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27642dfb-5d88-4fde-8c4b-fdc0b6188818 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:31.090535 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:02:31.133875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761995e-38ca-44e7-bafc-38794e97be9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:31.134907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761995e-38ca-44e7-bafc-38794e97be9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:31.135753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761995e-38ca-44e7-bafc-38794e97be9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:31.136390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761995e-38ca-44e7-bafc-38794e97be9c admin admin] PATH_INFO: `/v3/projects/773721e18ca846cb8e1372bb56b460d3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:31.144540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761995e-38ca-44e7-bafc-38794e97be9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=773721e18ca846cb8e1372bb56b460d3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:31.148150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761995e-38ca-44e7-bafc-38794e97be9c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:31.240412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a761995e-38ca-44e7-bafc-38794e97be9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '773721e18ca846cb8e1372bb56b460d3', 'request_id': 'req-a761995e-38ca-44e7-bafc-38794e97be9c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:31.261068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a761995e-38ca-44e7-bafc-38794e97be9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '773721e18ca846cb8e1372bb56b460d3', 'request_id': 'req-a761995e-38ca-44e7-bafc-38794e97be9c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:31.272251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a761995e-38ca-44e7-bafc-38794e97be9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '773721e18ca846cb8e1372bb56b460d3', 'request_id': 'req-a761995e-38ca-44e7-bafc-38794e97be9c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:31.289039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a761995e-38ca-44e7-bafc-38794e97be9c admin admin] The token cache is being invalidate because project 773721e18ca846cb8e1372bb56b460d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:02:31.298992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a761995e-38ca-44e7-bafc-38794e97be9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:31.300361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a761995e-38ca-44e7-bafc-38794e97be9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:31.303424 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2330/4646] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:02:30 2022] DELETE /identity/v3/projects/773721e18ca846cb8e1372bb56b460d3 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:02:31.308039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518474ff-66f8-4a34-8115-50437380de4b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:31.308883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518474ff-66f8-4a34-8115-50437380de4b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:31.309314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518474ff-66f8-4a34-8115-50437380de4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:31.350019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-518474ff-66f8-4a34-8115-50437380de4b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:02:31.351525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-518474ff-66f8-4a34-8115-50437380de4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:31.438229 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2317/4647] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:02:31.446381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b888ed9-4440-4d8a-be6d-ea643fbe193e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:31.446665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b888ed9-4440-4d8a-be6d-ea643fbe193e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:31.447015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b888ed9-4440-4d8a-be6d-ea643fbe193e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:31.486056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7b888ed9-4440-4d8a-be6d-ea643fbe193e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:02:31.487294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7b888ed9-4440-4d8a-be6d-ea643fbe193e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:31.501651 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2331/4648] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:02:31.503308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518474ff-66f8-4a34-8115-50437380de4b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:31.519655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518474ff-66f8-4a34-8115-50437380de4b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:31.531291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15733f6e-3d04-4097-9c21-1cf7a9421034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:31.532282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15733f6e-3d04-4097-9c21-1cf7a9421034 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:31.532696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15733f6e-3d04-4097-9c21-1cf7a9421034 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:31.532886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15733f6e-3d04-4097-9c21-1cf7a9421034 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:31.533759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15733f6e-3d04-4097-9c21-1cf7a9421034 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:02:31.534209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15733f6e-3d04-4097-9c21-1cf7a9421034 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:31.535925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15733f6e-3d04-4097-9c21-1cf7a9421034 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:31.578362 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2318/4649] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:02:31.580517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b888ed9-4440-4d8a-be6d-ea643fbe193e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:31.596315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b888ed9-4440-4d8a-be6d-ea643fbe193e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:31.624853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582e9c5-14a1-4604-b2be-17a323e48dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:31.628425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582e9c5-14a1-4604-b2be-17a323e48dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:31.628835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582e9c5-14a1-4604-b2be-17a323e48dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:31.630201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582e9c5-14a1-4604-b2be-17a323e48dc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:31.631081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582e9c5-14a1-4604-b2be-17a323e48dc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:31.634983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582e9c5-14a1-4604-b2be-17a323e48dc8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:31.726731 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2332/4650] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:02:31 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:02:31.732697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15733f6e-3d04-4097-9c21-1cf7a9421034 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:31.763644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15733f6e-3d04-4097-9c21-1cf7a9421034 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:31.922122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1bade-a767-4124-a601-bf88c9a76a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:31.922969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1bade-a767-4124-a601-bf88c9a76a54 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:31.924501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1bade-a767-4124-a601-bf88c9a76a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:31.925192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1bade-a767-4124-a601-bf88c9a76a54 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:31.926132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba1bade-a767-4124-a601-bf88c9a76a54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:31.928331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba1bade-a767-4124-a601-bf88c9a76a54 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:31.973589 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2319/4651] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:02:31 2022] POST /identity/v3/users => generated 284 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:02:31.975793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582e9c5-14a1-4604-b2be-17a323e48dc8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:31.998772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582e9c5-14a1-4604-b2be-17a323e48dc8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:32.019963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937e97f-49b3-41de-a5ae-4534ae89c9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:32.022521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937e97f-49b3-41de-a5ae-4534ae89c9ae admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:32.022672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937e97f-49b3-41de-a5ae-4534ae89c9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:32.025814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937e97f-49b3-41de-a5ae-4534ae89c9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:32.027083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937e97f-49b3-41de-a5ae-4534ae89c9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:32.032059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937e97f-49b3-41de-a5ae-4534ae89c9ae admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:32.078309 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2333/4652] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:02:32.079717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1bade-a767-4124-a601-bf88c9a76a54 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:32.090999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1bade-a767-4124-a601-bf88c9a76a54 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:32.113267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54942e56-2f65-4699-ba25-37ed2e8cd4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:32.113912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54942e56-2f65-4699-ba25-37ed2e8cd4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:32.114190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54942e56-2f65-4699-ba25-37ed2e8cd4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:32.114459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54942e56-2f65-4699-ba25-37ed2e8cd4b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:32.115115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54942e56-2f65-4699-ba25-37ed2e8cd4b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:32.116750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54942e56-2f65-4699-ba25-37ed2e8cd4b0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:32.156858 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2320/4653] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:02:32.160991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937e97f-49b3-41de-a5ae-4534ae89c9ae admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:32.183810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937e97f-49b3-41de-a5ae-4534ae89c9ae admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:32.195078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ceb94-4ad7-4f75-a0c7-765dbc8c3f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:32.196634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ceb94-4ad7-4f75-a0c7-765dbc8c3f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:32.197638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ceb94-4ad7-4f75-a0c7-765dbc8c3f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:32.197920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ceb94-4ad7-4f75-a0c7-765dbc8c3f62 admin admin] PATH_INFO: `/v3/projects/3172e6405d094e5abac1a23db73c9043/users/70125a9a58134d229fbe2eac25e8a335/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:32.261901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ceb94-4ad7-4f75-a0c7-765dbc8c3f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3172e6405d094e5abac1a23db73c9043, user_id=70125a9a58134d229fbe2eac25e8a335, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:32.267763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ceb94-4ad7-4f75-a0c7-765dbc8c3f62 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:32.296936 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2334/4654] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:02:32 2022] PUT /identity/v3/projects/3172e6405d094e5abac1a23db73c9043/users/70125a9a58134d229fbe2eac25e8a335/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:02:32.307830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be076628-da5d-4111-80ee-9699b5652bd0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:32.308441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be076628-da5d-4111-80ee-9699b5652bd0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:32.309395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be076628-da5d-4111-80ee-9699b5652bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:32.372147 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:02:32.400509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-be076628-da5d-4111-80ee-9699b5652bd0 None None] MFA Rules not processed for user `70125a9a58134d229fbe2eac25e8a335`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:02:32.401884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-be076628-da5d-4111-80ee-9699b5652bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:32.509632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd1b4a-97bd-4d96-8822-ddedc58b9078 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:32.510030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd1b4a-97bd-4d96-8822-ddedc58b9078 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:32.510230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd1b4a-97bd-4d96-8822-ddedc58b9078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:32.557488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-83dd1b4a-97bd-4d96-8822-ddedc58b9078 None None] MFA Rules not processed for user `d5559b87c3fb4fc1933a038eb3070193`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:02:32.558655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-83dd1b4a-97bd-4d96-8822-ddedc58b9078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:32.573903 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2321/4655] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:02:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:02:32.579693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be076628-da5d-4111-80ee-9699b5652bd0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:32.611778 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:02:32.659618 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2335/4656] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:02:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:02:32.661101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05064863-1fd8-48d6-a749-fe62d7da4c8e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:32.661386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05064863-1fd8-48d6-a749-fe62d7da4c8e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:32.661656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05064863-1fd8-48d6-a749-fe62d7da4c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:32.683065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-05064863-1fd8-48d6-a749-fe62d7da4c8e None None] MFA Rules not processed for user `d5559b87c3fb4fc1933a038eb3070193`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:02:32.684278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-05064863-1fd8-48d6-a749-fe62d7da4c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:32.692051 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2336/4657] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:02:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:02:32.712800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be076628-da5d-4111-80ee-9699b5652bd0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:32.719158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a145ea-9c61-47aa-8677-b7e5836b0c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:32.720119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a145ea-9c61-47aa-8677-b7e5836b0c56 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:32.720644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a145ea-9c61-47aa-8677-b7e5836b0c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:32.721127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a145ea-9c61-47aa-8677-b7e5836b0c56 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:32.722422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a145ea-9c61-47aa-8677-b7e5836b0c56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:32.724566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a145ea-9c61-47aa-8677-b7e5836b0c56 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:32.766690 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2322/4658] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:02:32 2022] POST /identity/v3/projects => generated 365 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:02:32.770439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05064863-1fd8-48d6-a749-fe62d7da4c8e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:32.782524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05064863-1fd8-48d6-a749-fe62d7da4c8e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:32.820282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3da9a-3994-45d3-bd2f-38bf502d2b29 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:32.821328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3da9a-3994-45d3-bd2f-38bf502d2b29 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:32.821985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3da9a-3994-45d3-bd2f-38bf502d2b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:32.865967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-83c3da9a-3994-45d3-bd2f-38bf502d2b29 None None] MFA Rules not processed for user `3b97b83ebcf242d0abd55dfbb15ab066`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:02:32.868341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-83c3da9a-3994-45d3-bd2f-38bf502d2b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:32.873483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459e0b0-ce85-4297-b920-e5af4813dc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:32.874105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459e0b0-ce85-4297-b920-e5af4813dc80 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:32.875084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459e0b0-ce85-4297-b920-e5af4813dc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:32.875178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459e0b0-ce85-4297-b920-e5af4813dc80 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:32.875832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459e0b0-ce85-4297-b920-e5af4813dc80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:32.878539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459e0b0-ce85-4297-b920-e5af4813dc80 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:32.945523 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2337/4659] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:02:32 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:02:32.945523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459e0b0-ce85-4297-b920-e5af4813dc80 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:32.959579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0459e0b0-ce85-4297-b920-e5af4813dc80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:33.048613 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2323/4660] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:02:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:02:33.049586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3da9a-3994-45d3-bd2f-38bf502d2b29 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:33.073521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3da9a-3994-45d3-bd2f-38bf502d2b29 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:33.082032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa607e90-7fef-45f2-80ef-de378be377d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:33.083151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa607e90-7fef-45f2-80ef-de378be377d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:33.083611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa607e90-7fef-45f2-80ef-de378be377d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:33.086034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa607e90-7fef-45f2-80ef-de378be377d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:33.087080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa607e90-7fef-45f2-80ef-de378be377d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:33.092186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa607e90-7fef-45f2-80ef-de378be377d2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:33.107357 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2324/4661] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:02:33.115098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa607e90-7fef-45f2-80ef-de378be377d2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:33.117142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459e0b0-ce85-4297-b920-e5af4813dc80 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:33.123525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80a4cc-2ad0-41ca-976a-e8d437c64beb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:33.124228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80a4cc-2ad0-41ca-976a-e8d437c64beb service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:33.125471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80a4cc-2ad0-41ca-976a-e8d437c64beb service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:33.125841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80a4cc-2ad0-41ca-976a-e8d437c64beb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:33.138239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa607e90-7fef-45f2-80ef-de378be377d2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:33.144463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711bff7-4e06-4db1-a38e-55d256ab310b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:33.145525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711bff7-4e06-4db1-a38e-55d256ab310b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:33.146039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711bff7-4e06-4db1-a38e-55d256ab310b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:33.146426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711bff7-4e06-4db1-a38e-55d256ab310b admin admin] PATH_INFO: `/v3/projects/f771faf07aeb43c59f6a8b97c92a4bc2/users/a1b55be2896d4a84b8d0184ff2fff459/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:33.175764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711bff7-4e06-4db1-a38e-55d256ab310b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f771faf07aeb43c59f6a8b97c92a4bc2, user_id=a1b55be2896d4a84b8d0184ff2fff459, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:33.178714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711bff7-4e06-4db1-a38e-55d256ab310b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:33.182074 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:02:33.200195 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2325/4662] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:02:33 2022] PUT /identity/v3/projects/f771faf07aeb43c59f6a8b97c92a4bc2/users/a1b55be2896d4a84b8d0184ff2fff459/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:02:33.204120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711bff7-4e06-4db1-a38e-55d256ab310b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:33.240052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80a4cc-2ad0-41ca-976a-e8d437c64beb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:33.241699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80a4cc-2ad0-41ca-976a-e8d437c64beb service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:33.262162 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2338/4663] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:02:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:02:33.336743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711bff7-4e06-4db1-a38e-55d256ab310b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:33.342484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ae195-a513-4645-b8cd-222a1eb2edda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:33.344290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ae195-a513-4645-b8cd-222a1eb2edda admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:33.344863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ae195-a513-4645-b8cd-222a1eb2edda admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:33.345913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ae195-a513-4645-b8cd-222a1eb2edda admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:33.346993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ae195-a513-4645-b8cd-222a1eb2edda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:33.351691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ae195-a513-4645-b8cd-222a1eb2edda admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:33.383816 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2326/4664] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:02:33.385151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80a4cc-2ad0-41ca-976a-e8d437c64beb service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:33.408636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80a4cc-2ad0-41ca-976a-e8d437c64beb service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:33.421498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a08f89-2c3f-40d8-bee5-4c8dc61111de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:33.423693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a08f89-2c3f-40d8-bee5-4c8dc61111de admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:33.424250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a08f89-2c3f-40d8-bee5-4c8dc61111de admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:33.424769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a08f89-2c3f-40d8-bee5-4c8dc61111de admin admin] PATH_INFO: `/v3/projects/f771faf07aeb43c59f6a8b97c92a4bc2/users/a1b55be2896d4a84b8d0184ff2fff459/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:33.429035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a08f89-2c3f-40d8-bee5-4c8dc61111de admin admin] RBAC: Authorizing `identity:create_grant(project_id=f771faf07aeb43c59f6a8b97c92a4bc2, user_id=a1b55be2896d4a84b8d0184ff2fff459, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:33.432781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a08f89-2c3f-40d8-bee5-4c8dc61111de admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:33.436458 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:02:33.459264 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2339/4665] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:02:33 2022] PUT /identity/v3/projects/f771faf07aeb43c59f6a8b97c92a4bc2/users/a1b55be2896d4a84b8d0184ff2fff459/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:02:33.461458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e490b-6ac0-48f4-b021-5b135d4d5f24 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:33.461746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e490b-6ac0-48f4-b021-5b135d4d5f24 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:33.462023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e490b-6ac0-48f4-b021-5b135d4d5f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:33.555243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ca8e490b-6ac0-48f4-b021-5b135d4d5f24 None None] MFA Rules not processed for user `a1b55be2896d4a84b8d0184ff2fff459`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:02:33.557065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ca8e490b-6ac0-48f4-b021-5b135d4d5f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:33.744067 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2327/4666] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:02:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:02:34.018282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a08f89-2c3f-40d8-bee5-4c8dc61111de admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:34.020051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-73a08f89-2c3f-40d8-bee5-4c8dc61111de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:34.155110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a08f89-2c3f-40d8-bee5-4c8dc61111de admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:34.160232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381a6cf-c8e7-4eb5-a803-32a9612a216d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:34.162603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381a6cf-c8e7-4eb5-a803-32a9612a216d service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:34.162899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381a6cf-c8e7-4eb5-a803-32a9612a216d service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:34.163218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381a6cf-c8e7-4eb5-a803-32a9612a216d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:34.193702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381a6cf-c8e7-4eb5-a803-32a9612a216d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:34.195047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381a6cf-c8e7-4eb5-a803-32a9612a216d service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:34.225058 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2340/4667] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:02:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:02:35.376485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e490b-6ac0-48f4-b021-5b135d4d5f24 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:35.388089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e490b-6ac0-48f4-b021-5b135d4d5f24 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:35.392709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1f9ea-0273-430e-93d1-39d0a3e13f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:35.393920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1f9ea-0273-430e-93d1-39d0a3e13f75 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:35.394196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1f9ea-0273-430e-93d1-39d0a3e13f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:35.394463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1f9ea-0273-430e-93d1-39d0a3e13f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:35.396170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-72f1f9ea-0273-430e-93d1-39d0a3e13f75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:35.473471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1f9ea-0273-430e-93d1-39d0a3e13f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:35.474915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1f9ea-0273-430e-93d1-39d0a3e13f75 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:35.489801 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2328/4668] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:02:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:02:37.280307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381a6cf-c8e7-4eb5-a803-32a9612a216d service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:37.282464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1381a6cf-c8e7-4eb5-a803-32a9612a216d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:37.472021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381a6cf-c8e7-4eb5-a803-32a9612a216d service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:37.476235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae4e7c-b8e1-43d4-9393-49c3a9f94a16 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:37.477321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae4e7c-b8e1-43d4-9393-49c3a9f94a16 service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:37.478102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae4e7c-b8e1-43d4-9393-49c3a9f94a16 service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:37.483453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae4e7c-b8e1-43d4-9393-49c3a9f94a16 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:37.486235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b6ae4e7c-b8e1-43d4-9393-49c3a9f94a16 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:37.507535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae4e7c-b8e1-43d4-9393-49c3a9f94a16 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:37.510334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae4e7c-b8e1-43d4-9393-49c3a9f94a16 service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:37.549501 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2341/4669] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:02:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:02:37.762657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1f9ea-0273-430e-93d1-39d0a3e13f75 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:37.766003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-72f1f9ea-0273-430e-93d1-39d0a3e13f75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:37.776084 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:02:37.800515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1f9ea-0273-430e-93d1-39d0a3e13f75 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:37.826202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b7c62-f21d-4bdd-bf9e-b2aa7d6ffb54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:37.827946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b7c62-f21d-4bdd-bf9e-b2aa7d6ffb54 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:37.828764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b7c62-f21d-4bdd-bf9e-b2aa7d6ffb54 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:37.829047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b7c62-f21d-4bdd-bf9e-b2aa7d6ffb54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:37.833842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-920b7c62-f21d-4bdd-bf9e-b2aa7d6ffb54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:37.861213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b7c62-f21d-4bdd-bf9e-b2aa7d6ffb54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:37.864917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b7c62-f21d-4bdd-bf9e-b2aa7d6ffb54 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:37.887139 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2329/4670] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:02:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:02:38.066169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae4e7c-b8e1-43d4-9393-49c3a9f94a16 service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:38.087637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae4e7c-b8e1-43d4-9393-49c3a9f94a16 service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:38.100594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7ea94-7c9e-45e9-bd67-7750156da9f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:38.120819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7ea94-7c9e-45e9-bd67-7750156da9f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:38.121210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7ea94-7c9e-45e9-bd67-7750156da9f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:38.121589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7ea94-7c9e-45e9-bd67-7750156da9f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:38.124198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d8d7ea94-7c9e-45e9-bd67-7750156da9f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:38.166503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7ea94-7c9e-45e9-bd67-7750156da9f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:38.168480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7ea94-7c9e-45e9-bd67-7750156da9f6 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:38.202071 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2342/4671] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:02:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:02:43.298623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9d2aa-bce0-4bbc-9f94-f52bd5147afd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:43.299084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9d2aa-bce0-4bbc-9f94-f52bd5147afd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:43.299341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9d2aa-bce0-4bbc-9f94-f52bd5147afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:43.334031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0ac9d2aa-bce0-4bbc-9f94-f52bd5147afd None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:02:43.335563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0ac9d2aa-bce0-4bbc-9f94-f52bd5147afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:43.430789 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2330/4672] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:02:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:02:43.462854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7ea94-7c9e-45e9-bd67-7750156da9f6 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:43.464939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d8d7ea94-7c9e-45e9-bd67-7750156da9f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:43.606327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7ea94-7c9e-45e9-bd67-7750156da9f6 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:43.613819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb65a7-63ce-41ad-97f7-fd87b2bef3b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:43.614847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb65a7-63ce-41ad-97f7-fd87b2bef3b5 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:43.615331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb65a7-63ce-41ad-97f7-fd87b2bef3b5 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:43.615802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb65a7-63ce-41ad-97f7-fd87b2bef3b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:43.627940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb65a7-63ce-41ad-97f7-fd87b2bef3b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:43.630006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb65a7-63ce-41ad-97f7-fd87b2bef3b5 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:43.638925 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2343/4673] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:02:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:02:52.614213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03c60d-815d-4c97-a56d-781d738e04e9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:52.614849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03c60d-815d-4c97-a56d-781d738e04e9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:52.615275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03c60d-815d-4c97-a56d-781d738e04e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:52.810528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6d03c60d-815d-4c97-a56d-781d738e04e9 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:02:52.812325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6d03c60d-815d-4c97-a56d-781d738e04e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:52.822512 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2331/4674] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:02:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:02:52.851274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb65a7-63ce-41ad-97f7-fd87b2bef3b5 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:52.872283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb65a7-63ce-41ad-97f7-fd87b2bef3b5 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:52.891649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c86fe8-0366-4bef-84c9-9681c6fa8d25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:52.894779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c86fe8-0366-4bef-84c9-9681c6fa8d25 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:52.895437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c86fe8-0366-4bef-84c9-9681c6fa8d25 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:52.895945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c86fe8-0366-4bef-84c9-9681c6fa8d25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:52.921208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c86fe8-0366-4bef-84c9-9681c6fa8d25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:52.934904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c86fe8-0366-4bef-84c9-9681c6fa8d25 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:52.975898 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2344/4675] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:02:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:02:55.792452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03c60d-815d-4c97-a56d-781d738e04e9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:55.794203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6d03c60d-815d-4c97-a56d-781d738e04e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:55.999642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03c60d-815d-4c97-a56d-781d738e04e9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:56.006203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff0069-0edd-4273-81e7-7fb76801c8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:56.006966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff0069-0edd-4273-81e7-7fb76801c8df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:56.013580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff0069-0edd-4273-81e7-7fb76801c8df admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:56.014677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff0069-0edd-4273-81e7-7fb76801c8df admin admin] PATH_INFO: `/v3/users/df38bba9885247a4912244fe62c42650` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:56.017047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff0069-0edd-4273-81e7-7fb76801c8df admin admin] RBAC: Authorizing `identity:delete_user(user_id=df38bba9885247a4912244fe62c42650)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:56.020291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff0069-0edd-4273-81e7-7fb76801c8df admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:56.160224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7fff0069-0edd-4273-81e7-7fb76801c8df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df38bba9885247a4912244fe62c42650'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:56.182415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7fff0069-0edd-4273-81e7-7fb76801c8df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df38bba9885247a4912244fe62c42650'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:56.183425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7fff0069-0edd-4273-81e7-7fb76801c8df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df38bba9885247a4912244fe62c42650'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:56.204111 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:02:56.221729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7fff0069-0edd-4273-81e7-7fb76801c8df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df38bba9885247a4912244fe62c42650'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:56.235971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7fff0069-0edd-4273-81e7-7fb76801c8df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df38bba9885247a4912244fe62c42650'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:56.250309 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2332/4676] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:02:55 2022] DELETE /identity/v3/users/df38bba9885247a4912244fe62c42650 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:02:58.488284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c86fe8-0366-4bef-84c9-9681c6fa8d25 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:58.493726 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:02:58.504258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c86fe8-0366-4bef-84c9-9681c6fa8d25 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:58.640148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316f890-d60b-4669-b23e-cbcc69bb9508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:58.641259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316f890-d60b-4669-b23e-cbcc69bb9508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:58.641930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316f890-d60b-4669-b23e-cbcc69bb9508 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:58.642404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316f890-d60b-4669-b23e-cbcc69bb9508 admin admin] PATH_INFO: `/v3/projects/8cebaec8d08f423f84daed734043d403` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:58.645121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316f890-d60b-4669-b23e-cbcc69bb9508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cebaec8d08f423f84daed734043d403)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:58.650692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316f890-d60b-4669-b23e-cbcc69bb9508 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:58.727796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff0069-0edd-4273-81e7-7fb76801c8df admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:58.730351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7fff0069-0edd-4273-81e7-7fb76801c8df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:58.763676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2316f890-d60b-4669-b23e-cbcc69bb9508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cebaec8d08f423f84daed734043d403', 'request_id': 'req-2316f890-d60b-4669-b23e-cbcc69bb9508'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:58.783677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2316f890-d60b-4669-b23e-cbcc69bb9508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cebaec8d08f423f84daed734043d403', 'request_id': 'req-2316f890-d60b-4669-b23e-cbcc69bb9508'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:58.791562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2316f890-d60b-4669-b23e-cbcc69bb9508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cebaec8d08f423f84daed734043d403', 'request_id': 'req-2316f890-d60b-4669-b23e-cbcc69bb9508'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:58.815963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2316f890-d60b-4669-b23e-cbcc69bb9508 admin admin] The token cache is being invalidate because project 8cebaec8d08f423f84daed734043d403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:02:58.816247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2316f890-d60b-4669-b23e-cbcc69bb9508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:58.816991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2316f890-d60b-4669-b23e-cbcc69bb9508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:58.820793 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2345/4677] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:02:58 2022] DELETE /identity/v3/projects/8cebaec8d08f423f84daed734043d403 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:02:58.824450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316f890-d60b-4669-b23e-cbcc69bb9508 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:58.825911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2316f890-d60b-4669-b23e-cbcc69bb9508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:58.973537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316f890-d60b-4669-b23e-cbcc69bb9508 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:58.982194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0791d13-4f8f-47e5-b438-329e9ea15be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:58.986140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0791d13-4f8f-47e5-b438-329e9ea15be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:58.986482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0791d13-4f8f-47e5-b438-329e9ea15be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:58.986767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0791d13-4f8f-47e5-b438-329e9ea15be9 admin admin] PATH_INFO: `/v3/users/1b60805d3ba4446e8df25fddb6d7f831` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:58.990160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0791d13-4f8f-47e5-b438-329e9ea15be9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b60805d3ba4446e8df25fddb6d7f831)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:58.993401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0791d13-4f8f-47e5-b438-329e9ea15be9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:59.006144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff0069-0edd-4273-81e7-7fb76801c8df admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:59.086317 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:02:59.123167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d0791d13-4f8f-47e5-b438-329e9ea15be9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b60805d3ba4446e8df25fddb6d7f831'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:59.125915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d0791d13-4f8f-47e5-b438-329e9ea15be9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b60805d3ba4446e8df25fddb6d7f831'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:59.152587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d0791d13-4f8f-47e5-b438-329e9ea15be9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b60805d3ba4446e8df25fddb6d7f831'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:59.185631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8c7b2-15b0-458c-a9ae-9069221280a9 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b55be2896d4a84b8d0184ff2fff459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f771faf07aeb43c59f6a8b97c92a4bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:59.186702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8c7b2-15b0-458c-a9ae-9069221280a9 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:59.186702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8c7b2-15b0-458c-a9ae-9069221280a9 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:59.187207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8c7b2-15b0-458c-a9ae-9069221280a9 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:59.188796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8c7b2-15b0-458c-a9ae-9069221280a9 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:02:59.189208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8c7b2-15b0-458c-a9ae-9069221280a9 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:59.193955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8c7b2-15b0-458c-a9ae-9069221280a9 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:59.221087 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2333/4678] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 494 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:02:59.225580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8c7b2-15b0-458c-a9ae-9069221280a9 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:59.230948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dcd8c7b2-15b0-458c-a9ae-9069221280a9 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:59.244175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d0791d13-4f8f-47e5-b438-329e9ea15be9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b60805d3ba4446e8df25fddb6d7f831'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:59.272402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d0791d13-4f8f-47e5-b438-329e9ea15be9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b60805d3ba4446e8df25fddb6d7f831'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:02:59.278361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8c7b2-15b0-458c-a9ae-9069221280a9 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:59.294146 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2346/4679] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:02:58 2022] DELETE /identity/v3/users/1b60805d3ba4446e8df25fddb6d7f831 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:02:59.299016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37553fb4-932f-4e74-8992-d7d8fa11e8e5 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b55be2896d4a84b8d0184ff2fff459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f771faf07aeb43c59f6a8b97c92a4bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:59.301900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37553fb4-932f-4e74-8992-d7d8fa11e8e5 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:59.302407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37553fb4-932f-4e74-8992-d7d8fa11e8e5 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:59.304586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37553fb4-932f-4e74-8992-d7d8fa11e8e5 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:59.305693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37553fb4-932f-4e74-8992-d7d8fa11e8e5 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:59.312702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37553fb4-932f-4e74-8992-d7d8fa11e8e5 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:59.423060 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2334/4680] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:02:59 2022] POST /identity/v3/projects => generated 344 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:02:59.427079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0791d13-4f8f-47e5-b438-329e9ea15be9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:59.506792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37553fb4-932f-4e74-8992-d7d8fa11e8e5 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:02:59.510032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-37553fb4-932f-4e74-8992-d7d8fa11e8e5 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:59.707202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0791d13-4f8f-47e5-b438-329e9ea15be9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:59.734723 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:02:59.777075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37553fb4-932f-4e74-8992-d7d8fa11e8e5 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:02:59.795857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ed5ac-b54e-42d4-93a0-8f88775c6516 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:59.797495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ed5ac-b54e-42d4-93a0-8f88775c6516 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:59.797773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ed5ac-b54e-42d4-93a0-8f88775c6516 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:59.798043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ed5ac-b54e-42d4-93a0-8f88775c6516 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:59.806790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ef8ed5ac-b54e-42d4-93a0-8f88775c6516 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:02:59.847818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ed5ac-b54e-42d4-93a0-8f88775c6516 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:59.849066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ed5ac-b54e-42d4-93a0-8f88775c6516 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:59.886544 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2335/4681] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:02:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:02:59.959447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619afeab-21c2-4bf9-9cdd-021a85b1d4bb tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b55be2896d4a84b8d0184ff2fff459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f771faf07aeb43c59f6a8b97c92a4bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:02:59.960278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619afeab-21c2-4bf9-9cdd-021a85b1d4bb tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:02:59.960759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619afeab-21c2-4bf9-9cdd-021a85b1d4bb tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:02:59.961360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619afeab-21c2-4bf9-9cdd-021a85b1d4bb tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:02:59.962182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619afeab-21c2-4bf9-9cdd-021a85b1d4bb tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:02:59.962653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619afeab-21c2-4bf9-9cdd-021a85b1d4bb tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:02:59.965166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619afeab-21c2-4bf9-9cdd-021a85b1d4bb tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:02:59.989947 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2347/4682] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 563 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:03:00.124340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ed5ac-b54e-42d4-93a0-8f88775c6516 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:00.126076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ef8ed5ac-b54e-42d4-93a0-8f88775c6516 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:00.362964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ed5ac-b54e-42d4-93a0-8f88775c6516 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:00.376555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adafcbf-6369-4438-a8af-601f819cb720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:00.379544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adafcbf-6369-4438-a8af-601f819cb720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:00.379832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adafcbf-6369-4438-a8af-601f819cb720 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:00.380107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adafcbf-6369-4438-a8af-601f819cb720 admin admin] PATH_INFO: `/v3/projects/291887ae95d64ec89ba2975df7daeb2a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:00.384310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adafcbf-6369-4438-a8af-601f819cb720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=291887ae95d64ec89ba2975df7daeb2a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:00.391982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adafcbf-6369-4438-a8af-601f819cb720 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:00.529270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2adafcbf-6369-4438-a8af-601f819cb720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '291887ae95d64ec89ba2975df7daeb2a', 'request_id': 'req-2adafcbf-6369-4438-a8af-601f819cb720'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:00.549266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2adafcbf-6369-4438-a8af-601f819cb720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '291887ae95d64ec89ba2975df7daeb2a', 'request_id': 'req-2adafcbf-6369-4438-a8af-601f819cb720'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:00.558259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2adafcbf-6369-4438-a8af-601f819cb720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '291887ae95d64ec89ba2975df7daeb2a', 'request_id': 'req-2adafcbf-6369-4438-a8af-601f819cb720'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:00.599096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2adafcbf-6369-4438-a8af-601f819cb720 admin admin] The token cache is being invalidate because project 291887ae95d64ec89ba2975df7daeb2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:03:00.599454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2adafcbf-6369-4438-a8af-601f819cb720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:00.602462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2adafcbf-6369-4438-a8af-601f819cb720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:00.602462 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2336/4683] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:03:00 2022] DELETE /identity/v3/projects/291887ae95d64ec89ba2975df7daeb2a => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:03:00.607138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a9acc-92f9-44ae-b708-3b7f2695f943 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:00.607452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a9acc-92f9-44ae-b708-3b7f2695f943 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:00.608243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a9acc-92f9-44ae-b708-3b7f2695f943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:00.669635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d80a9acc-92f9-44ae-b708-3b7f2695f943 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:03:00.671614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d80a9acc-92f9-44ae-b708-3b7f2695f943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:00.898289 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:03:00.936656 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2348/4684] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:03:00.943186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09777d-19eb-449c-b7e2-17c09d64c9e5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:00.945336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09777d-19eb-449c-b7e2-17c09d64c9e5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:00.945875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09777d-19eb-449c-b7e2-17c09d64c9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:00.985705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-eb09777d-19eb-449c-b7e2-17c09d64c9e5 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:03:00.986958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eb09777d-19eb-449c-b7e2-17c09d64c9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:00.998251 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2337/4685] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:03:01.002452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a9acc-92f9-44ae-b708-3b7f2695f943 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:01.015481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a9acc-92f9-44ae-b708-3b7f2695f943 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:01.021484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50850090-2106-46db-81f0-d3c8e5d185e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:01.022433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50850090-2106-46db-81f0-d3c8e5d185e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:01.023710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50850090-2106-46db-81f0-d3c8e5d185e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:01.024213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50850090-2106-46db-81f0-d3c8e5d185e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:01.025114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50850090-2106-46db-81f0-d3c8e5d185e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:03:01.025643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50850090-2106-46db-81f0-d3c8e5d185e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:01.028051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50850090-2106-46db-81f0-d3c8e5d185e4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:01.048303 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2349/4686] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:03:01.053703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09777d-19eb-449c-b7e2-17c09d64c9e5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:01.099973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09777d-19eb-449c-b7e2-17c09d64c9e5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:01.112103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1eb1d-e181-4000-ac49-5ecee135407c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:01.112637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1eb1d-e181-4000-ac49-5ecee135407c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:01.112830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1eb1d-e181-4000-ac49-5ecee135407c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:01.113074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1eb1d-e181-4000-ac49-5ecee135407c admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:01.114116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1eb1d-e181-4000-ac49-5ecee135407c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:01.117652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1eb1d-e181-4000-ac49-5ecee135407c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:01.182213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50850090-2106-46db-81f0-d3c8e5d185e4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:01.195055 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2338/4687] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:03:01 2022] POST /identity/v3/projects => generated 389 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:03:01.204027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50850090-2106-46db-81f0-d3c8e5d185e4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:01.310142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c810ba7-2b8d-490c-9340-67800331a460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:01.311504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c810ba7-2b8d-490c-9340-67800331a460 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:01.313518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c810ba7-2b8d-490c-9340-67800331a460 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:01.313518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c810ba7-2b8d-490c-9340-67800331a460 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:01.315832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c810ba7-2b8d-490c-9340-67800331a460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:01.316668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c810ba7-2b8d-490c-9340-67800331a460 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:01.350918 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2350/4688] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:03:01 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:03:01.351150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1eb1d-e181-4000-ac49-5ecee135407c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:01.363555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1eb1d-e181-4000-ac49-5ecee135407c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:01.389222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d03d5a-a350-4c1b-a3e5-e62dbf01424d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:01.393459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d03d5a-a350-4c1b-a3e5-e62dbf01424d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:01.393751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d03d5a-a350-4c1b-a3e5-e62dbf01424d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:01.394026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d03d5a-a350-4c1b-a3e5-e62dbf01424d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:01.401894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d03d5a-a350-4c1b-a3e5-e62dbf01424d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:01.411545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d03d5a-a350-4c1b-a3e5-e62dbf01424d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:01.450062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c810ba7-2b8d-490c-9340-67800331a460 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:01.469956 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2339/4689] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:03:01.470859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c810ba7-2b8d-490c-9340-67800331a460 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:01.482085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb8ba5-3ce5-4a9d-8632-1fabb95f16a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:01.484040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb8ba5-3ce5-4a9d-8632-1fabb95f16a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:01.484328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb8ba5-3ce5-4a9d-8632-1fabb95f16a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:01.485908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb8ba5-3ce5-4a9d-8632-1fabb95f16a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:01.486639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb8ba5-3ce5-4a9d-8632-1fabb95f16a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:01.491800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb8ba5-3ce5-4a9d-8632-1fabb95f16a3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:01.535632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d03d5a-a350-4c1b-a3e5-e62dbf01424d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:01.546419 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2351/4690] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:03:01.553132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d03d5a-a350-4c1b-a3e5-e62dbf01424d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:01.566448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a885eea-7b94-4738-ac5a-a60bc9a15b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:01.568133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a885eea-7b94-4738-ac5a-a60bc9a15b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:01.568417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a885eea-7b94-4738-ac5a-a60bc9a15b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:01.569995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a885eea-7b94-4738-ac5a-a60bc9a15b9e admin admin] PATH_INFO: `/v3/projects/9d28561f1ac44f969d2af8dfc01a663a/users/0e653b28181749d292ce144d4b717ab7/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:01.599953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a885eea-7b94-4738-ac5a-a60bc9a15b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d28561f1ac44f969d2af8dfc01a663a, user_id=0e653b28181749d292ce144d4b717ab7, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:01.611246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a885eea-7b94-4738-ac5a-a60bc9a15b9e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:01.677029 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2340/4691] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:03:01 2022] PUT /identity/v3/projects/9d28561f1ac44f969d2af8dfc01a663a/users/0e653b28181749d292ce144d4b717ab7/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:03:01.682019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653d862-ec70-4eb5-8cb7-97a59551c631 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:01.682327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653d862-ec70-4eb5-8cb7-97a59551c631 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:01.682636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653d862-ec70-4eb5-8cb7-97a59551c631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:01.719289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6653d862-ec70-4eb5-8cb7-97a59551c631 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:03:01.721161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6653d862-ec70-4eb5-8cb7-97a59551c631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:01.881530 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2352/4692] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:03:01.901738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a885eea-7b94-4738-ac5a-a60bc9a15b9e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:01.904222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5a885eea-7b94-4738-ac5a-a60bc9a15b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:01.960323 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:03:02.085485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a885eea-7b94-4738-ac5a-a60bc9a15b9e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:02.103024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9ff74-0681-411c-b31a-d7e0768b7ef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:02.104382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9ff74-0681-411c-b31a-d7e0768b7ef5 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:02.104382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9ff74-0681-411c-b31a-d7e0768b7ef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:02.104382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9ff74-0681-411c-b31a-d7e0768b7ef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:02.162655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9ff74-0681-411c-b31a-d7e0768b7ef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:02.175882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9ff74-0681-411c-b31a-d7e0768b7ef5 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:02.228417 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2341/4693] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:03:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:03:03.116352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653d862-ec70-4eb5-8cb7-97a59551c631 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:03.119225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6653d862-ec70-4eb5-8cb7-97a59551c631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:03.238500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653d862-ec70-4eb5-8cb7-97a59551c631 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:03.246284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36d276-b40e-4f6f-833c-7ee5c02313b3 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b55be2896d4a84b8d0184ff2fff459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f771faf07aeb43c59f6a8b97c92a4bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:03.253455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36d276-b40e-4f6f-833c-7ee5c02313b3 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:03.253856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36d276-b40e-4f6f-833c-7ee5c02313b3 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:03.254225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36d276-b40e-4f6f-833c-7ee5c02313b3 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] PATH_INFO: `/v3/projects/6935eee31f68401bbb090df301f081cb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:03.255543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36d276-b40e-4f6f-833c-7ee5c02313b3 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6935eee31f68401bbb090df301f081cb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:03.257998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36d276-b40e-4f6f-833c-7ee5c02313b3 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:03.260065 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:03:03.337797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a36d276-b40e-4f6f-833c-7ee5c02313b3 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6935eee31f68401bbb090df301f081cb', 'request_id': 'req-1a36d276-b40e-4f6f-833c-7ee5c02313b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:03.368571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a36d276-b40e-4f6f-833c-7ee5c02313b3 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6935eee31f68401bbb090df301f081cb', 'request_id': 'req-1a36d276-b40e-4f6f-833c-7ee5c02313b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:03.381764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a36d276-b40e-4f6f-833c-7ee5c02313b3 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6935eee31f68401bbb090df301f081cb', 'request_id': 'req-1a36d276-b40e-4f6f-833c-7ee5c02313b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:03.397392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a36d276-b40e-4f6f-833c-7ee5c02313b3 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] The token cache is being invalidate because project 6935eee31f68401bbb090df301f081cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:03:03.399037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a36d276-b40e-4f6f-833c-7ee5c02313b3 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:03.399886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a36d276-b40e-4f6f-833c-7ee5c02313b3 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:03.409757 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2353/4694] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:03:03 2022] DELETE /identity/v3/projects/6935eee31f68401bbb090df301f081cb => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:03:03.427181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9ff74-0681-411c-b31a-d7e0768b7ef5 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:03.428849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ecd9ff74-0681-411c-b31a-d7e0768b7ef5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:03.456388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9ff74-0681-411c-b31a-d7e0768b7ef5 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:03.605453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d24cf0-0506-41c9-aec0-3fa30f75a432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:03.606100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d24cf0-0506-41c9-aec0-3fa30f75a432 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:03.606386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d24cf0-0506-41c9-aec0-3fa30f75a432 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:03.606660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d24cf0-0506-41c9-aec0-3fa30f75a432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:03.617320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e9d24cf0-0506-41c9-aec0-3fa30f75a432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:03.767576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d24cf0-0506-41c9-aec0-3fa30f75a432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:03.773474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d24cf0-0506-41c9-aec0-3fa30f75a432 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:03.803101 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2342/4695] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:03:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:03:12.064148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36d276-b40e-4f6f-833c-7ee5c02313b3 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:12.066359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1a36d276-b40e-4f6f-833c-7ee5c02313b3 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:12.094377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36d276-b40e-4f6f-833c-7ee5c02313b3 tempest-RoutersAdminTest-25705455 tempest-RoutersAdminTest-25705455-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:12.105307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1dabd0-f9f7-4654-926a-ecacdadee694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:12.106607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dabd0-f9f7-4654-926a-ecacdadee694 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:12.109474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dabd0-f9f7-4654-926a-ecacdadee694 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:12.110128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dabd0-f9f7-4654-926a-ecacdadee694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:12.115787 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1c1dabd0-f9f7-4654-926a-ecacdadee694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:12.163134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1dabd0-f9f7-4654-926a-ecacdadee694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:12.168511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1dabd0-f9f7-4654-926a-ecacdadee694 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:12.198548 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2354/4696] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:03:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:03:13.166343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578d324-85f8-462b-aa87-f34f9cfa36ee None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:13.166936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578d324-85f8-462b-aa87-f34f9cfa36ee None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:13.167238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578d324-85f8-462b-aa87-f34f9cfa36ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:13.203049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b578d324-85f8-462b-aa87-f34f9cfa36ee None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:03:13.206401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b578d324-85f8-462b-aa87-f34f9cfa36ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:13.293024 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2343/4697] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 10:03:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:03:13.359123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1dabd0-f9f7-4654-926a-ecacdadee694 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:13.361407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1c1dabd0-f9f7-4654-926a-ecacdadee694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:13.536905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1dabd0-f9f7-4654-926a-ecacdadee694 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:13.543720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729c564-b175-48d3-801a-554436a0db85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:13.545917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729c564-b175-48d3-801a-554436a0db85 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:13.546341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729c564-b175-48d3-801a-554436a0db85 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:13.546725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729c564-b175-48d3-801a-554436a0db85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:13.557837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729c564-b175-48d3-801a-554436a0db85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:13.561886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729c564-b175-48d3-801a-554436a0db85 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:13.588887 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2355/4698] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:03:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:03:17.070111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a39f13-cffc-4608-b210-35378f5d86d2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:17.071011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a39f13-cffc-4608-b210-35378f5d86d2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:17.071494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a39f13-cffc-4608-b210-35378f5d86d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:17.106753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-49a39f13-cffc-4608-b210-35378f5d86d2 None None] MFA Rules not processed for user `3b97b83ebcf242d0abd55dfbb15ab066`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:03:17.109957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-49a39f13-cffc-4608-b210-35378f5d86d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:17.127154 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:03:17.261525 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2344/4699] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:03:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:03:20.600444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de980eef-185c-4c62-885c-c82e69751d1f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:20.600945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de980eef-185c-4c62-885c-c82e69751d1f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:20.601027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de980eef-185c-4c62-885c-c82e69751d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:20.641825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-de980eef-185c-4c62-885c-c82e69751d1f None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:03:20.643083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-de980eef-185c-4c62-885c-c82e69751d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:20.666440 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2356/4700] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 10:03:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:03:20.684498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a39f13-cffc-4608-b210-35378f5d86d2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:20.703144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a39f13-cffc-4608-b210-35378f5d86d2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:20.714370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7890ba3-5947-4ff8-8710-74dd14f63800 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:20.715229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7890ba3-5947-4ff8-8710-74dd14f63800 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:20.715813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7890ba3-5947-4ff8-8710-74dd14f63800 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:20.716219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7890ba3-5947-4ff8-8710-74dd14f63800 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:20.727876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7890ba3-5947-4ff8-8710-74dd14f63800 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:20.729547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7890ba3-5947-4ff8-8710-74dd14f63800 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:20.755703 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2345/4701] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:03:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:03:21.408567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc17a96-d8f3-4969-87a2-05fbb203fa15 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:21.409099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc17a96-d8f3-4969-87a2-05fbb203fa15 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:21.409526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc17a96-d8f3-4969-87a2-05fbb203fa15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:21.437242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6fc17a96-d8f3-4969-87a2-05fbb203fa15 None None] MFA Rules not processed for user `76de66d46a57438f960c832cb8a70c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:03:21.440855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6fc17a96-d8f3-4969-87a2-05fbb203fa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:21.515287 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:03:21.540282 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2357/4702] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:03:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:03:23.784962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651d088-83a5-40da-a525-4565d1f31cb1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:23.786340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651d088-83a5-40da-a525-4565d1f31cb1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:23.786771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651d088-83a5-40da-a525-4565d1f31cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:23.883282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3651d088-83a5-40da-a525-4565d1f31cb1 None None] MFA Rules not processed for user `0e653b28181749d292ce144d4b717ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:03:23.884894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3651d088-83a5-40da-a525-4565d1f31cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:24.077814 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2346/4703] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:03:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:03:24.089054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe891e36-7d35-4485-ad8f-df4ccb77df0f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:24.089595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe891e36-7d35-4485-ad8f-df4ccb77df0f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:24.089595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe891e36-7d35-4485-ad8f-df4ccb77df0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:24.125569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fe891e36-7d35-4485-ad8f-df4ccb77df0f None None] MFA Rules not processed for user `0e653b28181749d292ce144d4b717ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:03:24.126808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fe891e36-7d35-4485-ad8f-df4ccb77df0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:24.145261 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2358/4704] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:03:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:03:24.580668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651d088-83a5-40da-a525-4565d1f31cb1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:24.584038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3651d088-83a5-40da-a525-4565d1f31cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:24.755011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651d088-83a5-40da-a525-4565d1f31cb1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:24.767430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775015ef-84f6-4310-9774-a19b445bbbe6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:24.768791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775015ef-84f6-4310-9774-a19b445bbbe6 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:24.769253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775015ef-84f6-4310-9774-a19b445bbbe6 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:24.769660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775015ef-84f6-4310-9774-a19b445bbbe6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:24.784585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775015ef-84f6-4310-9774-a19b445bbbe6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:24.786559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775015ef-84f6-4310-9774-a19b445bbbe6 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:24.799496 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2347/4705] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:03:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:03:34.114331 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:03:34.232863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe891e36-7d35-4485-ad8f-df4ccb77df0f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:34.235644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fe891e36-7d35-4485-ad8f-df4ccb77df0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:34.411149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe891e36-7d35-4485-ad8f-df4ccb77df0f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:34.420308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fe05d-e05b-4b15-82fa-668e3829173a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:34.431851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fe05d-e05b-4b15-82fa-668e3829173a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:34.432392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fe05d-e05b-4b15-82fa-668e3829173a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:34.432875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fe05d-e05b-4b15-82fa-668e3829173a admin admin] PATH_INFO: `/v3/users/d5559b87c3fb4fc1933a038eb3070193` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:34.436875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fe05d-e05b-4b15-82fa-668e3829173a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5559b87c3fb4fc1933a038eb3070193)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:34.441271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fe05d-e05b-4b15-82fa-668e3829173a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:34.549731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-827fe05d-e05b-4b15-82fa-668e3829173a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5559b87c3fb4fc1933a038eb3070193'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:34.550541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-827fe05d-e05b-4b15-82fa-668e3829173a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5559b87c3fb4fc1933a038eb3070193'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:34.569601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-827fe05d-e05b-4b15-82fa-668e3829173a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5559b87c3fb4fc1933a038eb3070193'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:34.593777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-827fe05d-e05b-4b15-82fa-668e3829173a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5559b87c3fb4fc1933a038eb3070193'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:34.613387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-827fe05d-e05b-4b15-82fa-668e3829173a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5559b87c3fb4fc1933a038eb3070193'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:34.624067 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2359/4706] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:03:34 2022] DELETE /identity/v3/users/d5559b87c3fb4fc1933a038eb3070193 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:03:34.793084 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:03:35.953262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775015ef-84f6-4310-9774-a19b445bbbe6 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:35.972492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775015ef-84f6-4310-9774-a19b445bbbe6 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:36.080410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b7054-d1e2-4179-8a4a-6137f21deb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:36.081582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b7054-d1e2-4179-8a4a-6137f21deb93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:36.082275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b7054-d1e2-4179-8a4a-6137f21deb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:36.083392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b7054-d1e2-4179-8a4a-6137f21deb93 admin admin] PATH_INFO: `/v3/projects/3c84a7b4fecc420bb93364f4546ba269` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:36.086441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b7054-d1e2-4179-8a4a-6137f21deb93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c84a7b4fecc420bb93364f4546ba269)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:36.088624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b7054-d1e2-4179-8a4a-6137f21deb93 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:36.291433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f68b7054-d1e2-4179-8a4a-6137f21deb93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c84a7b4fecc420bb93364f4546ba269', 'request_id': 'req-f68b7054-d1e2-4179-8a4a-6137f21deb93'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:36.312847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f68b7054-d1e2-4179-8a4a-6137f21deb93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c84a7b4fecc420bb93364f4546ba269', 'request_id': 'req-f68b7054-d1e2-4179-8a4a-6137f21deb93'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:36.320367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f68b7054-d1e2-4179-8a4a-6137f21deb93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c84a7b4fecc420bb93364f4546ba269', 'request_id': 'req-f68b7054-d1e2-4179-8a4a-6137f21deb93'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:36.343477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f68b7054-d1e2-4179-8a4a-6137f21deb93 admin admin] The token cache is being invalidate because project 3c84a7b4fecc420bb93364f4546ba269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:03:36.344118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f68b7054-d1e2-4179-8a4a-6137f21deb93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:36.345052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f68b7054-d1e2-4179-8a4a-6137f21deb93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:36.348208 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2348/4707] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:03:35 2022] DELETE /identity/v3/projects/3c84a7b4fecc420bb93364f4546ba269 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:03:36.357225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db29621-c69e-49a9-9002-bea660ac2b11 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:36.358629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db29621-c69e-49a9-9002-bea660ac2b11 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:36.359425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db29621-c69e-49a9-9002-bea660ac2b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:36.411639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0db29621-c69e-49a9-9002-bea660ac2b11 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:03:36.413749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0db29621-c69e-49a9-9002-bea660ac2b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:36.551269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ac4fd-c179-43d6-bb0b-d906fd2d1d29 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:36.551531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ac4fd-c179-43d6-bb0b-d906fd2d1d29 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:36.552202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ac4fd-c179-43d6-bb0b-d906fd2d1d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:36.552933 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2360/4708] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:03:36.578654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6d7ac4fd-c179-43d6-bb0b-d906fd2d1d29 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:03:36.580274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6d7ac4fd-c179-43d6-bb0b-d906fd2d1d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:36.599380 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2349/4709] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:03:36.605482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db29621-c69e-49a9-9002-bea660ac2b11 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:36.627395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db29621-c69e-49a9-9002-bea660ac2b11 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:36.652240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fff25d-b020-4538-9500-962a624efb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:36.653594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fff25d-b020-4538-9500-962a624efb05 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:36.654031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fff25d-b020-4538-9500-962a624efb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:36.655792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fff25d-b020-4538-9500-962a624efb05 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:36.656761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fff25d-b020-4538-9500-962a624efb05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:03:36.657248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fff25d-b020-4538-9500-962a624efb05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:36.659035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fff25d-b020-4538-9500-962a624efb05 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:36.673561 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2361/4710] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:03:36.677868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ac4fd-c179-43d6-bb0b-d906fd2d1d29 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:36.689721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ac4fd-c179-43d6-bb0b-d906fd2d1d29 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:36.695157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dfbf0-d2e9-4e21-bac1-1bc3ce3a48eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:36.696108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dfbf0-d2e9-4e21-bac1-1bc3ce3a48eb admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:36.696629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dfbf0-d2e9-4e21-bac1-1bc3ce3a48eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:36.697122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dfbf0-d2e9-4e21-bac1-1bc3ce3a48eb admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:36.697976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752dfbf0-d2e9-4e21-bac1-1bc3ce3a48eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:36.700591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752dfbf0-d2e9-4e21-bac1-1bc3ce3a48eb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:36.754218 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2350/4711] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:03:36 2022] POST /identity/v3/projects => generated 397 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:03:36.758177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fff25d-b020-4538-9500-962a624efb05 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:36.771819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fff25d-b020-4538-9500-962a624efb05 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:36.776867 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:03:36.869541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ffdb2-6c2f-42db-be07-062f6fdf7537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:36.870293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ffdb2-6c2f-42db-be07-062f6fdf7537 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:36.870678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ffdb2-6c2f-42db-be07-062f6fdf7537 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:36.871058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ffdb2-6c2f-42db-be07-062f6fdf7537 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:36.872636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ffdb2-6c2f-42db-be07-062f6fdf7537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:36.874712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ffdb2-6c2f-42db-be07-062f6fdf7537 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:36.906756 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2362/4712] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:03:36 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:03:36.911368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dfbf0-d2e9-4e21-bac1-1bc3ce3a48eb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:36.930935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dfbf0-d2e9-4e21-bac1-1bc3ce3a48eb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:36.945139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bd181-751b-4321-ad54-8477c157867a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:36.946769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bd181-751b-4321-ad54-8477c157867a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:36.946769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bd181-751b-4321-ad54-8477c157867a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:36.946769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bd181-751b-4321-ad54-8477c157867a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:36.947397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bd181-751b-4321-ad54-8477c157867a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:36.949908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bd181-751b-4321-ad54-8477c157867a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:36.966968 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2351/4713] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:03:36.971090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ffdb2-6c2f-42db-be07-062f6fdf7537 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:36.988537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ffdb2-6c2f-42db-be07-062f6fdf7537 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:36.995735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbb08e-ff87-405e-a53c-1abf3248eb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:36.996363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbb08e-ff87-405e-a53c-1abf3248eb2e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:36.996660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbb08e-ff87-405e-a53c-1abf3248eb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:36.997587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbb08e-ff87-405e-a53c-1abf3248eb2e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:36.998285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbb08e-ff87-405e-a53c-1abf3248eb2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:37.000274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbb08e-ff87-405e-a53c-1abf3248eb2e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:37.029235 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2363/4714] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:03:37.032224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bd181-751b-4321-ad54-8477c157867a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:37.057118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bd181-751b-4321-ad54-8477c157867a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:37.064435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556573e-e289-48b7-ac71-4cf8a11cef87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:37.065735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556573e-e289-48b7-ac71-4cf8a11cef87 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:37.073639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556573e-e289-48b7-ac71-4cf8a11cef87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:37.074243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556573e-e289-48b7-ac71-4cf8a11cef87 admin admin] PATH_INFO: `/v3/projects/7c8a53266994414cbf4e9019d91ea3cd/users/b87c2bb52c344b4697baeed01e078140/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:37.110758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556573e-e289-48b7-ac71-4cf8a11cef87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c8a53266994414cbf4e9019d91ea3cd, user_id=b87c2bb52c344b4697baeed01e078140, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:37.123154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556573e-e289-48b7-ac71-4cf8a11cef87 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:37.170028 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2352/4715] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:03:37 2022] PUT /identity/v3/projects/7c8a53266994414cbf4e9019d91ea3cd/users/b87c2bb52c344b4697baeed01e078140/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:03:37.183240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5e14c-5005-4793-9021-e296aa0df2ec None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:37.183442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5e14c-5005-4793-9021-e296aa0df2ec None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:37.183850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5e14c-5005-4793-9021-e296aa0df2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:37.226885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-91e5e14c-5005-4793-9021-e296aa0df2ec None None] MFA Rules not processed for user `b87c2bb52c344b4697baeed01e078140`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:03:37.228001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-91e5e14c-5005-4793-9021-e296aa0df2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:37.336383 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2364/4716] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:03:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:03:37.347710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88495d5-9229-410f-9099-1132b00af0e8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:37.347992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88495d5-9229-410f-9099-1132b00af0e8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:37.348267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88495d5-9229-410f-9099-1132b00af0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:37.379740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c88495d5-9229-410f-9099-1132b00af0e8 None None] MFA Rules not processed for user `b87c2bb52c344b4697baeed01e078140`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:03:37.381831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c88495d5-9229-410f-9099-1132b00af0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:37.393369 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2353/4717] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:03:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:03:37.742268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5e14c-5005-4793-9021-e296aa0df2ec None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:37.743757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-91e5e14c-5005-4793-9021-e296aa0df2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:37.851356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5e14c-5005-4793-9021-e296aa0df2ec None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:37.859128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2108eeb-45ea-4e70-a9e1-c14a14af9e7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:37.859693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2108eeb-45ea-4e70-a9e1-c14a14af9e7f service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:37.859969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2108eeb-45ea-4e70-a9e1-c14a14af9e7f service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:37.860394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2108eeb-45ea-4e70-a9e1-c14a14af9e7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:37.877922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2108eeb-45ea-4e70-a9e1-c14a14af9e7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:37.879831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2108eeb-45ea-4e70-a9e1-c14a14af9e7f service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:37.887039 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:03:37.900240 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2365/4718] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:03:37 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:03:37.945357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302636d0-7685-4c50-8ff3-5efb676962ca None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:37.945776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302636d0-7685-4c50-8ff3-5efb676962ca None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:37.947038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302636d0-7685-4c50-8ff3-5efb676962ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:37.994786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-302636d0-7685-4c50-8ff3-5efb676962ca None None] MFA Rules not processed for user `b87c2bb52c344b4697baeed01e078140`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:03:37.994786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-302636d0-7685-4c50-8ff3-5efb676962ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:38.004349 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2354/4719] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:03:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:03:38.027891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2108eeb-45ea-4e70-a9e1-c14a14af9e7f service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:38.061238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2108eeb-45ea-4e70-a9e1-c14a14af9e7f service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:38.071186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82570fd7-d6db-4bd6-86b8-80ffce0063cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:38.087772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82570fd7-d6db-4bd6-86b8-80ffce0063cc service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:38.092503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82570fd7-d6db-4bd6-86b8-80ffce0063cc service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:38.093500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82570fd7-d6db-4bd6-86b8-80ffce0063cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:38.097155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-82570fd7-d6db-4bd6-86b8-80ffce0063cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:38.141803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82570fd7-d6db-4bd6-86b8-80ffce0063cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:38.144057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82570fd7-d6db-4bd6-86b8-80ffce0063cc service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:38.167896 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2366/4720] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:03:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:03:38.257057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b738f33-b7f7-49fe-904d-aa81ee1cdd55 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:38.257398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b738f33-b7f7-49fe-904d-aa81ee1cdd55 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:38.257775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b738f33-b7f7-49fe-904d-aa81ee1cdd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:38.294814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0b738f33-b7f7-49fe-904d-aa81ee1cdd55 None None] MFA Rules not processed for user `b87c2bb52c344b4697baeed01e078140`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:03:38.297137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0b738f33-b7f7-49fe-904d-aa81ee1cdd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:38.313021 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2355/4721] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:03:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:03:38.727821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e882b-c93a-4302-811d-240cd5a2604a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:38.728465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e882b-c93a-4302-811d-240cd5a2604a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:38.728920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e882b-c93a-4302-811d-240cd5a2604a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:38.755171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4d7e882b-c93a-4302-811d-240cd5a2604a None None] MFA Rules not processed for user `b87c2bb52c344b4697baeed01e078140`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:03:38.758945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4d7e882b-c93a-4302-811d-240cd5a2604a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:38.772167 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2367/4722] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:03:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:03:39.514181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b738f33-b7f7-49fe-904d-aa81ee1cdd55 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:39.515622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0b738f33-b7f7-49fe-904d-aa81ee1cdd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:39.526307 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:03:39.531862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e882b-c93a-4302-811d-240cd5a2604a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:39.533399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4d7e882b-c93a-4302-811d-240cd5a2604a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:39.680971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b738f33-b7f7-49fe-904d-aa81ee1cdd55 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:39.695522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a7390-e856-438b-bf7a-56348c7f01ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:39.696223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a7390-e856-438b-bf7a-56348c7f01ff service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:39.696562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a7390-e856-438b-bf7a-56348c7f01ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:39.696911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a7390-e856-438b-bf7a-56348c7f01ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:39.702005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fc8a7390-e856-438b-bf7a-56348c7f01ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:39.707981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e882b-c93a-4302-811d-240cd5a2604a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:39.733586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635b99a-b3a4-436d-a4b1-47024ef588dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:39.734135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a7390-e856-438b-bf7a-56348c7f01ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:39.735401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635b99a-b3a4-436d-a4b1-47024ef588dd service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:39.735549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635b99a-b3a4-436d-a4b1-47024ef588dd service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:39.735822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635b99a-b3a4-436d-a4b1-47024ef588dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:39.737701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a7390-e856-438b-bf7a-56348c7f01ff service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:39.765601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635b99a-b3a4-436d-a4b1-47024ef588dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:39.767094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635b99a-b3a4-436d-a4b1-47024ef588dd service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:39.767283 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2356/4723] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:03:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:03:39.768162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a7390-e856-438b-bf7a-56348c7f01ff service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:39.803939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a7390-e856-438b-bf7a-56348c7f01ff service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:39.811852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076f4cc-c846-46b1-97da-c2797090df9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:39.812494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076f4cc-c846-46b1-97da-c2797090df9b service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:39.812798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076f4cc-c846-46b1-97da-c2797090df9b service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:39.813068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076f4cc-c846-46b1-97da-c2797090df9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:39.820270 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2368/4724] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:03:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:03:39.831916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076f4cc-c846-46b1-97da-c2797090df9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:39.833674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076f4cc-c846-46b1-97da-c2797090df9b service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:39.847158 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2357/4725] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:03:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:03:40.027010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fe5f5-a4cf-4368-bfda-0669fa3a4e21 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:40.027535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fe5f5-a4cf-4368-bfda-0669fa3a4e21 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:40.028515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fe5f5-a4cf-4368-bfda-0669fa3a4e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:40.067612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-503fe5f5-a4cf-4368-bfda-0669fa3a4e21 None None] MFA Rules not processed for user `b87c2bb52c344b4697baeed01e078140`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:03:40.081952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-503fe5f5-a4cf-4368-bfda-0669fa3a4e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:40.095538 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2369/4726] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:03:40 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:03:41.125652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076f4cc-c846-46b1-97da-c2797090df9b service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:41.267067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076f4cc-c846-46b1-97da-c2797090df9b service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:41.272066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9eede9-f38c-4b33-8fa1-89afe24b1ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:41.273016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eede9-f38c-4b33-8fa1-89afe24b1ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:41.273494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eede9-f38c-4b33-8fa1-89afe24b1ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:41.273997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eede9-f38c-4b33-8fa1-89afe24b1ae1 admin admin] PATH_INFO: `/v3/users/b87c2bb52c344b4697baeed01e078140` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:41.275522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9eede9-f38c-4b33-8fa1-89afe24b1ae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b87c2bb52c344b4697baeed01e078140)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:41.277981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9eede9-f38c-4b33-8fa1-89afe24b1ae1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:41.358044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fe9eede9-f38c-4b33-8fa1-89afe24b1ae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b87c2bb52c344b4697baeed01e078140'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:41.367572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fe9eede9-f38c-4b33-8fa1-89afe24b1ae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b87c2bb52c344b4697baeed01e078140'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:41.368209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fe9eede9-f38c-4b33-8fa1-89afe24b1ae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b87c2bb52c344b4697baeed01e078140'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:41.382163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fe9eede9-f38c-4b33-8fa1-89afe24b1ae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b87c2bb52c344b4697baeed01e078140'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:41.409171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fe9eede9-f38c-4b33-8fa1-89afe24b1ae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b87c2bb52c344b4697baeed01e078140'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:41.419868 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2358/4727] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:03:41 2022] DELETE /identity/v3/users/b87c2bb52c344b4697baeed01e078140 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:03:41.424838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a2964-8dbd-4f2a-b886-3ea1ef73f228 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:41.425266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a2964-8dbd-4f2a-b886-3ea1ef73f228 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:41.425559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a2964-8dbd-4f2a-b886-3ea1ef73f228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:41.455900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a14a2964-8dbd-4f2a-b886-3ea1ef73f228 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:03:41.457574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a14a2964-8dbd-4f2a-b886-3ea1ef73f228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:41.542175 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2370/4728] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:03:41.572373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9eede9-f38c-4b33-8fa1-89afe24b1ae1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:41.574174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fe9eede9-f38c-4b33-8fa1-89afe24b1ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:41.617600 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:03:41.678589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9eede9-f38c-4b33-8fa1-89afe24b1ae1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:41.682561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463da9c-7cb3-4e21-8685-a3eff6e903e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:41.683302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463da9c-7cb3-4e21-8685-a3eff6e903e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:41.683675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463da9c-7cb3-4e21-8685-a3eff6e903e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:41.684046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463da9c-7cb3-4e21-8685-a3eff6e903e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:41.695400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463da9c-7cb3-4e21-8685-a3eff6e903e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:41.697002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463da9c-7cb3-4e21-8685-a3eff6e903e2 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:41.711648 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2359/4729] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:03:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:03:42.544759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a2964-8dbd-4f2a-b886-3ea1ef73f228 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:42.546339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a14a2964-8dbd-4f2a-b886-3ea1ef73f228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:42.571708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a2964-8dbd-4f2a-b886-3ea1ef73f228 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:42.578344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862aed91-14bf-44c8-8b78-dabd8df5d3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:42.579543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aed91-14bf-44c8-8b78-dabd8df5d3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:42.579829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aed91-14bf-44c8-8b78-dabd8df5d3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:42.580102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aed91-14bf-44c8-8b78-dabd8df5d3b8 admin admin] PATH_INFO: `/v3/projects/7c8a53266994414cbf4e9019d91ea3cd` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:42.581335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862aed91-14bf-44c8-8b78-dabd8df5d3b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c8a53266994414cbf4e9019d91ea3cd)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:42.588235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862aed91-14bf-44c8-8b78-dabd8df5d3b8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:42.675606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-862aed91-14bf-44c8-8b78-dabd8df5d3b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c8a53266994414cbf4e9019d91ea3cd', 'request_id': 'req-862aed91-14bf-44c8-8b78-dabd8df5d3b8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:42.684468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-862aed91-14bf-44c8-8b78-dabd8df5d3b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c8a53266994414cbf4e9019d91ea3cd', 'request_id': 'req-862aed91-14bf-44c8-8b78-dabd8df5d3b8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:42.693282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-862aed91-14bf-44c8-8b78-dabd8df5d3b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c8a53266994414cbf4e9019d91ea3cd', 'request_id': 'req-862aed91-14bf-44c8-8b78-dabd8df5d3b8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:42.703938 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:03:42.708777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-862aed91-14bf-44c8-8b78-dabd8df5d3b8 admin admin] The token cache is being invalidate because project 7c8a53266994414cbf4e9019d91ea3cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:03:42.710400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-862aed91-14bf-44c8-8b78-dabd8df5d3b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:42.711425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-862aed91-14bf-44c8-8b78-dabd8df5d3b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:03:42.718763 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2371/4730] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:03:42 2022] DELETE /identity/v3/projects/7c8a53266994414cbf4e9019d91ea3cd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:03:42.721022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce38388-1b39-4b54-834e-d7d4362dc7a0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:42.721498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce38388-1b39-4b54-834e-d7d4362dc7a0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:42.721602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce38388-1b39-4b54-834e-d7d4362dc7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:42.750554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1ce38388-1b39-4b54-834e-d7d4362dc7a0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:03:42.751999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1ce38388-1b39-4b54-834e-d7d4362dc7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:42.833762 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2360/4731] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:03:42.843072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94b535-cc68-4707-89e2-de108548701b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:42.843506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94b535-cc68-4707-89e2-de108548701b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:42.843630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94b535-cc68-4707-89e2-de108548701b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:42.863622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2e94b535-cc68-4707-89e2-de108548701b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:03:42.865010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2e94b535-cc68-4707-89e2-de108548701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:42.873373 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2372/4732] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:03:42.877616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce38388-1b39-4b54-834e-d7d4362dc7a0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:42.887301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce38388-1b39-4b54-834e-d7d4362dc7a0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:42.893507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14d051-714d-46fd-8b0c-d8cd614586f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:42.893507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14d051-714d-46fd-8b0c-d8cd614586f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:42.893507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14d051-714d-46fd-8b0c-d8cd614586f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:42.893774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14d051-714d-46fd-8b0c-d8cd614586f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:42.894204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14d051-714d-46fd-8b0c-d8cd614586f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:03:42.894501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14d051-714d-46fd-8b0c-d8cd614586f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:42.896051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14d051-714d-46fd-8b0c-d8cd614586f3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:42.914833 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2361/4733] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:03:42.925900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94b535-cc68-4707-89e2-de108548701b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:42.947447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94b535-cc68-4707-89e2-de108548701b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:42.954364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7aa64-8ed9-4ff2-bcb2-bf1e9125cc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:42.954983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7aa64-8ed9-4ff2-bcb2-bf1e9125cc47 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:42.955256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7aa64-8ed9-4ff2-bcb2-bf1e9125cc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:42.955520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7aa64-8ed9-4ff2-bcb2-bf1e9125cc47 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:42.956148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7aa64-8ed9-4ff2-bcb2-bf1e9125cc47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:42.958381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7aa64-8ed9-4ff2-bcb2-bf1e9125cc47 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:42.994454 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2373/4734] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:03:42 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:03:42.995834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14d051-714d-46fd-8b0c-d8cd614586f3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:43.008245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14d051-714d-46fd-8b0c-d8cd614586f3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:43.067536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff3a1d-8e5d-4027-90a6-ca3ad2659ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:43.068152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff3a1d-8e5d-4027-90a6-ca3ad2659ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:43.068432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff3a1d-8e5d-4027-90a6-ca3ad2659ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:43.069192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff3a1d-8e5d-4027-90a6-ca3ad2659ff7 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:43.069378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff3a1d-8e5d-4027-90a6-ca3ad2659ff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:43.071263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff3a1d-8e5d-4027-90a6-ca3ad2659ff7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:43.097772 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2362/4735] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:03:42 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:03:43.099293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7aa64-8ed9-4ff2-bcb2-bf1e9125cc47 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:43.109545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7aa64-8ed9-4ff2-bcb2-bf1e9125cc47 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:43.114367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311ab61-a39d-4f30-9b0a-8706e059ab07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:43.114967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311ab61-a39d-4f30-9b0a-8706e059ab07 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:43.115240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311ab61-a39d-4f30-9b0a-8706e059ab07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:43.115506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311ab61-a39d-4f30-9b0a-8706e059ab07 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:43.116139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311ab61-a39d-4f30-9b0a-8706e059ab07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:43.117910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311ab61-a39d-4f30-9b0a-8706e059ab07 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:43.128506 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2374/4736] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:03:43.132618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff3a1d-8e5d-4027-90a6-ca3ad2659ff7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:43.143416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff3a1d-8e5d-4027-90a6-ca3ad2659ff7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:43.148261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110da18-a249-47f3-952c-b8b4b0f79f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:43.149007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110da18-a249-47f3-952c-b8b4b0f79f4a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:43.149284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110da18-a249-47f3-952c-b8b4b0f79f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:43.149554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110da18-a249-47f3-952c-b8b4b0f79f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:43.150950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110da18-a249-47f3-952c-b8b4b0f79f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:43.152549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110da18-a249-47f3-952c-b8b4b0f79f4a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:43.163972 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2363/4737] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:03:43.168192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311ab61-a39d-4f30-9b0a-8706e059ab07 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:43.179209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311ab61-a39d-4f30-9b0a-8706e059ab07 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:43.185550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99191e-8f0a-4b61-b21a-b879127cf2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:43.186214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99191e-8f0a-4b61-b21a-b879127cf2d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:43.186491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99191e-8f0a-4b61-b21a-b879127cf2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:43.186763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99191e-8f0a-4b61-b21a-b879127cf2d3 admin admin] PATH_INFO: `/v3/projects/8d01f9fd66aa47d588dcb416f1bd4bba/users/84d7488be7d04fdf8ca44b961a9ba0e8/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:43.203551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99191e-8f0a-4b61-b21a-b879127cf2d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d01f9fd66aa47d588dcb416f1bd4bba, user_id=84d7488be7d04fdf8ca44b961a9ba0e8, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:43.206469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99191e-8f0a-4b61-b21a-b879127cf2d3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:43.225851 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2375/4738] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:03:43 2022] PUT /identity/v3/projects/8d01f9fd66aa47d588dcb416f1bd4bba/users/84d7488be7d04fdf8ca44b961a9ba0e8/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:03:43.231951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fb5b7-b202-497d-85a5-0731103a741c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:43.232644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fb5b7-b202-497d-85a5-0731103a741c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:43.233254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fb5b7-b202-497d-85a5-0731103a741c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:43.255142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fe7fb5b7-b202-497d-85a5-0731103a741c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:03:43.256527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fe7fb5b7-b202-497d-85a5-0731103a741c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:43.278260 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:03:43.346028 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2364/4739] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:03:43.380894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99191e-8f0a-4b61-b21a-b879127cf2d3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:03:43.383516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7a99191e-8f0a-4b61-b21a-b879127cf2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:03:43.512770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99191e-8f0a-4b61-b21a-b879127cf2d3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:03:43.517654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d25b3b-321a-45bd-bee9-bb81617429b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:03:43.519498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d25b3b-321a-45bd-bee9-bb81617429b3 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:03:43.519498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d25b3b-321a-45bd-bee9-bb81617429b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:03:43.519498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d25b3b-321a-45bd-bee9-bb81617429b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:03:43.532025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d25b3b-321a-45bd-bee9-bb81617429b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:03:43.534493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d25b3b-321a-45bd-bee9-bb81617429b3 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:03:43.548046 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2376/4740] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:03:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:03:53.334329 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=16 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:03:53.541225 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=53,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:01.775333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2a29f-f601-481b-8e9f-405e003970b9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:01.776237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2a29f-f601-481b-8e9f-405e003970b9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:01.776773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2a29f-f601-481b-8e9f-405e003970b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:01.866153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2ae2a29f-f601-481b-8e9f-405e003970b9 None None] MFA Rules not processed for user `84d7488be7d04fdf8ca44b961a9ba0e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:01.867396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2ae2a29f-f601-481b-8e9f-405e003970b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:02.058458 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2365/4741] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:02.067825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03caf9-23c0-451c-82e0-caaab0f6dfe6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:02.068791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03caf9-23c0-451c-82e0-caaab0f6dfe6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:02.069487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03caf9-23c0-451c-82e0-caaab0f6dfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:02.102174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9c03caf9-23c0-451c-82e0-caaab0f6dfe6 None None] MFA Rules not processed for user `84d7488be7d04fdf8ca44b961a9ba0e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:02.104122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9c03caf9-23c0-451c-82e0-caaab0f6dfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:02.117981 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2377/4742] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:02.125913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2a29f-f601-481b-8e9f-405e003970b9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:02.128375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2ae2a29f-f601-481b-8e9f-405e003970b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:02.282481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2a29f-f601-481b-8e9f-405e003970b9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:02.290014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24e482-fabc-42ae-b454-7b9a95a218bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:02.291190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24e482-fabc-42ae-b454-7b9a95a218bc service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:02.291665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24e482-fabc-42ae-b454-7b9a95a218bc service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:02.292141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24e482-fabc-42ae-b454-7b9a95a218bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:02.304398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24e482-fabc-42ae-b454-7b9a95a218bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:02.306620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24e482-fabc-42ae-b454-7b9a95a218bc service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:02.325277 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2366/4743] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:04:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:04:03.130732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290ec50-4971-41be-b5ac-f49c96b7a480 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:03.131321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290ec50-4971-41be-b5ac-f49c96b7a480 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:03.131658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290ec50-4971-41be-b5ac-f49c96b7a480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:03.176088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a290ec50-4971-41be-b5ac-f49c96b7a480 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:03.177801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a290ec50-4971-41be-b5ac-f49c96b7a480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:03.279895 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2378/4744] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:04:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:03.305527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24e482-fabc-42ae-b454-7b9a95a218bc service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:03.309312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-de24e482-fabc-42ae-b454-7b9a95a218bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:03.510322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24e482-fabc-42ae-b454-7b9a95a218bc service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:03.529364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ce790-3213-46ca-85a5-f396ee16d20f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:03.529871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ce790-3213-46ca-85a5-f396ee16d20f service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:03.531420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ce790-3213-46ca-85a5-f396ee16d20f service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:03.531942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ce790-3213-46ca-85a5-f396ee16d20f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:03.561554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ce790-3213-46ca-85a5-f396ee16d20f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:03.566578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ce790-3213-46ca-85a5-f396ee16d20f service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:03.606963 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2367/4745] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:04:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:04:07.989119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290ec50-4971-41be-b5ac-f49c96b7a480 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:07.991409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a290ec50-4971-41be-b5ac-f49c96b7a480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:08.035104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290ec50-4971-41be-b5ac-f49c96b7a480 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:08.049004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cc762-4c26-4121-8dd8-7f501e4b676d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:08.050872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cc762-4c26-4121-8dd8-7f501e4b676d service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:08.051661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cc762-4c26-4121-8dd8-7f501e4b676d service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:08.052849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cc762-4c26-4121-8dd8-7f501e4b676d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:08.074458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ae2cc762-4c26-4121-8dd8-7f501e4b676d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:08.140589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2cc762-4c26-4121-8dd8-7f501e4b676d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:08.155612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2cc762-4c26-4121-8dd8-7f501e4b676d service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:08.201522 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2379/4746] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:04:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:04:08.774271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d37e4b-ff8f-4745-a746-b0359a7c09bf None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:08.774791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d37e4b-ff8f-4745-a746-b0359a7c09bf None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:08.774913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d37e4b-ff8f-4745-a746-b0359a7c09bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:08.791945 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:08.811418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e1d37e4b-ff8f-4745-a746-b0359a7c09bf None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:08.818045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e1d37e4b-ff8f-4745-a746-b0359a7c09bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:08.853020 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2368/4747] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:04:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:08.865706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cc762-4c26-4121-8dd8-7f501e4b676d service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:08.885502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cc762-4c26-4121-8dd8-7f501e4b676d service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:08.902102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15831f15-9db1-4e8a-b669-7491f85b1b70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:08.902732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15831f15-9db1-4e8a-b669-7491f85b1b70 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:08.903017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15831f15-9db1-4e8a-b669-7491f85b1b70 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:08.903295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15831f15-9db1-4e8a-b669-7491f85b1b70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:08.937838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15831f15-9db1-4e8a-b669-7491f85b1b70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:08.939452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15831f15-9db1-4e8a-b669-7491f85b1b70 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:08.978488 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2380/4748] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:04:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:04:18.436913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d37e4b-ff8f-4745-a746-b0359a7c09bf None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:18.439033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e1d37e4b-ff8f-4745-a746-b0359a7c09bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:18.468402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d37e4b-ff8f-4745-a746-b0359a7c09bf None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:18.482995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f5542-1294-4c93-ab20-576e8eda3e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:18.483939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f5542-1294-4c93-ab20-576e8eda3e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:18.484375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f5542-1294-4c93-ab20-576e8eda3e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:18.484868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f5542-1294-4c93-ab20-576e8eda3e31 admin admin] PATH_INFO: `/v3/users/8bb9a3b41bbc4a11a1e50fb2f5de5c1d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:18.486190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f5542-1294-4c93-ab20-576e8eda3e31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bb9a3b41bbc4a11a1e50fb2f5de5c1d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:18.488251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f5542-1294-4c93-ab20-576e8eda3e31 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:18.588644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bf3f5542-1294-4c93-ab20-576e8eda3e31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bb9a3b41bbc4a11a1e50fb2f5de5c1d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:18.610967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bf3f5542-1294-4c93-ab20-576e8eda3e31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bb9a3b41bbc4a11a1e50fb2f5de5c1d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:18.611866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bf3f5542-1294-4c93-ab20-576e8eda3e31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bb9a3b41bbc4a11a1e50fb2f5de5c1d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:18.637355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bf3f5542-1294-4c93-ab20-576e8eda3e31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bb9a3b41bbc4a11a1e50fb2f5de5c1d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:18.652016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bf3f5542-1294-4c93-ab20-576e8eda3e31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bb9a3b41bbc4a11a1e50fb2f5de5c1d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:18.669120 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2369/4749] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:04:18 2022] DELETE /identity/v3/users/8bb9a3b41bbc4a11a1e50fb2f5de5c1d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:18.955602 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=40 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:20.184374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15831f15-9db1-4e8a-b669-7491f85b1b70 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:20.204770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15831f15-9db1-4e8a-b669-7491f85b1b70 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:20.401986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a83ce2-8428-45b7-8a39-954326235311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:20.402653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a83ce2-8428-45b7-8a39-954326235311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:20.402936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a83ce2-8428-45b7-8a39-954326235311 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:20.403208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a83ce2-8428-45b7-8a39-954326235311 admin admin] PATH_INFO: `/v3/projects/d0f664a30b5940ba8fcde6f93433e6bc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:20.409461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a83ce2-8428-45b7-8a39-954326235311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0f664a30b5940ba8fcde6f93433e6bc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:20.411432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a83ce2-8428-45b7-8a39-954326235311 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:20.587863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f9a83ce2-8428-45b7-8a39-954326235311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0f664a30b5940ba8fcde6f93433e6bc', 'request_id': 'req-f9a83ce2-8428-45b7-8a39-954326235311'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:20.610744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f9a83ce2-8428-45b7-8a39-954326235311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0f664a30b5940ba8fcde6f93433e6bc', 'request_id': 'req-f9a83ce2-8428-45b7-8a39-954326235311'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:20.628238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f9a83ce2-8428-45b7-8a39-954326235311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0f664a30b5940ba8fcde6f93433e6bc', 'request_id': 'req-f9a83ce2-8428-45b7-8a39-954326235311'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:20.665650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f9a83ce2-8428-45b7-8a39-954326235311 admin admin] The token cache is being invalidate because project d0f664a30b5940ba8fcde6f93433e6bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:04:20.665945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f9a83ce2-8428-45b7-8a39-954326235311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:20.673901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f9a83ce2-8428-45b7-8a39-954326235311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:20.684654 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2381/4750] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:04:20 2022] DELETE /identity/v3/projects/d0f664a30b5940ba8fcde6f93433e6bc => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:20.687862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54215ab-2bcb-48eb-8896-ea278d446fec None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:20.688353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54215ab-2bcb-48eb-8896-ea278d446fec None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:20.688532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54215ab-2bcb-48eb-8896-ea278d446fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:20.818295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a54215ab-2bcb-48eb-8896-ea278d446fec None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:20.822804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a54215ab-2bcb-48eb-8896-ea278d446fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:21.210689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf6f91-0f93-4d52-b1c3-bf9dfcb9dbaf None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:21.211253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf6f91-0f93-4d52-b1c3-bf9dfcb9dbaf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:21.211253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf6f91-0f93-4d52-b1c3-bf9dfcb9dbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:21.216345 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2370/4751] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 529 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:21.285400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9abf6f91-0f93-4d52-b1c3-bf9dfcb9dbaf None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:21.286754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9abf6f91-0f93-4d52-b1c3-bf9dfcb9dbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:21.319604 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2382/4752] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:04:21.322964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54215ab-2bcb-48eb-8896-ea278d446fec None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:21.366237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54215ab-2bcb-48eb-8896-ea278d446fec None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:21.382124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8685e4-3d20-41af-94b0-2cece2b5401e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:21.382746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8685e4-3d20-41af-94b0-2cece2b5401e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:21.383020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8685e4-3d20-41af-94b0-2cece2b5401e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:21.383276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8685e4-3d20-41af-94b0-2cece2b5401e admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:21.388160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8685e4-3d20-41af-94b0-2cece2b5401e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:04:21.397216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8685e4-3d20-41af-94b0-2cece2b5401e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:21.405265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8685e4-3d20-41af-94b0-2cece2b5401e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:21.499658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf6f91-0f93-4d52-b1c3-bf9dfcb9dbaf None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:21.510118 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2371/4753] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:04:21.537445 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf6f91-0f93-4d52-b1c3-bf9dfcb9dbaf None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:21.568531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a55a9-d548-4637-acdc-d413360e8609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:21.569546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a55a9-d548-4637-acdc-d413360e8609 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:21.571265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a55a9-d548-4637-acdc-d413360e8609 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:21.575157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a55a9-d548-4637-acdc-d413360e8609 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:21.576099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a55a9-d548-4637-acdc-d413360e8609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:21.581970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a55a9-d548-4637-acdc-d413360e8609 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:21.694232 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2383/4754] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:04:21 2022] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:04:21.700985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8685e4-3d20-41af-94b0-2cece2b5401e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:21.721349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8685e4-3d20-41af-94b0-2cece2b5401e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:21.907129 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:21.941583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c067b-5d9f-4ff2-bd7d-3cfeb83a72bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:21.942310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c067b-5d9f-4ff2-bd7d-3cfeb83a72bc admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:21.942646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c067b-5d9f-4ff2-bd7d-3cfeb83a72bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:21.942803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c067b-5d9f-4ff2-bd7d-3cfeb83a72bc admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:21.943408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c067b-5d9f-4ff2-bd7d-3cfeb83a72bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:21.945616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c067b-5d9f-4ff2-bd7d-3cfeb83a72bc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:22.018956 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2372/4755] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:04:21 2022] POST /identity/v3/users => generated 293 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:22.019924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a55a9-d548-4637-acdc-d413360e8609 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:22.033983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a55a9-d548-4637-acdc-d413360e8609 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:22.050231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c964c64-609b-41b5-8d26-44e9bef79d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:22.051226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c964c64-609b-41b5-8d26-44e9bef79d8c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:22.051226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c964c64-609b-41b5-8d26-44e9bef79d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:22.051427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c964c64-609b-41b5-8d26-44e9bef79d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:22.052160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c964c64-609b-41b5-8d26-44e9bef79d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:22.053968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c964c64-609b-41b5-8d26-44e9bef79d8c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:22.086375 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2384/4756] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:22.091171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c067b-5d9f-4ff2-bd7d-3cfeb83a72bc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:22.103547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c067b-5d9f-4ff2-bd7d-3cfeb83a72bc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:22.118633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f5c7e-ab7c-4d33-a295-6020bd882c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:22.119831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f5c7e-ab7c-4d33-a295-6020bd882c1b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:22.120800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f5c7e-ab7c-4d33-a295-6020bd882c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:22.121241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f5c7e-ab7c-4d33-a295-6020bd882c1b admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:22.122130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f5c7e-ab7c-4d33-a295-6020bd882c1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:22.124124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f5c7e-ab7c-4d33-a295-6020bd882c1b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:22.152950 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2373/4757] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:22.153787 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c964c64-609b-41b5-8d26-44e9bef79d8c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:22.170026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c964c64-609b-41b5-8d26-44e9bef79d8c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:22.198732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad9435-2c73-4944-aead-d9af742badef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:22.199613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad9435-2c73-4944-aead-d9af742badef admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:22.202068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad9435-2c73-4944-aead-d9af742badef admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:22.202450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad9435-2c73-4944-aead-d9af742badef admin admin] PATH_INFO: `/v3/projects/bfa62487356848879d36997cb675dfdd/users/1475c964ec494356a50cc9832f2cfc0b/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:22.237860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad9435-2c73-4944-aead-d9af742badef admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa62487356848879d36997cb675dfdd, user_id=1475c964ec494356a50cc9832f2cfc0b, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:22.240502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad9435-2c73-4944-aead-d9af742badef admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:22.283189 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2385/4758] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:04:22 2022] PUT /identity/v3/projects/bfa62487356848879d36997cb675dfdd/users/1475c964ec494356a50cc9832f2cfc0b/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:04:22.295248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25096663-125d-4f85-90ab-34e8baebb23d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:22.295573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25096663-125d-4f85-90ab-34e8baebb23d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:22.295802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25096663-125d-4f85-90ab-34e8baebb23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:22.312923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad9435-2c73-4944-aead-d9af742badef admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:22.314733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-83ad9435-2c73-4944-aead-d9af742badef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:22.412044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-25096663-125d-4f85-90ab-34e8baebb23d None None] MFA Rules not processed for user `1475c964ec494356a50cc9832f2cfc0b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:22.415594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-25096663-125d-4f85-90ab-34e8baebb23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:22.463066 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:22.551701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad9435-2c73-4944-aead-d9af742badef admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:22.565704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcdc90-b626-47fd-a227-c7dad1e79503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:22.568289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcdc90-b626-47fd-a227-c7dad1e79503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:22.570259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcdc90-b626-47fd-a227-c7dad1e79503 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:22.571903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcdc90-b626-47fd-a227-c7dad1e79503 admin admin] PATH_INFO: `/v3/users/6d1d3f5425734678b6fd67f9a675bbe0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:22.578051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fcdc90-b626-47fd-a227-c7dad1e79503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d1d3f5425734678b6fd67f9a675bbe0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:22.584082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fcdc90-b626-47fd-a227-c7dad1e79503 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:22.643874 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2374/4759] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:22.740755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-44fcdc90-b626-47fd-a227-c7dad1e79503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d1d3f5425734678b6fd67f9a675bbe0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:22.744304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-44fcdc90-b626-47fd-a227-c7dad1e79503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d1d3f5425734678b6fd67f9a675bbe0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:22.765287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-44fcdc90-b626-47fd-a227-c7dad1e79503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d1d3f5425734678b6fd67f9a675bbe0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:22.801862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-44fcdc90-b626-47fd-a227-c7dad1e79503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d1d3f5425734678b6fd67f9a675bbe0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:22.820056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-44fcdc90-b626-47fd-a227-c7dad1e79503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d1d3f5425734678b6fd67f9a675bbe0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:22.846868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2bb0c-105f-4a4e-9b29-9ce238bd2ec7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:22.846868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2bb0c-105f-4a4e-9b29-9ce238bd2ec7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:22.847470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2bb0c-105f-4a4e-9b29-9ce238bd2ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:22.847824 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2386/4760] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:04:22 2022] DELETE /identity/v3/users/6d1d3f5425734678b6fd67f9a675bbe0 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:22.919699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-92a2bb0c-105f-4a4e-9b29-9ce238bd2ec7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:22.925184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-92a2bb0c-105f-4a4e-9b29-9ce238bd2ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:23.091724 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2375/4761] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:04:23.104205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcdc90-b626-47fd-a227-c7dad1e79503 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:23.106434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-44fcdc90-b626-47fd-a227-c7dad1e79503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:23.264140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcdc90-b626-47fd-a227-c7dad1e79503 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:23.270124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932eee9-b2db-4cc6-b2e1-f576e8dd10f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:23.270750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932eee9-b2db-4cc6-b2e1-f576e8dd10f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:23.271023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932eee9-b2db-4cc6-b2e1-f576e8dd10f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:23.271288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932eee9-b2db-4cc6-b2e1-f576e8dd10f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:23.294550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932eee9-b2db-4cc6-b2e1-f576e8dd10f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:23.297878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932eee9-b2db-4cc6-b2e1-f576e8dd10f9 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:23.325681 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2387/4762] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:04:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:04:23.634687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2bb0c-105f-4a4e-9b29-9ce238bd2ec7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:23.637328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-92a2bb0c-105f-4a4e-9b29-9ce238bd2ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:23.801861 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:23.813074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2bb0c-105f-4a4e-9b29-9ce238bd2ec7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:23.826421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b8068-807e-43a4-9759-035e15c415ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:23.829302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b8068-807e-43a4-9759-035e15c415ef service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:23.829668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b8068-807e-43a4-9759-035e15c415ef service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:23.830009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b8068-807e-43a4-9759-035e15c415ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:23.833179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d41b8068-807e-43a4-9759-035e15c415ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:23.963801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b8068-807e-43a4-9759-035e15c415ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:23.968830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b8068-807e-43a4-9759-035e15c415ef service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:23.994061 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2376/4763] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:04:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:04:24.152721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932eee9-b2db-4cc6-b2e1-f576e8dd10f9 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:24.154180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c932eee9-b2db-4cc6-b2e1-f576e8dd10f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:24.176111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932eee9-b2db-4cc6-b2e1-f576e8dd10f9 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:24.190386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4895c3-5718-464e-88e5-9bfd7bfc981a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:24.191144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4895c3-5718-464e-88e5-9bfd7bfc981a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:24.191425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4895c3-5718-464e-88e5-9bfd7bfc981a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:24.191702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4895c3-5718-464e-88e5-9bfd7bfc981a admin admin] PATH_INFO: `/v3/projects/65d76274dc3548d4a6acc495001fad12` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:24.193675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4895c3-5718-464e-88e5-9bfd7bfc981a admin admin] RBAC: Authorizing `identity:delete_project(project_id=65d76274dc3548d4a6acc495001fad12)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:24.195610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4895c3-5718-464e-88e5-9bfd7bfc981a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:24.303018 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:24.310789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5e4895c3-5718-464e-88e5-9bfd7bfc981a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65d76274dc3548d4a6acc495001fad12', 'request_id': 'req-5e4895c3-5718-464e-88e5-9bfd7bfc981a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:24.332156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5e4895c3-5718-464e-88e5-9bfd7bfc981a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65d76274dc3548d4a6acc495001fad12', 'request_id': 'req-5e4895c3-5718-464e-88e5-9bfd7bfc981a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:24.349367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5e4895c3-5718-464e-88e5-9bfd7bfc981a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65d76274dc3548d4a6acc495001fad12', 'request_id': 'req-5e4895c3-5718-464e-88e5-9bfd7bfc981a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:24.399227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5e4895c3-5718-464e-88e5-9bfd7bfc981a admin admin] The token cache is being invalidate because project 65d76274dc3548d4a6acc495001fad12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:04:24.399227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5e4895c3-5718-464e-88e5-9bfd7bfc981a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:24.399227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5e4895c3-5718-464e-88e5-9bfd7bfc981a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:24.406866 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2388/4764] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:04:24 2022] DELETE /identity/v3/projects/65d76274dc3548d4a6acc495001fad12 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:24.414532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af986e1d-bd97-4dd5-9658-ea0538193c44 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:24.415142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af986e1d-bd97-4dd5-9658-ea0538193c44 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:24.415654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af986e1d-bd97-4dd5-9658-ea0538193c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:24.477846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-af986e1d-bd97-4dd5-9658-ea0538193c44 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:24.479107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-af986e1d-bd97-4dd5-9658-ea0538193c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:24.636733 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2377/4765] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:24.638850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2d36f-aee8-4213-8385-396d055115b1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:24.639319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2d36f-aee8-4213-8385-396d055115b1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:24.639902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2d36f-aee8-4213-8385-396d055115b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:24.684728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-58b2d36f-aee8-4213-8385-396d055115b1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:24.689011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-58b2d36f-aee8-4213-8385-396d055115b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:24.739265 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2389/4766] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:24.743657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af986e1d-bd97-4dd5-9658-ea0538193c44 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:24.758967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af986e1d-bd97-4dd5-9658-ea0538193c44 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:24.772887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d2770-ad15-485f-9a78-9cd8bfaa1730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:24.773694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d2770-ad15-485f-9a78-9cd8bfaa1730 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:24.775274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d2770-ad15-485f-9a78-9cd8bfaa1730 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:24.776700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d2770-ad15-485f-9a78-9cd8bfaa1730 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:24.777458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d2770-ad15-485f-9a78-9cd8bfaa1730 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:04:24.778649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d2770-ad15-485f-9a78-9cd8bfaa1730 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:24.781140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d2770-ad15-485f-9a78-9cd8bfaa1730 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:24.821671 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2378/4767] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:04:24.825610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2d36f-aee8-4213-8385-396d055115b1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:24.841746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2d36f-aee8-4213-8385-396d055115b1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:24.871124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82491bf-bf78-4342-9499-e5353ef06671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:24.871749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82491bf-bf78-4342-9499-e5353ef06671 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:24.872024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82491bf-bf78-4342-9499-e5353ef06671 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:24.872295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82491bf-bf78-4342-9499-e5353ef06671 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:24.872956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82491bf-bf78-4342-9499-e5353ef06671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:24.874959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82491bf-bf78-4342-9499-e5353ef06671 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:24.944309 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2390/4768] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:04:24 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:04:24.948759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d2770-ad15-485f-9a78-9cd8bfaa1730 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:24.968975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d2770-ad15-485f-9a78-9cd8bfaa1730 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:25.097140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340484fc-d286-4f1e-acc5-e04048615a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:25.097777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340484fc-d286-4f1e-acc5-e04048615a63 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:25.098052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340484fc-d286-4f1e-acc5-e04048615a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:25.098321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340484fc-d286-4f1e-acc5-e04048615a63 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:25.101291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340484fc-d286-4f1e-acc5-e04048615a63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:25.101291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340484fc-d286-4f1e-acc5-e04048615a63 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:25.143493 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2379/4769] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:04:24 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:25.148037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82491bf-bf78-4342-9499-e5353ef06671 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:25.164241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82491bf-bf78-4342-9499-e5353ef06671 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:25.184985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679458db-8bb4-47d1-8029-762af8223bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:25.186710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679458db-8bb4-47d1-8029-762af8223bdb admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:25.186999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679458db-8bb4-47d1-8029-762af8223bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:25.187275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679458db-8bb4-47d1-8029-762af8223bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:25.189953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679458db-8bb4-47d1-8029-762af8223bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:25.194106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679458db-8bb4-47d1-8029-762af8223bdb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:25.221096 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2391/4770] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:25.320269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340484fc-d286-4f1e-acc5-e04048615a63 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:25.331937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340484fc-d286-4f1e-acc5-e04048615a63 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:25.337917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374db80-4751-4030-9ff7-b7eda2aa5b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:25.337917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374db80-4751-4030-9ff7-b7eda2aa5b61 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:25.337917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374db80-4751-4030-9ff7-b7eda2aa5b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:25.338282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374db80-4751-4030-9ff7-b7eda2aa5b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:25.338939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374db80-4751-4030-9ff7-b7eda2aa5b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:25.341098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374db80-4751-4030-9ff7-b7eda2aa5b61 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:25.359373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679458db-8bb4-47d1-8029-762af8223bdb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:25.371150 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2380/4771] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:25.377533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679458db-8bb4-47d1-8029-762af8223bdb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:25.383632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea2fdb-c853-42e6-b253-aebb499b55d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:25.384321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea2fdb-c853-42e6-b253-aebb499b55d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:25.384614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea2fdb-c853-42e6-b253-aebb499b55d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:25.384904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea2fdb-c853-42e6-b253-aebb499b55d8 admin admin] PATH_INFO: `/v3/projects/5adff8f1065b442c950d5769a974e71a/users/6c5b006f2835499a9065b0909687bb49/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:25.413053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea2fdb-c853-42e6-b253-aebb499b55d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5adff8f1065b442c950d5769a974e71a, user_id=6c5b006f2835499a9065b0909687bb49, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:25.419010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea2fdb-c853-42e6-b253-aebb499b55d8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:25.485899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a72bb-278f-4249-976e-93b1ccea6bb3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:25.486167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a72bb-278f-4249-976e-93b1ccea6bb3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:25.486441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a72bb-278f-4249-976e-93b1ccea6bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:25.493490 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2392/4772] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:04:25 2022] PUT /identity/v3/projects/5adff8f1065b442c950d5769a974e71a/users/6c5b006f2835499a9065b0909687bb49/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:25.531394 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:25.566503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c07a72bb-278f-4249-976e-93b1ccea6bb3 None None] MFA Rules not processed for user `6c5b006f2835499a9065b0909687bb49`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:25.567577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c07a72bb-278f-4249-976e-93b1ccea6bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:25.819529 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2381/4773] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:25.918907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea2fdb-c853-42e6-b253-aebb499b55d8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:25.920831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5cea2fdb-c853-42e6-b253-aebb499b55d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:26.079268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea2fdb-c853-42e6-b253-aebb499b55d8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:26.090158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061c9d3-d375-4fa9-889c-f0ed585d6a03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:26.091195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061c9d3-d375-4fa9-889c-f0ed585d6a03 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:26.094307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061c9d3-d375-4fa9-889c-f0ed585d6a03 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:26.094836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061c9d3-d375-4fa9-889c-f0ed585d6a03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:26.116630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061c9d3-d375-4fa9-889c-f0ed585d6a03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:26.118334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061c9d3-d375-4fa9-889c-f0ed585d6a03 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:26.148072 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2393/4774] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:04:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:04:30.594654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9564a3-aafc-459e-9dd2-43509c04c152 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:30.595162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9564a3-aafc-459e-9dd2-43509c04c152 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:30.595296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9564a3-aafc-459e-9dd2-43509c04c152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:30.633721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-aa9564a3-aafc-459e-9dd2-43509c04c152 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:30.637193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aa9564a3-aafc-459e-9dd2-43509c04c152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:30.752767 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2382/4775] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 10:04:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:30.779844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061c9d3-d375-4fa9-889c-f0ed585d6a03 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:30.781430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d061c9d3-d375-4fa9-889c-f0ed585d6a03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:30.944039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061c9d3-d375-4fa9-889c-f0ed585d6a03 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:30.960147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfb07c-8107-4df9-bc9b-ceb60ef58b08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:30.960464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfb07c-8107-4df9-bc9b-ceb60ef58b08 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:30.960774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfb07c-8107-4df9-bc9b-ceb60ef58b08 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:30.961030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfb07c-8107-4df9-bc9b-ceb60ef58b08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:30.979931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfb07c-8107-4df9-bc9b-ceb60ef58b08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:30.981967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfb07c-8107-4df9-bc9b-ceb60ef58b08 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:30.997275 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:31.003045 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2394/4776] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:04:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:04:31.127857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9564a3-aafc-459e-9dd2-43509c04c152 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:31.131056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aa9564a3-aafc-459e-9dd2-43509c04c152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:31.300837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9564a3-aafc-459e-9dd2-43509c04c152 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:31.310112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b24162-01dd-477d-8176-e04eee65f435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:31.311545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b24162-01dd-477d-8176-e04eee65f435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:31.311824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b24162-01dd-477d-8176-e04eee65f435 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:31.312096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b24162-01dd-477d-8176-e04eee65f435 admin admin] PATH_INFO: `/v3/users/70125a9a58134d229fbe2eac25e8a335` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:31.313430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b24162-01dd-477d-8176-e04eee65f435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70125a9a58134d229fbe2eac25e8a335)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:31.315827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b24162-01dd-477d-8176-e04eee65f435 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:31.468365 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:31.472520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c4b24162-01dd-477d-8176-e04eee65f435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70125a9a58134d229fbe2eac25e8a335'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:31.488997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c4b24162-01dd-477d-8176-e04eee65f435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70125a9a58134d229fbe2eac25e8a335'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:31.489716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c4b24162-01dd-477d-8176-e04eee65f435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70125a9a58134d229fbe2eac25e8a335'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:31.517837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c4b24162-01dd-477d-8176-e04eee65f435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70125a9a58134d229fbe2eac25e8a335'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:31.531295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c4b24162-01dd-477d-8176-e04eee65f435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70125a9a58134d229fbe2eac25e8a335'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:31.543877 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2383/4777] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:04:31 2022] DELETE /identity/v3/users/70125a9a58134d229fbe2eac25e8a335 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:31.553607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429758f-e841-409b-af60-d004e62cf9f7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:31.556265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429758f-e841-409b-af60-d004e62cf9f7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:31.556696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429758f-e841-409b-af60-d004e62cf9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:31.614513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8429758f-e841-409b-af60-d004e62cf9f7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:31.616352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8429758f-e841-409b-af60-d004e62cf9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:31.708794 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2395/4778] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:31.735507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b24162-01dd-477d-8176-e04eee65f435 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:31.737127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c4b24162-01dd-477d-8176-e04eee65f435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:31.822395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0731292-c27d-4b76-bd32-3c40f4a9b967 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:31.824078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0731292-c27d-4b76-bd32-3c40f4a9b967 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:31.824534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0731292-c27d-4b76-bd32-3c40f4a9b967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:31.849685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f0731292-c27d-4b76-bd32-3c40f4a9b967 None None] MFA Rules not processed for user `76de66d46a57438f960c832cb8a70c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:31.851149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f0731292-c27d-4b76-bd32-3c40f4a9b967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:31.866127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b24162-01dd-477d-8176-e04eee65f435 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:31.875961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a31690-785d-45d2-b49b-18eacfbf73ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:31.878230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a31690-785d-45d2-b49b-18eacfbf73ca service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:31.878693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a31690-785d-45d2-b49b-18eacfbf73ca service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:31.879734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a31690-785d-45d2-b49b-18eacfbf73ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:31.909361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a31690-785d-45d2-b49b-18eacfbf73ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:31.923744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a31690-785d-45d2-b49b-18eacfbf73ca service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:31.959372 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2384/4779] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:04:31.997390 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2396/4780] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:32.862957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a31690-785d-45d2-b49b-18eacfbf73ca service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:32.864636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b8a31690-785d-45d2-b49b-18eacfbf73ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:32.883011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a31690-785d-45d2-b49b-18eacfbf73ca service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:32.900780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc42c1-a100-4e0a-b070-b6b8bb32fa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:32.901622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc42c1-a100-4e0a-b070-b6b8bb32fa28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:32.901925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc42c1-a100-4e0a-b070-b6b8bb32fa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:32.902198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc42c1-a100-4e0a-b070-b6b8bb32fa28 admin admin] PATH_INFO: `/v3/projects/3172e6405d094e5abac1a23db73c9043` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:32.903369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc42c1-a100-4e0a-b070-b6b8bb32fa28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3172e6405d094e5abac1a23db73c9043)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:32.905529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc42c1-a100-4e0a-b070-b6b8bb32fa28 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:33.025099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-84cc42c1-a100-4e0a-b070-b6b8bb32fa28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3172e6405d094e5abac1a23db73c9043', 'request_id': 'req-84cc42c1-a100-4e0a-b070-b6b8bb32fa28'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:33.040972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-84cc42c1-a100-4e0a-b070-b6b8bb32fa28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3172e6405d094e5abac1a23db73c9043', 'request_id': 'req-84cc42c1-a100-4e0a-b070-b6b8bb32fa28'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:33.056022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-84cc42c1-a100-4e0a-b070-b6b8bb32fa28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3172e6405d094e5abac1a23db73c9043', 'request_id': 'req-84cc42c1-a100-4e0a-b070-b6b8bb32fa28'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:33.079075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-84cc42c1-a100-4e0a-b070-b6b8bb32fa28 admin admin] The token cache is being invalidate because project 3172e6405d094e5abac1a23db73c9043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:04:33.080321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-84cc42c1-a100-4e0a-b070-b6b8bb32fa28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:33.081278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-84cc42c1-a100-4e0a-b070-b6b8bb32fa28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:33.086246 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2385/4781] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:04:32 2022] DELETE /identity/v3/projects/3172e6405d094e5abac1a23db73c9043 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:33.088085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0731292-c27d-4b76-bd32-3c40f4a9b967 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:33.106551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0731292-c27d-4b76-bd32-3c40f4a9b967 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:33.256430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ec217-bdf3-4550-adc0-44e70ac68562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:33.257115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ec217-bdf3-4550-adc0-44e70ac68562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:33.257389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ec217-bdf3-4550-adc0-44e70ac68562 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:33.264240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ec217-bdf3-4550-adc0-44e70ac68562 admin admin] PATH_INFO: `/v3/users/a1b55be2896d4a84b8d0184ff2fff459` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:33.274876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ec217-bdf3-4550-adc0-44e70ac68562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b55be2896d4a84b8d0184ff2fff459)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:33.277613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ec217-bdf3-4550-adc0-44e70ac68562 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:33.395353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8a3ec217-bdf3-4550-adc0-44e70ac68562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b55be2896d4a84b8d0184ff2fff459'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:33.396222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8a3ec217-bdf3-4550-adc0-44e70ac68562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b55be2896d4a84b8d0184ff2fff459'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:33.398289 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:33.431503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8a3ec217-bdf3-4550-adc0-44e70ac68562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b55be2896d4a84b8d0184ff2fff459'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:33.456012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8a3ec217-bdf3-4550-adc0-44e70ac68562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b55be2896d4a84b8d0184ff2fff459'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:33.466837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8a3ec217-bdf3-4550-adc0-44e70ac68562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b55be2896d4a84b8d0184ff2fff459'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:33.474131 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2397/4782] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:04:33 2022] DELETE /identity/v3/users/a1b55be2896d4a84b8d0184ff2fff459 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:34.311100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc42c1-a100-4e0a-b070-b6b8bb32fa28 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:34.312559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-84cc42c1-a100-4e0a-b070-b6b8bb32fa28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:34.431780 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:34.505869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc42c1-a100-4e0a-b070-b6b8bb32fa28 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:34.640929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74971c93-8a98-45e9-b0d5-10eae23dac84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:34.641975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74971c93-8a98-45e9-b0d5-10eae23dac84 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:34.642500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74971c93-8a98-45e9-b0d5-10eae23dac84 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:34.643124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74971c93-8a98-45e9-b0d5-10eae23dac84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:34.648321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-74971c93-8a98-45e9-b0d5-10eae23dac84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:34.665124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ec217-bdf3-4550-adc0-44e70ac68562 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:34.669710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8a3ec217-bdf3-4550-adc0-44e70ac68562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:34.670393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74971c93-8a98-45e9-b0d5-10eae23dac84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:34.672548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74971c93-8a98-45e9-b0d5-10eae23dac84 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:34.689719 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2386/4783] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:04:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:04:34.807943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ec217-bdf3-4550-adc0-44e70ac68562 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:34.814666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070d67d-6d5a-4c98-a8e4-7c07589386d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:34.816450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070d67d-6d5a-4c98-a8e4-7c07589386d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:34.817090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070d67d-6d5a-4c98-a8e4-7c07589386d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:34.817515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070d67d-6d5a-4c98-a8e4-7c07589386d3 admin admin] PATH_INFO: `/v3/projects/f771faf07aeb43c59f6a8b97c92a4bc2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:34.818934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070d67d-6d5a-4c98-a8e4-7c07589386d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f771faf07aeb43c59f6a8b97c92a4bc2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:34.822106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070d67d-6d5a-4c98-a8e4-7c07589386d3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:34.921204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7070d67d-6d5a-4c98-a8e4-7c07589386d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f771faf07aeb43c59f6a8b97c92a4bc2', 'request_id': 'req-7070d67d-6d5a-4c98-a8e4-7c07589386d3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:34.941484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7070d67d-6d5a-4c98-a8e4-7c07589386d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f771faf07aeb43c59f6a8b97c92a4bc2', 'request_id': 'req-7070d67d-6d5a-4c98-a8e4-7c07589386d3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:34.949248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7070d67d-6d5a-4c98-a8e4-7c07589386d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f771faf07aeb43c59f6a8b97c92a4bc2', 'request_id': 'req-7070d67d-6d5a-4c98-a8e4-7c07589386d3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:34.974735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7070d67d-6d5a-4c98-a8e4-7c07589386d3 admin admin] The token cache is being invalidate because project f771faf07aeb43c59f6a8b97c92a4bc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:04:34.975085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7070d67d-6d5a-4c98-a8e4-7c07589386d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:34.977792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7070d67d-6d5a-4c98-a8e4-7c07589386d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:34.985084 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2398/4784] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:04:34 2022] DELETE /identity/v3/projects/f771faf07aeb43c59f6a8b97c92a4bc2 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:34.990312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dfc75-9a03-4669-b8f1-061fba8d6941 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:34.990698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dfc75-9a03-4669-b8f1-061fba8d6941 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:34.991367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dfc75-9a03-4669-b8f1-061fba8d6941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:35.043511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cc1dfc75-9a03-4669-b8f1-061fba8d6941 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:35.046746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cc1dfc75-9a03-4669-b8f1-061fba8d6941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:35.226019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bb244-5739-418c-b4f6-246cb9aef6b7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:35.226498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bb244-5739-418c-b4f6-246cb9aef6b7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:35.226880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bb244-5739-418c-b4f6-246cb9aef6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:35.239704 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2387/4785] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:35.280386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e55bb244-5739-418c-b4f6-246cb9aef6b7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:35.282442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e55bb244-5739-418c-b4f6-246cb9aef6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:35.304664 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2399/4786] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:35.306320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1dfc75-9a03-4669-b8f1-061fba8d6941 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:35.321499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1dfc75-9a03-4669-b8f1-061fba8d6941 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:35.329936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421b4ea-e1cf-4f75-82ad-c33c0ba0e347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:35.330809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421b4ea-e1cf-4f75-82ad-c33c0ba0e347 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:35.331444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421b4ea-e1cf-4f75-82ad-c33c0ba0e347 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:35.331873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421b4ea-e1cf-4f75-82ad-c33c0ba0e347 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:35.333105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421b4ea-e1cf-4f75-82ad-c33c0ba0e347 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:04:35.333584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421b4ea-e1cf-4f75-82ad-c33c0ba0e347 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:35.335768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421b4ea-e1cf-4f75-82ad-c33c0ba0e347 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:35.379054 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2388/4787] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:04:35.381288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bb244-5739-418c-b4f6-246cb9aef6b7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:35.395836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bb244-5739-418c-b4f6-246cb9aef6b7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:35.415872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2b70e-7963-44f1-867a-567638083441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:35.416869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2b70e-7963-44f1-867a-567638083441 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:35.417616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2b70e-7963-44f1-867a-567638083441 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:35.418009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2b70e-7963-44f1-867a-567638083441 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:35.418767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2b70e-7963-44f1-867a-567638083441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:35.428673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2b70e-7963-44f1-867a-567638083441 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:35.551412 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2400/4788] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:04:35 2022] POST /identity/v3/projects => generated 391 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:35.558367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421b4ea-e1cf-4f75-82ad-c33c0ba0e347 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:35.581051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421b4ea-e1cf-4f75-82ad-c33c0ba0e347 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:35.752687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed00822-5cbd-4197-9d95-7649e2ab7d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:35.753335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed00822-5cbd-4197-9d95-7649e2ab7d2b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:35.753618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed00822-5cbd-4197-9d95-7649e2ab7d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:35.753890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed00822-5cbd-4197-9d95-7649e2ab7d2b admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:35.754535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed00822-5cbd-4197-9d95-7649e2ab7d2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:35.760853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed00822-5cbd-4197-9d95-7649e2ab7d2b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:35.812031 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:35.829717 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2389/4789] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:04:35 2022] POST /identity/v3/users => generated 296 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:35.834105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2b70e-7963-44f1-867a-567638083441 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:35.847135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2b70e-7963-44f1-867a-567638083441 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:35.855230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7478f0-e6ed-4dd5-8475-a85b01fdf043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:35.856386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7478f0-e6ed-4dd5-8475-a85b01fdf043 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:35.856935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7478f0-e6ed-4dd5-8475-a85b01fdf043 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:35.857472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7478f0-e6ed-4dd5-8475-a85b01fdf043 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:35.859179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7478f0-e6ed-4dd5-8475-a85b01fdf043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:35.861506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7478f0-e6ed-4dd5-8475-a85b01fdf043 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:35.880579 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2401/4790] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:35.884272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed00822-5cbd-4197-9d95-7649e2ab7d2b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:35.896736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed00822-5cbd-4197-9d95-7649e2ab7d2b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:35.902835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0930a9-8589-4245-b1d9-d440a4514109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:35.903805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0930a9-8589-4245-b1d9-d440a4514109 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:35.904297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0930a9-8589-4245-b1d9-d440a4514109 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:35.904879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0930a9-8589-4245-b1d9-d440a4514109 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:35.905747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0930a9-8589-4245-b1d9-d440a4514109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:35.907763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0930a9-8589-4245-b1d9-d440a4514109 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:35.929815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7478f0-e6ed-4dd5-8475-a85b01fdf043 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:35.937175 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2390/4791] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:35.941905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7478f0-e6ed-4dd5-8475-a85b01fdf043 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:35.947234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e827cd-e323-4bbd-8fdd-adee5383c86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:35.948818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e827cd-e323-4bbd-8fdd-adee5383c86b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:35.949488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e827cd-e323-4bbd-8fdd-adee5383c86b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:35.950102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e827cd-e323-4bbd-8fdd-adee5383c86b admin admin] PATH_INFO: `/v3/projects/1d4dbe47d2a94709bc9cb47bfed13b43/users/5414d9722a3f40e2b29676be1b3e6408/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:35.968126 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:35.973639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e827cd-e323-4bbd-8fdd-adee5383c86b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d4dbe47d2a94709bc9cb47bfed13b43, user_id=5414d9722a3f40e2b29676be1b3e6408, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:35.976830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e827cd-e323-4bbd-8fdd-adee5383c86b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:36.014985 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2402/4792] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:04:35 2022] PUT /identity/v3/projects/1d4dbe47d2a94709bc9cb47bfed13b43/users/5414d9722a3f40e2b29676be1b3e6408/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:36.025458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55728abf-f5ae-4517-bd99-eb5148b56df5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:36.026839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55728abf-f5ae-4517-bd99-eb5148b56df5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:36.027390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55728abf-f5ae-4517-bd99-eb5148b56df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:36.138306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-55728abf-f5ae-4517-bd99-eb5148b56df5 None None] MFA Rules not processed for user `5414d9722a3f40e2b29676be1b3e6408`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:36.141942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-55728abf-f5ae-4517-bd99-eb5148b56df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:36.332345 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2391/4793] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:04:36.359376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e827cd-e323-4bbd-8fdd-adee5383c86b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:36.361343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-56e827cd-e323-4bbd-8fdd-adee5383c86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:36.517952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e827cd-e323-4bbd-8fdd-adee5383c86b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:36.538656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee5dc0-b97a-4767-b09d-74a1a95fdff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:36.540514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee5dc0-b97a-4767-b09d-74a1a95fdff6 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:36.545327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee5dc0-b97a-4767-b09d-74a1a95fdff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:36.545711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee5dc0-b97a-4767-b09d-74a1a95fdff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:36.558935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee5dc0-b97a-4767-b09d-74a1a95fdff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:36.560990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee5dc0-b97a-4767-b09d-74a1a95fdff6 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:36.577675 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2403/4794] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:04:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:04:36.654995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55728abf-f5ae-4517-bd99-eb5148b56df5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:36.794719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55728abf-f5ae-4517-bd99-eb5148b56df5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:36.800449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdefc4-fab0-4ced-b77f-010127af5f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:36.801428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdefc4-fab0-4ced-b77f-010127af5f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:36.801889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdefc4-fab0-4ced-b77f-010127af5f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:36.802400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdefc4-fab0-4ced-b77f-010127af5f76 admin admin] PATH_INFO: `/v3/users/5414d9722a3f40e2b29676be1b3e6408` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:36.803813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cdefc4-fab0-4ced-b77f-010127af5f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5414d9722a3f40e2b29676be1b3e6408)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:36.808303 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cdefc4-fab0-4ced-b77f-010127af5f76 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:36.919353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c7cdefc4-fab0-4ced-b77f-010127af5f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5414d9722a3f40e2b29676be1b3e6408'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:36.935816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c7cdefc4-fab0-4ced-b77f-010127af5f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5414d9722a3f40e2b29676be1b3e6408'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:36.936785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c7cdefc4-fab0-4ced-b77f-010127af5f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5414d9722a3f40e2b29676be1b3e6408'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:36.959136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c7cdefc4-fab0-4ced-b77f-010127af5f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5414d9722a3f40e2b29676be1b3e6408'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:36.967781 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:36.973273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c7cdefc4-fab0-4ced-b77f-010127af5f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5414d9722a3f40e2b29676be1b3e6408'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:36.983779 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2392/4795] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:04:36 2022] DELETE /identity/v3/users/5414d9722a3f40e2b29676be1b3e6408 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:36.988650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddc533-bde7-4ebc-9bdb-1a6c7a79aa2d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:36.989184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddc533-bde7-4ebc-9bdb-1a6c7a79aa2d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:36.990404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddc533-bde7-4ebc-9bdb-1a6c7a79aa2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:37.024329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-49ddc533-bde7-4ebc-9bdb-1a6c7a79aa2d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:37.028494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-49ddc533-bde7-4ebc-9bdb-1a6c7a79aa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:37.209864 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2404/4796] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:37.336062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdefc4-fab0-4ced-b77f-010127af5f76 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:37.337600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c7cdefc4-fab0-4ced-b77f-010127af5f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:37.464751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdefc4-fab0-4ced-b77f-010127af5f76 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:37.472518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4792df6-5a45-46ca-b6c9-0b6a37cc9512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:37.473387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4792df6-5a45-46ca-b6c9-0b6a37cc9512 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:37.473763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4792df6-5a45-46ca-b6c9-0b6a37cc9512 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:37.474128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4792df6-5a45-46ca-b6c9-0b6a37cc9512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:37.495177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4792df6-5a45-46ca-b6c9-0b6a37cc9512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:37.496792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4792df6-5a45-46ca-b6c9-0b6a37cc9512 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:37.524152 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2393/4797] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:04:39.927817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddc533-bde7-4ebc-9bdb-1a6c7a79aa2d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:39.928392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-49ddc533-bde7-4ebc-9bdb-1a6c7a79aa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:39.949213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4792df6-5a45-46ca-b6c9-0b6a37cc9512 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:39.951126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d4792df6-5a45-46ca-b6c9-0b6a37cc9512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:39.952866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddc533-bde7-4ebc-9bdb-1a6c7a79aa2d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:39.962277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd6cd2-a77f-4fa4-ac04-cb0ea250701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:39.963164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd6cd2-a77f-4fa4-ac04-cb0ea250701c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:39.963658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd6cd2-a77f-4fa4-ac04-cb0ea250701c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:39.964209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd6cd2-a77f-4fa4-ac04-cb0ea250701c admin admin] PATH_INFO: `/v3/users/1475c964ec494356a50cc9832f2cfc0b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:39.966042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd6cd2-a77f-4fa4-ac04-cb0ea250701c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1475c964ec494356a50cc9832f2cfc0b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:39.969826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd6cd2-a77f-4fa4-ac04-cb0ea250701c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:39.981416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4792df6-5a45-46ca-b6c9-0b6a37cc9512 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:39.997983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde77bac-5986-4cb1-9678-0c49f9588c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:39.999237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde77bac-5986-4cb1-9678-0c49f9588c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:40.000884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde77bac-5986-4cb1-9678-0c49f9588c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:40.002217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde77bac-5986-4cb1-9678-0c49f9588c68 admin admin] PATH_INFO: `/v3/projects/1d4dbe47d2a94709bc9cb47bfed13b43` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:40.005998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde77bac-5986-4cb1-9678-0c49f9588c68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d4dbe47d2a94709bc9cb47bfed13b43)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:40.015412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde77bac-5986-4cb1-9678-0c49f9588c68 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:40.098802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8cfd6cd2-a77f-4fa4-ac04-cb0ea250701c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1475c964ec494356a50cc9832f2cfc0b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:40.100202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8cfd6cd2-a77f-4fa4-ac04-cb0ea250701c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1475c964ec494356a50cc9832f2cfc0b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:40.116558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8cfd6cd2-a77f-4fa4-ac04-cb0ea250701c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1475c964ec494356a50cc9832f2cfc0b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:40.134517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dde77bac-5986-4cb1-9678-0c49f9588c68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d4dbe47d2a94709bc9cb47bfed13b43', 'request_id': 'req-dde77bac-5986-4cb1-9678-0c49f9588c68'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:40.147806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dde77bac-5986-4cb1-9678-0c49f9588c68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d4dbe47d2a94709bc9cb47bfed13b43', 'request_id': 'req-dde77bac-5986-4cb1-9678-0c49f9588c68'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:40.158263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dde77bac-5986-4cb1-9678-0c49f9588c68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d4dbe47d2a94709bc9cb47bfed13b43', 'request_id': 'req-dde77bac-5986-4cb1-9678-0c49f9588c68'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:40.171748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8cfd6cd2-a77f-4fa4-ac04-cb0ea250701c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1475c964ec494356a50cc9832f2cfc0b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:40.181276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dde77bac-5986-4cb1-9678-0c49f9588c68 admin admin] The token cache is being invalidate because project 1d4dbe47d2a94709bc9cb47bfed13b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:04:40.182322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dde77bac-5986-4cb1-9678-0c49f9588c68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:40.183760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dde77bac-5986-4cb1-9678-0c49f9588c68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:40.192904 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2394/4798] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:04:39 2022] DELETE /identity/v3/projects/1d4dbe47d2a94709bc9cb47bfed13b43 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:40.195185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f27c11-85f3-41b8-a98f-7ebac5bdc031 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:40.195350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8cfd6cd2-a77f-4fa4-ac04-cb0ea250701c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1475c964ec494356a50cc9832f2cfc0b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:40.196156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f27c11-85f3-41b8-a98f-7ebac5bdc031 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:40.197127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f27c11-85f3-41b8-a98f-7ebac5bdc031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:40.227129 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2405/4799] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:04:39 2022] DELETE /identity/v3/users/1475c964ec494356a50cc9832f2cfc0b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:40.232898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9fa0b-9911-459c-a90a-50b9bb1c206d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:40.233192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9fa0b-9911-459c-a90a-50b9bb1c206d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:40.233473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9fa0b-9911-459c-a90a-50b9bb1c206d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:40.237476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d7f27c11-85f3-41b8-a98f-7ebac5bdc031 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:40.239601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d7f27c11-85f3-41b8-a98f-7ebac5bdc031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:40.286009 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:40.313885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e4b9fa0b-9911-459c-a90a-50b9bb1c206d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:40.315148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e4b9fa0b-9911-459c-a90a-50b9bb1c206d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:40.440993 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2395/4800] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:40.452282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a156eb-2d06-43a6-8e48-b72943455f16 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:40.454008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a156eb-2d06-43a6-8e48-b72943455f16 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:40.454374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a156eb-2d06-43a6-8e48-b72943455f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:40.504668 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2406/4801] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:40.509552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-24a156eb-2d06-43a6-8e48-b72943455f16 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:40.511112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-24a156eb-2d06-43a6-8e48-b72943455f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:40.516031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9fa0b-9911-459c-a90a-50b9bb1c206d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:40.519413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e4b9fa0b-9911-459c-a90a-50b9bb1c206d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:40.530713 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2396/4802] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:40.535312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a156eb-2d06-43a6-8e48-b72943455f16 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:40.553008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a156eb-2d06-43a6-8e48-b72943455f16 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:40.569090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf789e0-55c7-48f4-8147-ec1e2e39359b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:40.569724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf789e0-55c7-48f4-8147-ec1e2e39359b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:40.570001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf789e0-55c7-48f4-8147-ec1e2e39359b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:40.570275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf789e0-55c7-48f4-8147-ec1e2e39359b admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:40.571079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf789e0-55c7-48f4-8147-ec1e2e39359b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:04:40.571385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf789e0-55c7-48f4-8147-ec1e2e39359b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:40.573219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf789e0-55c7-48f4-8147-ec1e2e39359b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:40.601253 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2397/4803] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:04:40.608035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf789e0-55c7-48f4-8147-ec1e2e39359b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:40.613399 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:40.630652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf789e0-55c7-48f4-8147-ec1e2e39359b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:40.644435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f85c1c-57e5-48b1-8bf2-1d19e13433c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:40.645550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f85c1c-57e5-48b1-8bf2-1d19e13433c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:40.645834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f85c1c-57e5-48b1-8bf2-1d19e13433c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:40.646106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f85c1c-57e5-48b1-8bf2-1d19e13433c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:40.646753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f85c1c-57e5-48b1-8bf2-1d19e13433c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:40.652405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f85c1c-57e5-48b1-8bf2-1d19e13433c3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:40.718342 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2398/4804] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:04:40 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:04:40.723073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f85c1c-57e5-48b1-8bf2-1d19e13433c3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:40.767386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9fa0b-9911-459c-a90a-50b9bb1c206d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:40.862783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f85c1c-57e5-48b1-8bf2-1d19e13433c3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:40.873423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deab932-e459-4d11-a8f6-3be09fe535c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:40.874329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab932-e459-4d11-a8f6-3be09fe535c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:40.874499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab932-e459-4d11-a8f6-3be09fe535c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:40.874714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab932-e459-4d11-a8f6-3be09fe535c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:40.875820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deab932-e459-4d11-a8f6-3be09fe535c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:40.878189 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deab932-e459-4d11-a8f6-3be09fe535c0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:40.889047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bff446-4418-480f-909f-b5f0082f26ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:40.890525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bff446-4418-480f-909f-b5f0082f26ec service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:40.890845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bff446-4418-480f-909f-b5f0082f26ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:40.892556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bff446-4418-480f-909f-b5f0082f26ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:40.918866 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2399/4805] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:04:40 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:04:40.919946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bff446-4418-480f-909f-b5f0082f26ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:40.921721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deab932-e459-4d11-a8f6-3be09fe535c0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:40.923003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bff446-4418-480f-909f-b5f0082f26ec service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:40.942090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deab932-e459-4d11-a8f6-3be09fe535c0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:40.957894 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2407/4806] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:04:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:04:40.959128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b040c-e1ea-4773-8761-f577ab3c7f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:40.960421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b040c-e1ea-4773-8761-f577ab3c7f16 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:40.960421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b040c-e1ea-4773-8761-f577ab3c7f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:40.960421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b040c-e1ea-4773-8761-f577ab3c7f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:40.961115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b040c-e1ea-4773-8761-f577ab3c7f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:40.963038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b040c-e1ea-4773-8761-f577ab3c7f16 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:40.978248 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2400/4807] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:40.982934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bff446-4418-480f-909f-b5f0082f26ec service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:40.996198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b040c-e1ea-4773-8761-f577ab3c7f16 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:40.998388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-463b040c-e1ea-4773-8761-f577ab3c7f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:41.014205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bff446-4418-480f-909f-b5f0082f26ec service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:41.024491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b040c-e1ea-4773-8761-f577ab3c7f16 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:41.028749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae202409-063d-4a2d-bb12-90bd6058ccdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:41.029415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae202409-063d-4a2d-bb12-90bd6058ccdf admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:41.029729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae202409-063d-4a2d-bb12-90bd6058ccdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:41.030034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae202409-063d-4a2d-bb12-90bd6058ccdf admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:41.030726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae202409-063d-4a2d-bb12-90bd6058ccdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:41.039992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45184b7c-215c-42a5-a3e1-301eb9ddca62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:41.040818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45184b7c-215c-42a5-a3e1-301eb9ddca62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:41.041858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45184b7c-215c-42a5-a3e1-301eb9ddca62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:41.042317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45184b7c-215c-42a5-a3e1-301eb9ddca62 admin admin] PATH_INFO: `/v3/users/84d7488be7d04fdf8ca44b961a9ba0e8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:41.042898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae202409-063d-4a2d-bb12-90bd6058ccdf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:41.046201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45184b7c-215c-42a5-a3e1-301eb9ddca62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84d7488be7d04fdf8ca44b961a9ba0e8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:41.051094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45184b7c-215c-42a5-a3e1-301eb9ddca62 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:41.080818 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2408/4808] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:41.085783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae202409-063d-4a2d-bb12-90bd6058ccdf admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:41.115011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae202409-063d-4a2d-bb12-90bd6058ccdf admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:41.127053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f2b30-efb7-4cb2-87a0-c507141adbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:41.127547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f2b30-efb7-4cb2-87a0-c507141adbd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:41.128166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f2b30-efb7-4cb2-87a0-c507141adbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:41.128545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f2b30-efb7-4cb2-87a0-c507141adbd3 admin admin] PATH_INFO: `/v3/projects/84c6af266b2f4ba4b0662c632bb4cae3/users/542c8d34d222428087e511bdd0c65b96/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:41.183306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45184b7c-215c-42a5-a3e1-301eb9ddca62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84d7488be7d04fdf8ca44b961a9ba0e8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:41.201165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45184b7c-215c-42a5-a3e1-301eb9ddca62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84d7488be7d04fdf8ca44b961a9ba0e8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:41.201903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45184b7c-215c-42a5-a3e1-301eb9ddca62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84d7488be7d04fdf8ca44b961a9ba0e8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:41.208166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f2b30-efb7-4cb2-87a0-c507141adbd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c6af266b2f4ba4b0662c632bb4cae3, user_id=542c8d34d222428087e511bdd0c65b96, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:41.217119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f2b30-efb7-4cb2-87a0-c507141adbd3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:41.257900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45184b7c-215c-42a5-a3e1-301eb9ddca62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84d7488be7d04fdf8ca44b961a9ba0e8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:41.266184 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2409/4809] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:04:41 2022] PUT /identity/v3/projects/84c6af266b2f4ba4b0662c632bb4cae3/users/542c8d34d222428087e511bdd0c65b96/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:41.289505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45184b7c-215c-42a5-a3e1-301eb9ddca62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84d7488be7d04fdf8ca44b961a9ba0e8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:41.303291 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2401/4810] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:04:40 2022] DELETE /identity/v3/users/84d7488be7d04fdf8ca44b961a9ba0e8 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:04:41.408063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceb7c7-7746-426a-a0c5-0e92ad898cde None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:41.408705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceb7c7-7746-426a-a0c5-0e92ad898cde None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:41.409082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceb7c7-7746-426a-a0c5-0e92ad898cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:41.544438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f3ceb7c7-7746-426a-a0c5-0e92ad898cde None None] MFA Rules not processed for user `542c8d34d222428087e511bdd0c65b96`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:41.548212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f3ceb7c7-7746-426a-a0c5-0e92ad898cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:41.622972 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:41.778311 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2410/4811] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:41.808594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45184b7c-215c-42a5-a3e1-301eb9ddca62 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:41.810197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-45184b7c-215c-42a5-a3e1-301eb9ddca62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:41.890200 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:41.946049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45184b7c-215c-42a5-a3e1-301eb9ddca62 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:41.954781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb97c4-d634-4193-9863-93d234776bea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:41.955652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb97c4-d634-4193-9863-93d234776bea service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:41.956040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb97c4-d634-4193-9863-93d234776bea service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:41.956413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb97c4-d634-4193-9863-93d234776bea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:41.977908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb97c4-d634-4193-9863-93d234776bea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:41.980010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb97c4-d634-4193-9863-93d234776bea service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:42.000154 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2402/4812] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:04:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:04:42.217613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ceb7c7-7746-426a-a0c5-0e92ad898cde None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:42.219110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f3ceb7c7-7746-426a-a0c5-0e92ad898cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:42.363573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ceb7c7-7746-426a-a0c5-0e92ad898cde None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:42.377792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323b024-9d28-4591-adfc-fe94436f5d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:42.378775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323b024-9d28-4591-adfc-fe94436f5d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:42.379712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323b024-9d28-4591-adfc-fe94436f5d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:42.380106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323b024-9d28-4591-adfc-fe94436f5d6b admin admin] PATH_INFO: `/v3/projects/bfa62487356848879d36997cb675dfdd` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:42.381801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323b024-9d28-4591-adfc-fe94436f5d6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfa62487356848879d36997cb675dfdd)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:42.383930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323b024-9d28-4591-adfc-fe94436f5d6b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:42.518433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7323b024-9d28-4591-adfc-fe94436f5d6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfa62487356848879d36997cb675dfdd', 'request_id': 'req-7323b024-9d28-4591-adfc-fe94436f5d6b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:42.532696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7323b024-9d28-4591-adfc-fe94436f5d6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfa62487356848879d36997cb675dfdd', 'request_id': 'req-7323b024-9d28-4591-adfc-fe94436f5d6b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:42.546655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7323b024-9d28-4591-adfc-fe94436f5d6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfa62487356848879d36997cb675dfdd', 'request_id': 'req-7323b024-9d28-4591-adfc-fe94436f5d6b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:42.563801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7323b024-9d28-4591-adfc-fe94436f5d6b admin admin] The token cache is being invalidate because project bfa62487356848879d36997cb675dfdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:04:42.564263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7323b024-9d28-4591-adfc-fe94436f5d6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:42.565077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7323b024-9d28-4591-adfc-fe94436f5d6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:42.567238 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2411/4813] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:04:42 2022] DELETE /identity/v3/projects/bfa62487356848879d36997cb675dfdd => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:42.571839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569f4fa-b79a-4b40-8db5-3745f58ef53b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:42.572121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569f4fa-b79a-4b40-8db5-3745f58ef53b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:42.572460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569f4fa-b79a-4b40-8db5-3745f58ef53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:42.620100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7569f4fa-b79a-4b40-8db5-3745f58ef53b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:42.623852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7569f4fa-b79a-4b40-8db5-3745f58ef53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:42.762785 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2403/4814] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:42.763497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29239496-8548-4284-ab39-500b5bd7e18f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:42.763790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29239496-8548-4284-ab39-500b5bd7e18f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:42.764071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29239496-8548-4284-ab39-500b5bd7e18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:42.826722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-29239496-8548-4284-ab39-500b5bd7e18f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:42.827976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-29239496-8548-4284-ab39-500b5bd7e18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:42.860294 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2412/4815] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:42.861937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569f4fa-b79a-4b40-8db5-3745f58ef53b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:42.875110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569f4fa-b79a-4b40-8db5-3745f58ef53b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:42.897294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565d689-a803-4804-82af-06d90d9c3b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:42.897947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565d689-a803-4804-82af-06d90d9c3b3b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:42.898213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565d689-a803-4804-82af-06d90d9c3b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:42.898486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565d689-a803-4804-82af-06d90d9c3b3b admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:42.899156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565d689-a803-4804-82af-06d90d9c3b3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:04:42.899464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565d689-a803-4804-82af-06d90d9c3b3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:42.901804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565d689-a803-4804-82af-06d90d9c3b3b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:42.941477 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2404/4816] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:04:42.942613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29239496-8548-4284-ab39-500b5bd7e18f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:42.961300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29239496-8548-4284-ab39-500b5bd7e18f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:42.971284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa0f7f-437e-4e03-a18e-728d8bc64ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:42.972006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa0f7f-437e-4e03-a18e-728d8bc64ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:42.972726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa0f7f-437e-4e03-a18e-728d8bc64ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:42.973003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa0f7f-437e-4e03-a18e-728d8bc64ba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:42.974111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa0f7f-437e-4e03-a18e-728d8bc64ba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:42.976106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa0f7f-437e-4e03-a18e-728d8bc64ba0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:43.036652 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2413/4817] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:04:42 2022] POST /identity/v3/projects => generated 369 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:43.037195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565d689-a803-4804-82af-06d90d9c3b3b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:43.050853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565d689-a803-4804-82af-06d90d9c3b3b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:43.069389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa0f7f-437e-4e03-a18e-728d8bc64ba0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:43.071735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a5fa0f7f-437e-4e03-a18e-728d8bc64ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:43.132163 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:43.211755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa0f7f-437e-4e03-a18e-728d8bc64ba0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:43.216829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021dba80-6952-40d4-be90-df7668513eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:43.218893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9cc952-f741-4efe-a14e-488573e22a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:43.219540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cc952-f741-4efe-a14e-488573e22a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:43.219816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cc952-f741-4efe-a14e-488573e22a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:43.220044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dba80-6952-40d4-be90-df7668513eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:43.220160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cc952-f741-4efe-a14e-488573e22a60 admin admin] PATH_INFO: `/v3/projects/8d01f9fd66aa47d588dcb416f1bd4bba` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:43.221164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dba80-6952-40d4-be90-df7668513eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:43.222040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9cc952-f741-4efe-a14e-488573e22a60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d01f9fd66aa47d588dcb416f1bd4bba)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:43.222384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dba80-6952-40d4-be90-df7668513eb8 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:43.227644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9cc952-f741-4efe-a14e-488573e22a60 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:43.228209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021dba80-6952-40d4-be90-df7668513eb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:43.233030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021dba80-6952-40d4-be90-df7668513eb8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:43.298794 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2405/4818] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:04:43 2022] POST /identity/v3/users => generated 285 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:43.302965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021dba80-6952-40d4-be90-df7668513eb8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:43.325160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021dba80-6952-40d4-be90-df7668513eb8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:43.347536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb9cc952-f741-4efe-a14e-488573e22a60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d01f9fd66aa47d588dcb416f1bd4bba', 'request_id': 'req-eb9cc952-f741-4efe-a14e-488573e22a60'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:43.371125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb9cc952-f741-4efe-a14e-488573e22a60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d01f9fd66aa47d588dcb416f1bd4bba', 'request_id': 'req-eb9cc952-f741-4efe-a14e-488573e22a60'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:43.378128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb9cc952-f741-4efe-a14e-488573e22a60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d01f9fd66aa47d588dcb416f1bd4bba', 'request_id': 'req-eb9cc952-f741-4efe-a14e-488573e22a60'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:43.399318 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:43.402589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb9cc952-f741-4efe-a14e-488573e22a60 admin admin] The token cache is being invalidate because project 8d01f9fd66aa47d588dcb416f1bd4bba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:04:43.405948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb9cc952-f741-4efe-a14e-488573e22a60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:43.406885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb9cc952-f741-4efe-a14e-488573e22a60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:43.412896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238e3e1-3cbf-4ba7-8b24-c28d7a3e0fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:43.413913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238e3e1-3cbf-4ba7-8b24-c28d7a3e0fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:43.414382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238e3e1-3cbf-4ba7-8b24-c28d7a3e0fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:43.414676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238e3e1-3cbf-4ba7-8b24-c28d7a3e0fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:43.415432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238e3e1-3cbf-4ba7-8b24-c28d7a3e0fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:43.417985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238e3e1-3cbf-4ba7-8b24-c28d7a3e0fc9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:43.418104 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2414/4819] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:04:43 2022] DELETE /identity/v3/projects/8d01f9fd66aa47d588dcb416f1bd4bba => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:43.425858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a7408-80a4-4622-bd79-79e04c35e425 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:43.426150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a7408-80a4-4622-bd79-79e04c35e425 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:43.426425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a7408-80a4-4622-bd79-79e04c35e425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:43.436642 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2406/4820] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:43.443153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238e3e1-3cbf-4ba7-8b24-c28d7a3e0fc9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:43.447125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2238e3e1-3cbf-4ba7-8b24-c28d7a3e0fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:43.469154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d97a7408-80a4-4622-bd79-79e04c35e425 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:43.470378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d97a7408-80a4-4622-bd79-79e04c35e425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:43.473901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238e3e1-3cbf-4ba7-8b24-c28d7a3e0fc9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:43.479672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fecbd5-f6b8-4613-b328-893d5cb5c185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:43.480590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fecbd5-f6b8-4613-b328-893d5cb5c185 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:43.481271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fecbd5-f6b8-4613-b328-893d5cb5c185 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:43.482276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fecbd5-f6b8-4613-b328-893d5cb5c185 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:43.483087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fecbd5-f6b8-4613-b328-893d5cb5c185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:43.484943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fecbd5-f6b8-4613-b328-893d5cb5c185 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:43.491263 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2415/4821] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:43.498925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff939b-2ca0-41d1-a0ec-0ef283612d6b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:43.499210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff939b-2ca0-41d1-a0ec-0ef283612d6b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:43.499485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff939b-2ca0-41d1-a0ec-0ef283612d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:43.517345 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2407/4822] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:43.520369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fecbd5-f6b8-4613-b328-893d5cb5c185 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:43.547292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fecbd5-f6b8-4613-b328-893d5cb5c185 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:43.557174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-10ff939b-2ca0-41d1-a0ec-0ef283612d6b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:43.558680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-10ff939b-2ca0-41d1-a0ec-0ef283612d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:43.565360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422a272-4549-48c9-a338-b1ad6ce54b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:43.566442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422a272-4549-48c9-a338-b1ad6ce54b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:43.567449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422a272-4549-48c9-a338-b1ad6ce54b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:43.567449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422a272-4549-48c9-a338-b1ad6ce54b75 admin admin] PATH_INFO: `/v3/projects/4d5eeab6f54149399b13a1934d770a7c/users/8ebbd74ac2d4476c9440779a14e25293/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:43.588256 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2416/4823] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:43.592421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff939b-2ca0-41d1-a0ec-0ef283612d6b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:43.611122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff939b-2ca0-41d1-a0ec-0ef283612d6b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:43.613765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422a272-4549-48c9-a338-b1ad6ce54b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d5eeab6f54149399b13a1934d770a7c, user_id=8ebbd74ac2d4476c9440779a14e25293, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:43.617305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422a272-4549-48c9-a338-b1ad6ce54b75 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:43.625960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e901f-ed42-4e67-9d4d-9810dc83f618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:43.626656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e901f-ed42-4e67-9d4d-9810dc83f618 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:43.627042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e901f-ed42-4e67-9d4d-9810dc83f618 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:43.627523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e901f-ed42-4e67-9d4d-9810dc83f618 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:43.628281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e901f-ed42-4e67-9d4d-9810dc83f618 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:04:43.628731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e901f-ed42-4e67-9d4d-9810dc83f618 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:43.632502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e901f-ed42-4e67-9d4d-9810dc83f618 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:43.644546 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2408/4824] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:04:43 2022] PUT /identity/v3/projects/4d5eeab6f54149399b13a1934d770a7c/users/8ebbd74ac2d4476c9440779a14e25293/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:43.658008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0164be7-7819-4c46-9bef-7426c0d16477 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:43.658977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0164be7-7819-4c46-9bef-7426c0d16477 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:43.659134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0164be7-7819-4c46-9bef-7426c0d16477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:43.670388 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2417/4825] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:04:43.671834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e901f-ed42-4e67-9d4d-9810dc83f618 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:43.695599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e901f-ed42-4e67-9d4d-9810dc83f618 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:43.736355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b0164be7-7819-4c46-9bef-7426c0d16477 None None] MFA Rules not processed for user `8ebbd74ac2d4476c9440779a14e25293`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:43.737863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b0164be7-7819-4c46-9bef-7426c0d16477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:43.823938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804fc89-5351-421e-8dd7-7e89245b5f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:43.824701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804fc89-5351-421e-8dd7-7e89245b5f1f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:43.824983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804fc89-5351-421e-8dd7-7e89245b5f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:43.825949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804fc89-5351-421e-8dd7-7e89245b5f1f admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:43.826661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804fc89-5351-421e-8dd7-7e89245b5f1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:43.829682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804fc89-5351-421e-8dd7-7e89245b5f1f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:43.891337 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2418/4826] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:04:43 2022] POST /identity/v3/projects => generated 383 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:04:43.892951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804fc89-5351-421e-8dd7-7e89245b5f1f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:43.899170 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2409/4827] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:04:43.900219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0164be7-7819-4c46-9bef-7426c0d16477 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:43.912492 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:43.940515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0164be7-7819-4c46-9bef-7426c0d16477 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:43.994766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804fc89-5351-421e-8dd7-7e89245b5f1f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:44.003333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09675a-3e81-4428-af01-159d93fdcaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:44.004581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09675a-3e81-4428-af01-159d93fdcaba admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:44.005121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09675a-3e81-4428-af01-159d93fdcaba admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:44.005700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09675a-3e81-4428-af01-159d93fdcaba admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:44.006441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09675a-3e81-4428-af01-159d93fdcaba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:44.008881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09675a-3e81-4428-af01-159d93fdcaba admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:44.048192 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2419/4828] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:04:43 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:44.051526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09675a-3e81-4428-af01-159d93fdcaba admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:44.083675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09675a-3e81-4428-af01-159d93fdcaba admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:44.097682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ff31c-9f61-4509-a007-a26d77208ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:44.100023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ff31c-9f61-4509-a007-a26d77208ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:44.100428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ff31c-9f61-4509-a007-a26d77208ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:44.101036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ff31c-9f61-4509-a007-a26d77208ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:44.103192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ff31c-9f61-4509-a007-a26d77208ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:44.108695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ff31c-9f61-4509-a007-a26d77208ac6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:44.139491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a2121-e0d7-45c9-94b3-e314b214fafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:44.141311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a2121-e0d7-45c9-94b3-e314b214fafd admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:44.143250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a2121-e0d7-45c9-94b3-e314b214fafd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:44.144767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a2121-e0d7-45c9-94b3-e314b214fafd admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:44.145791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a2121-e0d7-45c9-94b3-e314b214fafd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:44.151336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a2121-e0d7-45c9-94b3-e314b214fafd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:44.165515 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2420/4829] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:44.167865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ff31c-9f61-4509-a007-a26d77208ac6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:44.196518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ff31c-9f61-4509-a007-a26d77208ac6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:44.208191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cf581-068d-4808-9da9-cf2f9f165fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:44.211602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cf581-068d-4808-9da9-cf2f9f165fce admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:44.211602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cf581-068d-4808-9da9-cf2f9f165fce admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:44.211602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cf581-068d-4808-9da9-cf2f9f165fce admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:44.211602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cf581-068d-4808-9da9-cf2f9f165fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:44.214529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cf581-068d-4808-9da9-cf2f9f165fce admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:44.239387 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2421/4830] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:44.246166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cf581-068d-4808-9da9-cf2f9f165fce admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:44.254223 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2410/4831] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:04:43 2022] POST /identity/v3/projects => generated 369 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:44.258757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a2121-e0d7-45c9-94b3-e314b214fafd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:44.270199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cf581-068d-4808-9da9-cf2f9f165fce admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:44.348320 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:44.430804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a2121-e0d7-45c9-94b3-e314b214fafd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:44.435723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8488ab-cc1f-4db2-97f3-463c7966f6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:44.436348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8488ab-cc1f-4db2-97f3-463c7966f6ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:44.436783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8488ab-cc1f-4db2-97f3-463c7966f6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:44.437319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8488ab-cc1f-4db2-97f3-463c7966f6ad admin admin] PATH_INFO: `/v3/projects/74b0ed2a14674b7385b880282bafeab0/users/f0e8405dde7241c8b6e1fe97702564fd/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:44.450034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc822c-18e5-470a-9af3-60c7670f08e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:44.450606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc822c-18e5-470a-9af3-60c7670f08e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:44.452025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc822c-18e5-470a-9af3-60c7670f08e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:44.452458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc822c-18e5-470a-9af3-60c7670f08e3 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:44.453145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc822c-18e5-470a-9af3-60c7670f08e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:44.457256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc822c-18e5-470a-9af3-60c7670f08e3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:44.472167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8488ab-cc1f-4db2-97f3-463c7966f6ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b0ed2a14674b7385b880282bafeab0, user_id=f0e8405dde7241c8b6e1fe97702564fd, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:44.479323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8488ab-cc1f-4db2-97f3-463c7966f6ad admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:44.511638 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2411/4832] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:04:44 2022] POST /identity/v3/users => generated 291 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:44.512231 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2422/4833] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:04:44 2022] PUT /identity/v3/projects/74b0ed2a14674b7385b880282bafeab0/users/f0e8405dde7241c8b6e1fe97702564fd/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:44.517088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b14bdb-b062-42c9-8c57-012f08c41ea2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:44.518418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8488ab-cc1f-4db2-97f3-463c7966f6ad admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:44.518948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b14bdb-b062-42c9-8c57-012f08c41ea2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:44.519646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b14bdb-b062-42c9-8c57-012f08c41ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:44.577294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-04b14bdb-b062-42c9-8c57-012f08c41ea2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:44.583081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-04b14bdb-b062-42c9-8c57-012f08c41ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:44.692479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8488ab-cc1f-4db2-97f3-463c7966f6ad admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:44.708724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c5433-6912-4512-943c-1080d3b26fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:44.709475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c5433-6912-4512-943c-1080d3b26fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:44.709759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c5433-6912-4512-943c-1080d3b26fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:44.710029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c5433-6912-4512-943c-1080d3b26fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:44.710822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c5433-6912-4512-943c-1080d3b26fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:44.713917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c5433-6912-4512-943c-1080d3b26fa2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:44.722108 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:44.738395 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2412/4834] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:44.740511 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2423/4835] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:44.744549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b14bdb-b062-42c9-8c57-012f08c41ea2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:44.758618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b14bdb-b062-42c9-8c57-012f08c41ea2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:44.765647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78f98f-7785-48ff-91b3-3686d19b7b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:44.766596 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78f98f-7785-48ff-91b3-3686d19b7b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:44.766940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78f98f-7785-48ff-91b3-3686d19b7b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:44.767319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78f98f-7785-48ff-91b3-3686d19b7b95 admin admin] PATH_INFO: `/v3/projects/b8d527a123d943eb83ac85247e6330f1/users/5c6bda519420419ab90c53b9858b5f9b/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:44.788521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c5433-6912-4512-943c-1080d3b26fa2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:44.790449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d76c5433-6912-4512-943c-1080d3b26fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:44.813627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78f98f-7785-48ff-91b3-3686d19b7b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d527a123d943eb83ac85247e6330f1, user_id=5c6bda519420419ab90c53b9858b5f9b, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:44.816293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78f98f-7785-48ff-91b3-3686d19b7b95 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:44.846617 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2413/4836] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:04:44 2022] PUT /identity/v3/projects/b8d527a123d943eb83ac85247e6330f1/users/5c6bda519420419ab90c53b9858b5f9b/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:44.850956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78f98f-7785-48ff-91b3-3686d19b7b95 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:44.884090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c5433-6912-4512-943c-1080d3b26fa2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:44.971235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34614ec3-de7e-483f-b856-0e23e12feae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:44.973260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34614ec3-de7e-483f-b856-0e23e12feae5 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:44.974658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34614ec3-de7e-483f-b856-0e23e12feae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:44.975156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34614ec3-de7e-483f-b856-0e23e12feae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:45.006878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78f98f-7785-48ff-91b3-3686d19b7b95 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:45.021794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a465e6f-c781-4e82-bf0d-ab79dc1abb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:45.022415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a465e6f-c781-4e82-bf0d-ab79dc1abb8a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:45.022707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a465e6f-c781-4e82-bf0d-ab79dc1abb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:45.023008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a465e6f-c781-4e82-bf0d-ab79dc1abb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:45.023602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a465e6f-c781-4e82-bf0d-ab79dc1abb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:45.025207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a465e6f-c781-4e82-bf0d-ab79dc1abb8a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:45.048904 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2414/4837] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:45.061000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a465e6f-c781-4e82-bf0d-ab79dc1abb8a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:45.078730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a465e6f-c781-4e82-bf0d-ab79dc1abb8a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:45.084083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbcbb8-a5dc-4369-b0c6-5f3949c6761b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:45.085174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbcbb8-a5dc-4369-b0c6-5f3949c6761b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:45.085452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbcbb8-a5dc-4369-b0c6-5f3949c6761b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:45.085721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbcbb8-a5dc-4369-b0c6-5f3949c6761b admin admin] PATH_INFO: `/v3/projects/b8d527a123d943eb83ac85247e6330f1/users/5c6bda519420419ab90c53b9858b5f9b/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:45.088895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dbcbb8-a5dc-4369-b0c6-5f3949c6761b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d527a123d943eb83ac85247e6330f1, user_id=5c6bda519420419ab90c53b9858b5f9b, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:45.093089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dbcbb8-a5dc-4369-b0c6-5f3949c6761b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:45.093499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34614ec3-de7e-483f-b856-0e23e12feae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:45.096839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34614ec3-de7e-483f-b856-0e23e12feae5 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:45.111071 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2415/4838] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:04:45 2022] PUT /identity/v3/projects/b8d527a123d943eb83ac85247e6330f1/users/5c6bda519420419ab90c53b9858b5f9b/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:45.123200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447bd51-fe67-414a-868c-b6f731b0df86 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:45.123528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447bd51-fe67-414a-868c-b6f731b0df86 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:45.123880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447bd51-fe67-414a-868c-b6f731b0df86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:45.125495 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2424/4839] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:04:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:04:45.165216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e447bd51-fe67-414a-868c-b6f731b0df86 None None] MFA Rules not processed for user `5c6bda519420419ab90c53b9858b5f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:45.170956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e447bd51-fe67-414a-868c-b6f731b0df86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:45.177284 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:45.324665 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2416/4840] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:45.328841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34614ec3-de7e-483f-b856-0e23e12feae5 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:45.487468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34614ec3-de7e-483f-b856-0e23e12feae5 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:45.493407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76caf25-aa8d-4436-ab22-0e3be2e2d600 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:45.495473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76caf25-aa8d-4436-ab22-0e3be2e2d600 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:45.495776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76caf25-aa8d-4436-ab22-0e3be2e2d600 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:45.496055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76caf25-aa8d-4436-ab22-0e3be2e2d600 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:45.496770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76caf25-aa8d-4436-ab22-0e3be2e2d600 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:45.498521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76caf25-aa8d-4436-ab22-0e3be2e2d600 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:45.515891 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:45.526511 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2425/4841] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:04:45 2022] POST /identity/v3/services => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:45.531238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447bd51-fe67-414a-868c-b6f731b0df86 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:45.542134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447bd51-fe67-414a-868c-b6f731b0df86 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:45.561637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b722bd-735a-41bb-97cb-739fa9d89ce8 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:45.569282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b722bd-735a-41bb-97cb-739fa9d89ce8 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:45.570478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b722bd-735a-41bb-97cb-739fa9d89ce8 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:45.571427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b722bd-735a-41bb-97cb-739fa9d89ce8 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:45.574059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b722bd-735a-41bb-97cb-739fa9d89ce8 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:45.576337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b722bd-735a-41bb-97cb-739fa9d89ce8 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:45.598648 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-79b722bd-735a-41bb-97cb-739fa9d89ce8 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1804247442. To ensure interoperability, identifiers should be a valid uuid. Sep 30 10:04:45.598648 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 30 10:04:45.598648 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:04:45.660192 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2417/4842] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Sep 30 10:04:45 2022] POST /identity/v3/endpoints => generated 359 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:45.661761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76caf25-aa8d-4436-ab22-0e3be2e2d600 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:45.679352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76caf25-aa8d-4436-ab22-0e3be2e2d600 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:45.719903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb73ecb-eaad-420c-a260-fb0eb3a56b8a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:45.720967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb73ecb-eaad-420c-a260-fb0eb3a56b8a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:45.721551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb73ecb-eaad-420c-a260-fb0eb3a56b8a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:45.722046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb73ecb-eaad-420c-a260-fb0eb3a56b8a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/regions/tempest-region-1804247442` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:45.722984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb73ecb-eaad-420c-a260-fb0eb3a56b8a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1804247442)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:45.728224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb73ecb-eaad-420c-a260-fb0eb3a56b8a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:45.768149 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2426/4843] 10.222.0.16 () {58 vars in 1206 bytes} [Fri Sep 30 10:04:45 2022] GET /identity/v3/regions/tempest-region-1804247442 => generated 180 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:04:45.774804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b722bd-735a-41bb-97cb-739fa9d89ce8 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:45.795028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b722bd-735a-41bb-97cb-739fa9d89ce8 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:45.800930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e26935-6a78-4d26-a16b-062b6cfea3fa tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:45.802058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e26935-6a78-4d26-a16b-062b6cfea3fa tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:45.802498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e26935-6a78-4d26-a16b-062b6cfea3fa tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:45.803275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e26935-6a78-4d26-a16b-062b6cfea3fa tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:45.804081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e26935-6a78-4d26-a16b-062b6cfea3fa tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:45.805413 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-13e26935-6a78-4d26-a16b-062b6cfea3fa tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:04:45.805413 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:04:45.805413 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:04:45.807186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e26935-6a78-4d26-a16b-062b6cfea3fa tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:45.864631 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2418/4844] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:04:45 2022] POST /identity/v3/services => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:04:45.868097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb73ecb-eaad-420c-a260-fb0eb3a56b8a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:45.892995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb73ecb-eaad-420c-a260-fb0eb3a56b8a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:45.939298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6d6e3-b3d6-422b-aacd-cec665f26b9b tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:45.941910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6d6e3-b3d6-422b-aacd-cec665f26b9b tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:45.943496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6d6e3-b3d6-422b-aacd-cec665f26b9b tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:45.944920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6d6e3-b3d6-422b-aacd-cec665f26b9b tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:45.945903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6d6e3-b3d6-422b-aacd-cec665f26b9b tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:45.951480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6d6e3-b3d6-422b-aacd-cec665f26b9b tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:45.999658 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-5ca6d6e3-b3d6-422b-aacd-cec665f26b9b tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-650639828. To ensure interoperability, identifiers should be a valid uuid. Sep 30 10:04:45.999658 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 30 10:04:45.999658 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:04:46.063074 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2427/4845] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Sep 30 10:04:45 2022] POST /identity/v3/endpoints => generated 361 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:46.064378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e26935-6a78-4d26-a16b-062b6cfea3fa tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:46.081474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e26935-6a78-4d26-a16b-062b6cfea3fa tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:46.110469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a9fec-1e67-4aa5-b55c-a621570f2737 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:46.111593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a9fec-1e67-4aa5-b55c-a621570f2737 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:46.112042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a9fec-1e67-4aa5-b55c-a621570f2737 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:46.112423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a9fec-1e67-4aa5-b55c-a621570f2737 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/regions/tempest-region-650639828` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:46.113235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a9fec-1e67-4aa5-b55c-a621570f2737 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-650639828)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:46.114494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a9fec-1e67-4aa5-b55c-a621570f2737 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:46.122121 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2419/4846] 10.222.0.16 () {58 vars in 1203 bytes} [Fri Sep 30 10:04:46 2022] GET /identity/v3/regions/tempest-region-650639828 => generated 178 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:04:46.123358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6d6e3-b3d6-422b-aacd-cec665f26b9b tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:46.147531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6d6e3-b3d6-422b-aacd-cec665f26b9b tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:46.164785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391e4ce-6168-4d2a-a01f-a9792228b4f4 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:46.167855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391e4ce-6168-4d2a-a01f-a9792228b4f4 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:46.169251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391e4ce-6168-4d2a-a01f-a9792228b4f4 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:46.169683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391e4ce-6168-4d2a-a01f-a9792228b4f4 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:46.170684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391e4ce-6168-4d2a-a01f-a9792228b4f4 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:46.173903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391e4ce-6168-4d2a-a01f-a9792228b4f4 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:46.210489 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-8391e4ce-6168-4d2a-a01f-a9792228b4f4 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-906304427. To ensure interoperability, identifiers should be a valid uuid. Sep 30 10:04:46.210489 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 30 10:04:46.210489 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:04:46.311342 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2428/4847] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Sep 30 10:04:46 2022] POST /identity/v3/endpoints => generated 358 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:04:46.312753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a9fec-1e67-4aa5-b55c-a621570f2737 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:46.329802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a9fec-1e67-4aa5-b55c-a621570f2737 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:46.370760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03251c8b-e741-4ee6-bd22-34c92078c9d7 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:46.371317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03251c8b-e741-4ee6-bd22-34c92078c9d7 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:46.371601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03251c8b-e741-4ee6-bd22-34c92078c9d7 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:46.371879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03251c8b-e741-4ee6-bd22-34c92078c9d7 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/regions/tempest-region-906304427` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:46.372474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03251c8b-e741-4ee6-bd22-34c92078c9d7 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-906304427)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:46.373712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03251c8b-e741-4ee6-bd22-34c92078c9d7 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:46.379692 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2420/4848] 10.222.0.16 () {58 vars in 1203 bytes} [Fri Sep 30 10:04:46 2022] GET /identity/v3/regions/tempest-region-906304427 => generated 178 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:04:46.382978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391e4ce-6168-4d2a-a01f-a9792228b4f4 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:46.405977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391e4ce-6168-4d2a-a01f-a9792228b4f4 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:46.414629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e65f6c-91f1-4f03-8187-919cb2663325 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:46.417110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e65f6c-91f1-4f03-8187-919cb2663325 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:46.417751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e65f6c-91f1-4f03-8187-919cb2663325 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:46.418381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e65f6c-91f1-4f03-8187-919cb2663325 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:46.419674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e65f6c-91f1-4f03-8187-919cb2663325 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:46.421786 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-94e65f6c-91f1-4f03-8187-919cb2663325 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:04:46.421786 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:04:46.421786 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:04:46.424086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e65f6c-91f1-4f03-8187-919cb2663325 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:46.450534 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2429/4849] 10.222.0.16 () {58 vars in 1134 bytes} [Fri Sep 30 10:04:46 2022] GET /identity/v3/endpoints => generated 4392 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:46.451840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03251c8b-e741-4ee6-bd22-34c92078c9d7 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:46.471109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03251c8b-e741-4ee6-bd22-34c92078c9d7 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:46.477955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82360c7b-798d-4ca7-b07a-dda8bff04b34 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:46.479789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82360c7b-798d-4ca7-b07a-dda8bff04b34 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:46.480367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82360c7b-798d-4ca7-b07a-dda8bff04b34 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:46.481002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82360c7b-798d-4ca7-b07a-dda8bff04b34 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/endpoints/ce135f07c74a419e9720b45e509d3be9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:46.491601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82360c7b-798d-4ca7-b07a-dda8bff04b34 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=ce135f07c74a419e9720b45e509d3be9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:46.492732 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-82360c7b-798d-4ca7-b07a-dda8bff04b34 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:04:46.492732 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:04:46.492732 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:04:46.493878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82360c7b-798d-4ca7-b07a-dda8bff04b34 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:46.496652 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2421/4850] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:04:46 2022] GET /identity/v3/endpoints/ce135f07c74a419e9720b45e509d3be9 => generated 358 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:04:46.502053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e65f6c-91f1-4f03-8187-919cb2663325 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:46.521749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e65f6c-91f1-4f03-8187-919cb2663325 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:46.544919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607780f-be54-4e8f-8ec6-65af1fc38366 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:46.545990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607780f-be54-4e8f-8ec6-65af1fc38366 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:46.546515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607780f-be54-4e8f-8ec6-65af1fc38366 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:46.547186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607780f-be54-4e8f-8ec6-65af1fc38366 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/endpoints/ce135f07c74a419e9720b45e509d3be9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:46.548761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607780f-be54-4e8f-8ec6-65af1fc38366 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=ce135f07c74a419e9720b45e509d3be9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:46.550683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607780f-be54-4e8f-8ec6-65af1fc38366 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:46.566626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5607780f-be54-4e8f-8ec6-65af1fc38366 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'ce135f07c74a419e9720b45e509d3be9', 'request_id': 'req-5607780f-be54-4e8f-8ec6-65af1fc38366'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:46.591571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82360c7b-798d-4ca7-b07a-dda8bff04b34 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:46.591899 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2430/4851] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Sep 30 10:04:46 2022] DELETE /identity/v3/endpoints/ce135f07c74a419e9720b45e509d3be9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:46.609091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82360c7b-798d-4ca7-b07a-dda8bff04b34 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:46.629844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab18f6-659c-47ea-b69e-8f80aca10247 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:46.630565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab18f6-659c-47ea-b69e-8f80aca10247 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:46.630910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab18f6-659c-47ea-b69e-8f80aca10247 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:46.631298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab18f6-659c-47ea-b69e-8f80aca10247 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:46.631961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab18f6-659c-47ea-b69e-8f80aca10247 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:46.633169 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-f5ab18f6-659c-47ea-b69e-8f80aca10247 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:04:46.633169 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:04:46.633169 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:04:46.639199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab18f6-659c-47ea-b69e-8f80aca10247 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:46.639373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607780f-be54-4e8f-8ec6-65af1fc38366 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:46.641305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5607780f-be54-4e8f-8ec6-65af1fc38366 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:46.648590 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2422/4852] 10.222.0.16 () {58 vars in 1134 bytes} [Fri Sep 30 10:04:46 2022] GET /identity/v3/endpoints => generated 4047 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:46.653449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab18f6-659c-47ea-b69e-8f80aca10247 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:46.666284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab18f6-659c-47ea-b69e-8f80aca10247 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:46.675146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43cd57-1f42-411c-bcb6-6ab9b1291bbd tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:46.675975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43cd57-1f42-411c-bcb6-6ab9b1291bbd tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:46.676341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43cd57-1f42-411c-bcb6-6ab9b1291bbd tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:46.676987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43cd57-1f42-411c-bcb6-6ab9b1291bbd tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/endpoints/ce135f07c74a419e9720b45e509d3be9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:46.688243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43cd57-1f42-411c-bcb6-6ab9b1291bbd tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 10:04:46.733991 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-6e43cd57-1f42-411c-bcb6-6ab9b1291bbd tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Could not find endpoint: ce135f07c74a419e9720b45e509d3be9.: keystone.exception.EndpointNotFound: Could not find endpoint: ce135f07c74a419e9720b45e509d3be9. Sep 30 10:04:46.733991 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:04:46.733991 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Sep 30 10:04:46.733991 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Sep 30 10:04:46.733991 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Sep 30 10:04:46.733991 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._iter().one() Sep 30 10:04:46.733991 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Sep 30 10:04:46.733991 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._only_one_row( Sep 30 10:04:46.733991 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Sep 30 10:04:46.733991 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exc.NoResultFound( Sep 30 10:04:46.733991 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Sep 30 10:04:46.733991 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:04:46.733991 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:04:46.733991 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:04:46.733991 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:04:46.733991 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Sep 30 10:04:46.735224 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Sep 30 10:04:46.735224 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Sep 30 10:04:46.735224 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Sep 30 10:04:46.735224 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Sep 30 10:04:46.735224 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Sep 30 10:04:46.735224 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: ce135f07c74a419e9720b45e509d3be9. Sep 30 10:04:46.735224 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:04:46.735224 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:04:46.735224 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:04:46.735224 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:04:46.735224 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:04:46.735224 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:04:46.735224 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:04:46.735224 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:04:46.735224 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:04:46.735224 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:04:46.735224 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:04:46.737625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:04:46.737625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:04:46.737625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:04:46.737625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Sep 30 10:04:46.737625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Sep 30 10:04:46.737625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 10:04:46.737625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 10:04:46.737625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 10:04:46.737625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 10:04:46.737625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:04:46.737625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:04:46.737625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:04:46.737625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:04:46.737625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:04:46.737625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:04:46.737625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:04:46.738667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 10:04:46.738667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:04:46.738667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:04:46.738667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:04:46.738667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:04:46.738667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:04:46.738667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:04:46.738667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:04:46.738667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:04:46.738667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Sep 30 10:04:46.738667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Sep 30 10:04:46.738667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: ce135f07c74a419e9720b45e509d3be9. Sep 30 10:04:46.738667 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:04:46.741612 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2423/4853] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Sep 30 10:04:46 2022] DELETE /identity/v3/endpoints/ce135f07c74a419e9720b45e509d3be9 => generated 114 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:04:46.741909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43cd57-1f42-411c-bcb6-6ab9b1291bbd tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:46.768959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607780f-be54-4e8f-8ec6-65af1fc38366 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:46.775553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43cd57-1f42-411c-bcb6-6ab9b1291bbd tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:46.777607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe513dbf-b075-474c-bd63-9e9c6c678eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:46.778831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe513dbf-b075-474c-bd63-9e9c6c678eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:46.779343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe513dbf-b075-474c-bd63-9e9c6c678eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:46.779833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe513dbf-b075-474c-bd63-9e9c6c678eb6 admin admin] PATH_INFO: `/v3/users/6c5b006f2835499a9065b0909687bb49` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:46.781788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe513dbf-b075-474c-bd63-9e9c6c678eb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c5b006f2835499a9065b0909687bb49)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:46.786300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe513dbf-b075-474c-bd63-9e9c6c678eb6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:46.811535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d133460-0e69-4cee-8a5d-bb179de196c2 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:46.813414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d133460-0e69-4cee-8a5d-bb179de196c2 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:46.813732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d133460-0e69-4cee-8a5d-bb179de196c2 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:46.813960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d133460-0e69-4cee-8a5d-bb179de196c2 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/regions/tempest-region-906304427` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:46.815483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d133460-0e69-4cee-8a5d-bb179de196c2 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-906304427)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:46.820415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d133460-0e69-4cee-8a5d-bb179de196c2 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:46.841388 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:46.856571 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-3d133460-0e69-4cee-8a5d-bb179de196c2 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-906304427. To ensure interoperability, identifiers should be a valid uuid. Sep 30 10:04:46.856571 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 30 10:04:46.856571 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:04:46.888052 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2424/4854] 10.222.0.16 () {58 vars in 1206 bytes} [Fri Sep 30 10:04:46 2022] DELETE /identity/v3/regions/tempest-region-906304427 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:46.893155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fe513dbf-b075-474c-bd63-9e9c6c678eb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c5b006f2835499a9065b0909687bb49'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:46.894401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d133460-0e69-4cee-8a5d-bb179de196c2 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:46.895123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fe513dbf-b075-474c-bd63-9e9c6c678eb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c5b006f2835499a9065b0909687bb49'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:46.901874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3d133460-0e69-4cee-8a5d-bb179de196c2 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:46.927193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fe513dbf-b075-474c-bd63-9e9c6c678eb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c5b006f2835499a9065b0909687bb49'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:46.954380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fe513dbf-b075-474c-bd63-9e9c6c678eb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c5b006f2835499a9065b0909687bb49'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:46.959973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d133460-0e69-4cee-8a5d-bb179de196c2 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:46.966359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fe513dbf-b075-474c-bd63-9e9c6c678eb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c5b006f2835499a9065b0909687bb49'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:46.973166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e7916-532a-427c-a372-e2fc3928f69f tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:46.973800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e7916-532a-427c-a372-e2fc3928f69f tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:46.974088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e7916-532a-427c-a372-e2fc3928f69f tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:46.974363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e7916-532a-427c-a372-e2fc3928f69f tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:46.974997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e7916-532a-427c-a372-e2fc3928f69f tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:46.976589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e7916-532a-427c-a372-e2fc3928f69f tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:46.980165 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:46.984531 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2431/4855] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:04:46 2022] DELETE /identity/v3/users/6c5b006f2835499a9065b0909687bb49 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:04:46.986189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597dcda-5c84-49c9-b989-1ac563f7076e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:46.986545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597dcda-5c84-49c9-b989-1ac563f7076e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:46.986799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597dcda-5c84-49c9-b989-1ac563f7076e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:47.003982 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2425/4856] 10.222.0.16 () {58 vars in 1134 bytes} [Fri Sep 30 10:04:46 2022] GET /identity/v3/endpoints => generated 4047 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:47.007217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e7916-532a-427c-a372-e2fc3928f69f tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:47.019539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e7916-532a-427c-a372-e2fc3928f69f tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:47.052446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f597dcda-5c84-49c9-b989-1ac563f7076e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:47.055965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f597dcda-5c84-49c9-b989-1ac563f7076e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:47.151761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f672221-9573-4b62-957b-0a1e71cd0ab5 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:47.152916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f672221-9573-4b62-957b-0a1e71cd0ab5 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:47.155243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f672221-9573-4b62-957b-0a1e71cd0ab5 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:47.155669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f672221-9573-4b62-957b-0a1e71cd0ab5 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:47.157156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f672221-9573-4b62-957b-0a1e71cd0ab5 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Adding query filter params (service_id=c17097a91fdc4bddb4b3499c15d747dc) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:04:47.157586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f672221-9573-4b62-957b-0a1e71cd0ab5 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:47.159442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f672221-9573-4b62-957b-0a1e71cd0ab5 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:47.172070 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2426/4857] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Sep 30 10:04:47 2022] GET /identity/v3/endpoints?service_id=c17097a91fdc4bddb4b3499c15d747dc => generated 501 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:04:47.176157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f672221-9573-4b62-957b-0a1e71cd0ab5 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:47.204940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f672221-9573-4b62-957b-0a1e71cd0ab5 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:47.218315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d6403-c38a-4fc3-b564-53e327391532 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:47.218943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d6403-c38a-4fc3-b564-53e327391532 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:47.219382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d6403-c38a-4fc3-b564-53e327391532 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:47.219661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d6403-c38a-4fc3-b564-53e327391532 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:47.220316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d6403-c38a-4fc3-b564-53e327391532 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Adding query filter params (service_id=fa6f281f2d114bf69c72500eab19e647) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:04:47.220628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d6403-c38a-4fc3-b564-53e327391532 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:47.224374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d6403-c38a-4fc3-b564-53e327391532 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:47.241561 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2427/4858] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Sep 30 10:04:47 2022] GET /identity/v3/endpoints?service_id=fa6f281f2d114bf69c72500eab19e647 => generated 503 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:04:47.242428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d6403-c38a-4fc3-b564-53e327391532 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:47.247648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-532d6403-c38a-4fc3-b564-53e327391532 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:47.348401 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2432/4859] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:46 2022] POST /identity/v3/auth/tokens => generated 3868 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:47.349542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597dcda-5c84-49c9-b989-1ac563f7076e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:47.365793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d6403-c38a-4fc3-b564-53e327391532 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:47.367371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597dcda-5c84-49c9-b989-1ac563f7076e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:47.373371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd0f86-7fa1-40da-99fc-4814c355ab5b tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:47.374242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd0f86-7fa1-40da-99fc-4814c355ab5b tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:47.374757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd0f86-7fa1-40da-99fc-4814c355ab5b tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:47.375253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd0f86-7fa1-40da-99fc-4814c355ab5b tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:47.382197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2affa7-1099-4bad-a360-848bf2b16b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:47.384150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2affa7-1099-4bad-a360-848bf2b16b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:47.384429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2affa7-1099-4bad-a360-848bf2b16b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:47.385266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2affa7-1099-4bad-a360-848bf2b16b1e admin admin] PATH_INFO: `/v3/users/0e653b28181749d292ce144d4b717ab7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:47.389019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2affa7-1099-4bad-a360-848bf2b16b1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e653b28181749d292ce144d4b717ab7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:47.390523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd0f86-7fa1-40da-99fc-4814c355ab5b tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:04:47.392440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd0f86-7fa1-40da-99fc-4814c355ab5b tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:47.393548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2affa7-1099-4bad-a360-848bf2b16b1e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:47.396391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd0f86-7fa1-40da-99fc-4814c355ab5b tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:47.411386 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2433/4860] 10.222.0.16 () {58 vars in 1167 bytes} [Fri Sep 30 10:04:47 2022] GET /identity/v3/endpoints?interface=public => generated 3404 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:47.413464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd0f86-7fa1-40da-99fc-4814c355ab5b tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:47.415709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a5cd0f86-7fa1-40da-99fc-4814c355ab5b tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:47.522407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd0f86-7fa1-40da-99fc-4814c355ab5b tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:47.529051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46119bf-7b47-49f0-a998-b67eb5d40a57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:47.530042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46119bf-7b47-49f0-a998-b67eb5d40a57 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:47.530724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46119bf-7b47-49f0-a998-b67eb5d40a57 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:47.531210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46119bf-7b47-49f0-a998-b67eb5d40a57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:47.540978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2d2affa7-1099-4bad-a360-848bf2b16b1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e653b28181749d292ce144d4b717ab7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:47.545008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46119bf-7b47-49f0-a998-b67eb5d40a57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:47.546970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46119bf-7b47-49f0-a998-b67eb5d40a57 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:47.569283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2d2affa7-1099-4bad-a360-848bf2b16b1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e653b28181749d292ce144d4b717ab7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:47.570227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2d2affa7-1099-4bad-a360-848bf2b16b1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e653b28181749d292ce144d4b717ab7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:47.570456 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2434/4861] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:04:47 2022] GET /identity/v3/auth/tokens => generated 3868 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:04:47.572999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46119bf-7b47-49f0-a998-b67eb5d40a57 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:47.591001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46119bf-7b47-49f0-a998-b67eb5d40a57 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:47.601356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26df0e-e7ca-47ba-bd7c-d0febf367bee tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:47.602371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26df0e-e7ca-47ba-bd7c-d0febf367bee tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:47.604358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26df0e-e7ca-47ba-bd7c-d0febf367bee tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:47.605840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26df0e-e7ca-47ba-bd7c-d0febf367bee tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:47.606753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26df0e-e7ca-47ba-bd7c-d0febf367bee tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:04:47.607740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26df0e-e7ca-47ba-bd7c-d0febf367bee tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:47.610081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2d2affa7-1099-4bad-a360-848bf2b16b1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e653b28181749d292ce144d4b717ab7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:47.612403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26df0e-e7ca-47ba-bd7c-d0febf367bee tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:47.624874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2d2affa7-1099-4bad-a360-848bf2b16b1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e653b28181749d292ce144d4b717ab7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:47.635646 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2435/4862] 10.222.0.16 () {58 vars in 1171 bytes} [Fri Sep 30 10:04:47 2022] GET /identity/v3/endpoints?interface=internal => generated 478 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:04:47.638922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26df0e-e7ca-47ba-bd7c-d0febf367bee tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:47.642687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-db26df0e-e7ca-47ba-bd7c-d0febf367bee tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:47.649324 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2428/4863] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:04:47 2022] DELETE /identity/v3/users/0e653b28181749d292ce144d4b717ab7 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:47.661888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26df0e-e7ca-47ba-bd7c-d0febf367bee tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:47.682817 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:47.812892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519add3-56c4-4dbc-8aa6-de8bcebf1e06 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:47.814554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519add3-56c4-4dbc-8aa6-de8bcebf1e06 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:47.814939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519add3-56c4-4dbc-8aa6-de8bcebf1e06 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:47.819718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519add3-56c4-4dbc-8aa6-de8bcebf1e06 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:47.820999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519add3-56c4-4dbc-8aa6-de8bcebf1e06 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:47.824846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519add3-56c4-4dbc-8aa6-de8bcebf1e06 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:47.862883 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2436/4864] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:04:47 2022] POST /identity/v3/services => generated 290 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:47.867114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2affa7-1099-4bad-a360-848bf2b16b1e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:47.879250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2affa7-1099-4bad-a360-848bf2b16b1e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:47.886376 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:47.905143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9db86a-8110-464a-8e4d-7809c9412e2a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:47.905933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9db86a-8110-464a-8e4d-7809c9412e2a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:47.906314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9db86a-8110-464a-8e4d-7809c9412e2a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:47.906835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9db86a-8110-464a-8e4d-7809c9412e2a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:47.907619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9db86a-8110-464a-8e4d-7809c9412e2a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:47.909405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9db86a-8110-464a-8e4d-7809c9412e2a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:47.936156 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-9e9db86a-8110-464a-8e4d-7809c9412e2a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1271931030. To ensure interoperability, identifiers should be a valid uuid. Sep 30 10:04:47.936156 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 30 10:04:47.936156 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:04:47.977333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519add3-56c4-4dbc-8aa6-de8bcebf1e06 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:47.978183 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2429/4865] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Sep 30 10:04:47 2022] POST /identity/v3/endpoints => generated 360 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:47.995209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519add3-56c4-4dbc-8aa6-de8bcebf1e06 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:48.018407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058555fb-4d0d-4a34-98c3-528ef23d7397 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:48.018584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058555fb-4d0d-4a34-98c3-528ef23d7397 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:48.019545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058555fb-4d0d-4a34-98c3-528ef23d7397 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:48.019545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058555fb-4d0d-4a34-98c3-528ef23d7397 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/regions/tempest-region-1271931030` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:48.019807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058555fb-4d0d-4a34-98c3-528ef23d7397 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1271931030)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:48.021227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058555fb-4d0d-4a34-98c3-528ef23d7397 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:48.025431 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2437/4866] 10.222.0.16 () {58 vars in 1206 bytes} [Fri Sep 30 10:04:47 2022] GET /identity/v3/regions/tempest-region-1271931030 => generated 180 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:04:48.029458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9db86a-8110-464a-8e4d-7809c9412e2a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:48.040594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9db86a-8110-464a-8e4d-7809c9412e2a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:48.062926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559ab5e-ca94-4880-a8d4-f04801d8af45 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:48.064482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559ab5e-ca94-4880-a8d4-f04801d8af45 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:48.064771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559ab5e-ca94-4880-a8d4-f04801d8af45 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:48.065046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559ab5e-ca94-4880-a8d4-f04801d8af45 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/endpoints/cc843a6a749548edbbbd22e61cfa7de8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:48.078347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559ab5e-ca94-4880-a8d4-f04801d8af45 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=cc843a6a749548edbbbd22e61cfa7de8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:48.085419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559ab5e-ca94-4880-a8d4-f04801d8af45 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:48.140399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058555fb-4d0d-4a34-98c3-528ef23d7397 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:48.146252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-058555fb-4d0d-4a34-98c3-528ef23d7397 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:48.172175 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-4559ab5e-ca94-4880-a8d4-f04801d8af45 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-730579726. To ensure interoperability, identifiers should be a valid uuid. Sep 30 10:04:48.172175 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 30 10:04:48.172175 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:04:48.270608 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2430/4867] 10.222.0.16 () {60 vars in 1256 bytes} [Fri Sep 30 10:04:48 2022] PATCH /identity/v3/endpoints/cc843a6a749548edbbbd22e61cfa7de8 => generated 362 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:04:48.275920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559ab5e-ca94-4880-a8d4-f04801d8af45 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:48.348802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559ab5e-ca94-4880-a8d4-f04801d8af45 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:48.365292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b95119-8c17-49f1-8bef-a423d33366c6 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:48.366082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b95119-8c17-49f1-8bef-a423d33366c6 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:48.366653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b95119-8c17-49f1-8bef-a423d33366c6 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:48.366653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b95119-8c17-49f1-8bef-a423d33366c6 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/regions/tempest-region-730579726` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:48.367333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b95119-8c17-49f1-8bef-a423d33366c6 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-730579726)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:48.368414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b95119-8c17-49f1-8bef-a423d33366c6 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:48.374065 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2431/4868] 10.222.0.16 () {58 vars in 1203 bytes} [Fri Sep 30 10:04:48 2022] GET /identity/v3/regions/tempest-region-730579726 => generated 178 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:04:48.375278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b95119-8c17-49f1-8bef-a423d33366c6 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:48.375937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058555fb-4d0d-4a34-98c3-528ef23d7397 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:48.395765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b95119-8c17-49f1-8bef-a423d33366c6 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:48.409150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e64cb5-c20a-4cf1-96fe-9f18f699c3bb tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:48.409419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e64cb5-c20a-4cf1-96fe-9f18f699c3bb tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:48.409705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e64cb5-c20a-4cf1-96fe-9f18f699c3bb tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:48.409984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e64cb5-c20a-4cf1-96fe-9f18f699c3bb tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/endpoints/cc843a6a749548edbbbd22e61cfa7de8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:48.412373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e657981-f85c-4d57-a8d9-442180698b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:48.414261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e657981-f85c-4d57-a8d9-442180698b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:48.414644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e657981-f85c-4d57-a8d9-442180698b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:48.415012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e657981-f85c-4d57-a8d9-442180698b8f admin admin] PATH_INFO: `/v3/projects/5adff8f1065b442c950d5769a974e71a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:48.417328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e657981-f85c-4d57-a8d9-442180698b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5adff8f1065b442c950d5769a974e71a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:48.419434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e657981-f85c-4d57-a8d9-442180698b8f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:48.432756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e64cb5-c20a-4cf1-96fe-9f18f699c3bb tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=cc843a6a749548edbbbd22e61cfa7de8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:48.435609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e64cb5-c20a-4cf1-96fe-9f18f699c3bb tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:48.460851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a7e64cb5-c20a-4cf1-96fe-9f18f699c3bb tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'cc843a6a749548edbbbd22e61cfa7de8', 'request_id': 'req-a7e64cb5-c20a-4cf1-96fe-9f18f699c3bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:48.493341 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2432/4869] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Sep 30 10:04:48 2022] DELETE /identity/v3/endpoints/cc843a6a749548edbbbd22e61cfa7de8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:04:48.497804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e64cb5-c20a-4cf1-96fe-9f18f699c3bb tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:48.549800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9e657981-f85c-4d57-a8d9-442180698b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5adff8f1065b442c950d5769a974e71a', 'request_id': 'req-9e657981-f85c-4d57-a8d9-442180698b8f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:48.552178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e64cb5-c20a-4cf1-96fe-9f18f699c3bb tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:48.589392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9e657981-f85c-4d57-a8d9-442180698b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5adff8f1065b442c950d5769a974e71a', 'request_id': 'req-9e657981-f85c-4d57-a8d9-442180698b8f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:48.616774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9e657981-f85c-4d57-a8d9-442180698b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5adff8f1065b442c950d5769a974e71a', 'request_id': 'req-9e657981-f85c-4d57-a8d9-442180698b8f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:48.655546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9e657981-f85c-4d57-a8d9-442180698b8f admin admin] The token cache is being invalidate because project 5adff8f1065b442c950d5769a974e71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:04:48.657035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9e657981-f85c-4d57-a8d9-442180698b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:48.677992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9e657981-f85c-4d57-a8d9-442180698b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:48.677992 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2438/4870] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:04:48 2022] DELETE /identity/v3/projects/5adff8f1065b442c950d5769a974e71a => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:48.677992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e657981-f85c-4d57-a8d9-442180698b8f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:48.685260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9e657981-f85c-4d57-a8d9-442180698b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:48.696091 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:48.711072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7000e6-2a09-4cd3-b893-9ec1a1992a17 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:48.711820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7000e6-2a09-4cd3-b893-9ec1a1992a17 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:48.712102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7000e6-2a09-4cd3-b893-9ec1a1992a17 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:48.712378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7000e6-2a09-4cd3-b893-9ec1a1992a17 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/regions/tempest-region-730579726` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:48.713776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7000e6-2a09-4cd3-b893-9ec1a1992a17 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-730579726)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:48.715495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7000e6-2a09-4cd3-b893-9ec1a1992a17 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:48.753609 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2433/4871] 10.222.0.16 () {58 vars in 1206 bytes} [Fri Sep 30 10:04:48 2022] DELETE /identity/v3/regions/tempest-region-730579726 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:04:48.754969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce1e52-49dd-41ce-9142-fae7999ddcd8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:48.755311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce1e52-49dd-41ce-9142-fae7999ddcd8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:48.755665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce1e52-49dd-41ce-9142-fae7999ddcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:48.785769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e657981-f85c-4d57-a8d9-442180698b8f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:48.786368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a8ce1e52-49dd-41ce-9142-fae7999ddcd8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:48.790102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a8ce1e52-49dd-41ce-9142-fae7999ddcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:48.827970 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:48.837941 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2434/4872] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:48 2022] POST /identity/v3/auth/tokens => generated 4002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:48.840424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6b6af-2868-4760-81d0-7ee6ee5ccdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:48.841132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6b6af-2868-4760-81d0-7ee6ee5ccdd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:48.841414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6b6af-2868-4760-81d0-7ee6ee5ccdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:48.841689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6b6af-2868-4760-81d0-7ee6ee5ccdd7 admin admin] PATH_INFO: `/v3/projects/9d28561f1ac44f969d2af8dfc01a663a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:48.843090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce1e52-49dd-41ce-9142-fae7999ddcd8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:48.844695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6b6af-2868-4760-81d0-7ee6ee5ccdd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d28561f1ac44f969d2af8dfc01a663a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:48.851015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6b6af-2868-4760-81d0-7ee6ee5ccdd7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:48.853892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a8ce1e52-49dd-41ce-9142-fae7999ddcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:48.923915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce1e52-49dd-41ce-9142-fae7999ddcd8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:48.946688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3013b7-bf44-40c4-9e60-60d6213125eb tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:48.949125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3013b7-bf44-40c4-9e60-60d6213125eb tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:48.949414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3013b7-bf44-40c4-9e60-60d6213125eb tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:48.949761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3013b7-bf44-40c4-9e60-60d6213125eb tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/regions/tempest-region-1271931030` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:48.951190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3013b7-bf44-40c4-9e60-60d6213125eb tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1271931030)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:48.958089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3013b7-bf44-40c4-9e60-60d6213125eb tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:48.982184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-68a6b6af-2868-4760-81d0-7ee6ee5ccdd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d28561f1ac44f969d2af8dfc01a663a', 'request_id': 'req-68a6b6af-2868-4760-81d0-7ee6ee5ccdd7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:48.995109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-68a6b6af-2868-4760-81d0-7ee6ee5ccdd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d28561f1ac44f969d2af8dfc01a663a', 'request_id': 'req-68a6b6af-2868-4760-81d0-7ee6ee5ccdd7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:49.005032 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2435/4873] 10.222.0.16 () {58 vars in 1209 bytes} [Fri Sep 30 10:04:48 2022] DELETE /identity/v3/regions/tempest-region-1271931030 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:49.006546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34a818-510e-4872-b13c-d24b47615fa4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:49.007029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34a818-510e-4872-b13c-d24b47615fa4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:49.007161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34a818-510e-4872-b13c-d24b47615fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:49.009078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-68a6b6af-2868-4760-81d0-7ee6ee5ccdd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d28561f1ac44f969d2af8dfc01a663a', 'request_id': 'req-68a6b6af-2868-4760-81d0-7ee6ee5ccdd7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:49.049047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-68a6b6af-2868-4760-81d0-7ee6ee5ccdd7 admin admin] The token cache is being invalidate because project 9d28561f1ac44f969d2af8dfc01a663a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:04:49.049336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-68a6b6af-2868-4760-81d0-7ee6ee5ccdd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:49.050027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-68a6b6af-2868-4760-81d0-7ee6ee5ccdd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:49.055960 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2439/4874] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:04:48 2022] DELETE /identity/v3/projects/9d28561f1ac44f969d2af8dfc01a663a => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:49.056229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3a34a818-510e-4872-b13c-d24b47615fa4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:49.056334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6b6af-2868-4760-81d0-7ee6ee5ccdd7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:49.057410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3a34a818-510e-4872-b13c-d24b47615fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:49.058606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-68a6b6af-2868-4760-81d0-7ee6ee5ccdd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:49.211955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6b6af-2868-4760-81d0-7ee6ee5ccdd7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:49.261529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147a1df-0dd8-4f8d-9c35-851d359b86c5 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:49.264121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147a1df-0dd8-4f8d-9c35-851d359b86c5 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:49.264688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147a1df-0dd8-4f8d-9c35-851d359b86c5 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:49.265862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147a1df-0dd8-4f8d-9c35-851d359b86c5 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/services/b8cbc9f498f6430e8a29ea7dd01cdb2c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:49.267530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147a1df-0dd8-4f8d-9c35-851d359b86c5 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b8cbc9f498f6430e8a29ea7dd01cdb2c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:49.271110 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-2147a1df-0dd8-4f8d-9c35-851d359b86c5 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:04:49.271110 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:04:49.271110 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:04:49.272873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147a1df-0dd8-4f8d-9c35-851d359b86c5 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:49.308831 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2436/4875] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:49 2022] POST /identity/v3/auth/tokens => generated 4002 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:49.319188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ce69c-0eb2-4889-9e10-8f1d581de9bf None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:49.319528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ce69c-0eb2-4889-9e10-8f1d581de9bf None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:49.321481 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:49.321892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ce69c-0eb2-4889-9e10-8f1d581de9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:49.339196 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2440/4876] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:04:49 2022] DELETE /identity/v3/services/b8cbc9f498f6430e8a29ea7dd01cdb2c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:49.353960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147a1df-0dd8-4f8d-9c35-851d359b86c5 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:49.382316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fa2ce69c-0eb2-4889-9e10-8f1d581de9bf None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:49.386980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fa2ce69c-0eb2-4889-9e10-8f1d581de9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:49.390804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147a1df-0dd8-4f8d-9c35-851d359b86c5 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:49.400946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed64627-1f45-4cbb-928a-07d5cd4ab728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:49.401707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed64627-1f45-4cbb-928a-07d5cd4ab728 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:49.402078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed64627-1f45-4cbb-928a-07d5cd4ab728 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:49.402733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed64627-1f45-4cbb-928a-07d5cd4ab728 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:49.403835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed64627-1f45-4cbb-928a-07d5cd4ab728 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:04:49.404233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed64627-1f45-4cbb-928a-07d5cd4ab728 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:49.406126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed64627-1f45-4cbb-928a-07d5cd4ab728 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:49.407557 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2437/4877] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:49 2022] POST /identity/v3/auth/tokens => generated 3868 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:49.415677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ce69c-0eb2-4889-9e10-8f1d581de9bf None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:49.421539 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2441/4878] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:04:49.424211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6f8c0-735d-4c6d-8397-c0eede94630f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:49.424592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6f8c0-735d-4c6d-8397-c0eede94630f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:49.425355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6f8c0-735d-4c6d-8397-c0eede94630f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:49.455728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ce69c-0eb2-4889-9e10-8f1d581de9bf None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:49.458816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e6a6f8c0-735d-4c6d-8397-c0eede94630f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:49.460566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e6a6f8c0-735d-4c6d-8397-c0eede94630f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:49.462362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a107b8-dc07-4445-838c-dce63e5721ff tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:49.463144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a107b8-dc07-4445-838c-dce63e5721ff tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:49.463522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a107b8-dc07-4445-838c-dce63e5721ff tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:49.463822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a107b8-dc07-4445-838c-dce63e5721ff tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/endpoints/2ec8fc7b71d9415d886aa538c824f9f9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:49.471347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a107b8-dc07-4445-838c-dce63e5721ff tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=2ec8fc7b71d9415d886aa538c824f9f9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:49.473194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a107b8-dc07-4445-838c-dce63e5721ff tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:49.474495 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2442/4879] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:49 2022] POST /identity/v3/auth/tokens => generated 3868 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:49.475991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6f8c0-735d-4c6d-8397-c0eede94630f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:49.488961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-08a107b8-dc07-4445-838c-dce63e5721ff tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '2ec8fc7b71d9415d886aa538c824f9f9', 'request_id': 'req-08a107b8-dc07-4445-838c-dce63e5721ff'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:49.490801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6f8c0-735d-4c6d-8397-c0eede94630f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:49.497798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2caaf61-7aa5-419e-a549-5b60d29f1247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:49.498413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2caaf61-7aa5-419e-a549-5b60d29f1247 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:49.498686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2caaf61-7aa5-419e-a549-5b60d29f1247 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:49.498953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2caaf61-7aa5-419e-a549-5b60d29f1247 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:49.499583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2caaf61-7aa5-419e-a549-5b60d29f1247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:49.502205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2caaf61-7aa5-419e-a549-5b60d29f1247 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:49.506709 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2438/4880] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Sep 30 10:04:49 2022] DELETE /identity/v3/endpoints/2ec8fc7b71d9415d886aa538c824f9f9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:49.507743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a107b8-dc07-4445-838c-dce63e5721ff tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:49.537616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a107b8-dc07-4445-838c-dce63e5721ff tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:49.544392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02bbfb-3933-4777-bc3d-47d7719e8832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:49.545757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02bbfb-3933-4777-bc3d-47d7719e8832 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:49.546153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02bbfb-3933-4777-bc3d-47d7719e8832 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:49.546550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02bbfb-3933-4777-bc3d-47d7719e8832 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:49.547804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02bbfb-3933-4777-bc3d-47d7719e8832 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:04:49.548347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02bbfb-3933-4777-bc3d-47d7719e8832 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:49.550627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02bbfb-3933-4777-bc3d-47d7719e8832 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:49.557476 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2443/4881] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:04:49 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:49.558410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2caaf61-7aa5-419e-a549-5b60d29f1247 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:49.573902 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2439/4882] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:04:49.574653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02bbfb-3933-4777-bc3d-47d7719e8832 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:49.593373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02bbfb-3933-4777-bc3d-47d7719e8832 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:49.660340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2caaf61-7aa5-419e-a549-5b60d29f1247 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:49.686487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74985a0d-7837-473e-913f-713349ccdaa2 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:49.687205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74985a0d-7837-473e-913f-713349ccdaa2 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:49.687486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74985a0d-7837-473e-913f-713349ccdaa2 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:49.687789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74985a0d-7837-473e-913f-713349ccdaa2 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/regions/tempest-region-650639828` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:49.688375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74985a0d-7837-473e-913f-713349ccdaa2 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-650639828)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:49.690903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74985a0d-7837-473e-913f-713349ccdaa2 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:49.706181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59384a22-bcaf-4a9f-bce4-ed1f43738a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:49.706867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59384a22-bcaf-4a9f-bce4-ed1f43738a75 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:49.707140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59384a22-bcaf-4a9f-bce4-ed1f43738a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:49.707498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59384a22-bcaf-4a9f-bce4-ed1f43738a75 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:49.708409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59384a22-bcaf-4a9f-bce4-ed1f43738a75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:49.711401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59384a22-bcaf-4a9f-bce4-ed1f43738a75 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:49.723079 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:49.764112 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2440/4883] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:04:49 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:49.764936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59384a22-bcaf-4a9f-bce4-ed1f43738a75 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:49.781227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59384a22-bcaf-4a9f-bce4-ed1f43738a75 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:49.787047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3851a6e-13b9-4ae1-a4dc-cf354bdeeffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:49.788232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3851a6e-13b9-4ae1-a4dc-cf354bdeeffa admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:49.788789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3851a6e-13b9-4ae1-a4dc-cf354bdeeffa admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:49.789289 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2444/4884] 10.222.0.16 () {58 vars in 1206 bytes} [Fri Sep 30 10:04:49 2022] DELETE /identity/v3/regions/tempest-region-650639828 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:49.790213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74985a0d-7837-473e-913f-713349ccdaa2 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:49.790613 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3851a6e-13b9-4ae1-a4dc-cf354bdeeffa admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:49.792117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3851a6e-13b9-4ae1-a4dc-cf354bdeeffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:49.794648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3851a6e-13b9-4ae1-a4dc-cf354bdeeffa admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:49.834214 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2441/4885] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:04:49 2022] POST /identity/v3/projects => generated 381 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:49.835572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3851a6e-13b9-4ae1-a4dc-cf354bdeeffa admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:49.855424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74985a0d-7837-473e-913f-713349ccdaa2 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:49.966958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3851a6e-13b9-4ae1-a4dc-cf354bdeeffa admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:49.978961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951a444-d2aa-47d8-90ca-4324459b2680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:49.979826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951a444-d2aa-47d8-90ca-4324459b2680 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:49.980202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951a444-d2aa-47d8-90ca-4324459b2680 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:49.980568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951a444-d2aa-47d8-90ca-4324459b2680 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:49.981443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951a444-d2aa-47d8-90ca-4324459b2680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:49.983927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951a444-d2aa-47d8-90ca-4324459b2680 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:49.989301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2ceab-c261-437d-bdae-b1e4aa867f1d tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:49.990268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2ceab-c261-437d-bdae-b1e4aa867f1d tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:49.991378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2ceab-c261-437d-bdae-b1e4aa867f1d tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:49.992013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2ceab-c261-437d-bdae-b1e4aa867f1d tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/services/fa6f281f2d114bf69c72500eab19e647` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:49.993017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2ceab-c261-437d-bdae-b1e4aa867f1d tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:delete_service(service_id=fa6f281f2d114bf69c72500eab19e647)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:49.995603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2ceab-c261-437d-bdae-b1e4aa867f1d tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:49.998620 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2445/4886] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:49.999602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951a444-d2aa-47d8-90ca-4324459b2680 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:50.015075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951a444-d2aa-47d8-90ca-4324459b2680 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:50.021403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4862095-ab28-4cf6-bd7b-0474cf19920c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:50.022257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4862095-ab28-4cf6-bd7b-0474cf19920c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:50.023207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4862095-ab28-4cf6-bd7b-0474cf19920c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:50.023207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4862095-ab28-4cf6-bd7b-0474cf19920c admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:50.023656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4862095-ab28-4cf6-bd7b-0474cf19920c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:50.027271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4862095-ab28-4cf6-bd7b-0474cf19920c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:50.041862 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:50.043468 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2442/4887] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:04:49 2022] DELETE /identity/v3/services/fa6f281f2d114bf69c72500eab19e647 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:50.045930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2ceab-c261-437d-bdae-b1e4aa867f1d tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:50.067946 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2446/4888] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:04:49 2022] POST /identity/v3/users => generated 291 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:50.069841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4862095-ab28-4cf6-bd7b-0474cf19920c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:50.086392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2ceab-c261-437d-bdae-b1e4aa867f1d tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:50.087135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4862095-ab28-4cf6-bd7b-0474cf19920c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:50.093167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40caf078-d58a-409a-9e05-2335b230c3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:50.094369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40caf078-d58a-409a-9e05-2335b230c3bb admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:50.094863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40caf078-d58a-409a-9e05-2335b230c3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:50.095369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40caf078-d58a-409a-9e05-2335b230c3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:50.096404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40caf078-d58a-409a-9e05-2335b230c3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:50.098393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40caf078-d58a-409a-9e05-2335b230c3bb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:50.109361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd2a9a-ad7d-497d-a5db-1737f7a05f23 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:50.110161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd2a9a-ad7d-497d-a5db-1737f7a05f23 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:50.110471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd2a9a-ad7d-497d-a5db-1737f7a05f23 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:50.110751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd2a9a-ad7d-497d-a5db-1737f7a05f23 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/endpoints/6391f37a148746a5b1c953434170f5fb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:50.117490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd2a9a-ad7d-497d-a5db-1737f7a05f23 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=6391f37a148746a5b1c953434170f5fb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:50.119461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd2a9a-ad7d-497d-a5db-1737f7a05f23 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:50.127586 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2443/4889] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:50.129028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40caf078-d58a-409a-9e05-2335b230c3bb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:50.133005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-96cd2a9a-ad7d-497d-a5db-1737f7a05f23 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '6391f37a148746a5b1c953434170f5fb', 'request_id': 'req-96cd2a9a-ad7d-497d-a5db-1737f7a05f23'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:50.147252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40caf078-d58a-409a-9e05-2335b230c3bb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:50.148814 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2447/4890] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Sep 30 10:04:50 2022] DELETE /identity/v3/endpoints/6391f37a148746a5b1c953434170f5fb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:50.149687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd2a9a-ad7d-497d-a5db-1737f7a05f23 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:50.170524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23eb05e-30f1-426a-82fb-2bba5ca07880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:50.171829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23eb05e-30f1-426a-82fb-2bba5ca07880 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:50.173030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23eb05e-30f1-426a-82fb-2bba5ca07880 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:50.173523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23eb05e-30f1-426a-82fb-2bba5ca07880 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:50.174525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23eb05e-30f1-426a-82fb-2bba5ca07880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:50.177390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23eb05e-30f1-426a-82fb-2bba5ca07880 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:50.177679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd2a9a-ad7d-497d-a5db-1737f7a05f23 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:50.183105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd05c0-3678-477b-97f0-287c0ebf092e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:50.183798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd05c0-3678-477b-97f0-287c0ebf092e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:50.184077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd05c0-3678-477b-97f0-287c0ebf092e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:50.184360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd05c0-3678-477b-97f0-287c0ebf092e admin admin] PATH_INFO: `/v3/projects/f7294d19b2614d33af05296054604114/users/338cdde0b28b4f69b5e29ea4b7f670a9/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:50.194717 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2444/4891] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:50.198035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23eb05e-30f1-426a-82fb-2bba5ca07880 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:50.202402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd05c0-3678-477b-97f0-287c0ebf092e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7294d19b2614d33af05296054604114, user_id=338cdde0b28b4f69b5e29ea4b7f670a9, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:50.205427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd05c0-3678-477b-97f0-287c0ebf092e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:50.226765 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2448/4892] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:04:50 2022] PUT /identity/v3/projects/f7294d19b2614d33af05296054604114/users/338cdde0b28b4f69b5e29ea4b7f670a9/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:50.227928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd05c0-3678-477b-97f0-287c0ebf092e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:50.235540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23eb05e-30f1-426a-82fb-2bba5ca07880 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:50.323343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd05c0-3678-477b-97f0-287c0ebf092e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:50.331567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1467c-7ff4-454d-ad2e-031443c0281a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:50.332393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1467c-7ff4-454d-ad2e-031443c0281a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:50.332953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1467c-7ff4-454d-ad2e-031443c0281a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:50.333281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1467c-7ff4-454d-ad2e-031443c0281a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:50.333936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1467c-7ff4-454d-ad2e-031443c0281a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:50.350160 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=4,keystone:SELECT=94,keystone:DELETE=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:50.354023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1467c-7ff4-454d-ad2e-031443c0281a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:50.362096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c7e31-06c4-49c4-8203-43b79e4924d7 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:50.364271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c7e31-06c4-49c4-8203-43b79e4924d7 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:50.366692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c7e31-06c4-49c4-8203-43b79e4924d7 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:50.367384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c7e31-06c4-49c4-8203-43b79e4924d7 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/regions/tempest-region-1804247442` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:50.368359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c7e31-06c4-49c4-8203-43b79e4924d7 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1804247442)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:50.376310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c7e31-06c4-49c4-8203-43b79e4924d7 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:50.391516 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2449/4893] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:50.394900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2ba77-c85e-46aa-bb82-9f7d3ed221a0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:50.395395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2ba77-c85e-46aa-bb82-9f7d3ed221a0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:50.396281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2ba77-c85e-46aa-bb82-9f7d3ed221a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:50.408541 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2445/4894] 10.222.0.16 () {58 vars in 1209 bytes} [Fri Sep 30 10:04:50 2022] DELETE /identity/v3/regions/tempest-region-1804247442 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:50.409664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c7e31-06c4-49c4-8203-43b79e4924d7 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:50.450446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c7e31-06c4-49c4-8203-43b79e4924d7 tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:50.457503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27a564-1d86-4500-9b45-d9c402f5e4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:50.468908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27a564-1d86-4500-9b45-d9c402f5e4bb admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:50.468908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27a564-1d86-4500-9b45-d9c402f5e4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:50.468908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27a564-1d86-4500-9b45-d9c402f5e4bb admin admin] PATH_INFO: `/v3/projects/56d748b6461c458dae0901effae442bc/users/03fa24587e544118bfe537a85d2f113e/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:50.502386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2ab2ba77-c85e-46aa-bb82-9f7d3ed221a0 None None] MFA Rules not processed for user `338cdde0b28b4f69b5e29ea4b7f670a9`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:50.505820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2ab2ba77-c85e-46aa-bb82-9f7d3ed221a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:50.523567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27a564-1d86-4500-9b45-d9c402f5e4bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d748b6461c458dae0901effae442bc, user_id=03fa24587e544118bfe537a85d2f113e, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:50.532517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27a564-1d86-4500-9b45-d9c402f5e4bb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:50.567459 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2446/4895] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:04:50 2022] PUT /identity/v3/projects/56d748b6461c458dae0901effae442bc/users/03fa24587e544118bfe537a85d2f113e/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:50.568368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27a564-1d86-4500-9b45-d9c402f5e4bb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:50.670924 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2450/4896] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:50 2022] POST /identity/v3/auth/tokens => generated 3385 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:50.682480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced6012-4207-41b2-ab87-b549e2142cb7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:50.683211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced6012-4207-41b2-ab87-b549e2142cb7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:50.683738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced6012-4207-41b2-ab87-b549e2142cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:50.753535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1ced6012-4207-41b2-ab87-b549e2142cb7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:50.754855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1ced6012-4207-41b2-ab87-b549e2142cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:50.771907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27a564-1d86-4500-9b45-d9c402f5e4bb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:50.777832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1abfca-c3ef-4957-b9eb-f07b2b4da14a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6bda519420419ab90c53b9858b5f9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8d527a123d943eb83ac85247e6330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:50.779382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1abfca-c3ef-4957-b9eb-f07b2b4da14a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:50.779751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1abfca-c3ef-4957-b9eb-f07b2b4da14a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:50.780096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1abfca-c3ef-4957-b9eb-f07b2b4da14a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] PATH_INFO: `/v3/services/c17097a91fdc4bddb4b3499c15d747dc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:50.780818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1abfca-c3ef-4957-b9eb-f07b2b4da14a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c17097a91fdc4bddb4b3499c15d747dc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:50.782741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1abfca-c3ef-4957-b9eb-f07b2b4da14a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:50.793238 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:50.828641 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2447/4897] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:04:50 2022] DELETE /identity/v3/services/c17097a91fdc4bddb4b3499c15d747dc => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:50.829658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1abfca-c3ef-4957-b9eb-f07b2b4da14a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:50.831959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4b1abfca-c3ef-4957-b9eb-f07b2b4da14a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:50.925553 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2451/4898] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:50.926121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced6012-4207-41b2-ab87-b549e2142cb7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:50.928989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1ced6012-4207-41b2-ab87-b549e2142cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:50.949772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1abfca-c3ef-4957-b9eb-f07b2b4da14a tempest-EndPointsTestJSON-162221614 tempest-EndPointsTestJSON-162221614-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:50.956191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceff1bf-905f-451b-8fc4-13dedf6e716a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:50.957081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceff1bf-905f-451b-8fc4-13dedf6e716a service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:50.957484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceff1bf-905f-451b-8fc4-13dedf6e716a service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:50.958087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceff1bf-905f-451b-8fc4-13dedf6e716a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:50.959637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced6012-4207-41b2-ab87-b549e2142cb7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:50.973435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf04181-fb21-41b0-9c10-d7808a10fd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:50.974088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf04181-fb21-41b0-9c10-d7808a10fd94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:50.974470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf04181-fb21-41b0-9c10-d7808a10fd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:50.974747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf04181-fb21-41b0-9c10-d7808a10fd94 admin admin] PATH_INFO: `/v3/users/8ebbd74ac2d4476c9440779a14e25293` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:50.976115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf04181-fb21-41b0-9c10-d7808a10fd94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ebbd74ac2d4476c9440779a14e25293)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:50.978091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf04181-fb21-41b0-9c10-d7808a10fd94 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:50.990263 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:51.047543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceff1bf-905f-451b-8fc4-13dedf6e716a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:51.049456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceff1bf-905f-451b-8fc4-13dedf6e716a service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:51.049783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fcf04181-fb21-41b0-9c10-d7808a10fd94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ebbd74ac2d4476c9440779a14e25293'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:51.050556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fcf04181-fb21-41b0-9c10-d7808a10fd94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ebbd74ac2d4476c9440779a14e25293'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:51.062310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fcf04181-fb21-41b0-9c10-d7808a10fd94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ebbd74ac2d4476c9440779a14e25293'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:51.085094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fcf04181-fb21-41b0-9c10-d7808a10fd94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ebbd74ac2d4476c9440779a14e25293'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:51.090918 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2448/4899] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:04:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:04:51.091879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceff1bf-905f-451b-8fc4-13dedf6e716a service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:51.116821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fcf04181-fb21-41b0-9c10-d7808a10fd94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ebbd74ac2d4476c9440779a14e25293'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:51.129102 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2452/4900] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:04:50 2022] DELETE /identity/v3/users/8ebbd74ac2d4476c9440779a14e25293 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:51.134312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16b53d-26b4-4aa7-8eab-3b81d062c5ab None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:51.134312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16b53d-26b4-4aa7-8eab-3b81d062c5ab None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:51.134652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16b53d-26b4-4aa7-8eab-3b81d062c5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:51.148977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceff1bf-905f-451b-8fc4-13dedf6e716a service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:51.156341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bf16b53d-26b4-4aa7-8eab-3b81d062c5ab None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:51.157670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bf16b53d-26b4-4aa7-8eab-3b81d062c5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:51.246522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a640a7-6561-4ced-a9d2-1deab898c3f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:51.247158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a640a7-6561-4ced-a9d2-1deab898c3f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:51.247437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a640a7-6561-4ced-a9d2-1deab898c3f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:51.247710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a640a7-6561-4ced-a9d2-1deab898c3f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:51.250053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d0a640a7-6561-4ced-a9d2-1deab898c3f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:51.321786 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2453/4901] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:04:51.391329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16b53d-26b4-4aa7-8eab-3b81d062c5ab None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:51.393072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bf16b53d-26b4-4aa7-8eab-3b81d062c5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:51.402421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a640a7-6561-4ced-a9d2-1deab898c3f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:51.404502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a640a7-6561-4ced-a9d2-1deab898c3f6 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:51.417023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16b53d-26b4-4aa7-8eab-3b81d062c5ab None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:51.431907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09e1e0-afe7-42ef-8acd-e84ade2ef942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:51.433017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09e1e0-afe7-42ef-8acd-e84ade2ef942 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:51.433533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09e1e0-afe7-42ef-8acd-e84ade2ef942 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:51.435185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09e1e0-afe7-42ef-8acd-e84ade2ef942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:51.447853 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2449/4902] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:04:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:04:51.457992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09e1e0-afe7-42ef-8acd-e84ade2ef942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:51.460181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09e1e0-afe7-42ef-8acd-e84ade2ef942 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:51.480170 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2454/4903] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:04:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:04:52.866526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a640a7-6561-4ced-a9d2-1deab898c3f6 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:52.867631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d0a640a7-6561-4ced-a9d2-1deab898c3f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:52.889658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a640a7-6561-4ced-a9d2-1deab898c3f6 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:52.894923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6abc71-484c-497c-9674-328d3764d3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:52.895567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6abc71-484c-497c-9674-328d3764d3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:52.895843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6abc71-484c-497c-9674-328d3764d3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:52.896185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6abc71-484c-497c-9674-328d3764d3ba admin admin] PATH_INFO: `/v3/projects/4d5eeab6f54149399b13a1934d770a7c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:52.897358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6abc71-484c-497c-9674-328d3764d3ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d5eeab6f54149399b13a1934d770a7c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:52.899443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6abc71-484c-497c-9674-328d3764d3ba admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:52.976190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd6abc71-484c-497c-9674-328d3764d3ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d5eeab6f54149399b13a1934d770a7c', 'request_id': 'req-fd6abc71-484c-497c-9674-328d3764d3ba'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:52.991837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09e1e0-afe7-42ef-8acd-e84ade2ef942 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:52.994601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ef09e1e0-afe7-42ef-8acd-e84ade2ef942 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:52.994800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd6abc71-484c-497c-9674-328d3764d3ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d5eeab6f54149399b13a1934d770a7c', 'request_id': 'req-fd6abc71-484c-497c-9674-328d3764d3ba'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:53.007482 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:53.013728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd6abc71-484c-497c-9674-328d3764d3ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d5eeab6f54149399b13a1934d770a7c', 'request_id': 'req-fd6abc71-484c-497c-9674-328d3764d3ba'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:53.016452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09e1e0-afe7-42ef-8acd-e84ade2ef942 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:53.021580 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:53.060984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd6abc71-484c-497c-9674-328d3764d3ba admin admin] The token cache is being invalidate because project 4d5eeab6f54149399b13a1934d770a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:04:53.061686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd6abc71-484c-497c-9674-328d3764d3ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:53.066832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd6abc71-484c-497c-9674-328d3764d3ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:53.074503 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2450/4904] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:04:52 2022] DELETE /identity/v3/projects/4d5eeab6f54149399b13a1934d770a7c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:53.076155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6abc71-484c-497c-9674-328d3764d3ba admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:53.078626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fd6abc71-484c-497c-9674-328d3764d3ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:53.114319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf78033-6e0d-41a1-a12b-43c83e2b1106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:53.114800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf78033-6e0d-41a1-a12b-43c83e2b1106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:53.115079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf78033-6e0d-41a1-a12b-43c83e2b1106 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:53.115351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf78033-6e0d-41a1-a12b-43c83e2b1106 admin admin] PATH_INFO: `/v3/users/338cdde0b28b4f69b5e29ea4b7f670a9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:53.116509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf78033-6e0d-41a1-a12b-43c83e2b1106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=338cdde0b28b4f69b5e29ea4b7f670a9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:53.118522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf78033-6e0d-41a1-a12b-43c83e2b1106 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:53.180295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cbf78033-6e0d-41a1-a12b-43c83e2b1106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '338cdde0b28b4f69b5e29ea4b7f670a9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:53.180912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cbf78033-6e0d-41a1-a12b-43c83e2b1106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '338cdde0b28b4f69b5e29ea4b7f670a9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:53.196564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cbf78033-6e0d-41a1-a12b-43c83e2b1106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '338cdde0b28b4f69b5e29ea4b7f670a9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:53.224845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6abc71-484c-497c-9674-328d3764d3ba admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:53.230006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cbf78033-6e0d-41a1-a12b-43c83e2b1106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '338cdde0b28b4f69b5e29ea4b7f670a9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:53.241116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c67316-abbc-45b0-85a4-1e85d9cdf02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:53.242099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c67316-abbc-45b0-85a4-1e85d9cdf02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:53.242772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c67316-abbc-45b0-85a4-1e85d9cdf02d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:53.242905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cbf78033-6e0d-41a1-a12b-43c83e2b1106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '338cdde0b28b4f69b5e29ea4b7f670a9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:53.243226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c67316-abbc-45b0-85a4-1e85d9cdf02d admin admin] PATH_INFO: `/v3/users/5c6bda519420419ab90c53b9858b5f9b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:53.244615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c67316-abbc-45b0-85a4-1e85d9cdf02d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c6bda519420419ab90c53b9858b5f9b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:53.248522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c67316-abbc-45b0-85a4-1e85d9cdf02d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:53.252962 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2455/4905] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:04:52 2022] DELETE /identity/v3/users/338cdde0b28b4f69b5e29ea4b7f670a9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:53.267436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9a67b-ccb2-4047-8250-c7eedf27612d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:53.276863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9a67b-ccb2-4047-8250-c7eedf27612d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:53.277326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9a67b-ccb2-4047-8250-c7eedf27612d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:53.340476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-22f9a67b-ccb2-4047-8250-c7eedf27612d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:53.346672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-22f9a67b-ccb2-4047-8250-c7eedf27612d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:53.392633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a1c67316-abbc-45b0-85a4-1e85d9cdf02d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c6bda519420419ab90c53b9858b5f9b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:53.410530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a1c67316-abbc-45b0-85a4-1e85d9cdf02d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c6bda519420419ab90c53b9858b5f9b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:53.412363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a1c67316-abbc-45b0-85a4-1e85d9cdf02d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c6bda519420419ab90c53b9858b5f9b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:53.464833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a1c67316-abbc-45b0-85a4-1e85d9cdf02d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c6bda519420419ab90c53b9858b5f9b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:53.498741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a1c67316-abbc-45b0-85a4-1e85d9cdf02d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c6bda519420419ab90c53b9858b5f9b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:53.517648 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2451/4906] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:04:53 2022] DELETE /identity/v3/users/5c6bda519420419ab90c53b9858b5f9b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:53.549348 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2456/4907] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:53.581875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c67316-abbc-45b0-85a4-1e85d9cdf02d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:53.583571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a1c67316-abbc-45b0-85a4-1e85d9cdf02d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:53.665340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c67316-abbc-45b0-85a4-1e85d9cdf02d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:53.671190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03815d2a-df51-4a19-bb15-77584c13b34d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:53.672162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815d2a-df51-4a19-bb15-77584c13b34d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:53.672687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815d2a-df51-4a19-bb15-77584c13b34d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:53.674108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815d2a-df51-4a19-bb15-77584c13b34d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:53.717874 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:53.786523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03815d2a-df51-4a19-bb15-77584c13b34d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:53.789457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03815d2a-df51-4a19-bb15-77584c13b34d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:53.803748 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2452/4908] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:04:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:04:55.601708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9a67b-ccb2-4047-8250-c7eedf27612d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:55.604036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-22f9a67b-ccb2-4047-8250-c7eedf27612d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:55.634320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9a67b-ccb2-4047-8250-c7eedf27612d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:55.654202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ea390-3eac-4c3f-a78a-63501d32e3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:55.655137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ea390-3eac-4c3f-a78a-63501d32e3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:55.656074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ea390-3eac-4c3f-a78a-63501d32e3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:55.656661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ea390-3eac-4c3f-a78a-63501d32e3fe admin admin] PATH_INFO: `/v3/projects/b8d527a123d943eb83ac85247e6330f1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:55.659969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ea390-3eac-4c3f-a78a-63501d32e3fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8d527a123d943eb83ac85247e6330f1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:55.660810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03815d2a-df51-4a19-bb15-77584c13b34d service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:55.663800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-03815d2a-df51-4a19-bb15-77584c13b34d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:55.665417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ea390-3eac-4c3f-a78a-63501d32e3fe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:55.682883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03815d2a-df51-4a19-bb15-77584c13b34d service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:55.705633 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:55.708537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395e44a-c238-4b0f-9786-ecae8465d829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:55.709229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395e44a-c238-4b0f-9786-ecae8465d829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:55.709508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395e44a-c238-4b0f-9786-ecae8465d829 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:55.709786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395e44a-c238-4b0f-9786-ecae8465d829 admin admin] PATH_INFO: `/v3/projects/f7294d19b2614d33af05296054604114` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:55.716167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395e44a-c238-4b0f-9786-ecae8465d829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7294d19b2614d33af05296054604114)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:55.718132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395e44a-c238-4b0f-9786-ecae8465d829 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:55.789618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-683ea390-3eac-4c3f-a78a-63501d32e3fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8d527a123d943eb83ac85247e6330f1', 'request_id': 'req-683ea390-3eac-4c3f-a78a-63501d32e3fe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:55.808348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-683ea390-3eac-4c3f-a78a-63501d32e3fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8d527a123d943eb83ac85247e6330f1', 'request_id': 'req-683ea390-3eac-4c3f-a78a-63501d32e3fe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:55.820120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-683ea390-3eac-4c3f-a78a-63501d32e3fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8d527a123d943eb83ac85247e6330f1', 'request_id': 'req-683ea390-3eac-4c3f-a78a-63501d32e3fe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:55.833838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2395e44a-c238-4b0f-9786-ecae8465d829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7294d19b2614d33af05296054604114', 'request_id': 'req-2395e44a-c238-4b0f-9786-ecae8465d829'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:55.843237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-683ea390-3eac-4c3f-a78a-63501d32e3fe admin admin] The token cache is being invalidate because project b8d527a123d943eb83ac85247e6330f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:04:55.845606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-683ea390-3eac-4c3f-a78a-63501d32e3fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:55.847590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-683ea390-3eac-4c3f-a78a-63501d32e3fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:55.850693 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2457/4909] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:04:55 2022] DELETE /identity/v3/projects/b8d527a123d943eb83ac85247e6330f1 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:55.855142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2395e44a-c238-4b0f-9786-ecae8465d829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7294d19b2614d33af05296054604114', 'request_id': 'req-2395e44a-c238-4b0f-9786-ecae8465d829'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:55.856687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2e1d1-5d08-411b-8fd8-2ff23897a263 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:55.857844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2e1d1-5d08-411b-8fd8-2ff23897a263 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:55.858234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2e1d1-5d08-411b-8fd8-2ff23897a263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:55.862046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2395e44a-c238-4b0f-9786-ecae8465d829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7294d19b2614d33af05296054604114', 'request_id': 'req-2395e44a-c238-4b0f-9786-ecae8465d829'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:55.885984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1bc2e1d1-5d08-411b-8fd8-2ff23897a263 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:55.887340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1bc2e1d1-5d08-411b-8fd8-2ff23897a263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:55.896798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2395e44a-c238-4b0f-9786-ecae8465d829 admin admin] The token cache is being invalidate because project f7294d19b2614d33af05296054604114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:04:55.897095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2395e44a-c238-4b0f-9786-ecae8465d829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:55.905083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2395e44a-c238-4b0f-9786-ecae8465d829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:55.910030 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2453/4910] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:04:55 2022] DELETE /identity/v3/projects/f7294d19b2614d33af05296054604114 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:55.911542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259515b-a076-4807-a60a-a27805a761d3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:55.911830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259515b-a076-4807-a60a-a27805a761d3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:55.912107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259515b-a076-4807-a60a-a27805a761d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:55.958757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7259515b-a076-4807-a60a-a27805a761d3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:55.960527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7259515b-a076-4807-a60a-a27805a761d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:56.013803 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2458/4911] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:56.021773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3a210-66ab-49b7-9167-ba111787b362 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:56.022060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3a210-66ab-49b7-9167-ba111787b362 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:56.022353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3a210-66ab-49b7-9167-ba111787b362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:56.046025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ffa3a210-66ab-49b7-9167-ba111787b362 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:56.047434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ffa3a210-66ab-49b7-9167-ba111787b362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:56.076091 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2459/4912] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:04:56.077659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3a210-66ab-49b7-9167-ba111787b362 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:56.095024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3a210-66ab-49b7-9167-ba111787b362 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:56.111067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff5d7c-1668-4afd-a1f7-2183c3281204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:56.111703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff5d7c-1668-4afd-a1f7-2183c3281204 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:56.111982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff5d7c-1668-4afd-a1f7-2183c3281204 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:56.112410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff5d7c-1668-4afd-a1f7-2183c3281204 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:56.113315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff5d7c-1668-4afd-a1f7-2183c3281204 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:04:56.113612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff5d7c-1668-4afd-a1f7-2183c3281204 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:56.115222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff5d7c-1668-4afd-a1f7-2183c3281204 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:56.122705 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2454/4913] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:04:56.137597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362a3b0-f7d2-4e7e-92db-8f1c380154a1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:56.142224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362a3b0-f7d2-4e7e-92db-8f1c380154a1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:56.142224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362a3b0-f7d2-4e7e-92db-8f1c380154a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:56.163904 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2460/4914] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:04:56.169347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff5d7c-1668-4afd-a1f7-2183c3281204 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:56.177999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0362a3b0-f7d2-4e7e-92db-8f1c380154a1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:56.180750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0362a3b0-f7d2-4e7e-92db-8f1c380154a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:56.192089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff5d7c-1668-4afd-a1f7-2183c3281204 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:56.201367 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2455/4915] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:56.206291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362a3b0-f7d2-4e7e-92db-8f1c380154a1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:56.207879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ab89b-c5ec-45b3-99ac-6d434e5d1403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:56.207879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ab89b-c5ec-45b3-99ac-6d434e5d1403 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:56.209031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ab89b-c5ec-45b3-99ac-6d434e5d1403 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:56.209308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ab89b-c5ec-45b3-99ac-6d434e5d1403 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:56.210617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ab89b-c5ec-45b3-99ac-6d434e5d1403 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:56.216811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ab89b-c5ec-45b3-99ac-6d434e5d1403 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:56.230022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362a3b0-f7d2-4e7e-92db-8f1c380154a1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:56.246502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fe700-ee70-4388-85d8-bd641b01dda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:56.247127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fe700-ee70-4388-85d8-bd641b01dda2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:56.247401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fe700-ee70-4388-85d8-bd641b01dda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:56.247696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fe700-ee70-4388-85d8-bd641b01dda2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:56.248320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fe700-ee70-4388-85d8-bd641b01dda2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:04:56.248630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fe700-ee70-4388-85d8-bd641b01dda2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:56.250670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fe700-ee70-4388-85d8-bd641b01dda2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:56.299852 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2461/4916] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:04:56 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:04:56.303779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ab89b-c5ec-45b3-99ac-6d434e5d1403 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:56.312086 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2456/4917] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:04:56.313067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fe700-ee70-4388-85d8-bd641b01dda2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:56.346775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fe700-ee70-4388-85d8-bd641b01dda2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:56.399095 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:56.488142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cf673-3894-4e15-8944-151ba15edf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:56.488934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cf673-3894-4e15-8944-151ba15edf82 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:56.489311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cf673-3894-4e15-8944-151ba15edf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:56.489702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cf673-3894-4e15-8944-151ba15edf82 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:56.490457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cf673-3894-4e15-8944-151ba15edf82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:56.494266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cf673-3894-4e15-8944-151ba15edf82 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:56.499213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ab89b-c5ec-45b3-99ac-6d434e5d1403 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:56.512935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817b8ca-7c0f-4b73-a2ec-0f21a9b1c21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:56.513707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817b8ca-7c0f-4b73-a2ec-0f21a9b1c21e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:56.514623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817b8ca-7c0f-4b73-a2ec-0f21a9b1c21e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:56.515098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817b8ca-7c0f-4b73-a2ec-0f21a9b1c21e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:56.515954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817b8ca-7c0f-4b73-a2ec-0f21a9b1c21e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:56.518868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817b8ca-7c0f-4b73-a2ec-0f21a9b1c21e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:56.559774 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2457/4918] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:04:56 2022] POST /identity/v3/projects => generated 357 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:56.564336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cf673-3894-4e15-8944-151ba15edf82 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:56.570109 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:56.583694 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2462/4919] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:04:56 2022] POST /identity/v3/users => generated 289 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:56.593249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817b8ca-7c0f-4b73-a2ec-0f21a9b1c21e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:56.622243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817b8ca-7c0f-4b73-a2ec-0f21a9b1c21e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:56.711001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cf673-3894-4e15-8944-151ba15edf82 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:56.722837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ccbc4-8026-428c-8d6a-02fb6d29bac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:56.723559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ccbc4-8026-428c-8d6a-02fb6d29bac9 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:56.723902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ccbc4-8026-428c-8d6a-02fb6d29bac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:56.724238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ccbc4-8026-428c-8d6a-02fb6d29bac9 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:56.725069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ccbc4-8026-428c-8d6a-02fb6d29bac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:56.727528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ccbc4-8026-428c-8d6a-02fb6d29bac9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:56.762478 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2458/4920] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:04:56 2022] POST /identity/v3/users => generated 279 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:56.765689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920d316-6df8-4a5a-bef6-f3d2f4801fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:56.767681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920d316-6df8-4a5a-bef6-f3d2f4801fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:56.768081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920d316-6df8-4a5a-bef6-f3d2f4801fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:56.768879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ccbc4-8026-428c-8d6a-02fb6d29bac9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:56.769663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920d316-6df8-4a5a-bef6-f3d2f4801fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:56.771478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920d316-6df8-4a5a-bef6-f3d2f4801fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:56.779234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920d316-6df8-4a5a-bef6-f3d2f4801fa2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:56.791654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ccbc4-8026-428c-8d6a-02fb6d29bac9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:56.800591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7366918-376e-44c7-89ed-299e0dd408e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:56.803426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7366918-376e-44c7-89ed-299e0dd408e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:56.803680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7366918-376e-44c7-89ed-299e0dd408e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:56.803964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7366918-376e-44c7-89ed-299e0dd408e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:56.804629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7366918-376e-44c7-89ed-299e0dd408e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:56.810176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7366918-376e-44c7-89ed-299e0dd408e9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:56.814886 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2463/4921] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:56.824701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920d316-6df8-4a5a-bef6-f3d2f4801fa2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:56.832167 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2459/4922] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:56.835654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7366918-376e-44c7-89ed-299e0dd408e9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:56.857577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920d316-6df8-4a5a-bef6-f3d2f4801fa2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:56.862829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7366918-376e-44c7-89ed-299e0dd408e9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:56.867851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c8e10-14ad-42c7-b9dc-b2c6b4ef2a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:56.870864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c8e10-14ad-42c7-b9dc-b2c6b4ef2a60 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:56.871738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c8e10-14ad-42c7-b9dc-b2c6b4ef2a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:56.872245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c8e10-14ad-42c7-b9dc-b2c6b4ef2a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:56.873888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c8e10-14ad-42c7-b9dc-b2c6b4ef2a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:56.879694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c8e10-14ad-42c7-b9dc-b2c6b4ef2a60 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:56.886441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff387f2-31a3-46fe-a055-041f3439bf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:56.888421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff387f2-31a3-46fe-a055-041f3439bf43 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:56.888724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff387f2-31a3-46fe-a055-041f3439bf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:56.890667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff387f2-31a3-46fe-a055-041f3439bf43 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:56.891338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff387f2-31a3-46fe-a055-041f3439bf43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:56.895825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff387f2-31a3-46fe-a055-041f3439bf43 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:56.929870 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2464/4923] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:56.935438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c8e10-14ad-42c7-b9dc-b2c6b4ef2a60 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:56.960335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c8e10-14ad-42c7-b9dc-b2c6b4ef2a60 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:56.964385 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2460/4924] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:04:56.966633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff387f2-31a3-46fe-a055-041f3439bf43 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:56.975215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff14c5-d9c5-49df-9081-b2be8581e84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:56.976487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff14c5-d9c5-49df-9081-b2be8581e84d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:56.977006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff14c5-d9c5-49df-9081-b2be8581e84d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:56.977644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff14c5-d9c5-49df-9081-b2be8581e84d admin admin] PATH_INFO: `/v3/projects/c0696f89d30f4c0384857904fb3500d8/users/f9704d96b4054d8b92a4cd2288fbc858/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:57.009255 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff387f2-31a3-46fe-a055-041f3439bf43 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:57.010874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff14c5-d9c5-49df-9081-b2be8581e84d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0696f89d30f4c0384857904fb3500d8, user_id=f9704d96b4054d8b92a4cd2288fbc858, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:57.013899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff14c5-d9c5-49df-9081-b2be8581e84d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:57.034601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536119e9-84a6-4169-9225-06f7f10731ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:57.037984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536119e9-84a6-4169-9225-06f7f10731ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:57.038501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536119e9-84a6-4169-9225-06f7f10731ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:57.041720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536119e9-84a6-4169-9225-06f7f10731ac admin admin] PATH_INFO: `/v3/projects/18906c490e5949058b194fd0dbef9aa3/users/ab2a38de4f294daaaa024b8046a5fed7/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:57.061385 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2465/4925] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:04:56 2022] PUT /identity/v3/projects/c0696f89d30f4c0384857904fb3500d8/users/f9704d96b4054d8b92a4cd2288fbc858/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:57.066992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7469fe-7c13-4f23-9d52-7af737db4500 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:57.067379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7469fe-7c13-4f23-9d52-7af737db4500 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:57.067748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7469fe-7c13-4f23-9d52-7af737db4500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:57.106024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536119e9-84a6-4169-9225-06f7f10731ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=18906c490e5949058b194fd0dbef9aa3, user_id=ab2a38de4f294daaaa024b8046a5fed7, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:57.110280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536119e9-84a6-4169-9225-06f7f10731ac admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:57.124835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-db7469fe-7c13-4f23-9d52-7af737db4500 None None] MFA Rules not processed for user `f9704d96b4054d8b92a4cd2288fbc858`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:57.126508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-db7469fe-7c13-4f23-9d52-7af737db4500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:57.142001 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2461/4926] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:04:56 2022] PUT /identity/v3/projects/18906c490e5949058b194fd0dbef9aa3/users/ab2a38de4f294daaaa024b8046a5fed7/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:57.155579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3312b-8bcb-4681-aee2-a4c4e7713d1e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:57.156217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3312b-8bcb-4681-aee2-a4c4e7713d1e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:57.158077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3312b-8bcb-4681-aee2-a4c4e7713d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:57.290628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3bd3312b-8bcb-4681-aee2-a4c4e7713d1e None None] MFA Rules not processed for user `ab2a38de4f294daaaa024b8046a5fed7`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:57.292641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3bd3312b-8bcb-4681-aee2-a4c4e7713d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:57.400400 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2466/4927] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:04:57.404758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7469fe-7c13-4f23-9d52-7af737db4500 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:57.445906 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:57.511798 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2462/4928] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:57 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:04:57.530014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3312b-8bcb-4681-aee2-a4c4e7713d1e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:57.531853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3bd3312b-8bcb-4681-aee2-a4c4e7713d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:57.552265 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:57.596171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7469fe-7c13-4f23-9d52-7af737db4500 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:57.687240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3312b-8bcb-4681-aee2-a4c4e7713d1e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:57.698976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67aaf53-ece8-4d4d-ab62-f4e0f53795f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:57.699629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aaf53-ece8-4d4d-ab62-f4e0f53795f1 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:57.699917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aaf53-ece8-4d4d-ab62-f4e0f53795f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:57.700173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aaf53-ece8-4d4d-ab62-f4e0f53795f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:57.722283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67aaf53-ece8-4d4d-ab62-f4e0f53795f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:57.723732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67aaf53-ece8-4d4d-ab62-f4e0f53795f1 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:57.738886 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2463/4929] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:04:57 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:04:57.745091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e3e56-8d93-4507-b1c9-2482cd649feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:57.746604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e3e56-8d93-4507-b1c9-2482cd649feb admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:57.747078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e3e56-8d93-4507-b1c9-2482cd649feb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:57.747611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e3e56-8d93-4507-b1c9-2482cd649feb admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:57.748416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e3e56-8d93-4507-b1c9-2482cd649feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:57.752754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e3e56-8d93-4507-b1c9-2482cd649feb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:57.827072 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2467/4930] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:04:57 2022] POST /identity/v3/projects => generated 375 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:04:57.831487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67aaf53-ece8-4d4d-ab62-f4e0f53795f1 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:57.860794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67aaf53-ece8-4d4d-ab62-f4e0f53795f1 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:57.986953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3730e-6d64-4cbf-8a29-1db04708fabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:57.988356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3730e-6d64-4cbf-8a29-1db04708fabe admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:57.988819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3730e-6d64-4cbf-8a29-1db04708fabe admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:57.989170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3730e-6d64-4cbf-8a29-1db04708fabe admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:57.990639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3730e-6d64-4cbf-8a29-1db04708fabe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:57.996329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3730e-6d64-4cbf-8a29-1db04708fabe admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:58.033127 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2464/4931] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:04:57 2022] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:58.034265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e3e56-8d93-4507-b1c9-2482cd649feb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:58.061081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e3e56-8d93-4507-b1c9-2482cd649feb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:58.067672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22396a15-7dd8-46fc-b107-517b1aa78a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:58.069530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22396a15-7dd8-46fc-b107-517b1aa78a5f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:58.069909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22396a15-7dd8-46fc-b107-517b1aa78a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:58.070278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22396a15-7dd8-46fc-b107-517b1aa78a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:58.071214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22396a15-7dd8-46fc-b107-517b1aa78a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:58.073755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22396a15-7dd8-46fc-b107-517b1aa78a5f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:58.090834 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2468/4932] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:04:58.093680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3730e-6d64-4cbf-8a29-1db04708fabe admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:58.111630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3730e-6d64-4cbf-8a29-1db04708fabe admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:58.122314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8dfdf-9b6a-4efb-9e23-29d80a3aeecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:58.124979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8dfdf-9b6a-4efb-9e23-29d80a3aeecd admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:58.125490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8dfdf-9b6a-4efb-9e23-29d80a3aeecd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:58.126134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8dfdf-9b6a-4efb-9e23-29d80a3aeecd admin admin] PATH_INFO: `/v3/projects/0ac7c82c004c4317ba3f5fb9a2bec184/users/5490f7b3bebd4149ae9f9faba97f4757/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:58.171323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8dfdf-9b6a-4efb-9e23-29d80a3aeecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ac7c82c004c4317ba3f5fb9a2bec184, user_id=5490f7b3bebd4149ae9f9faba97f4757, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:58.174517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8dfdf-9b6a-4efb-9e23-29d80a3aeecd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:58.206599 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2465/4933] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:04:58 2022] PUT /identity/v3/projects/0ac7c82c004c4317ba3f5fb9a2bec184/users/5490f7b3bebd4149ae9f9faba97f4757/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:04:58.211092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22396a15-7dd8-46fc-b107-517b1aa78a5f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:58.232297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22396a15-7dd8-46fc-b107-517b1aa78a5f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:58.305558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cd459-a530-4826-8ab5-aa7a1208c398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:58.306941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cd459-a530-4826-8ab5-aa7a1208c398 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:58.307255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cd459-a530-4826-8ab5-aa7a1208c398 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:58.308292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cd459-a530-4826-8ab5-aa7a1208c398 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:58.308638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10cd459-a530-4826-8ab5-aa7a1208c398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:58.310287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10cd459-a530-4826-8ab5-aa7a1208c398 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:58.344736 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2469/4934] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:04:58.349678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8dfdf-9b6a-4efb-9e23-29d80a3aeecd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:58.364927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8dfdf-9b6a-4efb-9e23-29d80a3aeecd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:58.370832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c620159-4bca-4601-8219-0fb10035e0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:58.371734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c620159-4bca-4601-8219-0fb10035e0db admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:58.372176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c620159-4bca-4601-8219-0fb10035e0db admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:58.372718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c620159-4bca-4601-8219-0fb10035e0db admin admin] PATH_INFO: `/v3/projects/0ac7c82c004c4317ba3f5fb9a2bec184/users/5490f7b3bebd4149ae9f9faba97f4757/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:58.375334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c620159-4bca-4601-8219-0fb10035e0db admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ac7c82c004c4317ba3f5fb9a2bec184, user_id=5490f7b3bebd4149ae9f9faba97f4757, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:58.378382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c620159-4bca-4601-8219-0fb10035e0db admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:58.400962 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2466/4935] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:04:58 2022] PUT /identity/v3/projects/0ac7c82c004c4317ba3f5fb9a2bec184/users/5490f7b3bebd4149ae9f9faba97f4757/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:58.403735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9008af-d4e3-4063-bc44-1ea1f7f70072 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:58.404193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9008af-d4e3-4063-bc44-1ea1f7f70072 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:58.404735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9008af-d4e3-4063-bc44-1ea1f7f70072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:58.450210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ff9008af-d4e3-4063-bc44-1ea1f7f70072 None None] MFA Rules not processed for user `5490f7b3bebd4149ae9f9faba97f4757`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:04:58.452538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ff9008af-d4e3-4063-bc44-1ea1f7f70072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:58.562523 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:58.620176 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2470/4936] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:04:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:04:58.626054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c620159-4bca-4601-8219-0fb10035e0db admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:58.642089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c620159-4bca-4601-8219-0fb10035e0db admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:58.648312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf07ded-dff9-4f44-86ed-b215984216b0 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5490f7b3bebd4149ae9f9faba97f4757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ac7c82c004c4317ba3f5fb9a2bec184', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:58.651507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf07ded-dff9-4f44-86ed-b215984216b0 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:58.652396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf07ded-dff9-4f44-86ed-b215984216b0 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:58.653531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf07ded-dff9-4f44-86ed-b215984216b0 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:58.654639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf07ded-dff9-4f44-86ed-b215984216b0 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:58.655866 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-4bf07ded-dff9-4f44-86ed-b215984216b0 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:04:58.655866 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:04:58.655866 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:04:58.657466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf07ded-dff9-4f44-86ed-b215984216b0 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:58.698821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9008af-d4e3-4063-bc44-1ea1f7f70072 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:58.709787 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2467/4937] 10.222.0.16 () {60 vars in 1185 bytes} [Fri Sep 30 10:04:58 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:04:58.715905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9008af-d4e3-4063-bc44-1ea1f7f70072 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:58.726046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd2687-f375-421e-8b1b-c1131651d1fd tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5490f7b3bebd4149ae9f9faba97f4757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ac7c82c004c4317ba3f5fb9a2bec184', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:58.738282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd2687-f375-421e-8b1b-c1131651d1fd tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:58.742377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd2687-f375-421e-8b1b-c1131651d1fd tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:58.743350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd2687-f375-421e-8b1b-c1131651d1fd tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/29affa5f915e47ea8f986865ae1c75f5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:58.744786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd2687-f375-421e-8b1b-c1131651d1fd tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=29affa5f915e47ea8f986865ae1c75f5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:58.749889 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-b6bd2687-f375-421e-8b1b-c1131651d1fd tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:04:58.749889 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:04:58.749889 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:04:58.757409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd2687-f375-421e-8b1b-c1131651d1fd tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:58.783393 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2471/4938] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Sep 30 10:04:58 2022] GET /identity/v3/OS-OAUTH1/consumers/29affa5f915e47ea8f986865ae1c75f5 => generated 221 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:04:58.790190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf07ded-dff9-4f44-86ed-b215984216b0 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:58.813358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf07ded-dff9-4f44-86ed-b215984216b0 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:58.830830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddda3b6-4784-46e6-835a-24e7acf31023 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5490f7b3bebd4149ae9f9faba97f4757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ac7c82c004c4317ba3f5fb9a2bec184', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:58.831736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddda3b6-4784-46e6-835a-24e7acf31023 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:58.832109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddda3b6-4784-46e6-835a-24e7acf31023 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:58.837989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddda3b6-4784-46e6-835a-24e7acf31023 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/29affa5f915e47ea8f986865ae1c75f5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:58.838940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddda3b6-4784-46e6-835a-24e7acf31023 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=29affa5f915e47ea8f986865ae1c75f5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:58.841089 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-5ddda3b6-4784-46e6-835a-24e7acf31023 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:04:58.841089 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:04:58.841089 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:04:58.842413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddda3b6-4784-46e6-835a-24e7acf31023 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:58.842779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ddda3b6-4784-46e6-835a-24e7acf31023 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Invalidating token cache because consumer 29affa5f915e47ea8f986865ae1c75f5 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:04:58.843219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ddda3b6-4784-46e6-835a-24e7acf31023 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:58.844962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ddda3b6-4784-46e6-835a-24e7acf31023 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:58.890272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5ddda3b6-4784-46e6-835a-24e7acf31023 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '29affa5f915e47ea8f986865ae1c75f5', 'request_id': 'req-5ddda3b6-4784-46e6-835a-24e7acf31023'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:58.897054 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:DELETE=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:04:58.936504 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2468/4939] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Sep 30 10:04:58 2022] DELETE /identity/v3/OS-OAUTH1/consumers/29affa5f915e47ea8f986865ae1c75f5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:58.937932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd2687-f375-421e-8b1b-c1131651d1fd tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:58.940083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b6bd2687-f375-421e-8b1b-c1131651d1fd tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:58.957117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd2687-f375-421e-8b1b-c1131651d1fd tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:58.964118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e438e2d-5db8-4e34-8c1e-70bcfe90ff15 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5490f7b3bebd4149ae9f9faba97f4757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ac7c82c004c4317ba3f5fb9a2bec184', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:58.964773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e438e2d-5db8-4e34-8c1e-70bcfe90ff15 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:58.965056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e438e2d-5db8-4e34-8c1e-70bcfe90ff15 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:58.965328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e438e2d-5db8-4e34-8c1e-70bcfe90ff15 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:58.965985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e438e2d-5db8-4e34-8c1e-70bcfe90ff15 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:58.967001 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-5e438e2d-5db8-4e34-8c1e-70bcfe90ff15 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:04:58.967001 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:04:58.967001 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:04:58.967897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e438e2d-5db8-4e34-8c1e-70bcfe90ff15 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:58.998137 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2472/4940] 10.222.0.16 () {60 vars in 1185 bytes} [Fri Sep 30 10:04:58 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:59.002542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddda3b6-4784-46e6-835a-24e7acf31023 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:59.021809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddda3b6-4784-46e6-835a-24e7acf31023 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:59.055152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8c0d7-c1d8-4108-ad98-5d4dd31ea463 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5490f7b3bebd4149ae9f9faba97f4757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ac7c82c004c4317ba3f5fb9a2bec184', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:59.057575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8c0d7-c1d8-4108-ad98-5d4dd31ea463 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:59.058291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8c0d7-c1d8-4108-ad98-5d4dd31ea463 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:59.058769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8c0d7-c1d8-4108-ad98-5d4dd31ea463 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/5adae4b616be4649a24ab978daf07c54` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:59.059744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8c0d7-c1d8-4108-ad98-5d4dd31ea463 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=5adae4b616be4649a24ab978daf07c54)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:59.062230 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-5df8c0d7-c1d8-4108-ad98-5d4dd31ea463 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:04:59.062230 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:04:59.062230 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:04:59.066531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8c0d7-c1d8-4108-ad98-5d4dd31ea463 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:59.078365 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2469/4941] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Sep 30 10:04:59 2022] GET /identity/v3/OS-OAUTH1/consumers/5adae4b616be4649a24ab978daf07c54 => generated 220 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:04:59.083044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e438e2d-5db8-4e34-8c1e-70bcfe90ff15 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:59.096551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e438e2d-5db8-4e34-8c1e-70bcfe90ff15 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:59.103147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11410f-f9ae-4a7f-89a3-494dd9878482 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5490f7b3bebd4149ae9f9faba97f4757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ac7c82c004c4317ba3f5fb9a2bec184', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:59.103991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11410f-f9ae-4a7f-89a3-494dd9878482 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:59.104432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11410f-f9ae-4a7f-89a3-494dd9878482 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:59.104887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11410f-f9ae-4a7f-89a3-494dd9878482 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/5adae4b616be4649a24ab978daf07c54` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:59.105823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11410f-f9ae-4a7f-89a3-494dd9878482 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=5adae4b616be4649a24ab978daf07c54)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:59.107007 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-7c11410f-f9ae-4a7f-89a3-494dd9878482 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:04:59.107007 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:04:59.107007 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:04:59.108239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11410f-f9ae-4a7f-89a3-494dd9878482 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:59.108697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7c11410f-f9ae-4a7f-89a3-494dd9878482 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Invalidating token cache because consumer 5adae4b616be4649a24ab978daf07c54 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:04:59.110598 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7c11410f-f9ae-4a7f-89a3-494dd9878482 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:59.111527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7c11410f-f9ae-4a7f-89a3-494dd9878482 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:59.138923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7c11410f-f9ae-4a7f-89a3-494dd9878482 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '5adae4b616be4649a24ab978daf07c54', 'request_id': 'req-7c11410f-f9ae-4a7f-89a3-494dd9878482'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:59.171479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8c0d7-c1d8-4108-ad98-5d4dd31ea463 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:59.173263 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2473/4942] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Sep 30 10:04:59 2022] DELETE /identity/v3/OS-OAUTH1/consumers/5adae4b616be4649a24ab978daf07c54 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:59.173518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5df8c0d7-c1d8-4108-ad98-5d4dd31ea463 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:59.195807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8c0d7-c1d8-4108-ad98-5d4dd31ea463 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:59.208267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e952e91-7727-4831-b802-cec83479737b tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5490f7b3bebd4149ae9f9faba97f4757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ac7c82c004c4317ba3f5fb9a2bec184', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:59.209489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e952e91-7727-4831-b802-cec83479737b tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:59.210020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e952e91-7727-4831-b802-cec83479737b tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:59.211098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e952e91-7727-4831-b802-cec83479737b tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/5adae4b616be4649a24ab978daf07c54` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:59.213207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e952e91-7727-4831-b802-cec83479737b tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=5adae4b616be4649a24ab978daf07c54)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:59.216253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e952e91-7727-4831-b802-cec83479737b tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:59.282404 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-7e952e91-7727-4831-b802-cec83479737b tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Sep 30 10:04:59.282404 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:04:59.282404 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:04:59.282404 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:04:59.282404 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:04:59.282404 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:04:59.282404 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:04:59.282404 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:04:59.282404 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:04:59.282404 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:04:59.282404 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:04:59.282404 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:04:59.282404 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Sep 30 10:04:59.282404 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Sep 30 10:04:59.282404 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Sep 30 10:04:59.283785 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Sep 30 10:04:59.283785 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Sep 30 10:04:59.283785 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Sep 30 10:04:59.283785 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Sep 30 10:04:59.283785 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Sep 30 10:04:59.283785 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Sep 30 10:04:59.283785 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Sep 30 10:04:59.283785 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Sep 30 10:04:59.283785 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:04:59.292037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11410f-f9ae-4a7f-89a3-494dd9878482 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:59.301447 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2470/4943] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Sep 30 10:04:59 2022] GET /identity/v3/OS-OAUTH1/consumers/5adae4b616be4649a24ab978daf07c54 => generated 74 bytes in 130 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 10:04:59.306415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11410f-f9ae-4a7f-89a3-494dd9878482 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:59.313315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401505ef-1bb3-4f6f-83df-61a008678d78 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5490f7b3bebd4149ae9f9faba97f4757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ac7c82c004c4317ba3f5fb9a2bec184', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:59.314296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401505ef-1bb3-4f6f-83df-61a008678d78 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:59.316191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401505ef-1bb3-4f6f-83df-61a008678d78 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:59.316717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401505ef-1bb3-4f6f-83df-61a008678d78 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/5adae4b616be4649a24ab978daf07c54` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:59.317563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401505ef-1bb3-4f6f-83df-61a008678d78 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=5adae4b616be4649a24ab978daf07c54)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:59.320188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401505ef-1bb3-4f6f-83df-61a008678d78 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:59.320466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-401505ef-1bb3-4f6f-83df-61a008678d78 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Invalidating token cache because consumer 5adae4b616be4649a24ab978daf07c54 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:04:59.321013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-401505ef-1bb3-4f6f-83df-61a008678d78 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:59.322432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-401505ef-1bb3-4f6f-83df-61a008678d78 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:59.342374 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-401505ef-1bb3-4f6f-83df-61a008678d78 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Sep 30 10:04:59.342374 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:04:59.342374 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:04:59.342374 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:04:59.342374 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:04:59.342374 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:04:59.342374 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:04:59.342374 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:04:59.342374 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:04:59.342374 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:04:59.342374 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:04:59.342374 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:04:59.342374 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Sep 30 10:04:59.342374 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Sep 30 10:04:59.342374 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:04:59.343657 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:04:59.343657 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Sep 30 10:04:59.343657 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Sep 30 10:04:59.343657 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Sep 30 10:04:59.343657 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Sep 30 10:04:59.343657 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Sep 30 10:04:59.343657 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Sep 30 10:04:59.343657 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Sep 30 10:04:59.343657 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Sep 30 10:04:59.343657 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Sep 30 10:04:59.343657 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:04:59.348861 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2474/4944] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Sep 30 10:04:59 2022] DELETE /identity/v3/OS-OAUTH1/consumers/5adae4b616be4649a24ab978daf07c54 => generated 74 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 10:04:59.349399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e952e91-7727-4831-b802-cec83479737b tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:59.352246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7e952e91-7727-4831-b802-cec83479737b tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:59.373640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e952e91-7727-4831-b802-cec83479737b tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:59.381532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d7572-618c-461d-91d8-691940120853 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5490f7b3bebd4149ae9f9faba97f4757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ac7c82c004c4317ba3f5fb9a2bec184', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:59.382371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d7572-618c-461d-91d8-691940120853 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:59.382725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d7572-618c-461d-91d8-691940120853 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:59.385123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d7572-618c-461d-91d8-691940120853 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:59.385733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d7572-618c-461d-91d8-691940120853 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:59.387361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d7572-618c-461d-91d8-691940120853 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:59.427268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401505ef-1bb3-4f6f-83df-61a008678d78 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:59.444505 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2471/4945] 10.222.0.16 () {60 vars in 1185 bytes} [Fri Sep 30 10:04:59 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:59.453074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401505ef-1bb3-4f6f-83df-61a008678d78 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:59.460403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba21245-0cbc-409e-87a8-6ad5220f1536 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5490f7b3bebd4149ae9f9faba97f4757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ac7c82c004c4317ba3f5fb9a2bec184', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:59.461975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba21245-0cbc-409e-87a8-6ad5220f1536 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:59.462229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba21245-0cbc-409e-87a8-6ad5220f1536 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:59.462753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba21245-0cbc-409e-87a8-6ad5220f1536 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:59.463494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba21245-0cbc-409e-87a8-6ad5220f1536 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:59.466005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba21245-0cbc-409e-87a8-6ad5220f1536 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:59.502532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d7572-618c-461d-91d8-691940120853 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:59.512793 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2475/4946] 10.222.0.16 () {60 vars in 1185 bytes} [Fri Sep 30 10:04:59 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:04:59.519767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d7572-618c-461d-91d8-691940120853 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:59.529285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc072d5-43d1-47e7-a670-ff915148d9ad tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5490f7b3bebd4149ae9f9faba97f4757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ac7c82c004c4317ba3f5fb9a2bec184', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:59.530263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc072d5-43d1-47e7-a670-ff915148d9ad tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:59.530892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc072d5-43d1-47e7-a670-ff915148d9ad tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:59.531533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc072d5-43d1-47e7-a670-ff915148d9ad tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:59.532221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc072d5-43d1-47e7-a670-ff915148d9ad tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:59.533782 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-edc072d5-43d1-47e7-a670-ff915148d9ad tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:04:59.533782 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:04:59.533782 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:04:59.534936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc072d5-43d1-47e7-a670-ff915148d9ad tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:59.553328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba21245-0cbc-409e-87a8-6ad5220f1536 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:59.563424 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2472/4947] 10.222.0.16 () {58 vars in 1164 bytes} [Fri Sep 30 10:04:59 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:04:59.570981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba21245-0cbc-409e-87a8-6ad5220f1536 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:59.598485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301c241-f119-4191-970d-5f44bd061f43 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5490f7b3bebd4149ae9f9faba97f4757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ac7c82c004c4317ba3f5fb9a2bec184', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:59.599298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301c241-f119-4191-970d-5f44bd061f43 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:59.599747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301c241-f119-4191-970d-5f44bd061f43 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:59.600136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301c241-f119-4191-970d-5f44bd061f43 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4cd675b6f0e54c03a67a8a904727eeb8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:59.601538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301c241-f119-4191-970d-5f44bd061f43 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=4cd675b6f0e54c03a67a8a904727eeb8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:59.604112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301c241-f119-4191-970d-5f44bd061f43 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:59.604519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c301c241-f119-4191-970d-5f44bd061f43 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Invalidating token cache because consumer 4cd675b6f0e54c03a67a8a904727eeb8 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:04:59.604941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c301c241-f119-4191-970d-5f44bd061f43 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:59.605800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c301c241-f119-4191-970d-5f44bd061f43 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:59.628200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c301c241-f119-4191-970d-5f44bd061f43 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '4cd675b6f0e54c03a67a8a904727eeb8', 'request_id': 'req-c301c241-f119-4191-970d-5f44bd061f43'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:59.648072 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2476/4948] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Sep 30 10:04:59 2022] DELETE /identity/v3/OS-OAUTH1/consumers/4cd675b6f0e54c03a67a8a904727eeb8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:04:59.654070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc072d5-43d1-47e7-a670-ff915148d9ad tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:59.656537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-edc072d5-43d1-47e7-a670-ff915148d9ad tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:59.691164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc072d5-43d1-47e7-a670-ff915148d9ad tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:59.711436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500fa59-d55b-4847-9da9-757385a40de9 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5490f7b3bebd4149ae9f9faba97f4757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ac7c82c004c4317ba3f5fb9a2bec184', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:59.715015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500fa59-d55b-4847-9da9-757385a40de9 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:59.716210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500fa59-d55b-4847-9da9-757385a40de9 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:59.717023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500fa59-d55b-4847-9da9-757385a40de9 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c0ba7376258047cda128ea616299def0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:59.719679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500fa59-d55b-4847-9da9-757385a40de9 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=c0ba7376258047cda128ea616299def0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:59.722109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500fa59-d55b-4847-9da9-757385a40de9 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:59.724365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2500fa59-d55b-4847-9da9-757385a40de9 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Invalidating token cache because consumer c0ba7376258047cda128ea616299def0 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:04:59.725244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2500fa59-d55b-4847-9da9-757385a40de9 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:59.726241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2500fa59-d55b-4847-9da9-757385a40de9 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:59.743571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2500fa59-d55b-4847-9da9-757385a40de9 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'c0ba7376258047cda128ea616299def0', 'request_id': 'req-2500fa59-d55b-4847-9da9-757385a40de9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:04:59.804156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301c241-f119-4191-970d-5f44bd061f43 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:59.804679 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2473/4949] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Sep 30 10:04:59 2022] DELETE /identity/v3/OS-OAUTH1/consumers/c0ba7376258047cda128ea616299def0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:04:59.835229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301c241-f119-4191-970d-5f44bd061f43 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:59.855265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec21783-4411-4eca-b894-348409bc309c tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5490f7b3bebd4149ae9f9faba97f4757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ac7c82c004c4317ba3f5fb9a2bec184', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:59.857534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec21783-4411-4eca-b894-348409bc309c tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:59.857926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec21783-4411-4eca-b894-348409bc309c tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:59.858294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec21783-4411-4eca-b894-348409bc309c tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:59.865289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec21783-4411-4eca-b894-348409bc309c tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:59.867279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec21783-4411-4eca-b894-348409bc309c tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:04:59.930102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500fa59-d55b-4847-9da9-757385a40de9 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:04:59.934511 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2477/4950] 10.222.0.16 () {60 vars in 1185 bytes} [Fri Sep 30 10:04:59 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:04:59.935539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2500fa59-d55b-4847-9da9-757385a40de9 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:04:59.960285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500fa59-d55b-4847-9da9-757385a40de9 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:04:59.977511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac1f10-3487-4d8e-aa2f-4dcb27080482 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5490f7b3bebd4149ae9f9faba97f4757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ac7c82c004c4317ba3f5fb9a2bec184', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:04:59.979002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac1f10-3487-4d8e-aa2f-4dcb27080482 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:04:59.980547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac1f10-3487-4d8e-aa2f-4dcb27080482 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:04:59.981029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac1f10-3487-4d8e-aa2f-4dcb27080482 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e28d5a27ed214aea99041f70c165e9e1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:04:59.981857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac1f10-3487-4d8e-aa2f-4dcb27080482 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=e28d5a27ed214aea99041f70c165e9e1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:04:59.983028 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-c9ac1f10-3487-4d8e-aa2f-4dcb27080482 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:04:59.983028 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:04:59.983028 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:04:59.985361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac1f10-3487-4d8e-aa2f-4dcb27080482 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:00.030274 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2474/4951] 10.222.0.16 () {60 vars in 1285 bytes} [Fri Sep 30 10:04:59 2022] PATCH /identity/v3/OS-OAUTH1/consumers/e28d5a27ed214aea99041f70c165e9e1 => generated 220 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:05:00.034438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec21783-4411-4eca-b894-348409bc309c tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:00.051152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec21783-4411-4eca-b894-348409bc309c tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:00.062632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4928d7-7442-4164-aace-cb2e1967ac57 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5490f7b3bebd4149ae9f9faba97f4757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ac7c82c004c4317ba3f5fb9a2bec184', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:00.063285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4928d7-7442-4164-aace-cb2e1967ac57 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:00.063695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4928d7-7442-4164-aace-cb2e1967ac57 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:00.063990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4928d7-7442-4164-aace-cb2e1967ac57 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e28d5a27ed214aea99041f70c165e9e1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:00.064591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4928d7-7442-4164-aace-cb2e1967ac57 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=e28d5a27ed214aea99041f70c165e9e1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:00.070076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4928d7-7442-4164-aace-cb2e1967ac57 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:00.078208 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2478/4952] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Sep 30 10:05:00 2022] GET /identity/v3/OS-OAUTH1/consumers/e28d5a27ed214aea99041f70c165e9e1 => generated 220 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:05:00.086714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac1f10-3487-4d8e-aa2f-4dcb27080482 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:00.108916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac1f10-3487-4d8e-aa2f-4dcb27080482 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:00.133947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff19eb-6b0d-46e9-8fd9-65c60d5aee42 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5490f7b3bebd4149ae9f9faba97f4757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ac7c82c004c4317ba3f5fb9a2bec184', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:00.134895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff19eb-6b0d-46e9-8fd9-65c60d5aee42 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:00.135370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff19eb-6b0d-46e9-8fd9-65c60d5aee42 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:00.135644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff19eb-6b0d-46e9-8fd9-65c60d5aee42 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e28d5a27ed214aea99041f70c165e9e1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:00.136240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff19eb-6b0d-46e9-8fd9-65c60d5aee42 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=e28d5a27ed214aea99041f70c165e9e1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:00.148093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff19eb-6b0d-46e9-8fd9-65c60d5aee42 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:00.148382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-31ff19eb-6b0d-46e9-8fd9-65c60d5aee42 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Invalidating token cache because consumer e28d5a27ed214aea99041f70c165e9e1 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:00.149156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-31ff19eb-6b0d-46e9-8fd9-65c60d5aee42 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:00.152102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-31ff19eb-6b0d-46e9-8fd9-65c60d5aee42 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:00.200891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-31ff19eb-6b0d-46e9-8fd9-65c60d5aee42 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'e28d5a27ed214aea99041f70c165e9e1', 'request_id': 'req-31ff19eb-6b0d-46e9-8fd9-65c60d5aee42'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:00.238382 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2475/4953] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Sep 30 10:05:00 2022] DELETE /identity/v3/OS-OAUTH1/consumers/e28d5a27ed214aea99041f70c165e9e1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:00.240234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4928d7-7442-4164-aace-cb2e1967ac57 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:00.243131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9f4928d7-7442-4164-aace-cb2e1967ac57 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:00.564057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4928d7-7442-4164-aace-cb2e1967ac57 tempest-OAUTHConsumersV3Test-250541005 tempest-OAUTHConsumersV3Test-250541005-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:00.593585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a36e9-527a-46cd-8468-aa2ccf4a775b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:00.594144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a36e9-527a-46cd-8468-aa2ccf4a775b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:00.594430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a36e9-527a-46cd-8468-aa2ccf4a775b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:00.594703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a36e9-527a-46cd-8468-aa2ccf4a775b admin admin] PATH_INFO: `/v3/users/f9704d96b4054d8b92a4cd2288fbc858` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:00.597833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a36e9-527a-46cd-8468-aa2ccf4a775b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9704d96b4054d8b92a4cd2288fbc858)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:00.599653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a36e9-527a-46cd-8468-aa2ccf4a775b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:00.766931 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:00.801130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2c7a36e9-527a-46cd-8468-aa2ccf4a775b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9704d96b4054d8b92a4cd2288fbc858'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:00.802645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2c7a36e9-527a-46cd-8468-aa2ccf4a775b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9704d96b4054d8b92a4cd2288fbc858'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:00.819740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2c7a36e9-527a-46cd-8468-aa2ccf4a775b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9704d96b4054d8b92a4cd2288fbc858'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:00.854618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2c7a36e9-527a-46cd-8468-aa2ccf4a775b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9704d96b4054d8b92a4cd2288fbc858'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:00.902567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2c7a36e9-527a-46cd-8468-aa2ccf4a775b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9704d96b4054d8b92a4cd2288fbc858'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:00.946813 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2479/4954] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:05:00 2022] DELETE /identity/v3/users/f9704d96b4054d8b92a4cd2288fbc858 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:00.951798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd232a0-2f9e-44d1-a04b-7ea7c38eb1ad None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:00.952914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd232a0-2f9e-44d1-a04b-7ea7c38eb1ad None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:00.953197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd232a0-2f9e-44d1-a04b-7ea7c38eb1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:01.083450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-edd232a0-2f9e-44d1-a04b-7ea7c38eb1ad None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:01.084927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-edd232a0-2f9e-44d1-a04b-7ea7c38eb1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:01.329811 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2476/4955] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:01.378699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a36e9-527a-46cd-8468-aa2ccf4a775b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:01.380106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2c7a36e9-527a-46cd-8468-aa2ccf4a775b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:01.613145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a36e9-527a-46cd-8468-aa2ccf4a775b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:01.631894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0479c42-78ab-4e46-9d19-a888d1780f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:01.636388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0479c42-78ab-4e46-9d19-a888d1780f22 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:01.638396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0479c42-78ab-4e46-9d19-a888d1780f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:01.638870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0479c42-78ab-4e46-9d19-a888d1780f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:01.668994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0479c42-78ab-4e46-9d19-a888d1780f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:01.670842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0479c42-78ab-4e46-9d19-a888d1780f22 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:01.696391 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2480/4956] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:01.805606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e837f-895c-40c3-b4af-a5e4babab6b2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:01.805916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e837f-895c-40c3-b4af-a5e4babab6b2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:01.806574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e837f-895c-40c3-b4af-a5e4babab6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:01.878363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3f9e837f-895c-40c3-b4af-a5e4babab6b2 None None] MFA Rules not processed for user `f0e8405dde7241c8b6e1fe97702564fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:01.884456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3f9e837f-895c-40c3-b4af-a5e4babab6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:02.028850 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:02.118744 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2477/4957] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:02.130155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0479c42-78ab-4e46-9d19-a888d1780f22 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:02.131625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d0479c42-78ab-4e46-9d19-a888d1780f22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:02.468689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0479c42-78ab-4e46-9d19-a888d1780f22 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:02.494101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016ebb3-109c-4269-8ebe-4d39dcc0ba50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:02.495016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016ebb3-109c-4269-8ebe-4d39dcc0ba50 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:02.495689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016ebb3-109c-4269-8ebe-4d39dcc0ba50 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:02.496142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016ebb3-109c-4269-8ebe-4d39dcc0ba50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:02.539998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016ebb3-109c-4269-8ebe-4d39dcc0ba50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:02.549415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016ebb3-109c-4269-8ebe-4d39dcc0ba50 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:02.567286 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2481/4958] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:02.881946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e837f-895c-40c3-b4af-a5e4babab6b2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:02.883430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3f9e837f-895c-40c3-b4af-a5e4babab6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:02.911594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e837f-895c-40c3-b4af-a5e4babab6b2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:02.946511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af056c-def8-435b-8c9f-4b7fe7669e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:02.948159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af056c-def8-435b-8c9f-4b7fe7669e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:02.948306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af056c-def8-435b-8c9f-4b7fe7669e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:02.948538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af056c-def8-435b-8c9f-4b7fe7669e8a admin admin] PATH_INFO: `/v3/projects/c0696f89d30f4c0384857904fb3500d8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:02.950388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af056c-def8-435b-8c9f-4b7fe7669e8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0696f89d30f4c0384857904fb3500d8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:02.952803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af056c-def8-435b-8c9f-4b7fe7669e8a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:03.082131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d6af056c-def8-435b-8c9f-4b7fe7669e8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0696f89d30f4c0384857904fb3500d8', 'request_id': 'req-d6af056c-def8-435b-8c9f-4b7fe7669e8a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:03.092389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d6af056c-def8-435b-8c9f-4b7fe7669e8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0696f89d30f4c0384857904fb3500d8', 'request_id': 'req-d6af056c-def8-435b-8c9f-4b7fe7669e8a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:03.099590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d6af056c-def8-435b-8c9f-4b7fe7669e8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0696f89d30f4c0384857904fb3500d8', 'request_id': 'req-d6af056c-def8-435b-8c9f-4b7fe7669e8a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:03.124232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d6af056c-def8-435b-8c9f-4b7fe7669e8a admin admin] The token cache is being invalidate because project c0696f89d30f4c0384857904fb3500d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:03.124797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d6af056c-def8-435b-8c9f-4b7fe7669e8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:03.133280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d6af056c-def8-435b-8c9f-4b7fe7669e8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:03.138493 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2478/4959] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:02 2022] DELETE /identity/v3/projects/c0696f89d30f4c0384857904fb3500d8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:03.140630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016ebb3-109c-4269-8ebe-4d39dcc0ba50 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:03.174636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016ebb3-109c-4269-8ebe-4d39dcc0ba50 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:03.285222 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:03.374826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27276090-6bc7-4371-be50-ec35220da306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:03.375946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27276090-6bc7-4371-be50-ec35220da306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:03.376274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27276090-6bc7-4371-be50-ec35220da306 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:03.376555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27276090-6bc7-4371-be50-ec35220da306 admin admin] PATH_INFO: `/v3/users/5490f7b3bebd4149ae9f9faba97f4757` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:03.380963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27276090-6bc7-4371-be50-ec35220da306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5490f7b3bebd4149ae9f9faba97f4757)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:03.383065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27276090-6bc7-4371-be50-ec35220da306 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:03.506732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-27276090-6bc7-4371-be50-ec35220da306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5490f7b3bebd4149ae9f9faba97f4757'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:03.507812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-27276090-6bc7-4371-be50-ec35220da306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5490f7b3bebd4149ae9f9faba97f4757'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:03.527408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-27276090-6bc7-4371-be50-ec35220da306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5490f7b3bebd4149ae9f9faba97f4757'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:03.546014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-27276090-6bc7-4371-be50-ec35220da306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5490f7b3bebd4149ae9f9faba97f4757'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:03.556316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-27276090-6bc7-4371-be50-ec35220da306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5490f7b3bebd4149ae9f9faba97f4757'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:03.564483 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2482/4960] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:05:03 2022] DELETE /identity/v3/users/5490f7b3bebd4149ae9f9faba97f4757 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:05:05.832191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af056c-def8-435b-8c9f-4b7fe7669e8a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:05.834635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d6af056c-def8-435b-8c9f-4b7fe7669e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:05.872773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af056c-def8-435b-8c9f-4b7fe7669e8a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:06.047828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af52a5-e7e5-4abc-a9fa-ccaadb63fdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:06.048660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af52a5-e7e5-4abc-a9fa-ccaadb63fdf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:06.049045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af52a5-e7e5-4abc-a9fa-ccaadb63fdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:06.049432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af52a5-e7e5-4abc-a9fa-ccaadb63fdf3 admin admin] PATH_INFO: `/v3/projects/0ac7c82c004c4317ba3f5fb9a2bec184` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:06.056592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af52a5-e7e5-4abc-a9fa-ccaadb63fdf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ac7c82c004c4317ba3f5fb9a2bec184)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:06.058702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af52a5-e7e5-4abc-a9fa-ccaadb63fdf3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:06.163226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a6af52a5-e7e5-4abc-a9fa-ccaadb63fdf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ac7c82c004c4317ba3f5fb9a2bec184', 'request_id': 'req-a6af52a5-e7e5-4abc-a9fa-ccaadb63fdf3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:06.184125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a6af52a5-e7e5-4abc-a9fa-ccaadb63fdf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ac7c82c004c4317ba3f5fb9a2bec184', 'request_id': 'req-a6af52a5-e7e5-4abc-a9fa-ccaadb63fdf3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:06.212857 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:06.214925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a6af52a5-e7e5-4abc-a9fa-ccaadb63fdf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ac7c82c004c4317ba3f5fb9a2bec184', 'request_id': 'req-a6af52a5-e7e5-4abc-a9fa-ccaadb63fdf3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:06.252851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a6af52a5-e7e5-4abc-a9fa-ccaadb63fdf3 admin admin] The token cache is being invalidate because project 0ac7c82c004c4317ba3f5fb9a2bec184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:06.261903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a6af52a5-e7e5-4abc-a9fa-ccaadb63fdf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:06.264982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a6af52a5-e7e5-4abc-a9fa-ccaadb63fdf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:06.276859 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2479/4961] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:05 2022] DELETE /identity/v3/projects/0ac7c82c004c4317ba3f5fb9a2bec184 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:06.282346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67c189-4d08-42eb-93a6-9c20b54b1107 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:06.283234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67c189-4d08-42eb-93a6-9c20b54b1107 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:06.283655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67c189-4d08-42eb-93a6-9c20b54b1107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:06.358300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-af67c189-4d08-42eb-93a6-9c20b54b1107 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:06.364848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-af67c189-4d08-42eb-93a6-9c20b54b1107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:06.604457 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2483/4962] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:06.606047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80357255-8847-4fb0-9171-ff3aa13faee9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:06.606402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80357255-8847-4fb0-9171-ff3aa13faee9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:06.607298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80357255-8847-4fb0-9171-ff3aa13faee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:06.691163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-80357255-8847-4fb0-9171-ff3aa13faee9 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:06.698299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-80357255-8847-4fb0-9171-ff3aa13faee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:06.717549 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2480/4963] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:06.722233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67c189-4d08-42eb-93a6-9c20b54b1107 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:06.738814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67c189-4d08-42eb-93a6-9c20b54b1107 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:06.749544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f2122-cdd6-466d-af7a-64ab3dfe85e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:06.750428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f2122-cdd6-466d-af7a-64ab3dfe85e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:06.750945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f2122-cdd6-466d-af7a-64ab3dfe85e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:06.751430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f2122-cdd6-466d-af7a-64ab3dfe85e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:06.752316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f2122-cdd6-466d-af7a-64ab3dfe85e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:05:06.752885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f2122-cdd6-466d-af7a-64ab3dfe85e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:06.754732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f2122-cdd6-466d-af7a-64ab3dfe85e3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:06.785638 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2484/4964] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:06.791377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80357255-8847-4fb0-9171-ff3aa13faee9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:06.806113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80357255-8847-4fb0-9171-ff3aa13faee9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:06.820646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42b186-2444-4191-87d3-4c993eaadb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:06.822282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42b186-2444-4191-87d3-4c993eaadb32 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:06.822653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42b186-2444-4191-87d3-4c993eaadb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:06.823060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42b186-2444-4191-87d3-4c993eaadb32 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:06.823830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42b186-2444-4191-87d3-4c993eaadb32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:06.827450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42b186-2444-4191-87d3-4c993eaadb32 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:06.875527 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2481/4965] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:06 2022] POST /identity/v3/projects => generated 367 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:06.879706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f2122-cdd6-466d-af7a-64ab3dfe85e3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:06.900834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f2122-cdd6-466d-af7a-64ab3dfe85e3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:06.966919 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:07.025729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d0171-dfa3-43da-849c-56e50889a6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:07.026991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d0171-dfa3-43da-849c-56e50889a6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:07.028909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d0171-dfa3-43da-849c-56e50889a6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:07.029344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d0171-dfa3-43da-849c-56e50889a6f7 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:07.030165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d0171-dfa3-43da-849c-56e50889a6f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:07.032265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d0171-dfa3-43da-849c-56e50889a6f7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:07.101150 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2485/4966] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:05:06 2022] POST /identity/v3/users => generated 284 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:05:07.105295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42b186-2444-4191-87d3-4c993eaadb32 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:07.121602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42b186-2444-4191-87d3-4c993eaadb32 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:07.136245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5d0ba-fc70-4c49-85ed-cd25b1bac7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:07.136989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5d0ba-fc70-4c49-85ed-cd25b1bac7ff admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:07.137274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5d0ba-fc70-4c49-85ed-cd25b1bac7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:07.137551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5d0ba-fc70-4c49-85ed-cd25b1bac7ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:07.138208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5d0ba-fc70-4c49-85ed-cd25b1bac7ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:07.140205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5d0ba-fc70-4c49-85ed-cd25b1bac7ff admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:07.161073 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2482/4967] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:07.165107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d0171-dfa3-43da-849c-56e50889a6f7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:07.183893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d0171-dfa3-43da-849c-56e50889a6f7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:07.204949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1aefc-471d-48a1-9f32-9228345d2c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:07.205883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1aefc-471d-48a1-9f32-9228345d2c54 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:07.206322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1aefc-471d-48a1-9f32-9228345d2c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:07.206748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1aefc-471d-48a1-9f32-9228345d2c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:07.207815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1aefc-471d-48a1-9f32-9228345d2c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:07.209706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1aefc-471d-48a1-9f32-9228345d2c54 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:07.234319 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2486/4968] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:07.238893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5d0ba-fc70-4c49-85ed-cd25b1bac7ff admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:07.252570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5d0ba-fc70-4c49-85ed-cd25b1bac7ff admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:07.267016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b2691-0c11-4976-9a24-83d8a3c11a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:07.268134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b2691-0c11-4976-9a24-83d8a3c11a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:07.268780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b2691-0c11-4976-9a24-83d8a3c11a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:07.269320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b2691-0c11-4976-9a24-83d8a3c11a7f admin admin] PATH_INFO: `/v3/projects/e7658fb592bb4a4583ec3bb735e1cbdb/users/3144f19e20944524b1e5fdd2887a038b/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:07.312411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b2691-0c11-4976-9a24-83d8a3c11a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7658fb592bb4a4583ec3bb735e1cbdb, user_id=3144f19e20944524b1e5fdd2887a038b, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:07.315421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b2691-0c11-4976-9a24-83d8a3c11a7f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:07.350720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1aefc-471d-48a1-9f32-9228345d2c54 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:07.351478 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2483/4969] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:05:07 2022] PUT /identity/v3/projects/e7658fb592bb4a4583ec3bb735e1cbdb/users/3144f19e20944524b1e5fdd2887a038b/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:05:07.362675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-89c1aefc-471d-48a1-9f32-9228345d2c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:07.363327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb76cbd-1996-4546-bad4-b649c04a9625 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:07.363619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb76cbd-1996-4546-bad4-b649c04a9625 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:07.364057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb76cbd-1996-4546-bad4-b649c04a9625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:07.429945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ecb76cbd-1996-4546-bad4-b649c04a9625 None None] MFA Rules not processed for user `3144f19e20944524b1e5fdd2887a038b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:07.436186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ecb76cbd-1996-4546-bad4-b649c04a9625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:07.554609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1aefc-471d-48a1-9f32-9228345d2c54 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:07.585612 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2484/4970] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:05:07.590208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb76cbd-1996-4546-bad4-b649c04a9625 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:07.706670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3783cc-7a5e-4f84-9fa6-f3277474ff27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:07.709404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3783cc-7a5e-4f84-9fa6-f3277474ff27 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:07.709918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3783cc-7a5e-4f84-9fa6-f3277474ff27 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:07.711208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3783cc-7a5e-4f84-9fa6-f3277474ff27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:07.716354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9c3783cc-7a5e-4f84-9fa6-f3277474ff27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:07.742868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3783cc-7a5e-4f84-9fa6-f3277474ff27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:07.744860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb76cbd-1996-4546-bad4-b649c04a9625 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:07.747716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3783cc-7a5e-4f84-9fa6-f3277474ff27 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:07.757299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dab0ca-9280-4e6c-9fe4-e9d80c3acac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:07.758212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dab0ca-9280-4e6c-9fe4-e9d80c3acac5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:07.758721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dab0ca-9280-4e6c-9fe4-e9d80c3acac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:07.759304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dab0ca-9280-4e6c-9fe4-e9d80c3acac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:07.761014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dab0ca-9280-4e6c-9fe4-e9d80c3acac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:07.764029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dab0ca-9280-4e6c-9fe4-e9d80c3acac5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:07.780954 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2487/4971] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:07.815706 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2485/4972] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:07 2022] POST /identity/v3/projects => generated 367 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:07.819589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3783cc-7a5e-4f84-9fa6-f3277474ff27 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:07.861038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3783cc-7a5e-4f84-9fa6-f3277474ff27 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:07.910251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db19a18-13e3-4693-b5d5-ec38c4ae9f99 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:07.910795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db19a18-13e3-4693-b5d5-ec38c4ae9f99 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:07.911192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db19a18-13e3-4693-b5d5-ec38c4ae9f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:07.932167 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:08.014307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4db19a18-13e3-4693-b5d5-ec38c4ae9f99 None None] MFA Rules not processed for user `03fa24587e544118bfe537a85d2f113e`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:08.015908 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:08.016872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4db19a18-13e3-4693-b5d5-ec38c4ae9f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:08.081733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763bb28-5f0f-436d-b0cb-b9b7a29ee456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:08.082366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763bb28-5f0f-436d-b0cb-b9b7a29ee456 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:08.082903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763bb28-5f0f-436d-b0cb-b9b7a29ee456 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:08.083761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763bb28-5f0f-436d-b0cb-b9b7a29ee456 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:08.084424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763bb28-5f0f-436d-b0cb-b9b7a29ee456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:08.086741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763bb28-5f0f-436d-b0cb-b9b7a29ee456 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:08.133318 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2488/4973] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:05:07 2022] POST /identity/v3/users => generated 290 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:08.135053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763bb28-5f0f-436d-b0cb-b9b7a29ee456 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:08.161680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763bb28-5f0f-436d-b0cb-b9b7a29ee456 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:08.173327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d56c49-bea1-4793-9868-4081f9313bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:08.176222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d56c49-bea1-4793-9868-4081f9313bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:08.179174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d56c49-bea1-4793-9868-4081f9313bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:08.179506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d56c49-bea1-4793-9868-4081f9313bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:08.181738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d56c49-bea1-4793-9868-4081f9313bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:08.187953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d56c49-bea1-4793-9868-4081f9313bb2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:08.216130 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2486/4974] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:08.219640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117fec7-00eb-4b8e-83c3-842f4743360f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:08.219929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117fec7-00eb-4b8e-83c3-842f4743360f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:08.220201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117fec7-00eb-4b8e-83c3-842f4743360f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:08.230089 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2489/4975] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:08.231691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d56c49-bea1-4793-9868-4081f9313bb2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:08.252589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d56c49-bea1-4793-9868-4081f9313bb2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:08.263710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17673184-2286-481a-82b9-9ed0ced596c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:08.264676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17673184-2286-481a-82b9-9ed0ced596c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:08.264993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17673184-2286-481a-82b9-9ed0ced596c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:08.265274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17673184-2286-481a-82b9-9ed0ced596c2 admin admin] PATH_INFO: `/v3/projects/b305a0a3bd584602939e4beb71f1bfdf/users/89f5acba80c34012b1f65a7792fff501/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:08.274349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7117fec7-00eb-4b8e-83c3-842f4743360f None None] MFA Rules not processed for user `03fa24587e544118bfe537a85d2f113e`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:08.276369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7117fec7-00eb-4b8e-83c3-842f4743360f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:08.299905 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2487/4976] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:08.300639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17673184-2286-481a-82b9-9ed0ced596c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b305a0a3bd584602939e4beb71f1bfdf, user_id=89f5acba80c34012b1f65a7792fff501, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:08.305092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17673184-2286-481a-82b9-9ed0ced596c2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:08.308966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117fec7-00eb-4b8e-83c3-842f4743360f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:08.311762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7117fec7-00eb-4b8e-83c3-842f4743360f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:08.346505 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2490/4977] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:05:08 2022] PUT /identity/v3/projects/b305a0a3bd584602939e4beb71f1bfdf/users/89f5acba80c34012b1f65a7792fff501/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:05:08.347961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17673184-2286-481a-82b9-9ed0ced596c2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:08.485806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117fec7-00eb-4b8e-83c3-842f4743360f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:08.537232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17673184-2286-481a-82b9-9ed0ced596c2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:08.537232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f94862-daf4-4a5c-b174-6c452b326b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:08.537906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f94862-daf4-4a5c-b174-6c452b326b30 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:08.537906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f94862-daf4-4a5c-b174-6c452b326b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:08.538086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f94862-daf4-4a5c-b174-6c452b326b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:08.539090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f94862-daf4-4a5c-b174-6c452b326b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:08.544781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f94862-daf4-4a5c-b174-6c452b326b30 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:08.570896 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2491/4978] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:08.575623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f94862-daf4-4a5c-b174-6c452b326b30 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:08.596681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f94862-daf4-4a5c-b174-6c452b326b30 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:08.612217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9711167-faac-4582-a06b-1a3cff168eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:08.613083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9711167-faac-4582-a06b-1a3cff168eaa admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:08.613721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9711167-faac-4582-a06b-1a3cff168eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:08.614014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9711167-faac-4582-a06b-1a3cff168eaa admin admin] PATH_INFO: `/v3/projects/b305a0a3bd584602939e4beb71f1bfdf/users/89f5acba80c34012b1f65a7792fff501/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:08.620104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9711167-faac-4582-a06b-1a3cff168eaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b305a0a3bd584602939e4beb71f1bfdf, user_id=89f5acba80c34012b1f65a7792fff501, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:08.628058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9711167-faac-4582-a06b-1a3cff168eaa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:08.662830 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2492/4979] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:05:08 2022] PUT /identity/v3/projects/b305a0a3bd584602939e4beb71f1bfdf/users/89f5acba80c34012b1f65a7792fff501/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:08.673342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8a342-e69a-410a-8f2a-a6723a062a70 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:08.673815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8a342-e69a-410a-8f2a-a6723a062a70 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:08.674099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8a342-e69a-410a-8f2a-a6723a062a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:08.677482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880f5ab-cb10-4bbb-8e51-7b1cc51f7f17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:08.680566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880f5ab-cb10-4bbb-8e51-7b1cc51f7f17 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:08.681902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880f5ab-cb10-4bbb-8e51-7b1cc51f7f17 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:08.682341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880f5ab-cb10-4bbb-8e51-7b1cc51f7f17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:08.717759 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:08.832831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ece8a342-e69a-410a-8f2a-a6723a062a70 None None] MFA Rules not processed for user `89f5acba80c34012b1f65a7792fff501`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:08.834628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ece8a342-e69a-410a-8f2a-a6723a062a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:08.928400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880f5ab-cb10-4bbb-8e51-7b1cc51f7f17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:08.930376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880f5ab-cb10-4bbb-8e51-7b1cc51f7f17 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:08.967604 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2488/4980] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:05:09.139161 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:09.165445 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2493/4981] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:05:09.170572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880f5ab-cb10-4bbb-8e51-7b1cc51f7f17 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:09.369978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880f5ab-cb10-4bbb-8e51-7b1cc51f7f17 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:09.385526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34f415-ca08-4202-8dbc-4277c8f4176f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:09.386167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34f415-ca08-4202-8dbc-4277c8f4176f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:09.386598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34f415-ca08-4202-8dbc-4277c8f4176f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:09.391742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34f415-ca08-4202-8dbc-4277c8f4176f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:09.391742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34f415-ca08-4202-8dbc-4277c8f4176f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:09.391742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34f415-ca08-4202-8dbc-4277c8f4176f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:09.561482 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2489/4982] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:09 2022] POST /identity/v3/projects => generated 360 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:09.565460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8a342-e69a-410a-8f2a-a6723a062a70 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:09.586831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8a342-e69a-410a-8f2a-a6723a062a70 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:09.839364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7676b-9eba-40e3-aebb-dedf8d50b4b1 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:09.840720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7676b-9eba-40e3-aebb-dedf8d50b4b1 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:09.841266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7676b-9eba-40e3-aebb-dedf8d50b4b1 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:09.841801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7676b-9eba-40e3-aebb-dedf8d50b4b1 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:09.843385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7676b-9eba-40e3-aebb-dedf8d50b4b1 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:09.858151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7676b-9eba-40e3-aebb-dedf8d50b4b1 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:09.906662 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2494/4983] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:05:09 2022] POST /identity/v3/users => generated 413 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:09.910795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34f415-ca08-4202-8dbc-4277c8f4176f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:09.925684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34f415-ca08-4202-8dbc-4277c8f4176f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:09.935279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efc084-6ee8-48c2-bd9c-39fb688a0980 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:09.936585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efc084-6ee8-48c2-bd9c-39fb688a0980 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:09.937177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efc084-6ee8-48c2-bd9c-39fb688a0980 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:09.937660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efc084-6ee8-48c2-bd9c-39fb688a0980 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/users/954d0fdef6934dc5a73c1ea7fe9c6931` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:09.965988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efc084-6ee8-48c2-bd9c-39fb688a0980 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:get_user(user_id=954d0fdef6934dc5a73c1ea7fe9c6931)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:09.968859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efc084-6ee8-48c2-bd9c-39fb688a0980 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:09.972101 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2490/4984] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Sep 30 10:05:09 2022] GET /identity/v3/users/954d0fdef6934dc5a73c1ea7fe9c6931 => generated 413 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:05:09.976152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7676b-9eba-40e3-aebb-dedf8d50b4b1 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:09.992220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7676b-9eba-40e3-aebb-dedf8d50b4b1 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:10.004800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81118e-43ab-4c4e-9737-6062f657f303 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:10.006779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81118e-43ab-4c4e-9737-6062f657f303 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:10.007109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81118e-43ab-4c4e-9737-6062f657f303 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:10.008087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81118e-43ab-4c4e-9737-6062f657f303 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/users/954d0fdef6934dc5a73c1ea7fe9c6931` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:10.010957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81118e-43ab-4c4e-9737-6062f657f303 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:delete_user(user_id=954d0fdef6934dc5a73c1ea7fe9c6931)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:10.015817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81118e-43ab-4c4e-9737-6062f657f303 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:10.160400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ce81118e-43ab-4c4e-9737-6062f657f303 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '954d0fdef6934dc5a73c1ea7fe9c6931'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:10.162122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ce81118e-43ab-4c4e-9737-6062f657f303 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '954d0fdef6934dc5a73c1ea7fe9c6931'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:10.183893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ce81118e-43ab-4c4e-9737-6062f657f303 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '954d0fdef6934dc5a73c1ea7fe9c6931'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:10.202780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ce81118e-43ab-4c4e-9737-6062f657f303 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '954d0fdef6934dc5a73c1ea7fe9c6931'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:10.226610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ce81118e-43ab-4c4e-9737-6062f657f303 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '954d0fdef6934dc5a73c1ea7fe9c6931'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:10.237679 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2495/4985] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:05:09 2022] DELETE /identity/v3/users/954d0fdef6934dc5a73c1ea7fe9c6931 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:10.239268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efc084-6ee8-48c2-bd9c-39fb688a0980 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:10.241289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-95efc084-6ee8-48c2-bd9c-39fb688a0980 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:10.269384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efc084-6ee8-48c2-bd9c-39fb688a0980 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:10.442351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ae34d-8254-42dd-a80b-e63dcb0948c8 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:10.443022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ae34d-8254-42dd-a80b-e63dcb0948c8 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:10.443300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ae34d-8254-42dd-a80b-e63dcb0948c8 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:10.443569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ae34d-8254-42dd-a80b-e63dcb0948c8 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/4cbd146ddf2c43f4b70542d56c8a7c37` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:10.450966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ae34d-8254-42dd-a80b-e63dcb0948c8 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4cbd146ddf2c43f4b70542d56c8a7c37)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:10.453114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ae34d-8254-42dd-a80b-e63dcb0948c8 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:10.546530 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:10.588896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-460ae34d-8254-42dd-a80b-e63dcb0948c8 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cbd146ddf2c43f4b70542d56c8a7c37', 'request_id': 'req-460ae34d-8254-42dd-a80b-e63dcb0948c8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:10.622357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-460ae34d-8254-42dd-a80b-e63dcb0948c8 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cbd146ddf2c43f4b70542d56c8a7c37', 'request_id': 'req-460ae34d-8254-42dd-a80b-e63dcb0948c8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:10.648867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-460ae34d-8254-42dd-a80b-e63dcb0948c8 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cbd146ddf2c43f4b70542d56c8a7c37', 'request_id': 'req-460ae34d-8254-42dd-a80b-e63dcb0948c8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:10.674989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-460ae34d-8254-42dd-a80b-e63dcb0948c8 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] The token cache is being invalidate because project 4cbd146ddf2c43f4b70542d56c8a7c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:10.675277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-460ae34d-8254-42dd-a80b-e63dcb0948c8 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:10.678145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-460ae34d-8254-42dd-a80b-e63dcb0948c8 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:10.687382 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2491/4986] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:10 2022] DELETE /identity/v3/projects/4cbd146ddf2c43f4b70542d56c8a7c37 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:10.689284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81118e-43ab-4c4e-9737-6062f657f303 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:10.707330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81118e-43ab-4c4e-9737-6062f657f303 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:10.902298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd4b14-c006-4e39-848e-c55ca893623e tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:10.903037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd4b14-c006-4e39-848e-c55ca893623e tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:10.903417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd4b14-c006-4e39-848e-c55ca893623e tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:10.903788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd4b14-c006-4e39-848e-c55ca893623e tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:10.904535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd4b14-c006-4e39-848e-c55ca893623e tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:10.906389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd4b14-c006-4e39-848e-c55ca893623e tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:10.911118 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:10.943542 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2496/4987] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:10 2022] POST /identity/v3/projects => generated 348 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:10.948264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ae34d-8254-42dd-a80b-e63dcb0948c8 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:10.949820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-460ae34d-8254-42dd-a80b-e63dcb0948c8 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:10.988027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ae34d-8254-42dd-a80b-e63dcb0948c8 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:11.170941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d17bda-210b-420c-828a-ed12585fcc9e tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:11.171873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d17bda-210b-420c-828a-ed12585fcc9e tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:11.172304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d17bda-210b-420c-828a-ed12585fcc9e tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:11.172767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d17bda-210b-420c-828a-ed12585fcc9e tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:11.173597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d17bda-210b-420c-828a-ed12585fcc9e tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:05:11.174051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d17bda-210b-420c-828a-ed12585fcc9e tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:11.176222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d17bda-210b-420c-828a-ed12585fcc9e tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:11.229229 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2492/4988] 10.222.0.16 () {58 vars in 1160 bytes} [Fri Sep 30 10:05:10 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:11.229976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd4b14-c006-4e39-848e-c55ca893623e tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:11.248062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd4b14-c006-4e39-848e-c55ca893623e tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:11.273552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5387944-0683-4a10-a623-505e507542ce tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:11.274565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5387944-0683-4a10-a623-505e507542ce tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:11.275300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5387944-0683-4a10-a623-505e507542ce tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:11.275300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5387944-0683-4a10-a623-505e507542ce tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:11.275788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5387944-0683-4a10-a623-505e507542ce tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:11.277541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5387944-0683-4a10-a623-505e507542ce tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:11.343048 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2497/4989] 10.222.0.16 () {58 vars in 1128 bytes} [Fri Sep 30 10:05:11 2022] GET /identity/v3/domains => generated 829 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:11.347058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d17bda-210b-420c-828a-ed12585fcc9e tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:11.367546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d17bda-210b-420c-828a-ed12585fcc9e tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:11.395779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1c8af-f6bc-44f6-934c-4ebae9d63c7f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:11.396497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1c8af-f6bc-44f6-934c-4ebae9d63c7f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:11.396798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1c8af-f6bc-44f6-934c-4ebae9d63c7f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:11.397066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1c8af-f6bc-44f6-934c-4ebae9d63c7f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/6af56e617eb044cda510d91b3ea09a5f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:11.400950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1c8af-f6bc-44f6-934c-4ebae9d63c7f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:update_project(project_id=6af56e617eb044cda510d91b3ea09a5f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:11.402343 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-58e1c8af-f6bc-44f6-934c-4ebae9d63c7f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:05:11.402343 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:05:11.402343 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:05:11.402824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1c8af-f6bc-44f6-934c-4ebae9d63c7f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:11.441887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-58e1c8af-f6bc-44f6-934c-4ebae9d63c7f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6af56e617eb044cda510d91b3ea09a5f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:11.442668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-58e1c8af-f6bc-44f6-934c-4ebae9d63c7f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6af56e617eb044cda510d91b3ea09a5f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:11.489168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-58e1c8af-f6bc-44f6-934c-4ebae9d63c7f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6af56e617eb044cda510d91b3ea09a5f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:11.493093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-58e1c8af-f6bc-44f6-934c-4ebae9d63c7f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6af56e617eb044cda510d91b3ea09a5f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:11.506242 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2493/4990] 10.222.0.16 () {60 vars in 1252 bytes} [Fri Sep 30 10:05:11 2022] PATCH /identity/v3/projects/6af56e617eb044cda510d91b3ea09a5f => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:11.510715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5387944-0683-4a10-a623-505e507542ce tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:11.513484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a5387944-0683-4a10-a623-505e507542ce tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:11.536204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5387944-0683-4a10-a623-505e507542ce tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:11.660264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11248169-6376-47eb-92fa-bab71e04d2a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:11.660948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11248169-6376-47eb-92fa-bab71e04d2a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:11.661376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11248169-6376-47eb-92fa-bab71e04d2a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:11.661820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11248169-6376-47eb-92fa-bab71e04d2a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/6af56e617eb044cda510d91b3ea09a5f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:11.730520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11248169-6376-47eb-92fa-bab71e04d2a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6af56e617eb044cda510d91b3ea09a5f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:11.732277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11248169-6376-47eb-92fa-bab71e04d2a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:11.798996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3c0e0-7431-4bbd-b83d-c75cdc7c02c5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:11.799278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3c0e0-7431-4bbd-b83d-c75cdc7c02c5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:11.799551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3c0e0-7431-4bbd-b83d-c75cdc7c02c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:11.861910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-acc3c0e0-7431-4bbd-b83d-c75cdc7c02c5 None None] MFA Rules not processed for user `f0e8405dde7241c8b6e1fe97702564fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:11.867655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11248169-6376-47eb-92fa-bab71e04d2a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6af56e617eb044cda510d91b3ea09a5f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:11.869128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-acc3c0e0-7431-4bbd-b83d-c75cdc7c02c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:11.893771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11248169-6376-47eb-92fa-bab71e04d2a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6af56e617eb044cda510d91b3ea09a5f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:12.020120 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2494/4991] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:12.108341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11248169-6376-47eb-92fa-bab71e04d2a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af56e617eb044cda510d91b3ea09a5f', 'request_id': 'req-11248169-6376-47eb-92fa-bab71e04d2a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:12.137262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11248169-6376-47eb-92fa-bab71e04d2a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af56e617eb044cda510d91b3ea09a5f', 'request_id': 'req-11248169-6376-47eb-92fa-bab71e04d2a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:12.144159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11248169-6376-47eb-92fa-bab71e04d2a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af56e617eb044cda510d91b3ea09a5f', 'request_id': 'req-11248169-6376-47eb-92fa-bab71e04d2a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:12.189487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11248169-6376-47eb-92fa-bab71e04d2a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] The token cache is being invalidate because project 6af56e617eb044cda510d91b3ea09a5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:12.189899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11248169-6376-47eb-92fa-bab71e04d2a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:12.191113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11248169-6376-47eb-92fa-bab71e04d2a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:12.221714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11248169-6376-47eb-92fa-bab71e04d2a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6af56e617eb044cda510d91b3ea09a5f', 'request_id': 'req-11248169-6376-47eb-92fa-bab71e04d2a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:12.231202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11248169-6376-47eb-92fa-bab71e04d2a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6af56e617eb044cda510d91b3ea09a5f', 'request_id': 'req-11248169-6376-47eb-92fa-bab71e04d2a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:12.238682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11248169-6376-47eb-92fa-bab71e04d2a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6af56e617eb044cda510d91b3ea09a5f', 'request_id': 'req-11248169-6376-47eb-92fa-bab71e04d2a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:12.260743 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2498/4992] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:11 2022] DELETE /identity/v3/projects/6af56e617eb044cda510d91b3ea09a5f => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:12.265594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3c0e0-7431-4bbd-b83d-c75cdc7c02c5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:12.283870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3c0e0-7431-4bbd-b83d-c75cdc7c02c5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:12.353486 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:12.434600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b591e75-512b-468f-a0f9-92d1bb551f10 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:12.437162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b591e75-512b-468f-a0f9-92d1bb551f10 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:12.437477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b591e75-512b-468f-a0f9-92d1bb551f10 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:12.437861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b591e75-512b-468f-a0f9-92d1bb551f10 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:12.438523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b591e75-512b-468f-a0f9-92d1bb551f10 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:12.442641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b591e75-512b-468f-a0f9-92d1bb551f10 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:12.493303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11248169-6376-47eb-92fa-bab71e04d2a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:12.493947 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2495/4993] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:12 2022] POST /identity/v3/projects => generated 360 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:12.496836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-11248169-6376-47eb-92fa-bab71e04d2a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:12.529825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11248169-6376-47eb-92fa-bab71e04d2a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:12.567536 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=2,keystone:SELECT=87,keystone:DELETE=11 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:12.743837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d370b-890f-43d8-8f1e-00218cf351ad tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:12.744517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d370b-890f-43d8-8f1e-00218cf351ad tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:12.746517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d370b-890f-43d8-8f1e-00218cf351ad tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:12.748938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d370b-890f-43d8-8f1e-00218cf351ad tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/5db58abc9f824a3985fae95d1a84e4fa` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:12.752095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d370b-890f-43d8-8f1e-00218cf351ad tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:get_project(project_id=5db58abc9f824a3985fae95d1a84e4fa)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:12.756888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d370b-890f-43d8-8f1e-00218cf351ad tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:12.772275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b591e75-512b-468f-a0f9-92d1bb551f10 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:12.784878 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2499/4994] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:05:12 2022] GET /identity/v3/projects/5db58abc9f824a3985fae95d1a84e4fa => generated 360 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:12.792265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b591e75-512b-468f-a0f9-92d1bb551f10 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:12.809005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237663f6-1020-4a08-a478-4d4ba14de6bc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:12.809643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237663f6-1020-4a08-a478-4d4ba14de6bc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:12.810543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237663f6-1020-4a08-a478-4d4ba14de6bc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:12.810830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237663f6-1020-4a08-a478-4d4ba14de6bc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/5db58abc9f824a3985fae95d1a84e4fa` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:12.812377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237663f6-1020-4a08-a478-4d4ba14de6bc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5db58abc9f824a3985fae95d1a84e4fa)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:12.814920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237663f6-1020-4a08-a478-4d4ba14de6bc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:12.966067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-237663f6-1020-4a08-a478-4d4ba14de6bc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db58abc9f824a3985fae95d1a84e4fa', 'request_id': 'req-237663f6-1020-4a08-a478-4d4ba14de6bc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:12.982944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-237663f6-1020-4a08-a478-4d4ba14de6bc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db58abc9f824a3985fae95d1a84e4fa', 'request_id': 'req-237663f6-1020-4a08-a478-4d4ba14de6bc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:13.001139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-237663f6-1020-4a08-a478-4d4ba14de6bc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db58abc9f824a3985fae95d1a84e4fa', 'request_id': 'req-237663f6-1020-4a08-a478-4d4ba14de6bc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:13.036560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-237663f6-1020-4a08-a478-4d4ba14de6bc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] The token cache is being invalidate because project 5db58abc9f824a3985fae95d1a84e4fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:13.038439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-237663f6-1020-4a08-a478-4d4ba14de6bc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:13.039532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-237663f6-1020-4a08-a478-4d4ba14de6bc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:13.042391 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2496/4995] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:12 2022] DELETE /identity/v3/projects/5db58abc9f824a3985fae95d1a84e4fa => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:13.047196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d370b-890f-43d8-8f1e-00218cf351ad tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:13.049670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f29d370b-890f-43d8-8f1e-00218cf351ad tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:13.095002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d370b-890f-43d8-8f1e-00218cf351ad tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:13.221935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e168fc-5f50-492c-972d-77511d60dcbf tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:13.232346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e168fc-5f50-492c-972d-77511d60dcbf tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:13.232676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e168fc-5f50-492c-972d-77511d60dcbf tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:13.233026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e168fc-5f50-492c-972d-77511d60dcbf tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:13.233638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e168fc-5f50-492c-972d-77511d60dcbf tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:13.235528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e168fc-5f50-492c-972d-77511d60dcbf tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:13.237217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237663f6-1020-4a08-a478-4d4ba14de6bc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:13.239089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-237663f6-1020-4a08-a478-4d4ba14de6bc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:13.325060 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2500/4996] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:13 2022] POST /identity/v3/projects => generated 359 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:05:13.326233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e168fc-5f50-492c-972d-77511d60dcbf tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:13.382280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237663f6-1020-4a08-a478-4d4ba14de6bc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:13.469485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91219eb-8b7b-467b-8026-b0c9ec03d082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:13.471334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91219eb-8b7b-467b-8026-b0c9ec03d082 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:13.472746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91219eb-8b7b-467b-8026-b0c9ec03d082 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:13.473114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91219eb-8b7b-467b-8026-b0c9ec03d082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:13.477186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e91219eb-8b7b-467b-8026-b0c9ec03d082 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:13.490430 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:13.498253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e168fc-5f50-492c-972d-77511d60dcbf tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:13.502844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91219eb-8b7b-467b-8026-b0c9ec03d082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:13.506822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91219eb-8b7b-467b-8026-b0c9ec03d082 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:13.509692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df9f39-9ff8-43a4-ab77-49917fb5dd37 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:13.510554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df9f39-9ff8-43a4-ab77-49917fb5dd37 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:13.510938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df9f39-9ff8-43a4-ab77-49917fb5dd37 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:13.511766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df9f39-9ff8-43a4-ab77-49917fb5dd37 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/736493687939437fbe8cafdb3c9585e6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:13.514408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df9f39-9ff8-43a4-ab77-49917fb5dd37 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:get_project(project_id=736493687939437fbe8cafdb3c9585e6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:13.518267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df9f39-9ff8-43a4-ab77-49917fb5dd37 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:13.523859 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2501/4997] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:05:13 2022] GET /identity/v3/projects/736493687939437fbe8cafdb3c9585e6 => generated 359 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:13.525270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df9f39-9ff8-43a4-ab77-49917fb5dd37 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:13.529046 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2497/4998] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:05:13.539603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df9f39-9ff8-43a4-ab77-49917fb5dd37 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:13.556277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6598245-0aba-493d-a940-ac9429e8a0a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:13.557267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6598245-0aba-493d-a940-ac9429e8a0a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:13.557653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6598245-0aba-493d-a940-ac9429e8a0a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:13.558017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6598245-0aba-493d-a940-ac9429e8a0a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/736493687939437fbe8cafdb3c9585e6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:13.563097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6598245-0aba-493d-a940-ac9429e8a0a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:delete_project(project_id=736493687939437fbe8cafdb3c9585e6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:13.565518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6598245-0aba-493d-a940-ac9429e8a0a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:13.660975 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:13.669786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d6598245-0aba-493d-a940-ac9429e8a0a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '736493687939437fbe8cafdb3c9585e6', 'request_id': 'req-d6598245-0aba-493d-a940-ac9429e8a0a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:13.689807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d6598245-0aba-493d-a940-ac9429e8a0a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '736493687939437fbe8cafdb3c9585e6', 'request_id': 'req-d6598245-0aba-493d-a940-ac9429e8a0a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:13.698848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d6598245-0aba-493d-a940-ac9429e8a0a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '736493687939437fbe8cafdb3c9585e6', 'request_id': 'req-d6598245-0aba-493d-a940-ac9429e8a0a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:13.723245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d6598245-0aba-493d-a940-ac9429e8a0a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] The token cache is being invalidate because project 736493687939437fbe8cafdb3c9585e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:13.723245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d6598245-0aba-493d-a940-ac9429e8a0a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:13.725824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d6598245-0aba-493d-a940-ac9429e8a0a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:13.729418 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2502/4999] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:13 2022] DELETE /identity/v3/projects/736493687939437fbe8cafdb3c9585e6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:13.734116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91219eb-8b7b-467b-8026-b0c9ec03d082 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:13.749853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91219eb-8b7b-467b-8026-b0c9ec03d082 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:13.915701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8994a5-1be9-452b-b232-766ddb6f9459 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:13.916808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8994a5-1be9-452b-b232-766ddb6f9459 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:13.917180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8994a5-1be9-452b-b232-766ddb6f9459 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:13.917585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8994a5-1be9-452b-b232-766ddb6f9459 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:13.918426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8994a5-1be9-452b-b232-766ddb6f9459 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:13.922265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8994a5-1be9-452b-b232-766ddb6f9459 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:13.999068 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2498/5000] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Sep 30 10:05:13 2022] POST /identity/v3/projects => generated 346 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:14.004466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6598245-0aba-493d-a940-ac9429e8a0a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:14.007592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d6598245-0aba-493d-a940-ac9429e8a0a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:14.029535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6598245-0aba-493d-a940-ac9429e8a0a4 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:14.127770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e6c1b-be68-4ab9-9995-55b63b782e75 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:14.128622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e6c1b-be68-4ab9-9995-55b63b782e75 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:14.129005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e6c1b-be68-4ab9-9995-55b63b782e75 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:14.129377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e6c1b-be68-4ab9-9995-55b63b782e75 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/b540f128cc064568a9ed7c7f87020967` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:14.130704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e6c1b-be68-4ab9-9995-55b63b782e75 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:get_project(project_id=b540f128cc064568a9ed7c7f87020967)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:14.134332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e6c1b-be68-4ab9-9995-55b63b782e75 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:14.141053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8994a5-1be9-452b-b232-766ddb6f9459 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:14.150904 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2503/5001] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:05:14 2022] GET /identity/v3/projects/b540f128cc064568a9ed7c7f87020967 => generated 346 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:14.160560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8994a5-1be9-452b-b232-766ddb6f9459 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:14.166803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5251516-bca5-4cce-b216-833f4e998a4d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:14.167997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5251516-bca5-4cce-b216-833f4e998a4d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:14.168524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5251516-bca5-4cce-b216-833f4e998a4d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:14.170483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5251516-bca5-4cce-b216-833f4e998a4d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/b540f128cc064568a9ed7c7f87020967` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:14.175300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5251516-bca5-4cce-b216-833f4e998a4d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b540f128cc064568a9ed7c7f87020967)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:14.178357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5251516-bca5-4cce-b216-833f4e998a4d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:14.310922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c5251516-bca5-4cce-b216-833f4e998a4d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b540f128cc064568a9ed7c7f87020967', 'request_id': 'req-c5251516-bca5-4cce-b216-833f4e998a4d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:14.331682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c5251516-bca5-4cce-b216-833f4e998a4d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b540f128cc064568a9ed7c7f87020967', 'request_id': 'req-c5251516-bca5-4cce-b216-833f4e998a4d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:14.351825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c5251516-bca5-4cce-b216-833f4e998a4d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b540f128cc064568a9ed7c7f87020967', 'request_id': 'req-c5251516-bca5-4cce-b216-833f4e998a4d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:14.386955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c5251516-bca5-4cce-b216-833f4e998a4d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] The token cache is being invalidate because project b540f128cc064568a9ed7c7f87020967 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:14.387484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c5251516-bca5-4cce-b216-833f4e998a4d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:14.389059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c5251516-bca5-4cce-b216-833f4e998a4d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:14.399049 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2499/5002] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:14 2022] DELETE /identity/v3/projects/b540f128cc064568a9ed7c7f87020967 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:14.400908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e6c1b-be68-4ab9-9995-55b63b782e75 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:14.403958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6c2e6c1b-be68-4ab9-9995-55b63b782e75 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:14.455657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e6c1b-be68-4ab9-9995-55b63b782e75 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:14.595213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd12fd-936d-4dfd-ba5a-570cfc0ae0a6 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:14.595843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd12fd-936d-4dfd-ba5a-570cfc0ae0a6 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:14.596178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd12fd-936d-4dfd-ba5a-570cfc0ae0a6 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:14.596456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd12fd-936d-4dfd-ba5a-570cfc0ae0a6 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:14.597218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd12fd-936d-4dfd-ba5a-570cfc0ae0a6 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:14.598642 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-14cd12fd-936d-4dfd-ba5a-570cfc0ae0a6 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:05:14.598642 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:05:14.598642 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:05:14.600220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd12fd-936d-4dfd-ba5a-570cfc0ae0a6 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:14.634280 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2504/5003] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:05:14 2022] POST /identity/v3/domains => generated 276 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:14.634760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5251516-bca5-4cce-b216-833f4e998a4d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:14.647980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5251516-bca5-4cce-b216-833f4e998a4d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:14.753934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da1f17-fb99-48de-8780-d8e9166139ce tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:14.755205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da1f17-fb99-48de-8780-d8e9166139ce tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:14.755747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da1f17-fb99-48de-8780-d8e9166139ce tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:14.756375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da1f17-fb99-48de-8780-d8e9166139ce tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:14.759517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da1f17-fb99-48de-8780-d8e9166139ce tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:14.763572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da1f17-fb99-48de-8780-d8e9166139ce tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:14.769747 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:14.826826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd12fd-936d-4dfd-ba5a-570cfc0ae0a6 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:14.839689 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2500/5004] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:14 2022] POST /identity/v3/projects => generated 405 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:14.844400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd12fd-936d-4dfd-ba5a-570cfc0ae0a6 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:14.985402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e3967-4111-4c2e-a66c-492799928006 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:14.986787 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e3967-4111-4c2e-a66c-492799928006 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:14.987560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e3967-4111-4c2e-a66c-492799928006 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:14.987945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e3967-4111-4c2e-a66c-492799928006 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/8eb46f1d47a0417ab06082343245f729` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:14.990922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e3967-4111-4c2e-a66c-492799928006 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:get_project(project_id=8eb46f1d47a0417ab06082343245f729)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:14.995407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e3967-4111-4c2e-a66c-492799928006 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:15.009758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da1f17-fb99-48de-8780-d8e9166139ce tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:15.017935 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2505/5005] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:05:14 2022] GET /identity/v3/projects/8eb46f1d47a0417ab06082343245f729 => generated 405 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:15.027454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da1f17-fb99-48de-8780-d8e9166139ce tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:15.034576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6caa9-e25d-4234-ad08-4d6cbca5d043 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:15.035407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6caa9-e25d-4234-ad08-4d6cbca5d043 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:15.035688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6caa9-e25d-4234-ad08-4d6cbca5d043 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:15.037469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6caa9-e25d-4234-ad08-4d6cbca5d043 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/8eb46f1d47a0417ab06082343245f729` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:15.039171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6caa9-e25d-4234-ad08-4d6cbca5d043 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8eb46f1d47a0417ab06082343245f729)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:15.041750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6caa9-e25d-4234-ad08-4d6cbca5d043 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:15.159553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-15d6caa9-e25d-4234-ad08-4d6cbca5d043 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eb46f1d47a0417ab06082343245f729', 'request_id': 'req-15d6caa9-e25d-4234-ad08-4d6cbca5d043'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:15.178726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-15d6caa9-e25d-4234-ad08-4d6cbca5d043 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eb46f1d47a0417ab06082343245f729', 'request_id': 'req-15d6caa9-e25d-4234-ad08-4d6cbca5d043'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:15.188219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-15d6caa9-e25d-4234-ad08-4d6cbca5d043 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eb46f1d47a0417ab06082343245f729', 'request_id': 'req-15d6caa9-e25d-4234-ad08-4d6cbca5d043'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:15.212787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-15d6caa9-e25d-4234-ad08-4d6cbca5d043 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] The token cache is being invalidate because project 8eb46f1d47a0417ab06082343245f729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:15.213087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-15d6caa9-e25d-4234-ad08-4d6cbca5d043 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:15.213773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-15d6caa9-e25d-4234-ad08-4d6cbca5d043 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:15.222607 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2501/5006] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:15 2022] DELETE /identity/v3/projects/8eb46f1d47a0417ab06082343245f729 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:15.226482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e3967-4111-4c2e-a66c-492799928006 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:15.228385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e15e3967-4111-4c2e-a66c-492799928006 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:15.251587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e3967-4111-4c2e-a66c-492799928006 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:15.297320 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:15.379529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba34e1-214c-4a7a-9300-8c28142dd2b1 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:15.380007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba34e1-214c-4a7a-9300-8c28142dd2b1 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:15.380357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba34e1-214c-4a7a-9300-8c28142dd2b1 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:15.380654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba34e1-214c-4a7a-9300-8c28142dd2b1 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/domains/9115484e33194de1bb8972a429a98bd9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:15.384218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba34e1-214c-4a7a-9300-8c28142dd2b1 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9115484e33194de1bb8972a429a98bd9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:15.385381 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-5dba34e1-214c-4a7a-9300-8c28142dd2b1 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:05:15.385381 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:05:15.385381 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:05:15.392160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba34e1-214c-4a7a-9300-8c28142dd2b1 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:15.461711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5dba34e1-214c-4a7a-9300-8c28142dd2b1 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9115484e33194de1bb8972a429a98bd9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:15.462487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5dba34e1-214c-4a7a-9300-8c28142dd2b1 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9115484e33194de1bb8972a429a98bd9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:15.526870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5dba34e1-214c-4a7a-9300-8c28142dd2b1 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9115484e33194de1bb8972a429a98bd9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:15.527417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5dba34e1-214c-4a7a-9300-8c28142dd2b1 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9115484e33194de1bb8972a429a98bd9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:15.534065 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2506/5007] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:05:15 2022] PATCH /identity/v3/domains/9115484e33194de1bb8972a429a98bd9 => generated 277 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:15.537963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6caa9-e25d-4234-ad08-4d6cbca5d043 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:15.554540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6caa9-e25d-4234-ad08-4d6cbca5d043 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:15.695869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60930996-065e-499e-b449-b1d859f7059b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:15.696710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60930996-065e-499e-b449-b1d859f7059b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:15.696990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60930996-065e-499e-b449-b1d859f7059b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:15.733195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf17fb7-c892-45cc-a954-6836a5027258 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:15.734381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf17fb7-c892-45cc-a954-6836a5027258 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:15.734860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf17fb7-c892-45cc-a954-6836a5027258 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:15.735338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf17fb7-c892-45cc-a954-6836a5027258 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/domains/9115484e33194de1bb8972a429a98bd9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:15.763493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf17fb7-c892-45cc-a954-6836a5027258 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9115484e33194de1bb8972a429a98bd9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:15.765675 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-3bf17fb7-c892-45cc-a954-6836a5027258 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:05:15.765675 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:05:15.765675 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:05:15.767231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf17fb7-c892-45cc-a954-6836a5027258 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:15.790416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-60930996-065e-499e-b449-b1d859f7059b None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:15.791776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-60930996-065e-499e-b449-b1d859f7059b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:15.800088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3bf17fb7-c892-45cc-a954-6836a5027258 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9115484e33194de1bb8972a429a98bd9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:15.809116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3bf17fb7-c892-45cc-a954-6836a5027258 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9115484e33194de1bb8972a429a98bd9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:15.908143 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:15.931773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3bf17fb7-c892-45cc-a954-6836a5027258 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9115484e33194de1bb8972a429a98bd9', 'request_id': 'req-3bf17fb7-c892-45cc-a954-6836a5027258'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:15.957163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3bf17fb7-c892-45cc-a954-6836a5027258 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9115484e33194de1bb8972a429a98bd9', 'request_id': 'req-3bf17fb7-c892-45cc-a954-6836a5027258'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:15.975013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3bf17fb7-c892-45cc-a954-6836a5027258 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9115484e33194de1bb8972a429a98bd9', 'request_id': 'req-3bf17fb7-c892-45cc-a954-6836a5027258'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:16.012151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3bf17fb7-c892-45cc-a954-6836a5027258 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] The token cache is being invalidate because project 9115484e33194de1bb8972a429a98bd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:16.012521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3bf17fb7-c892-45cc-a954-6836a5027258 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:16.017089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3bf17fb7-c892-45cc-a954-6836a5027258 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:16.022409 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2507/5008] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 10:05:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:16.043133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3bf17fb7-c892-45cc-a954-6836a5027258 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9115484e33194de1bb8972a429a98bd9', 'request_id': 'req-3bf17fb7-c892-45cc-a954-6836a5027258'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:16.054608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3bf17fb7-c892-45cc-a954-6836a5027258 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9115484e33194de1bb8972a429a98bd9', 'request_id': 'req-3bf17fb7-c892-45cc-a954-6836a5027258'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:16.056360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60930996-065e-499e-b449-b1d859f7059b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:16.056942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3bf17fb7-c892-45cc-a954-6836a5027258 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9115484e33194de1bb8972a429a98bd9', 'request_id': 'req-3bf17fb7-c892-45cc-a954-6836a5027258'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:16.059150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-60930996-065e-499e-b449-b1d859f7059b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:16.071814 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2502/5009] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:05:15 2022] DELETE /identity/v3/domains/9115484e33194de1bb8972a429a98bd9 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:16.077849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf17fb7-c892-45cc-a954-6836a5027258 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:16.084632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3bf17fb7-c892-45cc-a954-6836a5027258 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:16.298506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf17fb7-c892-45cc-a954-6836a5027258 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:16.307029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60930996-065e-499e-b449-b1d859f7059b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:16.317032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742688d-c672-4205-bdd0-e6b0d169ebc2 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:16.318154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742688d-c672-4205-bdd0-e6b0d169ebc2 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:16.318621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742688d-c672-4205-bdd0-e6b0d169ebc2 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:16.319141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742688d-c672-4205-bdd0-e6b0d169ebc2 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:16.320104 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742688d-c672-4205-bdd0-e6b0d169ebc2 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:16.322730 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-6742688d-c672-4205-bdd0-e6b0d169ebc2 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:05:16.322730 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:05:16.322730 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:05:16.325938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742688d-c672-4205-bdd0-e6b0d169ebc2 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:16.326646 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:16.419379 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2503/5010] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:05:16 2022] POST /identity/v3/domains => generated 277 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:05:16.424592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742688d-c672-4205-bdd0-e6b0d169ebc2 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:16.563910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d254f-0414-4b64-ad51-25b9a1054403 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:16.567486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d254f-0414-4b64-ad51-25b9a1054403 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:16.567486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d254f-0414-4b64-ad51-25b9a1054403 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:16.567486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d254f-0414-4b64-ad51-25b9a1054403 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:16.585537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bc0d254f-0414-4b64-ad51-25b9a1054403 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:16.688960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742688d-c672-4205-bdd0-e6b0d169ebc2 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:16.713913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3cfda-6b80-451b-9df7-061396c72a0a tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:16.720176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3cfda-6b80-451b-9df7-061396c72a0a tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:16.720730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3cfda-6b80-451b-9df7-061396c72a0a tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:16.721909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3cfda-6b80-451b-9df7-061396c72a0a tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:16.726783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3cfda-6b80-451b-9df7-061396c72a0a tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:16.732761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3cfda-6b80-451b-9df7-061396c72a0a tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:16.855552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d254f-0414-4b64-ad51-25b9a1054403 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:16.857235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d254f-0414-4b64-ad51-25b9a1054403 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:16.859534 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2504/5011] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:16 2022] POST /identity/v3/projects => generated 409 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:16.864784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3cfda-6b80-451b-9df7-061396c72a0a tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:16.904397 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:16.931967 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2508/5012] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:05:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 877 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 10:05:17.139360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3cfda-6b80-451b-9df7-061396c72a0a tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:17.163336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c204c59-6e3b-47a2-af75-ab58831ad481 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:17.167692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c204c59-6e3b-47a2-af75-ab58831ad481 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:17.170791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c204c59-6e3b-47a2-af75-ab58831ad481 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:17.171097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c204c59-6e3b-47a2-af75-ab58831ad481 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:17.174674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c204c59-6e3b-47a2-af75-ab58831ad481 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:17.181339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c204c59-6e3b-47a2-af75-ab58831ad481 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:17.370703 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2505/5013] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:16 2022] POST /identity/v3/projects => generated 404 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:17.371701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d254f-0414-4b64-ad51-25b9a1054403 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:17.403202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d254f-0414-4b64-ad51-25b9a1054403 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:17.630757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681018e2-be3a-4b21-b4c2-3d79a212d18d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:17.631995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681018e2-be3a-4b21-b4c2-3d79a212d18d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:17.632729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681018e2-be3a-4b21-b4c2-3d79a212d18d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:17.633089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681018e2-be3a-4b21-b4c2-3d79a212d18d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/78b869e56c75475fb43ddc7ce049e989` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:17.634712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681018e2-be3a-4b21-b4c2-3d79a212d18d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:delete_project(project_id=78b869e56c75475fb43ddc7ce049e989)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:17.636776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681018e2-be3a-4b21-b4c2-3d79a212d18d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:17.766549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-681018e2-be3a-4b21-b4c2-3d79a212d18d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78b869e56c75475fb43ddc7ce049e989', 'request_id': 'req-681018e2-be3a-4b21-b4c2-3d79a212d18d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:17.779474 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:17.799554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-681018e2-be3a-4b21-b4c2-3d79a212d18d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78b869e56c75475fb43ddc7ce049e989', 'request_id': 'req-681018e2-be3a-4b21-b4c2-3d79a212d18d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:17.819139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-681018e2-be3a-4b21-b4c2-3d79a212d18d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78b869e56c75475fb43ddc7ce049e989', 'request_id': 'req-681018e2-be3a-4b21-b4c2-3d79a212d18d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:17.866280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-681018e2-be3a-4b21-b4c2-3d79a212d18d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] The token cache is being invalidate because project 78b869e56c75475fb43ddc7ce049e989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:17.875923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-681018e2-be3a-4b21-b4c2-3d79a212d18d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:17.877242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-681018e2-be3a-4b21-b4c2-3d79a212d18d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:17.881282 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2509/5014] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:17 2022] DELETE /identity/v3/projects/78b869e56c75475fb43ddc7ce049e989 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:17.887305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c204c59-6e3b-47a2-af75-ab58831ad481 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:17.889655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6c204c59-6e3b-47a2-af75-ab58831ad481 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:17.922582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c204c59-6e3b-47a2-af75-ab58831ad481 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:18.009269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b891644-c67a-4d44-9152-2710a000b535 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:18.010755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b891644-c67a-4d44-9152-2710a000b535 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:18.011460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b891644-c67a-4d44-9152-2710a000b535 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:18.012038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b891644-c67a-4d44-9152-2710a000b535 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/26afa976c1004685829138bf4aecb8a6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:18.013918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b891644-c67a-4d44-9152-2710a000b535 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:delete_project(project_id=26afa976c1004685829138bf4aecb8a6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:18.017406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b891644-c67a-4d44-9152-2710a000b535 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:18.113384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0b891644-c67a-4d44-9152-2710a000b535 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26afa976c1004685829138bf4aecb8a6', 'request_id': 'req-0b891644-c67a-4d44-9152-2710a000b535'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:18.123946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0b891644-c67a-4d44-9152-2710a000b535 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26afa976c1004685829138bf4aecb8a6', 'request_id': 'req-0b891644-c67a-4d44-9152-2710a000b535'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:18.136676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0b891644-c67a-4d44-9152-2710a000b535 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26afa976c1004685829138bf4aecb8a6', 'request_id': 'req-0b891644-c67a-4d44-9152-2710a000b535'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:18.154352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0b891644-c67a-4d44-9152-2710a000b535 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] The token cache is being invalidate because project 26afa976c1004685829138bf4aecb8a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:18.155062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0b891644-c67a-4d44-9152-2710a000b535 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:18.156814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0b891644-c67a-4d44-9152-2710a000b535 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:18.162196 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2506/5015] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:17 2022] DELETE /identity/v3/projects/26afa976c1004685829138bf4aecb8a6 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:18.163336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681018e2-be3a-4b21-b4c2-3d79a212d18d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:18.180014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681018e2-be3a-4b21-b4c2-3d79a212d18d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:18.323131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d03f55-bd86-4897-8599-2412e7301700 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:18.323797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d03f55-bd86-4897-8599-2412e7301700 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:18.324398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d03f55-bd86-4897-8599-2412e7301700 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:18.324708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d03f55-bd86-4897-8599-2412e7301700 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/domains/ba403ac5940d445c832d63081a1235fa` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:18.327876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d03f55-bd86-4897-8599-2412e7301700 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ba403ac5940d445c832d63081a1235fa)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:18.329793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d03f55-bd86-4897-8599-2412e7301700 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:18.439780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-74d03f55-bd86-4897-8599-2412e7301700 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ba403ac5940d445c832d63081a1235fa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:18.440628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-74d03f55-bd86-4897-8599-2412e7301700 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ba403ac5940d445c832d63081a1235fa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:18.506097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-74d03f55-bd86-4897-8599-2412e7301700 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ba403ac5940d445c832d63081a1235fa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:18.507227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-74d03f55-bd86-4897-8599-2412e7301700 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ba403ac5940d445c832d63081a1235fa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:18.515677 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2510/5016] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:05:18 2022] PATCH /identity/v3/domains/ba403ac5940d445c832d63081a1235fa => generated 278 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:18.517605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b891644-c67a-4d44-9152-2710a000b535 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:18.519090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0b891644-c67a-4d44-9152-2710a000b535 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:18.553999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b891644-c67a-4d44-9152-2710a000b535 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:18.581053 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:18.697785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:18.698409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:18.698690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:18.701275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/domains/ba403ac5940d445c832d63081a1235fa` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:18.738449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ba403ac5940d445c832d63081a1235fa)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:18.740157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:18.808468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ba403ac5940d445c832d63081a1235fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:18.820911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ba403ac5940d445c832d63081a1235fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:18.939329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba403ac5940d445c832d63081a1235fa', 'request_id': 'req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:18.958572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba403ac5940d445c832d63081a1235fa', 'request_id': 'req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:18.968151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba403ac5940d445c832d63081a1235fa', 'request_id': 'req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:18.995720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] The token cache is being invalidate because project ba403ac5940d445c832d63081a1235fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:18.996099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:18.997905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:19.024488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ba403ac5940d445c832d63081a1235fa', 'request_id': 'req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:19.033345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ba403ac5940d445c832d63081a1235fa', 'request_id': 'req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:19.034632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ba403ac5940d445c832d63081a1235fa', 'request_id': 'req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:19.047484 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2507/5017] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:05:18 2022] DELETE /identity/v3/domains/ba403ac5940d445c832d63081a1235fa => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:19.052372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d03f55-bd86-4897-8599-2412e7301700 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:19.054866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-74d03f55-bd86-4897-8599-2412e7301700 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:19.081531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d03f55-bd86-4897-8599-2412e7301700 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:19.222313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c1c4b-ceab-4002-ab7f-f14a31ada328 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:19.223017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c1c4b-ceab-4002-ab7f-f14a31ada328 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:19.223301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c1c4b-ceab-4002-ab7f-f14a31ada328 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:19.223627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c1c4b-ceab-4002-ab7f-f14a31ada328 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:19.227771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c1c4b-ceab-4002-ab7f-f14a31ada328 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:19.235041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c1c4b-ceab-4002-ab7f-f14a31ada328 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:19.299038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:19.300731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:19.302295 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2511/5018] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:19 2022] POST /identity/v3/projects => generated 377 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:19.330026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f025f61-fbc0-40a6-9fe5-21e6298e4f4f tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:19.459837 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:19.475343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faab313-97c3-411f-b5b4-b27a4cbc2773 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:19.476060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faab313-97c3-411f-b5b4-b27a4cbc2773 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:19.476397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faab313-97c3-411f-b5b4-b27a4cbc2773 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:19.476705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faab313-97c3-411f-b5b4-b27a4cbc2773 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/5df6aa29e875402a808b662a5e0e9840` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:19.481467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faab313-97c3-411f-b5b4-b27a4cbc2773 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:get_project(project_id=5df6aa29e875402a808b662a5e0e9840)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:19.483608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faab313-97c3-411f-b5b4-b27a4cbc2773 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:19.485834 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2508/5019] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:05:19 2022] GET /identity/v3/projects/5df6aa29e875402a808b662a5e0e9840 => generated 377 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:05:19.489843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c1c4b-ceab-4002-ab7f-f14a31ada328 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:19.504905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c1c4b-ceab-4002-ab7f-f14a31ada328 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:19.512938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1941a-c20f-42fd-a740-43cc41052420 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:19.513566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1941a-c20f-42fd-a740-43cc41052420 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:19.513874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1941a-c20f-42fd-a740-43cc41052420 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:19.514114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1941a-c20f-42fd-a740-43cc41052420 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:19.514763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1941a-c20f-42fd-a740-43cc41052420 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:19.518340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1941a-c20f-42fd-a740-43cc41052420 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:19.561074 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2512/5020] 10.222.0.16 () {58 vars in 1131 bytes} [Fri Sep 30 10:05:19 2022] GET /identity/v3/projects => generated 6151 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:19.565322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faab313-97c3-411f-b5b4-b27a4cbc2773 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:19.581052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faab313-97c3-411f-b5b4-b27a4cbc2773 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:19.587456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b7e53-29a5-4e2b-b684-3fb9a9e2e25a tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:19.588182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b7e53-29a5-4e2b-b684-3fb9a9e2e25a tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:19.588503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b7e53-29a5-4e2b-b684-3fb9a9e2e25a tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:19.589760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b7e53-29a5-4e2b-b684-3fb9a9e2e25a tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/5df6aa29e875402a808b662a5e0e9840` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:19.590993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b7e53-29a5-4e2b-b684-3fb9a9e2e25a tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5df6aa29e875402a808b662a5e0e9840)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:19.592915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b7e53-29a5-4e2b-b684-3fb9a9e2e25a tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:19.693142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c06b7e53-29a5-4e2b-b684-3fb9a9e2e25a tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5df6aa29e875402a808b662a5e0e9840', 'request_id': 'req-c06b7e53-29a5-4e2b-b684-3fb9a9e2e25a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:19.715712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c06b7e53-29a5-4e2b-b684-3fb9a9e2e25a tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5df6aa29e875402a808b662a5e0e9840', 'request_id': 'req-c06b7e53-29a5-4e2b-b684-3fb9a9e2e25a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:19.730413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c06b7e53-29a5-4e2b-b684-3fb9a9e2e25a tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5df6aa29e875402a808b662a5e0e9840', 'request_id': 'req-c06b7e53-29a5-4e2b-b684-3fb9a9e2e25a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:19.768996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c06b7e53-29a5-4e2b-b684-3fb9a9e2e25a tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] The token cache is being invalidate because project 5df6aa29e875402a808b662a5e0e9840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:19.771049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c06b7e53-29a5-4e2b-b684-3fb9a9e2e25a tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:19.772957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c06b7e53-29a5-4e2b-b684-3fb9a9e2e25a tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:19.777231 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2509/5021] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:19 2022] DELETE /identity/v3/projects/5df6aa29e875402a808b662a5e0e9840 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:05:19.782698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1941a-c20f-42fd-a740-43cc41052420 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:19.785304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9fb1941a-c20f-42fd-a740-43cc41052420 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:19.811338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1941a-c20f-42fd-a740-43cc41052420 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:19.826746 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=93,keystone:UPDATE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:19.990330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02c83d-6817-4b85-b90a-333235b45917 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:19.991235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02c83d-6817-4b85-b90a-333235b45917 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:19.991626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02c83d-6817-4b85-b90a-333235b45917 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:19.992013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02c83d-6817-4b85-b90a-333235b45917 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:19.993590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02c83d-6817-4b85-b90a-333235b45917 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:19.995377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02c83d-6817-4b85-b90a-333235b45917 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:20.055799 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2513/5022] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Sep 30 10:05:19 2022] POST /identity/v3/projects => generated 347 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:20.060140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b7e53-29a5-4e2b-b684-3fb9a9e2e25a tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:20.077033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b7e53-29a5-4e2b-b684-3fb9a9e2e25a tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:20.192029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec99a92-b887-4933-b9a0-50f33f54ec8d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:20.194125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec99a92-b887-4933-b9a0-50f33f54ec8d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:20.194665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec99a92-b887-4933-b9a0-50f33f54ec8d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:20.196216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec99a92-b887-4933-b9a0-50f33f54ec8d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/8ba3ec11f9b54759bcf2ba8230f2b0bb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:20.201353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec99a92-b887-4933-b9a0-50f33f54ec8d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:update_project(project_id=8ba3ec11f9b54759bcf2ba8230f2b0bb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:20.206263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec99a92-b887-4933-b9a0-50f33f54ec8d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:20.267394 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2510/5023] 10.222.0.16 () {60 vars in 1252 bytes} [Fri Sep 30 10:05:20 2022] PATCH /identity/v3/projects/8ba3ec11f9b54759bcf2ba8230f2b0bb => generated 361 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:20.271422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02c83d-6817-4b85-b90a-333235b45917 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:20.293531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02c83d-6817-4b85-b90a-333235b45917 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:20.308300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477074b8-4fe6-4ea8-9794-654121e970bb tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:20.310316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477074b8-4fe6-4ea8-9794-654121e970bb tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:20.310316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477074b8-4fe6-4ea8-9794-654121e970bb tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:20.310316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477074b8-4fe6-4ea8-9794-654121e970bb tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/8ba3ec11f9b54759bcf2ba8230f2b0bb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:20.335915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477074b8-4fe6-4ea8-9794-654121e970bb tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:get_project(project_id=8ba3ec11f9b54759bcf2ba8230f2b0bb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:20.338325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477074b8-4fe6-4ea8-9794-654121e970bb tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:20.344792 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2514/5024] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:05:20 2022] GET /identity/v3/projects/8ba3ec11f9b54759bcf2ba8230f2b0bb => generated 348 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:20.345346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec99a92-b887-4933-b9a0-50f33f54ec8d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:20.360269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec99a92-b887-4933-b9a0-50f33f54ec8d tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:20.367058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647326c6-6a2d-47e5-a32a-5e436d872f8b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:20.369121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647326c6-6a2d-47e5-a32a-5e436d872f8b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:20.369651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647326c6-6a2d-47e5-a32a-5e436d872f8b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:20.370033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647326c6-6a2d-47e5-a32a-5e436d872f8b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/8ba3ec11f9b54759bcf2ba8230f2b0bb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:20.371365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647326c6-6a2d-47e5-a32a-5e436d872f8b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8ba3ec11f9b54759bcf2ba8230f2b0bb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:20.373810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647326c6-6a2d-47e5-a32a-5e436d872f8b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:20.487633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-647326c6-6a2d-47e5-a32a-5e436d872f8b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ba3ec11f9b54759bcf2ba8230f2b0bb', 'request_id': 'req-647326c6-6a2d-47e5-a32a-5e436d872f8b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:20.490110 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:20.500877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-647326c6-6a2d-47e5-a32a-5e436d872f8b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ba3ec11f9b54759bcf2ba8230f2b0bb', 'request_id': 'req-647326c6-6a2d-47e5-a32a-5e436d872f8b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:20.514535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-647326c6-6a2d-47e5-a32a-5e436d872f8b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ba3ec11f9b54759bcf2ba8230f2b0bb', 'request_id': 'req-647326c6-6a2d-47e5-a32a-5e436d872f8b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:20.533348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-647326c6-6a2d-47e5-a32a-5e436d872f8b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] The token cache is being invalidate because project 8ba3ec11f9b54759bcf2ba8230f2b0bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:20.533956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-647326c6-6a2d-47e5-a32a-5e436d872f8b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:20.535468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-647326c6-6a2d-47e5-a32a-5e436d872f8b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:20.537370 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2511/5025] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:20 2022] DELETE /identity/v3/projects/8ba3ec11f9b54759bcf2ba8230f2b0bb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:05:20.542647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477074b8-4fe6-4ea8-9794-654121e970bb tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:20.544875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-477074b8-4fe6-4ea8-9794-654121e970bb tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:20.558854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477074b8-4fe6-4ea8-9794-654121e970bb tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:20.685330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f7651-f1c5-4ff9-91a1-e929ec4aaaeb tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:20.685997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f7651-f1c5-4ff9-91a1-e929ec4aaaeb tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:20.686320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f7651-f1c5-4ff9-91a1-e929ec4aaaeb tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:20.686657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f7651-f1c5-4ff9-91a1-e929ec4aaaeb tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:20.687290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f7651-f1c5-4ff9-91a1-e929ec4aaaeb tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:20.689409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f7651-f1c5-4ff9-91a1-e929ec4aaaeb tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:20.761266 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2515/5026] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:20 2022] POST /identity/v3/projects => generated 360 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:20.765781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647326c6-6a2d-47e5-a32a-5e436d872f8b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:20.788242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647326c6-6a2d-47e5-a32a-5e436d872f8b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:20.906162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6a34c-8d4e-4b04-8c49-a2fc93620456 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:20.907268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6a34c-8d4e-4b04-8c49-a2fc93620456 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:20.907767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6a34c-8d4e-4b04-8c49-a2fc93620456 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:20.908985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6a34c-8d4e-4b04-8c49-a2fc93620456 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/ed68af8d3b324c17a254528d0ce3ce41` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:20.911176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6a34c-8d4e-4b04-8c49-a2fc93620456 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:update_project(project_id=ed68af8d3b324c17a254528d0ce3ce41)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:20.914109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6a34c-8d4e-4b04-8c49-a2fc93620456 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:21.009122 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2512/5027] 10.222.0.16 () {60 vars in 1252 bytes} [Fri Sep 30 10:05:20 2022] PATCH /identity/v3/projects/ed68af8d3b324c17a254528d0ce3ce41 => generated 372 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:21.013521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f7651-f1c5-4ff9-91a1-e929ec4aaaeb tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:21.027313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f7651-f1c5-4ff9-91a1-e929ec4aaaeb tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:21.032079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50054e03-e9c6-4480-8fbe-6c0884d1326b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:21.032748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50054e03-e9c6-4480-8fbe-6c0884d1326b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:21.033028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50054e03-e9c6-4480-8fbe-6c0884d1326b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:21.033300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50054e03-e9c6-4480-8fbe-6c0884d1326b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/ed68af8d3b324c17a254528d0ce3ce41` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:21.048167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50054e03-e9c6-4480-8fbe-6c0884d1326b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:get_project(project_id=ed68af8d3b324c17a254528d0ce3ce41)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:21.050584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50054e03-e9c6-4480-8fbe-6c0884d1326b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:21.053407 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2516/5028] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:05:21 2022] GET /identity/v3/projects/ed68af8d3b324c17a254528d0ce3ce41 => generated 359 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:21.056931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6a34c-8d4e-4b04-8c49-a2fc93620456 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:21.070671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6a34c-8d4e-4b04-8c49-a2fc93620456 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:21.088312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b0628-e606-44d7-9bd0-3bf2c88e867b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:21.088312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b0628-e606-44d7-9bd0-3bf2c88e867b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:21.088312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b0628-e606-44d7-9bd0-3bf2c88e867b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:21.088615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b0628-e606-44d7-9bd0-3bf2c88e867b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/ed68af8d3b324c17a254528d0ce3ce41` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:21.089683 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b0628-e606-44d7-9bd0-3bf2c88e867b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ed68af8d3b324c17a254528d0ce3ce41)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:21.090988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b0628-e606-44d7-9bd0-3bf2c88e867b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:21.172204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-029b0628-e606-44d7-9bd0-3bf2c88e867b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed68af8d3b324c17a254528d0ce3ce41', 'request_id': 'req-029b0628-e606-44d7-9bd0-3bf2c88e867b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:21.183641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-029b0628-e606-44d7-9bd0-3bf2c88e867b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed68af8d3b324c17a254528d0ce3ce41', 'request_id': 'req-029b0628-e606-44d7-9bd0-3bf2c88e867b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:21.191394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-029b0628-e606-44d7-9bd0-3bf2c88e867b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed68af8d3b324c17a254528d0ce3ce41', 'request_id': 'req-029b0628-e606-44d7-9bd0-3bf2c88e867b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:21.206078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-029b0628-e606-44d7-9bd0-3bf2c88e867b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] The token cache is being invalidate because project ed68af8d3b324c17a254528d0ce3ce41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:21.206769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-029b0628-e606-44d7-9bd0-3bf2c88e867b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:21.208114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-029b0628-e606-44d7-9bd0-3bf2c88e867b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:21.210189 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2513/5029] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:21 2022] DELETE /identity/v3/projects/ed68af8d3b324c17a254528d0ce3ce41 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:21.216057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50054e03-e9c6-4480-8fbe-6c0884d1326b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:21.218529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-50054e03-e9c6-4480-8fbe-6c0884d1326b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:21.238863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50054e03-e9c6-4480-8fbe-6c0884d1326b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:21.309459 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:21.319995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c2040-0f62-4a83-8ca9-c4ebc17925ab tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:21.322014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c2040-0f62-4a83-8ca9-c4ebc17925ab tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:21.322014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c2040-0f62-4a83-8ca9-c4ebc17925ab tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:21.322525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c2040-0f62-4a83-8ca9-c4ebc17925ab tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:21.323662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c2040-0f62-4a83-8ca9-c4ebc17925ab tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:21.331905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c2040-0f62-4a83-8ca9-c4ebc17925ab tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:21.414091 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2517/5030] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:21 2022] POST /identity/v3/projects => generated 355 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:05:21.416436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b0628-e606-44d7-9bd0-3bf2c88e867b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:21.436649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b0628-e606-44d7-9bd0-3bf2c88e867b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:21.475239 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:21.589634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93eef4b-8089-4972-87d3-d5f5c0e3642b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:21.592471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93eef4b-8089-4972-87d3-d5f5c0e3642b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:21.593014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93eef4b-8089-4972-87d3-d5f5c0e3642b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:21.593708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93eef4b-8089-4972-87d3-d5f5c0e3642b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/652263dec9f3441796480db7a4457eea` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:21.596634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93eef4b-8089-4972-87d3-d5f5c0e3642b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:update_project(project_id=652263dec9f3441796480db7a4457eea)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:21.599728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93eef4b-8089-4972-87d3-d5f5c0e3642b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:21.702789 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2514/5031] 10.222.0.16 () {60 vars in 1252 bytes} [Fri Sep 30 10:05:21 2022] PATCH /identity/v3/projects/652263dec9f3441796480db7a4457eea => generated 368 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:21.705715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c2040-0f62-4a83-8ca9-c4ebc17925ab tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:21.731916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c2040-0f62-4a83-8ca9-c4ebc17925ab tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:21.756102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27fdbf-52f5-40dd-bbae-8e3863687cb3 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:21.756886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27fdbf-52f5-40dd-bbae-8e3863687cb3 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:21.757167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27fdbf-52f5-40dd-bbae-8e3863687cb3 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:21.757444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27fdbf-52f5-40dd-bbae-8e3863687cb3 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/652263dec9f3441796480db7a4457eea` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:21.783048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27fdbf-52f5-40dd-bbae-8e3863687cb3 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:get_project(project_id=652263dec9f3441796480db7a4457eea)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:21.786780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27fdbf-52f5-40dd-bbae-8e3863687cb3 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:21.789144 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2518/5032] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:05:21 2022] GET /identity/v3/projects/652263dec9f3441796480db7a4457eea => generated 355 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:21.793584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93eef4b-8089-4972-87d3-d5f5c0e3642b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:21.808220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93eef4b-8089-4972-87d3-d5f5c0e3642b tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:21.814016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17207db-f61d-4dd1-8606-41d9e2f88dc7 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:21.815281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17207db-f61d-4dd1-8606-41d9e2f88dc7 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:21.815669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17207db-f61d-4dd1-8606-41d9e2f88dc7 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:21.816445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17207db-f61d-4dd1-8606-41d9e2f88dc7 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/projects/652263dec9f3441796480db7a4457eea` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:21.818184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17207db-f61d-4dd1-8606-41d9e2f88dc7 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorizing `identity:delete_project(project_id=652263dec9f3441796480db7a4457eea)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:21.820517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17207db-f61d-4dd1-8606-41d9e2f88dc7 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:21.925699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d17207db-f61d-4dd1-8606-41d9e2f88dc7 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652263dec9f3441796480db7a4457eea', 'request_id': 'req-d17207db-f61d-4dd1-8606-41d9e2f88dc7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:21.946553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d17207db-f61d-4dd1-8606-41d9e2f88dc7 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652263dec9f3441796480db7a4457eea', 'request_id': 'req-d17207db-f61d-4dd1-8606-41d9e2f88dc7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:21.956217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d17207db-f61d-4dd1-8606-41d9e2f88dc7 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652263dec9f3441796480db7a4457eea', 'request_id': 'req-d17207db-f61d-4dd1-8606-41d9e2f88dc7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:21.974469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d17207db-f61d-4dd1-8606-41d9e2f88dc7 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] The token cache is being invalidate because project 652263dec9f3441796480db7a4457eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:21.974803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d17207db-f61d-4dd1-8606-41d9e2f88dc7 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:21.975429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d17207db-f61d-4dd1-8606-41d9e2f88dc7 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:21.977739 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2515/5033] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:21 2022] DELETE /identity/v3/projects/652263dec9f3441796480db7a4457eea => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:21.982654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27fdbf-52f5-40dd-bbae-8e3863687cb3 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:21.984859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1a27fdbf-52f5-40dd-bbae-8e3863687cb3 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:22.016779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27fdbf-52f5-40dd-bbae-8e3863687cb3 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:22.126878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b078f0-66c2-4108-b35b-be9e736292fc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:22.127393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b078f0-66c2-4108-b35b-be9e736292fc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:22.127744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b078f0-66c2-4108-b35b-be9e736292fc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:22.127939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b078f0-66c2-4108-b35b-be9e736292fc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/domains/ba403ac5940d445c832d63081a1235fa` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:22.136198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b078f0-66c2-4108-b35b-be9e736292fc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 10:05:22.141502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-25b078f0-66c2-4108-b35b-be9e736292fc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Could not find domain: ba403ac5940d445c832d63081a1235fa.: keystone.exception.DomainNotFound: Could not find domain: ba403ac5940d445c832d63081a1235fa. Sep 30 10:05:22.141502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:05:22.141502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 30 10:05:22.141502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 30 10:05:22.141502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 10:05:22.141502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 10:05:22.141502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 10:05:22.141502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 10:05:22.141502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ba403ac5940d445c832d63081a1235fa. Sep 30 10:05:22.141502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:05:22.141502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:05:22.141502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:05:22.141502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:05:22.141502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:05:22.141502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:05:22.141502 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:05:22.144907 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:05:22.144907 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:05:22.144907 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:05:22.144907 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:05:22.144907 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:05:22.144907 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:05:22.144907 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:05:22.144907 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 30 10:05:22.144907 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 30 10:05:22.144907 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 10:05:22.144907 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 10:05:22.144907 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 10:05:22.144907 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 10:05:22.144907 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:05:22.144907 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:05:22.144907 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:05:22.146388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:05:22.146388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:05:22.146388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:05:22.146388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:05:22.146388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 10:05:22.146388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:05:22.146388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:05:22.146388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:05:22.146388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:05:22.146388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:05:22.146388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:05:22.146388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:05:22.146388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:05:22.146388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 30 10:05:22.146388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 10:05:22.146388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ba403ac5940d445c832d63081a1235fa. Sep 30 10:05:22.146388 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:05:22.147760 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2519/5034] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:05:21 2022] PATCH /identity/v3/domains/ba403ac5940d445c832d63081a1235fa => generated 112 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:05:22.149764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17207db-f61d-4dd1-8606-41d9e2f88dc7 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:22.186469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17207db-f61d-4dd1-8606-41d9e2f88dc7 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:22.197175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f782d-eec1-4ef8-b3ee-a5775caedb79 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f5acba80c34012b1f65a7792fff501', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b305a0a3bd584602939e4beb71f1bfdf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:22.197838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f782d-eec1-4ef8-b3ee-a5775caedb79 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:22.200865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f782d-eec1-4ef8-b3ee-a5775caedb79 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:22.201152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f782d-eec1-4ef8-b3ee-a5775caedb79 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] PATH_INFO: `/v3/domains/9115484e33194de1bb8972a429a98bd9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:22.229903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f782d-eec1-4ef8-b3ee-a5775caedb79 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 10:05:22.246625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-0b4f782d-eec1-4ef8-b3ee-a5775caedb79 tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Could not find domain: 9115484e33194de1bb8972a429a98bd9.: keystone.exception.DomainNotFound: Could not find domain: 9115484e33194de1bb8972a429a98bd9. Sep 30 10:05:22.246625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:05:22.246625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 30 10:05:22.246625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 30 10:05:22.246625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 10:05:22.246625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 10:05:22.246625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 10:05:22.246625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 10:05:22.246625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9115484e33194de1bb8972a429a98bd9. Sep 30 10:05:22.246625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:05:22.246625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:05:22.246625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:05:22.246625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:05:22.246625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:05:22.246625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:05:22.246625 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:05:22.248372 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:05:22.248372 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:05:22.248372 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:05:22.248372 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:05:22.248372 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:05:22.248372 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:05:22.248372 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:05:22.248372 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 30 10:05:22.248372 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 30 10:05:22.248372 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 10:05:22.248372 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 10:05:22.248372 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 10:05:22.248372 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 10:05:22.248372 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:05:22.248372 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:05:22.248372 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:05:22.249883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:05:22.249883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:05:22.249883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:05:22.249883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:05:22.249883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 10:05:22.249883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:05:22.249883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:05:22.249883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:05:22.249883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:05:22.249883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:05:22.249883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:05:22.249883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:05:22.249883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:05:22.249883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 30 10:05:22.249883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 10:05:22.249883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9115484e33194de1bb8972a429a98bd9. Sep 30 10:05:22.249883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:05:22.252386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b078f0-66c2-4108-b35b-be9e736292fc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:22.254484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-25b078f0-66c2-4108-b35b-be9e736292fc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:22.254709 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2516/5035] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:05:22 2022] PATCH /identity/v3/domains/9115484e33194de1bb8972a429a98bd9 => generated 112 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:05:22.402838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b078f0-66c2-4108-b35b-be9e736292fc tempest-ProjectsTestJSON-892857371 tempest-ProjectsTestJSON-892857371-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:22.412922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b01c9a-38ce-4853-9cc9-b1313fd8ed7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:22.413593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b01c9a-38ce-4853-9cc9-b1313fd8ed7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:22.413836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b01c9a-38ce-4853-9cc9-b1313fd8ed7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:22.414104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b01c9a-38ce-4853-9cc9-b1313fd8ed7e admin admin] PATH_INFO: `/v3/users/3144f19e20944524b1e5fdd2887a038b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:22.417418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b01c9a-38ce-4853-9cc9-b1313fd8ed7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3144f19e20944524b1e5fdd2887a038b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:22.420819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b01c9a-38ce-4853-9cc9-b1313fd8ed7e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:22.565090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-68b01c9a-38ce-4853-9cc9-b1313fd8ed7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3144f19e20944524b1e5fdd2887a038b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:22.567370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-68b01c9a-38ce-4853-9cc9-b1313fd8ed7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3144f19e20944524b1e5fdd2887a038b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:22.587631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-68b01c9a-38ce-4853-9cc9-b1313fd8ed7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3144f19e20944524b1e5fdd2887a038b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:22.605599 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:22.614046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-68b01c9a-38ce-4853-9cc9-b1313fd8ed7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3144f19e20944524b1e5fdd2887a038b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:22.629558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-68b01c9a-38ce-4853-9cc9-b1313fd8ed7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3144f19e20944524b1e5fdd2887a038b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:22.644521 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2520/5036] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:05:22 2022] DELETE /identity/v3/users/3144f19e20944524b1e5fdd2887a038b => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:22.648650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cf60f-ec40-4743-a497-e5fb3e391065 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:22.649955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cf60f-ec40-4743-a497-e5fb3e391065 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:22.650532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cf60f-ec40-4743-a497-e5fb3e391065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:22.693483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c04cf60f-ec40-4743-a497-e5fb3e391065 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:22.695181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c04cf60f-ec40-4743-a497-e5fb3e391065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:22.895416 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2517/5037] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:22.945425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b01c9a-38ce-4853-9cc9-b1313fd8ed7e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:22.949753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-68b01c9a-38ce-4853-9cc9-b1313fd8ed7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:22.956707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cf60f-ec40-4743-a497-e5fb3e391065 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:22.958388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c04cf60f-ec40-4743-a497-e5fb3e391065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:23.008079 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:23.099607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b01c9a-38ce-4853-9cc9-b1313fd8ed7e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:23.113907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e87c5-bc49-428e-9073-9e2a26860653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:23.114806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e87c5-bc49-428e-9073-9e2a26860653 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:23.115083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e87c5-bc49-428e-9073-9e2a26860653 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:23.116803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e87c5-bc49-428e-9073-9e2a26860653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:23.120200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ef0e87c5-bc49-428e-9073-9e2a26860653 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:23.154530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cf60f-ec40-4743-a497-e5fb3e391065 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:23.159630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e87c5-bc49-428e-9073-9e2a26860653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:23.162345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e87c5-bc49-428e-9073-9e2a26860653 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:23.170051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71998bd-0af6-4c96-ab32-3b2dfa143697 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:23.171137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71998bd-0af6-4c96-ab32-3b2dfa143697 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:23.171565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71998bd-0af6-4c96-ab32-3b2dfa143697 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:23.171841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71998bd-0af6-4c96-ab32-3b2dfa143697 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:23.175394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b71998bd-0af6-4c96-ab32-3b2dfa143697 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:23.193868 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2521/5038] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:23.194769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e87c5-bc49-428e-9073-9e2a26860653 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:23.213633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71998bd-0af6-4c96-ab32-3b2dfa143697 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:23.216790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71998bd-0af6-4c96-ab32-3b2dfa143697 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:23.226501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e87c5-bc49-428e-9073-9e2a26860653 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:23.240542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2738e5-dea5-4ff9-9899-53bb7ed672cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:23.241193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2738e5-dea5-4ff9-9899-53bb7ed672cf service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:23.241478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2738e5-dea5-4ff9-9899-53bb7ed672cf service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:23.241748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2738e5-dea5-4ff9-9899-53bb7ed672cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:23.248068 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2518/5039] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:23.259021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2738e5-dea5-4ff9-9899-53bb7ed672cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:23.261565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2738e5-dea5-4ff9-9899-53bb7ed672cf service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:23.275791 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2522/5040] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:25.177877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71998bd-0af6-4c96-ab32-3b2dfa143697 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:25.179326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b71998bd-0af6-4c96-ab32-3b2dfa143697 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:25.198245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71998bd-0af6-4c96-ab32-3b2dfa143697 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:25.206394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05803ce3-5062-4dae-a8ab-21f974127cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:25.207261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05803ce3-5062-4dae-a8ab-21f974127cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:25.208021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05803ce3-5062-4dae-a8ab-21f974127cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:25.208315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05803ce3-5062-4dae-a8ab-21f974127cd9 admin admin] PATH_INFO: `/v3/projects/e7658fb592bb4a4583ec3bb735e1cbdb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:25.209796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05803ce3-5062-4dae-a8ab-21f974127cd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7658fb592bb4a4583ec3bb735e1cbdb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:25.212660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05803ce3-5062-4dae-a8ab-21f974127cd9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:25.329584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2738e5-dea5-4ff9-9899-53bb7ed672cf service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:25.331391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1f2738e5-dea5-4ff9-9899-53bb7ed672cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:25.357787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05803ce3-5062-4dae-a8ab-21f974127cd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7658fb592bb4a4583ec3bb735e1cbdb', 'request_id': 'req-05803ce3-5062-4dae-a8ab-21f974127cd9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:25.380668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05803ce3-5062-4dae-a8ab-21f974127cd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7658fb592bb4a4583ec3bb735e1cbdb', 'request_id': 'req-05803ce3-5062-4dae-a8ab-21f974127cd9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:25.389478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2738e5-dea5-4ff9-9899-53bb7ed672cf service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:25.390234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05803ce3-5062-4dae-a8ab-21f974127cd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7658fb592bb4a4583ec3bb735e1cbdb', 'request_id': 'req-05803ce3-5062-4dae-a8ab-21f974127cd9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:25.403682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05803ce3-5062-4dae-a8ab-21f974127cd9 admin admin] The token cache is being invalidate because project e7658fb592bb4a4583ec3bb735e1cbdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:25.404015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05803ce3-5062-4dae-a8ab-21f974127cd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:25.404696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05803ce3-5062-4dae-a8ab-21f974127cd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:25.406795 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2519/5041] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:25 2022] DELETE /identity/v3/projects/e7658fb592bb4a4583ec3bb735e1cbdb => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:25.410746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05803ce3-5062-4dae-a8ab-21f974127cd9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:25.412121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-05803ce3-5062-4dae-a8ab-21f974127cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:25.477180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a459d96-4e5a-441f-aab7-73307e2bbb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:25.477982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a459d96-4e5a-441f-aab7-73307e2bbb0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:25.478263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a459d96-4e5a-441f-aab7-73307e2bbb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:25.478533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a459d96-4e5a-441f-aab7-73307e2bbb0e admin admin] PATH_INFO: `/v3/users/76de66d46a57438f960c832cb8a70c2c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:25.480488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a459d96-4e5a-441f-aab7-73307e2bbb0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=76de66d46a57438f960c832cb8a70c2c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:25.482493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a459d96-4e5a-441f-aab7-73307e2bbb0e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:25.495459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05803ce3-5062-4dae-a8ab-21f974127cd9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:25.500949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699e82f-60fd-4d6f-9789-d0ff60f65f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:25.502200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699e82f-60fd-4d6f-9789-d0ff60f65f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:25.502611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699e82f-60fd-4d6f-9789-d0ff60f65f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:25.502970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699e82f-60fd-4d6f-9789-d0ff60f65f88 admin admin] PATH_INFO: `/v3/users/89f5acba80c34012b1f65a7792fff501` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:25.504115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699e82f-60fd-4d6f-9789-d0ff60f65f88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89f5acba80c34012b1f65a7792fff501)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:25.506201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699e82f-60fd-4d6f-9789-d0ff60f65f88 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:25.562115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8a459d96-4e5a-441f-aab7-73307e2bbb0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76de66d46a57438f960c832cb8a70c2c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:25.570537 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:25.573491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8a459d96-4e5a-441f-aab7-73307e2bbb0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76de66d46a57438f960c832cb8a70c2c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:25.587535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8a459d96-4e5a-441f-aab7-73307e2bbb0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76de66d46a57438f960c832cb8a70c2c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:25.605341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a699e82f-60fd-4d6f-9789-d0ff60f65f88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89f5acba80c34012b1f65a7792fff501'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:25.624984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8a459d96-4e5a-441f-aab7-73307e2bbb0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76de66d46a57438f960c832cb8a70c2c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:25.629183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a699e82f-60fd-4d6f-9789-d0ff60f65f88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89f5acba80c34012b1f65a7792fff501'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:25.630464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a699e82f-60fd-4d6f-9789-d0ff60f65f88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89f5acba80c34012b1f65a7792fff501'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:25.639108 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:25.642853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8a459d96-4e5a-441f-aab7-73307e2bbb0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76de66d46a57438f960c832cb8a70c2c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:25.647455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a699e82f-60fd-4d6f-9789-d0ff60f65f88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89f5acba80c34012b1f65a7792fff501'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:25.655484 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2523/5042] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:05:25 2022] DELETE /identity/v3/users/76de66d46a57438f960c832cb8a70c2c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:25.661706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a699e82f-60fd-4d6f-9789-d0ff60f65f88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89f5acba80c34012b1f65a7792fff501'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:25.668891 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2520/5043] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:05:25 2022] DELETE /identity/v3/users/89f5acba80c34012b1f65a7792fff501 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:05:26.615485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a459d96-4e5a-441f-aab7-73307e2bbb0e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:26.617006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8a459d96-4e5a-441f-aab7-73307e2bbb0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:26.695582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a459d96-4e5a-441f-aab7-73307e2bbb0e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:26.797042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fd9f9-9f58-4ed9-92a3-fdbeb04e1b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:26.798931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fd9f9-9f58-4ed9-92a3-fdbeb04e1b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:26.799386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fd9f9-9f58-4ed9-92a3-fdbeb04e1b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:26.799836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fd9f9-9f58-4ed9-92a3-fdbeb04e1b56 admin admin] PATH_INFO: `/v3/projects/4c4be7f7957749d5a232f9d0a47ec60c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:26.803564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fd9f9-9f58-4ed9-92a3-fdbeb04e1b56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c4be7f7957749d5a232f9d0a47ec60c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:26.805819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fd9f9-9f58-4ed9-92a3-fdbeb04e1b56 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:26.895315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-305fd9f9-9f58-4ed9-92a3-fdbeb04e1b56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c4be7f7957749d5a232f9d0a47ec60c', 'request_id': 'req-305fd9f9-9f58-4ed9-92a3-fdbeb04e1b56'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:26.906319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-305fd9f9-9f58-4ed9-92a3-fdbeb04e1b56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c4be7f7957749d5a232f9d0a47ec60c', 'request_id': 'req-305fd9f9-9f58-4ed9-92a3-fdbeb04e1b56'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:26.919912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-305fd9f9-9f58-4ed9-92a3-fdbeb04e1b56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c4be7f7957749d5a232f9d0a47ec60c', 'request_id': 'req-305fd9f9-9f58-4ed9-92a3-fdbeb04e1b56'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:26.933280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-305fd9f9-9f58-4ed9-92a3-fdbeb04e1b56 admin admin] The token cache is being invalidate because project 4c4be7f7957749d5a232f9d0a47ec60c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:26.933799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-305fd9f9-9f58-4ed9-92a3-fdbeb04e1b56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:26.934737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-305fd9f9-9f58-4ed9-92a3-fdbeb04e1b56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:26.936911 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2524/5044] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:26 2022] DELETE /identity/v3/projects/4c4be7f7957749d5a232f9d0a47ec60c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:26.941881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e99d1-50cf-4691-9dcd-a7779ee56c9c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:26.942708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e99d1-50cf-4691-9dcd-a7779ee56c9c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:26.942980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e99d1-50cf-4691-9dcd-a7779ee56c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:26.968357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-384e99d1-50cf-4691-9dcd-a7779ee56c9c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:26.969702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-384e99d1-50cf-4691-9dcd-a7779ee56c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:27.058257 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2521/5045] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:27.066808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1d9ea-3f4f-4ada-b802-52f0bb2fdd06 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:27.067156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1d9ea-3f4f-4ada-b802-52f0bb2fdd06 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:27.067611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1d9ea-3f4f-4ada-b802-52f0bb2fdd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:27.091770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7cd1d9ea-3f4f-4ada-b802-52f0bb2fdd06 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:27.093022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7cd1d9ea-3f4f-4ada-b802-52f0bb2fdd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:27.104638 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2525/5046] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:27.108649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e99d1-50cf-4691-9dcd-a7779ee56c9c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:27.126783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e99d1-50cf-4691-9dcd-a7779ee56c9c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:27.134842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5eb09-e796-4231-846f-bbdc9558de61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:27.135449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5eb09-e796-4231-846f-bbdc9558de61 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:27.135732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5eb09-e796-4231-846f-bbdc9558de61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:27.136001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5eb09-e796-4231-846f-bbdc9558de61 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:27.136701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5eb09-e796-4231-846f-bbdc9558de61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:05:27.137054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5eb09-e796-4231-846f-bbdc9558de61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:27.139273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5eb09-e796-4231-846f-bbdc9558de61 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:27.154967 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2522/5047] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:27.159298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1d9ea-3f4f-4ada-b802-52f0bb2fdd06 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:27.169160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1d9ea-3f4f-4ada-b802-52f0bb2fdd06 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:27.174492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc2d4d-072b-4cd4-9245-0fbfac1a12d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:27.175033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc2d4d-072b-4cd4-9245-0fbfac1a12d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:27.175321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc2d4d-072b-4cd4-9245-0fbfac1a12d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:27.175594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc2d4d-072b-4cd4-9245-0fbfac1a12d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:27.176220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc2d4d-072b-4cd4-9245-0fbfac1a12d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:27.178196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc2d4d-072b-4cd4-9245-0fbfac1a12d3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:27.212591 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2526/5048] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:27 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:27.213896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5eb09-e796-4231-846f-bbdc9558de61 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:27.232544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5eb09-e796-4231-846f-bbdc9558de61 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:27.306029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057484ff-cd3e-450d-8ab3-2e307e0f2724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:27.306647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057484ff-cd3e-450d-8ab3-2e307e0f2724 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:27.306928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057484ff-cd3e-450d-8ab3-2e307e0f2724 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:27.307201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057484ff-cd3e-450d-8ab3-2e307e0f2724 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:27.307901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057484ff-cd3e-450d-8ab3-2e307e0f2724 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:27.309949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057484ff-cd3e-450d-8ab3-2e307e0f2724 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:27.338792 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2523/5049] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:05:27 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:27.343192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc2d4d-072b-4cd4-9245-0fbfac1a12d3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:27.350417 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:27.358553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc2d4d-072b-4cd4-9245-0fbfac1a12d3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:27.365443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386ea47-2944-4520-b43e-8f083c25b185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:27.366223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386ea47-2944-4520-b43e-8f083c25b185 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:27.366606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386ea47-2944-4520-b43e-8f083c25b185 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:27.366977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386ea47-2944-4520-b43e-8f083c25b185 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:27.368652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386ea47-2944-4520-b43e-8f083c25b185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:27.370895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386ea47-2944-4520-b43e-8f083c25b185 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:27.387904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057484ff-cd3e-450d-8ab3-2e307e0f2724 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:27.393926 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2527/5050] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:27.399350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057484ff-cd3e-450d-8ab3-2e307e0f2724 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:27.405208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c7090-6d82-4c18-8b39-222de68eca77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:27.406031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c7090-6d82-4c18-8b39-222de68eca77 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:27.406409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c7090-6d82-4c18-8b39-222de68eca77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:27.406782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c7090-6d82-4c18-8b39-222de68eca77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:27.407553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c7090-6d82-4c18-8b39-222de68eca77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:27.410481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c7090-6d82-4c18-8b39-222de68eca77 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:27.452431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386ea47-2944-4520-b43e-8f083c25b185 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:27.463001 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2524/5051] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:27.471030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386ea47-2944-4520-b43e-8f083c25b185 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:27.479532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891d74e-bcc3-4ca7-9cf8-599dd9247566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:27.480717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891d74e-bcc3-4ca7-9cf8-599dd9247566 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:27.481246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891d74e-bcc3-4ca7-9cf8-599dd9247566 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:27.482061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891d74e-bcc3-4ca7-9cf8-599dd9247566 admin admin] PATH_INFO: `/v3/projects/563bf985d01748cc876bd869877e98ce/users/ba2d50cd7f9f42b1bb8eb9fe4cffbf10/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:27.551549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891d74e-bcc3-4ca7-9cf8-599dd9247566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=563bf985d01748cc876bd869877e98ce, user_id=ba2d50cd7f9f42b1bb8eb9fe4cffbf10, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:27.554784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891d74e-bcc3-4ca7-9cf8-599dd9247566 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:27.577502 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2528/5052] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:05:27 2022] PUT /identity/v3/projects/563bf985d01748cc876bd869877e98ce/users/ba2d50cd7f9f42b1bb8eb9fe4cffbf10/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:27.587237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e0664-896b-4c9c-8fcf-a6b9ee27d7d2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:27.587581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e0664-896b-4c9c-8fcf-a6b9ee27d7d2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:27.587797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e0664-896b-4c9c-8fcf-a6b9ee27d7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:27.650940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-063e0664-896b-4c9c-8fcf-a6b9ee27d7d2 None None] MFA Rules not processed for user `ba2d50cd7f9f42b1bb8eb9fe4cffbf10`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:27.652464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-063e0664-896b-4c9c-8fcf-a6b9ee27d7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:27.659741 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:27.737679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891d74e-bcc3-4ca7-9cf8-599dd9247566 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:27.739721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4891d74e-bcc3-4ca7-9cf8-599dd9247566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:27.786987 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2525/5053] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:27.799525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e0664-896b-4c9c-8fcf-a6b9ee27d7d2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:27.801581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-063e0664-896b-4c9c-8fcf-a6b9ee27d7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:27.914114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891d74e-bcc3-4ca7-9cf8-599dd9247566 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:27.936082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b010f-0b7c-4f9d-b45d-2a4585ce36f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:27.936768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b010f-0b7c-4f9d-b45d-2a4585ce36f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:27.937025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b010f-0b7c-4f9d-b45d-2a4585ce36f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:27.937304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b010f-0b7c-4f9d-b45d-2a4585ce36f8 admin admin] PATH_INFO: `/v3/projects/b305a0a3bd584602939e4beb71f1bfdf` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:27.942387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b010f-0b7c-4f9d-b45d-2a4585ce36f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b305a0a3bd584602939e4beb71f1bfdf)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:27.944352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b010f-0b7c-4f9d-b45d-2a4585ce36f8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:27.998938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e0664-896b-4c9c-8fcf-a6b9ee27d7d2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:28.017980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653927a9-c6ee-4906-ba61-16fa1ff45fe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:28.019857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653927a9-c6ee-4906-ba61-16fa1ff45fe4 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:28.020168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653927a9-c6ee-4906-ba61-16fa1ff45fe4 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:28.020412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653927a9-c6ee-4906-ba61-16fa1ff45fe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:28.041734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653927a9-c6ee-4906-ba61-16fa1ff45fe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:28.049820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653927a9-c6ee-4906-ba61-16fa1ff45fe4 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:28.105115 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2526/5054] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:05:28.112332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bd1b010f-0b7c-4f9d-b45d-2a4585ce36f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b305a0a3bd584602939e4beb71f1bfdf', 'request_id': 'req-bd1b010f-0b7c-4f9d-b45d-2a4585ce36f8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:28.131419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bd1b010f-0b7c-4f9d-b45d-2a4585ce36f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b305a0a3bd584602939e4beb71f1bfdf', 'request_id': 'req-bd1b010f-0b7c-4f9d-b45d-2a4585ce36f8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:28.159414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bd1b010f-0b7c-4f9d-b45d-2a4585ce36f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b305a0a3bd584602939e4beb71f1bfdf', 'request_id': 'req-bd1b010f-0b7c-4f9d-b45d-2a4585ce36f8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:28.191754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bd1b010f-0b7c-4f9d-b45d-2a4585ce36f8 admin admin] The token cache is being invalidate because project b305a0a3bd584602939e4beb71f1bfdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:28.192046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bd1b010f-0b7c-4f9d-b45d-2a4585ce36f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:28.192809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bd1b010f-0b7c-4f9d-b45d-2a4585ce36f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:28.194635 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2529/5055] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:27 2022] DELETE /identity/v3/projects/b305a0a3bd584602939e4beb71f1bfdf => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:28.202735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e38f36-2154-4764-ab8d-8ca1be7b71b3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:28.203356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e38f36-2154-4764-ab8d-8ca1be7b71b3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:28.203877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e38f36-2154-4764-ab8d-8ca1be7b71b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:28.268857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b4e38f36-2154-4764-ab8d-8ca1be7b71b3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:28.271814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b4e38f36-2154-4764-ab8d-8ca1be7b71b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:28.418070 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2527/5056] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:28.427168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae11e6-e37d-4f12-a18f-4c3f7c3a880c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:28.427706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae11e6-e37d-4f12-a18f-4c3f7c3a880c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:28.428139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae11e6-e37d-4f12-a18f-4c3f7c3a880c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:28.475545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5aae11e6-e37d-4f12-a18f-4c3f7c3a880c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:28.477467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5aae11e6-e37d-4f12-a18f-4c3f7c3a880c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:28.503009 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2530/5057] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:28.504616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e38f36-2154-4764-ab8d-8ca1be7b71b3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:28.531164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e38f36-2154-4764-ab8d-8ca1be7b71b3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:28.555457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27774d3-ed70-4195-8e9d-376d2000a3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:28.557092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27774d3-ed70-4195-8e9d-376d2000a3af admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:28.557435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27774d3-ed70-4195-8e9d-376d2000a3af admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:28.557779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27774d3-ed70-4195-8e9d-376d2000a3af admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:28.562606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27774d3-ed70-4195-8e9d-376d2000a3af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:05:28.563002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27774d3-ed70-4195-8e9d-376d2000a3af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:28.564904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27774d3-ed70-4195-8e9d-376d2000a3af admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:28.596259 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2528/5058] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:28.598300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae11e6-e37d-4f12-a18f-4c3f7c3a880c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:28.612867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae11e6-e37d-4f12-a18f-4c3f7c3a880c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:28.622920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbb57f-0c93-469c-ae82-cf56492c307f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:28.624022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbb57f-0c93-469c-ae82-cf56492c307f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:28.624497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbb57f-0c93-469c-ae82-cf56492c307f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:28.625225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbb57f-0c93-469c-ae82-cf56492c307f admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:28.636786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbb57f-0c93-469c-ae82-cf56492c307f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:28.639036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27774d3-ed70-4195-8e9d-376d2000a3af admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:28.641019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f27774d3-ed70-4195-8e9d-376d2000a3af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:28.642019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbb57f-0c93-469c-ae82-cf56492c307f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:28.671256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27774d3-ed70-4195-8e9d-376d2000a3af admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:28.688315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799150f-867e-467c-a13c-4ace22d5c4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:28.690504 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799150f-867e-467c-a13c-4ace22d5c4c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:28.691054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799150f-867e-467c-a13c-4ace22d5c4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:28.691526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799150f-867e-467c-a13c-4ace22d5c4c0 admin admin] PATH_INFO: `/v3/users/ba2d50cd7f9f42b1bb8eb9fe4cffbf10` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:28.695194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799150f-867e-467c-a13c-4ace22d5c4c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba2d50cd7f9f42b1bb8eb9fe4cffbf10)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:28.701843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799150f-867e-467c-a13c-4ace22d5c4c0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:28.743429 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:28.759178 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2531/5059] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:28 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:28.760167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbb57f-0c93-469c-ae82-cf56492c307f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:28.831167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6799150f-867e-467c-a13c-4ace22d5c4c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba2d50cd7f9f42b1bb8eb9fe4cffbf10'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:28.850692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6799150f-867e-467c-a13c-4ace22d5c4c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba2d50cd7f9f42b1bb8eb9fe4cffbf10'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:28.851771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6799150f-867e-467c-a13c-4ace22d5c4c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba2d50cd7f9f42b1bb8eb9fe4cffbf10'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:28.884240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6799150f-867e-467c-a13c-4ace22d5c4c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba2d50cd7f9f42b1bb8eb9fe4cffbf10'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:28.901190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6799150f-867e-467c-a13c-4ace22d5c4c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba2d50cd7f9f42b1bb8eb9fe4cffbf10'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:28.916101 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2529/5060] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:05:28 2022] DELETE /identity/v3/users/ba2d50cd7f9f42b1bb8eb9fe4cffbf10 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:28.920803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c906e-d733-4b7b-a5f4-4bb06c6d711a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:28.921409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c906e-d733-4b7b-a5f4-4bb06c6d711a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:28.922515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c906e-d733-4b7b-a5f4-4bb06c6d711a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:28.967949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-734c906e-d733-4b7b-a5f4-4bb06c6d711a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:28.969580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-734c906e-d733-4b7b-a5f4-4bb06c6d711a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:29.057162 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:29.110817 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2530/5061] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:29.121612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbb57f-0c93-469c-ae82-cf56492c307f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:29.131090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df446c6c-ffda-4955-9746-3c400b041d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:29.131993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df446c6c-ffda-4955-9746-3c400b041d48 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:29.134235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df446c6c-ffda-4955-9746-3c400b041d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:29.134610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df446c6c-ffda-4955-9746-3c400b041d48 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:29.135642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df446c6c-ffda-4955-9746-3c400b041d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:29.138326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df446c6c-ffda-4955-9746-3c400b041d48 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:29.192868 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2532/5062] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:05:28 2022] POST /identity/v3/users => generated 296 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:29.193206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c906e-d733-4b7b-a5f4-4bb06c6d711a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:29.194626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-734c906e-d733-4b7b-a5f4-4bb06c6d711a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:29.220191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c906e-d733-4b7b-a5f4-4bb06c6d711a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:29.227988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145fb0f-5d20-4e21-b1f1-fb97d80af452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:29.228733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145fb0f-5d20-4e21-b1f1-fb97d80af452 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:29.229076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145fb0f-5d20-4e21-b1f1-fb97d80af452 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:29.229418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145fb0f-5d20-4e21-b1f1-fb97d80af452 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:29.230691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145fb0f-5d20-4e21-b1f1-fb97d80af452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:29.232554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145fb0f-5d20-4e21-b1f1-fb97d80af452 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:29.234488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df446c6c-ffda-4955-9746-3c400b041d48 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:29.239195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-df446c6c-ffda-4955-9746-3c400b041d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:29.266185 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2531/5063] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:29.267955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145fb0f-5d20-4e21-b1f1-fb97d80af452 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:29.287166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145fb0f-5d20-4e21-b1f1-fb97d80af452 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:29.293724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7e96a-ba38-4d4f-a872-c9e816c7c08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:29.294556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7e96a-ba38-4d4f-a872-c9e816c7c08e admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:29.295820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7e96a-ba38-4d4f-a872-c9e816c7c08e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:29.296164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7e96a-ba38-4d4f-a872-c9e816c7c08e admin admin] PATH_INFO: `/v3/projects/622712e8c6784c7b8df350459cfbe560/users/881426c03ae34859916c30765cfaec37/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:29.335715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7e96a-ba38-4d4f-a872-c9e816c7c08e admin admin] RBAC: Authorizing `identity:create_grant(project_id=622712e8c6784c7b8df350459cfbe560, user_id=881426c03ae34859916c30765cfaec37, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:29.342094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7e96a-ba38-4d4f-a872-c9e816c7c08e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:29.363511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df446c6c-ffda-4955-9746-3c400b041d48 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:29.381334 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2532/5064] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:05:29 2022] PUT /identity/v3/projects/622712e8c6784c7b8df350459cfbe560/users/881426c03ae34859916c30765cfaec37/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:29.384186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7e96a-ba38-4d4f-a872-c9e816c7c08e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:29.458931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e31956-f4f7-470e-a84a-9349298089ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:29.459956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e31956-f4f7-470e-a84a-9349298089ec service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:29.460238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e31956-f4f7-470e-a84a-9349298089ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:29.460880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e31956-f4f7-470e-a84a-9349298089ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:29.550338 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:29.559196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7e96a-ba38-4d4f-a872-c9e816c7c08e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:29.573790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c111cb-2a2a-46d6-a96d-e45e94e461f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:29.574417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c111cb-2a2a-46d6-a96d-e45e94e461f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:29.574697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c111cb-2a2a-46d6-a96d-e45e94e461f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:29.574970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c111cb-2a2a-46d6-a96d-e45e94e461f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:29.575630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c111cb-2a2a-46d6-a96d-e45e94e461f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:29.587036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c111cb-2a2a-46d6-a96d-e45e94e461f6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:29.609566 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2533/5065] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:29.615146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e31956-f4f7-470e-a84a-9349298089ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:29.618029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c111cb-2a2a-46d6-a96d-e45e94e461f6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:29.618853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e31956-f4f7-470e-a84a-9349298089ec service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:29.634655 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2533/5066] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:29.651664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c111cb-2a2a-46d6-a96d-e45e94e461f6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:29.656920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fcfab-0311-45a6-b86e-2de01912ffed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:29.657620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fcfab-0311-45a6-b86e-2de01912ffed admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:29.658487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fcfab-0311-45a6-b86e-2de01912ffed admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:29.658792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fcfab-0311-45a6-b86e-2de01912ffed admin admin] PATH_INFO: `/v3/projects/622712e8c6784c7b8df350459cfbe560/users/881426c03ae34859916c30765cfaec37/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:29.660912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fcfab-0311-45a6-b86e-2de01912ffed admin admin] RBAC: Authorizing `identity:create_grant(project_id=622712e8c6784c7b8df350459cfbe560, user_id=881426c03ae34859916c30765cfaec37, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:29.665581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fcfab-0311-45a6-b86e-2de01912ffed admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:29.707228 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2534/5067] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:05:29 2022] PUT /identity/v3/projects/622712e8c6784c7b8df350459cfbe560/users/881426c03ae34859916c30765cfaec37/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:29.709067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9174f00-1ebd-4fcc-8ddb-2a02072f651b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:29.709353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9174f00-1ebd-4fcc-8ddb-2a02072f651b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:29.709624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9174f00-1ebd-4fcc-8ddb-2a02072f651b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:29.777991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c9174f00-1ebd-4fcc-8ddb-2a02072f651b None None] MFA Rules not processed for user `881426c03ae34859916c30765cfaec37`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:29.779242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c9174f00-1ebd-4fcc-8ddb-2a02072f651b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:29.803660 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:29.910872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fcfab-0311-45a6-b86e-2de01912ffed admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:29.918981 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2534/5068] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:29 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:30.069190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fcfab-0311-45a6-b86e-2de01912ffed admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:30.077083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26df41c-6b87-406b-a972-cf2fb31b5ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:30.077722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26df41c-6b87-406b-a972-cf2fb31b5ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:30.078004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26df41c-6b87-406b-a972-cf2fb31b5ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:30.078714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26df41c-6b87-406b-a972-cf2fb31b5ce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:30.080062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26df41c-6b87-406b-a972-cf2fb31b5ce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:30.082796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26df41c-6b87-406b-a972-cf2fb31b5ce3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:30.170661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9174f00-1ebd-4fcc-8ddb-2a02072f651b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:30.194791 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2535/5069] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:29 2022] POST /identity/v3/projects => generated 381 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:30.211981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9174f00-1ebd-4fcc-8ddb-2a02072f651b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:30.379261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90930f2-7021-4881-9829-7341eeaf70a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:30.379987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90930f2-7021-4881-9829-7341eeaf70a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:30.381222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90930f2-7021-4881-9829-7341eeaf70a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:30.381514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90930f2-7021-4881-9829-7341eeaf70a8 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:30.382574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90930f2-7021-4881-9829-7341eeaf70a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:30.386036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90930f2-7021-4881-9829-7341eeaf70a8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:30.432773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26df41c-6b87-406b-a972-cf2fb31b5ce3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:30.443093 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2535/5070] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:05:30 2022] POST /identity/v3/users => generated 291 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:30.464032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26df41c-6b87-406b-a972-cf2fb31b5ce3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:30.494525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866c9ff-0090-468f-bbc4-5edcc0cd5e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:30.494994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866c9ff-0090-468f-bbc4-5edcc0cd5e75 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:30.495279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866c9ff-0090-468f-bbc4-5edcc0cd5e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:30.495551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866c9ff-0090-468f-bbc4-5edcc0cd5e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:30.496211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866c9ff-0090-468f-bbc4-5edcc0cd5e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:30.509802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866c9ff-0090-468f-bbc4-5edcc0cd5e75 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:30.539278 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2536/5071] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:30.542984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90930f2-7021-4881-9829-7341eeaf70a8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:30.556198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90930f2-7021-4881-9829-7341eeaf70a8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:30.572056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38596f7-31e3-4228-8535-565fae08dc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:30.573448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38596f7-31e3-4228-8535-565fae08dc75 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:30.573448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38596f7-31e3-4228-8535-565fae08dc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:30.573448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38596f7-31e3-4228-8535-565fae08dc75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:30.582791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38596f7-31e3-4228-8535-565fae08dc75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:30.587209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38596f7-31e3-4228-8535-565fae08dc75 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:30.608416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866c9ff-0090-468f-bbc4-5edcc0cd5e75 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:30.622392 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2536/5072] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:30.634447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866c9ff-0090-468f-bbc4-5edcc0cd5e75 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:30.653121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491156c0-6a52-45fe-82c2-886411b576e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:30.654332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491156c0-6a52-45fe-82c2-886411b576e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:30.654817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491156c0-6a52-45fe-82c2-886411b576e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:30.655249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491156c0-6a52-45fe-82c2-886411b576e2 admin admin] PATH_INFO: `/v3/projects/4c4a6ac63c294ef49273d1096643db2a/users/08db91ed81314304b660594693f4ffe9/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:30.709652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491156c0-6a52-45fe-82c2-886411b576e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4a6ac63c294ef49273d1096643db2a, user_id=08db91ed81314304b660594693f4ffe9, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:30.714652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491156c0-6a52-45fe-82c2-886411b576e2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:30.751366 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2537/5073] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:05:30 2022] PUT /identity/v3/projects/4c4a6ac63c294ef49273d1096643db2a/users/08db91ed81314304b660594693f4ffe9/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:05:30.754118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db047a72-0587-4cea-9667-e3827169e2c2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:30.754603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db047a72-0587-4cea-9667-e3827169e2c2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:30.755033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db047a72-0587-4cea-9667-e3827169e2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:30.828299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-db047a72-0587-4cea-9667-e3827169e2c2 None None] MFA Rules not processed for user `08db91ed81314304b660594693f4ffe9`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:30.829617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-db047a72-0587-4cea-9667-e3827169e2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:30.938407 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2537/5074] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:30.953229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491156c0-6a52-45fe-82c2-886411b576e2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:30.955286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-491156c0-6a52-45fe-82c2-886411b576e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:31.099826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491156c0-6a52-45fe-82c2-886411b576e2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:31.107246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659b485-62ac-4db1-b6f7-827c0341913d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:31.108029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659b485-62ac-4db1-b6f7-827c0341913d service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:31.108413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659b485-62ac-4db1-b6f7-827c0341913d service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:31.108887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659b485-62ac-4db1-b6f7-827c0341913d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:31.175875 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:31.262806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659b485-62ac-4db1-b6f7-827c0341913d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:31.267892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659b485-62ac-4db1-b6f7-827c0341913d service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:31.303288 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2538/5075] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:30 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:32.408126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db047a72-0587-4cea-9667-e3827169e2c2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:32.412617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-db047a72-0587-4cea-9667-e3827169e2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:32.487384 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:32.550676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db047a72-0587-4cea-9667-e3827169e2c2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:32.558476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532f4b2-e772-48ab-b0a1-ad10392e67c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:32.560252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532f4b2-e772-48ab-b0a1-ad10392e67c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:32.560800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532f4b2-e772-48ab-b0a1-ad10392e67c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:32.561358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532f4b2-e772-48ab-b0a1-ad10392e67c9 admin admin] PATH_INFO: `/v3/projects/563bf985d01748cc876bd869877e98ce` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:32.562971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532f4b2-e772-48ab-b0a1-ad10392e67c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=563bf985d01748cc876bd869877e98ce)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:32.566140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532f4b2-e772-48ab-b0a1-ad10392e67c9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:32.643656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659b485-62ac-4db1-b6f7-827c0341913d service glance] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:32.662917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659b485-62ac-4db1-b6f7-827c0341913d service glance] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:32.675225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b3e68-10d4-4efc-b09f-3d3fd0e652e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:32.677820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b3e68-10d4-4efc-b09f-3d3fd0e652e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:32.678808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b3e68-10d4-4efc-b09f-3d3fd0e652e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:32.679235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b3e68-10d4-4efc-b09f-3d3fd0e652e8 admin admin] PATH_INFO: `/v3/users/881426c03ae34859916c30765cfaec37` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:32.683155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b3e68-10d4-4efc-b09f-3d3fd0e652e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=881426c03ae34859916c30765cfaec37)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:32.689852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b3e68-10d4-4efc-b09f-3d3fd0e652e8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:32.744116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f532f4b2-e772-48ab-b0a1-ad10392e67c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '563bf985d01748cc876bd869877e98ce', 'request_id': 'req-f532f4b2-e772-48ab-b0a1-ad10392e67c9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:32.764882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f532f4b2-e772-48ab-b0a1-ad10392e67c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '563bf985d01748cc876bd869877e98ce', 'request_id': 'req-f532f4b2-e772-48ab-b0a1-ad10392e67c9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:32.779012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f532f4b2-e772-48ab-b0a1-ad10392e67c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '563bf985d01748cc876bd869877e98ce', 'request_id': 'req-f532f4b2-e772-48ab-b0a1-ad10392e67c9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:32.800134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f532f4b2-e772-48ab-b0a1-ad10392e67c9 admin admin] The token cache is being invalidate because project 563bf985d01748cc876bd869877e98ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:32.800818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f532f4b2-e772-48ab-b0a1-ad10392e67c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:32.801665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f532f4b2-e772-48ab-b0a1-ad10392e67c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:32.804890 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2538/5076] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:32 2022] DELETE /identity/v3/projects/563bf985d01748cc876bd869877e98ce => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:32.809758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefc5b5-c499-4f9e-a535-e7bdbf8d0c46 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:32.810442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefc5b5-c499-4f9e-a535-e7bdbf8d0c46 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:32.811095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefc5b5-c499-4f9e-a535-e7bdbf8d0c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:32.845808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-794b3e68-10d4-4efc-b09f-3d3fd0e652e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '881426c03ae34859916c30765cfaec37'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:32.860337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-794b3e68-10d4-4efc-b09f-3d3fd0e652e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '881426c03ae34859916c30765cfaec37'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:32.861118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-794b3e68-10d4-4efc-b09f-3d3fd0e652e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '881426c03ae34859916c30765cfaec37'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:32.873281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9aefc5b5-c499-4f9e-a535-e7bdbf8d0c46 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:32.875853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9aefc5b5-c499-4f9e-a535-e7bdbf8d0c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:32.882040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-794b3e68-10d4-4efc-b09f-3d3fd0e652e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '881426c03ae34859916c30765cfaec37'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:32.899981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-794b3e68-10d4-4efc-b09f-3d3fd0e652e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '881426c03ae34859916c30765cfaec37'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:32.921418 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2539/5077] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:05:32 2022] DELETE /identity/v3/users/881426c03ae34859916c30765cfaec37 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:32.922814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e088f-9081-49b5-b813-bd7be29440e2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:32.923284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e088f-9081-49b5-b813-bd7be29440e2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:32.923431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e088f-9081-49b5-b813-bd7be29440e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:32.961725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a11e088f-9081-49b5-b813-bd7be29440e2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:32.966414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a11e088f-9081-49b5-b813-bd7be29440e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:33.053274 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2539/5078] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:05:33.061339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57518e32-0ce4-4b97-827a-3a506a577dee None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:33.061800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57518e32-0ce4-4b97-827a-3a506a577dee None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:33.062140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57518e32-0ce4-4b97-827a-3a506a577dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:33.087439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-57518e32-0ce4-4b97-827a-3a506a577dee None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:33.089186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-57518e32-0ce4-4b97-827a-3a506a577dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:33.131395 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2540/5079] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:33.147227 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:33.159621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e088f-9081-49b5-b813-bd7be29440e2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:33.161066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a11e088f-9081-49b5-b813-bd7be29440e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:33.172519 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2540/5080] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:05:33.177335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57518e32-0ce4-4b97-827a-3a506a577dee None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:33.210276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57518e32-0ce4-4b97-827a-3a506a577dee None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:33.221733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a520241-3cd0-46bc-97d7-e96ae265e647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:33.222371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a520241-3cd0-46bc-97d7-e96ae265e647 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:33.223302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a520241-3cd0-46bc-97d7-e96ae265e647 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:33.223589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a520241-3cd0-46bc-97d7-e96ae265e647 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:33.224429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a520241-3cd0-46bc-97d7-e96ae265e647 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:05:33.224767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a520241-3cd0-46bc-97d7-e96ae265e647 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:33.229945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a520241-3cd0-46bc-97d7-e96ae265e647 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:33.252372 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2541/5081] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:33.257295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a520241-3cd0-46bc-97d7-e96ae265e647 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:33.270441 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:33.282797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a520241-3cd0-46bc-97d7-e96ae265e647 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:33.293841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e088f-9081-49b5-b813-bd7be29440e2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:33.295580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9df20-fbf3-44fb-a0e8-bac03778ea9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:33.297168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9df20-fbf3-44fb-a0e8-bac03778ea9e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:33.297462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9df20-fbf3-44fb-a0e8-bac03778ea9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:33.298318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9df20-fbf3-44fb-a0e8-bac03778ea9e admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:33.298879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71dc4c-1c6c-4f9f-a4fb-3cd4fea1e01a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:33.299013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9df20-fbf3-44fb-a0e8-bac03778ea9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:33.299663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71dc4c-1c6c-4f9f-a4fb-3cd4fea1e01a service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:33.299944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71dc4c-1c6c-4f9f-a4fb-3cd4fea1e01a service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:33.300213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71dc4c-1c6c-4f9f-a4fb-3cd4fea1e01a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:33.307017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9df20-fbf3-44fb-a0e8-bac03778ea9e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:33.315404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71dc4c-1c6c-4f9f-a4fb-3cd4fea1e01a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:33.318325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71dc4c-1c6c-4f9f-a4fb-3cd4fea1e01a service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:33.334303 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2541/5082] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:33.384680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71dc4c-1c6c-4f9f-a4fb-3cd4fea1e01a service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:33.385530 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2542/5083] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:33 2022] POST /identity/v3/projects => generated 399 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:33.397855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71dc4c-1c6c-4f9f-a4fb-3cd4fea1e01a service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:33.491896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf093323-2da8-49ba-9837-0c28cac4f865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:33.492754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf093323-2da8-49ba-9837-0c28cac4f865 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:33.500972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf093323-2da8-49ba-9837-0c28cac4f865 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:33.501327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf093323-2da8-49ba-9837-0c28cac4f865 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:33.502100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf093323-2da8-49ba-9837-0c28cac4f865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:33.505288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf093323-2da8-49ba-9837-0c28cac4f865 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:33.547794 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2542/5084] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:05:33 2022] POST /identity/v3/users => generated 300 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:05:33.552182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9df20-fbf3-44fb-a0e8-bac03778ea9e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:33.565040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9df20-fbf3-44fb-a0e8-bac03778ea9e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:33.570775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82ed25-5594-4b95-9aed-e9ca69b8c25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:33.571441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82ed25-5594-4b95-9aed-e9ca69b8c25e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:33.571718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82ed25-5594-4b95-9aed-e9ca69b8c25e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:33.571992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82ed25-5594-4b95-9aed-e9ca69b8c25e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:33.572672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82ed25-5594-4b95-9aed-e9ca69b8c25e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:33.574738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82ed25-5594-4b95-9aed-e9ca69b8c25e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:33.593255 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf093323-2da8-49ba-9837-0c28cac4f865 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:33.593607 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2543/5085] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:33.608197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf093323-2da8-49ba-9837-0c28cac4f865 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:33.615556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9370f1-26da-45b1-9822-0a506c0277de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:33.616864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9370f1-26da-45b1-9822-0a506c0277de admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:33.618496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9370f1-26da-45b1-9822-0a506c0277de admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:33.619474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9370f1-26da-45b1-9822-0a506c0277de admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:33.620398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9370f1-26da-45b1-9822-0a506c0277de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:33.622384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9370f1-26da-45b1-9822-0a506c0277de admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:33.637604 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2543/5086] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:05:33.641526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82ed25-5594-4b95-9aed-e9ca69b8c25e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:33.651788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82ed25-5594-4b95-9aed-e9ca69b8c25e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:33.671381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de207ede-19e6-4b20-ad7c-377547204665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:33.672393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de207ede-19e6-4b20-ad7c-377547204665 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:33.674475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de207ede-19e6-4b20-ad7c-377547204665 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:33.675029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de207ede-19e6-4b20-ad7c-377547204665 admin admin] PATH_INFO: `/v3/projects/3dde838b70364aaaaaee0e9d5445218f/users/58c50ed8702548f0b7568d172661e00d/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:33.714864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de207ede-19e6-4b20-ad7c-377547204665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dde838b70364aaaaaee0e9d5445218f, user_id=58c50ed8702548f0b7568d172661e00d, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:33.722359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de207ede-19e6-4b20-ad7c-377547204665 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:33.782274 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2544/5087] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:05:33 2022] PUT /identity/v3/projects/3dde838b70364aaaaaee0e9d5445218f/users/58c50ed8702548f0b7568d172661e00d/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:33.787670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28259f3f-7ca4-46ad-a3da-29414eb3783a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:33.788143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28259f3f-7ca4-46ad-a3da-29414eb3783a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:33.788700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28259f3f-7ca4-46ad-a3da-29414eb3783a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:33.837611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-28259f3f-7ca4-46ad-a3da-29414eb3783a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:33.838846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-28259f3f-7ca4-46ad-a3da-29414eb3783a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:33.920402 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2544/5088] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:33.952965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de207ede-19e6-4b20-ad7c-377547204665 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:33.957050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-de207ede-19e6-4b20-ad7c-377547204665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:34.141890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de207ede-19e6-4b20-ad7c-377547204665 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:34.154306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433160c7-0d2f-4d19-94ba-16de75e0b0aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:34.154853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433160c7-0d2f-4d19-94ba-16de75e0b0aa service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:34.155133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433160c7-0d2f-4d19-94ba-16de75e0b0aa service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:34.155404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433160c7-0d2f-4d19-94ba-16de75e0b0aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:34.193392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433160c7-0d2f-4d19-94ba-16de75e0b0aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:34.196361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433160c7-0d2f-4d19-94ba-16de75e0b0aa service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:34.225841 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2545/5089] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:34.232791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28259f3f-7ca4-46ad-a3da-29414eb3783a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:34.234214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-28259f3f-7ca4-46ad-a3da-29414eb3783a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:34.251484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28259f3f-7ca4-46ad-a3da-29414eb3783a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:34.261645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab838bba-0e40-4df1-b125-e0a56d76c08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:34.271940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab838bba-0e40-4df1-b125-e0a56d76c08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:34.272211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab838bba-0e40-4df1-b125-e0a56d76c08c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:34.272495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab838bba-0e40-4df1-b125-e0a56d76c08c admin admin] PATH_INFO: `/v3/projects/622712e8c6784c7b8df350459cfbe560` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:34.277533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab838bba-0e40-4df1-b125-e0a56d76c08c admin admin] RBAC: Authorizing `identity:delete_project(project_id=622712e8c6784c7b8df350459cfbe560)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:34.286731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab838bba-0e40-4df1-b125-e0a56d76c08c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:34.441235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ab838bba-0e40-4df1-b125-e0a56d76c08c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '622712e8c6784c7b8df350459cfbe560', 'request_id': 'req-ab838bba-0e40-4df1-b125-e0a56d76c08c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:34.460589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ab838bba-0e40-4df1-b125-e0a56d76c08c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '622712e8c6784c7b8df350459cfbe560', 'request_id': 'req-ab838bba-0e40-4df1-b125-e0a56d76c08c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:34.473450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ab838bba-0e40-4df1-b125-e0a56d76c08c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '622712e8c6784c7b8df350459cfbe560', 'request_id': 'req-ab838bba-0e40-4df1-b125-e0a56d76c08c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:34.475905 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:34.501675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ab838bba-0e40-4df1-b125-e0a56d76c08c admin admin] The token cache is being invalidate because project 622712e8c6784c7b8df350459cfbe560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:34.502193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ab838bba-0e40-4df1-b125-e0a56d76c08c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:34.504939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ab838bba-0e40-4df1-b125-e0a56d76c08c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:34.519097 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2545/5090] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:34 2022] DELETE /identity/v3/projects/622712e8c6784c7b8df350459cfbe560 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:34.523392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433160c7-0d2f-4d19-94ba-16de75e0b0aa service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:34.570870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab838bba-0e40-4df1-b125-e0a56d76c08c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:34.572665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ab838bba-0e40-4df1-b125-e0a56d76c08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:34.588579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433160c7-0d2f-4d19-94ba-16de75e0b0aa service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:34.740227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab838bba-0e40-4df1-b125-e0a56d76c08c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:34.755139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039c979-68e8-4ad8-b6ed-36f289d17132 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:34.756249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039c979-68e8-4ad8-b6ed-36f289d17132 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:34.756725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039c979-68e8-4ad8-b6ed-36f289d17132 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:34.757154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039c979-68e8-4ad8-b6ed-36f289d17132 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:34.759706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d039c979-68e8-4ad8-b6ed-36f289d17132 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:34.786065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904141d-eec6-47db-a706-0a4a82adc1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:34.787434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904141d-eec6-47db-a706-0a4a82adc1fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:34.787886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904141d-eec6-47db-a706-0a4a82adc1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:34.788415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904141d-eec6-47db-a706-0a4a82adc1fc admin admin] PATH_INFO: `/v3/users/08db91ed81314304b660594693f4ffe9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:34.793140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904141d-eec6-47db-a706-0a4a82adc1fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=08db91ed81314304b660594693f4ffe9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:34.800507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904141d-eec6-47db-a706-0a4a82adc1fc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:34.815296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039c979-68e8-4ad8-b6ed-36f289d17132 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:34.817721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039c979-68e8-4ad8-b6ed-36f289d17132 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:34.839150 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2546/5091] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:34.904463 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:34.943828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039c979-68e8-4ad8-b6ed-36f289d17132 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:34.945516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d039c979-68e8-4ad8-b6ed-36f289d17132 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:34.980648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b904141d-eec6-47db-a706-0a4a82adc1fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08db91ed81314304b660594693f4ffe9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:34.981449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b904141d-eec6-47db-a706-0a4a82adc1fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08db91ed81314304b660594693f4ffe9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:34.995309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039c979-68e8-4ad8-b6ed-36f289d17132 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:34.995632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b904141d-eec6-47db-a706-0a4a82adc1fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08db91ed81314304b660594693f4ffe9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:35.012845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35d028-e861-409e-a5d0-20c7b66bf1cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:35.014307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35d028-e861-409e-a5d0-20c7b66bf1cb service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:35.014591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35d028-e861-409e-a5d0-20c7b66bf1cb service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:35.014874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35d028-e861-409e-a5d0-20c7b66bf1cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:35.018688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fa35d028-e861-409e-a5d0-20c7b66bf1cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:35.021500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b904141d-eec6-47db-a706-0a4a82adc1fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08db91ed81314304b660594693f4ffe9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:35.032769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b904141d-eec6-47db-a706-0a4a82adc1fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08db91ed81314304b660594693f4ffe9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:35.040293 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2546/5092] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:05:34 2022] DELETE /identity/v3/users/08db91ed81314304b660594693f4ffe9 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:35.045461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904141d-eec6-47db-a706-0a4a82adc1fc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:35.047931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b904141d-eec6-47db-a706-0a4a82adc1fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:35.050900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35d028-e861-409e-a5d0-20c7b66bf1cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:35.054847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35d028-e861-409e-a5d0-20c7b66bf1cb service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:35.093613 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2547/5093] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:35.143576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904141d-eec6-47db-a706-0a4a82adc1fc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:35.150948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0874e-4496-4230-81f3-a53c476da10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:35.151744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0874e-4496-4230-81f3-a53c476da10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:35.152023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0874e-4496-4230-81f3-a53c476da10a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:35.152524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0874e-4496-4230-81f3-a53c476da10a admin admin] PATH_INFO: `/v3/users/ab2a38de4f294daaaa024b8046a5fed7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:35.153902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0874e-4496-4230-81f3-a53c476da10a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab2a38de4f294daaaa024b8046a5fed7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:35.156475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0874e-4496-4230-81f3-a53c476da10a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:35.275270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-65b0874e-4496-4230-81f3-a53c476da10a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab2a38de4f294daaaa024b8046a5fed7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:35.276101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-65b0874e-4496-4230-81f3-a53c476da10a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab2a38de4f294daaaa024b8046a5fed7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:35.301310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-65b0874e-4496-4230-81f3-a53c476da10a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab2a38de4f294daaaa024b8046a5fed7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:35.329290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-65b0874e-4496-4230-81f3-a53c476da10a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab2a38de4f294daaaa024b8046a5fed7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:35.341772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-65b0874e-4496-4230-81f3-a53c476da10a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab2a38de4f294daaaa024b8046a5fed7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:35.356615 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2547/5094] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:05:35 2022] DELETE /identity/v3/users/ab2a38de4f294daaaa024b8046a5fed7 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:35.358561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caddf7-4de5-48a8-a12e-572113b25050 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:35.359109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caddf7-4de5-48a8-a12e-572113b25050 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:35.359636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caddf7-4de5-48a8-a12e-572113b25050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:35.389182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f3caddf7-4de5-48a8-a12e-572113b25050 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:35.390954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f3caddf7-4de5-48a8-a12e-572113b25050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:35.491302 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2548/5095] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:35.814634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0874e-4496-4230-81f3-a53c476da10a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:35.817307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-65b0874e-4496-4230-81f3-a53c476da10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:35.873211 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:35.927652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0874e-4496-4230-81f3-a53c476da10a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:35.943468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1288a4-e160-490e-b07e-e67f412b5c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:35.944197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1288a4-e160-490e-b07e-e67f412b5c4f service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:35.944557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1288a4-e160-490e-b07e-e67f412b5c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:35.944926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1288a4-e160-490e-b07e-e67f412b5c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:35.959366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1288a4-e160-490e-b07e-e67f412b5c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:35.961714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1288a4-e160-490e-b07e-e67f412b5c4f service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:35.980110 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2548/5096] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:37.011815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3caddf7-4de5-48a8-a12e-572113b25050 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:37.013626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f3caddf7-4de5-48a8-a12e-572113b25050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:37.044914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3caddf7-4de5-48a8-a12e-572113b25050 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:37.051741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b19bb2-d931-4b9c-bb24-90f09b9a7da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:37.052710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b19bb2-d931-4b9c-bb24-90f09b9a7da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:37.053209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b19bb2-d931-4b9c-bb24-90f09b9a7da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:37.053672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b19bb2-d931-4b9c-bb24-90f09b9a7da2 admin admin] PATH_INFO: `/v3/projects/18906c490e5949058b194fd0dbef9aa3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:37.055783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b19bb2-d931-4b9c-bb24-90f09b9a7da2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18906c490e5949058b194fd0dbef9aa3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:37.058030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b19bb2-d931-4b9c-bb24-90f09b9a7da2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:37.194299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-08b19bb2-d931-4b9c-bb24-90f09b9a7da2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18906c490e5949058b194fd0dbef9aa3', 'request_id': 'req-08b19bb2-d931-4b9c-bb24-90f09b9a7da2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:37.213576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-08b19bb2-d931-4b9c-bb24-90f09b9a7da2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18906c490e5949058b194fd0dbef9aa3', 'request_id': 'req-08b19bb2-d931-4b9c-bb24-90f09b9a7da2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:37.221794 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:37.226206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-08b19bb2-d931-4b9c-bb24-90f09b9a7da2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18906c490e5949058b194fd0dbef9aa3', 'request_id': 'req-08b19bb2-d931-4b9c-bb24-90f09b9a7da2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:37.251957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-08b19bb2-d931-4b9c-bb24-90f09b9a7da2 admin admin] The token cache is being invalidate because project 18906c490e5949058b194fd0dbef9aa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:37.252577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-08b19bb2-d931-4b9c-bb24-90f09b9a7da2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:37.254354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-08b19bb2-d931-4b9c-bb24-90f09b9a7da2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:37.257110 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2549/5097] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:37 2022] DELETE /identity/v3/projects/18906c490e5949058b194fd0dbef9aa3 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:37.265017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74100e0f-c42b-4a03-94e4-54eee7e53f5f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:37.266024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74100e0f-c42b-4a03-94e4-54eee7e53f5f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:37.266544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74100e0f-c42b-4a03-94e4-54eee7e53f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:37.303388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-74100e0f-c42b-4a03-94e4-54eee7e53f5f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:37.305230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-74100e0f-c42b-4a03-94e4-54eee7e53f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:37.537676 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2549/5098] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:37.546953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a1f95-b44a-422b-a5d5-92bbdf357735 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:37.547631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a1f95-b44a-422b-a5d5-92bbdf357735 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:37.548732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a1f95-b44a-422b-a5d5-92bbdf357735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:37.602200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bb4a1f95-b44a-422b-a5d5-92bbdf357735 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:37.603386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bb4a1f95-b44a-422b-a5d5-92bbdf357735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:37.613216 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2550/5099] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:05:37.618347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74100e0f-c42b-4a03-94e4-54eee7e53f5f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:37.629901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74100e0f-c42b-4a03-94e4-54eee7e53f5f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:37.637391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751865fa-34c3-4321-ad73-6a5da89fe6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:37.638070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751865fa-34c3-4321-ad73-6a5da89fe6de admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:37.638356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751865fa-34c3-4321-ad73-6a5da89fe6de admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:37.638631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751865fa-34c3-4321-ad73-6a5da89fe6de admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:37.639353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751865fa-34c3-4321-ad73-6a5da89fe6de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:05:37.639659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751865fa-34c3-4321-ad73-6a5da89fe6de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:37.641817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751865fa-34c3-4321-ad73-6a5da89fe6de admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:37.668310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a1f95-b44a-422b-a5d5-92bbdf357735 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:37.672808 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2550/5100] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:05:37.693861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a1f95-b44a-422b-a5d5-92bbdf357735 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:37.709316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d37ec-78af-4e54-b85d-7d098bf7e85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:37.710884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d37ec-78af-4e54-b85d-7d098bf7e85c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:37.711442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d37ec-78af-4e54-b85d-7d098bf7e85c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:37.711645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d37ec-78af-4e54-b85d-7d098bf7e85c admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:37.712505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d37ec-78af-4e54-b85d-7d098bf7e85c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:37.715297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d37ec-78af-4e54-b85d-7d098bf7e85c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:37.779045 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2551/5101] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:37 2022] POST /identity/v3/projects => generated 351 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:37.783047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751865fa-34c3-4321-ad73-6a5da89fe6de admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:37.798355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751865fa-34c3-4321-ad73-6a5da89fe6de admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:37.942987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dbaf8-b958-4db9-87ba-47cc4d7cb24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:37.943847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dbaf8-b958-4db9-87ba-47cc4d7cb24f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:37.944216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dbaf8-b958-4db9-87ba-47cc4d7cb24f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:37.944491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dbaf8-b958-4db9-87ba-47cc4d7cb24f admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:37.945287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864dbaf8-b958-4db9-87ba-47cc4d7cb24f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:37.951644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864dbaf8-b958-4db9-87ba-47cc4d7cb24f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:38.014079 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2551/5102] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:05:37 2022] POST /identity/v3/users => generated 276 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:38.018262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d37ec-78af-4e54-b85d-7d098bf7e85c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:38.035199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d37ec-78af-4e54-b85d-7d098bf7e85c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:38.048736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a507c3a-22e0-4a41-804a-13a5bbab7a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:38.049437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a507c3a-22e0-4a41-804a-13a5bbab7a04 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:38.049821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a507c3a-22e0-4a41-804a-13a5bbab7a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:38.050403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a507c3a-22e0-4a41-804a-13a5bbab7a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:38.051124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a507c3a-22e0-4a41-804a-13a5bbab7a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:38.053068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a507c3a-22e0-4a41-804a-13a5bbab7a04 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:38.091560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dbaf8-b958-4db9-87ba-47cc4d7cb24f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:38.093400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-864dbaf8-b958-4db9-87ba-47cc4d7cb24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:38.100594 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2552/5103] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:38.104537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a507c3a-22e0-4a41-804a-13a5bbab7a04 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:38.122815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dbaf8-b958-4db9-87ba-47cc4d7cb24f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:38.145697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a507c3a-22e0-4a41-804a-13a5bbab7a04 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:38.146067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146f1bd-93a1-456c-b127-b93273c22e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:38.147242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146f1bd-93a1-456c-b127-b93273c22e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:38.149191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146f1bd-93a1-456c-b127-b93273c22e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:38.150065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146f1bd-93a1-456c-b127-b93273c22e49 admin admin] PATH_INFO: `/v3/projects/4c4a6ac63c294ef49273d1096643db2a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:38.165110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146f1bd-93a1-456c-b127-b93273c22e49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c4a6ac63c294ef49273d1096643db2a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:38.166943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cd58b-6dd5-4a10-95e9-3913d4487683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:38.168122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cd58b-6dd5-4a10-95e9-3913d4487683 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:38.168572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cd58b-6dd5-4a10-95e9-3913d4487683 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:38.169070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cd58b-6dd5-4a10-95e9-3913d4487683 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:38.172489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007cd58b-6dd5-4a10-95e9-3913d4487683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:38.174360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007cd58b-6dd5-4a10-95e9-3913d4487683 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:38.174494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146f1bd-93a1-456c-b127-b93273c22e49 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:38.204458 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2553/5104] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:38.208940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cd58b-6dd5-4a10-95e9-3913d4487683 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:38.230091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cd58b-6dd5-4a10-95e9-3913d4487683 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:38.241278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f9378-8284-4ab1-918b-42a4412cdd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:38.242377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f9378-8284-4ab1-918b-42a4412cdd7e admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:38.243128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f9378-8284-4ab1-918b-42a4412cdd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:38.243568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f9378-8284-4ab1-918b-42a4412cdd7e admin admin] PATH_INFO: `/v3/projects/c1ed2df03c784913b2edcec26c5a18e3/users/7071952d6752493198ebe33e107587e4/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:38.288249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f9378-8284-4ab1-918b-42a4412cdd7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ed2df03c784913b2edcec26c5a18e3, user_id=7071952d6752493198ebe33e107587e4, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:38.291562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f9378-8284-4ab1-918b-42a4412cdd7e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:38.309945 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:38.327033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8146f1bd-93a1-456c-b127-b93273c22e49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c4a6ac63c294ef49273d1096643db2a', 'request_id': 'req-8146f1bd-93a1-456c-b127-b93273c22e49'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:38.335287 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2554/5105] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:05:38 2022] PUT /identity/v3/projects/c1ed2df03c784913b2edcec26c5a18e3/users/7071952d6752493198ebe33e107587e4/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:38.346001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130d323-ad72-432e-9989-4a80b098529f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:38.346387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130d323-ad72-432e-9989-4a80b098529f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:38.346665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130d323-ad72-432e-9989-4a80b098529f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:38.355505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8146f1bd-93a1-456c-b127-b93273c22e49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c4a6ac63c294ef49273d1096643db2a', 'request_id': 'req-8146f1bd-93a1-456c-b127-b93273c22e49'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:38.370952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8146f1bd-93a1-456c-b127-b93273c22e49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c4a6ac63c294ef49273d1096643db2a', 'request_id': 'req-8146f1bd-93a1-456c-b127-b93273c22e49'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:38.417697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e130d323-ad72-432e-9989-4a80b098529f None None] MFA Rules not processed for user `7071952d6752493198ebe33e107587e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:38.419606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e130d323-ad72-432e-9989-4a80b098529f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:38.437275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8146f1bd-93a1-456c-b127-b93273c22e49 admin admin] The token cache is being invalidate because project 4c4a6ac63c294ef49273d1096643db2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:38.437502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8146f1bd-93a1-456c-b127-b93273c22e49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:38.438801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8146f1bd-93a1-456c-b127-b93273c22e49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:38.443502 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2552/5106] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:38 2022] DELETE /identity/v3/projects/4c4a6ac63c294ef49273d1096643db2a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:38.449727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c008cc-917f-4edc-927b-43d4ec1bfdc2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:38.450118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c008cc-917f-4edc-927b-43d4ec1bfdc2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:38.450347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c008cc-917f-4edc-927b-43d4ec1bfdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:38.573957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b9c008cc-917f-4edc-927b-43d4ec1bfdc2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:38.575419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b9c008cc-917f-4edc-927b-43d4ec1bfdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:38.718652 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2555/5107] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:38.736722 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2553/5108] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:38.744651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130d323-ad72-432e-9989-4a80b098529f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:38.747638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e130d323-ad72-432e-9989-4a80b098529f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:38.834718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf606b-20ae-4bf8-8be4-41a0ae2db55f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:38.835002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf606b-20ae-4bf8-8be4-41a0ae2db55f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:38.835277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf606b-20ae-4bf8-8be4-41a0ae2db55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:38.888721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f7bf606b-20ae-4bf8-8be4-41a0ae2db55f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:38.890262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f7bf606b-20ae-4bf8-8be4-41a0ae2db55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:38.895909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130d323-ad72-432e-9989-4a80b098529f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:38.905815 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2554/5109] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:38.907315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de918d5-4b72-43e4-991f-878f0211f17c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:38.907991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de918d5-4b72-43e4-991f-878f0211f17c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:38.908368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf606b-20ae-4bf8-8be4-41a0ae2db55f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:38.929290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de918d5-4b72-43e4-991f-878f0211f17c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:38.929290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de918d5-4b72-43e4-991f-878f0211f17c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:38.930808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf606b-20ae-4bf8-8be4-41a0ae2db55f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:38.949345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de918d5-4b72-43e4-991f-878f0211f17c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:38.950920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de918d5-4b72-43e4-991f-878f0211f17c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:38.951777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaf916-ee71-4753-b2b2-4bacf73541bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:38.953607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaf916-ee71-4753-b2b2-4bacf73541bd admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:38.954060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaf916-ee71-4753-b2b2-4bacf73541bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:38.954434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaf916-ee71-4753-b2b2-4bacf73541bd admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:38.955207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaf916-ee71-4753-b2b2-4bacf73541bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:05:38.958052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaf916-ee71-4753-b2b2-4bacf73541bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:38.965108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaf916-ee71-4753-b2b2-4bacf73541bd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:38.982785 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2556/5110] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:38.986257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de918d5-4b72-43e4-991f-878f0211f17c service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:38.987103 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2555/5111] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:38.990153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0de918d5-4b72-43e4-991f-878f0211f17c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:38.991209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaf916-ee71-4753-b2b2-4bacf73541bd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:39.005182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaf916-ee71-4753-b2b2-4bacf73541bd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:39.023401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62371acd-6c88-4243-ac9a-b2b9e39f33c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:39.024026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62371acd-6c88-4243-ac9a-b2b9e39f33c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:39.024312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62371acd-6c88-4243-ac9a-b2b9e39f33c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:39.024594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62371acd-6c88-4243-ac9a-b2b9e39f33c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:39.025472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62371acd-6c88-4243-ac9a-b2b9e39f33c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:39.031462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62371acd-6c88-4243-ac9a-b2b9e39f33c6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:39.043876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de918d5-4b72-43e4-991f-878f0211f17c service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:39.057558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d00c2-8ab9-44fd-8af1-44e8f975622e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:39.058206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d00c2-8ab9-44fd-8af1-44e8f975622e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:39.059251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d00c2-8ab9-44fd-8af1-44e8f975622e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:39.059689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d00c2-8ab9-44fd-8af1-44e8f975622e admin admin] PATH_INFO: `/v3/users/2d9048d76a5e47318a5a3990191d254b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:39.061822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d00c2-8ab9-44fd-8af1-44e8f975622e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d9048d76a5e47318a5a3990191d254b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:39.068949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d00c2-8ab9-44fd-8af1-44e8f975622e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:39.072188 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:39.098963 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2556/5112] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:38 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:05:39.104025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62371acd-6c88-4243-ac9a-b2b9e39f33c6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:39.195455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-be7d00c2-8ab9-44fd-8af1-44e8f975622e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d9048d76a5e47318a5a3990191d254b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:39.209245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-be7d00c2-8ab9-44fd-8af1-44e8f975622e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d9048d76a5e47318a5a3990191d254b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:39.210297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-be7d00c2-8ab9-44fd-8af1-44e8f975622e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d9048d76a5e47318a5a3990191d254b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:39.235887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-be7d00c2-8ab9-44fd-8af1-44e8f975622e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d9048d76a5e47318a5a3990191d254b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:39.249273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-be7d00c2-8ab9-44fd-8af1-44e8f975622e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d9048d76a5e47318a5a3990191d254b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:39.261680 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2557/5113] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:05:38 2022] DELETE /identity/v3/users/2d9048d76a5e47318a5a3990191d254b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:39.287596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62371acd-6c88-4243-ac9a-b2b9e39f33c6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:39.358562 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:39.521753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4841a13-b3d6-444d-8f2e-726e739c9411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:39.524567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4841a13-b3d6-444d-8f2e-726e739c9411 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:39.525373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4841a13-b3d6-444d-8f2e-726e739c9411 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:39.526127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4841a13-b3d6-444d-8f2e-726e739c9411 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:39.527811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4841a13-b3d6-444d-8f2e-726e739c9411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:39.532482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4841a13-b3d6-444d-8f2e-726e739c9411 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:39.614990 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2557/5114] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:05:39 2022] POST /identity/v3/users => generated 299 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:39.619657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d00c2-8ab9-44fd-8af1-44e8f975622e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:39.621143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-be7d00c2-8ab9-44fd-8af1-44e8f975622e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:39.648557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d00c2-8ab9-44fd-8af1-44e8f975622e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:39.658138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb56f2-f529-4bc9-9fd5-b1a53775e181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:39.658762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb56f2-f529-4bc9-9fd5-b1a53775e181 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:39.659040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb56f2-f529-4bc9-9fd5-b1a53775e181 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:39.659312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb56f2-f529-4bc9-9fd5-b1a53775e181 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:39.659962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb56f2-f529-4bc9-9fd5-b1a53775e181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:39.661566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb56f2-f529-4bc9-9fd5-b1a53775e181 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:39.686812 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2558/5115] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:39.694594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4841a13-b3d6-444d-8f2e-726e739c9411 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:39.728866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4841a13-b3d6-444d-8f2e-726e739c9411 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:39.744447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969e993-3209-4995-8fcf-147cff07bae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:39.746215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969e993-3209-4995-8fcf-147cff07bae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:39.747185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969e993-3209-4995-8fcf-147cff07bae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:39.749953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969e993-3209-4995-8fcf-147cff07bae2 admin admin] PATH_INFO: `/v3/projects/7a38cf177dc846b3b592cda538e4c767/users/4a5478e4e26c47e5b7a8c0628e73c131/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:39.791855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969e993-3209-4995-8fcf-147cff07bae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a38cf177dc846b3b592cda538e4c767, user_id=4a5478e4e26c47e5b7a8c0628e73c131, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:39.801510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969e993-3209-4995-8fcf-147cff07bae2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:39.832299 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2558/5116] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:05:39 2022] PUT /identity/v3/projects/7a38cf177dc846b3b592cda538e4c767/users/4a5478e4e26c47e5b7a8c0628e73c131/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:39.837176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb56f2-f529-4bc9-9fd5-b1a53775e181 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:39.853216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb56f2-f529-4bc9-9fd5-b1a53775e181 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:39.963669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7132098-313d-47ce-9c2d-79fe00859282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:39.964287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7132098-313d-47ce-9c2d-79fe00859282 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:39.964836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7132098-313d-47ce-9c2d-79fe00859282 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:39.965202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7132098-313d-47ce-9c2d-79fe00859282 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:39.965812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7132098-313d-47ce-9c2d-79fe00859282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:39.967560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7132098-313d-47ce-9c2d-79fe00859282 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:39.987008 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2559/5117] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:39.991052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969e993-3209-4995-8fcf-147cff07bae2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:40.010974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969e993-3209-4995-8fcf-147cff07bae2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:40.029649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbd586-a257-4589-89bd-d24386af6cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:40.031672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbd586-a257-4589-89bd-d24386af6cf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:40.031920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbd586-a257-4589-89bd-d24386af6cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:40.032180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbd586-a257-4589-89bd-d24386af6cf3 admin admin] PATH_INFO: `/v3/projects/7a38cf177dc846b3b592cda538e4c767/users/4a5478e4e26c47e5b7a8c0628e73c131/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:40.034799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbd586-a257-4589-89bd-d24386af6cf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a38cf177dc846b3b592cda538e4c767, user_id=4a5478e4e26c47e5b7a8c0628e73c131, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:40.037986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbd586-a257-4589-89bd-d24386af6cf3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:40.053118 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2559/5118] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:05:39 2022] PUT /identity/v3/projects/7a38cf177dc846b3b592cda538e4c767/users/4a5478e4e26c47e5b7a8c0628e73c131/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:40.070852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf303cd0-90e6-477c-a09f-465679009913 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:40.071531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf303cd0-90e6-477c-a09f-465679009913 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:40.071655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf303cd0-90e6-477c-a09f-465679009913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:40.133761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cf303cd0-90e6-477c-a09f-465679009913 None None] MFA Rules not processed for user `4a5478e4e26c47e5b7a8c0628e73c131`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:40.138995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cf303cd0-90e6-477c-a09f-465679009913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:40.185458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbd586-a257-4589-89bd-d24386af6cf3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:40.187713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-22dbd586-a257-4589-89bd-d24386af6cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:40.229751 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:40.266442 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2560/5119] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:40.270762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf303cd0-90e6-477c-a09f-465679009913 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:40.340731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbd586-a257-4589-89bd-d24386af6cf3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:40.346283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb4b19-cbee-4f91-bed7-b22e629a7467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:40.352331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb4b19-cbee-4f91-bed7-b22e629a7467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:40.352643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb4b19-cbee-4f91-bed7-b22e629a7467 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:40.352968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb4b19-cbee-4f91-bed7-b22e629a7467 admin admin] PATH_INFO: `/v3/projects/fedeab6fbc7449468380dac88a387269` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:40.354324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb4b19-cbee-4f91-bed7-b22e629a7467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fedeab6fbc7449468380dac88a387269)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:40.356256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb4b19-cbee-4f91-bed7-b22e629a7467 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:40.401873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf303cd0-90e6-477c-a09f-465679009913 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:40.410731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca7863-3285-41f2-bc81-e106d8253dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:40.411356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca7863-3285-41f2-bc81-e106d8253dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:40.411631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca7863-3285-41f2-bc81-e106d8253dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:40.411901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca7863-3285-41f2-bc81-e106d8253dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:40.412546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca7863-3285-41f2-bc81-e106d8253dd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:40.415994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca7863-3285-41f2-bc81-e106d8253dd6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:40.474529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-12bb4b19-cbee-4f91-bed7-b22e629a7467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fedeab6fbc7449468380dac88a387269', 'request_id': 'req-12bb4b19-cbee-4f91-bed7-b22e629a7467'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:40.494484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-12bb4b19-cbee-4f91-bed7-b22e629a7467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fedeab6fbc7449468380dac88a387269', 'request_id': 'req-12bb4b19-cbee-4f91-bed7-b22e629a7467'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:40.498511 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2561/5120] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:40 2022] POST /identity/v3/projects => generated 387 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:05:40.500386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca7863-3285-41f2-bc81-e106d8253dd6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:40.514225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-12bb4b19-cbee-4f91-bed7-b22e629a7467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fedeab6fbc7449468380dac88a387269', 'request_id': 'req-12bb4b19-cbee-4f91-bed7-b22e629a7467'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:40.539805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-12bb4b19-cbee-4f91-bed7-b22e629a7467 admin admin] The token cache is being invalidate because project fedeab6fbc7449468380dac88a387269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:40.540305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-12bb4b19-cbee-4f91-bed7-b22e629a7467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:40.541093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-12bb4b19-cbee-4f91-bed7-b22e629a7467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:40.552955 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2560/5121] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:40 2022] DELETE /identity/v3/projects/fedeab6fbc7449468380dac88a387269 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:40.554583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4b253-fa02-4200-857a-cea66e1de4f3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:40.554964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4b253-fa02-4200-857a-cea66e1de4f3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:40.555331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4b253-fa02-4200-857a-cea66e1de4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:40.602831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2af4b253-fa02-4200-857a-cea66e1de4f3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:40.604237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2af4b253-fa02-4200-857a-cea66e1de4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:40.621740 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:40.645976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca7863-3285-41f2-bc81-e106d8253dd6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:40.660168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c79917-8e1d-4ac9-8881-de584389ad1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:40.661162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c79917-8e1d-4ac9-8881-de584389ad1d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:40.661162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c79917-8e1d-4ac9-8881-de584389ad1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:40.661375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c79917-8e1d-4ac9-8881-de584389ad1d admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:40.662029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c79917-8e1d-4ac9-8881-de584389ad1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:40.666126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c79917-8e1d-4ac9-8881-de584389ad1d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:40.702865 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2562/5122] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:05:40 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:40.706751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c79917-8e1d-4ac9-8881-de584389ad1d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:40.714240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-77c79917-8e1d-4ac9-8881-de584389ad1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:40.744895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c79917-8e1d-4ac9-8881-de584389ad1d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:40.751216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e8f73-329d-401e-a998-61b648e12f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:40.752054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e8f73-329d-401e-a998-61b648e12f8a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:40.752437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e8f73-329d-401e-a998-61b648e12f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:40.752942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e8f73-329d-401e-a998-61b648e12f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:40.753713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e8f73-329d-401e-a998-61b648e12f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:40.755500 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2561/5123] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:40.755719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e8f73-329d-401e-a998-61b648e12f8a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:40.757016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcabf6-38b6-4c2f-a563-ff5cbf5ed4ba None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:40.757303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcabf6-38b6-4c2f-a563-ff5cbf5ed4ba None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:40.757671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcabf6-38b6-4c2f-a563-ff5cbf5ed4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:40.786947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d7bcabf6-38b6-4c2f-a563-ff5cbf5ed4ba None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:40.788253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d7bcabf6-38b6-4c2f-a563-ff5cbf5ed4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:40.790370 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2563/5124] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:40.795144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e8f73-329d-401e-a998-61b648e12f8a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:40.806498 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2562/5125] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:40.807828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcabf6-38b6-4c2f-a563-ff5cbf5ed4ba None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:40.829764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e8f73-329d-401e-a998-61b648e12f8a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:40.835254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6efe6-aaca-4785-9904-a7e9476a3575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:40.837640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6efe6-aaca-4785-9904-a7e9476a3575 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:40.838040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6efe6-aaca-4785-9904-a7e9476a3575 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:40.838934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6efe6-aaca-4785-9904-a7e9476a3575 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:40.839489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcabf6-38b6-4c2f-a563-ff5cbf5ed4ba None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:40.839613 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6efe6-aaca-4785-9904-a7e9476a3575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:40.841350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6efe6-aaca-4785-9904-a7e9476a3575 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:40.849252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afb372-694e-482c-a84f-0a8e14f69550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:40.850946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afb372-694e-482c-a84f-0a8e14f69550 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:40.852538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afb372-694e-482c-a84f-0a8e14f69550 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:40.856412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afb372-694e-482c-a84f-0a8e14f69550 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:40.857363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afb372-694e-482c-a84f-0a8e14f69550 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:05:40.870370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afb372-694e-482c-a84f-0a8e14f69550 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:40.877600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afb372-694e-482c-a84f-0a8e14f69550 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:40.878792 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2564/5126] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:40.882351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6efe6-aaca-4785-9904-a7e9476a3575 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:40.897742 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2563/5127] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:40.899281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afb372-694e-482c-a84f-0a8e14f69550 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:40.912516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afb372-694e-482c-a84f-0a8e14f69550 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:40.918628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f0b5e-111f-461a-8d14-73c041f6b468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:40.922084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f0b5e-111f-461a-8d14-73c041f6b468 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:40.922348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f0b5e-111f-461a-8d14-73c041f6b468 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:40.922632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f0b5e-111f-461a-8d14-73c041f6b468 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:40.923339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f0b5e-111f-461a-8d14-73c041f6b468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:40.925894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f0b5e-111f-461a-8d14-73c041f6b468 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:40.929280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6efe6-aaca-4785-9904-a7e9476a3575 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:40.935543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89353d88-f6cc-40a5-a866-690d0a969954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:40.936220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89353d88-f6cc-40a5-a866-690d0a969954 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:40.936565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89353d88-f6cc-40a5-a866-690d0a969954 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:40.936866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89353d88-f6cc-40a5-a866-690d0a969954 admin admin] PATH_INFO: `/v3/projects/b3666d54fc2d429c8312392f135c8ecc/users/dc49341954344d1592474534a31e5149/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:40.958240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89353d88-f6cc-40a5-a866-690d0a969954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3666d54fc2d429c8312392f135c8ecc, user_id=dc49341954344d1592474534a31e5149, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:40.963274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89353d88-f6cc-40a5-a866-690d0a969954 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:40.986818 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2564/5129] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:40 2022] POST /identity/v3/projects => generated 389 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:40.989086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f0b5e-111f-461a-8d14-73c041f6b468 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:40.993170 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2565/5129] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:05:40 2022] PUT /identity/v3/projects/b3666d54fc2d429c8312392f135c8ecc/users/dc49341954344d1592474534a31e5149/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:40.994914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce99259-014e-427c-802f-a82cb6085b3d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:40.995245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce99259-014e-427c-802f-a82cb6085b3d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:40.995750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce99259-014e-427c-802f-a82cb6085b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:41.042497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dce99259-014e-427c-802f-a82cb6085b3d None None] MFA Rules not processed for user `dc49341954344d1592474534a31e5149`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:41.043786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dce99259-014e-427c-802f-a82cb6085b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:41.052002 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:41.123399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f0b5e-111f-461a-8d14-73c041f6b468 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:41.154295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4218531-903c-4ab1-a3c6-a90cf0944d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:41.154937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4218531-903c-4ab1-a3c6-a90cf0944d9a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:41.156905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4218531-903c-4ab1-a3c6-a90cf0944d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:41.157421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4218531-903c-4ab1-a3c6-a90cf0944d9a admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:41.158024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4218531-903c-4ab1-a3c6-a90cf0944d9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:41.164216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4218531-903c-4ab1-a3c6-a90cf0944d9a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:41.215236 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2566/5130] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:41.229258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce99259-014e-427c-802f-a82cb6085b3d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:41.233994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dce99259-014e-427c-802f-a82cb6085b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:41.240664 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2565/5131] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:05:40 2022] POST /identity/v3/users => generated 295 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:41.244320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4218531-903c-4ab1-a3c6-a90cf0944d9a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:41.278026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4218531-903c-4ab1-a3c6-a90cf0944d9a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:41.306958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ebe0f-f94e-4c8d-a91d-3371ee9494c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:41.309472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ebe0f-f94e-4c8d-a91d-3371ee9494c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:41.310075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ebe0f-f94e-4c8d-a91d-3371ee9494c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:41.311268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ebe0f-f94e-4c8d-a91d-3371ee9494c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:41.312351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ebe0f-f94e-4c8d-a91d-3371ee9494c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:41.314836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ebe0f-f94e-4c8d-a91d-3371ee9494c3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:41.354803 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2566/5132] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:05:41.355850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ebe0f-f94e-4c8d-a91d-3371ee9494c3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:41.372165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ebe0f-f94e-4c8d-a91d-3371ee9494c3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:41.377090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce99259-014e-427c-802f-a82cb6085b3d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:41.385301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c441ed9-a3a9-4856-8185-c69bb45bf5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:41.385914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c441ed9-a3a9-4856-8185-c69bb45bf5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:41.386222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c441ed9-a3a9-4856-8185-c69bb45bf5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:41.386456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c441ed9-a3a9-4856-8185-c69bb45bf5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:41.387275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c441ed9-a3a9-4856-8185-c69bb45bf5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:41.388886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c441ed9-a3a9-4856-8185-c69bb45bf5e6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:41.390973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2845bd-4b4a-48a4-97ce-5edc4e643400 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:41.391423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2845bd-4b4a-48a4-97ce-5edc4e643400 service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:41.391708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2845bd-4b4a-48a4-97ce-5edc4e643400 service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:41.391981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2845bd-4b4a-48a4-97ce-5edc4e643400 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:41.394015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bb2845bd-4b4a-48a4-97ce-5edc4e643400 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:41.414422 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2567/5133] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:05:41.415720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c441ed9-a3a9-4856-8185-c69bb45bf5e6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:41.434253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c441ed9-a3a9-4856-8185-c69bb45bf5e6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:41.439269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbff8d4-8464-43b3-a664-b56ff28f970e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:41.439867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbff8d4-8464-43b3-a664-b56ff28f970e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:41.440145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbff8d4-8464-43b3-a664-b56ff28f970e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:41.440415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbff8d4-8464-43b3-a664-b56ff28f970e admin admin] PATH_INFO: `/v3/projects/f537122b0bf14ce0b6c63ecbf82c0d7a/users/223ddccd443541cd8ee3aa4a323e6850/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:41.473315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbff8d4-8464-43b3-a664-b56ff28f970e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f537122b0bf14ce0b6c63ecbf82c0d7a, user_id=223ddccd443541cd8ee3aa4a323e6850, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:41.475964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbff8d4-8464-43b3-a664-b56ff28f970e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:41.516153 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2568/5134] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:05:41 2022] PUT /identity/v3/projects/f537122b0bf14ce0b6c63ecbf82c0d7a/users/223ddccd443541cd8ee3aa4a323e6850/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:41.517963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d386de-6912-45ab-80d4-4641f866d32b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:41.518246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d386de-6912-45ab-80d4-4641f866d32b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:41.518544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d386de-6912-45ab-80d4-4641f866d32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:41.537343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2845bd-4b4a-48a4-97ce-5edc4e643400 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:41.538907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2845bd-4b4a-48a4-97ce-5edc4e643400 service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:41.556953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e2d386de-6912-45ab-80d4-4641f866d32b None None] MFA Rules not processed for user `223ddccd443541cd8ee3aa4a323e6850`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:41.558189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e2d386de-6912-45ab-80d4-4641f866d32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:41.561870 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2567/5135] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:41.573171 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:41.765911 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2569/5136] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:05:41.770938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2845bd-4b4a-48a4-97ce-5edc4e643400 service glance] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:41.791258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2845bd-4b4a-48a4-97ce-5edc4e643400 service glance] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:41.864817 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:41.878839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b00b5-af69-4c89-9e70-34c4e512466a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:41.879556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b00b5-af69-4c89-9e70-34c4e512466a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:41.879847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b00b5-af69-4c89-9e70-34c4e512466a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:41.880127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b00b5-af69-4c89-9e70-34c4e512466a admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:41.881105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b00b5-af69-4c89-9e70-34c4e512466a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:41.884288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b00b5-af69-4c89-9e70-34c4e512466a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:41.940778 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2568/5137] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:41 2022] POST /identity/v3/projects => generated 389 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:41.943847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d386de-6912-45ab-80d4-4641f866d32b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:41.969606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d386de-6912-45ab-80d4-4641f866d32b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:42.142390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb339cc-4390-402a-abb3-3ec037b05613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:42.142390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb339cc-4390-402a-abb3-3ec037b05613 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:42.142390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb339cc-4390-402a-abb3-3ec037b05613 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:42.142390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb339cc-4390-402a-abb3-3ec037b05613 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:42.142774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb339cc-4390-402a-abb3-3ec037b05613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:42.142774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb339cc-4390-402a-abb3-3ec037b05613 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:42.143848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b00b5-af69-4c89-9e70-34c4e512466a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:42.181364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b00b5-af69-4c89-9e70-34c4e512466a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:42.185190 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2570/5138] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:05:41 2022] POST /identity/v3/users => generated 301 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:42.186936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb339cc-4390-402a-abb3-3ec037b05613 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:42.195792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d8315-be97-42ba-9ab5-dcc21c41981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:42.196631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d8315-be97-42ba-9ab5-dcc21c41981e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:42.196980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d8315-be97-42ba-9ab5-dcc21c41981e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:42.197254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d8315-be97-42ba-9ab5-dcc21c41981e admin admin] PATH_INFO: `/v3/users/4a5478e4e26c47e5b7a8c0628e73c131` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:42.201496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d8315-be97-42ba-9ab5-dcc21c41981e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a5478e4e26c47e5b7a8c0628e73c131)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:42.208772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb339cc-4390-402a-abb3-3ec037b05613 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:42.216557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d8315-be97-42ba-9ab5-dcc21c41981e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:42.217584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2963cf-817f-4976-b851-c8cffe7436cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:42.218018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2963cf-817f-4976-b851-c8cffe7436cf admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:42.218472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2963cf-817f-4976-b851-c8cffe7436cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:42.218749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2963cf-817f-4976-b851-c8cffe7436cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:42.219399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2963cf-817f-4976-b851-c8cffe7436cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:42.223494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2963cf-817f-4976-b851-c8cffe7436cf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:42.254044 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2571/5139] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:42.258952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2963cf-817f-4976-b851-c8cffe7436cf admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:42.281623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2963cf-817f-4976-b851-c8cffe7436cf admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:42.297176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3fc46-b1e5-4c12-ab6d-c7cf44ea3b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:42.298741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3fc46-b1e5-4c12-ab6d-c7cf44ea3b21 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:42.299018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3fc46-b1e5-4c12-ab6d-c7cf44ea3b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:42.299286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3fc46-b1e5-4c12-ab6d-c7cf44ea3b21 admin admin] PATH_INFO: `/v3/projects/c502e2dd57bd4f38b63d042da89550b4/users/46f5462ddbbd482f97ac7007d7514da2/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:42.334086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3fc46-b1e5-4c12-ab6d-c7cf44ea3b21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c502e2dd57bd4f38b63d042da89550b4, user_id=46f5462ddbbd482f97ac7007d7514da2, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:42.341198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3fc46-b1e5-4c12-ab6d-c7cf44ea3b21 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:42.368425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-535d8315-be97-42ba-9ab5-dcc21c41981e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a5478e4e26c47e5b7a8c0628e73c131'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:42.368689 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2572/5140] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:05:42 2022] PUT /identity/v3/projects/c502e2dd57bd4f38b63d042da89550b4/users/46f5462ddbbd482f97ac7007d7514da2/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:42.372566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3fc46-b1e5-4c12-ab6d-c7cf44ea3b21 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:42.387832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-535d8315-be97-42ba-9ab5-dcc21c41981e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a5478e4e26c47e5b7a8c0628e73c131'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:42.389712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-535d8315-be97-42ba-9ab5-dcc21c41981e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a5478e4e26c47e5b7a8c0628e73c131'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:42.417887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-535d8315-be97-42ba-9ab5-dcc21c41981e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a5478e4e26c47e5b7a8c0628e73c131'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:42.446212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-535d8315-be97-42ba-9ab5-dcc21c41981e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a5478e4e26c47e5b7a8c0628e73c131'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:42.473062 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2569/5141] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:05:42 2022] DELETE /identity/v3/users/4a5478e4e26c47e5b7a8c0628e73c131 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:42.479168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66218ff-8bac-42af-bb05-da16e9a89088 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:42.479393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66218ff-8bac-42af-bb05-da16e9a89088 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:42.479670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66218ff-8bac-42af-bb05-da16e9a89088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:42.499797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3fc46-b1e5-4c12-ab6d-c7cf44ea3b21 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:42.510700 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:42.527780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f66218ff-8bac-42af-bb05-da16e9a89088 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:42.536647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f66218ff-8bac-42af-bb05-da16e9a89088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:42.618289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae88d63-fadb-46f6-9cb1-f95cc3e1b4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:42.618817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae88d63-fadb-46f6-9cb1-f95cc3e1b4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:42.619226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae88d63-fadb-46f6-9cb1-f95cc3e1b4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:42.619471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae88d63-fadb-46f6-9cb1-f95cc3e1b4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:42.621232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae88d63-fadb-46f6-9cb1-f95cc3e1b4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:42.624090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae88d63-fadb-46f6-9cb1-f95cc3e1b4c7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:42.640025 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2573/5142] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:05:42.641568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae88d63-fadb-46f6-9cb1-f95cc3e1b4c7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:42.643654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4ae88d63-fadb-46f6-9cb1-f95cc3e1b4c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:42.653387 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2570/5143] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:42.660001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae88d63-fadb-46f6-9cb1-f95cc3e1b4c7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:42.666652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b56fc-75a7-4cd7-8f86-1a0fef4436c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:42.667226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b56fc-75a7-4cd7-8f86-1a0fef4436c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:42.667564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b56fc-75a7-4cd7-8f86-1a0fef4436c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:42.668020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b56fc-75a7-4cd7-8f86-1a0fef4436c9 admin admin] PATH_INFO: `/v3/projects/c502e2dd57bd4f38b63d042da89550b4/users/46f5462ddbbd482f97ac7007d7514da2/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:42.670737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b56fc-75a7-4cd7-8f86-1a0fef4436c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c502e2dd57bd4f38b63d042da89550b4, user_id=46f5462ddbbd482f97ac7007d7514da2, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:42.674291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b56fc-75a7-4cd7-8f86-1a0fef4436c9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:42.676914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66218ff-8bac-42af-bb05-da16e9a89088 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:42.678731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f66218ff-8bac-42af-bb05-da16e9a89088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:42.715567 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2574/5144] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:05:42 2022] PUT /identity/v3/projects/c502e2dd57bd4f38b63d042da89550b4/users/46f5462ddbbd482f97ac7007d7514da2/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:42.718366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035cf74-cb93-4d2b-b967-37f527b5c0af None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:42.718675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035cf74-cb93-4d2b-b967-37f527b5c0af None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:42.718944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035cf74-cb93-4d2b-b967-37f527b5c0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:42.773985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6035cf74-cb93-4d2b-b967-37f527b5c0af None None] MFA Rules not processed for user `46f5462ddbbd482f97ac7007d7514da2`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:42.775002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6035cf74-cb93-4d2b-b967-37f527b5c0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:42.819080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66218ff-8bac-42af-bb05-da16e9a89088 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:42.842232 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:42.928867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e92f4e-7629-4d25-9540-a7ab70ad9b6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:42.931773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e92f4e-7629-4d25-9540-a7ab70ad9b6e service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:42.932310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e92f4e-7629-4d25-9540-a7ab70ad9b6e service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:42.932840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e92f4e-7629-4d25-9540-a7ab70ad9b6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:42.990357 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2575/5145] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:42 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:42.991465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035cf74-cb93-4d2b-b967-37f527b5c0af None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:43.003512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035cf74-cb93-4d2b-b967-37f527b5c0af None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:43.009868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c2293-8276-44f8-9dd1-8c225297ca22 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:43.010697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c2293-8276-44f8-9dd1-8c225297ca22 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:43.012000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c2293-8276-44f8-9dd1-8c225297ca22 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:43.012000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c2293-8276-44f8-9dd1-8c225297ca22 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:43.012000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c2293-8276-44f8-9dd1-8c225297ca22 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:43.014076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c2293-8276-44f8-9dd1-8c225297ca22 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:43.035462 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2576/5146] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:05:42 2022] POST /identity/v3/domains => generated 275 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:43.039724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c2293-8276-44f8-9dd1-8c225297ca22 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:43.080238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e92f4e-7629-4d25-9540-a7ab70ad9b6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:43.086190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e92f4e-7629-4d25-9540-a7ab70ad9b6e service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:43.118699 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2571/5147] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:43.185028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c2293-8276-44f8-9dd1-8c225297ca22 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:43.191817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7bfd3-180f-49c7-aff8-f8f30636923c tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:43.192757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7bfd3-180f-49c7-aff8-f8f30636923c tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:43.193196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7bfd3-180f-49c7-aff8-f8f30636923c tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:43.193629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7bfd3-180f-49c7-aff8-f8f30636923c tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/5a48c35e90d64ae1b2b9d64a0601bf78/config` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:43.194479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7bfd3-180f-49c7-aff8-f8f30636923c tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=5a48c35e90d64ae1b2b9d64a0601bf78)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:43.195575 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-20b7bfd3-180f-49c7-aff8-f8f30636923c tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:05:43.195575 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:05:43.195575 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:05:43.196516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7bfd3-180f-49c7-aff8-f8f30636923c tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:43.199781 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:43.269936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e92f4e-7629-4d25-9540-a7ab70ad9b6e service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:43.270472 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2577/5148] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Sep 30 10:05:43 2022] PUT /identity/v3/domains/5a48c35e90d64ae1b2b9d64a0601bf78/config => generated 138 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:43.286713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e92f4e-7629-4d25-9540-a7ab70ad9b6e service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:43.313674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbfdd0-c5a7-4735-b7af-22d065f2cebc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:43.316157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbfdd0-c5a7-4735-b7af-22d065f2cebc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:43.316545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbfdd0-c5a7-4735-b7af-22d065f2cebc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:43.316958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbfdd0-c5a7-4735-b7af-22d065f2cebc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/5a48c35e90d64ae1b2b9d64a0601bf78/config/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:43.322842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbfdd0-c5a7-4735-b7af-22d065f2cebc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=5a48c35e90d64ae1b2b9d64a0601bf78, group=identity)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:43.324719 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-ccfbfdd0-c5a7-4735-b7af-22d065f2cebc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:05:43.324719 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:05:43.324719 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:05:43.327484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbfdd0-c5a7-4735-b7af-22d065f2cebc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:43.375161 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2572/5149] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Sep 30 10:05:43 2022] GET /identity/v3/domains/5a48c35e90d64ae1b2b9d64a0601bf78/config/identity => generated 45 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:43.381297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7bfd3-180f-49c7-aff8-f8f30636923c tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:43.393744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7bfd3-180f-49c7-aff8-f8f30636923c tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:43.401542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8704fcf-2cac-4595-aa88-02f6603655cc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:43.402456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8704fcf-2cac-4595-aa88-02f6603655cc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:43.402757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8704fcf-2cac-4595-aa88-02f6603655cc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:43.403147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8704fcf-2cac-4595-aa88-02f6603655cc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/5a48c35e90d64ae1b2b9d64a0601bf78/config/identity/driver` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:43.404501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8704fcf-2cac-4595-aa88-02f6603655cc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=5a48c35e90d64ae1b2b9d64a0601bf78, group=identity, option=driver)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:43.406031 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-d8704fcf-2cac-4595-aa88-02f6603655cc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:05:43.406031 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:05:43.406031 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:05:43.406784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8704fcf-2cac-4595-aa88-02f6603655cc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:43.414409 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2578/5150] 10.222.0.16 () {58 vars in 1296 bytes} [Fri Sep 30 10:05:43 2022] GET /identity/v3/domains/5a48c35e90d64ae1b2b9d64a0601bf78/config/identity/driver => generated 31 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:43.419136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbfdd0-c5a7-4735-b7af-22d065f2cebc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:43.441465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbfdd0-c5a7-4735-b7af-22d065f2cebc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:43.448541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc562b-c24c-48ea-9e97-f797164744a6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:43.449783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc562b-c24c-48ea-9e97-f797164744a6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:43.450281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc562b-c24c-48ea-9e97-f797164744a6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:43.450858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc562b-c24c-48ea-9e97-f797164744a6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/5a48c35e90d64ae1b2b9d64a0601bf78/config/ldap` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:43.452853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc562b-c24c-48ea-9e97-f797164744a6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=5a48c35e90d64ae1b2b9d64a0601bf78, group=ldap)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:43.454998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc562b-c24c-48ea-9e97-f797164744a6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:43.467826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8704fcf-2cac-4595-aa88-02f6603655cc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:43.469157 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2573/5151] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Sep 30 10:05:43 2022] GET /identity/v3/domains/5a48c35e90d64ae1b2b9d64a0601bf78/config/ldap => generated 106 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:05:43.483577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8704fcf-2cac-4595-aa88-02f6603655cc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:43.493414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63aa0e-a4e2-47fa-a714-c15f73bce252 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:43.494289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63aa0e-a4e2-47fa-a714-c15f73bce252 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:43.494684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63aa0e-a4e2-47fa-a714-c15f73bce252 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:43.495059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63aa0e-a4e2-47fa-a714-c15f73bce252 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/5a48c35e90d64ae1b2b9d64a0601bf78/config/ldap/url` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:43.496312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63aa0e-a4e2-47fa-a714-c15f73bce252 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=5a48c35e90d64ae1b2b9d64a0601bf78, group=ldap, option=url)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:43.498797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63aa0e-a4e2-47fa-a714-c15f73bce252 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:43.511451 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2579/5152] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Sep 30 10:05:43 2022] GET /identity/v3/domains/5a48c35e90d64ae1b2b9d64a0601bf78/config/ldap/url => generated 46 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:43.516538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc562b-c24c-48ea-9e97-f797164744a6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:43.529463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc562b-c24c-48ea-9e97-f797164744a6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:43.535446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3455b76-d379-4fa4-b7e1-c1b90eee7fc8 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:43.536553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3455b76-d379-4fa4-b7e1-c1b90eee7fc8 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:43.536984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3455b76-d379-4fa4-b7e1-c1b90eee7fc8 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:43.537367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3455b76-d379-4fa4-b7e1-c1b90eee7fc8 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/5a48c35e90d64ae1b2b9d64a0601bf78/config/ldap/user_tree_dn` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:43.539400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3455b76-d379-4fa4-b7e1-c1b90eee7fc8 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=5a48c35e90d64ae1b2b9d64a0601bf78, group=ldap, option=user_tree_dn)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:43.542212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3455b76-d379-4fa4-b7e1-c1b90eee7fc8 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:43.553017 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2574/5153] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Sep 30 10:05:43 2022] GET /identity/v3/domains/5a48c35e90d64ae1b2b9d64a0601bf78/config/ldap/user_tree_dn => generated 63 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:43.555672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63aa0e-a4e2-47fa-a714-c15f73bce252 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:43.568052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63aa0e-a4e2-47fa-a714-c15f73bce252 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:43.574939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0ae2d-3858-41c5-a82c-628b680cceb1 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:43.574939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0ae2d-3858-41c5-a82c-628b680cceb1 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:43.575391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0ae2d-3858-41c5-a82c-628b680cceb1 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:43.576235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0ae2d-3858-41c5-a82c-628b680cceb1 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/5a48c35e90d64ae1b2b9d64a0601bf78/config` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:43.576908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0ae2d-3858-41c5-a82c-628b680cceb1 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=5a48c35e90d64ae1b2b9d64a0601bf78)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:43.578233 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-48e0ae2d-3858-41c5-a82c-628b680cceb1 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:05:43.578233 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:05:43.578233 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:05:43.579588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0ae2d-3858-41c5-a82c-628b680cceb1 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:43.594732 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2580/5154] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Sep 30 10:05:43 2022] DELETE /identity/v3/domains/5a48c35e90d64ae1b2b9d64a0601bf78/config => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:43.596460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3455b76-d379-4fa4-b7e1-c1b90eee7fc8 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:43.609559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3455b76-d379-4fa4-b7e1-c1b90eee7fc8 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:43.616638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958643e0-7fb6-4cf0-85ed-70999d0f30ed tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:43.618244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958643e0-7fb6-4cf0-85ed-70999d0f30ed tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:43.618564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958643e0-7fb6-4cf0-85ed-70999d0f30ed tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:43.618777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958643e0-7fb6-4cf0-85ed-70999d0f30ed tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/5a48c35e90d64ae1b2b9d64a0601bf78` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:43.621088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958643e0-7fb6-4cf0-85ed-70999d0f30ed tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5a48c35e90d64ae1b2b9d64a0601bf78)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:43.622331 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-958643e0-7fb6-4cf0-85ed-70999d0f30ed tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:05:43.622331 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:05:43.622331 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:05:43.623766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958643e0-7fb6-4cf0-85ed-70999d0f30ed tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:43.655926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-958643e0-7fb6-4cf0-85ed-70999d0f30ed tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5a48c35e90d64ae1b2b9d64a0601bf78'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:43.657126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-958643e0-7fb6-4cf0-85ed-70999d0f30ed tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5a48c35e90d64ae1b2b9d64a0601bf78'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:43.693826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-958643e0-7fb6-4cf0-85ed-70999d0f30ed tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5a48c35e90d64ae1b2b9d64a0601bf78'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:43.694765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-958643e0-7fb6-4cf0-85ed-70999d0f30ed tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5a48c35e90d64ae1b2b9d64a0601bf78'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:43.702062 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2575/5155] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:05:43 2022] PATCH /identity/v3/domains/5a48c35e90d64ae1b2b9d64a0601bf78 => generated 276 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:43.703923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0ae2d-3858-41c5-a82c-628b680cceb1 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:43.706375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-48e0ae2d-3858-41c5-a82c-628b680cceb1 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:43.721271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0ae2d-3858-41c5-a82c-628b680cceb1 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:43.796148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c46a7-dc06-4a2f-8fd1-d111adedae46 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:43.797798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c46a7-dc06-4a2f-8fd1-d111adedae46 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:43.797798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c46a7-dc06-4a2f-8fd1-d111adedae46 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:43.798495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c46a7-dc06-4a2f-8fd1-d111adedae46 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/5a48c35e90d64ae1b2b9d64a0601bf78` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:43.813652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c46a7-dc06-4a2f-8fd1-d111adedae46 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5a48c35e90d64ae1b2b9d64a0601bf78)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:43.814871 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-909c46a7-dc06-4a2f-8fd1-d111adedae46 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:05:43.814871 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:05:43.814871 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:05:43.816412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c46a7-dc06-4a2f-8fd1-d111adedae46 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:43.848725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-909c46a7-dc06-4a2f-8fd1-d111adedae46 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5a48c35e90d64ae1b2b9d64a0601bf78'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:43.855500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-909c46a7-dc06-4a2f-8fd1-d111adedae46 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5a48c35e90d64ae1b2b9d64a0601bf78'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:43.947646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-909c46a7-dc06-4a2f-8fd1-d111adedae46 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a48c35e90d64ae1b2b9d64a0601bf78', 'request_id': 'req-909c46a7-dc06-4a2f-8fd1-d111adedae46'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:43.966742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-909c46a7-dc06-4a2f-8fd1-d111adedae46 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a48c35e90d64ae1b2b9d64a0601bf78', 'request_id': 'req-909c46a7-dc06-4a2f-8fd1-d111adedae46'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:43.989500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-909c46a7-dc06-4a2f-8fd1-d111adedae46 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a48c35e90d64ae1b2b9d64a0601bf78', 'request_id': 'req-909c46a7-dc06-4a2f-8fd1-d111adedae46'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:44.013752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-909c46a7-dc06-4a2f-8fd1-d111adedae46 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] The token cache is being invalidate because project 5a48c35e90d64ae1b2b9d64a0601bf78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:44.014767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-909c46a7-dc06-4a2f-8fd1-d111adedae46 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:44.014960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-909c46a7-dc06-4a2f-8fd1-d111adedae46 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:44.018964 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:44.036230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-909c46a7-dc06-4a2f-8fd1-d111adedae46 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5a48c35e90d64ae1b2b9d64a0601bf78', 'request_id': 'req-909c46a7-dc06-4a2f-8fd1-d111adedae46'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:44.037211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-909c46a7-dc06-4a2f-8fd1-d111adedae46 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5a48c35e90d64ae1b2b9d64a0601bf78', 'request_id': 'req-909c46a7-dc06-4a2f-8fd1-d111adedae46'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:44.048186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-909c46a7-dc06-4a2f-8fd1-d111adedae46 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5a48c35e90d64ae1b2b9d64a0601bf78', 'request_id': 'req-909c46a7-dc06-4a2f-8fd1-d111adedae46'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:44.068492 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2581/5156] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:05:43 2022] DELETE /identity/v3/domains/5a48c35e90d64ae1b2b9d64a0601bf78 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:44.072575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958643e0-7fb6-4cf0-85ed-70999d0f30ed tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:44.097739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958643e0-7fb6-4cf0-85ed-70999d0f30ed tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:44.189939 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:44.210024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea746c-865b-4122-ad72-c25582ce4309 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:44.210903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea746c-865b-4122-ad72-c25582ce4309 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:44.211435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea746c-865b-4122-ad72-c25582ce4309 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:44.211829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea746c-865b-4122-ad72-c25582ce4309 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:44.212643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea746c-865b-4122-ad72-c25582ce4309 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:44.215102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea746c-865b-4122-ad72-c25582ce4309 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:44.240890 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2576/5157] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:05:44 2022] POST /identity/v3/domains => generated 277 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:44.246625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c46a7-dc06-4a2f-8fd1-d111adedae46 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:44.248081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-909c46a7-dc06-4a2f-8fd1-d111adedae46 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:44.263847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c46a7-dc06-4a2f-8fd1-d111adedae46 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:44.331261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257294d-1f06-41b6-b859-81813ff4279d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:44.332043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257294d-1f06-41b6-b859-81813ff4279d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:44.332709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257294d-1f06-41b6-b859-81813ff4279d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:44.333094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257294d-1f06-41b6-b859-81813ff4279d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/f181e542a36f4890b8c8ca621fc3c1bb/config` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:44.333891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257294d-1f06-41b6-b859-81813ff4279d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=f181e542a36f4890b8c8ca621fc3c1bb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:44.335702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257294d-1f06-41b6-b859-81813ff4279d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:44.380197 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2582/5158] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Sep 30 10:05:44 2022] PUT /identity/v3/domains/f181e542a36f4890b8c8ca621fc3c1bb/config => generated 138 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:44.386063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea746c-865b-4122-ad72-c25582ce4309 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:44.398806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea746c-865b-4122-ad72-c25582ce4309 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:44.404122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19067c-e172-4f41-a42c-18e1a6aeb6e3 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:44.404819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19067c-e172-4f41-a42c-18e1a6aeb6e3 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:44.405103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19067c-e172-4f41-a42c-18e1a6aeb6e3 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:44.405378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19067c-e172-4f41-a42c-18e1a6aeb6e3 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/f181e542a36f4890b8c8ca621fc3c1bb/config` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:44.406067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19067c-e172-4f41-a42c-18e1a6aeb6e3 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=f181e542a36f4890b8c8ca621fc3c1bb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:44.407083 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-fc19067c-e172-4f41-a42c-18e1a6aeb6e3 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:05:44.407083 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:05:44.407083 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:05:44.408008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19067c-e172-4f41-a42c-18e1a6aeb6e3 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:44.478772 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2577/5159] 10.222.0.16 () {60 vars in 1271 bytes} [Fri Sep 30 10:05:44 2022] PATCH /identity/v3/domains/f181e542a36f4890b8c8ca621fc3c1bb/config => generated 139 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:44.479700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257294d-1f06-41b6-b859-81813ff4279d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:44.502396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257294d-1f06-41b6-b859-81813ff4279d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:44.515082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998cbd3-e594-41f1-bc11-27618d0622f5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:44.516647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998cbd3-e594-41f1-bc11-27618d0622f5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:44.517085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998cbd3-e594-41f1-bc11-27618d0622f5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:44.517515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998cbd3-e594-41f1-bc11-27618d0622f5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/f181e542a36f4890b8c8ca621fc3c1bb/config` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:44.520066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998cbd3-e594-41f1-bc11-27618d0622f5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f181e542a36f4890b8c8ca621fc3c1bb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:44.522092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998cbd3-e594-41f1-bc11-27618d0622f5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:44.545684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19067c-e172-4f41-a42c-18e1a6aeb6e3 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:44.548319 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2583/5160] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Sep 30 10:05:44 2022] GET /identity/v3/domains/f181e542a36f4890b8c8ca621fc3c1bb/config => generated 139 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:44.573872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19067c-e172-4f41-a42c-18e1a6aeb6e3 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:44.601169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ffbd1-a366-402f-839d-b6d8decdf422 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:44.603101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ffbd1-a366-402f-839d-b6d8decdf422 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:44.618443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ffbd1-a366-402f-839d-b6d8decdf422 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:44.619087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ffbd1-a366-402f-839d-b6d8decdf422 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/f181e542a36f4890b8c8ca621fc3c1bb/config` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:44.620253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ffbd1-a366-402f-839d-b6d8decdf422 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=f181e542a36f4890b8c8ca621fc3c1bb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:44.627175 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-fd6ffbd1-a366-402f-839d-b6d8decdf422 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:05:44.627175 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:05:44.627175 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:05:44.628552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ffbd1-a366-402f-839d-b6d8decdf422 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:44.656241 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2578/5161] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Sep 30 10:05:44 2022] DELETE /identity/v3/domains/f181e542a36f4890b8c8ca621fc3c1bb/config => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:44.663656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ffbd1-a366-402f-839d-b6d8decdf422 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:44.663833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998cbd3-e594-41f1-bc11-27618d0622f5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:44.667399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c998cbd3-e594-41f1-bc11-27618d0622f5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:44.691184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ffbd1-a366-402f-839d-b6d8decdf422 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:44.700709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fb0e2-e646-42a4-be54-c1c94ab6eb03 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:44.701637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fb0e2-e646-42a4-be54-c1c94ab6eb03 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:44.702143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fb0e2-e646-42a4-be54-c1c94ab6eb03 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:44.702641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fb0e2-e646-42a4-be54-c1c94ab6eb03 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/f181e542a36f4890b8c8ca621fc3c1bb/config` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:44.704174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fb0e2-e646-42a4-be54-c1c94ab6eb03 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f181e542a36f4890b8c8ca621fc3c1bb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:44.708099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fb0e2-e646-42a4-be54-c1c94ab6eb03 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:44.724671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-097fb0e2-e646-42a4-be54-c1c94ab6eb03 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Could not find any options in domain configuration for domain f181e542a36f4890b8c8ca621fc3c1bb.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain f181e542a36f4890b8c8ca621fc3c1bb. Sep 30 10:05:44.724671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:05:44.724671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:05:44.724671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:05:44.724671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:05:44.724671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:05:44.724671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:05:44.724671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:05:44.724671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:05:44.724671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:05:44.724671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:05:44.724671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:05:44.724671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Sep 30 10:05:44.724671 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Sep 30 10:05:44.728077 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Sep 30 10:05:44.728077 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Sep 30 10:05:44.728077 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:05:44.728077 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:05:44.728077 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Sep 30 10:05:44.728077 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Sep 30 10:05:44.728077 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain f181e542a36f4890b8c8ca621fc3c1bb. Sep 30 10:05:44.728077 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:05:44.744332 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2579/5162] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Sep 30 10:05:44 2022] GET /identity/v3/domains/f181e542a36f4890b8c8ca621fc3c1bb/config => generated 151 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:05:44.748401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fb0e2-e646-42a4-be54-c1c94ab6eb03 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:44.786569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fb0e2-e646-42a4-be54-c1c94ab6eb03 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:44.802337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fe9e1-4e7c-4142-8302-ca925f2fe1f9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:44.803022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fe9e1-4e7c-4142-8302-ca925f2fe1f9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:44.803364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fe9e1-4e7c-4142-8302-ca925f2fe1f9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:44.803646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fe9e1-4e7c-4142-8302-ca925f2fe1f9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/f181e542a36f4890b8c8ca621fc3c1bb/config` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:44.807547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8fe9e1-4e7c-4142-8302-ca925f2fe1f9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=f181e542a36f4890b8c8ca621fc3c1bb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:44.813292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8fe9e1-4e7c-4142-8302-ca925f2fe1f9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:44.843412 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2580/5163] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Sep 30 10:05:44 2022] DELETE /identity/v3/domains/f181e542a36f4890b8c8ca621fc3c1bb/config => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:44.859631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998cbd3-e594-41f1-bc11-27618d0622f5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:44.860331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fe9e1-4e7c-4142-8302-ca925f2fe1f9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:44.868570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139a501-520b-4411-a6f4-1d0755dab71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:44.869567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139a501-520b-4411-a6f4-1d0755dab71d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:44.870070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139a501-520b-4411-a6f4-1d0755dab71d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:44.870532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139a501-520b-4411-a6f4-1d0755dab71d admin admin] PATH_INFO: `/v3/projects/7a38cf177dc846b3b592cda538e4c767` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:44.872094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139a501-520b-4411-a6f4-1d0755dab71d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a38cf177dc846b3b592cda538e4c767)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:44.874717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139a501-520b-4411-a6f4-1d0755dab71d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:44.940115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fe9e1-4e7c-4142-8302-ca925f2fe1f9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:44.963764 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:44.965159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4139a501-520b-4411-a6f4-1d0755dab71d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a38cf177dc846b3b592cda538e4c767', 'request_id': 'req-4139a501-520b-4411-a6f4-1d0755dab71d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:44.985814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4139a501-520b-4411-a6f4-1d0755dab71d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a38cf177dc846b3b592cda538e4c767', 'request_id': 'req-4139a501-520b-4411-a6f4-1d0755dab71d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:44.993169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4139a501-520b-4411-a6f4-1d0755dab71d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a38cf177dc846b3b592cda538e4c767', 'request_id': 'req-4139a501-520b-4411-a6f4-1d0755dab71d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:45.016005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4139a501-520b-4411-a6f4-1d0755dab71d admin admin] The token cache is being invalidate because project 7a38cf177dc846b3b592cda538e4c767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:45.016346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4139a501-520b-4411-a6f4-1d0755dab71d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:45.017721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4139a501-520b-4411-a6f4-1d0755dab71d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:45.019714 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2584/5164] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:44 2022] DELETE /identity/v3/projects/7a38cf177dc846b3b592cda538e4c767 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:45.024299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139a501-520b-4411-a6f4-1d0755dab71d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:45.026497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4139a501-520b-4411-a6f4-1d0755dab71d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:45.096900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea71d1-5e89-4038-81ce-902d6cc83a03 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:45.100062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea71d1-5e89-4038-81ce-902d6cc83a03 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:45.100690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea71d1-5e89-4038-81ce-902d6cc83a03 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:45.102402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea71d1-5e89-4038-81ce-902d6cc83a03 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/f181e542a36f4890b8c8ca621fc3c1bb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:45.107082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea71d1-5e89-4038-81ce-902d6cc83a03 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f181e542a36f4890b8c8ca621fc3c1bb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:45.109905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea71d1-5e89-4038-81ce-902d6cc83a03 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:45.170442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c2ea71d1-5e89-4038-81ce-902d6cc83a03 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f181e542a36f4890b8c8ca621fc3c1bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:45.171855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c2ea71d1-5e89-4038-81ce-902d6cc83a03 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f181e542a36f4890b8c8ca621fc3c1bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:45.180895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139a501-520b-4411-a6f4-1d0755dab71d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:45.217735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c2ea71d1-5e89-4038-81ce-902d6cc83a03 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f181e542a36f4890b8c8ca621fc3c1bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:45.218719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c2ea71d1-5e89-4038-81ce-902d6cc83a03 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f181e542a36f4890b8c8ca621fc3c1bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:45.225079 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2581/5165] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:05:44 2022] PATCH /identity/v3/domains/f181e542a36f4890b8c8ca621fc3c1bb => generated 278 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:45.226323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea71d1-5e89-4038-81ce-902d6cc83a03 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:45.235712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c2ea71d1-5e89-4038-81ce-902d6cc83a03 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:45.320741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140dd34-065f-4cd8-80bb-b8337f08fd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:45.321398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140dd34-065f-4cd8-80bb-b8337f08fd6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:45.321814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140dd34-065f-4cd8-80bb-b8337f08fd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:45.322093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140dd34-065f-4cd8-80bb-b8337f08fd6e admin admin] PATH_INFO: `/v3/users/dc49341954344d1592474534a31e5149` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:45.323847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140dd34-065f-4cd8-80bb-b8337f08fd6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc49341954344d1592474534a31e5149)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:45.325847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140dd34-065f-4cd8-80bb-b8337f08fd6e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:45.340372 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=10,keystone:UPDATE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:45.369639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea71d1-5e89-4038-81ce-902d6cc83a03 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:45.388291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3136b-f47a-438b-900e-a3f96f8842a9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:45.389128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3136b-f47a-438b-900e-a3f96f8842a9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:45.390493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3136b-f47a-438b-900e-a3f96f8842a9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:45.392746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3136b-f47a-438b-900e-a3f96f8842a9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/f181e542a36f4890b8c8ca621fc3c1bb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:45.431580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d140dd34-065f-4cd8-80bb-b8337f08fd6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc49341954344d1592474534a31e5149'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:45.432888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d140dd34-065f-4cd8-80bb-b8337f08fd6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc49341954344d1592474534a31e5149'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:45.448798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d140dd34-065f-4cd8-80bb-b8337f08fd6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc49341954344d1592474534a31e5149'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:45.467462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3136b-f47a-438b-900e-a3f96f8842a9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f181e542a36f4890b8c8ca621fc3c1bb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:45.472118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3136b-f47a-438b-900e-a3f96f8842a9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:45.474875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d140dd34-065f-4cd8-80bb-b8337f08fd6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc49341954344d1592474534a31e5149'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:45.483315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d140dd34-065f-4cd8-80bb-b8337f08fd6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc49341954344d1592474534a31e5149'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:45.496489 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2585/5166] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:05:45 2022] DELETE /identity/v3/users/dc49341954344d1592474534a31e5149 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:05:45.529573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-faa3136b-f47a-438b-900e-a3f96f8842a9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f181e542a36f4890b8c8ca621fc3c1bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:45.540754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-faa3136b-f47a-438b-900e-a3f96f8842a9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f181e542a36f4890b8c8ca621fc3c1bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:45.617761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-faa3136b-f47a-438b-900e-a3f96f8842a9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f181e542a36f4890b8c8ca621fc3c1bb', 'request_id': 'req-faa3136b-f47a-438b-900e-a3f96f8842a9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:45.629996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-faa3136b-f47a-438b-900e-a3f96f8842a9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f181e542a36f4890b8c8ca621fc3c1bb', 'request_id': 'req-faa3136b-f47a-438b-900e-a3f96f8842a9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:45.639839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-faa3136b-f47a-438b-900e-a3f96f8842a9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f181e542a36f4890b8c8ca621fc3c1bb', 'request_id': 'req-faa3136b-f47a-438b-900e-a3f96f8842a9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:45.668194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-faa3136b-f47a-438b-900e-a3f96f8842a9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] The token cache is being invalidate because project f181e542a36f4890b8c8ca621fc3c1bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:45.668886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-faa3136b-f47a-438b-900e-a3f96f8842a9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:45.669849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-faa3136b-f47a-438b-900e-a3f96f8842a9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:45.691182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-faa3136b-f47a-438b-900e-a3f96f8842a9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f181e542a36f4890b8c8ca621fc3c1bb', 'request_id': 'req-faa3136b-f47a-438b-900e-a3f96f8842a9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:45.695047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-faa3136b-f47a-438b-900e-a3f96f8842a9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f181e542a36f4890b8c8ca621fc3c1bb', 'request_id': 'req-faa3136b-f47a-438b-900e-a3f96f8842a9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:45.695940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-faa3136b-f47a-438b-900e-a3f96f8842a9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f181e542a36f4890b8c8ca621fc3c1bb', 'request_id': 'req-faa3136b-f47a-438b-900e-a3f96f8842a9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:45.704906 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2582/5167] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:05:45 2022] DELETE /identity/v3/domains/f181e542a36f4890b8c8ca621fc3c1bb => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:45.710851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140dd34-065f-4cd8-80bb-b8337f08fd6e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:45.712567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d140dd34-065f-4cd8-80bb-b8337f08fd6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:45.720057 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:45.840166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140dd34-065f-4cd8-80bb-b8337f08fd6e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:45.946135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fd073-bb3d-45b3-8f00-869673c4cf33 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:45.946767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fd073-bb3d-45b3-8f00-869673c4cf33 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:45.947049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fd073-bb3d-45b3-8f00-869673c4cf33 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:45.947433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fd073-bb3d-45b3-8f00-869673c4cf33 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:45.948111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42fd073-bb3d-45b3-8f00-869673c4cf33 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:45.949734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42fd073-bb3d-45b3-8f00-869673c4cf33 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:45.995231 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2586/5168] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:05:45 2022] POST /identity/v3/domains => generated 275 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:45.998804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3136b-f47a-438b-900e-a3f96f8842a9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:46.001622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-faa3136b-f47a-438b-900e-a3f96f8842a9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:46.020106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3136b-f47a-438b-900e-a3f96f8842a9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:46.126051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a035d-b738-484c-867c-d75ab97abf05 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:46.126638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a035d-b738-484c-867c-d75ab97abf05 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:46.127054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a035d-b738-484c-867c-d75ab97abf05 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:46.127332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a035d-b738-484c-867c-d75ab97abf05 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/34c9d1e12781482a9417a3ebecdd1eea/config` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:46.128219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a035d-b738-484c-867c-d75ab97abf05 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=34c9d1e12781482a9417a3ebecdd1eea)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:46.131267 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-888a035d-b738-484c-867c-d75ab97abf05 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:05:46.131267 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:05:46.131267 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:05:46.133146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a035d-b738-484c-867c-d75ab97abf05 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:46.196409 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:46.208011 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2583/5169] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Sep 30 10:05:45 2022] PUT /identity/v3/domains/34c9d1e12781482a9417a3ebecdd1eea/config => generated 138 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:46.213365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fd073-bb3d-45b3-8f00-869673c4cf33 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:46.231595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fd073-bb3d-45b3-8f00-869673c4cf33 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:46.247062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928223aa-a87e-499a-8c18-e47bee612068 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:46.263921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928223aa-a87e-499a-8c18-e47bee612068 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:46.265246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928223aa-a87e-499a-8c18-e47bee612068 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:46.268407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928223aa-a87e-499a-8c18-e47bee612068 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/34c9d1e12781482a9417a3ebecdd1eea/config/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:46.273620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928223aa-a87e-499a-8c18-e47bee612068 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=34c9d1e12781482a9417a3ebecdd1eea, group=identity)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:46.277349 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-928223aa-a87e-499a-8c18-e47bee612068 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:05:46.277349 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:05:46.277349 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:05:46.280701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928223aa-a87e-499a-8c18-e47bee612068 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:46.299938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a035d-b738-484c-867c-d75ab97abf05 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:46.302333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-888a035d-b738-484c-867c-d75ab97abf05 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:46.406186 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2587/5170] 10.222.0.16 () {60 vars in 1297 bytes} [Fri Sep 30 10:05:46 2022] PATCH /identity/v3/domains/34c9d1e12781482a9417a3ebecdd1eea/config/identity => generated 177 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:46.410124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928223aa-a87e-499a-8c18-e47bee612068 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:46.432566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928223aa-a87e-499a-8c18-e47bee612068 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:46.450468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877d8d0-8b9f-4da0-87b0-2de2dd9f34c0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:46.451200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877d8d0-8b9f-4da0-87b0-2de2dd9f34c0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:46.451420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877d8d0-8b9f-4da0-87b0-2de2dd9f34c0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:46.451697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877d8d0-8b9f-4da0-87b0-2de2dd9f34c0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/34c9d1e12781482a9417a3ebecdd1eea/config/identity/driver` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:46.452445 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877d8d0-8b9f-4da0-87b0-2de2dd9f34c0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=34c9d1e12781482a9417a3ebecdd1eea, group=identity, option=driver)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:46.454102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877d8d0-8b9f-4da0-87b0-2de2dd9f34c0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:46.530820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a035d-b738-484c-867c-d75ab97abf05 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:46.534349 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2588/5171] 10.222.0.16 () {60 vars in 1318 bytes} [Fri Sep 30 10:05:46 2022] PATCH /identity/v3/domains/34c9d1e12781482a9417a3ebecdd1eea/config/identity/driver => generated 177 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:46.536713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877d8d0-8b9f-4da0-87b0-2de2dd9f34c0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:46.540464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450e037-1404-4f9b-bcba-93590a325fa7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:46.541213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450e037-1404-4f9b-bcba-93590a325fa7 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:46.541496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450e037-1404-4f9b-bcba-93590a325fa7 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:46.541765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450e037-1404-4f9b-bcba-93590a325fa7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:46.547581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5877d8d0-8b9f-4da0-87b0-2de2dd9f34c0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:46.553519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f450e037-1404-4f9b-bcba-93590a325fa7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:46.580744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450e037-1404-4f9b-bcba-93590a325fa7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:46.583178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450e037-1404-4f9b-bcba-93590a325fa7 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:46.615373 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2584/5172] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:05:46.616355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450e037-1404-4f9b-bcba-93590a325fa7 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:46.643640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450e037-1404-4f9b-bcba-93590a325fa7 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:46.657003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db31a8-0d49-40e8-bf50-188aecf3ba18 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:46.661293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db31a8-0d49-40e8-bf50-188aecf3ba18 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:46.661293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db31a8-0d49-40e8-bf50-188aecf3ba18 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:46.661293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db31a8-0d49-40e8-bf50-188aecf3ba18 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/34c9d1e12781482a9417a3ebecdd1eea/config/identity/driver` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:46.662205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db31a8-0d49-40e8-bf50-188aecf3ba18 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=34c9d1e12781482a9417a3ebecdd1eea, group=identity, option=driver)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:46.669982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db31a8-0d49-40e8-bf50-188aecf3ba18 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:46.722107 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2585/5173] 10.222.0.16 () {58 vars in 1299 bytes} [Fri Sep 30 10:05:46 2022] DELETE /identity/v3/domains/34c9d1e12781482a9417a3ebecdd1eea/config/identity/driver => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:46.725360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db31a8-0d49-40e8-bf50-188aecf3ba18 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:46.733878 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:46.775240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db31a8-0d49-40e8-bf50-188aecf3ba18 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:46.794568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845048c-e121-4e76-9f1c-eb6bdee5f4ff tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:46.795253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845048c-e121-4e76-9f1c-eb6bdee5f4ff tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:46.795557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845048c-e121-4e76-9f1c-eb6bdee5f4ff tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:46.795845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845048c-e121-4e76-9f1c-eb6bdee5f4ff tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/34c9d1e12781482a9417a3ebecdd1eea/config/identity/driver` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:46.798083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845048c-e121-4e76-9f1c-eb6bdee5f4ff tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=34c9d1e12781482a9417a3ebecdd1eea, group=identity, option=driver)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:46.802415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845048c-e121-4e76-9f1c-eb6bdee5f4ff tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:46.853973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877d8d0-8b9f-4da0-87b0-2de2dd9f34c0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:46.869201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-1845048c-e121-4e76-9f1c-eb6bdee5f4ff tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Could not find option driver in group identity in domain configuration for domain 34c9d1e12781482a9417a3ebecdd1eea.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 34c9d1e12781482a9417a3ebecdd1eea. Sep 30 10:05:46.869201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:05:46.869201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:05:46.869201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:05:46.869201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:05:46.869201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:05:46.869201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:05:46.869201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:05:46.869201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:05:46.869201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:05:46.869201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:05:46.869201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:05:46.869201 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Sep 30 10:05:46.870205 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Sep 30 10:05:46.870205 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Sep 30 10:05:46.870205 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Sep 30 10:05:46.870205 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:05:46.870205 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:05:46.870205 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Sep 30 10:05:46.870205 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Sep 30 10:05:46.870205 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 34c9d1e12781482a9417a3ebecdd1eea. Sep 30 10:05:46.870205 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:05:46.874516 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2586/5174] 10.222.0.16 () {58 vars in 1296 bytes} [Fri Sep 30 10:05:46 2022] GET /identity/v3/domains/34c9d1e12781482a9417a3ebecdd1eea/config/identity/driver => generated 171 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 30 10:05:46.881126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db5304-303a-4d58-ac00-b5f85d24c457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:46.881430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845048c-e121-4e76-9f1c-eb6bdee5f4ff tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:46.885695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db5304-303a-4d58-ac00-b5f85d24c457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:46.888904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db5304-303a-4d58-ac00-b5f85d24c457 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:46.889203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db5304-303a-4d58-ac00-b5f85d24c457 admin admin] PATH_INFO: `/v3/users/7071952d6752493198ebe33e107587e4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:46.893066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db5304-303a-4d58-ac00-b5f85d24c457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7071952d6752493198ebe33e107587e4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:46.902183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db5304-303a-4d58-ac00-b5f85d24c457 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:46.916657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845048c-e121-4e76-9f1c-eb6bdee5f4ff tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:46.926413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708d01e-dbcc-4cb2-8a4c-cfe788608fbf tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:46.927086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708d01e-dbcc-4cb2-8a4c-cfe788608fbf tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:46.927368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708d01e-dbcc-4cb2-8a4c-cfe788608fbf tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:46.927643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708d01e-dbcc-4cb2-8a4c-cfe788608fbf tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/34c9d1e12781482a9417a3ebecdd1eea/config/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:46.930169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708d01e-dbcc-4cb2-8a4c-cfe788608fbf tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=34c9d1e12781482a9417a3ebecdd1eea, group=identity)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:46.932078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708d01e-dbcc-4cb2-8a4c-cfe788608fbf tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:46.989109 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2587/5175] 10.222.0.16 () {58 vars in 1278 bytes} [Fri Sep 30 10:05:46 2022] DELETE /identity/v3/domains/34c9d1e12781482a9417a3ebecdd1eea/config/identity => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:46.994294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708d01e-dbcc-4cb2-8a4c-cfe788608fbf tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:47.033209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708d01e-dbcc-4cb2-8a4c-cfe788608fbf tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:47.050769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a3ca2-456c-4c04-bc6c-9830ee9af384 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:47.051458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a3ca2-456c-4c04-bc6c-9830ee9af384 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:47.051736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a3ca2-456c-4c04-bc6c-9830ee9af384 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:47.052099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a3ca2-456c-4c04-bc6c-9830ee9af384 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/34c9d1e12781482a9417a3ebecdd1eea/config/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:47.054924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a3ca2-456c-4c04-bc6c-9830ee9af384 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=34c9d1e12781482a9417a3ebecdd1eea, group=identity)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:47.059130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a3ca2-456c-4c04-bc6c-9830ee9af384 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:47.071146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-70db5304-303a-4d58-ac00-b5f85d24c457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7071952d6752493198ebe33e107587e4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:47.072748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-70db5304-303a-4d58-ac00-b5f85d24c457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7071952d6752493198ebe33e107587e4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:47.092797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-70db5304-303a-4d58-ac00-b5f85d24c457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7071952d6752493198ebe33e107587e4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:47.096685 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-4c1a3ca2-456c-4c04-bc6c-9830ee9af384 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Could not find group identity in domain configuration for domain 34c9d1e12781482a9417a3ebecdd1eea.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 34c9d1e12781482a9417a3ebecdd1eea. Sep 30 10:05:47.096685 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:05:47.096685 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:05:47.096685 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:05:47.096685 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:05:47.096685 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:05:47.096685 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:05:47.096685 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:05:47.096685 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:05:47.096685 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:05:47.096685 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:05:47.096685 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:05:47.096685 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Sep 30 10:05:47.097655 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Sep 30 10:05:47.097655 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Sep 30 10:05:47.097655 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Sep 30 10:05:47.097655 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:05:47.097655 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:05:47.097655 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Sep 30 10:05:47.097655 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Sep 30 10:05:47.097655 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 34c9d1e12781482a9417a3ebecdd1eea. Sep 30 10:05:47.097655 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:05:47.102090 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2588/5176] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Sep 30 10:05:46 2022] GET /identity/v3/domains/34c9d1e12781482a9417a3ebecdd1eea/config/identity => generated 154 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 30 10:05:47.107415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a3ca2-456c-4c04-bc6c-9830ee9af384 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:47.116672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4c1a3ca2-456c-4c04-bc6c-9830ee9af384 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:47.141602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-70db5304-303a-4d58-ac00-b5f85d24c457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7071952d6752493198ebe33e107587e4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:47.159352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a3ca2-456c-4c04-bc6c-9830ee9af384 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:47.165706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-70db5304-303a-4d58-ac00-b5f85d24c457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7071952d6752493198ebe33e107587e4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:47.175199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a739988-aa37-4968-bd72-acad09990593 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:47.175923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a739988-aa37-4968-bd72-acad09990593 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:47.176204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a739988-aa37-4968-bd72-acad09990593 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:47.176485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a739988-aa37-4968-bd72-acad09990593 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/34c9d1e12781482a9417a3ebecdd1eea/config` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:47.177101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a739988-aa37-4968-bd72-acad09990593 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=34c9d1e12781482a9417a3ebecdd1eea)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:47.178739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a739988-aa37-4968-bd72-acad09990593 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:47.188888 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2589/5177] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:05:46 2022] DELETE /identity/v3/users/7071952d6752493198ebe33e107587e4 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:47.195576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30e94c-911b-46ad-a9e3-43df26a3a83b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:47.196299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30e94c-911b-46ad-a9e3-43df26a3a83b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:47.196815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30e94c-911b-46ad-a9e3-43df26a3a83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:47.207798 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2589/5178] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Sep 30 10:05:47 2022] DELETE /identity/v3/domains/34c9d1e12781482a9417a3ebecdd1eea/config => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:47.213253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a739988-aa37-4968-bd72-acad09990593 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:47.237679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a739988-aa37-4968-bd72-acad09990593 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:47.255902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0f30e94c-911b-46ad-a9e3-43df26a3a83b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:47.257699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0f30e94c-911b-46ad-a9e3-43df26a3a83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:47.384087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4115131-82ba-4882-a754-ae9a8a4feaa0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:47.385184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4115131-82ba-4882-a754-ae9a8a4feaa0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:47.385746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4115131-82ba-4882-a754-ae9a8a4feaa0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:47.386250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4115131-82ba-4882-a754-ae9a8a4feaa0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/34c9d1e12781482a9417a3ebecdd1eea` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:47.388297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4115131-82ba-4882-a754-ae9a8a4feaa0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=34c9d1e12781482a9417a3ebecdd1eea)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:47.390323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4115131-82ba-4882-a754-ae9a8a4feaa0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:47.425682 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2590/5179] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:47.426623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30e94c-911b-46ad-a9e3-43df26a3a83b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:47.432938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0f30e94c-911b-46ad-a9e3-43df26a3a83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:47.443054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e4115131-82ba-4882-a754-ae9a8a4feaa0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '34c9d1e12781482a9417a3ebecdd1eea'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:47.445173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e4115131-82ba-4882-a754-ae9a8a4feaa0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '34c9d1e12781482a9417a3ebecdd1eea'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:47.457309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30e94c-911b-46ad-a9e3-43df26a3a83b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:47.461373 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:47.502093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e4115131-82ba-4882-a754-ae9a8a4feaa0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '34c9d1e12781482a9417a3ebecdd1eea'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:47.503985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e4115131-82ba-4882-a754-ae9a8a4feaa0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '34c9d1e12781482a9417a3ebecdd1eea'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:47.510284 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2590/5180] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:05:47 2022] PATCH /identity/v3/domains/34c9d1e12781482a9417a3ebecdd1eea => generated 276 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:47.516344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4115131-82ba-4882-a754-ae9a8a4feaa0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:47.519696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e4115131-82ba-4882-a754-ae9a8a4feaa0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:47.614920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd4523-8fa8-4bb0-aa28-7c29f5423a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:47.615759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd4523-8fa8-4bb0-aa28-7c29f5423a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:47.616132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd4523-8fa8-4bb0-aa28-7c29f5423a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:47.616500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd4523-8fa8-4bb0-aa28-7c29f5423a63 admin admin] PATH_INFO: `/v3/projects/b3666d54fc2d429c8312392f135c8ecc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:47.621567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd4523-8fa8-4bb0-aa28-7c29f5423a63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3666d54fc2d429c8312392f135c8ecc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:47.623779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd4523-8fa8-4bb0-aa28-7c29f5423a63 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:47.637568 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:47.668739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4115131-82ba-4882-a754-ae9a8a4feaa0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:47.687854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e560e4-1e13-414e-aba0-60b9057ad9b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:47.689345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e560e4-1e13-414e-aba0-60b9057ad9b9 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:47.689765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e560e4-1e13-414e-aba0-60b9057ad9b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:47.690234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e560e4-1e13-414e-aba0-60b9057ad9b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:47.694227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a0e560e4-1e13-414e-aba0-60b9057ad9b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:47.729790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e560e4-1e13-414e-aba0-60b9057ad9b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:47.734485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e560e4-1e13-414e-aba0-60b9057ad9b9 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:47.747930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-67fd4523-8fa8-4bb0-aa28-7c29f5423a63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3666d54fc2d429c8312392f135c8ecc', 'request_id': 'req-67fd4523-8fa8-4bb0-aa28-7c29f5423a63'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:47.760999 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2591/5181] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:47.762662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e560e4-1e13-414e-aba0-60b9057ad9b9 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:47.764376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a0e560e4-1e13-414e-aba0-60b9057ad9b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:47.773549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-67fd4523-8fa8-4bb0-aa28-7c29f5423a63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3666d54fc2d429c8312392f135c8ecc', 'request_id': 'req-67fd4523-8fa8-4bb0-aa28-7c29f5423a63'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:47.781802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-67fd4523-8fa8-4bb0-aa28-7c29f5423a63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3666d54fc2d429c8312392f135c8ecc', 'request_id': 'req-67fd4523-8fa8-4bb0-aa28-7c29f5423a63'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:47.809888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-67fd4523-8fa8-4bb0-aa28-7c29f5423a63 admin admin] The token cache is being invalidate because project b3666d54fc2d429c8312392f135c8ecc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:47.810283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-67fd4523-8fa8-4bb0-aa28-7c29f5423a63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:47.813490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-67fd4523-8fa8-4bb0-aa28-7c29f5423a63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:47.822290 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2591/5182] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:47 2022] DELETE /identity/v3/projects/b3666d54fc2d429c8312392f135c8ecc => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:47.823878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496558b-86de-4e3b-9270-5a6ef0126373 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:47.824261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496558b-86de-4e3b-9270-5a6ef0126373 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:47.824646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496558b-86de-4e3b-9270-5a6ef0126373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:47.879970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0496558b-86de-4e3b-9270-5a6ef0126373 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:47.882344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0496558b-86de-4e3b-9270-5a6ef0126373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:47.938878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e560e4-1e13-414e-aba0-60b9057ad9b9 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:48.043506 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2592/5183] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:48.055045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c2346-b343-44c0-8c1a-c75d78411d71 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:48.055327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c2346-b343-44c0-8c1a-c75d78411d71 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:48.055595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c2346-b343-44c0-8c1a-c75d78411d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:48.082012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41807ac0-bbee-4eea-ae78-318615f1eae9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:48.087149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41807ac0-bbee-4eea-ae78-318615f1eae9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:48.087454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41807ac0-bbee-4eea-ae78-318615f1eae9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:48.087727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41807ac0-bbee-4eea-ae78-318615f1eae9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/34c9d1e12781482a9417a3ebecdd1eea` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:48.102896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ba9c2346-b343-44c0-8c1a-c75d78411d71 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:48.106923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ba9c2346-b343-44c0-8c1a-c75d78411d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:48.114765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41807ac0-bbee-4eea-ae78-318615f1eae9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=34c9d1e12781482a9417a3ebecdd1eea)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:48.116390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41807ac0-bbee-4eea-ae78-318615f1eae9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:48.139028 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2593/5184] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:48.140640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c2346-b343-44c0-8c1a-c75d78411d71 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:48.168722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c2346-b343-44c0-8c1a-c75d78411d71 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:48.182906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da6b1b-c37b-455f-98e4-e2e028d6f8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:48.183563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da6b1b-c37b-455f-98e4-e2e028d6f8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:48.184701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da6b1b-c37b-455f-98e4-e2e028d6f8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:48.184827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da6b1b-c37b-455f-98e4-e2e028d6f8a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:48.188250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da6b1b-c37b-455f-98e4-e2e028d6f8a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:05:48.188626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da6b1b-c37b-455f-98e4-e2e028d6f8a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:48.191959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da6b1b-c37b-455f-98e4-e2e028d6f8a3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:48.193192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-41807ac0-bbee-4eea-ae78-318615f1eae9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '34c9d1e12781482a9417a3ebecdd1eea'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:48.203033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-41807ac0-bbee-4eea-ae78-318615f1eae9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '34c9d1e12781482a9417a3ebecdd1eea'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:48.223372 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:48.236910 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2594/5185] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:48.241342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da6b1b-c37b-455f-98e4-e2e028d6f8a3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:48.265339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da6b1b-c37b-455f-98e4-e2e028d6f8a3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:48.272105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61363369-56cd-4edb-8b3e-bfc05e71b12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:48.274522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61363369-56cd-4edb-8b3e-bfc05e71b12f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:48.275035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61363369-56cd-4edb-8b3e-bfc05e71b12f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:48.275519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61363369-56cd-4edb-8b3e-bfc05e71b12f admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:48.276386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61363369-56cd-4edb-8b3e-bfc05e71b12f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:48.279213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61363369-56cd-4edb-8b3e-bfc05e71b12f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:48.338054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-41807ac0-bbee-4eea-ae78-318615f1eae9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34c9d1e12781482a9417a3ebecdd1eea', 'request_id': 'req-41807ac0-bbee-4eea-ae78-318615f1eae9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:48.347288 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2595/5186] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:48 2022] POST /identity/v3/projects => generated 389 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:48.352726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61363369-56cd-4edb-8b3e-bfc05e71b12f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:48.357748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-41807ac0-bbee-4eea-ae78-318615f1eae9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34c9d1e12781482a9417a3ebecdd1eea', 'request_id': 'req-41807ac0-bbee-4eea-ae78-318615f1eae9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:48.370120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-41807ac0-bbee-4eea-ae78-318615f1eae9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34c9d1e12781482a9417a3ebecdd1eea', 'request_id': 'req-41807ac0-bbee-4eea-ae78-318615f1eae9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:48.396820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-41807ac0-bbee-4eea-ae78-318615f1eae9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] The token cache is being invalidate because project 34c9d1e12781482a9417a3ebecdd1eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:48.397133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-41807ac0-bbee-4eea-ae78-318615f1eae9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:48.399798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-41807ac0-bbee-4eea-ae78-318615f1eae9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:48.433602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-41807ac0-bbee-4eea-ae78-318615f1eae9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '34c9d1e12781482a9417a3ebecdd1eea', 'request_id': 'req-41807ac0-bbee-4eea-ae78-318615f1eae9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:48.447807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-41807ac0-bbee-4eea-ae78-318615f1eae9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '34c9d1e12781482a9417a3ebecdd1eea', 'request_id': 'req-41807ac0-bbee-4eea-ae78-318615f1eae9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:48.449144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-41807ac0-bbee-4eea-ae78-318615f1eae9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '34c9d1e12781482a9417a3ebecdd1eea', 'request_id': 'req-41807ac0-bbee-4eea-ae78-318615f1eae9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:48.471811 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2592/5187] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:05:47 2022] DELETE /identity/v3/domains/34c9d1e12781482a9417a3ebecdd1eea => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:48.473166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41807ac0-bbee-4eea-ae78-318615f1eae9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:48.474633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-41807ac0-bbee-4eea-ae78-318615f1eae9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:48.547471 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:48.595300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61363369-56cd-4edb-8b3e-bfc05e71b12f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:48.610644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52321cb-986e-4028-a358-57706bc6247d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:48.611436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52321cb-986e-4028-a358-57706bc6247d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:48.611817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52321cb-986e-4028-a358-57706bc6247d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:48.612187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52321cb-986e-4028-a358-57706bc6247d admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:48.613059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52321cb-986e-4028-a358-57706bc6247d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:48.615226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52321cb-986e-4028-a358-57706bc6247d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:48.666906 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2596/5188] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:05:48 2022] POST /identity/v3/users => generated 295 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:05:48.672889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52321cb-986e-4028-a358-57706bc6247d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:48.675867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d52321cb-986e-4028-a358-57706bc6247d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:48.705381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52321cb-986e-4028-a358-57706bc6247d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:48.718920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac608a-0fde-4a52-a1e6-06646c10fc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:48.719700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac608a-0fde-4a52-a1e6-06646c10fc03 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:48.720084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac608a-0fde-4a52-a1e6-06646c10fc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:48.720454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac608a-0fde-4a52-a1e6-06646c10fc03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:48.721923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac608a-0fde-4a52-a1e6-06646c10fc03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:48.729061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac608a-0fde-4a52-a1e6-06646c10fc03 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:48.729513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41807ac0-bbee-4eea-ae78-318615f1eae9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:48.751376 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2597/5189] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:48.758442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac608a-0fde-4a52-a1e6-06646c10fc03 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:48.784709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac608a-0fde-4a52-a1e6-06646c10fc03 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:48.800112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf0e6d-591e-4674-8f4b-55367a76b789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:48.800893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf0e6d-591e-4674-8f4b-55367a76b789 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:48.801246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf0e6d-591e-4674-8f4b-55367a76b789 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:48.801586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf0e6d-591e-4674-8f4b-55367a76b789 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:48.802463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf0e6d-591e-4674-8f4b-55367a76b789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:48.805192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf0e6d-591e-4674-8f4b-55367a76b789 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:48.828976 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2598/5190] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:48.833838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf0e6d-591e-4674-8f4b-55367a76b789 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:48.858531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf0e6d-591e-4674-8f4b-55367a76b789 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:48.877208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25ff52-6c60-4099-99bd-c2a056d28417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:48.877964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25ff52-6c60-4099-99bd-c2a056d28417 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:48.878313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25ff52-6c60-4099-99bd-c2a056d28417 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:48.878651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25ff52-6c60-4099-99bd-c2a056d28417 admin admin] PATH_INFO: `/v3/projects/a43e3eaf929443a2956262ef4a4906b5/users/1711ce933fed4545877c0e970ba3ec50/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:48.888466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b195c6d-b3cd-4784-b82b-b9b922a64820 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:48.889306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b195c6d-b3cd-4784-b82b-b9b922a64820 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:48.889661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b195c6d-b3cd-4784-b82b-b9b922a64820 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:48.889946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b195c6d-b3cd-4784-b82b-b9b922a64820 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:48.890533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b195c6d-b3cd-4784-b82b-b9b922a64820 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:48.891555 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-0b195c6d-b3cd-4784-b82b-b9b922a64820 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:05:48.891555 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:05:48.891555 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:05:48.892450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b195c6d-b3cd-4784-b82b-b9b922a64820 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:48.903262 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2593/5191] 10.222.0.16 () {58 vars in 1173 bytes} [Fri Sep 30 10:05:48 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:48.905579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b195c6d-b3cd-4784-b82b-b9b922a64820 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:48.931605 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25ff52-6c60-4099-99bd-c2a056d28417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a43e3eaf929443a2956262ef4a4906b5, user_id=1711ce933fed4545877c0e970ba3ec50, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:48.934422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25ff52-6c60-4099-99bd-c2a056d28417 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:48.944378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b195c6d-b3cd-4784-b82b-b9b922a64820 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:48.953854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f928e6a-2d4c-4581-acf7-d2ff774e131f tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:48.954607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f928e6a-2d4c-4581-acf7-d2ff774e131f tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:48.954897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f928e6a-2d4c-4581-acf7-d2ff774e131f tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:48.955172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f928e6a-2d4c-4581-acf7-d2ff774e131f tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:48.955779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f928e6a-2d4c-4581-acf7-d2ff774e131f tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:48.967364 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2599/5192] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:05:48 2022] PUT /identity/v3/projects/a43e3eaf929443a2956262ef4a4906b5/users/1711ce933fed4545877c0e970ba3ec50/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:48.979481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f928e6a-2d4c-4581-acf7-d2ff774e131f tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:48.981145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd05382-be67-4237-ac19-d7102b242cff None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:48.981510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd05382-be67-4237-ac19-d7102b242cff None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:48.981785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd05382-be67-4237-ac19-d7102b242cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:48.983916 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2594/5193] 10.222.0.16 () {58 vars in 1200 bytes} [Fri Sep 30 10:05:48 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:48.985944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f928e6a-2d4c-4581-acf7-d2ff774e131f tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:49.014382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f928e6a-2d4c-4581-acf7-d2ff774e131f tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:49.048640 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:49.057876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8cd05382-be67-4237-ac19-d7102b242cff None None] MFA Rules not processed for user `1711ce933fed4545877c0e970ba3ec50`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:49.063885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8cd05382-be67-4237-ac19-d7102b242cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:49.165555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205c4fe-5777-4386-8f8e-449a6a438586 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:49.166391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205c4fe-5777-4386-8f8e-449a6a438586 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:49.167654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205c4fe-5777-4386-8f8e-449a6a438586 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:49.169366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205c4fe-5777-4386-8f8e-449a6a438586 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:49.170118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205c4fe-5777-4386-8f8e-449a6a438586 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:49.177886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205c4fe-5777-4386-8f8e-449a6a438586 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:49.185511 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2595/5194] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Sep 30 10:05:48 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:49.187149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205c4fe-5777-4386-8f8e-449a6a438586 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:49.204460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205c4fe-5777-4386-8f8e-449a6a438586 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:49.222012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a46295-fe49-45b5-a7ca-223d1814578e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:49.222926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a46295-fe49-45b5-a7ca-223d1814578e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:49.224216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a46295-fe49-45b5-a7ca-223d1814578e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:49.224993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a46295-fe49-45b5-a7ca-223d1814578e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:49.227427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a46295-fe49-45b5-a7ca-223d1814578e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:49.229400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a46295-fe49-45b5-a7ca-223d1814578e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:49.233192 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2596/5195] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:49 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:49.237486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a46295-fe49-45b5-a7ca-223d1814578e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:49.254040 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2600/5196] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:49.257733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a46295-fe49-45b5-a7ca-223d1814578e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:49.260695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd05382-be67-4237-ac19-d7102b242cff None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:49.272511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3218276-d06e-4aef-ac84-142ff6cdda69 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:49.274089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3218276-d06e-4aef-ac84-142ff6cdda69 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:49.274375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3218276-d06e-4aef-ac84-142ff6cdda69 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:49.274648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3218276-d06e-4aef-ac84-142ff6cdda69 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:49.278134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3218276-d06e-4aef-ac84-142ff6cdda69 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:49.279784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3218276-d06e-4aef-ac84-142ff6cdda69 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:49.284216 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2597/5197] 10.222.0.16 () {58 vars in 1188 bytes} [Fri Sep 30 10:05:49 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:49.288234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3218276-d06e-4aef-ac84-142ff6cdda69 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:49.318101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3218276-d06e-4aef-ac84-142ff6cdda69 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:49.330426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1696f8a-fca9-42c0-9e4f-5d1ae13b42ee tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:49.331168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1696f8a-fca9-42c0-9e4f-5d1ae13b42ee tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:49.331499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1696f8a-fca9-42c0-9e4f-5d1ae13b42ee tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:49.331776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1696f8a-fca9-42c0-9e4f-5d1ae13b42ee tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:49.332367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1696f8a-fca9-42c0-9e4f-5d1ae13b42ee tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:49.338817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1696f8a-fca9-42c0-9e4f-5d1ae13b42ee tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:49.343951 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2598/5198] 10.222.0.16 () {58 vars in 1200 bytes} [Fri Sep 30 10:05:49 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:49.345694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1696f8a-fca9-42c0-9e4f-5d1ae13b42ee tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:49.368574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1696f8a-fca9-42c0-9e4f-5d1ae13b42ee tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:49.379358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3f985-3d5b-4d8b-8524-d9c73a30cbc6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:49.380066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3f985-3d5b-4d8b-8524-d9c73a30cbc6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:49.380395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3f985-3d5b-4d8b-8524-d9c73a30cbc6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:49.380699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3f985-3d5b-4d8b-8524-d9c73a30cbc6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:49.382252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3f985-3d5b-4d8b-8524-d9c73a30cbc6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:49.384359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3f985-3d5b-4d8b-8524-d9c73a30cbc6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:49.389522 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2599/5199] 10.222.0.16 () {58 vars in 1203 bytes} [Fri Sep 30 10:05:49 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:49.391283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3f985-3d5b-4d8b-8524-d9c73a30cbc6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:49.414867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3f985-3d5b-4d8b-8524-d9c73a30cbc6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:49.421993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd05382-be67-4237-ac19-d7102b242cff None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:49.426766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b0ea2-16b2-44ad-aabd-f5203bb8dedd tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:49.427925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b0ea2-16b2-44ad-aabd-f5203bb8dedd tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:49.428214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b0ea2-16b2-44ad-aabd-f5203bb8dedd tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:49.428493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b0ea2-16b2-44ad-aabd-f5203bb8dedd tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:49.430855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b0ea2-16b2-44ad-aabd-f5203bb8dedd tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:49.432457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b0ea2-16b2-44ad-aabd-f5203bb8dedd tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:49.437700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ab45f-d805-4712-9915-11d6bcf0b11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:49.438083 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2600/5200] 10.222.0.16 () {58 vars in 1209 bytes} [Fri Sep 30 10:05:49 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:49.438727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ab45f-d805-4712-9915-11d6bcf0b11c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:49.439049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b0ea2-16b2-44ad-aabd-f5203bb8dedd tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:49.439356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ab45f-d805-4712-9915-11d6bcf0b11c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:49.439775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ab45f-d805-4712-9915-11d6bcf0b11c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:49.442429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ab45f-d805-4712-9915-11d6bcf0b11c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:49.446749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ab45f-d805-4712-9915-11d6bcf0b11c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:49.463425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b0ea2-16b2-44ad-aabd-f5203bb8dedd tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:49.479266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f31f7-6095-4e10-995a-18cabdb739be tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:49.479401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f31f7-6095-4e10-995a-18cabdb739be tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:49.479600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f31f7-6095-4e10-995a-18cabdb739be tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:49.479883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f31f7-6095-4e10-995a-18cabdb739be tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:49.480485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f31f7-6095-4e10-995a-18cabdb739be tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:49.482135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f31f7-6095-4e10-995a-18cabdb739be tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:49.483281 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2601/5201] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:05:49 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:49.492628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f31f7-6095-4e10-995a-18cabdb739be tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:49.512235 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2601/5202] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:49 2022] POST /identity/v3/projects => generated 391 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:49.513514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ab45f-d805-4712-9915-11d6bcf0b11c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:49.520253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f31f7-6095-4e10-995a-18cabdb739be tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:49.551091 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:49.685023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ec651-f547-421a-8623-7e7f2c409ec5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:49.686518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ec651-f547-421a-8623-7e7f2c409ec5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:49.688183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ec651-f547-421a-8623-7e7f2c409ec5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:49.688680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ec651-f547-421a-8623-7e7f2c409ec5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:49.689941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ec651-f547-421a-8623-7e7f2c409ec5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:49.692925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ec651-f547-421a-8623-7e7f2c409ec5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:49.695599 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2602/5203] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Sep 30 10:05:49 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:49.696743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ec651-f547-421a-8623-7e7f2c409ec5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:49.700700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a55ec651-f547-421a-8623-7e7f2c409ec5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:49.719959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ab45f-d805-4712-9915-11d6bcf0b11c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:49.721184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ec651-f547-421a-8623-7e7f2c409ec5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:49.730950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0abbd-d161-4974-9460-40cf3902a929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:49.735140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0abbd-d161-4974-9460-40cf3902a929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:49.735774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0abbd-d161-4974-9460-40cf3902a929 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:49.736407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0abbd-d161-4974-9460-40cf3902a929 admin admin] PATH_INFO: `/v3/projects/c1ed2df03c784913b2edcec26c5a18e3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:49.738307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0abbd-d161-4974-9460-40cf3902a929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ed2df03c784913b2edcec26c5a18e3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:49.739953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a57f12-33e9-44a9-aecb-a1ba6dd4e203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:49.741101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a57f12-33e9-44a9-aecb-a1ba6dd4e203 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:49.741488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a57f12-33e9-44a9-aecb-a1ba6dd4e203 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:49.742105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a57f12-33e9-44a9-aecb-a1ba6dd4e203 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:49.742543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a57f12-33e9-44a9-aecb-a1ba6dd4e203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:49.743106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0abbd-d161-4974-9460-40cf3902a929 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:49.746509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a57f12-33e9-44a9-aecb-a1ba6dd4e203 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:49.817456 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2602/5204] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:05:49 2022] POST /identity/v3/users => generated 302 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:49.818452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a57f12-33e9-44a9-aecb-a1ba6dd4e203 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:49.845275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a57f12-33e9-44a9-aecb-a1ba6dd4e203 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:49.864474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-44a0abbd-d161-4974-9460-40cf3902a929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ed2df03c784913b2edcec26c5a18e3', 'request_id': 'req-44a0abbd-d161-4974-9460-40cf3902a929'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:49.892708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-44a0abbd-d161-4974-9460-40cf3902a929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ed2df03c784913b2edcec26c5a18e3', 'request_id': 'req-44a0abbd-d161-4974-9460-40cf3902a929'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:49.899687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-44a0abbd-d161-4974-9460-40cf3902a929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ed2df03c784913b2edcec26c5a18e3', 'request_id': 'req-44a0abbd-d161-4974-9460-40cf3902a929'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:49.923443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-44a0abbd-d161-4974-9460-40cf3902a929 admin admin] The token cache is being invalidate because project c1ed2df03c784913b2edcec26c5a18e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:49.923894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-44a0abbd-d161-4974-9460-40cf3902a929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:49.926186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-44a0abbd-d161-4974-9460-40cf3902a929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:49.932074 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2603/5205] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:49 2022] DELETE /identity/v3/projects/c1ed2df03c784913b2edcec26c5a18e3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:49.932887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0abbd-d161-4974-9460-40cf3902a929 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:49.936173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-44a0abbd-d161-4974-9460-40cf3902a929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:49.944542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfb0e3-9137-41bf-8d41-b5952eebddd8 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:49.946050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfb0e3-9137-41bf-8d41-b5952eebddd8 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:49.946336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfb0e3-9137-41bf-8d41-b5952eebddd8 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:49.946613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfb0e3-9137-41bf-8d41-b5952eebddd8 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:49.948045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfb0e3-9137-41bf-8d41-b5952eebddd8 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:49.949206 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-1fdfb0e3-9137-41bf-8d41-b5952eebddd8 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:05:49.949206 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:05:49.949206 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:05:49.950481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfb0e3-9137-41bf-8d41-b5952eebddd8 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:49.953186 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2603/5206] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Sep 30 10:05:49 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:49.954782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4edae6-50fe-4a78-9d98-a172540e32fb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:49.955113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4edae6-50fe-4a78-9d98-a172540e32fb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:49.955390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4edae6-50fe-4a78-9d98-a172540e32fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:49.984268 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:49.989193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fd4edae6-50fe-4a78-9d98-a172540e32fb None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:49.992970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fd4edae6-50fe-4a78-9d98-a172540e32fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:50.068934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0abbd-d161-4974-9460-40cf3902a929 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:50.088981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2134da-9c4c-4ab0-a72d-eba37547ed5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:50.089872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2134da-9c4c-4ab0-a72d-eba37547ed5f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:50.090302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2134da-9c4c-4ab0-a72d-eba37547ed5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:50.090724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2134da-9c4c-4ab0-a72d-eba37547ed5f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:50.091526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2134da-9c4c-4ab0-a72d-eba37547ed5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:50.093290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2134da-9c4c-4ab0-a72d-eba37547ed5f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:50.097545 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2604/5207] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:50.107404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4edae6-50fe-4a78-9d98-a172540e32fb None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:50.108995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fd4edae6-50fe-4a78-9d98-a172540e32fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:50.120199 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2604/5208] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:50.125213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202a1b4-afb6-4cfe-b195-29b999c9c36d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:50.125737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202a1b4-afb6-4cfe-b195-29b999c9c36d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:50.126179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202a1b4-afb6-4cfe-b195-29b999c9c36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:50.126953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4edae6-50fe-4a78-9d98-a172540e32fb None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:50.134207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d5d9f-6dbb-4eb1-a23f-f403892341dc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:50.134801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d5d9f-6dbb-4eb1-a23f-f403892341dc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:50.135220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d5d9f-6dbb-4eb1-a23f-f403892341dc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:50.135345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d5d9f-6dbb-4eb1-a23f-f403892341dc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:50.137249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d5d9f-6dbb-4eb1-a23f-f403892341dc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:50.139221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d5d9f-6dbb-4eb1-a23f-f403892341dc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:50.140778 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2605/5209] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:05:50 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:50.141651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d5d9f-6dbb-4eb1-a23f-f403892341dc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:50.170734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d5d9f-6dbb-4eb1-a23f-f403892341dc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:50.173364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8202a1b4-afb6-4cfe-b195-29b999c9c36d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:50.175803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092f624-c7a6-4f4f-9fa8-5d78f170e5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:50.176988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8202a1b4-afb6-4cfe-b195-29b999c9c36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:50.177123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092f624-c7a6-4f4f-9fa8-5d78f170e5cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:50.177375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092f624-c7a6-4f4f-9fa8-5d78f170e5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:50.177647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092f624-c7a6-4f4f-9fa8-5d78f170e5cd admin admin] PATH_INFO: `/v3/projects/7a926c017fe547b9a90494e8ba909468/users/16453adae92045d1aa5b3e2586f62308/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:50.199533 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2605/5210] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:50.206078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202a1b4-afb6-4cfe-b195-29b999c9c36d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:50.223721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092f624-c7a6-4f4f-9fa8-5d78f170e5cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a926c017fe547b9a90494e8ba909468, user_id=16453adae92045d1aa5b3e2586f62308, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:50.237573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092f624-c7a6-4f4f-9fa8-5d78f170e5cd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:50.240356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202a1b4-afb6-4cfe-b195-29b999c9c36d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:50.258239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367b38f-0af5-4e07-a72e-036cf1421f02 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:50.259185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367b38f-0af5-4e07-a72e-036cf1421f02 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:50.259622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367b38f-0af5-4e07-a72e-036cf1421f02 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:50.260047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367b38f-0af5-4e07-a72e-036cf1421f02 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:50.260930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367b38f-0af5-4e07-a72e-036cf1421f02 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:50.267597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367b38f-0af5-4e07-a72e-036cf1421f02 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:50.269374 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2606/5211] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Sep 30 10:05:50 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:50.270311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367b38f-0af5-4e07-a72e-036cf1421f02 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:50.270815 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2606/5212] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:05:50 2022] PUT /identity/v3/projects/7a926c017fe547b9a90494e8ba909468/users/16453adae92045d1aa5b3e2586f62308/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:50.274175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092f624-c7a6-4f4f-9fa8-5d78f170e5cd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:50.300952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367b38f-0af5-4e07-a72e-036cf1421f02 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:50.331015 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:50.436043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa65092-44bf-4e36-a8f7-02f58187bba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:50.440255 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa65092-44bf-4e36-a8f7-02f58187bba5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:50.440934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa65092-44bf-4e36-a8f7-02f58187bba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:50.441221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa65092-44bf-4e36-a8f7-02f58187bba5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:50.441904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa65092-44bf-4e36-a8f7-02f58187bba5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:05:50.442636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa65092-44bf-4e36-a8f7-02f58187bba5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:50.445710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa65092-44bf-4e36-a8f7-02f58187bba5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:50.463519 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2607/5213] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:05:50.464044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092f624-c7a6-4f4f-9fa8-5d78f170e5cd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:50.468433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa65092-44bf-4e36-a8f7-02f58187bba5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:50.482773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944c389-4ebc-45e1-bd2e-50aa8d628326 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:50.483446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944c389-4ebc-45e1-bd2e-50aa8d628326 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:50.483724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944c389-4ebc-45e1-bd2e-50aa8d628326 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:50.483997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944c389-4ebc-45e1-bd2e-50aa8d628326 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:50.484585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944c389-4ebc-45e1-bd2e-50aa8d628326 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:50.486231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944c389-4ebc-45e1-bd2e-50aa8d628326 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:50.490495 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2607/5214] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Sep 30 10:05:50 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:50.490495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944c389-4ebc-45e1-bd2e-50aa8d628326 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:50.502648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa65092-44bf-4e36-a8f7-02f58187bba5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:50.513234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44a08d-49a3-45c2-90fb-33039b1ea902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:50.514022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44a08d-49a3-45c2-90fb-33039b1ea902 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:50.514338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44a08d-49a3-45c2-90fb-33039b1ea902 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:50.514636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44a08d-49a3-45c2-90fb-33039b1ea902 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:50.515219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44a08d-49a3-45c2-90fb-33039b1ea902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:50.516887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44a08d-49a3-45c2-90fb-33039b1ea902 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:50.522402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944c389-4ebc-45e1-bd2e-50aa8d628326 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:50.535104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01d767-698d-4213-b10c-00f4828caefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:50.536039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01d767-698d-4213-b10c-00f4828caefc admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:50.536502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01d767-698d-4213-b10c-00f4828caefc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:50.537084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01d767-698d-4213-b10c-00f4828caefc admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:50.537863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01d767-698d-4213-b10c-00f4828caefc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:50.540652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01d767-698d-4213-b10c-00f4828caefc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:50.544147 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2608/5215] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:50.544147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44a08d-49a3-45c2-90fb-33039b1ea902 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:50.555813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44a08d-49a3-45c2-90fb-33039b1ea902 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:50.563843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ea545-c38d-405f-9532-7def3b598df6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:50.564590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ea545-c38d-405f-9532-7def3b598df6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:50.564981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ea545-c38d-405f-9532-7def3b598df6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:50.565327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ea545-c38d-405f-9532-7def3b598df6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:50.567961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ea545-c38d-405f-9532-7def3b598df6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:50.567961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ea545-c38d-405f-9532-7def3b598df6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:50.569687 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2609/5216] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:05:50 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:50.571272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ea545-c38d-405f-9532-7def3b598df6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:50.591356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4a7ea545-c38d-405f-9532-7def3b598df6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:50.649319 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2608/5217] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:50 2022] POST /identity/v3/projects => generated 363 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:50.650379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01d767-698d-4213-b10c-00f4828caefc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:50.709748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ea545-c38d-405f-9532-7def3b598df6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:50.743621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01d767-698d-4213-b10c-00f4828caefc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:50.749484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bcdc9-b95f-44cc-ba25-e6b740d32707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:50.750510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bcdc9-b95f-44cc-ba25-e6b740d32707 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:50.751060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bcdc9-b95f-44cc-ba25-e6b740d32707 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:50.751494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bcdc9-b95f-44cc-ba25-e6b740d32707 admin admin] PATH_INFO: `/v3/projects/7a926c017fe547b9a90494e8ba909468/users/16453adae92045d1aa5b3e2586f62308/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:50.754872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bcdc9-b95f-44cc-ba25-e6b740d32707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a926c017fe547b9a90494e8ba909468, user_id=16453adae92045d1aa5b3e2586f62308, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:50.764274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bcdc9-b95f-44cc-ba25-e6b740d32707 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:50.795011 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2609/5218] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:05:50 2022] PUT /identity/v3/projects/7a926c017fe547b9a90494e8ba909468/users/16453adae92045d1aa5b3e2586f62308/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:50.795769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bcdc9-b95f-44cc-ba25-e6b740d32707 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:50.821574 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:50.838962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e9821-d6ab-449b-b94e-212d4ade76af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:50.839597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e9821-d6ab-449b-b94e-212d4ade76af service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:50.839887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e9821-d6ab-449b-b94e-212d4ade76af service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:50.840151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e9821-d6ab-449b-b94e-212d4ade76af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:50.843380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ac8e9821-d6ab-449b-b94e-212d4ade76af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:50.867759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e9821-d6ab-449b-b94e-212d4ade76af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:50.869589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e9821-d6ab-449b-b94e-212d4ade76af service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:50.884959 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2610/5219] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:50.886143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e9821-d6ab-449b-b94e-212d4ade76af service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:50.898585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bcdc9-b95f-44cc-ba25-e6b740d32707 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:50.899576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e9821-d6ab-449b-b94e-212d4ade76af service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:50.904365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d5be8-f937-42ac-9cfd-8cc498472e77 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:50.905256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d5be8-f937-42ac-9cfd-8cc498472e77 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:50.906175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d5be8-f937-42ac-9cfd-8cc498472e77 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:50.906468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d5be8-f937-42ac-9cfd-8cc498472e77 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:50.907119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d5be8-f937-42ac-9cfd-8cc498472e77 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:50.909596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d5be8-f937-42ac-9cfd-8cc498472e77 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:50.914422 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2610/5220] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Sep 30 10:05:50 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:50.914422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eff93b-17cb-4ab7-96e9-1fba6ee3c813 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:50.914422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eff93b-17cb-4ab7-96e9-1fba6ee3c813 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:50.914422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eff93b-17cb-4ab7-96e9-1fba6ee3c813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:50.994211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-18eff93b-17cb-4ab7-96e9-1fba6ee3c813 None None] MFA Rules not processed for user `16453adae92045d1aa5b3e2586f62308`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:50.995483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-18eff93b-17cb-4ab7-96e9-1fba6ee3c813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:51.044903 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:51.060365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb88f3c-c8d3-4ddd-8a6f-c9f1dcbb990f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:51.061096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb88f3c-c8d3-4ddd-8a6f-c9f1dcbb990f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:51.061380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb88f3c-c8d3-4ddd-8a6f-c9f1dcbb990f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:51.061650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb88f3c-c8d3-4ddd-8a6f-c9f1dcbb990f admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:51.062338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb88f3c-c8d3-4ddd-8a6f-c9f1dcbb990f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:51.067872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb88f3c-c8d3-4ddd-8a6f-c9f1dcbb990f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:51.137770 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2611/5221] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:05:50 2022] POST /identity/v3/users => generated 282 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:51.139006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb88f3c-c8d3-4ddd-8a6f-c9f1dcbb990f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:51.152848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb88f3c-c8d3-4ddd-8a6f-c9f1dcbb990f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:51.158813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51fcb0-5a1e-4729-83a4-b58a3487abeb tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:51.161892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51fcb0-5a1e-4729-83a4-b58a3487abeb tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:51.165316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51fcb0-5a1e-4729-83a4-b58a3487abeb tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:51.165862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51fcb0-5a1e-4729-83a4-b58a3487abeb tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:51.166682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51fcb0-5a1e-4729-83a4-b58a3487abeb tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:51.168709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51fcb0-5a1e-4729-83a4-b58a3487abeb tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:51.178078 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2612/5222] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Sep 30 10:05:51 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:51.179560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51fcb0-5a1e-4729-83a4-b58a3487abeb tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:51.187708 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2611/5223] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:50 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:51.189730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eff93b-17cb-4ab7-96e9-1fba6ee3c813 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:51.203324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51fcb0-5a1e-4729-83a4-b58a3487abeb tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:51.211961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eff93b-17cb-4ab7-96e9-1fba6ee3c813 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:51.215479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e64990-a693-414d-a6bf-d2edee0649ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:51.215872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e64990-a693-414d-a6bf-d2edee0649ad admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:51.216735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e64990-a693-414d-a6bf-d2edee0649ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:51.216735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e64990-a693-414d-a6bf-d2edee0649ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:51.218425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e64990-a693-414d-a6bf-d2edee0649ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:51.220437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e64990-a693-414d-a6bf-d2edee0649ad admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:51.224511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa14a5-3ce9-49d8-b432-24275e184a60 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:51.225255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa14a5-3ce9-49d8-b432-24275e184a60 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:51.225541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa14a5-3ce9-49d8-b432-24275e184a60 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:51.225878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa14a5-3ce9-49d8-b432-24275e184a60 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:51.226436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa14a5-3ce9-49d8-b432-24275e184a60 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:51.228046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa14a5-3ce9-49d8-b432-24275e184a60 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:51.239399 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2612/5224] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Sep 30 10:05:51 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:51.242157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa14a5-3ce9-49d8-b432-24275e184a60 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:51.259203 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2613/5225] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:51.261021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e64990-a693-414d-a6bf-d2edee0649ad admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:51.264315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-94e64990-a693-414d-a6bf-d2edee0649ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:51.269009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa14a5-3ce9-49d8-b432-24275e184a60 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:51.281593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018a2d5-43bd-4cb8-b7d9-17a85de8a5e5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:51.283566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018a2d5-43bd-4cb8-b7d9-17a85de8a5e5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:51.285128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018a2d5-43bd-4cb8-b7d9-17a85de8a5e5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:51.285541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018a2d5-43bd-4cb8-b7d9-17a85de8a5e5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:51.286212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018a2d5-43bd-4cb8-b7d9-17a85de8a5e5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:51.289637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018a2d5-43bd-4cb8-b7d9-17a85de8a5e5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:51.296113 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2613/5226] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Sep 30 10:05:51 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:51.298224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018a2d5-43bd-4cb8-b7d9-17a85de8a5e5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:51.328221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018a2d5-43bd-4cb8-b7d9-17a85de8a5e5 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:51.352487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6bce9-cc47-4da6-9c3c-6ecc0e084049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:51.353886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6bce9-cc47-4da6-9c3c-6ecc0e084049 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:51.354194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6bce9-cc47-4da6-9c3c-6ecc0e084049 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:51.355687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6bce9-cc47-4da6-9c3c-6ecc0e084049 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:51.356378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6bce9-cc47-4da6-9c3c-6ecc0e084049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:51.358037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6bce9-cc47-4da6-9c3c-6ecc0e084049 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:51.400541 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2614/5227] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:51.401905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6bce9-cc47-4da6-9c3c-6ecc0e084049 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:51.437887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6bce9-cc47-4da6-9c3c-6ecc0e084049 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:51.438335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e64990-a693-414d-a6bf-d2edee0649ad admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:51.442750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725a981-ecc0-470e-84fa-7c0503b7140c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:51.443580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725a981-ecc0-470e-84fa-7c0503b7140c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:51.443864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725a981-ecc0-470e-84fa-7c0503b7140c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:51.444132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725a981-ecc0-470e-84fa-7c0503b7140c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:51.446375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943cea7-ae3d-4a28-873b-862f3f7d213d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:51.446536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3725a981-ecc0-470e-84fa-7c0503b7140c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:51.448231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943cea7-ae3d-4a28-873b-862f3f7d213d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:51.448694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943cea7-ae3d-4a28-873b-862f3f7d213d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:51.452963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943cea7-ae3d-4a28-873b-862f3f7d213d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:51.454180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943cea7-ae3d-4a28-873b-862f3f7d213d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:51.456197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943cea7-ae3d-4a28-873b-862f3f7d213d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:51.472229 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2615/5228] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Sep 30 10:05:51 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:51.473514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943cea7-ae3d-4a28-873b-862f3f7d213d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:51.497695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943cea7-ae3d-4a28-873b-862f3f7d213d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:51.512360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b048b-bd7c-4204-a074-4860846c2a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:51.513698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b048b-bd7c-4204-a074-4860846c2a4e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:51.513980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b048b-bd7c-4204-a074-4860846c2a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:51.514251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b048b-bd7c-4204-a074-4860846c2a4e admin admin] PATH_INFO: `/v3/projects/51040a8897314f8c801caa23be100792/users/0d624bba642341ba9ea87a27034cc999/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:51.564310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b048b-bd7c-4204-a074-4860846c2a4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=51040a8897314f8c801caa23be100792, user_id=0d624bba642341ba9ea87a27034cc999, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:51.567032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b048b-bd7c-4204-a074-4860846c2a4e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:51.612893 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2616/5229] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:05:51 2022] PUT /identity/v3/projects/51040a8897314f8c801caa23be100792/users/0d624bba642341ba9ea87a27034cc999/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:51.613939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b048b-bd7c-4204-a074-4860846c2a4e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:51.616328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725a981-ecc0-470e-84fa-7c0503b7140c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:51.618632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725a981-ecc0-470e-84fa-7c0503b7140c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:51.643158 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2614/5230] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:51.646674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a20f31-af51-4a98-aa46-2ef5cb39c69e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:51.646982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a20f31-af51-4a98-aa46-2ef5cb39c69e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:51.647236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a20f31-af51-4a98-aa46-2ef5cb39c69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:51.744282 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:51.765224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-46a20f31-af51-4a98-aa46-2ef5cb39c69e None None] MFA Rules not processed for user `0d624bba642341ba9ea87a27034cc999`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:51.775383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-46a20f31-af51-4a98-aa46-2ef5cb39c69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:51.845510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b048b-bd7c-4204-a074-4860846c2a4e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:51.868072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1dae8-5ebe-4eab-88ac-cfb09fed689b tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:51.868681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1dae8-5ebe-4eab-88ac-cfb09fed689b tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:51.868805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1dae8-5ebe-4eab-88ac-cfb09fed689b tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:51.869051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1dae8-5ebe-4eab-88ac-cfb09fed689b tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:51.869955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1dae8-5ebe-4eab-88ac-cfb09fed689b tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:51.871588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1dae8-5ebe-4eab-88ac-cfb09fed689b tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:51.877069 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2617/5231] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Sep 30 10:05:51 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:51.882449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1dae8-5ebe-4eab-88ac-cfb09fed689b tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:51.917741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1dae8-5ebe-4eab-88ac-cfb09fed689b tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:51.939434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1044dc3-994f-43f4-ab48-9df5ead72346 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:51.940159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1044dc3-994f-43f4-ab48-9df5ead72346 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:51.940648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1044dc3-994f-43f4-ab48-9df5ead72346 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:51.941041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1044dc3-994f-43f4-ab48-9df5ead72346 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:51.941699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1044dc3-994f-43f4-ab48-9df5ead72346 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:51.943387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1044dc3-994f-43f4-ab48-9df5ead72346 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:51.951072 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2618/5232] 10.222.0.16 () {58 vars in 1257 bytes} [Fri Sep 30 10:05:51 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:51.952237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1044dc3-994f-43f4-ab48-9df5ead72346 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:51.997062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1044dc3-994f-43f4-ab48-9df5ead72346 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:52.016179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4be61-b670-43ba-b190-99ffd8440562 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:52.016810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4be61-b670-43ba-b190-99ffd8440562 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:52.017091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4be61-b670-43ba-b190-99ffd8440562 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:52.017365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4be61-b670-43ba-b190-99ffd8440562 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:52.017954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4be61-b670-43ba-b190-99ffd8440562 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:52.030936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4be61-b670-43ba-b190-99ffd8440562 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:52.032645 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2619/5233] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Sep 30 10:05:51 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:52.037593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4be61-b670-43ba-b190-99ffd8440562 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:52.041869 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2615/5234] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:52.043119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a20f31-af51-4a98-aa46-2ef5cb39c69e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:52.078074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4be61-b670-43ba-b190-99ffd8440562 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:52.097896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4a877-ee79-4771-a80b-81df57f4a165 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:52.098561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4a877-ee79-4771-a80b-81df57f4a165 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:52.098837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4a877-ee79-4771-a80b-81df57f4a165 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:52.099199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4a877-ee79-4771-a80b-81df57f4a165 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:52.099792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb4a877-ee79-4771-a80b-81df57f4a165 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:52.105135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb4a877-ee79-4771-a80b-81df57f4a165 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:52.112757 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2620/5235] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Sep 30 10:05:52 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:52.114135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4a877-ee79-4771-a80b-81df57f4a165 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:52.131111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4a877-ee79-4771-a80b-81df57f4a165 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:52.166485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea00e9-f314-490f-931a-d28d2631604a tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:52.173360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea00e9-f314-490f-931a-d28d2631604a tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:52.173632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea00e9-f314-490f-931a-d28d2631604a tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:52.175943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea00e9-f314-490f-931a-d28d2631604a tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:52.176640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea00e9-f314-490f-931a-d28d2631604a tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:52.178324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea00e9-f314-490f-931a-d28d2631604a tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:52.179817 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2621/5236] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Sep 30 10:05:52 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 30 10:05:52.189197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea00e9-f314-490f-931a-d28d2631604a tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:52.222351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea00e9-f314-490f-931a-d28d2631604a tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:52.239434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2bb4c-2f05-4865-b7f7-58e5a4c77794 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:52.239796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2bb4c-2f05-4865-b7f7-58e5a4c77794 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:52.240144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2bb4c-2f05-4865-b7f7-58e5a4c77794 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:52.240490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2bb4c-2f05-4865-b7f7-58e5a4c77794 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:52.263234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2bb4c-2f05-4865-b7f7-58e5a4c77794 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:52.264756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2bb4c-2f05-4865-b7f7-58e5a4c77794 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:52.276415 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2622/5237] 10.222.0.16 () {58 vars in 1254 bytes} [Fri Sep 30 10:05:52 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:52.281293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a20f31-af51-4a98-aa46-2ef5cb39c69e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:52.283053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2bb4c-2f05-4865-b7f7-58e5a4c77794 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:52.295444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ebc33-a79d-480c-9de6-38b0b37e7c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:52.296074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ebc33-a79d-480c-9de6-38b0b37e7c6d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:52.296911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ebc33-a79d-480c-9de6-38b0b37e7c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:52.297190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ebc33-a79d-480c-9de6-38b0b37e7c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:52.297830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ebc33-a79d-480c-9de6-38b0b37e7c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:52.299730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ebc33-a79d-480c-9de6-38b0b37e7c6d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:52.305747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2bb4c-2f05-4865-b7f7-58e5a4c77794 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:52.317929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf77ee8-8da8-485a-825f-e60ca74881be tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:52.319107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf77ee8-8da8-485a-825f-e60ca74881be tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:52.319413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf77ee8-8da8-485a-825f-e60ca74881be tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:52.320271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf77ee8-8da8-485a-825f-e60ca74881be tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:52.321061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf77ee8-8da8-485a-825f-e60ca74881be tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:52.323331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf77ee8-8da8-485a-825f-e60ca74881be tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:52.328921 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2623/5238] 10.222.0.16 () {58 vars in 1290 bytes} [Fri Sep 30 10:05:52 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:52.332973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf77ee8-8da8-485a-825f-e60ca74881be tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:52.354582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf77ee8-8da8-485a-825f-e60ca74881be tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:52.367898 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2616/5239] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:52 2022] POST /identity/v3/projects => generated 365 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:05:52.371710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ebc33-a79d-480c-9de6-38b0b37e7c6d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:52.373140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc64d5c-638d-49f0-9052-78cecde1ebb0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:52.376369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc64d5c-638d-49f0-9052-78cecde1ebb0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:52.379518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc64d5c-638d-49f0-9052-78cecde1ebb0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:52.380353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc64d5c-638d-49f0-9052-78cecde1ebb0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:52.381355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc64d5c-638d-49f0-9052-78cecde1ebb0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:52.384202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc64d5c-638d-49f0-9052-78cecde1ebb0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:52.386462 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2624/5240] 10.222.0.16 () {58 vars in 1257 bytes} [Fri Sep 30 10:05:52 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:52.390928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc64d5c-638d-49f0-9052-78cecde1ebb0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:52.415953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc64d5c-638d-49f0-9052-78cecde1ebb0 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:52.511487 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:52.523544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ebc33-a79d-480c-9de6-38b0b37e7c6d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:52.537146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8aa4d-7a61-495a-8691-d8d3faa8f3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:52.539033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8aa4d-7a61-495a-8691-d8d3faa8f3c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:52.539335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8aa4d-7a61-495a-8691-d8d3faa8f3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:52.539608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8aa4d-7a61-495a-8691-d8d3faa8f3c2 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:52.540262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8aa4d-7a61-495a-8691-d8d3faa8f3c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:52.543206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8aa4d-7a61-495a-8691-d8d3faa8f3c2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:52.553196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cc836-e93e-441e-bdf9-ebed2c33e7ae tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:52.554108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cc836-e93e-441e-bdf9-ebed2c33e7ae tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:52.554720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cc836-e93e-441e-bdf9-ebed2c33e7ae tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:52.555254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cc836-e93e-441e-bdf9-ebed2c33e7ae tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:52.556126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39cc836-e93e-441e-bdf9-ebed2c33e7ae tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:52.561430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39cc836-e93e-441e-bdf9-ebed2c33e7ae tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:52.563103 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2625/5241] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Sep 30 10:05:52 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:52.567729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cc836-e93e-441e-bdf9-ebed2c33e7ae tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:52.582258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cc836-e93e-441e-bdf9-ebed2c33e7ae tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:52.596654 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2617/5242] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:05:52 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:05:52.599246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8aa4d-7a61-495a-8691-d8d3faa8f3c2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:52.600483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d7acc-8a86-45af-820c-bbeca3436a3f tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:52.601869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d7acc-8a86-45af-820c-bbeca3436a3f tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:52.602150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d7acc-8a86-45af-820c-bbeca3436a3f tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:52.606747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d7acc-8a86-45af-820c-bbeca3436a3f tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:52.607426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d7acc-8a86-45af-820c-bbeca3436a3f tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:52.614230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d7acc-8a86-45af-820c-bbeca3436a3f tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:52.614230 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2626/5243] 10.222.0.16 () {58 vars in 1308 bytes} [Fri Sep 30 10:05:52 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:52.618708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d7acc-8a86-45af-820c-bbeca3436a3f tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:52.619778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8aa4d-7a61-495a-8691-d8d3faa8f3c2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:52.638389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d7acc-8a86-45af-820c-bbeca3436a3f tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:52.640290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bbd3b-a1e4-4114-8bb1-e53e79bcad77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:52.641211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bbd3b-a1e4-4114-8bb1-e53e79bcad77 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:52.641494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bbd3b-a1e4-4114-8bb1-e53e79bcad77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:52.641767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bbd3b-a1e4-4114-8bb1-e53e79bcad77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:52.642434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bbd3b-a1e4-4114-8bb1-e53e79bcad77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:52.644215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bbd3b-a1e4-4114-8bb1-e53e79bcad77 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:52.652074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b946e-bc5e-4018-ac62-0b2b09a986e3 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:52.652771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b946e-bc5e-4018-ac62-0b2b09a986e3 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:52.653055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b946e-bc5e-4018-ac62-0b2b09a986e3 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:52.653323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b946e-bc5e-4018-ac62-0b2b09a986e3 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:52.653913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b946e-bc5e-4018-ac62-0b2b09a986e3 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:52.655513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b946e-bc5e-4018-ac62-0b2b09a986e3 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:52.661063 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2618/5244] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:05:52.661342 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2627/5245] 10.222.0.16 () {58 vars in 1290 bytes} [Fri Sep 30 10:05:52 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:52.662109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b946e-bc5e-4018-ac62-0b2b09a986e3 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:52.665021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bbd3b-a1e4-4114-8bb1-e53e79bcad77 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:52.677541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bbd3b-a1e4-4114-8bb1-e53e79bcad77 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:52.688004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b946e-bc5e-4018-ac62-0b2b09a986e3 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:52.699299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a49d3-1c0c-46c1-ac46-9b7ea5eaad86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:52.699544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e5446-9b28-4649-8bd9-5621f7197801 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:52.700146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e5446-9b28-4649-8bd9-5621f7197801 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:52.700424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e5446-9b28-4649-8bd9-5621f7197801 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:52.700728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e5446-9b28-4649-8bd9-5621f7197801 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:52.701235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a49d3-1c0c-46c1-ac46-9b7ea5eaad86 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:52.701376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e5446-9b28-4649-8bd9-5621f7197801 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:52.702959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e5446-9b28-4649-8bd9-5621f7197801 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:52.703092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a49d3-1c0c-46c1-ac46-9b7ea5eaad86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:52.703371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a49d3-1c0c-46c1-ac46-9b7ea5eaad86 admin admin] PATH_INFO: `/v3/projects/226eb96c698349d6a1198f1c02e52413/users/fb6136016f1f425db63066e9272526d9/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:52.704130 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2628/5246] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:05:52 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:52.711189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e5446-9b28-4649-8bd9-5621f7197801 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:52.718979 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:52.735447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e5446-9b28-4649-8bd9-5621f7197801 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:52.753325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874975f-9d4b-4660-9774-a66ddeb2c864 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:52.753989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874975f-9d4b-4660-9774-a66ddeb2c864 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:52.754269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874975f-9d4b-4660-9774-a66ddeb2c864 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:52.754540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874975f-9d4b-4660-9774-a66ddeb2c864 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:52.755129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874975f-9d4b-4660-9774-a66ddeb2c864 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:52.759566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a49d3-1c0c-46c1-ac46-9b7ea5eaad86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=226eb96c698349d6a1198f1c02e52413, user_id=fb6136016f1f425db63066e9272526d9, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:52.760833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874975f-9d4b-4660-9774-a66ddeb2c864 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:52.762139 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2629/5247] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Sep 30 10:05:52 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:52.765993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874975f-9d4b-4660-9774-a66ddeb2c864 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:52.767165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a49d3-1c0c-46c1-ac46-9b7ea5eaad86 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:52.788977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874975f-9d4b-4660-9774-a66ddeb2c864 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:52.801302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85f809-a711-4a10-9dec-daf558159048 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:52.801999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85f809-a711-4a10-9dec-daf558159048 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:52.802283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85f809-a711-4a10-9dec-daf558159048 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:52.802560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85f809-a711-4a10-9dec-daf558159048 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:52.803152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85f809-a711-4a10-9dec-daf558159048 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:52.806046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85f809-a711-4a10-9dec-daf558159048 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:52.814000 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2630/5248] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Sep 30 10:05:52 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 30 10:05:52.815226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85f809-a711-4a10-9dec-daf558159048 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:52.831098 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2619/5249] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:05:52 2022] PUT /identity/v3/projects/226eb96c698349d6a1198f1c02e52413/users/fb6136016f1f425db63066e9272526d9/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:52.834352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a49d3-1c0c-46c1-ac46-9b7ea5eaad86 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:52.835673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85f809-a711-4a10-9dec-daf558159048 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:52.973751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a49d3-1c0c-46c1-ac46-9b7ea5eaad86 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:52.985755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad4562-7562-43d8-8abf-d19b2f885857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:52.986604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad4562-7562-43d8-8abf-d19b2f885857 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:52.987068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad4562-7562-43d8-8abf-d19b2f885857 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:52.987496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad4562-7562-43d8-8abf-d19b2f885857 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:52.988331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad4562-7562-43d8-8abf-d19b2f885857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:52.993641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad4562-7562-43d8-8abf-d19b2f885857 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:52.997476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14401eb3-bf6a-4526-8ca3-ac92af930096 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:52.999447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14401eb3-bf6a-4526-8ca3-ac92af930096 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:53.003867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14401eb3-bf6a-4526-8ca3-ac92af930096 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:53.004416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14401eb3-bf6a-4526-8ca3-ac92af930096 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:53.005619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14401eb3-bf6a-4526-8ca3-ac92af930096 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:53.011275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14401eb3-bf6a-4526-8ca3-ac92af930096 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:53.016188 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2631/5250] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Sep 30 10:05:52 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:53.021399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14401eb3-bf6a-4526-8ca3-ac92af930096 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:53.035510 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2620/5251] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:53.037836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad4562-7562-43d8-8abf-d19b2f885857 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:53.057045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14401eb3-bf6a-4526-8ca3-ac92af930096 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:53.059031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad4562-7562-43d8-8abf-d19b2f885857 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:53.071555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1d90f-f52d-4d8e-9d6b-c56ee231386e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:53.077865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1d90f-f52d-4d8e-9d6b-c56ee231386e admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:53.078335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1d90f-f52d-4d8e-9d6b-c56ee231386e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:53.078766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1d90f-f52d-4d8e-9d6b-c56ee231386e admin admin] PATH_INFO: `/v3/projects/226eb96c698349d6a1198f1c02e52413/users/fb6136016f1f425db63066e9272526d9/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:53.080652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dac2d3-1e0c-4f9f-a25b-c2f82db5dc36 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:53.082299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1d90f-f52d-4d8e-9d6b-c56ee231386e admin admin] RBAC: Authorizing `identity:create_grant(project_id=226eb96c698349d6a1198f1c02e52413, user_id=fb6136016f1f425db63066e9272526d9, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:53.082695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dac2d3-1e0c-4f9f-a25b-c2f82db5dc36 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:53.083790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dac2d3-1e0c-4f9f-a25b-c2f82db5dc36 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:53.085011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dac2d3-1e0c-4f9f-a25b-c2f82db5dc36 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:53.086429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1d90f-f52d-4d8e-9d6b-c56ee231386e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:53.087213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dac2d3-1e0c-4f9f-a25b-c2f82db5dc36 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:53.090457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dac2d3-1e0c-4f9f-a25b-c2f82db5dc36 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:53.096814 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2632/5252] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Sep 30 10:05:53 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:53.107750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dac2d3-1e0c-4f9f-a25b-c2f82db5dc36 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:53.108216 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2621/5253] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:05:53 2022] PUT /identity/v3/projects/226eb96c698349d6a1198f1c02e52413/users/fb6136016f1f425db63066e9272526d9/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:53.112448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d4748-4d24-4993-bd72-cca8f5d8c162 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:53.113838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d4748-4d24-4993-bd72-cca8f5d8c162 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:53.114856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d4748-4d24-4993-bd72-cca8f5d8c162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:53.127045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dac2d3-1e0c-4f9f-a25b-c2f82db5dc36 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:53.218549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-aa1d4748-4d24-4993-bd72-cca8f5d8c162 None None] MFA Rules not processed for user `fb6136016f1f425db63066e9272526d9`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:53.225150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aa1d4748-4d24-4993-bd72-cca8f5d8c162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:53.296054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940610e-4001-4c47-988a-6c581595e201 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:53.300072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940610e-4001-4c47-988a-6c581595e201 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:53.300512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940610e-4001-4c47-988a-6c581595e201 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:53.300963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940610e-4001-4c47-988a-6c581595e201 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:53.301705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940610e-4001-4c47-988a-6c581595e201 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:53.306850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940610e-4001-4c47-988a-6c581595e201 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:53.315682 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2633/5254] 10.222.0.16 () {58 vars in 1254 bytes} [Fri Sep 30 10:05:53 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:53.320372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940610e-4001-4c47-988a-6c581595e201 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:53.345512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940610e-4001-4c47-988a-6c581595e201 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:53.362823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce877a8-b4a0-4b34-9465-9b8c12f7ad0e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:53.364427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce877a8-b4a0-4b34-9465-9b8c12f7ad0e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:53.366016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce877a8-b4a0-4b34-9465-9b8c12f7ad0e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:53.367430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce877a8-b4a0-4b34-9465-9b8c12f7ad0e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:53.374022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce877a8-b4a0-4b34-9465-9b8c12f7ad0e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:53.380470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce877a8-b4a0-4b34-9465-9b8c12f7ad0e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:53.388649 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2634/5255] 10.222.0.16 () {58 vars in 1257 bytes} [Fri Sep 30 10:05:53 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:53.392888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce877a8-b4a0-4b34-9465-9b8c12f7ad0e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:53.419106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce877a8-b4a0-4b34-9465-9b8c12f7ad0e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:53.435820 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2622/5256] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:53.436955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74172c5-2e61-478b-aee6-b38c92fc9b6e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:53.438043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74172c5-2e61-478b-aee6-b38c92fc9b6e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:53.438675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74172c5-2e61-478b-aee6-b38c92fc9b6e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:53.439240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74172c5-2e61-478b-aee6-b38c92fc9b6e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:53.440000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74172c5-2e61-478b-aee6-b38c92fc9b6e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:53.441837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74172c5-2e61-478b-aee6-b38c92fc9b6e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:53.443213 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2635/5257] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Sep 30 10:05:53 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:53.443620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d4748-4d24-4993-bd72-cca8f5d8c162 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:53.445630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aa1d4748-4d24-4993-bd72-cca8f5d8c162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:53.450356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74172c5-2e61-478b-aee6-b38c92fc9b6e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:53.478729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74172c5-2e61-478b-aee6-b38c92fc9b6e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:53.498073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8dde8-8257-41e0-86ba-415217966d40 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:53.498787 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8dde8-8257-41e0-86ba-415217966d40 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:53.499059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8dde8-8257-41e0-86ba-415217966d40 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:53.499347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8dde8-8257-41e0-86ba-415217966d40 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:53.499944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8dde8-8257-41e0-86ba-415217966d40 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:53.501629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8dde8-8257-41e0-86ba-415217966d40 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:53.511231 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2636/5258] 10.222.0.16 () {58 vars in 1257 bytes} [Fri Sep 30 10:05:53 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:53.512201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8dde8-8257-41e0-86ba-415217966d40 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:53.537421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8dde8-8257-41e0-86ba-415217966d40 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:53.555827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6d6a1-e83e-4b71-ab3c-450d44a9edd6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:53.556500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6d6a1-e83e-4b71-ab3c-450d44a9edd6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:53.556802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6d6a1-e83e-4b71-ab3c-450d44a9edd6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:53.557080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6d6a1-e83e-4b71-ab3c-450d44a9edd6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:53.557677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6d6a1-e83e-4b71-ab3c-450d44a9edd6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:53.559292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6d6a1-e83e-4b71-ab3c-450d44a9edd6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:53.560499 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2637/5259] 10.222.0.16 () {58 vars in 1293 bytes} [Fri Sep 30 10:05:53 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:53.565457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6d6a1-e83e-4b71-ab3c-450d44a9edd6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:53.571053 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:53.585500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d4748-4d24-4993-bd72-cca8f5d8c162 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:53.587146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6d6a1-e83e-4b71-ab3c-450d44a9edd6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:53.597498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c3d12-cde0-458a-a38f-c3f3264785ad tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:53.598092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c3d12-cde0-458a-a38f-c3f3264785ad tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:53.598381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c3d12-cde0-458a-a38f-c3f3264785ad tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:53.598657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c3d12-cde0-458a-a38f-c3f3264785ad tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:53.599249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c3d12-cde0-458a-a38f-c3f3264785ad tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:53.601116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c3d12-cde0-458a-a38f-c3f3264785ad tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:53.605608 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2638/5260] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:53 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:53.606554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c3d12-cde0-458a-a38f-c3f3264785ad tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:53.607478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9554b4-5a19-4739-9f19-49d580cd98b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:53.608372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9554b4-5a19-4739-9f19-49d580cd98b6 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:53.609325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9554b4-5a19-4739-9f19-49d580cd98b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:53.610530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9554b4-5a19-4739-9f19-49d580cd98b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:53.625017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9554b4-5a19-4739-9f19-49d580cd98b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:53.627550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9554b4-5a19-4739-9f19-49d580cd98b6 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:53.642591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c3d12-cde0-458a-a38f-c3f3264785ad tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:53.643562 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2623/5261] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:05:53.649184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c32ce8-5db4-46bc-b773-4164e222f66d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:53.649932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c32ce8-5db4-46bc-b773-4164e222f66d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:53.650292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c32ce8-5db4-46bc-b773-4164e222f66d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:53.650638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c32ce8-5db4-46bc-b773-4164e222f66d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:53.651300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c32ce8-5db4-46bc-b773-4164e222f66d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:53.653135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c32ce8-5db4-46bc-b773-4164e222f66d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:53.659065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9554b4-5a19-4739-9f19-49d580cd98b6 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:53.662797 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2639/5262] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:05:53 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:53.673613 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9554b4-5a19-4739-9f19-49d580cd98b6 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:53.692012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670d1e5-4ff2-497c-a1c5-2d9cfce97c6e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:53.693118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670d1e5-4ff2-497c-a1c5-2d9cfce97c6e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:53.693587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670d1e5-4ff2-497c-a1c5-2d9cfce97c6e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:53.696395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670d1e5-4ff2-497c-a1c5-2d9cfce97c6e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:53.697581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670d1e5-4ff2-497c-a1c5-2d9cfce97c6e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:53.699498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670d1e5-4ff2-497c-a1c5-2d9cfce97c6e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:53.702115 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2624/5263] 10.222.0.16 () {58 vars in 1212 bytes} [Fri Sep 30 10:05:53 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 30 10:05:53.705777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c32ce8-5db4-46bc-b773-4164e222f66d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:53.720036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c32ce8-5db4-46bc-b773-4164e222f66d tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:53.740395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb605a6-ba6d-4bde-b019-93acff9265c8 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:53.741201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb605a6-ba6d-4bde-b019-93acff9265c8 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:53.742857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb605a6-ba6d-4bde-b019-93acff9265c8 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:53.743284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb605a6-ba6d-4bde-b019-93acff9265c8 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:53.744083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb605a6-ba6d-4bde-b019-93acff9265c8 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:53.745830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb605a6-ba6d-4bde-b019-93acff9265c8 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:53.747469 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2640/5264] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Sep 30 10:05:53 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:53.752376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670d1e5-4ff2-497c-a1c5-2d9cfce97c6e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:53.773748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670d1e5-4ff2-497c-a1c5-2d9cfce97c6e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:53.782543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb605a6-ba6d-4bde-b019-93acff9265c8 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:53.783934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9e630-f558-4461-9e86-20ae45fd6904 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:53.784883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9e630-f558-4461-9e86-20ae45fd6904 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:53.785688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9e630-f558-4461-9e86-20ae45fd6904 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:53.786150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9e630-f558-4461-9e86-20ae45fd6904 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:53.787789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9e630-f558-4461-9e86-20ae45fd6904 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:53.790205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9e630-f558-4461-9e86-20ae45fd6904 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:53.791858 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2625/5265] 10.222.0.16 () {58 vars in 1215 bytes} [Fri Sep 30 10:05:53 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 30 10:05:53.797088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9e630-f558-4461-9e86-20ae45fd6904 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:53.811810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb605a6-ba6d-4bde-b019-93acff9265c8 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:53.822966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9e630-f558-4461-9e86-20ae45fd6904 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:53.823906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84456e-b15e-464d-8eeb-03dcb54e4967 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:53.825075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84456e-b15e-464d-8eeb-03dcb54e4967 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:53.825348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84456e-b15e-464d-8eeb-03dcb54e4967 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:53.825614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84456e-b15e-464d-8eeb-03dcb54e4967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:53.829914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36fd47-5484-461e-9b1d-ada4883093dc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:53.831298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36fd47-5484-461e-9b1d-ada4883093dc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:53.832027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36fd47-5484-461e-9b1d-ada4883093dc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:53.833764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36fd47-5484-461e-9b1d-ada4883093dc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:53.834739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36fd47-5484-461e-9b1d-ada4883093dc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:53.838856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36fd47-5484-461e-9b1d-ada4883093dc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:53.840323 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2626/5266] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Sep 30 10:05:53 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:53.845599 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36fd47-5484-461e-9b1d-ada4883093dc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:53.860498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36fd47-5484-461e-9b1d-ada4883093dc tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:53.868350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77694007-00d1-454a-b0fe-fdc64df4f3ac tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:53.869419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77694007-00d1-454a-b0fe-fdc64df4f3ac tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:53.869935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77694007-00d1-454a-b0fe-fdc64df4f3ac tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:53.870441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77694007-00d1-454a-b0fe-fdc64df4f3ac tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:53.871267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77694007-00d1-454a-b0fe-fdc64df4f3ac tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:53.873392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77694007-00d1-454a-b0fe-fdc64df4f3ac tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:53.874897 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2627/5267] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:53 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:53.879839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77694007-00d1-454a-b0fe-fdc64df4f3ac tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:53.892395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77694007-00d1-454a-b0fe-fdc64df4f3ac tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:53.904536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c5406-8ed2-4689-93f2-4e9b23e48e65 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:53.905545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c5406-8ed2-4689-93f2-4e9b23e48e65 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:53.905899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c5406-8ed2-4689-93f2-4e9b23e48e65 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:53.906014 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:53.906240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c5406-8ed2-4689-93f2-4e9b23e48e65 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:53.906990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c5406-8ed2-4689-93f2-4e9b23e48e65 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:53.908888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c5406-8ed2-4689-93f2-4e9b23e48e65 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:53.915985 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2628/5268] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Sep 30 10:05:53 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:53.916980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c5406-8ed2-4689-93f2-4e9b23e48e65 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:53.938030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c5406-8ed2-4689-93f2-4e9b23e48e65 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:53.946632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87673f9-1b11-4f74-b56b-300309f42434 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:53.947262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87673f9-1b11-4f74-b56b-300309f42434 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:53.947527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87673f9-1b11-4f74-b56b-300309f42434 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:53.947841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87673f9-1b11-4f74-b56b-300309f42434 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:53.948480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87673f9-1b11-4f74-b56b-300309f42434 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:53.950158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87673f9-1b11-4f74-b56b-300309f42434 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:53.951807 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2629/5269] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Sep 30 10:05:53 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:53.956092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87673f9-1b11-4f74-b56b-300309f42434 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:53.969154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87673f9-1b11-4f74-b56b-300309f42434 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:53.975158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c5b80-6f10-439a-b44b-134ea198ebc9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:53.975533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c5b80-6f10-439a-b44b-134ea198ebc9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:53.976015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c5b80-6f10-439a-b44b-134ea198ebc9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:53.976370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c5b80-6f10-439a-b44b-134ea198ebc9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:53.977108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c5b80-6f10-439a-b44b-134ea198ebc9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:53.977917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84456e-b15e-464d-8eeb-03dcb54e4967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:53.979393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c5b80-6f10-439a-b44b-134ea198ebc9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:53.980259 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2630/5270] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Sep 30 10:05:53 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 30 10:05:53.984309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c5b80-6f10-439a-b44b-134ea198ebc9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:53.984950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84456e-b15e-464d-8eeb-03dcb54e4967 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:54.011703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c5b80-6f10-439a-b44b-134ea198ebc9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:54.012332 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2641/5271] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:05:54.017573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472345d-eb98-4114-ad60-6aa1c0302ed9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:54.018213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472345d-eb98-4114-ad60-6aa1c0302ed9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:54.018492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472345d-eb98-4114-ad60-6aa1c0302ed9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:54.018761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472345d-eb98-4114-ad60-6aa1c0302ed9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:54.019334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472345d-eb98-4114-ad60-6aa1c0302ed9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:54.020977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472345d-eb98-4114-ad60-6aa1c0302ed9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:54.024714 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2631/5272] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:05:53 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 30 10:05:54.028462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84456e-b15e-464d-8eeb-03dcb54e4967 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:54.043167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84456e-b15e-464d-8eeb-03dcb54e4967 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:54.051300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ea212-7b32-4636-8477-799088d748a6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:54.052566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ea212-7b32-4636-8477-799088d748a6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:54.052732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ea212-7b32-4636-8477-799088d748a6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:54.053103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ea212-7b32-4636-8477-799088d748a6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:54.055434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ea212-7b32-4636-8477-799088d748a6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:54.059090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ea212-7b32-4636-8477-799088d748a6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:54.063441 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2642/5273] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:54 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:54.064747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472345d-eb98-4114-ad60-6aa1c0302ed9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:54.090490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472345d-eb98-4114-ad60-6aa1c0302ed9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:54.101212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54fa9f-a866-41ca-bda0-3261ee2bfeaf tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:54.102663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54fa9f-a866-41ca-bda0-3261ee2bfeaf tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:54.103037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54fa9f-a866-41ca-bda0-3261ee2bfeaf tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:54.103483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54fa9f-a866-41ca-bda0-3261ee2bfeaf tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:54.104189 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54fa9f-a866-41ca-bda0-3261ee2bfeaf tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:54.110811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54fa9f-a866-41ca-bda0-3261ee2bfeaf tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:54.113616 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2632/5274] 10.222.0.16 () {58 vars in 1278 bytes} [Fri Sep 30 10:05:54 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:05:54.121168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ea212-7b32-4636-8477-799088d748a6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:54.157972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ea212-7b32-4636-8477-799088d748a6 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:54.183912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bd18e-c991-4fde-9f29-01eb41f3668e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:54.187043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bd18e-c991-4fde-9f29-01eb41f3668e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:54.187333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bd18e-c991-4fde-9f29-01eb41f3668e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:54.187712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bd18e-c991-4fde-9f29-01eb41f3668e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/34c9d1e12781482a9417a3ebecdd1eea` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:54.221715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bd18e-c991-4fde-9f29-01eb41f3668e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 10:05:54.223049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54fa9f-a866-41ca-bda0-3261ee2bfeaf tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:54.227689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cb54fa9f-a866-41ca-bda0-3261ee2bfeaf tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:54.232824 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-f02bd18e-c991-4fde-9f29-01eb41f3668e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Could not find domain: 34c9d1e12781482a9417a3ebecdd1eea.: keystone.exception.DomainNotFound: Could not find domain: 34c9d1e12781482a9417a3ebecdd1eea. Sep 30 10:05:54.232824 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:05:54.232824 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 30 10:05:54.232824 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 30 10:05:54.232824 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 10:05:54.232824 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 10:05:54.232824 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 10:05:54.232824 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 10:05:54.232824 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 34c9d1e12781482a9417a3ebecdd1eea. Sep 30 10:05:54.232824 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:05:54.232824 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:05:54.232824 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:05:54.232824 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:05:54.232824 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:05:54.232824 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:05:54.234141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:05:54.234141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:05:54.234141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:05:54.234141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:05:54.234141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:05:54.234141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:05:54.234141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:05:54.234141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:05:54.234141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 30 10:05:54.234141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 30 10:05:54.234141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 10:05:54.234141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 10:05:54.234141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 10:05:54.234141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 10:05:54.234141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:05:54.234141 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:05:54.235475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:05:54.235475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:05:54.235475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:05:54.235475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:05:54.235475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:05:54.235475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 10:05:54.235475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:05:54.235475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:05:54.235475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:05:54.235475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:05:54.235475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:05:54.235475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:05:54.235475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:05:54.235475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:05:54.235475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 30 10:05:54.235475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 10:05:54.235475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 34c9d1e12781482a9417a3ebecdd1eea. Sep 30 10:05:54.236767 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:05:54.236767 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2643/5275] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:05:54 2022] PATCH /identity/v3/domains/34c9d1e12781482a9417a3ebecdd1eea => generated 112 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:05:54.238605 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bd18e-c991-4fde-9f29-01eb41f3668e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:54.258536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bd18e-c991-4fde-9f29-01eb41f3668e tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:54.268463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991522a-4c6e-4242-bd08-8a5dcd42afca tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:54.269278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991522a-4c6e-4242-bd08-8a5dcd42afca tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:54.270504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991522a-4c6e-4242-bd08-8a5dcd42afca tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:54.270794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991522a-4c6e-4242-bd08-8a5dcd42afca tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/f181e542a36f4890b8c8ca621fc3c1bb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:54.302606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991522a-4c6e-4242-bd08-8a5dcd42afca tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 10:05:54.318681 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-f991522a-4c6e-4242-bd08-8a5dcd42afca tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Could not find domain: f181e542a36f4890b8c8ca621fc3c1bb.: keystone.exception.DomainNotFound: Could not find domain: f181e542a36f4890b8c8ca621fc3c1bb. Sep 30 10:05:54.318681 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:05:54.318681 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 30 10:05:54.318681 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 30 10:05:54.318681 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 10:05:54.318681 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 10:05:54.318681 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 10:05:54.318681 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 10:05:54.318681 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f181e542a36f4890b8c8ca621fc3c1bb. Sep 30 10:05:54.318681 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:05:54.318681 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:05:54.318681 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:05:54.318681 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:05:54.318681 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:05:54.318681 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:05:54.319817 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:05:54.319817 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:05:54.319817 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:05:54.319817 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:05:54.319817 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:05:54.319817 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:05:54.319817 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:05:54.319817 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:05:54.319817 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 30 10:05:54.319817 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 30 10:05:54.319817 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 10:05:54.319817 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 10:05:54.319817 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 10:05:54.319817 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 10:05:54.319817 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:05:54.319817 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:05:54.321014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:05:54.321014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:05:54.321014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:05:54.321014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:05:54.321014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:05:54.321014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 10:05:54.321014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:05:54.321014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:05:54.321014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:05:54.321014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:05:54.321014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:05:54.321014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:05:54.321014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:05:54.321014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:05:54.321014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 30 10:05:54.321014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 10:05:54.321014 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f181e542a36f4890b8c8ca621fc3c1bb. Sep 30 10:05:54.322173 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:05:54.326201 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2644/5276] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:05:54 2022] PATCH /identity/v3/domains/f181e542a36f4890b8c8ca621fc3c1bb => generated 112 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:05:54.334271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991522a-4c6e-4242-bd08-8a5dcd42afca tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:54.368656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991522a-4c6e-4242-bd08-8a5dcd42afca tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:54.377689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7da940-dfa2-4ce4-8f29-7b915f3713f9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f5462ddbbd482f97ac7007d7514da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c502e2dd57bd4f38b63d042da89550b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:54.379694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7da940-dfa2-4ce4-8f29-7b915f3713f9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:54.380094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7da940-dfa2-4ce4-8f29-7b915f3713f9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:54.380832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7da940-dfa2-4ce4-8f29-7b915f3713f9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] PATH_INFO: `/v3/domains/5a48c35e90d64ae1b2b9d64a0601bf78` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:54.405962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7da940-dfa2-4ce4-8f29-7b915f3713f9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 10:05:54.415570 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-ec7da940-dfa2-4ce4-8f29-7b915f3713f9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Could not find domain: 5a48c35e90d64ae1b2b9d64a0601bf78.: keystone.exception.DomainNotFound: Could not find domain: 5a48c35e90d64ae1b2b9d64a0601bf78. Sep 30 10:05:54.415570 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:05:54.415570 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 30 10:05:54.415570 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 30 10:05:54.415570 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 10:05:54.415570 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 10:05:54.415570 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 10:05:54.415570 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 10:05:54.415570 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 5a48c35e90d64ae1b2b9d64a0601bf78. Sep 30 10:05:54.415570 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:05:54.415570 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:05:54.415570 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:05:54.415570 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:05:54.415570 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:05:54.415570 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:05:54.416741 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:05:54.416741 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:05:54.416741 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:05:54.416741 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:05:54.416741 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:05:54.416741 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:05:54.416741 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:05:54.416741 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:05:54.416741 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 30 10:05:54.416741 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 30 10:05:54.416741 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 10:05:54.416741 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 10:05:54.416741 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 10:05:54.416741 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 10:05:54.416741 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:05:54.416741 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:05:54.418193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:05:54.418193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:05:54.418193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:05:54.418193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:05:54.418193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:05:54.418193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 10:05:54.418193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:05:54.418193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:05:54.418193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:05:54.418193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:05:54.418193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:05:54.418193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:05:54.418193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:05:54.418193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:05:54.418193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 30 10:05:54.418193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 10:05:54.418193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 5a48c35e90d64ae1b2b9d64a0601bf78. Sep 30 10:05:54.419244 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:05:54.420738 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2645/5277] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:05:54 2022] PATCH /identity/v3/domains/5a48c35e90d64ae1b2b9d64a0601bf78 => generated 112 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:05:54.421990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7da940-dfa2-4ce4-8f29-7b915f3713f9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:54.426304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ec7da940-dfa2-4ce4-8f29-7b915f3713f9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:54.440975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54fa9f-a866-41ca-bda0-3261ee2bfeaf tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:54.457698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830de63-a8f8-46d8-891b-e14f5f470ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:54.458678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830de63-a8f8-46d8-891b-e14f5f470ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:54.459132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830de63-a8f8-46d8-891b-e14f5f470ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:54.459369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7da940-dfa2-4ce4-8f29-7b915f3713f9 tempest-DomainConfigurationTestJSON-981966093 tempest-DomainConfigurationTestJSON-981966093-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:54.459783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830de63-a8f8-46d8-891b-e14f5f470ecf admin admin] PATH_INFO: `/v3/users/03fa24587e544118bfe537a85d2f113e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:54.461623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830de63-a8f8-46d8-891b-e14f5f470ecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=03fa24587e544118bfe537a85d2f113e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:54.465218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830de63-a8f8-46d8-891b-e14f5f470ecf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:54.473171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1d498-375f-4f77-ac21-7a6ed222adde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:54.473935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1d498-375f-4f77-ac21-7a6ed222adde admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:54.474219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1d498-375f-4f77-ac21-7a6ed222adde admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:54.474515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1d498-375f-4f77-ac21-7a6ed222adde admin admin] PATH_INFO: `/v3/users/223ddccd443541cd8ee3aa4a323e6850` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:54.478191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1d498-375f-4f77-ac21-7a6ed222adde admin admin] RBAC: Authorizing `identity:delete_user(user_id=223ddccd443541cd8ee3aa4a323e6850)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:54.481425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1d498-375f-4f77-ac21-7a6ed222adde admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:54.569660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c830de63-a8f8-46d8-891b-e14f5f470ecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03fa24587e544118bfe537a85d2f113e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:54.582950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c830de63-a8f8-46d8-891b-e14f5f470ecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03fa24587e544118bfe537a85d2f113e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:54.584232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c830de63-a8f8-46d8-891b-e14f5f470ecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03fa24587e544118bfe537a85d2f113e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:54.607746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c830de63-a8f8-46d8-891b-e14f5f470ecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03fa24587e544118bfe537a85d2f113e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:54.615612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11d1d498-375f-4f77-ac21-7a6ed222adde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '223ddccd443541cd8ee3aa4a323e6850'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:54.620592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11d1d498-375f-4f77-ac21-7a6ed222adde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '223ddccd443541cd8ee3aa4a323e6850'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:54.620786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c830de63-a8f8-46d8-891b-e14f5f470ecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03fa24587e544118bfe537a85d2f113e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:54.629928 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2633/5278] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:05:54 2022] DELETE /identity/v3/users/03fa24587e544118bfe537a85d2f113e => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:54.635359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11d1d498-375f-4f77-ac21-7a6ed222adde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '223ddccd443541cd8ee3aa4a323e6850'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:54.657104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11d1d498-375f-4f77-ac21-7a6ed222adde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '223ddccd443541cd8ee3aa4a323e6850'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:54.694429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11d1d498-375f-4f77-ac21-7a6ed222adde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '223ddccd443541cd8ee3aa4a323e6850'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:54.740672 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2646/5279] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:05:54 2022] DELETE /identity/v3/users/223ddccd443541cd8ee3aa4a323e6850 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:54.745284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b011474-93f4-4977-84a6-e7a42e86080a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:54.745572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b011474-93f4-4977-84a6-e7a42e86080a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:54.745828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b011474-93f4-4977-84a6-e7a42e86080a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:54.800235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1b011474-93f4-4977-84a6-e7a42e86080a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:54.801443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1b011474-93f4-4977-84a6-e7a42e86080a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:54.844027 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:54.952170 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2634/5280] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:55.016806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1d498-375f-4f77-ac21-7a6ed222adde admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:55.018986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-11d1d498-375f-4f77-ac21-7a6ed222adde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:55.174991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64572585-6c69-4842-a47b-567966e38a93 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:55.177179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64572585-6c69-4842-a47b-567966e38a93 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:55.177478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64572585-6c69-4842-a47b-567966e38a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:55.183318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1d498-375f-4f77-ac21-7a6ed222adde admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:55.188083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260ee44-7f08-424d-94f5-9fc4829f1039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:55.188834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260ee44-7f08-424d-94f5-9fc4829f1039 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:55.189184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260ee44-7f08-424d-94f5-9fc4829f1039 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:55.189624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260ee44-7f08-424d-94f5-9fc4829f1039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:55.201170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260ee44-7f08-424d-94f5-9fc4829f1039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:55.202730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260ee44-7f08-424d-94f5-9fc4829f1039 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:55.216385 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2647/5281] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:55.246239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-64572585-6c69-4842-a47b-567966e38a93 None None] MFA Rules not processed for user `58c50ed8702548f0b7568d172661e00d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:55.247472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-64572585-6c69-4842-a47b-567966e38a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:55.374237 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2635/5282] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:55 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:05:55.376777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92de55-3dad-41d7-be4f-bc49ce430b67 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:55.377359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92de55-3dad-41d7-be4f-bc49ce430b67 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:55.377860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92de55-3dad-41d7-be4f-bc49ce430b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:55.413828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7a92de55-3dad-41d7-be4f-bc49ce430b67 None None] MFA Rules not processed for user `58c50ed8702548f0b7568d172661e00d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:55.415891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7a92de55-3dad-41d7-be4f-bc49ce430b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:55.434277 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2648/5283] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:55 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:55.449296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64572585-6c69-4842-a47b-567966e38a93 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:55.450768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-64572585-6c69-4842-a47b-567966e38a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:55.642110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64572585-6c69-4842-a47b-567966e38a93 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:55.662771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d435f-9364-4b49-8bb1-54e082472ea9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:55.663503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d435f-9364-4b49-8bb1-54e082472ea9 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:55.663781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d435f-9364-4b49-8bb1-54e082472ea9 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:55.664233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d435f-9364-4b49-8bb1-54e082472ea9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:55.683944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d435f-9364-4b49-8bb1-54e082472ea9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:55.691285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d435f-9364-4b49-8bb1-54e082472ea9 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:55.700011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92de55-3dad-41d7-be4f-bc49ce430b67 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:55.701474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7a92de55-3dad-41d7-be4f-bc49ce430b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:55.721598 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2636/5284] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:55 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:05:55.730263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92de55-3dad-41d7-be4f-bc49ce430b67 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:55.742794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec7e8d-695d-4c2b-a773-227e292a5cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:55.743473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec7e8d-695d-4c2b-a773-227e292a5cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:55.743871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec7e8d-695d-4c2b-a773-227e292a5cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:55.744588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec7e8d-695d-4c2b-a773-227e292a5cf6 admin admin] PATH_INFO: `/v3/projects/56d748b6461c458dae0901effae442bc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:55.745272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec7e8d-695d-4c2b-a773-227e292a5cf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56d748b6461c458dae0901effae442bc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:55.747186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec7e8d-695d-4c2b-a773-227e292a5cf6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:55.756561 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:55.875510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76ec7e8d-695d-4c2b-a773-227e292a5cf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56d748b6461c458dae0901effae442bc', 'request_id': 'req-76ec7e8d-695d-4c2b-a773-227e292a5cf6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:55.892175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76ec7e8d-695d-4c2b-a773-227e292a5cf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56d748b6461c458dae0901effae442bc', 'request_id': 'req-76ec7e8d-695d-4c2b-a773-227e292a5cf6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:55.899836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76ec7e8d-695d-4c2b-a773-227e292a5cf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56d748b6461c458dae0901effae442bc', 'request_id': 'req-76ec7e8d-695d-4c2b-a773-227e292a5cf6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:55.925018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76ec7e8d-695d-4c2b-a773-227e292a5cf6 admin admin] The token cache is being invalidate because project 56d748b6461c458dae0901effae442bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:55.925567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76ec7e8d-695d-4c2b-a773-227e292a5cf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:55.927263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76ec7e8d-695d-4c2b-a773-227e292a5cf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:55.932010 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2649/5285] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:55 2022] DELETE /identity/v3/projects/56d748b6461c458dae0901effae442bc => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:55.938605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce17df-d02a-4533-bc8a-44c4c667a2ad None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:55.938605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce17df-d02a-4533-bc8a-44c4c667a2ad None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:55.938605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce17df-d02a-4533-bc8a-44c4c667a2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:55.984667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e4ce17df-d02a-4533-bc8a-44c4c667a2ad None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:55.988165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e4ce17df-d02a-4533-bc8a-44c4c667a2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:56.079676 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:56.170463 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2637/5286] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:56.179507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb050b8-7211-4aa5-ac1f-85a8c0bf56d8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:56.180558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb050b8-7211-4aa5-ac1f-85a8c0bf56d8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:56.181303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb050b8-7211-4aa5-ac1f-85a8c0bf56d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:56.228525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-dcb050b8-7211-4aa5-ac1f-85a8c0bf56d8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:56.229928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dcb050b8-7211-4aa5-ac1f-85a8c0bf56d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:56.252197 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2650/5287] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:56.258494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce17df-d02a-4533-bc8a-44c4c667a2ad None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:56.283884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce17df-d02a-4533-bc8a-44c4c667a2ad None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:56.298358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963a597-f2fc-4bc9-bc36-ac999aa3160b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:56.299182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963a597-f2fc-4bc9-bc36-ac999aa3160b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:56.299619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963a597-f2fc-4bc9-bc36-ac999aa3160b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:56.303925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963a597-f2fc-4bc9-bc36-ac999aa3160b admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:56.305175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963a597-f2fc-4bc9-bc36-ac999aa3160b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:05:56.305692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963a597-f2fc-4bc9-bc36-ac999aa3160b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:56.307387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963a597-f2fc-4bc9-bc36-ac999aa3160b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:56.351049 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2638/5288] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:05:56.355859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb050b8-7211-4aa5-ac1f-85a8c0bf56d8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:56.377261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb050b8-7211-4aa5-ac1f-85a8c0bf56d8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:56.396629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e946ab-e543-432c-93f6-11773b066736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:56.397930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e946ab-e543-432c-93f6-11773b066736 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:56.400436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e946ab-e543-432c-93f6-11773b066736 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:56.401130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e946ab-e543-432c-93f6-11773b066736 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:56.402126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e946ab-e543-432c-93f6-11773b066736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:56.406771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e946ab-e543-432c-93f6-11773b066736 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:56.480956 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2651/5289] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:05:56 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:05:56.481539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963a597-f2fc-4bc9-bc36-ac999aa3160b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:56.494129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963a597-f2fc-4bc9-bc36-ac999aa3160b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:56.589872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e946ab-e543-432c-93f6-11773b066736 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:56.592352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-90e946ab-e543-432c-93f6-11773b066736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:56.609123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30f4f7-120f-4fec-8b24-dcdfae056487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:56.610054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30f4f7-120f-4fec-8b24-dcdfae056487 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:56.610671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30f4f7-120f-4fec-8b24-dcdfae056487 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:56.611105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30f4f7-120f-4fec-8b24-dcdfae056487 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:56.612043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30f4f7-120f-4fec-8b24-dcdfae056487 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:56.623555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30f4f7-120f-4fec-8b24-dcdfae056487 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:56.675728 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2639/5290] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:05:56 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:05:56.682000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30f4f7-120f-4fec-8b24-dcdfae056487 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:56.699018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30f4f7-120f-4fec-8b24-dcdfae056487 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:56.715466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db535db-60ed-434a-aba6-5d9f39b9b435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:56.716720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db535db-60ed-434a-aba6-5d9f39b9b435 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:56.723214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db535db-60ed-434a-aba6-5d9f39b9b435 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:56.723832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db535db-60ed-434a-aba6-5d9f39b9b435 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:56.725062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db535db-60ed-434a-aba6-5d9f39b9b435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:56.728383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db535db-60ed-434a-aba6-5d9f39b9b435 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:56.752012 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2640/5291] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:56.769582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e946ab-e543-432c-93f6-11773b066736 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:56.769794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db535db-60ed-434a-aba6-5d9f39b9b435 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:56.781051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0257402-9283-4ee4-86e4-d0532c474ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:56.781936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0257402-9283-4ee4-86e4-d0532c474ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:56.782225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0257402-9283-4ee4-86e4-d0532c474ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:56.782505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0257402-9283-4ee4-86e4-d0532c474ae1 admin admin] PATH_INFO: `/v3/projects/f537122b0bf14ce0b6c63ecbf82c0d7a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:56.784572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0257402-9283-4ee4-86e4-d0532c474ae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f537122b0bf14ce0b6c63ecbf82c0d7a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:56.785332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db535db-60ed-434a-aba6-5d9f39b9b435 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:56.786763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0257402-9283-4ee4-86e4-d0532c474ae1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:56.798109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e27eb-e504-40b0-a93d-55f2aeb0b3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:56.798949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e27eb-e504-40b0-a93d-55f2aeb0b3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:56.799250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e27eb-e504-40b0-a93d-55f2aeb0b3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:56.799523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e27eb-e504-40b0-a93d-55f2aeb0b3a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:56.800415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e27eb-e504-40b0-a93d-55f2aeb0b3a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:56.802043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e27eb-e504-40b0-a93d-55f2aeb0b3a6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:56.848305 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2641/5292] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:05:56.853535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e27eb-e504-40b0-a93d-55f2aeb0b3a6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:56.880042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e27eb-e504-40b0-a93d-55f2aeb0b3a6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:56.908998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e0257402-9283-4ee4-86e4-d0532c474ae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f537122b0bf14ce0b6c63ecbf82c0d7a', 'request_id': 'req-e0257402-9283-4ee4-86e4-d0532c474ae1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:56.951785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e0257402-9283-4ee4-86e4-d0532c474ae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f537122b0bf14ce0b6c63ecbf82c0d7a', 'request_id': 'req-e0257402-9283-4ee4-86e4-d0532c474ae1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:56.982794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e0257402-9283-4ee4-86e4-d0532c474ae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f537122b0bf14ce0b6c63ecbf82c0d7a', 'request_id': 'req-e0257402-9283-4ee4-86e4-d0532c474ae1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:56.992103 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:57.019411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e0257402-9283-4ee4-86e4-d0532c474ae1 admin admin] The token cache is being invalidate because project f537122b0bf14ce0b6c63ecbf82c0d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:05:57.020693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e0257402-9283-4ee4-86e4-d0532c474ae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:57.021502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e0257402-9283-4ee4-86e4-d0532c474ae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:57.023976 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2652/5293] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:05:56 2022] DELETE /identity/v3/projects/f537122b0bf14ce0b6c63ecbf82c0d7a => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:57.028130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0257402-9283-4ee4-86e4-d0532c474ae1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:57.030519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e0257402-9283-4ee4-86e4-d0532c474ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:57.065904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b0475-25a5-4be5-9eb0-21841d002d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:57.069000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b0475-25a5-4be5-9eb0-21841d002d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:57.069477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b0475-25a5-4be5-9eb0-21841d002d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:57.069782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b0475-25a5-4be5-9eb0-21841d002d25 admin admin] PATH_INFO: `/v3/projects/2e355f0ab3664dbc867ecf1202674a73/users/5d7b6aad22ea44aeb1f56654111c4b22/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:57.093549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b0475-25a5-4be5-9eb0-21841d002d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e355f0ab3664dbc867ecf1202674a73, user_id=5d7b6aad22ea44aeb1f56654111c4b22, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:57.096591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b0475-25a5-4be5-9eb0-21841d002d25 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:57.123810 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2642/5294] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:05:56 2022] PUT /identity/v3/projects/2e355f0ab3664dbc867ecf1202674a73/users/5d7b6aad22ea44aeb1f56654111c4b22/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:57.129582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effefe6-54dd-46f1-9c63-7de47f8cf367 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:57.129920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effefe6-54dd-46f1-9c63-7de47f8cf367 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:57.130199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effefe6-54dd-46f1-9c63-7de47f8cf367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:57.182511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4effefe6-54dd-46f1-9c63-7de47f8cf367 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:05:57.184669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0257402-9283-4ee4-86e4-d0532c474ae1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:57.186835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4effefe6-54dd-46f1-9c63-7de47f8cf367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:57.219582 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:05:57.339307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ea0ff-cc77-4188-a4ad-fe58429fe633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:57.339967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ea0ff-cc77-4188-a4ad-fe58429fe633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:57.340243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ea0ff-cc77-4188-a4ad-fe58429fe633 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:57.340516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ea0ff-cc77-4188-a4ad-fe58429fe633 admin admin] PATH_INFO: `/v3/users/46f5462ddbbd482f97ac7007d7514da2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:57.342481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ea0ff-cc77-4188-a4ad-fe58429fe633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46f5462ddbbd482f97ac7007d7514da2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:57.352850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ea0ff-cc77-4188-a4ad-fe58429fe633 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:57.362879 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2643/5295] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:05:57.392429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effefe6-54dd-46f1-9c63-7de47f8cf367 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:05:57.394193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4effefe6-54dd-46f1-9c63-7de47f8cf367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:57.485012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-266ea0ff-cc77-4188-a4ad-fe58429fe633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46f5462ddbbd482f97ac7007d7514da2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:57.486049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-266ea0ff-cc77-4188-a4ad-fe58429fe633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46f5462ddbbd482f97ac7007d7514da2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:57.498078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-266ea0ff-cc77-4188-a4ad-fe58429fe633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46f5462ddbbd482f97ac7007d7514da2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:57.551749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-266ea0ff-cc77-4188-a4ad-fe58429fe633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46f5462ddbbd482f97ac7007d7514da2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:57.573336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effefe6-54dd-46f1-9c63-7de47f8cf367 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:05:57.581530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-266ea0ff-cc77-4188-a4ad-fe58429fe633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46f5462ddbbd482f97ac7007d7514da2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:05:57.596137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab7558-4ca2-41cb-bde4-fc9734854e77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:05:57.596975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab7558-4ca2-41cb-bde4-fc9734854e77 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:05:57.597258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab7558-4ca2-41cb-bde4-fc9734854e77 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:05:57.597535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab7558-4ca2-41cb-bde4-fc9734854e77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:05:57.599366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8eab7558-4ca2-41cb-bde4-fc9734854e77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:05:57.614465 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2653/5296] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:05:57 2022] DELETE /identity/v3/users/46f5462ddbbd482f97ac7007d7514da2 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:05:57.647997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab7558-4ca2-41cb-bde4-fc9734854e77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:05:57.649675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab7558-4ca2-41cb-bde4-fc9734854e77 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:05:57.672056 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2644/5297] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:05:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:06:00.695866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ea0ff-cc77-4188-a4ad-fe58429fe633 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:00.698529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-266ea0ff-cc77-4188-a4ad-fe58429fe633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:00.738409 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:00.888030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ea0ff-cc77-4188-a4ad-fe58429fe633 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:00.899920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5669f-7966-4b8e-935f-66403b4c70d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:00.900288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5669f-7966-4b8e-935f-66403b4c70d6 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:00.900531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5669f-7966-4b8e-935f-66403b4c70d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:00.900848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5669f-7966-4b8e-935f-66403b4c70d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:00.932627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0ba5669f-7966-4b8e-935f-66403b4c70d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:01.087262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab7558-4ca2-41cb-bde4-fc9734854e77 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:01.088882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8eab7558-4ca2-41cb-bde4-fc9734854e77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:01.115287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab7558-4ca2-41cb-bde4-fc9734854e77 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:01.204180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5669f-7966-4b8e-935f-66403b4c70d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:01.212443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5669f-7966-4b8e-935f-66403b4c70d6 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:01.263253 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2654/5298] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:00 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:06:01.367979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3b994-0f6b-4705-89df-4dafaa47d30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:01.368708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3b994-0f6b-4705-89df-4dafaa47d30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:01.369035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3b994-0f6b-4705-89df-4dafaa47d30e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:01.369296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3b994-0f6b-4705-89df-4dafaa47d30e admin admin] PATH_INFO: `/v3/projects/c502e2dd57bd4f38b63d042da89550b4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:01.370956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3b994-0f6b-4705-89df-4dafaa47d30e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c502e2dd57bd4f38b63d042da89550b4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:01.376100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3b994-0f6b-4705-89df-4dafaa47d30e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:01.483210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50b3b994-0f6b-4705-89df-4dafaa47d30e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c502e2dd57bd4f38b63d042da89550b4', 'request_id': 'req-50b3b994-0f6b-4705-89df-4dafaa47d30e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:01.493931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50b3b994-0f6b-4705-89df-4dafaa47d30e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c502e2dd57bd4f38b63d042da89550b4', 'request_id': 'req-50b3b994-0f6b-4705-89df-4dafaa47d30e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:01.500930 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:01.502510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50b3b994-0f6b-4705-89df-4dafaa47d30e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c502e2dd57bd4f38b63d042da89550b4', 'request_id': 'req-50b3b994-0f6b-4705-89df-4dafaa47d30e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:01.526808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50b3b994-0f6b-4705-89df-4dafaa47d30e admin admin] The token cache is being invalidate because project c502e2dd57bd4f38b63d042da89550b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:06:01.543478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50b3b994-0f6b-4705-89df-4dafaa47d30e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:01.545061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50b3b994-0f6b-4705-89df-4dafaa47d30e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:01.550286 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2645/5299] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:01 2022] DELETE /identity/v3/projects/c502e2dd57bd4f38b63d042da89550b4 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:01.562677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2210ecb-bc8a-4717-9a64-0e95878e7efd None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:01.563023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2210ecb-bc8a-4717-9a64-0e95878e7efd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:01.563240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2210ecb-bc8a-4717-9a64-0e95878e7efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:01.683471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a2210ecb-bc8a-4717-9a64-0e95878e7efd None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:01.694214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a2210ecb-bc8a-4717-9a64-0e95878e7efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:01.856201 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2655/5300] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:01.864174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58303ed1-4531-4ebf-9c1b-1aa4c03c6d6d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:01.864545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58303ed1-4531-4ebf-9c1b-1aa4c03c6d6d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:01.864913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58303ed1-4531-4ebf-9c1b-1aa4c03c6d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:01.941987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-58303ed1-4531-4ebf-9c1b-1aa4c03c6d6d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:01.951342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-58303ed1-4531-4ebf-9c1b-1aa4c03c6d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:01.981803 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2646/5301] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:06:01.993938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2210ecb-bc8a-4717-9a64-0e95878e7efd None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:02.015393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2210ecb-bc8a-4717-9a64-0e95878e7efd None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:02.035247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6400644-81b5-407b-b7a1-8081512d6ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:02.036125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6400644-81b5-407b-b7a1-8081512d6ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:02.036571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6400644-81b5-407b-b7a1-8081512d6ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:02.037041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6400644-81b5-407b-b7a1-8081512d6ac0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:02.038421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6400644-81b5-407b-b7a1-8081512d6ac0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:06:02.039525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6400644-81b5-407b-b7a1-8081512d6ac0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:02.042557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6400644-81b5-407b-b7a1-8081512d6ac0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:02.077915 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2656/5302] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:06:02.082355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58303ed1-4531-4ebf-9c1b-1aa4c03c6d6d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:02.094425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58303ed1-4531-4ebf-9c1b-1aa4c03c6d6d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:02.115717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d77eb-7034-4291-ba04-b74329cb00e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:02.117454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d77eb-7034-4291-ba04-b74329cb00e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:02.117724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d77eb-7034-4291-ba04-b74329cb00e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:02.118006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d77eb-7034-4291-ba04-b74329cb00e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:02.118667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d77eb-7034-4291-ba04-b74329cb00e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:02.125387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d77eb-7034-4291-ba04-b74329cb00e3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:02.195537 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2647/5303] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:06:02 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:06:02.199417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6400644-81b5-407b-b7a1-8081512d6ac0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:02.212990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6400644-81b5-407b-b7a1-8081512d6ac0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:02.358465 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:02.378331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5b435-38b3-4cf6-80cb-73af2dbc4c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:02.378983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5b435-38b3-4cf6-80cb-73af2dbc4c65 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:02.379263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5b435-38b3-4cf6-80cb-73af2dbc4c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:02.379535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5b435-38b3-4cf6-80cb-73af2dbc4c65 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:02.380179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5b435-38b3-4cf6-80cb-73af2dbc4c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:02.382763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5b435-38b3-4cf6-80cb-73af2dbc4c65 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:02.438777 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2657/5304] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:06:02 2022] POST /identity/v3/users => generated 287 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:02.442892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d77eb-7034-4291-ba04-b74329cb00e3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:02.457038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d77eb-7034-4291-ba04-b74329cb00e3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:02.471485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b6ea8-1dca-4fc9-ad87-1bc4d9ec9176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:02.472345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b6ea8-1dca-4fc9-ad87-1bc4d9ec9176 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:02.472812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b6ea8-1dca-4fc9-ad87-1bc4d9ec9176 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:02.473292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b6ea8-1dca-4fc9-ad87-1bc4d9ec9176 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:02.474160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b6ea8-1dca-4fc9-ad87-1bc4d9ec9176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:02.477142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b6ea8-1dca-4fc9-ad87-1bc4d9ec9176 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:02.508077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5b435-38b3-4cf6-80cb-73af2dbc4c65 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:02.514964 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2648/5305] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:02.520416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5b435-38b3-4cf6-80cb-73af2dbc4c65 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:02.535883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317cbc8-293b-4688-9f05-ab526ec7df05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:02.536810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317cbc8-293b-4688-9f05-ab526ec7df05 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:02.537255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317cbc8-293b-4688-9f05-ab526ec7df05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:02.537685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317cbc8-293b-4688-9f05-ab526ec7df05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:02.539594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317cbc8-293b-4688-9f05-ab526ec7df05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:02.544132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317cbc8-293b-4688-9f05-ab526ec7df05 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:02.575535 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2658/5306] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:02.579479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b6ea8-1dca-4fc9-ad87-1bc4d9ec9176 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:02.595656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b6ea8-1dca-4fc9-ad87-1bc4d9ec9176 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:02.609148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbb4d1-d9e9-42da-811b-1e18bad72e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:02.609840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbb4d1-d9e9-42da-811b-1e18bad72e77 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:02.610312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbb4d1-d9e9-42da-811b-1e18bad72e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:02.610418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbb4d1-d9e9-42da-811b-1e18bad72e77 admin admin] PATH_INFO: `/v3/projects/217ac3dbbc814a3e997ceeb298a8af69/users/a020502bb9f24f64bfaf58e7f008ab5a/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:02.649946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbb4d1-d9e9-42da-811b-1e18bad72e77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=217ac3dbbc814a3e997ceeb298a8af69, user_id=a020502bb9f24f64bfaf58e7f008ab5a, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:02.652811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbb4d1-d9e9-42da-811b-1e18bad72e77 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:02.682257 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2649/5307] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:02 2022] PUT /identity/v3/projects/217ac3dbbc814a3e997ceeb298a8af69/users/a020502bb9f24f64bfaf58e7f008ab5a/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:02.683968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062684e-8dde-47cf-8312-3566379fa2d6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:02.684263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062684e-8dde-47cf-8312-3566379fa2d6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:02.684545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062684e-8dde-47cf-8312-3566379fa2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:02.753657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3062684e-8dde-47cf-8312-3566379fa2d6 None None] MFA Rules not processed for user `a020502bb9f24f64bfaf58e7f008ab5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:02.762450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3062684e-8dde-47cf-8312-3566379fa2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:02.984980 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2659/5308] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:02.989563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbb4d1-d9e9-42da-811b-1e18bad72e77 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:03.181015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbb4d1-d9e9-42da-811b-1e18bad72e77 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:03.188322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209d9ae-545b-4d89-9fec-a8dd50ea5230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:03.189388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209d9ae-545b-4d89-9fec-a8dd50ea5230 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:03.189826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209d9ae-545b-4d89-9fec-a8dd50ea5230 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:03.190253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209d9ae-545b-4d89-9fec-a8dd50ea5230 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:03.191079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209d9ae-545b-4d89-9fec-a8dd50ea5230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:03.196127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209d9ae-545b-4d89-9fec-a8dd50ea5230 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:03.260530 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2650/5309] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:06:02 2022] POST /identity/v3/projects => generated 373 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:03.261814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062684e-8dde-47cf-8312-3566379fa2d6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:03.278043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062684e-8dde-47cf-8312-3566379fa2d6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:03.422064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b87918-c5e3-402e-b1e1-900e7efac9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:03.422686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b87918-c5e3-402e-b1e1-900e7efac9dd admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:03.422959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b87918-c5e3-402e-b1e1-900e7efac9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:03.423228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b87918-c5e3-402e-b1e1-900e7efac9dd admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:03.423868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b87918-c5e3-402e-b1e1-900e7efac9dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:03.426022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b87918-c5e3-402e-b1e1-900e7efac9dd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:03.472971 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2660/5310] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:06:03 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:03.477543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209d9ae-545b-4d89-9fec-a8dd50ea5230 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:03.502501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209d9ae-545b-4d89-9fec-a8dd50ea5230 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:03.531229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa014c-9b61-4f63-ac1f-9fe9ce7d18a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:03.532132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa014c-9b61-4f63-ac1f-9fe9ce7d18a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:03.533471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa014c-9b61-4f63-ac1f-9fe9ce7d18a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:03.533926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa014c-9b61-4f63-ac1f-9fe9ce7d18a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:03.541252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa014c-9b61-4f63-ac1f-9fe9ce7d18a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:03.543491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa014c-9b61-4f63-ac1f-9fe9ce7d18a3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:03.586738 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2651/5311] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:03.591086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b87918-c5e3-402e-b1e1-900e7efac9dd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:03.610239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b87918-c5e3-402e-b1e1-900e7efac9dd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:03.625824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa82dff-0c9f-4b3b-9ff0-1137356ca9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:03.626508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa82dff-0c9f-4b3b-9ff0-1137356ca9db admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:03.626775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa82dff-0c9f-4b3b-9ff0-1137356ca9db admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:03.627074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa82dff-0c9f-4b3b-9ff0-1137356ca9db admin admin] PATH_INFO: `/v3/projects/4572014ea4b34d90b58af5afe961d52a/users/9444a3c19d9047e7a93a388527d0cff4/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:03.668146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa82dff-0c9f-4b3b-9ff0-1137356ca9db admin admin] RBAC: Authorizing `identity:create_grant(project_id=4572014ea4b34d90b58af5afe961d52a, user_id=9444a3c19d9047e7a93a388527d0cff4, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:03.671546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa82dff-0c9f-4b3b-9ff0-1137356ca9db admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:03.711641 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2661/5312] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:03 2022] PUT /identity/v3/projects/4572014ea4b34d90b58af5afe961d52a/users/9444a3c19d9047e7a93a388527d0cff4/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:03.712885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa014c-9b61-4f63-ac1f-9fe9ce7d18a3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:03.728267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa014c-9b61-4f63-ac1f-9fe9ce7d18a3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:03.871535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118fb5b-d284-469d-85d3-1e031f6e5610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:03.871848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118fb5b-d284-469d-85d3-1e031f6e5610 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:03.872322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118fb5b-d284-469d-85d3-1e031f6e5610 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:03.872587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118fb5b-d284-469d-85d3-1e031f6e5610 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:03.873523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118fb5b-d284-469d-85d3-1e031f6e5610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:03.874842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118fb5b-d284-469d-85d3-1e031f6e5610 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:03.888175 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:03.914195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa82dff-0c9f-4b3b-9ff0-1137356ca9db admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:03.920386 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2652/5313] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:03.943218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa82dff-0c9f-4b3b-9ff0-1137356ca9db admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:03.961415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d68cfa-b09f-4ae6-9d0e-a2960cc6f59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:03.962158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d68cfa-b09f-4ae6-9d0e-a2960cc6f59e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:03.963955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d68cfa-b09f-4ae6-9d0e-a2960cc6f59e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:03.964314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d68cfa-b09f-4ae6-9d0e-a2960cc6f59e admin admin] PATH_INFO: `/v3/projects/4572014ea4b34d90b58af5afe961d52a/users/9444a3c19d9047e7a93a388527d0cff4/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:03.969931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d68cfa-b09f-4ae6-9d0e-a2960cc6f59e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4572014ea4b34d90b58af5afe961d52a, user_id=9444a3c19d9047e7a93a388527d0cff4, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:03.977391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d68cfa-b09f-4ae6-9d0e-a2960cc6f59e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:04.008708 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2662/5314] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:03 2022] PUT /identity/v3/projects/4572014ea4b34d90b58af5afe961d52a/users/9444a3c19d9047e7a93a388527d0cff4/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:04.019858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb56070-b51f-4b75-b546-a575282ab701 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:04.020153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb56070-b51f-4b75-b546-a575282ab701 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:04.020402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb56070-b51f-4b75-b546-a575282ab701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:04.088418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0cb56070-b51f-4b75-b546-a575282ab701 None None] MFA Rules not processed for user `9444a3c19d9047e7a93a388527d0cff4`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:04.090517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0cb56070-b51f-4b75-b546-a575282ab701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:04.234119 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2653/5315] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:04.238661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d68cfa-b09f-4ae6-9d0e-a2960cc6f59e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:04.262832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d68cfa-b09f-4ae6-9d0e-a2960cc6f59e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:04.269889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddfd50-dcbb-470d-be01-0ef6ed684b9c tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9444a3c19d9047e7a93a388527d0cff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4572014ea4b34d90b58af5afe961d52a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:04.270514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddfd50-dcbb-470d-be01-0ef6ed684b9c tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:04.270794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddfd50-dcbb-470d-be01-0ef6ed684b9c tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:04.271067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddfd50-dcbb-470d-be01-0ef6ed684b9c tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:04.271878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ddfd50-dcbb-470d-be01-0ef6ed684b9c tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:04.276250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ddfd50-dcbb-470d-be01-0ef6ed684b9c tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:04.310236 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2663/5316] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:06:04 2022] POST /identity/v3/services => generated 288 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:04.311319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb56070-b51f-4b75-b546-a575282ab701 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:04.324115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb56070-b51f-4b75-b546-a575282ab701 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:04.348589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587b36f-5a9f-4cf2-abd9-ee9230720fea tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9444a3c19d9047e7a93a388527d0cff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4572014ea4b34d90b58af5afe961d52a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:04.349295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587b36f-5a9f-4cf2-abd9-ee9230720fea tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:04.349580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587b36f-5a9f-4cf2-abd9-ee9230720fea tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:04.349852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587b36f-5a9f-4cf2-abd9-ee9230720fea tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:04.350550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587b36f-5a9f-4cf2-abd9-ee9230720fea tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:04.351625 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-c587b36f-5a9f-4cf2-abd9-ee9230720fea tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:06:04.351625 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:06:04.351625 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:06:04.352694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587b36f-5a9f-4cf2-abd9-ee9230720fea tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:04.429770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddfd50-dcbb-470d-be01-0ef6ed684b9c tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:04.434526 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2654/5317] 10.222.0.16 () {60 vars in 1213 bytes} [Fri Sep 30 10:06:04 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:04.435526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587b36f-5a9f-4cf2-abd9-ee9230720fea tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:04.439676 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:04.441911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c587b36f-5a9f-4cf2-abd9-ee9230720fea tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:04.448904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddfd50-dcbb-470d-be01-0ef6ed684b9c tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:04.455764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd7632-eb51-4204-bf88-699df4f3c7ea tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9444a3c19d9047e7a93a388527d0cff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4572014ea4b34d90b58af5afe961d52a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:04.456859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd7632-eb51-4204-bf88-699df4f3c7ea tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:04.457682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd7632-eb51-4204-bf88-699df4f3c7ea tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:04.458120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd7632-eb51-4204-bf88-699df4f3c7ea tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:04.459028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd7632-eb51-4204-bf88-699df4f3c7ea tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:04.462903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd7632-eb51-4204-bf88-699df4f3c7ea tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:04.510412 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2664/5318] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:06:04 2022] POST /identity/v3/services => generated 289 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:04.514253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd7632-eb51-4204-bf88-699df4f3c7ea tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:04.598769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd7632-eb51-4204-bf88-699df4f3c7ea tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:04.615781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bd3da-c611-438f-9fc8-1eccc97d84de tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9444a3c19d9047e7a93a388527d0cff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4572014ea4b34d90b58af5afe961d52a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:04.617074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bd3da-c611-438f-9fc8-1eccc97d84de tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:04.617480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bd3da-c611-438f-9fc8-1eccc97d84de tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:04.617867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bd3da-c611-438f-9fc8-1eccc97d84de tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:04.619392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bd3da-c611-438f-9fc8-1eccc97d84de tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:04.621677 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-409bd3da-c611-438f-9fc8-1eccc97d84de tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:06:04.621677 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:06:04.621677 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:06:04.622597 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bd3da-c611-438f-9fc8-1eccc97d84de tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:04.657438 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2665/5319] 10.222.0.16 () {60 vars in 1213 bytes} [Fri Sep 30 10:06:04 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:04.662014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587b36f-5a9f-4cf2-abd9-ee9230720fea tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:04.666341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bd3da-c611-438f-9fc8-1eccc97d84de tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:04.683170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bd3da-c611-438f-9fc8-1eccc97d84de tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:04.690237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31f6de-0512-4459-9d8f-4fe17b5e00e6 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9444a3c19d9047e7a93a388527d0cff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4572014ea4b34d90b58af5afe961d52a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:04.690890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31f6de-0512-4459-9d8f-4fe17b5e00e6 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:04.691174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31f6de-0512-4459-9d8f-4fe17b5e00e6 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:04.691447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31f6de-0512-4459-9d8f-4fe17b5e00e6 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:04.692257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31f6de-0512-4459-9d8f-4fe17b5e00e6 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:04.693484 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-ac31f6de-0512-4459-9d8f-4fe17b5e00e6 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:06:04.693484 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:06:04.693484 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:06:04.695624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31f6de-0512-4459-9d8f-4fe17b5e00e6 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:04.713328 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2666/5320] 10.222.0.16 () {58 vars in 1191 bytes} [Fri Sep 30 10:06:04 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 763 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:06:04.721633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31f6de-0512-4459-9d8f-4fe17b5e00e6 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:04.740741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71c612-d10e-4d7f-9179-05d628c1e7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:04.742094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71c612-d10e-4d7f-9179-05d628c1e7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:04.748404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71c612-d10e-4d7f-9179-05d628c1e7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:04.748788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71c612-d10e-4d7f-9179-05d628c1e7cd admin admin] PATH_INFO: `/v3/users/3b97b83ebcf242d0abd55dfbb15ab066` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:04.753382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71c612-d10e-4d7f-9179-05d628c1e7cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b97b83ebcf242d0abd55dfbb15ab066)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:04.754605 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31f6de-0512-4459-9d8f-4fe17b5e00e6 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:04.760386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71c612-d10e-4d7f-9179-05d628c1e7cd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:04.770672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eda318-04ee-4016-ac6b-f6ad0fbd7b1f tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9444a3c19d9047e7a93a388527d0cff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4572014ea4b34d90b58af5afe961d52a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:04.772828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eda318-04ee-4016-ac6b-f6ad0fbd7b1f tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:04.773974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eda318-04ee-4016-ac6b-f6ad0fbd7b1f tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:04.774467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eda318-04ee-4016-ac6b-f6ad0fbd7b1f tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/175e5ece06434af299761ab72c47c168` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:04.775660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eda318-04ee-4016-ac6b-f6ad0fbd7b1f tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=175e5ece06434af299761ab72c47c168)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:04.778271 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-d5eda318-04ee-4016-ac6b-f6ad0fbd7b1f tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:06:04.778271 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:06:04.778271 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:06:04.782004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eda318-04ee-4016-ac6b-f6ad0fbd7b1f tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:04.792368 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2667/5321] 10.222.0.16 () {58 vars in 1290 bytes} [Fri Sep 30 10:06:04 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/175e5ece06434af299761ab72c47c168 => generated 333 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:06:04.796436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eda318-04ee-4016-ac6b-f6ad0fbd7b1f tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:04.813757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eda318-04ee-4016-ac6b-f6ad0fbd7b1f tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:04.838432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e13ec-d2a4-4e42-845e-d9e8c9ec1f03 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9444a3c19d9047e7a93a388527d0cff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4572014ea4b34d90b58af5afe961d52a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:04.839054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e13ec-d2a4-4e42-845e-d9e8c9ec1f03 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:04.839341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e13ec-d2a4-4e42-845e-d9e8c9ec1f03 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:04.839638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e13ec-d2a4-4e42-845e-d9e8c9ec1f03 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/175e5ece06434af299761ab72c47c168` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:04.841278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e13ec-d2a4-4e42-845e-d9e8c9ec1f03 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=175e5ece06434af299761ab72c47c168)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:04.843829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e13ec-d2a4-4e42-845e-d9e8c9ec1f03 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:04.857531 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2668/5322] 10.222.0.16 () {58 vars in 1291 bytes} [Fri Sep 30 10:06:04 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/175e5ece06434af299761ab72c47c168 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Sep 30 10:06:04.862283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e13ec-d2a4-4e42-845e-d9e8c9ec1f03 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:04.874138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc71c612-d10e-4d7f-9179-05d628c1e7cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b97b83ebcf242d0abd55dfbb15ab066'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:04.877101 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:04.887212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc71c612-d10e-4d7f-9179-05d628c1e7cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b97b83ebcf242d0abd55dfbb15ab066'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:04.888009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc71c612-d10e-4d7f-9179-05d628c1e7cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b97b83ebcf242d0abd55dfbb15ab066'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:04.895832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e13ec-d2a4-4e42-845e-d9e8c9ec1f03 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:04.912086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc71c612-d10e-4d7f-9179-05d628c1e7cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b97b83ebcf242d0abd55dfbb15ab066'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:04.913844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060be626-8dc4-4da2-9bdc-66ad1cd53e09 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9444a3c19d9047e7a93a388527d0cff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4572014ea4b34d90b58af5afe961d52a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:04.914515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060be626-8dc4-4da2-9bdc-66ad1cd53e09 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:04.914799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060be626-8dc4-4da2-9bdc-66ad1cd53e09 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:04.915075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060be626-8dc4-4da2-9bdc-66ad1cd53e09 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/175e5ece06434af299761ab72c47c168` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:04.915668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060be626-8dc4-4da2-9bdc-66ad1cd53e09 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=175e5ece06434af299761ab72c47c168)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:04.917039 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-060be626-8dc4-4da2-9bdc-66ad1cd53e09 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:06:04.917039 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:06:04.917039 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:06:04.918011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060be626-8dc4-4da2-9bdc-66ad1cd53e09 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:04.921947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc71c612-d10e-4d7f-9179-05d628c1e7cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b97b83ebcf242d0abd55dfbb15ab066'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:04.940547 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2669/5323] 10.222.0.16 () {58 vars in 1293 bytes} [Fri Sep 30 10:06:04 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/175e5ece06434af299761ab72c47c168 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:04.947755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060be626-8dc4-4da2-9bdc-66ad1cd53e09 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:04.949662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-060be626-8dc4-4da2-9bdc-66ad1cd53e09 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:04.961361 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2655/5324] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:06:04 2022] DELETE /identity/v3/users/3b97b83ebcf242d0abd55dfbb15ab066 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:04.975913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060be626-8dc4-4da2-9bdc-66ad1cd53e09 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:05.066216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91505c-7d9a-43bb-aea5-1bf9c3d51132 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9444a3c19d9047e7a93a388527d0cff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4572014ea4b34d90b58af5afe961d52a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:05.067018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91505c-7d9a-43bb-aea5-1bf9c3d51132 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:05.067328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91505c-7d9a-43bb-aea5-1bf9c3d51132 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:05.067612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91505c-7d9a-43bb-aea5-1bf9c3d51132 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:05.068393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91505c-7d9a-43bb-aea5-1bf9c3d51132 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:05.074575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91505c-7d9a-43bb-aea5-1bf9c3d51132 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:05.083886 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2670/5325] 10.222.0.16 () {58 vars in 1191 bytes} [Fri Sep 30 10:06:04 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 449 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:06:05.090025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71c612-d10e-4d7f-9179-05d628c1e7cd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:05.115378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71c612-d10e-4d7f-9179-05d628c1e7cd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:05.135920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c50ea8-cf28-4f75-99e6-8fe9c127ce08 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9444a3c19d9047e7a93a388527d0cff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4572014ea4b34d90b58af5afe961d52a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:05.140473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c50ea8-cf28-4f75-99e6-8fe9c127ce08 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:05.140473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c50ea8-cf28-4f75-99e6-8fe9c127ce08 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:05.140794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c50ea8-cf28-4f75-99e6-8fe9c127ce08 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/175e5ece06434af299761ab72c47c168` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:05.142071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c50ea8-cf28-4f75-99e6-8fe9c127ce08 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=175e5ece06434af299761ab72c47c168)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:05.149227 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-60c50ea8-cf28-4f75-99e6-8fe9c127ce08 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:06:05.149227 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:06:05.149227 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:06:05.151279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c50ea8-cf28-4f75-99e6-8fe9c127ce08 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:05.192627 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-60c50ea8-cf28-4f75-99e6-8fe9c127ce08 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Could not find Endpoint Group: 175e5ece06434af299761ab72c47c168.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 175e5ece06434af299761ab72c47c168. Sep 30 10:06:05.192627 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:06:05.192627 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:06:05.192627 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:06:05.192627 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:06:05.192627 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:06:05.192627 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:06:05.192627 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:06:05.192627 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:06:05.192627 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:06:05.192627 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:06:05.192627 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:06:05.192627 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Sep 30 10:06:05.192627 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Sep 30 10:06:05.193720 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Sep 30 10:06:05.193720 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Sep 30 10:06:05.193720 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Sep 30 10:06:05.193720 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Sep 30 10:06:05.193720 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 175e5ece06434af299761ab72c47c168. Sep 30 10:06:05.193720 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:06:05.198843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91505c-7d9a-43bb-aea5-1bf9c3d51132 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:05.200218 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2656/5326] 10.222.0.16 () {58 vars in 1293 bytes} [Fri Sep 30 10:06:05 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/175e5ece06434af299761ab72c47c168 => generated 120 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:06:05.214322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91505c-7d9a-43bb-aea5-1bf9c3d51132 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:05.229240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa665ca1-0382-44ac-ac86-5bc2cec1b98d tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9444a3c19d9047e7a93a388527d0cff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4572014ea4b34d90b58af5afe961d52a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:05.231032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa665ca1-0382-44ac-ac86-5bc2cec1b98d tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:05.232331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa665ca1-0382-44ac-ac86-5bc2cec1b98d tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:05.232647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa665ca1-0382-44ac-ac86-5bc2cec1b98d tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] PATH_INFO: `/v3/services/922dde6290954d7c9f500ca36f22f719` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:05.234356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa665ca1-0382-44ac-ac86-5bc2cec1b98d tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorizing `identity:delete_service(service_id=922dde6290954d7c9f500ca36f22f719)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:05.239036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa665ca1-0382-44ac-ac86-5bc2cec1b98d tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:05.311441 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2671/5327] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:05 2022] DELETE /identity/v3/services/922dde6290954d7c9f500ca36f22f719 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:05.317218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c50ea8-cf28-4f75-99e6-8fe9c127ce08 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:05.337401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c50ea8-cf28-4f75-99e6-8fe9c127ce08 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:05.400121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47957565-e469-4597-9260-bfaee363904c tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9444a3c19d9047e7a93a388527d0cff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4572014ea4b34d90b58af5afe961d52a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:05.401826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47957565-e469-4597-9260-bfaee363904c tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:05.403651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47957565-e469-4597-9260-bfaee363904c tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:05.404036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47957565-e469-4597-9260-bfaee363904c tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:05.404823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47957565-e469-4597-9260-bfaee363904c tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:05.409726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47957565-e469-4597-9260-bfaee363904c tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:05.459154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa665ca1-0382-44ac-ac86-5bc2cec1b98d tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:05.460362 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2657/5328] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:06:05 2022] POST /identity/v3/services => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:05.496295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa665ca1-0382-44ac-ac86-5bc2cec1b98d tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:05.542452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ed4af-4715-4b6e-a953-453928f962e3 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9444a3c19d9047e7a93a388527d0cff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4572014ea4b34d90b58af5afe961d52a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:05.543168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ed4af-4715-4b6e-a953-453928f962e3 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:05.543511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ed4af-4715-4b6e-a953-453928f962e3 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:05.543989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ed4af-4715-4b6e-a953-453928f962e3 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:05.544767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ed4af-4715-4b6e-a953-453928f962e3 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:05.546555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ed4af-4715-4b6e-a953-453928f962e3 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:05.576786 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2672/5329] 10.222.0.16 () {60 vars in 1213 bytes} [Fri Sep 30 10:06:05 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:05.580822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47957565-e469-4597-9260-bfaee363904c tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:05.603740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47957565-e469-4597-9260-bfaee363904c tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:05.629439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adb070-7087-42e5-a0b9-4289c3ec92c9 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9444a3c19d9047e7a93a388527d0cff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4572014ea4b34d90b58af5afe961d52a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:05.638277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adb070-7087-42e5-a0b9-4289c3ec92c9 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:05.638556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adb070-7087-42e5-a0b9-4289c3ec92c9 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:05.638914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adb070-7087-42e5-a0b9-4289c3ec92c9 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:05.639515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adb070-7087-42e5-a0b9-4289c3ec92c9 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:05.651125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adb070-7087-42e5-a0b9-4289c3ec92c9 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:05.703548 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2658/5330] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:06:05 2022] POST /identity/v3/services => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:05.703975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ed4af-4715-4b6e-a953-453928f962e3 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:05.718410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ed4af-4715-4b6e-a953-453928f962e3 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:05.793355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ec8ab-d9f0-4dd4-8859-a8b1f1531a85 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9444a3c19d9047e7a93a388527d0cff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4572014ea4b34d90b58af5afe961d52a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:05.793355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ec8ab-d9f0-4dd4-8859-a8b1f1531a85 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:05.793355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ec8ab-d9f0-4dd4-8859-a8b1f1531a85 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:05.793647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ec8ab-d9f0-4dd4-8859-a8b1f1531a85 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/e469687fb6284025aad4ca25c5d418b5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:05.793647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ec8ab-d9f0-4dd4-8859-a8b1f1531a85 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=e469687fb6284025aad4ca25c5d418b5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:05.793647 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-ef1ec8ab-d9f0-4dd4-8859-a8b1f1531a85 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:06:05.793647 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:06:05.793647 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:06:05.797068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ec8ab-d9f0-4dd4-8859-a8b1f1531a85 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:05.827997 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2673/5331] 10.222.0.16 () {60 vars in 1313 bytes} [Fri Sep 30 10:06:05 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/e469687fb6284025aad4ca25c5d418b5 => generated 336 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:06:05.832321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adb070-7087-42e5-a0b9-4289c3ec92c9 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:05.855415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adb070-7087-42e5-a0b9-4289c3ec92c9 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:05.868044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe6dcb-d63c-4691-b816-5202be21b676 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9444a3c19d9047e7a93a388527d0cff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4572014ea4b34d90b58af5afe961d52a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:05.868890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe6dcb-d63c-4691-b816-5202be21b676 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:05.869179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe6dcb-d63c-4691-b816-5202be21b676 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:05.869524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe6dcb-d63c-4691-b816-5202be21b676 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] PATH_INFO: `/v3/services/5d57213ab5934542ab69107f203b2dc5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:05.870129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe6dcb-d63c-4691-b816-5202be21b676 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorizing `identity:delete_service(service_id=5d57213ab5934542ab69107f203b2dc5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:05.873967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe6dcb-d63c-4691-b816-5202be21b676 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:05.945428 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2659/5332] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:05 2022] DELETE /identity/v3/services/5d57213ab5934542ab69107f203b2dc5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:05.949742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ec8ab-d9f0-4dd4-8859-a8b1f1531a85 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:05.966398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ec8ab-d9f0-4dd4-8859-a8b1f1531a85 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:06.005167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e99cff-2570-4506-88d7-bfbd53ee3d02 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9444a3c19d9047e7a93a388527d0cff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4572014ea4b34d90b58af5afe961d52a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:06.006389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e99cff-2570-4506-88d7-bfbd53ee3d02 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:06.006732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e99cff-2570-4506-88d7-bfbd53ee3d02 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:06.007200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e99cff-2570-4506-88d7-bfbd53ee3d02 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/e469687fb6284025aad4ca25c5d418b5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:06.007829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e99cff-2570-4506-88d7-bfbd53ee3d02 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=e469687fb6284025aad4ca25c5d418b5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:06.016274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e99cff-2570-4506-88d7-bfbd53ee3d02 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:06.043315 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2674/5333] 10.222.0.16 () {58 vars in 1293 bytes} [Fri Sep 30 10:06:05 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/e469687fb6284025aad4ca25c5d418b5 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:06:06.047923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe6dcb-d63c-4691-b816-5202be21b676 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:06.067182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe6dcb-d63c-4691-b816-5202be21b676 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:06.079709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4d93f-7b77-4d57-9252-3f4f4ed096e6 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9444a3c19d9047e7a93a388527d0cff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4572014ea4b34d90b58af5afe961d52a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:06.080366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4d93f-7b77-4d57-9252-3f4f4ed096e6 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:06.080668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4d93f-7b77-4d57-9252-3f4f4ed096e6 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:06.080947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4d93f-7b77-4d57-9252-3f4f4ed096e6 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] PATH_INFO: `/v3/services/1ec7dc1724e141978419a574c787d566` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:06.081542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4d93f-7b77-4d57-9252-3f4f4ed096e6 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1ec7dc1724e141978419a574c787d566)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:06.083402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4d93f-7b77-4d57-9252-3f4f4ed096e6 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:06.146488 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2660/5334] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:06 2022] DELETE /identity/v3/services/1ec7dc1724e141978419a574c787d566 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:06.152591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e99cff-2570-4506-88d7-bfbd53ee3d02 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:06.180071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e99cff-2570-4506-88d7-bfbd53ee3d02 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:06.200574 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=6,keystone:UPDATE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:06.238732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a20aa-0c35-4d14-aeca-3ea6f64354f0 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9444a3c19d9047e7a93a388527d0cff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4572014ea4b34d90b58af5afe961d52a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:06.240111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a20aa-0c35-4d14-aeca-3ea6f64354f0 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:06.240693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a20aa-0c35-4d14-aeca-3ea6f64354f0 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:06.241502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a20aa-0c35-4d14-aeca-3ea6f64354f0 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/91b05634afa54f3c81624072b98739bd` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:06.242348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a20aa-0c35-4d14-aeca-3ea6f64354f0 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=91b05634afa54f3c81624072b98739bd)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:06.245145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a20aa-0c35-4d14-aeca-3ea6f64354f0 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:06.265189 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2675/5335] 10.222.0.16 () {58 vars in 1293 bytes} [Fri Sep 30 10:06:06 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/91b05634afa54f3c81624072b98739bd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:06.269543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4d93f-7b77-4d57-9252-3f4f4ed096e6 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:06.285815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4d93f-7b77-4d57-9252-3f4f4ed096e6 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:06.321176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04923d6c-16aa-49ec-a21a-392a50b7ed3c tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9444a3c19d9047e7a93a388527d0cff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4572014ea4b34d90b58af5afe961d52a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:06.321999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04923d6c-16aa-49ec-a21a-392a50b7ed3c tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:06.322196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04923d6c-16aa-49ec-a21a-392a50b7ed3c tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:06.322475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04923d6c-16aa-49ec-a21a-392a50b7ed3c tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] PATH_INFO: `/v3/services/2613955bd60e406394e6b4d381ff32d0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:06.324713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04923d6c-16aa-49ec-a21a-392a50b7ed3c tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorizing `identity:delete_service(service_id=2613955bd60e406394e6b4d381ff32d0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:06.327775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04923d6c-16aa-49ec-a21a-392a50b7ed3c tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:06.398891 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2661/5336] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:06 2022] DELETE /identity/v3/services/2613955bd60e406394e6b4d381ff32d0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:06.403171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a20aa-0c35-4d14-aeca-3ea6f64354f0 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:06.405701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6c7a20aa-0c35-4d14-aeca-3ea6f64354f0 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:06.544043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a20aa-0c35-4d14-aeca-3ea6f64354f0 tempest-EndPointGroupsTest-1907133567 tempest-EndPointGroupsTest-1907133567-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:06.595707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdad8f-4547-43de-b096-0be68222ffe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:06.598161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdad8f-4547-43de-b096-0be68222ffe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:06.598491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdad8f-4547-43de-b096-0be68222ffe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:06.604029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdad8f-4547-43de-b096-0be68222ffe8 admin admin] PATH_INFO: `/v3/users/a020502bb9f24f64bfaf58e7f008ab5a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:06.606222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cdad8f-4547-43de-b096-0be68222ffe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a020502bb9f24f64bfaf58e7f008ab5a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:06.613605 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cdad8f-4547-43de-b096-0be68222ffe8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:06.824336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84cdad8f-4547-43de-b096-0be68222ffe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a020502bb9f24f64bfaf58e7f008ab5a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:06.829339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84cdad8f-4547-43de-b096-0be68222ffe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a020502bb9f24f64bfaf58e7f008ab5a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:06.853248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84cdad8f-4547-43de-b096-0be68222ffe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a020502bb9f24f64bfaf58e7f008ab5a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:06.889801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84cdad8f-4547-43de-b096-0be68222ffe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a020502bb9f24f64bfaf58e7f008ab5a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:06.915106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84cdad8f-4547-43de-b096-0be68222ffe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a020502bb9f24f64bfaf58e7f008ab5a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:06.933611 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2676/5337] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:06:06 2022] DELETE /identity/v3/users/a020502bb9f24f64bfaf58e7f008ab5a => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:06.935356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c471b-7c72-4dbc-89df-894d076436b3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:06.935643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c471b-7c72-4dbc-89df-894d076436b3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:06.936240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c471b-7c72-4dbc-89df-894d076436b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:06.976526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a90c471b-7c72-4dbc-89df-894d076436b3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:06.977650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a90c471b-7c72-4dbc-89df-894d076436b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:07.107705 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2662/5338] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:07.248190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdad8f-4547-43de-b096-0be68222ffe8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:07.249748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c471b-7c72-4dbc-89df-894d076436b3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:07.250931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-84cdad8f-4547-43de-b096-0be68222ffe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:07.251135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a90c471b-7c72-4dbc-89df-894d076436b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:07.276594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c471b-7c72-4dbc-89df-894d076436b3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:07.294181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cff61-a3de-4d05-9ab1-087e214eea5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:07.294834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cff61-a3de-4d05-9ab1-087e214eea5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:07.295119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cff61-a3de-4d05-9ab1-087e214eea5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:07.295396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cff61-a3de-4d05-9ab1-087e214eea5b admin admin] PATH_INFO: `/v3/projects/488b287ec4434a1e9a2886a047187a46` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:07.302356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949cff61-a3de-4d05-9ab1-087e214eea5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=488b287ec4434a1e9a2886a047187a46)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:07.305011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949cff61-a3de-4d05-9ab1-087e214eea5b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:07.337306 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:07.367654 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:07.414387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdad8f-4547-43de-b096-0be68222ffe8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:07.422074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc982f-77b5-4072-afac-000330a51372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:07.425330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc982f-77b5-4072-afac-000330a51372 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:07.425625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc982f-77b5-4072-afac-000330a51372 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:07.425898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc982f-77b5-4072-afac-000330a51372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:07.453293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc982f-77b5-4072-afac-000330a51372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:07.455718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc982f-77b5-4072-afac-000330a51372 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:07.461567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-949cff61-a3de-4d05-9ab1-087e214eea5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '488b287ec4434a1e9a2886a047187a46', 'request_id': 'req-949cff61-a3de-4d05-9ab1-087e214eea5b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:07.474626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-949cff61-a3de-4d05-9ab1-087e214eea5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '488b287ec4434a1e9a2886a047187a46', 'request_id': 'req-949cff61-a3de-4d05-9ab1-087e214eea5b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:07.481966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-949cff61-a3de-4d05-9ab1-087e214eea5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '488b287ec4434a1e9a2886a047187a46', 'request_id': 'req-949cff61-a3de-4d05-9ab1-087e214eea5b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:07.486213 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2677/5339] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:06:07.508193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-949cff61-a3de-4d05-9ab1-087e214eea5b admin admin] The token cache is being invalidate because project 488b287ec4434a1e9a2886a047187a46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:06:07.508718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-949cff61-a3de-4d05-9ab1-087e214eea5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:07.509939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-949cff61-a3de-4d05-9ab1-087e214eea5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:07.522419 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2663/5340] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:07 2022] DELETE /identity/v3/projects/488b287ec4434a1e9a2886a047187a46 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:06:07.523911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75d311-aa99-45ee-8a18-7f6cf0111261 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:07.524199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75d311-aa99-45ee-8a18-7f6cf0111261 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:07.524471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75d311-aa99-45ee-8a18-7f6cf0111261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:07.568983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6a75d311-aa99-45ee-8a18-7f6cf0111261 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:07.573095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6a75d311-aa99-45ee-8a18-7f6cf0111261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:07.708535 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2678/5341] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:06:07.719304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0118c-0443-4256-8bbe-5abfbf5f99f2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:07.720496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0118c-0443-4256-8bbe-5abfbf5f99f2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:07.720819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0118c-0443-4256-8bbe-5abfbf5f99f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:07.764805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-31e0118c-0443-4256-8bbe-5abfbf5f99f2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:07.766617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-31e0118c-0443-4256-8bbe-5abfbf5f99f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:07.806618 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2664/5342] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:07.806851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75d311-aa99-45ee-8a18-7f6cf0111261 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:07.823127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75d311-aa99-45ee-8a18-7f6cf0111261 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:07.848503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf4191-8111-4a23-8f22-7801ad26a606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:07.849399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf4191-8111-4a23-8f22-7801ad26a606 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:07.849844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf4191-8111-4a23-8f22-7801ad26a606 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:07.851451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf4191-8111-4a23-8f22-7801ad26a606 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:07.852349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf4191-8111-4a23-8f22-7801ad26a606 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:06:07.853462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf4191-8111-4a23-8f22-7801ad26a606 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:07.855269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf4191-8111-4a23-8f22-7801ad26a606 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:07.875852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0118c-0443-4256-8bbe-5abfbf5f99f2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:07.883009 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2679/5343] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:06:07.887006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0118c-0443-4256-8bbe-5abfbf5f99f2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:07.892190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b4dac-c7f0-445d-8dc6-8a8e8b74b0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:07.894491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b4dac-c7f0-445d-8dc6-8a8e8b74b0bb admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:07.894966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b4dac-c7f0-445d-8dc6-8a8e8b74b0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:07.895235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b4dac-c7f0-445d-8dc6-8a8e8b74b0bb admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:07.895882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b4dac-c7f0-445d-8dc6-8a8e8b74b0bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:07.898526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b4dac-c7f0-445d-8dc6-8a8e8b74b0bb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:07.990741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf4191-8111-4a23-8f22-7801ad26a606 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:07.991820 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2665/5344] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:06:07 2022] POST /identity/v3/projects => generated 395 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:08.003988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf4191-8111-4a23-8f22-7801ad26a606 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:08.143349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef89d54-6968-493b-9d97-42f5c6672348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:08.144063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef89d54-6968-493b-9d97-42f5c6672348 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:08.144353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef89d54-6968-493b-9d97-42f5c6672348 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:08.144690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef89d54-6968-493b-9d97-42f5c6672348 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:08.145621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef89d54-6968-493b-9d97-42f5c6672348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:08.147441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef89d54-6968-493b-9d97-42f5c6672348 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:08.195313 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2680/5345] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:06:07 2022] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:06:08.199734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b4dac-c7f0-445d-8dc6-8a8e8b74b0bb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:08.211122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b4dac-c7f0-445d-8dc6-8a8e8b74b0bb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:08.225881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a41340-a460-4f4c-9cf7-df8306fa64ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:08.226518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a41340-a460-4f4c-9cf7-df8306fa64ea admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:08.227270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a41340-a460-4f4c-9cf7-df8306fa64ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:08.227270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a41340-a460-4f4c-9cf7-df8306fa64ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:08.229645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a41340-a460-4f4c-9cf7-df8306fa64ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:08.231489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a41340-a460-4f4c-9cf7-df8306fa64ea admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:08.267836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef89d54-6968-493b-9d97-42f5c6672348 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:08.269936 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2666/5346] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:08.285174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef89d54-6968-493b-9d97-42f5c6672348 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:08.291577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c43f4-5f89-454c-9363-82fe3980a8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:08.292476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c43f4-5f89-454c-9363-82fe3980a8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:08.292954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c43f4-5f89-454c-9363-82fe3980a8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:08.293393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c43f4-5f89-454c-9363-82fe3980a8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:08.294228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c43f4-5f89-454c-9363-82fe3980a8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:08.296004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c43f4-5f89-454c-9363-82fe3980a8c8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:08.316674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a41340-a460-4f4c-9cf7-df8306fa64ea admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:08.331557 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2681/5347] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:06:08.334370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a41340-a460-4f4c-9cf7-df8306fa64ea admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:08.340645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba5ff0-2019-4cc0-9781-fa12990efb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:08.341943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba5ff0-2019-4cc0-9781-fa12990efb1f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:08.342388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba5ff0-2019-4cc0-9781-fa12990efb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:08.342872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba5ff0-2019-4cc0-9781-fa12990efb1f admin admin] PATH_INFO: `/v3/projects/e8bd2fa0cbc449ac86530c037fe446f1/users/ef13867e7dc6433283f59bb0121af017/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:08.360845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba5ff0-2019-4cc0-9781-fa12990efb1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8bd2fa0cbc449ac86530c037fe446f1, user_id=ef13867e7dc6433283f59bb0121af017, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:08.364054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba5ff0-2019-4cc0-9781-fa12990efb1f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:08.409312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580e04b-51ad-437e-86fa-066c6178bdc7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:08.409598 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580e04b-51ad-437e-86fa-066c6178bdc7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:08.409873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580e04b-51ad-437e-86fa-066c6178bdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:08.412889 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2667/5348] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:08 2022] PUT /identity/v3/projects/e8bd2fa0cbc449ac86530c037fe446f1/users/ef13867e7dc6433283f59bb0121af017/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:08.446324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0580e04b-51ad-437e-86fa-066c6178bdc7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:08.450393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0580e04b-51ad-437e-86fa-066c6178bdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:08.542709 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:08.580221 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2682/5349] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:08.609410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba5ff0-2019-4cc0-9781-fa12990efb1f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:08.612550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a9ba5ff0-2019-4cc0-9781-fa12990efb1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:08.827143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba5ff0-2019-4cc0-9781-fa12990efb1f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:08.843311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6edf3c-4f6d-48c0-8e8c-8ad67397f088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:08.843954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6edf3c-4f6d-48c0-8e8c-8ad67397f088 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:08.844331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6edf3c-4f6d-48c0-8e8c-8ad67397f088 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:08.844490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6edf3c-4f6d-48c0-8e8c-8ad67397f088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:08.893073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6edf3c-4f6d-48c0-8e8c-8ad67397f088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:08.894810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6edf3c-4f6d-48c0-8e8c-8ad67397f088 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:08.939033 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2668/5350] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:06:09.509642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580e04b-51ad-437e-86fa-066c6178bdc7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:09.512236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0580e04b-51ad-437e-86fa-066c6178bdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:09.533945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580e04b-51ad-437e-86fa-066c6178bdc7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:09.544560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759b5a8-ce85-40f5-83ac-9826119a4666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:09.545409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759b5a8-ce85-40f5-83ac-9826119a4666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:09.545791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759b5a8-ce85-40f5-83ac-9826119a4666 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:09.546245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759b5a8-ce85-40f5-83ac-9826119a4666 admin admin] PATH_INFO: `/v3/users/1711ce933fed4545877c0e970ba3ec50` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:09.548333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759b5a8-ce85-40f5-83ac-9826119a4666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1711ce933fed4545877c0e970ba3ec50)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:09.561111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759b5a8-ce85-40f5-83ac-9826119a4666 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:09.711494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1759b5a8-ce85-40f5-83ac-9826119a4666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1711ce933fed4545877c0e970ba3ec50'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:09.712562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1759b5a8-ce85-40f5-83ac-9826119a4666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1711ce933fed4545877c0e970ba3ec50'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:09.735036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1759b5a8-ce85-40f5-83ac-9826119a4666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1711ce933fed4545877c0e970ba3ec50'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:09.764558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1759b5a8-ce85-40f5-83ac-9826119a4666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1711ce933fed4545877c0e970ba3ec50'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:09.785088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1759b5a8-ce85-40f5-83ac-9826119a4666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1711ce933fed4545877c0e970ba3ec50'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:09.823620 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2683/5351] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:06:09 2022] DELETE /identity/v3/users/1711ce933fed4545877c0e970ba3ec50 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:06:09.828112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551f590-b0c1-4c3d-905c-1c89582380da None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:09.828998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551f590-b0c1-4c3d-905c-1c89582380da None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:09.828998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551f590-b0c1-4c3d-905c-1c89582380da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:09.976166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8551f590-b0c1-4c3d-905c-1c89582380da None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:09.987408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8551f590-b0c1-4c3d-905c-1c89582380da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:10.206474 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:10.317175 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2669/5352] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:10.362898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759b5a8-ce85-40f5-83ac-9826119a4666 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:10.364674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1759b5a8-ce85-40f5-83ac-9826119a4666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:10.595180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759b5a8-ce85-40f5-83ac-9826119a4666 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:10.612499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d8d18-56a3-4a41-900d-c1b4eb7835f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:10.613237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d8d18-56a3-4a41-900d-c1b4eb7835f3 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:10.613615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d8d18-56a3-4a41-900d-c1b4eb7835f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:10.613905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d8d18-56a3-4a41-900d-c1b4eb7835f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:10.651572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d8d18-56a3-4a41-900d-c1b4eb7835f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:10.653334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d8d18-56a3-4a41-900d-c1b4eb7835f3 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:10.686339 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2684/5353] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:06:11.094342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551f590-b0c1-4c3d-905c-1c89582380da None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:11.095853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8551f590-b0c1-4c3d-905c-1c89582380da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:11.119010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551f590-b0c1-4c3d-905c-1c89582380da None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:11.136505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1623173-b61b-4b24-b690-4b973c68b623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:11.137401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1623173-b61b-4b24-b690-4b973c68b623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:11.137839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1623173-b61b-4b24-b690-4b973c68b623 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:11.138271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1623173-b61b-4b24-b690-4b973c68b623 admin admin] PATH_INFO: `/v3/projects/217ac3dbbc814a3e997ceeb298a8af69` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:11.142093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1623173-b61b-4b24-b690-4b973c68b623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=217ac3dbbc814a3e997ceeb298a8af69)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:11.144824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1623173-b61b-4b24-b690-4b973c68b623 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:11.278955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c1623173-b61b-4b24-b690-4b973c68b623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '217ac3dbbc814a3e997ceeb298a8af69', 'request_id': 'req-c1623173-b61b-4b24-b690-4b973c68b623'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:11.301562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c1623173-b61b-4b24-b690-4b973c68b623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '217ac3dbbc814a3e997ceeb298a8af69', 'request_id': 'req-c1623173-b61b-4b24-b690-4b973c68b623'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:11.312344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c1623173-b61b-4b24-b690-4b973c68b623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '217ac3dbbc814a3e997ceeb298a8af69', 'request_id': 'req-c1623173-b61b-4b24-b690-4b973c68b623'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:11.345956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c1623173-b61b-4b24-b690-4b973c68b623 admin admin] The token cache is being invalidate because project 217ac3dbbc814a3e997ceeb298a8af69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:06:11.346244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c1623173-b61b-4b24-b690-4b973c68b623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:11.347332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c1623173-b61b-4b24-b690-4b973c68b623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:11.353239 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2670/5354] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:11 2022] DELETE /identity/v3/projects/217ac3dbbc814a3e997ceeb298a8af69 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:11.354400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d8d18-56a3-4a41-900d-c1b4eb7835f3 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:11.371315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d8d18-56a3-4a41-900d-c1b4eb7835f3 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:11.514264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fb397-3a55-4b5a-82fc-d86828448365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:11.515100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fb397-3a55-4b5a-82fc-d86828448365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:11.515489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fb397-3a55-4b5a-82fc-d86828448365 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:11.515871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fb397-3a55-4b5a-82fc-d86828448365 admin admin] PATH_INFO: `/v3/users/9444a3c19d9047e7a93a388527d0cff4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:11.528593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fb397-3a55-4b5a-82fc-d86828448365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9444a3c19d9047e7a93a388527d0cff4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:11.531254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fb397-3a55-4b5a-82fc-d86828448365 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:11.536209 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:11.677884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7a8fb397-3a55-4b5a-82fc-d86828448365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9444a3c19d9047e7a93a388527d0cff4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:11.683943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7a8fb397-3a55-4b5a-82fc-d86828448365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9444a3c19d9047e7a93a388527d0cff4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:11.703581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7a8fb397-3a55-4b5a-82fc-d86828448365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9444a3c19d9047e7a93a388527d0cff4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:11.779995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7a8fb397-3a55-4b5a-82fc-d86828448365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9444a3c19d9047e7a93a388527d0cff4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:11.801823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7a8fb397-3a55-4b5a-82fc-d86828448365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9444a3c19d9047e7a93a388527d0cff4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:11.847447 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2685/5355] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:06:11 2022] DELETE /identity/v3/users/9444a3c19d9047e7a93a388527d0cff4 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:12.008791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1623173-b61b-4b24-b690-4b973c68b623 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:12.012539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c1623173-b61b-4b24-b690-4b973c68b623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:12.047077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1623173-b61b-4b24-b690-4b973c68b623 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:12.261557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe09f6-1b74-4ef4-93f5-d18424a83be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:12.263958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe09f6-1b74-4ef4-93f5-d18424a83be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:12.264810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe09f6-1b74-4ef4-93f5-d18424a83be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:12.270254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe09f6-1b74-4ef4-93f5-d18424a83be4 admin admin] PATH_INFO: `/v3/projects/a43e3eaf929443a2956262ef4a4906b5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:12.276967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe09f6-1b74-4ef4-93f5-d18424a83be4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a43e3eaf929443a2956262ef4a4906b5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:12.281190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe09f6-1b74-4ef4-93f5-d18424a83be4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:12.503133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-17fe09f6-1b74-4ef4-93f5-d18424a83be4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a43e3eaf929443a2956262ef4a4906b5', 'request_id': 'req-17fe09f6-1b74-4ef4-93f5-d18424a83be4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:12.536430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-17fe09f6-1b74-4ef4-93f5-d18424a83be4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a43e3eaf929443a2956262ef4a4906b5', 'request_id': 'req-17fe09f6-1b74-4ef4-93f5-d18424a83be4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:12.541588 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:12.546855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-17fe09f6-1b74-4ef4-93f5-d18424a83be4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a43e3eaf929443a2956262ef4a4906b5', 'request_id': 'req-17fe09f6-1b74-4ef4-93f5-d18424a83be4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:12.579716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-17fe09f6-1b74-4ef4-93f5-d18424a83be4 admin admin] The token cache is being invalidate because project a43e3eaf929443a2956262ef4a4906b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:06:12.579716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-17fe09f6-1b74-4ef4-93f5-d18424a83be4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:12.579716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-17fe09f6-1b74-4ef4-93f5-d18424a83be4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:12.582593 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2671/5356] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:12 2022] DELETE /identity/v3/projects/a43e3eaf929443a2956262ef4a4906b5 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:12.587879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fb397-3a55-4b5a-82fc-d86828448365 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:12.589688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7a8fb397-3a55-4b5a-82fc-d86828448365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:12.633180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fb397-3a55-4b5a-82fc-d86828448365 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:12.773188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f014885-ed88-4dbb-a6eb-e9df60069f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:12.774936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f014885-ed88-4dbb-a6eb-e9df60069f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:12.775228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f014885-ed88-4dbb-a6eb-e9df60069f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:12.775500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f014885-ed88-4dbb-a6eb-e9df60069f20 admin admin] PATH_INFO: `/v3/users/16453adae92045d1aa5b3e2586f62308` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:12.778656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f014885-ed88-4dbb-a6eb-e9df60069f20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16453adae92045d1aa5b3e2586f62308)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:12.787933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f014885-ed88-4dbb-a6eb-e9df60069f20 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:12.920845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4f014885-ed88-4dbb-a6eb-e9df60069f20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16453adae92045d1aa5b3e2586f62308'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:12.922582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4f014885-ed88-4dbb-a6eb-e9df60069f20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16453adae92045d1aa5b3e2586f62308'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:12.946474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4f014885-ed88-4dbb-a6eb-e9df60069f20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16453adae92045d1aa5b3e2586f62308'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:12.968127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4f014885-ed88-4dbb-a6eb-e9df60069f20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16453adae92045d1aa5b3e2586f62308'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:12.992894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4f014885-ed88-4dbb-a6eb-e9df60069f20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16453adae92045d1aa5b3e2586f62308'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:13.019686 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2686/5357] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:06:12 2022] DELETE /identity/v3/users/16453adae92045d1aa5b3e2586f62308 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:13.424522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe09f6-1b74-4ef4-93f5-d18424a83be4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:13.427203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-17fe09f6-1b74-4ef4-93f5-d18424a83be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:13.451209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe09f6-1b74-4ef4-93f5-d18424a83be4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:13.571282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbb95a-52ea-49b2-abc4-0fbba80bc0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:13.572544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbb95a-52ea-49b2-abc4-0fbba80bc0f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:13.573028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbb95a-52ea-49b2-abc4-0fbba80bc0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:13.573654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbb95a-52ea-49b2-abc4-0fbba80bc0f7 admin admin] PATH_INFO: `/v3/projects/4572014ea4b34d90b58af5afe961d52a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:13.576188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbb95a-52ea-49b2-abc4-0fbba80bc0f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4572014ea4b34d90b58af5afe961d52a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:13.581381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbb95a-52ea-49b2-abc4-0fbba80bc0f7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:13.787575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72bbb95a-52ea-49b2-abc4-0fbba80bc0f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4572014ea4b34d90b58af5afe961d52a', 'request_id': 'req-72bbb95a-52ea-49b2-abc4-0fbba80bc0f7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:13.799331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72bbb95a-52ea-49b2-abc4-0fbba80bc0f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4572014ea4b34d90b58af5afe961d52a', 'request_id': 'req-72bbb95a-52ea-49b2-abc4-0fbba80bc0f7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:13.814244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72bbb95a-52ea-49b2-abc4-0fbba80bc0f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4572014ea4b34d90b58af5afe961d52a', 'request_id': 'req-72bbb95a-52ea-49b2-abc4-0fbba80bc0f7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:13.839372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72bbb95a-52ea-49b2-abc4-0fbba80bc0f7 admin admin] The token cache is being invalidate because project 4572014ea4b34d90b58af5afe961d52a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:06:13.839654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72bbb95a-52ea-49b2-abc4-0fbba80bc0f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:13.843906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72bbb95a-52ea-49b2-abc4-0fbba80bc0f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:13.849476 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2672/5358] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:13 2022] DELETE /identity/v3/projects/4572014ea4b34d90b58af5afe961d52a => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:13.851683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34755f-c4e3-4d75-ab16-2f8371782bed None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:13.852592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34755f-c4e3-4d75-ab16-2f8371782bed None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:13.853045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34755f-c4e3-4d75-ab16-2f8371782bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:13.866502 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:13.912529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1a34755f-c4e3-4d75-ab16-2f8371782bed None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:13.915783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1a34755f-c4e3-4d75-ab16-2f8371782bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:14.177175 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2687/5359] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:06:14.188495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ff112-23eb-4e58-9c06-185b88dae4a9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:14.188844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ff112-23eb-4e58-9c06-185b88dae4a9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:14.189081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ff112-23eb-4e58-9c06-185b88dae4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:14.238399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-047ff112-23eb-4e58-9c06-185b88dae4a9 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:14.239846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-047ff112-23eb-4e58-9c06-185b88dae4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:14.259183 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2673/5360] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:14.263839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34755f-c4e3-4d75-ab16-2f8371782bed None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:14.276258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34755f-c4e3-4d75-ab16-2f8371782bed None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:14.288955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0ed4a-5265-4298-8b9b-61f21e2d7542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:14.289759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0ed4a-5265-4298-8b9b-61f21e2d7542 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:14.290120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0ed4a-5265-4298-8b9b-61f21e2d7542 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:14.290663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0ed4a-5265-4298-8b9b-61f21e2d7542 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:14.305481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0ed4a-5265-4298-8b9b-61f21e2d7542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:06:14.305902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0ed4a-5265-4298-8b9b-61f21e2d7542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:14.308705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0ed4a-5265-4298-8b9b-61f21e2d7542 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:14.337457 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2688/5361] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:06:14.342366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ff112-23eb-4e58-9c06-185b88dae4a9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:14.379312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ff112-23eb-4e58-9c06-185b88dae4a9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:14.442908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bd8b7-1543-411c-b22f-40b98317b04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:14.444979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bd8b7-1543-411c-b22f-40b98317b04b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:14.457668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bd8b7-1543-411c-b22f-40b98317b04b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:14.458390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bd8b7-1543-411c-b22f-40b98317b04b admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:14.459740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bd8b7-1543-411c-b22f-40b98317b04b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:14.462139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bd8b7-1543-411c-b22f-40b98317b04b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:14.665267 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2674/5362] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:06:14 2022] POST /identity/v3/projects => generated 367 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:14.669327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0ed4a-5265-4298-8b9b-61f21e2d7542 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:14.683833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0ed4a-5265-4298-8b9b-61f21e2d7542 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:14.963512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888faaa-11f7-431f-b57c-48eb8e0065a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:14.967401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888faaa-11f7-431f-b57c-48eb8e0065a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:14.968672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888faaa-11f7-431f-b57c-48eb8e0065a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:14.971644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888faaa-11f7-431f-b57c-48eb8e0065a5 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:14.974051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888faaa-11f7-431f-b57c-48eb8e0065a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:14.982868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888faaa-11f7-431f-b57c-48eb8e0065a5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:15.130571 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2689/5363] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:06:14 2022] POST /identity/v3/users => generated 284 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:15.132440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bd8b7-1543-411c-b22f-40b98317b04b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:15.154214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bd8b7-1543-411c-b22f-40b98317b04b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:15.169050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6caf1f-f2ef-40e0-828f-d24f14108d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:15.237317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6caf1f-f2ef-40e0-828f-d24f14108d5c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:15.238139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6caf1f-f2ef-40e0-828f-d24f14108d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:15.242346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6caf1f-f2ef-40e0-828f-d24f14108d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:15.244522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6caf1f-f2ef-40e0-828f-d24f14108d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:15.246880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6caf1f-f2ef-40e0-828f-d24f14108d5c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:15.276845 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2675/5364] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:15.280859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888faaa-11f7-431f-b57c-48eb8e0065a5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:15.296664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888faaa-11f7-431f-b57c-48eb8e0065a5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:15.337940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010c14b-b47b-4832-9bfb-f5c2fd5332d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:15.338565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010c14b-b47b-4832-9bfb-f5c2fd5332d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:15.338838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010c14b-b47b-4832-9bfb-f5c2fd5332d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:15.339106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010c14b-b47b-4832-9bfb-f5c2fd5332d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:15.344168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010c14b-b47b-4832-9bfb-f5c2fd5332d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:15.356378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010c14b-b47b-4832-9bfb-f5c2fd5332d5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:15.409088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6caf1f-f2ef-40e0-828f-d24f14108d5c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:15.424520 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2690/5365] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:15.432313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6caf1f-f2ef-40e0-828f-d24f14108d5c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:15.462490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010c14b-b47b-4832-9bfb-f5c2fd5332d5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:15.464544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0010c14b-b47b-4832-9bfb-f5c2fd5332d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:15.465410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6079d1-83c5-47d6-95a2-a30417335b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:15.486151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6079d1-83c5-47d6-95a2-a30417335b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:15.486468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6079d1-83c5-47d6-95a2-a30417335b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:15.486751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6079d1-83c5-47d6-95a2-a30417335b2a admin admin] PATH_INFO: `/v3/projects/4580aaa08e8f4c639065e51a85e57b18/users/b3b7f10db07a46f8b7dd44dfa24516e1/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:15.515433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010c14b-b47b-4832-9bfb-f5c2fd5332d5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:15.548810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdd1ac-c0de-47de-bd2c-98356ba80667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:15.549609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdd1ac-c0de-47de-bd2c-98356ba80667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:15.549989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdd1ac-c0de-47de-bd2c-98356ba80667 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:15.550362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdd1ac-c0de-47de-bd2c-98356ba80667 admin admin] PATH_INFO: `/v3/projects/7a926c017fe547b9a90494e8ba909468` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:15.552775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fdd1ac-c0de-47de-bd2c-98356ba80667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a926c017fe547b9a90494e8ba909468)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:15.554900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fdd1ac-c0de-47de-bd2c-98356ba80667 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:15.609153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6079d1-83c5-47d6-95a2-a30417335b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4580aaa08e8f4c639065e51a85e57b18, user_id=b3b7f10db07a46f8b7dd44dfa24516e1, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:15.622366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6079d1-83c5-47d6-95a2-a30417335b2a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:15.695020 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2676/5366] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:15 2022] PUT /identity/v3/projects/4580aaa08e8f4c639065e51a85e57b18/users/b3b7f10db07a46f8b7dd44dfa24516e1/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:15.697120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-78fdd1ac-c0de-47de-bd2c-98356ba80667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a926c017fe547b9a90494e8ba909468', 'request_id': 'req-78fdd1ac-c0de-47de-bd2c-98356ba80667'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:15.716800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af497e5a-0b1e-4ece-bea2-f2d79dcbd0be None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:15.717510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af497e5a-0b1e-4ece-bea2-f2d79dcbd0be None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:15.721359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af497e5a-0b1e-4ece-bea2-f2d79dcbd0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:15.721883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-78fdd1ac-c0de-47de-bd2c-98356ba80667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a926c017fe547b9a90494e8ba909468', 'request_id': 'req-78fdd1ac-c0de-47de-bd2c-98356ba80667'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:15.732166 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:15.737665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-78fdd1ac-c0de-47de-bd2c-98356ba80667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a926c017fe547b9a90494e8ba909468', 'request_id': 'req-78fdd1ac-c0de-47de-bd2c-98356ba80667'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:15.780391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-78fdd1ac-c0de-47de-bd2c-98356ba80667 admin admin] The token cache is being invalidate because project 7a926c017fe547b9a90494e8ba909468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:06:15.783155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-78fdd1ac-c0de-47de-bd2c-98356ba80667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:15.788078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-78fdd1ac-c0de-47de-bd2c-98356ba80667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:15.797960 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2691/5367] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:15 2022] DELETE /identity/v3/projects/7a926c017fe547b9a90494e8ba909468 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:15.799455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23283b-c333-4e96-ad47-6b5970c82738 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:15.799789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23283b-c333-4e96-ad47-6b5970c82738 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:15.800044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23283b-c333-4e96-ad47-6b5970c82738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:15.869316 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:15.878671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ab23283b-c333-4e96-ad47-6b5970c82738 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:15.891196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ab23283b-c333-4e96-ad47-6b5970c82738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:15.902299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-af497e5a-0b1e-4ece-bea2-f2d79dcbd0be None None] MFA Rules not processed for user `b3b7f10db07a46f8b7dd44dfa24516e1`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:15.905003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-af497e5a-0b1e-4ece-bea2-f2d79dcbd0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:16.137181 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2692/5368] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:16.150910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdf2da-23d2-45bb-b307-4688b7e4ab89 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:16.151328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdf2da-23d2-45bb-b307-4688b7e4ab89 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:16.151705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdf2da-23d2-45bb-b307-4688b7e4ab89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:16.211921 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2677/5369] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:16.217591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af497e5a-0b1e-4ece-bea2-f2d79dcbd0be None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:16.219040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a6bdf2da-23d2-45bb-b307-4688b7e4ab89 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:16.223179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-af497e5a-0b1e-4ece-bea2-f2d79dcbd0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:16.225526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a6bdf2da-23d2-45bb-b307-4688b7e4ab89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:16.291173 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2693/5370] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:06:16.302241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdf2da-23d2-45bb-b307-4688b7e4ab89 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:16.329689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af497e5a-0b1e-4ece-bea2-f2d79dcbd0be None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:16.333804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdf2da-23d2-45bb-b307-4688b7e4ab89 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:16.363152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea820b6-f19c-4e20-ae98-e1f5bbc1957f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:16.365657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea820b6-f19c-4e20-ae98-e1f5bbc1957f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:16.366980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea820b6-f19c-4e20-ae98-e1f5bbc1957f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:16.367490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea820b6-f19c-4e20-ae98-e1f5bbc1957f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:16.367720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b6b16-22c5-404d-983b-13021cad1a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:16.368545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b6b16-22c5-404d-983b-13021cad1a48 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:16.368704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea820b6-f19c-4e20-ae98-e1f5bbc1957f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:16.369195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b6b16-22c5-404d-983b-13021cad1a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:16.369653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b6b16-22c5-404d-983b-13021cad1a48 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:16.370493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b6b16-22c5-404d-983b-13021cad1a48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:06:16.370982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b6b16-22c5-404d-983b-13021cad1a48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:16.372944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b6b16-22c5-404d-983b-13021cad1a48 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:16.378648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea820b6-f19c-4e20-ae98-e1f5bbc1957f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:16.468155 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2678/5371] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:06:16 2022] POST /identity/v3/projects => generated 367 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:16.471270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea820b6-f19c-4e20-ae98-e1f5bbc1957f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:16.548464 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2694/5372] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:06:16.557625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b6b16-22c5-404d-983b-13021cad1a48 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:16.598295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b6b16-22c5-404d-983b-13021cad1a48 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:16.738322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea820b6-f19c-4e20-ae98-e1f5bbc1957f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:16.758884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce75a53-867b-46e2-ae07-ec34b94e3a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:16.759577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce75a53-867b-46e2-ae07-ec34b94e3a4e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:16.759861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce75a53-867b-46e2-ae07-ec34b94e3a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:16.760137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce75a53-867b-46e2-ae07-ec34b94e3a4e admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:16.761050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce75a53-867b-46e2-ae07-ec34b94e3a4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:16.779180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce75a53-867b-46e2-ae07-ec34b94e3a4e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:16.830695 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2679/5373] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:06:16 2022] POST /identity/v3/users => generated 290 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:16.840095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37732c4b-ed73-417e-8be7-e6b68eb06533 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:16.840377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37732c4b-ed73-417e-8be7-e6b68eb06533 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:16.840670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37732c4b-ed73-417e-8be7-e6b68eb06533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:16.944019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735961f-23ce-474c-88ab-55ab14b8177f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:16.944834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735961f-23ce-474c-88ab-55ab14b8177f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:16.945113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735961f-23ce-474c-88ab-55ab14b8177f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:16.945386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735961f-23ce-474c-88ab-55ab14b8177f admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:16.946008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735961f-23ce-474c-88ab-55ab14b8177f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:16.947941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735961f-23ce-474c-88ab-55ab14b8177f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:17.010911 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2695/5374] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:06:16 2022] POST /identity/v3/projects => generated 383 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:17.012119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735961f-23ce-474c-88ab-55ab14b8177f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:17.018647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-37732c4b-ed73-417e-8be7-e6b68eb06533 None None] MFA Rules not processed for user `5d7b6aad22ea44aeb1f56654111c4b22`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:17.019917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-37732c4b-ed73-417e-8be7-e6b68eb06533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:17.151944 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:17.154930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735961f-23ce-474c-88ab-55ab14b8177f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:17.165920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad20ee-ca80-4dbc-a4ed-dd9e108b8857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:17.169350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad20ee-ca80-4dbc-a4ed-dd9e108b8857 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:17.169634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad20ee-ca80-4dbc-a4ed-dd9e108b8857 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:17.169905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad20ee-ca80-4dbc-a4ed-dd9e108b8857 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:17.170953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad20ee-ca80-4dbc-a4ed-dd9e108b8857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:17.172373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad20ee-ca80-4dbc-a4ed-dd9e108b8857 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:17.203345 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2696/5375] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:17.204251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad20ee-ca80-4dbc-a4ed-dd9e108b8857 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:17.214512 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:17.224301 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2680/5376] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:17.225904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37732c4b-ed73-417e-8be7-e6b68eb06533 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:17.235533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad20ee-ca80-4dbc-a4ed-dd9e108b8857 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:17.247790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3850da-2aa7-4a5b-a981-1721899ea9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:17.248424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3850da-2aa7-4a5b-a981-1721899ea9b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:17.248732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3850da-2aa7-4a5b-a981-1721899ea9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:17.249006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3850da-2aa7-4a5b-a981-1721899ea9b8 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:17.249660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3850da-2aa7-4a5b-a981-1721899ea9b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:17.251556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3850da-2aa7-4a5b-a981-1721899ea9b8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:17.262238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37732c4b-ed73-417e-8be7-e6b68eb06533 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:17.276564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769a5d1-7a98-4848-bb93-1ece21ad130a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:17.277729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769a5d1-7a98-4848-bb93-1ece21ad130a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:17.278391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769a5d1-7a98-4848-bb93-1ece21ad130a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:17.278835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769a5d1-7a98-4848-bb93-1ece21ad130a admin admin] PATH_INFO: `/v3/projects/6207265b75b44a8f818c5b9dd448575a/users/5c93e2e4074d42a8a1b91ab218fa8ae0/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:17.296765 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2697/5377] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:06:17 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:17.300521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3850da-2aa7-4a5b-a981-1721899ea9b8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:17.305628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dd3850da-2aa7-4a5b-a981-1721899ea9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:17.319921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769a5d1-7a98-4848-bb93-1ece21ad130a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6207265b75b44a8f818c5b9dd448575a, user_id=5c93e2e4074d42a8a1b91ab218fa8ae0, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:17.322608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769a5d1-7a98-4848-bb93-1ece21ad130a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:17.377626 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2681/5378] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:17 2022] PUT /identity/v3/projects/6207265b75b44a8f818c5b9dd448575a/users/5c93e2e4074d42a8a1b91ab218fa8ae0/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:17.380401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769a5d1-7a98-4848-bb93-1ece21ad130a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:17.513426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3850da-2aa7-4a5b-a981-1721899ea9b8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:17.599264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769a5d1-7a98-4848-bb93-1ece21ad130a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:17.611618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6031bc-a726-4d35-b648-4d99ac59ab18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:17.612257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6031bc-a726-4d35-b648-4d99ac59ab18 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:17.612539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6031bc-a726-4d35-b648-4d99ac59ab18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:17.613784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6031bc-a726-4d35-b648-4d99ac59ab18 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:17.615802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6031bc-a726-4d35-b648-4d99ac59ab18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:17.630135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6031bc-a726-4d35-b648-4d99ac59ab18 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:17.675401 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2682/5379] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:17.676508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6031bc-a726-4d35-b648-4d99ac59ab18 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:17.685962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46037d74-a18e-40af-842c-b3dcd92a3412 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:17.693046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46037d74-a18e-40af-842c-b3dcd92a3412 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:17.693355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46037d74-a18e-40af-842c-b3dcd92a3412 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:17.696803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46037d74-a18e-40af-842c-b3dcd92a3412 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:17.710256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6031bc-a726-4d35-b648-4d99ac59ab18 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:17.742686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc496e3c-4da0-4f25-9e4d-13338ca1dfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:17.743317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc496e3c-4da0-4f25-9e4d-13338ca1dfea admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:17.743597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc496e3c-4da0-4f25-9e4d-13338ca1dfea admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:17.743874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc496e3c-4da0-4f25-9e4d-13338ca1dfea admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:17.752705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc496e3c-4da0-4f25-9e4d-13338ca1dfea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:17.764590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc496e3c-4da0-4f25-9e4d-13338ca1dfea admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:17.817849 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2683/5380] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:17.824243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc496e3c-4da0-4f25-9e4d-13338ca1dfea admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:17.857641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc496e3c-4da0-4f25-9e4d-13338ca1dfea admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:17.878164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab1bd1-80c6-4c81-9a2c-9ddb63c6a70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:17.878718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab1bd1-80c6-4c81-9a2c-9ddb63c6a70e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:17.879002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab1bd1-80c6-4c81-9a2c-9ddb63c6a70e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:17.882987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab1bd1-80c6-4c81-9a2c-9ddb63c6a70e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:17.883713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab1bd1-80c6-4c81-9a2c-9ddb63c6a70e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:17.885411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab1bd1-80c6-4c81-9a2c-9ddb63c6a70e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:17.944075 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2684/5381] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:17.945434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab1bd1-80c6-4c81-9a2c-9ddb63c6a70e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:17.958550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46037d74-a18e-40af-842c-b3dcd92a3412 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:17.960223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46037d74-a18e-40af-842c-b3dcd92a3412 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:17.987598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab1bd1-80c6-4c81-9a2c-9ddb63c6a70e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:18.000109 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2698/5382] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:06:18.003669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46037d74-a18e-40af-842c-b3dcd92a3412 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:18.012361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60136f3-1bba-4abe-b3b5-7e30bec7fbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:18.015227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60136f3-1bba-4abe-b3b5-7e30bec7fbb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:18.015522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60136f3-1bba-4abe-b3b5-7e30bec7fbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:18.015804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60136f3-1bba-4abe-b3b5-7e30bec7fbb9 admin admin] PATH_INFO: `/v3/projects/6207265b75b44a8f818c5b9dd448575a/users/5c93e2e4074d42a8a1b91ab218fa8ae0/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:18.025959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60136f3-1bba-4abe-b3b5-7e30bec7fbb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6207265b75b44a8f818c5b9dd448575a, user_id=5c93e2e4074d42a8a1b91ab218fa8ae0, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:18.033077 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:18.038973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60136f3-1bba-4abe-b3b5-7e30bec7fbb9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:18.057431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46037d74-a18e-40af-842c-b3dcd92a3412 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:18.083085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05bd22-9214-4551-95f0-7de47701630b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:18.083773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05bd22-9214-4551-95f0-7de47701630b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:18.084070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05bd22-9214-4551-95f0-7de47701630b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:18.084893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05bd22-9214-4551-95f0-7de47701630b admin admin] PATH_INFO: `/v3/projects/d7e428258bb647b8af427e73b89feade/users/59042296e6904e7aafe95af041b768bc/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:18.099944 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2685/5383] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:17 2022] PUT /identity/v3/projects/6207265b75b44a8f818c5b9dd448575a/users/5c93e2e4074d42a8a1b91ab218fa8ae0/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:18.104999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf65d14-d4dc-4306-98d5-dc574f0532c7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:18.105373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf65d14-d4dc-4306-98d5-dc574f0532c7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:18.105575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf65d14-d4dc-4306-98d5-dc574f0532c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:18.166560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05bd22-9214-4551-95f0-7de47701630b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e428258bb647b8af427e73b89feade, user_id=59042296e6904e7aafe95af041b768bc, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:18.170490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05bd22-9214-4551-95f0-7de47701630b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:18.211515 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2699/5384] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:18 2022] PUT /identity/v3/projects/d7e428258bb647b8af427e73b89feade/users/59042296e6904e7aafe95af041b768bc/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:18.230380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ea160-5859-4810-be8a-7b6e320c21d5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:18.230380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ea160-5859-4810-be8a-7b6e320c21d5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:18.232055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ea160-5859-4810-be8a-7b6e320c21d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:18.242152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-aaf65d14-d4dc-4306-98d5-dc574f0532c7 None None] MFA Rules not processed for user `5c93e2e4074d42a8a1b91ab218fa8ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:18.244632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aaf65d14-d4dc-4306-98d5-dc574f0532c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:18.356412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-616ea160-5859-4810-be8a-7b6e320c21d5 None None] MFA Rules not processed for user `59042296e6904e7aafe95af041b768bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:18.357685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-616ea160-5859-4810-be8a-7b6e320c21d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:18.560190 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2686/5385] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:18.564732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf65d14-d4dc-4306-98d5-dc574f0532c7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:18.616190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf65d14-d4dc-4306-98d5-dc574f0532c7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:18.627837 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2700/5386] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:06:18.640727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ea160-5859-4810-be8a-7b6e320c21d5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:18.648879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b40c8-746b-466b-8cdd-24508bba6326 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c93e2e4074d42a8a1b91ab218fa8ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6207265b75b44a8f818c5b9dd448575a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:18.650722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b40c8-746b-466b-8cdd-24508bba6326 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:18.657331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b40c8-746b-466b-8cdd-24508bba6326 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:18.657331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b40c8-746b-466b-8cdd-24508bba6326 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] PATH_INFO: `/v3/policies` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:18.665502 n-d-master-1 devstack@keystone.service[82080]: WARNING oslo_log.versionutils [None req-098b40c8-746b-466b-8cdd-24508bba6326 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 30 10:06:18.666268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b40c8-746b-466b-8cdd-24508bba6326 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:18.668803 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-098b40c8-746b-466b-8cdd-24508bba6326 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:06:18.668803 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:06:18.668803 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:06:18.674916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b40c8-746b-466b-8cdd-24508bba6326 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:18.754195 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2687/5387] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Sep 30 10:06:18 2022] POST /identity/v3/policies => generated 229 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:18.755638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b40c8-746b-466b-8cdd-24508bba6326 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:18.794188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b40c8-746b-466b-8cdd-24508bba6326 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:18.808317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6310a-af07-416a-8093-1a6395b7662c tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c93e2e4074d42a8a1b91ab218fa8ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6207265b75b44a8f818c5b9dd448575a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:18.812556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6310a-af07-416a-8093-1a6395b7662c tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:18.814193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6310a-af07-416a-8093-1a6395b7662c tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:18.814699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6310a-af07-416a-8093-1a6395b7662c tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] PATH_INFO: `/v3/policies/d06ae315105a4206bdeaa759c9215d31` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:18.817055 n-d-master-1 devstack@keystone.service[82080]: WARNING oslo_log.versionutils [None req-1be6310a-af07-416a-8093-1a6395b7662c tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 30 10:06:18.819877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6310a-af07-416a-8093-1a6395b7662c tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=d06ae315105a4206bdeaa759c9215d31)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:18.822663 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-1be6310a-af07-416a-8093-1a6395b7662c tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:06:18.822663 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:06:18.822663 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:06:18.830925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6310a-af07-416a-8093-1a6395b7662c tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:18.853089 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:18.888893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ea160-5859-4810-be8a-7b6e320c21d5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:18.898281 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2688/5388] 10.222.0.16 () {60 vars in 1252 bytes} [Fri Sep 30 10:06:18 2022] PATCH /identity/v3/policies/d06ae315105a4206bdeaa759c9215d31 => generated 234 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:06:18.902949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6310a-af07-416a-8093-1a6395b7662c tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:18.910539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464e5c6-c3ae-4360-87f2-8bfc989e78d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:18.925323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464e5c6-c3ae-4360-87f2-8bfc989e78d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:18.925708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464e5c6-c3ae-4360-87f2-8bfc989e78d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:18.925987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464e5c6-c3ae-4360-87f2-8bfc989e78d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:18.926680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464e5c6-c3ae-4360-87f2-8bfc989e78d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:18.940635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464e5c6-c3ae-4360-87f2-8bfc989e78d9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:18.944924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6310a-af07-416a-8093-1a6395b7662c tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:18.964088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8ac3e-16e5-4404-ae5d-4d5fd13aead0 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c93e2e4074d42a8a1b91ab218fa8ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6207265b75b44a8f818c5b9dd448575a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:18.966007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8ac3e-16e5-4404-ae5d-4d5fd13aead0 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:18.967228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8ac3e-16e5-4404-ae5d-4d5fd13aead0 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:18.969004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8ac3e-16e5-4404-ae5d-4d5fd13aead0 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] PATH_INFO: `/v3/policies/d06ae315105a4206bdeaa759c9215d31` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:18.969978 n-d-master-1 devstack@keystone.service[82080]: WARNING oslo_log.versionutils [None req-bcb8ac3e-16e5-4404-ae5d-4d5fd13aead0 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 30 10:06:18.971398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8ac3e-16e5-4404-ae5d-4d5fd13aead0 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=d06ae315105a4206bdeaa759c9215d31)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:18.974928 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-bcb8ac3e-16e5-4404-ae5d-4d5fd13aead0 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:06:18.974928 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:06:18.974928 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:06:18.978414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8ac3e-16e5-4404-ae5d-4d5fd13aead0 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:18.998129 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2689/5389] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:06:18 2022] GET /identity/v3/policies/d06ae315105a4206bdeaa759c9215d31 => generated 234 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:06:19.003153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8ac3e-16e5-4404-ae5d-4d5fd13aead0 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:19.027547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8ac3e-16e5-4404-ae5d-4d5fd13aead0 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:19.036076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c3a01-439d-4079-9368-9486c5f5abdf tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c93e2e4074d42a8a1b91ab218fa8ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6207265b75b44a8f818c5b9dd448575a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:19.037285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c3a01-439d-4079-9368-9486c5f5abdf tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:19.040967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c3a01-439d-4079-9368-9486c5f5abdf tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:19.041469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c3a01-439d-4079-9368-9486c5f5abdf tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] PATH_INFO: `/v3/policies/d06ae315105a4206bdeaa759c9215d31` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:19.042498 n-d-master-1 devstack@keystone.service[82080]: WARNING oslo_log.versionutils [None req-1c0c3a01-439d-4079-9368-9486c5f5abdf tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 30 10:06:19.043167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c3a01-439d-4079-9368-9486c5f5abdf tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=d06ae315105a4206bdeaa759c9215d31)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:19.044490 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-1c0c3a01-439d-4079-9368-9486c5f5abdf tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:06:19.044490 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:06:19.044490 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:06:19.052280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c3a01-439d-4079-9368-9486c5f5abdf tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:19.054703 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2701/5390] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:06:18 2022] POST /identity/v3/projects => generated 383 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:19.060766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464e5c6-c3ae-4360-87f2-8bfc989e78d9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:19.089521 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2690/5391] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:19 2022] DELETE /identity/v3/policies/d06ae315105a4206bdeaa759c9215d31 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:06:19.097547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c3a01-439d-4079-9368-9486c5f5abdf tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:19.130898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c3a01-439d-4079-9368-9486c5f5abdf tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:19.258133 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:19.282471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464e5c6-c3ae-4360-87f2-8bfc989e78d9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:19.296113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fdb1b-cacf-4591-ac0e-c76949aaa511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:19.297132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fdb1b-cacf-4591-ac0e-c76949aaa511 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:19.297770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fdb1b-cacf-4591-ac0e-c76949aaa511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:19.298869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fdb1b-cacf-4591-ac0e-c76949aaa511 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:19.301321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6fdb1b-cacf-4591-ac0e-c76949aaa511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:19.307785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6fdb1b-cacf-4591-ac0e-c76949aaa511 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:19.357765 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2702/5392] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:06:19 2022] POST /identity/v3/users => generated 298 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:19.361698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fdb1b-cacf-4591-ac0e-c76949aaa511 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:19.374306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebf572-8166-49ca-a51a-4290cab21f20 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c93e2e4074d42a8a1b91ab218fa8ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6207265b75b44a8f818c5b9dd448575a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:19.376581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebf572-8166-49ca-a51a-4290cab21f20 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:19.377022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebf572-8166-49ca-a51a-4290cab21f20 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:19.377406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebf572-8166-49ca-a51a-4290cab21f20 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] PATH_INFO: `/v3/policies` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:19.383259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebf572-8166-49ca-a51a-4290cab21f20 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:19.389845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebf572-8166-49ca-a51a-4290cab21f20 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:19.404906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fdb1b-cacf-4591-ac0e-c76949aaa511 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:19.418654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed05cda-9d6e-4bba-931f-a412bbef092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:19.423770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed05cda-9d6e-4bba-931f-a412bbef092b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:19.424287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed05cda-9d6e-4bba-931f-a412bbef092b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:19.426162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed05cda-9d6e-4bba-931f-a412bbef092b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:19.429113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed05cda-9d6e-4bba-931f-a412bbef092b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:19.437276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed05cda-9d6e-4bba-931f-a412bbef092b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:19.446625 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2691/5393] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Sep 30 10:06:19 2022] POST /identity/v3/policies => generated 227 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:19.449395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebf572-8166-49ca-a51a-4290cab21f20 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:19.485115 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2703/5394] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:19.489411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed05cda-9d6e-4bba-931f-a412bbef092b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:19.495131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebf572-8166-49ca-a51a-4290cab21f20 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:19.526115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed05cda-9d6e-4bba-931f-a412bbef092b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:19.526671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d611ca2-d74e-4efa-afee-93498ed83020 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c93e2e4074d42a8a1b91ab218fa8ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6207265b75b44a8f818c5b9dd448575a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:19.527581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d611ca2-d74e-4efa-afee-93498ed83020 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:19.528111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d611ca2-d74e-4efa-afee-93498ed83020 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:19.528656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d611ca2-d74e-4efa-afee-93498ed83020 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] PATH_INFO: `/v3/policies` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:19.530064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d611ca2-d74e-4efa-afee-93498ed83020 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:19.534778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d611ca2-d74e-4efa-afee-93498ed83020 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:19.540472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca8464-2c54-42b2-8fae-d19dffaf011e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:19.541174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca8464-2c54-42b2-8fae-d19dffaf011e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:19.541450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca8464-2c54-42b2-8fae-d19dffaf011e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:19.541719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca8464-2c54-42b2-8fae-d19dffaf011e admin admin] PATH_INFO: `/v3/projects/7676de16739049259383ae3f3b4a33e7/users/5e90569599844297a51235fe4a8f9318/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:19.591248 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2692/5395] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Sep 30 10:06:19 2022] POST /identity/v3/policies => generated 229 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:19.591477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca8464-2c54-42b2-8fae-d19dffaf011e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7676de16739049259383ae3f3b4a33e7, user_id=5e90569599844297a51235fe4a8f9318, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:19.593808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d611ca2-d74e-4efa-afee-93498ed83020 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:19.605079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca8464-2c54-42b2-8fae-d19dffaf011e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:19.639935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d611ca2-d74e-4efa-afee-93498ed83020 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:19.643324 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2704/5396] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:19 2022] PUT /identity/v3/projects/7676de16739049259383ae3f3b4a33e7/users/5e90569599844297a51235fe4a8f9318/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:19.644921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca8464-2c54-42b2-8fae-d19dffaf011e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:19.935310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca8464-2c54-42b2-8fae-d19dffaf011e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:19.942621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6de7c-42f6-4912-9214-29dc472bfa29 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c93e2e4074d42a8a1b91ab218fa8ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6207265b75b44a8f818c5b9dd448575a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:19.943413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d63403-ec05-4bef-99fa-cc4aee078e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:19.944843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d63403-ec05-4bef-99fa-cc4aee078e33 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:19.945346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d63403-ec05-4bef-99fa-cc4aee078e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:19.945794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6de7c-42f6-4912-9214-29dc472bfa29 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:19.946043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d63403-ec05-4bef-99fa-cc4aee078e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:19.946987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d63403-ec05-4bef-99fa-cc4aee078e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:19.947414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6de7c-42f6-4912-9214-29dc472bfa29 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:19.947800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6de7c-42f6-4912-9214-29dc472bfa29 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] PATH_INFO: `/v3/policies` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:19.949734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d63403-ec05-4bef-99fa-cc4aee078e33 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:19.953567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6de7c-42f6-4912-9214-29dc472bfa29 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:19.956854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6de7c-42f6-4912-9214-29dc472bfa29 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:19.967763 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2705/5397] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:06:19.972416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d63403-ec05-4bef-99fa-cc4aee078e33 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:20.005812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d63403-ec05-4bef-99fa-cc4aee078e33 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:20.017302 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2693/5398] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Sep 30 10:06:19 2022] POST /identity/v3/policies => generated 229 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:20.018684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082fe32-01ed-4107-9fdd-569baa1f4f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:20.020136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6de7c-42f6-4912-9214-29dc472bfa29 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:20.021118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082fe32-01ed-4107-9fdd-569baa1f4f2d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:20.021713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082fe32-01ed-4107-9fdd-569baa1f4f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:20.025147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082fe32-01ed-4107-9fdd-569baa1f4f2d admin admin] PATH_INFO: `/v3/projects/7676de16739049259383ae3f3b4a33e7/users/5e90569599844297a51235fe4a8f9318/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:20.031875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082fe32-01ed-4107-9fdd-569baa1f4f2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7676de16739049259383ae3f3b4a33e7, user_id=5e90569599844297a51235fe4a8f9318, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:20.039672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082fe32-01ed-4107-9fdd-569baa1f4f2d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:20.053836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6de7c-42f6-4912-9214-29dc472bfa29 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:20.074409 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2706/5399] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:19 2022] PUT /identity/v3/projects/7676de16739049259383ae3f3b4a33e7/users/5e90569599844297a51235fe4a8f9318/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:20.088426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde61a66-dca0-43ef-b53f-aae320614da4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:20.089059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde61a66-dca0-43ef-b53f-aae320614da4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:20.089506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde61a66-dca0-43ef-b53f-aae320614da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:20.153493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cde61a66-dca0-43ef-b53f-aae320614da4 None None] MFA Rules not processed for user `5e90569599844297a51235fe4a8f9318`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:20.154976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cde61a66-dca0-43ef-b53f-aae320614da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:20.173755 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:UPDATE=1,keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:20.204924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0405d1b-ac84-4781-adaf-44a5834890b4 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c93e2e4074d42a8a1b91ab218fa8ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6207265b75b44a8f818c5b9dd448575a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:20.205673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0405d1b-ac84-4781-adaf-44a5834890b4 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:20.206201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0405d1b-ac84-4781-adaf-44a5834890b4 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:20.206590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0405d1b-ac84-4781-adaf-44a5834890b4 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] PATH_INFO: `/v3/policies` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:20.209934 n-d-master-1 devstack@keystone.service[82080]: WARNING oslo_log.versionutils [None req-a0405d1b-ac84-4781-adaf-44a5834890b4 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 30 10:06:20.210670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0405d1b-ac84-4781-adaf-44a5834890b4 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:20.213391 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-a0405d1b-ac84-4781-adaf-44a5834890b4 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:06:20.213391 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:06:20.213391 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:06:20.214912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0405d1b-ac84-4781-adaf-44a5834890b4 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:20.230287 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2694/5400] 10.222.0.16 () {58 vars in 1131 bytes} [Fri Sep 30 10:06:20 2022] GET /identity/v3/policies => generated 761 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:06:20.238577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0405d1b-ac84-4781-adaf-44a5834890b4 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:20.278162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0405d1b-ac84-4781-adaf-44a5834890b4 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:20.286110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062da9e-da4f-4f74-a7d7-9881adad1817 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c93e2e4074d42a8a1b91ab218fa8ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6207265b75b44a8f818c5b9dd448575a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:20.289447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062da9e-da4f-4f74-a7d7-9881adad1817 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:20.290257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062da9e-da4f-4f74-a7d7-9881adad1817 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:20.290640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062da9e-da4f-4f74-a7d7-9881adad1817 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] PATH_INFO: `/v3/policies/e00f5e67e5294690a8c3b09e1ca90497` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:20.291858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062da9e-da4f-4f74-a7d7-9881adad1817 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=e00f5e67e5294690a8c3b09e1ca90497)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:20.294363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062da9e-da4f-4f74-a7d7-9881adad1817 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:20.335169 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2707/5401] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:20.337593 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2695/5402] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:20 2022] DELETE /identity/v3/policies/e00f5e67e5294690a8c3b09e1ca90497 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:20.341827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde61a66-dca0-43ef-b53f-aae320614da4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:20.363309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde61a66-dca0-43ef-b53f-aae320614da4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:20.385548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bb63d-0994-4eea-8583-27f834bc30c0 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c93e2e4074d42a8a1b91ab218fa8ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6207265b75b44a8f818c5b9dd448575a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:20.399839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bb63d-0994-4eea-8583-27f834bc30c0 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:20.399839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bb63d-0994-4eea-8583-27f834bc30c0 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:20.399839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bb63d-0994-4eea-8583-27f834bc30c0 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] PATH_INFO: `/v3/policies/f81d6f2f07854f08bcb67c5ecf83ebcc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:20.399839 n-d-master-1 devstack@keystone.service[82079]: WARNING oslo_log.versionutils [None req-fa4bb63d-0994-4eea-8583-27f834bc30c0 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 30 10:06:20.399839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bb63d-0994-4eea-8583-27f834bc30c0 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=f81d6f2f07854f08bcb67c5ecf83ebcc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:20.403284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062da9e-da4f-4f74-a7d7-9881adad1817 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:20.407342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7062da9e-da4f-4f74-a7d7-9881adad1817 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:20.410605 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-fa4bb63d-0994-4eea-8583-27f834bc30c0 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:06:20.410605 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:06:20.410605 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:06:20.415980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bb63d-0994-4eea-8583-27f834bc30c0 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:20.457181 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:20.468808 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2708/5403] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:20 2022] DELETE /identity/v3/policies/f81d6f2f07854f08bcb67c5ecf83ebcc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:06:20.471149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9baf7-cc02-49e6-b949-2e970ec94b99 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:20.472866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9baf7-cc02-49e6-b949-2e970ec94b99 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:20.475163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9baf7-cc02-49e6-b949-2e970ec94b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:20.591358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-afb9baf7-cc02-49e6-b949-2e970ec94b99 None None] MFA Rules not processed for user `5d7b6aad22ea44aeb1f56654111c4b22`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:20.599426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-afb9baf7-cc02-49e6-b949-2e970ec94b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:20.659855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062da9e-da4f-4f74-a7d7-9881adad1817 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:20.675207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8449f-b29c-4470-aa1d-054413f4e3c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:20.678061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8449f-b29c-4470-aa1d-054413f4e3c8 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:20.680828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8449f-b29c-4470-aa1d-054413f4e3c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:20.681744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8449f-b29c-4470-aa1d-054413f4e3c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:20.813641 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2709/5404] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:20.816318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9baf7-cc02-49e6-b949-2e970ec94b99 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:20.838839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8449f-b29c-4470-aa1d-054413f4e3c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:20.846811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8449f-b29c-4470-aa1d-054413f4e3c8 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:20.860543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9baf7-cc02-49e6-b949-2e970ec94b99 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:20.871540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91a48c-7f73-4565-b1f6-4d317ac295a8 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c93e2e4074d42a8a1b91ab218fa8ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6207265b75b44a8f818c5b9dd448575a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:20.877039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91a48c-7f73-4565-b1f6-4d317ac295a8 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:20.877283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91a48c-7f73-4565-b1f6-4d317ac295a8 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:20.877577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91a48c-7f73-4565-b1f6-4d317ac295a8 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] PATH_INFO: `/v3/policies/1b99a7980d89499e904e17b681836e81` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:20.878075 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2696/5405] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:06:20.878715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c91a48c-7f73-4565-b1f6-4d317ac295a8 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=1b99a7980d89499e904e17b681836e81)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:20.880561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c91a48c-7f73-4565-b1f6-4d317ac295a8 tempest-PoliciesTestJSON-386475765 tempest-PoliciesTestJSON-386475765-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:20.934724 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2710/5406] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:20 2022] DELETE /identity/v3/policies/1b99a7980d89499e904e17b681836e81 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:20.939544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8449f-b29c-4470-aa1d-054413f4e3c8 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:21.101786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8449f-b29c-4470-aa1d-054413f4e3c8 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:21.106644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadef518-521f-4fbb-b971-59547ca5391d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:21.107291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadef518-521f-4fbb-b971-59547ca5391d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:21.107571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadef518-521f-4fbb-b971-59547ca5391d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:21.107844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadef518-521f-4fbb-b971-59547ca5391d admin admin] PATH_INFO: `/v3/users/b3b7f10db07a46f8b7dd44dfa24516e1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:21.113384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadef518-521f-4fbb-b971-59547ca5391d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3b7f10db07a46f8b7dd44dfa24516e1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:21.126485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadef518-521f-4fbb-b971-59547ca5391d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:21.184159 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:21.290133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dadef518-521f-4fbb-b971-59547ca5391d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3b7f10db07a46f8b7dd44dfa24516e1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:21.311360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dadef518-521f-4fbb-b971-59547ca5391d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3b7f10db07a46f8b7dd44dfa24516e1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:21.312212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dadef518-521f-4fbb-b971-59547ca5391d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3b7f10db07a46f8b7dd44dfa24516e1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:21.354977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dadef518-521f-4fbb-b971-59547ca5391d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3b7f10db07a46f8b7dd44dfa24516e1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:21.390231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dadef518-521f-4fbb-b971-59547ca5391d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3b7f10db07a46f8b7dd44dfa24516e1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:21.413023 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2697/5407] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:06:20 2022] DELETE /identity/v3/users/b3b7f10db07a46f8b7dd44dfa24516e1 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:21.418585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96ae33-1559-40df-a975-35bbef5f22b8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:21.419112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96ae33-1559-40df-a975-35bbef5f22b8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:21.419270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96ae33-1559-40df-a975-35bbef5f22b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:21.471232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1c96ae33-1559-40df-a975-35bbef5f22b8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:21.474210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1c96ae33-1559-40df-a975-35bbef5f22b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:21.790134 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2711/5408] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:21.841962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadef518-521f-4fbb-b971-59547ca5391d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:21.843437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dadef518-521f-4fbb-b971-59547ca5391d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:22.032361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadef518-521f-4fbb-b971-59547ca5391d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:22.040907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9f5af-38bb-43f9-83dd-9948f5567a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:22.043136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9f5af-38bb-43f9-83dd-9948f5567a20 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:22.043430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9f5af-38bb-43f9-83dd-9948f5567a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:22.043706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9f5af-38bb-43f9-83dd-9948f5567a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:22.067476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9f5af-38bb-43f9-83dd-9948f5567a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:22.071394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9f5af-38bb-43f9-83dd-9948f5567a20 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:22.122189 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2698/5409] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:06:22.226968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fb61d-23fb-4a65-adf8-4b35c559f949 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:22.227253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fb61d-23fb-4a65-adf8-4b35c559f949 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:22.227549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fb61d-23fb-4a65-adf8-4b35c559f949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:22.299940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1f6fb61d-23fb-4a65-adf8-4b35c559f949 None None] MFA Rules not processed for user `ef13867e7dc6433283f59bb0121af017`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:22.305537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1f6fb61d-23fb-4a65-adf8-4b35c559f949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:22.498112 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2712/5410] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:22 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:22.515550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e5ff7-c2ee-4b84-89d5-33107fc9296b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:22.515667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e5ff7-c2ee-4b84-89d5-33107fc9296b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:22.516635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e5ff7-c2ee-4b84-89d5-33107fc9296b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:22.558847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-466e5ff7-c2ee-4b84-89d5-33107fc9296b None None] MFA Rules not processed for user `ef13867e7dc6433283f59bb0121af017`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:22.560097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-466e5ff7-c2ee-4b84-89d5-33107fc9296b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:22.590648 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2699/5411] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:22 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:22.632671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fb61d-23fb-4a65-adf8-4b35c559f949 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:22.650207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fb61d-23fb-4a65-adf8-4b35c559f949 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:22.678220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad787b-7e2b-4425-a417-768eaa632e9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:22.680429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad787b-7e2b-4425-a417-768eaa632e9f service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:22.682475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad787b-7e2b-4425-a417-768eaa632e9f service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:22.683304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad787b-7e2b-4425-a417-768eaa632e9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:22.689378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fcad787b-7e2b-4425-a417-768eaa632e9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:22.760393 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:22.888862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad787b-7e2b-4425-a417-768eaa632e9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:22.891099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad787b-7e2b-4425-a417-768eaa632e9f service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:22.912583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e5ff7-c2ee-4b84-89d5-33107fc9296b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:22.914487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-466e5ff7-c2ee-4b84-89d5-33107fc9296b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:22.932280 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2713/5412] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:06:22.954455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e5ff7-c2ee-4b84-89d5-33107fc9296b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:22.965851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bd257-aa13-4ed6-ad1f-f43233332ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:22.979094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bd257-aa13-4ed6-ad1f-f43233332ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:22.980673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bd257-aa13-4ed6-ad1f-f43233332ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:22.981770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bd257-aa13-4ed6-ad1f-f43233332ccb admin admin] PATH_INFO: `/v3/projects/4580aaa08e8f4c639065e51a85e57b18` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:22.984301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bd257-aa13-4ed6-ad1f-f43233332ccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4580aaa08e8f4c639065e51a85e57b18)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:22.987643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bd257-aa13-4ed6-ad1f-f43233332ccb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:23.204629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-307bd257-aa13-4ed6-ad1f-f43233332ccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4580aaa08e8f4c639065e51a85e57b18', 'request_id': 'req-307bd257-aa13-4ed6-ad1f-f43233332ccb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:23.228959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-307bd257-aa13-4ed6-ad1f-f43233332ccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4580aaa08e8f4c639065e51a85e57b18', 'request_id': 'req-307bd257-aa13-4ed6-ad1f-f43233332ccb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:23.246823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-307bd257-aa13-4ed6-ad1f-f43233332ccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4580aaa08e8f4c639065e51a85e57b18', 'request_id': 'req-307bd257-aa13-4ed6-ad1f-f43233332ccb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:23.297664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-307bd257-aa13-4ed6-ad1f-f43233332ccb admin admin] The token cache is being invalidate because project 4580aaa08e8f4c639065e51a85e57b18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:06:23.298257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-307bd257-aa13-4ed6-ad1f-f43233332ccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:23.299741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-307bd257-aa13-4ed6-ad1f-f43233332ccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:23.305908 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2700/5413] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:22 2022] DELETE /identity/v3/projects/4580aaa08e8f4c639065e51a85e57b18 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:23.307042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad787b-7e2b-4425-a417-768eaa632e9f service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:23.323080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad787b-7e2b-4425-a417-768eaa632e9f service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:23.492386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db240bdf-b0b6-4ec4-90f4-298bd2999995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:23.493179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db240bdf-b0b6-4ec4-90f4-298bd2999995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:23.494657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db240bdf-b0b6-4ec4-90f4-298bd2999995 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:23.495025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db240bdf-b0b6-4ec4-90f4-298bd2999995 admin admin] PATH_INFO: `/v3/users/5c93e2e4074d42a8a1b91ab218fa8ae0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:23.497677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db240bdf-b0b6-4ec4-90f4-298bd2999995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c93e2e4074d42a8a1b91ab218fa8ae0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:23.503444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db240bdf-b0b6-4ec4-90f4-298bd2999995 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:23.613219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-db240bdf-b0b6-4ec4-90f4-298bd2999995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c93e2e4074d42a8a1b91ab218fa8ae0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:23.615926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-db240bdf-b0b6-4ec4-90f4-298bd2999995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c93e2e4074d42a8a1b91ab218fa8ae0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:23.633911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-db240bdf-b0b6-4ec4-90f4-298bd2999995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c93e2e4074d42a8a1b91ab218fa8ae0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:23.654421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-db240bdf-b0b6-4ec4-90f4-298bd2999995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c93e2e4074d42a8a1b91ab218fa8ae0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:23.670633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-db240bdf-b0b6-4ec4-90f4-298bd2999995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c93e2e4074d42a8a1b91ab218fa8ae0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:23.695463 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2714/5414] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:06:23 2022] DELETE /identity/v3/users/5c93e2e4074d42a8a1b91ab218fa8ae0 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:23.905273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bd257-aa13-4ed6-ad1f-f43233332ccb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:23.907550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-307bd257-aa13-4ed6-ad1f-f43233332ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:23.967394 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:24.098680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bd257-aa13-4ed6-ad1f-f43233332ccb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:24.558351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa9188-2cc7-436a-a6e1-c96d4902ce6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:24.559169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa9188-2cc7-436a-a6e1-c96d4902ce6c service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:24.559586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa9188-2cc7-436a-a6e1-c96d4902ce6c service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:24.559993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa9188-2cc7-436a-a6e1-c96d4902ce6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:24.562183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-00aa9188-2cc7-436a-a6e1-c96d4902ce6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:24.732925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa9188-2cc7-436a-a6e1-c96d4902ce6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:24.735034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa9188-2cc7-436a-a6e1-c96d4902ce6c service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:24.772567 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2701/5415] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:23 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 866 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:06:24.900632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db240bdf-b0b6-4ec4-90f4-298bd2999995 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:24.902756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-db240bdf-b0b6-4ec4-90f4-298bd2999995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:25.031916 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:25.117475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db240bdf-b0b6-4ec4-90f4-298bd2999995 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:25.127691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e24bb4-633e-4ba7-85ce-b183df676053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:25.129656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e24bb4-633e-4ba7-85ce-b183df676053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:25.131378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e24bb4-633e-4ba7-85ce-b183df676053 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:25.131820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e24bb4-633e-4ba7-85ce-b183df676053 admin admin] PATH_INFO: `/v3/projects/6207265b75b44a8f818c5b9dd448575a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:25.134201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e24bb4-633e-4ba7-85ce-b183df676053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6207265b75b44a8f818c5b9dd448575a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:25.139529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e24bb4-633e-4ba7-85ce-b183df676053 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:25.234758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-33e24bb4-633e-4ba7-85ce-b183df676053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6207265b75b44a8f818c5b9dd448575a', 'request_id': 'req-33e24bb4-633e-4ba7-85ce-b183df676053'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:25.245586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-33e24bb4-633e-4ba7-85ce-b183df676053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6207265b75b44a8f818c5b9dd448575a', 'request_id': 'req-33e24bb4-633e-4ba7-85ce-b183df676053'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:25.258003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-33e24bb4-633e-4ba7-85ce-b183df676053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6207265b75b44a8f818c5b9dd448575a', 'request_id': 'req-33e24bb4-633e-4ba7-85ce-b183df676053'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:25.283484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-33e24bb4-633e-4ba7-85ce-b183df676053 admin admin] The token cache is being invalidate because project 6207265b75b44a8f818c5b9dd448575a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:06:25.285236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-33e24bb4-633e-4ba7-85ce-b183df676053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:25.286098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-33e24bb4-633e-4ba7-85ce-b183df676053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:25.292395 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2715/5416] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:24 2022] DELETE /identity/v3/projects/6207265b75b44a8f818c5b9dd448575a => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:25.294364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab099ac-7196-40ac-9d40-3fe8b9d4c28d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:25.295212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab099ac-7196-40ac-9d40-3fe8b9d4c28d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:25.295722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab099ac-7196-40ac-9d40-3fe8b9d4c28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:25.355680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0ab099ac-7196-40ac-9d40-3fe8b9d4c28d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:25.356953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0ab099ac-7196-40ac-9d40-3fe8b9d4c28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:25.485629 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:25.502423 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2702/5417] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:25.512479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f31b5f-4487-4fb2-916d-b0bdba3417bb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:25.512479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f31b5f-4487-4fb2-916d-b0bdba3417bb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:25.512479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f31b5f-4487-4fb2-916d-b0bdba3417bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:25.557453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-85f31b5f-4487-4fb2-916d-b0bdba3417bb None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:25.577672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-85f31b5f-4487-4fb2-916d-b0bdba3417bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:25.601003 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2716/5418] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:25.602603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab099ac-7196-40ac-9d40-3fe8b9d4c28d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:25.624790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab099ac-7196-40ac-9d40-3fe8b9d4c28d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:25.638074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cba977-5cb8-49fc-ad4c-3d1a72befdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:25.639009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cba977-5cb8-49fc-ad4c-3d1a72befdcf admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:25.640060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cba977-5cb8-49fc-ad4c-3d1a72befdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:25.641622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cba977-5cb8-49fc-ad4c-3d1a72befdcf admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:25.643342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cba977-5cb8-49fc-ad4c-3d1a72befdcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:06:25.644918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cba977-5cb8-49fc-ad4c-3d1a72befdcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:25.650080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cba977-5cb8-49fc-ad4c-3d1a72befdcf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:25.702346 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2703/5419] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:06:25.708691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f31b5f-4487-4fb2-916d-b0bdba3417bb None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:25.725742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f31b5f-4487-4fb2-916d-b0bdba3417bb None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:25.744094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa90aac-de22-40e8-aa87-c33d2e75966c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:25.746755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa90aac-de22-40e8-aa87-c33d2e75966c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:25.747302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa90aac-de22-40e8-aa87-c33d2e75966c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:25.748355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa90aac-de22-40e8-aa87-c33d2e75966c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:25.749453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa90aac-de22-40e8-aa87-c33d2e75966c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:25.754097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa90aac-de22-40e8-aa87-c33d2e75966c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:25.846317 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2717/5420] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:06:25 2022] POST /identity/v3/projects => generated 395 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:25.851187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cba977-5cb8-49fc-ad4c-3d1a72befdcf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:25.876376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cba977-5cb8-49fc-ad4c-3d1a72befdcf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:26.006135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a66f1-b6af-49b0-a28e-6489325a304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:26.007065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a66f1-b6af-49b0-a28e-6489325a304f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:26.007851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a66f1-b6af-49b0-a28e-6489325a304f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:26.008331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a66f1-b6af-49b0-a28e-6489325a304f admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:26.009146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a66f1-b6af-49b0-a28e-6489325a304f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:26.012171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a66f1-b6af-49b0-a28e-6489325a304f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:26.067085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa90aac-de22-40e8-aa87-c33d2e75966c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:26.067916 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2704/5421] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:06:25 2022] POST /identity/v3/users => generated 298 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:26.087621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa90aac-de22-40e8-aa87-c33d2e75966c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:26.097279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58256b-e309-4c81-9100-750828a4a9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:26.098235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58256b-e309-4c81-9100-750828a4a9ed admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:26.098671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58256b-e309-4c81-9100-750828a4a9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:26.099105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58256b-e309-4c81-9100-750828a4a9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:26.100705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58256b-e309-4c81-9100-750828a4a9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:26.102990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58256b-e309-4c81-9100-750828a4a9ed admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:26.131665 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2718/5422] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:26.133077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a66f1-b6af-49b0-a28e-6489325a304f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:26.148075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a66f1-b6af-49b0-a28e-6489325a304f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:26.157310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e294ee-77d8-4dd3-ad6c-692644696c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:26.157963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e294ee-77d8-4dd3-ad6c-692644696c0d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:26.160479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e294ee-77d8-4dd3-ad6c-692644696c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:26.160847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e294ee-77d8-4dd3-ad6c-692644696c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:26.163840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e294ee-77d8-4dd3-ad6c-692644696c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:26.166832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e294ee-77d8-4dd3-ad6c-692644696c0d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:26.202362 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2705/5423] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:26.207242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58256b-e309-4c81-9100-750828a4a9ed admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:26.230040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58256b-e309-4c81-9100-750828a4a9ed admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:26.248209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed4328-26c5-411f-bf62-e7acf254f5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:26.249640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed4328-26c5-411f-bf62-e7acf254f5d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:26.249938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed4328-26c5-411f-bf62-e7acf254f5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:26.250213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed4328-26c5-411f-bf62-e7acf254f5d3 admin admin] PATH_INFO: `/v3/projects/e668b94c3a024409896a1e4b058f3f7f/users/c751997d9bc14af39e3792387cf0f8ea/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:26.321906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed4328-26c5-411f-bf62-e7acf254f5d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e668b94c3a024409896a1e4b058f3f7f, user_id=c751997d9bc14af39e3792387cf0f8ea, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:26.325005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed4328-26c5-411f-bf62-e7acf254f5d3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:26.356701 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2719/5424] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:26 2022] PUT /identity/v3/projects/e668b94c3a024409896a1e4b058f3f7f/users/c751997d9bc14af39e3792387cf0f8ea/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:26.366989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f4c53-3339-4613-a838-bec2f1eb7607 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:26.367584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f4c53-3339-4613-a838-bec2f1eb7607 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:26.367584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f4c53-3339-4613-a838-bec2f1eb7607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:26.469852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-639f4c53-3339-4613-a838-bec2f1eb7607 None None] MFA Rules not processed for user `c751997d9bc14af39e3792387cf0f8ea`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:26.471093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-639f4c53-3339-4613-a838-bec2f1eb7607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:26.819256 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2706/5425] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:26 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:26.834884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed4328-26c5-411f-bf62-e7acf254f5d3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:27.065700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed4328-26c5-411f-bf62-e7acf254f5d3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:27.094875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6be5d-429c-4b87-a09c-2da44e56fa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:27.106343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6be5d-429c-4b87-a09c-2da44e56fa92 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:27.106854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6be5d-429c-4b87-a09c-2da44e56fa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:27.107500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6be5d-429c-4b87-a09c-2da44e56fa92 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:27.109553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6be5d-429c-4b87-a09c-2da44e56fa92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:27.115966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6be5d-429c-4b87-a09c-2da44e56fa92 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:27.135498 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:27.194959 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2720/5426] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:06:26 2022] POST /identity/v3/projects => generated 395 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:27.197396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f4c53-3339-4613-a838-bec2f1eb7607 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:27.215775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f4c53-3339-4613-a838-bec2f1eb7607 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:27.357463 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:27.384508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef83cc1-3fce-4c58-a917-b7137a4d5136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:27.385207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef83cc1-3fce-4c58-a917-b7137a4d5136 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:27.385485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef83cc1-3fce-4c58-a917-b7137a4d5136 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:27.385755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef83cc1-3fce-4c58-a917-b7137a4d5136 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:27.386394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef83cc1-3fce-4c58-a917-b7137a4d5136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:27.391841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef83cc1-3fce-4c58-a917-b7137a4d5136 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:27.483097 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2707/5427] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:06:27 2022] POST /identity/v3/users => generated 304 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:27.488784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6be5d-429c-4b87-a09c-2da44e56fa92 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:27.517579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6be5d-429c-4b87-a09c-2da44e56fa92 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:27.531372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c51fd-0d52-4aae-8468-8daf118b5e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:27.533040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c51fd-0d52-4aae-8468-8daf118b5e58 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:27.533322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c51fd-0d52-4aae-8468-8daf118b5e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:27.533595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c51fd-0d52-4aae-8468-8daf118b5e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:27.534999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c51fd-0d52-4aae-8468-8daf118b5e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:27.542349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c51fd-0d52-4aae-8468-8daf118b5e58 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:27.581872 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2721/5428] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:27.587103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef83cc1-3fce-4c58-a917-b7137a4d5136 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:27.602282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef83cc1-3fce-4c58-a917-b7137a4d5136 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:27.633472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a4140-ba06-40f0-9eba-c831be725b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:27.634164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a4140-ba06-40f0-9eba-c831be725b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:27.634440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a4140-ba06-40f0-9eba-c831be725b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:27.634713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a4140-ba06-40f0-9eba-c831be725b34 admin admin] PATH_INFO: `/v3/projects/60d4a4654cbb4d399d391b8c611c082a/users/1f4632b0456f4cada6ce714178f81c40/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:27.682269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a4140-ba06-40f0-9eba-c831be725b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d4a4654cbb4d399d391b8c611c082a, user_id=1f4632b0456f4cada6ce714178f81c40, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:27.684612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a4140-ba06-40f0-9eba-c831be725b34 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:27.735719 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2708/5429] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:27 2022] PUT /identity/v3/projects/60d4a4654cbb4d399d391b8c611c082a/users/1f4632b0456f4cada6ce714178f81c40/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:27.739508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c51fd-0d52-4aae-8468-8daf118b5e58 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:27.757828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c51fd-0d52-4aae-8468-8daf118b5e58 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:27.920373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2160e81-17d0-4c0b-a36a-23f4c237e139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:27.921252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2160e81-17d0-4c0b-a36a-23f4c237e139 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:27.921693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2160e81-17d0-4c0b-a36a-23f4c237e139 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:27.925253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2160e81-17d0-4c0b-a36a-23f4c237e139 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:27.926126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2160e81-17d0-4c0b-a36a-23f4c237e139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:27.929986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2160e81-17d0-4c0b-a36a-23f4c237e139 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:27.993783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a4140-ba06-40f0-9eba-c831be725b34 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:28.006634 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2722/5430] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:28.015684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a4140-ba06-40f0-9eba-c831be725b34 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:28.042669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd9289-42a2-448a-829c-88702124a4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:28.047310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd9289-42a2-448a-829c-88702124a4e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:28.050803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd9289-42a2-448a-829c-88702124a4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:28.050803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd9289-42a2-448a-829c-88702124a4e2 admin admin] PATH_INFO: `/v3/projects/60d4a4654cbb4d399d391b8c611c082a/users/1f4632b0456f4cada6ce714178f81c40/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:28.073029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd9289-42a2-448a-829c-88702124a4e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d4a4654cbb4d399d391b8c611c082a, user_id=1f4632b0456f4cada6ce714178f81c40, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:28.077556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd9289-42a2-448a-829c-88702124a4e2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:28.142767 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2709/5431] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:27 2022] PUT /identity/v3/projects/60d4a4654cbb4d399d391b8c611c082a/users/1f4632b0456f4cada6ce714178f81c40/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:28.158538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7111698-ca09-471a-933f-705675c1b3c0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:28.159077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7111698-ca09-471a-933f-705675c1b3c0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:28.159382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7111698-ca09-471a-933f-705675c1b3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:28.245923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b7111698-ca09-471a-933f-705675c1b3c0 None None] MFA Rules not processed for user `1f4632b0456f4cada6ce714178f81c40`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:28.247264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b7111698-ca09-471a-933f-705675c1b3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:28.481247 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2723/5432] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:28 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:28.487712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd9289-42a2-448a-829c-88702124a4e2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:28.636493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd9289-42a2-448a-829c-88702124a4e2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:28.645456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd441fb-6046-4032-8931-fc2053b1aa41 tempest-ProjectsNegativeStaticTestJSON-543874273 tempest-ProjectsNegativeStaticTestJSON-543874273-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c751997d9bc14af39e3792387cf0f8ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e668b94c3a024409896a1e4b058f3f7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:28.649117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd441fb-6046-4032-8931-fc2053b1aa41 tempest-ProjectsNegativeStaticTestJSON-543874273 tempest-ProjectsNegativeStaticTestJSON-543874273-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:28.650815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd441fb-6046-4032-8931-fc2053b1aa41 tempest-ProjectsNegativeStaticTestJSON-543874273 tempest-ProjectsNegativeStaticTestJSON-543874273-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:28.651312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd441fb-6046-4032-8931-fc2053b1aa41 tempest-ProjectsNegativeStaticTestJSON-543874273 tempest-ProjectsNegativeStaticTestJSON-543874273-project] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:28.654094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd441fb-6046-4032-8931-fc2053b1aa41 tempest-ProjectsNegativeStaticTestJSON-543874273 tempest-ProjectsNegativeStaticTestJSON-543874273-project] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:28.670276 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-7bd441fb-6046-4032-8931-fc2053b1aa41 tempest-ProjectsNegativeStaticTestJSON-543874273 tempest-ProjectsNegativeStaticTestJSON-543874273-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Sep 30 10:06:28.670276 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:06:28.670276 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:06:28.670276 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:06:28.670276 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:06:28.670276 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:06:28.670276 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:06:28.670276 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:06:28.670276 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:06:28.670276 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:06:28.670276 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:06:28.670276 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:06:28.670276 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Sep 30 10:06:28.670276 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Sep 30 10:06:28.671434 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Sep 30 10:06:28.671434 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application enforcer_obj._enforce( Sep 30 10:06:28.671434 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Sep 30 10:06:28.671434 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Sep 30 10:06:28.671434 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 30 10:06:28.671434 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Sep 30 10:06:28.671434 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Sep 30 10:06:28.671434 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:06:28.676234 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2710/5433] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Sep 30 10:06:28 2022] POST /identity/v3/projects => generated 136 bytes in 189 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:06:28.684930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7111698-ca09-471a-933f-705675c1b3c0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:28.703767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7111698-ca09-471a-933f-705675c1b3c0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:28.713022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391505e-f093-49a2-a3d0-8eeb636b1365 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f4632b0456f4cada6ce714178f81c40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d4a4654cbb4d399d391b8c611c082a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:28.716712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391505e-f093-49a2-a3d0-8eeb636b1365 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:28.716712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391505e-f093-49a2-a3d0-8eeb636b1365 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:28.716712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391505e-f093-49a2-a3d0-8eeb636b1365 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:28.716712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391505e-f093-49a2-a3d0-8eeb636b1365 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:28.718697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391505e-f093-49a2-a3d0-8eeb636b1365 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:28.728815 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-3391505e-f093-49a2-a3d0-8eeb636b1365 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] Invalid input for field 'name': '' is too short Sep 30 10:06:28.728815 n-d-master-1 devstack@keystone.service[82079]: Failed validating 'minLength' in schema['properties']['name']: Sep 30 10:06:28.728815 n-d-master-1 devstack@keystone.service[82079]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 30 10:06:28.728815 n-d-master-1 devstack@keystone.service[82079]: On instance['name']: Sep 30 10:06:28.728815 n-d-master-1 devstack@keystone.service[82079]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Sep 30 10:06:28.728815 n-d-master-1 devstack@keystone.service[82079]: Failed validating 'minLength' in schema['properties']['name']: Sep 30 10:06:28.728815 n-d-master-1 devstack@keystone.service[82079]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 30 10:06:28.728815 n-d-master-1 devstack@keystone.service[82079]: On instance['name']: Sep 30 10:06:28.728815 n-d-master-1 devstack@keystone.service[82079]: '' Sep 30 10:06:28.728815 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:06:28.728815 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 30 10:06:28.728815 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 30 10:06:28.728815 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 30 10:06:28.728815 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise error Sep 30 10:06:28.728815 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Sep 30 10:06:28.728815 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:06:28.728815 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Sep 30 10:06:28.728815 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 30 10:06:28.728815 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:06:28.728815 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application On instance['name']: Sep 30 10:06:28.728815 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application '' Sep 30 10:06:28.728815 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:06:28.728815 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:06:28.730777 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:06:28.730777 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:06:28.730777 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:06:28.730777 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:06:28.730777 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:06:28.730777 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:06:28.730777 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:06:28.730777 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:06:28.730777 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:06:28.730777 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:06:28.730777 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:06:28.730777 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:06:28.730777 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Sep 30 10:06:28.730777 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Sep 30 10:06:28.730777 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 30 10:06:28.730777 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 30 10:06:28.730777 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 30 10:06:28.732359 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 30 10:06:28.732359 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Sep 30 10:06:28.732359 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:06:28.732359 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Sep 30 10:06:28.732359 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 30 10:06:28.732359 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:06:28.732359 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application On instance['name']: Sep 30 10:06:28.732359 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application '' Sep 30 10:06:28.732359 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:06:28.735599 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2724/5434] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Sep 30 10:06:28 2022] POST /identity/v3/projects => generated 283 bytes in 53 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 30 10:06:28.742423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd441fb-6046-4032-8931-fc2053b1aa41 tempest-ProjectsNegativeStaticTestJSON-543874273 tempest-ProjectsNegativeStaticTestJSON-543874273-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:28.761920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd441fb-6046-4032-8931-fc2053b1aa41 tempest-ProjectsNegativeStaticTestJSON-543874273 tempest-ProjectsNegativeStaticTestJSON-543874273-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:28.774815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9047f-cacc-4e94-b56f-aac6edab2b61 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f4632b0456f4cada6ce714178f81c40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d4a4654cbb4d399d391b8c611c082a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:28.779383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9047f-cacc-4e94-b56f-aac6edab2b61 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:28.779671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9047f-cacc-4e94-b56f-aac6edab2b61 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:28.780089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9047f-cacc-4e94-b56f-aac6edab2b61 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:28.782312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9047f-cacc-4e94-b56f-aac6edab2b61 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:28.788522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9047f-cacc-4e94-b56f-aac6edab2b61 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:28.806420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-07e9047f-cacc-4e94-b56f-aac6edab2b61 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 30 10:06:28.806420 n-d-master-1 devstack@keystone.service[82080]: Failed validating 'maxLength' in schema['properties']['name']: Sep 30 10:06:28.806420 n-d-master-1 devstack@keystone.service[82080]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 30 10:06:28.806420 n-d-master-1 devstack@keystone.service[82080]: On instance['name']: Sep 30 10:06:28.806420 n-d-master-1 devstack@keystone.service[82080]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 30 10:06:28.806420 n-d-master-1 devstack@keystone.service[82080]: Failed validating 'maxLength' in schema['properties']['name']: Sep 30 10:06:28.806420 n-d-master-1 devstack@keystone.service[82080]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 30 10:06:28.806420 n-d-master-1 devstack@keystone.service[82080]: On instance['name']: Sep 30 10:06:28.806420 n-d-master-1 devstack@keystone.service[82080]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 30 10:06:28.806420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:06:28.806420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 30 10:06:28.806420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 30 10:06:28.806420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 30 10:06:28.806420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise error Sep 30 10:06:28.806420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 30 10:06:28.806420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:06:28.806420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Sep 30 10:06:28.806420 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 30 10:06:28.807906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:06:28.807906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application On instance['name']: Sep 30 10:06:28.807906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 30 10:06:28.807906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:06:28.807906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:06:28.807906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:06:28.807906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:06:28.807906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:06:28.807906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:06:28.807906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:06:28.807906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:06:28.807906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:06:28.807906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:06:28.807906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:06:28.807906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:06:28.807906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:06:28.807906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:06:28.807906 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Sep 30 10:06:28.809340 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Sep 30 10:06:28.809340 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 30 10:06:28.809340 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 30 10:06:28.809340 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 30 10:06:28.809340 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 30 10:06:28.809340 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 30 10:06:28.809340 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:06:28.809340 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Sep 30 10:06:28.809340 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 30 10:06:28.809340 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:06:28.809340 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application On instance['name']: Sep 30 10:06:28.809340 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 30 10:06:28.809340 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:06:28.813531 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2711/5435] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Sep 30 10:06:28 2022] POST /identity/v3/projects => generated 412 bytes in 72 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 30 10:06:28.818192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391505e-f093-49a2-a3d0-8eeb636b1365 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:28.838936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391505e-f093-49a2-a3d0-8eeb636b1365 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:28.853272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2196fe8-8aff-4a6d-bed5-3b98ac3a7600 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f4632b0456f4cada6ce714178f81c40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d4a4654cbb4d399d391b8c611c082a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:28.854295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2196fe8-8aff-4a6d-bed5-3b98ac3a7600 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:28.855469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2196fe8-8aff-4a6d-bed5-3b98ac3a7600 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:28.856192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2196fe8-8aff-4a6d-bed5-3b98ac3a7600 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] PATH_INFO: `/v3/projects/edcf00a87af04775baf8d66e22f21748` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:28.878654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2196fe8-8aff-4a6d-bed5-3b98ac3a7600 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] RBAC: Authorizing `identity:delete_project(project_id=edcf00a87af04775baf8d66e22f21748)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:28.887830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2196fe8-8aff-4a6d-bed5-3b98ac3a7600 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:28.934818 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-d2196fe8-8aff-4a6d-bed5-3b98ac3a7600 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] Could not find project: edcf00a87af04775baf8d66e22f21748.: keystone.exception.ProjectNotFound: Could not find project: edcf00a87af04775baf8d66e22f21748. Sep 30 10:06:28.934818 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:06:28.934818 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:06:28.934818 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:06:28.934818 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:06:28.934818 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:06:28.934818 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:06:28.934818 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:06:28.934818 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:06:28.934818 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:06:28.934818 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:06:28.934818 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:06:28.934818 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Sep 30 10:06:28.934818 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Sep 30 10:06:28.935926 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:06:28.935926 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:06:28.935926 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Sep 30 10:06:28.935926 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Sep 30 10:06:28.935926 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 10:06:28.935926 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 10:06:28.935926 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 10:06:28.935926 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 10:06:28.935926 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: edcf00a87af04775baf8d66e22f21748. Sep 30 10:06:28.935926 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:06:28.938890 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2725/5436] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:28 2022] DELETE /identity/v3/projects/edcf00a87af04775baf8d66e22f21748 => generated 113 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:06:28.945760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9047f-cacc-4e94-b56f-aac6edab2b61 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:28.965796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9047f-cacc-4e94-b56f-aac6edab2b61 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:28.977294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba21a73-e8e5-4b75-a6e5-4dfdbb43bec0 tempest-ProjectsNegativeStaticTestJSON-543874273 tempest-ProjectsNegativeStaticTestJSON-543874273-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c751997d9bc14af39e3792387cf0f8ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e668b94c3a024409896a1e4b058f3f7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:28.979016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba21a73-e8e5-4b75-a6e5-4dfdbb43bec0 tempest-ProjectsNegativeStaticTestJSON-543874273 tempest-ProjectsNegativeStaticTestJSON-543874273-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:28.979514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba21a73-e8e5-4b75-a6e5-4dfdbb43bec0 tempest-ProjectsNegativeStaticTestJSON-543874273 tempest-ProjectsNegativeStaticTestJSON-543874273-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:28.980033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba21a73-e8e5-4b75-a6e5-4dfdbb43bec0 tempest-ProjectsNegativeStaticTestJSON-543874273 tempest-ProjectsNegativeStaticTestJSON-543874273-project] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:28.981022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba21a73-e8e5-4b75-a6e5-4dfdbb43bec0 tempest-ProjectsNegativeStaticTestJSON-543874273 tempest-ProjectsNegativeStaticTestJSON-543874273-project] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:28.999217 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-eba21a73-e8e5-4b75-a6e5-4dfdbb43bec0 tempest-ProjectsNegativeStaticTestJSON-543874273 tempest-ProjectsNegativeStaticTestJSON-543874273-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Sep 30 10:06:28.999217 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:06:28.999217 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:06:28.999217 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:06:28.999217 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:06:28.999217 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:06:28.999217 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:06:28.999217 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:06:28.999217 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:06:28.999217 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:06:28.999217 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:06:28.999217 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:06:28.999217 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Sep 30 10:06:28.999217 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._list_projects() Sep 30 10:06:29.000367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Sep 30 10:06:29.000367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Sep 30 10:06:29.000367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Sep 30 10:06:29.000367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application enforcer_obj._enforce( Sep 30 10:06:29.000367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Sep 30 10:06:29.000367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Sep 30 10:06:29.000367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 30 10:06:29.000367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Sep 30 10:06:29.000367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Sep 30 10:06:29.000367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:06:29.011419 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2712/5437] 10.222.0.16 () {58 vars in 1131 bytes} [Fri Sep 30 10:06:28 2022] GET /identity/v3/projects => generated 135 bytes in 66 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:06:29.017978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2196fe8-8aff-4a6d-bed5-3b98ac3a7600 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:29.036068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2196fe8-8aff-4a6d-bed5-3b98ac3a7600 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:29.046175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f921a0-3425-41e4-a5ff-e7554a153e95 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f4632b0456f4cada6ce714178f81c40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d4a4654cbb4d399d391b8c611c082a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:29.047255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f921a0-3425-41e4-a5ff-e7554a153e95 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:29.053873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f921a0-3425-41e4-a5ff-e7554a153e95 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:29.054674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f921a0-3425-41e4-a5ff-e7554a153e95 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:29.055573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f921a0-3425-41e4-a5ff-e7554a153e95 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:29.058314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f921a0-3425-41e4-a5ff-e7554a153e95 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:29.163641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba21a73-e8e5-4b75-a6e5-4dfdbb43bec0 tempest-ProjectsNegativeStaticTestJSON-543874273 tempest-ProjectsNegativeStaticTestJSON-543874273-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:29.165614 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2726/5438] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:06:29 2022] POST /identity/v3/projects => generated 357 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:29.191586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba21a73-e8e5-4b75-a6e5-4dfdbb43bec0 tempest-ProjectsNegativeStaticTestJSON-543874273 tempest-ProjectsNegativeStaticTestJSON-543874273-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:29.407525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd683c-0be4-4219-b43d-6b672f27f509 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f4632b0456f4cada6ce714178f81c40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d4a4654cbb4d399d391b8c611c082a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:29.408337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd683c-0be4-4219-b43d-6b672f27f509 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:29.408753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd683c-0be4-4219-b43d-6b672f27f509 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:29.409127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd683c-0be4-4219-b43d-6b672f27f509 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:29.409865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd683c-0be4-4219-b43d-6b672f27f509 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:29.413853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd683c-0be4-4219-b43d-6b672f27f509 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:29.467006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.sql.core [None req-bdbd683c-0be4-4219-b43d-6b672f27f509 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-885754320' for key 'project.ixu_project_name_domain_id'") Sep 30 10:06:29.467006 n-d-master-1 devstack@keystone.service[82080]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 30 10:06:29.467006 n-d-master-1 devstack@keystone.service[82080]: [parameters: {'id': '3d900909ec934f8bbb93db20d03a6da3', 'name': 'tempest-project-dup-885754320', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 30 10:06:29.467006 n-d-master-1 devstack@keystone.service[82080]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82080) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 30 10:06:29.477864 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-bdbd683c-0be4-4219-b43d-6b672f27f509 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-885754320, project id 3d900909ec934f8bbb93db20d03a6da3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-885754320, project id 3d900909ec934f8bbb93db20d03a6da3. Sep 30 10:06:29.477864 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:06:29.477864 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 10:06:29.477864 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 10:06:29.477864 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 10:06:29.477864 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 10:06:29.477864 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 10:06:29.477864 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 10:06:29.477864 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 10:06:29.477864 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application conn.query(q) Sep 30 10:06:29.477864 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 10:06:29.477864 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 10:06:29.478835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 10:06:29.478835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application result.read() Sep 30 10:06:29.478835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 10:06:29.478835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 10:06:29.478835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 10:06:29.478835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 10:06:29.478835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 10:06:29.478835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 10:06:29.478835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 10:06:29.478835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 10:06:29.478835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-885754320' for key 'project.ixu_project_name_domain_id'") Sep 30 10:06:29.478835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:06:29.478835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 30 10:06:29.478835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:06:29.478835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:06:29.478835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 30 10:06:29.478835 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 30 10:06:29.479932 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 30 10:06:29.479932 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 30 10:06:29.479932 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 10:06:29.479932 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application next(self.gen) Sep 30 10:06:29.479932 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 30 10:06:29.479932 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application yield resource Sep 30 10:06:29.479932 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 10:06:29.479932 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application next(self.gen) Sep 30 10:06:29.479932 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 30 10:06:29.479932 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.session.rollback() Sep 30 10:06:29.479932 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 30 10:06:29.479932 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.force_reraise() Sep 30 10:06:29.479932 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 30 10:06:29.479932 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise self.value Sep 30 10:06:29.479932 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 30 10:06:29.479932 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 30 10:06:29.479932 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 30 10:06:29.479932 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application session.commit() Sep 30 10:06:29.481456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 30 10:06:29.481456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 30 10:06:29.481456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 30 10:06:29.481456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._prepare_impl() Sep 30 10:06:29.481456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 30 10:06:29.481456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.session.flush() Sep 30 10:06:29.481456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 30 10:06:29.481456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._flush(objects) Sep 30 10:06:29.481456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 30 10:06:29.481456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 30 10:06:29.481456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 30 10:06:29.481456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application compat.raise_( Sep 30 10:06:29.481456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 10:06:29.481456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception Sep 30 10:06:29.481456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 30 10:06:29.481456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application flush_context.execute() Sep 30 10:06:29.481456 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 30 10:06:29.482833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rec.execute(self) Sep 30 10:06:29.482833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 30 10:06:29.482833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 30 10:06:29.482833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 30 10:06:29.482833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 30 10:06:29.482833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 30 10:06:29.482833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 30 10:06:29.482833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 30 10:06:29.482833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 30 10:06:29.482833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 30 10:06:29.482833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 30 10:06:29.482833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 30 10:06:29.482833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 30 10:06:29.482833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 30 10:06:29.482833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 30 10:06:29.482833 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 30 10:06:29.483847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 30 10:06:29.483847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 10:06:29.483847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception Sep 30 10:06:29.483847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 10:06:29.483847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 10:06:29.483847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 10:06:29.483847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 10:06:29.483847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 10:06:29.483847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 10:06:29.483847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 10:06:29.483847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application conn.query(q) Sep 30 10:06:29.483847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 10:06:29.483847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 10:06:29.483847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 10:06:29.483847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application result.read() Sep 30 10:06:29.483847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 10:06:29.483847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 10:06:29.485195 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 10:06:29.485195 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 10:06:29.485195 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 10:06:29.485195 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 10:06:29.485195 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 10:06:29.485195 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 10:06:29.485195 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-885754320' for key 'project.ixu_project_name_domain_id'") Sep 30 10:06:29.485195 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 30 10:06:29.485195 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [parameters: {'id': '3d900909ec934f8bbb93db20d03a6da3', 'name': 'tempest-project-dup-885754320', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 30 10:06:29.485195 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 30 10:06:29.485195 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:06:29.485195 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:06:29.485195 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:06:29.485195 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:06:29.485195 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 30 10:06:29.486192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 30 10:06:29.486192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 30 10:06:29.486192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 30 10:06:29.486192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-885754320 at domain ID default. Sep 30 10:06:29.486192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:06:29.486192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:06:29.486192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:06:29.486192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:06:29.486192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:06:29.486192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:06:29.486192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:06:29.486192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:06:29.486192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:06:29.486192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:06:29.486192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:06:29.486192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:06:29.486192 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:06:29.487468 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:06:29.487468 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 30 10:06:29.487468 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 30 10:06:29.487468 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:06:29.487468 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:06:29.487468 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 30 10:06:29.487468 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 30 10:06:29.487468 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-885754320, project id 3d900909ec934f8bbb93db20d03a6da3. Sep 30 10:06:29.487468 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:06:29.488576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f921a0-3425-41e4-a5ff-e7554a153e95 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:29.505473 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2713/5439] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Sep 30 10:06:29 2022] POST /identity/v3/projects => generated 284 bytes in 325 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 30 10:06:29.554373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f921a0-3425-41e4-a5ff-e7554a153e95 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:29.574640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c02f9-1b4d-46d6-9670-b8438343d404 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f4632b0456f4cada6ce714178f81c40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d4a4654cbb4d399d391b8c611c082a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:29.575620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c02f9-1b4d-46d6-9670-b8438343d404 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:29.575912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c02f9-1b4d-46d6-9670-b8438343d404 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:29.577244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c02f9-1b4d-46d6-9670-b8438343d404 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] PATH_INFO: `/v3/projects/1a9958ac98214559a3ed8506c3f4cb5c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:29.584074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c02f9-1b4d-46d6-9670-b8438343d404 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1a9958ac98214559a3ed8506c3f4cb5c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:29.593896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c02f9-1b4d-46d6-9670-b8438343d404 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:29.649401 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:29.820798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cf9c02f9-1b4d-46d6-9670-b8438343d404 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a9958ac98214559a3ed8506c3f4cb5c', 'request_id': 'req-cf9c02f9-1b4d-46d6-9670-b8438343d404'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:29.853090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cf9c02f9-1b4d-46d6-9670-b8438343d404 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a9958ac98214559a3ed8506c3f4cb5c', 'request_id': 'req-cf9c02f9-1b4d-46d6-9670-b8438343d404'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:29.873325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cf9c02f9-1b4d-46d6-9670-b8438343d404 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a9958ac98214559a3ed8506c3f4cb5c', 'request_id': 'req-cf9c02f9-1b4d-46d6-9670-b8438343d404'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:29.916202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cf9c02f9-1b4d-46d6-9670-b8438343d404 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] The token cache is being invalidate because project 1a9958ac98214559a3ed8506c3f4cb5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:06:29.916773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cf9c02f9-1b4d-46d6-9670-b8438343d404 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:29.918362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cf9c02f9-1b4d-46d6-9670-b8438343d404 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:29.929814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd683c-0be4-4219-b43d-6b672f27f509 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:29.931536 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2727/5440] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:29 2022] DELETE /identity/v3/projects/1a9958ac98214559a3ed8506c3f4cb5c => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:29.938422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bdbd683c-0be4-4219-b43d-6b672f27f509 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:30.040244 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:30.144320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd683c-0be4-4219-b43d-6b672f27f509 tempest-ProjectsNegativeStaticTestJSON-645451114 tempest-ProjectsNegativeStaticTestJSON-645451114-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:30.377124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd37e31-2bfe-42ee-94af-d5d9bf60807f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:30.377792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd37e31-2bfe-42ee-94af-d5d9bf60807f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:30.378071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd37e31-2bfe-42ee-94af-d5d9bf60807f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:30.378341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd37e31-2bfe-42ee-94af-d5d9bf60807f admin admin] PATH_INFO: `/v3/users/c751997d9bc14af39e3792387cf0f8ea` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:30.386699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd37e31-2bfe-42ee-94af-d5d9bf60807f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c751997d9bc14af39e3792387cf0f8ea)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:30.402229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd37e31-2bfe-42ee-94af-d5d9bf60807f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:30.577087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-acd37e31-2bfe-42ee-94af-d5d9bf60807f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c751997d9bc14af39e3792387cf0f8ea'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:30.601954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-acd37e31-2bfe-42ee-94af-d5d9bf60807f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c751997d9bc14af39e3792387cf0f8ea'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:30.603101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-acd37e31-2bfe-42ee-94af-d5d9bf60807f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c751997d9bc14af39e3792387cf0f8ea'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:30.647664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-acd37e31-2bfe-42ee-94af-d5d9bf60807f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c751997d9bc14af39e3792387cf0f8ea'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:30.695236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-acd37e31-2bfe-42ee-94af-d5d9bf60807f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c751997d9bc14af39e3792387cf0f8ea'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:30.726758 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2714/5441] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:06:29 2022] DELETE /identity/v3/users/c751997d9bc14af39e3792387cf0f8ea => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:30.731564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925641da-6347-4c25-98f7-f76d67737208 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:30.732140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925641da-6347-4c25-98f7-f76d67737208 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:30.732312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925641da-6347-4c25-98f7-f76d67737208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:30.816372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-925641da-6347-4c25-98f7-f76d67737208 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:30.822628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-925641da-6347-4c25-98f7-f76d67737208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:31.028113 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2728/5442] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:31.055698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd37e31-2bfe-42ee-94af-d5d9bf60807f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:31.057441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-acd37e31-2bfe-42ee-94af-d5d9bf60807f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:31.229779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd37e31-2bfe-42ee-94af-d5d9bf60807f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:31.236993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b83d86-33eb-424e-ac32-8d0f0a3153d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:31.238220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b83d86-33eb-424e-ac32-8d0f0a3153d2 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:31.238667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b83d86-33eb-424e-ac32-8d0f0a3153d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:31.239111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b83d86-33eb-424e-ac32-8d0f0a3153d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:31.268884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b83d86-33eb-424e-ac32-8d0f0a3153d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:31.270323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b83d86-33eb-424e-ac32-8d0f0a3153d2 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:31.304408 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:31.315826 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2715/5443] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:06:32.659948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925641da-6347-4c25-98f7-f76d67737208 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:32.662300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-925641da-6347-4c25-98f7-f76d67737208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:32.686551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925641da-6347-4c25-98f7-f76d67737208 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:32.695706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee09323-8bb3-40a6-a869-521201bc0e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:32.696667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee09323-8bb3-40a6-a869-521201bc0e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:32.697448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee09323-8bb3-40a6-a869-521201bc0e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:32.697953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee09323-8bb3-40a6-a869-521201bc0e2b admin admin] PATH_INFO: `/v3/projects/e668b94c3a024409896a1e4b058f3f7f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:32.700648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee09323-8bb3-40a6-a869-521201bc0e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e668b94c3a024409896a1e4b058f3f7f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:32.711717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee09323-8bb3-40a6-a869-521201bc0e2b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:32.851160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0ee09323-8bb3-40a6-a869-521201bc0e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e668b94c3a024409896a1e4b058f3f7f', 'request_id': 'req-0ee09323-8bb3-40a6-a869-521201bc0e2b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:32.869147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0ee09323-8bb3-40a6-a869-521201bc0e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e668b94c3a024409896a1e4b058f3f7f', 'request_id': 'req-0ee09323-8bb3-40a6-a869-521201bc0e2b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:32.888215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0ee09323-8bb3-40a6-a869-521201bc0e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e668b94c3a024409896a1e4b058f3f7f', 'request_id': 'req-0ee09323-8bb3-40a6-a869-521201bc0e2b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:32.935775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0ee09323-8bb3-40a6-a869-521201bc0e2b admin admin] The token cache is being invalidate because project e668b94c3a024409896a1e4b058f3f7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:06:32.939170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0ee09323-8bb3-40a6-a869-521201bc0e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:32.942139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0ee09323-8bb3-40a6-a869-521201bc0e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:32.948813 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2729/5444] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:32 2022] DELETE /identity/v3/projects/e668b94c3a024409896a1e4b058f3f7f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:32.953245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b83d86-33eb-424e-ac32-8d0f0a3153d2 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:32.968200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b83d86-33eb-424e-ac32-8d0f0a3153d2 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:33.096586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfc8f9-ca71-4e80-a501-b83d2c1d941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:33.100440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfc8f9-ca71-4e80-a501-b83d2c1d941c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:33.100974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfc8f9-ca71-4e80-a501-b83d2c1d941c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:33.101098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfc8f9-ca71-4e80-a501-b83d2c1d941c admin admin] PATH_INFO: `/v3/users/1f4632b0456f4cada6ce714178f81c40` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:33.102764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bfc8f9-ca71-4e80-a501-b83d2c1d941c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f4632b0456f4cada6ce714178f81c40)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:33.120045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bfc8f9-ca71-4e80-a501-b83d2c1d941c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:33.238982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0bfc8f9-ca71-4e80-a501-b83d2c1d941c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f4632b0456f4cada6ce714178f81c40'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:33.263896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0bfc8f9-ca71-4e80-a501-b83d2c1d941c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f4632b0456f4cada6ce714178f81c40'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:33.264545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0bfc8f9-ca71-4e80-a501-b83d2c1d941c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f4632b0456f4cada6ce714178f81c40'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:33.285737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0bfc8f9-ca71-4e80-a501-b83d2c1d941c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f4632b0456f4cada6ce714178f81c40'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:33.301126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0bfc8f9-ca71-4e80-a501-b83d2c1d941c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f4632b0456f4cada6ce714178f81c40'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:33.321254 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2716/5445] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:06:32 2022] DELETE /identity/v3/users/1f4632b0456f4cada6ce714178f81c40 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:34.997474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee09323-8bb3-40a6-a869-521201bc0e2b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:35.000353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0ee09323-8bb3-40a6-a869-521201bc0e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:35.032754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee09323-8bb3-40a6-a869-521201bc0e2b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:35.084410 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:35.175882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99148634-a1f3-4910-a039-5956d2ae0bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:35.177762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99148634-a1f3-4910-a039-5956d2ae0bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:35.178048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99148634-a1f3-4910-a039-5956d2ae0bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:35.178473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99148634-a1f3-4910-a039-5956d2ae0bbb admin admin] PATH_INFO: `/v3/users/0d624bba642341ba9ea87a27034cc999` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:35.184240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99148634-a1f3-4910-a039-5956d2ae0bbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d624bba642341ba9ea87a27034cc999)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:35.186268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99148634-a1f3-4910-a039-5956d2ae0bbb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:35.306820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-99148634-a1f3-4910-a039-5956d2ae0bbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d624bba642341ba9ea87a27034cc999'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:35.316019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-99148634-a1f3-4910-a039-5956d2ae0bbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d624bba642341ba9ea87a27034cc999'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:35.344674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-99148634-a1f3-4910-a039-5956d2ae0bbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d624bba642341ba9ea87a27034cc999'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:35.375047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-99148634-a1f3-4910-a039-5956d2ae0bbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d624bba642341ba9ea87a27034cc999'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:35.384191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-99148634-a1f3-4910-a039-5956d2ae0bbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d624bba642341ba9ea87a27034cc999'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:35.439229 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2730/5446] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:06:34 2022] DELETE /identity/v3/users/0d624bba642341ba9ea87a27034cc999 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:35.441121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a6bac-7e5a-4107-b27e-8d4d57592af9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:35.441595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a6bac-7e5a-4107-b27e-8d4d57592af9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:35.441727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a6bac-7e5a-4107-b27e-8d4d57592af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:35.498684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7f9a6bac-7e5a-4107-b27e-8d4d57592af9 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:35.499936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7f9a6bac-7e5a-4107-b27e-8d4d57592af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:35.549853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99148634-a1f3-4910-a039-5956d2ae0bbb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:35.551322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-99148634-a1f3-4910-a039-5956d2ae0bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:35.684519 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2717/5447] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:35.712776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a6bac-7e5a-4107-b27e-8d4d57592af9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:35.714532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7f9a6bac-7e5a-4107-b27e-8d4d57592af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:35.760391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99148634-a1f3-4910-a039-5956d2ae0bbb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:35.775469 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:35.791442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702da477-72dd-4151-970a-4cfd9f9115fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:35.792441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702da477-72dd-4151-970a-4cfd9f9115fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:35.792441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702da477-72dd-4151-970a-4cfd9f9115fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:35.793976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702da477-72dd-4151-970a-4cfd9f9115fc admin admin] PATH_INFO: `/v3/projects/60d4a4654cbb4d399d391b8c611c082a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:35.798030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702da477-72dd-4151-970a-4cfd9f9115fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d4a4654cbb4d399d391b8c611c082a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:35.807650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702da477-72dd-4151-970a-4cfd9f9115fc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:35.930564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a6bac-7e5a-4107-b27e-8d4d57592af9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:35.973493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba004e-ed44-4e42-bcbf-2a18d4b3542d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:35.974645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba004e-ed44-4e42-bcbf-2a18d4b3542d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:35.974921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba004e-ed44-4e42-bcbf-2a18d4b3542d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:35.975185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba004e-ed44-4e42-bcbf-2a18d4b3542d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:36.007244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba004e-ed44-4e42-bcbf-2a18d4b3542d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:36.008905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba004e-ed44-4e42-bcbf-2a18d4b3542d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:36.023779 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:36.034588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-702da477-72dd-4151-970a-4cfd9f9115fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d4a4654cbb4d399d391b8c611c082a', 'request_id': 'req-702da477-72dd-4151-970a-4cfd9f9115fc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:36.042405 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2718/5448] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:06:36.054967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-702da477-72dd-4151-970a-4cfd9f9115fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d4a4654cbb4d399d391b8c611c082a', 'request_id': 'req-702da477-72dd-4151-970a-4cfd9f9115fc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:36.063668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-702da477-72dd-4151-970a-4cfd9f9115fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d4a4654cbb4d399d391b8c611c082a', 'request_id': 'req-702da477-72dd-4151-970a-4cfd9f9115fc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:36.105619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-702da477-72dd-4151-970a-4cfd9f9115fc admin admin] The token cache is being invalidate because project 60d4a4654cbb4d399d391b8c611c082a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:06:36.106269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-702da477-72dd-4151-970a-4cfd9f9115fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:36.110922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-702da477-72dd-4151-970a-4cfd9f9115fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:36.113514 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2731/5449] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:35 2022] DELETE /identity/v3/projects/60d4a4654cbb4d399d391b8c611c082a => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:36.121405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0a759-01d5-4cf7-bb10-4035a84c73a3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:36.121691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0a759-01d5-4cf7-bb10-4035a84c73a3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:36.121978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0a759-01d5-4cf7-bb10-4035a84c73a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:36.181318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2af0a759-01d5-4cf7-bb10-4035a84c73a3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:36.182596 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2af0a759-01d5-4cf7-bb10-4035a84c73a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:36.315882 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2719/5450] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:36.317310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1447aa-1212-4b15-a689-984ab1ca1081 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:36.317651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1447aa-1212-4b15-a689-984ab1ca1081 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:36.317996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1447aa-1212-4b15-a689-984ab1ca1081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:36.348485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6b1447aa-1212-4b15-a689-984ab1ca1081 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:36.350990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6b1447aa-1212-4b15-a689-984ab1ca1081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:36.361752 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2732/5451] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:36.367294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0a759-01d5-4cf7-bb10-4035a84c73a3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:36.386690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0a759-01d5-4cf7-bb10-4035a84c73a3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:36.393449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e0122-9ce5-4328-8a9b-c8865210d1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:36.394442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e0122-9ce5-4328-8a9b-c8865210d1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:36.394813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e0122-9ce5-4328-8a9b-c8865210d1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:36.395178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e0122-9ce5-4328-8a9b-c8865210d1e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:36.396467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e0122-9ce5-4328-8a9b-c8865210d1e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:06:36.397084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e0122-9ce5-4328-8a9b-c8865210d1e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:36.399892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e0122-9ce5-4328-8a9b-c8865210d1e7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:36.467121 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2720/5452] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:06:36.467740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1447aa-1212-4b15-a689-984ab1ca1081 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:36.490520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1447aa-1212-4b15-a689-984ab1ca1081 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:36.516045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2063b67-b959-4b77-a9b5-7889664e9702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:36.517422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2063b67-b959-4b77-a9b5-7889664e9702 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:36.517891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2063b67-b959-4b77-a9b5-7889664e9702 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:36.518484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2063b67-b959-4b77-a9b5-7889664e9702 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:36.519350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2063b67-b959-4b77-a9b5-7889664e9702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:36.523488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2063b67-b959-4b77-a9b5-7889664e9702 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:36.568668 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2733/5453] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:06:36 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:06:36.570939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e0122-9ce5-4328-8a9b-c8865210d1e7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:36.581997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e0122-9ce5-4328-8a9b-c8865210d1e7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:36.659006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250f998-0a61-4a39-b6bc-56a7207e58a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:36.659908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250f998-0a61-4a39-b6bc-56a7207e58a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:36.660246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250f998-0a61-4a39-b6bc-56a7207e58a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:36.660762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250f998-0a61-4a39-b6bc-56a7207e58a3 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:36.661838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250f998-0a61-4a39-b6bc-56a7207e58a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:36.666952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250f998-0a61-4a39-b6bc-56a7207e58a3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:36.704535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2063b67-b959-4b77-a9b5-7889664e9702 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:36.707133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b2063b67-b959-4b77-a9b5-7889664e9702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:36.720643 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2721/5454] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:06:36 2022] POST /identity/v3/users => generated 282 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:36.722675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250f998-0a61-4a39-b6bc-56a7207e58a3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:36.730963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2063b67-b959-4b77-a9b5-7889664e9702 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:36.736749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250f998-0a61-4a39-b6bc-56a7207e58a3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:36.737014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b83a29-42e7-4f2a-aef3-3ca4a7f0a73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:36.738016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b83a29-42e7-4f2a-aef3-3ca4a7f0a73f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:36.738898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b83a29-42e7-4f2a-aef3-3ca4a7f0a73f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:36.739554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b83a29-42e7-4f2a-aef3-3ca4a7f0a73f admin admin] PATH_INFO: `/v3/projects/51040a8897314f8c801caa23be100792` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:36.741949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b83a29-42e7-4f2a-aef3-3ca4a7f0a73f admin admin] RBAC: Authorizing `identity:delete_project(project_id=51040a8897314f8c801caa23be100792)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:36.744284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b83a29-42e7-4f2a-aef3-3ca4a7f0a73f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:36.744872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45827470-9647-441d-893b-07cd1e0bac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:36.745678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45827470-9647-441d-893b-07cd1e0bac79 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:36.746080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45827470-9647-441d-893b-07cd1e0bac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:36.746447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45827470-9647-441d-893b-07cd1e0bac79 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:36.747268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45827470-9647-441d-893b-07cd1e0bac79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:36.749230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45827470-9647-441d-893b-07cd1e0bac79 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:36.784079 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2722/5455] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:36.804070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45827470-9647-441d-893b-07cd1e0bac79 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:36.824997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45827470-9647-441d-893b-07cd1e0bac79 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:36.839542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ae382-f32e-4b5e-95cb-8af345629916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:36.840871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ae382-f32e-4b5e-95cb-8af345629916 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:36.843156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ae382-f32e-4b5e-95cb-8af345629916 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:36.843571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ae382-f32e-4b5e-95cb-8af345629916 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:36.846394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ae382-f32e-4b5e-95cb-8af345629916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:36.854716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ae382-f32e-4b5e-95cb-8af345629916 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:36.875803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4b83a29-42e7-4f2a-aef3-3ca4a7f0a73f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51040a8897314f8c801caa23be100792', 'request_id': 'req-d4b83a29-42e7-4f2a-aef3-3ca4a7f0a73f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:36.906652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4b83a29-42e7-4f2a-aef3-3ca4a7f0a73f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51040a8897314f8c801caa23be100792', 'request_id': 'req-d4b83a29-42e7-4f2a-aef3-3ca4a7f0a73f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:36.914352 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2723/5456] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:36.916473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ae382-f32e-4b5e-95cb-8af345629916 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:36.934526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4b83a29-42e7-4f2a-aef3-3ca4a7f0a73f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51040a8897314f8c801caa23be100792', 'request_id': 'req-d4b83a29-42e7-4f2a-aef3-3ca4a7f0a73f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:36.953865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ae382-f32e-4b5e-95cb-8af345629916 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:36.990945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4b83a29-42e7-4f2a-aef3-3ca4a7f0a73f admin admin] The token cache is being invalidate because project 51040a8897314f8c801caa23be100792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:06:36.993031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4b83a29-42e7-4f2a-aef3-3ca4a7f0a73f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:36.996927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4b83a29-42e7-4f2a-aef3-3ca4a7f0a73f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:37.007313 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2734/5457] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:36 2022] DELETE /identity/v3/projects/51040a8897314f8c801caa23be100792 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:37.010528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b83a29-42e7-4f2a-aef3-3ca4a7f0a73f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:37.016309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d4b83a29-42e7-4f2a-aef3-3ca4a7f0a73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:37.038349 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:37.189186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222ef76-4230-4eae-a133-75d4ed95c83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:37.190881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222ef76-4230-4eae-a133-75d4ed95c83b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:37.191371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222ef76-4230-4eae-a133-75d4ed95c83b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:37.204853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222ef76-4230-4eae-a133-75d4ed95c83b admin admin] PATH_INFO: `/v3/projects/ee1a3b51573f405d99e3b7e80b7307e2/users/a9a02a9384114b22ac5e83b779a0c2d1/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:37.244996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222ef76-4230-4eae-a133-75d4ed95c83b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee1a3b51573f405d99e3b7e80b7307e2, user_id=a9a02a9384114b22ac5e83b779a0c2d1, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:37.248053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222ef76-4230-4eae-a133-75d4ed95c83b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:37.300026 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2724/5458] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:36 2022] PUT /identity/v3/projects/ee1a3b51573f405d99e3b7e80b7307e2/users/a9a02a9384114b22ac5e83b779a0c2d1/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:37.301474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17000c-70b7-4f59-a466-443668a1e268 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:37.301756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17000c-70b7-4f59-a466-443668a1e268 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:37.302941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17000c-70b7-4f59-a466-443668a1e268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:37.347456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6e17000c-70b7-4f59-a466-443668a1e268 None None] MFA Rules not processed for user `a9a02a9384114b22ac5e83b779a0c2d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:37.349427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6e17000c-70b7-4f59-a466-443668a1e268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:37.368159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b83a29-42e7-4f2a-aef3-3ca4a7f0a73f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:37.426624 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:37.494500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db25a1-4a80-43ca-ab51-0cf47ab115a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:37.495409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db25a1-4a80-43ca-ab51-0cf47ab115a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:37.496583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db25a1-4a80-43ca-ab51-0cf47ab115a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:37.497064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db25a1-4a80-43ca-ab51-0cf47ab115a7 admin admin] PATH_INFO: `/v3/users/fb6136016f1f425db63066e9272526d9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:37.498477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db25a1-4a80-43ca-ab51-0cf47ab115a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb6136016f1f425db63066e9272526d9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:37.499224 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2725/5459] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:37.501768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db25a1-4a80-43ca-ab51-0cf47ab115a7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:37.513093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17000c-70b7-4f59-a466-443668a1e268 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:37.514977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6e17000c-70b7-4f59-a466-443668a1e268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:37.623033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f7db25a1-4a80-43ca-ab51-0cf47ab115a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb6136016f1f425db63066e9272526d9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:37.623988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f7db25a1-4a80-43ca-ab51-0cf47ab115a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb6136016f1f425db63066e9272526d9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:37.636861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f7db25a1-4a80-43ca-ab51-0cf47ab115a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb6136016f1f425db63066e9272526d9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:37.667090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f7db25a1-4a80-43ca-ab51-0cf47ab115a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb6136016f1f425db63066e9272526d9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:37.688286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f7db25a1-4a80-43ca-ab51-0cf47ab115a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb6136016f1f425db63066e9272526d9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:37.694544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17000c-70b7-4f59-a466-443668a1e268 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:37.700800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ddddb3-6148-4932-80e0-9163b2a00436 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:37.701477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddddb3-6148-4932-80e0-9163b2a00436 service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:37.701952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddddb3-6148-4932-80e0-9163b2a00436 service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:37.702294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddddb3-6148-4932-80e0-9163b2a00436 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:37.706038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-64ddddb3-6148-4932-80e0-9163b2a00436 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:37.710656 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2735/5460] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:06:37 2022] DELETE /identity/v3/users/fb6136016f1f425db63066e9272526d9 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:37.733765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ddddb3-6148-4932-80e0-9163b2a00436 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:37.746113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ddddb3-6148-4932-80e0-9163b2a00436 service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:37.762376 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2726/5461] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:06:38.655564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db25a1-4a80-43ca-ab51-0cf47ab115a7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:38.657199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f7db25a1-4a80-43ca-ab51-0cf47ab115a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:38.836216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db25a1-4a80-43ca-ab51-0cf47ab115a7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:38.848046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f1981-fe62-44b1-9faf-1dec08a90e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:38.849755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f1981-fe62-44b1-9faf-1dec08a90e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:38.850226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f1981-fe62-44b1-9faf-1dec08a90e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:38.850731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f1981-fe62-44b1-9faf-1dec08a90e87 admin admin] PATH_INFO: `/v3/users/a9a02a9384114b22ac5e83b779a0c2d1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:38.852161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f1981-fe62-44b1-9faf-1dec08a90e87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9a02a9384114b22ac5e83b779a0c2d1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:38.855742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f1981-fe62-44b1-9faf-1dec08a90e87 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:38.947933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-438f1981-fe62-44b1-9faf-1dec08a90e87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9a02a9384114b22ac5e83b779a0c2d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:38.949850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-438f1981-fe62-44b1-9faf-1dec08a90e87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9a02a9384114b22ac5e83b779a0c2d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:38.965206 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-438f1981-fe62-44b1-9faf-1dec08a90e87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9a02a9384114b22ac5e83b779a0c2d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:38.967067 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:38.997881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-438f1981-fe62-44b1-9faf-1dec08a90e87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9a02a9384114b22ac5e83b779a0c2d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:39.016635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-438f1981-fe62-44b1-9faf-1dec08a90e87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9a02a9384114b22ac5e83b779a0c2d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:39.038489 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2736/5462] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:06:38 2022] DELETE /identity/v3/users/a9a02a9384114b22ac5e83b779a0c2d1 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:39.041000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc0cda-04b3-45ad-b11d-8545ec1d3bac None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:39.041671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc0cda-04b3-45ad-b11d-8545ec1d3bac None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:39.042207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc0cda-04b3-45ad-b11d-8545ec1d3bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:39.078416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a9cc0cda-04b3-45ad-b11d-8545ec1d3bac None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:39.084383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a9cc0cda-04b3-45ad-b11d-8545ec1d3bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:39.131519 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:39.205678 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2727/5463] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:39.276416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f1981-fe62-44b1-9faf-1dec08a90e87 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:39.279116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-438f1981-fe62-44b1-9faf-1dec08a90e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:39.381711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f1981-fe62-44b1-9faf-1dec08a90e87 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:39.387801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808112d-1055-4411-9924-0f7e3ee8cc9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:39.389474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808112d-1055-4411-9924-0f7e3ee8cc9c service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:39.389985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808112d-1055-4411-9924-0f7e3ee8cc9c service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:39.390492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808112d-1055-4411-9924-0f7e3ee8cc9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:39.405314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808112d-1055-4411-9924-0f7e3ee8cc9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:39.408179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808112d-1055-4411-9924-0f7e3ee8cc9c service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:39.419631 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2737/5464] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:06:40.316004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc0cda-04b3-45ad-b11d-8545ec1d3bac None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:40.318557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a9cc0cda-04b3-45ad-b11d-8545ec1d3bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:40.345316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc0cda-04b3-45ad-b11d-8545ec1d3bac None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:40.351360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c372728-889e-42e3-93fa-25bf149baa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:40.352264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c372728-889e-42e3-93fa-25bf149baa70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:40.352751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c372728-889e-42e3-93fa-25bf149baa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:40.353025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c372728-889e-42e3-93fa-25bf149baa70 admin admin] PATH_INFO: `/v3/projects/226eb96c698349d6a1198f1c02e52413` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:40.354541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c372728-889e-42e3-93fa-25bf149baa70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=226eb96c698349d6a1198f1c02e52413)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:40.356813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c372728-889e-42e3-93fa-25bf149baa70 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:40.451984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c372728-889e-42e3-93fa-25bf149baa70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '226eb96c698349d6a1198f1c02e52413', 'request_id': 'req-6c372728-889e-42e3-93fa-25bf149baa70'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:40.461879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c372728-889e-42e3-93fa-25bf149baa70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '226eb96c698349d6a1198f1c02e52413', 'request_id': 'req-6c372728-889e-42e3-93fa-25bf149baa70'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:40.470507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c372728-889e-42e3-93fa-25bf149baa70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '226eb96c698349d6a1198f1c02e52413', 'request_id': 'req-6c372728-889e-42e3-93fa-25bf149baa70'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:40.485314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c372728-889e-42e3-93fa-25bf149baa70 admin admin] The token cache is being invalidate because project 226eb96c698349d6a1198f1c02e52413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:06:40.485717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c372728-889e-42e3-93fa-25bf149baa70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:40.486573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c372728-889e-42e3-93fa-25bf149baa70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:40.488488 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2728/5465] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:40 2022] DELETE /identity/v3/projects/226eb96c698349d6a1198f1c02e52413 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:40.493801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48592ae9-bc2c-4c54-a4a6-8889109472dc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:40.494677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48592ae9-bc2c-4c54-a4a6-8889109472dc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:40.495247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48592ae9-bc2c-4c54-a4a6-8889109472dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:40.535025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-48592ae9-bc2c-4c54-a4a6-8889109472dc None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:40.537429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-48592ae9-bc2c-4c54-a4a6-8889109472dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:40.613262 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2738/5466] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:40.621552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cbf43-a0a7-4906-92f0-d78bea5ea4fb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:40.622078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cbf43-a0a7-4906-92f0-d78bea5ea4fb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:40.622529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cbf43-a0a7-4906-92f0-d78bea5ea4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:40.648252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-701cbf43-a0a7-4906-92f0-d78bea5ea4fb None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:40.649537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-701cbf43-a0a7-4906-92f0-d78bea5ea4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:40.663576 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2729/5467] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:40.664708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48592ae9-bc2c-4c54-a4a6-8889109472dc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:40.676323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48592ae9-bc2c-4c54-a4a6-8889109472dc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:40.682165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea837d-cc79-4b36-9c23-253391b950a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:40.682785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea837d-cc79-4b36-9c23-253391b950a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:40.683067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea837d-cc79-4b36-9c23-253391b950a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:40.683345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea837d-cc79-4b36-9c23-253391b950a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:40.683995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea837d-cc79-4b36-9c23-253391b950a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:06:40.684298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea837d-cc79-4b36-9c23-253391b950a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:40.686688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea837d-cc79-4b36-9c23-253391b950a2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:40.702454 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2739/5468] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:06:40.706699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cbf43-a0a7-4906-92f0-d78bea5ea4fb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:40.725209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cbf43-a0a7-4906-92f0-d78bea5ea4fb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:40.734007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b9e67-4624-441b-b276-ea27fb0c2f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:40.734673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b9e67-4624-441b-b276-ea27fb0c2f5c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:40.735036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b9e67-4624-441b-b276-ea27fb0c2f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:40.735205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b9e67-4624-441b-b276-ea27fb0c2f5c admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:40.736022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b9e67-4624-441b-b276-ea27fb0c2f5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:40.738375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b9e67-4624-441b-b276-ea27fb0c2f5c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:40.794015 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2730/5469] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:06:40 2022] POST /identity/v3/projects => generated 377 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:40.798487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea837d-cc79-4b36-9c23-253391b950a2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:40.810332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea837d-cc79-4b36-9c23-253391b950a2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:40.907610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f546aa8-4738-4d85-8fb7-cae7787d5c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:40.908159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f546aa8-4738-4d85-8fb7-cae7787d5c11 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:40.908441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f546aa8-4738-4d85-8fb7-cae7787d5c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:40.908812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f546aa8-4738-4d85-8fb7-cae7787d5c11 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:40.910902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f546aa8-4738-4d85-8fb7-cae7787d5c11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:40.916220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f546aa8-4738-4d85-8fb7-cae7787d5c11 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:40.928809 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:40.965098 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2740/5470] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:06:40 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:40.970755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b9e67-4624-441b-b276-ea27fb0c2f5c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:40.983893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b9e67-4624-441b-b276-ea27fb0c2f5c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:40.997525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176cc23-0d10-4f3a-b5a0-98d0f9682cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:40.998169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176cc23-0d10-4f3a-b5a0-98d0f9682cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:40.998447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176cc23-0d10-4f3a-b5a0-98d0f9682cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:40.998720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176cc23-0d10-4f3a-b5a0-98d0f9682cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:40.999382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176cc23-0d10-4f3a-b5a0-98d0f9682cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:41.001026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176cc23-0d10-4f3a-b5a0-98d0f9682cc9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:41.024011 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2731/5471] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:41.028121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f546aa8-4738-4d85-8fb7-cae7787d5c11 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:41.047882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f546aa8-4738-4d85-8fb7-cae7787d5c11 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:41.055024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e05548-b410-411c-8e52-02f29069d9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:41.055024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e05548-b410-411c-8e52-02f29069d9bc admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:41.055407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e05548-b410-411c-8e52-02f29069d9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:41.056395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e05548-b410-411c-8e52-02f29069d9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:41.057219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e05548-b410-411c-8e52-02f29069d9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:41.059424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e05548-b410-411c-8e52-02f29069d9bc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:41.076084 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2741/5472] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:41.077353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176cc23-0d10-4f3a-b5a0-98d0f9682cc9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:41.091890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176cc23-0d10-4f3a-b5a0-98d0f9682cc9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:41.097308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1d558-6d92-4d88-9167-843eef06dbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:41.098092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1d558-6d92-4d88-9167-843eef06dbb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:41.098482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1d558-6d92-4d88-9167-843eef06dbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:41.099462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1d558-6d92-4d88-9167-843eef06dbb0 admin admin] PATH_INFO: `/v3/projects/bb842e745fcd4bd6b4e2095b73566068/users/66b7820ce5e24aa897c7a02b31efaae9/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:41.118491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1d558-6d92-4d88-9167-843eef06dbb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb842e745fcd4bd6b4e2095b73566068, user_id=66b7820ce5e24aa897c7a02b31efaae9, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:41.121913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1d558-6d92-4d88-9167-843eef06dbb0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:41.147576 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2732/5473] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:41 2022] PUT /identity/v3/projects/bb842e745fcd4bd6b4e2095b73566068/users/66b7820ce5e24aa897c7a02b31efaae9/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:41.149781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6d27d-1d43-4829-9984-a840fbdbe771 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:41.150167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6d27d-1d43-4829-9984-a840fbdbe771 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:41.150536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6d27d-1d43-4829-9984-a840fbdbe771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:41.182248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-21a6d27d-1d43-4829-9984-a840fbdbe771 None None] MFA Rules not processed for user `66b7820ce5e24aa897c7a02b31efaae9`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:41.183546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-21a6d27d-1d43-4829-9984-a840fbdbe771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:41.263642 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2742/5474] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:41.268519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1d558-6d92-4d88-9167-843eef06dbb0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:41.327871 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:41.359497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1d558-6d92-4d88-9167-843eef06dbb0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:41.366362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8de78f-692d-4732-8985-689912f434f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:41.367480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8de78f-692d-4732-8985-689912f434f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:41.367480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8de78f-692d-4732-8985-689912f434f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:41.367812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8de78f-692d-4732-8985-689912f434f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:41.368724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8de78f-692d-4732-8985-689912f434f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:41.370690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8de78f-692d-4732-8985-689912f434f8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:41.399627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6d27d-1d43-4829-9984-a840fbdbe771 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:41.401255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-21a6d27d-1d43-4829-9984-a840fbdbe771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:41.418302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6d27d-1d43-4829-9984-a840fbdbe771 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:41.424103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232ecff-8511-4210-89de-6ad9eae446fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:41.424551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232ecff-8511-4210-89de-6ad9eae446fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:41.424945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232ecff-8511-4210-89de-6ad9eae446fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:41.425316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232ecff-8511-4210-89de-6ad9eae446fd admin admin] PATH_INFO: `/v3/projects/ee1a3b51573f405d99e3b7e80b7307e2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:41.429024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232ecff-8511-4210-89de-6ad9eae446fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee1a3b51573f405d99e3b7e80b7307e2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:41.431991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232ecff-8511-4210-89de-6ad9eae446fd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:41.460052 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2733/5475] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:06:41 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:06:41.467859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8de78f-692d-4732-8985-689912f434f8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:41.516142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5232ecff-8511-4210-89de-6ad9eae446fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee1a3b51573f405d99e3b7e80b7307e2', 'request_id': 'req-5232ecff-8511-4210-89de-6ad9eae446fd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:41.547262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5232ecff-8511-4210-89de-6ad9eae446fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee1a3b51573f405d99e3b7e80b7307e2', 'request_id': 'req-5232ecff-8511-4210-89de-6ad9eae446fd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:41.554871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5232ecff-8511-4210-89de-6ad9eae446fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee1a3b51573f405d99e3b7e80b7307e2', 'request_id': 'req-5232ecff-8511-4210-89de-6ad9eae446fd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:41.574421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5232ecff-8511-4210-89de-6ad9eae446fd admin admin] The token cache is being invalidate because project ee1a3b51573f405d99e3b7e80b7307e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:06:41.574719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5232ecff-8511-4210-89de-6ad9eae446fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:41.575511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5232ecff-8511-4210-89de-6ad9eae446fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:41.576085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8de78f-692d-4732-8985-689912f434f8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:41.581075 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2743/5476] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:41 2022] DELETE /identity/v3/projects/ee1a3b51573f405d99e3b7e80b7307e2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:06:41.584466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f73fc-39be-497c-835e-dc9fe70eeab9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:41.584925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f73fc-39be-497c-835e-dc9fe70eeab9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:41.585343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f73fc-39be-497c-835e-dc9fe70eeab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:41.615033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-945f73fc-39be-497c-835e-dc9fe70eeab9 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:41.617410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-945f73fc-39be-497c-835e-dc9fe70eeab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:41.662495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3037890-c230-4d77-ae65-59560340f3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:41.664134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3037890-c230-4d77-ae65-59560340f3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:41.664594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3037890-c230-4d77-ae65-59560340f3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:41.665057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3037890-c230-4d77-ae65-59560340f3b6 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:41.665880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3037890-c230-4d77-ae65-59560340f3b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:41.668436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3037890-c230-4d77-ae65-59560340f3b6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:41.706687 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2734/5477] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:06:41 2022] POST /identity/v3/users => generated 295 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:06:41.709996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3037890-c230-4d77-ae65-59560340f3b6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:41.712762 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:41.714618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f3037890-c230-4d77-ae65-59560340f3b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:41.738857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3037890-c230-4d77-ae65-59560340f3b6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:41.744892 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2744/5478] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:41.752966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf11f1-ac10-44b8-9a7f-8f9cf849d60d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:41.753599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf11f1-ac10-44b8-9a7f-8f9cf849d60d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:41.754076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf11f1-ac10-44b8-9a7f-8f9cf849d60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:41.762762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af65b0d-e3fb-40a0-b469-1547d473cc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:41.763387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af65b0d-e3fb-40a0-b469-1547d473cc8d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:41.763662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af65b0d-e3fb-40a0-b469-1547d473cc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:41.763931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af65b0d-e3fb-40a0-b469-1547d473cc8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:41.764656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af65b0d-e3fb-40a0-b469-1547d473cc8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:41.766249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af65b0d-e3fb-40a0-b469-1547d473cc8d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:41.778518 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2735/5479] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:41.781002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-94cf11f1-ac10-44b8-9a7f-8f9cf849d60d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:41.782478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-94cf11f1-ac10-44b8-9a7f-8f9cf849d60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:41.783658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af65b0d-e3fb-40a0-b469-1547d473cc8d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:41.803413 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2745/5480] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:41.806276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf11f1-ac10-44b8-9a7f-8f9cf849d60d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:41.811846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af65b0d-e3fb-40a0-b469-1547d473cc8d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:41.819702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c6b12-99e5-430e-b3a3-b8e151521759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:41.821134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c6b12-99e5-430e-b3a3-b8e151521759 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:41.821579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c6b12-99e5-430e-b3a3-b8e151521759 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:41.822005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c6b12-99e5-430e-b3a3-b8e151521759 admin admin] PATH_INFO: `/v3/projects/041f16d76e3e4c5caa307b587cf3c787/users/2be442b1624e4532bff9d198f651677b/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:41.827452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf11f1-ac10-44b8-9a7f-8f9cf849d60d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:41.842649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cbf76-ff4f-40a8-9985-9499fb1ef72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:41.843069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cbf76-ff4f-40a8-9985-9499fb1ef72b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:41.843459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cbf76-ff4f-40a8-9985-9499fb1ef72b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:41.843811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cbf76-ff4f-40a8-9985-9499fb1ef72b admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:41.844759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cbf76-ff4f-40a8-9985-9499fb1ef72b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:06:41.844997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cbf76-ff4f-40a8-9985-9499fb1ef72b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:41.845347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c6b12-99e5-430e-b3a3-b8e151521759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=041f16d76e3e4c5caa307b587cf3c787, user_id=2be442b1624e4532bff9d198f651677b, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:41.846978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cbf76-ff4f-40a8-9985-9499fb1ef72b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:41.849702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c6b12-99e5-430e-b3a3-b8e151521759 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:41.883129 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2746/5481] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:06:41.884456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cbf76-ff4f-40a8-9985-9499fb1ef72b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:41.888092 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2736/5482] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:41 2022] PUT /identity/v3/projects/041f16d76e3e4c5caa307b587cf3c787/users/2be442b1624e4532bff9d198f651677b/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:41.889529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c6b12-99e5-430e-b3a3-b8e151521759 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:41.904897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cbf76-ff4f-40a8-9985-9499fb1ef72b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:41.942003 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:42.007794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c6b12-99e5-430e-b3a3-b8e151521759 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:42.015215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70866931-78a8-4552-aaf3-4355e49d2ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:42.015865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70866931-78a8-4552-aaf3-4355e49d2ecd admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:42.016119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70866931-78a8-4552-aaf3-4355e49d2ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:42.016705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70866931-78a8-4552-aaf3-4355e49d2ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:42.017608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70866931-78a8-4552-aaf3-4355e49d2ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:42.023846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70866931-78a8-4552-aaf3-4355e49d2ecd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:42.053443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c92002-2c23-45a7-8400-a3c71530ae89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:42.054377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c92002-2c23-45a7-8400-a3c71530ae89 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:42.054753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c92002-2c23-45a7-8400-a3c71530ae89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:42.055126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c92002-2c23-45a7-8400-a3c71530ae89 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:42.055997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c92002-2c23-45a7-8400-a3c71530ae89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:42.058023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c92002-2c23-45a7-8400-a3c71530ae89 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:42.058750 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2737/5483] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:06:42.063127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70866931-78a8-4552-aaf3-4355e49d2ecd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:42.076204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70866931-78a8-4552-aaf3-4355e49d2ecd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:42.082682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438eac9-8436-4079-8821-0ddb3e42cba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:42.084098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438eac9-8436-4079-8821-0ddb3e42cba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:42.085326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438eac9-8436-4079-8821-0ddb3e42cba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:42.085774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438eac9-8436-4079-8821-0ddb3e42cba3 admin admin] PATH_INFO: `/v3/projects/041f16d76e3e4c5caa307b587cf3c787/users/2be442b1624e4532bff9d198f651677b/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:42.088987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438eac9-8436-4079-8821-0ddb3e42cba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=041f16d76e3e4c5caa307b587cf3c787, user_id=2be442b1624e4532bff9d198f651677b, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:42.092935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438eac9-8436-4079-8821-0ddb3e42cba3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:42.127208 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2738/5484] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:42 2022] PUT /identity/v3/projects/041f16d76e3e4c5caa307b587cf3c787/users/2be442b1624e4532bff9d198f651677b/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:06:42.131837 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2747/5485] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:06:41 2022] POST /identity/v3/projects => generated 381 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:42.132057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8e91c-8c5d-4305-9043-27efa5ac94fd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:42.132057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8e91c-8c5d-4305-9043-27efa5ac94fd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:42.132057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8e91c-8c5d-4305-9043-27efa5ac94fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:42.133759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c92002-2c23-45a7-8400-a3c71530ae89 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:42.181788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-00a8e91c-8c5d-4305-9043-27efa5ac94fd None None] MFA Rules not processed for user `2be442b1624e4532bff9d198f651677b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:42.183939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-00a8e91c-8c5d-4305-9043-27efa5ac94fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:42.282230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c92002-2c23-45a7-8400-a3c71530ae89 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:42.302000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d963c6-e020-44c0-bb1a-104498798fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:42.304317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d963c6-e020-44c0-bb1a-104498798fbe admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:42.304739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d963c6-e020-44c0-bb1a-104498798fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:42.305117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d963c6-e020-44c0-bb1a-104498798fbe admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:42.306383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d963c6-e020-44c0-bb1a-104498798fbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:42.315948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d963c6-e020-44c0-bb1a-104498798fbe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:42.374099 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2748/5486] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:06:42 2022] POST /identity/v3/users => generated 291 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:42.375909 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2739/5487] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:06:42.394733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8e91c-8c5d-4305-9043-27efa5ac94fd None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:42.395475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d963c6-e020-44c0-bb1a-104498798fbe admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:42.400720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-00a8e91c-8c5d-4305-9043-27efa5ac94fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:42.410728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d963c6-e020-44c0-bb1a-104498798fbe admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:42.418568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bdbb7-ba1d-4a90-87f6-66b12f5ebc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:42.419519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bdbb7-ba1d-4a90-87f6-66b12f5ebc25 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:42.419703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bdbb7-ba1d-4a90-87f6-66b12f5ebc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:42.420099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bdbb7-ba1d-4a90-87f6-66b12f5ebc25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:42.420935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bdbb7-ba1d-4a90-87f6-66b12f5ebc25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:42.422889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bdbb7-ba1d-4a90-87f6-66b12f5ebc25 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:42.439322 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2749/5488] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:42.440585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bdbb7-ba1d-4a90-87f6-66b12f5ebc25 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:42.460547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bdbb7-ba1d-4a90-87f6-66b12f5ebc25 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:42.470712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed64be1-62a8-4b21-bcea-9f3817762372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:42.471512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed64be1-62a8-4b21-bcea-9f3817762372 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:42.472122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed64be1-62a8-4b21-bcea-9f3817762372 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:42.472502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed64be1-62a8-4b21-bcea-9f3817762372 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:42.474923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed64be1-62a8-4b21-bcea-9f3817762372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:42.480951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed64be1-62a8-4b21-bcea-9f3817762372 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:42.493618 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2750/5489] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:06:42.497287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed64be1-62a8-4b21-bcea-9f3817762372 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:42.509717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed64be1-62a8-4b21-bcea-9f3817762372 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:42.515210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03163640-cf9d-4599-9a2c-1f3e80ecd6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:42.516083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03163640-cf9d-4599-9a2c-1f3e80ecd6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:42.516583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03163640-cf9d-4599-9a2c-1f3e80ecd6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:42.517179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03163640-cf9d-4599-9a2c-1f3e80ecd6ea admin admin] PATH_INFO: `/v3/projects/dad8a45c6e164ae59a16e3e3a8cbf0f0/users/6f57293c4c64419ba5f9f8818797e515/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:42.536904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03163640-cf9d-4599-9a2c-1f3e80ecd6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad8a45c6e164ae59a16e3e3a8cbf0f0, user_id=6f57293c4c64419ba5f9f8818797e515, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:42.540043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03163640-cf9d-4599-9a2c-1f3e80ecd6ea admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:42.561535 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2751/5490] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:42 2022] PUT /identity/v3/projects/dad8a45c6e164ae59a16e3e3a8cbf0f0/users/6f57293c4c64419ba5f9f8818797e515/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:06:42.574707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39a8cc-d2bc-4c8d-889b-3cd09cd5cfeb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:42.575131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39a8cc-d2bc-4c8d-889b-3cd09cd5cfeb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:42.575515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39a8cc-d2bc-4c8d-889b-3cd09cd5cfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:42.595318 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:42.631674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8e91c-8c5d-4305-9043-27efa5ac94fd None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:42.648746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1d39a8cc-d2bc-4c8d-889b-3cd09cd5cfeb None None] MFA Rules not processed for user `6f57293c4c64419ba5f9f8818797e515`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:42.649956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1d39a8cc-d2bc-4c8d-889b-3cd09cd5cfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:42.738688 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:42.744299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d0ec1-9647-4bca-9e72-b04179cf1c3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:42.744954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d0ec1-9647-4bca-9e72-b04179cf1c3c service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:42.745320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d0ec1-9647-4bca-9e72-b04179cf1c3c service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:42.745502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d0ec1-9647-4bca-9e72-b04179cf1c3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:42.753663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f25d0ec1-9647-4bca-9e72-b04179cf1c3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:42.774364 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2752/5491] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:42.782913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89476233-cd6c-482e-9a26-f8c51806263b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:42.784501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89476233-cd6c-482e-9a26-f8c51806263b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:42.784930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89476233-cd6c-482e-9a26-f8c51806263b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:42.833629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-89476233-cd6c-482e-9a26-f8c51806263b None None] MFA Rules not processed for user `f0e8405dde7241c8b6e1fe97702564fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:42.835152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-89476233-cd6c-482e-9a26-f8c51806263b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:42.885452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d0ec1-9647-4bca-9e72-b04179cf1c3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:42.886934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d0ec1-9647-4bca-9e72-b04179cf1c3c service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:42.927281 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2740/5492] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:06:42.929859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d0ec1-9647-4bca-9e72-b04179cf1c3c service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:42.933412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f25d0ec1-9647-4bca-9e72-b04179cf1c3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:42.995161 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2753/5493] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:43.064978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d0ec1-9647-4bca-9e72-b04179cf1c3c service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:43.076191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb428bb-7a85-4ac5-bf4b-c6e02c41f6de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:43.076976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb428bb-7a85-4ac5-bf4b-c6e02c41f6de service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:43.078615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb428bb-7a85-4ac5-bf4b-c6e02c41f6de service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:43.078615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb428bb-7a85-4ac5-bf4b-c6e02c41f6de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:43.097588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb428bb-7a85-4ac5-bf4b-c6e02c41f6de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:43.099211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb428bb-7a85-4ac5-bf4b-c6e02c41f6de service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:43.124710 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2741/5494] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:06:43.588585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89476233-cd6c-482e-9a26-f8c51806263b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:43.727063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89476233-cd6c-482e-9a26-f8c51806263b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:43.738652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb0844-51d9-4c61-956a-ddd899d025cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:43.740061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb0844-51d9-4c61-956a-ddd899d025cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:43.740640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb0844-51d9-4c61-956a-ddd899d025cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:43.741195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb0844-51d9-4c61-956a-ddd899d025cb admin admin] PATH_INFO: `/v3/users/6f57293c4c64419ba5f9f8818797e515` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:43.742574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb0844-51d9-4c61-956a-ddd899d025cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f57293c4c64419ba5f9f8818797e515)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:43.744916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb0844-51d9-4c61-956a-ddd899d025cb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:43.798312 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:43.817004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1ecb0844-51d9-4c61-956a-ddd899d025cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f57293c4c64419ba5f9f8818797e515'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:43.818695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1ecb0844-51d9-4c61-956a-ddd899d025cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f57293c4c64419ba5f9f8818797e515'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:43.830623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1ecb0844-51d9-4c61-956a-ddd899d025cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f57293c4c64419ba5f9f8818797e515'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:43.848221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1ecb0844-51d9-4c61-956a-ddd899d025cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f57293c4c64419ba5f9f8818797e515'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:43.859338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1ecb0844-51d9-4c61-956a-ddd899d025cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f57293c4c64419ba5f9f8818797e515'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:43.868318 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2754/5495] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:06:43 2022] DELETE /identity/v3/users/6f57293c4c64419ba5f9f8818797e515 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:06:43.873354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2262961-9f19-41fe-8799-c6f6759933c8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:43.873888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2262961-9f19-41fe-8799-c6f6759933c8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:43.873888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2262961-9f19-41fe-8799-c6f6759933c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:43.909793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f2262961-9f19-41fe-8799-c6f6759933c8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:43.911110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f2262961-9f19-41fe-8799-c6f6759933c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:44.062446 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2742/5496] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:44.082537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb0844-51d9-4c61-956a-ddd899d025cb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:44.083901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1ecb0844-51d9-4c61-956a-ddd899d025cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:44.166105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb0844-51d9-4c61-956a-ddd899d025cb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:44.170449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19419354-dbc0-4434-8f65-43ea628b134f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:44.171554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19419354-dbc0-4434-8f65-43ea628b134f service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:44.172011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19419354-dbc0-4434-8f65-43ea628b134f service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:44.172439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19419354-dbc0-4434-8f65-43ea628b134f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:44.186629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19419354-dbc0-4434-8f65-43ea628b134f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:44.189193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19419354-dbc0-4434-8f65-43ea628b134f service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:44.206374 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2755/5497] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:06:45.461988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2262961-9f19-41fe-8799-c6f6759933c8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:45.464072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f2262961-9f19-41fe-8799-c6f6759933c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:45.480616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2262961-9f19-41fe-8799-c6f6759933c8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:45.487014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672867f7-a928-4a49-b559-5ff094e7c139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:45.494990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672867f7-a928-4a49-b559-5ff094e7c139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:45.500180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672867f7-a928-4a49-b559-5ff094e7c139 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:45.500641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672867f7-a928-4a49-b559-5ff094e7c139 admin admin] PATH_INFO: `/v3/projects/dad8a45c6e164ae59a16e3e3a8cbf0f0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:45.509146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672867f7-a928-4a49-b559-5ff094e7c139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dad8a45c6e164ae59a16e3e3a8cbf0f0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:45.515275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672867f7-a928-4a49-b559-5ff094e7c139 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:45.674328 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:45.688861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-672867f7-a928-4a49-b559-5ff094e7c139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad8a45c6e164ae59a16e3e3a8cbf0f0', 'request_id': 'req-672867f7-a928-4a49-b559-5ff094e7c139'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:45.710327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-672867f7-a928-4a49-b559-5ff094e7c139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad8a45c6e164ae59a16e3e3a8cbf0f0', 'request_id': 'req-672867f7-a928-4a49-b559-5ff094e7c139'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:45.725998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-672867f7-a928-4a49-b559-5ff094e7c139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad8a45c6e164ae59a16e3e3a8cbf0f0', 'request_id': 'req-672867f7-a928-4a49-b559-5ff094e7c139'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:45.749359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-672867f7-a928-4a49-b559-5ff094e7c139 admin admin] The token cache is being invalidate because project dad8a45c6e164ae59a16e3e3a8cbf0f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:06:45.749918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-672867f7-a928-4a49-b559-5ff094e7c139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:45.750770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-672867f7-a928-4a49-b559-5ff094e7c139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:45.756283 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2743/5498] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:45 2022] DELETE /identity/v3/projects/dad8a45c6e164ae59a16e3e3a8cbf0f0 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:45.762238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa02925-9377-422e-b373-335ac36afb85 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:45.763106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa02925-9377-422e-b373-335ac36afb85 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:45.763541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa02925-9377-422e-b373-335ac36afb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:45.797708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-efa02925-9377-422e-b373-335ac36afb85 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:45.800284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-efa02925-9377-422e-b373-335ac36afb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:45.902070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672867f7-a928-4a49-b559-5ff094e7c139 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:45.902961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-672867f7-a928-4a49-b559-5ff094e7c139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:46.052647 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2756/5499] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:46.079848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672867f7-a928-4a49-b559-5ff094e7c139 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:46.086355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e368ceb-b89b-406a-a7c0-c67a5b35fff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:46.087358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e368ceb-b89b-406a-a7c0-c67a5b35fff7 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:46.087831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e368ceb-b89b-406a-a7c0-c67a5b35fff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:46.088313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e368ceb-b89b-406a-a7c0-c67a5b35fff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:46.090713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2e368ceb-b89b-406a-a7c0-c67a5b35fff7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:46.166363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100b84b-3c42-4ca2-a258-3591f8f4313c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:46.169568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100b84b-3c42-4ca2-a258-3591f8f4313c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:46.170063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100b84b-3c42-4ca2-a258-3591f8f4313c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:46.202013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0100b84b-3c42-4ca2-a258-3591f8f4313c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:46.204859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0100b84b-3c42-4ca2-a258-3591f8f4313c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:46.218051 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2757/5500] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:46.222191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100b84b-3c42-4ca2-a258-3591f8f4313c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:46.236343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100b84b-3c42-4ca2-a258-3591f8f4313c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:46.245310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f0e93-bdaa-4fe3-a89d-572a28f4f2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:46.246682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f0e93-bdaa-4fe3-a89d-572a28f4f2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:46.247394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f0e93-bdaa-4fe3-a89d-572a28f4f2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:46.247968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f0e93-bdaa-4fe3-a89d-572a28f4f2d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:46.249003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f0e93-bdaa-4fe3-a89d-572a28f4f2d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:06:46.249586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f0e93-bdaa-4fe3-a89d-572a28f4f2d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:46.252469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f0e93-bdaa-4fe3-a89d-572a28f4f2d9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:46.253089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e368ceb-b89b-406a-a7c0-c67a5b35fff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:46.256056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e368ceb-b89b-406a-a7c0-c67a5b35fff7 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:46.270300 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2758/5501] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:06:46.276103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f0e93-bdaa-4fe3-a89d-572a28f4f2d9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:46.284366 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2744/5502] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:06:46.292705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f0e93-bdaa-4fe3-a89d-572a28f4f2d9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:46.296561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770bc2c-6fdc-45fb-9425-fd65449af3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:46.297219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770bc2c-6fdc-45fb-9425-fd65449af3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:46.297506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770bc2c-6fdc-45fb-9425-fd65449af3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:46.297780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770bc2c-6fdc-45fb-9425-fd65449af3f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:46.298477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770bc2c-6fdc-45fb-9425-fd65449af3f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:46.300473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770bc2c-6fdc-45fb-9425-fd65449af3f4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:46.355439 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2759/5503] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:06:46 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:06:46.359524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e368ceb-b89b-406a-a7c0-c67a5b35fff7 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:46.381637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e368ceb-b89b-406a-a7c0-c67a5b35fff7 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:46.506344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f55101-3eb4-4343-bb9e-19a60a34f14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:46.507789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f55101-3eb4-4343-bb9e-19a60a34f14f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:46.508689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f55101-3eb4-4343-bb9e-19a60a34f14f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:46.509175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f55101-3eb4-4343-bb9e-19a60a34f14f admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:46.510276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f55101-3eb4-4343-bb9e-19a60a34f14f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:46.514194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f55101-3eb4-4343-bb9e-19a60a34f14f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:46.573844 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2745/5504] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:06:46 2022] POST /identity/v3/users => generated 285 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:46.578476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770bc2c-6fdc-45fb-9425-fd65449af3f4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:46.596095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770bc2c-6fdc-45fb-9425-fd65449af3f4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:46.612531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4c6dd-d9d6-4ced-a828-a36ae7f0a357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:46.613558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4c6dd-d9d6-4ced-a828-a36ae7f0a357 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:46.613558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4c6dd-d9d6-4ced-a828-a36ae7f0a357 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:46.613775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4c6dd-d9d6-4ced-a828-a36ae7f0a357 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:46.615067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4c6dd-d9d6-4ced-a828-a36ae7f0a357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:46.617283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4c6dd-d9d6-4ced-a828-a36ae7f0a357 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:46.620318 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:46.642412 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2760/5505] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:46.647395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f55101-3eb4-4343-bb9e-19a60a34f14f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:46.658617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f55101-3eb4-4343-bb9e-19a60a34f14f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:46.673983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b089962-45c2-4136-adf6-5c7115bcdd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:46.675000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b089962-45c2-4136-adf6-5c7115bcdd0f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:46.675482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b089962-45c2-4136-adf6-5c7115bcdd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:46.675907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b089962-45c2-4136-adf6-5c7115bcdd0f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:46.676885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b089962-45c2-4136-adf6-5c7115bcdd0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:46.678776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b089962-45c2-4136-adf6-5c7115bcdd0f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:46.680627 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:46.697298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4c6dd-d9d6-4ced-a828-a36ae7f0a357 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:46.697922 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2746/5506] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:46.712983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4c6dd-d9d6-4ced-a828-a36ae7f0a357 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:46.724708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad1954-4d07-4e60-a418-12da0b4b6e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:46.725396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad1954-4d07-4e60-a418-12da0b4b6e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:46.725682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad1954-4d07-4e60-a418-12da0b4b6e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:46.725951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad1954-4d07-4e60-a418-12da0b4b6e47 admin admin] PATH_INFO: `/v3/projects/6b937ebafb7a4c3481b705636c3fab43/users/5c68691f5efd43df97312495ef0e558c/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:46.774524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad1954-4d07-4e60-a418-12da0b4b6e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b937ebafb7a4c3481b705636c3fab43, user_id=5c68691f5efd43df97312495ef0e558c, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:46.780476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad1954-4d07-4e60-a418-12da0b4b6e47 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:46.806177 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2761/5507] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:46 2022] PUT /identity/v3/projects/6b937ebafb7a4c3481b705636c3fab43/users/5c68691f5efd43df97312495ef0e558c/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:46.818415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2061a-a6ef-4301-8a54-d0244257b1cd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:46.819574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2061a-a6ef-4301-8a54-d0244257b1cd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:46.820079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2061a-a6ef-4301-8a54-d0244257b1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:46.857959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-64c2061a-a6ef-4301-8a54-d0244257b1cd None None] MFA Rules not processed for user `5c68691f5efd43df97312495ef0e558c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:46.859518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-64c2061a-a6ef-4301-8a54-d0244257b1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:46.999767 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2747/5508] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:47.004313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad1954-4d07-4e60-a418-12da0b4b6e47 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:47.117354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad1954-4d07-4e60-a418-12da0b4b6e47 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:47.122431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdd930-161c-4cbb-9e15-3a2c0f38e4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:47.123045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdd930-161c-4cbb-9e15-3a2c0f38e4cd admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:47.123324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdd930-161c-4cbb-9e15-3a2c0f38e4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:47.123594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdd930-161c-4cbb-9e15-3a2c0f38e4cd admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:47.124354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bdd930-161c-4cbb-9e15-3a2c0f38e4cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:47.126449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bdd930-161c-4cbb-9e15-3a2c0f38e4cd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:47.165654 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2762/5509] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:06:47 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:47.168149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2061a-a6ef-4301-8a54-d0244257b1cd None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:47.201843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2061a-a6ef-4301-8a54-d0244257b1cd None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:47.310079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444ed5e-77a4-41f8-abf3-42ddc88b4773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:47.311002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444ed5e-77a4-41f8-abf3-42ddc88b4773 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:47.312476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444ed5e-77a4-41f8-abf3-42ddc88b4773 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:47.312898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444ed5e-77a4-41f8-abf3-42ddc88b4773 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:47.316491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444ed5e-77a4-41f8-abf3-42ddc88b4773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:47.320259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444ed5e-77a4-41f8-abf3-42ddc88b4773 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:47.320881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1d4f4-d3ac-4aae-ae6e-f6a2d5def7e2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:47.321178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1d4f4-d3ac-4aae-ae6e-f6a2d5def7e2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:47.321471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1d4f4-d3ac-4aae-ae6e-f6a2d5def7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:47.347916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-68d1d4f4-d3ac-4aae-ae6e-f6a2d5def7e2 None None] MFA Rules not processed for user `ef13867e7dc6433283f59bb0121af017`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:47.354389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-68d1d4f4-d3ac-4aae-ae6e-f6a2d5def7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:47.360894 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2748/5510] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:06:47 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:47.362405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444ed5e-77a4-41f8-abf3-42ddc88b4773 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:47.381296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444ed5e-77a4-41f8-abf3-42ddc88b4773 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:47.397443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e42ff-f709-4dde-bedb-d8a6af3a2bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:47.399383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e42ff-f709-4dde-bedb-d8a6af3a2bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:47.399769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e42ff-f709-4dde-bedb-d8a6af3a2bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:47.400166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e42ff-f709-4dde-bedb-d8a6af3a2bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:47.400997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e42ff-f709-4dde-bedb-d8a6af3a2bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:47.405079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e42ff-f709-4dde-bedb-d8a6af3a2bd1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:47.431498 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2749/5511] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:47.432697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e42ff-f709-4dde-bedb-d8a6af3a2bd1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:47.467792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e42ff-f709-4dde-bedb-d8a6af3a2bd1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:47.486423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd83ee-4a9b-4382-8753-fdf4b843c718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:47.487469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd83ee-4a9b-4382-8753-fdf4b843c718 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:47.487907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd83ee-4a9b-4382-8753-fdf4b843c718 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:47.488709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd83ee-4a9b-4382-8753-fdf4b843c718 admin admin] PATH_INFO: `/v3/projects/4072cc7d5eaa491d99d1e7275d89753f/users/ce7d42b76f3c4acd99252e018b864e11/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:47.496651 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2763/5512] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:47 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:47.524721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd83ee-4a9b-4382-8753-fdf4b843c718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4072cc7d5eaa491d99d1e7275d89753f, user_id=ce7d42b76f3c4acd99252e018b864e11, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:47.529814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd83ee-4a9b-4382-8753-fdf4b843c718 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:47.548352 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2750/5513] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:47 2022] PUT /identity/v3/projects/4072cc7d5eaa491d99d1e7275d89753f/users/ce7d42b76f3c4acd99252e018b864e11/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:47.553469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1d4f4-d3ac-4aae-ae6e-f6a2d5def7e2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:47.569778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1d4f4-d3ac-4aae-ae6e-f6a2d5def7e2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:47.756288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfc267-2599-40c2-bae1-1a6ffa355aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:47.756288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfc267-2599-40c2-bae1-1a6ffa355aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:47.756288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfc267-2599-40c2-bae1-1a6ffa355aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:47.756288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfc267-2599-40c2-bae1-1a6ffa355aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:47.763237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddfc267-2599-40c2-bae1-1a6ffa355aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:47.765677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddfc267-2599-40c2-bae1-1a6ffa355aa9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:47.783575 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:47.805494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd83ee-4a9b-4382-8753-fdf4b843c718 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:47.818690 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2764/5514] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:47.836453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd83ee-4a9b-4382-8753-fdf4b843c718 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:47.836956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a8419-f295-4200-bc4d-6a57b0125254 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:47.837242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a8419-f295-4200-bc4d-6a57b0125254 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:47.837517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a8419-f295-4200-bc4d-6a57b0125254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:47.848264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6355834-a034-43e5-a4da-3b23d8a96f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:47.851345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6355834-a034-43e5-a4da-3b23d8a96f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:47.851670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6355834-a034-43e5-a4da-3b23d8a96f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:47.852124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6355834-a034-43e5-a4da-3b23d8a96f27 admin admin] PATH_INFO: `/v3/projects/4072cc7d5eaa491d99d1e7275d89753f/users/ce7d42b76f3c4acd99252e018b864e11/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:47.857912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6355834-a034-43e5-a4da-3b23d8a96f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4072cc7d5eaa491d99d1e7275d89753f, user_id=ce7d42b76f3c4acd99252e018b864e11, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:47.865322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6355834-a034-43e5-a4da-3b23d8a96f27 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:47.888232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f37a8419-f295-4200-bc4d-6a57b0125254 None None] MFA Rules not processed for user `ef13867e7dc6433283f59bb0121af017`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:47.892691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f37a8419-f295-4200-bc4d-6a57b0125254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:47.893938 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2751/5515] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:47 2022] PUT /identity/v3/projects/4072cc7d5eaa491d99d1e7275d89753f/users/ce7d42b76f3c4acd99252e018b864e11/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:06:47.908806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72d524-363e-4a5d-8dac-7ee36a55d00b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:47.909546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72d524-363e-4a5d-8dac-7ee36a55d00b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:47.910586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72d524-363e-4a5d-8dac-7ee36a55d00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:47.993712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6d72d524-363e-4a5d-8dac-7ee36a55d00b None None] MFA Rules not processed for user `ce7d42b76f3c4acd99252e018b864e11`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:47.998297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6d72d524-363e-4a5d-8dac-7ee36a55d00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:48.038804 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:48.083881 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2765/5516] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:47 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:06:48.122757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe360c4-180f-4aab-928f-4183679ce891 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:48.123073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe360c4-180f-4aab-928f-4183679ce891 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:48.123797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe360c4-180f-4aab-928f-4183679ce891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:48.172981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bfe360c4-180f-4aab-928f-4183679ce891 None None] MFA Rules not processed for user `ef13867e7dc6433283f59bb0121af017`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:48.176973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bfe360c4-180f-4aab-928f-4183679ce891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:48.224083 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2766/5517] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:48 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:06:48.260073 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2752/5518] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:06:48.303330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecbf95-676a-4bd0-8672-13b1473d4236 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:48.304313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecbf95-676a-4bd0-8672-13b1473d4236 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:48.304778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecbf95-676a-4bd0-8672-13b1473d4236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:48.351221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72d524-363e-4a5d-8dac-7ee36a55d00b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:48.352947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6d72d524-363e-4a5d-8dac-7ee36a55d00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:48.369502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c6ecbf95-676a-4bd0-8672-13b1473d4236 None None] MFA Rules not processed for user `ef13867e7dc6433283f59bb0121af017`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:48.376861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c6ecbf95-676a-4bd0-8672-13b1473d4236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:48.406725 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2767/5519] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:48 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:48.451184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0b948-9544-458a-a85a-f6f9aa78f783 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:48.451469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0b948-9544-458a-a85a-f6f9aa78f783 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:48.451742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0b948-9544-458a-a85a-f6f9aa78f783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:48.517576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-39e0b948-9544-458a-a85a-f6f9aa78f783 None None] MFA Rules not processed for user `ef13867e7dc6433283f59bb0121af017`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:48.518998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-39e0b948-9544-458a-a85a-f6f9aa78f783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:48.521454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72d524-363e-4a5d-8dac-7ee36a55d00b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:48.527389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9401d-230e-4521-a887-92ba023933fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:48.528234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9401d-230e-4521-a887-92ba023933fa service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:48.528405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9401d-230e-4521-a887-92ba023933fa service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:48.528567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9401d-230e-4521-a887-92ba023933fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:48.539742 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2768/5520] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:48 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:48.548179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9401d-230e-4521-a887-92ba023933fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:48.549801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9401d-230e-4521-a887-92ba023933fa service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:48.581528 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2753/5521] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:06:50.188235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0b948-9544-458a-a85a-f6f9aa78f783 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:50.190108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-39e0b948-9544-458a-a85a-f6f9aa78f783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:50.338384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0b948-9544-458a-a85a-f6f9aa78f783 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:50.343820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98c3b3-fd0c-43f1-9ec8-eec4c4d59c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:50.344755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98c3b3-fd0c-43f1-9ec8-eec4c4d59c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:50.345215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98c3b3-fd0c-43f1-9ec8-eec4c4d59c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:50.345845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98c3b3-fd0c-43f1-9ec8-eec4c4d59c1a admin admin] PATH_INFO: `/v3/users/59042296e6904e7aafe95af041b768bc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:50.347198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f98c3b3-fd0c-43f1-9ec8-eec4c4d59c1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=59042296e6904e7aafe95af041b768bc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:50.350459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f98c3b3-fd0c-43f1-9ec8-eec4c4d59c1a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:50.449600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2f98c3b3-fd0c-43f1-9ec8-eec4c4d59c1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59042296e6904e7aafe95af041b768bc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:50.460092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2f98c3b3-fd0c-43f1-9ec8-eec4c4d59c1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59042296e6904e7aafe95af041b768bc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:50.481953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2f98c3b3-fd0c-43f1-9ec8-eec4c4d59c1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59042296e6904e7aafe95af041b768bc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:50.511453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2f98c3b3-fd0c-43f1-9ec8-eec4c4d59c1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59042296e6904e7aafe95af041b768bc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:50.537631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2f98c3b3-fd0c-43f1-9ec8-eec4c4d59c1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59042296e6904e7aafe95af041b768bc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:50.560163 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2769/5522] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:06:50 2022] DELETE /identity/v3/users/59042296e6904e7aafe95af041b768bc => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:50.560883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03238ce1-296c-47dd-afd6-7bcbe86cba4c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:50.561874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03238ce1-296c-47dd-afd6-7bcbe86cba4c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:50.562313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03238ce1-296c-47dd-afd6-7bcbe86cba4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:50.602679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-03238ce1-296c-47dd-afd6-7bcbe86cba4c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:50.603922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-03238ce1-296c-47dd-afd6-7bcbe86cba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:50.719489 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2754/5523] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:50.748076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98c3b3-fd0c-43f1-9ec8-eec4c4d59c1a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:50.751978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2f98c3b3-fd0c-43f1-9ec8-eec4c4d59c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:50.763582 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:50.925492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98c3b3-fd0c-43f1-9ec8-eec4c4d59c1a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:50.938844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7d157-b32d-48b0-8868-59af2b7d4061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:50.939711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7d157-b32d-48b0-8868-59af2b7d4061 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:50.940275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7d157-b32d-48b0-8868-59af2b7d4061 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:50.940846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7d157-b32d-48b0-8868-59af2b7d4061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:50.960221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7d157-b32d-48b0-8868-59af2b7d4061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:50.964178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7d157-b32d-48b0-8868-59af2b7d4061 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:50.987431 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2770/5524] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:06:52.463855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03238ce1-296c-47dd-afd6-7bcbe86cba4c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:52.466420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-03238ce1-296c-47dd-afd6-7bcbe86cba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:52.494782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03238ce1-296c-47dd-afd6-7bcbe86cba4c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:52.519320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f9102-e2b1-44af-858e-d58cbbf286ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:52.520472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f9102-e2b1-44af-858e-d58cbbf286ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:52.520948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f9102-e2b1-44af-858e-d58cbbf286ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:52.521427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f9102-e2b1-44af-858e-d58cbbf286ee admin admin] PATH_INFO: `/v3/projects/d7e428258bb647b8af427e73b89feade` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:52.528238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f9102-e2b1-44af-858e-d58cbbf286ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7e428258bb647b8af427e73b89feade)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:52.534971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f9102-e2b1-44af-858e-d58cbbf286ee admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:52.664254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-398f9102-e2b1-44af-858e-d58cbbf286ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7e428258bb647b8af427e73b89feade', 'request_id': 'req-398f9102-e2b1-44af-858e-d58cbbf286ee'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:52.666981 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:52.685868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-398f9102-e2b1-44af-858e-d58cbbf286ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7e428258bb647b8af427e73b89feade', 'request_id': 'req-398f9102-e2b1-44af-858e-d58cbbf286ee'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:52.696912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-398f9102-e2b1-44af-858e-d58cbbf286ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7e428258bb647b8af427e73b89feade', 'request_id': 'req-398f9102-e2b1-44af-858e-d58cbbf286ee'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:52.721572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-398f9102-e2b1-44af-858e-d58cbbf286ee admin admin] The token cache is being invalidate because project d7e428258bb647b8af427e73b89feade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:06:52.722160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-398f9102-e2b1-44af-858e-d58cbbf286ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:52.724168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-398f9102-e2b1-44af-858e-d58cbbf286ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:52.743187 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2755/5525] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:52 2022] DELETE /identity/v3/projects/d7e428258bb647b8af427e73b89feade => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:52.743940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7d157-b32d-48b0-8868-59af2b7d4061 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:52.756479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7d157-b32d-48b0-8868-59af2b7d4061 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:52.974241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b297df4-744b-415e-ada0-c2eacf167be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:52.974957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b297df4-744b-415e-ada0-c2eacf167be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:52.975236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b297df4-744b-415e-ada0-c2eacf167be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:52.976594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b297df4-744b-415e-ada0-c2eacf167be0 admin admin] PATH_INFO: `/v3/users/5e90569599844297a51235fe4a8f9318` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:52.977880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b297df4-744b-415e-ada0-c2eacf167be0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e90569599844297a51235fe4a8f9318)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:52.979909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b297df4-744b-415e-ada0-c2eacf167be0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:53.135299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b297df4-744b-415e-ada0-c2eacf167be0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e90569599844297a51235fe4a8f9318'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:53.135980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b297df4-744b-415e-ada0-c2eacf167be0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e90569599844297a51235fe4a8f9318'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:53.154447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b297df4-744b-415e-ada0-c2eacf167be0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e90569599844297a51235fe4a8f9318'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:53.195468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b297df4-744b-415e-ada0-c2eacf167be0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e90569599844297a51235fe4a8f9318'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:53.231317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b297df4-744b-415e-ada0-c2eacf167be0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e90569599844297a51235fe4a8f9318'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:53.258449 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2771/5526] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:06:52 2022] DELETE /identity/v3/users/5e90569599844297a51235fe4a8f9318 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:54.182331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f9102-e2b1-44af-858e-d58cbbf286ee admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:54.190988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-398f9102-e2b1-44af-858e-d58cbbf286ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:54.222272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f9102-e2b1-44af-858e-d58cbbf286ee admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:54.337626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708479c-f447-47d6-931e-e0a54d2c8a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:54.340572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708479c-f447-47d6-931e-e0a54d2c8a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:54.344782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708479c-f447-47d6-931e-e0a54d2c8a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:54.345959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708479c-f447-47d6-931e-e0a54d2c8a79 admin admin] PATH_INFO: `/v3/projects/7676de16739049259383ae3f3b4a33e7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:54.349396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708479c-f447-47d6-931e-e0a54d2c8a79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7676de16739049259383ae3f3b4a33e7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:54.354828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708479c-f447-47d6-931e-e0a54d2c8a79 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:54.452376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c708479c-f447-47d6-931e-e0a54d2c8a79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7676de16739049259383ae3f3b4a33e7', 'request_id': 'req-c708479c-f447-47d6-931e-e0a54d2c8a79'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:54.465404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c708479c-f447-47d6-931e-e0a54d2c8a79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7676de16739049259383ae3f3b4a33e7', 'request_id': 'req-c708479c-f447-47d6-931e-e0a54d2c8a79'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:54.477139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c708479c-f447-47d6-931e-e0a54d2c8a79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7676de16739049259383ae3f3b4a33e7', 'request_id': 'req-c708479c-f447-47d6-931e-e0a54d2c8a79'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:54.495299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c708479c-f447-47d6-931e-e0a54d2c8a79 admin admin] The token cache is being invalidate because project 7676de16739049259383ae3f3b4a33e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:06:54.496022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c708479c-f447-47d6-931e-e0a54d2c8a79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:54.497065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c708479c-f447-47d6-931e-e0a54d2c8a79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:54.499783 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2756/5527] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:54 2022] DELETE /identity/v3/projects/7676de16739049259383ae3f3b4a33e7 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:54.505243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73a57c-24b5-435e-9ecb-91bab2ab1ac1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:54.506194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73a57c-24b5-435e-9ecb-91bab2ab1ac1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:54.506654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73a57c-24b5-435e-9ecb-91bab2ab1ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:54.547655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-de73a57c-24b5-435e-9ecb-91bab2ab1ac1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:54.549507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-de73a57c-24b5-435e-9ecb-91bab2ab1ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:54.588159 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:54.724559 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2772/5528] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:06:54.733494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f334a7-379d-4719-ae10-22c04e1fb299 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:54.734062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f334a7-379d-4719-ae10-22c04e1fb299 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:54.734551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f334a7-379d-4719-ae10-22c04e1fb299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:54.784160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c1f334a7-379d-4719-ae10-22c04e1fb299 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:54.801288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c1f334a7-379d-4719-ae10-22c04e1fb299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:54.829126 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2757/5529] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:54.834578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73a57c-24b5-435e-9ecb-91bab2ab1ac1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:54.850367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73a57c-24b5-435e-9ecb-91bab2ab1ac1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:54.883173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ae142-919e-4f50-8399-55f02a16babe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:54.884116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ae142-919e-4f50-8399-55f02a16babe admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:54.893161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ae142-919e-4f50-8399-55f02a16babe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:54.894001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ae142-919e-4f50-8399-55f02a16babe admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:54.896570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ae142-919e-4f50-8399-55f02a16babe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:06:54.898290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ae142-919e-4f50-8399-55f02a16babe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:54.906638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ae142-919e-4f50-8399-55f02a16babe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:54.952398 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2773/5530] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:06:54.956988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f334a7-379d-4719-ae10-22c04e1fb299 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:54.970507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f334a7-379d-4719-ae10-22c04e1fb299 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:55.000612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282eeb78-8bab-42dd-b9e6-d3d0391aa8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:55.001713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eeb78-8bab-42dd-b9e6-d3d0391aa8cf admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:55.002165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eeb78-8bab-42dd-b9e6-d3d0391aa8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:55.002453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eeb78-8bab-42dd-b9e6-d3d0391aa8cf admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:55.003314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282eeb78-8bab-42dd-b9e6-d3d0391aa8cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:55.014593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282eeb78-8bab-42dd-b9e6-d3d0391aa8cf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:55.091613 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2758/5531] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:06:54 2022] POST /identity/v3/projects => generated 407 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:55.096839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ae142-919e-4f50-8399-55f02a16babe admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:55.130923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ae142-919e-4f50-8399-55f02a16babe admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:55.314244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af3ac9-8e55-48bc-959c-2ffcb6a77d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:55.314832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af3ac9-8e55-48bc-959c-2ffcb6a77d1c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:55.315114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af3ac9-8e55-48bc-959c-2ffcb6a77d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:55.315393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af3ac9-8e55-48bc-959c-2ffcb6a77d1c admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:55.316035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af3ac9-8e55-48bc-959c-2ffcb6a77d1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:55.318929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af3ac9-8e55-48bc-959c-2ffcb6a77d1c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:55.374906 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2774/5532] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:06:55 2022] POST /identity/v3/users => generated 304 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:55.378934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282eeb78-8bab-42dd-b9e6-d3d0391aa8cf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:55.399078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282eeb78-8bab-42dd-b9e6-d3d0391aa8cf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:55.414771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78256a23-9c4e-492d-b8b7-f2bc3e95f0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:55.415489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78256a23-9c4e-492d-b8b7-f2bc3e95f0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:55.415845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78256a23-9c4e-492d-b8b7-f2bc3e95f0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:55.416191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78256a23-9c4e-492d-b8b7-f2bc3e95f0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:55.417050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78256a23-9c4e-492d-b8b7-f2bc3e95f0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:55.421112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78256a23-9c4e-492d-b8b7-f2bc3e95f0a1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:55.462007 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2759/5533] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:55.463597 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af3ac9-8e55-48bc-959c-2ffcb6a77d1c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:55.477414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af3ac9-8e55-48bc-959c-2ffcb6a77d1c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:55.495233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781fda8-e90a-4149-a813-da5562f83df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:55.496584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781fda8-e90a-4149-a813-da5562f83df7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:55.496907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781fda8-e90a-4149-a813-da5562f83df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:55.497212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781fda8-e90a-4149-a813-da5562f83df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:55.498009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781fda8-e90a-4149-a813-da5562f83df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:55.500278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781fda8-e90a-4149-a813-da5562f83df7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:55.516355 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2775/5534] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:55.520838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78256a23-9c4e-492d-b8b7-f2bc3e95f0a1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:55.539498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78256a23-9c4e-492d-b8b7-f2bc3e95f0a1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:55.547316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440008c-ffea-46ab-93fd-613d14bbc541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:55.549515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440008c-ffea-46ab-93fd-613d14bbc541 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:55.550050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440008c-ffea-46ab-93fd-613d14bbc541 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:55.550564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440008c-ffea-46ab-93fd-613d14bbc541 admin admin] PATH_INFO: `/v3/projects/9dd869e85dc048ca8f466c5bd04450cd/users/9b1fb6e4b13a459cb6e4b987be4a4f51/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:55.583686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440008c-ffea-46ab-93fd-613d14bbc541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd869e85dc048ca8f466c5bd04450cd, user_id=9b1fb6e4b13a459cb6e4b987be4a4f51, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:55.588221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781fda8-e90a-4149-a813-da5562f83df7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:55.590542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8781fda8-e90a-4149-a813-da5562f83df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:55.600821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440008c-ffea-46ab-93fd-613d14bbc541 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:55.613287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781fda8-e90a-4149-a813-da5562f83df7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:55.630935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1411f48-f325-45a9-9761-9a718a764df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:55.633429 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2760/5535] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:55 2022] PUT /identity/v3/projects/9dd869e85dc048ca8f466c5bd04450cd/users/9b1fb6e4b13a459cb6e4b987be4a4f51/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:55.633730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1411f48-f325-45a9-9761-9a718a764df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:55.634265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1411f48-f325-45a9-9761-9a718a764df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:55.634734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1411f48-f325-45a9-9761-9a718a764df6 admin admin] PATH_INFO: `/v3/users/5c68691f5efd43df97312495ef0e558c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:55.636153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1411f48-f325-45a9-9761-9a718a764df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c68691f5efd43df97312495ef0e558c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:55.638781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1411f48-f325-45a9-9761-9a718a764df6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:55.651050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0e9c5-b5a7-45f5-8e44-a4043c2e19d1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:55.652115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0e9c5-b5a7-45f5-8e44-a4043c2e19d1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:55.653114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0e9c5-b5a7-45f5-8e44-a4043c2e19d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:55.672461 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:55.716849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-92c0e9c5-b5a7-45f5-8e44-a4043c2e19d1 None None] MFA Rules not processed for user `9b1fb6e4b13a459cb6e4b987be4a4f51`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:55.718472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-92c0e9c5-b5a7-45f5-8e44-a4043c2e19d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:55.761982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f1411f48-f325-45a9-9761-9a718a764df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c68691f5efd43df97312495ef0e558c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:55.763330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f1411f48-f325-45a9-9761-9a718a764df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c68691f5efd43df97312495ef0e558c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:55.791558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f1411f48-f325-45a9-9761-9a718a764df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c68691f5efd43df97312495ef0e558c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:55.813219 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2761/5536] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:55 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:06:55.817012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f1411f48-f325-45a9-9761-9a718a764df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c68691f5efd43df97312495ef0e558c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:55.817960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0e9c5-b5a7-45f5-8e44-a4043c2e19d1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:55.820275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-92c0e9c5-b5a7-45f5-8e44-a4043c2e19d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:55.826272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f1411f48-f325-45a9-9761-9a718a764df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c68691f5efd43df97312495ef0e558c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:55.835856 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2776/5537] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:06:55 2022] DELETE /identity/v3/users/5c68691f5efd43df97312495ef0e558c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:55.839524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c730f-0a62-410f-b1f0-6da818bd8064 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:55.842124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c730f-0a62-410f-b1f0-6da818bd8064 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:55.842672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c730f-0a62-410f-b1f0-6da818bd8064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:55.867446 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:55.894751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ae8c730f-0a62-410f-b1f0-6da818bd8064 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:55.900059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ae8c730f-0a62-410f-b1f0-6da818bd8064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:55.904840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0e9c5-b5a7-45f5-8e44-a4043c2e19d1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:55.981339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b54b47-ff35-424a-ad7a-cb0928c7f112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:55.981975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b54b47-ff35-424a-ad7a-cb0928c7f112 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:55.982483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b54b47-ff35-424a-ad7a-cb0928c7f112 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:55.982762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b54b47-ff35-424a-ad7a-cb0928c7f112 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:55.984918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b54b47-ff35-424a-ad7a-cb0928c7f112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:55.990773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b54b47-ff35-424a-ad7a-cb0928c7f112 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:56.026446 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2777/5538] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:56.045355 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2762/5539] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:06:55 2022] POST /identity/v3/projects => generated 409 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:56.049869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c730f-0a62-410f-b1f0-6da818bd8064 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:56.062022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c730f-0a62-410f-b1f0-6da818bd8064 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:56.160967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27879d02-f85c-4bc0-b6fa-e665ce512226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:56.161917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27879d02-f85c-4bc0-b6fa-e665ce512226 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:56.162446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27879d02-f85c-4bc0-b6fa-e665ce512226 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:56.163309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27879d02-f85c-4bc0-b6fa-e665ce512226 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:56.164236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27879d02-f85c-4bc0-b6fa-e665ce512226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:56.167436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27879d02-f85c-4bc0-b6fa-e665ce512226 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:56.207488 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2778/5540] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:06:56 2022] POST /identity/v3/users => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:06:56.207727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b54b47-ff35-424a-ad7a-cb0928c7f112 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:56.221467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b54b47-ff35-424a-ad7a-cb0928c7f112 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:56.230195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f65ae1-591e-45fe-947b-90354bf4b4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:56.231260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f65ae1-591e-45fe-947b-90354bf4b4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:56.231734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f65ae1-591e-45fe-947b-90354bf4b4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:56.232377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f65ae1-591e-45fe-947b-90354bf4b4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:56.233256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f65ae1-591e-45fe-947b-90354bf4b4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:56.235413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f65ae1-591e-45fe-947b-90354bf4b4d3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:56.252083 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2763/5541] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:56.257104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27879d02-f85c-4bc0-b6fa-e665ce512226 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:56.273991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27879d02-f85c-4bc0-b6fa-e665ce512226 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:56.279244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce72529-e63b-4ac0-97ad-e1369a300747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:56.280021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce72529-e63b-4ac0-97ad-e1369a300747 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:56.280374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce72529-e63b-4ac0-97ad-e1369a300747 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:56.280763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce72529-e63b-4ac0-97ad-e1369a300747 admin admin] PATH_INFO: `/v3/projects/ff51fd6d33d842c9926e246d37b2a30f/users/435c5bdc064d442aa155643761f9959f/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:56.299462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce72529-e63b-4ac0-97ad-e1369a300747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff51fd6d33d842c9926e246d37b2a30f, user_id=435c5bdc064d442aa155643761f9959f, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:56.302302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce72529-e63b-4ac0-97ad-e1369a300747 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:56.325755 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2779/5542] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:56 2022] PUT /identity/v3/projects/ff51fd6d33d842c9926e246d37b2a30f/users/435c5bdc064d442aa155643761f9959f/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:56.327920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f65ae1-591e-45fe-947b-90354bf4b4d3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:56.346672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f65ae1-591e-45fe-947b-90354bf4b4d3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:56.366790 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:56.482208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871b0da-64f4-497f-9680-e37e94227812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:56.483030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871b0da-64f4-497f-9680-e37e94227812 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:56.483840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871b0da-64f4-497f-9680-e37e94227812 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:56.488554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871b0da-64f4-497f-9680-e37e94227812 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:56.489890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871b0da-64f4-497f-9680-e37e94227812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:56.491739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871b0da-64f4-497f-9680-e37e94227812 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:56.522027 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2764/5543] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:06:56.525932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce72529-e63b-4ac0-97ad-e1369a300747 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:56.537909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce72529-e63b-4ac0-97ad-e1369a300747 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:56.542939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f451402-3fa7-4b07-9481-1f056aa346db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:56.543734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f451402-3fa7-4b07-9481-1f056aa346db admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:56.544170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f451402-3fa7-4b07-9481-1f056aa346db admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:56.544696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f451402-3fa7-4b07-9481-1f056aa346db admin admin] PATH_INFO: `/v3/projects/ff51fd6d33d842c9926e246d37b2a30f/users/435c5bdc064d442aa155643761f9959f/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:56.546740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f451402-3fa7-4b07-9481-1f056aa346db admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff51fd6d33d842c9926e246d37b2a30f, user_id=435c5bdc064d442aa155643761f9959f, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:56.549555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f451402-3fa7-4b07-9481-1f056aa346db admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:56.564078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871b0da-64f4-497f-9680-e37e94227812 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:56.566176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8871b0da-64f4-497f-9680-e37e94227812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:56.573297 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2780/5544] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:06:56 2022] PUT /identity/v3/projects/ff51fd6d33d842c9926e246d37b2a30f/users/435c5bdc064d442aa155643761f9959f/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:06:56.585322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849d74c-6aa6-4859-bb6d-8fd451136cb2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:56.585616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849d74c-6aa6-4859-bb6d-8fd451136cb2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:56.585897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849d74c-6aa6-4859-bb6d-8fd451136cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:56.648907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5849d74c-6aa6-4859-bb6d-8fd451136cb2 None None] MFA Rules not processed for user `435c5bdc064d442aa155643761f9959f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:56.651874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5849d74c-6aa6-4859-bb6d-8fd451136cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:56.683927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871b0da-64f4-497f-9680-e37e94227812 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:56.770028 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:56.809575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807223a-cd85-4e9a-a018-c225be86b271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:56.810405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807223a-cd85-4e9a-a018-c225be86b271 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:56.812035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807223a-cd85-4e9a-a018-c225be86b271 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:56.812412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807223a-cd85-4e9a-a018-c225be86b271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:56.827795 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2781/5545] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:56 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:56.851736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849d74c-6aa6-4859-bb6d-8fd451136cb2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:56.853365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5849d74c-6aa6-4859-bb6d-8fd451136cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:56.873431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849d74c-6aa6-4859-bb6d-8fd451136cb2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:56.884543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1267aa-ec87-46c4-946e-20b501d25e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:56.885288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1267aa-ec87-46c4-946e-20b501d25e82 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:56.885664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1267aa-ec87-46c4-946e-20b501d25e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:56.886060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1267aa-ec87-46c4-946e-20b501d25e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:56.898806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1267aa-ec87-46c4-946e-20b501d25e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:56.900451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1267aa-ec87-46c4-946e-20b501d25e82 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:56.953327 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2782/5546] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:56 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:06:56.982834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807223a-cd85-4e9a-a018-c225be86b271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:56.984971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807223a-cd85-4e9a-a018-c225be86b271 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:57.005423 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2765/5547] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:06:57.486546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1267aa-ec87-46c4-946e-20b501d25e82 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:57.488194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-df1267aa-ec87-46c4-946e-20b501d25e82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:57.508495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1267aa-ec87-46c4-946e-20b501d25e82 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:57.515418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c7546-b3ae-471c-8d9d-782086b106fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:57.516074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c7546-b3ae-471c-8d9d-782086b106fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:57.516472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c7546-b3ae-471c-8d9d-782086b106fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:57.522535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c7546-b3ae-471c-8d9d-782086b106fd admin admin] PATH_INFO: `/v3/users/66b7820ce5e24aa897c7a02b31efaae9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:57.523911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c7546-b3ae-471c-8d9d-782086b106fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b7820ce5e24aa897c7a02b31efaae9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:57.528193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c7546-b3ae-471c-8d9d-782086b106fd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:57.612215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e73c7546-b3ae-471c-8d9d-782086b106fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b7820ce5e24aa897c7a02b31efaae9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:57.615297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e73c7546-b3ae-471c-8d9d-782086b106fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b7820ce5e24aa897c7a02b31efaae9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:57.631602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e73c7546-b3ae-471c-8d9d-782086b106fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b7820ce5e24aa897c7a02b31efaae9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:57.661886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e73c7546-b3ae-471c-8d9d-782086b106fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b7820ce5e24aa897c7a02b31efaae9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:57.671738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e73c7546-b3ae-471c-8d9d-782086b106fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b7820ce5e24aa897c7a02b31efaae9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:57.680521 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2783/5548] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:06:57 2022] DELETE /identity/v3/users/66b7820ce5e24aa897c7a02b31efaae9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:57.684840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1396f9-a214-489f-8e93-cffd92d79011 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:57.685333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1396f9-a214-489f-8e93-cffd92d79011 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:57.685437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1396f9-a214-489f-8e93-cffd92d79011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:57.706955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cb1396f9-a214-489f-8e93-cffd92d79011 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:57.709245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cb1396f9-a214-489f-8e93-cffd92d79011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:57.724946 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:57.878688 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2766/5549] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:06:57.904573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c7546-b3ae-471c-8d9d-782086b106fd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:57.906432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e73c7546-b3ae-471c-8d9d-782086b106fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:58.107672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c7546-b3ae-471c-8d9d-782086b106fd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:58.113036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02d6a9-bb4d-44ba-9a7c-06c231f8f578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:58.114293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02d6a9-bb4d-44ba-9a7c-06c231f8f578 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:58.114643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02d6a9-bb4d-44ba-9a7c-06c231f8f578 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:58.114983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02d6a9-bb4d-44ba-9a7c-06c231f8f578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:58.146418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02d6a9-bb4d-44ba-9a7c-06c231f8f578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:58.148097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02d6a9-bb4d-44ba-9a7c-06c231f8f578 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:58.159784 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2784/5550] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:06:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:06:58.356391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1396f9-a214-489f-8e93-cffd92d79011 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:58.357878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cb1396f9-a214-489f-8e93-cffd92d79011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:58.370513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1396f9-a214-489f-8e93-cffd92d79011 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:58.375894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3ac8f-f42a-49f0-9d03-f45f19779607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:58.376483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3ac8f-f42a-49f0-9d03-f45f19779607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:58.377072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3ac8f-f42a-49f0-9d03-f45f19779607 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:58.377351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3ac8f-f42a-49f0-9d03-f45f19779607 admin admin] PATH_INFO: `/v3/projects/6b937ebafb7a4c3481b705636c3fab43` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:58.378543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3ac8f-f42a-49f0-9d03-f45f19779607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b937ebafb7a4c3481b705636c3fab43)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:58.381039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3ac8f-f42a-49f0-9d03-f45f19779607 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:58.465251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-08b3ac8f-f42a-49f0-9d03-f45f19779607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b937ebafb7a4c3481b705636c3fab43', 'request_id': 'req-08b3ac8f-f42a-49f0-9d03-f45f19779607'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:58.483402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-08b3ac8f-f42a-49f0-9d03-f45f19779607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b937ebafb7a4c3481b705636c3fab43', 'request_id': 'req-08b3ac8f-f42a-49f0-9d03-f45f19779607'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:58.491953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-08b3ac8f-f42a-49f0-9d03-f45f19779607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b937ebafb7a4c3481b705636c3fab43', 'request_id': 'req-08b3ac8f-f42a-49f0-9d03-f45f19779607'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:58.512171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-08b3ac8f-f42a-49f0-9d03-f45f19779607 admin admin] The token cache is being invalidate because project 6b937ebafb7a4c3481b705636c3fab43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:06:58.512640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-08b3ac8f-f42a-49f0-9d03-f45f19779607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:58.513656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-08b3ac8f-f42a-49f0-9d03-f45f19779607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:58.516238 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2767/5551] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:06:58 2022] DELETE /identity/v3/projects/6b937ebafb7a4c3481b705636c3fab43 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:58.519585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02d6a9-bb4d-44ba-9a7c-06c231f8f578 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:06:58.533234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02d6a9-bb4d-44ba-9a7c-06c231f8f578 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:06:58.626485 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:06:58.668460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf342e-10c3-452b-8620-c09dd6daae1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:06:58.669534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf342e-10c3-452b-8620-c09dd6daae1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:58.669815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf342e-10c3-452b-8620-c09dd6daae1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:58.670089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf342e-10c3-452b-8620-c09dd6daae1a admin admin] PATH_INFO: `/v3/users/ce7d42b76f3c4acd99252e018b864e11` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:58.672073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf342e-10c3-452b-8620-c09dd6daae1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce7d42b76f3c4acd99252e018b864e11)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:06:58.674149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf342e-10c3-452b-8620-c09dd6daae1a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:06:58.768655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-50cf342e-10c3-452b-8620-c09dd6daae1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce7d42b76f3c4acd99252e018b864e11'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:58.769741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-50cf342e-10c3-452b-8620-c09dd6daae1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce7d42b76f3c4acd99252e018b864e11'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:58.791282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-50cf342e-10c3-452b-8620-c09dd6daae1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce7d42b76f3c4acd99252e018b864e11'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:58.820522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-50cf342e-10c3-452b-8620-c09dd6daae1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce7d42b76f3c4acd99252e018b864e11'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:58.830837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-50cf342e-10c3-452b-8620-c09dd6daae1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce7d42b76f3c4acd99252e018b864e11'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:06:58.841102 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2785/5552] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:06:58 2022] DELETE /identity/v3/users/ce7d42b76f3c4acd99252e018b864e11 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:06:59.297132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61805e47-98ca-4ecb-bdbb-9342e01e69e0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:06:59.298153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61805e47-98ca-4ecb-bdbb-9342e01e69e0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:06:59.298815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61805e47-98ca-4ecb-bdbb-9342e01e69e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:06:59.326330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-61805e47-98ca-4ecb-bdbb-9342e01e69e0 None None] MFA Rules not processed for user `58c50ed8702548f0b7568d172661e00d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:06:59.327889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-61805e47-98ca-4ecb-bdbb-9342e01e69e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:06:59.423090 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2768/5553] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:06:59 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:00.270885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf342e-10c3-452b-8620-c09dd6daae1a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:00.272634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-50cf342e-10c3-452b-8620-c09dd6daae1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:00.384942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf342e-10c3-452b-8620-c09dd6daae1a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:00.392912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb41bb9-d8c3-4f89-b010-8f443012561d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:00.394452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb41bb9-d8c3-4f89-b010-8f443012561d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:00.395800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb41bb9-d8c3-4f89-b010-8f443012561d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:00.396427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb41bb9-d8c3-4f89-b010-8f443012561d admin admin] PATH_INFO: `/v3/projects/bb842e745fcd4bd6b4e2095b73566068` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:00.398311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb41bb9-d8c3-4f89-b010-8f443012561d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb842e745fcd4bd6b4e2095b73566068)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:00.401287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb41bb9-d8c3-4f89-b010-8f443012561d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:00.516934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6bb41bb9-d8c3-4f89-b010-8f443012561d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb842e745fcd4bd6b4e2095b73566068', 'request_id': 'req-6bb41bb9-d8c3-4f89-b010-8f443012561d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:00.525401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61805e47-98ca-4ecb-bdbb-9342e01e69e0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:00.527803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-61805e47-98ca-4ecb-bdbb-9342e01e69e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:00.550610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61805e47-98ca-4ecb-bdbb-9342e01e69e0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:00.556283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6bb41bb9-d8c3-4f89-b010-8f443012561d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb842e745fcd4bd6b4e2095b73566068', 'request_id': 'req-6bb41bb9-d8c3-4f89-b010-8f443012561d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:00.581925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6bb41bb9-d8c3-4f89-b010-8f443012561d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb842e745fcd4bd6b4e2095b73566068', 'request_id': 'req-6bb41bb9-d8c3-4f89-b010-8f443012561d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:00.583822 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:00.618418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6bb41bb9-d8c3-4f89-b010-8f443012561d admin admin] The token cache is being invalidate because project bb842e745fcd4bd6b4e2095b73566068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:07:00.618808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6bb41bb9-d8c3-4f89-b010-8f443012561d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:00.621951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6bb41bb9-d8c3-4f89-b010-8f443012561d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:00.627067 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2786/5554] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:07:00 2022] DELETE /identity/v3/projects/bb842e745fcd4bd6b4e2095b73566068 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:07:00.628233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb41bb9-d8c3-4f89-b010-8f443012561d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:00.631063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6bb41bb9-d8c3-4f89-b010-8f443012561d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:00.649130 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:00.749172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b96a9-59be-474b-ae58-c829d042eebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:00.755421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b96a9-59be-474b-ae58-c829d042eebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:00.756365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b96a9-59be-474b-ae58-c829d042eebb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:00.759011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b96a9-59be-474b-ae58-c829d042eebb admin admin] PATH_INFO: `/v3/projects/4072cc7d5eaa491d99d1e7275d89753f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:00.761234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b96a9-59be-474b-ae58-c829d042eebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4072cc7d5eaa491d99d1e7275d89753f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:00.763691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b96a9-59be-474b-ae58-c829d042eebb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:00.770976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb41bb9-d8c3-4f89-b010-8f443012561d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:00.780491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4585c-9dc8-4d21-81e6-63d0d6270786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:00.781915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4585c-9dc8-4d21-81e6-63d0d6270786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:00.782797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4585c-9dc8-4d21-81e6-63d0d6270786 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:00.783236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4585c-9dc8-4d21-81e6-63d0d6270786 admin admin] PATH_INFO: `/v3/users/2be442b1624e4532bff9d198f651677b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:00.786120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4585c-9dc8-4d21-81e6-63d0d6270786 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2be442b1624e4532bff9d198f651677b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:00.789811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4585c-9dc8-4d21-81e6-63d0d6270786 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:00.900244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f1b4585c-9dc8-4d21-81e6-63d0d6270786 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2be442b1624e4532bff9d198f651677b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:00.900455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e86b96a9-59be-474b-ae58-c829d042eebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4072cc7d5eaa491d99d1e7275d89753f', 'request_id': 'req-e86b96a9-59be-474b-ae58-c829d042eebb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:00.901990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f1b4585c-9dc8-4d21-81e6-63d0d6270786 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2be442b1624e4532bff9d198f651677b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:00.928486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e86b96a9-59be-474b-ae58-c829d042eebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4072cc7d5eaa491d99d1e7275d89753f', 'request_id': 'req-e86b96a9-59be-474b-ae58-c829d042eebb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:00.931763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f1b4585c-9dc8-4d21-81e6-63d0d6270786 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2be442b1624e4532bff9d198f651677b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:00.938634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e86b96a9-59be-474b-ae58-c829d042eebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4072cc7d5eaa491d99d1e7275d89753f', 'request_id': 'req-e86b96a9-59be-474b-ae58-c829d042eebb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:00.949152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f1b4585c-9dc8-4d21-81e6-63d0d6270786 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2be442b1624e4532bff9d198f651677b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:00.959417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f1b4585c-9dc8-4d21-81e6-63d0d6270786 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2be442b1624e4532bff9d198f651677b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:00.970562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e86b96a9-59be-474b-ae58-c829d042eebb admin admin] The token cache is being invalidate because project 4072cc7d5eaa491d99d1e7275d89753f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:07:00.971574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e86b96a9-59be-474b-ae58-c829d042eebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:00.975411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e86b96a9-59be-474b-ae58-c829d042eebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:00.978068 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2769/5555] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:07:00 2022] DELETE /identity/v3/projects/4072cc7d5eaa491d99d1e7275d89753f => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:00.982884 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2787/5556] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:07:00 2022] DELETE /identity/v3/users/2be442b1624e4532bff9d198f651677b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:00.985293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b96a9-59be-474b-ae58-c829d042eebb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:00.985972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac150d2-19d0-432f-860f-534335dbb45d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:00.987608 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac150d2-19d0-432f-860f-534335dbb45d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:00.988280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac150d2-19d0-432f-860f-534335dbb45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:00.991147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e86b96a9-59be-474b-ae58-c829d042eebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:01.043043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-aac150d2-19d0-432f-860f-534335dbb45d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:01.046596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-aac150d2-19d0-432f-860f-534335dbb45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:01.156196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b96a9-59be-474b-ae58-c829d042eebb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:01.212042 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2788/5557] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:01.226314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2255e0-c679-4898-b21e-135acf414c0d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:01.226768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2255e0-c679-4898-b21e-135acf414c0d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:01.227107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2255e0-c679-4898-b21e-135acf414c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:01.278751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ea2255e0-c679-4898-b21e-135acf414c0d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:01.283154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ea2255e0-c679-4898-b21e-135acf414c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:01.296206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fd2f8-4440-4d8f-933e-47a8e556f27f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:01.296862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fd2f8-4440-4d8f-933e-47a8e556f27f service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:01.297616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fd2f8-4440-4d8f-933e-47a8e556f27f service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:01.297880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fd2f8-4440-4d8f-933e-47a8e556f27f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:01.300622 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2789/5558] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:01.306432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-987fd2f8-4440-4d8f-933e-47a8e556f27f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:01.308920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2255e0-c679-4898-b21e-135acf414c0d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:01.325631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987fd2f8-4440-4d8f-933e-47a8e556f27f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:01.328015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987fd2f8-4440-4d8f-933e-47a8e556f27f service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:01.330500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2255e0-c679-4898-b21e-135acf414c0d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:01.341747 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2770/5559] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:07:01.348485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21134e-b5aa-4631-b162-39f0bbae1ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:01.349360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21134e-b5aa-4631-b162-39f0bbae1ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:01.351060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21134e-b5aa-4631-b162-39f0bbae1ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:01.351531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21134e-b5aa-4631-b162-39f0bbae1ae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:01.352276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21134e-b5aa-4631-b162-39f0bbae1ae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:07:01.356551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21134e-b5aa-4631-b162-39f0bbae1ae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:01.358574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21134e-b5aa-4631-b162-39f0bbae1ae6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:01.364540 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:01.388712 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2790/5560] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:07:01.393574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fd2f8-4440-4d8f-933e-47a8e556f27f service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:01.411432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fd2f8-4440-4d8f-933e-47a8e556f27f service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:01.446855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e292c-48ec-4951-8708-89e8d31de062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:01.447488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e292c-48ec-4951-8708-89e8d31de062 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:01.447755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e292c-48ec-4951-8708-89e8d31de062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:01.448096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e292c-48ec-4951-8708-89e8d31de062 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:01.448770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e292c-48ec-4951-8708-89e8d31de062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:01.451450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e292c-48ec-4951-8708-89e8d31de062 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:01.519182 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2771/5561] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:07:01 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:07:01.520970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21134e-b5aa-4631-b162-39f0bbae1ae6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:01.541206 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21134e-b5aa-4631-b162-39f0bbae1ae6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:01.690654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bd06a-f9fb-444a-8586-e4c4b98dd7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:01.691952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bd06a-f9fb-444a-8586-e4c4b98dd7ff admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:01.692481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bd06a-f9fb-444a-8586-e4c4b98dd7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:01.692481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bd06a-f9fb-444a-8586-e4c4b98dd7ff admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:01.693293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bd06a-f9fb-444a-8586-e4c4b98dd7ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:01.700386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bd06a-f9fb-444a-8586-e4c4b98dd7ff admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:01.770382 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2791/5562] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:07:01 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:01.771431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e292c-48ec-4951-8708-89e8d31de062 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:01.780166 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:01.785480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e292c-48ec-4951-8708-89e8d31de062 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:01.802257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c25ea-37ab-4318-860c-783295065d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:01.802257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c25ea-37ab-4318-860c-783295065d1f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:01.802257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c25ea-37ab-4318-860c-783295065d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:01.802257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c25ea-37ab-4318-860c-783295065d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:01.804654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c25ea-37ab-4318-860c-783295065d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:01.807409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c25ea-37ab-4318-860c-783295065d1f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:01.837528 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2772/5563] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:07:01.839543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bd06a-f9fb-444a-8586-e4c4b98dd7ff admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:01.853329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bd06a-f9fb-444a-8586-e4c4b98dd7ff admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:01.866589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176dd630-f6e3-4d37-bca2-e945b76327d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:01.868217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dd630-f6e3-4d37-bca2-e945b76327d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:01.868694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dd630-f6e3-4d37-bca2-e945b76327d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:01.869250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dd630-f6e3-4d37-bca2-e945b76327d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:01.870093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176dd630-f6e3-4d37-bca2-e945b76327d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:01.872290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176dd630-f6e3-4d37-bca2-e945b76327d2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:01.900148 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2792/5564] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:01.901267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c25ea-37ab-4318-860c-783295065d1f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:01.920959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c25ea-37ab-4318-860c-783295065d1f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:01.934069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c5071-300b-4aea-8fda-006893d44f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:01.934835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c5071-300b-4aea-8fda-006893d44f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:01.935218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c5071-300b-4aea-8fda-006893d44f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:01.935697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c5071-300b-4aea-8fda-006893d44f19 admin admin] PATH_INFO: `/v3/projects/e1808637e638478083c8abda925427e5/users/0a7f26754f78486280b0f2c327fb1bb8/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:01.974419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c5071-300b-4aea-8fda-006893d44f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1808637e638478083c8abda925427e5, user_id=0a7f26754f78486280b0f2c327fb1bb8, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:01.978888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c5071-300b-4aea-8fda-006893d44f19 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:02.009686 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2773/5565] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:07:01 2022] PUT /identity/v3/projects/e1808637e638478083c8abda925427e5/users/0a7f26754f78486280b0f2c327fb1bb8/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:02.020703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136139a1-8cfd-4988-ae55-20cbcc5aa22b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:02.020973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136139a1-8cfd-4988-ae55-20cbcc5aa22b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:02.021251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136139a1-8cfd-4988-ae55-20cbcc5aa22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:02.078983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-136139a1-8cfd-4988-ae55-20cbcc5aa22b None None] MFA Rules not processed for user `0a7f26754f78486280b0f2c327fb1bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:02.080846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-136139a1-8cfd-4988-ae55-20cbcc5aa22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:02.285987 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2793/5566] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:02.291737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c5071-300b-4aea-8fda-006893d44f19 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:02.394641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c5071-300b-4aea-8fda-006893d44f19 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:02.403125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf0d13-a194-4360-9f65-d77dc7443fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:02.404493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf0d13-a194-4360-9f65-d77dc7443fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:02.405052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf0d13-a194-4360-9f65-d77dc7443fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:02.405652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf0d13-a194-4360-9f65-d77dc7443fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:02.406523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf0d13-a194-4360-9f65-d77dc7443fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:02.409523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf0d13-a194-4360-9f65-d77dc7443fa8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:02.456810 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2774/5567] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:07:02 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:02.461351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136139a1-8cfd-4988-ae55-20cbcc5aa22b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:02.478841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136139a1-8cfd-4988-ae55-20cbcc5aa22b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:02.636004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f3bb9-b658-4e7a-a142-74f339fe4443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:02.637316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f3bb9-b658-4e7a-a142-74f339fe4443 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:02.637600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f3bb9-b658-4e7a-a142-74f339fe4443 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:02.637880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f3bb9-b658-4e7a-a142-74f339fe4443 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:02.638535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f3bb9-b658-4e7a-a142-74f339fe4443 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:02.640495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f3bb9-b658-4e7a-a142-74f339fe4443 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:02.657879 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:02.688050 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2794/5568] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:07:02 2022] POST /identity/v3/users => generated 298 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:07:02.693000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf0d13-a194-4360-9f65-d77dc7443fa8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:02.722051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf0d13-a194-4360-9f65-d77dc7443fa8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:02.736311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b9a69-4ce8-406d-b582-76a23cc22888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:02.742274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b9a69-4ce8-406d-b582-76a23cc22888 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:02.742274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b9a69-4ce8-406d-b582-76a23cc22888 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:02.742572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b9a69-4ce8-406d-b582-76a23cc22888 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:02.743046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b9a69-4ce8-406d-b582-76a23cc22888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:02.744975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b9a69-4ce8-406d-b582-76a23cc22888 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:02.764825 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2775/5569] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:02.770568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f3bb9-b658-4e7a-a142-74f339fe4443 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:02.787904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f3bb9-b658-4e7a-a142-74f339fe4443 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:02.825183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e3c2e-1d23-45d7-9e1e-9897bf8daf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:02.826190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e3c2e-1d23-45d7-9e1e-9897bf8daf3c admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:02.826649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e3c2e-1d23-45d7-9e1e-9897bf8daf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:02.827092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e3c2e-1d23-45d7-9e1e-9897bf8daf3c admin admin] PATH_INFO: `/v3/projects/4673a959958e40909546161cbeb5a57c/users/a435a1cb71a94d9f8c38dc66e8cfc34c/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:02.858289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e3c2e-1d23-45d7-9e1e-9897bf8daf3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4673a959958e40909546161cbeb5a57c, user_id=a435a1cb71a94d9f8c38dc66e8cfc34c, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:02.863232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e3c2e-1d23-45d7-9e1e-9897bf8daf3c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:02.890774 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2795/5570] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:07:02 2022] PUT /identity/v3/projects/4673a959958e40909546161cbeb5a57c/users/a435a1cb71a94d9f8c38dc66e8cfc34c/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:02.894852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b9a69-4ce8-406d-b582-76a23cc22888 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:02.912887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b9a69-4ce8-406d-b582-76a23cc22888 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:03.058505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aca88d-2281-4116-84fe-10a6cf0e3272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:03.059054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aca88d-2281-4116-84fe-10a6cf0e3272 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:03.059331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aca88d-2281-4116-84fe-10a6cf0e3272 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:03.059603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aca88d-2281-4116-84fe-10a6cf0e3272 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:03.060304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aca88d-2281-4116-84fe-10a6cf0e3272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:03.062383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aca88d-2281-4116-84fe-10a6cf0e3272 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:03.087512 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2776/5571] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:03.087802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e3c2e-1d23-45d7-9e1e-9897bf8daf3c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:03.106904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e3c2e-1d23-45d7-9e1e-9897bf8daf3c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:03.114188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290b543-c1c7-411e-9ada-0b516b013ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:03.115927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290b543-c1c7-411e-9ada-0b516b013ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:03.116263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290b543-c1c7-411e-9ada-0b516b013ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:03.116701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290b543-c1c7-411e-9ada-0b516b013ed4 admin admin] PATH_INFO: `/v3/projects/4673a959958e40909546161cbeb5a57c/users/a435a1cb71a94d9f8c38dc66e8cfc34c/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:03.120000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290b543-c1c7-411e-9ada-0b516b013ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4673a959958e40909546161cbeb5a57c, user_id=a435a1cb71a94d9f8c38dc66e8cfc34c, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:03.136276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290b543-c1c7-411e-9ada-0b516b013ed4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:03.198253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a6794-801c-42d7-ad15-0adf29756b80 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:03.198537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a6794-801c-42d7-ad15-0adf29756b80 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:03.198803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a6794-801c-42d7-ad15-0adf29756b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:03.202604 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2796/5572] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:07:03 2022] PUT /identity/v3/projects/4673a959958e40909546161cbeb5a57c/users/a435a1cb71a94d9f8c38dc66e8cfc34c/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:07:03.280505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290b543-c1c7-411e-9ada-0b516b013ed4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:03.284809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3290b543-c1c7-411e-9ada-0b516b013ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:03.352519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dd7a6794-801c-42d7-ad15-0adf29756b80 None None] MFA Rules not processed for user `a435a1cb71a94d9f8c38dc66e8cfc34c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:03.362596 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dd7a6794-801c-42d7-ad15-0adf29756b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:03.470997 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:03.539792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290b543-c1c7-411e-9ada-0b516b013ed4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:03.550297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b507c8-c58a-4387-9797-bd9904ee8006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:03.551760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b507c8-c58a-4387-9797-bd9904ee8006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:03.552962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b507c8-c58a-4387-9797-bd9904ee8006 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:03.554189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b507c8-c58a-4387-9797-bd9904ee8006 admin admin] PATH_INFO: `/v3/projects/041f16d76e3e4c5caa307b587cf3c787` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:03.556419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b507c8-c58a-4387-9797-bd9904ee8006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=041f16d76e3e4c5caa307b587cf3c787)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:03.558645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b507c8-c58a-4387-9797-bd9904ee8006 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:03.588921 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2777/5573] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:03.614731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a6794-801c-42d7-ad15-0adf29756b80 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:03.615101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dd7a6794-801c-42d7-ad15-0adf29756b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:03.690216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e7b507c8-c58a-4387-9797-bd9904ee8006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '041f16d76e3e4c5caa307b587cf3c787', 'request_id': 'req-e7b507c8-c58a-4387-9797-bd9904ee8006'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:03.714475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e7b507c8-c58a-4387-9797-bd9904ee8006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '041f16d76e3e4c5caa307b587cf3c787', 'request_id': 'req-e7b507c8-c58a-4387-9797-bd9904ee8006'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:03.731293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e7b507c8-c58a-4387-9797-bd9904ee8006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '041f16d76e3e4c5caa307b587cf3c787', 'request_id': 'req-e7b507c8-c58a-4387-9797-bd9904ee8006'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:03.759606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e7b507c8-c58a-4387-9797-bd9904ee8006 admin admin] The token cache is being invalidate because project 041f16d76e3e4c5caa307b587cf3c787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:07:03.759911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e7b507c8-c58a-4387-9797-bd9904ee8006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:03.761990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e7b507c8-c58a-4387-9797-bd9904ee8006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:03.766442 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2797/5574] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:07:03 2022] DELETE /identity/v3/projects/041f16d76e3e4c5caa307b587cf3c787 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:07:03.771547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00793ebc-a11c-465f-bf77-8cabb1ef2517 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:03.771833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00793ebc-a11c-465f-bf77-8cabb1ef2517 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:03.772167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00793ebc-a11c-465f-bf77-8cabb1ef2517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:03.778268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a6794-801c-42d7-ad15-0adf29756b80 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:03.821727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-00793ebc-a11c-465f-bf77-8cabb1ef2517 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:03.825112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-00793ebc-a11c-465f-bf77-8cabb1ef2517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:03.954716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8997b89-7d9d-47e1-ae98-8e7daab9b788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:03.955433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8997b89-7d9d-47e1-ae98-8e7daab9b788 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:03.955718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8997b89-7d9d-47e1-ae98-8e7daab9b788 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:03.955985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8997b89-7d9d-47e1-ae98-8e7daab9b788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:03.959550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f8997b89-7d9d-47e1-ae98-8e7daab9b788 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:03.980526 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:04.058063 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2798/5575] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:04.065097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8639003-1134-4ccc-8330-0e6f10731e18 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:04.065338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8639003-1134-4ccc-8330-0e6f10731e18 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:04.065612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8639003-1134-4ccc-8330-0e6f10731e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:04.153375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a8639003-1134-4ccc-8330-0e6f10731e18 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:04.157614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a8639003-1134-4ccc-8330-0e6f10731e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:04.188999 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2799/5576] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:04.188999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8639003-1134-4ccc-8330-0e6f10731e18 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:04.192142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a8639003-1134-4ccc-8330-0e6f10731e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:04.197245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8997b89-7d9d-47e1-ae98-8e7daab9b788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:04.198873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8997b89-7d9d-47e1-ae98-8e7daab9b788 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:04.216628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8639003-1134-4ccc-8330-0e6f10731e18 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:04.219953 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2778/5577] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:07:04.221547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8997b89-7d9d-47e1-ae98-8e7daab9b788 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:04.229770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9dab5-c8f1-4493-b2aa-2d38c42651cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:04.230559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9dab5-c8f1-4493-b2aa-2d38c42651cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:04.230932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9dab5-c8f1-4493-b2aa-2d38c42651cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:04.231297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9dab5-c8f1-4493-b2aa-2d38c42651cd admin admin] PATH_INFO: `/v3/users/9b1fb6e4b13a459cb6e4b987be4a4f51` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:04.232660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9dab5-c8f1-4493-b2aa-2d38c42651cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b1fb6e4b13a459cb6e4b987be4a4f51)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:04.234686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9dab5-c8f1-4493-b2aa-2d38c42651cd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:04.244167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8997b89-7d9d-47e1-ae98-8e7daab9b788 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:04.267696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fd9bf-e596-46f0-b91d-66174fe49093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:04.268325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fd9bf-e596-46f0-b91d-66174fe49093 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:04.268640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fd9bf-e596-46f0-b91d-66174fe49093 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:04.268890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fd9bf-e596-46f0-b91d-66174fe49093 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:04.269819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fd9bf-e596-46f0-b91d-66174fe49093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:07:04.270139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fd9bf-e596-46f0-b91d-66174fe49093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:04.272063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fd9bf-e596-46f0-b91d-66174fe49093 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:04.316333 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2779/5578] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:07:04.319887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fd9bf-e596-46f0-b91d-66174fe49093 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:04.354048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fd9bf-e596-46f0-b91d-66174fe49093 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:04.376172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d9c71-14ac-4792-81ab-18ea0bfad4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:04.377017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d9c71-14ac-4792-81ab-18ea0bfad4e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:04.377608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d9c71-14ac-4792-81ab-18ea0bfad4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:04.377849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d9c71-14ac-4792-81ab-18ea0bfad4e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:04.378557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d9c71-14ac-4792-81ab-18ea0bfad4e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:04.380554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d9c71-14ac-4792-81ab-18ea0bfad4e3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:04.382591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7b9dab5-c8f1-4493-b2aa-2d38c42651cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b1fb6e4b13a459cb6e4b987be4a4f51'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:04.385304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7b9dab5-c8f1-4493-b2aa-2d38c42651cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b1fb6e4b13a459cb6e4b987be4a4f51'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:04.398389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7b9dab5-c8f1-4493-b2aa-2d38c42651cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b1fb6e4b13a459cb6e4b987be4a4f51'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:04.422628 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:04.426773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7b9dab5-c8f1-4493-b2aa-2d38c42651cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b1fb6e4b13a459cb6e4b987be4a4f51'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:04.453019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7b9dab5-c8f1-4493-b2aa-2d38c42651cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b1fb6e4b13a459cb6e4b987be4a4f51'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:04.460810 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2780/5579] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:07:04 2022] POST /identity/v3/projects => generated 401 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:04.464379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d9c71-14ac-4792-81ab-18ea0bfad4e3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:04.471286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d19d9c71-14ac-4792-81ab-18ea0bfad4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:04.480001 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2800/5580] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:07:04 2022] DELETE /identity/v3/users/9b1fb6e4b13a459cb6e4b987be4a4f51 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:04.482213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a89cec-d0c2-4d14-9120-6b4d8598b251 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:04.482497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a89cec-d0c2-4d14-9120-6b4d8598b251 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:04.482786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a89cec-d0c2-4d14-9120-6b4d8598b251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:04.531299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e3a89cec-d0c2-4d14-9120-6b4d8598b251 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:04.536724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e3a89cec-d0c2-4d14-9120-6b4d8598b251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:04.616246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d9c71-14ac-4792-81ab-18ea0bfad4e3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:04.745696 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2801/5581] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:04.746377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a89cec-d0c2-4d14-9120-6b4d8598b251 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:04.747697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e3a89cec-d0c2-4d14-9120-6b4d8598b251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:04.773806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a89cec-d0c2-4d14-9120-6b4d8598b251 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:04.786222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39247329-c4d0-4686-bbf7-f49440ad3ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:04.788517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39247329-c4d0-4686-bbf7-f49440ad3ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:04.788963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39247329-c4d0-4686-bbf7-f49440ad3ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:04.789247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39247329-c4d0-4686-bbf7-f49440ad3ab7 admin admin] PATH_INFO: `/v3/users/5d7b6aad22ea44aeb1f56654111c4b22` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:04.798838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5ca81-24dd-4120-899b-a0b7df83578c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:04.799545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5ca81-24dd-4120-899b-a0b7df83578c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:04.799959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5ca81-24dd-4120-899b-a0b7df83578c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:04.800399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5ca81-24dd-4120-899b-a0b7df83578c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:04.801093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5ca81-24dd-4120-899b-a0b7df83578c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:04.803395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5ca81-24dd-4120-899b-a0b7df83578c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:04.811949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39247329-c4d0-4686-bbf7-f49440ad3ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d7b6aad22ea44aeb1f56654111c4b22)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:04.815698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39247329-c4d0-4686-bbf7-f49440ad3ab7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:04.843702 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2781/5582] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:07:04 2022] POST /identity/v3/users => generated 301 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:04.845816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5ca81-24dd-4120-899b-a0b7df83578c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:04.848828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-33e5ca81-24dd-4120-899b-a0b7df83578c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:05.023698 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:05.027116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-39247329-c4d0-4686-bbf7-f49440ad3ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d7b6aad22ea44aeb1f56654111c4b22'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:05.028048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-39247329-c4d0-4686-bbf7-f49440ad3ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d7b6aad22ea44aeb1f56654111c4b22'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:05.035167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5ca81-24dd-4120-899b-a0b7df83578c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:05.050528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-39247329-c4d0-4686-bbf7-f49440ad3ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d7b6aad22ea44aeb1f56654111c4b22'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:05.052038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fdfed4-9f13-40be-9bea-b4ed2bf8d07a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:05.052722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdfed4-9f13-40be-9bea-b4ed2bf8d07a service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:05.053001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdfed4-9f13-40be-9bea-b4ed2bf8d07a service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:05.053271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdfed4-9f13-40be-9bea-b4ed2bf8d07a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:05.060526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-97fdfed4-9f13-40be-9bea-b4ed2bf8d07a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:05.095657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fdfed4-9f13-40be-9bea-b4ed2bf8d07a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:05.096817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-39247329-c4d0-4686-bbf7-f49440ad3ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d7b6aad22ea44aeb1f56654111c4b22'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:05.097139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fdfed4-9f13-40be-9bea-b4ed2bf8d07a service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:05.108311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-39247329-c4d0-4686-bbf7-f49440ad3ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d7b6aad22ea44aeb1f56654111c4b22'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:05.117048 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2782/5583] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:07:05.117739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fdfed4-9f13-40be-9bea-b4ed2bf8d07a service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:05.122475 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2802/5584] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:07:04 2022] DELETE /identity/v3/users/5d7b6aad22ea44aeb1f56654111c4b22 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:05.123897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-97fdfed4-9f13-40be-9bea-b4ed2bf8d07a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:05.147603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fdfed4-9f13-40be-9bea-b4ed2bf8d07a service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:05.230723 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:05.318768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c8bdf-1391-48c7-a675-c3226c246766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:05.320901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c8bdf-1391-48c7-a675-c3226c246766 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:05.321959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c8bdf-1391-48c7-a675-c3226c246766 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:05.322433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c8bdf-1391-48c7-a675-c3226c246766 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:05.323910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c8bdf-1391-48c7-a675-c3226c246766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:05.326052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c8bdf-1391-48c7-a675-c3226c246766 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:05.340367 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2783/5585] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:05.344540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39247329-c4d0-4686-bbf7-f49440ad3ab7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:05.358146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39247329-c4d0-4686-bbf7-f49440ad3ab7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:05.366423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6bba29-1a57-4ad1-a1da-7d22d24b41fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:05.367168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bba29-1a57-4ad1-a1da-7d22d24b41fa admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:05.367545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bba29-1a57-4ad1-a1da-7d22d24b41fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:05.368246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bba29-1a57-4ad1-a1da-7d22d24b41fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:05.368676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6bba29-1a57-4ad1-a1da-7d22d24b41fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:05.370912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6bba29-1a57-4ad1-a1da-7d22d24b41fa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:05.389026 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2803/5586] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:05.393274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c8bdf-1391-48c7-a675-c3226c246766 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:05.413924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c8bdf-1391-48c7-a675-c3226c246766 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:05.424298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158e5e0-127d-4240-839e-1e0dc2c36be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:05.427425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158e5e0-127d-4240-839e-1e0dc2c36be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:05.427844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158e5e0-127d-4240-839e-1e0dc2c36be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:05.428127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158e5e0-127d-4240-839e-1e0dc2c36be8 admin admin] PATH_INFO: `/v3/projects/2faaded0256243f4a82fd2e670cef686/users/167e3eca580d49abb4e1297047ee566c/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:05.450858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158e5e0-127d-4240-839e-1e0dc2c36be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2faaded0256243f4a82fd2e670cef686, user_id=167e3eca580d49abb4e1297047ee566c, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:05.454658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158e5e0-127d-4240-839e-1e0dc2c36be8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:05.481721 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2784/5587] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:07:05 2022] PUT /identity/v3/projects/2faaded0256243f4a82fd2e670cef686/users/167e3eca580d49abb4e1297047ee566c/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:07:05.495812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd84a4-e6ed-4722-aa42-b15ff82129ce None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:05.496102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd84a4-e6ed-4722-aa42-b15ff82129ce None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:05.496834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd84a4-e6ed-4722-aa42-b15ff82129ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:05.536760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5fdd84a4-e6ed-4722-aa42-b15ff82129ce None None] MFA Rules not processed for user `167e3eca580d49abb4e1297047ee566c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:05.538331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5fdd84a4-e6ed-4722-aa42-b15ff82129ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:05.697653 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2804/5588] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:05 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:05.700171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158e5e0-127d-4240-839e-1e0dc2c36be8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:05.713173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd84a4-e6ed-4722-aa42-b15ff82129ce None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:05.717850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5fdd84a4-e6ed-4722-aa42-b15ff82129ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:05.878014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158e5e0-127d-4240-839e-1e0dc2c36be8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:05.901254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cd7d6-0940-465e-a28a-70995f666ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:05.911133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cd7d6-0940-465e-a28a-70995f666ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:05.911499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cd7d6-0940-465e-a28a-70995f666ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:05.911772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cd7d6-0940-465e-a28a-70995f666ad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:05.912468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6cd7d6-0940-465e-a28a-70995f666ad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:05.914439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6cd7d6-0940-465e-a28a-70995f666ad8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:05.935712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd84a4-e6ed-4722-aa42-b15ff82129ce None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:05.948589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782894ba-dea8-423e-bdd3-79fa2dc6d6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:05.949842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782894ba-dea8-423e-bdd3-79fa2dc6d6ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:05.950011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782894ba-dea8-423e-bdd3-79fa2dc6d6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:05.950279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782894ba-dea8-423e-bdd3-79fa2dc6d6ee admin admin] PATH_INFO: `/v3/projects/2e355f0ab3664dbc867ecf1202674a73` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:05.954852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782894ba-dea8-423e-bdd3-79fa2dc6d6ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e355f0ab3664dbc867ecf1202674a73)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:05.958722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782894ba-dea8-423e-bdd3-79fa2dc6d6ee admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:05.989144 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2785/5589] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:07:05 2022] POST /identity/v3/projects => generated 401 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:05.990259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cd7d6-0940-465e-a28a-70995f666ad8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:06.108461 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:06.118962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-782894ba-dea8-423e-bdd3-79fa2dc6d6ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e355f0ab3664dbc867ecf1202674a73', 'request_id': 'req-782894ba-dea8-423e-bdd3-79fa2dc6d6ee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:06.135766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-782894ba-dea8-423e-bdd3-79fa2dc6d6ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e355f0ab3664dbc867ecf1202674a73', 'request_id': 'req-782894ba-dea8-423e-bdd3-79fa2dc6d6ee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:06.144123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-782894ba-dea8-423e-bdd3-79fa2dc6d6ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e355f0ab3664dbc867ecf1202674a73', 'request_id': 'req-782894ba-dea8-423e-bdd3-79fa2dc6d6ee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:06.164314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cd7d6-0940-465e-a28a-70995f666ad8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:06.173093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-782894ba-dea8-423e-bdd3-79fa2dc6d6ee admin admin] The token cache is being invalidate because project 2e355f0ab3664dbc867ecf1202674a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:07:06.173396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-782894ba-dea8-423e-bdd3-79fa2dc6d6ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:06.176182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-782894ba-dea8-423e-bdd3-79fa2dc6d6ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:06.184643 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2805/5590] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:07:05 2022] DELETE /identity/v3/projects/2e355f0ab3664dbc867ecf1202674a73 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:06.189030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444b6ca-3084-4ac5-ad23-54ab0df73791 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:06.189321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444b6ca-3084-4ac5-ad23-54ab0df73791 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:06.189598 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444b6ca-3084-4ac5-ad23-54ab0df73791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:06.234014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2444b6ca-3084-4ac5-ad23-54ab0df73791 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:06.235275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2444b6ca-3084-4ac5-ad23-54ab0df73791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:06.243456 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:06.279417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48869a0-0ac4-4f93-b685-a0d2d11f46e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:06.280243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48869a0-0ac4-4f93-b685-a0d2d11f46e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:06.280790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48869a0-0ac4-4f93-b685-a0d2d11f46e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:06.281178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48869a0-0ac4-4f93-b685-a0d2d11f46e3 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:06.281963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48869a0-0ac4-4f93-b685-a0d2d11f46e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:06.284202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48869a0-0ac4-4f93-b685-a0d2d11f46e3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:06.325871 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2786/5591] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:07:05 2022] POST /identity/v3/users => generated 307 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:06.346979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48869a0-0ac4-4f93-b685-a0d2d11f46e3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:06.361002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f48869a0-0ac4-4f93-b685-a0d2d11f46e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:06.371762 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2806/5592] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:07:06.392165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48869a0-0ac4-4f93-b685-a0d2d11f46e3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:06.414330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2f811-7464-4476-a007-3e17a6612443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:06.416635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2f811-7464-4476-a007-3e17a6612443 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:06.417160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2f811-7464-4476-a007-3e17a6612443 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:06.417779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2f811-7464-4476-a007-3e17a6612443 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:06.419490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2f811-7464-4476-a007-3e17a6612443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:06.421816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2f811-7464-4476-a007-3e17a6612443 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:06.443442 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2787/5593] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:06.447527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444b6ca-3084-4ac5-ad23-54ab0df73791 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:06.460618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444b6ca-3084-4ac5-ad23-54ab0df73791 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:06.466630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f97523-d526-4ce8-89c8-baddd86d26d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:06.467470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f97523-d526-4ce8-89c8-baddd86d26d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:06.468055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f97523-d526-4ce8-89c8-baddd86d26d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:06.468403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f97523-d526-4ce8-89c8-baddd86d26d0 admin admin] PATH_INFO: `/v3/projects/3ab11560a4764cb398474100fd343126/users/20da9d5a236c4781aaf170746bde9803/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:06.490973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f97523-d526-4ce8-89c8-baddd86d26d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ab11560a4764cb398474100fd343126, user_id=20da9d5a236c4781aaf170746bde9803, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:06.493473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefa064-e9ee-43d4-b785-ac4870b8e91a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:06.493752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefa064-e9ee-43d4-b785-ac4870b8e91a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:06.494047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefa064-e9ee-43d4-b785-ac4870b8e91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:06.501595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f97523-d526-4ce8-89c8-baddd86d26d0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:06.523828 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2807/5594] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:07:06 2022] PUT /identity/v3/projects/3ab11560a4764cb398474100fd343126/users/20da9d5a236c4781aaf170746bde9803/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:06.525084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f97523-d526-4ce8-89c8-baddd86d26d0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:06.528122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-efefa064-e9ee-43d4-b785-ac4870b8e91a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:06.530235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-efefa064-e9ee-43d4-b785-ac4870b8e91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:06.653189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f97523-d526-4ce8-89c8-baddd86d26d0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:06.663577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7c8ae-7a42-4dbe-8e01-b2449b4c17b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:06.665629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7c8ae-7a42-4dbe-8e01-b2449b4c17b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:06.665934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7c8ae-7a42-4dbe-8e01-b2449b4c17b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:06.666067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7c8ae-7a42-4dbe-8e01-b2449b4c17b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:06.666702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7c8ae-7a42-4dbe-8e01-b2449b4c17b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:06.668987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7c8ae-7a42-4dbe-8e01-b2449b4c17b0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:06.685569 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2808/5595] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:06.685569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7c8ae-7a42-4dbe-8e01-b2449b4c17b0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:06.686974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a4a7c8ae-7a42-4dbe-8e01-b2449b4c17b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:06.691189 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2788/5596] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:07:06.692900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefa064-e9ee-43d4-b785-ac4870b8e91a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:06.705584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefa064-e9ee-43d4-b785-ac4870b8e91a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:06.711156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7c8ae-7a42-4dbe-8e01-b2449b4c17b0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:06.712654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e7c2e-c57e-4e66-a544-9db48d9b2548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:06.714117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e7c2e-c57e-4e66-a544-9db48d9b2548 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:06.715315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e7c2e-c57e-4e66-a544-9db48d9b2548 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:06.715836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e7c2e-c57e-4e66-a544-9db48d9b2548 admin admin] PATH_INFO: `/v3/projects/3ab11560a4764cb398474100fd343126/users/20da9d5a236c4781aaf170746bde9803/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:06.718730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e7c2e-c57e-4e66-a544-9db48d9b2548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ab11560a4764cb398474100fd343126, user_id=20da9d5a236c4781aaf170746bde9803, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:06.721896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb30b5e-28d7-4d84-beff-8bebd7632353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:06.722549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e7c2e-c57e-4e66-a544-9db48d9b2548 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:06.723211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb30b5e-28d7-4d84-beff-8bebd7632353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:06.724422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb30b5e-28d7-4d84-beff-8bebd7632353 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:06.724626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb30b5e-28d7-4d84-beff-8bebd7632353 admin admin] PATH_INFO: `/v3/projects/9dd869e85dc048ca8f466c5bd04450cd` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:06.736920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb30b5e-28d7-4d84-beff-8bebd7632353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd869e85dc048ca8f466c5bd04450cd)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:06.736920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb30b5e-28d7-4d84-beff-8bebd7632353 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:06.791106 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2789/5597] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:07:06 2022] PUT /identity/v3/projects/3ab11560a4764cb398474100fd343126/users/20da9d5a236c4781aaf170746bde9803/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:06.791106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e7c2e-c57e-4e66-a544-9db48d9b2548 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:06.864157 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:06.883188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9bb30b5e-28d7-4d84-beff-8bebd7632353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd869e85dc048ca8f466c5bd04450cd', 'request_id': 'req-9bb30b5e-28d7-4d84-beff-8bebd7632353'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:06.902939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9bb30b5e-28d7-4d84-beff-8bebd7632353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd869e85dc048ca8f466c5bd04450cd', 'request_id': 'req-9bb30b5e-28d7-4d84-beff-8bebd7632353'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:06.911528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9bb30b5e-28d7-4d84-beff-8bebd7632353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd869e85dc048ca8f466c5bd04450cd', 'request_id': 'req-9bb30b5e-28d7-4d84-beff-8bebd7632353'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:06.936627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9bb30b5e-28d7-4d84-beff-8bebd7632353 admin admin] The token cache is being invalidate because project 9dd869e85dc048ca8f466c5bd04450cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:07:06.937671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9bb30b5e-28d7-4d84-beff-8bebd7632353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:06.938660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9bb30b5e-28d7-4d84-beff-8bebd7632353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:06.940794 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2809/5598] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:07:06 2022] DELETE /identity/v3/projects/9dd869e85dc048ca8f466c5bd04450cd => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:06.942492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171faa0-180a-44e6-84a7-26978b71af5c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:06.942961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171faa0-180a-44e6-84a7-26978b71af5c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:06.943399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171faa0-180a-44e6-84a7-26978b71af5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:06.956194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e7c2e-c57e-4e66-a544-9db48d9b2548 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:07.013827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a171faa0-180a-44e6-84a7-26978b71af5c None None] MFA Rules not processed for user `20da9d5a236c4781aaf170746bde9803`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:07.015302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a171faa0-180a-44e6-84a7-26978b71af5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:07.074262 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:07.096777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d7541-f267-4f73-b2ef-bafe25a5bc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:07.098499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d7541-f267-4f73-b2ef-bafe25a5bc9d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:07.098852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d7541-f267-4f73-b2ef-bafe25a5bc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:07.099226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d7541-f267-4f73-b2ef-bafe25a5bc9d admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:07.102354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d7541-f267-4f73-b2ef-bafe25a5bc9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:07:07.102735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d7541-f267-4f73-b2ef-bafe25a5bc9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:07.104546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d7541-f267-4f73-b2ef-bafe25a5bc9d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:07.133675 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2790/5599] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:07:07.136011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d7541-f267-4f73-b2ef-bafe25a5bc9d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:07.142969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f80d7541-f267-4f73-b2ef-bafe25a5bc9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:07.169373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d7541-f267-4f73-b2ef-bafe25a5bc9d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:07.179083 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2810/5600] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:06 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:07.180800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171faa0-180a-44e6-84a7-26978b71af5c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:07.188707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a171faa0-180a-44e6-84a7-26978b71af5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:07.188888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32fae4-cbe7-4136-96a7-014aa16a3868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:07.189522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32fae4-cbe7-4136-96a7-014aa16a3868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:07.189866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32fae4-cbe7-4136-96a7-014aa16a3868 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:07.190266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32fae4-cbe7-4136-96a7-014aa16a3868 admin admin] PATH_INFO: `/v3/users/435c5bdc064d442aa155643761f9959f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:07.192101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32fae4-cbe7-4136-96a7-014aa16a3868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=435c5bdc064d442aa155643761f9959f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:07.197050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32fae4-cbe7-4136-96a7-014aa16a3868 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:07.213025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171faa0-180a-44e6-84a7-26978b71af5c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:07.223157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd9f4c-b6be-4db5-9438-5a24c43508d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:07.224936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd9f4c-b6be-4db5-9438-5a24c43508d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:07.225226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd9f4c-b6be-4db5-9438-5a24c43508d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:07.225645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd9f4c-b6be-4db5-9438-5a24c43508d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:07.226301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd9f4c-b6be-4db5-9438-5a24c43508d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:07.229744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd9f4c-b6be-4db5-9438-5a24c43508d1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:07.274283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2a32fae4-cbe7-4136-96a7-014aa16a3868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435c5bdc064d442aa155643761f9959f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:07.280932 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2811/5601] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:07:07 2022] POST /identity/v3/projects => generated 395 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:07.280932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd9f4c-b6be-4db5-9438-5a24c43508d1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:07.281596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8cfd9f4c-b6be-4db5-9438-5a24c43508d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:07.288410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2a32fae4-cbe7-4136-96a7-014aa16a3868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435c5bdc064d442aa155643761f9959f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:07.290765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2a32fae4-cbe7-4136-96a7-014aa16a3868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435c5bdc064d442aa155643761f9959f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:07.315129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2a32fae4-cbe7-4136-96a7-014aa16a3868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435c5bdc064d442aa155643761f9959f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:07.329377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2a32fae4-cbe7-4136-96a7-014aa16a3868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435c5bdc064d442aa155643761f9959f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:07.347242 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2791/5602] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:07:07 2022] DELETE /identity/v3/users/435c5bdc064d442aa155643761f9959f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:07.347242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32fae4-cbe7-4136-96a7-014aa16a3868 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:07.347242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2a32fae4-cbe7-4136-96a7-014aa16a3868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:07.434463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd9f4c-b6be-4db5-9438-5a24c43508d1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:07.477687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32fae4-cbe7-4136-96a7-014aa16a3868 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:07.497946 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:07.500468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b04ffe-2ee6-445b-b1a4-07c39259f545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:07.501301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b04ffe-2ee6-445b-b1a4-07c39259f545 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:07.501688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b04ffe-2ee6-445b-b1a4-07c39259f545 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:07.502033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b04ffe-2ee6-445b-b1a4-07c39259f545 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:07.502866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b04ffe-2ee6-445b-b1a4-07c39259f545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:07.507795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b04ffe-2ee6-445b-b1a4-07c39259f545 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:07.508232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2fce4-2dee-4cd4-bc8d-e68ea98650b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:07.508953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2fce4-2dee-4cd4-bc8d-e68ea98650b0 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:07.509300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2fce4-2dee-4cd4-bc8d-e68ea98650b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:07.509643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2fce4-2dee-4cd4-bc8d-e68ea98650b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:07.513223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dad2fce4-2dee-4cd4-bc8d-e68ea98650b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:07.558424 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2792/5603] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:07:07 2022] POST /identity/v3/users => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:07.562986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b04ffe-2ee6-445b-b1a4-07c39259f545 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:07.585889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b04ffe-2ee6-445b-b1a4-07c39259f545 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:07.600988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a17f1c-e29c-4872-9e7f-768a025c9708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:07.601647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a17f1c-e29c-4872-9e7f-768a025c9708 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:07.601986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a17f1c-e29c-4872-9e7f-768a025c9708 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:07.602320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a17f1c-e29c-4872-9e7f-768a025c9708 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:07.603301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a17f1c-e29c-4872-9e7f-768a025c9708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:07.605046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a17f1c-e29c-4872-9e7f-768a025c9708 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:07.613436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2fce4-2dee-4cd4-bc8d-e68ea98650b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:07.615400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2fce4-2dee-4cd4-bc8d-e68ea98650b0 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:07.635100 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2793/5604] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:07.637386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a17f1c-e29c-4872-9e7f-768a025c9708 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:07.643816 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2812/5605] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:07 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:07:07.666805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a17f1c-e29c-4872-9e7f-768a025c9708 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:07.683804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e69d2-7b39-4f89-9229-024e9a2ccc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:07.685224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e69d2-7b39-4f89-9229-024e9a2ccc54 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:07.686018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e69d2-7b39-4f89-9229-024e9a2ccc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:07.686733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e69d2-7b39-4f89-9229-024e9a2ccc54 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:07.688142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e69d2-7b39-4f89-9229-024e9a2ccc54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:07.689817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e69d2-7b39-4f89-9229-024e9a2ccc54 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:07.723402 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2794/5606] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:07.725060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2fce4-2dee-4cd4-bc8d-e68ea98650b0 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:07.737787 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2fce4-2dee-4cd4-bc8d-e68ea98650b0 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:07.743929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7975185-ea09-40f9-b558-d1cfcb8c762f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:07.744813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7975185-ea09-40f9-b558-d1cfcb8c762f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:07.745297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7975185-ea09-40f9-b558-d1cfcb8c762f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:07.745654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7975185-ea09-40f9-b558-d1cfcb8c762f admin admin] PATH_INFO: `/v3/projects/61d2b5900d40406d9c06d2201a681abe/users/7100e3fe0fb945f697857613dbbe990a/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:07.758072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e69d2-7b39-4f89-9229-024e9a2ccc54 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:07.760440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c08e69d2-7b39-4f89-9229-024e9a2ccc54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:07.785039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7975185-ea09-40f9-b558-d1cfcb8c762f admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d2b5900d40406d9c06d2201a681abe, user_id=7100e3fe0fb945f697857613dbbe990a, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:07.787282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e69d2-7b39-4f89-9229-024e9a2ccc54 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:07.794186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7975185-ea09-40f9-b558-d1cfcb8c762f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:07.799184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde787a7-d7c2-407b-99ff-70f36cc88906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:07.800032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde787a7-d7c2-407b-99ff-70f36cc88906 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:07.802183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde787a7-d7c2-407b-99ff-70f36cc88906 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:07.802611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde787a7-d7c2-407b-99ff-70f36cc88906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:07.805902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dde787a7-d7c2-407b-99ff-70f36cc88906 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:07.824409 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2813/5607] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:07:07 2022] PUT /identity/v3/projects/61d2b5900d40406d9c06d2201a681abe/users/7100e3fe0fb945f697857613dbbe990a/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:07.830234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58861c0d-c767-49c4-b5b6-466bd77aabb6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:07.830647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58861c0d-c767-49c4-b5b6-466bd77aabb6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:07.831017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58861c0d-c767-49c4-b5b6-466bd77aabb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:07.863988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-58861c0d-c767-49c4-b5b6-466bd77aabb6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:07.865705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-58861c0d-c767-49c4-b5b6-466bd77aabb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:07.873503 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:07.969582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde787a7-d7c2-407b-99ff-70f36cc88906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:07.971092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde787a7-d7c2-407b-99ff-70f36cc88906 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:07.979742 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2814/5608] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:07.994436 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2795/5609] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:07 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:07:08.057065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58861c0d-c767-49c4-b5b6-466bd77aabb6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:08.064531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-58861c0d-c767-49c4-b5b6-466bd77aabb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:08.158794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58861c0d-c767-49c4-b5b6-466bd77aabb6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:08.165028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd6fed-a6ce-4824-a770-25a2a207c164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:08.165750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd6fed-a6ce-4824-a770-25a2a207c164 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:08.166474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd6fed-a6ce-4824-a770-25a2a207c164 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:08.166474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd6fed-a6ce-4824-a770-25a2a207c164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:08.180640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd6fed-a6ce-4824-a770-25a2a207c164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:08.182524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd6fed-a6ce-4824-a770-25a2a207c164 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:08.194459 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2815/5610] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:07:08.396270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde787a7-d7c2-407b-99ff-70f36cc88906 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:08.397753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dde787a7-d7c2-407b-99ff-70f36cc88906 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:08.440330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde787a7-d7c2-407b-99ff-70f36cc88906 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:08.463800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f15a0-9ef2-4af3-84fe-8ab1925ab17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:08.464474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f15a0-9ef2-4af3-84fe-8ab1925ab17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:08.464781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f15a0-9ef2-4af3-84fe-8ab1925ab17c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:08.465051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f15a0-9ef2-4af3-84fe-8ab1925ab17c admin admin] PATH_INFO: `/v3/projects/ff51fd6d33d842c9926e246d37b2a30f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:08.467615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f15a0-9ef2-4af3-84fe-8ab1925ab17c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff51fd6d33d842c9926e246d37b2a30f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:08.469703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f15a0-9ef2-4af3-84fe-8ab1925ab17c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:08.567126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-068f15a0-9ef2-4af3-84fe-8ab1925ab17c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff51fd6d33d842c9926e246d37b2a30f', 'request_id': 'req-068f15a0-9ef2-4af3-84fe-8ab1925ab17c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:08.579258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-068f15a0-9ef2-4af3-84fe-8ab1925ab17c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff51fd6d33d842c9926e246d37b2a30f', 'request_id': 'req-068f15a0-9ef2-4af3-84fe-8ab1925ab17c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:08.591968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-068f15a0-9ef2-4af3-84fe-8ab1925ab17c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff51fd6d33d842c9926e246d37b2a30f', 'request_id': 'req-068f15a0-9ef2-4af3-84fe-8ab1925ab17c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:08.609169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-068f15a0-9ef2-4af3-84fe-8ab1925ab17c admin admin] The token cache is being invalidate because project ff51fd6d33d842c9926e246d37b2a30f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:07:08.609633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-068f15a0-9ef2-4af3-84fe-8ab1925ab17c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:08.610625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-068f15a0-9ef2-4af3-84fe-8ab1925ab17c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:08.616462 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2796/5611] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:07:08 2022] DELETE /identity/v3/projects/ff51fd6d33d842c9926e246d37b2a30f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:08.618256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6145e57-a298-47e8-8b97-b37d8c5f5bf8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:08.618547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6145e57-a298-47e8-8b97-b37d8c5f5bf8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:08.618884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6145e57-a298-47e8-8b97-b37d8c5f5bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:08.689752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f6145e57-a298-47e8-8b97-b37d8c5f5bf8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:08.691025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f6145e57-a298-47e8-8b97-b37d8c5f5bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:08.702250 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:08.807195 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2816/5612] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:08.814927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44966622-237e-4787-8e08-ba4da21bf3a2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:08.815563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44966622-237e-4787-8e08-ba4da21bf3a2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:08.816014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44966622-237e-4787-8e08-ba4da21bf3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:08.849365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-44966622-237e-4787-8e08-ba4da21bf3a2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:08.850963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-44966622-237e-4787-8e08-ba4da21bf3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:08.899787 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2797/5613] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:08.901304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6145e57-a298-47e8-8b97-b37d8c5f5bf8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:08.922123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6145e57-a298-47e8-8b97-b37d8c5f5bf8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:08.939386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9e007-0632-4ddb-a256-6fe4a979ce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:08.943883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9e007-0632-4ddb-a256-6fe4a979ce5a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:08.944454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9e007-0632-4ddb-a256-6fe4a979ce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:08.946825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9e007-0632-4ddb-a256-6fe4a979ce5a admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:08.951556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9e007-0632-4ddb-a256-6fe4a979ce5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:07:08.952959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9e007-0632-4ddb-a256-6fe4a979ce5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:08.957746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9e007-0632-4ddb-a256-6fe4a979ce5a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:08.992648 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2817/5614] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:07:08.993605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44966622-237e-4787-8e08-ba4da21bf3a2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:09.016221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44966622-237e-4787-8e08-ba4da21bf3a2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:09.042194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0378ec5-62ea-47b9-bc8f-73411bb4a838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:09.043132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0378ec5-62ea-47b9-bc8f-73411bb4a838 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:09.043632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0378ec5-62ea-47b9-bc8f-73411bb4a838 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:09.044188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0378ec5-62ea-47b9-bc8f-73411bb4a838 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:09.045226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0378ec5-62ea-47b9-bc8f-73411bb4a838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:09.047879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0378ec5-62ea-47b9-bc8f-73411bb4a838 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:09.109871 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2798/5615] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:07:08 2022] POST /identity/v3/projects => generated 355 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:09.114308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9e007-0632-4ddb-a256-6fe4a979ce5a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:09.134333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9e007-0632-4ddb-a256-6fe4a979ce5a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:09.267596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9223a6-c32e-4383-9cad-e52dcf0297fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:09.268218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9223a6-c32e-4383-9cad-e52dcf0297fd admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:09.268494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9223a6-c32e-4383-9cad-e52dcf0297fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:09.268805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9223a6-c32e-4383-9cad-e52dcf0297fd admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:09.270395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9223a6-c32e-4383-9cad-e52dcf0297fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:09.272631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9223a6-c32e-4383-9cad-e52dcf0297fd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:09.312289 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2818/5616] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:07:09 2022] POST /identity/v3/users => generated 278 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:09.313729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0378ec5-62ea-47b9-bc8f-73411bb4a838 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:09.350914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0378ec5-62ea-47b9-bc8f-73411bb4a838 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:09.359503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb4c79-93c1-4dd6-87e4-40ffc1e6b0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:09.373181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb4c79-93c1-4dd6-87e4-40ffc1e6b0bc admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:09.374332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb4c79-93c1-4dd6-87e4-40ffc1e6b0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:09.374681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb4c79-93c1-4dd6-87e4-40ffc1e6b0bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:09.375906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb4c79-93c1-4dd6-87e4-40ffc1e6b0bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:09.378262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb4c79-93c1-4dd6-87e4-40ffc1e6b0bc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:09.404389 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2799/5617] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:09.407441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9223a6-c32e-4383-9cad-e52dcf0297fd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:09.421230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9223a6-c32e-4383-9cad-e52dcf0297fd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:09.432059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf318e-7cea-41bc-a57d-ecbf481590e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:09.432903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf318e-7cea-41bc-a57d-ecbf481590e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:09.433002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf318e-7cea-41bc-a57d-ecbf481590e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:09.433225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf318e-7cea-41bc-a57d-ecbf481590e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:09.433875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf318e-7cea-41bc-a57d-ecbf481590e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:09.438133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf318e-7cea-41bc-a57d-ecbf481590e0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:09.466392 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2819/5618] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:09.470331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb4c79-93c1-4dd6-87e4-40ffc1e6b0bc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:09.485378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb4c79-93c1-4dd6-87e4-40ffc1e6b0bc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:09.498302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f630a03-65b7-4464-821e-e3e77ba7005a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:09.499337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f630a03-65b7-4464-821e-e3e77ba7005a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:09.500029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f630a03-65b7-4464-821e-e3e77ba7005a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:09.501899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f630a03-65b7-4464-821e-e3e77ba7005a admin admin] PATH_INFO: `/v3/projects/4d9fb4fb9da74ca08bf2805937fe0b48/users/5cf7c2cbda0a42f08187a85407c210cf/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:09.525559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f630a03-65b7-4464-821e-e3e77ba7005a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9fb4fb9da74ca08bf2805937fe0b48, user_id=5cf7c2cbda0a42f08187a85407c210cf, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:09.532416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f630a03-65b7-4464-821e-e3e77ba7005a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:09.565184 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2800/5619] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:07:09 2022] PUT /identity/v3/projects/4d9fb4fb9da74ca08bf2805937fe0b48/users/5cf7c2cbda0a42f08187a85407c210cf/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:09.583941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd35876-7fd1-4688-b78d-65a28c04cfc2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:09.584232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd35876-7fd1-4688-b78d-65a28c04cfc2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:09.584503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd35876-7fd1-4688-b78d-65a28c04cfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:09.682179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bcd35876-7fd1-4688-b78d-65a28c04cfc2 None None] MFA Rules not processed for user `5cf7c2cbda0a42f08187a85407c210cf`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:09.682877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bcd35876-7fd1-4688-b78d-65a28c04cfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:09.823002 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2820/5620] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:09.828220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f630a03-65b7-4464-821e-e3e77ba7005a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:09.878234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd35876-7fd1-4688-b78d-65a28c04cfc2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:09.880966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bcd35876-7fd1-4688-b78d-65a28c04cfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:09.903520 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:09.964553 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:10.026390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f630a03-65b7-4464-821e-e3e77ba7005a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:10.039724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853cfdf-cc5d-40ff-bf2d-e31a46689c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:10.040576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853cfdf-cc5d-40ff-bf2d-e31a46689c10 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:10.040884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853cfdf-cc5d-40ff-bf2d-e31a46689c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:10.041160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853cfdf-cc5d-40ff-bf2d-e31a46689c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:10.041797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853cfdf-cc5d-40ff-bf2d-e31a46689c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:10.044970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853cfdf-cc5d-40ff-bf2d-e31a46689c10 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:10.069761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd35876-7fd1-4688-b78d-65a28c04cfc2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:10.076427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556c9c0-3d23-4246-8928-e4f925286cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:10.077359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556c9c0-3d23-4246-8928-e4f925286cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:10.077649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556c9c0-3d23-4246-8928-e4f925286cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:10.077981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556c9c0-3d23-4246-8928-e4f925286cb3 admin admin] PATH_INFO: `/v3/users/0a7f26754f78486280b0f2c327fb1bb8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:10.079998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556c9c0-3d23-4246-8928-e4f925286cb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a7f26754f78486280b0f2c327fb1bb8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:10.083710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556c9c0-3d23-4246-8928-e4f925286cb3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:10.119133 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2801/5621] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:07:09 2022] POST /identity/v3/projects => generated 357 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:10.120083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853cfdf-cc5d-40ff-bf2d-e31a46689c10 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:10.212872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9556c9c0-3d23-4246-8928-e4f925286cb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a7f26754f78486280b0f2c327fb1bb8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:10.215575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9556c9c0-3d23-4246-8928-e4f925286cb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a7f26754f78486280b0f2c327fb1bb8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:10.233888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9556c9c0-3d23-4246-8928-e4f925286cb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a7f26754f78486280b0f2c327fb1bb8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:10.279014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9556c9c0-3d23-4246-8928-e4f925286cb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a7f26754f78486280b0f2c327fb1bb8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:10.281626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853cfdf-cc5d-40ff-bf2d-e31a46689c10 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:10.291216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376a1c9-5376-400d-bb28-7db8f14a5191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:10.291974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376a1c9-5376-400d-bb28-7db8f14a5191 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:10.293562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376a1c9-5376-400d-bb28-7db8f14a5191 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:10.294567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376a1c9-5376-400d-bb28-7db8f14a5191 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:10.295342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376a1c9-5376-400d-bb28-7db8f14a5191 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:10.297980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376a1c9-5376-400d-bb28-7db8f14a5191 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:10.308763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9556c9c0-3d23-4246-8928-e4f925286cb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a7f26754f78486280b0f2c327fb1bb8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:10.324012 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2821/5622] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:07:09 2022] DELETE /identity/v3/users/0a7f26754f78486280b0f2c327fb1bb8 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:10.330538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556c9c0-3d23-4246-8928-e4f925286cb3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:10.337053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9556c9c0-3d23-4246-8928-e4f925286cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:10.367027 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2802/5623] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:07:10 2022] POST /identity/v3/users => generated 285 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:10.368684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2042c84-8993-4f21-aad5-cac1abfe01b6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:10.369282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2042c84-8993-4f21-aad5-cac1abfe01b6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:10.370035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2042c84-8993-4f21-aad5-cac1abfe01b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:10.417575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d2042c84-8993-4f21-aad5-cac1abfe01b6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:10.420307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d2042c84-8993-4f21-aad5-cac1abfe01b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:10.453628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556c9c0-3d23-4246-8928-e4f925286cb3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:10.463984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec35cb9-4f26-4594-889f-28bb4d9f4b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:10.464731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec35cb9-4f26-4594-889f-28bb4d9f4b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:10.465144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec35cb9-4f26-4594-889f-28bb4d9f4b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:10.465516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec35cb9-4f26-4594-889f-28bb4d9f4b50 admin admin] PATH_INFO: `/v3/users/ef13867e7dc6433283f59bb0121af017` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:10.467630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec35cb9-4f26-4594-889f-28bb4d9f4b50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef13867e7dc6433283f59bb0121af017)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:10.470258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec35cb9-4f26-4594-889f-28bb4d9f4b50 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:10.539293 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:10.546282 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2803/5624] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:10.547454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2042c84-8993-4f21-aad5-cac1abfe01b6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:10.549268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d2042c84-8993-4f21-aad5-cac1abfe01b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:10.560483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2ec35cb9-4f26-4594-889f-28bb4d9f4b50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef13867e7dc6433283f59bb0121af017'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:10.561947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2ec35cb9-4f26-4594-889f-28bb4d9f4b50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef13867e7dc6433283f59bb0121af017'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:10.572968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2ec35cb9-4f26-4594-889f-28bb4d9f4b50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef13867e7dc6433283f59bb0121af017'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:10.575689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2042c84-8993-4f21-aad5-cac1abfe01b6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:10.583153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adfe6e-8660-43fc-94ef-d90285cb0fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:10.584222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adfe6e-8660-43fc-94ef-d90285cb0fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:10.585001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adfe6e-8660-43fc-94ef-d90285cb0fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:10.585403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adfe6e-8660-43fc-94ef-d90285cb0fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:10.586485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40adfe6e-8660-43fc-94ef-d90285cb0fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:10.588303 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40adfe6e-8660-43fc-94ef-d90285cb0fe4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:10.589838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2ec35cb9-4f26-4594-889f-28bb4d9f4b50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef13867e7dc6433283f59bb0121af017'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:10.602379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2ec35cb9-4f26-4594-889f-28bb4d9f4b50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef13867e7dc6433283f59bb0121af017'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:10.604123 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2804/5625] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:10.605882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adfe6e-8660-43fc-94ef-d90285cb0fe4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:10.608241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-40adfe6e-8660-43fc-94ef-d90285cb0fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:10.635198 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2822/5626] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:07:10 2022] DELETE /identity/v3/users/ef13867e7dc6433283f59bb0121af017 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:10.636273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec35cb9-4f26-4594-889f-28bb4d9f4b50 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:10.648209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2ec35cb9-4f26-4594-889f-28bb4d9f4b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:10.715591 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:10.726773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adfe6e-8660-43fc-94ef-d90285cb0fe4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:10.809865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec35cb9-4f26-4594-889f-28bb4d9f4b50 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:10.818241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20915260-701e-4dd1-9e8d-ceb18f5edec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:10.819669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20915260-701e-4dd1-9e8d-ceb18f5edec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:10.820279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20915260-701e-4dd1-9e8d-ceb18f5edec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:10.820915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20915260-701e-4dd1-9e8d-ceb18f5edec8 admin admin] PATH_INFO: `/v3/projects/a2479e7569e74e059ef58df9894b09b4/users/ef7b409e92d14f0c876860e125042872/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:10.844863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20915260-701e-4dd1-9e8d-ceb18f5edec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2479e7569e74e059ef58df9894b09b4, user_id=ef7b409e92d14f0c876860e125042872, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:10.850652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20915260-701e-4dd1-9e8d-ceb18f5edec8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:10.882102 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2823/5627] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:07:10 2022] PUT /identity/v3/projects/a2479e7569e74e059ef58df9894b09b4/users/ef7b409e92d14f0c876860e125042872/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:10.884804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311a7ad-0bea-40ba-b36b-f747d3afe8d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:10.886440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311a7ad-0bea-40ba-b36b-f747d3afe8d7 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:10.886601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20915260-701e-4dd1-9e8d-ceb18f5edec8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:10.887092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311a7ad-0bea-40ba-b36b-f747d3afe8d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:10.887830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311a7ad-0bea-40ba-b36b-f747d3afe8d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:10.890667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1311a7ad-0bea-40ba-b36b-f747d3afe8d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:10.909384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311a7ad-0bea-40ba-b36b-f747d3afe8d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:10.913953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311a7ad-0bea-40ba-b36b-f747d3afe8d7 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:10.930911 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2805/5628] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:07:11.006701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20915260-701e-4dd1-9e8d-ceb18f5edec8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:11.014150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a37d8b-6304-429c-adc4-8d9cbadc852f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:11.015371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a37d8b-6304-429c-adc4-8d9cbadc852f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:11.016024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a37d8b-6304-429c-adc4-8d9cbadc852f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:11.016837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a37d8b-6304-429c-adc4-8d9cbadc852f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:11.017793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a37d8b-6304-429c-adc4-8d9cbadc852f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:11.021802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a37d8b-6304-429c-adc4-8d9cbadc852f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:11.041582 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2824/5629] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:11.042828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311a7ad-0bea-40ba-b36b-f747d3afe8d7 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:11.054835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311a7ad-0bea-40ba-b36b-f747d3afe8d7 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:11.060298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1916e-ace6-4bb7-917c-55d266fb76df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:11.061395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1916e-ace6-4bb7-917c-55d266fb76df admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:11.061963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1916e-ace6-4bb7-917c-55d266fb76df admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:11.062333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1916e-ace6-4bb7-917c-55d266fb76df admin admin] PATH_INFO: `/v3/projects/a2479e7569e74e059ef58df9894b09b4/users/ef7b409e92d14f0c876860e125042872/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:11.064485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1916e-ace6-4bb7-917c-55d266fb76df admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2479e7569e74e059ef58df9894b09b4, user_id=ef7b409e92d14f0c876860e125042872, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:11.068260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1916e-ace6-4bb7-917c-55d266fb76df admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:11.098422 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2806/5630] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:07:11 2022] PUT /identity/v3/projects/a2479e7569e74e059ef58df9894b09b4/users/ef7b409e92d14f0c876860e125042872/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:11.103320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079a89f-f638-4837-be87-a6c2814bd093 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:11.103796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079a89f-f638-4837-be87-a6c2814bd093 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:11.103994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079a89f-f638-4837-be87-a6c2814bd093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:11.183449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3079a89f-f638-4837-be87-a6c2814bd093 None None] MFA Rules not processed for user `ef7b409e92d14f0c876860e125042872`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:11.185522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3079a89f-f638-4837-be87-a6c2814bd093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:11.255856 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:11.347030 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2825/5631] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:11 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:11.353469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1916e-ace6-4bb7-917c-55d266fb76df admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:11.371279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1916e-ace6-4bb7-917c-55d266fb76df admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:11.378104 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4617d-389b-4e8b-82d9-a27ba34fdb04 tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef7b409e92d14f0c876860e125042872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2479e7569e74e059ef58df9894b09b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:11.379117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4617d-389b-4e8b-82d9-a27ba34fdb04 tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:11.379266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4617d-389b-4e8b-82d9-a27ba34fdb04 tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:11.379496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4617d-389b-4e8b-82d9-a27ba34fdb04 tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:11.380220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4617d-389b-4e8b-82d9-a27ba34fdb04 tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:07:11.380612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4617d-389b-4e8b-82d9-a27ba34fdb04 tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:11.382995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4617d-389b-4e8b-82d9-a27ba34fdb04 tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:11.415951 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2807/5632] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:07:11.417571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079a89f-f638-4837-be87-a6c2814bd093 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:11.430886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079a89f-f638-4837-be87-a6c2814bd093 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:11.435800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2763a97-fabc-4e0b-97be-4ee23f884220 tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef7b409e92d14f0c876860e125042872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2479e7569e74e059ef58df9894b09b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:11.436990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2763a97-fabc-4e0b-97be-4ee23f884220 tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:11.437500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2763a97-fabc-4e0b-97be-4ee23f884220 tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:11.437994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2763a97-fabc-4e0b-97be-4ee23f884220 tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:11.438894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2763a97-fabc-4e0b-97be-4ee23f884220 tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:11.441135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2763a97-fabc-4e0b-97be-4ee23f884220 tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:11.504212 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2826/5633] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:07:11 2022] POST /identity/v3/projects => generated 349 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:11.508824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4617d-389b-4e8b-82d9-a27ba34fdb04 tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:11.525383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4617d-389b-4e8b-82d9-a27ba34fdb04 tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:11.640506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1948275-2ee0-4f66-8278-97982cbaee3c tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef7b409e92d14f0c876860e125042872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2479e7569e74e059ef58df9894b09b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:11.641564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1948275-2ee0-4f66-8278-97982cbaee3c tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:11.642077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1948275-2ee0-4f66-8278-97982cbaee3c tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:11.642585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1948275-2ee0-4f66-8278-97982cbaee3c tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:11.643586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1948275-2ee0-4f66-8278-97982cbaee3c tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:07:11.644206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1948275-2ee0-4f66-8278-97982cbaee3c tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:11.648098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1948275-2ee0-4f66-8278-97982cbaee3c tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:11.672878 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2808/5634] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:07:11.702229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2763a97-fabc-4e0b-97be-4ee23f884220 tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:11.844348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2763a97-fabc-4e0b-97be-4ee23f884220 tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:11.853738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1948275-2ee0-4f66-8278-97982cbaee3c tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:11.856209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d1948275-2ee0-4f66-8278-97982cbaee3c tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:11.860755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdb096-bb07-444c-ac4e-e3818649065a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:11.861609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdb096-bb07-444c-ac4e-e3818649065a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:11.862773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdb096-bb07-444c-ac4e-e3818649065a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:11.863081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdb096-bb07-444c-ac4e-e3818649065a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:11.884845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdb096-bb07-444c-ac4e-e3818649065a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:11.888737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdb096-bb07-444c-ac4e-e3818649065a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:11.952394 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2827/5635] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:11 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:07:12.107813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1948275-2ee0-4f66-8278-97982cbaee3c tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:12.126001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d010ed-8beb-4c6e-b8a8-4bb220a853b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:12.126693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d010ed-8beb-4c6e-b8a8-4bb220a853b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:12.126970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d010ed-8beb-4c6e-b8a8-4bb220a853b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:12.127243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d010ed-8beb-4c6e-b8a8-4bb220a853b1 admin admin] PATH_INFO: `/v3/projects/e8bd2fa0cbc449ac86530c037fe446f1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:12.128527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d010ed-8beb-4c6e-b8a8-4bb220a853b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8bd2fa0cbc449ac86530c037fe446f1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:12.131201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d010ed-8beb-4c6e-b8a8-4bb220a853b1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:12.166943 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:12.256281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c2d010ed-8beb-4c6e-b8a8-4bb220a853b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8bd2fa0cbc449ac86530c037fe446f1', 'request_id': 'req-c2d010ed-8beb-4c6e-b8a8-4bb220a853b1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:12.287781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c2d010ed-8beb-4c6e-b8a8-4bb220a853b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8bd2fa0cbc449ac86530c037fe446f1', 'request_id': 'req-c2d010ed-8beb-4c6e-b8a8-4bb220a853b1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:12.301868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c2d010ed-8beb-4c6e-b8a8-4bb220a853b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8bd2fa0cbc449ac86530c037fe446f1', 'request_id': 'req-c2d010ed-8beb-4c6e-b8a8-4bb220a853b1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:12.341204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c2d010ed-8beb-4c6e-b8a8-4bb220a853b1 admin admin] The token cache is being invalidate because project e8bd2fa0cbc449ac86530c037fe446f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:07:12.341822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c2d010ed-8beb-4c6e-b8a8-4bb220a853b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:12.343723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c2d010ed-8beb-4c6e-b8a8-4bb220a853b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:12.348431 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2809/5636] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:07:11 2022] DELETE /identity/v3/projects/e8bd2fa0cbc449ac86530c037fe446f1 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:07:12.356910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918f11a-6923-4f32-8d0e-52b0e944eb21 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:12.357442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918f11a-6923-4f32-8d0e-52b0e944eb21 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:12.357567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918f11a-6923-4f32-8d0e-52b0e944eb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:12.425585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7918f11a-6923-4f32-8d0e-52b0e944eb21 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:12.427017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7918f11a-6923-4f32-8d0e-52b0e944eb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:12.578607 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2828/5637] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:12.587411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e31cd-9530-4535-9a1d-00b44621c843 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:12.587945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e31cd-9530-4535-9a1d-00b44621c843 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:12.587945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e31cd-9530-4535-9a1d-00b44621c843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:12.639879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-418e31cd-9530-4535-9a1d-00b44621c843 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:12.643080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-418e31cd-9530-4535-9a1d-00b44621c843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:12.665410 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2810/5638] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:12.669393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918f11a-6923-4f32-8d0e-52b0e944eb21 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:12.687270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918f11a-6923-4f32-8d0e-52b0e944eb21 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:12.701543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ca9e7-cca6-452f-a868-397fed4f97e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:12.702096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ca9e7-cca6-452f-a868-397fed4f97e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:12.702419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ca9e7-cca6-452f-a868-397fed4f97e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:12.702655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ca9e7-cca6-452f-a868-397fed4f97e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:12.703327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ca9e7-cca6-452f-a868-397fed4f97e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:07:12.703635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ca9e7-cca6-452f-a868-397fed4f97e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:12.705292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ca9e7-cca6-452f-a868-397fed4f97e6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:12.740054 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2829/5639] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:07:12.741518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e31cd-9530-4535-9a1d-00b44621c843 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:12.756025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e31cd-9530-4535-9a1d-00b44621c843 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:12.761723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51aae7-6624-4456-906b-11c550577248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:12.762402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51aae7-6624-4456-906b-11c550577248 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:12.762795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51aae7-6624-4456-906b-11c550577248 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:12.763081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51aae7-6624-4456-906b-11c550577248 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:12.764697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51aae7-6624-4456-906b-11c550577248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:12.772915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51aae7-6624-4456-906b-11c550577248 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:12.841831 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2811/5640] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:07:12 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:12.846269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ca9e7-cca6-452f-a868-397fed4f97e6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:12.864852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ca9e7-cca6-452f-a868-397fed4f97e6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:12.919963 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:13.033847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51aae7-6624-4456-906b-11c550577248 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:13.036092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0a51aae7-6624-4456-906b-11c550577248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:13.039200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9107382-00d3-4868-986e-17e68575dd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:13.039821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9107382-00d3-4868-986e-17e68575dd4c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:13.040113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9107382-00d3-4868-986e-17e68575dd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:13.040374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9107382-00d3-4868-986e-17e68575dd4c admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:13.041481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9107382-00d3-4868-986e-17e68575dd4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:13.043424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9107382-00d3-4868-986e-17e68575dd4c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:13.072523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51aae7-6624-4456-906b-11c550577248 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:13.089180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534823c9-3410-4f71-a73a-35a7272a5661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:13.089840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534823c9-3410-4f71-a73a-35a7272a5661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:13.090116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534823c9-3410-4f71-a73a-35a7272a5661 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:13.090582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534823c9-3410-4f71-a73a-35a7272a5661 admin admin] PATH_INFO: `/v3/projects/e1808637e638478083c8abda925427e5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:13.092625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534823c9-3410-4f71-a73a-35a7272a5661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1808637e638478083c8abda925427e5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:13.094746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534823c9-3410-4f71-a73a-35a7272a5661 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:13.104410 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2830/5641] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:07:12 2022] POST /identity/v3/users => generated 287 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:13.106323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9107382-00d3-4868-986e-17e68575dd4c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:13.133654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9107382-00d3-4868-986e-17e68575dd4c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:13.145987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ed279-e103-4f4f-a5ef-7cdc69fcfe31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:13.146622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ed279-e103-4f4f-a5ef-7cdc69fcfe31 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:13.146906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ed279-e103-4f4f-a5ef-7cdc69fcfe31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:13.147181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ed279-e103-4f4f-a5ef-7cdc69fcfe31 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:13.147837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ed279-e103-4f4f-a5ef-7cdc69fcfe31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:13.149564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ed279-e103-4f4f-a5ef-7cdc69fcfe31 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:13.187422 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2831/5642] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:07:13.189189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ed279-e103-4f4f-a5ef-7cdc69fcfe31 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:13.211594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ed279-e103-4f4f-a5ef-7cdc69fcfe31 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:13.227867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71e2ac-abd3-4f53-9512-5ff610fb4292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:13.228509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71e2ac-abd3-4f53-9512-5ff610fb4292 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:13.228881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71e2ac-abd3-4f53-9512-5ff610fb4292 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:13.229081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71e2ac-abd3-4f53-9512-5ff610fb4292 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:13.231319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71e2ac-abd3-4f53-9512-5ff610fb4292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:13.237037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71e2ac-abd3-4f53-9512-5ff610fb4292 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:13.270294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-534823c9-3410-4f71-a73a-35a7272a5661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1808637e638478083c8abda925427e5', 'request_id': 'req-534823c9-3410-4f71-a73a-35a7272a5661'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:13.277313 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2832/5643] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:13.279809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71e2ac-abd3-4f53-9512-5ff610fb4292 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:13.304157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-534823c9-3410-4f71-a73a-35a7272a5661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1808637e638478083c8abda925427e5', 'request_id': 'req-534823c9-3410-4f71-a73a-35a7272a5661'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:13.310822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71e2ac-abd3-4f53-9512-5ff610fb4292 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:13.313324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-534823c9-3410-4f71-a73a-35a7272a5661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1808637e638478083c8abda925427e5', 'request_id': 'req-534823c9-3410-4f71-a73a-35a7272a5661'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:13.357917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-534823c9-3410-4f71-a73a-35a7272a5661 admin admin] The token cache is being invalidate because project e1808637e638478083c8abda925427e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:07:13.358397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-534823c9-3410-4f71-a73a-35a7272a5661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:13.361369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-534823c9-3410-4f71-a73a-35a7272a5661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:13.373118 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2812/5644] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:07:13 2022] DELETE /identity/v3/projects/e1808637e638478083c8abda925427e5 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:13.374429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534823c9-3410-4f71-a73a-35a7272a5661 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:13.378151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-534823c9-3410-4f71-a73a-35a7272a5661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:13.453903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef12ab-a3e8-4d1d-af39-4723405afd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:13.455324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef12ab-a3e8-4d1d-af39-4723405afd30 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:13.455624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef12ab-a3e8-4d1d-af39-4723405afd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:13.455904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef12ab-a3e8-4d1d-af39-4723405afd30 admin admin] PATH_INFO: `/v3/projects/38479192783c4718a6b41b4d13d191e0/users/2ad42e28e3444cd3b25054439f53e9c8/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:13.486225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef12ab-a3e8-4d1d-af39-4723405afd30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38479192783c4718a6b41b4d13d191e0, user_id=2ad42e28e3444cd3b25054439f53e9c8, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:13.492014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef12ab-a3e8-4d1d-af39-4723405afd30 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:13.529751 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2833/5645] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:07:13 2022] PUT /identity/v3/projects/38479192783c4718a6b41b4d13d191e0/users/2ad42e28e3444cd3b25054439f53e9c8/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:13.530778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef12ab-a3e8-4d1d-af39-4723405afd30 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:13.538376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f7ef12ab-a3e8-4d1d-af39-4723405afd30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:13.538737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534823c9-3410-4f71-a73a-35a7272a5661 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:13.549772 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:13.677011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38207551-4f61-4581-8803-10c980538fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:13.677832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38207551-4f61-4581-8803-10c980538fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:13.678205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38207551-4f61-4581-8803-10c980538fde admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:13.678570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38207551-4f61-4581-8803-10c980538fde admin admin] PATH_INFO: `/v3/users/a435a1cb71a94d9f8c38dc66e8cfc34c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:13.685172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38207551-4f61-4581-8803-10c980538fde admin admin] RBAC: Authorizing `identity:delete_user(user_id=a435a1cb71a94d9f8c38dc66e8cfc34c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:13.687333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38207551-4f61-4581-8803-10c980538fde admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:13.758029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef12ab-a3e8-4d1d-af39-4723405afd30 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:13.774251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67daab4-df3d-4cf0-94b9-4a22274da8cf tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef7b409e92d14f0c876860e125042872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2479e7569e74e059ef58df9894b09b4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:13.775787 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67daab4-df3d-4cf0-94b9-4a22274da8cf tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:13.776239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67daab4-df3d-4cf0-94b9-4a22274da8cf tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:13.776919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67daab4-df3d-4cf0-94b9-4a22274da8cf tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] PATH_INFO: `/v3/projects/4e147b3dfe844c77b8a61f851d7aafa1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:13.779132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67daab4-df3d-4cf0-94b9-4a22274da8cf tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4e147b3dfe844c77b8a61f851d7aafa1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:13.781272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67daab4-df3d-4cf0-94b9-4a22274da8cf tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:13.826822 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:13.834616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-38207551-4f61-4581-8803-10c980538fde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a435a1cb71a94d9f8c38dc66e8cfc34c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:13.856238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-38207551-4f61-4581-8803-10c980538fde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a435a1cb71a94d9f8c38dc66e8cfc34c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:13.857061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-38207551-4f61-4581-8803-10c980538fde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a435a1cb71a94d9f8c38dc66e8cfc34c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:13.892966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-38207551-4f61-4581-8803-10c980538fde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a435a1cb71a94d9f8c38dc66e8cfc34c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:13.905743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c67daab4-df3d-4cf0-94b9-4a22274da8cf tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e147b3dfe844c77b8a61f851d7aafa1', 'request_id': 'req-c67daab4-df3d-4cf0-94b9-4a22274da8cf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:13.922187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-38207551-4f61-4581-8803-10c980538fde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a435a1cb71a94d9f8c38dc66e8cfc34c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:13.941809 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2813/5646] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:07:13 2022] DELETE /identity/v3/users/a435a1cb71a94d9f8c38dc66e8cfc34c => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:13.943562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7791301-3946-493d-ba07-6ebb68a2523d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:13.944093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7791301-3946-493d-ba07-6ebb68a2523d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:13.944577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7791301-3946-493d-ba07-6ebb68a2523d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:13.950597 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c67daab4-df3d-4cf0-94b9-4a22274da8cf tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e147b3dfe844c77b8a61f851d7aafa1', 'request_id': 'req-c67daab4-df3d-4cf0-94b9-4a22274da8cf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:13.970153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c67daab4-df3d-4cf0-94b9-4a22274da8cf tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e147b3dfe844c77b8a61f851d7aafa1', 'request_id': 'req-c67daab4-df3d-4cf0-94b9-4a22274da8cf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:14.003171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e7791301-3946-493d-ba07-6ebb68a2523d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:14.014334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e7791301-3946-493d-ba07-6ebb68a2523d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:14.021109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c67daab4-df3d-4cf0-94b9-4a22274da8cf tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] The token cache is being invalidate because project 4e147b3dfe844c77b8a61f851d7aafa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:07:14.021771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c67daab4-df3d-4cf0-94b9-4a22274da8cf tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:14.029135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c67daab4-df3d-4cf0-94b9-4a22274da8cf tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:14.031175 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2834/5647] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:07:13 2022] DELETE /identity/v3/projects/4e147b3dfe844c77b8a61f851d7aafa1 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:14.152787 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2814/5648] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:14.213158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67daab4-df3d-4cf0-94b9-4a22274da8cf tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:14.215008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c67daab4-df3d-4cf0-94b9-4a22274da8cf tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:14.331856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67daab4-df3d-4cf0-94b9-4a22274da8cf tempest-QuotasTest-1133292386 tempest-QuotasTest-1133292386-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:14.453704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0dc6b-39f6-4bab-8b37-c5895d8db617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:14.454374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0dc6b-39f6-4bab-8b37-c5895d8db617 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:14.454907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0dc6b-39f6-4bab-8b37-c5895d8db617 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:14.454907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0dc6b-39f6-4bab-8b37-c5895d8db617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:14.473811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0dc6b-39f6-4bab-8b37-c5895d8db617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:14.475757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0dc6b-39f6-4bab-8b37-c5895d8db617 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:14.491963 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2835/5649] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:07:14.850242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7791301-3946-493d-ba07-6ebb68a2523d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:14.851747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e7791301-3946-493d-ba07-6ebb68a2523d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:14.864719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7791301-3946-493d-ba07-6ebb68a2523d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:14.869832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02631e-4170-48ad-be97-322040e61d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:14.870493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02631e-4170-48ad-be97-322040e61d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:14.870771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02631e-4170-48ad-be97-322040e61d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:14.871041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02631e-4170-48ad-be97-322040e61d20 admin admin] PATH_INFO: `/v3/users/5cf7c2cbda0a42f08187a85407c210cf` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:14.872320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02631e-4170-48ad-be97-322040e61d20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cf7c2cbda0a42f08187a85407c210cf)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:14.874245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02631e-4170-48ad-be97-322040e61d20 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:14.901270 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:14.969114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dd02631e-4170-48ad-be97-322040e61d20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cf7c2cbda0a42f08187a85407c210cf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:14.997587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dd02631e-4170-48ad-be97-322040e61d20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cf7c2cbda0a42f08187a85407c210cf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:15.001716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dd02631e-4170-48ad-be97-322040e61d20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cf7c2cbda0a42f08187a85407c210cf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:15.036313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dd02631e-4170-48ad-be97-322040e61d20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cf7c2cbda0a42f08187a85407c210cf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:15.048300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dd02631e-4170-48ad-be97-322040e61d20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cf7c2cbda0a42f08187a85407c210cf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:15.071864 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2815/5650] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:07:14 2022] DELETE /identity/v3/users/5cf7c2cbda0a42f08187a85407c210cf => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:15.072824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f362c4d-b045-4a10-b588-a4f7d0b98750 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:15.073085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f362c4d-b045-4a10-b588-a4f7d0b98750 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:15.073357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f362c4d-b045-4a10-b588-a4f7d0b98750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:15.106121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6f362c4d-b045-4a10-b588-a4f7d0b98750 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:15.107929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6f362c4d-b045-4a10-b588-a4f7d0b98750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:15.211744 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2836/5651] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:15.222745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02631e-4170-48ad-be97-322040e61d20 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:15.224331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dd02631e-4170-48ad-be97-322040e61d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:15.293097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02631e-4170-48ad-be97-322040e61d20 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:15.296768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7da1d5-2f77-4610-a369-2681a27bc6b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:15.297666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7da1d5-2f77-4610-a369-2681a27bc6b7 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:15.298031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7da1d5-2f77-4610-a369-2681a27bc6b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:15.299441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7da1d5-2f77-4610-a369-2681a27bc6b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:15.309913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7da1d5-2f77-4610-a369-2681a27bc6b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:15.311451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7da1d5-2f77-4610-a369-2681a27bc6b7 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:15.323293 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2816/5652] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:07:15.549426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f362c4d-b045-4a10-b588-a4f7d0b98750 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:15.551552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6f362c4d-b045-4a10-b588-a4f7d0b98750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:15.559786 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:15.567807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f362c4d-b045-4a10-b588-a4f7d0b98750 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:15.576071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff7480-ca44-4180-b841-2a933b3e60c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:15.576857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff7480-ca44-4180-b841-2a933b3e60c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:15.577243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff7480-ca44-4180-b841-2a933b3e60c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:15.577607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff7480-ca44-4180-b841-2a933b3e60c4 admin admin] PATH_INFO: `/v3/projects/4673a959958e40909546161cbeb5a57c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:15.581498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff7480-ca44-4180-b841-2a933b3e60c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4673a959958e40909546161cbeb5a57c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:15.585223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff7480-ca44-4180-b841-2a933b3e60c4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:15.693142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7da1d5-2f77-4610-a369-2681a27bc6b7 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:15.695323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4f7da1d5-2f77-4610-a369-2681a27bc6b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:15.702578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f5ff7480-ca44-4180-b841-2a933b3e60c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4673a959958e40909546161cbeb5a57c', 'request_id': 'req-f5ff7480-ca44-4180-b841-2a933b3e60c4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:15.724722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f5ff7480-ca44-4180-b841-2a933b3e60c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4673a959958e40909546161cbeb5a57c', 'request_id': 'req-f5ff7480-ca44-4180-b841-2a933b3e60c4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:15.731818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f5ff7480-ca44-4180-b841-2a933b3e60c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4673a959958e40909546161cbeb5a57c', 'request_id': 'req-f5ff7480-ca44-4180-b841-2a933b3e60c4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:15.732262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7da1d5-2f77-4610-a369-2681a27bc6b7 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:15.761559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f5ff7480-ca44-4180-b841-2a933b3e60c4 admin admin] The token cache is being invalidate because project 4673a959958e40909546161cbeb5a57c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:07:15.763495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f5ff7480-ca44-4180-b841-2a933b3e60c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:15.764711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f5ff7480-ca44-4180-b841-2a933b3e60c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:15.773646 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2837/5653] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:07:15 2022] DELETE /identity/v3/projects/4673a959958e40909546161cbeb5a57c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:15.775184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479f6e2-61e3-4b9b-b118-53a12520ae9b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:15.777472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479f6e2-61e3-4b9b-b118-53a12520ae9b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:15.777930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479f6e2-61e3-4b9b-b118-53a12520ae9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:15.819711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c479f6e2-61e3-4b9b-b118-53a12520ae9b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:15.821057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c479f6e2-61e3-4b9b-b118-53a12520ae9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:15.867131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836ca8b-bf7e-4a85-94fc-b829d3918414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:15.868856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836ca8b-bf7e-4a85-94fc-b829d3918414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:15.869299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836ca8b-bf7e-4a85-94fc-b829d3918414 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:15.869887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836ca8b-bf7e-4a85-94fc-b829d3918414 admin admin] PATH_INFO: `/v3/projects/4d9fb4fb9da74ca08bf2805937fe0b48` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:15.873711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836ca8b-bf7e-4a85-94fc-b829d3918414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d9fb4fb9da74ca08bf2805937fe0b48)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:15.877372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836ca8b-bf7e-4a85-94fc-b829d3918414 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:15.919536 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2838/5654] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:15.921184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15d296-bc7a-422d-a16b-f318148b9d57 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:15.921566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15d296-bc7a-422d-a16b-f318148b9d57 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:15.922409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15d296-bc7a-422d-a16b-f318148b9d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:15.964278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0b15d296-bc7a-422d-a16b-f318148b9d57 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:15.965530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0b15d296-bc7a-422d-a16b-f318148b9d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:15.973857 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:15.985725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4836ca8b-bf7e-4a85-94fc-b829d3918414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d9fb4fb9da74ca08bf2805937fe0b48', 'request_id': 'req-4836ca8b-bf7e-4a85-94fc-b829d3918414'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:16.011608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4836ca8b-bf7e-4a85-94fc-b829d3918414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d9fb4fb9da74ca08bf2805937fe0b48', 'request_id': 'req-4836ca8b-bf7e-4a85-94fc-b829d3918414'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:16.020932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4836ca8b-bf7e-4a85-94fc-b829d3918414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d9fb4fb9da74ca08bf2805937fe0b48', 'request_id': 'req-4836ca8b-bf7e-4a85-94fc-b829d3918414'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:16.036035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4836ca8b-bf7e-4a85-94fc-b829d3918414 admin admin] The token cache is being invalidate because project 4d9fb4fb9da74ca08bf2805937fe0b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:07:16.036338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4836ca8b-bf7e-4a85-94fc-b829d3918414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:16.037148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4836ca8b-bf7e-4a85-94fc-b829d3918414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:16.039190 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2817/5655] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:07:15 2022] DELETE /identity/v3/projects/4d9fb4fb9da74ca08bf2805937fe0b48 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:16.043290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836ca8b-bf7e-4a85-94fc-b829d3918414 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:16.045036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4836ca8b-bf7e-4a85-94fc-b829d3918414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:16.080331 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2839/5656] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:16.087375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15d296-bc7a-422d-a16b-f318148b9d57 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:16.099582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15d296-bc7a-422d-a16b-f318148b9d57 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:16.107931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a02175-4168-4ca8-9b3e-5b5fc2835c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:16.110194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a02175-4168-4ca8-9b3e-5b5fc2835c63 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:16.111426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a02175-4168-4ca8-9b3e-5b5fc2835c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:16.111873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a02175-4168-4ca8-9b3e-5b5fc2835c63 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:16.113599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a02175-4168-4ca8-9b3e-5b5fc2835c63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:07:16.114361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a02175-4168-4ca8-9b3e-5b5fc2835c63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:16.117178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a02175-4168-4ca8-9b3e-5b5fc2835c63 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:16.138536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836ca8b-bf7e-4a85-94fc-b829d3918414 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:16.149185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf5bbb-7605-411d-a37d-210bda1dfd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:16.150522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf5bbb-7605-411d-a37d-210bda1dfd6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:16.150874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf5bbb-7605-411d-a37d-210bda1dfd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:16.151286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf5bbb-7605-411d-a37d-210bda1dfd6e admin admin] PATH_INFO: `/v3/users/ef7b409e92d14f0c876860e125042872` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:16.154627 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2840/5657] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:07:16.158173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf5bbb-7605-411d-a37d-210bda1dfd6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef7b409e92d14f0c876860e125042872)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:16.158880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a02175-4168-4ca8-9b3e-5b5fc2835c63 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:16.160673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf5bbb-7605-411d-a37d-210bda1dfd6e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:16.214327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a02175-4168-4ca8-9b3e-5b5fc2835c63 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:16.225470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57709f5-4986-4641-82d9-03686c3edc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:16.226496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57709f5-4986-4641-82d9-03686c3edc8c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:16.227293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57709f5-4986-4641-82d9-03686c3edc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:16.227981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57709f5-4986-4641-82d9-03686c3edc8c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:16.229155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57709f5-4986-4641-82d9-03686c3edc8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:16.232383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57709f5-4986-4641-82d9-03686c3edc8c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:16.253147 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:16.289952 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2841/5658] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:07:16 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:16.291074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57709f5-4986-4641-82d9-03686c3edc8c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:16.291747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7adf5bbb-7605-411d-a37d-210bda1dfd6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef7b409e92d14f0c876860e125042872'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:16.304701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7adf5bbb-7605-411d-a37d-210bda1dfd6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef7b409e92d14f0c876860e125042872'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:16.305512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7adf5bbb-7605-411d-a37d-210bda1dfd6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef7b409e92d14f0c876860e125042872'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:16.341294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7adf5bbb-7605-411d-a37d-210bda1dfd6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef7b409e92d14f0c876860e125042872'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:16.360047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7adf5bbb-7605-411d-a37d-210bda1dfd6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef7b409e92d14f0c876860e125042872'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:16.377980 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2818/5659] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:07:16 2022] DELETE /identity/v3/users/ef7b409e92d14f0c876860e125042872 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:16.429855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf5bbb-7605-411d-a37d-210bda1dfd6e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:16.431583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7adf5bbb-7605-411d-a37d-210bda1dfd6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:16.445944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57709f5-4986-4641-82d9-03686c3edc8c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:16.565207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3197ac-60c5-4f02-a0a1-8489755fe958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:16.568841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3197ac-60c5-4f02-a0a1-8489755fe958 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:16.569688 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:16.571772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3197ac-60c5-4f02-a0a1-8489755fe958 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:16.573010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3197ac-60c5-4f02-a0a1-8489755fe958 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:16.575626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3197ac-60c5-4f02-a0a1-8489755fe958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:16.579544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3197ac-60c5-4f02-a0a1-8489755fe958 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:16.590115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf5bbb-7605-411d-a37d-210bda1dfd6e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:16.596902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3aacf6-4fb9-45f1-acbf-7fb2f75896e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:16.598405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aacf6-4fb9-45f1-acbf-7fb2f75896e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:16.598754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aacf6-4fb9-45f1-acbf-7fb2f75896e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:16.599235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aacf6-4fb9-45f1-acbf-7fb2f75896e9 admin admin] PATH_INFO: `/v3/users/167e3eca580d49abb4e1297047ee566c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:16.600677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3aacf6-4fb9-45f1-acbf-7fb2f75896e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=167e3eca580d49abb4e1297047ee566c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:16.602764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3aacf6-4fb9-45f1-acbf-7fb2f75896e9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:16.639304 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2842/5660] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:07:16 2022] POST /identity/v3/users => generated 293 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:16.643524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3197ac-60c5-4f02-a0a1-8489755fe958 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:16.646877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ee3197ac-60c5-4f02-a0a1-8489755fe958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:16.669120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3197ac-60c5-4f02-a0a1-8489755fe958 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:16.677220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4d7e6-b58b-4ad8-9128-af328719dd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:16.678232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4d7e6-b58b-4ad8-9128-af328719dd86 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:16.679047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4d7e6-b58b-4ad8-9128-af328719dd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:16.679481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4d7e6-b58b-4ad8-9128-af328719dd86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:16.680284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4d7e6-b58b-4ad8-9128-af328719dd86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:16.682465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4d7e6-b58b-4ad8-9128-af328719dd86 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:16.705551 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2843/5661] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:07:16.706276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0d3aacf6-4fb9-45f1-acbf-7fb2f75896e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '167e3eca580d49abb4e1297047ee566c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:16.710368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4d7e6-b58b-4ad8-9128-af328719dd86 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:16.725602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4d7e6-b58b-4ad8-9128-af328719dd86 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:16.729161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0d3aacf6-4fb9-45f1-acbf-7fb2f75896e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '167e3eca580d49abb4e1297047ee566c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:16.730583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0d3aacf6-4fb9-45f1-acbf-7fb2f75896e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '167e3eca580d49abb4e1297047ee566c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:16.734868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1f90e-f21a-4e31-b1f5-66208b8340c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:16.735850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1f90e-f21a-4e31-b1f5-66208b8340c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:16.736395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1f90e-f21a-4e31-b1f5-66208b8340c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:16.736989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1f90e-f21a-4e31-b1f5-66208b8340c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:16.738484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1f90e-f21a-4e31-b1f5-66208b8340c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:16.740698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1f90e-f21a-4e31-b1f5-66208b8340c7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:16.752974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0d3aacf6-4fb9-45f1-acbf-7fb2f75896e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '167e3eca580d49abb4e1297047ee566c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:16.765455 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2844/5662] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:07:16.766819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0d3aacf6-4fb9-45f1-acbf-7fb2f75896e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '167e3eca580d49abb4e1297047ee566c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:16.770222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1f90e-f21a-4e31-b1f5-66208b8340c7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:16.773181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7df1f90e-f21a-4e31-b1f5-66208b8340c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:16.779745 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2819/5663] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:07:16 2022] DELETE /identity/v3/users/167e3eca580d49abb4e1297047ee566c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:16.784680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546e742-e553-466f-afd2-a1b143861903 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:16.785921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546e742-e553-466f-afd2-a1b143861903 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:16.786714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546e742-e553-466f-afd2-a1b143861903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:16.787796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1f90e-f21a-4e31-b1f5-66208b8340c7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:16.822802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9546e742-e553-466f-afd2-a1b143861903 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:16.824557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9546e742-e553-466f-afd2-a1b143861903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:16.885508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e1814-f218-47c1-a7fb-4a0834dad81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:16.887405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e1814-f218-47c1-a7fb-4a0834dad81d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:16.887814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e1814-f218-47c1-a7fb-4a0834dad81d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:16.888765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e1814-f218-47c1-a7fb-4a0834dad81d admin admin] PATH_INFO: `/v3/projects/6ca3eb7ad4f84f0dbeb6e511de3cd2c0/users/7626452434404635a6e26f9d2b61be49/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:16.917478 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:16.932114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e1814-f218-47c1-a7fb-4a0834dad81d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca3eb7ad4f84f0dbeb6e511de3cd2c0, user_id=7626452434404635a6e26f9d2b61be49, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:16.941948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e1814-f218-47c1-a7fb-4a0834dad81d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:16.942991 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2820/5664] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:16.955073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546e742-e553-466f-afd2-a1b143861903 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:16.958469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9546e742-e553-466f-afd2-a1b143861903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:16.992881 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2845/5665] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:07:16 2022] PUT /identity/v3/projects/6ca3eb7ad4f84f0dbeb6e511de3cd2c0/users/7626452434404635a6e26f9d2b61be49/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:07:17.008048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41947fd1-f34d-4d22-b490-09258b60f688 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:17.008757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41947fd1-f34d-4d22-b490-09258b60f688 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:17.009321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41947fd1-f34d-4d22-b490-09258b60f688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:17.073055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-41947fd1-f34d-4d22-b490-09258b60f688 None None] MFA Rules not processed for user `7626452434404635a6e26f9d2b61be49`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:17.074699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-41947fd1-f34d-4d22-b490-09258b60f688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:17.126101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546e742-e553-466f-afd2-a1b143861903 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:17.184202 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:17.221154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22365c-de4b-4f87-bd6e-e98bd0e88b3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:17.222118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22365c-de4b-4f87-bd6e-e98bd0e88b3f service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:17.223353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22365c-de4b-4f87-bd6e-e98bd0e88b3f service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:17.223941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22365c-de4b-4f87-bd6e-e98bd0e88b3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:17.233983 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2846/5666] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:17.308110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41947fd1-f34d-4d22-b490-09258b60f688 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:17.309931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-41947fd1-f34d-4d22-b490-09258b60f688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:17.334452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41947fd1-f34d-4d22-b490-09258b60f688 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:17.343905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f9280-8877-44ea-8706-5f1839c59a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:17.344673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f9280-8877-44ea-8706-5f1839c59a50 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:17.345183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f9280-8877-44ea-8706-5f1839c59a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:17.345667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f9280-8877-44ea-8706-5f1839c59a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:17.362431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f9280-8877-44ea-8706-5f1839c59a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:17.367347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f9280-8877-44ea-8706-5f1839c59a50 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:17.393638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22365c-de4b-4f87-bd6e-e98bd0e88b3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:17.393889 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2847/5667] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:07:17.396013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22365c-de4b-4f87-bd6e-e98bd0e88b3f service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:17.409802 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2821/5668] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:07:18.694402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f9280-8877-44ea-8706-5f1839c59a50 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:18.696001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a60f9280-8877-44ea-8706-5f1839c59a50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:18.717898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f9280-8877-44ea-8706-5f1839c59a50 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:18.722838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a976bbb-095e-42b8-bdf0-a397a8058846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:18.723727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a976bbb-095e-42b8-bdf0-a397a8058846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:18.724272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a976bbb-095e-42b8-bdf0-a397a8058846 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:18.724705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a976bbb-095e-42b8-bdf0-a397a8058846 admin admin] PATH_INFO: `/v3/projects/a2479e7569e74e059ef58df9894b09b4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:18.725998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a976bbb-095e-42b8-bdf0-a397a8058846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2479e7569e74e059ef58df9894b09b4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:18.728006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a976bbb-095e-42b8-bdf0-a397a8058846 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:18.852851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6a976bbb-095e-42b8-bdf0-a397a8058846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2479e7569e74e059ef58df9894b09b4', 'request_id': 'req-6a976bbb-095e-42b8-bdf0-a397a8058846'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:18.878666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6a976bbb-095e-42b8-bdf0-a397a8058846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2479e7569e74e059ef58df9894b09b4', 'request_id': 'req-6a976bbb-095e-42b8-bdf0-a397a8058846'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:18.887451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6a976bbb-095e-42b8-bdf0-a397a8058846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2479e7569e74e059ef58df9894b09b4', 'request_id': 'req-6a976bbb-095e-42b8-bdf0-a397a8058846'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:18.923199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6a976bbb-095e-42b8-bdf0-a397a8058846 admin admin] The token cache is being invalidate because project a2479e7569e74e059ef58df9894b09b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:07:18.923827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6a976bbb-095e-42b8-bdf0-a397a8058846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:18.926254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6a976bbb-095e-42b8-bdf0-a397a8058846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:18.936730 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2848/5669] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:07:18 2022] DELETE /identity/v3/projects/a2479e7569e74e059ef58df9894b09b4 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:18.943743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a016b9-58fb-4ef2-abae-87a36bdf5466 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:18.944211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a016b9-58fb-4ef2-abae-87a36bdf5466 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:18.944329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a016b9-58fb-4ef2-abae-87a36bdf5466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:18.982925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-60a016b9-58fb-4ef2-abae-87a36bdf5466 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:18.984141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-60a016b9-58fb-4ef2-abae-87a36bdf5466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:19.114638 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2822/5670] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:19.124375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ef191-97fb-4ad9-9108-92b9c8f93ff2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:19.124684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ef191-97fb-4ad9-9108-92b9c8f93ff2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:19.124934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ef191-97fb-4ad9-9108-92b9c8f93ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:19.151847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-614ef191-97fb-4ad9-9108-92b9c8f93ff2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:19.153528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-614ef191-97fb-4ad9-9108-92b9c8f93ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:19.170281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a016b9-58fb-4ef2-abae-87a36bdf5466 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:19.178714 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2849/5671] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:19.184364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a016b9-58fb-4ef2-abae-87a36bdf5466 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:19.189951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241f0ee-10f5-4e00-9de9-ff0639488f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:19.190738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241f0ee-10f5-4e00-9de9-ff0639488f0a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:19.191030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241f0ee-10f5-4e00-9de9-ff0639488f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:19.198913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241f0ee-10f5-4e00-9de9-ff0639488f0a admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:19.201034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241f0ee-10f5-4e00-9de9-ff0639488f0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:07:19.201461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241f0ee-10f5-4e00-9de9-ff0639488f0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:19.203331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241f0ee-10f5-4e00-9de9-ff0639488f0a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:19.229283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ef191-97fb-4ad9-9108-92b9c8f93ff2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:19.235869 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2823/5672] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:07:19.242074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ef191-97fb-4ad9-9108-92b9c8f93ff2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:19.257046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff5203-5eec-4333-b59c-0e078e4397e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:19.257973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff5203-5eec-4333-b59c-0e078e4397e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:19.258423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff5203-5eec-4333-b59c-0e078e4397e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:19.259481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff5203-5eec-4333-b59c-0e078e4397e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:19.260463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff5203-5eec-4333-b59c-0e078e4397e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:19.263695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff5203-5eec-4333-b59c-0e078e4397e6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:19.341069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241f0ee-10f5-4e00-9de9-ff0639488f0a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:19.353403 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2850/5673] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:07:19 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:19.358547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241f0ee-10f5-4e00-9de9-ff0639488f0a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:19.521649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de6a55-5ff4-4a9c-a384-97424a94f36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:19.522559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de6a55-5ff4-4a9c-a384-97424a94f36f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:19.523025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de6a55-5ff4-4a9c-a384-97424a94f36f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:19.523465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de6a55-5ff4-4a9c-a384-97424a94f36f admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:19.524258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de6a55-5ff4-4a9c-a384-97424a94f36f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:19.526347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de6a55-5ff4-4a9c-a384-97424a94f36f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:19.553058 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:19.580718 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2824/5674] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:07:19 2022] POST /identity/v3/users => generated 287 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:19.584060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff5203-5eec-4333-b59c-0e078e4397e6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:19.599538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff5203-5eec-4333-b59c-0e078e4397e6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:19.609276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d0ce3-d452-4e39-9bc0-8119e5a097f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:19.609802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d0ce3-d452-4e39-9bc0-8119e5a097f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:19.610082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d0ce3-d452-4e39-9bc0-8119e5a097f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:19.610353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d0ce3-d452-4e39-9bc0-8119e5a097f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:19.615786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d0ce3-d452-4e39-9bc0-8119e5a097f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:19.617490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d0ce3-d452-4e39-9bc0-8119e5a097f7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:19.657073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de6a55-5ff4-4a9c-a384-97424a94f36f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:19.666653 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2851/5675] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:19.674727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de6a55-5ff4-4a9c-a384-97424a94f36f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:19.688845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2764db9-2370-4bd3-8bf8-24fcf4b36a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:19.689499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2764db9-2370-4bd3-8bf8-24fcf4b36a6e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:19.689780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2764db9-2370-4bd3-8bf8-24fcf4b36a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:19.690054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2764db9-2370-4bd3-8bf8-24fcf4b36a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:19.692895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2764db9-2370-4bd3-8bf8-24fcf4b36a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:19.697509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2764db9-2370-4bd3-8bf8-24fcf4b36a6e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:19.735550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d0ce3-d452-4e39-9bc0-8119e5a097f7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:19.736864 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2825/5676] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:19.750898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d0ce3-d452-4e39-9bc0-8119e5a097f7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:19.759089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f899dc-10c4-44a9-889f-feb6bf2ca7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:19.759425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f899dc-10c4-44a9-889f-feb6bf2ca7f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:19.759711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f899dc-10c4-44a9-889f-feb6bf2ca7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:19.759987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f899dc-10c4-44a9-889f-feb6bf2ca7f9 admin admin] PATH_INFO: `/v3/projects/24d3426089b941d6aaa71a088aca0b87/users/9f1c017199854022a14c01c173b9eb1e/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:19.764266 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:19.789028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f899dc-10c4-44a9-889f-feb6bf2ca7f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d3426089b941d6aaa71a088aca0b87, user_id=9f1c017199854022a14c01c173b9eb1e, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:19.793021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f899dc-10c4-44a9-889f-feb6bf2ca7f9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:19.825413 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2852/5677] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:07:19 2022] PUT /identity/v3/projects/24d3426089b941d6aaa71a088aca0b87/users/9f1c017199854022a14c01c173b9eb1e/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:19.827777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0029b-f450-4022-8504-6f1cd45f82f7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:19.828297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0029b-f450-4022-8504-6f1cd45f82f7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:19.829046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0029b-f450-4022-8504-6f1cd45f82f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:19.949347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-57b0029b-f450-4022-8504-6f1cd45f82f7 None None] MFA Rules not processed for user `9f1c017199854022a14c01c173b9eb1e`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:19.952451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-57b0029b-f450-4022-8504-6f1cd45f82f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:20.114199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f899dc-10c4-44a9-889f-feb6bf2ca7f9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:20.116497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-56f899dc-10c4-44a9-889f-feb6bf2ca7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:20.120902 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2826/5678] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:20.200060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0029b-f450-4022-8504-6f1cd45f82f7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:20.200831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-57b0029b-f450-4022-8504-6f1cd45f82f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:20.267415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f899dc-10c4-44a9-889f-feb6bf2ca7f9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:20.282715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f46497-4c04-499f-9371-1076a34f7ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:20.283296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f46497-4c04-499f-9371-1076a34f7ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:20.283577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f46497-4c04-499f-9371-1076a34f7ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:20.283850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f46497-4c04-499f-9371-1076a34f7ba3 admin admin] PATH_INFO: `/v3/projects/2faaded0256243f4a82fd2e670cef686` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:20.287037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f46497-4c04-499f-9371-1076a34f7ba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2faaded0256243f4a82fd2e670cef686)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:20.291366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f46497-4c04-499f-9371-1076a34f7ba3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:20.343021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0029b-f450-4022-8504-6f1cd45f82f7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:20.354154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bcf66-93db-40d1-9c17-3719e1b59de9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:20.354790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bcf66-93db-40d1-9c17-3719e1b59de9 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:20.355069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bcf66-93db-40d1-9c17-3719e1b59de9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:20.355342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bcf66-93db-40d1-9c17-3719e1b59de9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:20.369859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841bcf66-93db-40d1-9c17-3719e1b59de9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:20.371410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841bcf66-93db-40d1-9c17-3719e1b59de9 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:20.403648 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2827/5679] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:07:20.429255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-08f46497-4c04-499f-9371-1076a34f7ba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2faaded0256243f4a82fd2e670cef686', 'request_id': 'req-08f46497-4c04-499f-9371-1076a34f7ba3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:20.451300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-08f46497-4c04-499f-9371-1076a34f7ba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2faaded0256243f4a82fd2e670cef686', 'request_id': 'req-08f46497-4c04-499f-9371-1076a34f7ba3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:20.466642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-08f46497-4c04-499f-9371-1076a34f7ba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2faaded0256243f4a82fd2e670cef686', 'request_id': 'req-08f46497-4c04-499f-9371-1076a34f7ba3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:20.493922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-08f46497-4c04-499f-9371-1076a34f7ba3 admin admin] The token cache is being invalidate because project 2faaded0256243f4a82fd2e670cef686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:07:20.494200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-08f46497-4c04-499f-9371-1076a34f7ba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:20.496288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-08f46497-4c04-499f-9371-1076a34f7ba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:20.499005 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2853/5680] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:07:20 2022] DELETE /identity/v3/projects/2faaded0256243f4a82fd2e670cef686 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:07:20.504302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bcf66-93db-40d1-9c17-3719e1b59de9 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:20.528701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bcf66-93db-40d1-9c17-3719e1b59de9 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:20.672757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318d5e5-9f09-4808-b844-8f2293a3839e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:20.673412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318d5e5-9f09-4808-b844-8f2293a3839e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:20.673741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318d5e5-9f09-4808-b844-8f2293a3839e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:20.674022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318d5e5-9f09-4808-b844-8f2293a3839e admin admin] PATH_INFO: `/v3/users/20da9d5a236c4781aaf170746bde9803` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:20.675686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318d5e5-9f09-4808-b844-8f2293a3839e admin admin] RBAC: Authorizing `identity:delete_user(user_id=20da9d5a236c4781aaf170746bde9803)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:20.677903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318d5e5-9f09-4808-b844-8f2293a3839e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:20.698303 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=1,keystone:SELECT=98,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:20.755078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4318d5e5-9f09-4808-b844-8f2293a3839e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20da9d5a236c4781aaf170746bde9803'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:20.770940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4318d5e5-9f09-4808-b844-8f2293a3839e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20da9d5a236c4781aaf170746bde9803'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:20.771688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4318d5e5-9f09-4808-b844-8f2293a3839e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20da9d5a236c4781aaf170746bde9803'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:20.799775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4318d5e5-9f09-4808-b844-8f2293a3839e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20da9d5a236c4781aaf170746bde9803'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:20.813774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4318d5e5-9f09-4808-b844-8f2293a3839e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20da9d5a236c4781aaf170746bde9803'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:20.844206 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2828/5681] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:07:20 2022] DELETE /identity/v3/users/20da9d5a236c4781aaf170746bde9803 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:22.267112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f46497-4c04-499f-9371-1076a34f7ba3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:22.268547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-08f46497-4c04-499f-9371-1076a34f7ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:22.294021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f46497-4c04-499f-9371-1076a34f7ba3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:22.407765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ba0ab-8bae-4aaa-9909-69e6381405a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:22.408500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ba0ab-8bae-4aaa-9909-69e6381405a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:22.409212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ba0ab-8bae-4aaa-9909-69e6381405a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:22.410279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ba0ab-8bae-4aaa-9909-69e6381405a0 admin admin] PATH_INFO: `/v3/projects/3ab11560a4764cb398474100fd343126` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:22.413348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ba0ab-8bae-4aaa-9909-69e6381405a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ab11560a4764cb398474100fd343126)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:22.417761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ba0ab-8bae-4aaa-9909-69e6381405a0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:22.440564 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:22.526662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-434ba0ab-8bae-4aaa-9909-69e6381405a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ab11560a4764cb398474100fd343126', 'request_id': 'req-434ba0ab-8bae-4aaa-9909-69e6381405a0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:22.559054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-434ba0ab-8bae-4aaa-9909-69e6381405a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ab11560a4764cb398474100fd343126', 'request_id': 'req-434ba0ab-8bae-4aaa-9909-69e6381405a0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:22.584472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-434ba0ab-8bae-4aaa-9909-69e6381405a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ab11560a4764cb398474100fd343126', 'request_id': 'req-434ba0ab-8bae-4aaa-9909-69e6381405a0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:22.606920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-434ba0ab-8bae-4aaa-9909-69e6381405a0 admin admin] The token cache is being invalidate because project 3ab11560a4764cb398474100fd343126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:07:22.607451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-434ba0ab-8bae-4aaa-9909-69e6381405a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:22.608331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-434ba0ab-8bae-4aaa-9909-69e6381405a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:22.611149 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2854/5682] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:07:22 2022] DELETE /identity/v3/projects/3ab11560a4764cb398474100fd343126 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:22.618602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46bd15-9463-4e52-9f04-46192c077aaf None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:22.619155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46bd15-9463-4e52-9f04-46192c077aaf None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:22.619155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46bd15-9463-4e52-9f04-46192c077aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:22.661410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4d46bd15-9463-4e52-9f04-46192c077aaf None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:22.662721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4d46bd15-9463-4e52-9f04-46192c077aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:22.811910 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2829/5683] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:22.821592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5c0cf-58cb-4966-9e79-bd16d39812c7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:22.821892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5c0cf-58cb-4966-9e79-bd16d39812c7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:22.822221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5c0cf-58cb-4966-9e79-bd16d39812c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:22.863251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-45f5c0cf-58cb-4966-9e79-bd16d39812c7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:22.864580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-45f5c0cf-58cb-4966-9e79-bd16d39812c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:22.888355 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2855/5684] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:22.892375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46bd15-9463-4e52-9f04-46192c077aaf None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:22.923948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46bd15-9463-4e52-9f04-46192c077aaf None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:22.951823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2748f-c29b-4cd9-bc85-06be1c94f962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:22.952979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2748f-c29b-4cd9-bc85-06be1c94f962 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:22.954044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2748f-c29b-4cd9-bc85-06be1c94f962 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:22.954593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2748f-c29b-4cd9-bc85-06be1c94f962 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:22.955507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2748f-c29b-4cd9-bc85-06be1c94f962 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:07:22.956034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2748f-c29b-4cd9-bc85-06be1c94f962 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:22.968927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2748f-c29b-4cd9-bc85-06be1c94f962 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:22.986293 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2830/5685] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:07:22.990341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5c0cf-58cb-4966-9e79-bd16d39812c7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:23.002798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5c0cf-58cb-4966-9e79-bd16d39812c7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:23.023801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7caa3-9170-4151-909b-1a29209f1ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:23.024432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7caa3-9170-4151-909b-1a29209f1ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:23.024755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7caa3-9170-4151-909b-1a29209f1ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:23.025074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7caa3-9170-4151-909b-1a29209f1ba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:23.025726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7caa3-9170-4151-909b-1a29209f1ba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:23.027733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7caa3-9170-4151-909b-1a29209f1ba5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:23.082825 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2856/5686] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:07:22 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:23.086641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2748f-c29b-4cd9-bc85-06be1c94f962 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:23.099814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2748f-c29b-4cd9-bc85-06be1c94f962 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:23.229491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390642a2-7c5b-41fb-b354-5d2fbddffc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:23.230681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390642a2-7c5b-41fb-b354-5d2fbddffc54 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:23.231157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390642a2-7c5b-41fb-b354-5d2fbddffc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:23.231588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390642a2-7c5b-41fb-b354-5d2fbddffc54 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:23.232783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390642a2-7c5b-41fb-b354-5d2fbddffc54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:23.235548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390642a2-7c5b-41fb-b354-5d2fbddffc54 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:23.352849 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2831/5687] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:07:23 2022] POST /identity/v3/users => generated 289 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:23.354850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7caa3-9170-4151-909b-1a29209f1ba5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:23.371890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7caa3-9170-4151-909b-1a29209f1ba5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:23.386552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a727b46-6d24-4487-a6a8-ea0c8c2aae59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:23.387399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a727b46-6d24-4487-a6a8-ea0c8c2aae59 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:23.388035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a727b46-6d24-4487-a6a8-ea0c8c2aae59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:23.388526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a727b46-6d24-4487-a6a8-ea0c8c2aae59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:23.390045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a727b46-6d24-4487-a6a8-ea0c8c2aae59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:23.392587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a727b46-6d24-4487-a6a8-ea0c8c2aae59 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:23.418726 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2857/5688] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:23.423081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390642a2-7c5b-41fb-b354-5d2fbddffc54 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:23.434450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390642a2-7c5b-41fb-b354-5d2fbddffc54 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:23.444681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26c225-236f-42ce-bf8b-9bc06eaaf50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:23.445525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26c225-236f-42ce-bf8b-9bc06eaaf50d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:23.445988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26c225-236f-42ce-bf8b-9bc06eaaf50d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:23.446362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26c225-236f-42ce-bf8b-9bc06eaaf50d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:23.447163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26c225-236f-42ce-bf8b-9bc06eaaf50d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:23.449015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26c225-236f-42ce-bf8b-9bc06eaaf50d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:23.458688 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:23.469690 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2832/5689] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:23.470868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a727b46-6d24-4487-a6a8-ea0c8c2aae59 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:23.484509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a727b46-6d24-4487-a6a8-ea0c8c2aae59 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:23.501847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd07cfa-18aa-47b2-bdcb-e0f61ed19e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:23.503003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd07cfa-18aa-47b2-bdcb-e0f61ed19e57 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:23.503578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd07cfa-18aa-47b2-bdcb-e0f61ed19e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:23.504154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd07cfa-18aa-47b2-bdcb-e0f61ed19e57 admin admin] PATH_INFO: `/v3/projects/55e6b9022b8d47e390f78db6b4531605/users/5c7bf31cc6f646dfb65bce9029750041/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:23.526813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd07cfa-18aa-47b2-bdcb-e0f61ed19e57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55e6b9022b8d47e390f78db6b4531605, user_id=5c7bf31cc6f646dfb65bce9029750041, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:23.529756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd07cfa-18aa-47b2-bdcb-e0f61ed19e57 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:23.560836 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2858/5690] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:07:23 2022] PUT /identity/v3/projects/55e6b9022b8d47e390f78db6b4531605/users/5c7bf31cc6f646dfb65bce9029750041/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:23.569620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a939b-a75f-423c-993c-4cd3cfed192b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:23.570280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a939b-a75f-423c-993c-4cd3cfed192b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:23.570750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a939b-a75f-423c-993c-4cd3cfed192b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:23.621106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f86a939b-a75f-423c-993c-4cd3cfed192b None None] MFA Rules not processed for user `5c7bf31cc6f646dfb65bce9029750041`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:23.625358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f86a939b-a75f-423c-993c-4cd3cfed192b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:23.740257 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2833/5691] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:07:23.744477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd07cfa-18aa-47b2-bdcb-e0f61ed19e57 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:23.876944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd07cfa-18aa-47b2-bdcb-e0f61ed19e57 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:23.885381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1dc16-dd89-4da5-9540-ade21eafa069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:23.887179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1dc16-dd89-4da5-9540-ade21eafa069 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:23.887820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1dc16-dd89-4da5-9540-ade21eafa069 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:23.888348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1dc16-dd89-4da5-9540-ade21eafa069 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:23.889547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1dc16-dd89-4da5-9540-ade21eafa069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:23.900008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1dc16-dd89-4da5-9540-ade21eafa069 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:24.029612 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2859/5692] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:07:23 2022] POST /identity/v3/projects => generated 377 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:07:24.034183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a939b-a75f-423c-993c-4cd3cfed192b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:24.050765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a939b-a75f-423c-993c-4cd3cfed192b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:24.173167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0e691-3a00-4091-9215-f4dbf64abc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:24.179208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0e691-3a00-4091-9215-f4dbf64abc9e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:24.179764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0e691-3a00-4091-9215-f4dbf64abc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:24.180224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0e691-3a00-4091-9215-f4dbf64abc9e admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:24.180936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0e691-3a00-4091-9215-f4dbf64abc9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:24.183396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0e691-3a00-4091-9215-f4dbf64abc9e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:24.221690 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2834/5693] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:07:24 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:07:24.225391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1dc16-dd89-4da5-9540-ade21eafa069 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:24.240203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1dc16-dd89-4da5-9540-ade21eafa069 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:24.261635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eca17d-2da1-460e-bf68-60048b23e1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:24.262883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eca17d-2da1-460e-bf68-60048b23e1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:24.263401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eca17d-2da1-460e-bf68-60048b23e1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:24.264514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eca17d-2da1-460e-bf68-60048b23e1a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:24.265451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eca17d-2da1-460e-bf68-60048b23e1a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:24.268572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eca17d-2da1-460e-bf68-60048b23e1a0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:24.298119 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2860/5694] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:07:24.300518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0e691-3a00-4091-9215-f4dbf64abc9e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:24.317188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0e691-3a00-4091-9215-f4dbf64abc9e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:24.328302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecf6bb-ea1f-463a-9e1f-3b1f46151850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:24.329621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecf6bb-ea1f-463a-9e1f-3b1f46151850 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:24.330108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecf6bb-ea1f-463a-9e1f-3b1f46151850 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:24.331914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecf6bb-ea1f-463a-9e1f-3b1f46151850 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:24.333478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceecf6bb-ea1f-463a-9e1f-3b1f46151850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:24.337268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceecf6bb-ea1f-463a-9e1f-3b1f46151850 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:24.375371 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2835/5695] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:24.379509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eca17d-2da1-460e-bf68-60048b23e1a0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:24.395664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eca17d-2da1-460e-bf68-60048b23e1a0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:24.411622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e416a032-1b8a-426a-87af-7dddbb17f092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:24.412343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416a032-1b8a-426a-87af-7dddbb17f092 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:24.412646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416a032-1b8a-426a-87af-7dddbb17f092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:24.413116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416a032-1b8a-426a-87af-7dddbb17f092 admin admin] PATH_INFO: `/v3/projects/43ad7bcab7a549c8a2e44d509815be12/users/09d4883b31ad4a96855f57d474a02017/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:24.448740 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:24.456851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e416a032-1b8a-426a-87af-7dddbb17f092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ad7bcab7a549c8a2e44d509815be12, user_id=09d4883b31ad4a96855f57d474a02017, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:24.464119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e416a032-1b8a-426a-87af-7dddbb17f092 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:24.492267 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2861/5696] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:07:24 2022] PUT /identity/v3/projects/43ad7bcab7a549c8a2e44d509815be12/users/09d4883b31ad4a96855f57d474a02017/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:07:24.503688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb977f54-f657-4228-9ceb-a9aa6d64c925 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:24.504646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb977f54-f657-4228-9ceb-a9aa6d64c925 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:24.505036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb977f54-f657-4228-9ceb-a9aa6d64c925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:24.523236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e416a032-1b8a-426a-87af-7dddbb17f092 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:24.525142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e416a032-1b8a-426a-87af-7dddbb17f092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:24.586127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bb977f54-f657-4228-9ceb-a9aa6d64c925 None None] MFA Rules not processed for user `09d4883b31ad4a96855f57d474a02017`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:24.588630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bb977f54-f657-4228-9ceb-a9aa6d64c925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:24.675535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e416a032-1b8a-426a-87af-7dddbb17f092 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:24.691711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8363d-d573-4f19-91a8-c2fbe5e62935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:24.691711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8363d-d573-4f19-91a8-c2fbe5e62935 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:24.692698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8363d-d573-4f19-91a8-c2fbe5e62935 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:24.692698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8363d-d573-4f19-91a8-c2fbe5e62935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:24.698655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2ff8363d-d573-4f19-91a8-c2fbe5e62935 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:24.744847 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:24.770346 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2836/5697] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:24.772517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb977f54-f657-4228-9ceb-a9aa6d64c925 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:24.865440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8363d-d573-4f19-91a8-c2fbe5e62935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:24.867380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8363d-d573-4f19-91a8-c2fbe5e62935 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:24.889564 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2862/5698] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:07:24.935483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb977f54-f657-4228-9ceb-a9aa6d64c925 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:24.940775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6131fa8-15fb-4b71-a5c3-ac8dbaac6ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:24.941966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6131fa8-15fb-4b71-a5c3-ac8dbaac6ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:24.942817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6131fa8-15fb-4b71-a5c3-ac8dbaac6ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:24.943648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6131fa8-15fb-4b71-a5c3-ac8dbaac6ab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:24.945122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6131fa8-15fb-4b71-a5c3-ac8dbaac6ab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:24.964050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6131fa8-15fb-4b71-a5c3-ac8dbaac6ab1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:25.013511 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2837/5699] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:07:24 2022] POST /identity/v3/projects => generated 377 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:25.014837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8363d-d573-4f19-91a8-c2fbe5e62935 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:25.029168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8363d-d573-4f19-91a8-c2fbe5e62935 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:25.125142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e0714-cc92-4e1e-a910-9fafe0afa901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:25.125520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e0714-cc92-4e1e-a910-9fafe0afa901 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:25.125798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e0714-cc92-4e1e-a910-9fafe0afa901 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:25.126070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e0714-cc92-4e1e-a910-9fafe0afa901 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:25.126856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e0714-cc92-4e1e-a910-9fafe0afa901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:25.136567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e0714-cc92-4e1e-a910-9fafe0afa901 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:25.173236 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2863/5700] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:07:25 2022] POST /identity/v3/users => generated 295 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:25.174498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6131fa8-15fb-4b71-a5c3-ac8dbaac6ab1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:25.194904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6131fa8-15fb-4b71-a5c3-ac8dbaac6ab1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:25.204012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6287f5-752d-4811-a182-32b7094060e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:25.204933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6287f5-752d-4811-a182-32b7094060e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:25.205162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6287f5-752d-4811-a182-32b7094060e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:25.205493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6287f5-752d-4811-a182-32b7094060e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:25.207382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6287f5-752d-4811-a182-32b7094060e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:25.209538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6287f5-752d-4811-a182-32b7094060e2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:25.227833 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2838/5701] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:25.229656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e0714-cc92-4e1e-a910-9fafe0afa901 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:25.258827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e0714-cc92-4e1e-a910-9fafe0afa901 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:25.273583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be851e-d88a-4e0e-a62b-1477a337c947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:25.274278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be851e-d88a-4e0e-a62b-1477a337c947 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:25.274616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be851e-d88a-4e0e-a62b-1477a337c947 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:25.275027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be851e-d88a-4e0e-a62b-1477a337c947 admin admin] PATH_INFO: `/v3/projects/6c57f8b8a680403eb85cf6856d02593b/users/ac59ec20fd1941d097b2018464225d19/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:25.298779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be851e-d88a-4e0e-a62b-1477a337c947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c57f8b8a680403eb85cf6856d02593b, user_id=ac59ec20fd1941d097b2018464225d19, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:25.302260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be851e-d88a-4e0e-a62b-1477a337c947 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:25.319060 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:25.331457 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2864/5702] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:07:25 2022] PUT /identity/v3/projects/6c57f8b8a680403eb85cf6856d02593b/users/ac59ec20fd1941d097b2018464225d19/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:25.336906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6287f5-752d-4811-a182-32b7094060e2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:25.357357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6287f5-752d-4811-a182-32b7094060e2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:25.463088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102814ac-4111-491c-8e23-5663dcdf27c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:25.464581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102814ac-4111-491c-8e23-5663dcdf27c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:25.464913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102814ac-4111-491c-8e23-5663dcdf27c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:25.465278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102814ac-4111-491c-8e23-5663dcdf27c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:25.467337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102814ac-4111-491c-8e23-5663dcdf27c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:25.469422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102814ac-4111-491c-8e23-5663dcdf27c4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:25.486938 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2839/5703] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:25.491638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be851e-d88a-4e0e-a62b-1477a337c947 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:25.507750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be851e-d88a-4e0e-a62b-1477a337c947 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:25.525467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69e9b9-f6b8-4980-9e80-9202cf0afb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:25.526378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69e9b9-f6b8-4980-9e80-9202cf0afb4c admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:25.526651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69e9b9-f6b8-4980-9e80-9202cf0afb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:25.542348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69e9b9-f6b8-4980-9e80-9202cf0afb4c admin admin] PATH_INFO: `/v3/projects/6c57f8b8a680403eb85cf6856d02593b/users/ac59ec20fd1941d097b2018464225d19/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:25.553437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69e9b9-f6b8-4980-9e80-9202cf0afb4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c57f8b8a680403eb85cf6856d02593b, user_id=ac59ec20fd1941d097b2018464225d19, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:25.559081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69e9b9-f6b8-4980-9e80-9202cf0afb4c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:25.588758 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2865/5704] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:07:25 2022] PUT /identity/v3/projects/6c57f8b8a680403eb85cf6856d02593b/users/ac59ec20fd1941d097b2018464225d19/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:25.600934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa0e22-e016-4418-9955-17e9814eee7e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:25.601219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa0e22-e016-4418-9955-17e9814eee7e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:25.601496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa0e22-e016-4418-9955-17e9814eee7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:25.664671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e1aa0e22-e016-4418-9955-17e9814eee7e None None] MFA Rules not processed for user `ac59ec20fd1941d097b2018464225d19`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:25.666392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e1aa0e22-e016-4418-9955-17e9814eee7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:25.868572 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:25.900677 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2840/5705] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:25.901458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69e9b9-f6b8-4980-9e80-9202cf0afb4c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:25.903780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5e69e9b9-f6b8-4980-9e80-9202cf0afb4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:26.075769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69e9b9-f6b8-4980-9e80-9202cf0afb4c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:26.082911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cd32b-4faa-44e3-93ae-6447f6505798 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:26.083907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cd32b-4faa-44e3-93ae-6447f6505798 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:26.084276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cd32b-4faa-44e3-93ae-6447f6505798 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:26.084683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cd32b-4faa-44e3-93ae-6447f6505798 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:26.099368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2cd32b-4faa-44e3-93ae-6447f6505798 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:26.101476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2cd32b-4faa-44e3-93ae-6447f6505798 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:26.131916 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2866/5706] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:07:26.204235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa0e22-e016-4418-9955-17e9814eee7e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:26.206672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e1aa0e22-e016-4418-9955-17e9814eee7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:26.241116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa0e22-e016-4418-9955-17e9814eee7e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:26.250042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0ef9f-7655-4787-bcb3-7d01d0789f55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:26.252397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0ef9f-7655-4787-bcb3-7d01d0789f55 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:26.252857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0ef9f-7655-4787-bcb3-7d01d0789f55 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:26.253257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0ef9f-7655-4787-bcb3-7d01d0789f55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:26.443192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0ef9f-7655-4787-bcb3-7d01d0789f55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:26.446029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0ef9f-7655-4787-bcb3-7d01d0789f55 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:26.474219 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2841/5707] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:07:28.027867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865a8c8-2574-40c7-b23a-95e400fbdf5f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:28.028381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865a8c8-2574-40c7-b23a-95e400fbdf5f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:28.028549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865a8c8-2574-40c7-b23a-95e400fbdf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:28.117591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4865a8c8-2574-40c7-b23a-95e400fbdf5f None None] MFA Rules not processed for user `7100e3fe0fb945f697857613dbbe990a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:28.119691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4865a8c8-2574-40c7-b23a-95e400fbdf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:28.384891 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2867/5708] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:28 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:28.398526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b0e46-f873-471f-9653-a9c116bb43d5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:28.399031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b0e46-f873-471f-9653-a9c116bb43d5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:28.399137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b0e46-f873-471f-9653-a9c116bb43d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:28.459634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ce8b0e46-f873-471f-9653-a9c116bb43d5 None None] MFA Rules not processed for user `7100e3fe0fb945f697857613dbbe990a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:28.459634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ce8b0e46-f873-471f-9653-a9c116bb43d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:28.483222 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2842/5709] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:28 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:28.503498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865a8c8-2574-40c7-b23a-95e400fbdf5f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:28.505017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4865a8c8-2574-40c7-b23a-95e400fbdf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:28.719939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865a8c8-2574-40c7-b23a-95e400fbdf5f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:28.738160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37888e15-a799-4235-8523-ccb57769af2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:28.738558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37888e15-a799-4235-8523-ccb57769af2d service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:28.738837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37888e15-a799-4235-8523-ccb57769af2d service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:28.739109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37888e15-a799-4235-8523-ccb57769af2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:28.749601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37888e15-a799-4235-8523-ccb57769af2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:28.752252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37888e15-a799-4235-8523-ccb57769af2d service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:28.774283 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2868/5710] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:28 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:07:29.979290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4edcfb-50af-45bc-968c-3b285e663806 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:29.979846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4edcfb-50af-45bc-968c-3b285e663806 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:29.980075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4edcfb-50af-45bc-968c-3b285e663806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:30.068511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5d4edcfb-50af-45bc-968c-3b285e663806 None None] MFA Rules not processed for user `2ad42e28e3444cd3b25054439f53e9c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:30.072418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5d4edcfb-50af-45bc-968c-3b285e663806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:30.301613 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2843/5711] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:30.304046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a7d24-d2cf-41d8-aef6-c0996929eced None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:30.304046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a7d24-d2cf-41d8-aef6-c0996929eced None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:30.304046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a7d24-d2cf-41d8-aef6-c0996929eced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:30.315941 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:30.355781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a58a7d24-d2cf-41d8-aef6-c0996929eced None None] MFA Rules not processed for user `2ad42e28e3444cd3b25054439f53e9c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:30.357186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a58a7d24-d2cf-41d8-aef6-c0996929eced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:30.366519 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2869/5712] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:30.810350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4edcfb-50af-45bc-968c-3b285e663806 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:30.812282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5d4edcfb-50af-45bc-968c-3b285e663806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:30.841908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4edcfb-50af-45bc-968c-3b285e663806 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:30.862926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a37abc-3743-4bc5-92d0-388796f2018d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:30.863946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a37abc-3743-4bc5-92d0-388796f2018d service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:30.864723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a37abc-3743-4bc5-92d0-388796f2018d service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:30.865945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a37abc-3743-4bc5-92d0-388796f2018d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:30.875598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a37abc-3743-4bc5-92d0-388796f2018d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:30.877745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a37abc-3743-4bc5-92d0-388796f2018d service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:30.894468 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2844/5713] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:07:33.471099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a7d24-d2cf-41d8-aef6-c0996929eced None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:33.473786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a58a7d24-d2cf-41d8-aef6-c0996929eced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:33.766898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a7d24-d2cf-41d8-aef6-c0996929eced None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:33.773348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315f689-9d89-4a62-a5ef-063c00f62281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:33.782990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315f689-9d89-4a62-a5ef-063c00f62281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:33.783447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315f689-9d89-4a62-a5ef-063c00f62281 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:33.783605 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315f689-9d89-4a62-a5ef-063c00f62281 admin admin] PATH_INFO: `/v3/users/542c8d34d222428087e511bdd0c65b96` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:33.785508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315f689-9d89-4a62-a5ef-063c00f62281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=542c8d34d222428087e511bdd0c65b96)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:33.787718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315f689-9d89-4a62-a5ef-063c00f62281 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:33.999360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e315f689-9d89-4a62-a5ef-063c00f62281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '542c8d34d222428087e511bdd0c65b96'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:34.000118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e315f689-9d89-4a62-a5ef-063c00f62281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '542c8d34d222428087e511bdd0c65b96'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:34.022612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e315f689-9d89-4a62-a5ef-063c00f62281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '542c8d34d222428087e511bdd0c65b96'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:34.092910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e315f689-9d89-4a62-a5ef-063c00f62281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '542c8d34d222428087e511bdd0c65b96'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:34.136521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e315f689-9d89-4a62-a5ef-063c00f62281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '542c8d34d222428087e511bdd0c65b96'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:34.169737 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2870/5714] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:07:33 2022] DELETE /identity/v3/users/542c8d34d222428087e511bdd0c65b96 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:34.176025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08837889-564a-4feb-a9ac-5a52c7a56310 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:34.176612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08837889-564a-4feb-a9ac-5a52c7a56310 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:34.176612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08837889-564a-4feb-a9ac-5a52c7a56310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:34.256108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-08837889-564a-4feb-a9ac-5a52c7a56310 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:34.257351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-08837889-564a-4feb-a9ac-5a52c7a56310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:34.522438 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2845/5715] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:34.564780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315f689-9d89-4a62-a5ef-063c00f62281 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:34.567724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e315f689-9d89-4a62-a5ef-063c00f62281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:34.780779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315f689-9d89-4a62-a5ef-063c00f62281 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:34.786442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ad404-032d-4eb9-b443-7850fae4138c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:34.787194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ad404-032d-4eb9-b443-7850fae4138c service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:34.787579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ad404-032d-4eb9-b443-7850fae4138c service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:34.787948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ad404-032d-4eb9-b443-7850fae4138c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:34.810816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ad404-032d-4eb9-b443-7850fae4138c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:34.812385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ad404-032d-4eb9-b443-7850fae4138c service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:34.850133 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2871/5716] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:07:35.211259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08837889-564a-4feb-a9ac-5a52c7a56310 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:35.212852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-08837889-564a-4feb-a9ac-5a52c7a56310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:35.222261 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:35.252752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08837889-564a-4feb-a9ac-5a52c7a56310 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:35.260805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec699f7b-1235-48be-acd2-8660335c043c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:35.262006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec699f7b-1235-48be-acd2-8660335c043c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:35.262921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec699f7b-1235-48be-acd2-8660335c043c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:35.263957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec699f7b-1235-48be-acd2-8660335c043c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:35.272684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ec699f7b-1235-48be-acd2-8660335c043c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:35.465624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec699f7b-1235-48be-acd2-8660335c043c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:35.467368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec699f7b-1235-48be-acd2-8660335c043c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:35.539195 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2846/5717] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:07:35.750089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ad404-032d-4eb9-b443-7850fae4138c service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:35.752223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3b5ad404-032d-4eb9-b443-7850fae4138c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:35.793354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ad404-032d-4eb9-b443-7850fae4138c service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:35.806727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdafdba-d984-4e4a-9fcd-bff0768776c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:35.808915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdafdba-d984-4e4a-9fcd-bff0768776c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:35.809731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdafdba-d984-4e4a-9fcd-bff0768776c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:35.811463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdafdba-d984-4e4a-9fcd-bff0768776c6 admin admin] PATH_INFO: `/v3/projects/84c6af266b2f4ba4b0662c632bb4cae3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:35.815884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdafdba-d984-4e4a-9fcd-bff0768776c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c6af266b2f4ba4b0662c632bb4cae3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:35.829648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdafdba-d984-4e4a-9fcd-bff0768776c6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:35.865520 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:35.975548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ebdafdba-d984-4e4a-9fcd-bff0768776c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c6af266b2f4ba4b0662c632bb4cae3', 'request_id': 'req-ebdafdba-d984-4e4a-9fcd-bff0768776c6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:35.991849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ebdafdba-d984-4e4a-9fcd-bff0768776c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c6af266b2f4ba4b0662c632bb4cae3', 'request_id': 'req-ebdafdba-d984-4e4a-9fcd-bff0768776c6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:36.007952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ebdafdba-d984-4e4a-9fcd-bff0768776c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c6af266b2f4ba4b0662c632bb4cae3', 'request_id': 'req-ebdafdba-d984-4e4a-9fcd-bff0768776c6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:36.043166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ebdafdba-d984-4e4a-9fcd-bff0768776c6 admin admin] The token cache is being invalidate because project 84c6af266b2f4ba4b0662c632bb4cae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:07:36.043521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ebdafdba-d984-4e4a-9fcd-bff0768776c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:36.045144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ebdafdba-d984-4e4a-9fcd-bff0768776c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:36.052823 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2872/5718] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:07:35 2022] DELETE /identity/v3/projects/84c6af266b2f4ba4b0662c632bb4cae3 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:36.054051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57c16c-932a-41ef-bfd1-c93838515f87 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:36.054424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57c16c-932a-41ef-bfd1-c93838515f87 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:36.054944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57c16c-932a-41ef-bfd1-c93838515f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:36.100231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5d57c16c-932a-41ef-bfd1-c93838515f87 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:36.102903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5d57c16c-932a-41ef-bfd1-c93838515f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:36.307533 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2847/5719] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:36.316125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4196a3-536f-4f70-b40f-e1133e994844 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:36.317018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4196a3-536f-4f70-b40f-e1133e994844 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:36.317870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4196a3-536f-4f70-b40f-e1133e994844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:36.402395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ac4196a3-536f-4f70-b40f-e1133e994844 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:36.411698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ac4196a3-536f-4f70-b40f-e1133e994844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:36.444336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57c16c-932a-41ef-bfd1-c93838515f87 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:36.453066 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2873/5720] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:36.463386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57c16c-932a-41ef-bfd1-c93838515f87 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:36.477045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3664c4-2483-4cd1-aefe-27f40d4c76e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:36.483663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4196a3-536f-4f70-b40f-e1133e994844 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:36.485254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ac4196a3-536f-4f70-b40f-e1133e994844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:36.492287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3664c4-2483-4cd1-aefe-27f40d4c76e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:36.493096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3664c4-2483-4cd1-aefe-27f40d4c76e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:36.494475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3664c4-2483-4cd1-aefe-27f40d4c76e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:36.495449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3664c4-2483-4cd1-aefe-27f40d4c76e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:07:36.496279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3664c4-2483-4cd1-aefe-27f40d4c76e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:36.499466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3664c4-2483-4cd1-aefe-27f40d4c76e4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:36.507487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4196a3-536f-4f70-b40f-e1133e994844 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:36.524016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1eb1f-c6e3-461b-8950-c1a1c43d690c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:36.527335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1eb1f-c6e3-461b-8950-c1a1c43d690c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:36.531770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1eb1f-c6e3-461b-8950-c1a1c43d690c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:36.532356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1eb1f-c6e3-461b-8950-c1a1c43d690c admin admin] PATH_INFO: `/v3/users/5c7bf31cc6f646dfb65bce9029750041` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:36.538180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1eb1f-c6e3-461b-8950-c1a1c43d690c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c7bf31cc6f646dfb65bce9029750041)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:36.539727 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2848/5721] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:07:36.545036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3664c4-2483-4cd1-aefe-27f40d4c76e4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:36.546478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1eb1f-c6e3-461b-8950-c1a1c43d690c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:36.577963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3664c4-2483-4cd1-aefe-27f40d4c76e4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:36.589135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853f4c0-a5f2-4045-9838-714a60cc4b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:36.592446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853f4c0-a5f2-4045-9838-714a60cc4b97 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:36.593055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853f4c0-a5f2-4045-9838-714a60cc4b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:36.593523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853f4c0-a5f2-4045-9838-714a60cc4b97 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:36.594364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853f4c0-a5f2-4045-9838-714a60cc4b97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:36.599328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853f4c0-a5f2-4045-9838-714a60cc4b97 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:36.657410 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2849/5722] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:07:36 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:36.663608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853f4c0-a5f2-4045-9838-714a60cc4b97 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:36.671589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-35a1eb1f-c6e3-461b-8950-c1a1c43d690c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c7bf31cc6f646dfb65bce9029750041'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:36.672291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-35a1eb1f-c6e3-461b-8950-c1a1c43d690c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c7bf31cc6f646dfb65bce9029750041'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:36.688636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-35a1eb1f-c6e3-461b-8950-c1a1c43d690c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c7bf31cc6f646dfb65bce9029750041'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:36.712328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-35a1eb1f-c6e3-461b-8950-c1a1c43d690c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c7bf31cc6f646dfb65bce9029750041'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:36.730857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-35a1eb1f-c6e3-461b-8950-c1a1c43d690c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c7bf31cc6f646dfb65bce9029750041'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:36.762199 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2874/5723] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:07:36 2022] DELETE /identity/v3/users/5c7bf31cc6f646dfb65bce9029750041 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:36.768089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15219398-73aa-4a99-9b74-75812f18c0e9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:36.768844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15219398-73aa-4a99-9b74-75812f18c0e9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:36.769176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15219398-73aa-4a99-9b74-75812f18c0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:36.803289 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:36.814747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-15219398-73aa-4a99-9b74-75812f18c0e9 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:36.816075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-15219398-73aa-4a99-9b74-75812f18c0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:36.833359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853f4c0-a5f2-4045-9838-714a60cc4b97 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:36.992158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fac2bf-17a2-4ab0-958e-4c6308266335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:36.992800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fac2bf-17a2-4ab0-958e-4c6308266335 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:36.993079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fac2bf-17a2-4ab0-958e-4c6308266335 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:36.993343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fac2bf-17a2-4ab0-958e-4c6308266335 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:36.994486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fac2bf-17a2-4ab0-958e-4c6308266335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:36.995989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fac2bf-17a2-4ab0-958e-4c6308266335 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:37.065235 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2850/5724] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:07:36 2022] POST /identity/v3/users => generated 287 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:37.066415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fac2bf-17a2-4ab0-958e-4c6308266335 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:37.068102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-41fac2bf-17a2-4ab0-958e-4c6308266335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:37.071148 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2875/5725] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:07:37.087215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fac2bf-17a2-4ab0-958e-4c6308266335 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:37.092689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16d8c9-b038-43af-924a-4531f036e89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:37.093215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16d8c9-b038-43af-924a-4531f036e89e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:37.093532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16d8c9-b038-43af-924a-4531f036e89e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:37.093941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16d8c9-b038-43af-924a-4531f036e89e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:37.094595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16d8c9-b038-43af-924a-4531f036e89e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:37.096474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16d8c9-b038-43af-924a-4531f036e89e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:37.120660 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2851/5726] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:07:37.123259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15219398-73aa-4a99-9b74-75812f18c0e9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:37.140592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15219398-73aa-4a99-9b74-75812f18c0e9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:37.150235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16d8c9-b038-43af-924a-4531f036e89e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:37.152031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ce16d8c9-b038-43af-924a-4531f036e89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:37.153481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea5cfe-9a58-4abc-b9d9-b0d55a503268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:37.154107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea5cfe-9a58-4abc-b9d9-b0d55a503268 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:37.154382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea5cfe-9a58-4abc-b9d9-b0d55a503268 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:37.154649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea5cfe-9a58-4abc-b9d9-b0d55a503268 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:37.155303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea5cfe-9a58-4abc-b9d9-b0d55a503268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:37.167599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea5cfe-9a58-4abc-b9d9-b0d55a503268 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:37.169917 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:37.203317 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2876/5727] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:37.204483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea5cfe-9a58-4abc-b9d9-b0d55a503268 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:37.248889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea5cfe-9a58-4abc-b9d9-b0d55a503268 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:37.257678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e67b6f-031d-49a2-87ed-556b5d863f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:37.259348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e67b6f-031d-49a2-87ed-556b5d863f15 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:37.259739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e67b6f-031d-49a2-87ed-556b5d863f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:37.260112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e67b6f-031d-49a2-87ed-556b5d863f15 admin admin] PATH_INFO: `/v3/projects/5a747b299e3c4fee852da42f1bad58b9/users/c6d4a470f66940aea4d187750be3831d/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:37.313306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e67b6f-031d-49a2-87ed-556b5d863f15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a747b299e3c4fee852da42f1bad58b9, user_id=c6d4a470f66940aea4d187750be3831d, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:37.317101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e67b6f-031d-49a2-87ed-556b5d863f15 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:37.344935 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2877/5728] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:07:37 2022] PUT /identity/v3/projects/5a747b299e3c4fee852da42f1bad58b9/users/c6d4a470f66940aea4d187750be3831d/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:37.347388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16d8c9-b038-43af-924a-4531f036e89e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:37.358990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5761f-4dce-4d46-a915-0bf09b0bd1cd None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:37.359273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5761f-4dce-4d46-a915-0bf09b0bd1cd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:37.359556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5761f-4dce-4d46-a915-0bf09b0bd1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:37.441769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b2d5761f-4dce-4d46-a915-0bf09b0bd1cd None None] MFA Rules not processed for user `c6d4a470f66940aea4d187750be3831d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:37.448166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b2d5761f-4dce-4d46-a915-0bf09b0bd1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:37.533517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb5118-93db-4690-95d7-7c7fb27637b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:37.535186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb5118-93db-4690-95d7-7c7fb27637b0 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:37.535649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb5118-93db-4690-95d7-7c7fb27637b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:37.536097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb5118-93db-4690-95d7-7c7fb27637b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:37.566981 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2878/5729] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:07:37.624309 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:37.646846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb5118-93db-4690-95d7-7c7fb27637b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:37.649526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb5118-93db-4690-95d7-7c7fb27637b0 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:37.663426 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2852/5730] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:07:37.691701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5761f-4dce-4d46-a915-0bf09b0bd1cd None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:37.719135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5761f-4dce-4d46-a915-0bf09b0bd1cd None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:37.730203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cf2c4-54b1-43ad-9f3f-be7d3fd8cb71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:37.732110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cf2c4-54b1-43ad-9f3f-be7d3fd8cb71 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:37.733142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cf2c4-54b1-43ad-9f3f-be7d3fd8cb71 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:37.734453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cf2c4-54b1-43ad-9f3f-be7d3fd8cb71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:37.758560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49cf2c4-54b1-43ad-9f3f-be7d3fd8cb71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:37.761957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49cf2c4-54b1-43ad-9f3f-be7d3fd8cb71 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:37.795944 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2879/5731] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:07:39.599208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb5118-93db-4690-95d7-7c7fb27637b0 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:39.600784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-18bb5118-93db-4690-95d7-7c7fb27637b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:39.626605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb5118-93db-4690-95d7-7c7fb27637b0 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:39.640109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2095d8-a812-4207-a08c-421ba6eb57ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:39.640765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2095d8-a812-4207-a08c-421ba6eb57ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:39.641235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2095d8-a812-4207-a08c-421ba6eb57ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:39.643254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2095d8-a812-4207-a08c-421ba6eb57ad admin admin] PATH_INFO: `/v3/projects/55e6b9022b8d47e390f78db6b4531605` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:39.645396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2095d8-a812-4207-a08c-421ba6eb57ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=55e6b9022b8d47e390f78db6b4531605)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:39.647650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2095d8-a812-4207-a08c-421ba6eb57ad admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:39.802332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6a2095d8-a812-4207-a08c-421ba6eb57ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55e6b9022b8d47e390f78db6b4531605', 'request_id': 'req-6a2095d8-a812-4207-a08c-421ba6eb57ad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:39.819266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6a2095d8-a812-4207-a08c-421ba6eb57ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55e6b9022b8d47e390f78db6b4531605', 'request_id': 'req-6a2095d8-a812-4207-a08c-421ba6eb57ad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:39.844917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6a2095d8-a812-4207-a08c-421ba6eb57ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55e6b9022b8d47e390f78db6b4531605', 'request_id': 'req-6a2095d8-a812-4207-a08c-421ba6eb57ad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:39.862718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6a2095d8-a812-4207-a08c-421ba6eb57ad admin admin] The token cache is being invalidate because project 55e6b9022b8d47e390f78db6b4531605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:07:39.863161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6a2095d8-a812-4207-a08c-421ba6eb57ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:39.864230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6a2095d8-a812-4207-a08c-421ba6eb57ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:39.867932 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2853/5732] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:07:39 2022] DELETE /identity/v3/projects/55e6b9022b8d47e390f78db6b4531605 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:07:39.870964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cf2c4-54b1-43ad-9f3f-be7d3fd8cb71 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:39.885427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cf2c4-54b1-43ad-9f3f-be7d3fd8cb71 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:40.048563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fd08f-9514-440f-b2a3-f92235d6deb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:40.049969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fd08f-9514-440f-b2a3-f92235d6deb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:40.050630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fd08f-9514-440f-b2a3-f92235d6deb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:40.051134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fd08f-9514-440f-b2a3-f92235d6deb1 admin admin] PATH_INFO: `/v3/users/09d4883b31ad4a96855f57d474a02017` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:40.054592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172fd08f-9514-440f-b2a3-f92235d6deb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09d4883b31ad4a96855f57d474a02017)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:40.057336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172fd08f-9514-440f-b2a3-f92235d6deb1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:40.164848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-172fd08f-9514-440f-b2a3-f92235d6deb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09d4883b31ad4a96855f57d474a02017'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:40.166778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-172fd08f-9514-440f-b2a3-f92235d6deb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09d4883b31ad4a96855f57d474a02017'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:40.180852 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:40.191334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-172fd08f-9514-440f-b2a3-f92235d6deb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09d4883b31ad4a96855f57d474a02017'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:40.228044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-172fd08f-9514-440f-b2a3-f92235d6deb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09d4883b31ad4a96855f57d474a02017'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:40.246308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-172fd08f-9514-440f-b2a3-f92235d6deb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09d4883b31ad4a96855f57d474a02017'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:40.258694 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2880/5733] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:07:39 2022] DELETE /identity/v3/users/09d4883b31ad4a96855f57d474a02017 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:42.475676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2095d8-a812-4207-a08c-421ba6eb57ad admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:42.477813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6a2095d8-a812-4207-a08c-421ba6eb57ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:42.499931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2095d8-a812-4207-a08c-421ba6eb57ad admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:42.638901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4439e5e-09aa-409b-b7d3-1f3516976244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:42.641375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4439e5e-09aa-409b-b7d3-1f3516976244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:42.642315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4439e5e-09aa-409b-b7d3-1f3516976244 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:42.642315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4439e5e-09aa-409b-b7d3-1f3516976244 admin admin] PATH_INFO: `/v3/projects/43ad7bcab7a549c8a2e44d509815be12` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:42.645359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4439e5e-09aa-409b-b7d3-1f3516976244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43ad7bcab7a549c8a2e44d509815be12)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:42.648830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4439e5e-09aa-409b-b7d3-1f3516976244 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:42.701384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa1b0a-1047-4eef-bc3f-17dd21d3db75 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:42.702500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa1b0a-1047-4eef-bc3f-17dd21d3db75 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:42.702781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa1b0a-1047-4eef-bc3f-17dd21d3db75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:42.741661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-98fa1b0a-1047-4eef-bc3f-17dd21d3db75 None None] MFA Rules not processed for user `58c50ed8702548f0b7568d172661e00d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:42.742895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-98fa1b0a-1047-4eef-bc3f-17dd21d3db75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:42.804217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d4439e5e-09aa-409b-b7d3-1f3516976244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43ad7bcab7a549c8a2e44d509815be12', 'request_id': 'req-d4439e5e-09aa-409b-b7d3-1f3516976244'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:42.821837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d4439e5e-09aa-409b-b7d3-1f3516976244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43ad7bcab7a549c8a2e44d509815be12', 'request_id': 'req-d4439e5e-09aa-409b-b7d3-1f3516976244'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:42.828545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d4439e5e-09aa-409b-b7d3-1f3516976244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43ad7bcab7a549c8a2e44d509815be12', 'request_id': 'req-d4439e5e-09aa-409b-b7d3-1f3516976244'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:42.841411 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:42.853178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d4439e5e-09aa-409b-b7d3-1f3516976244 admin admin] The token cache is being invalidate because project 43ad7bcab7a549c8a2e44d509815be12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:07:42.853564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d4439e5e-09aa-409b-b7d3-1f3516976244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:42.855855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d4439e5e-09aa-409b-b7d3-1f3516976244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:42.860874 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2854/5734] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:07:42 2022] DELETE /identity/v3/projects/43ad7bcab7a549c8a2e44d509815be12 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:42.865435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4439e5e-09aa-409b-b7d3-1f3516976244 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:42.868916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d4439e5e-09aa-409b-b7d3-1f3516976244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:42.902169 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2881/5735] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:42 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:07:42.937185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa1b0a-1047-4eef-bc3f-17dd21d3db75 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:42.938610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-98fa1b0a-1047-4eef-bc3f-17dd21d3db75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:42.962932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa1b0a-1047-4eef-bc3f-17dd21d3db75 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:43.077087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4439e5e-09aa-409b-b7d3-1f3516976244 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:43.085325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded3cf2-2cee-4188-bd8a-15058fa24604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:43.086034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded3cf2-2cee-4188-bd8a-15058fa24604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:43.086265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded3cf2-2cee-4188-bd8a-15058fa24604 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:43.086504 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded3cf2-2cee-4188-bd8a-15058fa24604 admin admin] PATH_INFO: `/v3/users/ac59ec20fd1941d097b2018464225d19` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:43.091466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded3cf2-2cee-4188-bd8a-15058fa24604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac59ec20fd1941d097b2018464225d19)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:43.093643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded3cf2-2cee-4188-bd8a-15058fa24604 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:43.137325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914e6c6-378d-4fef-b11b-4aa004162701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:43.138009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914e6c6-378d-4fef-b11b-4aa004162701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:43.138286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914e6c6-378d-4fef-b11b-4aa004162701 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:43.138767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914e6c6-378d-4fef-b11b-4aa004162701 admin admin] PATH_INFO: `/v3/users/7626452434404635a6e26f9d2b61be49` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:43.141969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914e6c6-378d-4fef-b11b-4aa004162701 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7626452434404635a6e26f9d2b61be49)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:43.145038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914e6c6-378d-4fef-b11b-4aa004162701 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:43.206118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9ded3cf2-2cee-4188-bd8a-15058fa24604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac59ec20fd1941d097b2018464225d19'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:43.224421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9ded3cf2-2cee-4188-bd8a-15058fa24604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac59ec20fd1941d097b2018464225d19'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:43.225322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9ded3cf2-2cee-4188-bd8a-15058fa24604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac59ec20fd1941d097b2018464225d19'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:43.246542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2914e6c6-378d-4fef-b11b-4aa004162701 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7626452434404635a6e26f9d2b61be49'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:43.248210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2914e6c6-378d-4fef-b11b-4aa004162701 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7626452434404635a6e26f9d2b61be49'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:43.250214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9ded3cf2-2cee-4188-bd8a-15058fa24604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac59ec20fd1941d097b2018464225d19'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:43.264317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9ded3cf2-2cee-4188-bd8a-15058fa24604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac59ec20fd1941d097b2018464225d19'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:43.264575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2914e6c6-378d-4fef-b11b-4aa004162701 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7626452434404635a6e26f9d2b61be49'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:43.278549 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2855/5736] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:07:42 2022] DELETE /identity/v3/users/ac59ec20fd1941d097b2018464225d19 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:07:43.291498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2914e6c6-378d-4fef-b11b-4aa004162701 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7626452434404635a6e26f9d2b61be49'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:43.294605 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:43.304762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2914e6c6-378d-4fef-b11b-4aa004162701 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7626452434404635a6e26f9d2b61be49'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:43.318639 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2882/5737] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:07:42 2022] DELETE /identity/v3/users/7626452434404635a6e26f9d2b61be49 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:07:43.322990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fa73d-bc47-4d0c-9f8c-4d0ba802d6d6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:43.323270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fa73d-bc47-4d0c-9f8c-4d0ba802d6d6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:43.323697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fa73d-bc47-4d0c-9f8c-4d0ba802d6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:43.358444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e68fa73d-bc47-4d0c-9f8c-4d0ba802d6d6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:43.360158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e68fa73d-bc47-4d0c-9f8c-4d0ba802d6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:43.568244 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2856/5738] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:43.593323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914e6c6-378d-4fef-b11b-4aa004162701 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:43.595256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2914e6c6-378d-4fef-b11b-4aa004162701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:43.735675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914e6c6-378d-4fef-b11b-4aa004162701 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:43.749026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74581cb-178e-46c3-9a00-d65e8fd21007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:43.751273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74581cb-178e-46c3-9a00-d65e8fd21007 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:43.751566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74581cb-178e-46c3-9a00-d65e8fd21007 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:43.751999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74581cb-178e-46c3-9a00-d65e8fd21007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:43.775736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74581cb-178e-46c3-9a00-d65e8fd21007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:43.777788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74581cb-178e-46c3-9a00-d65e8fd21007 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:43.797255 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2883/5739] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:07:44.659493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fa73d-bc47-4d0c-9f8c-4d0ba802d6d6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:44.661440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e68fa73d-bc47-4d0c-9f8c-4d0ba802d6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:44.682191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fa73d-bc47-4d0c-9f8c-4d0ba802d6d6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:44.695607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83308405-6b5d-4c1a-aa5b-1e07344cc228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:44.696264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83308405-6b5d-4c1a-aa5b-1e07344cc228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:44.696751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83308405-6b5d-4c1a-aa5b-1e07344cc228 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:44.696870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83308405-6b5d-4c1a-aa5b-1e07344cc228 admin admin] PATH_INFO: `/v3/projects/6c57f8b8a680403eb85cf6856d02593b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:44.698240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83308405-6b5d-4c1a-aa5b-1e07344cc228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c57f8b8a680403eb85cf6856d02593b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:44.700025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83308405-6b5d-4c1a-aa5b-1e07344cc228 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:44.735534 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:44.806827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-83308405-6b5d-4c1a-aa5b-1e07344cc228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c57f8b8a680403eb85cf6856d02593b', 'request_id': 'req-83308405-6b5d-4c1a-aa5b-1e07344cc228'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:44.837160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-83308405-6b5d-4c1a-aa5b-1e07344cc228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c57f8b8a680403eb85cf6856d02593b', 'request_id': 'req-83308405-6b5d-4c1a-aa5b-1e07344cc228'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:44.877832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-83308405-6b5d-4c1a-aa5b-1e07344cc228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c57f8b8a680403eb85cf6856d02593b', 'request_id': 'req-83308405-6b5d-4c1a-aa5b-1e07344cc228'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:44.907030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-83308405-6b5d-4c1a-aa5b-1e07344cc228 admin admin] The token cache is being invalidate because project 6c57f8b8a680403eb85cf6856d02593b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:07:44.907686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-83308405-6b5d-4c1a-aa5b-1e07344cc228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:44.909708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-83308405-6b5d-4c1a-aa5b-1e07344cc228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:44.913691 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2857/5740] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:07:44 2022] DELETE /identity/v3/projects/6c57f8b8a680403eb85cf6856d02593b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:44.918719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdbf45-a2af-47eb-840d-f723df4c1403 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:44.919186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdbf45-a2af-47eb-840d-f723df4c1403 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:44.919526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdbf45-a2af-47eb-840d-f723df4c1403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:44.947309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-acbdbf45-a2af-47eb-840d-f723df4c1403 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:44.948883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-acbdbf45-a2af-47eb-840d-f723df4c1403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:45.136613 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2884/5741] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:45.141040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488fd79-4727-44d3-967b-90c5eda58721 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:45.141252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488fd79-4727-44d3-967b-90c5eda58721 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:45.141522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488fd79-4727-44d3-967b-90c5eda58721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:45.211907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1488fd79-4727-44d3-967b-90c5eda58721 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:45.213234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1488fd79-4727-44d3-967b-90c5eda58721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:45.259728 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2858/5742] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:45.261014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdbf45-a2af-47eb-840d-f723df4c1403 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:45.276905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdbf45-a2af-47eb-840d-f723df4c1403 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:45.296856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad23d2d-53a5-4788-b13a-2f081b17556b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:45.297702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad23d2d-53a5-4788-b13a-2f081b17556b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:45.298223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad23d2d-53a5-4788-b13a-2f081b17556b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:45.298657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad23d2d-53a5-4788-b13a-2f081b17556b admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:45.300146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad23d2d-53a5-4788-b13a-2f081b17556b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:07:45.300720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad23d2d-53a5-4788-b13a-2f081b17556b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:45.304183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad23d2d-53a5-4788-b13a-2f081b17556b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:45.343975 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2885/5743] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:07:45.348433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488fd79-4727-44d3-967b-90c5eda58721 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:45.363549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488fd79-4727-44d3-967b-90c5eda58721 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:45.379158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2bde4-4a9e-470e-91af-d821872c1cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:45.381369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2bde4-4a9e-470e-91af-d821872c1cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:45.383283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2bde4-4a9e-470e-91af-d821872c1cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:45.383746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2bde4-4a9e-470e-91af-d821872c1cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:45.385269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2bde4-4a9e-470e-91af-d821872c1cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:45.391515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2bde4-4a9e-470e-91af-d821872c1cb1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:45.465166 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2859/5744] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:07:45 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:45.472918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad23d2d-53a5-4788-b13a-2f081b17556b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:45.488338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad23d2d-53a5-4788-b13a-2f081b17556b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:45.640866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2bde4-4a9e-470e-91af-d821872c1cb1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:45.643664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b6b2bde4-4a9e-470e-91af-d821872c1cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:45.646052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f457e-021b-40c5-8b2e-c78bc3fb07e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:45.646709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f457e-021b-40c5-8b2e-c78bc3fb07e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:45.647015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f457e-021b-40c5-8b2e-c78bc3fb07e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:45.647288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f457e-021b-40c5-8b2e-c78bc3fb07e1 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:45.647924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f457e-021b-40c5-8b2e-c78bc3fb07e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:45.650611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f457e-021b-40c5-8b2e-c78bc3fb07e1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:45.678357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2bde4-4a9e-470e-91af-d821872c1cb1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:45.697177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81319b3b-85e6-4db5-ac27-a412d51a622e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:45.700045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81319b3b-85e6-4db5-ac27-a412d51a622e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:45.701458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81319b3b-85e6-4db5-ac27-a412d51a622e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:45.701845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81319b3b-85e6-4db5-ac27-a412d51a622e admin admin] PATH_INFO: `/v3/projects/6ca3eb7ad4f84f0dbeb6e511de3cd2c0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:45.705235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81319b3b-85e6-4db5-ac27-a412d51a622e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ca3eb7ad4f84f0dbeb6e511de3cd2c0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:45.706171 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2886/5745] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:07:45 2022] POST /identity/v3/users => generated 284 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:45.707528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81319b3b-85e6-4db5-ac27-a412d51a622e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:45.707667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f457e-021b-40c5-8b2e-c78bc3fb07e1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:45.736050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f457e-021b-40c5-8b2e-c78bc3fb07e1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:45.743584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b98978-790e-4c0e-a9b8-6a20e9176d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:45.744347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b98978-790e-4c0e-a9b8-6a20e9176d87 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:45.744724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b98978-790e-4c0e-a9b8-6a20e9176d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:45.745188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b98978-790e-4c0e-a9b8-6a20e9176d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:45.746080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b98978-790e-4c0e-a9b8-6a20e9176d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:45.755141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b98978-790e-4c0e-a9b8-6a20e9176d87 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:45.765893 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:45.778497 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2887/5746] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:45.779920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b98978-790e-4c0e-a9b8-6a20e9176d87 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:45.798517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b98978-790e-4c0e-a9b8-6a20e9176d87 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:45.806347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb51a7c-c490-4234-a4f9-3e3dbd3ce23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:45.807102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb51a7c-c490-4234-a4f9-3e3dbd3ce23f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:45.807457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb51a7c-c490-4234-a4f9-3e3dbd3ce23f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:45.808071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb51a7c-c490-4234-a4f9-3e3dbd3ce23f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:45.809013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb51a7c-c490-4234-a4f9-3e3dbd3ce23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:45.811299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb51a7c-c490-4234-a4f9-3e3dbd3ce23f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:45.829303 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2888/5747] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:45.830188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-81319b3b-85e6-4db5-ac27-a412d51a622e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ca3eb7ad4f84f0dbeb6e511de3cd2c0', 'request_id': 'req-81319b3b-85e6-4db5-ac27-a412d51a622e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:45.831383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb51a7c-c490-4234-a4f9-3e3dbd3ce23f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:45.851403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-81319b3b-85e6-4db5-ac27-a412d51a622e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ca3eb7ad4f84f0dbeb6e511de3cd2c0', 'request_id': 'req-81319b3b-85e6-4db5-ac27-a412d51a622e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:45.860940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-81319b3b-85e6-4db5-ac27-a412d51a622e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ca3eb7ad4f84f0dbeb6e511de3cd2c0', 'request_id': 'req-81319b3b-85e6-4db5-ac27-a412d51a622e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:45.880258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb51a7c-c490-4234-a4f9-3e3dbd3ce23f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:45.890563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-81319b3b-85e6-4db5-ac27-a412d51a622e admin admin] The token cache is being invalidate because project 6ca3eb7ad4f84f0dbeb6e511de3cd2c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:07:45.892352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-81319b3b-85e6-4db5-ac27-a412d51a622e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:45.895337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-81319b3b-85e6-4db5-ac27-a412d51a622e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:45.900289 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2860/5748] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:07:45 2022] DELETE /identity/v3/projects/6ca3eb7ad4f84f0dbeb6e511de3cd2c0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:07:45.905143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad0632-d52b-4044-bc22-a5bd5f4f76c2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:45.905690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad0632-d52b-4044-bc22-a5bd5f4f76c2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:45.906751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad0632-d52b-4044-bc22-a5bd5f4f76c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:45.981615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cdad0632-d52b-4044-bc22-a5bd5f4f76c2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:45.985348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cdad0632-d52b-4044-bc22-a5bd5f4f76c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:46.052986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9970607-935d-4054-aeeb-599528753789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:46.053568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9970607-935d-4054-aeeb-599528753789 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:46.054003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9970607-935d-4054-aeeb-599528753789 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:46.055911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9970607-935d-4054-aeeb-599528753789 admin admin] PATH_INFO: `/v3/projects/47be4b1478a846708cf9f3d9c8955fe5/users/a0645ddee1fa4426b9c1efd0fb3a9849/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:46.090888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9970607-935d-4054-aeeb-599528753789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47be4b1478a846708cf9f3d9c8955fe5, user_id=a0645ddee1fa4426b9c1efd0fb3a9849, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:46.099140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9970607-935d-4054-aeeb-599528753789 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:46.109733 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:46.127127 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2889/5749] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:07:45 2022] PUT /identity/v3/projects/47be4b1478a846708cf9f3d9c8955fe5/users/a0645ddee1fa4426b9c1efd0fb3a9849/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:46.139690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f69c59-ba1d-4ac4-9fc7-7c6179bd5a5e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:46.140303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f69c59-ba1d-4ac4-9fc7-7c6179bd5a5e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:46.140905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f69c59-ba1d-4ac4-9fc7-7c6179bd5a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:46.149385 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2861/5750] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:07:46.159106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a58bd-6c54-458f-847c-777e929a4c1c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:46.159725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a58bd-6c54-458f-847c-777e929a4c1c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:46.160224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a58bd-6c54-458f-847c-777e929a4c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:46.204971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-941a58bd-6c54-458f-847c-777e929a4c1c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:46.208475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-941a58bd-6c54-458f-847c-777e929a4c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:46.213061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b6f69c59-ba1d-4ac4-9fc7-7c6179bd5a5e None None] MFA Rules not processed for user `a0645ddee1fa4426b9c1efd0fb3a9849`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:46.214393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b6f69c59-ba1d-4ac4-9fc7-7c6179bd5a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:46.369822 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2862/5751] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:07:46.370995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a58bd-6c54-458f-847c-777e929a4c1c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:46.388090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a58bd-6c54-458f-847c-777e929a4c1c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:46.389837 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2890/5752] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:46.396499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f69c59-ba1d-4ac4-9fc7-7c6179bd5a5e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:46.398159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b6f69c59-ba1d-4ac4-9fc7-7c6179bd5a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:46.406346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0331b4f-da9b-4c27-9ccc-9e4ad20bd4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:46.406983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331b4f-da9b-4c27-9ccc-9e4ad20bd4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:46.407297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331b4f-da9b-4c27-9ccc-9e4ad20bd4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:46.407573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331b4f-da9b-4c27-9ccc-9e4ad20bd4d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:46.408310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0331b4f-da9b-4c27-9ccc-9e4ad20bd4d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:07:46.408774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0331b4f-da9b-4c27-9ccc-9e4ad20bd4d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:46.410831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0331b4f-da9b-4c27-9ccc-9e4ad20bd4d9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:46.416931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f69c59-ba1d-4ac4-9fc7-7c6179bd5a5e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:46.424796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc7f8a-a598-4dc3-880c-8cb6e29a1fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:46.425772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc7f8a-a598-4dc3-880c-8cb6e29a1fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:46.426140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc7f8a-a598-4dc3-880c-8cb6e29a1fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:46.426585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc7f8a-a598-4dc3-880c-8cb6e29a1fa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:46.427465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc7f8a-a598-4dc3-880c-8cb6e29a1fa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:46.430483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc7f8a-a598-4dc3-880c-8cb6e29a1fa5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:46.445035 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2863/5753] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:07:46.448913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0331b4f-da9b-4c27-9ccc-9e4ad20bd4d9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:46.462683 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0331b4f-da9b-4c27-9ccc-9e4ad20bd4d9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:46.469669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823f492-8f24-41aa-90fa-1b9c01c29a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:46.473829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823f492-8f24-41aa-90fa-1b9c01c29a1a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:46.475136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823f492-8f24-41aa-90fa-1b9c01c29a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:46.475711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823f492-8f24-41aa-90fa-1b9c01c29a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:46.476145 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2891/5754] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:07:46 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:46.477916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823f492-8f24-41aa-90fa-1b9c01c29a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:46.480695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc7f8a-a598-4dc3-880c-8cb6e29a1fa5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:46.480867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823f492-8f24-41aa-90fa-1b9c01c29a1a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:46.543203 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2864/5755] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:07:46 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:07:46.547132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823f492-8f24-41aa-90fa-1b9c01c29a1a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:46.554143 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:46.592730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc7f8a-a598-4dc3-880c-8cb6e29a1fa5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:46.696901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823f492-8f24-41aa-90fa-1b9c01c29a1a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:46.710625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10e27a-a8c8-44f0-8549-f865b5fc2257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:46.711666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10e27a-a8c8-44f0-8549-f865b5fc2257 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:46.712624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10e27a-a8c8-44f0-8549-f865b5fc2257 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:46.713149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10e27a-a8c8-44f0-8549-f865b5fc2257 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:46.714125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10e27a-a8c8-44f0-8549-f865b5fc2257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:46.716842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10e27a-a8c8-44f0-8549-f865b5fc2257 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:46.731209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66430a-e7fe-46ea-b8d4-4625d742e613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:46.731823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66430a-e7fe-46ea-b8d4-4625d742e613 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:46.732102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66430a-e7fe-46ea-b8d4-4625d742e613 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:46.732493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66430a-e7fe-46ea-b8d4-4625d742e613 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:46.733143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66430a-e7fe-46ea-b8d4-4625d742e613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:46.735371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66430a-e7fe-46ea-b8d4-4625d742e613 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:46.758302 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2865/5756] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:07:46 2022] POST /identity/v3/users => generated 284 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:46.759805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10e27a-a8c8-44f0-8549-f865b5fc2257 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:46.776688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10e27a-a8c8-44f0-8549-f865b5fc2257 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:46.780926 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2892/5757] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:07:46 2022] POST /identity/v3/users => generated 289 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:07:46.782496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f95e4f-abea-4ea2-b11b-9f51aacd10a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:46.783321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f95e4f-abea-4ea2-b11b-9f51aacd10a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:46.783975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f95e4f-abea-4ea2-b11b-9f51aacd10a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:46.784361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f95e4f-abea-4ea2-b11b-9f51aacd10a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:46.784922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66430a-e7fe-46ea-b8d4-4625d742e613 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:46.785309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f95e4f-abea-4ea2-b11b-9f51aacd10a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:46.788688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f95e4f-abea-4ea2-b11b-9f51aacd10a5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:46.806860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66430a-e7fe-46ea-b8d4-4625d742e613 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:46.813418 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2866/5758] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:46.814860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f95e4f-abea-4ea2-b11b-9f51aacd10a5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:46.824103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def03de2-89d6-4ad1-b5c0-e86d8e27dc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:46.824944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def03de2-89d6-4ad1-b5c0-e86d8e27dc96 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:46.825215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def03de2-89d6-4ad1-b5c0-e86d8e27dc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:46.825488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def03de2-89d6-4ad1-b5c0-e86d8e27dc96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:46.826130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def03de2-89d6-4ad1-b5c0-e86d8e27dc96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:46.826955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f95e4f-abea-4ea2-b11b-9f51aacd10a5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:46.827729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def03de2-89d6-4ad1-b5c0-e86d8e27dc96 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:46.833399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ec53c-5df2-47e8-893e-4344c596ad72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:46.834381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ec53c-5df2-47e8-893e-4344c596ad72 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:46.834726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ec53c-5df2-47e8-893e-4344c596ad72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:46.835064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ec53c-5df2-47e8-893e-4344c596ad72 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:46.835950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ec53c-5df2-47e8-893e-4344c596ad72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:46.837562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ec53c-5df2-47e8-893e-4344c596ad72 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:46.862036 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2867/5759] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:46.863085 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2893/5760] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:07:46.863212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ec53c-5df2-47e8-893e-4344c596ad72 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:46.864241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def03de2-89d6-4ad1-b5c0-e86d8e27dc96 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:46.874815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ec53c-5df2-47e8-893e-4344c596ad72 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:46.875943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def03de2-89d6-4ad1-b5c0-e86d8e27dc96 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:46.880877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96cdbf-5507-4a6d-a76c-452518780766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:46.881719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96cdbf-5507-4a6d-a76c-452518780766 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:46.882311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96cdbf-5507-4a6d-a76c-452518780766 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:46.882651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96cdbf-5507-4a6d-a76c-452518780766 admin admin] PATH_INFO: `/v3/projects/9c0728311a114f9b80b5bb458b271d56/users/c245bbebdefe4eccb8661ccb1664e246/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:46.883213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd54cd6-2847-44df-9437-aba3535f614a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:46.885418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd54cd6-2847-44df-9437-aba3535f614a admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:46.885780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd54cd6-2847-44df-9437-aba3535f614a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:46.887030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd54cd6-2847-44df-9437-aba3535f614a admin admin] PATH_INFO: `/v3/projects/8205b0681d9b477baa550d808151970e/users/141c0e26e533451f892ada997f9b723b/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:46.911383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96cdbf-5507-4a6d-a76c-452518780766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c0728311a114f9b80b5bb458b271d56, user_id=c245bbebdefe4eccb8661ccb1664e246, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:46.917900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96cdbf-5507-4a6d-a76c-452518780766 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:46.934802 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2868/5761] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:07:46 2022] PUT /identity/v3/projects/9c0728311a114f9b80b5bb458b271d56/users/c245bbebdefe4eccb8661ccb1664e246/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:46.946298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a53ddf-8e82-401f-bd5e-81a84eca4447 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:46.946649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a53ddf-8e82-401f-bd5e-81a84eca4447 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:46.948012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a53ddf-8e82-401f-bd5e-81a84eca4447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:46.975735 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:46.977838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd54cd6-2847-44df-9437-aba3535f614a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8205b0681d9b477baa550d808151970e, user_id=141c0e26e533451f892ada997f9b723b, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:46.984035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd54cd6-2847-44df-9437-aba3535f614a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:47.017306 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2894/5762] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:07:46 2022] PUT /identity/v3/projects/8205b0681d9b477baa550d808151970e/users/141c0e26e533451f892ada997f9b723b/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:47.023111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd54cd6-2847-44df-9437-aba3535f614a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:47.023973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-76a53ddf-8e82-401f-bd5e-81a84eca4447 None None] MFA Rules not processed for user `c245bbebdefe4eccb8661ccb1664e246`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:47.030069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-76a53ddf-8e82-401f-bd5e-81a84eca4447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:47.228973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd54cd6-2847-44df-9437-aba3535f614a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:47.237811 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2869/5763] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:47.242229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c74c3-e197-4f43-9691-9b0bcf243700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:47.244862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c74c3-e197-4f43-9691-9b0bcf243700 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:47.245508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c74c3-e197-4f43-9691-9b0bcf243700 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:47.247885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c74c3-e197-4f43-9691-9b0bcf243700 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:47.262884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c74c3-e197-4f43-9691-9b0bcf243700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:47.264644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c74c3-e197-4f43-9691-9b0bcf243700 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:47.282444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a53ddf-8e82-401f-bd5e-81a84eca4447 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:47.287306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-76a53ddf-8e82-401f-bd5e-81a84eca4447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:47.291768 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2895/5764] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:07:47.295818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c74c3-e197-4f43-9691-9b0bcf243700 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:47.324524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c74c3-e197-4f43-9691-9b0bcf243700 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:47.333773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817dcef5-e35f-42f3-8f1d-76019d19cb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:47.334772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dcef5-e35f-42f3-8f1d-76019d19cb2b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:47.335237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dcef5-e35f-42f3-8f1d-76019d19cb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:47.335672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dcef5-e35f-42f3-8f1d-76019d19cb2b admin admin] PATH_INFO: `/v3/projects/8205b0681d9b477baa550d808151970e/users/141c0e26e533451f892ada997f9b723b/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:47.342945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817dcef5-e35f-42f3-8f1d-76019d19cb2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8205b0681d9b477baa550d808151970e, user_id=141c0e26e533451f892ada997f9b723b, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:47.346456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817dcef5-e35f-42f3-8f1d-76019d19cb2b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:47.368069 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2896/5765] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:07:47 2022] PUT /identity/v3/projects/8205b0681d9b477baa550d808151970e/users/141c0e26e533451f892ada997f9b723b/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:07:47.376772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a53ddf-8e82-401f-bd5e-81a84eca4447 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:47.382779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9ecab-7078-481d-93e9-efaddc0dc4e9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:47.382935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9ecab-7078-481d-93e9-efaddc0dc4e9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:47.383117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9ecab-7078-481d-93e9-efaddc0dc4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:47.446269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2cb9ecab-7078-481d-93e9-efaddc0dc4e9 None None] MFA Rules not processed for user `141c0e26e533451f892ada997f9b723b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:47.447545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2cb9ecab-7078-481d-93e9-efaddc0dc4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:47.450590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66b5b6-4470-4106-8e9c-252977f59f1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:47.451233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66b5b6-4470-4106-8e9c-252977f59f1f service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:47.451513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66b5b6-4470-4106-8e9c-252977f59f1f service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:47.454206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66b5b6-4470-4106-8e9c-252977f59f1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:47.475021 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:47.667213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66b5b6-4470-4106-8e9c-252977f59f1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:47.670529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66b5b6-4470-4106-8e9c-252977f59f1f service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:47.695898 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2897/5766] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:47.709940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9ecab-7078-481d-93e9-efaddc0dc4e9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:47.710822 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2870/5767] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:07:47.712148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2cb9ecab-7078-481d-93e9-efaddc0dc4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:47.865024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9ecab-7078-481d-93e9-efaddc0dc4e9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:47.875984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7937d98-8b4e-4f00-8d29-7147ff779b1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:47.876646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7937d98-8b4e-4f00-8d29-7147ff779b1f service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:47.876922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7937d98-8b4e-4f00-8d29-7147ff779b1f service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:47.877729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7937d98-8b4e-4f00-8d29-7147ff779b1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:47.907280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7937d98-8b4e-4f00-8d29-7147ff779b1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:47.909542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7937d98-8b4e-4f00-8d29-7147ff779b1f service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:47.928721 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2898/5768] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:07:48.070590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66b5b6-4470-4106-8e9c-252977f59f1f service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:48.079850 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:48.094913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66b5b6-4470-4106-8e9c-252977f59f1f service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:48.106031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89539cf7-d79f-45da-bfcb-c4002ed41d89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:48.106662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89539cf7-d79f-45da-bfcb-c4002ed41d89 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:48.106946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89539cf7-d79f-45da-bfcb-c4002ed41d89 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:48.109251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89539cf7-d79f-45da-bfcb-c4002ed41d89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:48.278675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89539cf7-d79f-45da-bfcb-c4002ed41d89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:48.281520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89539cf7-d79f-45da-bfcb-c4002ed41d89 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:48.297980 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2871/5769] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:07:57.921523 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=54 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:58.290202 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=26 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:07:58.862986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7937d98-8b4e-4f00-8d29-7147ff779b1f service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:59.133353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7937d98-8b4e-4f00-8d29-7147ff779b1f service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:59.162047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89294587-33b2-4a4f-af49-9031c038b38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:59.162707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89294587-33b2-4a4f-af49-9031c038b38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:59.162989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89294587-33b2-4a4f-af49-9031c038b38e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:59.163272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89294587-33b2-4a4f-af49-9031c038b38e admin admin] PATH_INFO: `/v3/users/a0645ddee1fa4426b9c1efd0fb3a9849` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:59.170457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89294587-33b2-4a4f-af49-9031c038b38e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0645ddee1fa4426b9c1efd0fb3a9849)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:59.178219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89294587-33b2-4a4f-af49-9031c038b38e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:59.286638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-89294587-33b2-4a4f-af49-9031c038b38e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0645ddee1fa4426b9c1efd0fb3a9849'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:59.290737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-89294587-33b2-4a4f-af49-9031c038b38e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0645ddee1fa4426b9c1efd0fb3a9849'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:59.317207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-89294587-33b2-4a4f-af49-9031c038b38e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0645ddee1fa4426b9c1efd0fb3a9849'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:59.336261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-89294587-33b2-4a4f-af49-9031c038b38e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0645ddee1fa4426b9c1efd0fb3a9849'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:59.346256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-89294587-33b2-4a4f-af49-9031c038b38e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0645ddee1fa4426b9c1efd0fb3a9849'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:07:59.354188 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2899/5770] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:07:58 2022] DELETE /identity/v3/users/a0645ddee1fa4426b9c1efd0fb3a9849 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:07:59.359219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9835749-6b9a-4801-8642-31abf8598c7d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:59.363825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9835749-6b9a-4801-8642-31abf8598c7d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:59.364466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9835749-6b9a-4801-8642-31abf8598c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:59.436968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f9835749-6b9a-4801-8642-31abf8598c7d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:07:59.436968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f9835749-6b9a-4801-8642-31abf8598c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:59.573833 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2872/5771] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:07:59.693253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89294587-33b2-4a4f-af49-9031c038b38e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:07:59.694855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-89294587-33b2-4a4f-af49-9031c038b38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:07:59.843020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89294587-33b2-4a4f-af49-9031c038b38e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:07:59.851334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05d117-b4c6-4a33-aa53-19ed1d53cb7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:07:59.852106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05d117-b4c6-4a33-aa53-19ed1d53cb7f service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:07:59.852269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05d117-b4c6-4a33-aa53-19ed1d53cb7f service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:07:59.852489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05d117-b4c6-4a33-aa53-19ed1d53cb7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:07:59.889592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05d117-b4c6-4a33-aa53-19ed1d53cb7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:07:59.891613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05d117-b4c6-4a33-aa53-19ed1d53cb7f service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:07:59.919529 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2900/5772] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:07:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:08:02.107465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9835749-6b9a-4801-8642-31abf8598c7d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:02.112367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f9835749-6b9a-4801-8642-31abf8598c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:02.137528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9835749-6b9a-4801-8642-31abf8598c7d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:02.150680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679abe6-f4b1-41f9-8f23-1935a35d25ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:02.151884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679abe6-f4b1-41f9-8f23-1935a35d25ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:02.157458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679abe6-f4b1-41f9-8f23-1935a35d25ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:02.159404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679abe6-f4b1-41f9-8f23-1935a35d25ab admin admin] PATH_INFO: `/v3/projects/47be4b1478a846708cf9f3d9c8955fe5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:02.162955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679abe6-f4b1-41f9-8f23-1935a35d25ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=47be4b1478a846708cf9f3d9c8955fe5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:02.168371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679abe6-f4b1-41f9-8f23-1935a35d25ab admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:02.350570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0679abe6-f4b1-41f9-8f23-1935a35d25ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47be4b1478a846708cf9f3d9c8955fe5', 'request_id': 'req-0679abe6-f4b1-41f9-8f23-1935a35d25ab'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:02.366316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0679abe6-f4b1-41f9-8f23-1935a35d25ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47be4b1478a846708cf9f3d9c8955fe5', 'request_id': 'req-0679abe6-f4b1-41f9-8f23-1935a35d25ab'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:02.381716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0679abe6-f4b1-41f9-8f23-1935a35d25ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47be4b1478a846708cf9f3d9c8955fe5', 'request_id': 'req-0679abe6-f4b1-41f9-8f23-1935a35d25ab'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:02.407405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0679abe6-f4b1-41f9-8f23-1935a35d25ab admin admin] The token cache is being invalidate because project 47be4b1478a846708cf9f3d9c8955fe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:08:02.409699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0679abe6-f4b1-41f9-8f23-1935a35d25ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:02.410874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0679abe6-f4b1-41f9-8f23-1935a35d25ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:02.432780 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2873/5773] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:08:02 2022] DELETE /identity/v3/projects/47be4b1478a846708cf9f3d9c8955fe5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:02.436662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05d117-b4c6-4a33-aa53-19ed1d53cb7f service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:02.487685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05d117-b4c6-4a33-aa53-19ed1d53cb7f service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:02.609962 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:02.684328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b480d2b-c0f1-41f8-baa4-60f1a78539bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:02.685024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b480d2b-c0f1-41f8-baa4-60f1a78539bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:02.685302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b480d2b-c0f1-41f8-baa4-60f1a78539bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:02.685573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b480d2b-c0f1-41f8-baa4-60f1a78539bd admin admin] PATH_INFO: `/v3/users/141c0e26e533451f892ada997f9b723b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:02.690537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b480d2b-c0f1-41f8-baa4-60f1a78539bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=141c0e26e533451f892ada997f9b723b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:02.692481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b480d2b-c0f1-41f8-baa4-60f1a78539bd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:02.842734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b480d2b-c0f1-41f8-baa4-60f1a78539bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '141c0e26e533451f892ada997f9b723b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:02.843486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b480d2b-c0f1-41f8-baa4-60f1a78539bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '141c0e26e533451f892ada997f9b723b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:02.867076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b480d2b-c0f1-41f8-baa4-60f1a78539bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '141c0e26e533451f892ada997f9b723b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:02.921071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b480d2b-c0f1-41f8-baa4-60f1a78539bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '141c0e26e533451f892ada997f9b723b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:02.938393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b480d2b-c0f1-41f8-baa4-60f1a78539bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '141c0e26e533451f892ada997f9b723b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:02.966219 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2901/5774] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:08:02 2022] DELETE /identity/v3/users/141c0e26e533451f892ada997f9b723b => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:04.369975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679abe6-f4b1-41f9-8f23-1935a35d25ab admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:04.372278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0679abe6-f4b1-41f9-8f23-1935a35d25ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:04.397211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679abe6-f4b1-41f9-8f23-1935a35d25ab admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:04.504801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce4b98-30e7-410f-968f-1911877682f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:04.506316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce4b98-30e7-410f-968f-1911877682f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:04.506316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce4b98-30e7-410f-968f-1911877682f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:04.506808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce4b98-30e7-410f-968f-1911877682f1 admin admin] PATH_INFO: `/v3/projects/8205b0681d9b477baa550d808151970e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:04.511525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce4b98-30e7-410f-968f-1911877682f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8205b0681d9b477baa550d808151970e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:04.514002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce4b98-30e7-410f-968f-1911877682f1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:04.586189 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:04.619781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45ce4b98-30e7-410f-968f-1911877682f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8205b0681d9b477baa550d808151970e', 'request_id': 'req-45ce4b98-30e7-410f-968f-1911877682f1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:04.630829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45ce4b98-30e7-410f-968f-1911877682f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8205b0681d9b477baa550d808151970e', 'request_id': 'req-45ce4b98-30e7-410f-968f-1911877682f1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:04.640221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45ce4b98-30e7-410f-968f-1911877682f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8205b0681d9b477baa550d808151970e', 'request_id': 'req-45ce4b98-30e7-410f-968f-1911877682f1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:04.659910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45ce4b98-30e7-410f-968f-1911877682f1 admin admin] The token cache is being invalidate because project 8205b0681d9b477baa550d808151970e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:08:04.661187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45ce4b98-30e7-410f-968f-1911877682f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:04.662258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45ce4b98-30e7-410f-968f-1911877682f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:04.671219 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2874/5775] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:08:04 2022] DELETE /identity/v3/projects/8205b0681d9b477baa550d808151970e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:04.671843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70770752-394e-4dd0-963f-c1a6c7eb6e8f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:04.672672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70770752-394e-4dd0-963f-c1a6c7eb6e8f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:04.673370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70770752-394e-4dd0-963f-c1a6c7eb6e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:04.695359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-70770752-394e-4dd0-963f-c1a6c7eb6e8f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:04.696923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-70770752-394e-4dd0-963f-c1a6c7eb6e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:04.775957 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2902/5776] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:04.785043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d41a7-cc44-45a1-911e-0d01629f3051 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:04.785687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d41a7-cc44-45a1-911e-0d01629f3051 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:04.786213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d41a7-cc44-45a1-911e-0d01629f3051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:04.839368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ed5d41a7-cc44-45a1-911e-0d01629f3051 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:04.840848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ed5d41a7-cc44-45a1-911e-0d01629f3051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:04.901043 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2875/5777] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:04.904899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70770752-394e-4dd0-963f-c1a6c7eb6e8f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:04.918092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70770752-394e-4dd0-963f-c1a6c7eb6e8f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:04.947881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c3c06-7aa6-4049-9f8d-17bf9d47edac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:04.948212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c3c06-7aa6-4049-9f8d-17bf9d47edac admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:04.948505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c3c06-7aa6-4049-9f8d-17bf9d47edac admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:04.957266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c3c06-7aa6-4049-9f8d-17bf9d47edac admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:04.958115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c3c06-7aa6-4049-9f8d-17bf9d47edac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:08:04.958433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c3c06-7aa6-4049-9f8d-17bf9d47edac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:04.970883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c3c06-7aa6-4049-9f8d-17bf9d47edac admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:05.034694 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2903/5778] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:08:05.038418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d41a7-cc44-45a1-911e-0d01629f3051 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:05.055089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d41a7-cc44-45a1-911e-0d01629f3051 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:05.076621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28810b92-cbb8-4642-ac5b-5b648a3d045a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:05.077290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28810b92-cbb8-4642-ac5b-5b648a3d045a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:05.077580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28810b92-cbb8-4642-ac5b-5b648a3d045a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:05.077859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28810b92-cbb8-4642-ac5b-5b648a3d045a admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:05.078508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28810b92-cbb8-4642-ac5b-5b648a3d045a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:05.085260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28810b92-cbb8-4642-ac5b-5b648a3d045a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:05.144691 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2876/5779] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:08:05 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:05.149868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c3c06-7aa6-4049-9f8d-17bf9d47edac admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:05.176576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c3c06-7aa6-4049-9f8d-17bf9d47edac admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:05.249145 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:05.331626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a410f9-2028-4599-85b1-ce4055bbabc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:05.332512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a410f9-2028-4599-85b1-ce4055bbabc2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:05.332842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a410f9-2028-4599-85b1-ce4055bbabc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:05.333118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a410f9-2028-4599-85b1-ce4055bbabc2 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:05.333766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a410f9-2028-4599-85b1-ce4055bbabc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:05.336113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a410f9-2028-4599-85b1-ce4055bbabc2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:05.378272 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2904/5780] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:08:05 2022] POST /identity/v3/users => generated 292 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:05.382468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28810b92-cbb8-4642-ac5b-5b648a3d045a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:05.405896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28810b92-cbb8-4642-ac5b-5b648a3d045a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:05.416320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55120c-e163-41f0-81f5-f576dd504451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:05.417262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55120c-e163-41f0-81f5-f576dd504451 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:05.417701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55120c-e163-41f0-81f5-f576dd504451 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:05.418084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55120c-e163-41f0-81f5-f576dd504451 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:05.418926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55120c-e163-41f0-81f5-f576dd504451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:05.421248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55120c-e163-41f0-81f5-f576dd504451 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:05.440553 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2877/5781] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:08:05.445357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a410f9-2028-4599-85b1-ce4055bbabc2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:05.465611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a410f9-2028-4599-85b1-ce4055bbabc2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:05.480136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671b1ab-a8b4-4416-a774-939efea6a088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:05.481691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671b1ab-a8b4-4416-a774-939efea6a088 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:05.482124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671b1ab-a8b4-4416-a774-939efea6a088 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:05.482659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671b1ab-a8b4-4416-a774-939efea6a088 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:05.484830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671b1ab-a8b4-4416-a774-939efea6a088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:05.491413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671b1ab-a8b4-4416-a774-939efea6a088 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:05.523178 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2905/5782] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:05.527088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55120c-e163-41f0-81f5-f576dd504451 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:05.544322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55120c-e163-41f0-81f5-f576dd504451 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:05.553720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbd1cd-947f-4277-851b-bce005fb7540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:05.555636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbd1cd-947f-4277-851b-bce005fb7540 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:05.555836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbd1cd-947f-4277-851b-bce005fb7540 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:05.557409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbd1cd-947f-4277-851b-bce005fb7540 admin admin] PATH_INFO: `/v3/projects/f80e6453333343f1a393ebb38100797b/users/90187d54e0634e77b0fe08004b18e0ac/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:05.595339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbd1cd-947f-4277-851b-bce005fb7540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f80e6453333343f1a393ebb38100797b, user_id=90187d54e0634e77b0fe08004b18e0ac, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:05.600802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbd1cd-947f-4277-851b-bce005fb7540 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:05.625884 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2878/5783] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:08:05 2022] PUT /identity/v3/projects/f80e6453333343f1a393ebb38100797b/users/90187d54e0634e77b0fe08004b18e0ac/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:05.638420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8f42f-efb9-4e87-bc56-31325394aca0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:05.638774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8f42f-efb9-4e87-bc56-31325394aca0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:05.639825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8f42f-efb9-4e87-bc56-31325394aca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:05.697127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b8e8f42f-efb9-4e87-bc56-31325394aca0 None None] MFA Rules not processed for user `90187d54e0634e77b0fe08004b18e0ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:05.698425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b8e8f42f-efb9-4e87-bc56-31325394aca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:05.866041 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2906/5784] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:05.868919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbd1cd-947f-4277-851b-bce005fb7540 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:05.989777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbd1cd-947f-4277-851b-bce005fb7540 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:05.997693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca0e7f-3d3f-44cc-aea6-fab6e4f2bbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:05.998325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca0e7f-3d3f-44cc-aea6-fab6e4f2bbd9 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:05.998604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca0e7f-3d3f-44cc-aea6-fab6e4f2bbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:05.998877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca0e7f-3d3f-44cc-aea6-fab6e4f2bbd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:05.999890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca0e7f-3d3f-44cc-aea6-fab6e4f2bbd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:06.002674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca0e7f-3d3f-44cc-aea6-fab6e4f2bbd9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:06.065781 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2879/5785] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:08:05 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:06.066193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8f42f-efb9-4e87-bc56-31325394aca0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:06.085096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8f42f-efb9-4e87-bc56-31325394aca0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:06.270258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac4796-220c-445a-839c-57a5dee2cb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:06.270897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac4796-220c-445a-839c-57a5dee2cb0c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:06.274279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac4796-220c-445a-839c-57a5dee2cb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:06.274572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac4796-220c-445a-839c-57a5dee2cb0c admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:06.275311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac4796-220c-445a-839c-57a5dee2cb0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:06.279942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac4796-220c-445a-839c-57a5dee2cb0c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:06.343203 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2907/5786] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:08:06 2022] POST /identity/v3/users => generated 297 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:08:06.347583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca0e7f-3d3f-44cc-aea6-fab6e4f2bbd9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:06.368837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca0e7f-3d3f-44cc-aea6-fab6e4f2bbd9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:06.384006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252e108-c48c-44da-a343-c5cb8b7588c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:06.386417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252e108-c48c-44da-a343-c5cb8b7588c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:06.386878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252e108-c48c-44da-a343-c5cb8b7588c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:06.387331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252e108-c48c-44da-a343-c5cb8b7588c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:06.388215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252e108-c48c-44da-a343-c5cb8b7588c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:06.390149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252e108-c48c-44da-a343-c5cb8b7588c9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:06.408369 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2880/5787] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:06.412269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac4796-220c-445a-839c-57a5dee2cb0c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:06.427953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac4796-220c-445a-839c-57a5dee2cb0c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:06.440847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb4cf0-965c-49b2-9792-26106036d942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:06.442439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb4cf0-965c-49b2-9792-26106036d942 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:06.443014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb4cf0-965c-49b2-9792-26106036d942 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:06.443679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb4cf0-965c-49b2-9792-26106036d942 admin admin] PATH_INFO: `/v3/projects/eb1b77540c3c4dcb8c89ab1a38adebec/users/82fdba345a6844f49211aeae6cb2995e/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:06.492935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb4cf0-965c-49b2-9792-26106036d942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1b77540c3c4dcb8c89ab1a38adebec, user_id=82fdba345a6844f49211aeae6cb2995e, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:06.496775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb4cf0-965c-49b2-9792-26106036d942 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:06.528886 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2908/5788] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:08:06 2022] PUT /identity/v3/projects/eb1b77540c3c4dcb8c89ab1a38adebec/users/82fdba345a6844f49211aeae6cb2995e/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:08:06.533389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252e108-c48c-44da-a343-c5cb8b7588c9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:06.552550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252e108-c48c-44da-a343-c5cb8b7588c9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:06.614207 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:06.762551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723b04e-b938-4123-8000-02bc4dbd2034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:06.763667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723b04e-b938-4123-8000-02bc4dbd2034 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:06.764194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723b04e-b938-4123-8000-02bc4dbd2034 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:06.764635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723b04e-b938-4123-8000-02bc4dbd2034 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:06.766209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723b04e-b938-4123-8000-02bc4dbd2034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:06.768186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723b04e-b938-4123-8000-02bc4dbd2034 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:06.804070 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2881/5789] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:06.805292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb4cf0-965c-49b2-9792-26106036d942 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:06.812648 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:06.822451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb4cf0-965c-49b2-9792-26106036d942 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:06.842601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70917c-b51f-443f-a0c9-82049613307b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:06.843251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70917c-b51f-443f-a0c9-82049613307b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:06.843534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70917c-b51f-443f-a0c9-82049613307b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:06.843810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70917c-b51f-443f-a0c9-82049613307b admin admin] PATH_INFO: `/v3/projects/eb1b77540c3c4dcb8c89ab1a38adebec/users/82fdba345a6844f49211aeae6cb2995e/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:06.847470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70917c-b51f-443f-a0c9-82049613307b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1b77540c3c4dcb8c89ab1a38adebec, user_id=82fdba345a6844f49211aeae6cb2995e, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:06.851488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70917c-b51f-443f-a0c9-82049613307b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:06.890906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a1095-ed41-465f-82b6-2ae9648a8077 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:06.891194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a1095-ed41-465f-82b6-2ae9648a8077 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:06.891466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a1095-ed41-465f-82b6-2ae9648a8077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:06.894922 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2909/5790] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:08:06 2022] PUT /identity/v3/projects/eb1b77540c3c4dcb8c89ab1a38adebec/users/82fdba345a6844f49211aeae6cb2995e/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:06.972358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-573a1095-ed41-465f-82b6-2ae9648a8077 None None] MFA Rules not processed for user `82fdba345a6844f49211aeae6cb2995e`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:06.973677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-573a1095-ed41-465f-82b6-2ae9648a8077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:07.122867 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2882/5791] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:07.134925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70917c-b51f-443f-a0c9-82049613307b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:07.139706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2e70917c-b51f-443f-a0c9-82049613307b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:07.245046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70917c-b51f-443f-a0c9-82049613307b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:07.265560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2156eef-42f2-47e5-a7ef-cf7f58505056 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:07.266212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2156eef-42f2-47e5-a7ef-cf7f58505056 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:07.266491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2156eef-42f2-47e5-a7ef-cf7f58505056 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:07.266762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2156eef-42f2-47e5-a7ef-cf7f58505056 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:07.286125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2156eef-42f2-47e5-a7ef-cf7f58505056 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:07.288216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2156eef-42f2-47e5-a7ef-cf7f58505056 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:07.326406 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2910/5792] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:08:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:08:07.440329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a1095-ed41-465f-82b6-2ae9648a8077 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:07.462488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a1095-ed41-465f-82b6-2ae9648a8077 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:07.471192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb6946-928d-4d19-afe0-9e5a38405b3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:07.471837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb6946-928d-4d19-afe0-9e5a38405b3b service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:07.472377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb6946-928d-4d19-afe0-9e5a38405b3b service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:07.472679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb6946-928d-4d19-afe0-9e5a38405b3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:07.588709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb6946-928d-4d19-afe0-9e5a38405b3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:07.590611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb6946-928d-4d19-afe0-9e5a38405b3b service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:07.611896 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2883/5793] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:08:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:08:08.119816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2156eef-42f2-47e5-a7ef-cf7f58505056 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:08.365219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2156eef-42f2-47e5-a7ef-cf7f58505056 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:08.381005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096cf394-a1e6-472a-b87b-718957ea9014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:08.381734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cf394-a1e6-472a-b87b-718957ea9014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:08.382053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cf394-a1e6-472a-b87b-718957ea9014 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:08.382331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cf394-a1e6-472a-b87b-718957ea9014 admin admin] PATH_INFO: `/v3/users/90187d54e0634e77b0fe08004b18e0ac` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:08.384944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096cf394-a1e6-472a-b87b-718957ea9014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90187d54e0634e77b0fe08004b18e0ac)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:08.387092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096cf394-a1e6-472a-b87b-718957ea9014 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:08.542900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-096cf394-a1e6-472a-b87b-718957ea9014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90187d54e0634e77b0fe08004b18e0ac'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:08.544966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-096cf394-a1e6-472a-b87b-718957ea9014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90187d54e0634e77b0fe08004b18e0ac'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:08.562163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-096cf394-a1e6-472a-b87b-718957ea9014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90187d54e0634e77b0fe08004b18e0ac'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:08.615766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-096cf394-a1e6-472a-b87b-718957ea9014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90187d54e0634e77b0fe08004b18e0ac'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:08.643492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-096cf394-a1e6-472a-b87b-718957ea9014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90187d54e0634e77b0fe08004b18e0ac'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:08.662234 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2911/5794] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:08:08 2022] DELETE /identity/v3/users/90187d54e0634e77b0fe08004b18e0ac => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:08.667138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170b0a2-28f1-4c90-a3fc-46c2579c6ee8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:08.667680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170b0a2-28f1-4c90-a3fc-46c2579c6ee8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:08.668031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170b0a2-28f1-4c90-a3fc-46c2579c6ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:08.708991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0170b0a2-28f1-4c90-a3fc-46c2579c6ee8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:08.711353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0170b0a2-28f1-4c90-a3fc-46c2579c6ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:08.843835 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:08.898385 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2884/5795] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:09.056823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096cf394-a1e6-472a-b87b-718957ea9014 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:09.058434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-096cf394-a1e6-472a-b87b-718957ea9014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:09.095471 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:09.283282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096cf394-a1e6-472a-b87b-718957ea9014 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:09.300195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c625e7-44d9-4619-b235-90aa70274ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:09.301759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c625e7-44d9-4619-b235-90aa70274ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:09.302230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c625e7-44d9-4619-b235-90aa70274ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:09.302728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c625e7-44d9-4619-b235-90aa70274ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:09.315043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c625e7-44d9-4619-b235-90aa70274ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:09.316845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c625e7-44d9-4619-b235-90aa70274ae8 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:09.335251 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2912/5796] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:08:10.818901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170b0a2-28f1-4c90-a3fc-46c2579c6ee8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:10.820369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0170b0a2-28f1-4c90-a3fc-46c2579c6ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:10.843288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170b0a2-28f1-4c90-a3fc-46c2579c6ee8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:10.857151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80f908-6268-43f0-8625-bf9a749d73e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:10.859478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80f908-6268-43f0-8625-bf9a749d73e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:10.860344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80f908-6268-43f0-8625-bf9a749d73e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:10.867631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80f908-6268-43f0-8625-bf9a749d73e8 admin admin] PATH_INFO: `/v3/projects/f80e6453333343f1a393ebb38100797b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:10.873331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80f908-6268-43f0-8625-bf9a749d73e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f80e6453333343f1a393ebb38100797b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:10.888587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80f908-6268-43f0-8625-bf9a749d73e8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:11.049378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dd80f908-6268-43f0-8625-bf9a749d73e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f80e6453333343f1a393ebb38100797b', 'request_id': 'req-dd80f908-6268-43f0-8625-bf9a749d73e8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:11.062377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dd80f908-6268-43f0-8625-bf9a749d73e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f80e6453333343f1a393ebb38100797b', 'request_id': 'req-dd80f908-6268-43f0-8625-bf9a749d73e8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:11.073823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dd80f908-6268-43f0-8625-bf9a749d73e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f80e6453333343f1a393ebb38100797b', 'request_id': 'req-dd80f908-6268-43f0-8625-bf9a749d73e8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:11.091156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dd80f908-6268-43f0-8625-bf9a749d73e8 admin admin] The token cache is being invalidate because project f80e6453333343f1a393ebb38100797b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:08:11.091824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dd80f908-6268-43f0-8625-bf9a749d73e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:11.092932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dd80f908-6268-43f0-8625-bf9a749d73e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:11.096568 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2885/5797] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:08:10 2022] DELETE /identity/v3/projects/f80e6453333343f1a393ebb38100797b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:11.100389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c625e7-44d9-4619-b235-90aa70274ae8 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:11.113686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c625e7-44d9-4619-b235-90aa70274ae8 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:11.237548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aba5f6-e2b0-4710-89fa-42229d0ea5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:11.238488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aba5f6-e2b0-4710-89fa-42229d0ea5da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:11.239003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aba5f6-e2b0-4710-89fa-42229d0ea5da admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:11.239508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aba5f6-e2b0-4710-89fa-42229d0ea5da admin admin] PATH_INFO: `/v3/users/82fdba345a6844f49211aeae6cb2995e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:11.240993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aba5f6-e2b0-4710-89fa-42229d0ea5da admin admin] RBAC: Authorizing `identity:delete_user(user_id=82fdba345a6844f49211aeae6cb2995e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:11.245252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aba5f6-e2b0-4710-89fa-42229d0ea5da admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:11.374100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-62aba5f6-e2b0-4710-89fa-42229d0ea5da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82fdba345a6844f49211aeae6cb2995e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:11.374997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-62aba5f6-e2b0-4710-89fa-42229d0ea5da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82fdba345a6844f49211aeae6cb2995e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:11.407268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80f908-6268-43f0-8625-bf9a749d73e8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:11.409057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-62aba5f6-e2b0-4710-89fa-42229d0ea5da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82fdba345a6844f49211aeae6cb2995e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:11.412580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dd80f908-6268-43f0-8625-bf9a749d73e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:11.451654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-62aba5f6-e2b0-4710-89fa-42229d0ea5da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82fdba345a6844f49211aeae6cb2995e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:11.490102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-62aba5f6-e2b0-4710-89fa-42229d0ea5da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82fdba345a6844f49211aeae6cb2995e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:11.516300 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2913/5798] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:08:11 2022] DELETE /identity/v3/users/82fdba345a6844f49211aeae6cb2995e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:11.651971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80f908-6268-43f0-8625-bf9a749d73e8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:11.743591 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:11.772425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7e5f7-bcef-4c90-b587-c389cc3b6920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:11.773095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7e5f7-bcef-4c90-b587-c389cc3b6920 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:11.773389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7e5f7-bcef-4c90-b587-c389cc3b6920 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:11.773647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7e5f7-bcef-4c90-b587-c389cc3b6920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:11.777161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-27f7e5f7-bcef-4c90-b587-c389cc3b6920 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:11.794269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7e5f7-bcef-4c90-b587-c389cc3b6920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:11.796188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7e5f7-bcef-4c90-b587-c389cc3b6920 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:11.813990 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2886/5799] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:08:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:08:13.620037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aba5f6-e2b0-4710-89fa-42229d0ea5da admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:13.621660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-62aba5f6-e2b0-4710-89fa-42229d0ea5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:13.667562 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:13.718627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aba5f6-e2b0-4710-89fa-42229d0ea5da admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:13.726914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0483fc-f547-40d5-aa33-a72b07ea8ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:13.728679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0483fc-f547-40d5-aa33-a72b07ea8ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:13.729292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0483fc-f547-40d5-aa33-a72b07ea8ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:13.730110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0483fc-f547-40d5-aa33-a72b07ea8ac6 admin admin] PATH_INFO: `/v3/projects/eb1b77540c3c4dcb8c89ab1a38adebec` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:13.733054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0483fc-f547-40d5-aa33-a72b07ea8ac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1b77540c3c4dcb8c89ab1a38adebec)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:13.737275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0483fc-f547-40d5-aa33-a72b07ea8ac6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:13.832753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a0483fc-f547-40d5-aa33-a72b07ea8ac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1b77540c3c4dcb8c89ab1a38adebec', 'request_id': 'req-4a0483fc-f547-40d5-aa33-a72b07ea8ac6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:13.856333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a0483fc-f547-40d5-aa33-a72b07ea8ac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1b77540c3c4dcb8c89ab1a38adebec', 'request_id': 'req-4a0483fc-f547-40d5-aa33-a72b07ea8ac6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:13.868871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a0483fc-f547-40d5-aa33-a72b07ea8ac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1b77540c3c4dcb8c89ab1a38adebec', 'request_id': 'req-4a0483fc-f547-40d5-aa33-a72b07ea8ac6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:13.886502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a0483fc-f547-40d5-aa33-a72b07ea8ac6 admin admin] The token cache is being invalidate because project eb1b77540c3c4dcb8c89ab1a38adebec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:08:13.887197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a0483fc-f547-40d5-aa33-a72b07ea8ac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:13.887948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a0483fc-f547-40d5-aa33-a72b07ea8ac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:13.897215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2697143-5a0a-42dc-b58c-e47b364a8987 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:13.898520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2697143-5a0a-42dc-b58c-e47b364a8987 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:13.899441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2697143-5a0a-42dc-b58c-e47b364a8987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:13.904810 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2914/5800] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:08:13 2022] DELETE /identity/v3/projects/eb1b77540c3c4dcb8c89ab1a38adebec => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:13.925887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e2697143-5a0a-42dc-b58c-e47b364a8987 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:13.927896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e2697143-5a0a-42dc-b58c-e47b364a8987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:14.076821 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2887/5801] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:14.077164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895db048-a087-4d64-9c4e-7c116151256d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:14.077574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895db048-a087-4d64-9c4e-7c116151256d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:14.077881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895db048-a087-4d64-9c4e-7c116151256d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:14.130984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-895db048-a087-4d64-9c4e-7c116151256d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:14.132286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-895db048-a087-4d64-9c4e-7c116151256d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:14.160693 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2915/5802] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:14.165015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2697143-5a0a-42dc-b58c-e47b364a8987 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:14.195796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2697143-5a0a-42dc-b58c-e47b364a8987 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:14.219291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c527c-ca98-48f1-8143-13d6ee566cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:14.220768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c527c-ca98-48f1-8143-13d6ee566cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:14.221273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c527c-ca98-48f1-8143-13d6ee566cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:14.221757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c527c-ca98-48f1-8143-13d6ee566cd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:14.224782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c527c-ca98-48f1-8143-13d6ee566cd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:08:14.225203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c527c-ca98-48f1-8143-13d6ee566cd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:14.226862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c527c-ca98-48f1-8143-13d6ee566cd6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:14.281502 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2888/5803] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:08:14.287918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895db048-a087-4d64-9c4e-7c116151256d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:14.297034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895db048-a087-4d64-9c4e-7c116151256d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:14.302168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1916b-baef-4c87-b19b-07972ed47fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:14.302796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1916b-baef-4c87-b19b-07972ed47fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:14.303073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1916b-baef-4c87-b19b-07972ed47fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:14.303343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1916b-baef-4c87-b19b-07972ed47fb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:14.303978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1916b-baef-4c87-b19b-07972ed47fb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:14.305931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1916b-baef-4c87-b19b-07972ed47fb8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:14.346856 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2916/5804] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:08:14 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:14.347369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c527c-ca98-48f1-8143-13d6ee566cd6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:14.359338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c527c-ca98-48f1-8143-13d6ee566cd6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:14.464872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e6335-df88-4081-a1e2-28fc83317377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:14.465491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e6335-df88-4081-a1e2-28fc83317377 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:14.465911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e6335-df88-4081-a1e2-28fc83317377 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:14.466185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e6335-df88-4081-a1e2-28fc83317377 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:14.466911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e6335-df88-4081-a1e2-28fc83317377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:14.468999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e6335-df88-4081-a1e2-28fc83317377 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:14.505829 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2889/5805] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:08:14 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:14.507049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1916b-baef-4c87-b19b-07972ed47fb8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:14.519252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1916b-baef-4c87-b19b-07972ed47fb8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:14.527127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75026d06-c7dd-4614-b911-6d3d61f95c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:14.528067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75026d06-c7dd-4614-b911-6d3d61f95c70 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:14.528544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75026d06-c7dd-4614-b911-6d3d61f95c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:14.529134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75026d06-c7dd-4614-b911-6d3d61f95c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:14.530009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75026d06-c7dd-4614-b911-6d3d61f95c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:14.544508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75026d06-c7dd-4614-b911-6d3d61f95c70 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:14.578258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e6335-df88-4081-a1e2-28fc83317377 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:14.587321 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2917/5806] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:14.591631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e6335-df88-4081-a1e2-28fc83317377 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:14.599899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e3313-c4cc-4914-afee-b8b88c1f7775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:14.601291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e3313-c4cc-4914-afee-b8b88c1f7775 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:14.601837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e3313-c4cc-4914-afee-b8b88c1f7775 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:14.602269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e3313-c4cc-4914-afee-b8b88c1f7775 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:14.603328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e3313-c4cc-4914-afee-b8b88c1f7775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:14.605363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e3313-c4cc-4914-afee-b8b88c1f7775 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:14.624158 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2890/5807] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:14.628726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75026d06-c7dd-4614-b911-6d3d61f95c70 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:14.642338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75026d06-c7dd-4614-b911-6d3d61f95c70 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:14.654165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a536f-46bb-450f-bd62-0fe95c808b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:14.655363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a536f-46bb-450f-bd62-0fe95c808b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:14.655918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a536f-46bb-450f-bd62-0fe95c808b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:14.658999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a536f-46bb-450f-bd62-0fe95c808b0d admin admin] PATH_INFO: `/v3/projects/5fe4e57490394ee9a7dec5acb0c1155a/users/4ef2dbeb0e354f94bae720b6efef361f/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:14.687379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220a536f-46bb-450f-bd62-0fe95c808b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe4e57490394ee9a7dec5acb0c1155a, user_id=4ef2dbeb0e354f94bae720b6efef361f, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:14.691499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220a536f-46bb-450f-bd62-0fe95c808b0d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:14.728798 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2918/5808] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:08:14 2022] PUT /identity/v3/projects/5fe4e57490394ee9a7dec5acb0c1155a/users/4ef2dbeb0e354f94bae720b6efef361f/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:14.732646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89ac8c-34db-4136-8559-e698745960e4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:14.732934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89ac8c-34db-4136-8559-e698745960e4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:14.733204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89ac8c-34db-4136-8559-e698745960e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:14.788488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0c89ac8c-34db-4136-8559-e698745960e4 None None] MFA Rules not processed for user `4ef2dbeb0e354f94bae720b6efef361f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:14.792414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0c89ac8c-34db-4136-8559-e698745960e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:14.870184 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:14.917193 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2891/5809] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:08:14.932161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a536f-46bb-450f-bd62-0fe95c808b0d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:14.934349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-220a536f-46bb-450f-bd62-0fe95c808b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:15.093025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a536f-46bb-450f-bd62-0fe95c808b0d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:15.098714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f679dc-b529-4fd4-8c47-6be22d246877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:15.099821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f679dc-b529-4fd4-8c47-6be22d246877 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:15.100421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f679dc-b529-4fd4-8c47-6be22d246877 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:15.100952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f679dc-b529-4fd4-8c47-6be22d246877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:15.118406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f679dc-b529-4fd4-8c47-6be22d246877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:15.120541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f679dc-b529-4fd4-8c47-6be22d246877 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:15.132768 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2919/5810] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:08:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:08:15.167368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89ac8c-34db-4136-8559-e698745960e4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:15.357035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89ac8c-34db-4136-8559-e698745960e4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:15.375227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f2932-83a7-456a-b67a-e788081d66ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:15.376041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f2932-83a7-456a-b67a-e788081d66ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:15.376904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f2932-83a7-456a-b67a-e788081d66ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:15.377236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f2932-83a7-456a-b67a-e788081d66ac admin admin] PATH_INFO: `/v3/users/4ef2dbeb0e354f94bae720b6efef361f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:15.380258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f2932-83a7-456a-b67a-e788081d66ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ef2dbeb0e354f94bae720b6efef361f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:15.382365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f2932-83a7-456a-b67a-e788081d66ac admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:15.490332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4f1f2932-83a7-456a-b67a-e788081d66ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ef2dbeb0e354f94bae720b6efef361f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:15.510639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4f1f2932-83a7-456a-b67a-e788081d66ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ef2dbeb0e354f94bae720b6efef361f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:15.511340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4f1f2932-83a7-456a-b67a-e788081d66ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ef2dbeb0e354f94bae720b6efef361f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:15.540373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4f1f2932-83a7-456a-b67a-e788081d66ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ef2dbeb0e354f94bae720b6efef361f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:15.558720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4f1f2932-83a7-456a-b67a-e788081d66ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ef2dbeb0e354f94bae720b6efef361f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:15.576051 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2892/5811] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:08:15 2022] DELETE /identity/v3/users/4ef2dbeb0e354f94bae720b6efef361f => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:15.577811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409d12b-7508-47d7-89dd-20987dfca530 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:15.578104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409d12b-7508-47d7-89dd-20987dfca530 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:15.578378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409d12b-7508-47d7-89dd-20987dfca530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:15.589524 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:15.619498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8409d12b-7508-47d7-89dd-20987dfca530 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:15.620823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8409d12b-7508-47d7-89dd-20987dfca530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:15.773669 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2920/5812] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:15.848243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f2932-83a7-456a-b67a-e788081d66ac admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:15.849758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4f1f2932-83a7-456a-b67a-e788081d66ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:15.998255 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f2932-83a7-456a-b67a-e788081d66ac admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:16.005891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afbce6-d2f1-4c3e-a946-2788b4d816ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:16.006528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afbce6-d2f1-4c3e-a946-2788b4d816ca service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:16.006815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afbce6-d2f1-4c3e-a946-2788b4d816ca service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:16.007082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afbce6-d2f1-4c3e-a946-2788b4d816ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:16.033411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39afbce6-d2f1-4c3e-a946-2788b4d816ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:16.035095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39afbce6-d2f1-4c3e-a946-2788b4d816ca service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:16.066979 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2893/5813] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:08:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:08:17.966120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409d12b-7508-47d7-89dd-20987dfca530 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:17.968709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8409d12b-7508-47d7-89dd-20987dfca530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:17.990826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409d12b-7508-47d7-89dd-20987dfca530 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:18.006020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5c2bb-c21b-4113-b5fd-5b609305ded2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:18.006949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5c2bb-c21b-4113-b5fd-5b609305ded2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:18.007529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5c2bb-c21b-4113-b5fd-5b609305ded2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:18.008768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5c2bb-c21b-4113-b5fd-5b609305ded2 admin admin] PATH_INFO: `/v3/projects/5fe4e57490394ee9a7dec5acb0c1155a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:18.013702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5c2bb-c21b-4113-b5fd-5b609305ded2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe4e57490394ee9a7dec5acb0c1155a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:18.016313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5c2bb-c21b-4113-b5fd-5b609305ded2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:18.130250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-97b5c2bb-c21b-4113-b5fd-5b609305ded2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe4e57490394ee9a7dec5acb0c1155a', 'request_id': 'req-97b5c2bb-c21b-4113-b5fd-5b609305ded2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:18.176925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-97b5c2bb-c21b-4113-b5fd-5b609305ded2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe4e57490394ee9a7dec5acb0c1155a', 'request_id': 'req-97b5c2bb-c21b-4113-b5fd-5b609305ded2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:18.193766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-97b5c2bb-c21b-4113-b5fd-5b609305ded2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe4e57490394ee9a7dec5acb0c1155a', 'request_id': 'req-97b5c2bb-c21b-4113-b5fd-5b609305ded2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:18.218959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-97b5c2bb-c21b-4113-b5fd-5b609305ded2 admin admin] The token cache is being invalidate because project 5fe4e57490394ee9a7dec5acb0c1155a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:08:18.219176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-97b5c2bb-c21b-4113-b5fd-5b609305ded2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:18.226574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-97b5c2bb-c21b-4113-b5fd-5b609305ded2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:18.237323 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2921/5814] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:08:17 2022] DELETE /identity/v3/projects/5fe4e57490394ee9a7dec5acb0c1155a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:18.239666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff62e7a-ebc8-46a0-96cf-89301c7d6d78 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:18.240135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff62e7a-ebc8-46a0-96cf-89301c7d6d78 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:18.240631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff62e7a-ebc8-46a0-96cf-89301c7d6d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:18.356868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dff62e7a-ebc8-46a0-96cf-89301c7d6d78 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:18.358749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dff62e7a-ebc8-46a0-96cf-89301c7d6d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:18.378235 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:18.532627 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2894/5815] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:08:18.540714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a36ed-f27c-4eda-bd8b-4913bd939423 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:18.541268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a36ed-f27c-4eda-bd8b-4913bd939423 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:18.541786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a36ed-f27c-4eda-bd8b-4913bd939423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:18.608199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8f4a36ed-f27c-4eda-bd8b-4913bd939423 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:18.609866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8f4a36ed-f27c-4eda-bd8b-4913bd939423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:18.634224 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2922/5816] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:18.639014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff62e7a-ebc8-46a0-96cf-89301c7d6d78 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:18.668760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff62e7a-ebc8-46a0-96cf-89301c7d6d78 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:18.713281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab7d88-141e-4e82-b6b5-53006c1629d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:18.714197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab7d88-141e-4e82-b6b5-53006c1629d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:18.714612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab7d88-141e-4e82-b6b5-53006c1629d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:18.715017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab7d88-141e-4e82-b6b5-53006c1629d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:18.716024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab7d88-141e-4e82-b6b5-53006c1629d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:08:18.716466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab7d88-141e-4e82-b6b5-53006c1629d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:18.719112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab7d88-141e-4e82-b6b5-53006c1629d7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:18.786788 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2895/5817] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:08:18.791117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a36ed-f27c-4eda-bd8b-4913bd939423 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:18.803692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a36ed-f27c-4eda-bd8b-4913bd939423 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:18.823621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59eb20-25d4-4b5f-800e-59006d74c01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:18.824695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59eb20-25d4-4b5f-800e-59006d74c01e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:18.825220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59eb20-25d4-4b5f-800e-59006d74c01e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:18.825710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59eb20-25d4-4b5f-800e-59006d74c01e admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:18.826590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59eb20-25d4-4b5f-800e-59006d74c01e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:18.828780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59eb20-25d4-4b5f-800e-59006d74c01e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:18.908788 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2923/5818] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:08:18 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:18.909841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab7d88-141e-4e82-b6b5-53006c1629d7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:18.937814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab7d88-141e-4e82-b6b5-53006c1629d7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:19.136535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02903d6f-219f-49b2-8006-25ff13577895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:19.137623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02903d6f-219f-49b2-8006-25ff13577895 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:19.138076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02903d6f-219f-49b2-8006-25ff13577895 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:19.138489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02903d6f-219f-49b2-8006-25ff13577895 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:19.139540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02903d6f-219f-49b2-8006-25ff13577895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:19.142642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02903d6f-219f-49b2-8006-25ff13577895 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:19.211646 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2896/5819] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:08:18 2022] POST /identity/v3/users => generated 287 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:08:19.215245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59eb20-25d4-4b5f-800e-59006d74c01e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:19.241243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59eb20-25d4-4b5f-800e-59006d74c01e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:19.255361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a51fdc-60f7-49d3-b0f0-ec2294200df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:19.256402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a51fdc-60f7-49d3-b0f0-ec2294200df3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:19.256931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a51fdc-60f7-49d3-b0f0-ec2294200df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:19.257406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a51fdc-60f7-49d3-b0f0-ec2294200df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:19.258335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a51fdc-60f7-49d3-b0f0-ec2294200df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:19.260242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a51fdc-60f7-49d3-b0f0-ec2294200df3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:19.275645 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2924/5820] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:19.277665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02903d6f-219f-49b2-8006-25ff13577895 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:19.303927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02903d6f-219f-49b2-8006-25ff13577895 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:19.317632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5886f8-97fe-44b2-9d66-00e76cecd996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:19.318492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5886f8-97fe-44b2-9d66-00e76cecd996 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:19.318890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5886f8-97fe-44b2-9d66-00e76cecd996 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:19.321450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5886f8-97fe-44b2-9d66-00e76cecd996 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:19.322586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5886f8-97fe-44b2-9d66-00e76cecd996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:19.325070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5886f8-97fe-44b2-9d66-00e76cecd996 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:19.368542 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2897/5821] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:08:19.370395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a51fdc-60f7-49d3-b0f0-ec2294200df3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:19.393074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a51fdc-60f7-49d3-b0f0-ec2294200df3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:19.404166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b379ac4-6bc5-4542-a856-02febe6d8023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:19.405309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b379ac4-6bc5-4542-a856-02febe6d8023 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:19.405847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b379ac4-6bc5-4542-a856-02febe6d8023 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:19.406351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b379ac4-6bc5-4542-a856-02febe6d8023 admin admin] PATH_INFO: `/v3/projects/53faa8f1f2814d2ea13610d54b6b6c50/users/fdf4dc6526d94c758f71594281b02f0c/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:19.456418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b379ac4-6bc5-4542-a856-02febe6d8023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53faa8f1f2814d2ea13610d54b6b6c50, user_id=fdf4dc6526d94c758f71594281b02f0c, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:19.460670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b379ac4-6bc5-4542-a856-02febe6d8023 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:19.498786 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2925/5822] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:08:19 2022] PUT /identity/v3/projects/53faa8f1f2814d2ea13610d54b6b6c50/users/fdf4dc6526d94c758f71594281b02f0c/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:19.500539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8b99b-7ce6-439f-b92a-e48597ff43fc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:19.501383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8b99b-7ce6-439f-b92a-e48597ff43fc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:19.501657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8b99b-7ce6-439f-b92a-e48597ff43fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:19.557021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bad8b99b-7ce6-439f-b92a-e48597ff43fc None None] MFA Rules not processed for user `fdf4dc6526d94c758f71594281b02f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:19.558404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bad8b99b-7ce6-439f-b92a-e48597ff43fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:19.729875 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2898/5823] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:08:19.739820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b379ac4-6bc5-4542-a856-02febe6d8023 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:19.742058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8b379ac4-6bc5-4542-a856-02febe6d8023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:19.810475 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:19.913123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b379ac4-6bc5-4542-a856-02febe6d8023 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:19.923550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57862900-f17f-461e-b0a2-3b78dd73d1b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:19.924551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57862900-f17f-461e-b0a2-3b78dd73d1b8 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:19.927140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57862900-f17f-461e-b0a2-3b78dd73d1b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:19.927596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57862900-f17f-461e-b0a2-3b78dd73d1b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:19.950355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57862900-f17f-461e-b0a2-3b78dd73d1b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:19.952009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57862900-f17f-461e-b0a2-3b78dd73d1b8 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:19.977530 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2926/5824] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:08:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:08:25.421613 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a4c8c-778b-4f5e-aa33-4fa344b6d665 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:25.422128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a4c8c-778b-4f5e-aa33-4fa344b6d665 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:25.423809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a4c8c-778b-4f5e-aa33-4fa344b6d665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:25.441959 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:25.474598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-094a4c8c-778b-4f5e-aa33-4fa344b6d665 None None] MFA Rules not processed for user `f0e8405dde7241c8b6e1fe97702564fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:25.475840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-094a4c8c-778b-4f5e-aa33-4fa344b6d665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:25.600754 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2899/5825] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:26.949561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57862900-f17f-461e-b0a2-3b78dd73d1b8 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:26.951568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-57862900-f17f-461e-b0a2-3b78dd73d1b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:27.102443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57862900-f17f-461e-b0a2-3b78dd73d1b8 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:27.114286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f837121-04d6-492d-bf26-361d5cd03837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:27.116140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f837121-04d6-492d-bf26-361d5cd03837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:27.116676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f837121-04d6-492d-bf26-361d5cd03837 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:27.117412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f837121-04d6-492d-bf26-361d5cd03837 admin admin] PATH_INFO: `/v3/users/2ad42e28e3444cd3b25054439f53e9c8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:27.121013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f837121-04d6-492d-bf26-361d5cd03837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad42e28e3444cd3b25054439f53e9c8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:27.123910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f837121-04d6-492d-bf26-361d5cd03837 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:27.258755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f837121-04d6-492d-bf26-361d5cd03837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad42e28e3444cd3b25054439f53e9c8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:27.259470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f837121-04d6-492d-bf26-361d5cd03837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad42e28e3444cd3b25054439f53e9c8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:27.287737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f837121-04d6-492d-bf26-361d5cd03837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad42e28e3444cd3b25054439f53e9c8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:27.341002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f837121-04d6-492d-bf26-361d5cd03837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad42e28e3444cd3b25054439f53e9c8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:27.365159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f837121-04d6-492d-bf26-361d5cd03837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad42e28e3444cd3b25054439f53e9c8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:27.383802 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2927/5826] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:08:26 2022] DELETE /identity/v3/users/2ad42e28e3444cd3b25054439f53e9c8 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:27.539807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a4c8c-778b-4f5e-aa33-4fa344b6d665 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:27.557776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a4c8c-778b-4f5e-aa33-4fa344b6d665 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:27.726805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ece31-3be2-42f3-a4d0-6fb0b0bbaa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:27.727788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ece31-3be2-42f3-a4d0-6fb0b0bbaa82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:27.728258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ece31-3be2-42f3-a4d0-6fb0b0bbaa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:27.728750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ece31-3be2-42f3-a4d0-6fb0b0bbaa82 admin admin] PATH_INFO: `/v3/users/fdf4dc6526d94c758f71594281b02f0c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:27.730959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ece31-3be2-42f3-a4d0-6fb0b0bbaa82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdf4dc6526d94c758f71594281b02f0c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:27.738765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ece31-3be2-42f3-a4d0-6fb0b0bbaa82 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:27.884266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-169ece31-3be2-42f3-a4d0-6fb0b0bbaa82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdf4dc6526d94c758f71594281b02f0c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:27.921829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-169ece31-3be2-42f3-a4d0-6fb0b0bbaa82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdf4dc6526d94c758f71594281b02f0c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:27.923261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-169ece31-3be2-42f3-a4d0-6fb0b0bbaa82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdf4dc6526d94c758f71594281b02f0c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:27.944361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-169ece31-3be2-42f3-a4d0-6fb0b0bbaa82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdf4dc6526d94c758f71594281b02f0c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:27.975820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-169ece31-3be2-42f3-a4d0-6fb0b0bbaa82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdf4dc6526d94c758f71594281b02f0c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:27.988710 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2900/5827] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:08:27 2022] DELETE /identity/v3/users/fdf4dc6526d94c758f71594281b02f0c => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:27.993160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cfbcc-b35a-4374-a917-adf4a5bfb66a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:27.993658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cfbcc-b35a-4374-a917-adf4a5bfb66a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:27.993773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cfbcc-b35a-4374-a917-adf4a5bfb66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:28.026697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-872cfbcc-b35a-4374-a917-adf4a5bfb66a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:28.028235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-872cfbcc-b35a-4374-a917-adf4a5bfb66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:28.121109 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:28.154625 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2928/5828] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:08:28.170949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ece31-3be2-42f3-a4d0-6fb0b0bbaa82 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:28.172558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-169ece31-3be2-42f3-a4d0-6fb0b0bbaa82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:28.186154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872cfbcc-b35a-4374-a917-adf4a5bfb66a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:28.187589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-872cfbcc-b35a-4374-a917-adf4a5bfb66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:28.211291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872cfbcc-b35a-4374-a917-adf4a5bfb66a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:28.225176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797a3b0-5a57-4619-b92a-b71f268de9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:28.225825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797a3b0-5a57-4619-b92a-b71f268de9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:28.226103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797a3b0-5a57-4619-b92a-b71f268de9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:28.226373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797a3b0-5a57-4619-b92a-b71f268de9b0 admin admin] PATH_INFO: `/v3/projects/38479192783c4718a6b41b4d13d191e0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:28.227527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797a3b0-5a57-4619-b92a-b71f268de9b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38479192783c4718a6b41b4d13d191e0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:28.229463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797a3b0-5a57-4619-b92a-b71f268de9b0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:28.267802 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:28.322848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ece31-3be2-42f3-a4d0-6fb0b0bbaa82 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:28.330109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc1a20-307e-4250-9d9b-d27556819021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:28.330736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc1a20-307e-4250-9d9b-d27556819021 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:28.331008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc1a20-307e-4250-9d9b-d27556819021 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:28.331275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc1a20-307e-4250-9d9b-d27556819021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:28.358955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc1a20-307e-4250-9d9b-d27556819021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:28.362479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0797a3b0-5a57-4619-b92a-b71f268de9b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38479192783c4718a6b41b4d13d191e0', 'request_id': 'req-0797a3b0-5a57-4619-b92a-b71f268de9b0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:28.367418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc1a20-307e-4250-9d9b-d27556819021 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:28.378383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0797a3b0-5a57-4619-b92a-b71f268de9b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38479192783c4718a6b41b4d13d191e0', 'request_id': 'req-0797a3b0-5a57-4619-b92a-b71f268de9b0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:28.385482 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2901/5829] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:08:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:08:28.392443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0797a3b0-5a57-4619-b92a-b71f268de9b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38479192783c4718a6b41b4d13d191e0', 'request_id': 'req-0797a3b0-5a57-4619-b92a-b71f268de9b0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:28.412574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0797a3b0-5a57-4619-b92a-b71f268de9b0 admin admin] The token cache is being invalidate because project 38479192783c4718a6b41b4d13d191e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:08:28.413401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0797a3b0-5a57-4619-b92a-b71f268de9b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:28.414309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0797a3b0-5a57-4619-b92a-b71f268de9b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:28.417245 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2929/5830] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:08:28 2022] DELETE /identity/v3/projects/38479192783c4718a6b41b4d13d191e0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:08:28.423451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d03db5-0760-48ad-aac8-32c209195b76 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:28.423855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d03db5-0760-48ad-aac8-32c209195b76 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:28.424224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d03db5-0760-48ad-aac8-32c209195b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:28.452811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-73d03db5-0760-48ad-aac8-32c209195b76 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:28.454964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-73d03db5-0760-48ad-aac8-32c209195b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:28.493331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797a3b0-5a57-4619-b92a-b71f268de9b0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:28.495013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0797a3b0-5a57-4619-b92a-b71f268de9b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:28.566794 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2902/5831] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:28.569177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0926a57-9f84-47a1-b7e4-34f1427933ca None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:28.569712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0926a57-9f84-47a1-b7e4-34f1427933ca None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:28.570153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0926a57-9f84-47a1-b7e4-34f1427933ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:28.597893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b0926a57-9f84-47a1-b7e4-34f1427933ca None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:28.600325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b0926a57-9f84-47a1-b7e4-34f1427933ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:28.610937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797a3b0-5a57-4619-b92a-b71f268de9b0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:28.613374 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2903/5832] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:28.617938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0926a57-9f84-47a1-b7e4-34f1427933ca None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:28.619917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b673caa-99e1-4de1-9c03-846bb78aa5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:28.620813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b673caa-99e1-4de1-9c03-846bb78aa5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:28.621184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b673caa-99e1-4de1-9c03-846bb78aa5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:28.621548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b673caa-99e1-4de1-9c03-846bb78aa5c4 admin admin] PATH_INFO: `/v3/users/c6d4a470f66940aea4d187750be3831d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:28.622784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b673caa-99e1-4de1-9c03-846bb78aa5c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6d4a470f66940aea4d187750be3831d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:28.631232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b673caa-99e1-4de1-9c03-846bb78aa5c4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:28.631783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0926a57-9f84-47a1-b7e4-34f1427933ca None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:28.638867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46529b5a-b628-4526-9aa7-4059528565b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:28.640052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46529b5a-b628-4526-9aa7-4059528565b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:28.640497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46529b5a-b628-4526-9aa7-4059528565b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:28.640998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46529b5a-b628-4526-9aa7-4059528565b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:28.641872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46529b5a-b628-4526-9aa7-4059528565b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:08:28.642345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46529b5a-b628-4526-9aa7-4059528565b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:28.644206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46529b5a-b628-4526-9aa7-4059528565b9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:28.665073 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2904/5833] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:08:28.669758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46529b5a-b628-4526-9aa7-4059528565b9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:28.710893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46529b5a-b628-4526-9aa7-4059528565b9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:28.727760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf607c-5dbc-4acf-a32f-7a4ca3c5e34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:28.728392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf607c-5dbc-4acf-a32f-7a4ca3c5e34d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:28.728700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf607c-5dbc-4acf-a32f-7a4ca3c5e34d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:28.728983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf607c-5dbc-4acf-a32f-7a4ca3c5e34d admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:28.729629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf607c-5dbc-4acf-a32f-7a4ca3c5e34d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:28.736093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf607c-5dbc-4acf-a32f-7a4ca3c5e34d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:28.738649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2b673caa-99e1-4de1-9c03-846bb78aa5c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6d4a470f66940aea4d187750be3831d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:28.741235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2b673caa-99e1-4de1-9c03-846bb78aa5c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6d4a470f66940aea4d187750be3831d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:28.765286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2b673caa-99e1-4de1-9c03-846bb78aa5c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6d4a470f66940aea4d187750be3831d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:28.786906 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:28.789113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2b673caa-99e1-4de1-9c03-846bb78aa5c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6d4a470f66940aea4d187750be3831d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:28.808387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2b673caa-99e1-4de1-9c03-846bb78aa5c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6d4a470f66940aea4d187750be3831d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:28.830458 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2905/5834] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:08:28 2022] POST /identity/v3/projects => generated 363 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:08:28.830705 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2930/5835] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:08:28 2022] DELETE /identity/v3/users/c6d4a470f66940aea4d187750be3831d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:08:28.831310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e387f-3f02-4152-b325-43fb2e0bb5b2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:28.831924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e387f-3f02-4152-b325-43fb2e0bb5b2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:28.832336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e387f-3f02-4152-b325-43fb2e0bb5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:28.833127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf607c-5dbc-4acf-a32f-7a4ca3c5e34d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:28.835057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1bdf607c-5dbc-4acf-a32f-7a4ca3c5e34d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:28.886054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c81e387f-3f02-4152-b325-43fb2e0bb5b2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:28.890353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c81e387f-3f02-4152-b325-43fb2e0bb5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:28.963257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf607c-5dbc-4acf-a32f-7a4ca3c5e34d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:29.046703 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2931/5836] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:29.085561 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:29.103247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e387f-3f02-4152-b325-43fb2e0bb5b2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:29.104961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c81e387f-3f02-4152-b325-43fb2e0bb5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:29.222063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e387f-3f02-4152-b325-43fb2e0bb5b2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:29.226794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e8063-1da2-4ce9-97ce-9016d2bd48ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:29.228887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e8063-1da2-4ce9-97ce-9016d2bd48ce service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:29.229533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e8063-1da2-4ce9-97ce-9016d2bd48ce service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:29.230027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e8063-1da2-4ce9-97ce-9016d2bd48ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:29.245818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a14b5-0eec-4ada-bc31-be92fc825d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:29.246574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a14b5-0eec-4ada-bc31-be92fc825d56 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:29.246864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a14b5-0eec-4ada-bc31-be92fc825d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:29.247141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a14b5-0eec-4ada-bc31-be92fc825d56 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:29.247786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a14b5-0eec-4ada-bc31-be92fc825d56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:29.250059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a14b5-0eec-4ada-bc31-be92fc825d56 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:29.260288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e8063-1da2-4ce9-97ce-9016d2bd48ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:29.266862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e8063-1da2-4ce9-97ce-9016d2bd48ce service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:29.294426 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2932/5837] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:08:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:08:29.299719 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2906/5838] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:08:28 2022] POST /identity/v3/users => generated 282 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:29.301175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e8063-1da2-4ce9-97ce-9016d2bd48ce service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:29.301732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a14b5-0eec-4ada-bc31-be92fc825d56 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:29.304921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b43e8063-1da2-4ce9-97ce-9016d2bd48ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:29.323985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a14b5-0eec-4ada-bc31-be92fc825d56 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:29.341749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709d279-d8ba-4fc1-8c61-ee039a09a53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:29.342395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709d279-d8ba-4fc1-8c61-ee039a09a53f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:29.342951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709d279-d8ba-4fc1-8c61-ee039a09a53f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:29.343466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709d279-d8ba-4fc1-8c61-ee039a09a53f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:29.344160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709d279-d8ba-4fc1-8c61-ee039a09a53f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:29.346570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709d279-d8ba-4fc1-8c61-ee039a09a53f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:29.370658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e8063-1da2-4ce9-97ce-9016d2bd48ce service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:29.383145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1b657-aa57-4125-b44e-f9f4ae81ad4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:29.384335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1b657-aa57-4125-b44e-f9f4ae81ad4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:29.384739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1b657-aa57-4125-b44e-f9f4ae81ad4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:29.385194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1b657-aa57-4125-b44e-f9f4ae81ad4c admin admin] PATH_INFO: `/v3/projects/53faa8f1f2814d2ea13610d54b6b6c50` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:29.397751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1b657-aa57-4125-b44e-f9f4ae81ad4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=53faa8f1f2814d2ea13610d54b6b6c50)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:29.404476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1b657-aa57-4125-b44e-f9f4ae81ad4c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:29.410371 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2907/5839] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:29.415717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709d279-d8ba-4fc1-8c61-ee039a09a53f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:29.444120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709d279-d8ba-4fc1-8c61-ee039a09a53f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:29.471230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4cae8-3d2d-4052-955a-48d9bd6751ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:29.471870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4cae8-3d2d-4052-955a-48d9bd6751ab admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:29.472992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4cae8-3d2d-4052-955a-48d9bd6751ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:29.473216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4cae8-3d2d-4052-955a-48d9bd6751ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:29.473880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4cae8-3d2d-4052-955a-48d9bd6751ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:29.475484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4cae8-3d2d-4052-955a-48d9bd6751ab admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:29.509739 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2908/5840] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:29.511632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4cae8-3d2d-4052-955a-48d9bd6751ab admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:29.538703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4cae8-3d2d-4052-955a-48d9bd6751ab admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:29.541367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1b1b657-aa57-4125-b44e-f9f4ae81ad4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53faa8f1f2814d2ea13610d54b6b6c50', 'request_id': 'req-b1b1b657-aa57-4125-b44e-f9f4ae81ad4c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:29.570353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1b1b657-aa57-4125-b44e-f9f4ae81ad4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53faa8f1f2814d2ea13610d54b6b6c50', 'request_id': 'req-b1b1b657-aa57-4125-b44e-f9f4ae81ad4c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:29.587692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1b1b657-aa57-4125-b44e-f9f4ae81ad4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53faa8f1f2814d2ea13610d54b6b6c50', 'request_id': 'req-b1b1b657-aa57-4125-b44e-f9f4ae81ad4c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:29.616678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1b1b657-aa57-4125-b44e-f9f4ae81ad4c admin admin] The token cache is being invalidate because project 53faa8f1f2814d2ea13610d54b6b6c50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:08:29.616958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1b1b657-aa57-4125-b44e-f9f4ae81ad4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:29.617753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1b1b657-aa57-4125-b44e-f9f4ae81ad4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:29.620682 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2933/5841] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:08:29 2022] DELETE /identity/v3/projects/53faa8f1f2814d2ea13610d54b6b6c50 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:29.626701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b893b-fec5-43e9-9e67-f3e92ae767e4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:29.627407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b893b-fec5-43e9-9e67-f3e92ae767e4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:29.627880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b893b-fec5-43e9-9e67-f3e92ae767e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:29.666273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3e5b893b-fec5-43e9-9e67-f3e92ae767e4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:29.667921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3e5b893b-fec5-43e9-9e67-f3e92ae767e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:29.682152 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:29.744061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd569ccb-c409-46a2-aba6-1a0a60de28db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:29.745626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd569ccb-c409-46a2-aba6-1a0a60de28db admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:29.746112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd569ccb-c409-46a2-aba6-1a0a60de28db admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:29.746623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd569ccb-c409-46a2-aba6-1a0a60de28db admin admin] PATH_INFO: `/v3/projects/55c2a3f896f54ddbbb4915c3279b7427/users/91c365436fc44169b63aeea41fda13d7/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:29.783887 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2934/5842] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:29.811561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd569ccb-c409-46a2-aba6-1a0a60de28db admin admin] RBAC: Authorizing `identity:create_grant(project_id=55c2a3f896f54ddbbb4915c3279b7427, user_id=91c365436fc44169b63aeea41fda13d7, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:29.831358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd569ccb-c409-46a2-aba6-1a0a60de28db admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:29.905819 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2909/5843] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:08:29 2022] PUT /identity/v3/projects/55c2a3f896f54ddbbb4915c3279b7427/users/91c365436fc44169b63aeea41fda13d7/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:29.910663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223ee0f-43da-4a9a-a190-9a031c136a9c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:29.920078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9025b-fb7e-47fa-ae99-b06cd53007d6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:29.920364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9025b-fb7e-47fa-ae99-b06cd53007d6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:29.920871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9025b-fb7e-47fa-ae99-b06cd53007d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:29.930013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223ee0f-43da-4a9a-a190-9a031c136a9c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:29.930184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223ee0f-43da-4a9a-a190-9a031c136a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:29.985800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7ab9025b-fb7e-47fa-ae99-b06cd53007d6 None None] MFA Rules not processed for user `91c365436fc44169b63aeea41fda13d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:29.986156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0223ee0f-43da-4a9a-a190-9a031c136a9c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:29.987099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7ab9025b-fb7e-47fa-ae99-b06cd53007d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:29.987438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0223ee0f-43da-4a9a-a190-9a031c136a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:30.136248 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2935/5844] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:30.138997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223ee0f-43da-4a9a-a190-9a031c136a9c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:30.155689 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2910/5845] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:30.163627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223ee0f-43da-4a9a-a190-9a031c136a9c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:30.164165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9025b-fb7e-47fa-ae99-b06cd53007d6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:30.165624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7ab9025b-fb7e-47fa-ae99-b06cd53007d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:30.178754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5075ba-d902-45cf-ba64-2d3a8b0b32cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:30.179621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5075ba-d902-45cf-ba64-2d3a8b0b32cc admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:30.180101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5075ba-d902-45cf-ba64-2d3a8b0b32cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:30.180554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5075ba-d902-45cf-ba64-2d3a8b0b32cc admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:30.181413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5075ba-d902-45cf-ba64-2d3a8b0b32cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:08:30.183126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5075ba-d902-45cf-ba64-2d3a8b0b32cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:30.185018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5075ba-d902-45cf-ba64-2d3a8b0b32cc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:30.202669 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2936/5846] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:08:30.209601 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:30.215142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5075ba-d902-45cf-ba64-2d3a8b0b32cc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:30.239321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5075ba-d902-45cf-ba64-2d3a8b0b32cc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:30.249058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9336b-910d-4352-8616-0c189b7418dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:30.250138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9336b-910d-4352-8616-0c189b7418dc admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:30.250634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9336b-910d-4352-8616-0c189b7418dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:30.257051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9336b-910d-4352-8616-0c189b7418dc admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:30.258036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9336b-910d-4352-8616-0c189b7418dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:30.260362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9336b-910d-4352-8616-0c189b7418dc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:30.346850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9025b-fb7e-47fa-ae99-b06cd53007d6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:30.369254 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2937/5847] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:08:30 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:30.369254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9336b-910d-4352-8616-0c189b7418dc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:30.373387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c3c9336b-910d-4352-8616-0c189b7418dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:30.560093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f729166-f0af-4be0-86fc-3c95dbab5888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:30.560849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f729166-f0af-4be0-86fc-3c95dbab5888 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:30.561109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f729166-f0af-4be0-86fc-3c95dbab5888 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:30.561380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f729166-f0af-4be0-86fc-3c95dbab5888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:30.564527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9336b-910d-4352-8616-0c189b7418dc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:30.578982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9113a1c-4f7e-4565-9a65-ce9194a67536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:30.579647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9113a1c-4f7e-4565-9a65-ce9194a67536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:30.579924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9113a1c-4f7e-4565-9a65-ce9194a67536 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:30.580199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9113a1c-4f7e-4565-9a65-ce9194a67536 admin admin] PATH_INFO: `/v3/projects/5a747b299e3c4fee852da42f1bad58b9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:30.582803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9113a1c-4f7e-4565-9a65-ce9194a67536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a747b299e3c4fee852da42f1bad58b9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:30.585433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9113a1c-4f7e-4565-9a65-ce9194a67536 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:30.642317 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:30.687701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f729166-f0af-4be0-86fc-3c95dbab5888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:30.691838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f729166-f0af-4be0-86fc-3c95dbab5888 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:30.693543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f9113a1c-4f7e-4565-9a65-ce9194a67536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a747b299e3c4fee852da42f1bad58b9', 'request_id': 'req-f9113a1c-4f7e-4565-9a65-ce9194a67536'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:30.708547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f9113a1c-4f7e-4565-9a65-ce9194a67536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a747b299e3c4fee852da42f1bad58b9', 'request_id': 'req-f9113a1c-4f7e-4565-9a65-ce9194a67536'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:30.736512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f9113a1c-4f7e-4565-9a65-ce9194a67536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a747b299e3c4fee852da42f1bad58b9', 'request_id': 'req-f9113a1c-4f7e-4565-9a65-ce9194a67536'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:30.740400 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2911/5848] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:08:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:08:30.741384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f729166-f0af-4be0-86fc-3c95dbab5888 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:30.775185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f9113a1c-4f7e-4565-9a65-ce9194a67536 admin admin] The token cache is being invalidate because project 5a747b299e3c4fee852da42f1bad58b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:08:30.777933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f9113a1c-4f7e-4565-9a65-ce9194a67536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:30.780036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f9113a1c-4f7e-4565-9a65-ce9194a67536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:30.781133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f729166-f0af-4be0-86fc-3c95dbab5888 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:30.786394 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2938/5849] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:08:30 2022] DELETE /identity/v3/projects/5a747b299e3c4fee852da42f1bad58b9 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:30.791464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ddc35-529d-4dcc-b17c-293b1e0b6757 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:30.794931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ddc35-529d-4dcc-b17c-293b1e0b6757 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:30.795293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ddc35-529d-4dcc-b17c-293b1e0b6757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:30.882049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-994ddc35-529d-4dcc-b17c-293b1e0b6757 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:30.883700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-994ddc35-529d-4dcc-b17c-293b1e0b6757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:30.959260 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:31.004335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb05999-2d8f-413a-9186-606bde13716b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:31.005216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb05999-2d8f-413a-9186-606bde13716b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:31.005620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb05999-2d8f-413a-9186-606bde13716b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:31.005998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb05999-2d8f-413a-9186-606bde13716b admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:31.007043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb05999-2d8f-413a-9186-606bde13716b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:31.009438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb05999-2d8f-413a-9186-606bde13716b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:31.029835 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2939/5850] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:31.031443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ddc35-529d-4dcc-b17c-293b1e0b6757 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:31.034951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-994ddc35-529d-4dcc-b17c-293b1e0b6757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:31.045958 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2912/5851] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:08:30 2022] POST /identity/v3/users => generated 291 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:31.049171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee64cf3-6ad8-4c2d-a3b4-d9e5d13ca0e8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:31.049715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee64cf3-6ad8-4c2d-a3b4-d9e5d13ca0e8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:31.050234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee64cf3-6ad8-4c2d-a3b4-d9e5d13ca0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:31.066823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ddc35-529d-4dcc-b17c-293b1e0b6757 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:31.082077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b928745-478e-48ff-8603-c4b5f56f4ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:31.082959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b928745-478e-48ff-8603-c4b5f56f4ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:31.083240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b928745-478e-48ff-8603-c4b5f56f4ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:31.087856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-eee64cf3-6ad8-4c2d-a3b4-d9e5d13ca0e8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:31.090341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b928745-478e-48ff-8603-c4b5f56f4ba6 admin admin] PATH_INFO: `/v3/users/91c365436fc44169b63aeea41fda13d7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:31.093450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eee64cf3-6ad8-4c2d-a3b4-d9e5d13ca0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:31.094814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b928745-478e-48ff-8603-c4b5f56f4ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c365436fc44169b63aeea41fda13d7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:31.102525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b928745-478e-48ff-8603-c4b5f56f4ba6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:31.135805 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2913/5852] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:31.136515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee64cf3-6ad8-4c2d-a3b4-d9e5d13ca0e8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:31.140105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eee64cf3-6ad8-4c2d-a3b4-d9e5d13ca0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:31.158213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee64cf3-6ad8-4c2d-a3b4-d9e5d13ca0e8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:31.171611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72cc93-cdde-42c8-8b0c-e26dfa845fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:31.172315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72cc93-cdde-42c8-8b0c-e26dfa845fab admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:31.172680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72cc93-cdde-42c8-8b0c-e26dfa845fab admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:31.172902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72cc93-cdde-42c8-8b0c-e26dfa845fab admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:31.173711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72cc93-cdde-42c8-8b0c-e26dfa845fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:31.175371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72cc93-cdde-42c8-8b0c-e26dfa845fab admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:31.194445 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2914/5853] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:31.195191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72cc93-cdde-42c8-8b0c-e26dfa845fab admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:31.198317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b928745-478e-48ff-8603-c4b5f56f4ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c365436fc44169b63aeea41fda13d7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:31.199020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b928745-478e-48ff-8603-c4b5f56f4ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c365436fc44169b63aeea41fda13d7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:31.223951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b928745-478e-48ff-8603-c4b5f56f4ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c365436fc44169b63aeea41fda13d7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:31.233427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72cc93-cdde-42c8-8b0c-e26dfa845fab admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:31.245111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b928745-478e-48ff-8603-c4b5f56f4ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c365436fc44169b63aeea41fda13d7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:31.259955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebd607-df68-4625-a956-3fe792f6d775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:31.260522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebd607-df68-4625-a956-3fe792f6d775 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:31.260866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebd607-df68-4625-a956-3fe792f6d775 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:31.261097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebd607-df68-4625-a956-3fe792f6d775 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:31.261763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebd607-df68-4625-a956-3fe792f6d775 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:08:31.262068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebd607-df68-4625-a956-3fe792f6d775 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:31.263675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebd607-df68-4625-a956-3fe792f6d775 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:31.265183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b928745-478e-48ff-8603-c4b5f56f4ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c365436fc44169b63aeea41fda13d7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:31.278178 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2940/5854] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:08:31 2022] DELETE /identity/v3/users/91c365436fc44169b63aeea41fda13d7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:31.278178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b928745-478e-48ff-8603-c4b5f56f4ba6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:31.281644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6b928745-478e-48ff-8603-c4b5f56f4ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:31.309020 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2915/5855] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:08:31.317129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e014ec8-692e-4e12-b95a-092696738158 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:31.320763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e014ec8-692e-4e12-b95a-092696738158 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:31.320763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e014ec8-692e-4e12-b95a-092696738158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:31.340112 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:31.366210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5e014ec8-692e-4e12-b95a-092696738158 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:31.382180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5e014ec8-692e-4e12-b95a-092696738158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:31.456969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b928745-478e-48ff-8603-c4b5f56f4ba6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:31.469850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104a047-3f5b-4d99-88fa-89b3b0838f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:31.470475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104a047-3f5b-4d99-88fa-89b3b0838f2d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:31.470756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104a047-3f5b-4d99-88fa-89b3b0838f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:31.471028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104a047-3f5b-4d99-88fa-89b3b0838f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:31.471684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104a047-3f5b-4d99-88fa-89b3b0838f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:31.473339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104a047-3f5b-4d99-88fa-89b3b0838f2d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:31.506398 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2941/5856] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:31.506398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104a047-3f5b-4d99-88fa-89b3b0838f2d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:31.514493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e104a047-3f5b-4d99-88fa-89b3b0838f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:31.547299 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2916/5857] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:31.547904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e014ec8-692e-4e12-b95a-092696738158 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:31.554690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104a047-3f5b-4d99-88fa-89b3b0838f2d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:31.575258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e014ec8-692e-4e12-b95a-092696738158 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:31.580217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318e8dd-b500-4a27-b436-1040d4471f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:31.580880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318e8dd-b500-4a27-b436-1040d4471f7f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:31.581185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318e8dd-b500-4a27-b436-1040d4471f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:31.581441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318e8dd-b500-4a27-b436-1040d4471f7f admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:31.582338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5318e8dd-b500-4a27-b436-1040d4471f7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:31.584428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5318e8dd-b500-4a27-b436-1040d4471f7f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:31.611039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2f9ed-ebfa-46f0-a76c-f876fc2adda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:31.611739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2f9ed-ebfa-46f0-a76c-f876fc2adda8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:31.612021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2f9ed-ebfa-46f0-a76c-f876fc2adda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:31.612299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2f9ed-ebfa-46f0-a76c-f876fc2adda8 admin admin] PATH_INFO: `/v3/projects/4194ee9a9a9c4dfc9b26ae18af2426cd/users/40cea8ffee0e48aba3f0ce206768d1ef/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:31.661237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2f9ed-ebfa-46f0-a76c-f876fc2adda8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4194ee9a9a9c4dfc9b26ae18af2426cd, user_id=40cea8ffee0e48aba3f0ce206768d1ef, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:31.674173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2f9ed-ebfa-46f0-a76c-f876fc2adda8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:31.686354 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2942/5858] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:08:31 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:31.689866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318e8dd-b500-4a27-b436-1040d4471f7f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:31.721271 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2917/5859] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:08:31 2022] PUT /identity/v3/projects/4194ee9a9a9c4dfc9b26ae18af2426cd/users/40cea8ffee0e48aba3f0ce206768d1ef/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:31.733728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a9e9d-92e9-4d47-8051-b2c502d28b7c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:31.736444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a9e9d-92e9-4d47-8051-b2c502d28b7c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:31.737166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a9e9d-92e9-4d47-8051-b2c502d28b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:31.794171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-628a9e9d-92e9-4d47-8051-b2c502d28b7c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:31.795314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-628a9e9d-92e9-4d47-8051-b2c502d28b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:31.918602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318e8dd-b500-4a27-b436-1040d4471f7f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:32.001132 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2918/5860] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:32.002851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a9e9d-92e9-4d47-8051-b2c502d28b7c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:32.015357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-628a9e9d-92e9-4d47-8051-b2c502d28b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:32.070671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14f4f4-f36e-4cd0-ab78-41e421620b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:32.071467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14f4f4-f36e-4cd0-ab78-41e421620b48 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:32.071851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14f4f4-f36e-4cd0-ab78-41e421620b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:32.074145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14f4f4-f36e-4cd0-ab78-41e421620b48 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:32.076286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14f4f4-f36e-4cd0-ab78-41e421620b48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:32.083743 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:32.090853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14f4f4-f36e-4cd0-ab78-41e421620b48 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:32.155478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a9e9d-92e9-4d47-8051-b2c502d28b7c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:32.157029 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2943/5861] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:08:31 2022] POST /identity/v3/users => generated 287 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:32.158086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14f4f4-f36e-4cd0-ab78-41e421620b48 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:32.160548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5f14f4f4-f36e-4cd0-ab78-41e421620b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:32.165579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5b855-de05-4eab-94d6-afd22b9c3087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:32.166214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5b855-de05-4eab-94d6-afd22b9c3087 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:32.166495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5b855-de05-4eab-94d6-afd22b9c3087 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:32.166770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5b855-de05-4eab-94d6-afd22b9c3087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:32.187100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14f4f4-f36e-4cd0-ab78-41e421620b48 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:32.190357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5b855-de05-4eab-94d6-afd22b9c3087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:32.191804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5b855-de05-4eab-94d6-afd22b9c3087 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:32.222547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49032e1b-633b-4eab-b818-24c3e41412f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:32.223202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49032e1b-633b-4eab-b818-24c3e41412f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:32.223465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49032e1b-633b-4eab-b818-24c3e41412f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:32.223746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49032e1b-633b-4eab-b818-24c3e41412f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:32.241787 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2919/5862] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:08:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:08:32.242668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5b855-de05-4eab-94d6-afd22b9c3087 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:32.255458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49032e1b-633b-4eab-b818-24c3e41412f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:32.256952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49032e1b-633b-4eab-b818-24c3e41412f8 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:32.265145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5b855-de05-4eab-94d6-afd22b9c3087 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:32.272423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb415c1-4760-443b-be0a-6cf78e56f68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:32.273278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb415c1-4760-443b-be0a-6cf78e56f68b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:32.282077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb415c1-4760-443b-be0a-6cf78e56f68b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:32.282718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb415c1-4760-443b-be0a-6cf78e56f68b admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:32.283579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb415c1-4760-443b-be0a-6cf78e56f68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:32.285119 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2944/5863] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:08:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:08:32.285342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb415c1-4760-443b-be0a-6cf78e56f68b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:32.298780 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2920/5864] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:32.302882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49032e1b-633b-4eab-b818-24c3e41412f8 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:32.319704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49032e1b-633b-4eab-b818-24c3e41412f8 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:32.329503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b144fa-2cd5-43f4-9814-7d06f8c4ac2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:32.330136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b144fa-2cd5-43f4-9814-7d06f8c4ac2e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:32.330420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b144fa-2cd5-43f4-9814-7d06f8c4ac2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:32.330707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b144fa-2cd5-43f4-9814-7d06f8c4ac2e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:32.331454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b144fa-2cd5-43f4-9814-7d06f8c4ac2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:32.333506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b144fa-2cd5-43f4-9814-7d06f8c4ac2e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:32.354888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb415c1-4760-443b-be0a-6cf78e56f68b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:32.367337 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2945/5865] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:08:32.382223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb415c1-4760-443b-be0a-6cf78e56f68b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:32.394415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c8cff-58cc-41c1-b687-7d5c346c3cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:32.396706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c8cff-58cc-41c1-b687-7d5c346c3cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:32.397230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c8cff-58cc-41c1-b687-7d5c346c3cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:32.397898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c8cff-58cc-41c1-b687-7d5c346c3cfc admin admin] PATH_INFO: `/v3/projects/213e00ee960843fab90491df550908b0/users/f81d4db0277848fcaa502fe932e62355/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:32.453720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c8cff-58cc-41c1-b687-7d5c346c3cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=213e00ee960843fab90491df550908b0, user_id=f81d4db0277848fcaa502fe932e62355, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:32.456918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c8cff-58cc-41c1-b687-7d5c346c3cfc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:32.480621 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2921/5866] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:08:32 2022] PUT /identity/v3/projects/213e00ee960843fab90491df550908b0/users/f81d4db0277848fcaa502fe932e62355/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:32.492383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2039d-1cdc-42de-b8c9-13901b929a53 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:32.492763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2039d-1cdc-42de-b8c9-13901b929a53 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:32.493149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2039d-1cdc-42de-b8c9-13901b929a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:32.531081 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:32.551578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6eb2039d-1cdc-42de-b8c9-13901b929a53 None None] MFA Rules not processed for user `f81d4db0277848fcaa502fe932e62355`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:32.553907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6eb2039d-1cdc-42de-b8c9-13901b929a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:32.686606 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2946/5867] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:32.688416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c8cff-58cc-41c1-b687-7d5c346c3cfc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:32.845186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c8cff-58cc-41c1-b687-7d5c346c3cfc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:32.855340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355483c0-0f23-47c3-907a-a5bdea7f1cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:32.855898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355483c0-0f23-47c3-907a-a5bdea7f1cdc admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:32.856179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355483c0-0f23-47c3-907a-a5bdea7f1cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:32.856654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355483c0-0f23-47c3-907a-a5bdea7f1cdc admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:32.857337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355483c0-0f23-47c3-907a-a5bdea7f1cdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:32.859500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355483c0-0f23-47c3-907a-a5bdea7f1cdc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:32.913401 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2922/5868] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:08:32 2022] POST /identity/v3/projects => generated 373 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:32.918339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2039d-1cdc-42de-b8c9-13901b929a53 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:32.936515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2039d-1cdc-42de-b8c9-13901b929a53 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:33.038532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a679d-6a6c-4f23-b7f6-bd60bbe53f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:33.039599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a679d-6a6c-4f23-b7f6-bd60bbe53f28 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:33.040084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a679d-6a6c-4f23-b7f6-bd60bbe53f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:33.040574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a679d-6a6c-4f23-b7f6-bd60bbe53f28 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:33.041647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a679d-6a6c-4f23-b7f6-bd60bbe53f28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:33.046049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a679d-6a6c-4f23-b7f6-bd60bbe53f28 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:33.081257 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2947/5869] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:08:32 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:33.087091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355483c0-0f23-47c3-907a-a5bdea7f1cdc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:33.107795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355483c0-0f23-47c3-907a-a5bdea7f1cdc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:33.124622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f609dc9-e4e1-459b-b0d3-c5e2f543f976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:33.126080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f609dc9-e4e1-459b-b0d3-c5e2f543f976 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:33.126782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f609dc9-e4e1-459b-b0d3-c5e2f543f976 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:33.127175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f609dc9-e4e1-459b-b0d3-c5e2f543f976 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:33.127812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f609dc9-e4e1-459b-b0d3-c5e2f543f976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:33.130367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f609dc9-e4e1-459b-b0d3-c5e2f543f976 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:33.169728 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2923/5870] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:33.174911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a679d-6a6c-4f23-b7f6-bd60bbe53f28 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:33.194834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a679d-6a6c-4f23-b7f6-bd60bbe53f28 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:33.204667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffa7f7-fd23-40ff-9b9c-f2762220aaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:33.205399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffa7f7-fd23-40ff-9b9c-f2762220aaee admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:33.205755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffa7f7-fd23-40ff-9b9c-f2762220aaee admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:33.207054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffa7f7-fd23-40ff-9b9c-f2762220aaee admin admin] PATH_INFO: `/v3/projects/0809b9c26e01426c85057b593229dc3b/users/d0ea03160e5e400a951fc28e9b205ae1/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:33.233058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bffa7f7-fd23-40ff-9b9c-f2762220aaee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0809b9c26e01426c85057b593229dc3b, user_id=d0ea03160e5e400a951fc28e9b205ae1, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:33.237638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bffa7f7-fd23-40ff-9b9c-f2762220aaee admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:33.279046 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2948/5871] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:08:33 2022] PUT /identity/v3/projects/0809b9c26e01426c85057b593229dc3b/users/d0ea03160e5e400a951fc28e9b205ae1/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:33.280171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f609dc9-e4e1-459b-b0d3-c5e2f543f976 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:33.298767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f609dc9-e4e1-459b-b0d3-c5e2f543f976 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:33.444859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b19ef-b292-481f-92b7-b97479f70bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:33.445475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b19ef-b292-481f-92b7-b97479f70bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:33.445753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b19ef-b292-481f-92b7-b97479f70bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:33.446026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b19ef-b292-481f-92b7-b97479f70bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:33.446714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b19ef-b292-481f-92b7-b97479f70bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:33.449313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b19ef-b292-481f-92b7-b97479f70bc2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:33.472631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffa7f7-fd23-40ff-9b9c-f2762220aaee admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:33.494958 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2924/5872] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:08:33.497725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffa7f7-fd23-40ff-9b9c-f2762220aaee admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:33.511613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060aa81-dce2-4223-9b32-0fb2175acd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:33.512585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060aa81-dce2-4223-9b32-0fb2175acd9a admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:33.512997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060aa81-dce2-4223-9b32-0fb2175acd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:33.513286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060aa81-dce2-4223-9b32-0fb2175acd9a admin admin] PATH_INFO: `/v3/projects/0809b9c26e01426c85057b593229dc3b/users/d0ea03160e5e400a951fc28e9b205ae1/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:33.519513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060aa81-dce2-4223-9b32-0fb2175acd9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0809b9c26e01426c85057b593229dc3b, user_id=d0ea03160e5e400a951fc28e9b205ae1, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:33.526035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060aa81-dce2-4223-9b32-0fb2175acd9a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:33.539026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b19ef-b292-481f-92b7-b97479f70bc2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:33.541034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5b3b19ef-b292-481f-92b7-b97479f70bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:33.568988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b19ef-b292-481f-92b7-b97479f70bc2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:33.570252 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2949/5873] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:08:33 2022] PUT /identity/v3/projects/0809b9c26e01426c85057b593229dc3b/users/d0ea03160e5e400a951fc28e9b205ae1/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:33.574006 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:33.583274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc28d3-f4f3-48ec-8d21-1893a8ddd351 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:33.584005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc28d3-f4f3-48ec-8d21-1893a8ddd351 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:33.585598 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc28d3-f4f3-48ec-8d21-1893a8ddd351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:33.670121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c3bc28d3-f4f3-48ec-8d21-1893a8ddd351 None None] MFA Rules not processed for user `d0ea03160e5e400a951fc28e9b205ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:33.671489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c3bc28d3-f4f3-48ec-8d21-1893a8ddd351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:33.787678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c25b0-2f2b-41df-ba60-2c0b47527faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:33.788485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c25b0-2f2b-41df-ba60-2c0b47527faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:33.788888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c25b0-2f2b-41df-ba60-2c0b47527faf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:33.789252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c25b0-2f2b-41df-ba60-2c0b47527faf admin admin] PATH_INFO: `/v3/projects/55c2a3f896f54ddbbb4915c3279b7427` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:33.790926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c25b0-2f2b-41df-ba60-2c0b47527faf admin admin] RBAC: Authorizing `identity:delete_project(project_id=55c2a3f896f54ddbbb4915c3279b7427)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:33.794252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c25b0-2f2b-41df-ba60-2c0b47527faf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:33.795373 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:33.869710 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2950/5874] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:33.884430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc28d3-f4f3-48ec-8d21-1893a8ddd351 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:33.888767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c3bc28d3-f4f3-48ec-8d21-1893a8ddd351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:33.918826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd3c25b0-2f2b-41df-ba60-2c0b47527faf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55c2a3f896f54ddbbb4915c3279b7427', 'request_id': 'req-fd3c25b0-2f2b-41df-ba60-2c0b47527faf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:33.940794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd3c25b0-2f2b-41df-ba60-2c0b47527faf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55c2a3f896f54ddbbb4915c3279b7427', 'request_id': 'req-fd3c25b0-2f2b-41df-ba60-2c0b47527faf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:33.953976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd3c25b0-2f2b-41df-ba60-2c0b47527faf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55c2a3f896f54ddbbb4915c3279b7427', 'request_id': 'req-fd3c25b0-2f2b-41df-ba60-2c0b47527faf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:33.987788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd3c25b0-2f2b-41df-ba60-2c0b47527faf admin admin] The token cache is being invalidate because project 55c2a3f896f54ddbbb4915c3279b7427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:08:33.989545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd3c25b0-2f2b-41df-ba60-2c0b47527faf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:33.991251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd3c25b0-2f2b-41df-ba60-2c0b47527faf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:34.002380 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2925/5875] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:08:33 2022] DELETE /identity/v3/projects/55c2a3f896f54ddbbb4915c3279b7427 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:34.004149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093dcf6-310b-49d8-8f83-3016ee6f6747 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:34.004421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093dcf6-310b-49d8-8f83-3016ee6f6747 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:34.004725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093dcf6-310b-49d8-8f83-3016ee6f6747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:34.037713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8093dcf6-310b-49d8-8f83-3016ee6f6747 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:34.039293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8093dcf6-310b-49d8-8f83-3016ee6f6747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:34.070661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc28d3-f4f3-48ec-8d21-1893a8ddd351 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:34.118083 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2926/5876] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:34.128182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fec73-8c3c-4569-915f-8decbb91ed64 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:34.128567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fec73-8c3c-4569-915f-8decbb91ed64 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:34.128990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fec73-8c3c-4569-915f-8decbb91ed64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:34.157959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b74fec73-8c3c-4569-915f-8decbb91ed64 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:34.159411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b74fec73-8c3c-4569-915f-8decbb91ed64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:34.174957 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2927/5877] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:34.176152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fec73-8c3c-4569-915f-8decbb91ed64 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:34.186858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fec73-8c3c-4569-915f-8decbb91ed64 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:34.193895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a178e-2eed-4459-b9cd-c7d7d1e421c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:34.194686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a178e-2eed-4459-b9cd-c7d7d1e421c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:34.195062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a178e-2eed-4459-b9cd-c7d7d1e421c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:34.195481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a178e-2eed-4459-b9cd-c7d7d1e421c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:34.196420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a178e-2eed-4459-b9cd-c7d7d1e421c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:08:34.196932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a178e-2eed-4459-b9cd-c7d7d1e421c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:34.199067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a178e-2eed-4459-b9cd-c7d7d1e421c0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:34.218126 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2928/5878] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:08:34.219727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a178e-2eed-4459-b9cd-c7d7d1e421c0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:34.231001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a178e-2eed-4459-b9cd-c7d7d1e421c0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:34.237255 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bcb83-75ad-436c-85b2-d0093f24e587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:34.238343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bcb83-75ad-436c-85b2-d0093f24e587 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:34.238343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bcb83-75ad-436c-85b2-d0093f24e587 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:34.238795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bcb83-75ad-436c-85b2-d0093f24e587 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:34.239599 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bcb83-75ad-436c-85b2-d0093f24e587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:34.241473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bcb83-75ad-436c-85b2-d0093f24e587 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:34.248347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4053a66-93ba-4d73-ae4b-6c98e6d14bba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:34.249159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4053a66-93ba-4d73-ae4b-6c98e6d14bba service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:34.249509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4053a66-93ba-4d73-ae4b-6c98e6d14bba service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:34.249858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4053a66-93ba-4d73-ae4b-6c98e6d14bba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:34.252078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f4053a66-93ba-4d73-ae4b-6c98e6d14bba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:34.259934 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:34.288060 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2929/5879] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:08:34 2022] POST /identity/v3/projects => generated 365 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:34.292924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef676cb6-06fa-4cb8-928d-5339730dca83 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:34.293152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef676cb6-06fa-4cb8-928d-5339730dca83 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:34.300357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef676cb6-06fa-4cb8-928d-5339730dca83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:34.343175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ef676cb6-06fa-4cb8-928d-5339730dca83 None None] MFA Rules not processed for user `40cea8ffee0e48aba3f0ce206768d1ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:34.346357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ef676cb6-06fa-4cb8-928d-5339730dca83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:34.401166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4053a66-93ba-4d73-ae4b-6c98e6d14bba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:34.402646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4053a66-93ba-4d73-ae4b-6c98e6d14bba service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:34.426320 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2951/5880] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:08:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:08:34.427011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4053a66-93ba-4d73-ae4b-6c98e6d14bba service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:34.451955 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2930/5881] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:34.461679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4053a66-93ba-4d73-ae4b-6c98e6d14bba service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:34.480117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef676cb6-06fa-4cb8-928d-5339730dca83 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:34.483437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ef676cb6-06fa-4cb8-928d-5339730dca83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:34.588284 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:34.643702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e06ddb-2f35-45e1-bf7e-13bb894f992f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:34.644372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e06ddb-2f35-45e1-bf7e-13bb894f992f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:34.644637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e06ddb-2f35-45e1-bf7e-13bb894f992f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:34.644914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e06ddb-2f35-45e1-bf7e-13bb894f992f admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:34.645581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e06ddb-2f35-45e1-bf7e-13bb894f992f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:34.656521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e06ddb-2f35-45e1-bf7e-13bb894f992f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:34.669202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef676cb6-06fa-4cb8-928d-5339730dca83 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:34.675999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889c0a1-c3a8-4068-88e8-2b491bd75415 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:34.681044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889c0a1-c3a8-4068-88e8-2b491bd75415 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:34.687852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889c0a1-c3a8-4068-88e8-2b491bd75415 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:34.688994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889c0a1-c3a8-4068-88e8-2b491bd75415 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:34.702924 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2952/5882] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:08:34 2022] POST /identity/v3/users => generated 283 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:34.705477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e06ddb-2f35-45e1-bf7e-13bb894f992f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:34.709623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-86e06ddb-2f35-45e1-bf7e-13bb894f992f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:34.717715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889c0a1-c3a8-4068-88e8-2b491bd75415 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:34.722401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889c0a1-c3a8-4068-88e8-2b491bd75415 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:34.746558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e06ddb-2f35-45e1-bf7e-13bb894f992f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:34.749311 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2931/5883] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:08:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:08:34.752714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889c0a1-c3a8-4068-88e8-2b491bd75415 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:34.761584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af4465-680c-4152-b276-23e67cb091a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:34.762280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af4465-680c-4152-b276-23e67cb091a4 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:34.762561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af4465-680c-4152-b276-23e67cb091a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:34.762832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af4465-680c-4152-b276-23e67cb091a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:34.770347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-69af4465-680c-4152-b276-23e67cb091a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:34.777387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889c0a1-c3a8-4068-88e8-2b491bd75415 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:34.787163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8f966-9d49-4f19-a261-7d130b478f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:34.788037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8f966-9d49-4f19-a261-7d130b478f30 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:34.788037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8f966-9d49-4f19-a261-7d130b478f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:34.788368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8f966-9d49-4f19-a261-7d130b478f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:34.789185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8f966-9d49-4f19-a261-7d130b478f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:34.792133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8f966-9d49-4f19-a261-7d130b478f30 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:34.810149 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2932/5884] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:34.811104 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8f966-9d49-4f19-a261-7d130b478f30 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:34.822266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8f966-9d49-4f19-a261-7d130b478f30 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:34.827335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff2c4e-4489-456c-a6c9-22a26c9bd764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:34.827944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff2c4e-4489-456c-a6c9-22a26c9bd764 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:34.828835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff2c4e-4489-456c-a6c9-22a26c9bd764 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:34.829116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff2c4e-4489-456c-a6c9-22a26c9bd764 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:34.829950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff2c4e-4489-456c-a6c9-22a26c9bd764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:34.831530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff2c4e-4489-456c-a6c9-22a26c9bd764 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:34.842924 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2933/5885] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:34.848407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff2c4e-4489-456c-a6c9-22a26c9bd764 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:34.859175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff2c4e-4489-456c-a6c9-22a26c9bd764 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:34.865706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae08ab-248d-4ca4-ad36-356c4d7def38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:34.866549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae08ab-248d-4ca4-ad36-356c4d7def38 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:34.866858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae08ab-248d-4ca4-ad36-356c4d7def38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:34.867150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae08ab-248d-4ca4-ad36-356c4d7def38 admin admin] PATH_INFO: `/v3/projects/9c358e8b76b04e1d894fec587fce3651/users/34250e39cc8a42feb75981925cb09752/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:34.886615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae08ab-248d-4ca4-ad36-356c4d7def38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c358e8b76b04e1d894fec587fce3651, user_id=34250e39cc8a42feb75981925cb09752, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:34.890274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae08ab-248d-4ca4-ad36-356c4d7def38 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:34.896245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af4465-680c-4152-b276-23e67cb091a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:34.901019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af4465-680c-4152-b276-23e67cb091a4 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:34.924593 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2934/5886] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:08:34 2022] PUT /identity/v3/projects/9c358e8b76b04e1d894fec587fce3651/users/34250e39cc8a42feb75981925cb09752/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:34.926142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8a5d4-8fa6-4076-ba01-12323e391477 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:34.926423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8a5d4-8fa6-4076-ba01-12323e391477 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:34.926691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8a5d4-8fa6-4076-ba01-12323e391477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:34.931688 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2953/5887] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:08:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:08:35.002028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-47b8a5d4-8fa6-4076-ba01-12323e391477 None None] MFA Rules not processed for user `34250e39cc8a42feb75981925cb09752`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:35.006704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-47b8a5d4-8fa6-4076-ba01-12323e391477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:35.101110 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:35.239415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af4465-680c-4152-b276-23e67cb091a4 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:35.240332 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2935/5888] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:35.259628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af4465-680c-4152-b276-23e67cb091a4 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:35.492154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0d37b-a54e-41a8-bab1-76b667b2696a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:35.492830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0d37b-a54e-41a8-bab1-76b667b2696a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:35.493344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0d37b-a54e-41a8-bab1-76b667b2696a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:35.493645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0d37b-a54e-41a8-bab1-76b667b2696a admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:35.494287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0d37b-a54e-41a8-bab1-76b667b2696a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:35.496280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0d37b-a54e-41a8-bab1-76b667b2696a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:35.541185 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2954/5889] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:08:35 2022] POST /identity/v3/projects => generated 367 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:35.546640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8a5d4-8fa6-4076-ba01-12323e391477 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:35.578496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8a5d4-8fa6-4076-ba01-12323e391477 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:35.692260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0aae87-eb4b-45dc-bf3d-4e5ba69e37fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:35.693114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0aae87-eb4b-45dc-bf3d-4e5ba69e37fc admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:35.693622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0aae87-eb4b-45dc-bf3d-4e5ba69e37fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:35.694675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0aae87-eb4b-45dc-bf3d-4e5ba69e37fc admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:35.696548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0aae87-eb4b-45dc-bf3d-4e5ba69e37fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:35.698300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0aae87-eb4b-45dc-bf3d-4e5ba69e37fc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:35.741044 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2936/5890] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:08:35 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:35.744477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0d37b-a54e-41a8-bab1-76b667b2696a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:35.760168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0d37b-a54e-41a8-bab1-76b667b2696a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:35.771979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446bddc-97c8-46fd-8053-d144178ed2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:35.773173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446bddc-97c8-46fd-8053-d144178ed2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:35.773716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446bddc-97c8-46fd-8053-d144178ed2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:35.774614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446bddc-97c8-46fd-8053-d144178ed2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:35.775470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446bddc-97c8-46fd-8053-d144178ed2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:35.779143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446bddc-97c8-46fd-8053-d144178ed2c1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:35.809823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0aae87-eb4b-45dc-bf3d-4e5ba69e37fc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:35.810332 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2955/5891] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:35.825355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0aae87-eb4b-45dc-bf3d-4e5ba69e37fc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:35.846327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e55a8-3c53-4418-9428-ee1fc993b679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:35.846327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e55a8-3c53-4418-9428-ee1fc993b679 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:35.846327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e55a8-3c53-4418-9428-ee1fc993b679 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:35.846919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e55a8-3c53-4418-9428-ee1fc993b679 admin admin] PATH_INFO: `/v3/projects/900d117206e84f7091423839f6c564b0/users/b9ee92eb9c4c467281888ead11432800/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:35.882125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e55a8-3c53-4418-9428-ee1fc993b679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=900d117206e84f7091423839f6c564b0, user_id=b9ee92eb9c4c467281888ead11432800, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:35.884811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e55a8-3c53-4418-9428-ee1fc993b679 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:35.916503 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2937/5892] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:08:35 2022] PUT /identity/v3/projects/900d117206e84f7091423839f6c564b0/users/b9ee92eb9c4c467281888ead11432800/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:35.918233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446bddc-97c8-46fd-8053-d144178ed2c1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:35.931621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446bddc-97c8-46fd-8053-d144178ed2c1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:36.014467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e55a8-3c53-4418-9428-ee1fc993b679 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:36.017467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fb6e55a8-3c53-4418-9428-ee1fc993b679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:36.021629 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:36.081945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986e324-7573-47f0-b6dd-ff273b15323e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:36.082727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986e324-7573-47f0-b6dd-ff273b15323e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:36.083005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986e324-7573-47f0-b6dd-ff273b15323e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:36.083272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986e324-7573-47f0-b6dd-ff273b15323e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:36.083918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986e324-7573-47f0-b6dd-ff273b15323e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:36.094925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986e324-7573-47f0-b6dd-ff273b15323e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:36.126679 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2956/5893] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:36.130522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986e324-7573-47f0-b6dd-ff273b15323e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:36.157614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986e324-7573-47f0-b6dd-ff273b15323e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:36.176096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e55a8-3c53-4418-9428-ee1fc993b679 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:36.183082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ad081-763c-44cc-b4a5-e92e73d01817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:36.184288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ad081-763c-44cc-b4a5-e92e73d01817 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:36.185889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ad081-763c-44cc-b4a5-e92e73d01817 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:36.186178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ad081-763c-44cc-b4a5-e92e73d01817 admin admin] PATH_INFO: `/v3/projects/900d117206e84f7091423839f6c564b0/users/b9ee92eb9c4c467281888ead11432800/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:36.186861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4f3ef-d934-4f92-a1c2-92e65c8cab14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:36.187490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4f3ef-d934-4f92-a1c2-92e65c8cab14 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:36.188384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4f3ef-d934-4f92-a1c2-92e65c8cab14 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:36.188677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4f3ef-d934-4f92-a1c2-92e65c8cab14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:36.194631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c9d4f3ef-d934-4f92-a1c2-92e65c8cab14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:36.194847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ad081-763c-44cc-b4a5-e92e73d01817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=900d117206e84f7091423839f6c564b0, user_id=b9ee92eb9c4c467281888ead11432800, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:36.216941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4f3ef-d934-4f92-a1c2-92e65c8cab14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:36.218489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4f3ef-d934-4f92-a1c2-92e65c8cab14 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:36.226778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ad081-763c-44cc-b4a5-e92e73d01817 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:36.241341 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2938/5894] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:08:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:08:36.271122 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2957/5895] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:08:36 2022] PUT /identity/v3/projects/900d117206e84f7091423839f6c564b0/users/b9ee92eb9c4c467281888ead11432800/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:08:36.283838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da265828-ec83-492c-8554-dca8a22b8251 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:36.284109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da265828-ec83-492c-8554-dca8a22b8251 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:36.284482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da265828-ec83-492c-8554-dca8a22b8251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:36.361526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-da265828-ec83-492c-8554-dca8a22b8251 None None] MFA Rules not processed for user `b9ee92eb9c4c467281888ead11432800`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:36.364177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-da265828-ec83-492c-8554-dca8a22b8251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:36.500288 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:36.635442 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2939/5896] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:36.636740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ad081-763c-44cc-b4a5-e92e73d01817 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:36.664526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ad081-763c-44cc-b4a5-e92e73d01817 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:36.680319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61f78b-f3c7-4b76-b781-8fe04f89f23f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:36.705586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61f78b-f3c7-4b76-b781-8fe04f89f23f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:36.712943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61f78b-f3c7-4b76-b781-8fe04f89f23f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:36.713509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61f78b-f3c7-4b76-b781-8fe04f89f23f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:36.715290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61f78b-f3c7-4b76-b781-8fe04f89f23f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:36.717453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61f78b-f3c7-4b76-b781-8fe04f89f23f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:36.750953 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2958/5897] 10.222.0.16 () {60 vars in 1150 bytes} [Fri Sep 30 10:08:36 2022] POST /identity/v3/domains => generated 277 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:36.755412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da265828-ec83-492c-8554-dca8a22b8251 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:36.772951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da265828-ec83-492c-8554-dca8a22b8251 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:36.945275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742830e7-abae-42b5-aca4-b992885d1c94 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:36.946346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742830e7-abae-42b5-aca4-b992885d1c94 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:36.947311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742830e7-abae-42b5-aca4-b992885d1c94 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:36.947880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742830e7-abae-42b5-aca4-b992885d1c94 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:36.948817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742830e7-abae-42b5-aca4-b992885d1c94 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:36.950796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742830e7-abae-42b5-aca4-b992885d1c94 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:37.007485 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2940/5898] 10.222.0.16 () {60 vars in 1150 bytes} [Fri Sep 30 10:08:36 2022] POST /identity/v3/domains => generated 275 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:37.009620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61f78b-f3c7-4b76-b781-8fe04f89f23f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:37.032874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61f78b-f3c7-4b76-b781-8fe04f89f23f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:37.269385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e2cab-b845-4b56-b9a7-5be08d420f5f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:37.270100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e2cab-b845-4b56-b9a7-5be08d420f5f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:37.282385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e2cab-b845-4b56-b9a7-5be08d420f5f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:37.282962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e2cab-b845-4b56-b9a7-5be08d420f5f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:37.283459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e2cab-b845-4b56-b9a7-5be08d420f5f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:37.289285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e2cab-b845-4b56-b9a7-5be08d420f5f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:37.330236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742830e7-abae-42b5-aca4-b992885d1c94 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:37.340949 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2959/5899] 10.222.0.16 () {60 vars in 1150 bytes} [Fri Sep 30 10:08:37 2022] POST /identity/v3/domains => generated 275 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:37.346938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742830e7-abae-42b5-aca4-b992885d1c94 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:37.584806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbbe0b-2b3f-4600-a9c3-0fad571601ea tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:37.585525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbbe0b-2b3f-4600-a9c3-0fad571601ea tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:37.586756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbbe0b-2b3f-4600-a9c3-0fad571601ea tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:37.587104 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbbe0b-2b3f-4600-a9c3-0fad571601ea tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:37.592590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbbe0b-2b3f-4600-a9c3-0fad571601ea tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:37.595278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbbe0b-2b3f-4600-a9c3-0fad571601ea tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:37.633147 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2941/5900] 10.222.0.16 () {60 vars in 1150 bytes} [Fri Sep 30 10:08:37 2022] POST /identity/v3/domains => generated 279 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:37.635742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e2cab-b845-4b56-b9a7-5be08d420f5f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:37.654865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e2cab-b845-4b56-b9a7-5be08d420f5f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:37.810919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7986597-787e-494b-a575-53c232148a99 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:37.810919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7986597-787e-494b-a575-53c232148a99 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:37.810919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7986597-787e-494b-a575-53c232148a99 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:37.811358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7986597-787e-494b-a575-53c232148a99 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains/255b35bca62b46e293f8343f5b7f3ae2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:37.850947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7986597-787e-494b-a575-53c232148a99 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=255b35bca62b46e293f8343f5b7f3ae2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:37.855742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7986597-787e-494b-a575-53c232148a99 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:37.931572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d7986597-787e-494b-a575-53c232148a99 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '255b35bca62b46e293f8343f5b7f3ae2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:37.940744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d7986597-787e-494b-a575-53c232148a99 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '255b35bca62b46e293f8343f5b7f3ae2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:37.987047 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:38.052341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d7986597-787e-494b-a575-53c232148a99 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '255b35bca62b46e293f8343f5b7f3ae2', 'request_id': 'req-d7986597-787e-494b-a575-53c232148a99'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:38.068207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d7986597-787e-494b-a575-53c232148a99 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '255b35bca62b46e293f8343f5b7f3ae2', 'request_id': 'req-d7986597-787e-494b-a575-53c232148a99'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:38.078993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d7986597-787e-494b-a575-53c232148a99 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '255b35bca62b46e293f8343f5b7f3ae2', 'request_id': 'req-d7986597-787e-494b-a575-53c232148a99'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:38.124019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d7986597-787e-494b-a575-53c232148a99 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] The token cache is being invalidate because project 255b35bca62b46e293f8343f5b7f3ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:08:38.124787 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d7986597-787e-494b-a575-53c232148a99 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:38.127699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d7986597-787e-494b-a575-53c232148a99 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:38.158552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d7986597-787e-494b-a575-53c232148a99 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '255b35bca62b46e293f8343f5b7f3ae2', 'request_id': 'req-d7986597-787e-494b-a575-53c232148a99'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:38.160284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d7986597-787e-494b-a575-53c232148a99 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '255b35bca62b46e293f8343f5b7f3ae2', 'request_id': 'req-d7986597-787e-494b-a575-53c232148a99'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:38.181652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d7986597-787e-494b-a575-53c232148a99 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '255b35bca62b46e293f8343f5b7f3ae2', 'request_id': 'req-d7986597-787e-494b-a575-53c232148a99'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:38.216276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbbe0b-2b3f-4600-a9c3-0fad571601ea tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:38.216504 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2960/5901] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:08:37 2022] DELETE /identity/v3/domains/255b35bca62b46e293f8343f5b7f3ae2 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:38.218309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a7fbbe0b-2b3f-4600-a9c3-0fad571601ea tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:38.253640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbbe0b-2b3f-4600-a9c3-0fad571601ea tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:38.390241 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:38.417898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377b122-23ab-421f-af5f-66ab714d47f7 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:38.418865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377b122-23ab-421f-af5f-66ab714d47f7 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:38.419322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377b122-23ab-421f-af5f-66ab714d47f7 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:38.420751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377b122-23ab-421f-af5f-66ab714d47f7 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:38.421667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377b122-23ab-421f-af5f-66ab714d47f7 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:38.424317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377b122-23ab-421f-af5f-66ab714d47f7 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:38.475799 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2942/5902] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:08:38 2022] POST /identity/v3/domains => generated 249 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:38.479837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7986597-787e-494b-a575-53c232148a99 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:38.497270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7986597-787e-494b-a575-53c232148a99 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:38.708155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e966ef0-66f9-449f-913d-6a8372fb085f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:38.709209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e966ef0-66f9-449f-913d-6a8372fb085f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:38.709502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e966ef0-66f9-449f-913d-6a8372fb085f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:38.709779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e966ef0-66f9-449f-913d-6a8372fb085f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains/6ce47077418848f39bb5b86ccccc72db` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:38.750958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e966ef0-66f9-449f-913d-6a8372fb085f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6ce47077418848f39bb5b86ccccc72db)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:38.752467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e966ef0-66f9-449f-913d-6a8372fb085f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:38.893948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4e966ef0-66f9-449f-913d-6a8372fb085f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6ce47077418848f39bb5b86ccccc72db'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:38.896813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4e966ef0-66f9-449f-913d-6a8372fb085f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6ce47077418848f39bb5b86ccccc72db'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:39.007131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4e966ef0-66f9-449f-913d-6a8372fb085f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6ce47077418848f39bb5b86ccccc72db'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:39.009960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4e966ef0-66f9-449f-913d-6a8372fb085f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6ce47077418848f39bb5b86ccccc72db'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:39.015367 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2961/5903] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:08:38 2022] PATCH /identity/v3/domains/6ce47077418848f39bb5b86ccccc72db => generated 250 bytes in 536 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:08:39.019655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377b122-23ab-421f-af5f-66ab714d47f7 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:39.021606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f377b122-23ab-421f-af5f-66ab714d47f7 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:39.053269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377b122-23ab-421f-af5f-66ab714d47f7 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:39.257596 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397bec7-e4fc-4c94-960a-bf89461b3b77 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:39.273270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397bec7-e4fc-4c94-960a-bf89461b3b77 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:39.275118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397bec7-e4fc-4c94-960a-bf89461b3b77 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:39.276046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397bec7-e4fc-4c94-960a-bf89461b3b77 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains/6ce47077418848f39bb5b86ccccc72db` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:39.312624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397bec7-e4fc-4c94-960a-bf89461b3b77 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6ce47077418848f39bb5b86ccccc72db)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:39.315770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397bec7-e4fc-4c94-960a-bf89461b3b77 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:39.393359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d397bec7-e4fc-4c94-960a-bf89461b3b77 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6ce47077418848f39bb5b86ccccc72db'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:39.402457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d397bec7-e4fc-4c94-960a-bf89461b3b77 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6ce47077418848f39bb5b86ccccc72db'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:39.489946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d397bec7-e4fc-4c94-960a-bf89461b3b77 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce47077418848f39bb5b86ccccc72db', 'request_id': 'req-d397bec7-e4fc-4c94-960a-bf89461b3b77'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:39.499728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d397bec7-e4fc-4c94-960a-bf89461b3b77 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce47077418848f39bb5b86ccccc72db', 'request_id': 'req-d397bec7-e4fc-4c94-960a-bf89461b3b77'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:39.519552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d397bec7-e4fc-4c94-960a-bf89461b3b77 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce47077418848f39bb5b86ccccc72db', 'request_id': 'req-d397bec7-e4fc-4c94-960a-bf89461b3b77'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:39.545013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d397bec7-e4fc-4c94-960a-bf89461b3b77 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] The token cache is being invalidate because project 6ce47077418848f39bb5b86ccccc72db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:08:39.545877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d397bec7-e4fc-4c94-960a-bf89461b3b77 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:39.547628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d397bec7-e4fc-4c94-960a-bf89461b3b77 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:39.580305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d397bec7-e4fc-4c94-960a-bf89461b3b77 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6ce47077418848f39bb5b86ccccc72db', 'request_id': 'req-d397bec7-e4fc-4c94-960a-bf89461b3b77'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:39.585198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d397bec7-e4fc-4c94-960a-bf89461b3b77 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6ce47077418848f39bb5b86ccccc72db', 'request_id': 'req-d397bec7-e4fc-4c94-960a-bf89461b3b77'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:39.586108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d397bec7-e4fc-4c94-960a-bf89461b3b77 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6ce47077418848f39bb5b86ccccc72db', 'request_id': 'req-d397bec7-e4fc-4c94-960a-bf89461b3b77'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:39.596909 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2943/5904] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:08:39 2022] DELETE /identity/v3/domains/6ce47077418848f39bb5b86ccccc72db => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:39.600789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e966ef0-66f9-449f-913d-6a8372fb085f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:39.622157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e966ef0-66f9-449f-913d-6a8372fb085f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:39.765898 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:39.912737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31d11b-9248-4f4f-8ae6-03e4c80ff150 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:39.915715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31d11b-9248-4f4f-8ae6-03e4c80ff150 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:39.917409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31d11b-9248-4f4f-8ae6-03e4c80ff150 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:39.917966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31d11b-9248-4f4f-8ae6-03e4c80ff150 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:39.923579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31d11b-9248-4f4f-8ae6-03e4c80ff150 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:39.929609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31d11b-9248-4f4f-8ae6-03e4c80ff150 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:39.989773 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2962/5905] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:08:39 2022] POST /identity/v3/domains => generated 278 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:39.994813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397bec7-e4fc-4c94-960a-bf89461b3b77 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:39.996533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d397bec7-e4fc-4c94-960a-bf89461b3b77 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:40.046978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397bec7-e4fc-4c94-960a-bf89461b3b77 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:40.134923 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:40.289342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16869676-47e7-4ec3-bf35-12d81b326b07 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:40.290962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16869676-47e7-4ec3-bf35-12d81b326b07 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:40.291257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16869676-47e7-4ec3-bf35-12d81b326b07 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:40.291533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16869676-47e7-4ec3-bf35-12d81b326b07 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains/3dc860c9002049b3b97e68e8ac85eec9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:40.327806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16869676-47e7-4ec3-bf35-12d81b326b07 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3dc860c9002049b3b97e68e8ac85eec9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:40.333815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16869676-47e7-4ec3-bf35-12d81b326b07 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:40.405140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-16869676-47e7-4ec3-bf35-12d81b326b07 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3dc860c9002049b3b97e68e8ac85eec9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:40.412803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-16869676-47e7-4ec3-bf35-12d81b326b07 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3dc860c9002049b3b97e68e8ac85eec9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:40.446268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31d11b-9248-4f4f-8ae6-03e4c80ff150 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:40.448684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1f31d11b-9248-4f4f-8ae6-03e4c80ff150 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:40.489340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-16869676-47e7-4ec3-bf35-12d81b326b07 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3dc860c9002049b3b97e68e8ac85eec9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:40.491289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-16869676-47e7-4ec3-bf35-12d81b326b07 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3dc860c9002049b3b97e68e8ac85eec9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:40.500835 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2944/5906] 10.222.0.16 () {60 vars in 1250 bytes} [Fri Sep 30 10:08:39 2022] PATCH /identity/v3/domains/3dc860c9002049b3b97e68e8ac85eec9 => generated 279 bytes in 507 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:08:40.502220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16869676-47e7-4ec3-bf35-12d81b326b07 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:40.509184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-16869676-47e7-4ec3-bf35-12d81b326b07 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:40.669813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31d11b-9248-4f4f-8ae6-03e4c80ff150 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:40.693327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16869676-47e7-4ec3-bf35-12d81b326b07 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:40.710059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af9ca2-8e2b-4838-be6f-e2e8313cee18 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:40.711022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af9ca2-8e2b-4838-be6f-e2e8313cee18 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:40.711548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af9ca2-8e2b-4838-be6f-e2e8313cee18 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:40.711901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af9ca2-8e2b-4838-be6f-e2e8313cee18 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains/3dc860c9002049b3b97e68e8ac85eec9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:40.745186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af9ca2-8e2b-4838-be6f-e2e8313cee18 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=3dc860c9002049b3b97e68e8ac85eec9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:40.747439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af9ca2-8e2b-4838-be6f-e2e8313cee18 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:40.758317 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2945/5907] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Sep 30 10:08:40 2022] GET /identity/v3/domains/3dc860c9002049b3b97e68e8ac85eec9 => generated 279 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:08:40.761553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af9ca2-8e2b-4838-be6f-e2e8313cee18 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:40.791268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af9ca2-8e2b-4838-be6f-e2e8313cee18 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:40.796063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e944b02-9436-4e28-ac40-1d6bf7aa8e2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:40.797349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e944b02-9436-4e28-ac40-1d6bf7aa8e2f service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:40.797852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e944b02-9436-4e28-ac40-1d6bf7aa8e2f service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:40.798325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e944b02-9436-4e28-ac40-1d6bf7aa8e2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:40.801872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1e944b02-9436-4e28-ac40-1d6bf7aa8e2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:40.817521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8a004-4324-49c0-8c3b-cef5a9871216 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:40.818557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8a004-4324-49c0-8c3b-cef5a9871216 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:40.819372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e944b02-9436-4e28-ac40-1d6bf7aa8e2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:40.819670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8a004-4324-49c0-8c3b-cef5a9871216 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:40.820477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8a004-4324-49c0-8c3b-cef5a9871216 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains/3dc860c9002049b3b97e68e8ac85eec9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:40.822178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8a004-4324-49c0-8c3b-cef5a9871216 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3dc860c9002049b3b97e68e8ac85eec9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:40.822831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e944b02-9436-4e28-ac40-1d6bf7aa8e2f service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:40.826249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8a004-4324-49c0-8c3b-cef5a9871216 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:40.854358 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2963/5908] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:08:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:08:40.890758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05f8a004-4324-49c0-8c3b-cef5a9871216 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3dc860c9002049b3b97e68e8ac85eec9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:40.913488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05f8a004-4324-49c0-8c3b-cef5a9871216 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3dc860c9002049b3b97e68e8ac85eec9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:41.029363 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:41.037611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05f8a004-4324-49c0-8c3b-cef5a9871216 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc860c9002049b3b97e68e8ac85eec9', 'request_id': 'req-05f8a004-4324-49c0-8c3b-cef5a9871216'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:41.057636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05f8a004-4324-49c0-8c3b-cef5a9871216 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc860c9002049b3b97e68e8ac85eec9', 'request_id': 'req-05f8a004-4324-49c0-8c3b-cef5a9871216'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:41.065877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05f8a004-4324-49c0-8c3b-cef5a9871216 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc860c9002049b3b97e68e8ac85eec9', 'request_id': 'req-05f8a004-4324-49c0-8c3b-cef5a9871216'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:41.089189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e944b02-9436-4e28-ac40-1d6bf7aa8e2f service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:41.095091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1e944b02-9436-4e28-ac40-1d6bf7aa8e2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:41.104012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05f8a004-4324-49c0-8c3b-cef5a9871216 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] The token cache is being invalidate because project 3dc860c9002049b3b97e68e8ac85eec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:08:41.106023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05f8a004-4324-49c0-8c3b-cef5a9871216 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:41.108013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05f8a004-4324-49c0-8c3b-cef5a9871216 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:41.131576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05f8a004-4324-49c0-8c3b-cef5a9871216 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3dc860c9002049b3b97e68e8ac85eec9', 'request_id': 'req-05f8a004-4324-49c0-8c3b-cef5a9871216'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:41.141983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05f8a004-4324-49c0-8c3b-cef5a9871216 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3dc860c9002049b3b97e68e8ac85eec9', 'request_id': 'req-05f8a004-4324-49c0-8c3b-cef5a9871216'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:41.144528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05f8a004-4324-49c0-8c3b-cef5a9871216 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3dc860c9002049b3b97e68e8ac85eec9', 'request_id': 'req-05f8a004-4324-49c0-8c3b-cef5a9871216'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:41.155230 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2946/5909] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:08:40 2022] DELETE /identity/v3/domains/3dc860c9002049b3b97e68e8ac85eec9 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:41.159613 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8a004-4324-49c0-8c3b-cef5a9871216 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:41.163794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-05f8a004-4324-49c0-8c3b-cef5a9871216 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:41.251505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e944b02-9436-4e28-ac40-1d6bf7aa8e2f service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:41.299224 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:41.354950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8a004-4324-49c0-8c3b-cef5a9871216 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:41.368417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185f5ff-f418-411d-992a-9cb6e5980ecf tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:41.369288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185f5ff-f418-411d-992a-9cb6e5980ecf tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:41.369695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185f5ff-f418-411d-992a-9cb6e5980ecf tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:41.369831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f595b8d-1861-4a95-8c0c-fabd97d0901a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:41.370406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f595b8d-1861-4a95-8c0c-fabd97d0901a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:41.370547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185f5ff-f418-411d-992a-9cb6e5980ecf tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:41.371674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f595b8d-1861-4a95-8c0c-fabd97d0901a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:41.372136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f595b8d-1861-4a95-8c0c-fabd97d0901a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:41.372355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185f5ff-f418-411d-992a-9cb6e5980ecf tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:41.374258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0f595b8d-1861-4a95-8c0c-fabd97d0901a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:41.374413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185f5ff-f418-411d-992a-9cb6e5980ecf tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:41.403038 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2947/5910] 10.222.0.16 () {58 vars in 1128 bytes} [Fri Sep 30 10:08:41 2022] GET /identity/v3/domains => generated 1345 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:08:41.408658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185f5ff-f418-411d-992a-9cb6e5980ecf tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:41.445784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f595b8d-1861-4a95-8c0c-fabd97d0901a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:41.449953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f595b8d-1861-4a95-8c0c-fabd97d0901a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:41.452548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185f5ff-f418-411d-992a-9cb6e5980ecf tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:41.472641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c646c-68f1-4e5d-98e4-7d7cf94e5c5c tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:41.473358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c646c-68f1-4e5d-98e4-7d7cf94e5c5c tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:41.473639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c646c-68f1-4e5d-98e4-7d7cf94e5c5c tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:41.473919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c646c-68f1-4e5d-98e4-7d7cf94e5c5c tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains/3dc860c9002049b3b97e68e8ac85eec9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:41.498052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c646c-68f1-4e5d-98e4-7d7cf94e5c5c tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 10:08:41.529312 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-418c646c-68f1-4e5d-98e4-7d7cf94e5c5c tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Could not find domain: 3dc860c9002049b3b97e68e8ac85eec9.: keystone.exception.DomainNotFound: Could not find domain: 3dc860c9002049b3b97e68e8ac85eec9. Sep 30 10:08:41.529312 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:08:41.529312 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 30 10:08:41.529312 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 30 10:08:41.529312 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 10:08:41.529312 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 10:08:41.529312 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 10:08:41.529312 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 10:08:41.529312 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3dc860c9002049b3b97e68e8ac85eec9. Sep 30 10:08:41.529312 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:08:41.529312 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:08:41.529312 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:08:41.529312 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:08:41.529312 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:08:41.529312 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:08:41.529312 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:08:41.530688 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:08:41.530688 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:08:41.530688 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:08:41.530688 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:08:41.530688 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:08:41.530688 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:08:41.530688 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:08:41.530688 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 30 10:08:41.530688 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 30 10:08:41.530688 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 10:08:41.530688 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 10:08:41.530688 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 10:08:41.530688 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 10:08:41.530688 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:08:41.530688 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:08:41.530688 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:08:41.532407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:08:41.532407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:08:41.532407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:08:41.532407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:08:41.532407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 10:08:41.532407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:08:41.532407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:08:41.532407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:08:41.532407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:08:41.532407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:08:41.532407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:08:41.532407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:08:41.532407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:08:41.532407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 30 10:08:41.532407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 10:08:41.532407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3dc860c9002049b3b97e68e8ac85eec9. Sep 30 10:08:41.532407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:08:41.535481 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2948/5911] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:08:41 2022] PATCH /identity/v3/domains/3dc860c9002049b3b97e68e8ac85eec9 => generated 112 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:08:41.536457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c646c-68f1-4e5d-98e4-7d7cf94e5c5c tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:41.555659 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2964/5912] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:08:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:08:41.573490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c646c-68f1-4e5d-98e4-7d7cf94e5c5c tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:41.593909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59207290-d350-4af4-b8a3-83d656395400 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:41.594545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59207290-d350-4af4-b8a3-83d656395400 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:41.594829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59207290-d350-4af4-b8a3-83d656395400 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:41.595105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59207290-d350-4af4-b8a3-83d656395400 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:41.595778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59207290-d350-4af4-b8a3-83d656395400 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:41.598577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59207290-d350-4af4-b8a3-83d656395400 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:41.642009 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2949/5913] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:08:41 2022] POST /identity/v3/domains => generated 274 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:41.646262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f595b8d-1861-4a95-8c0c-fabd97d0901a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:41.664580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f595b8d-1861-4a95-8c0c-fabd97d0901a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:41.830076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd694c-16eb-42c2-ad63-12dbef7b50ba tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:41.830855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd694c-16eb-42c2-ad63-12dbef7b50ba tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:41.831092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd694c-16eb-42c2-ad63-12dbef7b50ba tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:41.831370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd694c-16eb-42c2-ad63-12dbef7b50ba tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:41.832327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd694c-16eb-42c2-ad63-12dbef7b50ba tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:41.834893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd694c-16eb-42c2-ad63-12dbef7b50ba tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:41.907899 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2965/5914] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:08:41 2022] POST /identity/v3/users => generated 348 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:41.908422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59207290-d350-4af4-b8a3-83d656395400 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:41.944749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59207290-d350-4af4-b8a3-83d656395400 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:41.962132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf456bc-d5bb-447b-9073-6261ee4985c7 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:41.967885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf456bc-d5bb-447b-9073-6261ee4985c7 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:41.968215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf456bc-d5bb-447b-9073-6261ee4985c7 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:41.968484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf456bc-d5bb-447b-9073-6261ee4985c7 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/groups` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:41.975623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf456bc-d5bb-447b-9073-6261ee4985c7 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:41.976502 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-8bf456bc-d5bb-447b-9073-6261ee4985c7 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:08:41.976502 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:08:41.976502 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:08:41.977836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf456bc-d5bb-447b-9073-6261ee4985c7 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:42.034220 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2950/5915] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Sep 30 10:08:41 2022] POST /identity/v3/groups => generated 325 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:42.035795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd694c-16eb-42c2-ad63-12dbef7b50ba tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:42.052549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd694c-16eb-42c2-ad63-12dbef7b50ba tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:42.067368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16fc28-48ea-4250-abd7-f0f6881f57f9 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:42.068887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16fc28-48ea-4250-abd7-f0f6881f57f9 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:42.069274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16fc28-48ea-4250-abd7-f0f6881f57f9 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:42.069646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16fc28-48ea-4250-abd7-f0f6881f57f9 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains/70a0f52ef0b04216888f00517b8ce97d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:42.071841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16fc28-48ea-4250-abd7-f0f6881f57f9 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=70a0f52ef0b04216888f00517b8ce97d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:42.075094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16fc28-48ea-4250-abd7-f0f6881f57f9 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:42.132435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5f16fc28-48ea-4250-abd7-f0f6881f57f9 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '70a0f52ef0b04216888f00517b8ce97d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:42.134830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5f16fc28-48ea-4250-abd7-f0f6881f57f9 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '70a0f52ef0b04216888f00517b8ce97d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:42.172570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5f16fc28-48ea-4250-abd7-f0f6881f57f9 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '70a0f52ef0b04216888f00517b8ce97d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:42.173731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5f16fc28-48ea-4250-abd7-f0f6881f57f9 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '70a0f52ef0b04216888f00517b8ce97d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:42.181579 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2966/5916] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:08:42 2022] PATCH /identity/v3/domains/70a0f52ef0b04216888f00517b8ce97d => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:08:42.181883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf456bc-d5bb-447b-9073-6261ee4985c7 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:42.183903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8bf456bc-d5bb-447b-9073-6261ee4985c7 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:42.202174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf456bc-d5bb-447b-9073-6261ee4985c7 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:42.310821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:42.312377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:42.314690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:42.315500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains/70a0f52ef0b04216888f00517b8ce97d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:42.335131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=70a0f52ef0b04216888f00517b8ce97d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:42.337312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:42.349979 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:42.401567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '70a0f52ef0b04216888f00517b8ce97d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:42.409232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '70a0f52ef0b04216888f00517b8ce97d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:42.701136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '907f4d33fd4948ad90fa7056eff9f3a9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:42.722922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '907f4d33fd4948ad90fa7056eff9f3a9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:42.725120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '907f4d33fd4948ad90fa7056eff9f3a9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:42.763399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '907f4d33fd4948ad90fa7056eff9f3a9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:42.795800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '907f4d33fd4948ad90fa7056eff9f3a9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:42.895077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70a0f52ef0b04216888f00517b8ce97d', 'request_id': 'req-030cdb25-5681-4420-aa9f-1abe0d813a8a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:42.909920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70a0f52ef0b04216888f00517b8ce97d', 'request_id': 'req-030cdb25-5681-4420-aa9f-1abe0d813a8a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:42.923531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70a0f52ef0b04216888f00517b8ce97d', 'request_id': 'req-030cdb25-5681-4420-aa9f-1abe0d813a8a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:42.929725 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:42.964849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] The token cache is being invalidate because project 70a0f52ef0b04216888f00517b8ce97d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:08:42.965167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:42.974096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:43.014904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '70a0f52ef0b04216888f00517b8ce97d', 'request_id': 'req-030cdb25-5681-4420-aa9f-1abe0d813a8a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:43.025532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '70a0f52ef0b04216888f00517b8ce97d', 'request_id': 'req-030cdb25-5681-4420-aa9f-1abe0d813a8a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:43.027459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '70a0f52ef0b04216888f00517b8ce97d', 'request_id': 'req-030cdb25-5681-4420-aa9f-1abe0d813a8a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:43.049514 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2951/5917] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:08:42 2022] DELETE /identity/v3/domains/70a0f52ef0b04216888f00517b8ce97d => generated 0 bytes in 864 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:43.051132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16fc28-48ea-4250-abd7-f0f6881f57f9 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:43.067885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16fc28-48ea-4250-abd7-f0f6881f57f9 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:43.226861 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:43.254450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22612087-cd8a-4f3a-b2c5-f53118a63905 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:43.257361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612087-cd8a-4f3a-b2c5-f53118a63905 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:43.257656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612087-cd8a-4f3a-b2c5-f53118a63905 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:43.257935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612087-cd8a-4f3a-b2c5-f53118a63905 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains/70a0f52ef0b04216888f00517b8ce97d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:43.293631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22612087-cd8a-4f3a-b2c5-f53118a63905 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=70a0f52ef0b04216888f00517b8ce97d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:43.295487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22612087-cd8a-4f3a-b2c5-f53118a63905 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:43.354498 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-22612087-cd8a-4f3a-b2c5-f53118a63905 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Could not find domain: 70a0f52ef0b04216888f00517b8ce97d.: keystone.exception.DomainNotFound: Could not find domain: 70a0f52ef0b04216888f00517b8ce97d. Sep 30 10:08:43.354498 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:08:43.354498 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 30 10:08:43.354498 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 30 10:08:43.354498 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 10:08:43.354498 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 10:08:43.354498 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 10:08:43.354498 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 10:08:43.354498 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 70a0f52ef0b04216888f00517b8ce97d. Sep 30 10:08:43.354498 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:08:43.354498 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:08:43.354498 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:08:43.354498 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:08:43.354498 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:08:43.354498 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:08:43.354498 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:08:43.355761 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:08:43.355761 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:08:43.355761 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:08:43.355761 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:08:43.355761 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:08:43.355761 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:08:43.355761 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:08:43.355761 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 10:08:43.355761 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 10:08:43.355761 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 10:08:43.355761 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 10:08:43.355761 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:08:43.355761 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:08:43.355761 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:08:43.355761 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:08:43.355761 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:08:43.355761 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:08:43.357212 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:08:43.357212 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 10:08:43.357212 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:08:43.357212 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:08:43.357212 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:08:43.357212 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:08:43.357212 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:08:43.357212 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:08:43.357212 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:08:43.357212 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:08:43.357212 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 30 10:08:43.357212 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 10:08:43.357212 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 70a0f52ef0b04216888f00517b8ce97d. Sep 30 10:08:43.357212 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:08:43.360199 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2967/5918] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Sep 30 10:08:43 2022] GET /identity/v3/domains/70a0f52ef0b04216888f00517b8ce97d => generated 112 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:08:43.364866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:43.369132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:43.415081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cdb25-5681-4420-aa9f-1abe0d813a8a tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:43.421034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d5c04-e0ac-4e25-85bc-c92d34d60918 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:43.422711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d5c04-e0ac-4e25-85bc-c92d34d60918 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:43.423179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d5c04-e0ac-4e25-85bc-c92d34d60918 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:43.423469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d5c04-e0ac-4e25-85bc-c92d34d60918 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/users/907f4d33fd4948ad90fa7056eff9f3a9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:43.442484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d5c04-e0ac-4e25-85bc-c92d34d60918 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:get_user(user_id=907f4d33fd4948ad90fa7056eff9f3a9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:43.444851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d5c04-e0ac-4e25-85bc-c92d34d60918 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:43.477745 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-136d5c04-e0ac-4e25-85bc-c92d34d60918 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Could not find user: 907f4d33fd4948ad90fa7056eff9f3a9.: keystone.exception.UserNotFound: Could not find user: 907f4d33fd4948ad90fa7056eff9f3a9. Sep 30 10:08:43.477745 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:08:43.477745 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:08:43.477745 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:08:43.477745 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:08:43.477745 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:08:43.477745 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:08:43.477745 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:08:43.477745 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:08:43.477745 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:08:43.477745 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:08:43.477745 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:08:43.477745 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 10:08:43.477745 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 10:08:43.477745 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 10:08:43.479329 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 10:08:43.479329 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:08:43.479329 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:08:43.479329 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 10:08:43.479329 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 10:08:43.479329 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 10:08:43.479329 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 10:08:43.479329 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:08:43.479329 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:08:43.479329 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:08:43.479329 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:08:43.479329 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:08:43.479329 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 10:08:43.479329 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:08:43.479329 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:08:43.479329 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:08:43.479329 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:08:43.480785 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:08:43.480785 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:08:43.480785 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:08:43.480785 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:08:43.480785 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 10:08:43.480785 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 10:08:43.480785 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 10:08:43.480785 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 10:08:43.480785 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 10:08:43.480785 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 10:08:43.480785 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 907f4d33fd4948ad90fa7056eff9f3a9. Sep 30 10:08:43.480785 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:08:43.480785 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2952/5919] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Sep 30 10:08:43 2022] GET /identity/v3/users/907f4d33fd4948ad90fa7056eff9f3a9 => generated 110 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:08:43.485808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22612087-cd8a-4f3a-b2c5-f53118a63905 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:43.502316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22612087-cd8a-4f3a-b2c5-f53118a63905 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:43.514257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66925cd4-5203-4e44-b5c6-01307b436e87 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:43.515064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66925cd4-5203-4e44-b5c6-01307b436e87 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:43.515392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66925cd4-5203-4e44-b5c6-01307b436e87 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:43.516193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66925cd4-5203-4e44-b5c6-01307b436e87 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/groups/fbddb997f1c94c7eaf14d2175777a9b7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:43.529864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66925cd4-5203-4e44-b5c6-01307b436e87 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:get_group(group_id=fbddb997f1c94c7eaf14d2175777a9b7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:43.531018 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-66925cd4-5203-4e44-b5c6-01307b436e87 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:08:43.531018 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:08:43.531018 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:08:43.532901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66925cd4-5203-4e44-b5c6-01307b436e87 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:43.570863 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-66925cd4-5203-4e44-b5c6-01307b436e87 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Could not find group: fbddb997f1c94c7eaf14d2175777a9b7.: keystone.exception.GroupNotFound: Could not find group: fbddb997f1c94c7eaf14d2175777a9b7. Sep 30 10:08:43.570863 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:08:43.570863 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:08:43.570863 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:08:43.570863 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:08:43.570863 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:08:43.570863 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:08:43.570863 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:08:43.570863 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:08:43.570863 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:08:43.570863 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:08:43.570863 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:08:43.570863 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Sep 30 10:08:43.570863 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_group(group_id) Sep 30 10:08:43.570863 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Sep 30 10:08:43.576734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Sep 30 10:08:43.576734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:08:43.576734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:08:43.576734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 10:08:43.576734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 10:08:43.576734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 10:08:43.576734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 10:08:43.576734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:08:43.576734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:08:43.576734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:08:43.576734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:08:43.576734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:08:43.576734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 10:08:43.576734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:08:43.576734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:08:43.576734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:08:43.576734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:08:43.578200 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:08:43.578200 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:08:43.578200 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:08:43.578200 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:08:43.578200 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Sep 30 10:08:43.578200 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Sep 30 10:08:43.578200 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Sep 30 10:08:43.578200 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Sep 30 10:08:43.578200 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Sep 30 10:08:43.578200 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Sep 30 10:08:43.578200 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: fbddb997f1c94c7eaf14d2175777a9b7. Sep 30 10:08:43.578200 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:08:43.578200 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2968/5920] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:08:43 2022] GET /identity/v3/groups/fbddb997f1c94c7eaf14d2175777a9b7 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:08:43.580838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d5c04-e0ac-4e25-85bc-c92d34d60918 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:43.592779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d5c04-e0ac-4e25-85bc-c92d34d60918 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:43.604416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc633933-5927-47f8-96ba-3a4cf8a7f495 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:43.605635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc633933-5927-47f8-96ba-3a4cf8a7f495 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:43.607178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc633933-5927-47f8-96ba-3a4cf8a7f495 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:43.608203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc633933-5927-47f8-96ba-3a4cf8a7f495 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/groups/fbddb997f1c94c7eaf14d2175777a9b7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:43.625263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc633933-5927-47f8-96ba-3a4cf8a7f495 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 10:08:43.638587 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-cc633933-5927-47f8-96ba-3a4cf8a7f495 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Could not find group: fbddb997f1c94c7eaf14d2175777a9b7.: keystone.exception.GroupNotFound: Could not find group: fbddb997f1c94c7eaf14d2175777a9b7. Sep 30 10:08:43.638587 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:08:43.638587 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:08:43.638587 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:08:43.638587 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:08:43.638587 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:08:43.638587 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:08:43.638587 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:08:43.638587 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:08:43.638587 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:08:43.638587 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:08:43.638587 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:08:43.638587 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Sep 30 10:08:43.638587 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Sep 30 10:08:43.639769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 10:08:43.639769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 10:08:43.639769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 10:08:43.639769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 10:08:43.639769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:08:43.639769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:08:43.639769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 10:08:43.639769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 10:08:43.639769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 10:08:43.639769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 10:08:43.639769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:08:43.639769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:08:43.639769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:08:43.639769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:08:43.639769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:08:43.639769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 10:08:43.639769 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:08:43.642683 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:08:43.642683 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:08:43.642683 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:08:43.642683 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:08:43.642683 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:08:43.642683 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:08:43.642683 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:08:43.642683 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Sep 30 10:08:43.642683 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Sep 30 10:08:43.642683 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Sep 30 10:08:43.642683 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Sep 30 10:08:43.642683 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Sep 30 10:08:43.642683 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Sep 30 10:08:43.642683 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: fbddb997f1c94c7eaf14d2175777a9b7. Sep 30 10:08:43.642683 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:08:43.642683 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2953/5921] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Sep 30 10:08:43 2022] DELETE /identity/v3/groups/fbddb997f1c94c7eaf14d2175777a9b7 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:08:43.644901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66925cd4-5203-4e44-b5c6-01307b436e87 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:43.664417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66925cd4-5203-4e44-b5c6-01307b436e87 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:43.685430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc3c93-9d84-4f1a-8ed3-128f784ed008 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:43.686089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc3c93-9d84-4f1a-8ed3-128f784ed008 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:43.686374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc3c93-9d84-4f1a-8ed3-128f784ed008 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:43.686651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc3c93-9d84-4f1a-8ed3-128f784ed008 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/users/907f4d33fd4948ad90fa7056eff9f3a9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:43.696191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc3c93-9d84-4f1a-8ed3-128f784ed008 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:delete_user(user_id=907f4d33fd4948ad90fa7056eff9f3a9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:43.698064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc3c93-9d84-4f1a-8ed3-128f784ed008 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:43.716025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-7cbc3c93-9d84-4f1a-8ed3-128f784ed008 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Could not find user: 907f4d33fd4948ad90fa7056eff9f3a9.: keystone.exception.UserNotFound: Could not find user: 907f4d33fd4948ad90fa7056eff9f3a9. Sep 30 10:08:43.716025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:08:43.716025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:08:43.716025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:08:43.716025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:08:43.716025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:08:43.716025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:08:43.716025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:08:43.716025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:08:43.716025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:08:43.716025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:08:43.716025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:08:43.716025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Sep 30 10:08:43.716025 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Sep 30 10:08:43.718274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:08:43.718274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:08:43.718274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 10:08:43.718274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 10:08:43.718274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 10:08:43.718274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 10:08:43.718274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Sep 30 10:08:43.718274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Sep 30 10:08:43.718274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:08:43.718274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:08:43.718274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 10:08:43.718274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 10:08:43.718274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 10:08:43.718274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 10:08:43.718274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:08:43.718274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:08:43.718274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:08:43.718274 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:08:43.720342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:08:43.720342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 10:08:43.720342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:08:43.720342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:08:43.720342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:08:43.720342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:08:43.720342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:08:43.720342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:08:43.720342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:08:43.720342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:08:43.720342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 10:08:43.720342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 10:08:43.720342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 10:08:43.720342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 10:08:43.720342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 10:08:43.720342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 10:08:43.720342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 907f4d33fd4948ad90fa7056eff9f3a9. Sep 30 10:08:43.720342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:08:43.722194 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2969/5922] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:08:43 2022] DELETE /identity/v3/users/907f4d33fd4948ad90fa7056eff9f3a9 => generated 110 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:08:43.723438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc633933-5927-47f8-96ba-3a4cf8a7f495 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:43.743371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc633933-5927-47f8-96ba-3a4cf8a7f495 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:43.752496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94154951-31cc-4722-aa82-609d414ff6cb tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:43.753293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94154951-31cc-4722-aa82-609d414ff6cb tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:43.753691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94154951-31cc-4722-aa82-609d414ff6cb tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:43.753977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94154951-31cc-4722-aa82-609d414ff6cb tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains/70a0f52ef0b04216888f00517b8ce97d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:43.762867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94154951-31cc-4722-aa82-609d414ff6cb tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 10:08:43.770865 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-94154951-31cc-4722-aa82-609d414ff6cb tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Could not find domain: 70a0f52ef0b04216888f00517b8ce97d.: keystone.exception.DomainNotFound: Could not find domain: 70a0f52ef0b04216888f00517b8ce97d. Sep 30 10:08:43.770865 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:08:43.770865 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 30 10:08:43.770865 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 30 10:08:43.770865 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 10:08:43.770865 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 10:08:43.770865 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 10:08:43.770865 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 10:08:43.770865 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 70a0f52ef0b04216888f00517b8ce97d. Sep 30 10:08:43.770865 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:08:43.770865 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:08:43.770865 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:08:43.770865 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:08:43.770865 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:08:43.770865 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:08:43.770865 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:08:43.777458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:08:43.777458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:08:43.777458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:08:43.777458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:08:43.777458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:08:43.777458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:08:43.777458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:08:43.777458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 30 10:08:43.777458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 30 10:08:43.777458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 10:08:43.777458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 10:08:43.777458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 10:08:43.777458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 10:08:43.777458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:08:43.777458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:08:43.777458 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:08:43.778784 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:08:43.778784 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:08:43.778784 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:08:43.778784 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:08:43.778784 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 10:08:43.778784 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:08:43.778784 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:08:43.778784 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:08:43.778784 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:08:43.778784 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:08:43.778784 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:08:43.778784 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:08:43.778784 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:08:43.778784 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 30 10:08:43.778784 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 10:08:43.778784 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 70a0f52ef0b04216888f00517b8ce97d. Sep 30 10:08:43.778784 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:08:43.780194 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2954/5923] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:08:43 2022] PATCH /identity/v3/domains/70a0f52ef0b04216888f00517b8ce97d => generated 112 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:08:43.785404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc3c93-9d84-4f1a-8ed3-128f784ed008 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:43.816190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc3c93-9d84-4f1a-8ed3-128f784ed008 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:43.831325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffff55-63ef-43e5-ad8b-8fb2b9eaac30 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:43.832489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffff55-63ef-43e5-ad8b-8fb2b9eaac30 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:43.832972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffff55-63ef-43e5-ad8b-8fb2b9eaac30 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:43.833406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffff55-63ef-43e5-ad8b-8fb2b9eaac30 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:43.835409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffff55-63ef-43e5-ad8b-8fb2b9eaac30 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:43.839229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffff55-63ef-43e5-ad8b-8fb2b9eaac30 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:43.874269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94154951-31cc-4722-aa82-609d414ff6cb tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:43.877051 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2970/5924] 10.222.0.16 () {58 vars in 1128 bytes} [Fri Sep 30 10:08:43 2022] GET /identity/v3/domains => generated 1345 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:43.892180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94154951-31cc-4722-aa82-609d414ff6cb tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:43.901272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d651ae-8974-4c12-9960-3186c174a8b5 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:43.902198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d651ae-8974-4c12-9960-3186c174a8b5 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:43.904947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d651ae-8974-4c12-9960-3186c174a8b5 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:43.905433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d651ae-8974-4c12-9960-3186c174a8b5 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:43.906344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d651ae-8974-4c12-9960-3186c174a8b5 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:08:43.908075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d651ae-8974-4c12-9960-3186c174a8b5 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:43.910112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d651ae-8974-4c12-9960-3186c174a8b5 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:43.950328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffff55-63ef-43e5-ad8b-8fb2b9eaac30 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:43.963913 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2955/5925] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:08:43 2022] GET /identity/v3/domains?enabled=True => generated 1094 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:43.967831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffff55-63ef-43e5-ad8b-8fb2b9eaac30 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:43.974620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcf71c-e923-48e0-ba41-88c38f60c8e6 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:43.975501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcf71c-e923-48e0-ba41-88c38f60c8e6 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:43.975977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcf71c-e923-48e0-ba41-88c38f60c8e6 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:43.976424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcf71c-e923-48e0-ba41-88c38f60c8e6 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:43.978247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcf71c-e923-48e0-ba41-88c38f60c8e6 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-1676360409) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:08:43.978869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcf71c-e923-48e0-ba41-88c38f60c8e6 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:43.981632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcf71c-e923-48e0-ba41-88c38f60c8e6 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:44.007541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d651ae-8974-4c12-9960-3186c174a8b5 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:44.016963 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2971/5926] 10.222.0.16 () {58 vars in 1199 bytes} [Fri Sep 30 10:08:43 2022] GET /identity/v3/domains?name=tempest-test_domain-1676360409 => generated 409 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:08:44.027724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d651ae-8974-4c12-9960-3186c174a8b5 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:44.037419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d181f37-5241-4816-b7ad-7141d4bfb6ec tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:44.038403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d181f37-5241-4816-b7ad-7141d4bfb6ec tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:44.038905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d181f37-5241-4816-b7ad-7141d4bfb6ec tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:44.039284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d181f37-5241-4816-b7ad-7141d4bfb6ec tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains/70a0f52ef0b04216888f00517b8ce97d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:44.050334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d181f37-5241-4816-b7ad-7141d4bfb6ec tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 10:08:44.057107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-0d181f37-5241-4816-b7ad-7141d4bfb6ec tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Could not find domain: 70a0f52ef0b04216888f00517b8ce97d.: keystone.exception.DomainNotFound: Could not find domain: 70a0f52ef0b04216888f00517b8ce97d. Sep 30 10:08:44.057107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:08:44.057107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 30 10:08:44.057107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 30 10:08:44.057107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 10:08:44.057107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 10:08:44.057107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 10:08:44.057107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 10:08:44.057107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 70a0f52ef0b04216888f00517b8ce97d. Sep 30 10:08:44.057107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:08:44.057107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:08:44.057107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:08:44.057107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:08:44.057107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:08:44.057107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:08:44.057107 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:08:44.058553 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:08:44.058553 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:08:44.058553 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:08:44.058553 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:08:44.058553 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:08:44.058553 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:08:44.058553 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:08:44.058553 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 30 10:08:44.058553 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 30 10:08:44.058553 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 10:08:44.058553 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 10:08:44.058553 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 10:08:44.058553 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 10:08:44.058553 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:08:44.058553 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:08:44.058553 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:08:44.059883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:08:44.059883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:08:44.059883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:08:44.059883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:08:44.059883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 10:08:44.059883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:08:44.059883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:08:44.059883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:08:44.059883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:08:44.059883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:08:44.059883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:08:44.059883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:08:44.059883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:08:44.059883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 30 10:08:44.059883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 10:08:44.059883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 70a0f52ef0b04216888f00517b8ce97d. Sep 30 10:08:44.059883 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:08:44.076664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcf71c-e923-48e0-ba41-88c38f60c8e6 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:44.087236 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2956/5927] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:08:44 2022] PATCH /identity/v3/domains/70a0f52ef0b04216888f00517b8ce97d => generated 112 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:08:44.091070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcf71c-e923-48e0-ba41-88c38f60c8e6 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:44.100117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8aa5b8-c5e3-4dfa-a10c-6535884275e8 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:44.101659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8aa5b8-c5e3-4dfa-a10c-6535884275e8 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:44.102331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8aa5b8-c5e3-4dfa-a10c-6535884275e8 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:44.102832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8aa5b8-c5e3-4dfa-a10c-6535884275e8 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains/c2bcdd7311534aedbd6184b02e5e904c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:44.142167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8aa5b8-c5e3-4dfa-a10c-6535884275e8 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c2bcdd7311534aedbd6184b02e5e904c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:44.146553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8aa5b8-c5e3-4dfa-a10c-6535884275e8 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:44.285351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d181f37-5241-4816-b7ad-7141d4bfb6ec tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:44.293022 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2972/5928] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:08:44 2022] PATCH /identity/v3/domains/c2bcdd7311534aedbd6184b02e5e904c => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:08:44.302660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d181f37-5241-4816-b7ad-7141d4bfb6ec tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:44.325920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ab2a1-bc87-4a7c-8274-672633114279 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:44.326587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ab2a1-bc87-4a7c-8274-672633114279 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:44.326871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ab2a1-bc87-4a7c-8274-672633114279 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:44.327322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ab2a1-bc87-4a7c-8274-672633114279 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains/c2bcdd7311534aedbd6184b02e5e904c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:44.354053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ab2a1-bc87-4a7c-8274-672633114279 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c2bcdd7311534aedbd6184b02e5e904c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:44.355701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ab2a1-bc87-4a7c-8274-672633114279 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:44.412319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d8ab2a1-bc87-4a7c-8274-672633114279 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c2bcdd7311534aedbd6184b02e5e904c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:44.416178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d8ab2a1-bc87-4a7c-8274-672633114279 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c2bcdd7311534aedbd6184b02e5e904c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:44.612364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d8ab2a1-bc87-4a7c-8274-672633114279 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2bcdd7311534aedbd6184b02e5e904c', 'request_id': 'req-5d8ab2a1-bc87-4a7c-8274-672633114279'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:44.645227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d8ab2a1-bc87-4a7c-8274-672633114279 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2bcdd7311534aedbd6184b02e5e904c', 'request_id': 'req-5d8ab2a1-bc87-4a7c-8274-672633114279'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:44.654362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d8ab2a1-bc87-4a7c-8274-672633114279 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2bcdd7311534aedbd6184b02e5e904c', 'request_id': 'req-5d8ab2a1-bc87-4a7c-8274-672633114279'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:44.672396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d8ab2a1-bc87-4a7c-8274-672633114279 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] The token cache is being invalidate because project c2bcdd7311534aedbd6184b02e5e904c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:08:44.673183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d8ab2a1-bc87-4a7c-8274-672633114279 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:44.674093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d8ab2a1-bc87-4a7c-8274-672633114279 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:44.684049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d8ab2a1-bc87-4a7c-8274-672633114279 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c2bcdd7311534aedbd6184b02e5e904c', 'request_id': 'req-5d8ab2a1-bc87-4a7c-8274-672633114279'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:44.691859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d8ab2a1-bc87-4a7c-8274-672633114279 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c2bcdd7311534aedbd6184b02e5e904c', 'request_id': 'req-5d8ab2a1-bc87-4a7c-8274-672633114279'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:44.693191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d8ab2a1-bc87-4a7c-8274-672633114279 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c2bcdd7311534aedbd6184b02e5e904c', 'request_id': 'req-5d8ab2a1-bc87-4a7c-8274-672633114279'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:44.703554 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2957/5929] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:08:44 2022] DELETE /identity/v3/domains/c2bcdd7311534aedbd6184b02e5e904c => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:44.708571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8aa5b8-c5e3-4dfa-a10c-6535884275e8 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:44.712588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6c8aa5b8-c5e3-4dfa-a10c-6535884275e8 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:44.749977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8aa5b8-c5e3-4dfa-a10c-6535884275e8 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:44.930753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1d81a-f5ad-4f13-af91-8c9eb7a7fa5f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:44.932795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1d81a-f5ad-4f13-af91-8c9eb7a7fa5f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:44.934345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1d81a-f5ad-4f13-af91-8c9eb7a7fa5f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:44.936464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1d81a-f5ad-4f13-af91-8c9eb7a7fa5f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains/f82c0f68eb5544a583b1fb74ff178fc8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:44.969194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1d81a-f5ad-4f13-af91-8c9eb7a7fa5f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f82c0f68eb5544a583b1fb74ff178fc8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:44.970976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1d81a-f5ad-4f13-af91-8c9eb7a7fa5f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:45.024953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f8b1d81a-f5ad-4f13-af91-8c9eb7a7fa5f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f82c0f68eb5544a583b1fb74ff178fc8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:45.026871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f8b1d81a-f5ad-4f13-af91-8c9eb7a7fa5f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f82c0f68eb5544a583b1fb74ff178fc8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:45.087078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f8b1d81a-f5ad-4f13-af91-8c9eb7a7fa5f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f82c0f68eb5544a583b1fb74ff178fc8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:45.090608 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f8b1d81a-f5ad-4f13-af91-8c9eb7a7fa5f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f82c0f68eb5544a583b1fb74ff178fc8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:45.096987 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2973/5930] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:08:44 2022] PATCH /identity/v3/domains/f82c0f68eb5544a583b1fb74ff178fc8 => generated 276 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:08:45.100733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ab2a1-bc87-4a7c-8274-672633114279 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:45.120970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ab2a1-bc87-4a7c-8274-672633114279 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:45.132092 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=16,keystone:SELECT=83,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:45.261054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716895c-8d9d-45ed-b3a5-52281e3deee4 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:45.261700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716895c-8d9d-45ed-b3a5-52281e3deee4 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:45.262375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716895c-8d9d-45ed-b3a5-52281e3deee4 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:45.262375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716895c-8d9d-45ed-b3a5-52281e3deee4 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains/f82c0f68eb5544a583b1fb74ff178fc8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:45.288141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716895c-8d9d-45ed-b3a5-52281e3deee4 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f82c0f68eb5544a583b1fb74ff178fc8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:45.289874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716895c-8d9d-45ed-b3a5-52281e3deee4 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:45.364774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8716895c-8d9d-45ed-b3a5-52281e3deee4 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f82c0f68eb5544a583b1fb74ff178fc8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:45.369048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8716895c-8d9d-45ed-b3a5-52281e3deee4 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f82c0f68eb5544a583b1fb74ff178fc8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:45.474113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8716895c-8d9d-45ed-b3a5-52281e3deee4 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f82c0f68eb5544a583b1fb74ff178fc8', 'request_id': 'req-8716895c-8d9d-45ed-b3a5-52281e3deee4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:45.503089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8716895c-8d9d-45ed-b3a5-52281e3deee4 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f82c0f68eb5544a583b1fb74ff178fc8', 'request_id': 'req-8716895c-8d9d-45ed-b3a5-52281e3deee4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:45.524778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8716895c-8d9d-45ed-b3a5-52281e3deee4 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f82c0f68eb5544a583b1fb74ff178fc8', 'request_id': 'req-8716895c-8d9d-45ed-b3a5-52281e3deee4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:45.570114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8716895c-8d9d-45ed-b3a5-52281e3deee4 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] The token cache is being invalidate because project f82c0f68eb5544a583b1fb74ff178fc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:08:45.570434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8716895c-8d9d-45ed-b3a5-52281e3deee4 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:45.572501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8716895c-8d9d-45ed-b3a5-52281e3deee4 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:45.607448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8716895c-8d9d-45ed-b3a5-52281e3deee4 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f82c0f68eb5544a583b1fb74ff178fc8', 'request_id': 'req-8716895c-8d9d-45ed-b3a5-52281e3deee4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:45.613255 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8716895c-8d9d-45ed-b3a5-52281e3deee4 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f82c0f68eb5544a583b1fb74ff178fc8', 'request_id': 'req-8716895c-8d9d-45ed-b3a5-52281e3deee4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:45.614535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8716895c-8d9d-45ed-b3a5-52281e3deee4 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f82c0f68eb5544a583b1fb74ff178fc8', 'request_id': 'req-8716895c-8d9d-45ed-b3a5-52281e3deee4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:45.637718 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2958/5931] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:08:45 2022] DELETE /identity/v3/domains/f82c0f68eb5544a583b1fb74ff178fc8 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:45.639575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1d81a-f5ad-4f13-af91-8c9eb7a7fa5f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:45.641666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f8b1d81a-f5ad-4f13-af91-8c9eb7a7fa5f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:45.672339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1d81a-f5ad-4f13-af91-8c9eb7a7fa5f tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:45.683727 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:45.811540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af9673-83e3-45c8-bd91-263db7e60704 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:45.812297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af9673-83e3-45c8-bd91-263db7e60704 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:45.812819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af9673-83e3-45c8-bd91-263db7e60704 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:45.813267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af9673-83e3-45c8-bd91-263db7e60704 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains/0b84fa1dbb3d4878a4cd01dc1da7e718` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:45.839391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af9673-83e3-45c8-bd91-263db7e60704 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0b84fa1dbb3d4878a4cd01dc1da7e718)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:45.841125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af9673-83e3-45c8-bd91-263db7e60704 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:45.897781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-69af9673-83e3-45c8-bd91-263db7e60704 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0b84fa1dbb3d4878a4cd01dc1da7e718'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:45.898829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-69af9673-83e3-45c8-bd91-263db7e60704 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0b84fa1dbb3d4878a4cd01dc1da7e718'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:45.954825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-69af9673-83e3-45c8-bd91-263db7e60704 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0b84fa1dbb3d4878a4cd01dc1da7e718'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:45.957052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-69af9673-83e3-45c8-bd91-263db7e60704 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0b84fa1dbb3d4878a4cd01dc1da7e718'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:45.963114 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2974/5932] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:08:45 2022] PATCH /identity/v3/domains/0b84fa1dbb3d4878a4cd01dc1da7e718 => generated 278 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:08:45.966758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716895c-8d9d-45ed-b3a5-52281e3deee4 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:45.968218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8716895c-8d9d-45ed-b3a5-52281e3deee4 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:45.991539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716895c-8d9d-45ed-b3a5-52281e3deee4 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:46.128090 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:46.174509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271392f-924b-4d7f-884f-0f6561fe87ed tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9ee92eb9c4c467281888ead11432800', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900d117206e84f7091423839f6c564b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:46.175545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271392f-924b-4d7f-884f-0f6561fe87ed tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:46.175999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271392f-924b-4d7f-884f-0f6561fe87ed tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:46.176470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271392f-924b-4d7f-884f-0f6561fe87ed tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] PATH_INFO: `/v3/domains/0b84fa1dbb3d4878a4cd01dc1da7e718` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:46.206143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c271392f-924b-4d7f-884f-0f6561fe87ed tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0b84fa1dbb3d4878a4cd01dc1da7e718)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:46.208327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c271392f-924b-4d7f-884f-0f6561fe87ed tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:46.257246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c271392f-924b-4d7f-884f-0f6561fe87ed tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0b84fa1dbb3d4878a4cd01dc1da7e718'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:46.260976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c271392f-924b-4d7f-884f-0f6561fe87ed tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0b84fa1dbb3d4878a4cd01dc1da7e718'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:46.422096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c271392f-924b-4d7f-884f-0f6561fe87ed tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b84fa1dbb3d4878a4cd01dc1da7e718', 'request_id': 'req-c271392f-924b-4d7f-884f-0f6561fe87ed'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:46.454910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c271392f-924b-4d7f-884f-0f6561fe87ed tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b84fa1dbb3d4878a4cd01dc1da7e718', 'request_id': 'req-c271392f-924b-4d7f-884f-0f6561fe87ed'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:46.465468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c271392f-924b-4d7f-884f-0f6561fe87ed tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b84fa1dbb3d4878a4cd01dc1da7e718', 'request_id': 'req-c271392f-924b-4d7f-884f-0f6561fe87ed'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:46.491457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c271392f-924b-4d7f-884f-0f6561fe87ed tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] The token cache is being invalidate because project 0b84fa1dbb3d4878a4cd01dc1da7e718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:08:46.492392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c271392f-924b-4d7f-884f-0f6561fe87ed tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:46.493659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c271392f-924b-4d7f-884f-0f6561fe87ed tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:46.517371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c271392f-924b-4d7f-884f-0f6561fe87ed tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0b84fa1dbb3d4878a4cd01dc1da7e718', 'request_id': 'req-c271392f-924b-4d7f-884f-0f6561fe87ed'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:46.524019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c271392f-924b-4d7f-884f-0f6561fe87ed tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0b84fa1dbb3d4878a4cd01dc1da7e718', 'request_id': 'req-c271392f-924b-4d7f-884f-0f6561fe87ed'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:46.526433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c271392f-924b-4d7f-884f-0f6561fe87ed tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0b84fa1dbb3d4878a4cd01dc1da7e718', 'request_id': 'req-c271392f-924b-4d7f-884f-0f6561fe87ed'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:46.546097 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2959/5933] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:08:45 2022] DELETE /identity/v3/domains/0b84fa1dbb3d4878a4cd01dc1da7e718 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:46.548067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af9673-83e3-45c8-bd91-263db7e60704 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:46.550015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-69af9673-83e3-45c8-bd91-263db7e60704 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:46.729729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af9673-83e3-45c8-bd91-263db7e60704 tempest-DomainsTestJSON-1655510109 tempest-DomainsTestJSON-1655510109-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:46.888491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680b1d3-6c67-4dd7-ba66-f1bad9652e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:46.889136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680b1d3-6c67-4dd7-ba66-f1bad9652e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:46.889416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680b1d3-6c67-4dd7-ba66-f1bad9652e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:46.889690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680b1d3-6c67-4dd7-ba66-f1bad9652e74 admin admin] PATH_INFO: `/v3/users/34250e39cc8a42feb75981925cb09752` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:46.897718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680b1d3-6c67-4dd7-ba66-f1bad9652e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34250e39cc8a42feb75981925cb09752)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:46.899722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680b1d3-6c67-4dd7-ba66-f1bad9652e74 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:46.930417 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:47.041730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f680b1d3-6c67-4dd7-ba66-f1bad9652e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34250e39cc8a42feb75981925cb09752'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:47.044103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f680b1d3-6c67-4dd7-ba66-f1bad9652e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34250e39cc8a42feb75981925cb09752'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:47.066345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f680b1d3-6c67-4dd7-ba66-f1bad9652e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34250e39cc8a42feb75981925cb09752'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:47.104456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f680b1d3-6c67-4dd7-ba66-f1bad9652e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34250e39cc8a42feb75981925cb09752'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:47.169168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f680b1d3-6c67-4dd7-ba66-f1bad9652e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34250e39cc8a42feb75981925cb09752'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:47.180517 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2975/5934] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:08:46 2022] DELETE /identity/v3/users/34250e39cc8a42feb75981925cb09752 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:47.185118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d5fda-eb1a-427f-bc34-081af9c5a711 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:47.185399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d5fda-eb1a-427f-bc34-081af9c5a711 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:47.185666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d5fda-eb1a-427f-bc34-081af9c5a711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:47.215688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4a0d5fda-eb1a-427f-bc34-081af9c5a711 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:47.218220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4a0d5fda-eb1a-427f-bc34-081af9c5a711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:47.467739 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2960/5935] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:47.554785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680b1d3-6c67-4dd7-ba66-f1bad9652e74 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:47.557069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f680b1d3-6c67-4dd7-ba66-f1bad9652e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:47.720354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680b1d3-6c67-4dd7-ba66-f1bad9652e74 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:47.739695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59036681-ced7-4e77-bff5-f8358f2a18f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:47.740524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59036681-ced7-4e77-bff5-f8358f2a18f4 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:47.741250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59036681-ced7-4e77-bff5-f8358f2a18f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:47.741640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59036681-ced7-4e77-bff5-f8358f2a18f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:47.763247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59036681-ced7-4e77-bff5-f8358f2a18f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:47.769742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59036681-ced7-4e77-bff5-f8358f2a18f4 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:47.801636 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2976/5936] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:08:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:08:48.449168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d5fda-eb1a-427f-bc34-081af9c5a711 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:48.452873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4a0d5fda-eb1a-427f-bc34-081af9c5a711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:48.485769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d5fda-eb1a-427f-bc34-081af9c5a711 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:48.510539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37222373-c6dc-45c8-bbca-ddf280f4d5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:48.511321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37222373-c6dc-45c8-bbca-ddf280f4d5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:48.511712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37222373-c6dc-45c8-bbca-ddf280f4d5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:48.512093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37222373-c6dc-45c8-bbca-ddf280f4d5fc admin admin] PATH_INFO: `/v3/users/58c50ed8702548f0b7568d172661e00d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:48.513857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37222373-c6dc-45c8-bbca-ddf280f4d5fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=58c50ed8702548f0b7568d172661e00d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:48.516525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37222373-c6dc-45c8-bbca-ddf280f4d5fc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:48.543779 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:48.652169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-37222373-c6dc-45c8-bbca-ddf280f4d5fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58c50ed8702548f0b7568d172661e00d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:48.671005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-37222373-c6dc-45c8-bbca-ddf280f4d5fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58c50ed8702548f0b7568d172661e00d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:48.672392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-37222373-c6dc-45c8-bbca-ddf280f4d5fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58c50ed8702548f0b7568d172661e00d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:48.728554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-37222373-c6dc-45c8-bbca-ddf280f4d5fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58c50ed8702548f0b7568d172661e00d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:48.767253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-37222373-c6dc-45c8-bbca-ddf280f4d5fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58c50ed8702548f0b7568d172661e00d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:48.828689 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2961/5937] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:08:48 2022] DELETE /identity/v3/users/58c50ed8702548f0b7568d172661e00d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:51.132017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59036681-ced7-4e77-bff5-f8358f2a18f4 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:51.137803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-59036681-ced7-4e77-bff5-f8358f2a18f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:51.232878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59036681-ced7-4e77-bff5-f8358f2a18f4 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:51.493949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37222373-c6dc-45c8-bbca-ddf280f4d5fc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:51.495457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-37222373-c6dc-45c8-bbca-ddf280f4d5fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:51.542683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3eef7-ef47-4292-948a-6642c6d6efe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:51.543059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3eef7-ef47-4292-948a-6642c6d6efe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:51.543552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3eef7-ef47-4292-948a-6642c6d6efe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:51.543805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3eef7-ef47-4292-948a-6642c6d6efe3 admin admin] PATH_INFO: `/v3/projects/9c358e8b76b04e1d894fec587fce3651` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:51.545218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3eef7-ef47-4292-948a-6642c6d6efe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c358e8b76b04e1d894fec587fce3651)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:51.547574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3eef7-ef47-4292-948a-6642c6d6efe3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:51.706151 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:51.739117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37222373-c6dc-45c8-bbca-ddf280f4d5fc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:51.745508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bba3eef7-ef47-4292-948a-6642c6d6efe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c358e8b76b04e1d894fec587fce3651', 'request_id': 'req-bba3eef7-ef47-4292-948a-6642c6d6efe3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:51.777141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bba3eef7-ef47-4292-948a-6642c6d6efe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c358e8b76b04e1d894fec587fce3651', 'request_id': 'req-bba3eef7-ef47-4292-948a-6642c6d6efe3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:51.804444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bba3eef7-ef47-4292-948a-6642c6d6efe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c358e8b76b04e1d894fec587fce3651', 'request_id': 'req-bba3eef7-ef47-4292-948a-6642c6d6efe3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:51.839189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bba3eef7-ef47-4292-948a-6642c6d6efe3 admin admin] The token cache is being invalidate because project 9c358e8b76b04e1d894fec587fce3651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:08:51.839523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bba3eef7-ef47-4292-948a-6642c6d6efe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:51.840730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bba3eef7-ef47-4292-948a-6642c6d6efe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:51.847686 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2977/5938] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:08:51 2022] DELETE /identity/v3/projects/9c358e8b76b04e1d894fec587fce3651 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:51.851880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3eef7-ef47-4292-948a-6642c6d6efe3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:51.853547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bba3eef7-ef47-4292-948a-6642c6d6efe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:51.948333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9ff12-16a8-4881-bf76-492e154f2efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:51.948333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9ff12-16a8-4881-bf76-492e154f2efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:51.948333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9ff12-16a8-4881-bf76-492e154f2efe admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:51.948333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9ff12-16a8-4881-bf76-492e154f2efe admin admin] PATH_INFO: `/v3/projects/3dde838b70364aaaaaee0e9d5445218f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:51.949439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9ff12-16a8-4881-bf76-492e154f2efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dde838b70364aaaaaee0e9d5445218f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:51.955926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9ff12-16a8-4881-bf76-492e154f2efe admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:52.037909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3eef7-ef47-4292-948a-6642c6d6efe3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:52.062890 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:52.066474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-83f9ff12-16a8-4881-bf76-492e154f2efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dde838b70364aaaaaee0e9d5445218f', 'request_id': 'req-83f9ff12-16a8-4881-bf76-492e154f2efe'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:52.086534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-83f9ff12-16a8-4881-bf76-492e154f2efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dde838b70364aaaaaee0e9d5445218f', 'request_id': 'req-83f9ff12-16a8-4881-bf76-492e154f2efe'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:52.115571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-83f9ff12-16a8-4881-bf76-492e154f2efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dde838b70364aaaaaee0e9d5445218f', 'request_id': 'req-83f9ff12-16a8-4881-bf76-492e154f2efe'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:52.162814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-83f9ff12-16a8-4881-bf76-492e154f2efe admin admin] The token cache is being invalidate because project 3dde838b70364aaaaaee0e9d5445218f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:08:52.163817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-83f9ff12-16a8-4881-bf76-492e154f2efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:52.169758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-83f9ff12-16a8-4881-bf76-492e154f2efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:52.175423 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2962/5939] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:08:51 2022] DELETE /identity/v3/projects/3dde838b70364aaaaaee0e9d5445218f => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:52.184787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec226eb5-0a06-4ba6-8c5c-10409e63a6e0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:52.185857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec226eb5-0a06-4ba6-8c5c-10409e63a6e0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:52.188891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec226eb5-0a06-4ba6-8c5c-10409e63a6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:52.277466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ec226eb5-0a06-4ba6-8c5c-10409e63a6e0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:52.306025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ec226eb5-0a06-4ba6-8c5c-10409e63a6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:52.335077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422763d-fda8-4d71-94e1-761886ba9476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:52.340174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422763d-fda8-4d71-94e1-761886ba9476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:52.340681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422763d-fda8-4d71-94e1-761886ba9476 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:52.342215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422763d-fda8-4d71-94e1-761886ba9476 admin admin] PATH_INFO: `/v3/users/b9ee92eb9c4c467281888ead11432800` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:52.345063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422763d-fda8-4d71-94e1-761886ba9476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ee92eb9c4c467281888ead11432800)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:52.348932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422763d-fda8-4d71-94e1-761886ba9476 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:52.518828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5422763d-fda8-4d71-94e1-761886ba9476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ee92eb9c4c467281888ead11432800'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:52.526888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5422763d-fda8-4d71-94e1-761886ba9476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ee92eb9c4c467281888ead11432800'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:52.546965 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2963/5940] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:52.560378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53c77e-fcb8-4ac0-aa00-359282abbc18 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:52.560762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53c77e-fcb8-4ac0-aa00-359282abbc18 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:52.566162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53c77e-fcb8-4ac0-aa00-359282abbc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:52.610582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5422763d-fda8-4d71-94e1-761886ba9476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ee92eb9c4c467281888ead11432800'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:52.643844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ad53c77e-fcb8-4ac0-aa00-359282abbc18 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:52.649513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ad53c77e-fcb8-4ac0-aa00-359282abbc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:52.689477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5422763d-fda8-4d71-94e1-761886ba9476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ee92eb9c4c467281888ead11432800'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:52.691054 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:52.696798 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2964/5941] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:52.701338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53c77e-fcb8-4ac0-aa00-359282abbc18 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:52.731671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5422763d-fda8-4d71-94e1-761886ba9476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ee92eb9c4c467281888ead11432800'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:52.768248 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2978/5942] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:08:51 2022] DELETE /identity/v3/users/b9ee92eb9c4c467281888ead11432800 => generated 0 bytes in 912 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:52.768397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53c77e-fcb8-4ac0-aa00-359282abbc18 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:53.073984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65939a-3d61-497e-a312-4466fb52cf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:53.077339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65939a-3d61-497e-a312-4466fb52cf3a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:53.078476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65939a-3d61-497e-a312-4466fb52cf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:53.078879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65939a-3d61-497e-a312-4466fb52cf3a admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:53.079741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65939a-3d61-497e-a312-4466fb52cf3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:08:53.097158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65939a-3d61-497e-a312-4466fb52cf3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:53.111083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65939a-3d61-497e-a312-4466fb52cf3a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:53.163518 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2965/5943] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:08:53.164002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422763d-fda8-4d71-94e1-761886ba9476 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:53.193641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422763d-fda8-4d71-94e1-761886ba9476 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:53.220547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee8fb7-e7b6-4bd4-bd54-318fa388cf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:53.221462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee8fb7-e7b6-4bd4-bd54-318fa388cf28 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:53.239171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee8fb7-e7b6-4bd4-bd54-318fa388cf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:53.252921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee8fb7-e7b6-4bd4-bd54-318fa388cf28 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:53.253764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee8fb7-e7b6-4bd4-bd54-318fa388cf28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:53.258204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee8fb7-e7b6-4bd4-bd54-318fa388cf28 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:53.355576 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2979/5944] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:08:53 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:08:53.357664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65939a-3d61-497e-a312-4466fb52cf3a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:53.370769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65939a-3d61-497e-a312-4466fb52cf3a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:53.574644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d39bb-ba49-4efa-b35d-103c25bc8423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:53.575374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d39bb-ba49-4efa-b35d-103c25bc8423 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:53.575851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d39bb-ba49-4efa-b35d-103c25bc8423 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:53.576060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d39bb-ba49-4efa-b35d-103c25bc8423 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:53.576820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d39bb-ba49-4efa-b35d-103c25bc8423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:53.580280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d39bb-ba49-4efa-b35d-103c25bc8423 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:53.604856 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:53.650304 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2966/5945] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:08:53 2022] POST /identity/v3/users => generated 289 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:53.654596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee8fb7-e7b6-4bd4-bd54-318fa388cf28 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:53.681998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee8fb7-e7b6-4bd4-bd54-318fa388cf28 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:53.711743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d372c8-3160-4bb2-816a-f60b71a827a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:53.712858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d372c8-3160-4bb2-816a-f60b71a827a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:53.713429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d372c8-3160-4bb2-816a-f60b71a827a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:53.717677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d372c8-3160-4bb2-816a-f60b71a827a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:53.720669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d372c8-3160-4bb2-816a-f60b71a827a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:53.723465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d372c8-3160-4bb2-816a-f60b71a827a6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:53.795896 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2980/5946] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:53.801776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d39bb-ba49-4efa-b35d-103c25bc8423 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:53.839866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d39bb-ba49-4efa-b35d-103c25bc8423 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:53.850623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afbe50-2a43-437a-853e-9189d1e44de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:53.851536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afbe50-2a43-437a-853e-9189d1e44de6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:53.851979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afbe50-2a43-437a-853e-9189d1e44de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:53.852451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afbe50-2a43-437a-853e-9189d1e44de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:53.853316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6afbe50-2a43-437a-853e-9189d1e44de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:53.860473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6afbe50-2a43-437a-853e-9189d1e44de6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:53.907400 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2967/5947] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:53.907609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d372c8-3160-4bb2-816a-f60b71a827a6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:53.928003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d372c8-3160-4bb2-816a-f60b71a827a6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:53.952921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bae71a-2c7c-4c90-9f29-8f6bc4368f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:53.957100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bae71a-2c7c-4c90-9f29-8f6bc4368f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:53.959537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bae71a-2c7c-4c90-9f29-8f6bc4368f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:53.960952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bae71a-2c7c-4c90-9f29-8f6bc4368f0d admin admin] PATH_INFO: `/v3/projects/7d3a183bda764533bcef8ebf3550cc2a/users/4c65999e9e65482f86cb4b8609dca117/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:54.004198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bae71a-2c7c-4c90-9f29-8f6bc4368f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d3a183bda764533bcef8ebf3550cc2a, user_id=4c65999e9e65482f86cb4b8609dca117, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:54.010438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bae71a-2c7c-4c90-9f29-8f6bc4368f0d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:54.056552 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2981/5948] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:08:53 2022] PUT /identity/v3/projects/7d3a183bda764533bcef8ebf3550cc2a/users/4c65999e9e65482f86cb4b8609dca117/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:54.058402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2068693-2a7e-4529-9620-2c5208cca5f6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:54.058902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2068693-2a7e-4529-9620-2c5208cca5f6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:54.059355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2068693-2a7e-4529-9620-2c5208cca5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:54.154432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a2068693-2a7e-4529-9620-2c5208cca5f6 None None] MFA Rules not processed for user `4c65999e9e65482f86cb4b8609dca117`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:54.156715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a2068693-2a7e-4529-9620-2c5208cca5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:54.453601 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2968/5949] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:54.455191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe913713-cbeb-4619-a565-6825df2275d4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:54.456258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe913713-cbeb-4619-a565-6825df2275d4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:54.456993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe913713-cbeb-4619-a565-6825df2275d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:54.521263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fe913713-cbeb-4619-a565-6825df2275d4 None None] MFA Rules not processed for user `4c65999e9e65482f86cb4b8609dca117`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:54.525952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fe913713-cbeb-4619-a565-6825df2275d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:54.558093 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2982/5950] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:54.792225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2068693-2a7e-4529-9620-2c5208cca5f6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:54.794266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a2068693-2a7e-4529-9620-2c5208cca5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:55.051582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2068693-2a7e-4529-9620-2c5208cca5f6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:55.076011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c4b65-856e-4ffd-a17e-8fe3a5a75316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:55.082567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c4b65-856e-4ffd-a17e-8fe3a5a75316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:55.082850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c4b65-856e-4ffd-a17e-8fe3a5a75316 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:55.083126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c4b65-856e-4ffd-a17e-8fe3a5a75316 admin admin] PATH_INFO: `/v3/projects/900d117206e84f7091423839f6c564b0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:55.086028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe913713-cbeb-4619-a565-6825df2275d4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:55.087810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fe913713-cbeb-4619-a565-6825df2275d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:55.089639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c4b65-856e-4ffd-a17e-8fe3a5a75316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=900d117206e84f7091423839f6c564b0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:55.094805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c4b65-856e-4ffd-a17e-8fe3a5a75316 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:55.245495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe913713-cbeb-4619-a565-6825df2275d4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:55.261939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524779f1-321f-41d4-a514-ba19c2f19daa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:55.262579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524779f1-321f-41d4-a514-ba19c2f19daa service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:55.262850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524779f1-321f-41d4-a514-ba19c2f19daa service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:55.263133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524779f1-321f-41d4-a514-ba19c2f19daa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:55.282372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524779f1-321f-41d4-a514-ba19c2f19daa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:55.288662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524779f1-321f-41d4-a514-ba19c2f19daa service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:55.311047 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2983/5951] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:08:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:08:55.428173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2a1c4b65-856e-4ffd-a17e-8fe3a5a75316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '900d117206e84f7091423839f6c564b0', 'request_id': 'req-2a1c4b65-856e-4ffd-a17e-8fe3a5a75316'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:55.496561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2a1c4b65-856e-4ffd-a17e-8fe3a5a75316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '900d117206e84f7091423839f6c564b0', 'request_id': 'req-2a1c4b65-856e-4ffd-a17e-8fe3a5a75316'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:55.519488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2a1c4b65-856e-4ffd-a17e-8fe3a5a75316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '900d117206e84f7091423839f6c564b0', 'request_id': 'req-2a1c4b65-856e-4ffd-a17e-8fe3a5a75316'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:55.538826 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:55.544483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2a1c4b65-856e-4ffd-a17e-8fe3a5a75316 admin admin] The token cache is being invalidate because project 900d117206e84f7091423839f6c564b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:08:55.545162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2a1c4b65-856e-4ffd-a17e-8fe3a5a75316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:55.547485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2a1c4b65-856e-4ffd-a17e-8fe3a5a75316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:08:55.554984 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2969/5952] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:08:54 2022] DELETE /identity/v3/projects/900d117206e84f7091423839f6c564b0 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:55.557780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a178e-f48a-4d75-a282-1066c786371e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:55.558327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a178e-f48a-4d75-a282-1066c786371e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:55.558499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a178e-f48a-4d75-a282-1066c786371e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:55.593273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cc6a178e-f48a-4d75-a282-1066c786371e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:55.594480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cc6a178e-f48a-4d75-a282-1066c786371e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:55.821318 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2984/5953] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:55.830168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41249c94-c1fb-4aab-8964-60f46945fbbe None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:55.830790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41249c94-c1fb-4aab-8964-60f46945fbbe None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:55.833164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41249c94-c1fb-4aab-8964-60f46945fbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:55.899476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-41249c94-c1fb-4aab-8964-60f46945fbbe None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:55.900643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-41249c94-c1fb-4aab-8964-60f46945fbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:55.944174 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2970/5954] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:55.955092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a178e-f48a-4d75-a282-1066c786371e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:55.987613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a178e-f48a-4d75-a282-1066c786371e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:55.994949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1126433-3f3b-4b63-af72-09dd322aa326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:55.996173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1126433-3f3b-4b63-af72-09dd322aa326 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:55.996173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1126433-3f3b-4b63-af72-09dd322aa326 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:55.996173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1126433-3f3b-4b63-af72-09dd322aa326 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:55.997361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1126433-3f3b-4b63-af72-09dd322aa326 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:08:55.997361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1126433-3f3b-4b63-af72-09dd322aa326 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:55.999102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1126433-3f3b-4b63-af72-09dd322aa326 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:56.007481 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:56.040340 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2985/5955] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:08:56.046838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41249c94-c1fb-4aab-8964-60f46945fbbe None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:56.063348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41249c94-c1fb-4aab-8964-60f46945fbbe None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:56.076047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c693a-8da4-4174-85d1-688c34690aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:56.081730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c693a-8da4-4174-85d1-688c34690aba admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:56.082328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c693a-8da4-4174-85d1-688c34690aba admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:56.083352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c693a-8da4-4174-85d1-688c34690aba admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:56.084264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c693a-8da4-4174-85d1-688c34690aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:56.086581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c693a-8da4-4174-85d1-688c34690aba admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:56.198243 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2971/5956] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:08:56 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:56.203765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1126433-3f3b-4b63-af72-09dd322aa326 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:56.225147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1126433-3f3b-4b63-af72-09dd322aa326 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:56.509702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16ac04-119a-4590-a529-6e44ed2b5a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:56.510337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16ac04-119a-4590-a529-6e44ed2b5a96 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:56.510619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16ac04-119a-4590-a529-6e44ed2b5a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:56.510898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16ac04-119a-4590-a529-6e44ed2b5a96 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:56.511549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16ac04-119a-4590-a529-6e44ed2b5a96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:56.513556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16ac04-119a-4590-a529-6e44ed2b5a96 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:56.675481 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2986/5957] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:08:56 2022] POST /identity/v3/users => generated 292 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:08:56.676750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c693a-8da4-4174-85d1-688c34690aba admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:56.694613 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c693a-8da4-4174-85d1-688c34690aba admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:56.728351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae5677-0ddf-47d8-938e-437cf3ae9818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:56.742187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae5677-0ddf-47d8-938e-437cf3ae9818 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:56.742546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae5677-0ddf-47d8-938e-437cf3ae9818 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:56.742820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae5677-0ddf-47d8-938e-437cf3ae9818 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:56.745188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae5677-0ddf-47d8-938e-437cf3ae9818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:56.746849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae5677-0ddf-47d8-938e-437cf3ae9818 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:56.805971 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2972/5958] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:56.810968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16ac04-119a-4590-a529-6e44ed2b5a96 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:56.827254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16ac04-119a-4590-a529-6e44ed2b5a96 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:56.848362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2090f7-97c9-4973-a677-b6707c46a7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:56.849814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2090f7-97c9-4973-a677-b6707c46a7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:56.850099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2090f7-97c9-4973-a677-b6707c46a7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:56.856630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2090f7-97c9-4973-a677-b6707c46a7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:56.858413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2090f7-97c9-4973-a677-b6707c46a7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:56.862890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2090f7-97c9-4973-a677-b6707c46a7c6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:56.927793 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2987/5959] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:56.931837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae5677-0ddf-47d8-938e-437cf3ae9818 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:56.963559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae5677-0ddf-47d8-938e-437cf3ae9818 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:56.986110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37ffa6-33e9-45a3-80b2-6c041c96cb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:56.986815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37ffa6-33e9-45a3-80b2-6c041c96cb5f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:56.987023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37ffa6-33e9-45a3-80b2-6c041c96cb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:56.987482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37ffa6-33e9-45a3-80b2-6c041c96cb5f admin admin] PATH_INFO: `/v3/projects/fbc7c1393bdd49dab121ac5c43cfdd8a/users/690d10bef69d4193b23ed77febdd4ed8/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:57.039423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37ffa6-33e9-45a3-80b2-6c041c96cb5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc7c1393bdd49dab121ac5c43cfdd8a, user_id=690d10bef69d4193b23ed77febdd4ed8, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:57.052860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37ffa6-33e9-45a3-80b2-6c041c96cb5f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:57.125337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e6660-1dc2-4738-b336-4a803d9c6bec None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:57.126027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e6660-1dc2-4738-b336-4a803d9c6bec None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:57.126523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e6660-1dc2-4738-b336-4a803d9c6bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:57.133211 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2973/5960] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:08:56 2022] PUT /identity/v3/projects/fbc7c1393bdd49dab121ac5c43cfdd8a/users/690d10bef69d4193b23ed77febdd4ed8/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:08:57.187351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b99e6660-1dc2-4738-b336-4a803d9c6bec None None] MFA Rules not processed for user `690d10bef69d4193b23ed77febdd4ed8`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:57.189277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b99e6660-1dc2-4738-b336-4a803d9c6bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:57.593930 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2988/5961] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:08:57.595527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37ffa6-33e9-45a3-80b2-6c041c96cb5f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:57.832195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37ffa6-33e9-45a3-80b2-6c041c96cb5f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:57.841786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eabf98-e607-40c9-976a-4cccb9557c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:57.842548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eabf98-e607-40c9-976a-4cccb9557c85 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:57.843459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eabf98-e607-40c9-976a-4cccb9557c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:57.843840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eabf98-e607-40c9-976a-4cccb9557c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:57.844580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eabf98-e607-40c9-976a-4cccb9557c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:57.848065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eabf98-e607-40c9-976a-4cccb9557c85 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:57.917031 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2974/5962] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:08:57 2022] POST /identity/v3/projects => generated 383 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:57.917247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e6660-1dc2-4738-b336-4a803d9c6bec None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:57.936271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e6660-1dc2-4738-b336-4a803d9c6bec None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:58.082482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc75f1-afff-43d2-a18b-5ac46d46520a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:58.083284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc75f1-afff-43d2-a18b-5ac46d46520a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:58.083678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc75f1-afff-43d2-a18b-5ac46d46520a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:58.084063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc75f1-afff-43d2-a18b-5ac46d46520a admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:58.084967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc75f1-afff-43d2-a18b-5ac46d46520a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:58.087181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc75f1-afff-43d2-a18b-5ac46d46520a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:58.120893 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:58.148206 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2989/5963] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:08:57 2022] POST /identity/v3/users => generated 298 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:58.152123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eabf98-e607-40c9-976a-4cccb9557c85 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:58.171688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eabf98-e607-40c9-976a-4cccb9557c85 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:58.182895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586be41-8c13-4436-88ee-fc65b60dd367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:58.183858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586be41-8c13-4436-88ee-fc65b60dd367 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:58.184248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586be41-8c13-4436-88ee-fc65b60dd367 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:58.184648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586be41-8c13-4436-88ee-fc65b60dd367 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:58.188509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586be41-8c13-4436-88ee-fc65b60dd367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:58.192926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586be41-8c13-4436-88ee-fc65b60dd367 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:58.221448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc75f1-afff-43d2-a18b-5ac46d46520a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:58.222301 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2975/5964] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:58.233326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc75f1-afff-43d2-a18b-5ac46d46520a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:58.274935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2d52b-602d-47a2-9a6f-79a610f5c642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:58.277298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2d52b-602d-47a2-9a6f-79a610f5c642 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:58.277913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2d52b-602d-47a2-9a6f-79a610f5c642 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:58.278227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2d52b-602d-47a2-9a6f-79a610f5c642 admin admin] PATH_INFO: `/v3/projects/53c511270a28479a8cf4c01572622e41/users/2f91a0291fa5471fb00c277afcc6cd4e/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:58.316177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2d52b-602d-47a2-9a6f-79a610f5c642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53c511270a28479a8cf4c01572622e41, user_id=2f91a0291fa5471fb00c277afcc6cd4e, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:58.322071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2d52b-602d-47a2-9a6f-79a610f5c642 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:58.356549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586be41-8c13-4436-88ee-fc65b60dd367 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:58.357183 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2990/5965] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:08:58 2022] PUT /identity/v3/projects/53c511270a28479a8cf4c01572622e41/users/2f91a0291fa5471fb00c277afcc6cd4e/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:58.369415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586be41-8c13-4436-88ee-fc65b60dd367 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:58.534451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d502f5-e443-4fc4-94fc-51e3e878b3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:58.535743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d502f5-e443-4fc4-94fc-51e3e878b3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:58.536974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d502f5-e443-4fc4-94fc-51e3e878b3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:58.537107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d502f5-e443-4fc4-94fc-51e3e878b3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:58.539023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d502f5-e443-4fc4-94fc-51e3e878b3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:58.545170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d502f5-e443-4fc4-94fc-51e3e878b3b2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:58.592096 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2976/5966] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:08:58.601298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2d52b-602d-47a2-9a6f-79a610f5c642 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:58.628468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2d52b-602d-47a2-9a6f-79a610f5c642 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:58.662373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146d3b4-6a40-420c-9ba9-30a489dfd3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:58.665546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146d3b4-6a40-420c-9ba9-30a489dfd3d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:58.666544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146d3b4-6a40-420c-9ba9-30a489dfd3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:58.666825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146d3b4-6a40-420c-9ba9-30a489dfd3d8 admin admin] PATH_INFO: `/v3/projects/53c511270a28479a8cf4c01572622e41/users/2f91a0291fa5471fb00c277afcc6cd4e/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:58.684294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146d3b4-6a40-420c-9ba9-30a489dfd3d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53c511270a28479a8cf4c01572622e41, user_id=2f91a0291fa5471fb00c277afcc6cd4e, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:58.726912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146d3b4-6a40-420c-9ba9-30a489dfd3d8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:58.778775 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2991/5967] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:08:58 2022] PUT /identity/v3/projects/53c511270a28479a8cf4c01572622e41/users/2f91a0291fa5471fb00c277afcc6cd4e/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:08:58.797295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08058ac-cd64-4ca8-995d-8c0e7072c461 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:58.797582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08058ac-cd64-4ca8-995d-8c0e7072c461 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:58.797858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08058ac-cd64-4ca8-995d-8c0e7072c461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:58.813456 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:08:58.977486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e08058ac-cd64-4ca8-995d-8c0e7072c461 None None] MFA Rules not processed for user `2f91a0291fa5471fb00c277afcc6cd4e`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:08:58.979042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e08058ac-cd64-4ca8-995d-8c0e7072c461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:08:59.321366 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2977/5968] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:08:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 525 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:08:59.327084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146d3b4-6a40-420c-9ba9-30a489dfd3d8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:59.350602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146d3b4-6a40-420c-9ba9-30a489dfd3d8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:59.375997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03f0eb-585a-43b1-ab17-9d9d804df7aa tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f91a0291fa5471fb00c277afcc6cd4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53c511270a28479a8cf4c01572622e41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:59.378830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03f0eb-585a-43b1-ab17-9d9d804df7aa tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:59.380569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03f0eb-585a-43b1-ab17-9d9d804df7aa tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:59.381804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03f0eb-585a-43b1-ab17-9d9d804df7aa tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:59.382640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03f0eb-585a-43b1-ab17-9d9d804df7aa tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:59.388722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03f0eb-585a-43b1-ab17-9d9d804df7aa tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:59.428227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-ae03f0eb-585a-43b1-ab17-9d9d804df7aa tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invalid input for field 'name': '' is too short Sep 30 10:08:59.428227 n-d-master-1 devstack@keystone.service[82079]: Failed validating 'minLength' in schema['properties']['name']: Sep 30 10:08:59.428227 n-d-master-1 devstack@keystone.service[82079]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 30 10:08:59.428227 n-d-master-1 devstack@keystone.service[82079]: On instance['name']: Sep 30 10:08:59.428227 n-d-master-1 devstack@keystone.service[82079]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Sep 30 10:08:59.428227 n-d-master-1 devstack@keystone.service[82079]: Failed validating 'minLength' in schema['properties']['name']: Sep 30 10:08:59.428227 n-d-master-1 devstack@keystone.service[82079]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 30 10:08:59.428227 n-d-master-1 devstack@keystone.service[82079]: On instance['name']: Sep 30 10:08:59.428227 n-d-master-1 devstack@keystone.service[82079]: '' Sep 30 10:08:59.428227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:08:59.428227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 30 10:08:59.428227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 30 10:08:59.428227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 30 10:08:59.428227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise error Sep 30 10:08:59.428227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Sep 30 10:08:59.428227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:08:59.428227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Sep 30 10:08:59.428227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 30 10:08:59.428227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:08:59.428227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application On instance['name']: Sep 30 10:08:59.428227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application '' Sep 30 10:08:59.428227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:08:59.428227 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:08:59.437245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:08:59.437245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:08:59.437245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:08:59.437245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:08:59.437245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:08:59.437245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:08:59.437245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:08:59.437245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:08:59.437245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:08:59.437245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:08:59.437245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:08:59.437245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:08:59.437245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Sep 30 10:08:59.437245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Sep 30 10:08:59.437245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 30 10:08:59.437245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 30 10:08:59.437245 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 30 10:08:59.450093 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 30 10:08:59.450093 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Sep 30 10:08:59.450093 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:08:59.450093 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Sep 30 10:08:59.450093 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 30 10:08:59.450093 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:08:59.450093 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application On instance['name']: Sep 30 10:08:59.450093 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application '' Sep 30 10:08:59.450093 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:08:59.450093 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2992/5969] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:08:59 2022] POST /identity/v3/domains => generated 283 bytes in 119 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Sep 30 10:08:59.462746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08058ac-cd64-4ca8-995d-8c0e7072c461 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:59.474952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08058ac-cd64-4ca8-995d-8c0e7072c461 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:59.487317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466fe93-876a-4574-8796-b2d9bf9f0ea2 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f91a0291fa5471fb00c277afcc6cd4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53c511270a28479a8cf4c01572622e41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:59.488067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466fe93-876a-4574-8796-b2d9bf9f0ea2 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:59.488453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466fe93-876a-4574-8796-b2d9bf9f0ea2 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:59.489467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466fe93-876a-4574-8796-b2d9bf9f0ea2 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:59.490154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466fe93-876a-4574-8796-b2d9bf9f0ea2 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:59.493862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466fe93-876a-4574-8796-b2d9bf9f0ea2 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:59.527927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-3466fe93-876a-4574-8796-b2d9bf9f0ea2 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 30 10:08:59.527927 n-d-master-1 devstack@keystone.service[82080]: Failed validating 'maxLength' in schema['properties']['name']: Sep 30 10:08:59.527927 n-d-master-1 devstack@keystone.service[82080]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 30 10:08:59.527927 n-d-master-1 devstack@keystone.service[82080]: On instance['name']: Sep 30 10:08:59.527927 n-d-master-1 devstack@keystone.service[82080]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 30 10:08:59.527927 n-d-master-1 devstack@keystone.service[82080]: Failed validating 'maxLength' in schema['properties']['name']: Sep 30 10:08:59.527927 n-d-master-1 devstack@keystone.service[82080]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 30 10:08:59.527927 n-d-master-1 devstack@keystone.service[82080]: On instance['name']: Sep 30 10:08:59.527927 n-d-master-1 devstack@keystone.service[82080]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 30 10:08:59.527927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:08:59.527927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 30 10:08:59.527927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 30 10:08:59.527927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 30 10:08:59.527927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise error Sep 30 10:08:59.527927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 30 10:08:59.527927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:08:59.527927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Sep 30 10:08:59.527927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 30 10:08:59.527927 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:08:59.529437 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application On instance['name']: Sep 30 10:08:59.529437 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 30 10:08:59.529437 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:08:59.529437 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:08:59.529437 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:08:59.529437 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:08:59.529437 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:08:59.529437 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:08:59.529437 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:08:59.529437 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:08:59.529437 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:08:59.529437 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:08:59.529437 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:08:59.529437 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:08:59.529437 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:08:59.529437 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:08:59.529437 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Sep 30 10:08:59.529437 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Sep 30 10:08:59.530751 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 30 10:08:59.530751 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 30 10:08:59.530751 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 30 10:08:59.530751 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 30 10:08:59.530751 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 30 10:08:59.530751 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:08:59.530751 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Sep 30 10:08:59.530751 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 30 10:08:59.530751 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:08:59.530751 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application On instance['name']: Sep 30 10:08:59.530751 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 30 10:08:59.530751 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:08:59.531594 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2978/5970] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:08:59 2022] POST /identity/v3/domains => generated 412 bytes in 73 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 30 10:08:59.541056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03f0eb-585a-43b1-ab17-9d9d804df7aa tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:59.555842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03f0eb-585a-43b1-ab17-9d9d804df7aa tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:59.573268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac3870-e891-455a-a0a7-978318d5d03f tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f91a0291fa5471fb00c277afcc6cd4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53c511270a28479a8cf4c01572622e41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:59.576766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac3870-e891-455a-a0a7-978318d5d03f tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:59.581224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac3870-e891-455a-a0a7-978318d5d03f tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:59.582041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac3870-e891-455a-a0a7-978318d5d03f tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:59.582945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac3870-e891-455a-a0a7-978318d5d03f tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:59.585065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac3870-e891-455a-a0a7-978318d5d03f tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:59.624191 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2993/5971] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:08:59 2022] POST /identity/v3/domains => generated 276 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:08:59.625550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466fe93-876a-4574-8796-b2d9bf9f0ea2 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:59.643474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466fe93-876a-4574-8796-b2d9bf9f0ea2 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:59.752513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623dad93-d644-4eaf-a62f-951af1b2e28e tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f91a0291fa5471fb00c277afcc6cd4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53c511270a28479a8cf4c01572622e41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:59.753560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dad93-d644-4eaf-a62f-951af1b2e28e tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:59.755454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dad93-d644-4eaf-a62f-951af1b2e28e tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:59.756734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dad93-d644-4eaf-a62f-951af1b2e28e tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] PATH_INFO: `/v3/domains/f90d2e93bcb9422e9b4c03b4c3b9e1af` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:59.772313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623dad93-d644-4eaf-a62f-951af1b2e28e tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f90d2e93bcb9422e9b4c03b4c3b9e1af)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:59.774059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623dad93-d644-4eaf-a62f-951af1b2e28e tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:08:59.820333 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-623dad93-d644-4eaf-a62f-951af1b2e28e tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Sep 30 10:08:59.820333 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:08:59.820333 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:08:59.820333 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:08:59.820333 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:08:59.820333 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:08:59.820333 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:08:59.820333 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:08:59.820333 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:08:59.820333 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:08:59.820333 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:08:59.820333 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:08:59.820333 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Sep 30 10:08:59.820333 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Sep 30 10:08:59.821555 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:08:59.821555 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:08:59.821555 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Sep 30 10:08:59.821555 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Sep 30 10:08:59.821555 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Sep 30 10:08:59.821555 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Sep 30 10:08:59.821555 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Sep 30 10:08:59.821555 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:08:59.829004 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2979/5972] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:08:59 2022] DELETE /identity/v3/domains/f90d2e93bcb9422e9b4c03b4c3b9e1af => generated 120 bytes in 205 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Sep 30 10:08:59.838740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac3870-e891-455a-a0a7-978318d5d03f tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:08:59.891245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac3870-e891-455a-a0a7-978318d5d03f tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:08:59.934349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a150f8-38ad-4e79-b45f-00b50e119b3d tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f91a0291fa5471fb00c277afcc6cd4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53c511270a28479a8cf4c01572622e41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:08:59.935280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a150f8-38ad-4e79-b45f-00b50e119b3d tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:08:59.935713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a150f8-38ad-4e79-b45f-00b50e119b3d tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:08:59.936405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a150f8-38ad-4e79-b45f-00b50e119b3d tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] PATH_INFO: `/v3/domains/f90d2e93bcb9422e9b4c03b4c3b9e1af` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:08:59.946101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a150f8-38ad-4e79-b45f-00b50e119b3d tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f90d2e93bcb9422e9b4c03b4c3b9e1af)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:08:59.946101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a150f8-38ad-4e79-b45f-00b50e119b3d tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:00.003647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-52a150f8-38ad-4e79-b45f-00b50e119b3d tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f90d2e93bcb9422e9b4c03b4c3b9e1af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:00.006585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-52a150f8-38ad-4e79-b45f-00b50e119b3d tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f90d2e93bcb9422e9b4c03b4c3b9e1af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:00.049862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-52a150f8-38ad-4e79-b45f-00b50e119b3d tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f90d2e93bcb9422e9b4c03b4c3b9e1af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:00.050764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-52a150f8-38ad-4e79-b45f-00b50e119b3d tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f90d2e93bcb9422e9b4c03b4c3b9e1af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:00.054190 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2994/5973] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:08:59 2022] PATCH /identity/v3/domains/f90d2e93bcb9422e9b4c03b4c3b9e1af => generated 277 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:09:00.058599 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623dad93-d644-4eaf-a62f-951af1b2e28e tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:00.060351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-623dad93-d644-4eaf-a62f-951af1b2e28e tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:00.097876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623dad93-d644-4eaf-a62f-951af1b2e28e tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:00.259716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0edb6-31d0-41b0-92a9-76a636887c4c tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f91a0291fa5471fb00c277afcc6cd4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53c511270a28479a8cf4c01572622e41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:00.260907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0edb6-31d0-41b0-92a9-76a636887c4c tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:00.261193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0edb6-31d0-41b0-92a9-76a636887c4c tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:00.261632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0edb6-31d0-41b0-92a9-76a636887c4c tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] PATH_INFO: `/v3/domains/f90d2e93bcb9422e9b4c03b4c3b9e1af` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:00.299655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0edb6-31d0-41b0-92a9-76a636887c4c tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f90d2e93bcb9422e9b4c03b4c3b9e1af)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:00.304749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0edb6-31d0-41b0-92a9-76a636887c4c tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:00.308105 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:00.445999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1dc0edb6-31d0-41b0-92a9-76a636887c4c tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f90d2e93bcb9422e9b4c03b4c3b9e1af'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:00.464277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1dc0edb6-31d0-41b0-92a9-76a636887c4c tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f90d2e93bcb9422e9b4c03b4c3b9e1af'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:00.639098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1dc0edb6-31d0-41b0-92a9-76a636887c4c tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f90d2e93bcb9422e9b4c03b4c3b9e1af', 'request_id': 'req-1dc0edb6-31d0-41b0-92a9-76a636887c4c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:00.656192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1dc0edb6-31d0-41b0-92a9-76a636887c4c tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f90d2e93bcb9422e9b4c03b4c3b9e1af', 'request_id': 'req-1dc0edb6-31d0-41b0-92a9-76a636887c4c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:00.664943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1dc0edb6-31d0-41b0-92a9-76a636887c4c tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f90d2e93bcb9422e9b4c03b4c3b9e1af', 'request_id': 'req-1dc0edb6-31d0-41b0-92a9-76a636887c4c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:00.698586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1dc0edb6-31d0-41b0-92a9-76a636887c4c tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] The token cache is being invalidate because project f90d2e93bcb9422e9b4c03b4c3b9e1af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:09:00.698887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1dc0edb6-31d0-41b0-92a9-76a636887c4c tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:00.699947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1dc0edb6-31d0-41b0-92a9-76a636887c4c tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:00.721262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1dc0edb6-31d0-41b0-92a9-76a636887c4c tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f90d2e93bcb9422e9b4c03b4c3b9e1af', 'request_id': 'req-1dc0edb6-31d0-41b0-92a9-76a636887c4c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:00.729110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1dc0edb6-31d0-41b0-92a9-76a636887c4c tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f90d2e93bcb9422e9b4c03b4c3b9e1af', 'request_id': 'req-1dc0edb6-31d0-41b0-92a9-76a636887c4c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:00.730541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1dc0edb6-31d0-41b0-92a9-76a636887c4c tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f90d2e93bcb9422e9b4c03b4c3b9e1af', 'request_id': 'req-1dc0edb6-31d0-41b0-92a9-76a636887c4c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:00.743323 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2980/5974] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:09:00 2022] DELETE /identity/v3/domains/f90d2e93bcb9422e9b4c03b4c3b9e1af => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:00.750886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a150f8-38ad-4e79-b45f-00b50e119b3d tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:00.798935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a150f8-38ad-4e79-b45f-00b50e119b3d tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:00.954491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4846f-849d-46ef-a613-b9a9667caa99 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f91a0291fa5471fb00c277afcc6cd4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53c511270a28479a8cf4c01572622e41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:00.960822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4846f-849d-46ef-a613-b9a9667caa99 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:00.961339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4846f-849d-46ef-a613-b9a9667caa99 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:00.961801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4846f-849d-46ef-a613-b9a9667caa99 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] PATH_INFO: `/v3/domains/8e276b5bf2f54e72906a5339165ad631` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:00.972569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4846f-849d-46ef-a613-b9a9667caa99 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 10:09:00.993589 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-d6a4846f-849d-46ef-a613-b9a9667caa99 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Could not find domain: 8e276b5bf2f54e72906a5339165ad631.: keystone.exception.DomainNotFound: Could not find domain: 8e276b5bf2f54e72906a5339165ad631. Sep 30 10:09:00.993589 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:09:00.993589 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 30 10:09:00.993589 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 30 10:09:00.993589 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 10:09:00.993589 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 10:09:00.993589 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 10:09:00.993589 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 10:09:00.993589 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8e276b5bf2f54e72906a5339165ad631. Sep 30 10:09:00.993589 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:09:00.993589 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:09:00.993589 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:09:00.993589 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:09:00.993589 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:09:00.993589 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:09:00.995128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:09:00.995128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:09:00.995128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:09:00.995128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:09:00.995128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:09:00.995128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:09:00.995128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:09:00.995128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:09:00.995128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Sep 30 10:09:00.995128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Sep 30 10:09:00.995128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 10:09:00.995128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 10:09:00.995128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 10:09:00.995128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 10:09:00.995128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:09:00.995128 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:09:00.999675 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:09:00.999675 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:09:00.999675 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:09:00.999675 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:09:00.999675 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:09:00.999675 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 10:09:00.999675 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:09:00.999675 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:09:00.999675 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:09:00.999675 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:09:00.999675 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:09:00.999675 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:09:00.999675 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:09:00.999675 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:09:00.999675 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 30 10:09:00.999675 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 10:09:00.999675 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8e276b5bf2f54e72906a5339165ad631. Sep 30 10:09:01.001632 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:09:01.007691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0edb6-31d0-41b0-92a9-76a636887c4c tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:01.008038 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2995/5975] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:09:00 2022] DELETE /identity/v3/domains/8e276b5bf2f54e72906a5339165ad631 => generated 112 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:09:01.009250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1dc0edb6-31d0-41b0-92a9-76a636887c4c tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:01.043198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0edb6-31d0-41b0-92a9-76a636887c4c tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:01.060155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081dfb3e-257a-40b1-a6e1-68fd90a9b267 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f91a0291fa5471fb00c277afcc6cd4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53c511270a28479a8cf4c01572622e41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:01.065218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dfb3e-257a-40b1-a6e1-68fd90a9b267 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:01.065784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dfb3e-257a-40b1-a6e1-68fd90a9b267 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:01.066109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dfb3e-257a-40b1-a6e1-68fd90a9b267 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:01.068465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081dfb3e-257a-40b1-a6e1-68fd90a9b267 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:01.075623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081dfb3e-257a-40b1-a6e1-68fd90a9b267 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:01.162522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4846f-849d-46ef-a613-b9a9667caa99 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:01.176973 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2981/5976] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:09:01 2022] POST /identity/v3/domains => generated 253 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:01.183932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4846f-849d-46ef-a613-b9a9667caa99 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:01.313943 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:01.333561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb284f-aa02-4e5d-acf9-6bc676e887b5 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f91a0291fa5471fb00c277afcc6cd4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53c511270a28479a8cf4c01572622e41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:01.334195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb284f-aa02-4e5d-acf9-6bc676e887b5 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:01.334469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb284f-aa02-4e5d-acf9-6bc676e887b5 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:01.334948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb284f-aa02-4e5d-acf9-6bc676e887b5 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:01.335789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb284f-aa02-4e5d-acf9-6bc676e887b5 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:01.337644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb284f-aa02-4e5d-acf9-6bc676e887b5 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:01.360010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.sql.core [None req-d9bb284f-aa02-4e5d-acf9-6bc676e887b5 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1818290856' for key 'project.ixu_project_name_domain_id'") Sep 30 10:09:01.360010 n-d-master-1 devstack@keystone.service[82079]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 30 10:09:01.360010 n-d-master-1 devstack@keystone.service[82079]: [parameters: {'id': '72459227b88a42a289409eee17d3e4a3', 'name': 'tempest-domain-dup-1818290856', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Sep 30 10:09:01.360010 n-d-master-1 devstack@keystone.service[82079]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82079) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 30 10:09:01.369734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-d9bb284f-aa02-4e5d-acf9-6bc676e887b5 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1818290856.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1818290856. Sep 30 10:09:01.369734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:09:01.369734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 10:09:01.369734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 10:09:01.369734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 10:09:01.369734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 10:09:01.369734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 10:09:01.369734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 10:09:01.369734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 10:09:01.369734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application conn.query(q) Sep 30 10:09:01.369734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 10:09:01.369734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 10:09:01.369734 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 10:09:01.371010 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result.read() Sep 30 10:09:01.371010 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 10:09:01.371010 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 10:09:01.371010 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 10:09:01.371010 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 10:09:01.371010 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 10:09:01.371010 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 10:09:01.371010 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 10:09:01.371010 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 10:09:01.371010 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-1818290856' for key 'project.ixu_project_name_domain_id'") Sep 30 10:09:01.371010 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:09:01.371010 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 30 10:09:01.371010 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:09:01.371010 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:09:01.371010 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 30 10:09:01.371010 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 30 10:09:01.371010 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 30 10:09:01.371010 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 30 10:09:01.372342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 10:09:01.372342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application next(self.gen) Sep 30 10:09:01.372342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 30 10:09:01.372342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application yield resource Sep 30 10:09:01.372342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 10:09:01.372342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application next(self.gen) Sep 30 10:09:01.372342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 30 10:09:01.372342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.session.rollback() Sep 30 10:09:01.372342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 30 10:09:01.372342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.force_reraise() Sep 30 10:09:01.372342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 30 10:09:01.372342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise self.value Sep 30 10:09:01.372342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 30 10:09:01.372342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 30 10:09:01.372342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 30 10:09:01.372342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application session.commit() Sep 30 10:09:01.372342 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 30 10:09:01.373592 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 30 10:09:01.373592 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 30 10:09:01.373592 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._prepare_impl() Sep 30 10:09:01.373592 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 30 10:09:01.373592 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.session.flush() Sep 30 10:09:01.373592 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 30 10:09:01.373592 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._flush(objects) Sep 30 10:09:01.373592 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 30 10:09:01.373592 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 30 10:09:01.373592 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 30 10:09:01.373592 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application compat.raise_( Sep 30 10:09:01.373592 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 10:09:01.373592 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception Sep 30 10:09:01.373592 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 30 10:09:01.373592 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application flush_context.execute() Sep 30 10:09:01.373592 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 30 10:09:01.373592 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rec.execute(self) Sep 30 10:09:01.375203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 30 10:09:01.375203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 30 10:09:01.375203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 30 10:09:01.375203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 30 10:09:01.375203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 30 10:09:01.375203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 30 10:09:01.375203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 30 10:09:01.375203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 30 10:09:01.375203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 30 10:09:01.375203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 30 10:09:01.375203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 30 10:09:01.375203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 30 10:09:01.375203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 30 10:09:01.375203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 30 10:09:01.375203 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 30 10:09:01.376311 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 30 10:09:01.376311 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 10:09:01.376311 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception Sep 30 10:09:01.376311 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 10:09:01.376311 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 10:09:01.376311 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 10:09:01.376311 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 10:09:01.376311 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 10:09:01.376311 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 10:09:01.376311 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 10:09:01.376311 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application conn.query(q) Sep 30 10:09:01.376311 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 10:09:01.376311 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 10:09:01.376311 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 10:09:01.376311 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result.read() Sep 30 10:09:01.376311 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 10:09:01.376311 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 10:09:01.377816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 10:09:01.377816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 10:09:01.377816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 10:09:01.377816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 10:09:01.377816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 10:09:01.377816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 10:09:01.377816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1818290856' for key 'project.ixu_project_name_domain_id'") Sep 30 10:09:01.377816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 30 10:09:01.377816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [parameters: {'id': '72459227b88a42a289409eee17d3e4a3', 'name': 'tempest-domain-dup-1818290856', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Sep 30 10:09:01.377816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 30 10:09:01.377816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:09:01.377816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:09:01.377816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:09:01.377816 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:09:01.380488 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 30 10:09:01.380488 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 30 10:09:01.380488 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 30 10:09:01.380488 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 30 10:09:01.380488 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-1818290856. Sep 30 10:09:01.380488 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:09:01.380488 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:09:01.380488 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:09:01.380488 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:09:01.380488 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:09:01.380488 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:09:01.380488 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:09:01.380488 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:09:01.380488 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:09:01.380488 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:09:01.380488 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:09:01.380488 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:09:01.382638 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:09:01.382638 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:09:01.382638 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Sep 30 10:09:01.382638 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Sep 30 10:09:01.382638 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:09:01.382638 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:09:01.382638 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Sep 30 10:09:01.382638 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Sep 30 10:09:01.382638 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:09:01.382638 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:09:01.382638 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 30 10:09:01.382638 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 30 10:09:01.382638 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1818290856. Sep 30 10:09:01.382638 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:09:01.385555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081dfb3e-257a-40b1-a6e1-68fd90a9b267 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:01.385664 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2996/5977] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:09:01 2022] POST /identity/v3/domains => generated 212 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 30 10:09:01.398027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081dfb3e-257a-40b1-a6e1-68fd90a9b267 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:01.408688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb32797-e8ae-49a5-bad4-b7936817f101 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f91a0291fa5471fb00c277afcc6cd4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53c511270a28479a8cf4c01572622e41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:01.411137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb32797-e8ae-49a5-bad4-b7936817f101 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:01.411559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb32797-e8ae-49a5-bad4-b7936817f101 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:01.411943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb32797-e8ae-49a5-bad4-b7936817f101 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] PATH_INFO: `/v3/domains/c8c7d8bf97d84fecb0d1b9b84b708672` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:01.446582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb32797-e8ae-49a5-bad4-b7936817f101 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c8c7d8bf97d84fecb0d1b9b84b708672)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:01.449438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb32797-e8ae-49a5-bad4-b7936817f101 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:01.508940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-adb32797-e8ae-49a5-bad4-b7936817f101 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c8c7d8bf97d84fecb0d1b9b84b708672'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:01.509863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-adb32797-e8ae-49a5-bad4-b7936817f101 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c8c7d8bf97d84fecb0d1b9b84b708672'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:01.576627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-adb32797-e8ae-49a5-bad4-b7936817f101 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c8c7d8bf97d84fecb0d1b9b84b708672'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:01.576627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-adb32797-e8ae-49a5-bad4-b7936817f101 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c8c7d8bf97d84fecb0d1b9b84b708672'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:01.577150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb284f-aa02-4e5d-acf9-6bc676e887b5 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:01.579711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d9bb284f-aa02-4e5d-acf9-6bc676e887b5 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:01.579881 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2982/5978] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:09:01 2022] PATCH /identity/v3/domains/c8c7d8bf97d84fecb0d1b9b84b708672 => generated 254 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:09:01.604610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb284f-aa02-4e5d-acf9-6bc676e887b5 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:01.756676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f91a0291fa5471fb00c277afcc6cd4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53c511270a28479a8cf4c01572622e41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:01.758281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:01.759944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:01.760409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] PATH_INFO: `/v3/domains/c8c7d8bf97d84fecb0d1b9b84b708672` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:01.790163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c8c7d8bf97d84fecb0d1b9b84b708672)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:01.792249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:01.886625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c8c7d8bf97d84fecb0d1b9b84b708672'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:01.899440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c8c7d8bf97d84fecb0d1b9b84b708672'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:02.175137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8c7d8bf97d84fecb0d1b9b84b708672', 'request_id': 'req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:02.189615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8c7d8bf97d84fecb0d1b9b84b708672', 'request_id': 'req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:02.251754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8c7d8bf97d84fecb0d1b9b84b708672', 'request_id': 'req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:02.300022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] The token cache is being invalidate because project c8c7d8bf97d84fecb0d1b9b84b708672 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:09:02.300330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:02.310456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:02.329291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c8c7d8bf97d84fecb0d1b9b84b708672', 'request_id': 'req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:02.330590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c8c7d8bf97d84fecb0d1b9b84b708672', 'request_id': 'req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:02.341713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c8c7d8bf97d84fecb0d1b9b84b708672', 'request_id': 'req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:02.359774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb32797-e8ae-49a5-bad4-b7936817f101 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:02.371305 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2997/5979] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:09:01 2022] DELETE /identity/v3/domains/c8c7d8bf97d84fecb0d1b9b84b708672 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:02.379850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb32797-e8ae-49a5-bad4-b7936817f101 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:02.508229 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:02.553768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f8a92-eaac-4cbf-91ff-69067dd85934 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f91a0291fa5471fb00c277afcc6cd4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53c511270a28479a8cf4c01572622e41', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:02.555253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f8a92-eaac-4cbf-91ff-69067dd85934 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:02.555733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f8a92-eaac-4cbf-91ff-69067dd85934 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:02.556210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f8a92-eaac-4cbf-91ff-69067dd85934 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] PATH_INFO: `/v3/domains/f90d2e93bcb9422e9b4c03b4c3b9e1af` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:02.565690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f8a92-eaac-4cbf-91ff-69067dd85934 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 10:09:02.571882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-011f8a92-eaac-4cbf-91ff-69067dd85934 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Could not find domain: f90d2e93bcb9422e9b4c03b4c3b9e1af.: keystone.exception.DomainNotFound: Could not find domain: f90d2e93bcb9422e9b4c03b4c3b9e1af. Sep 30 10:09:02.571882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:09:02.571882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 30 10:09:02.571882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 30 10:09:02.571882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 10:09:02.571882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 10:09:02.571882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 10:09:02.571882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 10:09:02.571882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f90d2e93bcb9422e9b4c03b4c3b9e1af. Sep 30 10:09:02.571882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:09:02.571882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:09:02.571882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:09:02.571882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:09:02.571882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:09:02.571882 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:09:02.573448 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:09:02.573448 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:09:02.573448 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:09:02.573448 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:09:02.573448 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:09:02.573448 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:09:02.573448 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:09:02.573448 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:09:02.573448 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 30 10:09:02.573448 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 30 10:09:02.573448 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 10:09:02.573448 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 10:09:02.573448 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 10:09:02.573448 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 10:09:02.573448 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:09:02.573448 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:09:02.574794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:09:02.574794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:09:02.574794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:09:02.574794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:09:02.574794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:09:02.574794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 10:09:02.574794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:09:02.574794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:09:02.574794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:09:02.574794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:09:02.574794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:09:02.574794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:09:02.574794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:09:02.574794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:09:02.574794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 30 10:09:02.574794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 10:09:02.574794 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f90d2e93bcb9422e9b4c03b4c3b9e1af. Sep 30 10:09:02.576205 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:09:02.576742 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2983/5980] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:09:02 2022] PATCH /identity/v3/domains/f90d2e93bcb9422e9b4c03b4c3b9e1af => generated 112 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:09:02.578723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:02.580435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:02.663916 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:02.737163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bc75f-7bfd-456c-a5e5-35cb5f8f9536 tempest-DomainsNegativeTestJSON-1148503046 tempest-DomainsNegativeTestJSON-1148503046-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:02.765950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fe1ad-aaca-49c8-ac64-bbb6de7f4ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:02.774078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fe1ad-aaca-49c8-ac64-bbb6de7f4ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:02.774405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fe1ad-aaca-49c8-ac64-bbb6de7f4ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:02.774712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fe1ad-aaca-49c8-ac64-bbb6de7f4ac9 admin admin] PATH_INFO: `/v3/users/690d10bef69d4193b23ed77febdd4ed8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:02.779824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274fe1ad-aaca-49c8-ac64-bbb6de7f4ac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=690d10bef69d4193b23ed77febdd4ed8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:02.784621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274fe1ad-aaca-49c8-ac64-bbb6de7f4ac9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:02.905591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-274fe1ad-aaca-49c8-ac64-bbb6de7f4ac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '690d10bef69d4193b23ed77febdd4ed8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:02.906968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-274fe1ad-aaca-49c8-ac64-bbb6de7f4ac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '690d10bef69d4193b23ed77febdd4ed8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:02.926587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-274fe1ad-aaca-49c8-ac64-bbb6de7f4ac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '690d10bef69d4193b23ed77febdd4ed8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:02.969377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-274fe1ad-aaca-49c8-ac64-bbb6de7f4ac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '690d10bef69d4193b23ed77febdd4ed8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:02.994325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-274fe1ad-aaca-49c8-ac64-bbb6de7f4ac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '690d10bef69d4193b23ed77febdd4ed8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:03.017624 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2998/5981] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:09:02 2022] DELETE /identity/v3/users/690d10bef69d4193b23ed77febdd4ed8 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:03.025616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57180b-45f2-4964-a40d-a37fdf900811 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:03.025918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57180b-45f2-4964-a40d-a37fdf900811 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:03.026197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57180b-45f2-4964-a40d-a37fdf900811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:03.116074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4d57180b-45f2-4964-a40d-a37fdf900811 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:03.117690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4d57180b-45f2-4964-a40d-a37fdf900811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:03.374700 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2984/5982] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:03.593168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fe1ad-aaca-49c8-ac64-bbb6de7f4ac9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:03.595685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-274fe1ad-aaca-49c8-ac64-bbb6de7f4ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:03.693394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fe1ad-aaca-49c8-ac64-bbb6de7f4ac9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:03.707114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1696a1-9b6b-4000-a8b9-866e69833d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:03.707997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1696a1-9b6b-4000-a8b9-866e69833d44 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:03.708399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1696a1-9b6b-4000-a8b9-866e69833d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:03.708871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1696a1-9b6b-4000-a8b9-866e69833d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:03.739035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1696a1-9b6b-4000-a8b9-866e69833d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:03.740828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1696a1-9b6b-4000-a8b9-866e69833d44 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:03.761614 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2999/5983] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:09:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:09:05.528572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57180b-45f2-4964-a40d-a37fdf900811 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:05.533423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4d57180b-45f2-4964-a40d-a37fdf900811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:05.566954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57180b-45f2-4964-a40d-a37fdf900811 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:05.582152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb134bf-a171-47df-a3fa-2f96316ab530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:05.582804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb134bf-a171-47df-a3fa-2f96316ab530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:05.583078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb134bf-a171-47df-a3fa-2f96316ab530 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:05.583343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb134bf-a171-47df-a3fa-2f96316ab530 admin admin] PATH_INFO: `/v3/projects/fbc7c1393bdd49dab121ac5c43cfdd8a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:05.588969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb134bf-a171-47df-a3fa-2f96316ab530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbc7c1393bdd49dab121ac5c43cfdd8a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:05.600268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb134bf-a171-47df-a3fa-2f96316ab530 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:05.741696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0bb134bf-a171-47df-a3fa-2f96316ab530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbc7c1393bdd49dab121ac5c43cfdd8a', 'request_id': 'req-0bb134bf-a171-47df-a3fa-2f96316ab530'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:05.783747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0bb134bf-a171-47df-a3fa-2f96316ab530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbc7c1393bdd49dab121ac5c43cfdd8a', 'request_id': 'req-0bb134bf-a171-47df-a3fa-2f96316ab530'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:05.796627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0bb134bf-a171-47df-a3fa-2f96316ab530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbc7c1393bdd49dab121ac5c43cfdd8a', 'request_id': 'req-0bb134bf-a171-47df-a3fa-2f96316ab530'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:05.826864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0bb134bf-a171-47df-a3fa-2f96316ab530 admin admin] The token cache is being invalidate because project fbc7c1393bdd49dab121ac5c43cfdd8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:09:05.827460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0bb134bf-a171-47df-a3fa-2f96316ab530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:05.828313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0bb134bf-a171-47df-a3fa-2f96316ab530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:05.833468 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2985/5984] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:09:05 2022] DELETE /identity/v3/projects/fbc7c1393bdd49dab121ac5c43cfdd8a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:05.834722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1696a1-9b6b-4000-a8b9-866e69833d44 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:05.847524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1696a1-9b6b-4000-a8b9-866e69833d44 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:06.002325 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:06.026392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111075c6-6a96-4141-863c-47954b016533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:06.027371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111075c6-6a96-4141-863c-47954b016533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:06.027514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111075c6-6a96-4141-863c-47954b016533 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:06.027767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111075c6-6a96-4141-863c-47954b016533 admin admin] PATH_INFO: `/v3/users/2f91a0291fa5471fb00c277afcc6cd4e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:06.029104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111075c6-6a96-4141-863c-47954b016533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f91a0291fa5471fb00c277afcc6cd4e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:06.033027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111075c6-6a96-4141-863c-47954b016533 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:06.144038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-111075c6-6a96-4141-863c-47954b016533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f91a0291fa5471fb00c277afcc6cd4e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:06.144878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-111075c6-6a96-4141-863c-47954b016533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f91a0291fa5471fb00c277afcc6cd4e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:06.161132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-111075c6-6a96-4141-863c-47954b016533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f91a0291fa5471fb00c277afcc6cd4e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:06.209343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-111075c6-6a96-4141-863c-47954b016533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f91a0291fa5471fb00c277afcc6cd4e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:06.228811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-111075c6-6a96-4141-863c-47954b016533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f91a0291fa5471fb00c277afcc6cd4e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:06.243290 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3000/5985] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:09:05 2022] DELETE /identity/v3/users/2f91a0291fa5471fb00c277afcc6cd4e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:08.330846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb134bf-a171-47df-a3fa-2f96316ab530 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:08.332582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0bb134bf-a171-47df-a3fa-2f96316ab530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:08.387169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb134bf-a171-47df-a3fa-2f96316ab530 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:08.607576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e70bf-6f6f-4795-8983-3cde8dc4941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:08.609300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e70bf-6f6f-4795-8983-3cde8dc4941c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:08.609776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e70bf-6f6f-4795-8983-3cde8dc4941c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:08.610205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e70bf-6f6f-4795-8983-3cde8dc4941c admin admin] PATH_INFO: `/v3/users/c245bbebdefe4eccb8661ccb1664e246` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:08.612377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e70bf-6f6f-4795-8983-3cde8dc4941c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c245bbebdefe4eccb8661ccb1664e246)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:08.618937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e70bf-6f6f-4795-8983-3cde8dc4941c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:08.635409 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:08.738416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-871e70bf-6f6f-4795-8983-3cde8dc4941c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c245bbebdefe4eccb8661ccb1664e246'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:08.757542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-871e70bf-6f6f-4795-8983-3cde8dc4941c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c245bbebdefe4eccb8661ccb1664e246'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:08.758181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-871e70bf-6f6f-4795-8983-3cde8dc4941c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c245bbebdefe4eccb8661ccb1664e246'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:08.787646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-871e70bf-6f6f-4795-8983-3cde8dc4941c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c245bbebdefe4eccb8661ccb1664e246'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:08.807399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-871e70bf-6f6f-4795-8983-3cde8dc4941c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c245bbebdefe4eccb8661ccb1664e246'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:08.826103 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2986/5986] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:09:08 2022] DELETE /identity/v3/users/c245bbebdefe4eccb8661ccb1664e246 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:08.829006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa17091-d67d-40c0-8e55-565c90de5026 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:08.829521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa17091-d67d-40c0-8e55-565c90de5026 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:08.830728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa17091-d67d-40c0-8e55-565c90de5026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:08.920306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9fa17091-d67d-40c0-8e55-565c90de5026 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:08.927985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9fa17091-d67d-40c0-8e55-565c90de5026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:09.124152 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3001/5987] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:09.144848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e70bf-6f6f-4795-8983-3cde8dc4941c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:09.147636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-871e70bf-6f6f-4795-8983-3cde8dc4941c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:09.334049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e70bf-6f6f-4795-8983-3cde8dc4941c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:09.338044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cabfe-c99e-475d-b1b2-ed69c77e2ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:09.338831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cabfe-c99e-475d-b1b2-ed69c77e2ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:09.339120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cabfe-c99e-475d-b1b2-ed69c77e2ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:09.339394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cabfe-c99e-475d-b1b2-ed69c77e2ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:09.367379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124cabfe-c99e-475d-b1b2-ed69c77e2ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:09.368846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124cabfe-c99e-475d-b1b2-ed69c77e2ac4 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:09.402816 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2987/5988] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:09:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:09:09.826759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa17091-d67d-40c0-8e55-565c90de5026 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:09.828615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9fa17091-d67d-40c0-8e55-565c90de5026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:09.860935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa17091-d67d-40c0-8e55-565c90de5026 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:09.872123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2cb76-24f6-4e64-86aa-22228db227c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:09.881265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2cb76-24f6-4e64-86aa-22228db227c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:09.881993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2cb76-24f6-4e64-86aa-22228db227c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:09.882499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2cb76-24f6-4e64-86aa-22228db227c7 admin admin] PATH_INFO: `/v3/projects/9c0728311a114f9b80b5bb458b271d56` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:09.884136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2cb76-24f6-4e64-86aa-22228db227c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c0728311a114f9b80b5bb458b271d56)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:09.886330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2cb76-24f6-4e64-86aa-22228db227c7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:10.017817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cabfe-c99e-475d-b1b2-ed69c77e2ac4 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:10.019477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-124cabfe-c99e-475d-b1b2-ed69c77e2ac4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:10.058642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cabfe-c99e-475d-b1b2-ed69c77e2ac4 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:10.100580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-20b2cb76-24f6-4e64-86aa-22228db227c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c0728311a114f9b80b5bb458b271d56', 'request_id': 'req-20b2cb76-24f6-4e64-86aa-22228db227c7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:10.114978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-20b2cb76-24f6-4e64-86aa-22228db227c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c0728311a114f9b80b5bb458b271d56', 'request_id': 'req-20b2cb76-24f6-4e64-86aa-22228db227c7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:10.123931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-20b2cb76-24f6-4e64-86aa-22228db227c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c0728311a114f9b80b5bb458b271d56', 'request_id': 'req-20b2cb76-24f6-4e64-86aa-22228db227c7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:10.137945 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:10.190498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-20b2cb76-24f6-4e64-86aa-22228db227c7 admin admin] The token cache is being invalidate because project 9c0728311a114f9b80b5bb458b271d56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:09:10.192066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-20b2cb76-24f6-4e64-86aa-22228db227c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:10.194612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-20b2cb76-24f6-4e64-86aa-22228db227c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:10.199109 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3002/5989] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:09:09 2022] DELETE /identity/v3/projects/9c0728311a114f9b80b5bb458b271d56 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:10.204947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e16321-fed8-496b-a072-f30993cec3bb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:10.205323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e16321-fed8-496b-a072-f30993cec3bb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:10.205829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e16321-fed8-496b-a072-f30993cec3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:10.236904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b32e2-57cc-402c-93f2-79172294919b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:10.237665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b32e2-57cc-402c-93f2-79172294919b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:10.238017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b32e2-57cc-402c-93f2-79172294919b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:10.238366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b32e2-57cc-402c-93f2-79172294919b admin admin] PATH_INFO: `/v3/projects/53c511270a28479a8cf4c01572622e41` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:10.240690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b32e2-57cc-402c-93f2-79172294919b admin admin] RBAC: Authorizing `identity:delete_project(project_id=53c511270a28479a8cf4c01572622e41)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:10.244759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b32e2-57cc-402c-93f2-79172294919b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:10.256851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-31e16321-fed8-496b-a072-f30993cec3bb None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:10.258356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-31e16321-fed8-496b-a072-f30993cec3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:10.280536 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3003/5990] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:09:10.284098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da064955-447f-42d7-a844-0c4ed0afd66a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:10.284506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da064955-447f-42d7-a844-0c4ed0afd66a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:10.284913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da064955-447f-42d7-a844-0c4ed0afd66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:10.319506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-da064955-447f-42d7-a844-0c4ed0afd66a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:10.321186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-da064955-447f-42d7-a844-0c4ed0afd66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:10.335421 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:10.359115 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3004/5991] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:09:10.363413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da064955-447f-42d7-a844-0c4ed0afd66a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:10.367560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7b6b32e2-57cc-402c-93f2-79172294919b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53c511270a28479a8cf4c01572622e41', 'request_id': 'req-7b6b32e2-57cc-402c-93f2-79172294919b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:10.383130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da064955-447f-42d7-a844-0c4ed0afd66a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:10.391259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7b6b32e2-57cc-402c-93f2-79172294919b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53c511270a28479a8cf4c01572622e41', 'request_id': 'req-7b6b32e2-57cc-402c-93f2-79172294919b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:10.398946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7b6b32e2-57cc-402c-93f2-79172294919b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53c511270a28479a8cf4c01572622e41', 'request_id': 'req-7b6b32e2-57cc-402c-93f2-79172294919b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:10.421260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7b6b32e2-57cc-402c-93f2-79172294919b admin admin] The token cache is being invalidate because project 53c511270a28479a8cf4c01572622e41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:09:10.421652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7b6b32e2-57cc-402c-93f2-79172294919b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:10.423221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7b6b32e2-57cc-402c-93f2-79172294919b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:10.425436 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2988/5992] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:09:10 2022] DELETE /identity/v3/projects/53c511270a28479a8cf4c01572622e41 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:10.430426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbca10-831d-4d16-b49c-e495aa62fef4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:10.431031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbca10-831d-4d16-b49c-e495aa62fef4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:10.431508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbca10-831d-4d16-b49c-e495aa62fef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:10.465959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6ffbca10-831d-4d16-b49c-e495aa62fef4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:10.471892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6ffbca10-831d-4d16-b49c-e495aa62fef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:10.502223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a4ae1-7f62-4d61-8130-814852ecc413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:10.503168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a4ae1-7f62-4d61-8130-814852ecc413 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:10.503896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a4ae1-7f62-4d61-8130-814852ecc413 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:10.505267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a4ae1-7f62-4d61-8130-814852ecc413 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:10.506239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a4ae1-7f62-4d61-8130-814852ecc413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:09:10.509836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a4ae1-7f62-4d61-8130-814852ecc413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:10.511714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a4ae1-7f62-4d61-8130-814852ecc413 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:10.563086 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3005/5993] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:09:10.584440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a4ae1-7f62-4d61-8130-814852ecc413 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:10.588543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-302a4ae1-7f62-4d61-8130-814852ecc413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:10.604586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a4ae1-7f62-4d61-8130-814852ecc413 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:10.610904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc2efb-f0d9-4b84-984b-b48d626d5c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:10.611871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc2efb-f0d9-4b84-984b-b48d626d5c76 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:10.612339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc2efb-f0d9-4b84-984b-b48d626d5c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:10.612836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc2efb-f0d9-4b84-984b-b48d626d5c76 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:10.613652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc2efb-f0d9-4b84-984b-b48d626d5c76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:10.616090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc2efb-f0d9-4b84-984b-b48d626d5c76 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:10.679294 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3006/5994] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:09:10 2022] POST /identity/v3/projects => generated 361 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:10.682016 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2989/5995] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:09:10.683429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc2efb-f0d9-4b84-984b-b48d626d5c76 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:10.691531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33bda2-c821-46af-adbe-9b57e7483121 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:10.691815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33bda2-c821-46af-adbe-9b57e7483121 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:10.692104 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33bda2-c821-46af-adbe-9b57e7483121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:10.734305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8d33bda2-c821-46af-adbe-9b57e7483121 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:10.736301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8d33bda2-c821-46af-adbe-9b57e7483121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:10.814490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc2efb-f0d9-4b84-984b-b48d626d5c76 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:10.820210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb93fca-1dad-4d6d-8996-59894d6450e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:10.820870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb93fca-1dad-4d6d-8996-59894d6450e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:10.821201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb93fca-1dad-4d6d-8996-59894d6450e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:10.821416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb93fca-1dad-4d6d-8996-59894d6450e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:10.822053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb93fca-1dad-4d6d-8996-59894d6450e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:10.824187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb93fca-1dad-4d6d-8996-59894d6450e4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:10.854527 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2990/5996] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:10.856338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33bda2-c821-46af-adbe-9b57e7483121 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:10.863033 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3007/5997] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:09:10 2022] POST /identity/v3/users => generated 281 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:10.874345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb93fca-1dad-4d6d-8996-59894d6450e4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:10.885624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33bda2-c821-46af-adbe-9b57e7483121 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:10.892220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb93fca-1dad-4d6d-8996-59894d6450e4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:10.898379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf16568-0094-4175-ad80-9776475b8939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:10.899060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf16568-0094-4175-ad80-9776475b8939 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:10.899344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf16568-0094-4175-ad80-9776475b8939 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:10.899631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf16568-0094-4175-ad80-9776475b8939 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:10.902489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf16568-0094-4175-ad80-9776475b8939 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:09:10.902811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf16568-0094-4175-ad80-9776475b8939 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:10.910253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf16568-0094-4175-ad80-9776475b8939 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:10.914049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953bca2-1eda-4239-bf4e-ba73b055ca89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:10.917161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953bca2-1eda-4239-bf4e-ba73b055ca89 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:10.917562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953bca2-1eda-4239-bf4e-ba73b055ca89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:10.922297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953bca2-1eda-4239-bf4e-ba73b055ca89 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:10.923156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953bca2-1eda-4239-bf4e-ba73b055ca89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:10.926366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953bca2-1eda-4239-bf4e-ba73b055ca89 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:10.946207 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3008/5998] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:09:10.949796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953bca2-1eda-4239-bf4e-ba73b055ca89 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:10.957004 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2991/5999] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:09:10.962490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf16568-0094-4175-ad80-9776475b8939 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:10.964069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953bca2-1eda-4239-bf4e-ba73b055ca89 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:10.971128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53759afe-e70c-4fae-9d15-74bb2d91656e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:10.972329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53759afe-e70c-4fae-9d15-74bb2d91656e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:10.972896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53759afe-e70c-4fae-9d15-74bb2d91656e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:10.973236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53759afe-e70c-4fae-9d15-74bb2d91656e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:10.974524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53759afe-e70c-4fae-9d15-74bb2d91656e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:10.976861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53759afe-e70c-4fae-9d15-74bb2d91656e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:10.992262 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3009/6000] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:09:10.995326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf16568-0094-4175-ad80-9776475b8939 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:10.996579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53759afe-e70c-4fae-9d15-74bb2d91656e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:11.012373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410f74c-4944-4b45-9eeb-c4d57a7ae04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:11.013030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410f74c-4944-4b45-9eeb-c4d57a7ae04e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:11.013308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410f74c-4944-4b45-9eeb-c4d57a7ae04e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:11.013583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410f74c-4944-4b45-9eeb-c4d57a7ae04e admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:11.014344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410f74c-4944-4b45-9eeb-c4d57a7ae04e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:11.020821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410f74c-4944-4b45-9eeb-c4d57a7ae04e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:11.029390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53759afe-e70c-4fae-9d15-74bb2d91656e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:11.041769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4b950-f76f-40e3-ab09-ff3a5c1f152d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:11.043132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4b950-f76f-40e3-ab09-ff3a5c1f152d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:11.043657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4b950-f76f-40e3-ab09-ff3a5c1f152d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:11.044152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4b950-f76f-40e3-ab09-ff3a5c1f152d admin admin] PATH_INFO: `/v3/projects/806aefe78f6b447f98b6e5e45385568a/users/04a731cedce8403fb170d7dc8aa57aa7/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:11.078228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4b950-f76f-40e3-ab09-ff3a5c1f152d admin admin] RBAC: Authorizing `identity:create_grant(project_id=806aefe78f6b447f98b6e5e45385568a, user_id=04a731cedce8403fb170d7dc8aa57aa7, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:11.083118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4b950-f76f-40e3-ab09-ff3a5c1f152d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:11.087964 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2992/6001] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:09:10 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:11.092948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410f74c-4944-4b45-9eeb-c4d57a7ae04e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:11.098276 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:11.112418 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3010/6002] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:09:10 2022] PUT /identity/v3/projects/806aefe78f6b447f98b6e5e45385568a/users/04a731cedce8403fb170d7dc8aa57aa7/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:09:11.123522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532c632-012e-45fb-9b9a-b1cecd547f81 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:11.124859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532c632-012e-45fb-9b9a-b1cecd547f81 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:11.125825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532c632-012e-45fb-9b9a-b1cecd547f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:11.156898 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:11.183370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b532c632-012e-45fb-9b9a-b1cecd547f81 None None] MFA Rules not processed for user `04a731cedce8403fb170d7dc8aa57aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:11.184788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b532c632-012e-45fb-9b9a-b1cecd547f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:11.240583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410f74c-4944-4b45-9eeb-c4d57a7ae04e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:11.330891 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3011/6003] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:11.341781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532c632-012e-45fb-9b9a-b1cecd547f81 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:11.343633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b532c632-012e-45fb-9b9a-b1cecd547f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:11.428716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e8c40-2429-4746-afc6-442f797ef588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:11.430609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e8c40-2429-4746-afc6-442f797ef588 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:11.431164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e8c40-2429-4746-afc6-442f797ef588 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:11.431606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e8c40-2429-4746-afc6-442f797ef588 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:11.432896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e8c40-2429-4746-afc6-442f797ef588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:11.435183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e8c40-2429-4746-afc6-442f797ef588 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:11.484180 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2993/6004] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:09:11 2022] POST /identity/v3/users => generated 284 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:11.489751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e8c40-2429-4746-afc6-442f797ef588 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:11.518569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e8c40-2429-4746-afc6-442f797ef588 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:11.528855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace0b13-8902-44bd-9e33-581fad83eed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:11.529972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace0b13-8902-44bd-9e33-581fad83eed2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:11.530415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace0b13-8902-44bd-9e33-581fad83eed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:11.530825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532c632-012e-45fb-9b9a-b1cecd547f81 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:11.531018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace0b13-8902-44bd-9e33-581fad83eed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:11.531976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace0b13-8902-44bd-9e33-581fad83eed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:11.534000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace0b13-8902-44bd-9e33-581fad83eed2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:11.536091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f92c0-d7ae-4067-b57b-ecd0f1444c89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:11.537131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f92c0-d7ae-4067-b57b-ecd0f1444c89 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:11.537549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f92c0-d7ae-4067-b57b-ecd0f1444c89 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:11.537898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f92c0-d7ae-4067-b57b-ecd0f1444c89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:11.563853 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2994/6005] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:09:11.565044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f92c0-d7ae-4067-b57b-ecd0f1444c89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:11.568232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f92c0-d7ae-4067-b57b-ecd0f1444c89 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:11.569480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace0b13-8902-44bd-9e33-581fad83eed2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:11.595491 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3012/6006] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:09:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:09:11.613411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace0b13-8902-44bd-9e33-581fad83eed2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:11.627925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87a15f-1a6c-4f62-b69d-07dc66080dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:11.628548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87a15f-1a6c-4f62-b69d-07dc66080dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:11.628902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87a15f-1a6c-4f62-b69d-07dc66080dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:11.629170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87a15f-1a6c-4f62-b69d-07dc66080dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:11.629811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87a15f-1a6c-4f62-b69d-07dc66080dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:11.632818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87a15f-1a6c-4f62-b69d-07dc66080dd7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:11.665387 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2995/6007] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:09:11.670231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f92c0-d7ae-4067-b57b-ecd0f1444c89 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:11.706176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f92c0-d7ae-4067-b57b-ecd0f1444c89 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:11.721542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f6da4-9e84-4d38-bbe2-771294cba94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:11.725986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f6da4-9e84-4d38-bbe2-771294cba94d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:11.726412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f6da4-9e84-4d38-bbe2-771294cba94d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:11.726632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f6da4-9e84-4d38-bbe2-771294cba94d admin admin] PATH_INFO: `/v3/projects/42b938a16a1c450088c1371e0fc0df54/users/68ac4be53ad64b0e9202ccfc53707e67/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:11.753379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f6da4-9e84-4d38-bbe2-771294cba94d admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b938a16a1c450088c1371e0fc0df54, user_id=68ac4be53ad64b0e9202ccfc53707e67, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:11.760802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f6da4-9e84-4d38-bbe2-771294cba94d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:11.794740 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3013/6008] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:09:11 2022] PUT /identity/v3/projects/42b938a16a1c450088c1371e0fc0df54/users/68ac4be53ad64b0e9202ccfc53707e67/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:11.806491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607f886-df91-4120-8eb3-47e4b6a14c98 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:11.807154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607f886-df91-4120-8eb3-47e4b6a14c98 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:11.807818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607f886-df91-4120-8eb3-47e4b6a14c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:11.851099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9607f886-df91-4120-8eb3-47e4b6a14c98 None None] MFA Rules not processed for user `68ac4be53ad64b0e9202ccfc53707e67`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:11.852510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9607f886-df91-4120-8eb3-47e4b6a14c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:11.950214 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2996/6009] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:09:11.952294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f6da4-9e84-4d38-bbe2-771294cba94d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:12.047661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f6da4-9e84-4d38-bbe2-771294cba94d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:12.052680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d831c6-089a-40db-80af-4388f078ba5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:12.054042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d831c6-089a-40db-80af-4388f078ba5b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:12.054331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d831c6-089a-40db-80af-4388f078ba5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:12.054603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d831c6-089a-40db-80af-4388f078ba5b admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:12.055828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d831c6-089a-40db-80af-4388f078ba5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:12.059039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d831c6-089a-40db-80af-4388f078ba5b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:12.081744 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:12.103687 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3014/6010] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:09:11 2022] POST /identity/v3/projects => generated 369 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:12.105262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607f886-df91-4120-8eb3-47e4b6a14c98 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:12.121207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607f886-df91-4120-8eb3-47e4b6a14c98 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:12.231246 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:12.338274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5449f-b1a3-4142-9f09-6e7a40c3b1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:12.338907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5449f-b1a3-4142-9f09-6e7a40c3b1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:12.339185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5449f-b1a3-4142-9f09-6e7a40c3b1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:12.339456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5449f-b1a3-4142-9f09-6e7a40c3b1c9 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:12.340089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5449f-b1a3-4142-9f09-6e7a40c3b1c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:12.342065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5449f-b1a3-4142-9f09-6e7a40c3b1c9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:12.381193 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2997/6011] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:09:12 2022] POST /identity/v3/users => generated 291 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:12.382485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d831c6-089a-40db-80af-4388f078ba5b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:12.399969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d831c6-089a-40db-80af-4388f078ba5b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:12.412417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5449f-b1a3-4142-9f09-6e7a40c3b1c9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:12.412577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364ae81-46a5-4247-970b-607354444f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:12.413231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364ae81-46a5-4247-970b-607354444f2e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:12.414177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364ae81-46a5-4247-970b-607354444f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:12.414177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364ae81-46a5-4247-970b-607354444f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:12.414400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bfe5449f-b1a3-4142-9f09-6e7a40c3b1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:12.414712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364ae81-46a5-4247-970b-607354444f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:12.416297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364ae81-46a5-4247-970b-607354444f2e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:12.434053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5449f-b1a3-4142-9f09-6e7a40c3b1c9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:12.440528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32282b-0748-40fe-98f5-2b17a1c7442b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:12.441674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32282b-0748-40fe-98f5-2b17a1c7442b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:12.442091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32282b-0748-40fe-98f5-2b17a1c7442b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:12.442615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32282b-0748-40fe-98f5-2b17a1c7442b admin admin] PATH_INFO: `/v3/users/4c65999e9e65482f86cb4b8609dca117` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:12.450443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32282b-0748-40fe-98f5-2b17a1c7442b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c65999e9e65482f86cb4b8609dca117)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:12.450677 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3015/6012] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:09:12.450827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32282b-0748-40fe-98f5-2b17a1c7442b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:12.451772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364ae81-46a5-4247-970b-607354444f2e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:12.513728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364ae81-46a5-4247-970b-607354444f2e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:12.536005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dea954-745e-497b-9b68-76dfc8af5809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:12.539842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dea954-745e-497b-9b68-76dfc8af5809 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:12.540143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dea954-745e-497b-9b68-76dfc8af5809 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:12.540389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dea954-745e-497b-9b68-76dfc8af5809 admin admin] PATH_INFO: `/v3/projects/e0a61ad0920841a394ec172c384eaa60/users/9f8cdcc8a94e482181e5655efc6142e4/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:12.585483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dea954-745e-497b-9b68-76dfc8af5809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a61ad0920841a394ec172c384eaa60, user_id=9f8cdcc8a94e482181e5655efc6142e4, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:12.590104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dea954-745e-497b-9b68-76dfc8af5809 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:12.633470 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3016/6013] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:09:12 2022] PUT /identity/v3/projects/e0a61ad0920841a394ec172c384eaa60/users/9f8cdcc8a94e482181e5655efc6142e4/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:12.638455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dea954-745e-497b-9b68-76dfc8af5809 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:12.640677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0e32282b-0748-40fe-98f5-2b17a1c7442b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c65999e9e65482f86cb4b8609dca117'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:12.669579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0e32282b-0748-40fe-98f5-2b17a1c7442b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c65999e9e65482f86cb4b8609dca117'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:12.672478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0e32282b-0748-40fe-98f5-2b17a1c7442b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c65999e9e65482f86cb4b8609dca117'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:12.736891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0e32282b-0748-40fe-98f5-2b17a1c7442b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c65999e9e65482f86cb4b8609dca117'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:12.747830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0e32282b-0748-40fe-98f5-2b17a1c7442b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c65999e9e65482f86cb4b8609dca117'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:12.762306 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2998/6014] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:09:12 2022] DELETE /identity/v3/users/4c65999e9e65482f86cb4b8609dca117 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:12.767252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435c903-9c75-47a5-8cea-3170e5504379 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:12.768200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435c903-9c75-47a5-8cea-3170e5504379 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:12.769105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435c903-9c75-47a5-8cea-3170e5504379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:12.773675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dea954-745e-497b-9b68-76dfc8af5809 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:12.813177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6435c903-9c75-47a5-8cea-3170e5504379 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:12.814921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6435c903-9c75-47a5-8cea-3170e5504379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:12.893988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c334f5-6bad-4c8d-97d9-4d25aae5a20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:12.894992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c334f5-6bad-4c8d-97d9-4d25aae5a20a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:12.895527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c334f5-6bad-4c8d-97d9-4d25aae5a20a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:12.896017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c334f5-6bad-4c8d-97d9-4d25aae5a20a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:12.897032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c334f5-6bad-4c8d-97d9-4d25aae5a20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:12.899565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c334f5-6bad-4c8d-97d9-4d25aae5a20a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:12.924988 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3017/6015] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:09:12.926947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c334f5-6bad-4c8d-97d9-4d25aae5a20a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:12.931207 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2999/6016] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:12.933213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a4c334f5-6bad-4c8d-97d9-4d25aae5a20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:12.945277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435c903-9c75-47a5-8cea-3170e5504379 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:12.947108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6435c903-9c75-47a5-8cea-3170e5504379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:12.948898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c334f5-6bad-4c8d-97d9-4d25aae5a20a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:12.955526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0e68b-40d6-42ff-964f-7f2aa230e8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:12.957303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0e68b-40d6-42ff-964f-7f2aa230e8cf admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:12.957303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0e68b-40d6-42ff-964f-7f2aa230e8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:12.957617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0e68b-40d6-42ff-964f-7f2aa230e8cf admin admin] PATH_INFO: `/v3/projects/e0a61ad0920841a394ec172c384eaa60/users/9f8cdcc8a94e482181e5655efc6142e4/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:12.959893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0e68b-40d6-42ff-964f-7f2aa230e8cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a61ad0920841a394ec172c384eaa60, user_id=9f8cdcc8a94e482181e5655efc6142e4, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:12.963864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0e68b-40d6-42ff-964f-7f2aa230e8cf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:12.988960 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3018/6017] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:09:12 2022] PUT /identity/v3/projects/e0a61ad0920841a394ec172c384eaa60/users/9f8cdcc8a94e482181e5655efc6142e4/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:13.005273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f090fa-6be6-4ef5-8648-db2d7ecf6813 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:13.005571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f090fa-6be6-4ef5-8648-db2d7ecf6813 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:13.005849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f090fa-6be6-4ef5-8648-db2d7ecf6813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:13.024446 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:13.056041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d3f090fa-6be6-4ef5-8648-db2d7ecf6813 None None] MFA Rules not processed for user `9f8cdcc8a94e482181e5655efc6142e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:13.058066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d3f090fa-6be6-4ef5-8648-db2d7ecf6813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:13.091994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435c903-9c75-47a5-8cea-3170e5504379 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:13.150046 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:13.179417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f3aba-44a3-4103-8031-9e538d56ab18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:13.181284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f3aba-44a3-4103-8031-9e538d56ab18 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:13.181735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f3aba-44a3-4103-8031-9e538d56ab18 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:13.184145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f3aba-44a3-4103-8031-9e538d56ab18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:13.239035 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3019/6018] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:13.242026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f090fa-6be6-4ef5-8648-db2d7ecf6813 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:13.267455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f090fa-6be6-4ef5-8648-db2d7ecf6813 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:13.283431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3851e-62f7-44cc-bf6c-e2f0bf949ef1 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f8cdcc8a94e482181e5655efc6142e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0a61ad0920841a394ec172c384eaa60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:13.286038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3851e-62f7-44cc-bf6c-e2f0bf949ef1 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:13.289195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3851e-62f7-44cc-bf6c-e2f0bf949ef1 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:13.289565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3851e-62f7-44cc-bf6c-e2f0bf949ef1 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:13.290389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3851e-62f7-44cc-bf6c-e2f0bf949ef1 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:13.299141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3851e-62f7-44cc-bf6c-e2f0bf949ef1 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:13.349201 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3020/6019] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Sep 30 10:09:13 2022] POST /identity/v3/services => generated 240 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:13.354092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3851e-62f7-44cc-bf6c-e2f0bf949ef1 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:13.365368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f3aba-44a3-4103-8031-9e538d56ab18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:13.366949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f3aba-44a3-4103-8031-9e538d56ab18 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:13.385011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3851e-62f7-44cc-bf6c-e2f0bf949ef1 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:13.394920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff17c1d-93c5-418f-997f-2fddb396c3b1 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f8cdcc8a94e482181e5655efc6142e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0a61ad0920841a394ec172c384eaa60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:13.395611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff17c1d-93c5-418f-997f-2fddb396c3b1 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:13.396026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff17c1d-93c5-418f-997f-2fddb396c3b1 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:13.396449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff17c1d-93c5-418f-997f-2fddb396c3b1 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] PATH_INFO: `/v3/services/9ba47fd0ba5b40aebe209036be0d0516` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:13.396696 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3000/6020] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:09:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:09:13.397148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff17c1d-93c5-418f-997f-2fddb396c3b1 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorizing `identity:delete_service(service_id=9ba47fd0ba5b40aebe209036be0d0516)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:13.399322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff17c1d-93c5-418f-997f-2fddb396c3b1 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:13.461328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f3aba-44a3-4103-8031-9e538d56ab18 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:13.466907 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3021/6021] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:09:13 2022] DELETE /identity/v3/services/9ba47fd0ba5b40aebe209036be0d0516 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:13.478188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f3aba-44a3-4103-8031-9e538d56ab18 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:13.502543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcab4a4-5e5e-4a28-bab2-aa8a0a43a0ac tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f8cdcc8a94e482181e5655efc6142e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0a61ad0920841a394ec172c384eaa60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:13.503358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcab4a4-5e5e-4a28-bab2-aa8a0a43a0ac tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:13.505077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcab4a4-5e5e-4a28-bab2-aa8a0a43a0ac tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:13.505586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcab4a4-5e5e-4a28-bab2-aa8a0a43a0ac tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:13.506661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcab4a4-5e5e-4a28-bab2-aa8a0a43a0ac tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:13.508573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcab4a4-5e5e-4a28-bab2-aa8a0a43a0ac tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:13.573988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff17c1d-93c5-418f-997f-2fddb396c3b1 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:13.574183 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3001/6022] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:09:13 2022] POST /identity/v3/services => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:13.601762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff17c1d-93c5-418f-997f-2fddb396c3b1 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:13.636415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912377d6-1b1c-4b93-a775-607e05a6ca48 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f8cdcc8a94e482181e5655efc6142e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0a61ad0920841a394ec172c384eaa60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:13.640335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912377d6-1b1c-4b93-a775-607e05a6ca48 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:13.640654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912377d6-1b1c-4b93-a775-607e05a6ca48 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:13.642504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912377d6-1b1c-4b93-a775-607e05a6ca48 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] PATH_INFO: `/v3/services/e8fe8ec2c763419dba293b416e41b56d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:13.645106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912377d6-1b1c-4b93-a775-607e05a6ca48 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorizing `identity:update_service(service_id=e8fe8ec2c763419dba293b416e41b56d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:13.648738 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-912377d6-1b1c-4b93-a775-607e05a6ca48 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:09:13.648738 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:09:13.648738 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:09:13.650162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912377d6-1b1c-4b93-a775-607e05a6ca48 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:13.732574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcab4a4-5e5e-4a28-bab2-aa8a0a43a0ac tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:13.755872 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3022/6023] 10.222.0.16 () {60 vars in 1252 bytes} [Fri Sep 30 10:09:13 2022] PATCH /identity/v3/services/e8fe8ec2c763419dba293b416e41b56d => generated 284 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:09:13.758971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcab4a4-5e5e-4a28-bab2-aa8a0a43a0ac tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:13.810572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028ad10-8bab-452f-bb12-c8d43f224564 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f8cdcc8a94e482181e5655efc6142e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0a61ad0920841a394ec172c384eaa60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:13.811495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028ad10-8bab-452f-bb12-c8d43f224564 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:13.811988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028ad10-8bab-452f-bb12-c8d43f224564 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:13.812487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028ad10-8bab-452f-bb12-c8d43f224564 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] PATH_INFO: `/v3/services/e8fe8ec2c763419dba293b416e41b56d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:13.813801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028ad10-8bab-452f-bb12-c8d43f224564 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorizing `identity:get_service(service_id=e8fe8ec2c763419dba293b416e41b56d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:13.818065 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-5028ad10-8bab-452f-bb12-c8d43f224564 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:09:13.818065 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:09:13.818065 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:09:13.821078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028ad10-8bab-452f-bb12-c8d43f224564 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:13.846146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912377d6-1b1c-4b93-a775-607e05a6ca48 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:13.852164 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3002/6024] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:09:13 2022] GET /identity/v3/services/e8fe8ec2c763419dba293b416e41b56d => generated 284 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:09:13.862157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912377d6-1b1c-4b93-a775-607e05a6ca48 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:13.877130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85348245-7ec9-4246-a6b8-ae53012c1125 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f8cdcc8a94e482181e5655efc6142e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0a61ad0920841a394ec172c384eaa60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:13.877952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85348245-7ec9-4246-a6b8-ae53012c1125 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:13.878345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85348245-7ec9-4246-a6b8-ae53012c1125 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:13.878886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85348245-7ec9-4246-a6b8-ae53012c1125 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] PATH_INFO: `/v3/services/e8fe8ec2c763419dba293b416e41b56d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:13.879553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85348245-7ec9-4246-a6b8-ae53012c1125 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorizing `identity:delete_service(service_id=e8fe8ec2c763419dba293b416e41b56d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:13.883497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85348245-7ec9-4246-a6b8-ae53012c1125 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:13.935794 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3023/6025] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:09:13 2022] DELETE /identity/v3/services/e8fe8ec2c763419dba293b416e41b56d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:13.937469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028ad10-8bab-452f-bb12-c8d43f224564 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:13.955914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028ad10-8bab-452f-bb12-c8d43f224564 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:14.001996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cd6b8-41be-4596-bfe1-d54c43fefad4 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f8cdcc8a94e482181e5655efc6142e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0a61ad0920841a394ec172c384eaa60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:14.002699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cd6b8-41be-4596-bfe1-d54c43fefad4 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:14.002985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cd6b8-41be-4596-bfe1-d54c43fefad4 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:14.003258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cd6b8-41be-4596-bfe1-d54c43fefad4 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] PATH_INFO: `/v3/services/e8fe8ec2c763419dba293b416e41b56d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:14.003853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9cd6b8-41be-4596-bfe1-d54c43fefad4 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorizing `identity:get_service(service_id=e8fe8ec2c763419dba293b416e41b56d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:14.005561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9cd6b8-41be-4596-bfe1-d54c43fefad4 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:14.039743 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-2d9cd6b8-41be-4596-bfe1-d54c43fefad4 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Could not find service: e8fe8ec2c763419dba293b416e41b56d.: keystone.exception.ServiceNotFound: Could not find service: e8fe8ec2c763419dba293b416e41b56d. Sep 30 10:09:14.039743 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:09:14.039743 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 10:09:14.039743 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 10:09:14.039743 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 10:09:14.039743 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 10:09:14.039743 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 10:09:14.039743 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 10:09:14.039743 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: e8fe8ec2c763419dba293b416e41b56d. Sep 30 10:09:14.039743 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:09:14.039743 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:09:14.039743 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:09:14.039743 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:09:14.039743 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:09:14.039743 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:09:14.041238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:09:14.041238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:09:14.041238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:09:14.041238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:09:14.041238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:09:14.041238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:09:14.041238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:09:14.041238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:09:14.041238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 10:09:14.041238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 10:09:14.041238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 10:09:14.041238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 10:09:14.041238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:09:14.041238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:09:14.041238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:09:14.041238 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:09:14.042947 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:09:14.042947 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:09:14.042947 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:09:14.042947 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 10:09:14.042947 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:09:14.042947 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:09:14.042947 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:09:14.042947 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:09:14.042947 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:09:14.042947 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:09:14.042947 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:09:14.042947 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:09:14.042947 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 10:09:14.042947 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 10:09:14.042947 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: e8fe8ec2c763419dba293b416e41b56d. Sep 30 10:09:14.042947 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:09:14.048362 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3003/6026] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:09:13 2022] GET /identity/v3/services/e8fe8ec2c763419dba293b416e41b56d => generated 113 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:09:14.055995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85348245-7ec9-4246-a6b8-ae53012c1125 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:14.072830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85348245-7ec9-4246-a6b8-ae53012c1125 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:14.084564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3775c-9010-4ce2-b771-d6631758920a tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f8cdcc8a94e482181e5655efc6142e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0a61ad0920841a394ec172c384eaa60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:14.084564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3775c-9010-4ce2-b771-d6631758920a tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:14.084564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3775c-9010-4ce2-b771-d6631758920a tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:14.086094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3775c-9010-4ce2-b771-d6631758920a tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:14.087052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3775c-9010-4ce2-b771-d6631758920a tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:14.093916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3775c-9010-4ce2-b771-d6631758920a tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:14.123311 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3024/6027] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:09:14 2022] POST /identity/v3/services => generated 273 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:14.127958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cd6b8-41be-4596-bfe1-d54c43fefad4 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:14.146910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cd6b8-41be-4596-bfe1-d54c43fefad4 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:14.183703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba906284-e9e1-43a8-ac4d-7d7544c3dbdf tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f8cdcc8a94e482181e5655efc6142e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0a61ad0920841a394ec172c384eaa60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:14.184411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba906284-e9e1-43a8-ac4d-7d7544c3dbdf tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:14.184724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba906284-e9e1-43a8-ac4d-7d7544c3dbdf tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:14.184996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba906284-e9e1-43a8-ac4d-7d7544c3dbdf tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:14.185832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba906284-e9e1-43a8-ac4d-7d7544c3dbdf tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:14.188820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba906284-e9e1-43a8-ac4d-7d7544c3dbdf tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:14.223689 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3004/6028] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:09:14 2022] POST /identity/v3/services => generated 275 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:14.227506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3775c-9010-4ce2-b771-d6631758920a tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:14.241197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3775c-9010-4ce2-b771-d6631758920a tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:14.281636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c00c4-4919-4bef-8afd-72f116dda9b8 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f8cdcc8a94e482181e5655efc6142e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0a61ad0920841a394ec172c384eaa60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:14.282272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c00c4-4919-4bef-8afd-72f116dda9b8 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:14.282557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c00c4-4919-4bef-8afd-72f116dda9b8 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:14.282900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c00c4-4919-4bef-8afd-72f116dda9b8 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:14.283564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c00c4-4919-4bef-8afd-72f116dda9b8 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:14.285237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c00c4-4919-4bef-8afd-72f116dda9b8 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:14.323987 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3025/6029] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:09:14 2022] POST /identity/v3/services => generated 274 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:14.324927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba906284-e9e1-43a8-ac4d-7d7544c3dbdf tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:14.340666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba906284-e9e1-43a8-ac4d-7d7544c3dbdf tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:14.383897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e19b5-476b-4e92-b2db-42de9ef8998b tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f8cdcc8a94e482181e5655efc6142e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0a61ad0920841a394ec172c384eaa60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:14.384779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e19b5-476b-4e92-b2db-42de9ef8998b tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:14.385066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e19b5-476b-4e92-b2db-42de9ef8998b tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:14.385344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e19b5-476b-4e92-b2db-42de9ef8998b tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:14.385964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e19b5-476b-4e92-b2db-42de9ef8998b tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:14.387887 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-202e19b5-476b-4e92-b2db-42de9ef8998b tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:09:14.387887 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:09:14.387887 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:09:14.388826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e19b5-476b-4e92-b2db-42de9ef8998b tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:14.398663 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:14.415971 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3005/6030] 10.222.0.16 () {58 vars in 1131 bytes} [Fri Sep 30 10:09:14 2022] GET /identity/v3/services => generated 2977 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:09:14.421622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c00c4-4919-4bef-8afd-72f116dda9b8 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:14.440695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c00c4-4919-4bef-8afd-72f116dda9b8 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:14.460003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ffb6a-684c-4561-8920-cced4e7881cb tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f8cdcc8a94e482181e5655efc6142e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0a61ad0920841a394ec172c384eaa60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:14.461150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ffb6a-684c-4561-8920-cced4e7881cb tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:14.465458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ffb6a-684c-4561-8920-cced4e7881cb tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:14.465738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ffb6a-684c-4561-8920-cced4e7881cb tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:14.466441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ffb6a-684c-4561-8920-cced4e7881cb tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-803022889) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:09:14.466748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ffb6a-684c-4561-8920-cced4e7881cb tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:14.468541 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-ee8ffb6a-684c-4561-8920-cced4e7881cb tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:09:14.468541 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:09:14.468541 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:09:14.469485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ffb6a-684c-4561-8920-cced4e7881cb tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:14.489570 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3026/6031] 10.222.0.16 () {58 vars in 1220 bytes} [Fri Sep 30 10:09:14 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-803022889 => generated 415 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:09:14.493815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e19b5-476b-4e92-b2db-42de9ef8998b tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:14.511892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e19b5-476b-4e92-b2db-42de9ef8998b tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:14.527052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2333220-46a2-4cdd-b17e-66d59dd64653 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f8cdcc8a94e482181e5655efc6142e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0a61ad0920841a394ec172c384eaa60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:14.527754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2333220-46a2-4cdd-b17e-66d59dd64653 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:14.528036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2333220-46a2-4cdd-b17e-66d59dd64653 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:14.528318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2333220-46a2-4cdd-b17e-66d59dd64653 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:14.529214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2333220-46a2-4cdd-b17e-66d59dd64653 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1306289240) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:09:14.529530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2333220-46a2-4cdd-b17e-66d59dd64653 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:14.535316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2333220-46a2-4cdd-b17e-66d59dd64653 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:14.550698 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3006/6032] 10.222.0.16 () {58 vars in 1222 bytes} [Fri Sep 30 10:09:14 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1306289240 => generated 418 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:09:14.552282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ffb6a-684c-4561-8920-cced4e7881cb tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:14.568247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ffb6a-684c-4561-8920-cced4e7881cb tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:14.589445 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2e762-9bbc-46a0-b11c-1504130d5d96 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f8cdcc8a94e482181e5655efc6142e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0a61ad0920841a394ec172c384eaa60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:14.590978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2e762-9bbc-46a0-b11c-1504130d5d96 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:14.591576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2e762-9bbc-46a0-b11c-1504130d5d96 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:14.592073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2e762-9bbc-46a0-b11c-1504130d5d96 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:14.593156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2e762-9bbc-46a0-b11c-1504130d5d96 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-226508335) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:09:14.594395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2e762-9bbc-46a0-b11c-1504130d5d96 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:14.596347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2e762-9bbc-46a0-b11c-1504130d5d96 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:14.611681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2333220-46a2-4cdd-b17e-66d59dd64653 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:14.619880 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3027/6033] 10.222.0.16 () {58 vars in 1220 bytes} [Fri Sep 30 10:09:14 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-226508335 => generated 416 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:09:14.625626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2333220-46a2-4cdd-b17e-66d59dd64653 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:14.642444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a15ee-9aaa-4484-b5a3-0b2eba3790c9 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f8cdcc8a94e482181e5655efc6142e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0a61ad0920841a394ec172c384eaa60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:14.643751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a15ee-9aaa-4484-b5a3-0b2eba3790c9 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:14.644275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a15ee-9aaa-4484-b5a3-0b2eba3790c9 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:14.644873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a15ee-9aaa-4484-b5a3-0b2eba3790c9 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] PATH_INFO: `/v3/services/11fdabe393574e3ebc16a1969b21d4f7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:14.645715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a15ee-9aaa-4484-b5a3-0b2eba3790c9 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorizing `identity:delete_service(service_id=11fdabe393574e3ebc16a1969b21d4f7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:14.648335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a15ee-9aaa-4484-b5a3-0b2eba3790c9 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:14.688441 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3007/6034] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:09:14 2022] DELETE /identity/v3/services/11fdabe393574e3ebc16a1969b21d4f7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:14.689821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2e762-9bbc-46a0-b11c-1504130d5d96 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:14.706956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2e762-9bbc-46a0-b11c-1504130d5d96 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:14.748468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1378c-d8e6-4b17-9588-daf26ba7bc3e tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f8cdcc8a94e482181e5655efc6142e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0a61ad0920841a394ec172c384eaa60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:14.749537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1378c-d8e6-4b17-9588-daf26ba7bc3e tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:14.750090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1378c-d8e6-4b17-9588-daf26ba7bc3e tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:14.750599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1378c-d8e6-4b17-9588-daf26ba7bc3e tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] PATH_INFO: `/v3/services/2ebbcebd26454447b2874a24210879ae` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:14.751593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f1378c-d8e6-4b17-9588-daf26ba7bc3e tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorizing `identity:delete_service(service_id=2ebbcebd26454447b2874a24210879ae)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:14.757694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f1378c-d8e6-4b17-9588-daf26ba7bc3e tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:14.828386 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3028/6035] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:09:14 2022] DELETE /identity/v3/services/2ebbcebd26454447b2874a24210879ae => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:14.833202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a15ee-9aaa-4484-b5a3-0b2eba3790c9 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:14.848238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a15ee-9aaa-4484-b5a3-0b2eba3790c9 tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:14.893707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c11cb-5a37-4408-b92c-2056a0cbb5ba tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f8cdcc8a94e482181e5655efc6142e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0a61ad0920841a394ec172c384eaa60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:14.895069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c11cb-5a37-4408-b92c-2056a0cbb5ba tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:14.895664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c11cb-5a37-4408-b92c-2056a0cbb5ba tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:14.896211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c11cb-5a37-4408-b92c-2056a0cbb5ba tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] PATH_INFO: `/v3/services/cc76665f15b14f0fadb646fc290abb3d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:14.899654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c11cb-5a37-4408-b92c-2056a0cbb5ba tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorizing `identity:delete_service(service_id=cc76665f15b14f0fadb646fc290abb3d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:14.904545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c11cb-5a37-4408-b92c-2056a0cbb5ba tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:14.966437 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3008/6036] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:09:14 2022] DELETE /identity/v3/services/cc76665f15b14f0fadb646fc290abb3d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:14.967503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1378c-d8e6-4b17-9588-daf26ba7bc3e tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:15.008781 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=6,keystone:UPDATE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:15.015587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1378c-d8e6-4b17-9588-daf26ba7bc3e tempest-ServicesTestJSON-2137234145 tempest-ServicesTestJSON-2137234145-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:15.069963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe08091-778c-40b7-8720-dd39b8e09331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:15.071769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe08091-778c-40b7-8720-dd39b8e09331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:15.072311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe08091-778c-40b7-8720-dd39b8e09331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:15.072804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe08091-778c-40b7-8720-dd39b8e09331 admin admin] PATH_INFO: `/v3/users/68ac4be53ad64b0e9202ccfc53707e67` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:15.074297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe08091-778c-40b7-8720-dd39b8e09331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68ac4be53ad64b0e9202ccfc53707e67)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:15.076445 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe08091-778c-40b7-8720-dd39b8e09331 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:15.219239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5fe08091-778c-40b7-8720-dd39b8e09331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68ac4be53ad64b0e9202ccfc53707e67'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:15.220449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5fe08091-778c-40b7-8720-dd39b8e09331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68ac4be53ad64b0e9202ccfc53707e67'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:15.236943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5fe08091-778c-40b7-8720-dd39b8e09331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68ac4be53ad64b0e9202ccfc53707e67'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:15.259557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5fe08091-778c-40b7-8720-dd39b8e09331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68ac4be53ad64b0e9202ccfc53707e67'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:15.274082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5fe08091-778c-40b7-8720-dd39b8e09331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68ac4be53ad64b0e9202ccfc53707e67'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:15.298392 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3029/6037] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:09:14 2022] DELETE /identity/v3/users/68ac4be53ad64b0e9202ccfc53707e67 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:09:15.303196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375928d-b2fe-4899-9f6d-bf913ac17225 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:15.303735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375928d-b2fe-4899-9f6d-bf913ac17225 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:15.304191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375928d-b2fe-4899-9f6d-bf913ac17225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:15.343419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4375928d-b2fe-4899-9f6d-bf913ac17225 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:15.347738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4375928d-b2fe-4899-9f6d-bf913ac17225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:15.508076 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3009/6038] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:15.586308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe08091-778c-40b7-8720-dd39b8e09331 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:15.587947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5fe08091-778c-40b7-8720-dd39b8e09331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:15.671848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375928d-b2fe-4899-9f6d-bf913ac17225 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:15.675831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4375928d-b2fe-4899-9f6d-bf913ac17225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:15.797311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe08091-778c-40b7-8720-dd39b8e09331 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:15.813351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa56c2d-52c2-472d-be8b-10f7a27aa55b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:15.813998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa56c2d-52c2-472d-be8b-10f7a27aa55b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:15.814278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa56c2d-52c2-472d-be8b-10f7a27aa55b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:15.815107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa56c2d-52c2-472d-be8b-10f7a27aa55b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:15.832229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa56c2d-52c2-472d-be8b-10f7a27aa55b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:15.833763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa56c2d-52c2-472d-be8b-10f7a27aa55b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:15.863880 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3030/6039] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:09:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:09:15.864797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa56c2d-52c2-472d-be8b-10f7a27aa55b service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:15.880634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9aa56c2d-52c2-472d-be8b-10f7a27aa55b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:15.916472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375928d-b2fe-4899-9f6d-bf913ac17225 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:15.923249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed570d1-6927-46ee-a02b-a6f7527b5d6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:15.925708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed570d1-6927-46ee-a02b-a6f7527b5d6d service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:15.926832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed570d1-6927-46ee-a02b-a6f7527b5d6d service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:15.927531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed570d1-6927-46ee-a02b-a6f7527b5d6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:15.930413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eed570d1-6927-46ee-a02b-a6f7527b5d6d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:15.934386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa56c2d-52c2-472d-be8b-10f7a27aa55b service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:15.949428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0887e-f173-44a8-9988-b3887424fdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:15.950273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0887e-f173-44a8-9988-b3887424fdb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:15.950441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0887e-f173-44a8-9988-b3887424fdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:15.950712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0887e-f173-44a8-9988-b3887424fdb5 admin admin] PATH_INFO: `/v3/projects/7d3a183bda764533bcef8ebf3550cc2a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:15.954629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0887e-f173-44a8-9988-b3887424fdb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d3a183bda764533bcef8ebf3550cc2a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:15.959953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0887e-f173-44a8-9988-b3887424fdb5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:15.975458 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:16.039651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed570d1-6927-46ee-a02b-a6f7527b5d6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:16.043510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed570d1-6927-46ee-a02b-a6f7527b5d6d service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:16.064774 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3010/6040] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:09:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:09:16.110960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-40b0887e-f173-44a8-9988-b3887424fdb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d3a183bda764533bcef8ebf3550cc2a', 'request_id': 'req-40b0887e-f173-44a8-9988-b3887424fdb5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:16.135227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-40b0887e-f173-44a8-9988-b3887424fdb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d3a183bda764533bcef8ebf3550cc2a', 'request_id': 'req-40b0887e-f173-44a8-9988-b3887424fdb5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:16.137251 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:16.153104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-40b0887e-f173-44a8-9988-b3887424fdb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d3a183bda764533bcef8ebf3550cc2a', 'request_id': 'req-40b0887e-f173-44a8-9988-b3887424fdb5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:16.189476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-40b0887e-f173-44a8-9988-b3887424fdb5 admin admin] The token cache is being invalidate because project 7d3a183bda764533bcef8ebf3550cc2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:09:16.191223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-40b0887e-f173-44a8-9988-b3887424fdb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:16.198031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-40b0887e-f173-44a8-9988-b3887424fdb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:16.203074 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3031/6041] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:09:15 2022] DELETE /identity/v3/projects/7d3a183bda764533bcef8ebf3550cc2a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:16.215731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef876d-22e1-40c4-963a-084a38bc68d6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:16.216235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef876d-22e1-40c4-963a-084a38bc68d6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:16.216393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef876d-22e1-40c4-963a-084a38bc68d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:16.290145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e6ef876d-22e1-40c4-963a-084a38bc68d6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:16.291771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e6ef876d-22e1-40c4-963a-084a38bc68d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:16.443608 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3011/6042] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:16.444579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84566e17-f9b9-496c-8660-d9926c8dc284 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:16.444973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84566e17-f9b9-496c-8660-d9926c8dc284 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:16.445250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84566e17-f9b9-496c-8660-d9926c8dc284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:16.493775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-84566e17-f9b9-496c-8660-d9926c8dc284 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:16.498129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-84566e17-f9b9-496c-8660-d9926c8dc284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:16.523741 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3032/6043] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:16.527328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef876d-22e1-40c4-963a-084a38bc68d6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:16.541388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef876d-22e1-40c4-963a-084a38bc68d6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:16.556092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8424219-ba80-4a3f-9e48-f367eec9b0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:16.557695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8424219-ba80-4a3f-9e48-f367eec9b0ac admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:16.557980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8424219-ba80-4a3f-9e48-f367eec9b0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:16.558255 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8424219-ba80-4a3f-9e48-f367eec9b0ac admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:16.560100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8424219-ba80-4a3f-9e48-f367eec9b0ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:09:16.560413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8424219-ba80-4a3f-9e48-f367eec9b0ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:16.567428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8424219-ba80-4a3f-9e48-f367eec9b0ac admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:16.648099 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3012/6044] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:09:16.653038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84566e17-f9b9-496c-8660-d9926c8dc284 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:16.668475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84566e17-f9b9-496c-8660-d9926c8dc284 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:16.681957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe36b5-5671-400d-bffb-7e2031a47911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:16.682593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe36b5-5671-400d-bffb-7e2031a47911 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:16.682952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe36b5-5671-400d-bffb-7e2031a47911 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:16.683326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe36b5-5671-400d-bffb-7e2031a47911 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:16.686623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe36b5-5671-400d-bffb-7e2031a47911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:16.692868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe36b5-5671-400d-bffb-7e2031a47911 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:16.783201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8424219-ba80-4a3f-9e48-f367eec9b0ac admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:16.787981 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3033/6045] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:09:16 2022] POST /identity/v3/projects => generated 389 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:16.795394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8424219-ba80-4a3f-9e48-f367eec9b0ac admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:16.985179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242a757-0782-42a1-b120-6f3411ae32f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:16.986221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242a757-0782-42a1-b120-6f3411ae32f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:16.986504 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242a757-0782-42a1-b120-6f3411ae32f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:16.986777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242a757-0782-42a1-b120-6f3411ae32f8 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:16.987422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242a757-0782-42a1-b120-6f3411ae32f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:16.989363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242a757-0782-42a1-b120-6f3411ae32f8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:17.049598 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3013/6046] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:09:16 2022] POST /identity/v3/users => generated 295 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:09:17.053960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe36b5-5671-400d-bffb-7e2031a47911 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:17.070191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe36b5-5671-400d-bffb-7e2031a47911 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:17.093536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fee23-2434-4bec-ad4e-d3abcabc0356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:17.094602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fee23-2434-4bec-ad4e-d3abcabc0356 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:17.109181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fee23-2434-4bec-ad4e-d3abcabc0356 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:17.111541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fee23-2434-4bec-ad4e-d3abcabc0356 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:17.114054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fee23-2434-4bec-ad4e-d3abcabc0356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:17.117925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fee23-2434-4bec-ad4e-d3abcabc0356 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:17.145669 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3034/6047] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:09:17.146392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242a757-0782-42a1-b120-6f3411ae32f8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:17.163136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242a757-0782-42a1-b120-6f3411ae32f8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:17.182779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f649bb1-b21d-4e14-aac2-685bc94db83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:17.183585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f649bb1-b21d-4e14-aac2-685bc94db83f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:17.183868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f649bb1-b21d-4e14-aac2-685bc94db83f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:17.184136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f649bb1-b21d-4e14-aac2-685bc94db83f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:17.184817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f649bb1-b21d-4e14-aac2-685bc94db83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:17.186829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f649bb1-b21d-4e14-aac2-685bc94db83f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:17.225226 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3014/6048] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:09:17.230874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fee23-2434-4bec-ad4e-d3abcabc0356 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:17.251281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fee23-2434-4bec-ad4e-d3abcabc0356 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:17.287713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33055d49-fa66-4f44-97d2-b29260e93077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:17.288678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33055d49-fa66-4f44-97d2-b29260e93077 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:17.289435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33055d49-fa66-4f44-97d2-b29260e93077 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:17.290771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33055d49-fa66-4f44-97d2-b29260e93077 admin admin] PATH_INFO: `/v3/projects/5ece34f9216a4ea7be7224098415b4a4/users/bd2bba0db07140c0851cebb70631ce7c/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:17.328686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33055d49-fa66-4f44-97d2-b29260e93077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ece34f9216a4ea7be7224098415b4a4, user_id=bd2bba0db07140c0851cebb70631ce7c, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:17.332578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33055d49-fa66-4f44-97d2-b29260e93077 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:17.360169 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3035/6049] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:09:17 2022] PUT /identity/v3/projects/5ece34f9216a4ea7be7224098415b4a4/users/bd2bba0db07140c0851cebb70631ce7c/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:17.365050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cdc95-f044-413c-ba00-9b9afaffe356 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:17.365331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cdc95-f044-413c-ba00-9b9afaffe356 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:17.365800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cdc95-f044-413c-ba00-9b9afaffe356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:17.417480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-360cdc95-f044-413c-ba00-9b9afaffe356 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:17.424384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-360cdc95-f044-413c-ba00-9b9afaffe356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:17.520419 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:17.583441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33055d49-fa66-4f44-97d2-b29260e93077 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:17.586254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-33055d49-fa66-4f44-97d2-b29260e93077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:17.609107 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3015/6050] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:17.699680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cdc95-f044-413c-ba00-9b9afaffe356 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:17.701971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-360cdc95-f044-413c-ba00-9b9afaffe356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:17.799051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33055d49-fa66-4f44-97d2-b29260e93077 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:17.818201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5e1d8-f6fb-4e6a-972f-eaf2a569e769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:17.818859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5e1d8-f6fb-4e6a-972f-eaf2a569e769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:17.819138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5e1d8-f6fb-4e6a-972f-eaf2a569e769 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:17.819406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5e1d8-f6fb-4e6a-972f-eaf2a569e769 admin admin] PATH_INFO: `/v3/projects/42b938a16a1c450088c1371e0fc0df54` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:17.827703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5e1d8-f6fb-4e6a-972f-eaf2a569e769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42b938a16a1c450088c1371e0fc0df54)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:17.831123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5e1d8-f6fb-4e6a-972f-eaf2a569e769 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:18.023122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cdc95-f044-413c-ba00-9b9afaffe356 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:18.031641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-59b5e1d8-f6fb-4e6a-972f-eaf2a569e769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b938a16a1c450088c1371e0fc0df54', 'request_id': 'req-59b5e1d8-f6fb-4e6a-972f-eaf2a569e769'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:18.060170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-59b5e1d8-f6fb-4e6a-972f-eaf2a569e769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b938a16a1c450088c1371e0fc0df54', 'request_id': 'req-59b5e1d8-f6fb-4e6a-972f-eaf2a569e769'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:18.092718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-59b5e1d8-f6fb-4e6a-972f-eaf2a569e769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b938a16a1c450088c1371e0fc0df54', 'request_id': 'req-59b5e1d8-f6fb-4e6a-972f-eaf2a569e769'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:18.152011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-59b5e1d8-f6fb-4e6a-972f-eaf2a569e769 admin admin] The token cache is being invalidate because project 42b938a16a1c450088c1371e0fc0df54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:09:18.152681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-59b5e1d8-f6fb-4e6a-972f-eaf2a569e769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:18.153555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-59b5e1d8-f6fb-4e6a-972f-eaf2a569e769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:18.158059 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3036/6051] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:09:17 2022] DELETE /identity/v3/projects/42b938a16a1c450088c1371e0fc0df54 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:18.162326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5e1d8-f6fb-4e6a-972f-eaf2a569e769 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:18.165930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-59b5e1d8-f6fb-4e6a-972f-eaf2a569e769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:18.192178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06addf-b25a-40d5-a015-49337a262307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:18.192382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06addf-b25a-40d5-a015-49337a262307 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:18.194925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06addf-b25a-40d5-a015-49337a262307 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:18.195685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06addf-b25a-40d5-a015-49337a262307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:18.202690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eb06addf-b25a-40d5-a015-49337a262307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:18.214274 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:18.362960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5e1d8-f6fb-4e6a-972f-eaf2a569e769 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:18.382066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e048c33-5273-43f5-8124-2eabeb90fbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:18.382721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e048c33-5273-43f5-8124-2eabeb90fbab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:18.383051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e048c33-5273-43f5-8124-2eabeb90fbab admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:18.385459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e048c33-5273-43f5-8124-2eabeb90fbab admin admin] PATH_INFO: `/v3/users/9f8cdcc8a94e482181e5655efc6142e4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:18.391550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e048c33-5273-43f5-8124-2eabeb90fbab admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f8cdcc8a94e482181e5655efc6142e4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:18.395758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e048c33-5273-43f5-8124-2eabeb90fbab admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:18.417557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06addf-b25a-40d5-a015-49337a262307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:18.422433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06addf-b25a-40d5-a015-49337a262307 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:18.466819 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3016/6052] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:09:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 768 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:09:18.556439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2e048c33-5273-43f5-8124-2eabeb90fbab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f8cdcc8a94e482181e5655efc6142e4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:18.557810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2e048c33-5273-43f5-8124-2eabeb90fbab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f8cdcc8a94e482181e5655efc6142e4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:18.681479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2e048c33-5273-43f5-8124-2eabeb90fbab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f8cdcc8a94e482181e5655efc6142e4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:18.681479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2e048c33-5273-43f5-8124-2eabeb90fbab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f8cdcc8a94e482181e5655efc6142e4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:18.681479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2e048c33-5273-43f5-8124-2eabeb90fbab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f8cdcc8a94e482181e5655efc6142e4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:18.685083 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3037/6053] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:09:18 2022] DELETE /identity/v3/users/9f8cdcc8a94e482181e5655efc6142e4 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:20.668180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06addf-b25a-40d5-a015-49337a262307 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:20.687373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06addf-b25a-40d5-a015-49337a262307 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:20.839997 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:20.898330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513092e4-25ec-44c7-94e1-c60b40df0297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:20.899665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513092e4-25ec-44c7-94e1-c60b40df0297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:20.900078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513092e4-25ec-44c7-94e1-c60b40df0297 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:20.900482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513092e4-25ec-44c7-94e1-c60b40df0297 admin admin] PATH_INFO: `/v3/projects/e0a61ad0920841a394ec172c384eaa60` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:20.901814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513092e4-25ec-44c7-94e1-c60b40df0297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0a61ad0920841a394ec172c384eaa60)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:20.903849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513092e4-25ec-44c7-94e1-c60b40df0297 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:21.021311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-513092e4-25ec-44c7-94e1-c60b40df0297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0a61ad0920841a394ec172c384eaa60', 'request_id': 'req-513092e4-25ec-44c7-94e1-c60b40df0297'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:21.049250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-513092e4-25ec-44c7-94e1-c60b40df0297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0a61ad0920841a394ec172c384eaa60', 'request_id': 'req-513092e4-25ec-44c7-94e1-c60b40df0297'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:21.060110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-513092e4-25ec-44c7-94e1-c60b40df0297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0a61ad0920841a394ec172c384eaa60', 'request_id': 'req-513092e4-25ec-44c7-94e1-c60b40df0297'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:21.091253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-513092e4-25ec-44c7-94e1-c60b40df0297 admin admin] The token cache is being invalidate because project e0a61ad0920841a394ec172c384eaa60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:09:21.092783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-513092e4-25ec-44c7-94e1-c60b40df0297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:21.094039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-513092e4-25ec-44c7-94e1-c60b40df0297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:21.106288 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3017/6054] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:09:20 2022] DELETE /identity/v3/projects/e0a61ad0920841a394ec172c384eaa60 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:21.106473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623ff66-6c7b-47b7-b905-b8674d0ed6c8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:21.106473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623ff66-6c7b-47b7-b905-b8674d0ed6c8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:21.106473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623ff66-6c7b-47b7-b905-b8674d0ed6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:21.159308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b623ff66-6c7b-47b7-b905-b8674d0ed6c8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:21.163924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b623ff66-6c7b-47b7-b905-b8674d0ed6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:21.335910 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3038/6055] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:21.344477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990744f-c331-4ebd-8a17-c1ac811dbfc8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:21.345186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990744f-c331-4ebd-8a17-c1ac811dbfc8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:21.345656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990744f-c331-4ebd-8a17-c1ac811dbfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:21.403782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1990744f-c331-4ebd-8a17-c1ac811dbfc8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:21.406553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1990744f-c331-4ebd-8a17-c1ac811dbfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:21.419004 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3018/6056] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:21.423508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623ff66-6c7b-47b7-b905-b8674d0ed6c8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:21.435845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623ff66-6c7b-47b7-b905-b8674d0ed6c8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:21.442311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdbc7df-bbdf-4ca6-9536-2b509f4a06c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:21.443275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbc7df-bbdf-4ca6-9536-2b509f4a06c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:21.443746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbc7df-bbdf-4ca6-9536-2b509f4a06c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:21.444228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbc7df-bbdf-4ca6-9536-2b509f4a06c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:21.445223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdbc7df-bbdf-4ca6-9536-2b509f4a06c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:09:21.445738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdbc7df-bbdf-4ca6-9536-2b509f4a06c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:21.448164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdbc7df-bbdf-4ca6-9536-2b509f4a06c0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:21.466617 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3039/6057] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:09:21.471349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990744f-c331-4ebd-8a17-c1ac811dbfc8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:21.491125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990744f-c331-4ebd-8a17-c1ac811dbfc8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:21.507159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbeddce-4d68-4208-b59d-8bb78b7b8946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:21.508212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbeddce-4d68-4208-b59d-8bb78b7b8946 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:21.508718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbeddce-4d68-4208-b59d-8bb78b7b8946 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:21.510482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbeddce-4d68-4208-b59d-8bb78b7b8946 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:21.511380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbeddce-4d68-4208-b59d-8bb78b7b8946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:21.517638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbeddce-4d68-4208-b59d-8bb78b7b8946 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:21.601384 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3019/6058] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:09:21 2022] POST /identity/v3/projects => generated 381 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:21.605147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdbc7df-bbdf-4ca6-9536-2b509f4a06c0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:21.620117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdbc7df-bbdf-4ca6-9536-2b509f4a06c0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:21.657742 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:21.758542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f661ff-a6bb-4048-948b-572c7b8c9ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:21.760921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f661ff-a6bb-4048-948b-572c7b8c9ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:21.761391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f661ff-a6bb-4048-948b-572c7b8c9ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:21.761953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f661ff-a6bb-4048-948b-572c7b8c9ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:21.764489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f661ff-a6bb-4048-948b-572c7b8c9ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:21.769549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f661ff-a6bb-4048-948b-572c7b8c9ae3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:21.829562 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3040/6059] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:09:21 2022] POST /identity/v3/users => generated 291 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:09:21.832317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbeddce-4d68-4208-b59d-8bb78b7b8946 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:21.851997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbeddce-4d68-4208-b59d-8bb78b7b8946 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:21.866201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0afda-2ebf-4152-a4aa-17437164900c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:21.867221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0afda-2ebf-4152-a4aa-17437164900c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:21.867515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0afda-2ebf-4152-a4aa-17437164900c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:21.867799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0afda-2ebf-4152-a4aa-17437164900c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:21.871406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0afda-2ebf-4152-a4aa-17437164900c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:21.876058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0afda-2ebf-4152-a4aa-17437164900c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:21.902466 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3020/6060] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:09:21.908147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f661ff-a6bb-4048-948b-572c7b8c9ae3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:21.942534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f661ff-a6bb-4048-948b-572c7b8c9ae3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:21.949192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699f535-ab75-4371-a76c-1ea0af6de90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:21.949830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699f535-ab75-4371-a76c-1ea0af6de90d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:21.950171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699f535-ab75-4371-a76c-1ea0af6de90d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:21.950551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699f535-ab75-4371-a76c-1ea0af6de90d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:21.952357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699f535-ab75-4371-a76c-1ea0af6de90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:21.954199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699f535-ab75-4371-a76c-1ea0af6de90d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:21.973074 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3041/6061] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:09:21.986603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0afda-2ebf-4152-a4aa-17437164900c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:22.001372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0afda-2ebf-4152-a4aa-17437164900c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:22.010595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49f916-1270-4c79-ac87-ca618c759970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:22.011869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49f916-1270-4c79-ac87-ca618c759970 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:22.012624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49f916-1270-4c79-ac87-ca618c759970 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:22.015683 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49f916-1270-4c79-ac87-ca618c759970 admin admin] PATH_INFO: `/v3/projects/b10d2a72eed24ba6b226c434972cb4c0/users/88ad5521f2f34e79a78fdeb05975c60a/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:22.060178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49f916-1270-4c79-ac87-ca618c759970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10d2a72eed24ba6b226c434972cb4c0, user_id=88ad5521f2f34e79a78fdeb05975c60a, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:22.063246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49f916-1270-4c79-ac87-ca618c759970 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:22.099965 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3021/6062] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:09:21 2022] PUT /identity/v3/projects/b10d2a72eed24ba6b226c434972cb4c0/users/88ad5521f2f34e79a78fdeb05975c60a/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:22.111589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed40666-fee4-4850-b914-fadca429936b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:22.111589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed40666-fee4-4850-b914-fadca429936b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:22.112050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed40666-fee4-4850-b914-fadca429936b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:22.185297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8ed40666-fee4-4850-b914-fadca429936b None None] MFA Rules not processed for user `88ad5521f2f34e79a78fdeb05975c60a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:22.191516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8ed40666-fee4-4850-b914-fadca429936b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:22.399072 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3042/6063] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:22.403062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49f916-1270-4c79-ac87-ca618c759970 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:22.558103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49f916-1270-4c79-ac87-ca618c759970 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:22.573216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596d1e3-05b8-48f5-bff0-f4ee44038a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:22.573858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596d1e3-05b8-48f5-bff0-f4ee44038a14 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:22.574220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596d1e3-05b8-48f5-bff0-f4ee44038a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:22.574495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596d1e3-05b8-48f5-bff0-f4ee44038a14 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:22.575155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596d1e3-05b8-48f5-bff0-f4ee44038a14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:22.578680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596d1e3-05b8-48f5-bff0-f4ee44038a14 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:22.605883 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:22.639310 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3022/6064] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:09:22 2022] POST /identity/v3/projects => generated 379 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:09:22.643834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed40666-fee4-4850-b914-fadca429936b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:22.662086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed40666-fee4-4850-b914-fadca429936b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:22.757366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f904ce2-258d-4562-bc6c-237c6de53736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:22.758032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f904ce2-258d-4562-bc6c-237c6de53736 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:22.761089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f904ce2-258d-4562-bc6c-237c6de53736 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:22.761381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f904ce2-258d-4562-bc6c-237c6de53736 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:22.764592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f904ce2-258d-4562-bc6c-237c6de53736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:22.771033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f904ce2-258d-4562-bc6c-237c6de53736 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:22.822965 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3043/6065] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:09:22 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:22.827512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596d1e3-05b8-48f5-bff0-f4ee44038a14 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:22.844333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596d1e3-05b8-48f5-bff0-f4ee44038a14 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:22.869650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174e8de-3f6f-460d-b965-9e7b0d9e2ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:22.869978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174e8de-3f6f-460d-b965-9e7b0d9e2ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:22.872811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174e8de-3f6f-460d-b965-9e7b0d9e2ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:22.873785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174e8de-3f6f-460d-b965-9e7b0d9e2ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:22.875636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174e8de-3f6f-460d-b965-9e7b0d9e2ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:22.877586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174e8de-3f6f-460d-b965-9e7b0d9e2ff6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:22.901192 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3023/6066] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:09:22.905550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f904ce2-258d-4562-bc6c-237c6de53736 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:22.920708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f904ce2-258d-4562-bc6c-237c6de53736 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:22.936906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dbd90-2ef4-473c-ba35-1382259c11ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:22.937607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dbd90-2ef4-473c-ba35-1382259c11ba admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:22.937943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dbd90-2ef4-473c-ba35-1382259c11ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:22.938221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dbd90-2ef4-473c-ba35-1382259c11ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:22.938888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dbd90-2ef4-473c-ba35-1382259c11ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:22.944669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dbd90-2ef4-473c-ba35-1382259c11ba admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:22.990135 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3044/6067] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:09:22.994418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174e8de-3f6f-460d-b965-9e7b0d9e2ff6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:23.008436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174e8de-3f6f-460d-b965-9e7b0d9e2ff6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:23.023917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdb1c1-ee30-46d3-8853-3e1cda60950b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:23.024497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdb1c1-ee30-46d3-8853-3e1cda60950b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:23.024885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdb1c1-ee30-46d3-8853-3e1cda60950b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:23.025080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdb1c1-ee30-46d3-8853-3e1cda60950b admin admin] PATH_INFO: `/v3/projects/43243a5d9e804dd38a2c39a0de39efd8/users/6618f4e1a9fa42349aa6acff0d1b9c51/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:23.070203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdb1c1-ee30-46d3-8853-3e1cda60950b admin admin] RBAC: Authorizing `identity:create_grant(project_id=43243a5d9e804dd38a2c39a0de39efd8, user_id=6618f4e1a9fa42349aa6acff0d1b9c51, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:23.073854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdb1c1-ee30-46d3-8853-3e1cda60950b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:23.134449 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3024/6068] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:09:22 2022] PUT /identity/v3/projects/43243a5d9e804dd38a2c39a0de39efd8/users/6618f4e1a9fa42349aa6acff0d1b9c51/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:23.280180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e536be-e04a-4d09-a577-019f938b4cae None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:23.280683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e536be-e04a-4d09-a577-019f938b4cae None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:23.281456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e536be-e04a-4d09-a577-019f938b4cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:23.291303 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:23.350400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-90e536be-e04a-4d09-a577-019f938b4cae None None] MFA Rules not processed for user `6618f4e1a9fa42349aa6acff0d1b9c51`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:23.351848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-90e536be-e04a-4d09-a577-019f938b4cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:23.598728 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3045/6069] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:23.600053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdb1c1-ee30-46d3-8853-3e1cda60950b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:23.757431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdb1c1-ee30-46d3-8853-3e1cda60950b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:23.769268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ae1f5-0a64-45f4-a8ee-fa4efa61925e tempest-IdentityV3ProjectsTest-2105014804 tempest-IdentityV3ProjectsTest-2105014804-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ad5521f2f34e79a78fdeb05975c60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b10d2a72eed24ba6b226c434972cb4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:23.769938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ae1f5-0a64-45f4-a8ee-fa4efa61925e tempest-IdentityV3ProjectsTest-2105014804 tempest-IdentityV3ProjectsTest-2105014804-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:23.770222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ae1f5-0a64-45f4-a8ee-fa4efa61925e tempest-IdentityV3ProjectsTest-2105014804 tempest-IdentityV3ProjectsTest-2105014804-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:23.770503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ae1f5-0a64-45f4-a8ee-fa4efa61925e tempest-IdentityV3ProjectsTest-2105014804 tempest-IdentityV3ProjectsTest-2105014804-project] PATH_INFO: `/v3/users/88ad5521f2f34e79a78fdeb05975c60a/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:23.773217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ae1f5-0a64-45f4-a8ee-fa4efa61925e tempest-IdentityV3ProjectsTest-2105014804 tempest-IdentityV3ProjectsTest-2105014804-project] RBAC: Authorizing `identity:list_user_projects(user_id=88ad5521f2f34e79a78fdeb05975c60a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:23.775024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ae1f5-0a64-45f4-a8ee-fa4efa61925e tempest-IdentityV3ProjectsTest-2105014804 tempest-IdentityV3ProjectsTest-2105014804-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:23.883752 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3025/6070] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Sep 30 10:09:23 2022] GET /identity/v3/users/88ad5521f2f34e79a78fdeb05975c60a/projects => generated 517 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:09:23.891624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afb998-0b47-4171-a1d5-6debfcb9450b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:23.892179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afb998-0b47-4171-a1d5-6debfcb9450b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:23.892913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afb998-0b47-4171-a1d5-6debfcb9450b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:24.008213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-43afb998-0b47-4171-a1d5-6debfcb9450b None None] MFA Rules not processed for user `88ad5521f2f34e79a78fdeb05975c60a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:24.017437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-43afb998-0b47-4171-a1d5-6debfcb9450b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:24.037335 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3046/6071] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:24.040230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694c292-5282-4543-a84a-ca5964babbca None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:24.043371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694c292-5282-4543-a84a-ca5964babbca None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:24.043843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694c292-5282-4543-a84a-ca5964babbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:24.112845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a694c292-5282-4543-a84a-ca5964babbca None None] MFA Rules not processed for user `88ad5521f2f34e79a78fdeb05975c60a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:24.115046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a694c292-5282-4543-a84a-ca5964babbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:24.322557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.models.token_model [None req-a694c292-5282-4543-a84a-ca5964babbca None None] User 88ad5521f2f34e79a78fdeb05975c60a has no access to project 43243a5d9e804dd38a2c39a0de39efd8 {{(pid=82080) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Sep 30 10:09:24.343600 n-d-master-1 devstack@keystone.service[82080]: WARNING keystone.server.flask.application [None req-a694c292-5282-4543-a84a-ca5964babbca None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 30 10:09:24.350186 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3026/6072] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:24 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 312 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Sep 30 10:09:24.356058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afb998-0b47-4171-a1d5-6debfcb9450b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:24.523671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afb998-0b47-4171-a1d5-6debfcb9450b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:24.533886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793d6cd-5d2a-4930-9611-893ba69af55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:24.534891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793d6cd-5d2a-4930-9611-893ba69af55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:24.535398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793d6cd-5d2a-4930-9611-893ba69af55a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:24.536110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793d6cd-5d2a-4930-9611-893ba69af55a admin admin] PATH_INFO: `/v3/users/88ad5521f2f34e79a78fdeb05975c60a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:24.537537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793d6cd-5d2a-4930-9611-893ba69af55a admin admin] RBAC: Authorizing `identity:delete_user(user_id=88ad5521f2f34e79a78fdeb05975c60a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:24.557472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793d6cd-5d2a-4930-9611-893ba69af55a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:24.645736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f793d6cd-5d2a-4930-9611-893ba69af55a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88ad5521f2f34e79a78fdeb05975c60a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:24.646617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f793d6cd-5d2a-4930-9611-893ba69af55a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88ad5521f2f34e79a78fdeb05975c60a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:24.663528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f793d6cd-5d2a-4930-9611-893ba69af55a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88ad5521f2f34e79a78fdeb05975c60a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:24.708944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f793d6cd-5d2a-4930-9611-893ba69af55a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88ad5521f2f34e79a78fdeb05975c60a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:24.723737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f793d6cd-5d2a-4930-9611-893ba69af55a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88ad5521f2f34e79a78fdeb05975c60a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:24.731149 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:24.743407 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3047/6073] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:09:24 2022] DELETE /identity/v3/users/88ad5521f2f34e79a78fdeb05975c60a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:24.747754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245d639-9694-4f9c-9ce1-1acbeb4c4ce3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:24.748325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245d639-9694-4f9c-9ce1-1acbeb4c4ce3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:24.748802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245d639-9694-4f9c-9ce1-1acbeb4c4ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:24.790729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b245d639-9694-4f9c-9ce1-1acbeb4c4ce3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:24.791888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b245d639-9694-4f9c-9ce1-1acbeb4c4ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:24.871407 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:24.939362 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3027/6074] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:25.039239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793d6cd-5d2a-4930-9611-893ba69af55a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:25.041123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f793d6cd-5d2a-4930-9611-893ba69af55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:25.191310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245d639-9694-4f9c-9ce1-1acbeb4c4ce3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:25.193827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b245d639-9694-4f9c-9ce1-1acbeb4c4ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:25.226150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793d6cd-5d2a-4930-9611-893ba69af55a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:25.242441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab59ce0-6585-448d-83d7-17c2c758568e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:25.243425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab59ce0-6585-448d-83d7-17c2c758568e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:25.243842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab59ce0-6585-448d-83d7-17c2c758568e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:25.244872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab59ce0-6585-448d-83d7-17c2c758568e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:25.266864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab59ce0-6585-448d-83d7-17c2c758568e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:25.268677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab59ce0-6585-448d-83d7-17c2c758568e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:25.296650 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3048/6075] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:09:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:09:25.593352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245d639-9694-4f9c-9ce1-1acbeb4c4ce3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:25.605478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0d8c1-c890-4ca4-ae33-710c9710926f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:25.606317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0d8c1-c890-4ca4-ae33-710c9710926f service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:25.606737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0d8c1-c890-4ca4-ae33-710c9710926f service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:25.607081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0d8c1-c890-4ca4-ae33-710c9710926f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:25.610507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-caa0d8c1-c890-4ca4-ae33-710c9710926f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:25.633138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0d8c1-c890-4ca4-ae33-710c9710926f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:25.637336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0d8c1-c890-4ca4-ae33-710c9710926f service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:25.659184 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3028/6076] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:09:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:09:26.327579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab59ce0-6585-448d-83d7-17c2c758568e service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:26.329099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fab59ce0-6585-448d-83d7-17c2c758568e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:26.363761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab59ce0-6585-448d-83d7-17c2c758568e service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:26.378503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde23b2-8e40-4469-8e74-90da17e6caff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:26.388922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde23b2-8e40-4469-8e74-90da17e6caff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:26.388922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde23b2-8e40-4469-8e74-90da17e6caff admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:26.388922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde23b2-8e40-4469-8e74-90da17e6caff admin admin] PATH_INFO: `/v3/projects/b10d2a72eed24ba6b226c434972cb4c0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:26.399600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde23b2-8e40-4469-8e74-90da17e6caff admin admin] RBAC: Authorizing `identity:delete_project(project_id=b10d2a72eed24ba6b226c434972cb4c0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:26.402667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde23b2-8e40-4469-8e74-90da17e6caff admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:26.547407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fbde23b2-8e40-4469-8e74-90da17e6caff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b10d2a72eed24ba6b226c434972cb4c0', 'request_id': 'req-fbde23b2-8e40-4469-8e74-90da17e6caff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:26.570658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fbde23b2-8e40-4469-8e74-90da17e6caff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b10d2a72eed24ba6b226c434972cb4c0', 'request_id': 'req-fbde23b2-8e40-4469-8e74-90da17e6caff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:26.585722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fbde23b2-8e40-4469-8e74-90da17e6caff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b10d2a72eed24ba6b226c434972cb4c0', 'request_id': 'req-fbde23b2-8e40-4469-8e74-90da17e6caff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:26.608429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fbde23b2-8e40-4469-8e74-90da17e6caff admin admin] The token cache is being invalidate because project b10d2a72eed24ba6b226c434972cb4c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:09:26.608753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fbde23b2-8e40-4469-8e74-90da17e6caff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:26.613118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fbde23b2-8e40-4469-8e74-90da17e6caff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:26.620034 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3049/6077] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:09:26 2022] DELETE /identity/v3/projects/b10d2a72eed24ba6b226c434972cb4c0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:26.624373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0d8c1-c890-4ca4-ae33-710c9710926f service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:26.642068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0d8c1-c890-4ca4-ae33-710c9710926f service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:26.928909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549c04e-d4a7-4bb1-810d-de85ae2ed73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:26.929569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549c04e-d4a7-4bb1-810d-de85ae2ed73d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:26.929863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549c04e-d4a7-4bb1-810d-de85ae2ed73d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:26.930123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549c04e-d4a7-4bb1-810d-de85ae2ed73d admin admin] PATH_INFO: `/v3/users/6618f4e1a9fa42349aa6acff0d1b9c51` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:26.933987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549c04e-d4a7-4bb1-810d-de85ae2ed73d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6618f4e1a9fa42349aa6acff0d1b9c51)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:26.941283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549c04e-d4a7-4bb1-810d-de85ae2ed73d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:27.022883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0549c04e-d4a7-4bb1-810d-de85ae2ed73d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6618f4e1a9fa42349aa6acff0d1b9c51'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:27.055616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0549c04e-d4a7-4bb1-810d-de85ae2ed73d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6618f4e1a9fa42349aa6acff0d1b9c51'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:27.057790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0549c04e-d4a7-4bb1-810d-de85ae2ed73d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6618f4e1a9fa42349aa6acff0d1b9c51'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:27.065737 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:27.082041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0549c04e-d4a7-4bb1-810d-de85ae2ed73d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6618f4e1a9fa42349aa6acff0d1b9c51'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:27.097516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0549c04e-d4a7-4bb1-810d-de85ae2ed73d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6618f4e1a9fa42349aa6acff0d1b9c51'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:27.105530 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3029/6078] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:09:26 2022] DELETE /identity/v3/users/6618f4e1a9fa42349aa6acff0d1b9c51 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:28.377672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde23b2-8e40-4469-8e74-90da17e6caff admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:28.379955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fbde23b2-8e40-4469-8e74-90da17e6caff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:28.408766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde23b2-8e40-4469-8e74-90da17e6caff admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:28.537876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577f050-dcee-4cc6-b4ce-4dc5505608e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:28.538525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577f050-dcee-4cc6-b4ce-4dc5505608e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:28.538794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577f050-dcee-4cc6-b4ce-4dc5505608e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:28.539066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577f050-dcee-4cc6-b4ce-4dc5505608e8 admin admin] PATH_INFO: `/v3/projects/43243a5d9e804dd38a2c39a0de39efd8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:28.545628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577f050-dcee-4cc6-b4ce-4dc5505608e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43243a5d9e804dd38a2c39a0de39efd8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:28.547388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577f050-dcee-4cc6-b4ce-4dc5505608e8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:28.633967 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:28.670537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4577f050-dcee-4cc6-b4ce-4dc5505608e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43243a5d9e804dd38a2c39a0de39efd8', 'request_id': 'req-4577f050-dcee-4cc6-b4ce-4dc5505608e8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:28.696078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4577f050-dcee-4cc6-b4ce-4dc5505608e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43243a5d9e804dd38a2c39a0de39efd8', 'request_id': 'req-4577f050-dcee-4cc6-b4ce-4dc5505608e8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:28.707928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4577f050-dcee-4cc6-b4ce-4dc5505608e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43243a5d9e804dd38a2c39a0de39efd8', 'request_id': 'req-4577f050-dcee-4cc6-b4ce-4dc5505608e8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:28.737892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4577f050-dcee-4cc6-b4ce-4dc5505608e8 admin admin] The token cache is being invalidate because project 43243a5d9e804dd38a2c39a0de39efd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:09:28.738261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4577f050-dcee-4cc6-b4ce-4dc5505608e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:28.739263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4577f050-dcee-4cc6-b4ce-4dc5505608e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:28.747409 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3050/6079] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:09:28 2022] DELETE /identity/v3/projects/43243a5d9e804dd38a2c39a0de39efd8 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:28.749997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd78e68-f189-4823-a636-803fded3f394 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:28.750468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd78e68-f189-4823-a636-803fded3f394 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:28.750553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd78e68-f189-4823-a636-803fded3f394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:28.783920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dcd78e68-f189-4823-a636-803fded3f394 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:28.788349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dcd78e68-f189-4823-a636-803fded3f394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:28.963311 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3030/6080] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:28.965046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065df1b0-9ca2-4bfc-a1f4-ae3ce642a7b2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:28.965544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065df1b0-9ca2-4bfc-a1f4-ae3ce642a7b2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:28.966015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065df1b0-9ca2-4bfc-a1f4-ae3ce642a7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:29.006118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-065df1b0-9ca2-4bfc-a1f4-ae3ce642a7b2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:29.007846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-065df1b0-9ca2-4bfc-a1f4-ae3ce642a7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:29.031638 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3051/6081] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:09:29.035388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd78e68-f189-4823-a636-803fded3f394 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:29.061485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd78e68-f189-4823-a636-803fded3f394 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:29.066649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82216c-0ac0-4c0f-906b-7112e1e602af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:29.067278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82216c-0ac0-4c0f-906b-7112e1e602af admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:29.067558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82216c-0ac0-4c0f-906b-7112e1e602af admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:29.067830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82216c-0ac0-4c0f-906b-7112e1e602af admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:29.068491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82216c-0ac0-4c0f-906b-7112e1e602af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:09:29.068819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82216c-0ac0-4c0f-906b-7112e1e602af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:29.070432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82216c-0ac0-4c0f-906b-7112e1e602af admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:29.098953 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3031/6082] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:09:29.100157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065df1b0-9ca2-4bfc-a1f4-ae3ce642a7b2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:29.117619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065df1b0-9ca2-4bfc-a1f4-ae3ce642a7b2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:29.123236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca1119-0a4d-4f70-a304-c99fddc9c733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:29.124183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca1119-0a4d-4f70-a304-c99fddc9c733 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:29.124970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca1119-0a4d-4f70-a304-c99fddc9c733 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:29.125349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca1119-0a4d-4f70-a304-c99fddc9c733 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:29.126927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca1119-0a4d-4f70-a304-c99fddc9c733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:29.129266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca1119-0a4d-4f70-a304-c99fddc9c733 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:29.194883 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3052/6083] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:09:29 2022] POST /identity/v3/projects => generated 397 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:09:29.198878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82216c-0ac0-4c0f-906b-7112e1e602af admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:29.210219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82216c-0ac0-4c0f-906b-7112e1e602af admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:29.350616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5845b56-d620-4f16-8da1-536f590bda91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:29.351251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5845b56-d620-4f16-8da1-536f590bda91 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:29.354817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5845b56-d620-4f16-8da1-536f590bda91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:29.354817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5845b56-d620-4f16-8da1-536f590bda91 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:29.355008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5845b56-d620-4f16-8da1-536f590bda91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:29.360935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5845b56-d620-4f16-8da1-536f590bda91 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:29.404732 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3032/6084] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:09:29 2022] POST /identity/v3/users => generated 305 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:29.409058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca1119-0a4d-4f70-a304-c99fddc9c733 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:29.428524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca1119-0a4d-4f70-a304-c99fddc9c733 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:29.442299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ea867-c99c-4ac1-80a6-941a3c52adb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:29.442849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ea867-c99c-4ac1-80a6-941a3c52adb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:29.443131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ea867-c99c-4ac1-80a6-941a3c52adb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:29.443402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ea867-c99c-4ac1-80a6-941a3c52adb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:29.444054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ea867-c99c-4ac1-80a6-941a3c52adb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:29.445688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ea867-c99c-4ac1-80a6-941a3c52adb9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:29.466632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5845b56-d620-4f16-8da1-536f590bda91 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:29.467703 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3053/6085] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:09:29.477685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5845b56-d620-4f16-8da1-536f590bda91 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:29.494569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c708b-0010-42dd-9ddd-9dabdca94c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:29.495679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c708b-0010-42dd-9ddd-9dabdca94c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:29.496366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c708b-0010-42dd-9ddd-9dabdca94c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:29.496949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c708b-0010-42dd-9ddd-9dabdca94c3a admin admin] PATH_INFO: `/v3/projects/dc78d168b60747a387ddf608ea0b6e9e/users/8696615b06ad49819187cb7866db985c/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:29.538634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c708b-0010-42dd-9ddd-9dabdca94c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc78d168b60747a387ddf608ea0b6e9e, user_id=8696615b06ad49819187cb7866db985c, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:29.542022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c708b-0010-42dd-9ddd-9dabdca94c3a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:29.576423 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3033/6086] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:09:29 2022] PUT /identity/v3/projects/dc78d168b60747a387ddf608ea0b6e9e/users/8696615b06ad49819187cb7866db985c/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:09:29.583294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ea867-c99c-4ac1-80a6-941a3c52adb9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:29.603275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ea867-c99c-4ac1-80a6-941a3c52adb9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:29.806165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e47c0-0cba-4c0c-a564-b413a3946e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:29.806816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e47c0-0cba-4c0c-a564-b413a3946e7d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:29.807095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e47c0-0cba-4c0c-a564-b413a3946e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:29.807370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e47c0-0cba-4c0c-a564-b413a3946e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:29.808007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e47c0-0cba-4c0c-a564-b413a3946e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:29.809641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e47c0-0cba-4c0c-a564-b413a3946e7d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:29.833669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c708b-0010-42dd-9ddd-9dabdca94c3a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:29.834212 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3054/6087] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:09:29.851535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c708b-0010-42dd-9ddd-9dabdca94c3a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:29.861399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405358bb-1b14-4fd9-b68e-31519eefa211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:29.862264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405358bb-1b14-4fd9-b68e-31519eefa211 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:29.862766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405358bb-1b14-4fd9-b68e-31519eefa211 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:29.863293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405358bb-1b14-4fd9-b68e-31519eefa211 admin admin] PATH_INFO: `/v3/projects/dc78d168b60747a387ddf608ea0b6e9e/users/8696615b06ad49819187cb7866db985c/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:29.867349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405358bb-1b14-4fd9-b68e-31519eefa211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc78d168b60747a387ddf608ea0b6e9e, user_id=8696615b06ad49819187cb7866db985c, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:29.878611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405358bb-1b14-4fd9-b68e-31519eefa211 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:29.909024 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3034/6088] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:09:29 2022] PUT /identity/v3/projects/dc78d168b60747a387ddf608ea0b6e9e/users/8696615b06ad49819187cb7866db985c/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:09:29.927804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ebbec-4a72-4fdc-af21-c5bc32882f1e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:29.935017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ebbec-4a72-4fdc-af21-c5bc32882f1e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:29.935870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ebbec-4a72-4fdc-af21-c5bc32882f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:30.012697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d09ebbec-4a72-4fdc-af21-c5bc32882f1e None None] MFA Rules not processed for user `8696615b06ad49819187cb7866db985c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:30.014853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d09ebbec-4a72-4fdc-af21-c5bc32882f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:30.247315 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:30.262802 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3055/6089] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:29 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:30.264066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405358bb-1b14-4fd9-b68e-31519eefa211 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:30.320403 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:30.506934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405358bb-1b14-4fd9-b68e-31519eefa211 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:30.519622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba280bcb-b080-4fef-a0e5-3c7971eed19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:30.520172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba280bcb-b080-4fef-a0e5-3c7971eed19b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:30.520655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba280bcb-b080-4fef-a0e5-3c7971eed19b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:30.520936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba280bcb-b080-4fef-a0e5-3c7971eed19b admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:30.521589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba280bcb-b080-4fef-a0e5-3c7971eed19b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:30.527577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba280bcb-b080-4fef-a0e5-3c7971eed19b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:30.601884 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3035/6090] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:09:30 2022] POST /identity/v3/projects => generated 397 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:09:30.605714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ebbec-4a72-4fdc-af21-c5bc32882f1e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:30.625833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ebbec-4a72-4fdc-af21-c5bc32882f1e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:30.792613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200899bc-335b-4cf8-8a43-19ae10d7aeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:30.793253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200899bc-335b-4cf8-8a43-19ae10d7aeab admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:30.793603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200899bc-335b-4cf8-8a43-19ae10d7aeab admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:30.795233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200899bc-335b-4cf8-8a43-19ae10d7aeab admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:30.796262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200899bc-335b-4cf8-8a43-19ae10d7aeab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:30.800188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200899bc-335b-4cf8-8a43-19ae10d7aeab admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:30.864071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba280bcb-b080-4fef-a0e5-3c7971eed19b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:30.864840 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3056/6091] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:09:30 2022] POST /identity/v3/users => generated 299 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:09:30.889425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba280bcb-b080-4fef-a0e5-3c7971eed19b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:30.909697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7b4eb-894c-4fe7-afdf-15e161f65eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:30.910343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7b4eb-894c-4fe7-afdf-15e161f65eef admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:30.910621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7b4eb-894c-4fe7-afdf-15e161f65eef admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:30.910901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7b4eb-894c-4fe7-afdf-15e161f65eef admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:30.929331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7b4eb-894c-4fe7-afdf-15e161f65eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:30.931348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7b4eb-894c-4fe7-afdf-15e161f65eef admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:30.986116 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3036/6092] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:09:30.990039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200899bc-335b-4cf8-8a43-19ae10d7aeab admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:31.005018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200899bc-335b-4cf8-8a43-19ae10d7aeab admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:31.024312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542d679-8b38-4256-8800-eecfcddedb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:31.024964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542d679-8b38-4256-8800-eecfcddedb88 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:31.025499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542d679-8b38-4256-8800-eecfcddedb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:31.025499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542d679-8b38-4256-8800-eecfcddedb88 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:31.026573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542d679-8b38-4256-8800-eecfcddedb88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:31.027750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542d679-8b38-4256-8800-eecfcddedb88 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:31.085163 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3057/6093] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:09:31.086243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7b4eb-894c-4fe7-afdf-15e161f65eef admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:31.103662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7b4eb-894c-4fe7-afdf-15e161f65eef admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:31.131661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc28362-b0d1-4ba7-9a3a-6dfb0c927f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:31.132633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc28362-b0d1-4ba7-9a3a-6dfb0c927f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:31.133037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc28362-b0d1-4ba7-9a3a-6dfb0c927f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:31.133405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc28362-b0d1-4ba7-9a3a-6dfb0c927f0e admin admin] PATH_INFO: `/v3/projects/47224b53594348039616614af242730a/users/3f7b39e8bb04458bb3f4fddcfed8330d/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:31.184416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc28362-b0d1-4ba7-9a3a-6dfb0c927f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=47224b53594348039616614af242730a, user_id=3f7b39e8bb04458bb3f4fddcfed8330d, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:31.188844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc28362-b0d1-4ba7-9a3a-6dfb0c927f0e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:31.228731 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3037/6094] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:09:31 2022] PUT /identity/v3/projects/47224b53594348039616614af242730a/users/3f7b39e8bb04458bb3f4fddcfed8330d/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:09:31.243047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc66ec0-aeb9-40e4-98d9-a59a4ec24815 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:31.243336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc66ec0-aeb9-40e4-98d9-a59a4ec24815 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:31.243613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc66ec0-aeb9-40e4-98d9-a59a4ec24815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:31.341344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cfc66ec0-aeb9-40e4-98d9-a59a4ec24815 None None] MFA Rules not processed for user `3f7b39e8bb04458bb3f4fddcfed8330d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:31.342645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cfc66ec0-aeb9-40e4-98d9-a59a4ec24815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:31.527493 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3058/6095] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:31 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:31.537858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc28362-b0d1-4ba7-9a3a-6dfb0c927f0e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:31.540813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-adc28362-b0d1-4ba7-9a3a-6dfb0c927f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:31.755969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc28362-b0d1-4ba7-9a3a-6dfb0c927f0e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:31.769895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07450b-12b8-4dbd-a8b6-fefd6874abff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:31.770532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07450b-12b8-4dbd-a8b6-fefd6874abff service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:31.770806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07450b-12b8-4dbd-a8b6-fefd6874abff service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:31.771075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07450b-12b8-4dbd-a8b6-fefd6874abff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:31.967001 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:31.974970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07450b-12b8-4dbd-a8b6-fefd6874abff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:31.976406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07450b-12b8-4dbd-a8b6-fefd6874abff service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:32.000726 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3038/6096] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:09:31 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:09:33.124718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc66ec0-aeb9-40e4-98d9-a59a4ec24815 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:33.324655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc66ec0-aeb9-40e4-98d9-a59a4ec24815 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:33.342217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4625f08-1e5b-4d7f-80d3-c4686dbc462a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:33.343744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4625f08-1e5b-4d7f-80d3-c4686dbc462a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:33.344282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4625f08-1e5b-4d7f-80d3-c4686dbc462a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:33.344869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4625f08-1e5b-4d7f-80d3-c4686dbc462a admin admin] PATH_INFO: `/v3/users/8696615b06ad49819187cb7866db985c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:33.346366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4625f08-1e5b-4d7f-80d3-c4686dbc462a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8696615b06ad49819187cb7866db985c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:33.348527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4625f08-1e5b-4d7f-80d3-c4686dbc462a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:33.355679 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:33.431266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f4625f08-1e5b-4d7f-80d3-c4686dbc462a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8696615b06ad49819187cb7866db985c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:33.432289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f4625f08-1e5b-4d7f-80d3-c4686dbc462a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8696615b06ad49819187cb7866db985c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:33.480168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f4625f08-1e5b-4d7f-80d3-c4686dbc462a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8696615b06ad49819187cb7866db985c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:33.537534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f4625f08-1e5b-4d7f-80d3-c4686dbc462a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8696615b06ad49819187cb7866db985c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:33.559017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f4625f08-1e5b-4d7f-80d3-c4686dbc462a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8696615b06ad49819187cb7866db985c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:33.592922 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3059/6097] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:09:33 2022] DELETE /identity/v3/users/8696615b06ad49819187cb7866db985c => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:33.597319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacb4ab-d805-447d-b360-49af4fb83f37 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:33.597840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacb4ab-d805-447d-b360-49af4fb83f37 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:33.597840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacb4ab-d805-447d-b360-49af4fb83f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:33.674081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9eacb4ab-d805-447d-b360-49af4fb83f37 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:33.680906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9eacb4ab-d805-447d-b360-49af4fb83f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:33.891326 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3039/6098] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:33.995637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4625f08-1e5b-4d7f-80d3-c4686dbc462a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:33.997162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f4625f08-1e5b-4d7f-80d3-c4686dbc462a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:34.251451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4625f08-1e5b-4d7f-80d3-c4686dbc462a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:34.265044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac224ab7-5d3d-4a06-b824-85d6873ced43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:34.266120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac224ab7-5d3d-4a06-b824-85d6873ced43 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:34.266549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac224ab7-5d3d-4a06-b824-85d6873ced43 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:34.267145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac224ab7-5d3d-4a06-b824-85d6873ced43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:34.316375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac224ab7-5d3d-4a06-b824-85d6873ced43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:34.319563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac224ab7-5d3d-4a06-b824-85d6873ced43 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:34.336335 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3060/6099] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:09:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:09:36.321037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacb4ab-d805-447d-b360-49af4fb83f37 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:36.325209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9eacb4ab-d805-447d-b360-49af4fb83f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:36.384174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacb4ab-d805-447d-b360-49af4fb83f37 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:36.394011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac224ab7-5d3d-4a06-b824-85d6873ced43 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:36.395926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ac224ab7-5d3d-4a06-b824-85d6873ced43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:36.425412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615736f-b9c4-40ad-9528-fae987e4a3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:36.429396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615736f-b9c4-40ad-9528-fae987e4a3f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:36.430617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615736f-b9c4-40ad-9528-fae987e4a3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:36.431709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615736f-b9c4-40ad-9528-fae987e4a3f6 admin admin] PATH_INFO: `/v3/projects/dc78d168b60747a387ddf608ea0b6e9e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:36.433620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac224ab7-5d3d-4a06-b824-85d6873ced43 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:36.438834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615736f-b9c4-40ad-9528-fae987e4a3f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc78d168b60747a387ddf608ea0b6e9e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:36.443727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615736f-b9c4-40ad-9528-fae987e4a3f6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:36.469208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbe687-a838-4648-8d2c-618345615759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:36.470300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbe687-a838-4648-8d2c-618345615759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:36.471036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbe687-a838-4648-8d2c-618345615759 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:36.471575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbe687-a838-4648-8d2c-618345615759 admin admin] PATH_INFO: `/v3/users/7100e3fe0fb945f697857613dbbe990a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:36.477480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbe687-a838-4648-8d2c-618345615759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7100e3fe0fb945f697857613dbbe990a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:36.480434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbe687-a838-4648-8d2c-618345615759 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:36.645382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03bbe687-a838-4648-8d2c-618345615759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7100e3fe0fb945f697857613dbbe990a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:36.646753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03bbe687-a838-4648-8d2c-618345615759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7100e3fe0fb945f697857613dbbe990a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:36.667862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9615736f-b9c4-40ad-9528-fae987e4a3f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc78d168b60747a387ddf608ea0b6e9e', 'request_id': 'req-9615736f-b9c4-40ad-9528-fae987e4a3f6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:36.668558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03bbe687-a838-4648-8d2c-618345615759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7100e3fe0fb945f697857613dbbe990a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:36.698023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03bbe687-a838-4648-8d2c-618345615759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7100e3fe0fb945f697857613dbbe990a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:36.703175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9615736f-b9c4-40ad-9528-fae987e4a3f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc78d168b60747a387ddf608ea0b6e9e', 'request_id': 'req-9615736f-b9c4-40ad-9528-fae987e4a3f6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:36.713753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03bbe687-a838-4648-8d2c-618345615759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7100e3fe0fb945f697857613dbbe990a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:36.721899 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:36.731466 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3061/6100] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:09:36 2022] DELETE /identity/v3/users/7100e3fe0fb945f697857613dbbe990a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:36.745404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9615736f-b9c4-40ad-9528-fae987e4a3f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc78d168b60747a387ddf608ea0b6e9e', 'request_id': 'req-9615736f-b9c4-40ad-9528-fae987e4a3f6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:36.782558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9615736f-b9c4-40ad-9528-fae987e4a3f6 admin admin] The token cache is being invalidate because project dc78d168b60747a387ddf608ea0b6e9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:09:36.782863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9615736f-b9c4-40ad-9528-fae987e4a3f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:36.788742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9615736f-b9c4-40ad-9528-fae987e4a3f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:36.790973 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3040/6101] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:09:36 2022] DELETE /identity/v3/projects/dc78d168b60747a387ddf608ea0b6e9e => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:36.796463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbe687-a838-4648-8d2c-618345615759 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:36.801054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-03bbe687-a838-4648-8d2c-618345615759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:36.975489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbe687-a838-4648-8d2c-618345615759 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:36.984304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdd1e0-0340-4b83-97e4-bbe83bed14d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:36.984999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdd1e0-0340-4b83-97e4-bbe83bed14d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:36.985284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdd1e0-0340-4b83-97e4-bbe83bed14d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:36.985562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdd1e0-0340-4b83-97e4-bbe83bed14d7 admin admin] PATH_INFO: `/v3/users/3f7b39e8bb04458bb3f4fddcfed8330d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:36.993840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcdd1e0-0340-4b83-97e4-bbe83bed14d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f7b39e8bb04458bb3f4fddcfed8330d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:36.995814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcdd1e0-0340-4b83-97e4-bbe83bed14d7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:37.208254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fdcdd1e0-0340-4b83-97e4-bbe83bed14d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f7b39e8bb04458bb3f4fddcfed8330d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:37.208254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fdcdd1e0-0340-4b83-97e4-bbe83bed14d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f7b39e8bb04458bb3f4fddcfed8330d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:37.239390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fdcdd1e0-0340-4b83-97e4-bbe83bed14d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f7b39e8bb04458bb3f4fddcfed8330d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:37.284822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fdcdd1e0-0340-4b83-97e4-bbe83bed14d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f7b39e8bb04458bb3f4fddcfed8330d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:37.303490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fdcdd1e0-0340-4b83-97e4-bbe83bed14d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f7b39e8bb04458bb3f4fddcfed8330d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:37.331717 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3062/6102] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:09:36 2022] DELETE /identity/v3/users/3f7b39e8bb04458bb3f4fddcfed8330d => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:38.454406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615736f-b9c4-40ad-9528-fae987e4a3f6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:38.456014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9615736f-b9c4-40ad-9528-fae987e4a3f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:38.626973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615736f-b9c4-40ad-9528-fae987e4a3f6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:38.696877 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:38.800251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ad48d-45d0-4502-a085-8e3adadb5c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:38.801273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ad48d-45d0-4502-a085-8e3adadb5c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:38.801763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ad48d-45d0-4502-a085-8e3adadb5c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:38.802266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ad48d-45d0-4502-a085-8e3adadb5c97 admin admin] PATH_INFO: `/v3/projects/61d2b5900d40406d9c06d2201a681abe` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:38.809464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ad48d-45d0-4502-a085-8e3adadb5c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d2b5900d40406d9c06d2201a681abe)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:38.813773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ad48d-45d0-4502-a085-8e3adadb5c97 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:38.952341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdd1e0-0340-4b83-97e4-bbe83bed14d7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:38.953969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fdcdd1e0-0340-4b83-97e4-bbe83bed14d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:38.969965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af4ad48d-45d0-4502-a085-8e3adadb5c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d2b5900d40406d9c06d2201a681abe', 'request_id': 'req-af4ad48d-45d0-4502-a085-8e3adadb5c97'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:38.983498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af4ad48d-45d0-4502-a085-8e3adadb5c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d2b5900d40406d9c06d2201a681abe', 'request_id': 'req-af4ad48d-45d0-4502-a085-8e3adadb5c97'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:38.994664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdd1e0-0340-4b83-97e4-bbe83bed14d7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:38.997725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af4ad48d-45d0-4502-a085-8e3adadb5c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d2b5900d40406d9c06d2201a681abe', 'request_id': 'req-af4ad48d-45d0-4502-a085-8e3adadb5c97'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:39.057678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af4ad48d-45d0-4502-a085-8e3adadb5c97 admin admin] The token cache is being invalidate because project 61d2b5900d40406d9c06d2201a681abe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:09:39.058398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af4ad48d-45d0-4502-a085-8e3adadb5c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:39.061272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af4ad48d-45d0-4502-a085-8e3adadb5c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:39.064803 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3041/6103] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:09:38 2022] DELETE /identity/v3/projects/61d2b5900d40406d9c06d2201a681abe => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:39.075828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c417c0b-dd4b-4070-af53-60e046dbea06 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:39.076169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c417c0b-dd4b-4070-af53-60e046dbea06 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:39.076453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c417c0b-dd4b-4070-af53-60e046dbea06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:39.256398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a28068-518e-465d-81f7-e465d9adfd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:39.261234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a28068-518e-465d-81f7-e465d9adfd84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:39.261750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a28068-518e-465d-81f7-e465d9adfd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:39.264511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a28068-518e-465d-81f7-e465d9adfd84 admin admin] PATH_INFO: `/v3/projects/47224b53594348039616614af242730a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:39.275531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4c417c0b-dd4b-4070-af53-60e046dbea06 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:39.278102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4c417c0b-dd4b-4070-af53-60e046dbea06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:39.282111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a28068-518e-465d-81f7-e465d9adfd84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47224b53594348039616614af242730a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:39.284906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a28068-518e-465d-81f7-e465d9adfd84 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:39.292191 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3042/6104] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:39.300211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0c4ee-950d-4719-b2b8-2e1d54315efd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:39.300500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0c4ee-950d-4719-b2b8-2e1d54315efd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:39.300809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0c4ee-950d-4719-b2b8-2e1d54315efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:39.408277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c5d0c4ee-950d-4719-b2b8-2e1d54315efd None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:39.411382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c5d0c4ee-950d-4719-b2b8-2e1d54315efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:39.445176 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:39.459390 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3043/6105] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:39.460936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61d5d6-7658-4aca-8cb9-3325836d9fa0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:39.461221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61d5d6-7658-4aca-8cb9-3325836d9fa0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:39.461493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61d5d6-7658-4aca-8cb9-3325836d9fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:39.526792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29a28068-518e-465d-81f7-e465d9adfd84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47224b53594348039616614af242730a', 'request_id': 'req-29a28068-518e-465d-81f7-e465d9adfd84'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:39.566888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29a28068-518e-465d-81f7-e465d9adfd84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47224b53594348039616614af242730a', 'request_id': 'req-29a28068-518e-465d-81f7-e465d9adfd84'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:39.590131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2c61d5d6-7658-4aca-8cb9-3325836d9fa0 None None] MFA Rules not processed for user `bd2bba0db07140c0851cebb70631ce7c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:39.593728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29a28068-518e-465d-81f7-e465d9adfd84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47224b53594348039616614af242730a', 'request_id': 'req-29a28068-518e-465d-81f7-e465d9adfd84'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:39.594952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2c61d5d6-7658-4aca-8cb9-3325836d9fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:39.633390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29a28068-518e-465d-81f7-e465d9adfd84 admin admin] The token cache is being invalidate because project 47224b53594348039616614af242730a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:09:39.637604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29a28068-518e-465d-81f7-e465d9adfd84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:39.641167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29a28068-518e-465d-81f7-e465d9adfd84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:39.644936 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3063/6106] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:09:38 2022] DELETE /identity/v3/projects/47224b53594348039616614af242730a => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:39.649175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a28068-518e-465d-81f7-e465d9adfd84 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:39.655846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-29a28068-518e-465d-81f7-e465d9adfd84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:39.832862 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3044/6107] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:39.832862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1de30-35ac-4f94-b46e-d63b8b2b7b21 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:39.832862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1de30-35ac-4f94-b46e-d63b8b2b7b21 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:39.832862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1de30-35ac-4f94-b46e-d63b8b2b7b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:39.854181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a28068-518e-465d-81f7-e465d9adfd84 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:39.873642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51885dcc-4a11-44db-ac23-6516ec0d47a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:39.874372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51885dcc-4a11-44db-ac23-6516ec0d47a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:39.874758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51885dcc-4a11-44db-ac23-6516ec0d47a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:39.875280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51885dcc-4a11-44db-ac23-6516ec0d47a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:39.876217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51885dcc-4a11-44db-ac23-6516ec0d47a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:09:39.880422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51885dcc-4a11-44db-ac23-6516ec0d47a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:39.882234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51885dcc-4a11-44db-ac23-6516ec0d47a2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:39.908142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e5e1de30-35ac-4f94-b46e-d63b8b2b7b21 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:39.908142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e5e1de30-35ac-4f94-b46e-d63b8b2b7b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:39.916397 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3064/6108] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:09:39.916397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34491c-da28-4965-a95d-9bb4efbcec20 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:39.916397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34491c-da28-4965-a95d-9bb4efbcec20 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:39.916397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34491c-da28-4965-a95d-9bb4efbcec20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:39.970051 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3045/6109] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:39.976219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1de30-35ac-4f94-b46e-d63b8b2b7b21 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:40.008489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1de30-35ac-4f94-b46e-d63b8b2b7b21 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:40.031986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6b34491c-da28-4965-a95d-9bb4efbcec20 None None] MFA Rules not processed for user `bd2bba0db07140c0851cebb70631ce7c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:40.036373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6b34491c-da28-4965-a95d-9bb4efbcec20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:40.051157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373db64-5aef-439a-9478-34a1f37e8a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:40.051790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373db64-5aef-439a-9478-34a1f37e8a91 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:40.052066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373db64-5aef-439a-9478-34a1f37e8a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:40.052352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373db64-5aef-439a-9478-34a1f37e8a91 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:40.053004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373db64-5aef-439a-9478-34a1f37e8a91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:40.066007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373db64-5aef-439a-9478-34a1f37e8a91 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:40.074831 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3065/6110] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:40.076856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d1277-ae41-47bf-af5c-faba8edb2b3b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:40.077141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d1277-ae41-47bf-af5c-faba8edb2b3b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:40.077411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d1277-ae41-47bf-af5c-faba8edb2b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:40.141047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c41d1277-ae41-47bf-af5c-faba8edb2b3b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:40.142279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c41d1277-ae41-47bf-af5c-faba8edb2b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:40.164795 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3046/6111] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:09:39 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:40.164795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373db64-5aef-439a-9478-34a1f37e8a91 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:40.177659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b373db64-5aef-439a-9478-34a1f37e8a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:40.181862 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3066/6112] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:40.183525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d1277-ae41-47bf-af5c-faba8edb2b3b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:40.193839 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:40.200001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d1277-ae41-47bf-af5c-faba8edb2b3b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:40.406004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0265313-caed-4da8-b700-d90578dc9c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:40.406623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0265313-caed-4da8-b700-d90578dc9c1e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:40.406900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0265313-caed-4da8-b700-d90578dc9c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:40.407169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0265313-caed-4da8-b700-d90578dc9c1e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:40.407792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0265313-caed-4da8-b700-d90578dc9c1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:40.409731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0265313-caed-4da8-b700-d90578dc9c1e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:40.421251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373db64-5aef-439a-9478-34a1f37e8a91 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:40.438116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd13ac-6b5a-4748-8386-14206aedf425 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:40.438754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd13ac-6b5a-4748-8386-14206aedf425 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:40.439032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd13ac-6b5a-4748-8386-14206aedf425 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:40.439302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd13ac-6b5a-4748-8386-14206aedf425 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:40.472196 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3067/6113] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:09:40 2022] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:40.474925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0265313-caed-4da8-b700-d90578dc9c1e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:40.506305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0265313-caed-4da8-b700-d90578dc9c1e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:40.523128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d457d-82a1-4b79-90be-871da5ac5c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:40.523746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d457d-82a1-4b79-90be-871da5ac5c89 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:40.524019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d457d-82a1-4b79-90be-871da5ac5c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:40.524286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d457d-82a1-4b79-90be-871da5ac5c89 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:40.524954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d457d-82a1-4b79-90be-871da5ac5c89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:09:40.525254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d457d-82a1-4b79-90be-871da5ac5c89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:40.526849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d457d-82a1-4b79-90be-871da5ac5c89 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:40.569329 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3068/6114] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:09:40.577397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d457d-82a1-4b79-90be-871da5ac5c89 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:40.604666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d457d-82a1-4b79-90be-871da5ac5c89 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:40.609148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd13ac-6b5a-4748-8386-14206aedf425 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:40.611163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd13ac-6b5a-4748-8386-14206aedf425 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:40.622621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb74e1-e4ae-47cd-ad41-d9a3e8cc197e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:40.623179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb74e1-e4ae-47cd-ad41-d9a3e8cc197e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:40.623455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb74e1-e4ae-47cd-ad41-d9a3e8cc197e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:40.623721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb74e1-e4ae-47cd-ad41-d9a3e8cc197e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:40.624359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb74e1-e4ae-47cd-ad41-d9a3e8cc197e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:40.626124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb74e1-e4ae-47cd-ad41-d9a3e8cc197e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:40.627632 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:40.647254 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3047/6115] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:09:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:09:40.648318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd13ac-6b5a-4748-8386-14206aedf425 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:40.662344 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3069/6116] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:09:40.667421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb74e1-e4ae-47cd-ad41-d9a3e8cc197e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:40.681798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb74e1-e4ae-47cd-ad41-d9a3e8cc197e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:40.684066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd13ac-6b5a-4748-8386-14206aedf425 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:40.687576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c76baf-2328-48c5-bc31-bcac2a527b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:40.688183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c76baf-2328-48c5-bc31-bcac2a527b90 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:40.688467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c76baf-2328-48c5-bc31-bcac2a527b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:40.688777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c76baf-2328-48c5-bc31-bcac2a527b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:40.689447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c76baf-2328-48c5-bc31-bcac2a527b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:40.690204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f04342-5d65-449b-98ca-0f62861b0f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:40.691048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f04342-5d65-449b-98ca-0f62861b0f19 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:40.691166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c76baf-2328-48c5-bc31-bcac2a527b90 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:40.691658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f04342-5d65-449b-98ca-0f62861b0f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:40.692126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f04342-5d65-449b-98ca-0f62861b0f19 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:40.692988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f04342-5d65-449b-98ca-0f62861b0f19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:40.707404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f04342-5d65-449b-98ca-0f62861b0f19 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:40.737042 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3070/6117] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:09:40.738011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c76baf-2328-48c5-bc31-bcac2a527b90 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:40.754771 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3048/6118] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:09:40 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:40.758938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f04342-5d65-449b-98ca-0f62861b0f19 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:40.824191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c76baf-2328-48c5-bc31-bcac2a527b90 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:40.898416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f04342-5d65-449b-98ca-0f62861b0f19 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:40.917492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53587d0-3de4-432d-b1cd-4bae10a71b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:40.918472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53587d0-3de4-432d-b1cd-4bae10a71b3a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:40.918953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53587d0-3de4-432d-b1cd-4bae10a71b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:40.920099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53587d0-3de4-432d-b1cd-4bae10a71b3a admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:40.920998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53587d0-3de4-432d-b1cd-4bae10a71b3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:40.923137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53587d0-3de4-432d-b1cd-4bae10a71b3a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:40.981860 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3049/6119] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:09:40 2022] POST /identity/v3/users => generated 284 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:09:40.986582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53587d0-3de4-432d-b1cd-4bae10a71b3a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:41.006030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53587d0-3de4-432d-b1cd-4bae10a71b3a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:41.021098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c3f25-9b82-4b94-80ad-4d79fd4dbdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:41.021738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c3f25-9b82-4b94-80ad-4d79fd4dbdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:41.022018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c3f25-9b82-4b94-80ad-4d79fd4dbdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:41.022857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c3f25-9b82-4b94-80ad-4d79fd4dbdd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:41.023791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c3f25-9b82-4b94-80ad-4d79fd4dbdd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:41.025044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c3f25-9b82-4b94-80ad-4d79fd4dbdd4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:41.029540 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:41.061600 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3050/6120] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:09:41.065931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c3f25-9b82-4b94-80ad-4d79fd4dbdd4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:41.071898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b04bb-00f1-48a1-afbb-d40d8a43d4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:41.072784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b04bb-00f1-48a1-afbb-d40d8a43d4e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:41.073207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b04bb-00f1-48a1-afbb-d40d8a43d4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:41.073489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b04bb-00f1-48a1-afbb-d40d8a43d4e2 admin admin] PATH_INFO: `/v3/projects/e9c9e97c1e7141db9509f3344fd12123/users/7e5714139ec94577bf07cfb95e7d925c/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:41.094894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b04bb-00f1-48a1-afbb-d40d8a43d4e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c9e97c1e7141db9509f3344fd12123, user_id=7e5714139ec94577bf07cfb95e7d925c, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:41.099841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b04bb-00f1-48a1-afbb-d40d8a43d4e2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:41.123314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c3f25-9b82-4b94-80ad-4d79fd4dbdd4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:41.144959 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3071/6121] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:09:40 2022] PUT /identity/v3/projects/e9c9e97c1e7141db9509f3344fd12123/users/7e5714139ec94577bf07cfb95e7d925c/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:41.151000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2479b08-22e6-46de-99a0-0694821c4bff None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:41.151294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2479b08-22e6-46de-99a0-0694821c4bff None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:41.151578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2479b08-22e6-46de-99a0-0694821c4bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:41.215337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d2479b08-22e6-46de-99a0-0694821c4bff None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:41.217819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d2479b08-22e6-46de-99a0-0694821c4bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:41.301570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb1c30-9db9-4b38-8f5f-e2a75c21f8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:41.302203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb1c30-9db9-4b38-8f5f-e2a75c21f8ce admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:41.302484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb1c30-9db9-4b38-8f5f-e2a75c21f8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:41.302758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb1c30-9db9-4b38-8f5f-e2a75c21f8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:41.303428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb1c30-9db9-4b38-8f5f-e2a75c21f8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:41.305085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb1c30-9db9-4b38-8f5f-e2a75c21f8ce admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:41.352383 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3051/6122] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:09:41.354418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb1c30-9db9-4b38-8f5f-e2a75c21f8ce admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:41.369987 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3072/6123] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:41.384367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2479b08-22e6-46de-99a0-0694821c4bff None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:41.385370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d2479b08-22e6-46de-99a0-0694821c4bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:41.407432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb1c30-9db9-4b38-8f5f-e2a75c21f8ce admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:41.429171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f33c1-fd5f-4947-b742-f6e682dbc4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:41.429864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f33c1-fd5f-4947-b742-f6e682dbc4d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:41.430150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f33c1-fd5f-4947-b742-f6e682dbc4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:41.430428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f33c1-fd5f-4947-b742-f6e682dbc4d7 admin admin] PATH_INFO: `/v3/projects/1565e389530541d098e9871e090889b6/users/2b15e0287f19463197292a8b171dc0b0/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:41.497075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f33c1-fd5f-4947-b742-f6e682dbc4d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1565e389530541d098e9871e090889b6, user_id=2b15e0287f19463197292a8b171dc0b0, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:41.507511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f33c1-fd5f-4947-b742-f6e682dbc4d7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:41.567881 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3052/6124] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:09:41 2022] PUT /identity/v3/projects/1565e389530541d098e9871e090889b6/users/2b15e0287f19463197292a8b171dc0b0/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:41.584204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c7f26-5ea6-4b31-8514-0ae67fa1b903 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:41.585495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2479b08-22e6-46de-99a0-0694821c4bff None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:41.595714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c7f26-5ea6-4b31-8514-0ae67fa1b903 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:41.596984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c7f26-5ea6-4b31-8514-0ae67fa1b903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:41.659059 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:41.716054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5c1c7f26-5ea6-4b31-8514-0ae67fa1b903 None None] MFA Rules not processed for user `2b15e0287f19463197292a8b171dc0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:41.720089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5c1c7f26-5ea6-4b31-8514-0ae67fa1b903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:41.796481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc125804-17ab-45d5-9bb7-901ba05abb22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:41.797188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc125804-17ab-45d5-9bb7-901ba05abb22 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:41.797470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc125804-17ab-45d5-9bb7-901ba05abb22 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:41.797740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc125804-17ab-45d5-9bb7-901ba05abb22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:41.901675 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3053/6125] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:41.909377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c7f26-5ea6-4b31-8514-0ae67fa1b903 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:41.999157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc125804-17ab-45d5-9bb7-901ba05abb22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:42.000837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc125804-17ab-45d5-9bb7-901ba05abb22 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:42.022649 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3073/6126] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:09:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:09:42.125057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c7f26-5ea6-4b31-8514-0ae67fa1b903 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:42.138890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a0a13-5ed1-4044-868c-1e78f7c06dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:42.139633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a0a13-5ed1-4044-868c-1e78f7c06dde admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:42.144109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a0a13-5ed1-4044-868c-1e78f7c06dde admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:42.144479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a0a13-5ed1-4044-868c-1e78f7c06dde admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:42.145200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a0a13-5ed1-4044-868c-1e78f7c06dde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:42.164381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a0a13-5ed1-4044-868c-1e78f7c06dde admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:42.182842 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:42.275239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc125804-17ab-45d5-9bb7-901ba05abb22 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:42.276969 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3054/6127] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:09:41 2022] POST /identity/v3/projects => generated 367 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:42.308084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc125804-17ab-45d5-9bb7-901ba05abb22 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:42.449430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023e831-bfaf-4e74-b1c2-45f80c85b08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:42.452000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023e831-bfaf-4e74-b1c2-45f80c85b08e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:42.452311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023e831-bfaf-4e74-b1c2-45f80c85b08e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:42.452585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023e831-bfaf-4e74-b1c2-45f80c85b08e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:42.453273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023e831-bfaf-4e74-b1c2-45f80c85b08e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:42.461669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023e831-bfaf-4e74-b1c2-45f80c85b08e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:42.578798 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3074/6128] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:09:42 2022] POST /identity/v3/users => generated 284 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:42.587678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a0a13-5ed1-4044-868c-1e78f7c06dde admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:42.624390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a0a13-5ed1-4044-868c-1e78f7c06dde admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:42.646196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8d935-5331-4f68-a36a-0a14a0ad6d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:42.646848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8d935-5331-4f68-a36a-0a14a0ad6d59 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:42.647130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8d935-5331-4f68-a36a-0a14a0ad6d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:42.647400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8d935-5331-4f68-a36a-0a14a0ad6d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:42.648222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8d935-5331-4f68-a36a-0a14a0ad6d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:42.650182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8d935-5331-4f68-a36a-0a14a0ad6d59 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:42.683584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023e831-bfaf-4e74-b1c2-45f80c85b08e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:42.685551 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3055/6129] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:09:42.707322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023e831-bfaf-4e74-b1c2-45f80c85b08e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:42.738084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447afe26-0348-46a0-8209-fb9517b19220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:42.738729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447afe26-0348-46a0-8209-fb9517b19220 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:42.739005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447afe26-0348-46a0-8209-fb9517b19220 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:42.740992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447afe26-0348-46a0-8209-fb9517b19220 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:42.748712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447afe26-0348-46a0-8209-fb9517b19220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:42.753171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447afe26-0348-46a0-8209-fb9517b19220 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:42.833301 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3075/6130] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:09:42.838116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8d935-5331-4f68-a36a-0a14a0ad6d59 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:42.864164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8d935-5331-4f68-a36a-0a14a0ad6d59 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:42.916004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5910f4-2f15-4ff9-8353-d04ab710df30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:42.917165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5910f4-2f15-4ff9-8353-d04ab710df30 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:42.917660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5910f4-2f15-4ff9-8353-d04ab710df30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:42.918232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5910f4-2f15-4ff9-8353-d04ab710df30 admin admin] PATH_INFO: `/v3/projects/07c7092d6f5a473894273ffd0330e3a4/users/009eeb76f84147ddb35ba7a4fa7711e4/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:43.094768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5910f4-2f15-4ff9-8353-d04ab710df30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c7092d6f5a473894273ffd0330e3a4, user_id=009eeb76f84147ddb35ba7a4fa7711e4, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:43.098777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5910f4-2f15-4ff9-8353-d04ab710df30 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:43.147092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447afe26-0348-46a0-8209-fb9517b19220 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:43.149395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-447afe26-0348-46a0-8209-fb9517b19220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:43.150499 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3056/6131] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:09:42 2022] PUT /identity/v3/projects/07c7092d6f5a473894273ffd0330e3a4/users/009eeb76f84147ddb35ba7a4fa7711e4/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:09:43.160991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7e463-3168-4067-8f8a-9a0e308cd6e8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:43.161332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7e463-3168-4067-8f8a-9a0e308cd6e8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:43.161706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7e463-3168-4067-8f8a-9a0e308cd6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:43.229426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6fe7e463-3168-4067-8f8a-9a0e308cd6e8 None None] MFA Rules not processed for user `009eeb76f84147ddb35ba7a4fa7711e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:43.232181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6fe7e463-3168-4067-8f8a-9a0e308cd6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:43.426609 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:43.455626 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3057/6132] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:09:43.457964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812e1f1-5ae9-48de-91ec-714572b02df1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:43.458751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812e1f1-5ae9-48de-91ec-714572b02df1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:43.459327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812e1f1-5ae9-48de-91ec-714572b02df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:43.521458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9812e1f1-5ae9-48de-91ec-714572b02df1 None None] MFA Rules not processed for user `bd2bba0db07140c0851cebb70631ce7c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:43.523500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9812e1f1-5ae9-48de-91ec-714572b02df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:43.531573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447afe26-0348-46a0-8209-fb9517b19220 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:43.694516 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3058/6133] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:43.695653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812e1f1-5ae9-48de-91ec-714572b02df1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:43.703086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9812e1f1-5ae9-48de-91ec-714572b02df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:43.753357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727fcec-91da-4a51-af39-51ae325fe392 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:43.754149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727fcec-91da-4a51-af39-51ae325fe392 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:43.754435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727fcec-91da-4a51-af39-51ae325fe392 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:43.754702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727fcec-91da-4a51-af39-51ae325fe392 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:43.765083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4727fcec-91da-4a51-af39-51ae325fe392 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:43.826355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727fcec-91da-4a51-af39-51ae325fe392 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:43.828108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727fcec-91da-4a51-af39-51ae325fe392 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:43.873417 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3076/6134] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:09:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:09:43.926080 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:43.996319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812e1f1-5ae9-48de-91ec-714572b02df1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:44.022071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cf3d7-1ef8-47c1-8e57-93daf80fb9eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:44.024360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cf3d7-1ef8-47c1-8e57-93daf80fb9eb service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:44.024360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cf3d7-1ef8-47c1-8e57-93daf80fb9eb service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:44.025546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cf3d7-1ef8-47c1-8e57-93daf80fb9eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:44.343900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cf3d7-1ef8-47c1-8e57-93daf80fb9eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:44.350839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cf3d7-1ef8-47c1-8e57-93daf80fb9eb service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:44.420388 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3059/6135] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:09:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:09:44.893164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727fcec-91da-4a51-af39-51ae325fe392 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:44.908089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727fcec-91da-4a51-af39-51ae325fe392 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:44.922278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4cddc-d6c4-438d-828b-0140730946ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:44.924714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4cddc-d6c4-438d-828b-0140730946ed service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:44.926079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4cddc-d6c4-438d-828b-0140730946ed service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:44.926495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4cddc-d6c4-438d-828b-0140730946ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:44.944494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4cddc-d6c4-438d-828b-0140730946ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:44.948215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4cddc-d6c4-438d-828b-0140730946ed service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:44.972644 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3077/6136] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:09:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:09:48.425194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cf3d7-1ef8-47c1-8e57-93daf80fb9eb service glance] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:48.547600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cf3d7-1ef8-47c1-8e57-93daf80fb9eb service glance] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:48.557275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fd4f8-92f6-42d2-989b-04a16990a3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:48.558102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fd4f8-92f6-42d2-989b-04a16990a3ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:48.558643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fd4f8-92f6-42d2-989b-04a16990a3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:48.559022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fd4f8-92f6-42d2-989b-04a16990a3ad admin admin] PATH_INFO: `/v3/users/2b15e0287f19463197292a8b171dc0b0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:48.561736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fd4f8-92f6-42d2-989b-04a16990a3ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b15e0287f19463197292a8b171dc0b0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:48.564429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fd4f8-92f6-42d2-989b-04a16990a3ad admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:48.687932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-051fd4f8-92f6-42d2-989b-04a16990a3ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b15e0287f19463197292a8b171dc0b0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:48.705749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-051fd4f8-92f6-42d2-989b-04a16990a3ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b15e0287f19463197292a8b171dc0b0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:48.708100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-051fd4f8-92f6-42d2-989b-04a16990a3ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b15e0287f19463197292a8b171dc0b0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:48.737763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-051fd4f8-92f6-42d2-989b-04a16990a3ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b15e0287f19463197292a8b171dc0b0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:48.758868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-051fd4f8-92f6-42d2-989b-04a16990a3ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b15e0287f19463197292a8b171dc0b0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:48.782385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f62af-cb23-4131-b6e2-d5f068787405 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:48.782949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f62af-cb23-4131-b6e2-d5f068787405 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:48.783151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f62af-cb23-4131-b6e2-d5f068787405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:48.786082 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3060/6137] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:09:48 2022] DELETE /identity/v3/users/2b15e0287f19463197292a8b171dc0b0 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:48.818591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7f3f62af-cb23-4131-b6e2-d5f068787405 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:48.823206 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7f3f62af-cb23-4131-b6e2-d5f068787405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:49.004552 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3078/6138] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:49.052251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fd4f8-92f6-42d2-989b-04a16990a3ad admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:49.054029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-051fd4f8-92f6-42d2-989b-04a16990a3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:49.110236 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:49.235810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fd4f8-92f6-42d2-989b-04a16990a3ad admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:49.247625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242b675-93d6-4c65-bac2-6056af102cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:49.248116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242b675-93d6-4c65-bac2-6056af102cfc service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:49.248398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242b675-93d6-4c65-bac2-6056af102cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:49.248769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242b675-93d6-4c65-bac2-6056af102cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:49.268780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242b675-93d6-4c65-bac2-6056af102cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:49.271550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242b675-93d6-4c65-bac2-6056af102cfc service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:49.298568 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3061/6139] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:09:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:09:50.772531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f62af-cb23-4131-b6e2-d5f068787405 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:50.778507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7f3f62af-cb23-4131-b6e2-d5f068787405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:50.818634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f62af-cb23-4131-b6e2-d5f068787405 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:50.870361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca70d0-443c-47dd-8f5b-efced47d06bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:50.873157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca70d0-443c-47dd-8f5b-efced47d06bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:50.876000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca70d0-443c-47dd-8f5b-efced47d06bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:50.876774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca70d0-443c-47dd-8f5b-efced47d06bd admin admin] PATH_INFO: `/v3/projects/1565e389530541d098e9871e090889b6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:50.881224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca70d0-443c-47dd-8f5b-efced47d06bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1565e389530541d098e9871e090889b6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:50.893298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca70d0-443c-47dd-8f5b-efced47d06bd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:51.193318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-60ca70d0-443c-47dd-8f5b-efced47d06bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1565e389530541d098e9871e090889b6', 'request_id': 'req-60ca70d0-443c-47dd-8f5b-efced47d06bd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:51.223189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-60ca70d0-443c-47dd-8f5b-efced47d06bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1565e389530541d098e9871e090889b6', 'request_id': 'req-60ca70d0-443c-47dd-8f5b-efced47d06bd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:51.233878 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:51.251013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-60ca70d0-443c-47dd-8f5b-efced47d06bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1565e389530541d098e9871e090889b6', 'request_id': 'req-60ca70d0-443c-47dd-8f5b-efced47d06bd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:51.312014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-60ca70d0-443c-47dd-8f5b-efced47d06bd admin admin] The token cache is being invalidate because project 1565e389530541d098e9871e090889b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:09:51.315140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-60ca70d0-443c-47dd-8f5b-efced47d06bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:51.317944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-60ca70d0-443c-47dd-8f5b-efced47d06bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:51.330500 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3079/6140] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:09:50 2022] DELETE /identity/v3/projects/1565e389530541d098e9871e090889b6 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:51.331812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242b675-93d6-4c65-bac2-6056af102cfc service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:51.344340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242b675-93d6-4c65-bac2-6056af102cfc service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:51.550178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163b0fc-e766-4127-9968-e4000515131f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:51.550830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163b0fc-e766-4127-9968-e4000515131f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:51.551108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163b0fc-e766-4127-9968-e4000515131f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:51.551450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163b0fc-e766-4127-9968-e4000515131f admin admin] PATH_INFO: `/v3/users/009eeb76f84147ddb35ba7a4fa7711e4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:51.553045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163b0fc-e766-4127-9968-e4000515131f admin admin] RBAC: Authorizing `identity:delete_user(user_id=009eeb76f84147ddb35ba7a4fa7711e4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:51.554948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163b0fc-e766-4127-9968-e4000515131f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:51.694428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2163b0fc-e766-4127-9968-e4000515131f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '009eeb76f84147ddb35ba7a4fa7711e4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:51.718927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2163b0fc-e766-4127-9968-e4000515131f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '009eeb76f84147ddb35ba7a4fa7711e4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:51.719949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2163b0fc-e766-4127-9968-e4000515131f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '009eeb76f84147ddb35ba7a4fa7711e4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:51.750464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2163b0fc-e766-4127-9968-e4000515131f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '009eeb76f84147ddb35ba7a4fa7711e4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:51.800942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2163b0fc-e766-4127-9968-e4000515131f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '009eeb76f84147ddb35ba7a4fa7711e4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:51.813433 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3062/6141] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:09:51 2022] DELETE /identity/v3/users/009eeb76f84147ddb35ba7a4fa7711e4 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:54.536420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca70d0-443c-47dd-8f5b-efced47d06bd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:54.538497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-60ca70d0-443c-47dd-8f5b-efced47d06bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:54.566476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca70d0-443c-47dd-8f5b-efced47d06bd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:54.693132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce95c7-cbb2-4ef1-b40c-fe2720f0f139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:54.694001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce95c7-cbb2-4ef1-b40c-fe2720f0f139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:54.694427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce95c7-cbb2-4ef1-b40c-fe2720f0f139 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:54.694874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce95c7-cbb2-4ef1-b40c-fe2720f0f139 admin admin] PATH_INFO: `/v3/projects/07c7092d6f5a473894273ffd0330e3a4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:54.696176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce95c7-cbb2-4ef1-b40c-fe2720f0f139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07c7092d6f5a473894273ffd0330e3a4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:54.700841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce95c7-cbb2-4ef1-b40c-fe2720f0f139 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:54.813840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-08ce95c7-cbb2-4ef1-b40c-fe2720f0f139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07c7092d6f5a473894273ffd0330e3a4', 'request_id': 'req-08ce95c7-cbb2-4ef1-b40c-fe2720f0f139'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:54.828240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-08ce95c7-cbb2-4ef1-b40c-fe2720f0f139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07c7092d6f5a473894273ffd0330e3a4', 'request_id': 'req-08ce95c7-cbb2-4ef1-b40c-fe2720f0f139'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:54.836854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-08ce95c7-cbb2-4ef1-b40c-fe2720f0f139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07c7092d6f5a473894273ffd0330e3a4', 'request_id': 'req-08ce95c7-cbb2-4ef1-b40c-fe2720f0f139'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:54.859944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-08ce95c7-cbb2-4ef1-b40c-fe2720f0f139 admin admin] The token cache is being invalidate because project 07c7092d6f5a473894273ffd0330e3a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:09:54.860505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-08ce95c7-cbb2-4ef1-b40c-fe2720f0f139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:54.867928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-08ce95c7-cbb2-4ef1-b40c-fe2720f0f139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:09:54.871426 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3080/6142] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:09:54 2022] DELETE /identity/v3/projects/07c7092d6f5a473894273ffd0330e3a4 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:54.877799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf41d5-2a8f-4cd4-a6ce-efe92835fda8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:54.878698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf41d5-2a8f-4cd4-a6ce-efe92835fda8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:54.879220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf41d5-2a8f-4cd4-a6ce-efe92835fda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:54.913627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1baf41d5-2a8f-4cd4-a6ce-efe92835fda8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:54.922428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1baf41d5-2a8f-4cd4-a6ce-efe92835fda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:55.076665 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:55.162495 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3063/6143] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:55.173372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583efa2c-cd29-45e6-b99f-9532bb3433be None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:55.174605 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583efa2c-cd29-45e6-b99f-9532bb3433be None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:55.175379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583efa2c-cd29-45e6-b99f-9532bb3433be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:55.235229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-583efa2c-cd29-45e6-b99f-9532bb3433be None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:55.237567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-583efa2c-cd29-45e6-b99f-9532bb3433be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:55.268169 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3081/6144] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:55.272649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf41d5-2a8f-4cd4-a6ce-efe92835fda8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:55.290980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf41d5-2a8f-4cd4-a6ce-efe92835fda8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:55.306804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e70bb-d1ab-43bd-8b1e-b0855bc59c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:55.307542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e70bb-d1ab-43bd-8b1e-b0855bc59c03 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:55.307929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e70bb-d1ab-43bd-8b1e-b0855bc59c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:55.308324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e70bb-d1ab-43bd-8b1e-b0855bc59c03 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:55.310084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e70bb-d1ab-43bd-8b1e-b0855bc59c03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:09:55.310507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e70bb-d1ab-43bd-8b1e-b0855bc59c03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:55.314057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e70bb-d1ab-43bd-8b1e-b0855bc59c03 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:55.341925 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3064/6145] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:09:55.347034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583efa2c-cd29-45e6-b99f-9532bb3433be None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:55.374243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583efa2c-cd29-45e6-b99f-9532bb3433be None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:55.389408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb6f6a-44e4-497b-b36f-25b4c350dc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:55.390312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb6f6a-44e4-497b-b36f-25b4c350dc57 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:55.390724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb6f6a-44e4-497b-b36f-25b4c350dc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:55.391151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb6f6a-44e4-497b-b36f-25b4c350dc57 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:55.391891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb6f6a-44e4-497b-b36f-25b4c350dc57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:55.395525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb6f6a-44e4-497b-b36f-25b4c350dc57 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:55.477077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e70bb-d1ab-43bd-8b1e-b0855bc59c03 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:55.477399 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3082/6146] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:09:55 2022] POST /identity/v3/projects => generated 393 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:55.488795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e70bb-d1ab-43bd-8b1e-b0855bc59c03 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:55.693632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddb677-5691-4221-a343-ec602b16a2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:55.697046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddb677-5691-4221-a343-ec602b16a2cd admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:55.697950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddb677-5691-4221-a343-ec602b16a2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:55.698603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddb677-5691-4221-a343-ec602b16a2cd admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:55.699515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddb677-5691-4221-a343-ec602b16a2cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:55.703599 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddb677-5691-4221-a343-ec602b16a2cd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:55.741664 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3065/6147] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:09:55 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:55.743448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb6f6a-44e4-497b-b36f-25b4c350dc57 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:55.760443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb6f6a-44e4-497b-b36f-25b4c350dc57 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:55.785166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafba37-1fd0-45b8-acc5-213791408fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:55.785703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafba37-1fd0-45b8-acc5-213791408fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:55.786005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafba37-1fd0-45b8-acc5-213791408fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:55.786263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafba37-1fd0-45b8-acc5-213791408fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:55.786911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafba37-1fd0-45b8-acc5-213791408fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:55.788741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafba37-1fd0-45b8-acc5-213791408fa3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:55.822048 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3083/6148] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:09:55.826322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddb677-5691-4221-a343-ec602b16a2cd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:55.845522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddb677-5691-4221-a343-ec602b16a2cd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:55.865452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adeb5c-54cc-40bd-8ebe-907b8197136e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:55.866119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adeb5c-54cc-40bd-8ebe-907b8197136e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:55.868899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adeb5c-54cc-40bd-8ebe-907b8197136e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:55.869455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adeb5c-54cc-40bd-8ebe-907b8197136e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:55.871291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9adeb5c-54cc-40bd-8ebe-907b8197136e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:55.873957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9adeb5c-54cc-40bd-8ebe-907b8197136e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:55.913892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafba37-1fd0-45b8-acc5-213791408fa3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:55.930832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafba37-1fd0-45b8-acc5-213791408fa3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:55.941053 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3066/6149] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:09:55.949493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a312e-2de8-4320-900d-7f8c8de3a9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:55.950922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a312e-2de8-4320-900d-7f8c8de3a9ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:55.951535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a312e-2de8-4320-900d-7f8c8de3a9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:55.951956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a312e-2de8-4320-900d-7f8c8de3a9ae admin admin] PATH_INFO: `/v3/projects/8c011b77deea4cef89d30b923aab1405/users/6726764653cd436b8f4313e3edf111f6/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:55.997958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a312e-2de8-4320-900d-7f8c8de3a9ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c011b77deea4cef89d30b923aab1405, user_id=6726764653cd436b8f4313e3edf111f6, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:56.001663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a312e-2de8-4320-900d-7f8c8de3a9ae admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:56.029035 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3084/6150] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:09:55 2022] PUT /identity/v3/projects/8c011b77deea4cef89d30b923aab1405/users/6726764653cd436b8f4313e3edf111f6/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:56.041688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf4a7f-ee88-4ae3-b554-27d91671548e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:56.042074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf4a7f-ee88-4ae3-b554-27d91671548e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:56.042472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf4a7f-ee88-4ae3-b554-27d91671548e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:56.083093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6acf4a7f-ee88-4ae3-b554-27d91671548e None None] MFA Rules not processed for user `6726764653cd436b8f4313e3edf111f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:56.085099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6acf4a7f-ee88-4ae3-b554-27d91671548e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:56.176644 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3067/6151] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:56.181101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a312e-2de8-4320-900d-7f8c8de3a9ae admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:56.200218 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:56.314245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a312e-2de8-4320-900d-7f8c8de3a9ae admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:56.327462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3882031-28b3-407a-b19f-954618f25009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:56.328331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3882031-28b3-407a-b19f-954618f25009 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:56.328758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3882031-28b3-407a-b19f-954618f25009 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:56.329878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3882031-28b3-407a-b19f-954618f25009 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:56.330768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3882031-28b3-407a-b19f-954618f25009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:56.336832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3882031-28b3-407a-b19f-954618f25009 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:56.434245 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3085/6152] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:09:56 2022] POST /identity/v3/projects => generated 391 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:09:56.438303 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf4a7f-ee88-4ae3-b554-27d91671548e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:56.453528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf4a7f-ee88-4ae3-b554-27d91671548e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:56.547913 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:09:56.623424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af72bb-eb13-4198-862d-093215fff96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:56.624059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af72bb-eb13-4198-862d-093215fff96e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:56.624511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af72bb-eb13-4198-862d-093215fff96e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:56.624726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af72bb-eb13-4198-862d-093215fff96e admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:56.625266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af72bb-eb13-4198-862d-093215fff96e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:56.631473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af72bb-eb13-4198-862d-093215fff96e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:56.683167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3882031-28b3-407a-b19f-954618f25009 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:56.685774 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3068/6153] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:09:56 2022] POST /identity/v3/users => generated 302 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:09:56.702208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3882031-28b3-407a-b19f-954618f25009 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:56.717657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6db26b-f22f-4134-942e-abb092ed33bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:56.718963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6db26b-f22f-4134-942e-abb092ed33bd admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:56.719382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6db26b-f22f-4134-942e-abb092ed33bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:56.719790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6db26b-f22f-4134-942e-abb092ed33bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:56.720594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6db26b-f22f-4134-942e-abb092ed33bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:56.722511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6db26b-f22f-4134-942e-abb092ed33bd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:56.755715 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3086/6154] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:09:56.757634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af72bb-eb13-4198-862d-093215fff96e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:56.774950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af72bb-eb13-4198-862d-093215fff96e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:56.793360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90693c0-a041-474b-8796-550ce1c6352f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:56.794518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90693c0-a041-474b-8796-550ce1c6352f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:56.794975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90693c0-a041-474b-8796-550ce1c6352f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:56.795449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90693c0-a041-474b-8796-550ce1c6352f admin admin] PATH_INFO: `/v3/projects/1b3b6ab0e1af427d9609c2c805555a49/users/d5fcd256f19148ebac591dfe22de8fef/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:56.854739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90693c0-a041-474b-8796-550ce1c6352f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b3b6ab0e1af427d9609c2c805555a49, user_id=d5fcd256f19148ebac591dfe22de8fef, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:56.863854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90693c0-a041-474b-8796-550ce1c6352f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:56.968246 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3069/6155] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:09:56 2022] PUT /identity/v3/projects/1b3b6ab0e1af427d9609c2c805555a49/users/d5fcd256f19148ebac591dfe22de8fef/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:56.969938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6db26b-f22f-4134-942e-abb092ed33bd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:57.004463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6db26b-f22f-4134-942e-abb092ed33bd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:57.245401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e59fbc-a08a-40d1-b514-ca631c9e898e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:57.245401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e59fbc-a08a-40d1-b514-ca631c9e898e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:57.245401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e59fbc-a08a-40d1-b514-ca631c9e898e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:57.245401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e59fbc-a08a-40d1-b514-ca631c9e898e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:57.246134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e59fbc-a08a-40d1-b514-ca631c9e898e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:57.247407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e59fbc-a08a-40d1-b514-ca631c9e898e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:57.269659 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3087/6156] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:09:57.273768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90693c0-a041-474b-8796-550ce1c6352f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:57.293254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90693c0-a041-474b-8796-550ce1c6352f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:57.308540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957bae8-ae10-440f-8383-a077eb5e53ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:57.310510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957bae8-ae10-440f-8383-a077eb5e53ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:57.312147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957bae8-ae10-440f-8383-a077eb5e53ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:57.312548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957bae8-ae10-440f-8383-a077eb5e53ac admin admin] PATH_INFO: `/v3/projects/1b3b6ab0e1af427d9609c2c805555a49/users/d5fcd256f19148ebac591dfe22de8fef/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:57.318612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957bae8-ae10-440f-8383-a077eb5e53ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b3b6ab0e1af427d9609c2c805555a49, user_id=d5fcd256f19148ebac591dfe22de8fef, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:57.327491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957bae8-ae10-440f-8383-a077eb5e53ac admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:57.353514 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3070/6157] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:09:57 2022] PUT /identity/v3/projects/1b3b6ab0e1af427d9609c2c805555a49/users/d5fcd256f19148ebac591dfe22de8fef/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:09:57.364449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecaabd-3aa0-4d9c-b370-0d1de9d335c2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:57.364866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecaabd-3aa0-4d9c-b370-0d1de9d335c2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:57.365031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecaabd-3aa0-4d9c-b370-0d1de9d335c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:57.441143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bdecaabd-3aa0-4d9c-b370-0d1de9d335c2 None None] MFA Rules not processed for user `d5fcd256f19148ebac591dfe22de8fef`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:09:57.442532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bdecaabd-3aa0-4d9c-b370-0d1de9d335c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:57.708710 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3088/6158] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:09:57 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:09:57.739035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957bae8-ae10-440f-8383-a077eb5e53ac admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:09:57.742747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8957bae8-ae10-440f-8383-a077eb5e53ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:09:57.954755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957bae8-ae10-440f-8383-a077eb5e53ac admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:09:57.979296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2be9a4-b3cd-44b8-9d2f-4c6a71425a8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:09:57.981405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2be9a4-b3cd-44b8-9d2f-4c6a71425a8c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:09:57.981918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2be9a4-b3cd-44b8-9d2f-4c6a71425a8c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:09:57.982359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2be9a4-b3cd-44b8-9d2f-4c6a71425a8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:09:58.019784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2be9a4-b3cd-44b8-9d2f-4c6a71425a8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:09:58.028796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2be9a4-b3cd-44b8-9d2f-4c6a71425a8c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:09:58.060949 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3071/6159] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:09:57 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:02.745545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecaabd-3aa0-4d9c-b370-0d1de9d335c2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:02.747967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bdecaabd-3aa0-4d9c-b370-0d1de9d335c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:02.766372 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:02.966853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecaabd-3aa0-4d9c-b370-0d1de9d335c2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:02.988501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73c353-fb1a-4c2e-8f04-037671c2839d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:02.989250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73c353-fb1a-4c2e-8f04-037671c2839d service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:02.989534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73c353-fb1a-4c2e-8f04-037671c2839d service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:02.989877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73c353-fb1a-4c2e-8f04-037671c2839d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:02.991735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-de73c353-fb1a-4c2e-8f04-037671c2839d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:03.101839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73c353-fb1a-4c2e-8f04-037671c2839d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:03.103740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73c353-fb1a-4c2e-8f04-037671c2839d service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:03.147811 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3089/6160] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:05.139792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78c0af-5138-45b6-a332-c24fd97f217e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:05.140266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78c0af-5138-45b6-a332-c24fd97f217e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:05.140364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78c0af-5138-45b6-a332-c24fd97f217e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:05.249290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1e78c0af-5138-45b6-a332-c24fd97f217e None None] MFA Rules not processed for user `7e5714139ec94577bf07cfb95e7d925c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:05.250573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1e78c0af-5138-45b6-a332-c24fd97f217e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:05.505413 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3072/6161] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:12.777683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73c353-fb1a-4c2e-8f04-037671c2839d service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:12.990629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73c353-fb1a-4c2e-8f04-037671c2839d service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:13.009426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad4769-19eb-4f3f-a5f6-1da234e3d12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:13.009998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad4769-19eb-4f3f-a5f6-1da234e3d12f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:13.010276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad4769-19eb-4f3f-a5f6-1da234e3d12f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:13.010548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad4769-19eb-4f3f-a5f6-1da234e3d12f admin admin] PATH_INFO: `/v3/users/6726764653cd436b8f4313e3edf111f6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:13.017919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad4769-19eb-4f3f-a5f6-1da234e3d12f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6726764653cd436b8f4313e3edf111f6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:13.023673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad4769-19eb-4f3f-a5f6-1da234e3d12f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:13.122123 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:13.141305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-94ad4769-19eb-4f3f-a5f6-1da234e3d12f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6726764653cd436b8f4313e3edf111f6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:13.142003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-94ad4769-19eb-4f3f-a5f6-1da234e3d12f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6726764653cd436b8f4313e3edf111f6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:13.159548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-94ad4769-19eb-4f3f-a5f6-1da234e3d12f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6726764653cd436b8f4313e3edf111f6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:13.183924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-94ad4769-19eb-4f3f-a5f6-1da234e3d12f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6726764653cd436b8f4313e3edf111f6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:13.200581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-94ad4769-19eb-4f3f-a5f6-1da234e3d12f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6726764653cd436b8f4313e3edf111f6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:13.215871 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3090/6162] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:10:12 2022] DELETE /identity/v3/users/6726764653cd436b8f4313e3edf111f6 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:13.220282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f6a3c-0f8a-49a1-a683-5a2e0985c9a6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:13.220806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f6a3c-0f8a-49a1-a683-5a2e0985c9a6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:13.220882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f6a3c-0f8a-49a1-a683-5a2e0985c9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:13.256947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b48f6a3c-0f8a-49a1-a683-5a2e0985c9a6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:13.260888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b48f6a3c-0f8a-49a1-a683-5a2e0985c9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:13.311803 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:13.525774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad4769-19eb-4f3f-a5f6-1da234e3d12f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:13.526132 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3073/6163] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:13.527829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-94ad4769-19eb-4f3f-a5f6-1da234e3d12f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:13.634048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad4769-19eb-4f3f-a5f6-1da234e3d12f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:13.640468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bea5f1-7c81-4022-a800-b8c5b3017456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:13.641329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bea5f1-7c81-4022-a800-b8c5b3017456 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:13.641700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bea5f1-7c81-4022-a800-b8c5b3017456 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:13.642068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bea5f1-7c81-4022-a800-b8c5b3017456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:13.652895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bea5f1-7c81-4022-a800-b8c5b3017456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:13.654543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bea5f1-7c81-4022-a800-b8c5b3017456 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:13.666290 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3091/6164] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:14.408299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f6a3c-0f8a-49a1-a683-5a2e0985c9a6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:14.410251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b48f6a3c-0f8a-49a1-a683-5a2e0985c9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:14.546169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f6a3c-0f8a-49a1-a683-5a2e0985c9a6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:14.562975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda49fd-52c3-437d-9456-b043f885668d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:14.565003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda49fd-52c3-437d-9456-b043f885668d service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:14.566443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda49fd-52c3-437d-9456-b043f885668d service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:14.566870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda49fd-52c3-437d-9456-b043f885668d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:14.575569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0cda49fd-52c3-437d-9456-b043f885668d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:14.636204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda49fd-52c3-437d-9456-b043f885668d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:14.638444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda49fd-52c3-437d-9456-b043f885668d service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:14.671955 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3074/6165] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:14.815393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bea5f1-7c81-4022-a800-b8c5b3017456 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:14.817458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-28bea5f1-7c81-4022-a800-b8c5b3017456 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:14.868258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bea5f1-7c81-4022-a800-b8c5b3017456 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:14.880755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ce3bd-a47d-4576-9906-f7b13709d96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:14.881685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ce3bd-a47d-4576-9906-f7b13709d96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:14.882237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ce3bd-a47d-4576-9906-f7b13709d96b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:14.882644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ce3bd-a47d-4576-9906-f7b13709d96b admin admin] PATH_INFO: `/v3/projects/8c011b77deea4cef89d30b923aab1405` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:14.886231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ce3bd-a47d-4576-9906-f7b13709d96b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c011b77deea4cef89d30b923aab1405)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:14.888539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ce3bd-a47d-4576-9906-f7b13709d96b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:15.057316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e4ce3bd-a47d-4576-9906-f7b13709d96b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c011b77deea4cef89d30b923aab1405', 'request_id': 'req-7e4ce3bd-a47d-4576-9906-f7b13709d96b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:15.091396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e4ce3bd-a47d-4576-9906-f7b13709d96b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c011b77deea4cef89d30b923aab1405', 'request_id': 'req-7e4ce3bd-a47d-4576-9906-f7b13709d96b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:15.100896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e4ce3bd-a47d-4576-9906-f7b13709d96b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c011b77deea4cef89d30b923aab1405', 'request_id': 'req-7e4ce3bd-a47d-4576-9906-f7b13709d96b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:15.155309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e4ce3bd-a47d-4576-9906-f7b13709d96b admin admin] The token cache is being invalidate because project 8c011b77deea4cef89d30b923aab1405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:10:15.155609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e4ce3bd-a47d-4576-9906-f7b13709d96b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:15.156292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e4ce3bd-a47d-4576-9906-f7b13709d96b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:15.164480 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3092/6166] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:10:14 2022] DELETE /identity/v3/projects/8c011b77deea4cef89d30b923aab1405 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:15.169385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda49fd-52c3-437d-9456-b043f885668d service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:15.190059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda49fd-52c3-437d-9456-b043f885668d service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:15.365958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac25e4-34a0-41b2-86e8-1fed037aa7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:15.366804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac25e4-34a0-41b2-86e8-1fed037aa7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:15.367087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac25e4-34a0-41b2-86e8-1fed037aa7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:15.367353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac25e4-34a0-41b2-86e8-1fed037aa7fd admin admin] PATH_INFO: `/v3/users/d5fcd256f19148ebac591dfe22de8fef` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:15.368811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac25e4-34a0-41b2-86e8-1fed037aa7fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5fcd256f19148ebac591dfe22de8fef)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:15.373389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac25e4-34a0-41b2-86e8-1fed037aa7fd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:15.493136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3aac25e4-34a0-41b2-86e8-1fed037aa7fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5fcd256f19148ebac591dfe22de8fef'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:15.499966 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:15.513073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3aac25e4-34a0-41b2-86e8-1fed037aa7fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5fcd256f19148ebac591dfe22de8fef'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:15.514084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3aac25e4-34a0-41b2-86e8-1fed037aa7fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5fcd256f19148ebac591dfe22de8fef'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:15.558766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3aac25e4-34a0-41b2-86e8-1fed037aa7fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5fcd256f19148ebac591dfe22de8fef'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:15.578116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3aac25e4-34a0-41b2-86e8-1fed037aa7fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5fcd256f19148ebac591dfe22de8fef'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:15.630335 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3075/6167] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:10:15 2022] DELETE /identity/v3/users/d5fcd256f19148ebac591dfe22de8fef => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:17.317657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ce3bd-a47d-4576-9906-f7b13709d96b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:17.319714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7e4ce3bd-a47d-4576-9906-f7b13709d96b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:17.381789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ce3bd-a47d-4576-9906-f7b13709d96b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:17.603648 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:17.677104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccc7a1-8580-4a45-bab0-3213d25b3f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:17.677762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccc7a1-8580-4a45-bab0-3213d25b3f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:17.678041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccc7a1-8580-4a45-bab0-3213d25b3f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:17.678310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccc7a1-8580-4a45-bab0-3213d25b3f9e admin admin] PATH_INFO: `/v3/projects/1b3b6ab0e1af427d9609c2c805555a49` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:17.691288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccc7a1-8580-4a45-bab0-3213d25b3f9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b3b6ab0e1af427d9609c2c805555a49)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:17.693318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccc7a1-8580-4a45-bab0-3213d25b3f9e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:17.877184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-adccc7a1-8580-4a45-bab0-3213d25b3f9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b3b6ab0e1af427d9609c2c805555a49', 'request_id': 'req-adccc7a1-8580-4a45-bab0-3213d25b3f9e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:17.893781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-adccc7a1-8580-4a45-bab0-3213d25b3f9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b3b6ab0e1af427d9609c2c805555a49', 'request_id': 'req-adccc7a1-8580-4a45-bab0-3213d25b3f9e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:17.901430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-adccc7a1-8580-4a45-bab0-3213d25b3f9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b3b6ab0e1af427d9609c2c805555a49', 'request_id': 'req-adccc7a1-8580-4a45-bab0-3213d25b3f9e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:17.931247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-adccc7a1-8580-4a45-bab0-3213d25b3f9e admin admin] The token cache is being invalidate because project 1b3b6ab0e1af427d9609c2c805555a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:10:17.931741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-adccc7a1-8580-4a45-bab0-3213d25b3f9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:17.938460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-adccc7a1-8580-4a45-bab0-3213d25b3f9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:17.940742 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3093/6168] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:10:17 2022] DELETE /identity/v3/projects/1b3b6ab0e1af427d9609c2c805555a49 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:17.945426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63af924-3530-48b3-a212-e95b44697c99 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:17.945929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63af924-3530-48b3-a212-e95b44697c99 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:17.946049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63af924-3530-48b3-a212-e95b44697c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:18.006485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c63af924-3530-48b3-a212-e95b44697c99 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:18.015000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c63af924-3530-48b3-a212-e95b44697c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:18.251910 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3076/6169] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:18.260733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a0ae1-22f5-4277-bcee-8306c18173c1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:18.261445 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a0ae1-22f5-4277-bcee-8306c18173c1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:18.261950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a0ae1-22f5-4277-bcee-8306c18173c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:18.329002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-460a0ae1-22f5-4277-bcee-8306c18173c1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:18.334756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-460a0ae1-22f5-4277-bcee-8306c18173c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:18.358096 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3094/6170] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:18.361886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63af924-3530-48b3-a212-e95b44697c99 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:18.378358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63af924-3530-48b3-a212-e95b44697c99 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:18.393105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6d83d-075e-4829-b644-e9c1c2d3acc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:18.393836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6d83d-075e-4829-b644-e9c1c2d3acc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:18.394329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6d83d-075e-4829-b644-e9c1c2d3acc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:18.394809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6d83d-075e-4829-b644-e9c1c2d3acc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:18.395658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6d83d-075e-4829-b644-e9c1c2d3acc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:10:18.396875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6d83d-075e-4829-b644-e9c1c2d3acc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:18.400893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6d83d-075e-4829-b644-e9c1c2d3acc9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:18.436336 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3077/6171] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:10:18.440875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a0ae1-22f5-4277-bcee-8306c18173c1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:18.458302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a0ae1-22f5-4277-bcee-8306c18173c1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:18.469578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a981b2-b65c-4ac7-a94a-e2d924df6d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:18.471189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a981b2-b65c-4ac7-a94a-e2d924df6d0c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:18.473505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a981b2-b65c-4ac7-a94a-e2d924df6d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:18.474408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a981b2-b65c-4ac7-a94a-e2d924df6d0c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:18.475386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a981b2-b65c-4ac7-a94a-e2d924df6d0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:18.483217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a981b2-b65c-4ac7-a94a-e2d924df6d0c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:18.583890 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3095/6172] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:10:18 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:18.588031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6d83d-075e-4829-b644-e9c1c2d3acc9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:18.610267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6d83d-075e-4829-b644-e9c1c2d3acc9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:18.819088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a75118-c34d-4e7e-81f2-9a923a50b5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:18.820246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a75118-c34d-4e7e-81f2-9a923a50b5a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:18.820764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a75118-c34d-4e7e-81f2-9a923a50b5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:18.822402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a75118-c34d-4e7e-81f2-9a923a50b5a6 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:18.825211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a75118-c34d-4e7e-81f2-9a923a50b5a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:18.832558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a75118-c34d-4e7e-81f2-9a923a50b5a6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:18.912377 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3078/6173] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:10:18 2022] POST /identity/v3/users => generated 286 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:18.914291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a981b2-b65c-4ac7-a94a-e2d924df6d0c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:18.952949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a981b2-b65c-4ac7-a94a-e2d924df6d0c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:18.967533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b3ac8-5397-4f7a-a8b1-fa66e7d934c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:18.968255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b3ac8-5397-4f7a-a8b1-fa66e7d934c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:18.972309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b3ac8-5397-4f7a-a8b1-fa66e7d934c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:18.972309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b3ac8-5397-4f7a-a8b1-fa66e7d934c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:18.972309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b3ac8-5397-4f7a-a8b1-fa66e7d934c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:18.978040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b3ac8-5397-4f7a-a8b1-fa66e7d934c1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:19.006045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a75118-c34d-4e7e-81f2-9a923a50b5a6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:19.036078 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3096/6174] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:19.049189 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a75118-c34d-4e7e-81f2-9a923a50b5a6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:19.068233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0290d8-1340-49d3-8236-8429b10088e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:19.069407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0290d8-1340-49d3-8236-8429b10088e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:19.071786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0290d8-1340-49d3-8236-8429b10088e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:19.080831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0290d8-1340-49d3-8236-8429b10088e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:19.085483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0290d8-1340-49d3-8236-8429b10088e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:19.087985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0290d8-1340-49d3-8236-8429b10088e3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:19.109830 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3079/6175] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:19.112943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b3ac8-5397-4f7a-a8b1-fa66e7d934c1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:19.144713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b3ac8-5397-4f7a-a8b1-fa66e7d934c1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:19.151542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef301e-15d1-4e91-99aa-07eb11b649c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:19.154379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef301e-15d1-4e91-99aa-07eb11b649c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:19.154822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef301e-15d1-4e91-99aa-07eb11b649c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:19.155245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef301e-15d1-4e91-99aa-07eb11b649c6 admin admin] PATH_INFO: `/v3/projects/067e37aaf62141eca1eaf7978dd96e4c/users/22d6cb1793d8443f948cae52bf2bdb50/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:19.194455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef301e-15d1-4e91-99aa-07eb11b649c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=067e37aaf62141eca1eaf7978dd96e4c, user_id=22d6cb1793d8443f948cae52bf2bdb50, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:19.201292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef301e-15d1-4e91-99aa-07eb11b649c6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:19.233729 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3097/6176] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:19 2022] PUT /identity/v3/projects/067e37aaf62141eca1eaf7978dd96e4c/users/22d6cb1793d8443f948cae52bf2bdb50/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:19.248201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a145f8-ca4a-4819-9546-4429ac29aefc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:19.248843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a145f8-ca4a-4819-9546-4429ac29aefc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:19.249302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a145f8-ca4a-4819-9546-4429ac29aefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:19.321865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-46a145f8-ca4a-4819-9546-4429ac29aefc None None] MFA Rules not processed for user `22d6cb1793d8443f948cae52bf2bdb50`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:19.327242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-46a145f8-ca4a-4819-9546-4429ac29aefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:19.400241 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:19.533675 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3080/6177] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:19.591072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef301e-15d1-4e91-99aa-07eb11b649c6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:19.599517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fcef301e-15d1-4e91-99aa-07eb11b649c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:19.902972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef301e-15d1-4e91-99aa-07eb11b649c6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:19.940625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade9881-bc6a-4ec9-a4d4-45839b1a4748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:19.941286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade9881-bc6a-4ec9-a4d4-45839b1a4748 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:19.941568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade9881-bc6a-4ec9-a4d4-45839b1a4748 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:19.941841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade9881-bc6a-4ec9-a4d4-45839b1a4748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:19.976145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade9881-bc6a-4ec9-a4d4-45839b1a4748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:19.978493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade9881-bc6a-4ec9-a4d4-45839b1a4748 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:20.021250 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3098/6178] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:21.932463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a145f8-ca4a-4819-9546-4429ac29aefc None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:21.935657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-46a145f8-ca4a-4819-9546-4429ac29aefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:22.092806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a145f8-ca4a-4819-9546-4429ac29aefc None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:22.106527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0831a-a085-4132-93fa-c61b688c3de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:22.108152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0831a-a085-4132-93fa-c61b688c3de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:22.110283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0831a-a085-4132-93fa-c61b688c3de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:22.112335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0831a-a085-4132-93fa-c61b688c3de0 admin admin] PATH_INFO: `/v3/users/f81d4db0277848fcaa502fe932e62355` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:22.116580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0831a-a085-4132-93fa-c61b688c3de0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f81d4db0277848fcaa502fe932e62355)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:22.127562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0831a-a085-4132-93fa-c61b688c3de0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:22.242819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-75c0831a-a085-4132-93fa-c61b688c3de0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f81d4db0277848fcaa502fe932e62355'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:22.264111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-75c0831a-a085-4132-93fa-c61b688c3de0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f81d4db0277848fcaa502fe932e62355'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:22.265058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-75c0831a-a085-4132-93fa-c61b688c3de0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f81d4db0277848fcaa502fe932e62355'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:22.298106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-75c0831a-a085-4132-93fa-c61b688c3de0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f81d4db0277848fcaa502fe932e62355'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:22.319193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-75c0831a-a085-4132-93fa-c61b688c3de0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f81d4db0277848fcaa502fe932e62355'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:22.340042 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3081/6179] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:10:21 2022] DELETE /identity/v3/users/f81d4db0277848fcaa502fe932e62355 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:22.344636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4de2d-346d-427a-83e5-fecaa38c6803 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:22.345604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4de2d-346d-427a-83e5-fecaa38c6803 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:22.346033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4de2d-346d-427a-83e5-fecaa38c6803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:22.392456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-95a4de2d-346d-427a-83e5-fecaa38c6803 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:22.397616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-95a4de2d-346d-427a-83e5-fecaa38c6803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:22.416946 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:22.575662 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3099/6180] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:22.720989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0831a-a085-4132-93fa-c61b688c3de0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:22.722868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-75c0831a-a085-4132-93fa-c61b688c3de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:22.800051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4de2d-346d-427a-83e5-fecaa38c6803 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:22.801676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-95a4de2d-346d-427a-83e5-fecaa38c6803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:22.811038 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:22.820251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4de2d-346d-427a-83e5-fecaa38c6803 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:22.853568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0831a-a085-4132-93fa-c61b688c3de0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:22.857099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c1671-186c-4584-85ca-18e10fa7e5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:22.858454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c1671-186c-4584-85ca-18e10fa7e5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:22.858902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c1671-186c-4584-85ca-18e10fa7e5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:22.859795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c1671-186c-4584-85ca-18e10fa7e5a7 admin admin] PATH_INFO: `/v3/users/22d6cb1793d8443f948cae52bf2bdb50` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:22.861459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c1671-186c-4584-85ca-18e10fa7e5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22d6cb1793d8443f948cae52bf2bdb50)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:22.864887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47583632-362a-4637-80a8-ae9082776fc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:22.866392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c1671-186c-4584-85ca-18e10fa7e5a7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:22.866958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47583632-362a-4637-80a8-ae9082776fc8 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:22.867382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47583632-362a-4637-80a8-ae9082776fc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:22.868341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47583632-362a-4637-80a8-ae9082776fc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:22.895092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47583632-362a-4637-80a8-ae9082776fc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:22.896523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47583632-362a-4637-80a8-ae9082776fc8 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:22.917997 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3082/6181] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:22.961704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d49c1671-186c-4584-85ca-18e10fa7e5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22d6cb1793d8443f948cae52bf2bdb50'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:22.962479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d49c1671-186c-4584-85ca-18e10fa7e5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22d6cb1793d8443f948cae52bf2bdb50'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:22.978019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d49c1671-186c-4584-85ca-18e10fa7e5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22d6cb1793d8443f948cae52bf2bdb50'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:22.998012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d49c1671-186c-4584-85ca-18e10fa7e5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22d6cb1793d8443f948cae52bf2bdb50'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:23.009182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d49c1671-186c-4584-85ca-18e10fa7e5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22d6cb1793d8443f948cae52bf2bdb50'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:23.018128 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3100/6182] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:10:22 2022] DELETE /identity/v3/users/22d6cb1793d8443f948cae52bf2bdb50 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:23.022299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8706f-0586-4357-8e68-42a6f2b6d836 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:23.022780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8706f-0586-4357-8e68-42a6f2b6d836 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:23.022866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8706f-0586-4357-8e68-42a6f2b6d836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:23.049734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-91f8706f-0586-4357-8e68-42a6f2b6d836 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:23.051060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-91f8706f-0586-4357-8e68-42a6f2b6d836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:23.181726 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3083/6183] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:10:23.208193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c1671-186c-4584-85ca-18e10fa7e5a7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:23.210192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d49c1671-186c-4584-85ca-18e10fa7e5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:23.316263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c1671-186c-4584-85ca-18e10fa7e5a7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:23.320883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e94bd4-b0bc-49ae-8bee-7d2198c5e5d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:23.322251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e94bd4-b0bc-49ae-8bee-7d2198c5e5d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:23.322705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e94bd4-b0bc-49ae-8bee-7d2198c5e5d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:23.324390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e94bd4-b0bc-49ae-8bee-7d2198c5e5d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:23.338639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e94bd4-b0bc-49ae-8bee-7d2198c5e5d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:23.340761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e94bd4-b0bc-49ae-8bee-7d2198c5e5d3 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:23.353739 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3101/6184] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:23.598341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8706f-0586-4357-8e68-42a6f2b6d836 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:23.599895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-91f8706f-0586-4357-8e68-42a6f2b6d836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:23.620034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8706f-0586-4357-8e68-42a6f2b6d836 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:23.634035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ec7b7-a995-4b74-a91b-ee4760222977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:23.634742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ec7b7-a995-4b74-a91b-ee4760222977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:23.635016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ec7b7-a995-4b74-a91b-ee4760222977 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:23.636141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ec7b7-a995-4b74-a91b-ee4760222977 admin admin] PATH_INFO: `/v3/users/7e5714139ec94577bf07cfb95e7d925c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:23.638434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ec7b7-a995-4b74-a91b-ee4760222977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e5714139ec94577bf07cfb95e7d925c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:23.644336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ec7b7-a995-4b74-a91b-ee4760222977 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:23.769102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-251ec7b7-a995-4b74-a91b-ee4760222977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e5714139ec94577bf07cfb95e7d925c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:23.795809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-251ec7b7-a995-4b74-a91b-ee4760222977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e5714139ec94577bf07cfb95e7d925c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:23.796854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-251ec7b7-a995-4b74-a91b-ee4760222977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e5714139ec94577bf07cfb95e7d925c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:23.821360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-251ec7b7-a995-4b74-a91b-ee4760222977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e5714139ec94577bf07cfb95e7d925c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:23.835425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-251ec7b7-a995-4b74-a91b-ee4760222977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e5714139ec94577bf07cfb95e7d925c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:23.851435 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3084/6185] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:10:23 2022] DELETE /identity/v3/users/7e5714139ec94577bf07cfb95e7d925c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:24.277132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e94bd4-b0bc-49ae-8bee-7d2198c5e5d3 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:24.279040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-49e94bd4-b0bc-49ae-8bee-7d2198c5e5d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:24.321025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e94bd4-b0bc-49ae-8bee-7d2198c5e5d3 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:24.362816 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:24.444534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c824ba-fcb6-4941-bedf-98a104d370bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:24.447350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c824ba-fcb6-4941-bedf-98a104d370bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:24.448307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c824ba-fcb6-4941-bedf-98a104d370bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:24.465642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c824ba-fcb6-4941-bedf-98a104d370bf admin admin] PATH_INFO: `/v3/projects/213e00ee960843fab90491df550908b0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:24.471460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c824ba-fcb6-4941-bedf-98a104d370bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=213e00ee960843fab90491df550908b0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:24.476042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c824ba-fcb6-4941-bedf-98a104d370bf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:24.514780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ec7b7-a995-4b74-a91b-ee4760222977 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:24.516325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-251ec7b7-a995-4b74-a91b-ee4760222977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:24.549147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ec7b7-a995-4b74-a91b-ee4760222977 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:24.557108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df404b47-45f7-41b3-8111-1a741295249e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:24.558276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df404b47-45f7-41b3-8111-1a741295249e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:24.558869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df404b47-45f7-41b3-8111-1a741295249e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:24.559322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df404b47-45f7-41b3-8111-1a741295249e admin admin] PATH_INFO: `/v3/projects/e9c9e97c1e7141db9509f3344fd12123` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:24.561402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df404b47-45f7-41b3-8111-1a741295249e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9c9e97c1e7141db9509f3344fd12123)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:24.570379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df404b47-45f7-41b3-8111-1a741295249e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:24.592511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b0c824ba-fcb6-4941-bedf-98a104d370bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '213e00ee960843fab90491df550908b0', 'request_id': 'req-b0c824ba-fcb6-4941-bedf-98a104d370bf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:24.622470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b0c824ba-fcb6-4941-bedf-98a104d370bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '213e00ee960843fab90491df550908b0', 'request_id': 'req-b0c824ba-fcb6-4941-bedf-98a104d370bf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:24.631146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b0c824ba-fcb6-4941-bedf-98a104d370bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '213e00ee960843fab90491df550908b0', 'request_id': 'req-b0c824ba-fcb6-4941-bedf-98a104d370bf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:24.666040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b0c824ba-fcb6-4941-bedf-98a104d370bf admin admin] The token cache is being invalidate because project 213e00ee960843fab90491df550908b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:10:24.667736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b0c824ba-fcb6-4941-bedf-98a104d370bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:24.668680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b0c824ba-fcb6-4941-bedf-98a104d370bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:24.676798 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3102/6186] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:10:24 2022] DELETE /identity/v3/projects/213e00ee960843fab90491df550908b0 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:24.679161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c824ba-fcb6-4941-bedf-98a104d370bf admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:24.682354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b0c824ba-fcb6-4941-bedf-98a104d370bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:24.696538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-df404b47-45f7-41b3-8111-1a741295249e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9c9e97c1e7141db9509f3344fd12123', 'request_id': 'req-df404b47-45f7-41b3-8111-1a741295249e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:24.704588 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:24.713997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-df404b47-45f7-41b3-8111-1a741295249e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9c9e97c1e7141db9509f3344fd12123', 'request_id': 'req-df404b47-45f7-41b3-8111-1a741295249e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:24.736297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-df404b47-45f7-41b3-8111-1a741295249e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9c9e97c1e7141db9509f3344fd12123', 'request_id': 'req-df404b47-45f7-41b3-8111-1a741295249e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:24.766139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-df404b47-45f7-41b3-8111-1a741295249e admin admin] The token cache is being invalidate because project e9c9e97c1e7141db9509f3344fd12123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:10:24.767907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-df404b47-45f7-41b3-8111-1a741295249e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:24.769865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-df404b47-45f7-41b3-8111-1a741295249e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:24.786538 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3085/6187] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:10:24 2022] DELETE /identity/v3/projects/e9c9e97c1e7141db9509f3344fd12123 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:24.791885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79e1e5-19d6-4460-8a0a-339573644853 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:24.792771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79e1e5-19d6-4460-8a0a-339573644853 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:24.793046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79e1e5-19d6-4460-8a0a-339573644853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:24.843939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8e79e1e5-19d6-4460-8a0a-339573644853 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:24.848506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8e79e1e5-19d6-4460-8a0a-339573644853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:24.864902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c824ba-fcb6-4941-bedf-98a104d370bf admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:25.008274 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3086/6188] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:25.012102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee620fa3-a4a9-4722-a521-6e819b0d7921 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:25.013309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee620fa3-a4a9-4722-a521-6e819b0d7921 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:25.016242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee620fa3-a4a9-4722-a521-6e819b0d7921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:25.054532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ee620fa3-a4a9-4722-a521-6e819b0d7921 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:25.055908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ee620fa3-a4a9-4722-a521-6e819b0d7921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:25.075540 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3087/6189] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:25.079492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee620fa3-a4a9-4722-a521-6e819b0d7921 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:25.091168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee620fa3-a4a9-4722-a521-6e819b0d7921 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:25.096108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41299a0f-3d4e-4890-a743-409c99ce6c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:25.096707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41299a0f-3d4e-4890-a743-409c99ce6c6f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:25.096987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41299a0f-3d4e-4890-a743-409c99ce6c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:25.097255 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41299a0f-3d4e-4890-a743-409c99ce6c6f admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:25.097910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41299a0f-3d4e-4890-a743-409c99ce6c6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:10:25.098211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41299a0f-3d4e-4890-a743-409c99ce6c6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:25.100028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41299a0f-3d4e-4890-a743-409c99ce6c6f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:25.101317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f912c5-bc00-4d1c-8910-63c75dbbf3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:25.102182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f912c5-bc00-4d1c-8910-63c75dbbf3ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:25.102792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f912c5-bc00-4d1c-8910-63c75dbbf3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:25.103259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f912c5-bc00-4d1c-8910-63c75dbbf3ad admin admin] PATH_INFO: `/v3/users/d0ea03160e5e400a951fc28e9b205ae1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:25.111314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f912c5-bc00-4d1c-8910-63c75dbbf3ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ea03160e5e400a951fc28e9b205ae1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:25.113953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f912c5-bc00-4d1c-8910-63c75dbbf3ad admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:25.124423 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3088/6190] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:10:25.125485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41299a0f-3d4e-4890-a743-409c99ce6c6f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:25.128718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-41299a0f-3d4e-4890-a743-409c99ce6c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:25.141568 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:25.144670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41299a0f-3d4e-4890-a743-409c99ce6c6f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:25.158893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0453c-7053-4f2e-9fd0-48bfb1d2b4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:25.159858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0453c-7053-4f2e-9fd0-48bfb1d2b4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:25.161269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0453c-7053-4f2e-9fd0-48bfb1d2b4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:25.161755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0453c-7053-4f2e-9fd0-48bfb1d2b4bd admin admin] PATH_INFO: `/v3/projects/067e37aaf62141eca1eaf7978dd96e4c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:25.169213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0453c-7053-4f2e-9fd0-48bfb1d2b4bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=067e37aaf62141eca1eaf7978dd96e4c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:25.175196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0453c-7053-4f2e-9fd0-48bfb1d2b4bd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:25.243574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-34f912c5-bc00-4d1c-8910-63c75dbbf3ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ea03160e5e400a951fc28e9b205ae1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:25.248266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-34f912c5-bc00-4d1c-8910-63c75dbbf3ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ea03160e5e400a951fc28e9b205ae1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:25.264264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-34f912c5-bc00-4d1c-8910-63c75dbbf3ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ea03160e5e400a951fc28e9b205ae1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:25.299977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-34f912c5-bc00-4d1c-8910-63c75dbbf3ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ea03160e5e400a951fc28e9b205ae1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:25.300476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a2f0453c-7053-4f2e-9fd0-48bfb1d2b4bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '067e37aaf62141eca1eaf7978dd96e4c', 'request_id': 'req-a2f0453c-7053-4f2e-9fd0-48bfb1d2b4bd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:25.317035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a2f0453c-7053-4f2e-9fd0-48bfb1d2b4bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '067e37aaf62141eca1eaf7978dd96e4c', 'request_id': 'req-a2f0453c-7053-4f2e-9fd0-48bfb1d2b4bd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:25.322211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-34f912c5-bc00-4d1c-8910-63c75dbbf3ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ea03160e5e400a951fc28e9b205ae1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:25.346861 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3103/6191] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:10:24 2022] DELETE /identity/v3/users/d0ea03160e5e400a951fc28e9b205ae1 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:25.346861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f912c5-bc00-4d1c-8910-63c75dbbf3ad admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:25.348478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-34f912c5-bc00-4d1c-8910-63c75dbbf3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:25.359128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a2f0453c-7053-4f2e-9fd0-48bfb1d2b4bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '067e37aaf62141eca1eaf7978dd96e4c', 'request_id': 'req-a2f0453c-7053-4f2e-9fd0-48bfb1d2b4bd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:25.383212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a2f0453c-7053-4f2e-9fd0-48bfb1d2b4bd admin admin] The token cache is being invalidate because project 067e37aaf62141eca1eaf7978dd96e4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:10:25.383505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a2f0453c-7053-4f2e-9fd0-48bfb1d2b4bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:25.384185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a2f0453c-7053-4f2e-9fd0-48bfb1d2b4bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:25.388659 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3089/6192] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:10:25 2022] DELETE /identity/v3/projects/067e37aaf62141eca1eaf7978dd96e4c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:25.392399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb48a7e-3efd-4333-a9a9-c55bf0b45c4b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:25.392718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb48a7e-3efd-4333-a9a9-c55bf0b45c4b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:25.393045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb48a7e-3efd-4333-a9a9-c55bf0b45c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:25.428467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8bb48a7e-3efd-4333-a9a9-c55bf0b45c4b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:25.430550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8bb48a7e-3efd-4333-a9a9-c55bf0b45c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:25.505642 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:25.516237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f912c5-bc00-4d1c-8910-63c75dbbf3ad admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:25.526382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7309e2e-3f9f-4f66-aa2a-1ef5139c3fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:25.527702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7309e2e-3f9f-4f66-aa2a-1ef5139c3fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:25.527983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7309e2e-3f9f-4f66-aa2a-1ef5139c3fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:25.528256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7309e2e-3f9f-4f66-aa2a-1ef5139c3fa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:25.528936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7309e2e-3f9f-4f66-aa2a-1ef5139c3fa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:25.539785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7309e2e-3f9f-4f66-aa2a-1ef5139c3fa0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:25.550376 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3090/6193] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:10:25.559817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f35a5a-7b8b-49d8-b026-821d161921de None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:25.560163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f35a5a-7b8b-49d8-b026-821d161921de None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:25.560441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f35a5a-7b8b-49d8-b026-821d161921de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:25.598891 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3104/6194] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:10:25 2022] POST /identity/v3/projects => generated 363 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:25.603305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7309e2e-3f9f-4f66-aa2a-1ef5139c3fa0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:25.607031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b7309e2e-3f9f-4f66-aa2a-1ef5139c3fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:25.611241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a0f35a5a-7b8b-49d8-b026-821d161921de None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:25.612510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a0f35a5a-7b8b-49d8-b026-821d161921de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:25.779171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7309e2e-3f9f-4f66-aa2a-1ef5139c3fa0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:25.780126 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3091/6195] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:25.781266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f35a5a-7b8b-49d8-b026-821d161921de None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:25.785665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e30029-feca-45f0-8f04-6e208a5bb1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:25.787717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e30029-feca-45f0-8f04-6e208a5bb1d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:25.788421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e30029-feca-45f0-8f04-6e208a5bb1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:25.789115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e30029-feca-45f0-8f04-6e208a5bb1d2 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:25.801699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e30029-feca-45f0-8f04-6e208a5bb1d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:25.802262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f35a5a-7b8b-49d8-b026-821d161921de None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:25.804172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e30029-feca-45f0-8f04-6e208a5bb1d2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:25.814464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09156c-e675-4d73-8eb8-ff85c352f93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:25.815112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09156c-e675-4d73-8eb8-ff85c352f93c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:25.815386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09156c-e675-4d73-8eb8-ff85c352f93c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:25.816715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09156c-e675-4d73-8eb8-ff85c352f93c admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:25.816715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09156c-e675-4d73-8eb8-ff85c352f93c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:10:25.819547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09156c-e675-4d73-8eb8-ff85c352f93c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:25.822435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09156c-e675-4d73-8eb8-ff85c352f93c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:25.830292 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:25.847776 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3105/6196] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:10:25 2022] POST /identity/v3/users => generated 282 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:25.849122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e30029-feca-45f0-8f04-6e208a5bb1d2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:25.864259 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3092/6197] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:10:25.865400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09156c-e675-4d73-8eb8-ff85c352f93c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:25.888053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09156c-e675-4d73-8eb8-ff85c352f93c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:25.904696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a9fcd-d184-4118-8c91-fb138a84ec00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:25.905266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a9fcd-d184-4118-8c91-fb138a84ec00 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:25.905540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a9fcd-d184-4118-8c91-fb138a84ec00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:25.905807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a9fcd-d184-4118-8c91-fb138a84ec00 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:25.910779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e30029-feca-45f0-8f04-6e208a5bb1d2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:25.916811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a9fcd-d184-4118-8c91-fb138a84ec00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:25.916811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a9fcd-d184-4118-8c91-fb138a84ec00 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:25.929539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f62e0-9c65-4f9c-82dd-707f36dfd350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:25.929834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f62e0-9c65-4f9c-82dd-707f36dfd350 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:25.934057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f62e0-9c65-4f9c-82dd-707f36dfd350 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:25.934803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f62e0-9c65-4f9c-82dd-707f36dfd350 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:25.936006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f62e0-9c65-4f9c-82dd-707f36dfd350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:25.941474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f62e0-9c65-4f9c-82dd-707f36dfd350 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:25.986024 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3106/6198] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:25.990379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f62e0-9c65-4f9c-82dd-707f36dfd350 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:25.999203 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3093/6199] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:10:25 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:26.000143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a9fcd-d184-4118-8c91-fb138a84ec00 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:26.032957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f62e0-9c65-4f9c-82dd-707f36dfd350 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:26.154994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a9fcd-d184-4118-8c91-fb138a84ec00 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:26.165470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd0b3e-4b63-4932-b726-4991d043b8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:26.165887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd0b3e-4b63-4932-b726-4991d043b8b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:26.166164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd0b3e-4b63-4932-b726-4991d043b8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:26.166434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd0b3e-4b63-4932-b726-4991d043b8b4 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:26.167652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd0b3e-4b63-4932-b726-4991d043b8b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:26.174484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd0b3e-4b63-4932-b726-4991d043b8b4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:26.220216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc197c14-e00e-460c-a9b7-f6ca8f5c84be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:26.222957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc197c14-e00e-460c-a9b7-f6ca8f5c84be admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:26.224453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc197c14-e00e-460c-a9b7-f6ca8f5c84be admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:26.224834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc197c14-e00e-460c-a9b7-f6ca8f5c84be admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:26.225524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc197c14-e00e-460c-a9b7-f6ca8f5c84be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:26.231188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc197c14-e00e-460c-a9b7-f6ca8f5c84be admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:26.233545 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3094/6200] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:10:25 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:26.234565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd0b3e-4b63-4932-b726-4991d043b8b4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:26.257484 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3107/6201] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:26.258643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc197c14-e00e-460c-a9b7-f6ca8f5c84be admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:26.262394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd0b3e-4b63-4932-b726-4991d043b8b4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:26.271035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19220c2-4d5a-4dd4-b0b5-813c86fbc330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:26.271734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19220c2-4d5a-4dd4-b0b5-813c86fbc330 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:26.272025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19220c2-4d5a-4dd4-b0b5-813c86fbc330 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:26.272294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19220c2-4d5a-4dd4-b0b5-813c86fbc330 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:26.277917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19220c2-4d5a-4dd4-b0b5-813c86fbc330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:26.278614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19220c2-4d5a-4dd4-b0b5-813c86fbc330 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:26.289109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc197c14-e00e-460c-a9b7-f6ca8f5c84be admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:26.299752 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3095/6202] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:26.305915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19220c2-4d5a-4dd4-b0b5-813c86fbc330 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:26.318249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3c63c-b51c-4411-8314-74618d0fcb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:26.318907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3c63c-b51c-4411-8314-74618d0fcb60 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:26.319128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3c63c-b51c-4411-8314-74618d0fcb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:26.319465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3c63c-b51c-4411-8314-74618d0fcb60 admin admin] PATH_INFO: `/v3/projects/54b670013f414f3b8b2e813c834ae8cd/users/893b6b199a214c309117f5dd58ed4f11/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:26.334651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19220c2-4d5a-4dd4-b0b5-813c86fbc330 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:26.359928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf92b2-48a9-4ddc-bd3d-cbb704bbe973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:26.361266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf92b2-48a9-4ddc-bd3d-cbb704bbe973 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:26.362314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf92b2-48a9-4ddc-bd3d-cbb704bbe973 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:26.362455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3c63c-b51c-4411-8314-74618d0fcb60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54b670013f414f3b8b2e813c834ae8cd, user_id=893b6b199a214c309117f5dd58ed4f11, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:26.362626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf92b2-48a9-4ddc-bd3d-cbb704bbe973 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:26.363309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf92b2-48a9-4ddc-bd3d-cbb704bbe973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:26.371351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3c63c-b51c-4411-8314-74618d0fcb60 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:26.373572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf92b2-48a9-4ddc-bd3d-cbb704bbe973 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:26.400825 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3108/6203] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:26 2022] PUT /identity/v3/projects/54b670013f414f3b8b2e813c834ae8cd/users/893b6b199a214c309117f5dd58ed4f11/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:26.410638 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3096/6204] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:26.415573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf92b2-48a9-4ddc-bd3d-cbb704bbe973 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:26.415726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e325a8-3bc7-4d62-b418-66d6aa436811 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:26.415957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e325a8-3bc7-4d62-b418-66d6aa436811 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:26.416235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e325a8-3bc7-4d62-b418-66d6aa436811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:26.440155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf92b2-48a9-4ddc-bd3d-cbb704bbe973 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:26.485536 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:26.501873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e0e325a8-3bc7-4d62-b418-66d6aa436811 None None] MFA Rules not processed for user `893b6b199a214c309117f5dd58ed4f11`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:26.503850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e0e325a8-3bc7-4d62-b418-66d6aa436811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:26.583801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004b90d-2307-4007-9ff2-d51f2d8053fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:26.584485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004b90d-2307-4007-9ff2-d51f2d8053fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:26.584798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004b90d-2307-4007-9ff2-d51f2d8053fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:26.585075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004b90d-2307-4007-9ff2-d51f2d8053fc admin admin] PATH_INFO: `/v3/projects/92f6663764b44884994674b4dc0b9eb7/users/f7e2c36c861a4b42a0de007113de9f5b/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:26.647081 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3109/6205] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:26.655573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004b90d-2307-4007-9ff2-d51f2d8053fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f6663764b44884994674b4dc0b9eb7, user_id=f7e2c36c861a4b42a0de007113de9f5b, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:26.658364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004b90d-2307-4007-9ff2-d51f2d8053fc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:26.663317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e325a8-3bc7-4d62-b418-66d6aa436811 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:26.665209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e0e325a8-3bc7-4d62-b418-66d6aa436811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:26.694601 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3097/6206] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:26 2022] PUT /identity/v3/projects/92f6663764b44884994674b4dc0b9eb7/users/f7e2c36c861a4b42a0de007113de9f5b/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:26.707409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ea2bf-c120-403b-9d99-7054d4161db9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:26.708071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ea2bf-c120-403b-9d99-7054d4161db9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:26.708651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ea2bf-c120-403b-9d99-7054d4161db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:26.764114 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:26.799120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-749ea2bf-c120-403b-9d99-7054d4161db9 None None] MFA Rules not processed for user `f7e2c36c861a4b42a0de007113de9f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:26.803453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-749ea2bf-c120-403b-9d99-7054d4161db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:26.822154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e325a8-3bc7-4d62-b418-66d6aa436811 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:26.972808 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3098/6207] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:10:26.974198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5707f-079c-4741-a024-af8d94ec1705 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:26.974484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5707f-079c-4741-a024-af8d94ec1705 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:26.974758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5707f-079c-4741-a024-af8d94ec1705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:27.007867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a44de4-e804-46b9-836d-89df695a3a3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:27.009033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a44de4-e804-46b9-836d-89df695a3a3d service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:27.009524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a44de4-e804-46b9-836d-89df695a3a3d service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:27.011953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a44de4-e804-46b9-836d-89df695a3a3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:27.033510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-adc5707f-079c-4741-a024-af8d94ec1705 None None] MFA Rules not processed for user `f0e8405dde7241c8b6e1fe97702564fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:27.034887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-adc5707f-079c-4741-a024-af8d94ec1705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:27.166666 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3099/6208] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:27.169047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a44de4-e804-46b9-836d-89df695a3a3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:27.171312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a44de4-e804-46b9-836d-89df695a3a3d service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:27.173275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5707f-079c-4741-a024-af8d94ec1705 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:27.174920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-adc5707f-079c-4741-a024-af8d94ec1705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:27.196374 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3110/6209] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:10:27.198142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a44de4-e804-46b9-836d-89df695a3a3d service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:27.201297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f3a44de4-e804-46b9-836d-89df695a3a3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:27.270802 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:27.324796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5707f-079c-4741-a024-af8d94ec1705 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:27.335752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a44de4-e804-46b9-836d-89df695a3a3d service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:27.339903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c613e-b3c0-4784-9074-e36bc40e8272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:27.341594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c613e-b3c0-4784-9074-e36bc40e8272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:27.342469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c613e-b3c0-4784-9074-e36bc40e8272 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:27.343380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c613e-b3c0-4784-9074-e36bc40e8272 admin admin] PATH_INFO: `/v3/projects/0809b9c26e01426c85057b593229dc3b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:27.347624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c613e-b3c0-4784-9074-e36bc40e8272 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0809b9c26e01426c85057b593229dc3b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:27.348060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629905b-8366-4a4c-abe2-5f3d2a461b9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:27.349652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629905b-8366-4a4c-abe2-5f3d2a461b9b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:27.350838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629905b-8366-4a4c-abe2-5f3d2a461b9b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:27.351899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629905b-8366-4a4c-abe2-5f3d2a461b9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:27.353450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c613e-b3c0-4784-9074-e36bc40e8272 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:27.387628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629905b-8366-4a4c-abe2-5f3d2a461b9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:27.392877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629905b-8366-4a4c-abe2-5f3d2a461b9b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:27.418954 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3111/6210] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:27.420544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e377d3a-4be9-461c-83e6-b12b6351f2d9 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:27.421106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e377d3a-4be9-461c-83e6-b12b6351f2d9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:27.421523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e377d3a-4be9-461c-83e6-b12b6351f2d9 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:27.424424 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3112/6211] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 10:10:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 10:10:27.429495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e377d3a-4be9-461c-83e6-b12b6351f2d9 None None] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 10:10:27.480883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e377d3a-4be9-461c-83e6-b12b6351f2d9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:27.513527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-385c613e-b3c0-4784-9074-e36bc40e8272 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0809b9c26e01426c85057b593229dc3b', 'request_id': 'req-385c613e-b3c0-4784-9074-e36bc40e8272'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:27.529902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e377d3a-4be9-461c-83e6-b12b6351f2d9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:27.538064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-385c613e-b3c0-4784-9074-e36bc40e8272 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0809b9c26e01426c85057b593229dc3b', 'request_id': 'req-385c613e-b3c0-4784-9074-e36bc40e8272'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:27.547928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-385c613e-b3c0-4784-9074-e36bc40e8272 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0809b9c26e01426c85057b593229dc3b', 'request_id': 'req-385c613e-b3c0-4784-9074-e36bc40e8272'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:27.577557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-385c613e-b3c0-4784-9074-e36bc40e8272 admin admin] The token cache is being invalidate because project 0809b9c26e01426c85057b593229dc3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:10:27.577847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-385c613e-b3c0-4784-9074-e36bc40e8272 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:27.582055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-385c613e-b3c0-4784-9074-e36bc40e8272 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:27.590471 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3100/6212] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:10:27 2022] DELETE /identity/v3/projects/0809b9c26e01426c85057b593229dc3b => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:27.591553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c613e-b3c0-4784-9074-e36bc40e8272 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:27.594504 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-385c613e-b3c0-4784-9074-e36bc40e8272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:27.610176 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:27.693853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6523ddb-363e-4f1e-a025-6a9476bf0138 tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '893b6b199a214c309117f5dd58ed4f11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54b670013f414f3b8b2e813c834ae8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:27.694707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6523ddb-363e-4f1e-a025-6a9476bf0138 tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:27.695127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6523ddb-363e-4f1e-a025-6a9476bf0138 tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:27.695521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6523ddb-363e-4f1e-a025-6a9476bf0138 tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] PATH_INFO: `/v3/projects/54b670013f414f3b8b2e813c834ae8cd` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:27.696582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6523ddb-363e-4f1e-a025-6a9476bf0138 tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] RBAC: Authorizing `identity:get_project(project_id=54b670013f414f3b8b2e813c834ae8cd)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:27.702222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6523ddb-363e-4f1e-a025-6a9476bf0138 tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:27.706539 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3113/6213] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 10:10:27 2022] GET /identity/v3/projects/54b670013f414f3b8b2e813c834ae8cd => generated 363 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:10:27.712285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d73b22-a92c-4ce7-854c-ca69f2f2410a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:27.712712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d73b22-a92c-4ce7-854c-ca69f2f2410a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:27.713339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d73b22-a92c-4ce7-854c-ca69f2f2410a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:27.770098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b7d73b22-a92c-4ce7-854c-ca69f2f2410a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:27.771780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b7d73b22-a92c-4ce7-854c-ca69f2f2410a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:27.929882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c613e-b3c0-4784-9074-e36bc40e8272 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:27.970005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0846e-1ba4-4b2b-b773-d244350663a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:27.970838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0846e-1ba4-4b2b-b773-d244350663a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:27.980466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0846e-1ba4-4b2b-b773-d244350663a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:27.980466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0846e-1ba4-4b2b-b773-d244350663a5 admin admin] PATH_INFO: `/v3/users/f7e2c36c861a4b42a0de007113de9f5b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:27.983340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0846e-1ba4-4b2b-b773-d244350663a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e2c36c861a4b42a0de007113de9f5b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:27.985344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0846e-1ba4-4b2b-b773-d244350663a5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:28.061047 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3114/6214] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:28.067311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06f13f-f55f-4702-b8a0-9a8c5956aaed None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:28.067985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06f13f-f55f-4702-b8a0-9a8c5956aaed None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:28.068489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06f13f-f55f-4702-b8a0-9a8c5956aaed None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:28.072626 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3115/6215] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 10:10:28 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 10:10:28.075803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1a049-dcc3-4ba5-b264-3711cd678be1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:28.076788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1a049-dcc3-4ba5-b264-3711cd678be1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:28.079865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1a049-dcc3-4ba5-b264-3711cd678be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:28.138591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7be1a049-dcc3-4ba5-b264-3711cd678be1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:28.139979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-70e0846e-1ba4-4b2b-b773-d244350663a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e2c36c861a4b42a0de007113de9f5b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:28.140163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7be1a049-dcc3-4ba5-b264-3711cd678be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:28.155063 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3116/6216] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:28.156105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1a049-dcc3-4ba5-b264-3711cd678be1 None None] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 10:10:28.158726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-70e0846e-1ba4-4b2b-b773-d244350663a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e2c36c861a4b42a0de007113de9f5b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:28.159401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-70e0846e-1ba4-4b2b-b773-d244350663a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e2c36c861a4b42a0de007113de9f5b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:28.159513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7be1a049-dcc3-4ba5-b264-3711cd678be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:28.187179 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:28.190185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-70e0846e-1ba4-4b2b-b773-d244350663a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e2c36c861a4b42a0de007113de9f5b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:28.224187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-70e0846e-1ba4-4b2b-b773-d244350663a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e2c36c861a4b42a0de007113de9f5b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:28.250011 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3101/6217] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:10:27 2022] DELETE /identity/v3/users/f7e2c36c861a4b42a0de007113de9f5b => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:28.251297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0846e-1ba4-4b2b-b773-d244350663a5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:28.256243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-70e0846e-1ba4-4b2b-b773-d244350663a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:28.471887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1a049-dcc3-4ba5-b264-3711cd678be1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:28.474121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7be1a049-dcc3-4ba5-b264-3711cd678be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:28.481745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0846e-1ba4-4b2b-b773-d244350663a5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:28.492513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1a049-dcc3-4ba5-b264-3711cd678be1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:28.494451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e50e21-2aed-4c56-9a7e-4f6981afef42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:28.495359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e50e21-2aed-4c56-9a7e-4f6981afef42 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:28.496398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e50e21-2aed-4c56-9a7e-4f6981afef42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:28.496398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e50e21-2aed-4c56-9a7e-4f6981afef42 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:28.496618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e50e21-2aed-4c56-9a7e-4f6981afef42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:10:28.496941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e50e21-2aed-4c56-9a7e-4f6981afef42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:28.498540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e50e21-2aed-4c56-9a7e-4f6981afef42 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:28.529829 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3102/6218] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:10:28.529829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85375ef4-afe6-4ea9-8b31-c83b5db64833 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:28.529829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85375ef4-afe6-4ea9-8b31-c83b5db64833 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:28.529829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85375ef4-afe6-4ea9-8b31-c83b5db64833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:28.537522 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:28.576010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-85375ef4-afe6-4ea9-8b31-c83b5db64833 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:28.577279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-85375ef4-afe6-4ea9-8b31-c83b5db64833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:28.597937 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3103/6219] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:28.599380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85375ef4-afe6-4ea9-8b31-c83b5db64833 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:28.619291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85375ef4-afe6-4ea9-8b31-c83b5db64833 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:28.621673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff55c03-3ecd-469e-a415-5d158b3d8d6c tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '893b6b199a214c309117f5dd58ed4f11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54b670013f414f3b8b2e813c834ae8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:28.622438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff55c03-3ecd-469e-a415-5d158b3d8d6c tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:28.622811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff55c03-3ecd-469e-a415-5d158b3d8d6c tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:28.623221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff55c03-3ecd-469e-a415-5d158b3d8d6c tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] PATH_INFO: `/v3/projects/54b670013f414f3b8b2e813c834ae8cd` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:28.624767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff55c03-3ecd-469e-a415-5d158b3d8d6c tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] RBAC: Authorizing `identity:get_project(project_id=54b670013f414f3b8b2e813c834ae8cd)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:28.628071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff55c03-3ecd-469e-a415-5d158b3d8d6c tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:28.631946 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3117/6220] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 10:10:28 2022] GET /identity/v3/projects/54b670013f414f3b8b2e813c834ae8cd => generated 363 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:10:28.632765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff55c03-3ecd-469e-a415-5d158b3d8d6c tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:28.634401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072f706-7680-4b40-b257-deec944f14b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:28.634542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1ff55c03-3ecd-469e-a415-5d158b3d8d6c tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:28.635293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072f706-7680-4b40-b257-deec944f14b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:28.637378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072f706-7680-4b40-b257-deec944f14b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:28.639503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072f706-7680-4b40-b257-deec944f14b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:28.640400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072f706-7680-4b40-b257-deec944f14b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:28.645192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072f706-7680-4b40-b257-deec944f14b1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:28.716964 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3104/6221] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:10:28 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:28.718203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072f706-7680-4b40-b257-deec944f14b1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:28.857556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072f706-7680-4b40-b257-deec944f14b1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:28.869865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff55c03-3ecd-469e-a415-5d158b3d8d6c tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:28.874435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbfe2d-ffb0-474a-96e2-1e12859b2c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:28.875190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbfe2d-ffb0-474a-96e2-1e12859b2c95 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:28.875912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbfe2d-ffb0-474a-96e2-1e12859b2c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:28.876249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbfe2d-ffb0-474a-96e2-1e12859b2c95 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:28.877793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fbfe2d-ffb0-474a-96e2-1e12859b2c95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:28.880357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fbfe2d-ffb0-474a-96e2-1e12859b2c95 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:28.956062 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3105/6222] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:10:28 2022] POST /identity/v3/users => generated 294 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:28.960042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbfe2d-ffb0-474a-96e2-1e12859b2c95 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:28.982687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbfe2d-ffb0-474a-96e2-1e12859b2c95 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:28.993426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51d1b0-8e43-4fdc-bbba-e99131b312fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:28.995551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51d1b0-8e43-4fdc-bbba-e99131b312fe admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:28.995844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51d1b0-8e43-4fdc-bbba-e99131b312fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:28.996119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51d1b0-8e43-4fdc-bbba-e99131b312fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:28.996812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51d1b0-8e43-4fdc-bbba-e99131b312fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:28.998457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51d1b0-8e43-4fdc-bbba-e99131b312fe admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:29.026173 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3106/6223] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:29.030601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51d1b0-8e43-4fdc-bbba-e99131b312fe admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:29.064431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51d1b0-8e43-4fdc-bbba-e99131b312fe admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:29.078776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b21d9c-7bae-4688-a7e9-6bc368f1ed63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:29.082124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991a4b1-eef8-402e-8608-5e37c73ba247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:29.083568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991a4b1-eef8-402e-8608-5e37c73ba247 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:29.085296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991a4b1-eef8-402e-8608-5e37c73ba247 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:29.085662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991a4b1-eef8-402e-8608-5e37c73ba247 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:29.086400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991a4b1-eef8-402e-8608-5e37c73ba247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:29.091150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991a4b1-eef8-402e-8608-5e37c73ba247 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:29.091389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b21d9c-7bae-4688-a7e9-6bc368f1ed63 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:29.091782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b21d9c-7bae-4688-a7e9-6bc368f1ed63 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:29.092062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b21d9c-7bae-4688-a7e9-6bc368f1ed63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:29.120780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b21d9c-7bae-4688-a7e9-6bc368f1ed63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:29.124147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b21d9c-7bae-4688-a7e9-6bc368f1ed63 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:29.133177 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3107/6224] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:10:29.133177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45758f8-7bc3-49f7-be09-1ecfb95c9383 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:29.133177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45758f8-7bc3-49f7-be09-1ecfb95c9383 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:29.133177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45758f8-7bc3-49f7-be09-1ecfb95c9383 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:29.134143 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3108/6225] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 10:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 10:10:29.134927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45758f8-7bc3-49f7-be09-1ecfb95c9383 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:29.153772 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3118/6226] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:29.154459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b21d9c-7bae-4688-a7e9-6bc368f1ed63 service neutron] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 10:10:29.161664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-09b21d9c-7bae-4688-a7e9-6bc368f1ed63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:29.187019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45758f8-7bc3-49f7-be09-1ecfb95c9383 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:29.231250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84767b98-5090-496a-bbd1-52bcaee301cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:29.233532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84767b98-5090-496a-bbd1-52bcaee301cc admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:29.234358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84767b98-5090-496a-bbd1-52bcaee301cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:29.235237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84767b98-5090-496a-bbd1-52bcaee301cc admin admin] PATH_INFO: `/v3/projects/4d970f8f783942ae97c47c5bf60fa631/users/5e1032cb649e452fb1a2f68c605b743a/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:29.269123 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:29.277501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84767b98-5090-496a-bbd1-52bcaee301cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d970f8f783942ae97c47c5bf60fa631, user_id=5e1032cb649e452fb1a2f68c605b743a, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:29.284016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84767b98-5090-496a-bbd1-52bcaee301cc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:29.301404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b21d9c-7bae-4688-a7e9-6bc368f1ed63 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:29.302923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-09b21d9c-7bae-4688-a7e9-6bc368f1ed63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:29.329602 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3109/6227] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:29 2022] PUT /identity/v3/projects/4d970f8f783942ae97c47c5bf60fa631/users/5e1032cb649e452fb1a2f68c605b743a/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:29.341527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e81ab5-8975-4772-a505-f3cf15ae4b03 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:29.341820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e81ab5-8975-4772-a505-f3cf15ae4b03 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:29.342098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e81ab5-8975-4772-a505-f3cf15ae4b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:29.370988 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:29.411398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a9e81ab5-8975-4772-a505-f3cf15ae4b03 None None] MFA Rules not processed for user `5e1032cb649e452fb1a2f68c605b743a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:29.412803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a9e81ab5-8975-4772-a505-f3cf15ae4b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:29.464712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b21d9c-7bae-4688-a7e9-6bc368f1ed63 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:29.591279 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3110/6228] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:29.592360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e81ab5-8975-4772-a505-f3cf15ae4b03 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:29.613148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81725e67-506b-4c76-afde-19e12fd3671d tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '893b6b199a214c309117f5dd58ed4f11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54b670013f414f3b8b2e813c834ae8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:29.614775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81725e67-506b-4c76-afde-19e12fd3671d tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:29.615128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81725e67-506b-4c76-afde-19e12fd3671d tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:29.619242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81725e67-506b-4c76-afde-19e12fd3671d tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] PATH_INFO: `/v3/projects/54b670013f414f3b8b2e813c834ae8cd` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:29.620880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81725e67-506b-4c76-afde-19e12fd3671d tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] RBAC: Authorizing `identity:get_project(project_id=54b670013f414f3b8b2e813c834ae8cd)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:29.629954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81725e67-506b-4c76-afde-19e12fd3671d tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:29.641091 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3119/6229] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 10:10:29 2022] GET /identity/v3/projects/54b670013f414f3b8b2e813c834ae8cd => generated 363 bytes in 487 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:10:29.695105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bff465-7ca0-468b-9153-ed42924745fb None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:29.695387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bff465-7ca0-468b-9153-ed42924745fb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:29.695656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bff465-7ca0-468b-9153-ed42924745fb None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:29.697228 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3120/6230] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 10:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 10:10:29.707966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bff465-7ca0-468b-9153-ed42924745fb None None] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 10:10:29.710700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-99bff465-7ca0-468b-9153-ed42924745fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:29.824634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e81ab5-8975-4772-a505-f3cf15ae4b03 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:29.839865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd234984-bb47-4cd1-8dfb-c82a962105da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:29.841190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd234984-bb47-4cd1-8dfb-c82a962105da admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:29.842260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd234984-bb47-4cd1-8dfb-c82a962105da admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:29.842607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd234984-bb47-4cd1-8dfb-c82a962105da admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:29.843589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd234984-bb47-4cd1-8dfb-c82a962105da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:29.846804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd234984-bb47-4cd1-8dfb-c82a962105da admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:29.898075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bff465-7ca0-468b-9153-ed42924745fb None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:29.916109 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3111/6231] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:10:29 2022] POST /identity/v3/projects => generated 387 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:29.919352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd234984-bb47-4cd1-8dfb-c82a962105da admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:29.949825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bff465-7ca0-468b-9153-ed42924745fb None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:30.052168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd234984-bb47-4cd1-8dfb-c82a962105da admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:30.079848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e9a77-acfd-4f27-85ca-ba50982b1cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:30.080586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e9a77-acfd-4f27-85ca-ba50982b1cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:30.081149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e9a77-acfd-4f27-85ca-ba50982b1cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:30.086980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e9a77-acfd-4f27-85ca-ba50982b1cb3 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:30.087671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e9a77-acfd-4f27-85ca-ba50982b1cb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:30.090405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e9a77-acfd-4f27-85ca-ba50982b1cb3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:30.110704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e0f9b-eeaa-4f62-964f-9ff3342126a1 tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '893b6b199a214c309117f5dd58ed4f11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54b670013f414f3b8b2e813c834ae8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:30.111713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e0f9b-eeaa-4f62-964f-9ff3342126a1 tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:30.112276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e0f9b-eeaa-4f62-964f-9ff3342126a1 tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:30.113032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e0f9b-eeaa-4f62-964f-9ff3342126a1 tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] PATH_INFO: `/v3/projects/54b670013f414f3b8b2e813c834ae8cd` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:30.114144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e0f9b-eeaa-4f62-964f-9ff3342126a1 tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] RBAC: Authorizing `identity:get_project(project_id=54b670013f414f3b8b2e813c834ae8cd)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:30.119927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e0f9b-eeaa-4f62-964f-9ff3342126a1 tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:30.129537 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:30.136168 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3121/6232] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 10:10:29 2022] GET /identity/v3/projects/54b670013f414f3b8b2e813c834ae8cd => generated 363 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:10:30.171052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e0f9b-eeaa-4f62-964f-9ff3342126a1 tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:30.179781 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3112/6233] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:10:29 2022] POST /identity/v3/users => generated 300 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:30.193946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e0f9b-eeaa-4f62-964f-9ff3342126a1 tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:30.206554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edc0e7-0c80-4396-9df9-6f0a4da6aeaa None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:30.206899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edc0e7-0c80-4396-9df9-6f0a4da6aeaa None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:30.207214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edc0e7-0c80-4396-9df9-6f0a4da6aeaa None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:30.208857 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3113/6234] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 10:10:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 10:10:30.215308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90edc0e7-0c80-4396-9df9-6f0a4da6aeaa None None] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 10:10:30.223828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c7d60-31e8-4dfb-b6fd-3f9542044c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:30.224483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c7d60-31e8-4dfb-b6fd-3f9542044c8a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:30.224865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c7d60-31e8-4dfb-b6fd-3f9542044c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:30.225284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c7d60-31e8-4dfb-b6fd-3f9542044c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:30.226068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c7d60-31e8-4dfb-b6fd-3f9542044c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:30.228901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c7d60-31e8-4dfb-b6fd-3f9542044c8a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:30.243730 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3122/6235] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:10:30.246891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c7d60-31e8-4dfb-b6fd-3f9542044c8a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:30.267958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c7d60-31e8-4dfb-b6fd-3f9542044c8a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:30.294498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22423143-8bb1-42aa-acb1-25cf4094b9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:30.295805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22423143-8bb1-42aa-acb1-25cf4094b9d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:30.296351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22423143-8bb1-42aa-acb1-25cf4094b9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:30.296886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22423143-8bb1-42aa-acb1-25cf4094b9d5 admin admin] PATH_INFO: `/v3/projects/4a503a4f4fb94021b51d2ccc62cf3bf5/users/9b43dacc77e6482fb11cb3401f60a23b/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:30.325229 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:30.328808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22423143-8bb1-42aa-acb1-25cf4094b9d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a503a4f4fb94021b51d2ccc62cf3bf5, user_id=9b43dacc77e6482fb11cb3401f60a23b, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:30.332624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22423143-8bb1-42aa-acb1-25cf4094b9d5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:30.369794 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3123/6236] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:30 2022] PUT /identity/v3/projects/4a503a4f4fb94021b51d2ccc62cf3bf5/users/9b43dacc77e6482fb11cb3401f60a23b/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:30.374967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90edc0e7-0c80-4396-9df9-6f0a4da6aeaa None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:30.375820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22423143-8bb1-42aa-acb1-25cf4094b9d5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:30.409606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90edc0e7-0c80-4396-9df9-6f0a4da6aeaa None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:30.571211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514623b1-cc9f-455a-a4ab-3869670d072c tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '893b6b199a214c309117f5dd58ed4f11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54b670013f414f3b8b2e813c834ae8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:30.577175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514623b1-cc9f-455a-a4ab-3869670d072c tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:30.577467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514623b1-cc9f-455a-a4ab-3869670d072c tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:30.579068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514623b1-cc9f-455a-a4ab-3869670d072c tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] PATH_INFO: `/v3/projects/54b670013f414f3b8b2e813c834ae8cd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:30.580038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514623b1-cc9f-455a-a4ab-3869670d072c tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] RBAC: Authorizing `identity:get_project(project_id=54b670013f414f3b8b2e813c834ae8cd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:30.582137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514623b1-cc9f-455a-a4ab-3869670d072c tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:30.587224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22423143-8bb1-42aa-acb1-25cf4094b9d5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:30.592100 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3114/6237] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 10:10:30 2022] GET /identity/v3/projects/54b670013f414f3b8b2e813c834ae8cd => generated 363 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:10:30.618738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416a0ee-c145-488d-8197-25dba4d51517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:30.627955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416a0ee-c145-488d-8197-25dba4d51517 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:30.630751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416a0ee-c145-488d-8197-25dba4d51517 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:30.631043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416a0ee-c145-488d-8197-25dba4d51517 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:30.631722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416a0ee-c145-488d-8197-25dba4d51517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:30.642747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416a0ee-c145-488d-8197-25dba4d51517 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:30.678864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514623b1-cc9f-455a-a4ab-3869670d072c tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:30.681794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-514623b1-cc9f-455a-a4ab-3869670d072c tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:30.689755 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3124/6238] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:30.699201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416a0ee-c145-488d-8197-25dba4d51517 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:30.709484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514623b1-cc9f-455a-a4ab-3869670d072c tempest-QuotasTestJSON-655853906 tempest-QuotasTestJSON-655853906-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:30.723696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55a301-3eff-486f-bf60-ca35d726169e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:30.724548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55a301-3eff-486f-bf60-ca35d726169e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:30.725125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55a301-3eff-486f-bf60-ca35d726169e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:30.725544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55a301-3eff-486f-bf60-ca35d726169e admin admin] PATH_INFO: `/v3/users/893b6b199a214c309117f5dd58ed4f11` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:30.728309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55a301-3eff-486f-bf60-ca35d726169e admin admin] RBAC: Authorizing `identity:delete_user(user_id=893b6b199a214c309117f5dd58ed4f11)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:30.735073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55a301-3eff-486f-bf60-ca35d726169e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:30.740424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416a0ee-c145-488d-8197-25dba4d51517 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:30.746976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d051c-8940-4e63-9f74-9003bf047f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:30.747898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d051c-8940-4e63-9f74-9003bf047f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:30.748304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d051c-8940-4e63-9f74-9003bf047f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:30.748966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d051c-8940-4e63-9f74-9003bf047f76 admin admin] PATH_INFO: `/v3/projects/4a503a4f4fb94021b51d2ccc62cf3bf5/users/9b43dacc77e6482fb11cb3401f60a23b/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:30.751317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d051c-8940-4e63-9f74-9003bf047f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a503a4f4fb94021b51d2ccc62cf3bf5, user_id=9b43dacc77e6482fb11cb3401f60a23b, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:30.754559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d051c-8940-4e63-9f74-9003bf047f76 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:30.790673 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3125/6239] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:30 2022] PUT /identity/v3/projects/4a503a4f4fb94021b51d2ccc62cf3bf5/users/9b43dacc77e6482fb11cb3401f60a23b/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:30.806963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589cdbf-02ff-493c-b560-2916df36d185 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:30.812866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589cdbf-02ff-493c-b560-2916df36d185 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:30.813513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589cdbf-02ff-493c-b560-2916df36d185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:30.874996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b55a301-3eff-486f-bf60-ca35d726169e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '893b6b199a214c309117f5dd58ed4f11'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:30.878834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5589cdbf-02ff-493c-b560-2916df36d185 None None] MFA Rules not processed for user `9b43dacc77e6482fb11cb3401f60a23b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:30.880711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5589cdbf-02ff-493c-b560-2916df36d185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:30.894911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b55a301-3eff-486f-bf60-ca35d726169e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '893b6b199a214c309117f5dd58ed4f11'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:30.896390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b55a301-3eff-486f-bf60-ca35d726169e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '893b6b199a214c309117f5dd58ed4f11'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:30.950748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b55a301-3eff-486f-bf60-ca35d726169e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '893b6b199a214c309117f5dd58ed4f11'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:30.972307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b55a301-3eff-486f-bf60-ca35d726169e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '893b6b199a214c309117f5dd58ed4f11'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:30.994591 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3115/6240] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:10:30 2022] DELETE /identity/v3/users/893b6b199a214c309117f5dd58ed4f11 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:30.996493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18ac06-da0a-4064-a219-984bcf4cab66 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:30.997091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18ac06-da0a-4064-a219-984bcf4cab66 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:30.997515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18ac06-da0a-4064-a219-984bcf4cab66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:31.049242 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:31.056334 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3126/6241] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:31.057317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589cdbf-02ff-493c-b560-2916df36d185 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:31.059302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5589cdbf-02ff-493c-b560-2916df36d185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:31.070587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1d18ac06-da0a-4064-a219-984bcf4cab66 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:31.075906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1d18ac06-da0a-4064-a219-984bcf4cab66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:31.196145 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3116/6242] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:31.198936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18ac06-da0a-4064-a219-984bcf4cab66 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:31.201017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1d18ac06-da0a-4064-a219-984bcf4cab66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:31.208770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589cdbf-02ff-493c-b560-2916df36d185 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:31.214277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f3718-dbcd-4ab7-9d31-0464b0a4e21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:31.216088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f3718-dbcd-4ab7-9d31-0464b0a4e21e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:31.216471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f3718-dbcd-4ab7-9d31-0464b0a4e21e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:31.217012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f3718-dbcd-4ab7-9d31-0464b0a4e21e admin admin] PATH_INFO: `/v3/projects/92f6663764b44884994674b4dc0b9eb7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:31.218528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f3718-dbcd-4ab7-9d31-0464b0a4e21e admin admin] RBAC: Authorizing `identity:delete_project(project_id=92f6663764b44884994674b4dc0b9eb7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:31.221216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f3718-dbcd-4ab7-9d31-0464b0a4e21e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:31.223166 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:31.309582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e26f3718-dbcd-4ab7-9d31-0464b0a4e21e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92f6663764b44884994674b4dc0b9eb7', 'request_id': 'req-e26f3718-dbcd-4ab7-9d31-0464b0a4e21e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:31.315665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18ac06-da0a-4064-a219-984bcf4cab66 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:31.323453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e26f3718-dbcd-4ab7-9d31-0464b0a4e21e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92f6663764b44884994674b4dc0b9eb7', 'request_id': 'req-e26f3718-dbcd-4ab7-9d31-0464b0a4e21e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:31.345531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e26f3718-dbcd-4ab7-9d31-0464b0a4e21e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92f6663764b44884994674b4dc0b9eb7', 'request_id': 'req-e26f3718-dbcd-4ab7-9d31-0464b0a4e21e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:31.374182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e26f3718-dbcd-4ab7-9d31-0464b0a4e21e admin admin] The token cache is being invalidate because project 92f6663764b44884994674b4dc0b9eb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:10:31.376686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e26f3718-dbcd-4ab7-9d31-0464b0a4e21e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:31.381447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e26f3718-dbcd-4ab7-9d31-0464b0a4e21e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:31.389572 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3127/6243] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:10:31 2022] DELETE /identity/v3/projects/92f6663764b44884994674b4dc0b9eb7 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:31.389572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f3718-dbcd-4ab7-9d31-0464b0a4e21e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:31.390455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e26f3718-dbcd-4ab7-9d31-0464b0a4e21e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:31.391984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5650b-99c7-46bb-8575-d6169cf4bc8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:31.392758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5650b-99c7-46bb-8575-d6169cf4bc8b service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:31.393201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5650b-99c7-46bb-8575-d6169cf4bc8b service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:31.393479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5650b-99c7-46bb-8575-d6169cf4bc8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:31.395461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4fd5650b-99c7-46bb-8575-d6169cf4bc8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:31.476050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f3718-dbcd-4ab7-9d31-0464b0a4e21e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:31.480285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca96bf1-43c0-4c18-ab99-848cfae4be0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:31.481161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca96bf1-43c0-4c18-ab99-848cfae4be0b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:31.481595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca96bf1-43c0-4c18-ab99-848cfae4be0b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:31.482184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca96bf1-43c0-4c18-ab99-848cfae4be0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:31.484460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9ca96bf1-43c0-4c18-ab99-848cfae4be0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:31.525093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5650b-99c7-46bb-8575-d6169cf4bc8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:31.527118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5650b-99c7-46bb-8575-d6169cf4bc8b service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:31.546372 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3117/6244] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:31.548383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c3198-628f-4041-8912-c263b0a1565f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:31.548625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c3198-628f-4041-8912-c263b0a1565f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:31.548907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c3198-628f-4041-8912-c263b0a1565f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:31.578987 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:31.616921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-428c3198-628f-4041-8912-c263b0a1565f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:31.620099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-428c3198-628f-4041-8912-c263b0a1565f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:31.707157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca96bf1-43c0-4c18-ab99-848cfae4be0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:31.710121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca96bf1-43c0-4c18-ab99-848cfae4be0b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:31.729095 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3128/6245] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:31.794141 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3118/6246] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:31.801756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c1d44-ce2e-40d9-876e-69006a6b5822 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:31.802225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c1d44-ce2e-40d9-876e-69006a6b5822 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:31.802644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c1d44-ce2e-40d9-876e-69006a6b5822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:31.864344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-696c1d44-ce2e-40d9-876e-69006a6b5822 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:31.865619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-696c1d44-ce2e-40d9-876e-69006a6b5822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:31.889718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c3198-628f-4041-8912-c263b0a1565f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:31.891285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-428c3198-628f-4041-8912-c263b0a1565f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:31.910357 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3129/6247] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:31.918002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c1d44-ce2e-40d9-876e-69006a6b5822 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:31.929417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c3198-628f-4041-8912-c263b0a1565f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:31.942040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b34d9e-3ab3-4379-a5fa-75d7cdedfc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:31.942725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b34d9e-3ab3-4379-a5fa-75d7cdedfc56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:31.943658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b34d9e-3ab3-4379-a5fa-75d7cdedfc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:31.944100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b34d9e-3ab3-4379-a5fa-75d7cdedfc56 admin admin] PATH_INFO: `/v3/users/5e1032cb649e452fb1a2f68c605b743a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:31.944240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c1d44-ce2e-40d9-876e-69006a6b5822 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:31.946044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b34d9e-3ab3-4379-a5fa-75d7cdedfc56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e1032cb649e452fb1a2f68c605b743a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:31.949301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b34d9e-3ab3-4379-a5fa-75d7cdedfc56 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:31.959025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13578901-3d8e-4bf4-aeef-e265c5d27b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:31.960070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13578901-3d8e-4bf4-aeef-e265c5d27b78 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:31.961010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13578901-3d8e-4bf4-aeef-e265c5d27b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:31.962274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13578901-3d8e-4bf4-aeef-e265c5d27b78 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:31.963110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13578901-3d8e-4bf4-aeef-e265c5d27b78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:10:31.965265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13578901-3d8e-4bf4-aeef-e265c5d27b78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:31.970126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13578901-3d8e-4bf4-aeef-e265c5d27b78 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:32.006595 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3130/6248] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:10:32.021654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13578901-3d8e-4bf4-aeef-e265c5d27b78 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:32.049737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13578901-3d8e-4bf4-aeef-e265c5d27b78 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:32.065384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba30d0-7848-48db-9a5d-bccadc84e0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:32.065994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba30d0-7848-48db-9a5d-bccadc84e0bb admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:32.066371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba30d0-7848-48db-9a5d-bccadc84e0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:32.066649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba30d0-7848-48db-9a5d-bccadc84e0bb admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:32.067286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba30d0-7848-48db-9a5d-bccadc84e0bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:32.069397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba30d0-7848-48db-9a5d-bccadc84e0bb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:32.076097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50b34d9e-3ab3-4379-a5fa-75d7cdedfc56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e1032cb649e452fb1a2f68c605b743a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:32.095928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50b34d9e-3ab3-4379-a5fa-75d7cdedfc56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e1032cb649e452fb1a2f68c605b743a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:32.096734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50b34d9e-3ab3-4379-a5fa-75d7cdedfc56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e1032cb649e452fb1a2f68c605b743a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:32.099243 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:32.122087 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3131/6249] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:10:32 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:32.123222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba30d0-7848-48db-9a5d-bccadc84e0bb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:32.137540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50b34d9e-3ab3-4379-a5fa-75d7cdedfc56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e1032cb649e452fb1a2f68c605b743a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:32.159116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50b34d9e-3ab3-4379-a5fa-75d7cdedfc56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e1032cb649e452fb1a2f68c605b743a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:32.179474 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3119/6250] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:10:31 2022] DELETE /identity/v3/users/5e1032cb649e452fb1a2f68c605b743a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:10:32.184273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d72cb-338c-418e-b6e8-0d0b28258c16 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:32.184629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d72cb-338c-418e-b6e8-0d0b28258c16 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:32.184915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d72cb-338c-418e-b6e8-0d0b28258c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:32.244670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4e6d72cb-338c-418e-b6e8-0d0b28258c16 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:32.248323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4e6d72cb-338c-418e-b6e8-0d0b28258c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:32.293687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba30d0-7848-48db-9a5d-bccadc84e0bb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:32.409131 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3120/6251] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:32.447065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f127e-78be-4664-9bf5-f48c5111830b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:32.447757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f127e-78be-4664-9bf5-f48c5111830b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:32.448298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f127e-78be-4664-9bf5-f48c5111830b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:32.449764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f127e-78be-4664-9bf5-f48c5111830b admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:32.450695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f127e-78be-4664-9bf5-f48c5111830b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:32.453291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f127e-78be-4664-9bf5-f48c5111830b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:32.486039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d72cb-338c-418e-b6e8-0d0b28258c16 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:32.488457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4e6d72cb-338c-418e-b6e8-0d0b28258c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:32.511632 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3132/6252] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:10:32 2022] POST /identity/v3/users => generated 285 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:32.514782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f127e-78be-4664-9bf5-f48c5111830b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:32.524552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-202f127e-78be-4664-9bf5-f48c5111830b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:32.583629 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:32.616280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f127e-78be-4664-9bf5-f48c5111830b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:32.642839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eda30-5ab1-4ade-a3ed-0da50ff53651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:32.648565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eda30-5ab1-4ade-a3ed-0da50ff53651 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:32.649901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eda30-5ab1-4ade-a3ed-0da50ff53651 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:32.650207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eda30-5ab1-4ade-a3ed-0da50ff53651 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:32.650881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5eda30-5ab1-4ade-a3ed-0da50ff53651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:32.665614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5eda30-5ab1-4ade-a3ed-0da50ff53651 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:32.708667 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3133/6253] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:32.711330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eda30-5ab1-4ade-a3ed-0da50ff53651 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:32.735595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d72cb-338c-418e-b6e8-0d0b28258c16 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:32.747092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eda30-5ab1-4ade-a3ed-0da50ff53651 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:32.755181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fd422-b1e5-4afb-97ac-b6a7573764cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:32.755807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fd422-b1e5-4afb-97ac-b6a7573764cb service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:32.756279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fd422-b1e5-4afb-97ac-b6a7573764cb service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:32.756770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fd422-b1e5-4afb-97ac-b6a7573764cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:32.781214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65c1a3-831e-4589-8d71-4a88df20b5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:32.782627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fd422-b1e5-4afb-97ac-b6a7573764cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:32.782998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65c1a3-831e-4589-8d71-4a88df20b5db admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:32.783467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65c1a3-831e-4589-8d71-4a88df20b5db admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:32.783901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65c1a3-831e-4589-8d71-4a88df20b5db admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:32.785741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fd422-b1e5-4afb-97ac-b6a7573764cb service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:32.786166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65c1a3-831e-4589-8d71-4a88df20b5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:32.790114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65c1a3-831e-4589-8d71-4a88df20b5db admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:32.804659 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3121/6254] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:32.826404 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3134/6255] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:32.828552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fd422-b1e5-4afb-97ac-b6a7573764cb service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:32.849818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fd422-b1e5-4afb-97ac-b6a7573764cb service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:32.861819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b3f1c-5fa5-45ae-abc4-8177af94ed99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:32.864023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b3f1c-5fa5-45ae-abc4-8177af94ed99 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:32.883244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b3f1c-5fa5-45ae-abc4-8177af94ed99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:32.883758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b3f1c-5fa5-45ae-abc4-8177af94ed99 admin admin] PATH_INFO: `/v3/projects/6e9948c41ff84e748bc366ea1c74701d/users/09b9183775e741d3bf634ae9c6178ccc/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:32.950366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b3f1c-5fa5-45ae-abc4-8177af94ed99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9948c41ff84e748bc366ea1c74701d, user_id=09b9183775e741d3bf634ae9c6178ccc, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:32.978417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b3f1c-5fa5-45ae-abc4-8177af94ed99 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:33.056693 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3122/6256] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:32 2022] PUT /identity/v3/projects/6e9948c41ff84e748bc366ea1c74701d/users/09b9183775e741d3bf634ae9c6178ccc/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:33.067310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99577483-ffe3-4aa5-af5f-aac4b6fd220f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:33.068290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99577483-ffe3-4aa5-af5f-aac4b6fd220f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:33.068786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99577483-ffe3-4aa5-af5f-aac4b6fd220f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:33.156021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-99577483-ffe3-4aa5-af5f-aac4b6fd220f None None] MFA Rules not processed for user `09b9183775e741d3bf634ae9c6178ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:33.160826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-99577483-ffe3-4aa5-af5f-aac4b6fd220f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:33.317539 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:33.348500 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3135/6257] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:33.353318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b3f1c-5fa5-45ae-abc4-8177af94ed99 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:33.533576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99577483-ffe3-4aa5-af5f-aac4b6fd220f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:33.535543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-99577483-ffe3-4aa5-af5f-aac4b6fd220f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:33.566053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99577483-ffe3-4aa5-af5f-aac4b6fd220f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:33.578637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdd404-1d46-4c8d-b899-5d75a900c960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:33.579287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdd404-1d46-4c8d-b899-5d75a900c960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:33.579561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdd404-1d46-4c8d-b899-5d75a900c960 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:33.580016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdd404-1d46-4c8d-b899-5d75a900c960 admin admin] PATH_INFO: `/v3/projects/54b670013f414f3b8b2e813c834ae8cd` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:33.582998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b3f1c-5fa5-45ae-abc4-8177af94ed99 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:33.589173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbdd404-1d46-4c8d-b899-5d75a900c960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54b670013f414f3b8b2e813c834ae8cd)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:33.591291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbdd404-1d46-4c8d-b899-5d75a900c960 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:33.617014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710483b2-223e-451c-b54d-530f8fc4be1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:33.625535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710483b2-223e-451c-b54d-530f8fc4be1a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:33.626640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710483b2-223e-451c-b54d-530f8fc4be1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:33.627162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710483b2-223e-451c-b54d-530f8fc4be1a admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:33.631078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710483b2-223e-451c-b54d-530f8fc4be1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:33.634753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710483b2-223e-451c-b54d-530f8fc4be1a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:33.717868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1cbdd404-1d46-4c8d-b899-5d75a900c960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54b670013f414f3b8b2e813c834ae8cd', 'request_id': 'req-1cbdd404-1d46-4c8d-b899-5d75a900c960'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:33.721762 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3123/6258] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:10:33 2022] POST /identity/v3/projects => generated 369 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:33.723138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710483b2-223e-451c-b54d-530f8fc4be1a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:33.735074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1cbdd404-1d46-4c8d-b899-5d75a900c960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54b670013f414f3b8b2e813c834ae8cd', 'request_id': 'req-1cbdd404-1d46-4c8d-b899-5d75a900c960'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:33.746590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1cbdd404-1d46-4c8d-b899-5d75a900c960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54b670013f414f3b8b2e813c834ae8cd', 'request_id': 'req-1cbdd404-1d46-4c8d-b899-5d75a900c960'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:33.776801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1cbdd404-1d46-4c8d-b899-5d75a900c960 admin admin] The token cache is being invalidate because project 54b670013f414f3b8b2e813c834ae8cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:10:33.777628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1cbdd404-1d46-4c8d-b899-5d75a900c960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:33.778024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1cbdd404-1d46-4c8d-b899-5d75a900c960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:33.779972 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3136/6259] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:10:33 2022] DELETE /identity/v3/projects/54b670013f414f3b8b2e813c834ae8cd => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:33.786288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6514daf-e7e3-4412-8aab-fa4a31d937fa None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:33.786647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6514daf-e7e3-4412-8aab-fa4a31d937fa None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:33.787019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6514daf-e7e3-4412-8aab-fa4a31d937fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:33.812808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e6514daf-e7e3-4412-8aab-fa4a31d937fa None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:33.813968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e6514daf-e7e3-4412-8aab-fa4a31d937fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:33.905630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710483b2-223e-451c-b54d-530f8fc4be1a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:33.917768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957483c-ea86-41c1-ac1f-c52cf9ac99ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:33.918538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957483c-ea86-41c1-ac1f-c52cf9ac99ec admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:33.918786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957483c-ea86-41c1-ac1f-c52cf9ac99ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:33.919093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957483c-ea86-41c1-ac1f-c52cf9ac99ec admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:33.920816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957483c-ea86-41c1-ac1f-c52cf9ac99ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:33.941872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957483c-ea86-41c1-ac1f-c52cf9ac99ec admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:33.986988 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3137/6260] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:33.988763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7f1e2-0693-451d-a70b-39317ce5d5a7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:33.989057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7f1e2-0693-451d-a70b-39317ce5d5a7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:33.989373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7f1e2-0693-451d-a70b-39317ce5d5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:33.991541 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:34.024513 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3124/6261] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:10:33 2022] POST /identity/v3/users => generated 291 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:34.039662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957483c-ea86-41c1-ac1f-c52cf9ac99ec admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:34.045775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0957483c-ea86-41c1-ac1f-c52cf9ac99ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:34.086863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957483c-ea86-41c1-ac1f-c52cf9ac99ec admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:34.087001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e4b7f1e2-0693-451d-a70b-39317ce5d5a7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:34.088365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e4b7f1e2-0693-451d-a70b-39317ce5d5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:34.094928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9270c-5958-497e-8099-1681ad45bbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:34.095804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9270c-5958-497e-8099-1681ad45bbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:34.096935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9270c-5958-497e-8099-1681ad45bbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:34.098630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9270c-5958-497e-8099-1681ad45bbe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:34.099465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9270c-5958-497e-8099-1681ad45bbe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:34.101827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9270c-5958-497e-8099-1681ad45bbe2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:34.121436 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3138/6262] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:34.121436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9bd85-7c47-4e9f-b970-075296d31e4b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:34.121436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9bd85-7c47-4e9f-b970-075296d31e4b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:34.121436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9bd85-7c47-4e9f-b970-075296d31e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:34.138685 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3125/6263] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:34.139832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9270c-5958-497e-8099-1681ad45bbe2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:34.155349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-99b9bd85-7c47-4e9f-b970-075296d31e4b None None] MFA Rules not processed for user `40cea8ffee0e48aba3f0ce206768d1ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:34.157707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-99b9bd85-7c47-4e9f-b970-075296d31e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:34.161781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9270c-5958-497e-8099-1681ad45bbe2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:34.173882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302516a-d4c2-48ac-a0a2-e9f2615173b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:34.174627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302516a-d4c2-48ac-a0a2-e9f2615173b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:34.175751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302516a-d4c2-48ac-a0a2-e9f2615173b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:34.175972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302516a-d4c2-48ac-a0a2-e9f2615173b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:34.176699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302516a-d4c2-48ac-a0a2-e9f2615173b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:10:34.177043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302516a-d4c2-48ac-a0a2-e9f2615173b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:34.178603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302516a-d4c2-48ac-a0a2-e9f2615173b0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:34.211904 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3126/6264] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:10:34.212901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302516a-d4c2-48ac-a0a2-e9f2615173b0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:34.240712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302516a-d4c2-48ac-a0a2-e9f2615173b0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:34.264896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f55e1b-383f-49fa-9881-148eba9241b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:34.266077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f55e1b-383f-49fa-9881-148eba9241b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:34.266361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f55e1b-383f-49fa-9881-148eba9241b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:34.266631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f55e1b-383f-49fa-9881-148eba9241b6 admin admin] PATH_INFO: `/v3/projects/ed35999b8793411f87ef800b31ed13c4/users/5ecef553d39b44b1bd0a29081447f0e5/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:34.308825 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3139/6265] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:34.308825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9bd85-7c47-4e9f-b970-075296d31e4b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:34.320399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f55e1b-383f-49fa-9881-148eba9241b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed35999b8793411f87ef800b31ed13c4, user_id=5ecef553d39b44b1bd0a29081447f0e5, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:34.325041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f55e1b-383f-49fa-9881-148eba9241b6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:34.334207 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:34.347774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9bd85-7c47-4e9f-b970-075296d31e4b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:34.369655 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3127/6266] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:34 2022] PUT /identity/v3/projects/ed35999b8793411f87ef800b31ed13c4/users/5ecef553d39b44b1bd0a29081447f0e5/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:34.370797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f55e1b-383f-49fa-9881-148eba9241b6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:34.378015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-37f55e1b-383f-49fa-9881-148eba9241b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:34.442767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1397041-1a7a-4a7d-8dcb-fb2093514358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:34.443605 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1397041-1a7a-4a7d-8dcb-fb2093514358 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:34.443964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1397041-1a7a-4a7d-8dcb-fb2093514358 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:34.444305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1397041-1a7a-4a7d-8dcb-fb2093514358 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:34.445148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1397041-1a7a-4a7d-8dcb-fb2093514358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:34.447981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1397041-1a7a-4a7d-8dcb-fb2093514358 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:34.500556 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3140/6267] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:10:34 2022] POST /identity/v3/projects => generated 389 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:34.502144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1397041-1a7a-4a7d-8dcb-fb2093514358 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:34.527275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f55e1b-383f-49fa-9881-148eba9241b6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:34.634718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd5fe3-fdc5-4fc0-99bd-06e0b1093326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:34.636168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd5fe3-fdc5-4fc0-99bd-06e0b1093326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:34.636925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd5fe3-fdc5-4fc0-99bd-06e0b1093326 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:34.637569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd5fe3-fdc5-4fc0-99bd-06e0b1093326 admin admin] PATH_INFO: `/v3/projects/4d970f8f783942ae97c47c5bf60fa631` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:34.638979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd5fe3-fdc5-4fc0-99bd-06e0b1093326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d970f8f783942ae97c47c5bf60fa631)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:34.641307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd5fe3-fdc5-4fc0-99bd-06e0b1093326 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:34.643265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1397041-1a7a-4a7d-8dcb-fb2093514358 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:34.662728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900b530-c5fe-44aa-8947-5f388fc7e038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:34.664141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900b530-c5fe-44aa-8947-5f388fc7e038 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:34.666099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900b530-c5fe-44aa-8947-5f388fc7e038 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:34.667569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900b530-c5fe-44aa-8947-5f388fc7e038 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:34.671793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900b530-c5fe-44aa-8947-5f388fc7e038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:34.675356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900b530-c5fe-44aa-8947-5f388fc7e038 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:34.707768 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3141/6268] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:34.708312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93dd5fe3-fdc5-4fc0-99bd-06e0b1093326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d970f8f783942ae97c47c5bf60fa631', 'request_id': 'req-93dd5fe3-fdc5-4fc0-99bd-06e0b1093326'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:34.708876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900b530-c5fe-44aa-8947-5f388fc7e038 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:34.712861 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:34.724928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93dd5fe3-fdc5-4fc0-99bd-06e0b1093326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d970f8f783942ae97c47c5bf60fa631', 'request_id': 'req-93dd5fe3-fdc5-4fc0-99bd-06e0b1093326'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:34.734976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900b530-c5fe-44aa-8947-5f388fc7e038 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:34.735384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93dd5fe3-fdc5-4fc0-99bd-06e0b1093326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d970f8f783942ae97c47c5bf60fa631', 'request_id': 'req-93dd5fe3-fdc5-4fc0-99bd-06e0b1093326'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:34.757414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93dd5fe3-fdc5-4fc0-99bd-06e0b1093326 admin admin] The token cache is being invalidate because project 4d970f8f783942ae97c47c5bf60fa631 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:10:34.757761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93dd5fe3-fdc5-4fc0-99bd-06e0b1093326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:34.758508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93dd5fe3-fdc5-4fc0-99bd-06e0b1093326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:34.760296 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3128/6269] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:10:34 2022] DELETE /identity/v3/projects/4d970f8f783942ae97c47c5bf60fa631 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:34.761568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd5fe3-fdc5-4fc0-99bd-06e0b1093326 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:34.765497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-93dd5fe3-fdc5-4fc0-99bd-06e0b1093326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:34.832419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e5567-9d6e-42cc-a219-8e18292ef2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:34.833136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e5567-9d6e-42cc-a219-8e18292ef2ca admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:34.833533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e5567-9d6e-42cc-a219-8e18292ef2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:34.833806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e5567-9d6e-42cc-a219-8e18292ef2ca admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:34.834514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e5567-9d6e-42cc-a219-8e18292ef2ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:34.837166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e5567-9d6e-42cc-a219-8e18292ef2ca admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:34.871180 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3142/6270] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:10:34 2022] POST /identity/v3/users => generated 295 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:34.876282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e5567-9d6e-42cc-a219-8e18292ef2ca admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:34.878389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-420e5567-9d6e-42cc-a219-8e18292ef2ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:34.894974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e5567-9d6e-42cc-a219-8e18292ef2ca admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:34.913474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edbcb5-28c2-4558-b55e-224f38a4ac2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:34.916173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edbcb5-28c2-4558-b55e-224f38a4ac2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:34.916864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edbcb5-28c2-4558-b55e-224f38a4ac2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:34.917416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edbcb5-28c2-4558-b55e-224f38a4ac2f admin admin] PATH_INFO: `/v3/users/9b43dacc77e6482fb11cb3401f60a23b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:34.919335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edbcb5-28c2-4558-b55e-224f38a4ac2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b43dacc77e6482fb11cb3401f60a23b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:34.921856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edbcb5-28c2-4558-b55e-224f38a4ac2f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:34.944857 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:35.035796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd5fe3-fdc5-4fc0-99bd-06e0b1093326 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:35.046562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e5edbcb5-28c2-4558-b55e-224f38a4ac2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b43dacc77e6482fb11cb3401f60a23b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:35.047688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e5edbcb5-28c2-4558-b55e-224f38a4ac2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b43dacc77e6482fb11cb3401f60a23b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:35.052153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e0619-cade-4ab4-ad6b-a43054cfc69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:35.055059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e0619-cade-4ab4-ad6b-a43054cfc69b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:35.055345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e0619-cade-4ab4-ad6b-a43054cfc69b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:35.055679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e0619-cade-4ab4-ad6b-a43054cfc69b admin admin] PATH_INFO: `/v3/projects/ed35999b8793411f87ef800b31ed13c4/users/5ecef553d39b44b1bd0a29081447f0e5/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:35.062505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e0619-cade-4ab4-ad6b-a43054cfc69b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed35999b8793411f87ef800b31ed13c4, user_id=5ecef553d39b44b1bd0a29081447f0e5, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:35.068762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e5edbcb5-28c2-4558-b55e-224f38a4ac2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b43dacc77e6482fb11cb3401f60a23b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:35.070768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e0619-cade-4ab4-ad6b-a43054cfc69b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:35.097269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e5edbcb5-28c2-4558-b55e-224f38a4ac2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b43dacc77e6482fb11cb3401f60a23b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:35.098838 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3129/6271] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:34 2022] PUT /identity/v3/projects/ed35999b8793411f87ef800b31ed13c4/users/5ecef553d39b44b1bd0a29081447f0e5/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:35.100478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e0619-cade-4ab4-ad6b-a43054cfc69b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:35.108203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-094e0619-cade-4ab4-ad6b-a43054cfc69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:35.111405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e5edbcb5-28c2-4558-b55e-224f38a4ac2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b43dacc77e6482fb11cb3401f60a23b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:35.122052 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3143/6272] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:10:34 2022] DELETE /identity/v3/users/9b43dacc77e6482fb11cb3401f60a23b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:35.122052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ab0b3-b653-40b8-a56b-940b5c7aed31 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:35.122052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ab0b3-b653-40b8-a56b-940b5c7aed31 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:35.122052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ab0b3-b653-40b8-a56b-940b5c7aed31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:35.155688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-499ab0b3-b653-40b8-a56b-940b5c7aed31 None None] MFA Rules not processed for user `5ecef553d39b44b1bd0a29081447f0e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:35.157240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-499ab0b3-b653-40b8-a56b-940b5c7aed31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:35.273462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e0619-cade-4ab4-ad6b-a43054cfc69b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:35.275133 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3144/6273] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:35.287159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ab0b3-b653-40b8-a56b-940b5c7aed31 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:35.288861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-499ab0b3-b653-40b8-a56b-940b5c7aed31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:35.411395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fd1ff-c912-433b-9aea-fccbeb253900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:35.412030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fd1ff-c912-433b-9aea-fccbeb253900 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:35.412308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fd1ff-c912-433b-9aea-fccbeb253900 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:35.412573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fd1ff-c912-433b-9aea-fccbeb253900 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:35.413268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fd1ff-c912-433b-9aea-fccbeb253900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:35.414898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fd1ff-c912-433b-9aea-fccbeb253900 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:35.420460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ab0b3-b653-40b8-a56b-940b5c7aed31 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:35.430203 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3130/6274] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:35.433418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5607d-0979-4aeb-a973-9fac92e658fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:35.434078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5607d-0979-4aeb-a973-9fac92e658fa service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:35.434357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5607d-0979-4aeb-a973-9fac92e658fa service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:35.435299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5607d-0979-4aeb-a973-9fac92e658fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:35.437549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fd1ff-c912-433b-9aea-fccbeb253900 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:35.449447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fd1ff-c912-433b-9aea-fccbeb253900 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:35.454469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c804b-4dd2-484f-b1a4-440a303e1de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:35.455179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c804b-4dd2-484f-b1a4-440a303e1de6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:35.455532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c804b-4dd2-484f-b1a4-440a303e1de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:35.456127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c804b-4dd2-484f-b1a4-440a303e1de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:35.456892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c804b-4dd2-484f-b1a4-440a303e1de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:35.458740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c804b-4dd2-484f-b1a4-440a303e1de6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:35.461799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5607d-0979-4aeb-a973-9fac92e658fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:35.466195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5607d-0979-4aeb-a973-9fac92e658fa service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:35.474000 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3131/6275] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:35.476316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c804b-4dd2-484f-b1a4-440a303e1de6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:35.488074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c804b-4dd2-484f-b1a4-440a303e1de6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:35.493504 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3145/6276] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:10:35.505882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675a011-5ef1-48a1-b862-c1270c29cd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:35.506952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675a011-5ef1-48a1-b862-c1270c29cd7f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:35.507396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675a011-5ef1-48a1-b862-c1270c29cd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:35.507819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675a011-5ef1-48a1-b862-c1270c29cd7f admin admin] PATH_INFO: `/v3/projects/422723b5ef7b4e5b94d39e72cf32ccf9/users/c0f97633b6e94bbea9169cb3a2717624/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:35.520804 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:35.546477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675a011-5ef1-48a1-b862-c1270c29cd7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=422723b5ef7b4e5b94d39e72cf32ccf9, user_id=c0f97633b6e94bbea9169cb3a2717624, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:35.551348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675a011-5ef1-48a1-b862-c1270c29cd7f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:35.595738 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3132/6277] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:35 2022] PUT /identity/v3/projects/422723b5ef7b4e5b94d39e72cf32ccf9/users/c0f97633b6e94bbea9169cb3a2717624/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:35.601164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c56a2-adad-4593-bf59-a7ef53919732 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:35.601426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c56a2-adad-4593-bf59-a7ef53919732 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:35.601757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c56a2-adad-4593-bf59-a7ef53919732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:35.660394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d63c56a2-adad-4593-bf59-a7ef53919732 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:35.664406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d63c56a2-adad-4593-bf59-a7ef53919732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:35.703347 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:35.864191 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3146/6278] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:35.907340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675a011-5ef1-48a1-b862-c1270c29cd7f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:35.910075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9675a011-5ef1-48a1-b862-c1270c29cd7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:36.086977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675a011-5ef1-48a1-b862-c1270c29cd7f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:36.099614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408a58c-49d1-4a75-809f-e695d663c776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:36.105495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408a58c-49d1-4a75-809f-e695d663c776 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:36.105948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408a58c-49d1-4a75-809f-e695d663c776 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:36.106750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408a58c-49d1-4a75-809f-e695d663c776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:36.133760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3408a58c-49d1-4a75-809f-e695d663c776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:36.137297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3408a58c-49d1-4a75-809f-e695d663c776 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:36.171288 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3133/6279] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:37.042753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c56a2-adad-4593-bf59-a7ef53919732 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:37.044920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d63c56a2-adad-4593-bf59-a7ef53919732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:37.155244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408a58c-49d1-4a75-809f-e695d663c776 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:37.157368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3408a58c-49d1-4a75-809f-e695d663c776 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:37.185834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408a58c-49d1-4a75-809f-e695d663c776 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:37.202351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d839f93-b669-4e59-84a5-8399cba2aeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:37.203008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d839f93-b669-4e59-84a5-8399cba2aeb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:37.203286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d839f93-b669-4e59-84a5-8399cba2aeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:37.203686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d839f93-b669-4e59-84a5-8399cba2aeb7 admin admin] PATH_INFO: `/v3/projects/4a503a4f4fb94021b51d2ccc62cf3bf5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:37.205259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d839f93-b669-4e59-84a5-8399cba2aeb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a503a4f4fb94021b51d2ccc62cf3bf5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:37.210592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d839f93-b669-4e59-84a5-8399cba2aeb7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:37.259115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c56a2-adad-4593-bf59-a7ef53919732 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:37.277718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627df38-6938-4dc2-87de-a7a19750ee50 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:37.279682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627df38-6938-4dc2-87de-a7a19750ee50 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:37.282724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627df38-6938-4dc2-87de-a7a19750ee50 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:37.283711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627df38-6938-4dc2-87de-a7a19750ee50 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:37.289606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7627df38-6938-4dc2-87de-a7a19750ee50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:37.330392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9d839f93-b669-4e59-84a5-8399cba2aeb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a503a4f4fb94021b51d2ccc62cf3bf5', 'request_id': 'req-9d839f93-b669-4e59-84a5-8399cba2aeb7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:37.331654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627df38-6938-4dc2-87de-a7a19750ee50 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:37.337267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627df38-6938-4dc2-87de-a7a19750ee50 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:37.361429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9d839f93-b669-4e59-84a5-8399cba2aeb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a503a4f4fb94021b51d2ccc62cf3bf5', 'request_id': 'req-9d839f93-b669-4e59-84a5-8399cba2aeb7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:37.368559 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3147/6280] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:37.377444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9d839f93-b669-4e59-84a5-8399cba2aeb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a503a4f4fb94021b51d2ccc62cf3bf5', 'request_id': 'req-9d839f93-b669-4e59-84a5-8399cba2aeb7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:37.409985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9d839f93-b669-4e59-84a5-8399cba2aeb7 admin admin] The token cache is being invalidate because project 4a503a4f4fb94021b51d2ccc62cf3bf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:10:37.410283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9d839f93-b669-4e59-84a5-8399cba2aeb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:37.410992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9d839f93-b669-4e59-84a5-8399cba2aeb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:37.421730 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3134/6281] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:10:37 2022] DELETE /identity/v3/projects/4a503a4f4fb94021b51d2ccc62cf3bf5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:10:37.423753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c83157-9f54-4f35-ba9e-0a4fcf0dbaae None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:37.424037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c83157-9f54-4f35-ba9e-0a4fcf0dbaae None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:37.424309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c83157-9f54-4f35-ba9e-0a4fcf0dbaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:37.504802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-59c83157-9f54-4f35-ba9e-0a4fcf0dbaae None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:37.509287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-59c83157-9f54-4f35-ba9e-0a4fcf0dbaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:37.684428 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3148/6282] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:37.686307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa148f44-6d40-4f7f-a6c9-372a37c5d291 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:37.686480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa148f44-6d40-4f7f-a6c9-372a37c5d291 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:37.687057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa148f44-6d40-4f7f-a6c9-372a37c5d291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:37.733783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-aa148f44-6d40-4f7f-a6c9-372a37c5d291 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:37.735278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aa148f44-6d40-4f7f-a6c9-372a37c5d291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:37.748337 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3135/6283] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:37.751843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c83157-9f54-4f35-ba9e-0a4fcf0dbaae None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:37.771266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c83157-9f54-4f35-ba9e-0a4fcf0dbaae None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:37.782063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38944a21-9907-4a3d-96c1-9ecc6382bfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:37.782690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38944a21-9907-4a3d-96c1-9ecc6382bfc4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:37.782999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38944a21-9907-4a3d-96c1-9ecc6382bfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:37.783891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38944a21-9907-4a3d-96c1-9ecc6382bfc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:37.784557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38944a21-9907-4a3d-96c1-9ecc6382bfc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:10:37.784903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38944a21-9907-4a3d-96c1-9ecc6382bfc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:37.786494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38944a21-9907-4a3d-96c1-9ecc6382bfc4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:37.813634 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3149/6284] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:10:37.816267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa148f44-6d40-4f7f-a6c9-372a37c5d291 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:37.829697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa148f44-6d40-4f7f-a6c9-372a37c5d291 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:37.850320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab5be0-78a1-4f95-8aea-116d960d18c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:37.851845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab5be0-78a1-4f95-8aea-116d960d18c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:37.852483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab5be0-78a1-4f95-8aea-116d960d18c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:37.852986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab5be0-78a1-4f95-8aea-116d960d18c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:37.853839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab5be0-78a1-4f95-8aea-116d960d18c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:37.858701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab5be0-78a1-4f95-8aea-116d960d18c9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:37.927116 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3136/6285] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:10:37 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:37.931169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38944a21-9907-4a3d-96c1-9ecc6382bfc4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:37.950614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38944a21-9907-4a3d-96c1-9ecc6382bfc4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:37.978669 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:38.111676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07565b77-7781-475b-b5be-8b34b0dd5577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:38.112314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07565b77-7781-475b-b5be-8b34b0dd5577 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:38.112517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07565b77-7781-475b-b5be-8b34b0dd5577 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:38.114061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07565b77-7781-475b-b5be-8b34b0dd5577 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:38.115024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07565b77-7781-475b-b5be-8b34b0dd5577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:38.118122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07565b77-7781-475b-b5be-8b34b0dd5577 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:38.152053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab5be0-78a1-4f95-8aea-116d960d18c9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:38.155557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dfab5be0-78a1-4f95-8aea-116d960d18c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:38.181424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab5be0-78a1-4f95-8aea-116d960d18c9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:38.184526 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3150/6286] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:10:37 2022] POST /identity/v3/users => generated 294 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:38.189466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07565b77-7781-475b-b5be-8b34b0dd5577 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:38.203023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5763ed-93d4-40ea-9572-598103e4061d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:38.203942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5763ed-93d4-40ea-9572-598103e4061d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:38.207692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5763ed-93d4-40ea-9572-598103e4061d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:38.208366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5763ed-93d4-40ea-9572-598103e4061d admin admin] PATH_INFO: `/v3/users/09b9183775e741d3bf634ae9c6178ccc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:38.210156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5763ed-93d4-40ea-9572-598103e4061d admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b9183775e741d3bf634ae9c6178ccc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:38.213625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5763ed-93d4-40ea-9572-598103e4061d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:38.219880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07565b77-7781-475b-b5be-8b34b0dd5577 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:38.234947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa1884-cccf-4f52-9a2e-d4c12caa1f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:38.235594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa1884-cccf-4f52-9a2e-d4c12caa1f32 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:38.235880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa1884-cccf-4f52-9a2e-d4c12caa1f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:38.236324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa1884-cccf-4f52-9a2e-d4c12caa1f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:38.237342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa1884-cccf-4f52-9a2e-d4c12caa1f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:38.240681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa1884-cccf-4f52-9a2e-d4c12caa1f32 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:38.281925 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3151/6287] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:38.286192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa1884-cccf-4f52-9a2e-d4c12caa1f32 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:38.308423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa1884-cccf-4f52-9a2e-d4c12caa1f32 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:38.313621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ddad2-b5fd-4bfe-b550-995d0134ad59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:38.314340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ddad2-b5fd-4bfe-b550-995d0134ad59 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:38.314861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ddad2-b5fd-4bfe-b550-995d0134ad59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:38.315281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ddad2-b5fd-4bfe-b550-995d0134ad59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:38.316572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ddad2-b5fd-4bfe-b550-995d0134ad59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:38.318444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ddad2-b5fd-4bfe-b550-995d0134ad59 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:38.318683 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:38.337319 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3152/6288] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:38.345231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9c5763ed-93d4-40ea-9572-598103e4061d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b9183775e741d3bf634ae9c6178ccc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:38.346337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ddad2-b5fd-4bfe-b550-995d0134ad59 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:38.363073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9c5763ed-93d4-40ea-9572-598103e4061d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b9183775e741d3bf634ae9c6178ccc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:38.363967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9c5763ed-93d4-40ea-9572-598103e4061d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b9183775e741d3bf634ae9c6178ccc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:38.372573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ddad2-b5fd-4bfe-b550-995d0134ad59 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:38.388009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a64dab-a070-40a7-a7c3-b4976e729228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:38.388786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a64dab-a070-40a7-a7c3-b4976e729228 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:38.389069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a64dab-a070-40a7-a7c3-b4976e729228 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:38.389345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a64dab-a070-40a7-a7c3-b4976e729228 admin admin] PATH_INFO: `/v3/projects/a5d2ff30a0de45b9a41440ca9a51581f/users/aef70ecab8604df08a52dd47c2d108ea/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:38.400659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9c5763ed-93d4-40ea-9572-598103e4061d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b9183775e741d3bf634ae9c6178ccc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:38.421485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a64dab-a070-40a7-a7c3-b4976e729228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5d2ff30a0de45b9a41440ca9a51581f, user_id=aef70ecab8604df08a52dd47c2d108ea, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:38.424316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a64dab-a070-40a7-a7c3-b4976e729228 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:38.425181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9c5763ed-93d4-40ea-9572-598103e4061d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b9183775e741d3bf634ae9c6178ccc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:38.447031 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3137/6289] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:10:38 2022] DELETE /identity/v3/users/09b9183775e741d3bf634ae9c6178ccc => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:38.452931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092d5f1-244a-4ded-8877-3aaa65e5d055 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:38.453594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092d5f1-244a-4ded-8877-3aaa65e5d055 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:38.454026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092d5f1-244a-4ded-8877-3aaa65e5d055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:38.461652 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3153/6290] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:38 2022] PUT /identity/v3/projects/a5d2ff30a0de45b9a41440ca9a51581f/users/aef70ecab8604df08a52dd47c2d108ea/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:38.473004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7a5dc-6033-4184-bae4-baffa72c0a46 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:38.473344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7a5dc-6033-4184-bae4-baffa72c0a46 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:38.473668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7a5dc-6033-4184-bae4-baffa72c0a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:38.521863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0092d5f1-244a-4ded-8877-3aaa65e5d055 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:38.528941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0092d5f1-244a-4ded-8877-3aaa65e5d055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:38.568366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9fc7a5dc-6033-4184-bae4-baffa72c0a46 None None] MFA Rules not processed for user `aef70ecab8604df08a52dd47c2d108ea`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:38.571889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9fc7a5dc-6033-4184-bae4-baffa72c0a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:38.694366 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3138/6291] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:38.717783 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3154/6292] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:10:38.719228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092d5f1-244a-4ded-8877-3aaa65e5d055 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:38.720828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0092d5f1-244a-4ded-8877-3aaa65e5d055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:38.733229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7a5dc-6033-4184-bae4-baffa72c0a46 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:38.737489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9fc7a5dc-6033-4184-bae4-baffa72c0a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:38.746696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092d5f1-244a-4ded-8877-3aaa65e5d055 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:38.760591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cb204-d38b-4bc3-860d-ee700f314a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:38.762820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cb204-d38b-4bc3-860d-ee700f314a01 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:38.763145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cb204-d38b-4bc3-860d-ee700f314a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:38.763422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cb204-d38b-4bc3-860d-ee700f314a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:38.764979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cb204-d38b-4bc3-860d-ee700f314a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:38.771031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cb204-d38b-4bc3-860d-ee700f314a01 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:38.835365 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3139/6293] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:10:38 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:10:38.837394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cb204-d38b-4bc3-860d-ee700f314a01 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:38.866993 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:38.880672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7a5dc-6033-4184-bae4-baffa72c0a46 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:38.977904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf380114-441a-45a1-b1c5-bcd80774798a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:38.978530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf380114-441a-45a1-b1c5-bcd80774798a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:38.979906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf380114-441a-45a1-b1c5-bcd80774798a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:38.979906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf380114-441a-45a1-b1c5-bcd80774798a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:38.983253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cb204-d38b-4bc3-860d-ee700f314a01 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:38.992950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf380114-441a-45a1-b1c5-bcd80774798a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:38.994965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf380114-441a-45a1-b1c5-bcd80774798a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:38.996332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1241e5-d6db-458e-bfdd-4ec997a47bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:38.996988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1241e5-d6db-458e-bfdd-4ec997a47bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:38.997268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1241e5-d6db-458e-bfdd-4ec997a47bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:38.997541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1241e5-d6db-458e-bfdd-4ec997a47bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:38.998177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1241e5-d6db-458e-bfdd-4ec997a47bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:39.002893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1241e5-d6db-458e-bfdd-4ec997a47bb7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:39.007453 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3155/6294] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:39.044277 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3140/6295] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:10:38 2022] POST /identity/v3/users => generated 300 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:39.049158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf380114-441a-45a1-b1c5-bcd80774798a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:39.066869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf380114-441a-45a1-b1c5-bcd80774798a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:39.075133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b9fe7-2018-486a-ab07-f2a9e80c1e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:39.076164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b9fe7-2018-486a-ab07-f2a9e80c1e30 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:39.076691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b9fe7-2018-486a-ab07-f2a9e80c1e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:39.077106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b9fe7-2018-486a-ab07-f2a9e80c1e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:39.078113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b9fe7-2018-486a-ab07-f2a9e80c1e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:39.080224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b9fe7-2018-486a-ab07-f2a9e80c1e30 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:39.115587 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3156/6296] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:10:39.117442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1241e5-d6db-458e-bfdd-4ec997a47bb7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:39.130413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1241e5-d6db-458e-bfdd-4ec997a47bb7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:39.146762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08758a5a-4d25-4361-9c2c-33b234dc566c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:39.146995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08758a5a-4d25-4361-9c2c-33b234dc566c admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:39.147507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08758a5a-4d25-4361-9c2c-33b234dc566c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:39.148476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08758a5a-4d25-4361-9c2c-33b234dc566c admin admin] PATH_INFO: `/v3/projects/baeed2055fb147f3915d43517a38491e/users/09372f41eab847a9b13c4c75fbecf499/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:39.168383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08758a5a-4d25-4361-9c2c-33b234dc566c admin admin] RBAC: Authorizing `identity:create_grant(project_id=baeed2055fb147f3915d43517a38491e, user_id=09372f41eab847a9b13c4c75fbecf499, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:39.172910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08758a5a-4d25-4361-9c2c-33b234dc566c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:39.183755 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:39.195832 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3141/6297] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:39 2022] PUT /identity/v3/projects/baeed2055fb147f3915d43517a38491e/users/09372f41eab847a9b13c4c75fbecf499/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:39.199252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b9fe7-2018-486a-ab07-f2a9e80c1e30 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:39.213237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b9fe7-2018-486a-ab07-f2a9e80c1e30 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:39.304638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef4e39-cfb6-4eba-8a68-2a60ccc88f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:39.305271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef4e39-cfb6-4eba-8a68-2a60ccc88f9f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:39.305552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef4e39-cfb6-4eba-8a68-2a60ccc88f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:39.305901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef4e39-cfb6-4eba-8a68-2a60ccc88f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:39.306551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef4e39-cfb6-4eba-8a68-2a60ccc88f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:39.308936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef4e39-cfb6-4eba-8a68-2a60ccc88f9f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:39.324681 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3157/6298] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:39.329058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08758a5a-4d25-4361-9c2c-33b234dc566c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:39.345177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08758a5a-4d25-4361-9c2c-33b234dc566c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:39.351675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd0545-2e5a-48f9-bf8b-20b109617993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:39.353090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd0545-2e5a-48f9-bf8b-20b109617993 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:39.353580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd0545-2e5a-48f9-bf8b-20b109617993 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:39.354196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd0545-2e5a-48f9-bf8b-20b109617993 admin admin] PATH_INFO: `/v3/projects/baeed2055fb147f3915d43517a38491e/users/09372f41eab847a9b13c4c75fbecf499/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:39.357233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd0545-2e5a-48f9-bf8b-20b109617993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baeed2055fb147f3915d43517a38491e, user_id=09372f41eab847a9b13c4c75fbecf499, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:39.360967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd0545-2e5a-48f9-bf8b-20b109617993 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:39.378244 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3142/6299] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:39 2022] PUT /identity/v3/projects/baeed2055fb147f3915d43517a38491e/users/09372f41eab847a9b13c4c75fbecf499/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:39.392177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731873ac-67a6-4e3a-9b1d-21c5965b2048 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:39.392615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731873ac-67a6-4e3a-9b1d-21c5965b2048 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:39.393010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731873ac-67a6-4e3a-9b1d-21c5965b2048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:39.429158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-731873ac-67a6-4e3a-9b1d-21c5965b2048 None None] MFA Rules not processed for user `09372f41eab847a9b13c4c75fbecf499`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:39.430585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-731873ac-67a6-4e3a-9b1d-21c5965b2048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:39.596993 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3158/6300] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:39.606671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd0545-2e5a-48f9-bf8b-20b109617993 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:39.609656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-83fd0545-2e5a-48f9-bf8b-20b109617993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:39.750237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd0545-2e5a-48f9-bf8b-20b109617993 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:39.764866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bfebe-7f5d-4fe3-a38e-70997525cb27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:39.765909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bfebe-7f5d-4fe3-a38e-70997525cb27 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:39.765909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bfebe-7f5d-4fe3-a38e-70997525cb27 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:39.766116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bfebe-7f5d-4fe3-a38e-70997525cb27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:39.789766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10bfebe-7f5d-4fe3-a38e-70997525cb27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:39.791934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10bfebe-7f5d-4fe3-a38e-70997525cb27 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:39.805082 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3143/6301] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:39 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:39.890247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731873ac-67a6-4e3a-9b1d-21c5965b2048 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:39.989309 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:40.061099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731873ac-67a6-4e3a-9b1d-21c5965b2048 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:40.067657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259b79a-ef61-4a24-885a-1bf3bcac8e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:40.068581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259b79a-ef61-4a24-885a-1bf3bcac8e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:40.068956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259b79a-ef61-4a24-885a-1bf3bcac8e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:40.070194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259b79a-ef61-4a24-885a-1bf3bcac8e96 admin admin] PATH_INFO: `/v3/users/aef70ecab8604df08a52dd47c2d108ea` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:40.070950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259b79a-ef61-4a24-885a-1bf3bcac8e96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aef70ecab8604df08a52dd47c2d108ea)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:40.073915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259b79a-ef61-4a24-885a-1bf3bcac8e96 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:40.164972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1259b79a-ef61-4a24-885a-1bf3bcac8e96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aef70ecab8604df08a52dd47c2d108ea'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:40.165444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1259b79a-ef61-4a24-885a-1bf3bcac8e96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aef70ecab8604df08a52dd47c2d108ea'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:40.192856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1259b79a-ef61-4a24-885a-1bf3bcac8e96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aef70ecab8604df08a52dd47c2d108ea'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:40.212274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1259b79a-ef61-4a24-885a-1bf3bcac8e96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aef70ecab8604df08a52dd47c2d108ea'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:40.223186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1259b79a-ef61-4a24-885a-1bf3bcac8e96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aef70ecab8604df08a52dd47c2d108ea'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:40.230549 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3159/6302] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:10:39 2022] DELETE /identity/v3/users/aef70ecab8604df08a52dd47c2d108ea => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:40.235024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b31be-571d-41c2-9d16-0d2e74d9e52d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:40.235875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b31be-571d-41c2-9d16-0d2e74d9e52d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:40.236349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b31be-571d-41c2-9d16-0d2e74d9e52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:40.258243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-358b31be-571d-41c2-9d16-0d2e74d9e52d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:40.259707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-358b31be-571d-41c2-9d16-0d2e74d9e52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:40.285785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259b79a-ef61-4a24-885a-1bf3bcac8e96 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:40.287521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1259b79a-ef61-4a24-885a-1bf3bcac8e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:40.347115 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3144/6303] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:10:40.363183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b31be-571d-41c2-9d16-0d2e74d9e52d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:40.365669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-358b31be-571d-41c2-9d16-0d2e74d9e52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:40.412643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259b79a-ef61-4a24-885a-1bf3bcac8e96 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:40.420638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62453a1-f227-4513-bbc2-ed81a360f5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:40.421549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62453a1-f227-4513-bbc2-ed81a360f5d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:40.422072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62453a1-f227-4513-bbc2-ed81a360f5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:40.422513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62453a1-f227-4513-bbc2-ed81a360f5d8 admin admin] PATH_INFO: `/v3/projects/6e9948c41ff84e748bc366ea1c74701d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:40.424367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62453a1-f227-4513-bbc2-ed81a360f5d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9948c41ff84e748bc366ea1c74701d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:40.428403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62453a1-f227-4513-bbc2-ed81a360f5d8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:40.517057 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:40.519299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b31be-571d-41c2-9d16-0d2e74d9e52d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:40.535135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a62453a1-f227-4513-bbc2-ed81a360f5d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9948c41ff84e748bc366ea1c74701d', 'request_id': 'req-a62453a1-f227-4513-bbc2-ed81a360f5d8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:40.548003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a62453a1-f227-4513-bbc2-ed81a360f5d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9948c41ff84e748bc366ea1c74701d', 'request_id': 'req-a62453a1-f227-4513-bbc2-ed81a360f5d8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:40.566286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a62453a1-f227-4513-bbc2-ed81a360f5d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9948c41ff84e748bc366ea1c74701d', 'request_id': 'req-a62453a1-f227-4513-bbc2-ed81a360f5d8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:40.591192 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:40.592280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a62453a1-f227-4513-bbc2-ed81a360f5d8 admin admin] The token cache is being invalidate because project 6e9948c41ff84e748bc366ea1c74701d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:10:40.592950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a62453a1-f227-4513-bbc2-ed81a360f5d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:40.593665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a62453a1-f227-4513-bbc2-ed81a360f5d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:40.599676 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3160/6304] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:10:40 2022] DELETE /identity/v3/projects/6e9948c41ff84e748bc366ea1c74701d => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:40.600860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62453a1-f227-4513-bbc2-ed81a360f5d8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:40.605504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a62453a1-f227-4513-bbc2-ed81a360f5d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:40.608120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba02d15-163a-486a-b446-30cc813548cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:40.608950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba02d15-163a-486a-b446-30cc813548cd service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:40.609397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba02d15-163a-486a-b446-30cc813548cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:40.609833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba02d15-163a-486a-b446-30cc813548cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:40.612078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8ba02d15-163a-486a-b446-30cc813548cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:40.706695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba02d15-163a-486a-b446-30cc813548cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:40.709458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba02d15-163a-486a-b446-30cc813548cd service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:40.725476 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3145/6305] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:10:40.741818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62453a1-f227-4513-bbc2-ed81a360f5d8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:40.748774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd2232-32bf-443c-b8f4-1f195bc688f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:40.749910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd2232-32bf-443c-b8f4-1f195bc688f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:40.750476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd2232-32bf-443c-b8f4-1f195bc688f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:40.750869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd2232-32bf-443c-b8f4-1f195bc688f2 admin admin] PATH_INFO: `/v3/users/5ecef553d39b44b1bd0a29081447f0e5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:40.752398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd2232-32bf-443c-b8f4-1f195bc688f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ecef553d39b44b1bd0a29081447f0e5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:40.755945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd2232-32bf-443c-b8f4-1f195bc688f2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:40.875217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bddd2232-32bf-443c-b8f4-1f195bc688f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ecef553d39b44b1bd0a29081447f0e5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:40.876629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bddd2232-32bf-443c-b8f4-1f195bc688f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ecef553d39b44b1bd0a29081447f0e5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:40.895663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bddd2232-32bf-443c-b8f4-1f195bc688f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ecef553d39b44b1bd0a29081447f0e5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:40.917772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bddd2232-32bf-443c-b8f4-1f195bc688f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ecef553d39b44b1bd0a29081447f0e5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:40.933002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bddd2232-32bf-443c-b8f4-1f195bc688f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ecef553d39b44b1bd0a29081447f0e5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:40.941768 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3161/6306] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:10:40 2022] DELETE /identity/v3/users/5ecef553d39b44b1bd0a29081447f0e5 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:41.932323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba02d15-163a-486a-b446-30cc813548cd service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:41.934700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8ba02d15-163a-486a-b446-30cc813548cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:41.953846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba02d15-163a-486a-b446-30cc813548cd service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:42.082253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd2232-32bf-443c-b8f4-1f195bc688f2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:42.086202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bddd2232-32bf-443c-b8f4-1f195bc688f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:42.100890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df65d0-f037-4556-89b1-36720167e66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:42.101622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df65d0-f037-4556-89b1-36720167e66c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:42.102066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df65d0-f037-4556-89b1-36720167e66c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:42.102308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df65d0-f037-4556-89b1-36720167e66c admin admin] PATH_INFO: `/v3/projects/a5d2ff30a0de45b9a41440ca9a51581f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:42.103548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df65d0-f037-4556-89b1-36720167e66c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5d2ff30a0de45b9a41440ca9a51581f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:42.105943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df65d0-f037-4556-89b1-36720167e66c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:42.189365 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:42.222738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72df65d0-f037-4556-89b1-36720167e66c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5d2ff30a0de45b9a41440ca9a51581f', 'request_id': 'req-72df65d0-f037-4556-89b1-36720167e66c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:42.231081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd2232-32bf-443c-b8f4-1f195bc688f2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:42.250806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72df65d0-f037-4556-89b1-36720167e66c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5d2ff30a0de45b9a41440ca9a51581f', 'request_id': 'req-72df65d0-f037-4556-89b1-36720167e66c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:42.263135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72df65d0-f037-4556-89b1-36720167e66c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5d2ff30a0de45b9a41440ca9a51581f', 'request_id': 'req-72df65d0-f037-4556-89b1-36720167e66c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:42.281889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72df65d0-f037-4556-89b1-36720167e66c admin admin] The token cache is being invalidate because project a5d2ff30a0de45b9a41440ca9a51581f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:10:42.282195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72df65d0-f037-4556-89b1-36720167e66c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:42.282934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72df65d0-f037-4556-89b1-36720167e66c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:42.284920 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3146/6307] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:10:41 2022] DELETE /identity/v3/projects/a5d2ff30a0de45b9a41440ca9a51581f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:42.292851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df65d0-f037-4556-89b1-36720167e66c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:42.295055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-72df65d0-f037-4556-89b1-36720167e66c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:42.354306 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:42.400117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9615e3c-6d78-4a26-b41f-4d894785daa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:42.400983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9615e3c-6d78-4a26-b41f-4d894785daa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:42.402708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9615e3c-6d78-4a26-b41f-4d894785daa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:42.403004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9615e3c-6d78-4a26-b41f-4d894785daa5 admin admin] PATH_INFO: `/v3/projects/ed35999b8793411f87ef800b31ed13c4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:42.405613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9615e3c-6d78-4a26-b41f-4d894785daa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed35999b8793411f87ef800b31ed13c4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:42.409847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9615e3c-6d78-4a26-b41f-4d894785daa5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:42.469372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df65d0-f037-4556-89b1-36720167e66c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:42.482228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd71485-f4a0-44f1-8f49-d98d9cc8cc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:42.483477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd71485-f4a0-44f1-8f49-d98d9cc8cc3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:42.483819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd71485-f4a0-44f1-8f49-d98d9cc8cc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:42.484105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd71485-f4a0-44f1-8f49-d98d9cc8cc3e admin admin] PATH_INFO: `/v3/users/09372f41eab847a9b13c4c75fbecf499` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:42.488108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd71485-f4a0-44f1-8f49-d98d9cc8cc3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=09372f41eab847a9b13c4c75fbecf499)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:42.490103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd71485-f4a0-44f1-8f49-d98d9cc8cc3e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:42.536264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e9615e3c-6d78-4a26-b41f-4d894785daa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed35999b8793411f87ef800b31ed13c4', 'request_id': 'req-e9615e3c-6d78-4a26-b41f-4d894785daa5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:42.552803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e9615e3c-6d78-4a26-b41f-4d894785daa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed35999b8793411f87ef800b31ed13c4', 'request_id': 'req-e9615e3c-6d78-4a26-b41f-4d894785daa5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:42.571916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e9615e3c-6d78-4a26-b41f-4d894785daa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed35999b8793411f87ef800b31ed13c4', 'request_id': 'req-e9615e3c-6d78-4a26-b41f-4d894785daa5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:42.600313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e9615e3c-6d78-4a26-b41f-4d894785daa5 admin admin] The token cache is being invalidate because project ed35999b8793411f87ef800b31ed13c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:10:42.600629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e9615e3c-6d78-4a26-b41f-4d894785daa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:42.601477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e9615e3c-6d78-4a26-b41f-4d894785daa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:42.608087 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3162/6308] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:10:42 2022] DELETE /identity/v3/projects/ed35999b8793411f87ef800b31ed13c4 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:42.608729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cbd71485-f4a0-44f1-8f49-d98d9cc8cc3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09372f41eab847a9b13c4c75fbecf499'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:42.609612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b37ff-9ed4-45bb-b69d-67400d51834e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:42.609924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b37ff-9ed4-45bb-b69d-67400d51834e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:42.610200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b37ff-9ed4-45bb-b69d-67400d51834e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:42.623230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cbd71485-f4a0-44f1-8f49-d98d9cc8cc3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09372f41eab847a9b13c4c75fbecf499'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:42.623922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cbd71485-f4a0-44f1-8f49-d98d9cc8cc3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09372f41eab847a9b13c4c75fbecf499'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:42.649011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cbd71485-f4a0-44f1-8f49-d98d9cc8cc3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09372f41eab847a9b13c4c75fbecf499'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:42.662773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-545b37ff-9ed4-45bb-b69d-67400d51834e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:42.664227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-545b37ff-9ed4-45bb-b69d-67400d51834e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:42.671268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cbd71485-f4a0-44f1-8f49-d98d9cc8cc3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09372f41eab847a9b13c4c75fbecf499'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:42.691691 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3147/6309] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:10:42 2022] DELETE /identity/v3/users/09372f41eab847a9b13c4c75fbecf499 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:42.885272 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3163/6310] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:10:42.887967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35a92d-e0f0-414d-a7ea-ddbf520d90e3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:42.888261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35a92d-e0f0-414d-a7ea-ddbf520d90e3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:42.888541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35a92d-e0f0-414d-a7ea-ddbf520d90e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:42.915025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7a35a92d-e0f0-414d-a7ea-ddbf520d90e3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:42.917708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7a35a92d-e0f0-414d-a7ea-ddbf520d90e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:43.066406 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3148/6311] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:43.070165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b37ff-9ed4-45bb-b69d-67400d51834e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:43.082586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b37ff-9ed4-45bb-b69d-67400d51834e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:43.087908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232eaccb-a915-4947-8f09-8a8ac69bf612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:43.089194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232eaccb-a915-4947-8f09-8a8ac69bf612 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:43.089482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232eaccb-a915-4947-8f09-8a8ac69bf612 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:43.089941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232eaccb-a915-4947-8f09-8a8ac69bf612 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:43.091848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232eaccb-a915-4947-8f09-8a8ac69bf612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:10:43.091848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232eaccb-a915-4947-8f09-8a8ac69bf612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:43.092492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232eaccb-a915-4947-8f09-8a8ac69bf612 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:43.115757 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3164/6312] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:10:43.120983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35a92d-e0f0-414d-a7ea-ddbf520d90e3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:43.138074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35a92d-e0f0-414d-a7ea-ddbf520d90e3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:43.147053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a2e27-5902-46f4-95f5-6b9ef3cc84b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:43.147777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a2e27-5902-46f4-95f5-6b9ef3cc84b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:43.148136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a2e27-5902-46f4-95f5-6b9ef3cc84b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:43.148482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a2e27-5902-46f4-95f5-6b9ef3cc84b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:43.149546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a2e27-5902-46f4-95f5-6b9ef3cc84b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:43.151823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a2e27-5902-46f4-95f5-6b9ef3cc84b4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:43.199932 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3149/6313] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:10:43 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:43.204647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232eaccb-a915-4947-8f09-8a8ac69bf612 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:43.219562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232eaccb-a915-4947-8f09-8a8ac69bf612 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:43.232471 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:43.328982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae37955-2338-446d-a540-9b72d6f95e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:43.329667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae37955-2338-446d-a540-9b72d6f95e2c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:43.329944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae37955-2338-446d-a540-9b72d6f95e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:43.330409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae37955-2338-446d-a540-9b72d6f95e2c admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:43.331302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae37955-2338-446d-a540-9b72d6f95e2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:43.333226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae37955-2338-446d-a540-9b72d6f95e2c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:43.381973 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3165/6314] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:10:43 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:43.382594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a2e27-5902-46f4-95f5-6b9ef3cc84b4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:43.394440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a2e27-5902-46f4-95f5-6b9ef3cc84b4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:43.400126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50338b2-4d15-48d2-9d54-a3436c3fb5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:43.401030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50338b2-4d15-48d2-9d54-a3436c3fb5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:43.401522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50338b2-4d15-48d2-9d54-a3436c3fb5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:43.403222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50338b2-4d15-48d2-9d54-a3436c3fb5a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:43.404294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50338b2-4d15-48d2-9d54-a3436c3fb5a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:43.406411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50338b2-4d15-48d2-9d54-a3436c3fb5a4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:43.427755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae37955-2338-446d-a540-9b72d6f95e2c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:43.440040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae37955-2338-446d-a540-9b72d6f95e2c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:43.440687 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3150/6315] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:43.451739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb529bd2-38df-4990-bd05-7bca560de31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:43.452807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb529bd2-38df-4990-bd05-7bca560de31e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:43.454574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb529bd2-38df-4990-bd05-7bca560de31e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:43.456053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb529bd2-38df-4990-bd05-7bca560de31e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:43.457028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb529bd2-38df-4990-bd05-7bca560de31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:43.459409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb529bd2-38df-4990-bd05-7bca560de31e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:43.481629 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3166/6316] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:43.488645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50338b2-4d15-48d2-9d54-a3436c3fb5a4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:43.503875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb529bd2-38df-4990-bd05-7bca560de31e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:43.505274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50338b2-4d15-48d2-9d54-a3436c3fb5a4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:43.508219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fb529bd2-38df-4990-bd05-7bca560de31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:43.533631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808e599-4364-4696-a184-73c8e730d974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:43.534475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808e599-4364-4696-a184-73c8e730d974 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:43.534764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808e599-4364-4696-a184-73c8e730d974 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:43.535033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808e599-4364-4696-a184-73c8e730d974 admin admin] PATH_INFO: `/v3/projects/7fd886189dbc4278ab6a990a49a32c63/users/a746b4eed1294d27a4c386e9926441d8/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:43.556256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb529bd2-38df-4990-bd05-7bca560de31e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:43.561644 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:43.571252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f78a47-b4d1-4d65-992a-fe6b85225829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:43.571918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f78a47-b4d1-4d65-992a-fe6b85225829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:43.572204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f78a47-b4d1-4d65-992a-fe6b85225829 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:43.573032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f78a47-b4d1-4d65-992a-fe6b85225829 admin admin] PATH_INFO: `/v3/projects/baeed2055fb147f3915d43517a38491e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:43.575641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f78a47-b4d1-4d65-992a-fe6b85225829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baeed2055fb147f3915d43517a38491e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:43.580402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808e599-4364-4696-a184-73c8e730d974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd886189dbc4278ab6a990a49a32c63, user_id=a746b4eed1294d27a4c386e9926441d8, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:43.584926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f78a47-b4d1-4d65-992a-fe6b85225829 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:43.585980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808e599-4364-4696-a184-73c8e730d974 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:43.617024 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3151/6317] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:43 2022] PUT /identity/v3/projects/7fd886189dbc4278ab6a990a49a32c63/users/a746b4eed1294d27a4c386e9926441d8/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:43.632227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75b3b5-b68b-46bc-867c-aefac41dbc67 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:43.654204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75b3b5-b68b-46bc-867c-aefac41dbc67 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:43.654477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75b3b5-b68b-46bc-867c-aefac41dbc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:43.749264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5d75b3b5-b68b-46bc-867c-aefac41dbc67 None None] MFA Rules not processed for user `a746b4eed1294d27a4c386e9926441d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:43.750516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5d75b3b5-b68b-46bc-867c-aefac41dbc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:43.755189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b4f78a47-b4d1-4d65-992a-fe6b85225829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baeed2055fb147f3915d43517a38491e', 'request_id': 'req-b4f78a47-b4d1-4d65-992a-fe6b85225829'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:43.778262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b4f78a47-b4d1-4d65-992a-fe6b85225829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baeed2055fb147f3915d43517a38491e', 'request_id': 'req-b4f78a47-b4d1-4d65-992a-fe6b85225829'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:43.790307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b4f78a47-b4d1-4d65-992a-fe6b85225829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baeed2055fb147f3915d43517a38491e', 'request_id': 'req-b4f78a47-b4d1-4d65-992a-fe6b85225829'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:43.810681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b4f78a47-b4d1-4d65-992a-fe6b85225829 admin admin] The token cache is being invalidate because project baeed2055fb147f3915d43517a38491e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:10:43.811014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b4f78a47-b4d1-4d65-992a-fe6b85225829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:43.812802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b4f78a47-b4d1-4d65-992a-fe6b85225829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:43.816782 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3167/6318] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:10:43 2022] DELETE /identity/v3/projects/baeed2055fb147f3915d43517a38491e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:43.821886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2111a52-e3ec-421a-8abd-6fe418eb08aa None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:43.821886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2111a52-e3ec-421a-8abd-6fe418eb08aa None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:43.822144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2111a52-e3ec-421a-8abd-6fe418eb08aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:43.867183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d2111a52-e3ec-421a-8abd-6fe418eb08aa None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:43.868421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d2111a52-e3ec-421a-8abd-6fe418eb08aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:43.936694 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3152/6319] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:43.945001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75b3b5-b68b-46bc-867c-aefac41dbc67 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:43.949462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5d75b3b5-b68b-46bc-867c-aefac41dbc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:44.048009 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3168/6320] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:44.056189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b601a-0b7e-4e5c-a57a-356358e4f861 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:44.056189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b601a-0b7e-4e5c-a57a-356358e4f861 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:44.056189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b601a-0b7e-4e5c-a57a-356358e4f861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:44.094941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-576b601a-0b7e-4e5c-a57a-356358e4f861 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:44.096963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-576b601a-0b7e-4e5c-a57a-356358e4f861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:44.107214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75b3b5-b68b-46bc-867c-aefac41dbc67 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:44.118470 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3169/6321] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:44.120181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b601a-0b7e-4e5c-a57a-356358e4f861 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:44.127111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347751b-0836-4cc8-90a7-63c0d5f93b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:44.127927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347751b-0836-4cc8-90a7-63c0d5f93b2c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:44.128643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347751b-0836-4cc8-90a7-63c0d5f93b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:44.129129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347751b-0836-4cc8-90a7-63c0d5f93b2c admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:44.129584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347751b-0836-4cc8-90a7-63c0d5f93b2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:44.131594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347751b-0836-4cc8-90a7-63c0d5f93b2c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:44.136083 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:44.143738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b601a-0b7e-4e5c-a57a-356358e4f861 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:44.157479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4df59-0a99-41ef-b778-5c84be3ef7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:44.158250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4df59-0a99-41ef-b778-5c84be3ef7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:44.158624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4df59-0a99-41ef-b778-5c84be3ef7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:44.159144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4df59-0a99-41ef-b778-5c84be3ef7e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:44.159932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4df59-0a99-41ef-b778-5c84be3ef7e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:10:44.160582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4df59-0a99-41ef-b778-5c84be3ef7e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:44.164884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4df59-0a99-41ef-b778-5c84be3ef7e1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:44.198218 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3153/6322] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:10:43 2022] POST /identity/v3/projects => generated 369 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:44.199407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347751b-0836-4cc8-90a7-63c0d5f93b2c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:44.202381 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3170/6323] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:10:44.208541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4df59-0a99-41ef-b778-5c84be3ef7e1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:44.239424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4df59-0a99-41ef-b778-5c84be3ef7e1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:44.382391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347751b-0836-4cc8-90a7-63c0d5f93b2c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:44.386046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64419f-fd69-44e5-a5d6-152003b94f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:44.386806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64419f-fd69-44e5-a5d6-152003b94f13 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:44.387256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64419f-fd69-44e5-a5d6-152003b94f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:44.387622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64419f-fd69-44e5-a5d6-152003b94f13 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:44.389536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64419f-fd69-44e5-a5d6-152003b94f13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:44.396824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64419f-fd69-44e5-a5d6-152003b94f13 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:44.403645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a209040-cc81-4127-83cd-f3d4fa8fcd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:44.404249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a209040-cc81-4127-83cd-f3d4fa8fcd04 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:44.404523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a209040-cc81-4127-83cd-f3d4fa8fcd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:44.404819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a209040-cc81-4127-83cd-f3d4fa8fcd04 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:44.405452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a209040-cc81-4127-83cd-f3d4fa8fcd04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:44.407576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a209040-cc81-4127-83cd-f3d4fa8fcd04 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:44.422480 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:44.444504 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3171/6324] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:10:44 2022] POST /identity/v3/projects => generated 371 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:44.449209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64419f-fd69-44e5-a5d6-152003b94f13 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:44.453664 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3154/6325] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:10:44 2022] POST /identity/v3/users => generated 291 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:44.458501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a209040-cc81-4127-83cd-f3d4fa8fcd04 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:44.471544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a209040-cc81-4127-83cd-f3d4fa8fcd04 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:44.555737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64419f-fd69-44e5-a5d6-152003b94f13 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:44.563807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1318ce-f000-43c0-bae2-9ea03d180fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:44.564750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1318ce-f000-43c0-bae2-9ea03d180fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:44.565756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1318ce-f000-43c0-bae2-9ea03d180fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:44.565756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1318ce-f000-43c0-bae2-9ea03d180fb2 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:44.566505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1318ce-f000-43c0-bae2-9ea03d180fb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:44.569439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1318ce-f000-43c0-bae2-9ea03d180fb2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:44.582325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d6aa4-76a1-4ea4-8570-a7933374d772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:44.583728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d6aa4-76a1-4ea4-8570-a7933374d772 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:44.584293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d6aa4-76a1-4ea4-8570-a7933374d772 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:44.585389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d6aa4-76a1-4ea4-8570-a7933374d772 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:44.587891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d6aa4-76a1-4ea4-8570-a7933374d772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:44.590709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d6aa4-76a1-4ea4-8570-a7933374d772 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:44.601563 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3172/6326] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:10:44 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:10:44.607369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1318ce-f000-43c0-bae2-9ea03d180fb2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:44.609116 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3155/6327] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:10:44.612912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d6aa4-76a1-4ea4-8570-a7933374d772 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:44.623578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1318ce-f000-43c0-bae2-9ea03d180fb2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:44.630119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279dfba-c6fd-48f8-837d-cfb0bb9cd9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:44.630876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279dfba-c6fd-48f8-837d-cfb0bb9cd9af admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:44.631343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279dfba-c6fd-48f8-837d-cfb0bb9cd9af admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:44.631718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279dfba-c6fd-48f8-837d-cfb0bb9cd9af admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:44.632589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279dfba-c6fd-48f8-837d-cfb0bb9cd9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:44.633428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d6aa4-76a1-4ea4-8570-a7933374d772 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:44.634570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279dfba-c6fd-48f8-837d-cfb0bb9cd9af admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:44.641431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bc743-8955-4f73-ac08-bcd8a0a2eb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:44.642356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bc743-8955-4f73-ac08-bcd8a0a2eb29 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:44.642862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bc743-8955-4f73-ac08-bcd8a0a2eb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:44.643281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bc743-8955-4f73-ac08-bcd8a0a2eb29 admin admin] PATH_INFO: `/v3/projects/855e2081cefd47b08c6639095ad9f57f/users/a519d57f2d0f482b8ccfd66ae0699b74/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:44.651303 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3173/6328] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:44.654481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279dfba-c6fd-48f8-837d-cfb0bb9cd9af admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:44.666800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279dfba-c6fd-48f8-837d-cfb0bb9cd9af admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:44.689328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eead525-f4f3-4a4c-9206-fcc925bd7672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:44.689953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eead525-f4f3-4a4c-9206-fcc925bd7672 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:44.690233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eead525-f4f3-4a4c-9206-fcc925bd7672 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:44.690372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16bc743-8955-4f73-ac08-bcd8a0a2eb29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855e2081cefd47b08c6639095ad9f57f, user_id=a519d57f2d0f482b8ccfd66ae0699b74, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:44.690503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eead525-f4f3-4a4c-9206-fcc925bd7672 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:44.691155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eead525-f4f3-4a4c-9206-fcc925bd7672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:44.695664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eead525-f4f3-4a4c-9206-fcc925bd7672 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:44.699648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16bc743-8955-4f73-ac08-bcd8a0a2eb29 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:44.710909 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3174/6329] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:10:44.712574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eead525-f4f3-4a4c-9206-fcc925bd7672 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:44.731532 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3156/6330] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:44 2022] PUT /identity/v3/projects/855e2081cefd47b08c6639095ad9f57f/users/a519d57f2d0f482b8ccfd66ae0699b74/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:10:44.737778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eead525-f4f3-4a4c-9206-fcc925bd7672 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:44.739667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bc743-8955-4f73-ac08-bcd8a0a2eb29 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:44.839427 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:44.879190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae088196-4be9-4b00-b73f-86481b6720da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:44.882178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae088196-4be9-4b00-b73f-86481b6720da admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:44.882464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae088196-4be9-4b00-b73f-86481b6720da admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:44.882736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae088196-4be9-4b00-b73f-86481b6720da admin admin] PATH_INFO: `/v3/projects/7e5064adf8794d6795b456fa4811c7fd/users/26573c021b9f4c6ea54ee87dc4f38f68/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:44.884975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bc743-8955-4f73-ac08-bcd8a0a2eb29 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:44.899260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b24f1-03b4-4d64-884b-3cafae9064b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:44.899846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b24f1-03b4-4d64-884b-3cafae9064b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:44.900123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b24f1-03b4-4d64-884b-3cafae9064b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:44.900489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b24f1-03b4-4d64-884b-3cafae9064b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:44.904999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b24f1-03b4-4d64-884b-3cafae9064b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:44.908165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b24f1-03b4-4d64-884b-3cafae9064b7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:44.926630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae088196-4be9-4b00-b73f-86481b6720da admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e5064adf8794d6795b456fa4811c7fd, user_id=26573c021b9f4c6ea54ee87dc4f38f68, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:44.929546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae088196-4be9-4b00-b73f-86481b6720da admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:44.939528 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3157/6331] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:10:44.942544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b24f1-03b4-4d64-884b-3cafae9064b7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:44.955382 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3175/6332] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:44 2022] PUT /identity/v3/projects/7e5064adf8794d6795b456fa4811c7fd/users/26573c021b9f4c6ea54ee87dc4f38f68/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:44.966906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db10941-04df-4f87-9614-f5d84ada721c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:44.967280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db10941-04df-4f87-9614-f5d84ada721c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:44.967563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db10941-04df-4f87-9614-f5d84ada721c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:44.967670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b24f1-03b4-4d64-884b-3cafae9064b7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:45.028109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8db10941-04df-4f87-9614-f5d84ada721c None None] MFA Rules not processed for user `26573c021b9f4c6ea54ee87dc4f38f68`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:45.029471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8db10941-04df-4f87-9614-f5d84ada721c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:45.064800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfab487-a95e-4497-a158-4cef226067c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:45.065754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfab487-a95e-4497-a158-4cef226067c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:45.066224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfab487-a95e-4497-a158-4cef226067c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:45.067303 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfab487-a95e-4497-a158-4cef226067c7 admin admin] PATH_INFO: `/v3/projects/855e2081cefd47b08c6639095ad9f57f/users/a519d57f2d0f482b8ccfd66ae0699b74/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:45.070134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfab487-a95e-4497-a158-4cef226067c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855e2081cefd47b08c6639095ad9f57f, user_id=a519d57f2d0f482b8ccfd66ae0699b74, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:45.074228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfab487-a95e-4497-a158-4cef226067c7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:45.077890 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:45.094921 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3158/6333] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:44 2022] PUT /identity/v3/projects/855e2081cefd47b08c6639095ad9f57f/users/a519d57f2d0f482b8ccfd66ae0699b74/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:10:45.107656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a6279-9d00-46a6-9f7c-9af3782e9164 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:45.108321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a6279-9d00-46a6-9f7c-9af3782e9164 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:45.108321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a6279-9d00-46a6-9f7c-9af3782e9164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:45.180044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6b3a6279-9d00-46a6-9f7c-9af3782e9164 None None] MFA Rules not processed for user `a519d57f2d0f482b8ccfd66ae0699b74`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:45.181390 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3176/6334] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:45.183983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6b3a6279-9d00-46a6-9f7c-9af3782e9164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:45.199476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db10941-04df-4f87-9614-f5d84ada721c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:45.202795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8db10941-04df-4f87-9614-f5d84ada721c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:45.296152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db10941-04df-4f87-9614-f5d84ada721c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:45.309551 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3159/6335] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:45.324149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a6279-9d00-46a6-9f7c-9af3782e9164 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:45.325937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6b3a6279-9d00-46a6-9f7c-9af3782e9164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:45.384817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e024e4-fab2-4bca-92f6-de4420a7a77b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:45.385498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e024e4-fab2-4bca-92f6-de4420a7a77b service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:45.385777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e024e4-fab2-4bca-92f6-de4420a7a77b service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:45.386049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e024e4-fab2-4bca-92f6-de4420a7a77b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:45.409610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a6279-9d00-46a6-9f7c-9af3782e9164 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:45.414296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300df93-9bfc-459d-a90f-7994975162d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:45.415267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300df93-9bfc-459d-a90f-7994975162d1 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:45.415619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300df93-9bfc-459d-a90f-7994975162d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:45.416087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300df93-9bfc-459d-a90f-7994975162d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:45.421445 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:45.428812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300df93-9bfc-459d-a90f-7994975162d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:45.430576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300df93-9bfc-459d-a90f-7994975162d1 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:45.442206 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3160/6336] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:10:45.466845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e024e4-fab2-4bca-92f6-de4420a7a77b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:45.469450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e024e4-fab2-4bca-92f6-de4420a7a77b service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:45.489566 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3177/6337] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:45.513361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300df93-9bfc-459d-a90f-7994975162d1 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:45.528129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300df93-9bfc-459d-a90f-7994975162d1 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:45.532194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeff598-1989-43a9-8ad0-a04af2209c3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:45.533114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeff598-1989-43a9-8ad0-a04af2209c3e service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:45.533601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeff598-1989-43a9-8ad0-a04af2209c3e service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:45.534090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeff598-1989-43a9-8ad0-a04af2209c3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:45.608831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeff598-1989-43a9-8ad0-a04af2209c3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:45.611267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeff598-1989-43a9-8ad0-a04af2209c3e service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:45.623127 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3161/6338] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:48.211539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e024e4-fab2-4bca-92f6-de4420a7a77b service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:48.214529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-23e024e4-fab2-4bca-92f6-de4420a7a77b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:48.337486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708d283-fc52-434f-8e15-08b62928743e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:48.338593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708d283-fc52-434f-8e15-08b62928743e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:48.338912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708d283-fc52-434f-8e15-08b62928743e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:48.364662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e024e4-fab2-4bca-92f6-de4420a7a77b service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:48.374225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79d224-6b54-439e-b193-733d7e4035f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:48.374970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79d224-6b54-439e-b193-733d7e4035f6 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:48.375383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79d224-6b54-439e-b193-733d7e4035f6 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:48.376034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79d224-6b54-439e-b193-733d7e4035f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:48.378759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bb79d224-6b54-439e-b193-733d7e4035f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:48.390630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8708d283-fc52-434f-8e15-08b62928743e None None] MFA Rules not processed for user `26573c021b9f4c6ea54ee87dc4f38f68`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:48.394132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8708d283-fc52-434f-8e15-08b62928743e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:48.421559 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3162/6339] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:10:48.431012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79d224-6b54-439e-b193-733d7e4035f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:48.437659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79d224-6b54-439e-b193-733d7e4035f6 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:48.466858 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3178/6340] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:50.426234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708d283-fc52-434f-8e15-08b62928743e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:50.490479 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:50.643139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708d283-fc52-434f-8e15-08b62928743e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:50.667110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8f00a-4cdd-4a2e-a952-9794a341e6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:50.668964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8f00a-4cdd-4a2e-a952-9794a341e6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:50.669369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8f00a-4cdd-4a2e-a952-9794a341e6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:50.670691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8f00a-4cdd-4a2e-a952-9794a341e6bd admin admin] PATH_INFO: `/v3/users/a746b4eed1294d27a4c386e9926441d8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:50.674488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8f00a-4cdd-4a2e-a952-9794a341e6bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a746b4eed1294d27a4c386e9926441d8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:50.681473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8f00a-4cdd-4a2e-a952-9794a341e6bd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:50.812936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-75b8f00a-4cdd-4a2e-a952-9794a341e6bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a746b4eed1294d27a4c386e9926441d8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:50.849974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-75b8f00a-4cdd-4a2e-a952-9794a341e6bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a746b4eed1294d27a4c386e9926441d8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:50.851618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-75b8f00a-4cdd-4a2e-a952-9794a341e6bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a746b4eed1294d27a4c386e9926441d8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:50.884195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-75b8f00a-4cdd-4a2e-a952-9794a341e6bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a746b4eed1294d27a4c386e9926441d8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:50.905012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-75b8f00a-4cdd-4a2e-a952-9794a341e6bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a746b4eed1294d27a4c386e9926441d8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:50.925933 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3163/6341] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:10:50 2022] DELETE /identity/v3/users/a746b4eed1294d27a4c386e9926441d8 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:50.937705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73678410-647c-4420-81a0-6f0fa69fa22e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:50.937705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73678410-647c-4420-81a0-6f0fa69fa22e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:50.937705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73678410-647c-4420-81a0-6f0fa69fa22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:50.966412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-73678410-647c-4420-81a0-6f0fa69fa22e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:50.967783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-73678410-647c-4420-81a0-6f0fa69fa22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:51.111414 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3179/6342] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:51.270750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8f00a-4cdd-4a2e-a952-9794a341e6bd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:51.273705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-75b8f00a-4cdd-4a2e-a952-9794a341e6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:51.451882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8f00a-4cdd-4a2e-a952-9794a341e6bd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:51.457328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce2bac-3144-4279-9c4a-bfcd19b0210f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:51.458387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce2bac-3144-4279-9c4a-bfcd19b0210f service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:51.458876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce2bac-3144-4279-9c4a-bfcd19b0210f service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:51.459405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce2bac-3144-4279-9c4a-bfcd19b0210f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:51.486940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce2bac-3144-4279-9c4a-bfcd19b0210f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:51.489572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce2bac-3144-4279-9c4a-bfcd19b0210f service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:51.506470 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3164/6343] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:53.008497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73678410-647c-4420-81a0-6f0fa69fa22e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:53.010940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-73678410-647c-4420-81a0-6f0fa69fa22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:53.034924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73678410-647c-4420-81a0-6f0fa69fa22e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:53.045915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50046dd-affe-4e00-9c52-2cfbd3db4499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:53.047182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50046dd-affe-4e00-9c52-2cfbd3db4499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:53.048206 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50046dd-affe-4e00-9c52-2cfbd3db4499 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:53.049228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50046dd-affe-4e00-9c52-2cfbd3db4499 admin admin] PATH_INFO: `/v3/projects/7fd886189dbc4278ab6a990a49a32c63` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:53.050994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50046dd-affe-4e00-9c52-2cfbd3db4499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fd886189dbc4278ab6a990a49a32c63)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:53.053498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50046dd-affe-4e00-9c52-2cfbd3db4499 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:53.133312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b50046dd-affe-4e00-9c52-2cfbd3db4499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fd886189dbc4278ab6a990a49a32c63', 'request_id': 'req-b50046dd-affe-4e00-9c52-2cfbd3db4499'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:53.136516 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:53.149821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b50046dd-affe-4e00-9c52-2cfbd3db4499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fd886189dbc4278ab6a990a49a32c63', 'request_id': 'req-b50046dd-affe-4e00-9c52-2cfbd3db4499'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:53.157942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b50046dd-affe-4e00-9c52-2cfbd3db4499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fd886189dbc4278ab6a990a49a32c63', 'request_id': 'req-b50046dd-affe-4e00-9c52-2cfbd3db4499'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:53.176115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b50046dd-affe-4e00-9c52-2cfbd3db4499 admin admin] The token cache is being invalidate because project 7fd886189dbc4278ab6a990a49a32c63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:10:53.176774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b50046dd-affe-4e00-9c52-2cfbd3db4499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:53.177826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b50046dd-affe-4e00-9c52-2cfbd3db4499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:53.180027 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3180/6344] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:10:53 2022] DELETE /identity/v3/projects/7fd886189dbc4278ab6a990a49a32c63 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:53.184115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce2bac-3144-4279-9c4a-bfcd19b0210f service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:53.200167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce2bac-3144-4279-9c4a-bfcd19b0210f service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:53.241791 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:53.293688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8a3f0-f18a-4ba5-b481-e57163007d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:53.297564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8a3f0-f18a-4ba5-b481-e57163007d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:53.298316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8a3f0-f18a-4ba5-b481-e57163007d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:53.298865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8a3f0-f18a-4ba5-b481-e57163007d46 admin admin] PATH_INFO: `/v3/users/a519d57f2d0f482b8ccfd66ae0699b74` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:53.301600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8a3f0-f18a-4ba5-b481-e57163007d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a519d57f2d0f482b8ccfd66ae0699b74)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:53.304721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8a3f0-f18a-4ba5-b481-e57163007d46 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:53.383477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-23d8a3f0-f18a-4ba5-b481-e57163007d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a519d57f2d0f482b8ccfd66ae0699b74'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:53.397221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-23d8a3f0-f18a-4ba5-b481-e57163007d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a519d57f2d0f482b8ccfd66ae0699b74'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:53.398074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-23d8a3f0-f18a-4ba5-b481-e57163007d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a519d57f2d0f482b8ccfd66ae0699b74'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:53.421057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-23d8a3f0-f18a-4ba5-b481-e57163007d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a519d57f2d0f482b8ccfd66ae0699b74'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:53.431357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-23d8a3f0-f18a-4ba5-b481-e57163007d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a519d57f2d0f482b8ccfd66ae0699b74'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:53.442070 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3165/6345] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:10:53 2022] DELETE /identity/v3/users/a519d57f2d0f482b8ccfd66ae0699b74 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:55.164269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f9c0c-af18-4ebf-b296-804d6e567213 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:55.164768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f9c0c-af18-4ebf-b296-804d6e567213 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:55.164867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f9c0c-af18-4ebf-b296-804d6e567213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:55.241453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8a8f9c0c-af18-4ebf-b296-804d6e567213 None None] MFA Rules not processed for user `c0f97633b6e94bbea9169cb3a2717624`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:55.245421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8a8f9c0c-af18-4ebf-b296-804d6e567213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:55.409583 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3181/6346] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:55.418207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8a3f0-f18a-4ba5-b481-e57163007d46 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:55.420775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-23d8a3f0-f18a-4ba5-b481-e57163007d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:55.569571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8a3f0-f18a-4ba5-b481-e57163007d46 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:55.577421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5882583-301c-42c6-b5d0-c915d0634585 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:55.578355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5882583-301c-42c6-b5d0-c915d0634585 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:55.578841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5882583-301c-42c6-b5d0-c915d0634585 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:55.579452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5882583-301c-42c6-b5d0-c915d0634585 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:55.594525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5882583-301c-42c6-b5d0-c915d0634585 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:55.596764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5882583-301c-42c6-b5d0-c915d0634585 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:55.609432 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3166/6347] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:55.660953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f9c0c-af18-4ebf-b296-804d6e567213 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:55.662785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8a8f9c0c-af18-4ebf-b296-804d6e567213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:55.770495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f9c0c-af18-4ebf-b296-804d6e567213 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:55.779337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b7ac4-2c83-4355-9a06-dba4c4d64ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:55.780367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b7ac4-2c83-4355-9a06-dba4c4d64ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:55.780979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b7ac4-2c83-4355-9a06-dba4c4d64ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:55.781427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b7ac4-2c83-4355-9a06-dba4c4d64ac1 admin admin] PATH_INFO: `/v3/projects/855e2081cefd47b08c6639095ad9f57f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:55.783480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b7ac4-2c83-4355-9a06-dba4c4d64ac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=855e2081cefd47b08c6639095ad9f57f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:55.796863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b7ac4-2c83-4355-9a06-dba4c4d64ac1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:55.918093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e03b7ac4-2c83-4355-9a06-dba4c4d64ac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855e2081cefd47b08c6639095ad9f57f', 'request_id': 'req-e03b7ac4-2c83-4355-9a06-dba4c4d64ac1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:55.937329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e03b7ac4-2c83-4355-9a06-dba4c4d64ac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855e2081cefd47b08c6639095ad9f57f', 'request_id': 'req-e03b7ac4-2c83-4355-9a06-dba4c4d64ac1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:55.946436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e03b7ac4-2c83-4355-9a06-dba4c4d64ac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855e2081cefd47b08c6639095ad9f57f', 'request_id': 'req-e03b7ac4-2c83-4355-9a06-dba4c4d64ac1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:55.957240 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:55.969126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e03b7ac4-2c83-4355-9a06-dba4c4d64ac1 admin admin] The token cache is being invalidate because project 855e2081cefd47b08c6639095ad9f57f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:10:55.969790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e03b7ac4-2c83-4355-9a06-dba4c4d64ac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:55.971570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e03b7ac4-2c83-4355-9a06-dba4c4d64ac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:55.973835 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3182/6348] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:10:55 2022] DELETE /identity/v3/projects/855e2081cefd47b08c6639095ad9f57f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:55.978450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013f0e5-b616-4e7c-b5b2-87835b1e4c3b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:55.978883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013f0e5-b616-4e7c-b5b2-87835b1e4c3b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:55.979265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013f0e5-b616-4e7c-b5b2-87835b1e4c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:56.017931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9013f0e5-b616-4e7c-b5b2-87835b1e4c3b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:56.019635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9013f0e5-b616-4e7c-b5b2-87835b1e4c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:56.062306 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:56.201757 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3167/6349] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:56.209670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3856c87-61d9-4c78-a1c7-976748e6a017 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:56.210809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3856c87-61d9-4c78-a1c7-976748e6a017 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:56.211253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3856c87-61d9-4c78-a1c7-976748e6a017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:56.242061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f3856c87-61d9-4c78-a1c7-976748e6a017 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:56.243644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f3856c87-61d9-4c78-a1c7-976748e6a017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:56.256919 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3183/6350] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:56.261517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013f0e5-b616-4e7c-b5b2-87835b1e4c3b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:56.284078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013f0e5-b616-4e7c-b5b2-87835b1e4c3b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:56.294268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fed77-4356-4283-bbc3-050b4840bd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:56.295864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fed77-4356-4283-bbc3-050b4840bd33 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:56.298233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fed77-4356-4283-bbc3-050b4840bd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:56.299593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fed77-4356-4283-bbc3-050b4840bd33 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:56.301820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fed77-4356-4283-bbc3-050b4840bd33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:10:56.302773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fed77-4356-4283-bbc3-050b4840bd33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:56.304708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fed77-4356-4283-bbc3-050b4840bd33 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:56.336297 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3168/6351] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:10:56.337677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3856c87-61d9-4c78-a1c7-976748e6a017 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:56.355681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3856c87-61d9-4c78-a1c7-976748e6a017 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:56.365315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8586bc2-fd8f-4c40-9b9f-9622e1fe984d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:56.366770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8586bc2-fd8f-4c40-9b9f-9622e1fe984d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:56.366770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8586bc2-fd8f-4c40-9b9f-9622e1fe984d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:56.366770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8586bc2-fd8f-4c40-9b9f-9622e1fe984d admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:56.367378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8586bc2-fd8f-4c40-9b9f-9622e1fe984d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:56.374099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8586bc2-fd8f-4c40-9b9f-9622e1fe984d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:56.438911 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3184/6352] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:10:56 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:56.440145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fed77-4356-4283-bbc3-050b4840bd33 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:56.458815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fed77-4356-4283-bbc3-050b4840bd33 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:56.546102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deba955-0ccf-447b-b693-2f5482528dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:56.546879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deba955-0ccf-447b-b693-2f5482528dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:56.547220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deba955-0ccf-447b-b693-2f5482528dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:56.547626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deba955-0ccf-447b-b693-2f5482528dd8 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:56.548217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deba955-0ccf-447b-b693-2f5482528dd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:56.550261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deba955-0ccf-447b-b693-2f5482528dd8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:56.615393 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3169/6353] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:10:56 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:56.616591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8586bc2-fd8f-4c40-9b9f-9622e1fe984d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:56.636279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8586bc2-fd8f-4c40-9b9f-9622e1fe984d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:56.669968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d6f8f-35ba-4640-afcf-6c4118524f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:56.670614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d6f8f-35ba-4640-afcf-6c4118524f22 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:56.670903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d6f8f-35ba-4640-afcf-6c4118524f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:56.671196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d6f8f-35ba-4640-afcf-6c4118524f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:56.671912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d6f8f-35ba-4640-afcf-6c4118524f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:56.673526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d6f8f-35ba-4640-afcf-6c4118524f22 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:56.693660 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3185/6354] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:56.698014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deba955-0ccf-447b-b693-2f5482528dd8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:56.710311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deba955-0ccf-447b-b693-2f5482528dd8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:56.722000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcff41-30ce-40a3-b01a-1a91e7d10c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:56.723182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcff41-30ce-40a3-b01a-1a91e7d10c13 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:56.723664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcff41-30ce-40a3-b01a-1a91e7d10c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:56.724345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcff41-30ce-40a3-b01a-1a91e7d10c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:56.725299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dcff41-30ce-40a3-b01a-1a91e7d10c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:56.727588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dcff41-30ce-40a3-b01a-1a91e7d10c13 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:56.751779 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3170/6355] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:56.755807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d6f8f-35ba-4640-afcf-6c4118524f22 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:56.782638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d6f8f-35ba-4640-afcf-6c4118524f22 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:56.790117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21b4ee-867f-4814-a59b-f923c6a07421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:56.791247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21b4ee-867f-4814-a59b-f923c6a07421 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:56.791705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21b4ee-867f-4814-a59b-f923c6a07421 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:56.792134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21b4ee-867f-4814-a59b-f923c6a07421 admin admin] PATH_INFO: `/v3/projects/ca384a47cb1a41e5878679f8dab38439/users/bf0d39fff25f40638b016937c0ee3be0/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:56.833044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21b4ee-867f-4814-a59b-f923c6a07421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca384a47cb1a41e5878679f8dab38439, user_id=bf0d39fff25f40638b016937c0ee3be0, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:56.857697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21b4ee-867f-4814-a59b-f923c6a07421 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:56.901165 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3186/6356] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:56 2022] PUT /identity/v3/projects/ca384a47cb1a41e5878679f8dab38439/users/bf0d39fff25f40638b016937c0ee3be0/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:56.912695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d786d-274a-41f0-a9af-f025463f2b72 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:56.912939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d786d-274a-41f0-a9af-f025463f2b72 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:56.913214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d786d-274a-41f0-a9af-f025463f2b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:56.963211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8d0d786d-274a-41f0-a9af-f025463f2b72 None None] MFA Rules not processed for user `bf0d39fff25f40638b016937c0ee3be0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:56.964690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8d0d786d-274a-41f0-a9af-f025463f2b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:57.086846 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3171/6357] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:57.088658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21b4ee-867f-4814-a59b-f923c6a07421 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:57.227342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21b4ee-867f-4814-a59b-f923c6a07421 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:57.234263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d61b4-b324-41f7-887e-d5fb72a1af3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:57.235534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d61b4-b324-41f7-887e-d5fb72a1af3b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:57.235919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d61b4-b324-41f7-887e-d5fb72a1af3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:57.236312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d61b4-b324-41f7-887e-d5fb72a1af3b admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:57.237562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d61b4-b324-41f7-887e-d5fb72a1af3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:57.241743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d61b4-b324-41f7-887e-d5fb72a1af3b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:57.320749 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3187/6358] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:10:57 2022] POST /identity/v3/projects => generated 383 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:57.321669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d786d-274a-41f0-a9af-f025463f2b72 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:57.344189 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d786d-274a-41f0-a9af-f025463f2b72 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:57.382628 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:57.550044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690023c5-c555-411d-8b4e-d270ccbb5b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:57.550862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690023c5-c555-411d-8b4e-d270ccbb5b94 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:57.551143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690023c5-c555-411d-8b4e-d270ccbb5b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:57.551696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690023c5-c555-411d-8b4e-d270ccbb5b94 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:57.552632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690023c5-c555-411d-8b4e-d270ccbb5b94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:57.554825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690023c5-c555-411d-8b4e-d270ccbb5b94 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:57.609539 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3172/6359] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:10:57 2022] POST /identity/v3/users => generated 298 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:10:57.615462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d61b4-b324-41f7-887e-d5fb72a1af3b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:57.664736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d61b4-b324-41f7-887e-d5fb72a1af3b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:57.673284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab095e4-10f0-4a1c-8e29-d21cfab806ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:57.673918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab095e4-10f0-4a1c-8e29-d21cfab806ea admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:57.674198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab095e4-10f0-4a1c-8e29-d21cfab806ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:57.674470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab095e4-10f0-4a1c-8e29-d21cfab806ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:57.675118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab095e4-10f0-4a1c-8e29-d21cfab806ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:57.676760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab095e4-10f0-4a1c-8e29-d21cfab806ea admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:57.708841 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3188/6360] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:57.712748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690023c5-c555-411d-8b4e-d270ccbb5b94 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:57.727886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690023c5-c555-411d-8b4e-d270ccbb5b94 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:57.742518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03163f89-97a0-46ec-b22a-9542d00aa2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:57.743208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03163f89-97a0-46ec-b22a-9542d00aa2c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:57.743487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03163f89-97a0-46ec-b22a-9542d00aa2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:57.743878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03163f89-97a0-46ec-b22a-9542d00aa2c1 admin admin] PATH_INFO: `/v3/projects/67654486d8274cfda513cee6969f6188/users/f9fe351993f74e84b5c3f16918074d54/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:57.780657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03163f89-97a0-46ec-b22a-9542d00aa2c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67654486d8274cfda513cee6969f6188, user_id=f9fe351993f74e84b5c3f16918074d54, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:57.783468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03163f89-97a0-46ec-b22a-9542d00aa2c1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:57.820114 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3173/6361] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:57 2022] PUT /identity/v3/projects/67654486d8274cfda513cee6969f6188/users/f9fe351993f74e84b5c3f16918074d54/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:57.820388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab095e4-10f0-4a1c-8e29-d21cfab806ea admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:57.835080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab095e4-10f0-4a1c-8e29-d21cfab806ea admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:57.955230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561fd2a-aa20-42fb-b3aa-f5e5f3db4334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:57.956369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561fd2a-aa20-42fb-b3aa-f5e5f3db4334 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:57.956906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561fd2a-aa20-42fb-b3aa-f5e5f3db4334 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:57.957388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561fd2a-aa20-42fb-b3aa-f5e5f3db4334 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:57.960329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561fd2a-aa20-42fb-b3aa-f5e5f3db4334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:57.962311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561fd2a-aa20-42fb-b3aa-f5e5f3db4334 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:57.988653 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3189/6362] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:10:57.992559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03163f89-97a0-46ec-b22a-9542d00aa2c1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:58.005908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03163f89-97a0-46ec-b22a-9542d00aa2c1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:58.014386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a6a56-f62e-4212-b242-8b36eb780777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:58.015076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a6a56-f62e-4212-b242-8b36eb780777 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:58.015349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a6a56-f62e-4212-b242-8b36eb780777 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:58.015631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a6a56-f62e-4212-b242-8b36eb780777 admin admin] PATH_INFO: `/v3/projects/67654486d8274cfda513cee6969f6188/users/f9fe351993f74e84b5c3f16918074d54/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:58.018606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a6a56-f62e-4212-b242-8b36eb780777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67654486d8274cfda513cee6969f6188, user_id=f9fe351993f74e84b5c3f16918074d54, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:58.024190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a6a56-f62e-4212-b242-8b36eb780777 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:58.058044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec18d7-d1fc-449e-bb9c-7196cfec3282 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:58.063176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec18d7-d1fc-449e-bb9c-7196cfec3282 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:58.065321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec18d7-d1fc-449e-bb9c-7196cfec3282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:58.075362 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3174/6363] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:10:57 2022] PUT /identity/v3/projects/67654486d8274cfda513cee6969f6188/users/f9fe351993f74e84b5c3f16918074d54/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:58.086093 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:58.115754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-78ec18d7-d1fc-449e-bb9c-7196cfec3282 None None] MFA Rules not processed for user `f9fe351993f74e84b5c3f16918074d54`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:58.117730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-78ec18d7-d1fc-449e-bb9c-7196cfec3282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:58.324489 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3190/6364] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:58.337358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a6a56-f62e-4212-b242-8b36eb780777 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:58.340257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8b4a6a56-f62e-4212-b242-8b36eb780777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:58.408867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec18d7-d1fc-449e-bb9c-7196cfec3282 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:58.411087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-78ec18d7-d1fc-449e-bb9c-7196cfec3282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:58.504917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a6a56-f62e-4212-b242-8b36eb780777 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:58.519693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688cfa-53d2-4ce1-ac57-1a680a4017cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:58.523239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688cfa-53d2-4ce1-ac57-1a680a4017cf service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:58.524761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688cfa-53d2-4ce1-ac57-1a680a4017cf service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:58.525137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688cfa-53d2-4ce1-ac57-1a680a4017cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:58.559152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8688cfa-53d2-4ce1-ac57-1a680a4017cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:58.569224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8688cfa-53d2-4ce1-ac57-1a680a4017cf service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:58.596171 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3175/6365] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:58.635191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec18d7-d1fc-449e-bb9c-7196cfec3282 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:58.669954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f0519-5b01-4879-96f0-5fc9f5194a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:58.676356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f0519-5b01-4879-96f0-5fc9f5194a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:58.676814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f0519-5b01-4879-96f0-5fc9f5194a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:58.677098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f0519-5b01-4879-96f0-5fc9f5194a55 admin admin] PATH_INFO: `/v3/users/04a731cedce8403fb170d7dc8aa57aa7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:58.678486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f0519-5b01-4879-96f0-5fc9f5194a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04a731cedce8403fb170d7dc8aa57aa7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:58.680449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f0519-5b01-4879-96f0-5fc9f5194a55 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:58.822960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688cfa-53d2-4ce1-ac57-1a680a4017cf service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:58.837239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688cfa-53d2-4ce1-ac57-1a680a4017cf service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:58.862028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef93e9-36a2-4e91-a730-626584fb6e37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:58.862511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef93e9-36a2-4e91-a730-626584fb6e37 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:58.862794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef93e9-36a2-4e91-a730-626584fb6e37 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:58.863070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef93e9-36a2-4e91-a730-626584fb6e37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:58.887327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ac2f0519-5b01-4879-96f0-5fc9f5194a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04a731cedce8403fb170d7dc8aa57aa7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:58.888165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ac2f0519-5b01-4879-96f0-5fc9f5194a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04a731cedce8403fb170d7dc8aa57aa7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:58.930183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ac2f0519-5b01-4879-96f0-5fc9f5194a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04a731cedce8403fb170d7dc8aa57aa7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:58.966169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ac2f0519-5b01-4879-96f0-5fc9f5194a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04a731cedce8403fb170d7dc8aa57aa7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:58.982500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ac2f0519-5b01-4879-96f0-5fc9f5194a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04a731cedce8403fb170d7dc8aa57aa7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:10:59.011556 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3191/6366] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:10:58 2022] DELETE /identity/v3/users/04a731cedce8403fb170d7dc8aa57aa7 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:10:59.014835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11499f92-688d-4d4d-afaf-c9a95ef4ab65 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:59.014835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11499f92-688d-4d4d-afaf-c9a95ef4ab65 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:59.015123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11499f92-688d-4d4d-afaf-c9a95ef4ab65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:59.081296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-11499f92-688d-4d4d-afaf-c9a95ef4ab65 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:10:59.082437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-11499f92-688d-4d4d-afaf-c9a95ef4ab65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:59.099067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef93e9-36a2-4e91-a730-626584fb6e37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:59.100535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef93e9-36a2-4e91-a730-626584fb6e37 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:59.109985 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:59.138163 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3176/6367] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:10:59.255682 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3192/6368] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:10:59.344293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef93e9-36a2-4e91-a730-626584fb6e37 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:10:59.345860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eeef93e9-36a2-4e91-a730-626584fb6e37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:10:59.376842 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:10:59.511797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef93e9-36a2-4e91-a730-626584fb6e37 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:10:59.627753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfd723-40c9-4720-a8ca-e08230b29ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:10:59.628778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfd723-40c9-4720-a8ca-e08230b29ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:10:59.640430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfd723-40c9-4720-a8ca-e08230b29ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:10:59.645146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfd723-40c9-4720-a8ca-e08230b29ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:10:59.677608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfd723-40c9-4720-a8ca-e08230b29ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:10:59.686571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfd723-40c9-4720-a8ca-e08230b29ab0 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:10:59.722573 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3177/6369] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:10:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:11:01.147943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11499f92-688d-4d4d-afaf-c9a95ef4ab65 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:01.152664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-11499f92-688d-4d4d-afaf-c9a95ef4ab65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:01.186485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11499f92-688d-4d4d-afaf-c9a95ef4ab65 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:01.256359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349a1df-1be5-4c92-8425-d36913fa9b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:01.258637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349a1df-1be5-4c92-8425-d36913fa9b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:01.260133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349a1df-1be5-4c92-8425-d36913fa9b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:01.260421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349a1df-1be5-4c92-8425-d36913fa9b5f admin admin] PATH_INFO: `/v3/projects/806aefe78f6b447f98b6e5e45385568a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:01.266692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c349a1df-1be5-4c92-8425-d36913fa9b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=806aefe78f6b447f98b6e5e45385568a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:01.279312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c349a1df-1be5-4c92-8425-d36913fa9b5f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:01.445872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c349a1df-1be5-4c92-8425-d36913fa9b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '806aefe78f6b447f98b6e5e45385568a', 'request_id': 'req-c349a1df-1be5-4c92-8425-d36913fa9b5f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:01.465519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c349a1df-1be5-4c92-8425-d36913fa9b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '806aefe78f6b447f98b6e5e45385568a', 'request_id': 'req-c349a1df-1be5-4c92-8425-d36913fa9b5f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:01.476753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c349a1df-1be5-4c92-8425-d36913fa9b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '806aefe78f6b447f98b6e5e45385568a', 'request_id': 'req-c349a1df-1be5-4c92-8425-d36913fa9b5f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:01.505343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c349a1df-1be5-4c92-8425-d36913fa9b5f admin admin] The token cache is being invalidate because project 806aefe78f6b447f98b6e5e45385568a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:11:01.505690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c349a1df-1be5-4c92-8425-d36913fa9b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:01.507037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c349a1df-1be5-4c92-8425-d36913fa9b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:01.513144 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3193/6370] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:11:01 2022] DELETE /identity/v3/projects/806aefe78f6b447f98b6e5e45385568a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:01.517829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5398e-1c9f-4079-b437-0664047bc89b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:01.518310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5398e-1c9f-4079-b437-0664047bc89b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:01.518391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5398e-1c9f-4079-b437-0664047bc89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:01.577204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-97d5398e-1c9f-4079-b437-0664047bc89b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:01.582654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-97d5398e-1c9f-4079-b437-0664047bc89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:01.760333 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3178/6371] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:01.770141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a1912-e8cd-4b5a-968c-78f4e412f417 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:01.770551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a1912-e8cd-4b5a-968c-78f4e412f417 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:01.770924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a1912-e8cd-4b5a-968c-78f4e412f417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:01.817261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c54a1912-e8cd-4b5a-968c-78f4e412f417 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:01.818846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c54a1912-e8cd-4b5a-968c-78f4e412f417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:01.845139 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3194/6372] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:01.847275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5398e-1c9f-4079-b437-0664047bc89b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:01.863695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5398e-1c9f-4079-b437-0664047bc89b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:01.920181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c928a-70c6-4535-bc86-1042d4bc799f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:01.920847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c928a-70c6-4535-bc86-1042d4bc799f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:01.921125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c928a-70c6-4535-bc86-1042d4bc799f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:01.921393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c928a-70c6-4535-bc86-1042d4bc799f admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:01.922063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c928a-70c6-4535-bc86-1042d4bc799f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:11:01.925433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c928a-70c6-4535-bc86-1042d4bc799f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:01.929438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c928a-70c6-4535-bc86-1042d4bc799f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:01.998351 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3179/6373] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:11:02.002165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a1912-e8cd-4b5a-968c-78f4e412f417 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:02.014580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a1912-e8cd-4b5a-968c-78f4e412f417 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:02.059810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2dcb8-24c7-4fa3-9aa0-ea20e7432a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:02.065511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2dcb8-24c7-4fa3-9aa0-ea20e7432a60 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:02.065795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2dcb8-24c7-4fa3-9aa0-ea20e7432a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:02.066107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2dcb8-24c7-4fa3-9aa0-ea20e7432a60 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:02.066776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2dcb8-24c7-4fa3-9aa0-ea20e7432a60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:02.089948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2dcb8-24c7-4fa3-9aa0-ea20e7432a60 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:02.231393 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3195/6374] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:11:02 2022] POST /identity/v3/projects => generated 379 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:11:02.237783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c928a-70c6-4535-bc86-1042d4bc799f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:02.253063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c928a-70c6-4535-bc86-1042d4bc799f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:02.360957 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:02.369594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27246479-50d4-4c93-a6a7-c256464bc477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:02.370449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27246479-50d4-4c93-a6a7-c256464bc477 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:02.370698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27246479-50d4-4c93-a6a7-c256464bc477 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:02.371012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27246479-50d4-4c93-a6a7-c256464bc477 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:02.371979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27246479-50d4-4c93-a6a7-c256464bc477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:02.374028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27246479-50d4-4c93-a6a7-c256464bc477 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:02.435849 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3180/6375] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:11:02 2022] POST /identity/v3/users => generated 290 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:11:02.438185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2dcb8-24c7-4fa3-9aa0-ea20e7432a60 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:02.452513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2dcb8-24c7-4fa3-9aa0-ea20e7432a60 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:02.472409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28689a-2519-4daf-8789-ecd282b54591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:02.473987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28689a-2519-4daf-8789-ecd282b54591 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:02.474469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28689a-2519-4daf-8789-ecd282b54591 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:02.475462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28689a-2519-4daf-8789-ecd282b54591 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:02.476370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28689a-2519-4daf-8789-ecd282b54591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:02.478769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28689a-2519-4daf-8789-ecd282b54591 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:02.504453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27246479-50d4-4c93-a6a7-c256464bc477 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:02.512716 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3196/6376] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:11:02.533650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27246479-50d4-4c93-a6a7-c256464bc477 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:02.544087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5194d5-3d10-47e7-a000-8f908819d17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:02.548227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5194d5-3d10-47e7-a000-8f908819d17d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:02.548507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5194d5-3d10-47e7-a000-8f908819d17d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:02.549038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5194d5-3d10-47e7-a000-8f908819d17d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:02.550410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5194d5-3d10-47e7-a000-8f908819d17d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:02.552739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5194d5-3d10-47e7-a000-8f908819d17d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:02.580145 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3181/6377] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:11:02.581082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28689a-2519-4daf-8789-ecd282b54591 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:02.602168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28689a-2519-4daf-8789-ecd282b54591 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:02.613353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff2035-2463-42e7-b123-cff0358d5860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:02.615767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff2035-2463-42e7-b123-cff0358d5860 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:02.618489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff2035-2463-42e7-b123-cff0358d5860 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:02.620040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff2035-2463-42e7-b123-cff0358d5860 admin admin] PATH_INFO: `/v3/projects/b17700747d0d4daa82966aa2ad3b26b0/users/eb7f1384595648c4b3ef3148dae0791a/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:02.676075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff2035-2463-42e7-b123-cff0358d5860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b17700747d0d4daa82966aa2ad3b26b0, user_id=eb7f1384595648c4b3ef3148dae0791a, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:02.688213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff2035-2463-42e7-b123-cff0358d5860 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:02.733413 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3197/6378] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:11:02 2022] PUT /identity/v3/projects/b17700747d0d4daa82966aa2ad3b26b0/users/eb7f1384595648c4b3ef3148dae0791a/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:02.741713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7f701-a664-41f5-943f-925759662338 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:02.742099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7f701-a664-41f5-943f-925759662338 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:02.742472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7f701-a664-41f5-943f-925759662338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:02.788403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-09b7f701-a664-41f5-943f-925759662338 None None] MFA Rules not processed for user `eb7f1384595648c4b3ef3148dae0791a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:02.790689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-09b7f701-a664-41f5-943f-925759662338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:02.936844 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3182/6379] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:02.953488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff2035-2463-42e7-b123-cff0358d5860 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:02.956022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ceff2035-2463-42e7-b123-cff0358d5860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:03.048185 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:03.164040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff2035-2463-42e7-b123-cff0358d5860 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:03.171086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18549ebc-20e8-46d2-b6e4-204cd0db242e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:03.171086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18549ebc-20e8-46d2-b6e4-204cd0db242e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:03.171086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18549ebc-20e8-46d2-b6e4-204cd0db242e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:03.171469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18549ebc-20e8-46d2-b6e4-204cd0db242e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:03.182253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18549ebc-20e8-46d2-b6e4-204cd0db242e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:03.183934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18549ebc-20e8-46d2-b6e4-204cd0db242e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:03.195753 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3198/6380] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:11:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:11:03.213558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7f701-a664-41f5-943f-925759662338 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:03.339929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7f701-a664-41f5-943f-925759662338 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:03.348711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807c609-0e1f-406f-90c2-0e3361929028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:03.349434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807c609-0e1f-406f-90c2-0e3361929028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:03.349867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807c609-0e1f-406f-90c2-0e3361929028 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:03.350421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807c609-0e1f-406f-90c2-0e3361929028 admin admin] PATH_INFO: `/v3/users/eb7f1384595648c4b3ef3148dae0791a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:03.351960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807c609-0e1f-406f-90c2-0e3361929028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb7f1384595648c4b3ef3148dae0791a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:03.356132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807c609-0e1f-406f-90c2-0e3361929028 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:03.481573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e807c609-0e1f-406f-90c2-0e3361929028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb7f1384595648c4b3ef3148dae0791a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:03.497896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e807c609-0e1f-406f-90c2-0e3361929028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb7f1384595648c4b3ef3148dae0791a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:03.499395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e807c609-0e1f-406f-90c2-0e3361929028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb7f1384595648c4b3ef3148dae0791a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:03.545147 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:03.556517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e807c609-0e1f-406f-90c2-0e3361929028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb7f1384595648c4b3ef3148dae0791a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:03.579632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e807c609-0e1f-406f-90c2-0e3361929028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb7f1384595648c4b3ef3148dae0791a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:03.595416 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3183/6381] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:11:03 2022] DELETE /identity/v3/users/eb7f1384595648c4b3ef3148dae0791a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:03.607169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06702250-10e3-4777-9210-368ba78bea24 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:03.608222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06702250-10e3-4777-9210-368ba78bea24 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:03.608765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06702250-10e3-4777-9210-368ba78bea24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:03.634042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-06702250-10e3-4777-9210-368ba78bea24 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:03.635876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-06702250-10e3-4777-9210-368ba78bea24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:03.739150 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3199/6382] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:03.739600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807c609-0e1f-406f-90c2-0e3361929028 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:03.741215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e807c609-0e1f-406f-90c2-0e3361929028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:03.897108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807c609-0e1f-406f-90c2-0e3361929028 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:03.902953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69e8c7-27c0-4b01-87ef-d441eade6992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:03.903800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69e8c7-27c0-4b01-87ef-d441eade6992 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:03.904158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69e8c7-27c0-4b01-87ef-d441eade6992 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:03.904495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69e8c7-27c0-4b01-87ef-d441eade6992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:03.927079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69e8c7-27c0-4b01-87ef-d441eade6992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:03.928825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69e8c7-27c0-4b01-87ef-d441eade6992 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:03.941770 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3184/6383] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:11:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:11:04.762385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dda733-f01d-4bf3-b060-2996f572028e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:04.762933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dda733-f01d-4bf3-b060-2996f572028e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:04.762933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dda733-f01d-4bf3-b060-2996f572028e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:04.798337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-44dda733-f01d-4bf3-b060-2996f572028e None None] MFA Rules not processed for user `c0f97633b6e94bbea9169cb3a2717624`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:04.799641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-44dda733-f01d-4bf3-b060-2996f572028e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:04.896113 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3200/6384] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:05.522653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69e8c7-27c0-4b01-87ef-d441eade6992 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:05.528264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4e69e8c7-27c0-4b01-87ef-d441eade6992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:05.557767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69e8c7-27c0-4b01-87ef-d441eade6992 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:05.577946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cd04d-63ff-4334-b773-014d042fde48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:05.581066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cd04d-63ff-4334-b773-014d042fde48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:05.583137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cd04d-63ff-4334-b773-014d042fde48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:05.583892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cd04d-63ff-4334-b773-014d042fde48 admin admin] PATH_INFO: `/v3/projects/b17700747d0d4daa82966aa2ad3b26b0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:05.601086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cd04d-63ff-4334-b773-014d042fde48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b17700747d0d4daa82966aa2ad3b26b0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:05.601086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cd04d-63ff-4334-b773-014d042fde48 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:05.826308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-221cd04d-63ff-4334-b773-014d042fde48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b17700747d0d4daa82966aa2ad3b26b0', 'request_id': 'req-221cd04d-63ff-4334-b773-014d042fde48'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:05.848791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-221cd04d-63ff-4334-b773-014d042fde48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b17700747d0d4daa82966aa2ad3b26b0', 'request_id': 'req-221cd04d-63ff-4334-b773-014d042fde48'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:05.868407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-221cd04d-63ff-4334-b773-014d042fde48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b17700747d0d4daa82966aa2ad3b26b0', 'request_id': 'req-221cd04d-63ff-4334-b773-014d042fde48'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:05.892665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-221cd04d-63ff-4334-b773-014d042fde48 admin admin] The token cache is being invalidate because project b17700747d0d4daa82966aa2ad3b26b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:11:05.893204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-221cd04d-63ff-4334-b773-014d042fde48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:05.894091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-221cd04d-63ff-4334-b773-014d042fde48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:05.904054 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3185/6385] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:11:05 2022] DELETE /identity/v3/projects/b17700747d0d4daa82966aa2ad3b26b0 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:05.909390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748be163-c55b-485c-816f-04b0cdab85cf None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:05.910367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748be163-c55b-485c-816f-04b0cdab85cf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:05.911649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748be163-c55b-485c-816f-04b0cdab85cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:05.950653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-748be163-c55b-485c-816f-04b0cdab85cf None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:05.952587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-748be163-c55b-485c-816f-04b0cdab85cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:06.107982 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3201/6386] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:11:06.115415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229b05c-7c15-47c9-9d1b-88d77ca53adc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:06.115768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229b05c-7c15-47c9-9d1b-88d77ca53adc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:06.116107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229b05c-7c15-47c9-9d1b-88d77ca53adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:06.161196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6229b05c-7c15-47c9-9d1b-88d77ca53adc None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:06.162790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6229b05c-7c15-47c9-9d1b-88d77ca53adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:06.185920 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3186/6387] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:06.189875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748be163-c55b-485c-816f-04b0cdab85cf None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:06.206893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748be163-c55b-485c-816f-04b0cdab85cf None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:06.223317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010330a-c29d-4974-ab73-e3186f417622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:06.224038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010330a-c29d-4974-ab73-e3186f417622 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:06.224387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010330a-c29d-4974-ab73-e3186f417622 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:06.224754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010330a-c29d-4974-ab73-e3186f417622 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:06.226035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010330a-c29d-4974-ab73-e3186f417622 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:11:06.226540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010330a-c29d-4974-ab73-e3186f417622 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:06.228458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010330a-c29d-4974-ab73-e3186f417622 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:06.231714 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:06.250993 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3202/6388] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:11:06.260334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229b05c-7c15-47c9-9d1b-88d77ca53adc None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:06.278797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229b05c-7c15-47c9-9d1b-88d77ca53adc None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:06.300637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a415e-f5ee-4b43-9c67-a5f7c1710333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:06.302062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a415e-f5ee-4b43-9c67-a5f7c1710333 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:06.309545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a415e-f5ee-4b43-9c67-a5f7c1710333 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:06.310114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a415e-f5ee-4b43-9c67-a5f7c1710333 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:06.311923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a415e-f5ee-4b43-9c67-a5f7c1710333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:06.317878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a415e-f5ee-4b43-9c67-a5f7c1710333 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:06.386398 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3187/6389] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:11:06 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:11:06.391362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010330a-c29d-4974-ab73-e3186f417622 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:06.403436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010330a-c29d-4974-ab73-e3186f417622 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:06.567482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b85b10-f9fc-40d6-9625-6194dfbeae63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:06.568244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b85b10-f9fc-40d6-9625-6194dfbeae63 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:06.568815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b85b10-f9fc-40d6-9625-6194dfbeae63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:06.569191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b85b10-f9fc-40d6-9625-6194dfbeae63 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:06.569947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b85b10-f9fc-40d6-9625-6194dfbeae63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:06.573350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b85b10-f9fc-40d6-9625-6194dfbeae63 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:06.608644 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3203/6390] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:11:06 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:11:06.613353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a415e-f5ee-4b43-9c67-a5f7c1710333 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:06.636028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a415e-f5ee-4b43-9c67-a5f7c1710333 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:06.653187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6661f-97af-4bea-9891-0d3effbf0801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:06.654101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6661f-97af-4bea-9891-0d3effbf0801 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:06.655411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6661f-97af-4bea-9891-0d3effbf0801 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:06.655694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6661f-97af-4bea-9891-0d3effbf0801 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:06.656359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6661f-97af-4bea-9891-0d3effbf0801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:06.660471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6661f-97af-4bea-9891-0d3effbf0801 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:06.698606 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3188/6391] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:11:06.699412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b85b10-f9fc-40d6-9625-6194dfbeae63 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:06.720472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b85b10-f9fc-40d6-9625-6194dfbeae63 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:06.745489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70019726-f8fd-4553-887b-113aef642b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:06.746266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70019726-f8fd-4553-887b-113aef642b14 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:06.747790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70019726-f8fd-4553-887b-113aef642b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:06.748154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70019726-f8fd-4553-887b-113aef642b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:06.749023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70019726-f8fd-4553-887b-113aef642b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:06.756751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70019726-f8fd-4553-887b-113aef642b14 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:06.804923 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3204/6392] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:11:06.806742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6661f-97af-4bea-9891-0d3effbf0801 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:06.819619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6661f-97af-4bea-9891-0d3effbf0801 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:06.833846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db206f36-92f4-4675-a9c0-12d2191aa045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:06.834531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db206f36-92f4-4675-a9c0-12d2191aa045 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:06.839235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db206f36-92f4-4675-a9c0-12d2191aa045 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:06.839536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db206f36-92f4-4675-a9c0-12d2191aa045 admin admin] PATH_INFO: `/v3/projects/5d9ea30a06e74489846c66efb845e162/users/4756ee56166f493ab4c3ac8b5f9648b0/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:06.902543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db206f36-92f4-4675-a9c0-12d2191aa045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9ea30a06e74489846c66efb845e162, user_id=4756ee56166f493ab4c3ac8b5f9648b0, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:06.920344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db206f36-92f4-4675-a9c0-12d2191aa045 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:06.978270 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3189/6393] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:11:06 2022] PUT /identity/v3/projects/5d9ea30a06e74489846c66efb845e162/users/4756ee56166f493ab4c3ac8b5f9648b0/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:06.979787 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a25571-6dfa-466e-943e-136479720228 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:06.980273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a25571-6dfa-466e-943e-136479720228 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:06.980775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a25571-6dfa-466e-943e-136479720228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:07.107208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-37a25571-6dfa-466e-943e-136479720228 None None] MFA Rules not processed for user `4756ee56166f493ab4c3ac8b5f9648b0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:07.123294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-37a25571-6dfa-466e-943e-136479720228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:07.360098 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3205/6394] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:11:07.388510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db206f36-92f4-4675-a9c0-12d2191aa045 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:07.392628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-db206f36-92f4-4675-a9c0-12d2191aa045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:07.441152 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:07.678373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db206f36-92f4-4675-a9c0-12d2191aa045 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:07.694347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3064cb1-197f-4876-91ca-255ee1f1c3ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:07.696574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3064cb1-197f-4876-91ca-255ee1f1c3ff service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:07.698915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3064cb1-197f-4876-91ca-255ee1f1c3ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:07.699562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3064cb1-197f-4876-91ca-255ee1f1c3ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:07.750307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3064cb1-197f-4876-91ca-255ee1f1c3ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:07.755068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3064cb1-197f-4876-91ca-255ee1f1c3ff service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:07.785150 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3190/6395] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:11:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:11:08.407701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a25571-6dfa-466e-943e-136479720228 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:08.411096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-37a25571-6dfa-466e-943e-136479720228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:08.562295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a25571-6dfa-466e-943e-136479720228 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:08.572186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01055f4b-4c3b-4bb7-8bc4-d45cd46710fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:08.573295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01055f4b-4c3b-4bb7-8bc4-d45cd46710fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:08.573645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01055f4b-4c3b-4bb7-8bc4-d45cd46710fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:08.574124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01055f4b-4c3b-4bb7-8bc4-d45cd46710fb admin admin] PATH_INFO: `/v3/users/bf0d39fff25f40638b016937c0ee3be0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:08.575542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01055f4b-4c3b-4bb7-8bc4-d45cd46710fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf0d39fff25f40638b016937c0ee3be0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:08.578021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01055f4b-4c3b-4bb7-8bc4-d45cd46710fb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:08.584228 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:08.675450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01055f4b-4c3b-4bb7-8bc4-d45cd46710fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf0d39fff25f40638b016937c0ee3be0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:08.676256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01055f4b-4c3b-4bb7-8bc4-d45cd46710fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf0d39fff25f40638b016937c0ee3be0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:08.696916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01055f4b-4c3b-4bb7-8bc4-d45cd46710fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf0d39fff25f40638b016937c0ee3be0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:08.714595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01055f4b-4c3b-4bb7-8bc4-d45cd46710fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf0d39fff25f40638b016937c0ee3be0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:08.726085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01055f4b-4c3b-4bb7-8bc4-d45cd46710fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf0d39fff25f40638b016937c0ee3be0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:08.734137 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3206/6396] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:11:08 2022] DELETE /identity/v3/users/bf0d39fff25f40638b016937c0ee3be0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:08.741045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f7c17-e41d-491c-84fc-1676f7859516 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:08.742453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f7c17-e41d-491c-84fc-1676f7859516 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:08.743725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f7c17-e41d-491c-84fc-1676f7859516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:08.823195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8d5f7c17-e41d-491c-84fc-1676f7859516 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:08.825386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8d5f7c17-e41d-491c-84fc-1676f7859516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:09.024565 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3191/6397] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:09.034532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01055f4b-4c3b-4bb7-8bc4-d45cd46710fb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:09.036051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-01055f4b-4c3b-4bb7-8bc4-d45cd46710fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:09.164402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01055f4b-4c3b-4bb7-8bc4-d45cd46710fb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:09.170695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6c7b0-ef0c-4294-94e6-cc66f0f05448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:09.171585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6c7b0-ef0c-4294-94e6-cc66f0f05448 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:09.171954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6c7b0-ef0c-4294-94e6-cc66f0f05448 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:09.172190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6c7b0-ef0c-4294-94e6-cc66f0f05448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:09.185607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6c7b0-ef0c-4294-94e6-cc66f0f05448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:09.187807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6c7b0-ef0c-4294-94e6-cc66f0f05448 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:09.213397 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3207/6398] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:11:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:11:11.075019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f7c17-e41d-491c-84fc-1676f7859516 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:11.076540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8d5f7c17-e41d-491c-84fc-1676f7859516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:11.092173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f7c17-e41d-491c-84fc-1676f7859516 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:11.102155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d548f9-ff5b-4769-a085-00bc9e7aa2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:11.104192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d548f9-ff5b-4769-a085-00bc9e7aa2b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:11.104540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d548f9-ff5b-4769-a085-00bc9e7aa2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:11.105633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d548f9-ff5b-4769-a085-00bc9e7aa2b8 admin admin] PATH_INFO: `/v3/projects/ca384a47cb1a41e5878679f8dab38439` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:11.110785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d548f9-ff5b-4769-a085-00bc9e7aa2b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca384a47cb1a41e5878679f8dab38439)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:11.112759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d548f9-ff5b-4769-a085-00bc9e7aa2b8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:11.234648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a2d548f9-ff5b-4769-a085-00bc9e7aa2b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca384a47cb1a41e5878679f8dab38439', 'request_id': 'req-a2d548f9-ff5b-4769-a085-00bc9e7aa2b8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:11.257239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a2d548f9-ff5b-4769-a085-00bc9e7aa2b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca384a47cb1a41e5878679f8dab38439', 'request_id': 'req-a2d548f9-ff5b-4769-a085-00bc9e7aa2b8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:11.283676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a2d548f9-ff5b-4769-a085-00bc9e7aa2b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca384a47cb1a41e5878679f8dab38439', 'request_id': 'req-a2d548f9-ff5b-4769-a085-00bc9e7aa2b8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:11.315326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a2d548f9-ff5b-4769-a085-00bc9e7aa2b8 admin admin] The token cache is being invalidate because project ca384a47cb1a41e5878679f8dab38439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:11:11.315836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a2d548f9-ff5b-4769-a085-00bc9e7aa2b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:11.316680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a2d548f9-ff5b-4769-a085-00bc9e7aa2b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:11.318632 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3192/6399] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:11:11 2022] DELETE /identity/v3/projects/ca384a47cb1a41e5878679f8dab38439 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:11.322949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6c7b0-ef0c-4294-94e6-cc66f0f05448 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:11.340508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6c7b0-ef0c-4294-94e6-cc66f0f05448 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:11.496818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af37062-213e-4bcc-a03c-5a24f90a228a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:11.498197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af37062-213e-4bcc-a03c-5a24f90a228a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:11.498485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af37062-213e-4bcc-a03c-5a24f90a228a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:11.498823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af37062-213e-4bcc-a03c-5a24f90a228a admin admin] PATH_INFO: `/v3/users/f9fe351993f74e84b5c3f16918074d54` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:11.504185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af37062-213e-4bcc-a03c-5a24f90a228a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9fe351993f74e84b5c3f16918074d54)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:11.510446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af37062-213e-4bcc-a03c-5a24f90a228a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:11.589730 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:11.633606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4af37062-213e-4bcc-a03c-5a24f90a228a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9fe351993f74e84b5c3f16918074d54'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:11.637233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4af37062-213e-4bcc-a03c-5a24f90a228a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9fe351993f74e84b5c3f16918074d54'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:11.673560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4af37062-213e-4bcc-a03c-5a24f90a228a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9fe351993f74e84b5c3f16918074d54'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:11.719324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4af37062-213e-4bcc-a03c-5a24f90a228a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9fe351993f74e84b5c3f16918074d54'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:11.739254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4af37062-213e-4bcc-a03c-5a24f90a228a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9fe351993f74e84b5c3f16918074d54'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:11.772912 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3208/6400] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:11:11 2022] DELETE /identity/v3/users/f9fe351993f74e84b5c3f16918074d54 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:11:12.991316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d548f9-ff5b-4769-a085-00bc9e7aa2b8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:12.996204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a2d548f9-ff5b-4769-a085-00bc9e7aa2b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:13.020564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d548f9-ff5b-4769-a085-00bc9e7aa2b8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:13.150389 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:13.199798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4eaee-c205-4a91-8a22-a9d32c1d3d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:13.200826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4eaee-c205-4a91-8a22-a9d32c1d3d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:13.201256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4eaee-c205-4a91-8a22-a9d32c1d3d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:13.201702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4eaee-c205-4a91-8a22-a9d32c1d3d6d admin admin] PATH_INFO: `/v3/projects/67654486d8274cfda513cee6969f6188` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:13.203795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4eaee-c205-4a91-8a22-a9d32c1d3d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=67654486d8274cfda513cee6969f6188)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:13.206301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4eaee-c205-4a91-8a22-a9d32c1d3d6d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:13.301122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-34a4eaee-c205-4a91-8a22-a9d32c1d3d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67654486d8274cfda513cee6969f6188', 'request_id': 'req-34a4eaee-c205-4a91-8a22-a9d32c1d3d6d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:13.326238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-34a4eaee-c205-4a91-8a22-a9d32c1d3d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67654486d8274cfda513cee6969f6188', 'request_id': 'req-34a4eaee-c205-4a91-8a22-a9d32c1d3d6d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:13.334131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-34a4eaee-c205-4a91-8a22-a9d32c1d3d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67654486d8274cfda513cee6969f6188', 'request_id': 'req-34a4eaee-c205-4a91-8a22-a9d32c1d3d6d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:13.351905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-34a4eaee-c205-4a91-8a22-a9d32c1d3d6d admin admin] The token cache is being invalidate because project 67654486d8274cfda513cee6969f6188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:11:13.352940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-34a4eaee-c205-4a91-8a22-a9d32c1d3d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:13.353928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-34a4eaee-c205-4a91-8a22-a9d32c1d3d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:13.355658 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3193/6401] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:11:12 2022] DELETE /identity/v3/projects/67654486d8274cfda513cee6969f6188 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:13.360716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a4e37-1144-4ce7-8ca7-3b5c867d4ccc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:13.361217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a4e37-1144-4ce7-8ca7-3b5c867d4ccc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:13.361391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a4e37-1144-4ce7-8ca7-3b5c867d4ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:13.416256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-194a4e37-1144-4ce7-8ca7-3b5c867d4ccc None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:13.418317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-194a4e37-1144-4ce7-8ca7-3b5c867d4ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:13.524112 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3209/6402] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:13.533154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d5b7b-0d35-4ce0-9fa4-d17b83fbdcde None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:13.533835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d5b7b-0d35-4ce0-9fa4-d17b83fbdcde None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:13.534307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d5b7b-0d35-4ce0-9fa4-d17b83fbdcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:13.572215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e76d5b7b-0d35-4ce0-9fa4-d17b83fbdcde None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:13.573750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e76d5b7b-0d35-4ce0-9fa4-d17b83fbdcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:13.586717 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3194/6403] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:13.591259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a4e37-1144-4ce7-8ca7-3b5c867d4ccc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:13.605833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a4e37-1144-4ce7-8ca7-3b5c867d4ccc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:13.620684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf6cf6-890d-4bf9-8333-3e75033a8c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:13.621075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf6cf6-890d-4bf9-8333-3e75033a8c1f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:13.621359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf6cf6-890d-4bf9-8333-3e75033a8c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:13.621630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf6cf6-890d-4bf9-8333-3e75033a8c1f admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:13.622302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf6cf6-890d-4bf9-8333-3e75033a8c1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:11:13.622600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf6cf6-890d-4bf9-8333-3e75033a8c1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:13.624203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf6cf6-890d-4bf9-8333-3e75033a8c1f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:13.664442 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3210/6404] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:11:13.670370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d5b7b-0d35-4ce0-9fa4-d17b83fbdcde None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:13.698313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d5b7b-0d35-4ce0-9fa4-d17b83fbdcde None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:13.710078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace71c12-7621-46c5-8308-e112b24ed9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:13.713150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace71c12-7621-46c5-8308-e112b24ed9ee admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:13.714168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace71c12-7621-46c5-8308-e112b24ed9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:13.718367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace71c12-7621-46c5-8308-e112b24ed9ee admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:13.719704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace71c12-7621-46c5-8308-e112b24ed9ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:13.726251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace71c12-7621-46c5-8308-e112b24ed9ee admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:13.828158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf6cf6-890d-4bf9-8333-3e75033a8c1f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:13.829410 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3195/6405] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:11:13 2022] POST /identity/v3/projects => generated 371 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:11:13.857892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf6cf6-890d-4bf9-8333-3e75033a8c1f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:13.994631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645efc8d-23cc-4ad3-a467-8877f1bd8f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:13.995066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645efc8d-23cc-4ad3-a467-8877f1bd8f18 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:13.995417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645efc8d-23cc-4ad3-a467-8877f1bd8f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:13.995696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645efc8d-23cc-4ad3-a467-8877f1bd8f18 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:13.996334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645efc8d-23cc-4ad3-a467-8877f1bd8f18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:14.001035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645efc8d-23cc-4ad3-a467-8877f1bd8f18 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:14.066056 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3211/6406] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:11:13 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:11:14.070134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace71c12-7621-46c5-8308-e112b24ed9ee admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:14.087466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace71c12-7621-46c5-8308-e112b24ed9ee admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:14.103044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05659538-b60b-4962-8fe9-31e90a65724a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:14.104158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05659538-b60b-4962-8fe9-31e90a65724a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:14.104765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05659538-b60b-4962-8fe9-31e90a65724a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:14.105193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05659538-b60b-4962-8fe9-31e90a65724a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:14.106022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05659538-b60b-4962-8fe9-31e90a65724a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:14.107842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05659538-b60b-4962-8fe9-31e90a65724a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:14.143331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645efc8d-23cc-4ad3-a467-8877f1bd8f18 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:14.151896 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3196/6407] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:11:14.161463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645efc8d-23cc-4ad3-a467-8877f1bd8f18 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:14.174346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8dd82e-ccf2-424e-8c3e-3f802c4dc932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:14.174981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dd82e-ccf2-424e-8c3e-3f802c4dc932 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:14.175879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dd82e-ccf2-424e-8c3e-3f802c4dc932 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:14.175879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dd82e-ccf2-424e-8c3e-3f802c4dc932 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:14.176169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8dd82e-ccf2-424e-8c3e-3f802c4dc932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:14.178076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8dd82e-ccf2-424e-8c3e-3f802c4dc932 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:14.208383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05659538-b60b-4962-8fe9-31e90a65724a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:14.219299 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3212/6408] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:11:14.225522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05659538-b60b-4962-8fe9-31e90a65724a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:14.231559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c882e4-f3fc-4591-a1d7-9a8606fedc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:14.232425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c882e4-f3fc-4591-a1d7-9a8606fedc8a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:14.232895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c882e4-f3fc-4591-a1d7-9a8606fedc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:14.233352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c882e4-f3fc-4591-a1d7-9a8606fedc8a admin admin] PATH_INFO: `/v3/projects/50873d01eace48188746bca5ad0c470c/users/5649ca647f184349bad83e3a4660896a/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:14.256810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c882e4-f3fc-4591-a1d7-9a8606fedc8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=50873d01eace48188746bca5ad0c470c, user_id=5649ca647f184349bad83e3a4660896a, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:14.261771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c882e4-f3fc-4591-a1d7-9a8606fedc8a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:14.299594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6478ee5-4eac-4fa9-aa39-f9eece3beb0f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:14.299891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6478ee5-4eac-4fa9-aa39-f9eece3beb0f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:14.300181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6478ee5-4eac-4fa9-aa39-f9eece3beb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:14.303921 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3197/6409] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:11:14 2022] PUT /identity/v3/projects/50873d01eace48188746bca5ad0c470c/users/5649ca647f184349bad83e3a4660896a/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:14.345487 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:14.359086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a6478ee5-4eac-4fa9-aa39-f9eece3beb0f None None] MFA Rules not processed for user `5649ca647f184349bad83e3a4660896a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:14.368110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a6478ee5-4eac-4fa9-aa39-f9eece3beb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:14.485265 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3213/6410] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:14.498547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c882e4-f3fc-4591-a1d7-9a8606fedc8a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:14.500394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-89c882e4-f3fc-4591-a1d7-9a8606fedc8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:14.641364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c882e4-f3fc-4591-a1d7-9a8606fedc8a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:14.646067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8734a2-b4e7-4fa5-ba67-c6ffca170618 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:14.646911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8734a2-b4e7-4fa5-ba67-c6ffca170618 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:14.647379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8734a2-b4e7-4fa5-ba67-c6ffca170618 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:14.647802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8734a2-b4e7-4fa5-ba67-c6ffca170618 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:14.678677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8734a2-b4e7-4fa5-ba67-c6ffca170618 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:14.684376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8734a2-b4e7-4fa5-ba67-c6ffca170618 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:14.700285 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3198/6411] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:11:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:11:14.729665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6478ee5-4eac-4fa9-aa39-f9eece3beb0f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:14.932835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6478ee5-4eac-4fa9-aa39-f9eece3beb0f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:14.962219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f4c13-4d7b-472e-8c0a-fab2ed43f112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:14.962463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f4c13-4d7b-472e-8c0a-fab2ed43f112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:14.962804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f4c13-4d7b-472e-8c0a-fab2ed43f112 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:14.963115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f4c13-4d7b-472e-8c0a-fab2ed43f112 admin admin] PATH_INFO: `/v3/users/5649ca647f184349bad83e3a4660896a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:14.967032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f4c13-4d7b-472e-8c0a-fab2ed43f112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5649ca647f184349bad83e3a4660896a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:14.969078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f4c13-4d7b-472e-8c0a-fab2ed43f112 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:15.133180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ae3f4c13-4d7b-472e-8c0a-fab2ed43f112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5649ca647f184349bad83e3a4660896a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:15.134628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ae3f4c13-4d7b-472e-8c0a-fab2ed43f112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5649ca647f184349bad83e3a4660896a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:15.160743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ae3f4c13-4d7b-472e-8c0a-fab2ed43f112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5649ca647f184349bad83e3a4660896a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:15.186481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ae3f4c13-4d7b-472e-8c0a-fab2ed43f112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5649ca647f184349bad83e3a4660896a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:15.195591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ae3f4c13-4d7b-472e-8c0a-fab2ed43f112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5649ca647f184349bad83e3a4660896a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:15.226601 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3214/6412] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:11:14 2022] DELETE /identity/v3/users/5649ca647f184349bad83e3a4660896a => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:15.231367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4885f6-3af7-4a89-95d8-4c03ec973905 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:15.232206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4885f6-3af7-4a89-95d8-4c03ec973905 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:15.232664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4885f6-3af7-4a89-95d8-4c03ec973905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:15.247344 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:15.266002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6c4885f6-3af7-4a89-95d8-4c03ec973905 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:15.267710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6c4885f6-3af7-4a89-95d8-4c03ec973905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:15.367812 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3199/6413] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:15.384270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f4c13-4d7b-472e-8c0a-fab2ed43f112 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:15.386579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ae3f4c13-4d7b-472e-8c0a-fab2ed43f112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:15.425592 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:15.530025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f4c13-4d7b-472e-8c0a-fab2ed43f112 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:15.543259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8c8af-7d9d-470f-8ac7-cae17a6f00c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:15.544433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8c8af-7d9d-470f-8ac7-cae17a6f00c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:15.544856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8c8af-7d9d-470f-8ac7-cae17a6f00c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:15.545391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8c8af-7d9d-470f-8ac7-cae17a6f00c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:15.589009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8c8af-7d9d-470f-8ac7-cae17a6f00c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:15.593464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8c8af-7d9d-470f-8ac7-cae17a6f00c2 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:15.617928 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3215/6414] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:11:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:11:16.532421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4885f6-3af7-4a89-95d8-4c03ec973905 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:16.535106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6c4885f6-3af7-4a89-95d8-4c03ec973905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:16.637714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4885f6-3af7-4a89-95d8-4c03ec973905 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:16.653975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a5af1-a345-4682-ad04-8a8fedfcfd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:16.654672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a5af1-a345-4682-ad04-8a8fedfcfd04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:16.654926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a5af1-a345-4682-ad04-8a8fedfcfd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:16.655224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a5af1-a345-4682-ad04-8a8fedfcfd04 admin admin] PATH_INFO: `/v3/projects/50873d01eace48188746bca5ad0c470c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:16.659004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a5af1-a345-4682-ad04-8a8fedfcfd04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50873d01eace48188746bca5ad0c470c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:16.661042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a5af1-a345-4682-ad04-8a8fedfcfd04 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:16.753770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b71a5af1-a345-4682-ad04-8a8fedfcfd04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50873d01eace48188746bca5ad0c470c', 'request_id': 'req-b71a5af1-a345-4682-ad04-8a8fedfcfd04'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:16.778297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b71a5af1-a345-4682-ad04-8a8fedfcfd04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50873d01eace48188746bca5ad0c470c', 'request_id': 'req-b71a5af1-a345-4682-ad04-8a8fedfcfd04'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:16.787638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b71a5af1-a345-4682-ad04-8a8fedfcfd04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50873d01eace48188746bca5ad0c470c', 'request_id': 'req-b71a5af1-a345-4682-ad04-8a8fedfcfd04'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:16.816055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b71a5af1-a345-4682-ad04-8a8fedfcfd04 admin admin] The token cache is being invalidate because project 50873d01eace48188746bca5ad0c470c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:11:16.816427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b71a5af1-a345-4682-ad04-8a8fedfcfd04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:16.819714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b71a5af1-a345-4682-ad04-8a8fedfcfd04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:16.824636 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3200/6415] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:11:16 2022] DELETE /identity/v3/projects/50873d01eace48188746bca5ad0c470c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:16.828439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e20e57-762a-468d-9103-a938e3230030 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:16.829055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e20e57-762a-468d-9103-a938e3230030 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:16.829189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e20e57-762a-468d-9103-a938e3230030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:16.853160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-10e20e57-762a-468d-9103-a938e3230030 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:16.855176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-10e20e57-762a-468d-9103-a938e3230030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:16.983206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989eefa-e8cf-4a6e-b80e-b065b1335083 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:16.983489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989eefa-e8cf-4a6e-b80e-b065b1335083 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:16.983885 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3216/6416] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:16.984035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989eefa-e8cf-4a6e-b80e-b065b1335083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:17.023430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e989eefa-e8cf-4a6e-b80e-b065b1335083 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:17.026945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e989eefa-e8cf-4a6e-b80e-b065b1335083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:17.058555 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3201/6417] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:11:17.062116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e20e57-762a-468d-9103-a938e3230030 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:17.077153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e20e57-762a-468d-9103-a938e3230030 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:17.090864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e334ada-89e9-46a9-a7d2-302b24fb0e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:17.091986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e334ada-89e9-46a9-a7d2-302b24fb0e52 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:17.092821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e334ada-89e9-46a9-a7d2-302b24fb0e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:17.093972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e334ada-89e9-46a9-a7d2-302b24fb0e52 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:17.094852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e334ada-89e9-46a9-a7d2-302b24fb0e52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:11:17.096978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e334ada-89e9-46a9-a7d2-302b24fb0e52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:17.102191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e334ada-89e9-46a9-a7d2-302b24fb0e52 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:17.126617 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3217/6418] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:11:17.130681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989eefa-e8cf-4a6e-b80e-b065b1335083 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:17.151152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989eefa-e8cf-4a6e-b80e-b065b1335083 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:17.163760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4aa4dc-c992-4492-94fd-ebd7a6856473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:17.166254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aa4dc-c992-4492-94fd-ebd7a6856473 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:17.166723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aa4dc-c992-4492-94fd-ebd7a6856473 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:17.168202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aa4dc-c992-4492-94fd-ebd7a6856473 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:17.169320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4aa4dc-c992-4492-94fd-ebd7a6856473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:17.172044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4aa4dc-c992-4492-94fd-ebd7a6856473 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:17.276039 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3202/6419] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:11:17 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:11:17.279393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e334ada-89e9-46a9-a7d2-302b24fb0e52 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:17.301135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e334ada-89e9-46a9-a7d2-302b24fb0e52 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:17.505014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccc2d4-c0d0-4cda-b2c2-c39ce4760f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:17.505658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccc2d4-c0d0-4cda-b2c2-c39ce4760f4d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:17.505948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccc2d4-c0d0-4cda-b2c2-c39ce4760f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:17.506412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccc2d4-c0d0-4cda-b2c2-c39ce4760f4d admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:17.507158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccc2d4-c0d0-4cda-b2c2-c39ce4760f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:17.509395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccc2d4-c0d0-4cda-b2c2-c39ce4760f4d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:17.573372 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3218/6420] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:11:17 2022] POST /identity/v3/users => generated 292 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:11:17.577659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4aa4dc-c992-4492-94fd-ebd7a6856473 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:17.612232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4aa4dc-c992-4492-94fd-ebd7a6856473 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:17.616667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675750c6-9e30-4ffc-96b9-1625e3afbc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:17.617280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675750c6-9e30-4ffc-96b9-1625e3afbc17 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:17.617634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675750c6-9e30-4ffc-96b9-1625e3afbc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:17.619098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675750c6-9e30-4ffc-96b9-1625e3afbc17 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:17.619791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675750c6-9e30-4ffc-96b9-1625e3afbc17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:17.627899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675750c6-9e30-4ffc-96b9-1625e3afbc17 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:17.685133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccc2d4-c0d0-4cda-b2c2-c39ce4760f4d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:17.685736 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3203/6421] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:11:17.692896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccc2d4-c0d0-4cda-b2c2-c39ce4760f4d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:17.717825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ed105-3201-4d25-8b49-0455b51ceaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:17.719074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ed105-3201-4d25-8b49-0455b51ceaad admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:17.719919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ed105-3201-4d25-8b49-0455b51ceaad admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:17.720228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ed105-3201-4d25-8b49-0455b51ceaad admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:17.728539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ed105-3201-4d25-8b49-0455b51ceaad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:17.731797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ed105-3201-4d25-8b49-0455b51ceaad admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:17.761817 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3219/6422] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:11:17.767791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675750c6-9e30-4ffc-96b9-1625e3afbc17 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:17.784669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675750c6-9e30-4ffc-96b9-1625e3afbc17 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:17.801006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3aa22-abf4-45cb-a1f6-1fc20088dfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:17.802515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3aa22-abf4-45cb-a1f6-1fc20088dfca admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:17.803022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3aa22-abf4-45cb-a1f6-1fc20088dfca admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:17.803679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3aa22-abf4-45cb-a1f6-1fc20088dfca admin admin] PATH_INFO: `/v3/projects/449fe64c3c094f3cb0a0dfadcc0d26c7/users/617f2db078ef4302acbbc65d4017875d/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:17.845349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3aa22-abf4-45cb-a1f6-1fc20088dfca admin admin] RBAC: Authorizing `identity:create_grant(project_id=449fe64c3c094f3cb0a0dfadcc0d26c7, user_id=617f2db078ef4302acbbc65d4017875d, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:17.848311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3aa22-abf4-45cb-a1f6-1fc20088dfca admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:17.888768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13238446-2b24-48b9-80d8-8061b31e2d81 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:17.889239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13238446-2b24-48b9-80d8-8061b31e2d81 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:17.889354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13238446-2b24-48b9-80d8-8061b31e2d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:17.892930 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3204/6423] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:11:17 2022] PUT /identity/v3/projects/449fe64c3c094f3cb0a0dfadcc0d26c7/users/617f2db078ef4302acbbc65d4017875d/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:17.941289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-13238446-2b24-48b9-80d8-8061b31e2d81 None None] MFA Rules not processed for user `617f2db078ef4302acbbc65d4017875d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:17.943349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-13238446-2b24-48b9-80d8-8061b31e2d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:17.980848 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:18.129267 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3220/6424] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:18.142597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3aa22-abf4-45cb-a1f6-1fc20088dfca admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:18.144457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4ff3aa22-abf4-45cb-a1f6-1fc20088dfca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:18.151018 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:18.289158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3aa22-abf4-45cb-a1f6-1fc20088dfca admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:18.314962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cdedb-dbab-49d9-a184-0248dd5a3af0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:18.318655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cdedb-dbab-49d9-a184-0248dd5a3af0 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:18.322096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cdedb-dbab-49d9-a184-0248dd5a3af0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:18.322496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cdedb-dbab-49d9-a184-0248dd5a3af0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:18.345595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cdedb-dbab-49d9-a184-0248dd5a3af0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:18.347334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cdedb-dbab-49d9-a184-0248dd5a3af0 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:18.389141 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3205/6425] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:11:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:11:21.854692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13238446-2b24-48b9-80d8-8061b31e2d81 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:21.856159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-13238446-2b24-48b9-80d8-8061b31e2d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:22.002577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13238446-2b24-48b9-80d8-8061b31e2d81 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:22.007542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd38615-8329-44ea-b1bd-43780d10eee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:22.008196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd38615-8329-44ea-b1bd-43780d10eee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:22.009508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd38615-8329-44ea-b1bd-43780d10eee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:22.010176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd38615-8329-44ea-b1bd-43780d10eee9 admin admin] PATH_INFO: `/v3/users/4756ee56166f493ab4c3ac8b5f9648b0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:22.011890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd38615-8329-44ea-b1bd-43780d10eee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4756ee56166f493ab4c3ac8b5f9648b0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:22.014461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd38615-8329-44ea-b1bd-43780d10eee9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:22.094475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1bd38615-8329-44ea-b1bd-43780d10eee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4756ee56166f493ab4c3ac8b5f9648b0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:22.095491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1bd38615-8329-44ea-b1bd-43780d10eee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4756ee56166f493ab4c3ac8b5f9648b0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:22.105838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1bd38615-8329-44ea-b1bd-43780d10eee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4756ee56166f493ab4c3ac8b5f9648b0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:22.139372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1bd38615-8329-44ea-b1bd-43780d10eee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4756ee56166f493ab4c3ac8b5f9648b0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:22.160460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1bd38615-8329-44ea-b1bd-43780d10eee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4756ee56166f493ab4c3ac8b5f9648b0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:22.177144 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3221/6426] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:11:21 2022] DELETE /identity/v3/users/4756ee56166f493ab4c3ac8b5f9648b0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:22.180851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff817e-6a46-46e4-814c-e7e5f4dff84d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:22.182662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff817e-6a46-46e4-814c-e7e5f4dff84d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:22.182998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff817e-6a46-46e4-814c-e7e5f4dff84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:22.266827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-62ff817e-6a46-46e4-814c-e7e5f4dff84d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:22.268532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-62ff817e-6a46-46e4-814c-e7e5f4dff84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:22.494637 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3206/6427] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:22.548054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd38615-8329-44ea-b1bd-43780d10eee9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:22.549642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1bd38615-8329-44ea-b1bd-43780d10eee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:22.683875 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:22.749819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd38615-8329-44ea-b1bd-43780d10eee9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:22.766604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7b48e-565c-49d0-92bd-be51e4f6c3ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:22.767426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7b48e-565c-49d0-92bd-be51e4f6c3ee service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:22.767798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7b48e-565c-49d0-92bd-be51e4f6c3ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:22.768172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7b48e-565c-49d0-92bd-be51e4f6c3ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:22.785803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7b48e-565c-49d0-92bd-be51e4f6c3ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:22.787414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7b48e-565c-49d0-92bd-be51e4f6c3ee service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:22.811578 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3222/6428] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:11:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:11:23.273114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff817e-6a46-46e4-814c-e7e5f4dff84d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:23.275700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-62ff817e-6a46-46e4-814c-e7e5f4dff84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:23.319452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff817e-6a46-46e4-814c-e7e5f4dff84d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:23.339059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf5dcb-0a3c-4972-819d-64ba2a2b8ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:23.341642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf5dcb-0a3c-4972-819d-64ba2a2b8ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:23.341935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf5dcb-0a3c-4972-819d-64ba2a2b8ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:23.342215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf5dcb-0a3c-4972-819d-64ba2a2b8ce0 admin admin] PATH_INFO: `/v3/projects/5d9ea30a06e74489846c66efb845e162` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:23.344300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf5dcb-0a3c-4972-819d-64ba2a2b8ce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d9ea30a06e74489846c66efb845e162)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:23.346326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf5dcb-0a3c-4972-819d-64ba2a2b8ce0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:23.452808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4ecf5dcb-0a3c-4972-819d-64ba2a2b8ce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d9ea30a06e74489846c66efb845e162', 'request_id': 'req-4ecf5dcb-0a3c-4972-819d-64ba2a2b8ce0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:23.467451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4ecf5dcb-0a3c-4972-819d-64ba2a2b8ce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d9ea30a06e74489846c66efb845e162', 'request_id': 'req-4ecf5dcb-0a3c-4972-819d-64ba2a2b8ce0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:23.478294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4ecf5dcb-0a3c-4972-819d-64ba2a2b8ce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d9ea30a06e74489846c66efb845e162', 'request_id': 'req-4ecf5dcb-0a3c-4972-819d-64ba2a2b8ce0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:23.498704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4ecf5dcb-0a3c-4972-819d-64ba2a2b8ce0 admin admin] The token cache is being invalidate because project 5d9ea30a06e74489846c66efb845e162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:11:23.499363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4ecf5dcb-0a3c-4972-819d-64ba2a2b8ce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:23.500336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4ecf5dcb-0a3c-4972-819d-64ba2a2b8ce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:23.502460 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3207/6429] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:11:23 2022] DELETE /identity/v3/projects/5d9ea30a06e74489846c66efb845e162 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:23.507720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3f627-0c5b-4947-bca1-b9858de2be2e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:23.509047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3f627-0c5b-4947-bca1-b9858de2be2e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:23.509706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3f627-0c5b-4947-bca1-b9858de2be2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:23.589122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b8f3f627-0c5b-4947-bca1-b9858de2be2e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:23.590805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b8f3f627-0c5b-4947-bca1-b9858de2be2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:23.716799 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3223/6430] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:23.724762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712720e-9778-4f9f-9d99-dd9c4c6e04a6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:23.725471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712720e-9778-4f9f-9d99-dd9c4c6e04a6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:23.726112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712720e-9778-4f9f-9d99-dd9c4c6e04a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:23.760588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7712720e-9778-4f9f-9d99-dd9c4c6e04a6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:23.767487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7712720e-9778-4f9f-9d99-dd9c4c6e04a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:23.792374 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3208/6431] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:23.796091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3f627-0c5b-4947-bca1-b9858de2be2e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:23.808984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3f627-0c5b-4947-bca1-b9858de2be2e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:23.818401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c60fea-77f0-4d77-a3e3-c1f2ff7b6c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:23.818864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c60fea-77f0-4d77-a3e3-c1f2ff7b6c87 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:23.819211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c60fea-77f0-4d77-a3e3-c1f2ff7b6c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:23.819543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c60fea-77f0-4d77-a3e3-c1f2ff7b6c87 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:23.820426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c60fea-77f0-4d77-a3e3-c1f2ff7b6c87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:11:23.825592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c60fea-77f0-4d77-a3e3-c1f2ff7b6c87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:23.827696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c60fea-77f0-4d77-a3e3-c1f2ff7b6c87 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:23.861872 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3224/6432] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:11:23.865228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712720e-9778-4f9f-9d99-dd9c4c6e04a6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:23.874386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712720e-9778-4f9f-9d99-dd9c4c6e04a6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:23.889364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97097a57-35ae-477e-9b18-99b7192d8047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:23.889994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97097a57-35ae-477e-9b18-99b7192d8047 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:23.890272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97097a57-35ae-477e-9b18-99b7192d8047 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:23.890540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97097a57-35ae-477e-9b18-99b7192d8047 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:23.892233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97097a57-35ae-477e-9b18-99b7192d8047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:23.894174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97097a57-35ae-477e-9b18-99b7192d8047 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:23.957219 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:23.990332 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3209/6433] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:11:23 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:11:23.996990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c60fea-77f0-4d77-a3e3-c1f2ff7b6c87 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:24.012959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c60fea-77f0-4d77-a3e3-c1f2ff7b6c87 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:24.209149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290a875-0927-4b32-8937-78e378462630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:24.209722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290a875-0927-4b32-8937-78e378462630 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:24.210003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290a875-0927-4b32-8937-78e378462630 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:24.210273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290a875-0927-4b32-8937-78e378462630 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:24.210914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290a875-0927-4b32-8937-78e378462630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:24.222441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290a875-0927-4b32-8937-78e378462630 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:24.297396 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3225/6434] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:11:23 2022] POST /identity/v3/users => generated 289 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:11:24.301563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97097a57-35ae-477e-9b18-99b7192d8047 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:24.334641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97097a57-35ae-477e-9b18-99b7192d8047 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:24.357626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b776fc-0b8a-4cf7-85db-5056db65d491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:24.358534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b776fc-0b8a-4cf7-85db-5056db65d491 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:24.358818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b776fc-0b8a-4cf7-85db-5056db65d491 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:24.359092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b776fc-0b8a-4cf7-85db-5056db65d491 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:24.359745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b776fc-0b8a-4cf7-85db-5056db65d491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:24.361926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b776fc-0b8a-4cf7-85db-5056db65d491 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:24.411107 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3210/6435] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:11:24.424817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290a875-0927-4b32-8937-78e378462630 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:24.448838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290a875-0927-4b32-8937-78e378462630 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:24.463660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ff8c1-ccee-4af1-80a5-f11c38abeca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:24.464796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ff8c1-ccee-4af1-80a5-f11c38abeca1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:24.465314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ff8c1-ccee-4af1-80a5-f11c38abeca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:24.465807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ff8c1-ccee-4af1-80a5-f11c38abeca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:24.466696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ff8c1-ccee-4af1-80a5-f11c38abeca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:24.468522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ff8c1-ccee-4af1-80a5-f11c38abeca1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:24.513597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b776fc-0b8a-4cf7-85db-5056db65d491 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:24.532404 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3226/6436] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:11:24.549534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b776fc-0b8a-4cf7-85db-5056db65d491 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:24.559820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f31bce-52b5-40ae-99ce-b8b3e8b59dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:24.560876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f31bce-52b5-40ae-99ce-b8b3e8b59dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:24.561338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f31bce-52b5-40ae-99ce-b8b3e8b59dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:24.562741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f31bce-52b5-40ae-99ce-b8b3e8b59dcc admin admin] PATH_INFO: `/v3/projects/6aab5f9629a64536b5c7524501d3e5dd/users/b229460e60c242e299bedd51a632381f/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:24.615912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f31bce-52b5-40ae-99ce-b8b3e8b59dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aab5f9629a64536b5c7524501d3e5dd, user_id=b229460e60c242e299bedd51a632381f, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:24.619179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f31bce-52b5-40ae-99ce-b8b3e8b59dcc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:24.645181 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3211/6437] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:11:24 2022] PUT /identity/v3/projects/6aab5f9629a64536b5c7524501d3e5dd/users/b229460e60c242e299bedd51a632381f/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:24.655398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ab9ae-748f-4c15-bfab-bd7dc3e0a7cc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:24.656057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ab9ae-748f-4c15-bfab-bd7dc3e0a7cc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:24.656571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ab9ae-748f-4c15-bfab-bd7dc3e0a7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:24.726692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-137ab9ae-748f-4c15-bfab-bd7dc3e0a7cc None None] MFA Rules not processed for user `b229460e60c242e299bedd51a632381f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:24.729233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-137ab9ae-748f-4c15-bfab-bd7dc3e0a7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:24.785468 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:24.987854 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3227/6438] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:25.010222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f31bce-52b5-40ae-99ce-b8b3e8b59dcc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:25.012018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-70f31bce-52b5-40ae-99ce-b8b3e8b59dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:25.185936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f31bce-52b5-40ae-99ce-b8b3e8b59dcc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:25.199428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba3710-e8b1-491a-864e-0a737937c41d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:25.200064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba3710-e8b1-491a-864e-0a737937c41d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:25.200346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba3710-e8b1-491a-864e-0a737937c41d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:25.200964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba3710-e8b1-491a-864e-0a737937c41d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:25.219026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba3710-e8b1-491a-864e-0a737937c41d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:25.220495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba3710-e8b1-491a-864e-0a737937c41d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:25.233138 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3212/6439] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:11:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:11:25.247405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ab9ae-748f-4c15-bfab-bd7dc3e0a7cc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:25.374604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ab9ae-748f-4c15-bfab-bd7dc3e0a7cc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:25.385137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392dcb2-f78f-43d1-b9f3-23114b8656b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:25.385774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392dcb2-f78f-43d1-b9f3-23114b8656b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:25.386414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392dcb2-f78f-43d1-b9f3-23114b8656b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:25.386707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392dcb2-f78f-43d1-b9f3-23114b8656b0 admin admin] PATH_INFO: `/v3/users/b229460e60c242e299bedd51a632381f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:25.391093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392dcb2-f78f-43d1-b9f3-23114b8656b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b229460e60c242e299bedd51a632381f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:25.393301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392dcb2-f78f-43d1-b9f3-23114b8656b0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:25.493607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3392dcb2-f78f-43d1-b9f3-23114b8656b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b229460e60c242e299bedd51a632381f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:25.495255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3392dcb2-f78f-43d1-b9f3-23114b8656b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b229460e60c242e299bedd51a632381f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:25.516570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3392dcb2-f78f-43d1-b9f3-23114b8656b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b229460e60c242e299bedd51a632381f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:25.557131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3392dcb2-f78f-43d1-b9f3-23114b8656b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b229460e60c242e299bedd51a632381f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:25.567432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3392dcb2-f78f-43d1-b9f3-23114b8656b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b229460e60c242e299bedd51a632381f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:25.585526 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3228/6440] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:11:25 2022] DELETE /identity/v3/users/b229460e60c242e299bedd51a632381f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:25.587331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb7975-d9dd-436b-abce-1b0a36353fb1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:25.587817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb7975-d9dd-436b-abce-1b0a36353fb1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:25.587922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb7975-d9dd-436b-abce-1b0a36353fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:25.623123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-affb7975-d9dd-436b-abce-1b0a36353fb1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:25.624343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-affb7975-d9dd-436b-abce-1b0a36353fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:25.808464 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3213/6441] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:11:25.845693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392dcb2-f78f-43d1-b9f3-23114b8656b0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:25.847343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3392dcb2-f78f-43d1-b9f3-23114b8656b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:25.966613 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:26.029866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392dcb2-f78f-43d1-b9f3-23114b8656b0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:26.034061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ee893-93e5-4c0b-83cd-655992b6666e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:26.034895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ee893-93e5-4c0b-83cd-655992b6666e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:26.035361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ee893-93e5-4c0b-83cd-655992b6666e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:26.035784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ee893-93e5-4c0b-83cd-655992b6666e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:26.061489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ee893-93e5-4c0b-83cd-655992b6666e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:26.063520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ee893-93e5-4c0b-83cd-655992b6666e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:26.084182 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3229/6442] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:11:27.228162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb7975-d9dd-436b-abce-1b0a36353fb1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:27.230436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-affb7975-d9dd-436b-abce-1b0a36353fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:27.252108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb7975-d9dd-436b-abce-1b0a36353fb1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:27.262548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8b175-7773-40d1-a4b8-60222bbb454b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:27.263543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8b175-7773-40d1-a4b8-60222bbb454b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:27.264112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8b175-7773-40d1-a4b8-60222bbb454b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:27.264635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8b175-7773-40d1-a4b8-60222bbb454b admin admin] PATH_INFO: `/v3/projects/6aab5f9629a64536b5c7524501d3e5dd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:27.271343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8b175-7773-40d1-a4b8-60222bbb454b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aab5f9629a64536b5c7524501d3e5dd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:27.273526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8b175-7773-40d1-a4b8-60222bbb454b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:27.399122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2ca8b175-7773-40d1-a4b8-60222bbb454b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aab5f9629a64536b5c7524501d3e5dd', 'request_id': 'req-2ca8b175-7773-40d1-a4b8-60222bbb454b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:27.432576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2ca8b175-7773-40d1-a4b8-60222bbb454b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aab5f9629a64536b5c7524501d3e5dd', 'request_id': 'req-2ca8b175-7773-40d1-a4b8-60222bbb454b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:27.434521 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:27.445895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2ca8b175-7773-40d1-a4b8-60222bbb454b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aab5f9629a64536b5c7524501d3e5dd', 'request_id': 'req-2ca8b175-7773-40d1-a4b8-60222bbb454b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:27.467098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2ca8b175-7773-40d1-a4b8-60222bbb454b admin admin] The token cache is being invalidate because project 6aab5f9629a64536b5c7524501d3e5dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:11:27.467592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2ca8b175-7773-40d1-a4b8-60222bbb454b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:27.468371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2ca8b175-7773-40d1-a4b8-60222bbb454b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:27.473330 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3214/6443] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:11:27 2022] DELETE /identity/v3/projects/6aab5f9629a64536b5c7524501d3e5dd => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:27.475112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f57bc-fefb-4731-adc7-2449890c27cc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:27.475565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f57bc-fefb-4731-adc7-2449890c27cc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:27.475857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f57bc-fefb-4731-adc7-2449890c27cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:27.499457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d02f57bc-fefb-4731-adc7-2449890c27cc None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:27.500432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d02f57bc-fefb-4731-adc7-2449890c27cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:27.637673 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3230/6444] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:27.639470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bcf60-4b30-4d94-9df0-fd6513113f4e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:27.639939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bcf60-4b30-4d94-9df0-fd6513113f4e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:27.640362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bcf60-4b30-4d94-9df0-fd6513113f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:27.666181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-109bcf60-4b30-4d94-9df0-fd6513113f4e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:27.668389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-109bcf60-4b30-4d94-9df0-fd6513113f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:27.683239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f57bc-fefb-4731-adc7-2449890c27cc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:27.694759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f57bc-fefb-4731-adc7-2449890c27cc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:27.696554 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3215/6445] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:27.704577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd61e3c-c8f3-4978-8fcc-ae14fa1907e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:27.705301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd61e3c-c8f3-4978-8fcc-ae14fa1907e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:27.706063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd61e3c-c8f3-4978-8fcc-ae14fa1907e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:27.706521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd61e3c-c8f3-4978-8fcc-ae14fa1907e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:27.707455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd61e3c-c8f3-4978-8fcc-ae14fa1907e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:11:27.707766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd61e3c-c8f3-4978-8fcc-ae14fa1907e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:27.709647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd61e3c-c8f3-4978-8fcc-ae14fa1907e3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:27.726644 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3231/6446] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:11:27.731267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109bcf60-4b30-4d94-9df0-fd6513113f4e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:27.741330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109bcf60-4b30-4d94-9df0-fd6513113f4e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:27.748437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4f7e1-f4c0-4b2c-949d-c7369b6e3969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:27.749104 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4f7e1-f4c0-4b2c-949d-c7369b6e3969 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:27.749378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4f7e1-f4c0-4b2c-949d-c7369b6e3969 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:27.749707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4f7e1-f4c0-4b2c-949d-c7369b6e3969 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:27.750295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4f7e1-f4c0-4b2c-949d-c7369b6e3969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:27.752994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4f7e1-f4c0-4b2c-949d-c7369b6e3969 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:27.801400 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3216/6447] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:11:27 2022] POST /identity/v3/projects => generated 405 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:11:27.802503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd61e3c-c8f3-4978-8fcc-ae14fa1907e3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:27.816816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd61e3c-c8f3-4978-8fcc-ae14fa1907e3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:27.944283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c2b66-a452-4878-8b3f-810706cf72f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:27.944956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c2b66-a452-4878-8b3f-810706cf72f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:27.945236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c2b66-a452-4878-8b3f-810706cf72f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:27.945548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c2b66-a452-4878-8b3f-810706cf72f9 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:27.946682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c2b66-a452-4878-8b3f-810706cf72f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:27.948697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c2b66-a452-4878-8b3f-810706cf72f9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:27.992904 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3232/6448] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:11:27 2022] POST /identity/v3/users => generated 303 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:11:27.996947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4f7e1-f4c0-4b2c-949d-c7369b6e3969 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:28.034231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4f7e1-f4c0-4b2c-949d-c7369b6e3969 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:28.049747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94169ed5-1ae1-45de-a5ac-6463d6cab68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:28.050375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94169ed5-1ae1-45de-a5ac-6463d6cab68f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:28.056751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94169ed5-1ae1-45de-a5ac-6463d6cab68f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:28.057229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94169ed5-1ae1-45de-a5ac-6463d6cab68f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:28.057962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94169ed5-1ae1-45de-a5ac-6463d6cab68f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:28.067512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94169ed5-1ae1-45de-a5ac-6463d6cab68f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:28.094362 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3217/6449] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:11:28.098117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c2b66-a452-4878-8b3f-810706cf72f9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:28.121079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c2b66-a452-4878-8b3f-810706cf72f9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:28.130019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64288b-a116-4f7c-a3ac-65279091d3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:28.130645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64288b-a116-4f7c-a3ac-65279091d3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:28.130923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64288b-a116-4f7c-a3ac-65279091d3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:28.131194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64288b-a116-4f7c-a3ac-65279091d3e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:28.131841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64288b-a116-4f7c-a3ac-65279091d3e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:28.133595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64288b-a116-4f7c-a3ac-65279091d3e0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:28.165846 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3233/6450] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:11:28.167223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94169ed5-1ae1-45de-a5ac-6463d6cab68f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:28.185202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94169ed5-1ae1-45de-a5ac-6463d6cab68f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:28.190925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb4224-3b3b-4d55-aa9a-ae086654a4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:28.192420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb4224-3b3b-4d55-aa9a-ae086654a4a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:28.192833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb4224-3b3b-4d55-aa9a-ae086654a4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:28.193186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb4224-3b3b-4d55-aa9a-ae086654a4a3 admin admin] PATH_INFO: `/v3/projects/01f0b02b1912400f9c7d86861ac65408/users/641b9561d62843199e89f0c510f3a43c/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:28.248877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb4224-3b3b-4d55-aa9a-ae086654a4a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f0b02b1912400f9c7d86861ac65408, user_id=641b9561d62843199e89f0c510f3a43c, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:28.259060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb4224-3b3b-4d55-aa9a-ae086654a4a3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:28.292070 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3218/6451] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:11:28 2022] PUT /identity/v3/projects/01f0b02b1912400f9c7d86861ac65408/users/641b9561d62843199e89f0c510f3a43c/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:28.294572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977655c-b480-4ee4-b91b-15445bb50d56 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:28.294968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977655c-b480-4ee4-b91b-15445bb50d56 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:28.295341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977655c-b480-4ee4-b91b-15445bb50d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:28.334489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6977655c-b480-4ee4-b91b-15445bb50d56 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:28.336019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6977655c-b480-4ee4-b91b-15445bb50d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:28.458668 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:28.498272 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3234/6452] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:28.505639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb4224-3b3b-4d55-aa9a-ae086654a4a3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:28.508794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1ceb4224-3b3b-4d55-aa9a-ae086654a4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:28.631626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb4224-3b3b-4d55-aa9a-ae086654a4a3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:28.636465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaab10-0600-42d6-9a4c-220a400f92c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:28.638043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaab10-0600-42d6-9a4c-220a400f92c8 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:28.638546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaab10-0600-42d6-9a4c-220a400f92c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:28.639046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaab10-0600-42d6-9a4c-220a400f92c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:28.650347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbaab10-0600-42d6-9a4c-220a400f92c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:28.652261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbaab10-0600-42d6-9a4c-220a400f92c8 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:28.668684 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3219/6453] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:11:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:11:31.033377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0125c15-ee92-49e1-aedb-598878a92dcc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:31.033911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0125c15-ee92-49e1-aedb-598878a92dcc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:31.033911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0125c15-ee92-49e1-aedb-598878a92dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:31.114334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c0125c15-ee92-49e1-aedb-598878a92dcc None None] MFA Rules not processed for user `641b9561d62843199e89f0c510f3a43c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:31.115861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c0125c15-ee92-49e1-aedb-598878a92dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:31.283552 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3235/6454] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:31 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:31.288830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaab10-0600-42d6-9a4c-220a400f92c8 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:31.303989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaab10-0600-42d6-9a4c-220a400f92c8 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:31.326396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f527d-ae3e-4bcc-b7c3-92291ac492de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:31.327501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f527d-ae3e-4bcc-b7c3-92291ac492de admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:31.328164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f527d-ae3e-4bcc-b7c3-92291ac492de admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:31.328727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f527d-ae3e-4bcc-b7c3-92291ac492de admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:31.329507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f527d-ae3e-4bcc-b7c3-92291ac492de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:31.332543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f527d-ae3e-4bcc-b7c3-92291ac492de admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:31.394960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0125c15-ee92-49e1-aedb-598878a92dcc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:31.405865 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3220/6455] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:11:31 2022] POST /identity/v3/projects => generated 403 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:11:31.414891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0125c15-ee92-49e1-aedb-598878a92dcc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:31.572975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538afd8-79fd-4522-9626-4e16e1c0703f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:31.573856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538afd8-79fd-4522-9626-4e16e1c0703f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:31.574188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538afd8-79fd-4522-9626-4e16e1c0703f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:31.574783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538afd8-79fd-4522-9626-4e16e1c0703f admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:31.575909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538afd8-79fd-4522-9626-4e16e1c0703f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:31.578943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538afd8-79fd-4522-9626-4e16e1c0703f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:31.621237 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3236/6456] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:11:31 2022] POST /identity/v3/users => generated 308 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:11:31.625073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f527d-ae3e-4bcc-b7c3-92291ac492de admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:31.651697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f527d-ae3e-4bcc-b7c3-92291ac492de admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:31.659173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c193e-2fbe-4088-933d-74ce1a07bd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:31.660442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c193e-2fbe-4088-933d-74ce1a07bd66 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:31.661368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c193e-2fbe-4088-933d-74ce1a07bd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:31.661885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c193e-2fbe-4088-933d-74ce1a07bd66 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:31.662811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c193e-2fbe-4088-933d-74ce1a07bd66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:31.665864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c193e-2fbe-4088-933d-74ce1a07bd66 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:31.688722 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3221/6457] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:11:31.692835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538afd8-79fd-4522-9626-4e16e1c0703f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:31.709443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538afd8-79fd-4522-9626-4e16e1c0703f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:31.716030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a69c0e-c45a-4c20-ab89-969626328e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:31.717470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a69c0e-c45a-4c20-ab89-969626328e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:31.717811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a69c0e-c45a-4c20-ab89-969626328e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:31.718188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a69c0e-c45a-4c20-ab89-969626328e81 admin admin] PATH_INFO: `/v3/projects/357f46ee36e74c55a91ee5115b432c1a/users/433b508c68fb41d68785d37e8e6786ee/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:31.740527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a69c0e-c45a-4c20-ab89-969626328e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=357f46ee36e74c55a91ee5115b432c1a, user_id=433b508c68fb41d68785d37e8e6786ee, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:31.744797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a69c0e-c45a-4c20-ab89-969626328e81 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:31.806102 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3237/6458] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:11:31 2022] PUT /identity/v3/projects/357f46ee36e74c55a91ee5115b432c1a/users/433b508c68fb41d68785d37e8e6786ee/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:11:31.810620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c193e-2fbe-4088-933d-74ce1a07bd66 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:31.829748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c193e-2fbe-4088-933d-74ce1a07bd66 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:31.990903 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:32.010227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0e335-05e2-4081-b82f-80cedb190ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:32.010957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0e335-05e2-4081-b82f-80cedb190ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:32.011675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0e335-05e2-4081-b82f-80cedb190ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:32.012150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0e335-05e2-4081-b82f-80cedb190ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:32.013110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0e335-05e2-4081-b82f-80cedb190ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:32.014966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0e335-05e2-4081-b82f-80cedb190ac2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:32.047432 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3222/6459] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:11:32.048756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a69c0e-c45a-4c20-ab89-969626328e81 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:32.068176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a69c0e-c45a-4c20-ab89-969626328e81 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:32.088782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294513ad-d0fe-4b2f-9158-79cc3ef8a81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:32.089485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294513ad-d0fe-4b2f-9158-79cc3ef8a81a admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:32.089759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294513ad-d0fe-4b2f-9158-79cc3ef8a81a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:32.090025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294513ad-d0fe-4b2f-9158-79cc3ef8a81a admin admin] PATH_INFO: `/v3/projects/357f46ee36e74c55a91ee5115b432c1a/users/433b508c68fb41d68785d37e8e6786ee/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:32.094140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294513ad-d0fe-4b2f-9158-79cc3ef8a81a admin admin] RBAC: Authorizing `identity:create_grant(project_id=357f46ee36e74c55a91ee5115b432c1a, user_id=433b508c68fb41d68785d37e8e6786ee, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:32.099878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294513ad-d0fe-4b2f-9158-79cc3ef8a81a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:32.130814 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3238/6460] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:11:32 2022] PUT /identity/v3/projects/357f46ee36e74c55a91ee5115b432c1a/users/433b508c68fb41d68785d37e8e6786ee/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:34.321782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0e335-05e2-4081-b82f-80cedb190ac2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:34.324364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-deb0e335-05e2-4081-b82f-80cedb190ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:34.366014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0e335-05e2-4081-b82f-80cedb190ac2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:34.610829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103dd12-7362-4b18-b838-95d8e7c0b475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:34.611740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103dd12-7362-4b18-b838-95d8e7c0b475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:34.612171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103dd12-7362-4b18-b838-95d8e7c0b475 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:34.612592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103dd12-7362-4b18-b838-95d8e7c0b475 admin admin] PATH_INFO: `/v3/users/617f2db078ef4302acbbc65d4017875d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:34.614062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103dd12-7362-4b18-b838-95d8e7c0b475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=617f2db078ef4302acbbc65d4017875d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:34.616112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103dd12-7362-4b18-b838-95d8e7c0b475 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:34.694963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3103dd12-7362-4b18-b838-95d8e7c0b475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '617f2db078ef4302acbbc65d4017875d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:34.707070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3103dd12-7362-4b18-b838-95d8e7c0b475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '617f2db078ef4302acbbc65d4017875d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:34.708866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3103dd12-7362-4b18-b838-95d8e7c0b475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '617f2db078ef4302acbbc65d4017875d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:34.741733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3103dd12-7362-4b18-b838-95d8e7c0b475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '617f2db078ef4302acbbc65d4017875d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:34.763032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3103dd12-7362-4b18-b838-95d8e7c0b475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '617f2db078ef4302acbbc65d4017875d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:34.779615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b17832-70b0-47ba-871b-fbad94f091a3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:34.780071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b17832-70b0-47ba-871b-fbad94f091a3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:34.780071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b17832-70b0-47ba-871b-fbad94f091a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:34.799576 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3223/6461] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:11:34 2022] DELETE /identity/v3/users/617f2db078ef4302acbbc65d4017875d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:34.806604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38cf8e-4166-4f1b-bc8f-3df06cd88d18 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:34.809242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38cf8e-4166-4f1b-bc8f-3df06cd88d18 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:34.810309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38cf8e-4166-4f1b-bc8f-3df06cd88d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:34.833945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-92b17832-70b0-47ba-871b-fbad94f091a3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:34.835188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-92b17832-70b0-47ba-871b-fbad94f091a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:34.865013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2d38cf8e-4166-4f1b-bc8f-3df06cd88d18 None None] MFA Rules not processed for user `433b508c68fb41d68785d37e8e6786ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:34.866814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2d38cf8e-4166-4f1b-bc8f-3df06cd88d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:34.923336 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:34.986701 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:34.996254 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3239/6462] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:35.007138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b17832-70b0-47ba-871b-fbad94f091a3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:35.008915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-92b17832-70b0-47ba-871b-fbad94f091a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:35.060255 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3224/6463] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:34 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:35.151676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b17832-70b0-47ba-871b-fbad94f091a3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:35.156294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9298400-b0fa-4903-b2ca-103588b34c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:35.157160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9298400-b0fa-4903-b2ca-103588b34c7e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:35.157606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9298400-b0fa-4903-b2ca-103588b34c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:35.158022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9298400-b0fa-4903-b2ca-103588b34c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:35.174035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9298400-b0fa-4903-b2ca-103588b34c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:35.176171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9298400-b0fa-4903-b2ca-103588b34c7e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:35.188851 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3240/6464] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:11:36.241564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38cf8e-4166-4f1b-bc8f-3df06cd88d18 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:36.243887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2d38cf8e-4166-4f1b-bc8f-3df06cd88d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:36.269345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38cf8e-4166-4f1b-bc8f-3df06cd88d18 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:36.283138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002ca31-4b4a-4a43-913a-9f879911805a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:36.283753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002ca31-4b4a-4a43-913a-9f879911805a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:36.284319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002ca31-4b4a-4a43-913a-9f879911805a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:36.285526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002ca31-4b4a-4a43-913a-9f879911805a admin admin] PATH_INFO: `/v3/projects/449fe64c3c094f3cb0a0dfadcc0d26c7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:36.287003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002ca31-4b4a-4a43-913a-9f879911805a admin admin] RBAC: Authorizing `identity:delete_project(project_id=449fe64c3c094f3cb0a0dfadcc0d26c7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:36.290427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002ca31-4b4a-4a43-913a-9f879911805a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:36.414400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7002ca31-4b4a-4a43-913a-9f879911805a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '449fe64c3c094f3cb0a0dfadcc0d26c7', 'request_id': 'req-7002ca31-4b4a-4a43-913a-9f879911805a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:36.432805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7002ca31-4b4a-4a43-913a-9f879911805a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '449fe64c3c094f3cb0a0dfadcc0d26c7', 'request_id': 'req-7002ca31-4b4a-4a43-913a-9f879911805a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:36.439819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7002ca31-4b4a-4a43-913a-9f879911805a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '449fe64c3c094f3cb0a0dfadcc0d26c7', 'request_id': 'req-7002ca31-4b4a-4a43-913a-9f879911805a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:36.468637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7002ca31-4b4a-4a43-913a-9f879911805a admin admin] The token cache is being invalidate because project 449fe64c3c094f3cb0a0dfadcc0d26c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:11:36.468925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7002ca31-4b4a-4a43-913a-9f879911805a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:36.469606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7002ca31-4b4a-4a43-913a-9f879911805a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:36.474394 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3225/6465] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:11:36 2022] DELETE /identity/v3/projects/449fe64c3c094f3cb0a0dfadcc0d26c7 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:36.476694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f5db1-1d4a-44e6-8feb-a4b16c2e52f1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:36.477233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f5db1-1d4a-44e6-8feb-a4b16c2e52f1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:36.477363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f5db1-1d4a-44e6-8feb-a4b16c2e52f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:36.508654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-998f5db1-1d4a-44e6-8feb-a4b16c2e52f1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:36.509914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-998f5db1-1d4a-44e6-8feb-a4b16c2e52f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:36.530669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002ca31-4b4a-4a43-913a-9f879911805a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:36.531119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7002ca31-4b4a-4a43-913a-9f879911805a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:36.715711 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3241/6466] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:36.723383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e6c85-d802-4e36-a5b6-24eeca6ebbe6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:36.726107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e6c85-d802-4e36-a5b6-24eeca6ebbe6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:36.726711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e6c85-d802-4e36-a5b6-24eeca6ebbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:36.780966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002ca31-4b4a-4a43-913a-9f879911805a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:36.794321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-866e6c85-d802-4e36-a5b6-24eeca6ebbe6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:36.795544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-866e6c85-d802-4e36-a5b6-24eeca6ebbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:36.800592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52815219-e72a-4fb0-b219-83b87605cbed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:36.801245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52815219-e72a-4fb0-b219-83b87605cbed service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:36.802951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52815219-e72a-4fb0-b219-83b87605cbed service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:36.803227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52815219-e72a-4fb0-b219-83b87605cbed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:36.809252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-52815219-e72a-4fb0-b219-83b87605cbed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:36.826393 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3242/6467] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:36.827772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e6c85-d802-4e36-a5b6-24eeca6ebbe6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:36.840577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e6c85-d802-4e36-a5b6-24eeca6ebbe6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:36.850610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52815219-e72a-4fb0-b219-83b87605cbed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:36.854289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52815219-e72a-4fb0-b219-83b87605cbed service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:36.855881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4398bf-6245-4f33-972c-e4c43e586d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:36.856739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4398bf-6245-4f33-972c-e4c43e586d78 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:36.857071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4398bf-6245-4f33-972c-e4c43e586d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:36.857426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4398bf-6245-4f33-972c-e4c43e586d78 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:36.858585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4398bf-6245-4f33-972c-e4c43e586d78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:11:36.858899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4398bf-6245-4f33-972c-e4c43e586d78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:36.862341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4398bf-6245-4f33-972c-e4c43e586d78 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:36.885707 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3226/6468] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:11:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:11:36.906251 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3243/6469] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:11:36.908443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52815219-e72a-4fb0-b219-83b87605cbed service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:36.922080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52815219-e72a-4fb0-b219-83b87605cbed service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:36.934740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4abbc-6fca-44e4-9eb4-45d3e446b667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:36.935415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4abbc-6fca-44e4-9eb4-45d3e446b667 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:36.935698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4abbc-6fca-44e4-9eb4-45d3e446b667 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:36.935960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4abbc-6fca-44e4-9eb4-45d3e446b667 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:36.937783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4abbc-6fca-44e4-9eb4-45d3e446b667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:36.955744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4abbc-6fca-44e4-9eb4-45d3e446b667 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:37.041303 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3227/6470] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:11:36 2022] POST /identity/v3/projects => generated 363 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:11:37.045640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4398bf-6245-4f33-972c-e4c43e586d78 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:37.061230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4398bf-6245-4f33-972c-e4c43e586d78 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:37.172853 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:37.186235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645dd251-e69f-4ec8-b718-b85c7eb7a451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:37.186853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645dd251-e69f-4ec8-b718-b85c7eb7a451 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:37.187130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645dd251-e69f-4ec8-b718-b85c7eb7a451 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:37.189958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645dd251-e69f-4ec8-b718-b85c7eb7a451 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:37.190628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645dd251-e69f-4ec8-b718-b85c7eb7a451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:37.194289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645dd251-e69f-4ec8-b718-b85c7eb7a451 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:37.239373 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3244/6471] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:11:37 2022] POST /identity/v3/users => generated 282 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:11:37.239583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4abbc-6fca-44e4-9eb4-45d3e446b667 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:37.266247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4abbc-6fca-44e4-9eb4-45d3e446b667 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:37.282241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348a83d-ce58-41d7-adce-b23feb2deca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:37.282937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348a83d-ce58-41d7-adce-b23feb2deca2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:37.284037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348a83d-ce58-41d7-adce-b23feb2deca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:37.284323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348a83d-ce58-41d7-adce-b23feb2deca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:37.290119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348a83d-ce58-41d7-adce-b23feb2deca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:37.295467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348a83d-ce58-41d7-adce-b23feb2deca2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:37.334285 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3228/6472] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:11:37.337946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645dd251-e69f-4ec8-b718-b85c7eb7a451 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:37.355970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645dd251-e69f-4ec8-b718-b85c7eb7a451 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:37.375347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6c0c9-8566-408b-a7f0-d2f2c6f8b24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:37.375978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6c0c9-8566-408b-a7f0-d2f2c6f8b24a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:37.376258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6c0c9-8566-408b-a7f0-d2f2c6f8b24a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:37.376526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6c0c9-8566-408b-a7f0-d2f2c6f8b24a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:37.377254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6c0c9-8566-408b-a7f0-d2f2c6f8b24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:37.379691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6c0c9-8566-408b-a7f0-d2f2c6f8b24a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:37.400632 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3245/6473] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:11:37.404407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348a83d-ce58-41d7-adce-b23feb2deca2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:37.438109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348a83d-ce58-41d7-adce-b23feb2deca2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:37.443153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd28fa-0938-464b-b1b8-d1a4db05f6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:37.443844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd28fa-0938-464b-b1b8-d1a4db05f6c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:37.444303 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd28fa-0938-464b-b1b8-d1a4db05f6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:37.444587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd28fa-0938-464b-b1b8-d1a4db05f6c3 admin admin] PATH_INFO: `/v3/projects/8b2f54ef0496490f82c8925d288d3ff4/users/76b9388ed5d54ba4909ba8639f4fa218/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:37.475327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd28fa-0938-464b-b1b8-d1a4db05f6c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b2f54ef0496490f82c8925d288d3ff4, user_id=76b9388ed5d54ba4909ba8639f4fa218, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:37.478648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd28fa-0938-464b-b1b8-d1a4db05f6c3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:37.532191 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3229/6474] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:11:37 2022] PUT /identity/v3/projects/8b2f54ef0496490f82c8925d288d3ff4/users/76b9388ed5d54ba4909ba8639f4fa218/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:37.544018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673452d-54e1-41cd-b30d-1fe30d99bc8f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:37.544526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673452d-54e1-41cd-b30d-1fe30d99bc8f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:37.544673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673452d-54e1-41cd-b30d-1fe30d99bc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:37.613372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2673452d-54e1-41cd-b30d-1fe30d99bc8f None None] MFA Rules not processed for user `76b9388ed5d54ba4909ba8639f4fa218`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:37.614896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2673452d-54e1-41cd-b30d-1fe30d99bc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:37.741224 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3246/6475] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:37.775100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd28fa-0938-464b-b1b8-d1a4db05f6c3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:37.779231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-79bd28fa-0938-464b-b1b8-d1a4db05f6c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:37.805939 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:37.926772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd28fa-0938-464b-b1b8-d1a4db05f6c3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:37.948876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92889cdb-5cc5-48f6-9a4d-00c119fb5ca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:37.949059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92889cdb-5cc5-48f6-9a4d-00c119fb5ca2 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:37.949481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92889cdb-5cc5-48f6-9a4d-00c119fb5ca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:37.949882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673452d-54e1-41cd-b30d-1fe30d99bc8f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:37.950015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92889cdb-5cc5-48f6-9a4d-00c119fb5ca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:37.951456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2673452d-54e1-41cd-b30d-1fe30d99bc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:37.966236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92889cdb-5cc5-48f6-9a4d-00c119fb5ca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:37.970308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92889cdb-5cc5-48f6-9a4d-00c119fb5ca2 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:38.004427 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3230/6476] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:11:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:11:38.111744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673452d-54e1-41cd-b30d-1fe30d99bc8f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:38.142199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708e0a9-84d5-45e5-9bb8-235b9fdb9f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:38.145830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708e0a9-84d5-45e5-9bb8-235b9fdb9f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:38.147324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708e0a9-84d5-45e5-9bb8-235b9fdb9f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:38.148465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708e0a9-84d5-45e5-9bb8-235b9fdb9f47 admin admin] PATH_INFO: `/v3/users/641b9561d62843199e89f0c510f3a43c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:38.154832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708e0a9-84d5-45e5-9bb8-235b9fdb9f47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=641b9561d62843199e89f0c510f3a43c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:38.166304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708e0a9-84d5-45e5-9bb8-235b9fdb9f47 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:38.275976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8708e0a9-84d5-45e5-9bb8-235b9fdb9f47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '641b9561d62843199e89f0c510f3a43c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:38.278346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8708e0a9-84d5-45e5-9bb8-235b9fdb9f47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '641b9561d62843199e89f0c510f3a43c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:38.300906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8708e0a9-84d5-45e5-9bb8-235b9fdb9f47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '641b9561d62843199e89f0c510f3a43c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:38.318377 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:38.326808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8708e0a9-84d5-45e5-9bb8-235b9fdb9f47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '641b9561d62843199e89f0c510f3a43c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:38.347837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8708e0a9-84d5-45e5-9bb8-235b9fdb9f47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '641b9561d62843199e89f0c510f3a43c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:38.370476 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3247/6477] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:11:37 2022] DELETE /identity/v3/users/641b9561d62843199e89f0c510f3a43c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:38.873487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92889cdb-5cc5-48f6-9a4d-00c119fb5ca2 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:38.894900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92889cdb-5cc5-48f6-9a4d-00c119fb5ca2 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:39.099873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094e912-7fbf-4d34-b932-246b6631bbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:39.102449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094e912-7fbf-4d34-b932-246b6631bbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:39.103098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094e912-7fbf-4d34-b932-246b6631bbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:39.103451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094e912-7fbf-4d34-b932-246b6631bbb3 admin admin] PATH_INFO: `/v3/projects/01f0b02b1912400f9c7d86861ac65408` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:39.108163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094e912-7fbf-4d34-b932-246b6631bbb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01f0b02b1912400f9c7d86861ac65408)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:39.111746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094e912-7fbf-4d34-b932-246b6631bbb3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:39.193320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6094e912-7fbf-4d34-b932-246b6631bbb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01f0b02b1912400f9c7d86861ac65408', 'request_id': 'req-6094e912-7fbf-4d34-b932-246b6631bbb3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:39.208388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6094e912-7fbf-4d34-b932-246b6631bbb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01f0b02b1912400f9c7d86861ac65408', 'request_id': 'req-6094e912-7fbf-4d34-b932-246b6631bbb3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:39.227904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6094e912-7fbf-4d34-b932-246b6631bbb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01f0b02b1912400f9c7d86861ac65408', 'request_id': 'req-6094e912-7fbf-4d34-b932-246b6631bbb3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:39.256282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6094e912-7fbf-4d34-b932-246b6631bbb3 admin admin] The token cache is being invalidate because project 01f0b02b1912400f9c7d86861ac65408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:11:39.259707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6094e912-7fbf-4d34-b932-246b6631bbb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:39.260764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6094e912-7fbf-4d34-b932-246b6631bbb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:39.263266 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3231/6478] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:11:38 2022] DELETE /identity/v3/projects/01f0b02b1912400f9c7d86861ac65408 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:39.267417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708e0a9-84d5-45e5-9bb8-235b9fdb9f47 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:39.268979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8708e0a9-84d5-45e5-9bb8-235b9fdb9f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:39.291278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708e0a9-84d5-45e5-9bb8-235b9fdb9f47 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:39.476144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335d29c-fd28-4a7c-a1fb-98f544f5b252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:39.477235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335d29c-fd28-4a7c-a1fb-98f544f5b252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:39.477521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335d29c-fd28-4a7c-a1fb-98f544f5b252 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:39.477789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335d29c-fd28-4a7c-a1fb-98f544f5b252 admin admin] PATH_INFO: `/v3/users/433b508c68fb41d68785d37e8e6786ee` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:39.479988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335d29c-fd28-4a7c-a1fb-98f544f5b252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=433b508c68fb41d68785d37e8e6786ee)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:39.485878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335d29c-fd28-4a7c-a1fb-98f544f5b252 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:39.595600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e335d29c-fd28-4a7c-a1fb-98f544f5b252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '433b508c68fb41d68785d37e8e6786ee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:39.596324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e335d29c-fd28-4a7c-a1fb-98f544f5b252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '433b508c68fb41d68785d37e8e6786ee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:39.622080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e335d29c-fd28-4a7c-a1fb-98f544f5b252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '433b508c68fb41d68785d37e8e6786ee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:39.664766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e335d29c-fd28-4a7c-a1fb-98f544f5b252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '433b508c68fb41d68785d37e8e6786ee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:39.701518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e335d29c-fd28-4a7c-a1fb-98f544f5b252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '433b508c68fb41d68785d37e8e6786ee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:39.712359 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3248/6479] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:11:39 2022] DELETE /identity/v3/users/433b508c68fb41d68785d37e8e6786ee => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:40.343497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094e912-7fbf-4d34-b932-246b6631bbb3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:40.345550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6094e912-7fbf-4d34-b932-246b6631bbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:40.385438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094e912-7fbf-4d34-b932-246b6631bbb3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:40.474595 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:40.546846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13735e88-779f-4913-b186-b431a7515379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:40.549468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13735e88-779f-4913-b186-b431a7515379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:40.549766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13735e88-779f-4913-b186-b431a7515379 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:40.550051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13735e88-779f-4913-b186-b431a7515379 admin admin] PATH_INFO: `/v3/projects/357f46ee36e74c55a91ee5115b432c1a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:40.555149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13735e88-779f-4913-b186-b431a7515379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=357f46ee36e74c55a91ee5115b432c1a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:40.559781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13735e88-779f-4913-b186-b431a7515379 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:40.685197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-13735e88-779f-4913-b186-b431a7515379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '357f46ee36e74c55a91ee5115b432c1a', 'request_id': 'req-13735e88-779f-4913-b186-b431a7515379'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:40.713842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-13735e88-779f-4913-b186-b431a7515379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '357f46ee36e74c55a91ee5115b432c1a', 'request_id': 'req-13735e88-779f-4913-b186-b431a7515379'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:40.729295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-13735e88-779f-4913-b186-b431a7515379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '357f46ee36e74c55a91ee5115b432c1a', 'request_id': 'req-13735e88-779f-4913-b186-b431a7515379'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:40.753881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-13735e88-779f-4913-b186-b431a7515379 admin admin] The token cache is being invalidate because project 357f46ee36e74c55a91ee5115b432c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:11:40.756301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-13735e88-779f-4913-b186-b431a7515379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:40.757065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-13735e88-779f-4913-b186-b431a7515379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:40.759328 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3232/6480] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:11:40 2022] DELETE /identity/v3/projects/357f46ee36e74c55a91ee5115b432c1a => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:40.764293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18ed24-aba4-4854-be4f-658ce6a817d3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:40.764806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18ed24-aba4-4854-be4f-658ce6a817d3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:40.766043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18ed24-aba4-4854-be4f-658ce6a817d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:40.827820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cb18ed24-aba4-4854-be4f-658ce6a817d3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:40.831034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cb18ed24-aba4-4854-be4f-658ce6a817d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:41.004315 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3249/6481] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:41.006035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9cf2a-9d31-40d7-b503-a603ea5921f2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:41.006320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9cf2a-9d31-40d7-b503-a603ea5921f2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:41.006593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9cf2a-9d31-40d7-b503-a603ea5921f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:41.061283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b7a9cf2a-9d31-40d7-b503-a603ea5921f2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:41.063463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b7a9cf2a-9d31-40d7-b503-a603ea5921f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:41.093910 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3233/6482] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:41.098744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18ed24-aba4-4854-be4f-658ce6a817d3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:41.106425 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:41.124654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18ed24-aba4-4854-be4f-658ce6a817d3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:41.145259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eaf82b-5b39-4d57-9938-09e88e2b25a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:41.146257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaf82b-5b39-4d57-9938-09e88e2b25a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:41.146752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaf82b-5b39-4d57-9938-09e88e2b25a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:41.147285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaf82b-5b39-4d57-9938-09e88e2b25a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:41.148383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eaf82b-5b39-4d57-9938-09e88e2b25a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:11:41.149286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eaf82b-5b39-4d57-9938-09e88e2b25a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:41.152764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eaf82b-5b39-4d57-9938-09e88e2b25a9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:41.173981 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3250/6483] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:11:41.182284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9cf2a-9d31-40d7-b503-a603ea5921f2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:41.236063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9cf2a-9d31-40d7-b503-a603ea5921f2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:41.261271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dde4b8-8e70-4bcc-89d2-f0feb3562a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:41.261891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dde4b8-8e70-4bcc-89d2-f0feb3562a3e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:41.262755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dde4b8-8e70-4bcc-89d2-f0feb3562a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:41.262755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dde4b8-8e70-4bcc-89d2-f0feb3562a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:41.263069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dde4b8-8e70-4bcc-89d2-f0feb3562a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:41.274798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dde4b8-8e70-4bcc-89d2-f0feb3562a3e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:41.375524 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3234/6484] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:11:41 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:11:41.379690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eaf82b-5b39-4d57-9938-09e88e2b25a9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:41.406940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eaf82b-5b39-4d57-9938-09e88e2b25a9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:41.587534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c73aa-0f65-4e6c-9e0a-53fcfa5f524e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:41.587940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c73aa-0f65-4e6c-9e0a-53fcfa5f524e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:41.588338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c73aa-0f65-4e6c-9e0a-53fcfa5f524e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:41.589071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c73aa-0f65-4e6c-9e0a-53fcfa5f524e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:41.590070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c73aa-0f65-4e6c-9e0a-53fcfa5f524e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:41.592934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c73aa-0f65-4e6c-9e0a-53fcfa5f524e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:41.626658 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3251/6485] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:11:41 2022] POST /identity/v3/users => generated 288 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:11:41.628339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dde4b8-8e70-4bcc-89d2-f0feb3562a3e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:41.642170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dde4b8-8e70-4bcc-89d2-f0feb3562a3e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:41.659019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f84c4-3a12-4e43-a00e-44591e9e1129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:41.660141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f84c4-3a12-4e43-a00e-44591e9e1129 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:41.660618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f84c4-3a12-4e43-a00e-44591e9e1129 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:41.661702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f84c4-3a12-4e43-a00e-44591e9e1129 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:41.662716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f84c4-3a12-4e43-a00e-44591e9e1129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:41.667757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f84c4-3a12-4e43-a00e-44591e9e1129 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:41.691256 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3235/6486] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:11:41.696306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c73aa-0f65-4e6c-9e0a-53fcfa5f524e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:41.720123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c73aa-0f65-4e6c-9e0a-53fcfa5f524e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:41.728562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a142f-3acb-41c7-9999-d038f824affe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:41.729753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a142f-3acb-41c7-9999-d038f824affe admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:41.730340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a142f-3acb-41c7-9999-d038f824affe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:41.730804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a142f-3acb-41c7-9999-d038f824affe admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:41.731524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a142f-3acb-41c7-9999-d038f824affe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:41.733231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a142f-3acb-41c7-9999-d038f824affe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:41.760967 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3252/6487] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:11:41.764998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f84c4-3a12-4e43-a00e-44591e9e1129 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:41.782795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f84c4-3a12-4e43-a00e-44591e9e1129 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:41.788953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0a8ac-0472-41ce-8d99-3eb1adc727a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:41.789675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0a8ac-0472-41ce-8d99-3eb1adc727a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:41.789958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0a8ac-0472-41ce-8d99-3eb1adc727a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:41.790281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0a8ac-0472-41ce-8d99-3eb1adc727a6 admin admin] PATH_INFO: `/v3/projects/ebe42a2235334664a95690b77cb39e08/users/8cbe7b700c704d4c98515208ad928638/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:41.836485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0a8ac-0472-41ce-8d99-3eb1adc727a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe42a2235334664a95690b77cb39e08, user_id=8cbe7b700c704d4c98515208ad928638, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:41.839207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0a8ac-0472-41ce-8d99-3eb1adc727a6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:41.887101 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3236/6488] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:11:41 2022] PUT /identity/v3/projects/ebe42a2235334664a95690b77cb39e08/users/8cbe7b700c704d4c98515208ad928638/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:41.896460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096910a-c26d-4bfa-827f-e79b934473d5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:41.897696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096910a-c26d-4bfa-827f-e79b934473d5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:41.898318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096910a-c26d-4bfa-827f-e79b934473d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:41.963925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3096910a-c26d-4bfa-827f-e79b934473d5 None None] MFA Rules not processed for user `8cbe7b700c704d4c98515208ad928638`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:41.967682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3096910a-c26d-4bfa-827f-e79b934473d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:42.090004 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3253/6489] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:11:42.101247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0a8ac-0472-41ce-8d99-3eb1adc727a6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:42.104725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a4c0a8ac-0472-41ce-8d99-3eb1adc727a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:42.257711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0a8ac-0472-41ce-8d99-3eb1adc727a6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:42.267047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af3ef4-44a3-4da5-a148-8ea9e332d617 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:42.267838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af3ef4-44a3-4da5-a148-8ea9e332d617 service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:42.268078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af3ef4-44a3-4da5-a148-8ea9e332d617 service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:42.268398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af3ef4-44a3-4da5-a148-8ea9e332d617 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:42.288501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af3ef4-44a3-4da5-a148-8ea9e332d617 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:42.290930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af3ef4-44a3-4da5-a148-8ea9e332d617 service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:42.319612 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3237/6490] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:11:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:11:46.028709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044a4d9-5f3e-486e-a0a0-912e43a89049 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:46.029604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044a4d9-5f3e-486e-a0a0-912e43a89049 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:46.029884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044a4d9-5f3e-486e-a0a0-912e43a89049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:46.069345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9044a4d9-5f3e-486e-a0a0-912e43a89049 None None] MFA Rules not processed for user `bd2bba0db07140c0851cebb70631ce7c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:46.073929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9044a4d9-5f3e-486e-a0a0-912e43a89049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:46.229428 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3254/6491] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:52.306224 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:56.193378 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:11:59.421124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af3ef4-44a3-4da5-a148-8ea9e332d617 service glance] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:59.423202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-23af3ef4-44a3-4da5-a148-8ea9e332d617 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:59.524362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af3ef4-44a3-4da5-a148-8ea9e332d617 service glance] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:11:59.529894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fe307-966c-455c-b33e-b8f6671aadc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:11:59.531287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fe307-966c-455c-b33e-b8f6671aadc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:59.531792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fe307-966c-455c-b33e-b8f6671aadc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:59.532313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fe307-966c-455c-b33e-b8f6671aadc6 admin admin] PATH_INFO: `/v3/users/9f1c017199854022a14c01c173b9eb1e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:59.534132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fe307-966c-455c-b33e-b8f6671aadc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f1c017199854022a14c01c173b9eb1e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:11:59.536340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fe307-966c-455c-b33e-b8f6671aadc6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:11:59.626024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-938fe307-966c-455c-b33e-b8f6671aadc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f1c017199854022a14c01c173b9eb1e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:59.646973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-938fe307-966c-455c-b33e-b8f6671aadc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f1c017199854022a14c01c173b9eb1e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:59.647920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-938fe307-966c-455c-b33e-b8f6671aadc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f1c017199854022a14c01c173b9eb1e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:59.673646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-938fe307-966c-455c-b33e-b8f6671aadc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f1c017199854022a14c01c173b9eb1e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:59.705885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-938fe307-966c-455c-b33e-b8f6671aadc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f1c017199854022a14c01c173b9eb1e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:11:59.721100 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3238/6492] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:11:59 2022] DELETE /identity/v3/users/9f1c017199854022a14c01c173b9eb1e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:11:59.724761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a6a85-1f3d-4a59-a4b6-685ec67ba714 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:11:59.725955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a6a85-1f3d-4a59-a4b6-685ec67ba714 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:11:59.726552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a6a85-1f3d-4a59-a4b6-685ec67ba714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:11:59.760798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c97a6a85-1f3d-4a59-a4b6-685ec67ba714 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:11:59.784630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c97a6a85-1f3d-4a59-a4b6-685ec67ba714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:11:59.949051 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3255/6493] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:11:59.960275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fe307-966c-455c-b33e-b8f6671aadc6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:11:59.961409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-938fe307-966c-455c-b33e-b8f6671aadc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:00.123311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fe307-966c-455c-b33e-b8f6671aadc6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:00.133559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b2e15-182e-40d5-9b85-9c3b831005b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:00.134295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b2e15-182e-40d5-9b85-9c3b831005b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:00.134690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b2e15-182e-40d5-9b85-9c3b831005b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:00.134937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b2e15-182e-40d5-9b85-9c3b831005b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:00.160785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b2e15-182e-40d5-9b85-9c3b831005b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:00.178168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b2e15-182e-40d5-9b85-9c3b831005b5 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:00.232693 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3239/6494] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:11:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:12:00.712387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a6a85-1f3d-4a59-a4b6-685ec67ba714 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:00.715683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c97a6a85-1f3d-4a59-a4b6-685ec67ba714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:00.749946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a6a85-1f3d-4a59-a4b6-685ec67ba714 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:00.755023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa57ec7-a139-4c39-8587-cd22728ee471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:00.755670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa57ec7-a139-4c39-8587-cd22728ee471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:00.755999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa57ec7-a139-4c39-8587-cd22728ee471 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:00.756275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa57ec7-a139-4c39-8587-cd22728ee471 admin admin] PATH_INFO: `/v3/projects/24d3426089b941d6aaa71a088aca0b87` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:00.758729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa57ec7-a139-4c39-8587-cd22728ee471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d3426089b941d6aaa71a088aca0b87)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:00.760665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa57ec7-a139-4c39-8587-cd22728ee471 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:00.848241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5aa57ec7-a139-4c39-8587-cd22728ee471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d3426089b941d6aaa71a088aca0b87', 'request_id': 'req-5aa57ec7-a139-4c39-8587-cd22728ee471'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:00.867158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5aa57ec7-a139-4c39-8587-cd22728ee471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d3426089b941d6aaa71a088aca0b87', 'request_id': 'req-5aa57ec7-a139-4c39-8587-cd22728ee471'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:00.879201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5aa57ec7-a139-4c39-8587-cd22728ee471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d3426089b941d6aaa71a088aca0b87', 'request_id': 'req-5aa57ec7-a139-4c39-8587-cd22728ee471'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:00.903308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5aa57ec7-a139-4c39-8587-cd22728ee471 admin admin] The token cache is being invalidate because project 24d3426089b941d6aaa71a088aca0b87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:12:00.904060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5aa57ec7-a139-4c39-8587-cd22728ee471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:00.905414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5aa57ec7-a139-4c39-8587-cd22728ee471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:00.907125 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3256/6495] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:12:00 2022] DELETE /identity/v3/projects/24d3426089b941d6aaa71a088aca0b87 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:12:00.913063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4de2a4-a944-4175-8bb0-bc4b11b3abed None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:00.913063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4de2a4-a944-4175-8bb0-bc4b11b3abed None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:00.913638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4de2a4-a944-4175-8bb0-bc4b11b3abed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:00.973577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4e4de2a4-a944-4175-8bb0-bc4b11b3abed None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:12:00.976747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4e4de2a4-a944-4175-8bb0-bc4b11b3abed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:01.044101 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:01.210882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa4fff-2040-4e17-ad30-fb0924a96057 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:01.211227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa4fff-2040-4e17-ad30-fb0924a96057 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:01.211517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa4fff-2040-4e17-ad30-fb0924a96057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:01.214953 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3240/6496] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:12:01.269691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1bfa4fff-2040-4e17-ad30-fb0924a96057 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:12:01.270929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1bfa4fff-2040-4e17-ad30-fb0924a96057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:01.295373 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3257/6497] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:12:01.300515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4de2a4-a944-4175-8bb0-bc4b11b3abed None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:01.336875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4de2a4-a944-4175-8bb0-bc4b11b3abed None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:01.353693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a233e7-acd9-4182-be08-8cbb5a958455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:01.354328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a233e7-acd9-4182-be08-8cbb5a958455 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:01.354608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a233e7-acd9-4182-be08-8cbb5a958455 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:01.361947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a233e7-acd9-4182-be08-8cbb5a958455 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:01.362675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a233e7-acd9-4182-be08-8cbb5a958455 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:12:01.362988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a233e7-acd9-4182-be08-8cbb5a958455 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:01.364612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a233e7-acd9-4182-be08-8cbb5a958455 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:01.415619 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3241/6498] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:12:01.416347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa4fff-2040-4e17-ad30-fb0924a96057 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:01.429318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa4fff-2040-4e17-ad30-fb0924a96057 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:01.450776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76a404-18ec-40e1-8462-9b1fc55321cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:01.454237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76a404-18ec-40e1-8462-9b1fc55321cc admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:01.454618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76a404-18ec-40e1-8462-9b1fc55321cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:01.454963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76a404-18ec-40e1-8462-9b1fc55321cc admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:01.458381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76a404-18ec-40e1-8462-9b1fc55321cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:01.464378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76a404-18ec-40e1-8462-9b1fc55321cc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:01.553896 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3258/6499] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:12:01 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:12:01.560540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a233e7-acd9-4182-be08-8cbb5a958455 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:01.602793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a233e7-acd9-4182-be08-8cbb5a958455 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:01.791254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a0997-9545-4f96-8e22-3f9e6a87dbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:01.791888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a0997-9545-4f96-8e22-3f9e6a87dbd6 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:01.792167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a0997-9545-4f96-8e22-3f9e6a87dbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:01.792440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a0997-9545-4f96-8e22-3f9e6a87dbd6 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:01.793722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a0997-9545-4f96-8e22-3f9e6a87dbd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:01.795885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a0997-9545-4f96-8e22-3f9e6a87dbd6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:01.847637 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3242/6500] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:12:01 2022] POST /identity/v3/users => generated 289 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:12:01.849204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76a404-18ec-40e1-8462-9b1fc55321cc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:01.865181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76a404-18ec-40e1-8462-9b1fc55321cc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:01.872352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16cc9b-a471-4c3d-8356-694771d84280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:01.873374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16cc9b-a471-4c3d-8356-694771d84280 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:01.873940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16cc9b-a471-4c3d-8356-694771d84280 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:01.874402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16cc9b-a471-4c3d-8356-694771d84280 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:01.875246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16cc9b-a471-4c3d-8356-694771d84280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:01.877159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16cc9b-a471-4c3d-8356-694771d84280 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:01.895136 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3259/6501] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:12:01.895700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a0997-9545-4f96-8e22-3f9e6a87dbd6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:01.911326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a0997-9545-4f96-8e22-3f9e6a87dbd6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:01.918706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa0714-05b2-41d9-bdcf-7081f7aabc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:01.920192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa0714-05b2-41d9-bdcf-7081f7aabc67 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:01.920856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa0714-05b2-41d9-bdcf-7081f7aabc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:01.921471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa0714-05b2-41d9-bdcf-7081f7aabc67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:01.922295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa0714-05b2-41d9-bdcf-7081f7aabc67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:01.924215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa0714-05b2-41d9-bdcf-7081f7aabc67 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:01.940999 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3243/6502] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:12:01.945485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16cc9b-a471-4c3d-8356-694771d84280 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:01.958250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16cc9b-a471-4c3d-8356-694771d84280 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:01.965669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18adbf-9525-48a2-b05a-0e7a73675eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:01.967026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18adbf-9525-48a2-b05a-0e7a73675eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:01.967347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18adbf-9525-48a2-b05a-0e7a73675eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:01.967785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18adbf-9525-48a2-b05a-0e7a73675eb7 admin admin] PATH_INFO: `/v3/projects/68e61b97dea74d90a4f098912e434e2f/users/f20e1d379e5145ed88740e4acbcf1368/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:01.987312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18adbf-9525-48a2-b05a-0e7a73675eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e61b97dea74d90a4f098912e434e2f, user_id=f20e1d379e5145ed88740e4acbcf1368, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:01.992238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18adbf-9525-48a2-b05a-0e7a73675eb7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:02.020650 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3260/6503] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:12:01 2022] PUT /identity/v3/projects/68e61b97dea74d90a4f098912e434e2f/users/f20e1d379e5145ed88740e4acbcf1368/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:12:02.027657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0062eee-02c8-4f0b-8587-3d36f3fd38fc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:02.027948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0062eee-02c8-4f0b-8587-3d36f3fd38fc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:02.028225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0062eee-02c8-4f0b-8587-3d36f3fd38fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:02.073298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d0062eee-02c8-4f0b-8587-3d36f3fd38fc None None] MFA Rules not processed for user `f20e1d379e5145ed88740e4acbcf1368`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:12:02.081009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d0062eee-02c8-4f0b-8587-3d36f3fd38fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:02.326886 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3244/6504] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:12:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:12:02.351057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18adbf-9525-48a2-b05a-0e7a73675eb7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:02.353366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bf18adbf-9525-48a2-b05a-0e7a73675eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:02.428205 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:02.537843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18adbf-9525-48a2-b05a-0e7a73675eb7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:02.552123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21c1c7-e9be-4228-964d-cf1ee01b91db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:02.553142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21c1c7-e9be-4228-964d-cf1ee01b91db service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:02.554117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21c1c7-e9be-4228-964d-cf1ee01b91db service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:02.554593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21c1c7-e9be-4228-964d-cf1ee01b91db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:02.579343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21c1c7-e9be-4228-964d-cf1ee01b91db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:02.581959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21c1c7-e9be-4228-964d-cf1ee01b91db service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:02.608747 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3261/6505] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:12:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:12:08.375441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0062eee-02c8-4f0b-8587-3d36f3fd38fc None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:08.377109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d0062eee-02c8-4f0b-8587-3d36f3fd38fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:08.458184 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:08.607940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0062eee-02c8-4f0b-8587-3d36f3fd38fc None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:08.625777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17a286-5a83-47ac-b872-1bf09b82eefc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:08.626223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17a286-5a83-47ac-b872-1bf09b82eefc service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:08.626609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17a286-5a83-47ac-b872-1bf09b82eefc service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:08.626979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17a286-5a83-47ac-b872-1bf09b82eefc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:08.629255 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ab17a286-5a83-47ac-b872-1bf09b82eefc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:08.972940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17a286-5a83-47ac-b872-1bf09b82eefc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:08.974293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17a286-5a83-47ac-b872-1bf09b82eefc service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:09.007153 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3245/6506] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:12:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:12:12.608630 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=17 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:18.989757 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=46 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:22.834362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a168be-e660-424b-a844-b627a87bddf3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:22.836171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a168be-e660-424b-a844-b627a87bddf3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:22.837067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a168be-e660-424b-a844-b627a87bddf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:22.966882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-69a168be-e660-424b-a844-b627a87bddf3 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:12:22.968637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-69a168be-e660-424b-a844-b627a87bddf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:23.166678 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3262/6507] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:12:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:12:23.259968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17a286-5a83-47ac-b872-1bf09b82eefc service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:23.281029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17a286-5a83-47ac-b872-1bf09b82eefc service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:23.296189 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f359925-e712-4301-957e-d1124a9eec7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:23.296904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f359925-e712-4301-957e-d1124a9eec7c service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:23.298886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f359925-e712-4301-957e-d1124a9eec7c service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:23.300846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f359925-e712-4301-957e-d1124a9eec7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:23.338227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f359925-e712-4301-957e-d1124a9eec7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:23.339932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f359925-e712-4301-957e-d1124a9eec7c service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:23.353787 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3246/6508] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:12:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:12:25.013980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a168be-e660-424b-a844-b627a87bddf3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:25.029637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a168be-e660-424b-a844-b627a87bddf3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:25.050360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a23e6-9e5f-4893-a370-bfa9510177a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:25.051009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a23e6-9e5f-4893-a370-bfa9510177a4 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:25.051295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a23e6-9e5f-4893-a370-bfa9510177a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:25.051574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a23e6-9e5f-4893-a370-bfa9510177a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:25.070041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2d8a23e6-9e5f-4893-a370-bfa9510177a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:25.446244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a23e6-9e5f-4893-a370-bfa9510177a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:25.447575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a23e6-9e5f-4893-a370-bfa9510177a4 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:25.484009 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3263/6509] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:12:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:12:33.345842 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:35.463734 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=67 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:35.824746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f359925-e712-4301-957e-d1124a9eec7c service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:35.866867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f359925-e712-4301-957e-d1124a9eec7c service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:35.873368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ea71a-1753-48b7-bb5f-90bd68ed1633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:35.874324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ea71a-1753-48b7-bb5f-90bd68ed1633 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:35.874765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ea71a-1753-48b7-bb5f-90bd68ed1633 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:35.875207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ea71a-1753-48b7-bb5f-90bd68ed1633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:35.881974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-388ea71a-1753-48b7-bb5f-90bd68ed1633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:35.919048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ea71a-1753-48b7-bb5f-90bd68ed1633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:35.925792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ea71a-1753-48b7-bb5f-90bd68ed1633 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:35.959517 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3247/6510] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:12:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:12:38.303638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a23e6-9e5f-4893-a370-bfa9510177a4 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:38.305619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2d8a23e6-9e5f-4893-a370-bfa9510177a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:38.551530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a23e6-9e5f-4893-a370-bfa9510177a4 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:38.564090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d53b8-4f6a-4acb-a2ab-de4b350bcb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:38.565176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d53b8-4f6a-4acb-a2ab-de4b350bcb19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:38.565615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d53b8-4f6a-4acb-a2ab-de4b350bcb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:38.566055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d53b8-4f6a-4acb-a2ab-de4b350bcb19 admin admin] PATH_INFO: `/v3/users/8cbe7b700c704d4c98515208ad928638` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:38.567532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d53b8-4f6a-4acb-a2ab-de4b350bcb19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cbe7b700c704d4c98515208ad928638)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:38.571487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d53b8-4f6a-4acb-a2ab-de4b350bcb19 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:38.809307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-685d53b8-4f6a-4acb-a2ab-de4b350bcb19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cbe7b700c704d4c98515208ad928638'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:38.810065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-685d53b8-4f6a-4acb-a2ab-de4b350bcb19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cbe7b700c704d4c98515208ad928638'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:38.851310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-685d53b8-4f6a-4acb-a2ab-de4b350bcb19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cbe7b700c704d4c98515208ad928638'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:38.885825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-685d53b8-4f6a-4acb-a2ab-de4b350bcb19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cbe7b700c704d4c98515208ad928638'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:38.906682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-685d53b8-4f6a-4acb-a2ab-de4b350bcb19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cbe7b700c704d4c98515208ad928638'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:38.928917 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3264/6511] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:12:38 2022] DELETE /identity/v3/users/8cbe7b700c704d4c98515208ad928638 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:12:38.933863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478026a5-b912-47f2-afb2-2c99e0123b4b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:38.934726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478026a5-b912-47f2-afb2-2c99e0123b4b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:38.935181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478026a5-b912-47f2-afb2-2c99e0123b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:38.997551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-478026a5-b912-47f2-afb2-2c99e0123b4b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:12:38.999023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-478026a5-b912-47f2-afb2-2c99e0123b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:39.188205 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3248/6512] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:12:39.194558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d53b8-4f6a-4acb-a2ab-de4b350bcb19 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:39.196233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-685d53b8-4f6a-4acb-a2ab-de4b350bcb19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:39.471128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d53b8-4f6a-4acb-a2ab-de4b350bcb19 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:39.498826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9f7b0-834a-4609-98ea-f9a368132a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:39.501840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9f7b0-834a-4609-98ea-f9a368132a89 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:39.504167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9f7b0-834a-4609-98ea-f9a368132a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:39.505459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9f7b0-834a-4609-98ea-f9a368132a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:39.533886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9f7b0-834a-4609-98ea-f9a368132a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:39.537738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9f7b0-834a-4609-98ea-f9a368132a89 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:39.600207 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3265/6513] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:12:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:12:40.847382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478026a5-b912-47f2-afb2-2c99e0123b4b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:40.848941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-478026a5-b912-47f2-afb2-2c99e0123b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:40.904341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478026a5-b912-47f2-afb2-2c99e0123b4b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:40.922321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa71803-2cef-475f-aec3-6700de6e8c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:40.925467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa71803-2cef-475f-aec3-6700de6e8c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:40.926066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa71803-2cef-475f-aec3-6700de6e8c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:40.927320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa71803-2cef-475f-aec3-6700de6e8c2d admin admin] PATH_INFO: `/v3/projects/ebe42a2235334664a95690b77cb39e08` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:40.930236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa71803-2cef-475f-aec3-6700de6e8c2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebe42a2235334664a95690b77cb39e08)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:40.947894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa71803-2cef-475f-aec3-6700de6e8c2d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:41.122387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9fa71803-2cef-475f-aec3-6700de6e8c2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebe42a2235334664a95690b77cb39e08', 'request_id': 'req-9fa71803-2cef-475f-aec3-6700de6e8c2d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:41.146378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9fa71803-2cef-475f-aec3-6700de6e8c2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebe42a2235334664a95690b77cb39e08', 'request_id': 'req-9fa71803-2cef-475f-aec3-6700de6e8c2d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:41.167666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9fa71803-2cef-475f-aec3-6700de6e8c2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebe42a2235334664a95690b77cb39e08', 'request_id': 'req-9fa71803-2cef-475f-aec3-6700de6e8c2d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:41.216317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9fa71803-2cef-475f-aec3-6700de6e8c2d admin admin] The token cache is being invalidate because project ebe42a2235334664a95690b77cb39e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:12:41.220008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9fa71803-2cef-475f-aec3-6700de6e8c2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:41.221773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9fa71803-2cef-475f-aec3-6700de6e8c2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:41.225112 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3249/6514] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:12:40 2022] DELETE /identity/v3/projects/ebe42a2235334664a95690b77cb39e08 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:12:41.237029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c1c59-f1a9-4cf2-9df0-e5eb5b62e44a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:41.238518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c1c59-f1a9-4cf2-9df0-e5eb5b62e44a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:41.239853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c1c59-f1a9-4cf2-9df0-e5eb5b62e44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:41.321857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fa2c1c59-f1a9-4cf2-9df0-e5eb5b62e44a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:12:41.328699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fa2c1c59-f1a9-4cf2-9df0-e5eb5b62e44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:41.404311 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:42.205566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7f1ba-c28e-4775-b6c5-e4f48767ba9a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:42.206285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7f1ba-c28e-4775-b6c5-e4f48767ba9a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:42.206568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7f1ba-c28e-4775-b6c5-e4f48767ba9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:42.212141 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3266/6515] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 977 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:12:42.275657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-11d7f1ba-c28e-4775-b6c5-e4f48767ba9a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:12:42.276984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-11d7f1ba-c28e-4775-b6c5-e4f48767ba9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:42.324069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c1c59-f1a9-4cf2-9df0-e5eb5b62e44a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:42.324732 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3250/6516] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:12:42.338695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c1c59-f1a9-4cf2-9df0-e5eb5b62e44a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:42.353548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0d1b3-b07b-41d7-90c6-0ac140560022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:42.354330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0d1b3-b07b-41d7-90c6-0ac140560022 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:42.357959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0d1b3-b07b-41d7-90c6-0ac140560022 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:42.358554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0d1b3-b07b-41d7-90c6-0ac140560022 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:42.359470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0d1b3-b07b-41d7-90c6-0ac140560022 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:12:42.360006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0d1b3-b07b-41d7-90c6-0ac140560022 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:42.362076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0d1b3-b07b-41d7-90c6-0ac140560022 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:42.420481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7f1ba-c28e-4775-b6c5-e4f48767ba9a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:42.429769 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3267/6517] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:12:42.434396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7f1ba-c28e-4775-b6c5-e4f48767ba9a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:42.464616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779a757-9f30-421b-a657-667871b58694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:42.465307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779a757-9f30-421b-a657-667871b58694 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:42.465825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779a757-9f30-421b-a657-667871b58694 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:42.466112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779a757-9f30-421b-a657-667871b58694 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:42.466751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779a757-9f30-421b-a657-667871b58694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:42.477983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779a757-9f30-421b-a657-667871b58694 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:42.577123 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3251/6518] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:12:42 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:12:42.582291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0d1b3-b07b-41d7-90c6-0ac140560022 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:42.611299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0d1b3-b07b-41d7-90c6-0ac140560022 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:42.779356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b20776-6a67-447b-801d-3d3f427a5f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:42.782462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b20776-6a67-447b-801d-3d3f427a5f5c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:42.782462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b20776-6a67-447b-801d-3d3f427a5f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:42.782462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b20776-6a67-447b-801d-3d3f427a5f5c admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:42.782462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b20776-6a67-447b-801d-3d3f427a5f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:42.783068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b20776-6a67-447b-801d-3d3f427a5f5c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:42.840379 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3268/6519] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:12:42 2022] POST /identity/v3/users => generated 288 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:12:42.841324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779a757-9f30-421b-a657-667871b58694 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:42.857831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779a757-9f30-421b-a657-667871b58694 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:42.874910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604fe7e-8bec-43d3-b332-217ba8bcc475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:42.878842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604fe7e-8bec-43d3-b332-217ba8bcc475 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:42.881060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604fe7e-8bec-43d3-b332-217ba8bcc475 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:42.882621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604fe7e-8bec-43d3-b332-217ba8bcc475 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:42.883548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604fe7e-8bec-43d3-b332-217ba8bcc475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:42.891325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604fe7e-8bec-43d3-b332-217ba8bcc475 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:42.941792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b20776-6a67-447b-801d-3d3f427a5f5c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:42.944535 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3252/6520] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:12:42.956784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b20776-6a67-447b-801d-3d3f427a5f5c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:42.992846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d1753-f68d-487f-ae75-95ad12f54580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:42.993490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d1753-f68d-487f-ae75-95ad12f54580 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:42.993770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d1753-f68d-487f-ae75-95ad12f54580 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:42.994042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d1753-f68d-487f-ae75-95ad12f54580 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:42.994710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d1753-f68d-487f-ae75-95ad12f54580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:42.996366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d1753-f68d-487f-ae75-95ad12f54580 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:43.026722 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3269/6521] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:12:43.027885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604fe7e-8bec-43d3-b332-217ba8bcc475 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:43.092347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604fe7e-8bec-43d3-b332-217ba8bcc475 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:43.108581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30afebdb-66ab-4c6c-b338-9f94f71a2c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:43.109355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afebdb-66ab-4c6c-b338-9f94f71a2c26 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:43.109640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afebdb-66ab-4c6c-b338-9f94f71a2c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:43.109906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afebdb-66ab-4c6c-b338-9f94f71a2c26 admin admin] PATH_INFO: `/v3/projects/d8b60a261d8c406cbe3add91e8f34983/users/2f839356c7564779ac387f916fd83b43/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:43.170957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30afebdb-66ab-4c6c-b338-9f94f71a2c26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8b60a261d8c406cbe3add91e8f34983, user_id=2f839356c7564779ac387f916fd83b43, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:43.173904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30afebdb-66ab-4c6c-b338-9f94f71a2c26 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:43.231920 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:43.258499 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3253/6522] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:12:43 2022] PUT /identity/v3/projects/d8b60a261d8c406cbe3add91e8f34983/users/2f839356c7564779ac387f916fd83b43/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:12:43.268922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e36227-f28d-4400-9ecd-c6db21d92b36 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:43.269200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e36227-f28d-4400-9ecd-c6db21d92b36 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:43.269466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e36227-f28d-4400-9ecd-c6db21d92b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:43.417321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a6e36227-f28d-4400-9ecd-c6db21d92b36 None None] MFA Rules not processed for user `2f839356c7564779ac387f916fd83b43`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:12:43.424961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a6e36227-f28d-4400-9ecd-c6db21d92b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:43.652447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30afebdb-66ab-4c6c-b338-9f94f71a2c26 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:43.661830 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3270/6523] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:12:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:12:43.828829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30afebdb-66ab-4c6c-b338-9f94f71a2c26 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:43.844702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb917d59-8b41-4154-b340-2d1460846e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:43.844958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb917d59-8b41-4154-b340-2d1460846e01 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:43.845368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb917d59-8b41-4154-b340-2d1460846e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:43.845523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb917d59-8b41-4154-b340-2d1460846e01 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:43.846137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb917d59-8b41-4154-b340-2d1460846e01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:43.848037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb917d59-8b41-4154-b340-2d1460846e01 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:43.968056 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3254/6524] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:12:43 2022] POST /identity/v3/projects => generated 375 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:12:43.972304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e36227-f28d-4400-9ecd-c6db21d92b36 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:44.005603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e36227-f28d-4400-9ecd-c6db21d92b36 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:44.039183 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:44.149199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7cb76-dde9-44cc-a9e4-71fe306adedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:44.150863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7cb76-dde9-44cc-a9e4-71fe306adedd admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:44.151161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7cb76-dde9-44cc-a9e4-71fe306adedd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:44.151462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7cb76-dde9-44cc-a9e4-71fe306adedd admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:44.153326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7cb76-dde9-44cc-a9e4-71fe306adedd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:44.162466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7cb76-dde9-44cc-a9e4-71fe306adedd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:44.220968 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3271/6525] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:12:43 2022] POST /identity/v3/users => generated 294 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:12:44.230621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb917d59-8b41-4154-b340-2d1460846e01 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:44.244699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb917d59-8b41-4154-b340-2d1460846e01 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:44.261135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468894a5-17a2-4931-a634-3fd81f302657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:44.273270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468894a5-17a2-4931-a634-3fd81f302657 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:44.274669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468894a5-17a2-4931-a634-3fd81f302657 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:44.275023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468894a5-17a2-4931-a634-3fd81f302657 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:44.275773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468894a5-17a2-4931-a634-3fd81f302657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:44.278181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468894a5-17a2-4931-a634-3fd81f302657 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:44.323774 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3255/6526] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:12:44.324621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7cb76-dde9-44cc-a9e4-71fe306adedd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:44.342443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7cb76-dde9-44cc-a9e4-71fe306adedd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:44.357786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc6cc1-bfdb-400d-9e06-b8e4392e51a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:44.368314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc6cc1-bfdb-400d-9e06-b8e4392e51a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:44.368637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc6cc1-bfdb-400d-9e06-b8e4392e51a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:44.376889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc6cc1-bfdb-400d-9e06-b8e4392e51a2 admin admin] PATH_INFO: `/v3/projects/16541a61177f4aa894a5369f1057b5b1/users/afa2604c106e40ca81ff6dd6d24dd5a4/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:44.431419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc6cc1-bfdb-400d-9e06-b8e4392e51a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16541a61177f4aa894a5369f1057b5b1, user_id=afa2604c106e40ca81ff6dd6d24dd5a4, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:44.448001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc6cc1-bfdb-400d-9e06-b8e4392e51a2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:44.514963 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3272/6527] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:12:44 2022] PUT /identity/v3/projects/16541a61177f4aa894a5369f1057b5b1/users/afa2604c106e40ca81ff6dd6d24dd5a4/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:12:44.515321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468894a5-17a2-4931-a634-3fd81f302657 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:44.560895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468894a5-17a2-4931-a634-3fd81f302657 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:44.792275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dccf6e3-e4de-4a73-a1fe-75a346c423d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:44.793088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccf6e3-e4de-4a73-a1fe-75a346c423d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:44.794475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccf6e3-e4de-4a73-a1fe-75a346c423d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:44.794973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccf6e3-e4de-4a73-a1fe-75a346c423d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:44.797291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dccf6e3-e4de-4a73-a1fe-75a346c423d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:44.799409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dccf6e3-e4de-4a73-a1fe-75a346c423d8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:44.836475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc6cc1-bfdb-400d-9e06-b8e4392e51a2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:44.837282 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3256/6528] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:12:44.854928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc6cc1-bfdb-400d-9e06-b8e4392e51a2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:44.866803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb35f95-6a74-4d45-b7b8-10d952901452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:44.867487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb35f95-6a74-4d45-b7b8-10d952901452 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:44.867760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb35f95-6a74-4d45-b7b8-10d952901452 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:44.868026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb35f95-6a74-4d45-b7b8-10d952901452 admin admin] PATH_INFO: `/v3/projects/16541a61177f4aa894a5369f1057b5b1/users/afa2604c106e40ca81ff6dd6d24dd5a4/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:44.885643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb35f95-6a74-4d45-b7b8-10d952901452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16541a61177f4aa894a5369f1057b5b1, user_id=afa2604c106e40ca81ff6dd6d24dd5a4, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:44.894443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb35f95-6a74-4d45-b7b8-10d952901452 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:44.953543 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3273/6529] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:12:44 2022] PUT /identity/v3/projects/16541a61177f4aa894a5369f1057b5b1/users/afa2604c106e40ca81ff6dd6d24dd5a4/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:12:44.955992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b0d43-0467-4951-865b-b0debba64ad4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:44.956536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b0d43-0467-4951-865b-b0debba64ad4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:44.957079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b0d43-0467-4951-865b-b0debba64ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:45.040218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d70b0d43-0467-4951-865b-b0debba64ad4 None None] MFA Rules not processed for user `afa2604c106e40ca81ff6dd6d24dd5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:12:45.046623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d70b0d43-0467-4951-865b-b0debba64ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:45.081567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb35f95-6a74-4d45-b7b8-10d952901452 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:45.087540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dcb35f95-6a74-4d45-b7b8-10d952901452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:45.295789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb35f95-6a74-4d45-b7b8-10d952901452 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:45.307191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659f9cd-2e00-4ae6-a089-95fe33cfe113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:45.307847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659f9cd-2e00-4ae6-a089-95fe33cfe113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:45.308130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659f9cd-2e00-4ae6-a089-95fe33cfe113 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:45.309658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659f9cd-2e00-4ae6-a089-95fe33cfe113 admin admin] PATH_INFO: `/v3/users/f20e1d379e5145ed88740e4acbcf1368` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:45.311917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659f9cd-2e00-4ae6-a089-95fe33cfe113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f20e1d379e5145ed88740e4acbcf1368)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:45.313892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659f9cd-2e00-4ae6-a089-95fe33cfe113 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:45.333202 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:45.386917 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3257/6530] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:12:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:12:45.414321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f659f9cd-2e00-4ae6-a089-95fe33cfe113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f20e1d379e5145ed88740e4acbcf1368'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:45.416633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f659f9cd-2e00-4ae6-a089-95fe33cfe113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f20e1d379e5145ed88740e4acbcf1368'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:45.446300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f659f9cd-2e00-4ae6-a089-95fe33cfe113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f20e1d379e5145ed88740e4acbcf1368'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:45.461987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b0d43-0467-4951-865b-b0debba64ad4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:45.463980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d70b0d43-0467-4951-865b-b0debba64ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:45.501446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f659f9cd-2e00-4ae6-a089-95fe33cfe113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f20e1d379e5145ed88740e4acbcf1368'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:45.502777 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:45.512411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f659f9cd-2e00-4ae6-a089-95fe33cfe113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f20e1d379e5145ed88740e4acbcf1368'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:45.521188 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3274/6531] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:12:45 2022] DELETE /identity/v3/users/f20e1d379e5145ed88740e4acbcf1368 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:12:45.526238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041c37e-9c9c-4e53-867a-4e1dc95d2217 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:45.526516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041c37e-9c9c-4e53-867a-4e1dc95d2217 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:45.527014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041c37e-9c9c-4e53-867a-4e1dc95d2217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:45.554678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5041c37e-9c9c-4e53-867a-4e1dc95d2217 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:12:45.555880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5041c37e-9c9c-4e53-867a-4e1dc95d2217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:45.648011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b0d43-0467-4951-865b-b0debba64ad4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:45.713977 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3275/6532] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:12:45.732726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041c37e-9c9c-4e53-867a-4e1dc95d2217 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:45.735968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5041c37e-9c9c-4e53-867a-4e1dc95d2217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:45.761142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c612d1-39e4-4107-81ea-7ea93a2eb493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:45.761764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c612d1-39e4-4107-81ea-7ea93a2eb493 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:45.762041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c612d1-39e4-4107-81ea-7ea93a2eb493 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:45.762312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c612d1-39e4-4107-81ea-7ea93a2eb493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:45.764083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e1c612d1-39e4-4107-81ea-7ea93a2eb493 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:45.921768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041c37e-9c9c-4e53-867a-4e1dc95d2217 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:45.934809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d7ce0-c70a-4a53-8c3a-fff328b87ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:45.935453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d7ce0-c70a-4a53-8c3a-fff328b87ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:45.935732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d7ce0-c70a-4a53-8c3a-fff328b87ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:45.936009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d7ce0-c70a-4a53-8c3a-fff328b87ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:45.975184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d7ce0-c70a-4a53-8c3a-fff328b87ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:45.984463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d7ce0-c70a-4a53-8c3a-fff328b87ce0 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:45.996542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c612d1-39e4-4107-81ea-7ea93a2eb493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:45.998035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c612d1-39e4-4107-81ea-7ea93a2eb493 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:46.017981 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3276/6533] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:12:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:12:46.032803 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3258/6534] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:12:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:12:46.489389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d7ce0-c70a-4a53-8c3a-fff328b87ce0 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:46.491874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f07d7ce0-c70a-4a53-8c3a-fff328b87ce0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:46.568726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d7ce0-c70a-4a53-8c3a-fff328b87ce0 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:46.585205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2a6e4-9cab-4833-a747-14cf626800ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:46.591910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2a6e4-9cab-4833-a747-14cf626800ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:46.592518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2a6e4-9cab-4833-a747-14cf626800ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:46.593382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2a6e4-9cab-4833-a747-14cf626800ab admin admin] PATH_INFO: `/v3/projects/68e61b97dea74d90a4f098912e434e2f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:46.595240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2a6e4-9cab-4833-a747-14cf626800ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=68e61b97dea74d90a4f098912e434e2f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:46.603203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2a6e4-9cab-4833-a747-14cf626800ab admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:46.743098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2ff2a6e4-9cab-4833-a747-14cf626800ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68e61b97dea74d90a4f098912e434e2f', 'request_id': 'req-2ff2a6e4-9cab-4833-a747-14cf626800ab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:46.757743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2ff2a6e4-9cab-4833-a747-14cf626800ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68e61b97dea74d90a4f098912e434e2f', 'request_id': 'req-2ff2a6e4-9cab-4833-a747-14cf626800ab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:46.766476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2ff2a6e4-9cab-4833-a747-14cf626800ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68e61b97dea74d90a4f098912e434e2f', 'request_id': 'req-2ff2a6e4-9cab-4833-a747-14cf626800ab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:46.814987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2ff2a6e4-9cab-4833-a747-14cf626800ab admin admin] The token cache is being invalidate because project 68e61b97dea74d90a4f098912e434e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:12:46.814987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2ff2a6e4-9cab-4833-a747-14cf626800ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:46.820193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2ff2a6e4-9cab-4833-a747-14cf626800ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:46.824684 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3277/6535] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:12:46 2022] DELETE /identity/v3/projects/68e61b97dea74d90a4f098912e434e2f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:12:46.829025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f64dd-4924-4677-90ea-e017fb4a7bd7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:46.829507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f64dd-4924-4677-90ea-e017fb4a7bd7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:46.830057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f64dd-4924-4677-90ea-e017fb4a7bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:46.874386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-295f64dd-4924-4677-90ea-e017fb4a7bd7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:12:46.877333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-295f64dd-4924-4677-90ea-e017fb4a7bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:47.172347 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3259/6536] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:12:47.180644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f65f32-9b4b-4b28-b0ca-165202d22aeb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:47.181074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f65f32-9b4b-4b28-b0ca-165202d22aeb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:47.181725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f65f32-9b4b-4b28-b0ca-165202d22aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:47.235643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-09f65f32-9b4b-4b28-b0ca-165202d22aeb None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:12:47.245184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-09f65f32-9b4b-4b28-b0ca-165202d22aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:47.293356 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3278/6537] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:12:47.297569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f64dd-4924-4677-90ea-e017fb4a7bd7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:47.303890 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:47.315166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f64dd-4924-4677-90ea-e017fb4a7bd7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:47.335181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab50406-2c58-4302-8eae-50df831016d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:47.337256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab50406-2c58-4302-8eae-50df831016d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:47.338067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab50406-2c58-4302-8eae-50df831016d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:47.339756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab50406-2c58-4302-8eae-50df831016d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:47.341100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab50406-2c58-4302-8eae-50df831016d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:12:47.341837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab50406-2c58-4302-8eae-50df831016d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:47.347328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab50406-2c58-4302-8eae-50df831016d4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:47.384509 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3260/6538] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:12:47.385877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f65f32-9b4b-4b28-b0ca-165202d22aeb None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:47.416628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f65f32-9b4b-4b28-b0ca-165202d22aeb None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:47.432128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69fc75-8032-4590-918c-56968b8916ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:47.433949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69fc75-8032-4590-918c-56968b8916ae admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:47.435145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69fc75-8032-4590-918c-56968b8916ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:47.437059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69fc75-8032-4590-918c-56968b8916ae admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:47.437937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69fc75-8032-4590-918c-56968b8916ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:47.444973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69fc75-8032-4590-918c-56968b8916ae admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:47.458956 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:47.529858 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3279/6539] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:12:47 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:12:47.533825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab50406-2c58-4302-8eae-50df831016d4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:47.564404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab50406-2c58-4302-8eae-50df831016d4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:47.675076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a640580-2b96-4228-809a-94e09662c6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:47.679007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a640580-2b96-4228-809a-94e09662c6fb admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:47.696784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a640580-2b96-4228-809a-94e09662c6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:47.697229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a640580-2b96-4228-809a-94e09662c6fb admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:47.702432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a640580-2b96-4228-809a-94e09662c6fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:47.705085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a640580-2b96-4228-809a-94e09662c6fb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:47.764877 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3261/6540] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:12:47 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:12:47.769034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69fc75-8032-4590-918c-56968b8916ae admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:47.793770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69fc75-8032-4590-918c-56968b8916ae admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:47.808834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec7586-3666-4ad0-bba9-e6b075bae731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:47.812117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec7586-3666-4ad0-bba9-e6b075bae731 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:47.812560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec7586-3666-4ad0-bba9-e6b075bae731 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:47.812996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec7586-3666-4ad0-bba9-e6b075bae731 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:47.813824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec7586-3666-4ad0-bba9-e6b075bae731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:47.842210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec7586-3666-4ad0-bba9-e6b075bae731 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:47.883866 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3280/6541] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:12:47.888432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a640580-2b96-4228-809a-94e09662c6fb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:47.912912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a640580-2b96-4228-809a-94e09662c6fb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:47.932116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b136ce5-865f-47cd-a4eb-9e23ffb9da91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:47.933649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b136ce5-865f-47cd-a4eb-9e23ffb9da91 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:47.934161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b136ce5-865f-47cd-a4eb-9e23ffb9da91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:47.934866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b136ce5-865f-47cd-a4eb-9e23ffb9da91 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:47.936648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b136ce5-865f-47cd-a4eb-9e23ffb9da91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:47.948973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b136ce5-865f-47cd-a4eb-9e23ffb9da91 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:47.970029 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3262/6542] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:12:47.975355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec7586-3666-4ad0-bba9-e6b075bae731 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:48.001186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec7586-3666-4ad0-bba9-e6b075bae731 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:48.014552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9445c3-eab1-44ff-bb34-fe3ed33a8e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:48.016080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9445c3-eab1-44ff-bb34-fe3ed33a8e03 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:48.016593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9445c3-eab1-44ff-bb34-fe3ed33a8e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:48.017118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9445c3-eab1-44ff-bb34-fe3ed33a8e03 admin admin] PATH_INFO: `/v3/projects/b1bf345990cc4ca097666afdf2e04503/users/1ef111d26c96440db916822a535ff59a/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:48.051767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9445c3-eab1-44ff-bb34-fe3ed33a8e03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1bf345990cc4ca097666afdf2e04503, user_id=1ef111d26c96440db916822a535ff59a, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:48.054684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9445c3-eab1-44ff-bb34-fe3ed33a8e03 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:48.100118 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3281/6543] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:12:47 2022] PUT /identity/v3/projects/b1bf345990cc4ca097666afdf2e04503/users/1ef111d26c96440db916822a535ff59a/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:12:48.102362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cce6e-2ff3-48ae-a7c0-b58e698cf7b8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:48.102900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cce6e-2ff3-48ae-a7c0-b58e698cf7b8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:48.103287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cce6e-2ff3-48ae-a7c0-b58e698cf7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:48.146523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4d0cce6e-2ff3-48ae-a7c0-b58e698cf7b8 None None] MFA Rules not processed for user `1ef111d26c96440db916822a535ff59a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:12:48.148142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4d0cce6e-2ff3-48ae-a7c0-b58e698cf7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:48.448560 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3263/6544] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:12:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:12:48.461109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9445c3-eab1-44ff-bb34-fe3ed33a8e03 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:48.463104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7d9445c3-eab1-44ff-bb34-fe3ed33a8e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:48.617588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9445c3-eab1-44ff-bb34-fe3ed33a8e03 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:48.628763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379db96-fbd0-47ca-9f23-7d4440a3c6c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:48.630196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379db96-fbd0-47ca-9f23-7d4440a3c6c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:48.630637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379db96-fbd0-47ca-9f23-7d4440a3c6c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:48.631089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379db96-fbd0-47ca-9f23-7d4440a3c6c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:48.646795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379db96-fbd0-47ca-9f23-7d4440a3c6c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:48.648468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379db96-fbd0-47ca-9f23-7d4440a3c6c1 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:48.688077 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3282/6545] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:12:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:12:49.947835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0cce6e-2ff3-48ae-a7c0-b58e698cf7b8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:50.192152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0cce6e-2ff3-48ae-a7c0-b58e698cf7b8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:50.210156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e7201-9635-45e3-82c8-3a861d0132f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:50.211282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e7201-9635-45e3-82c8-3a861d0132f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:50.211810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e7201-9635-45e3-82c8-3a861d0132f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:50.212311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e7201-9635-45e3-82c8-3a861d0132f7 admin admin] PATH_INFO: `/v3/users/1ef111d26c96440db916822a535ff59a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:50.215062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e7201-9635-45e3-82c8-3a861d0132f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ef111d26c96440db916822a535ff59a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:50.225378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e7201-9635-45e3-82c8-3a861d0132f7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:50.246687 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:50.353041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d4e7201-9635-45e3-82c8-3a861d0132f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ef111d26c96440db916822a535ff59a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:50.377576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d4e7201-9635-45e3-82c8-3a861d0132f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ef111d26c96440db916822a535ff59a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:50.377980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d4e7201-9635-45e3-82c8-3a861d0132f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ef111d26c96440db916822a535ff59a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:50.393285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d4e7201-9635-45e3-82c8-3a861d0132f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ef111d26c96440db916822a535ff59a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:50.401716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d4e7201-9635-45e3-82c8-3a861d0132f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ef111d26c96440db916822a535ff59a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:50.415524 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3264/6546] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:12:49 2022] DELETE /identity/v3/users/1ef111d26c96440db916822a535ff59a => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:12:50.417430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967ca70-7e42-4372-acd3-24f4e0b9b56b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:50.418415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967ca70-7e42-4372-acd3-24f4e0b9b56b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:50.418843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967ca70-7e42-4372-acd3-24f4e0b9b56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:50.492611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0967ca70-7e42-4372-acd3-24f4e0b9b56b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:12:50.499928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0967ca70-7e42-4372-acd3-24f4e0b9b56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:50.728710 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3283/6547] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:12:50.783971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e7201-9635-45e3-82c8-3a861d0132f7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:50.786251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1d4e7201-9635-45e3-82c8-3a861d0132f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:50.980568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e7201-9635-45e3-82c8-3a861d0132f7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:51.009657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e7650-150b-438a-9724-cfe647e0df47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:51.010691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e7650-150b-438a-9724-cfe647e0df47 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:51.010988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e7650-150b-438a-9724-cfe647e0df47 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:51.011265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e7650-150b-438a-9724-cfe647e0df47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:51.096443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e7650-150b-438a-9724-cfe647e0df47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:51.102004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e7650-150b-438a-9724-cfe647e0df47 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:51.137727 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3265/6548] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:12:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:12:52.311777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967ca70-7e42-4372-acd3-24f4e0b9b56b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:52.314143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0967ca70-7e42-4372-acd3-24f4e0b9b56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:52.368425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967ca70-7e42-4372-acd3-24f4e0b9b56b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:52.385081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b4d94-484d-4b86-b83c-a6a7661dfd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:52.386802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b4d94-484d-4b86-b83c-a6a7661dfd66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:52.387744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b4d94-484d-4b86-b83c-a6a7661dfd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:52.388028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b4d94-484d-4b86-b83c-a6a7661dfd66 admin admin] PATH_INFO: `/v3/projects/b1bf345990cc4ca097666afdf2e04503` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:52.390530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b4d94-484d-4b86-b83c-a6a7661dfd66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1bf345990cc4ca097666afdf2e04503)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:52.394301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b4d94-484d-4b86-b83c-a6a7661dfd66 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:52.620166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a58b4d94-484d-4b86-b83c-a6a7661dfd66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1bf345990cc4ca097666afdf2e04503', 'request_id': 'req-a58b4d94-484d-4b86-b83c-a6a7661dfd66'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:52.624976 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:52.709171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a58b4d94-484d-4b86-b83c-a6a7661dfd66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1bf345990cc4ca097666afdf2e04503', 'request_id': 'req-a58b4d94-484d-4b86-b83c-a6a7661dfd66'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:52.765845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a58b4d94-484d-4b86-b83c-a6a7661dfd66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1bf345990cc4ca097666afdf2e04503', 'request_id': 'req-a58b4d94-484d-4b86-b83c-a6a7661dfd66'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:52.812282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a58b4d94-484d-4b86-b83c-a6a7661dfd66 admin admin] The token cache is being invalidate because project b1bf345990cc4ca097666afdf2e04503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:12:52.812576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a58b4d94-484d-4b86-b83c-a6a7661dfd66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:52.814693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a58b4d94-484d-4b86-b83c-a6a7661dfd66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:52.825339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69651930-2cb4-46df-8cb5-67c8e55a13ea None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:52.825894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69651930-2cb4-46df-8cb5-67c8e55a13ea None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:52.827794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69651930-2cb4-46df-8cb5-67c8e55a13ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:52.853930 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3284/6549] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:12:52 2022] DELETE /identity/v3/projects/b1bf345990cc4ca097666afdf2e04503 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:12:52.930775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-69651930-2cb4-46df-8cb5-67c8e55a13ea None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:12:52.962190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-69651930-2cb4-46df-8cb5-67c8e55a13ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:53.389408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50a3b0-894d-4f3c-8eae-d3b6110bf7fb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:53.390743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50a3b0-894d-4f3c-8eae-d3b6110bf7fb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:53.391210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50a3b0-894d-4f3c-8eae-d3b6110bf7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:53.407977 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3266/6550] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 582 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:12:53.485152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0a50a3b0-894d-4f3c-8eae-d3b6110bf7fb None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:12:53.491684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0a50a3b0-894d-4f3c-8eae-d3b6110bf7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:53.524348 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3285/6551] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:12:53.526477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69651930-2cb4-46df-8cb5-67c8e55a13ea None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:53.539606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69651930-2cb4-46df-8cb5-67c8e55a13ea None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:53.545279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435afd8-1f08-4d23-8745-faa6e253b833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:53.546563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435afd8-1f08-4d23-8745-faa6e253b833 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:53.547083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435afd8-1f08-4d23-8745-faa6e253b833 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:53.547583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435afd8-1f08-4d23-8745-faa6e253b833 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:53.548451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435afd8-1f08-4d23-8745-faa6e253b833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:12:53.549015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435afd8-1f08-4d23-8745-faa6e253b833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:53.550885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435afd8-1f08-4d23-8745-faa6e253b833 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:53.574950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50a3b0-894d-4f3c-8eae-d3b6110bf7fb None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:53.581762 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3267/6552] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:12:53.589539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50a3b0-894d-4f3c-8eae-d3b6110bf7fb None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:53.597153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1c00c-d633-40e9-b87d-c726ed5696bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:53.598362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1c00c-d633-40e9-b87d-c726ed5696bf admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:53.598934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1c00c-d633-40e9-b87d-c726ed5696bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:53.599741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1c00c-d633-40e9-b87d-c726ed5696bf admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:53.601226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1c00c-d633-40e9-b87d-c726ed5696bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:53.603500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1c00c-d633-40e9-b87d-c726ed5696bf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:53.671202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435afd8-1f08-4d23-8745-faa6e253b833 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:53.681084 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3286/6553] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:12:53 2022] POST /identity/v3/projects => generated 405 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:12:53.686106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435afd8-1f08-4d23-8745-faa6e253b833 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:53.696835 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:53.916868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308c9ec-dcbf-4f49-aca2-a9d2062c653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:53.918360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308c9ec-dcbf-4f49-aca2-a9d2062c653c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:53.920428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308c9ec-dcbf-4f49-aca2-a9d2062c653c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:53.922994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308c9ec-dcbf-4f49-aca2-a9d2062c653c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:53.924536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308c9ec-dcbf-4f49-aca2-a9d2062c653c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:53.930042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308c9ec-dcbf-4f49-aca2-a9d2062c653c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:54.019497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1c00c-d633-40e9-b87d-c726ed5696bf admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:54.035594 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3268/6554] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:12:53 2022] POST /identity/v3/users => generated 303 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:12:54.043252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1c00c-d633-40e9-b87d-c726ed5696bf admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:54.072564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5dc1a-4d46-447b-aeb9-318ebca131b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:54.077154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5dc1a-4d46-447b-aeb9-318ebca131b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:54.078053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5dc1a-4d46-447b-aeb9-318ebca131b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:54.078053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5dc1a-4d46-447b-aeb9-318ebca131b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:54.081569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5dc1a-4d46-447b-aeb9-318ebca131b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:54.087070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5dc1a-4d46-447b-aeb9-318ebca131b4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:54.131771 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3287/6555] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:12:54.134459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308c9ec-dcbf-4f49-aca2-a9d2062c653c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:54.148287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308c9ec-dcbf-4f49-aca2-a9d2062c653c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:54.192324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827dab0-d19d-4010-91e7-e55fef337da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:54.194941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827dab0-d19d-4010-91e7-e55fef337da7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:54.195229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827dab0-d19d-4010-91e7-e55fef337da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:54.195502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827dab0-d19d-4010-91e7-e55fef337da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:54.196174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827dab0-d19d-4010-91e7-e55fef337da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:54.208504 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827dab0-d19d-4010-91e7-e55fef337da7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:54.264962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5dc1a-4d46-447b-aeb9-318ebca131b4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:54.271239 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3269/6556] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:12:54.295987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5dc1a-4d46-447b-aeb9-318ebca131b4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:54.362278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96d2a6-f015-45b5-8700-002bc8598e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:54.365331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96d2a6-f015-45b5-8700-002bc8598e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:54.365976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96d2a6-f015-45b5-8700-002bc8598e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:54.366521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96d2a6-f015-45b5-8700-002bc8598e86 admin admin] PATH_INFO: `/v3/projects/3c1ba2fddf6c421c8bb41380e215c687/users/a95ebf4622c541f181075af2388483c4/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:54.425240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96d2a6-f015-45b5-8700-002bc8598e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c1ba2fddf6c421c8bb41380e215c687, user_id=a95ebf4622c541f181075af2388483c4, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:54.438163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96d2a6-f015-45b5-8700-002bc8598e86 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:54.459405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776cb05-77d2-402b-a932-69a49a702635 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:54.460163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776cb05-77d2-402b-a932-69a49a702635 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:54.460500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776cb05-77d2-402b-a932-69a49a702635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:54.500898 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3288/6557] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:12:54 2022] PUT /identity/v3/projects/3c1ba2fddf6c421c8bb41380e215c687/users/a95ebf4622c541f181075af2388483c4/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:12:54.514241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592588a8-d48e-479c-ae71-67675117ff2e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:54.514806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592588a8-d48e-479c-ae71-67675117ff2e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:54.515226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592588a8-d48e-479c-ae71-67675117ff2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:54.538029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7776cb05-77d2-402b-a932-69a49a702635 None None] MFA Rules not processed for user `40cea8ffee0e48aba3f0ce206768d1ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:12:54.539244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7776cb05-77d2-402b-a932-69a49a702635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:54.585088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-592588a8-d48e-479c-ae71-67675117ff2e None None] MFA Rules not processed for user `a95ebf4622c541f181075af2388483c4`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:12:54.587039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-592588a8-d48e-479c-ae71-67675117ff2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:54.829397 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3289/6558] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:12:54 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:12:54.835007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592588a8-d48e-479c-ae71-67675117ff2e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:54.853267 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3270/6559] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:12:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:12:55.081903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592588a8-d48e-479c-ae71-67675117ff2e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:55.088813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89969ffe-bf1a-45f2-a98d-342b1a30dd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:55.089905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89969ffe-bf1a-45f2-a98d-342b1a30dd28 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:55.090684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89969ffe-bf1a-45f2-a98d-342b1a30dd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:55.091158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89969ffe-bf1a-45f2-a98d-342b1a30dd28 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:55.092163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89969ffe-bf1a-45f2-a98d-342b1a30dd28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:55.094553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89969ffe-bf1a-45f2-a98d-342b1a30dd28 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:55.125362 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:55.166851 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3290/6560] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:12:54 2022] POST /identity/v3/projects => generated 403 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:12:55.171153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776cb05-77d2-402b-a932-69a49a702635 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:55.212813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776cb05-77d2-402b-a932-69a49a702635 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:55.496650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1cc44-12d7-4051-a3ae-f3d7983dee7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:55.497516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1cc44-12d7-4051-a3ae-f3d7983dee7a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:55.498128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1cc44-12d7-4051-a3ae-f3d7983dee7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:55.498854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1cc44-12d7-4051-a3ae-f3d7983dee7a admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:55.500586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1cc44-12d7-4051-a3ae-f3d7983dee7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:55.503259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1cc44-12d7-4051-a3ae-f3d7983dee7a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:55.561613 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3271/6561] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:12:55 2022] POST /identity/v3/users => generated 308 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:12:55.573958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89969ffe-bf1a-45f2-a98d-342b1a30dd28 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:55.591988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89969ffe-bf1a-45f2-a98d-342b1a30dd28 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:55.615205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb5514-e3dd-4a96-adac-12240728778d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:55.618499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb5514-e3dd-4a96-adac-12240728778d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:55.619607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb5514-e3dd-4a96-adac-12240728778d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:55.620041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb5514-e3dd-4a96-adac-12240728778d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:55.621345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb5514-e3dd-4a96-adac-12240728778d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:55.626780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb5514-e3dd-4a96-adac-12240728778d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:55.656190 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3291/6562] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:12:55.658713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1cc44-12d7-4051-a3ae-f3d7983dee7a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:55.682664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1cc44-12d7-4051-a3ae-f3d7983dee7a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:55.703142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d196822-e86b-49f2-8667-c4eea1cc05ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:55.709177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d196822-e86b-49f2-8667-c4eea1cc05ce admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:55.709621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d196822-e86b-49f2-8667-c4eea1cc05ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:55.710200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d196822-e86b-49f2-8667-c4eea1cc05ce admin admin] PATH_INFO: `/v3/projects/9aca9e1291ef4f8abac326c346c9e72e/users/767c344521d245edbb6dffe21b50b46a/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:55.760658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d196822-e86b-49f2-8667-c4eea1cc05ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aca9e1291ef4f8abac326c346c9e72e, user_id=767c344521d245edbb6dffe21b50b46a, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:55.778503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d196822-e86b-49f2-8667-c4eea1cc05ce admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:55.806309 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:55.824927 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3272/6563] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:12:55 2022] PUT /identity/v3/projects/9aca9e1291ef4f8abac326c346c9e72e/users/767c344521d245edbb6dffe21b50b46a/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:12:55.830259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb5514-e3dd-4a96-adac-12240728778d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:55.844639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb5514-e3dd-4a96-adac-12240728778d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:56.103150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e0e88-40b4-4ea6-aed4-08c44ffdbae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:56.103733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e0e88-40b4-4ea6-aed4-08c44ffdbae8 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:56.104009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e0e88-40b4-4ea6-aed4-08c44ffdbae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:56.104281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e0e88-40b4-4ea6-aed4-08c44ffdbae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:56.110238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e0e88-40b4-4ea6-aed4-08c44ffdbae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:56.115960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e0e88-40b4-4ea6-aed4-08c44ffdbae8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:56.161328 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3292/6564] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:12:56.165534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d196822-e86b-49f2-8667-c4eea1cc05ce admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:56.182934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d196822-e86b-49f2-8667-c4eea1cc05ce admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:56.199443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafb6b0-eba4-4027-aba1-9717e0a0256f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:56.203179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafb6b0-eba4-4027-aba1-9717e0a0256f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:56.203726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafb6b0-eba4-4027-aba1-9717e0a0256f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:56.204201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafb6b0-eba4-4027-aba1-9717e0a0256f admin admin] PATH_INFO: `/v3/projects/9aca9e1291ef4f8abac326c346c9e72e/users/767c344521d245edbb6dffe21b50b46a/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:56.209782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafb6b0-eba4-4027-aba1-9717e0a0256f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aca9e1291ef4f8abac326c346c9e72e, user_id=767c344521d245edbb6dffe21b50b46a, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:56.219243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafb6b0-eba4-4027-aba1-9717e0a0256f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:56.255587 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3273/6565] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:12:56 2022] PUT /identity/v3/projects/9aca9e1291ef4f8abac326c346c9e72e/users/767c344521d245edbb6dffe21b50b46a/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:12:56.269114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef44a7-7d9c-4fc6-ba25-e953a4cf2ba0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:56.269345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef44a7-7d9c-4fc6-ba25-e953a4cf2ba0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:56.269441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef44a7-7d9c-4fc6-ba25-e953a4cf2ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:56.334664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-32ef44a7-7d9c-4fc6-ba25-e953a4cf2ba0 None None] MFA Rules not processed for user `767c344521d245edbb6dffe21b50b46a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:12:56.348678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-32ef44a7-7d9c-4fc6-ba25-e953a4cf2ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:56.561684 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3293/6566] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:12:56 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:12:56.578670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafb6b0-eba4-4027-aba1-9717e0a0256f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:56.580747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cbafb6b0-eba4-4027-aba1-9717e0a0256f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:56.792252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafb6b0-eba4-4027-aba1-9717e0a0256f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:56.800250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309f137-c7a1-4aa9-a43f-154d376ff722 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:56.800848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309f137-c7a1-4aa9-a43f-154d376ff722 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:56.801244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309f137-c7a1-4aa9-a43f-154d376ff722 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:56.801634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309f137-c7a1-4aa9-a43f-154d376ff722 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:56.822721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309f137-c7a1-4aa9-a43f-154d376ff722 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:56.824155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309f137-c7a1-4aa9-a43f-154d376ff722 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:56.853085 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3274/6567] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:12:56 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:12:57.227306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef44a7-7d9c-4fc6-ba25-e953a4cf2ba0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:57.444951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef44a7-7d9c-4fc6-ba25-e953a4cf2ba0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:57.489912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d5717-7d94-4848-814d-06d93614f19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:57.490593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d5717-7d94-4848-814d-06d93614f19c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:57.490874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d5717-7d94-4848-814d-06d93614f19c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:57.491153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d5717-7d94-4848-814d-06d93614f19c admin admin] PATH_INFO: `/v3/users/a95ebf4622c541f181075af2388483c4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:57.494489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d5717-7d94-4848-814d-06d93614f19c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a95ebf4622c541f181075af2388483c4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:57.494489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d5717-7d94-4848-814d-06d93614f19c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:57.506808 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:57.623321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-940d5717-7d94-4848-814d-06d93614f19c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a95ebf4622c541f181075af2388483c4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:57.624062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-940d5717-7d94-4848-814d-06d93614f19c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a95ebf4622c541f181075af2388483c4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:57.638119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-940d5717-7d94-4848-814d-06d93614f19c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a95ebf4622c541f181075af2388483c4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:57.644232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309f137-c7a1-4aa9-a43f-154d376ff722 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:57.646000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3309f137-c7a1-4aa9-a43f-154d376ff722 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:57.675186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-940d5717-7d94-4848-814d-06d93614f19c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a95ebf4622c541f181075af2388483c4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:57.681674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309f137-c7a1-4aa9-a43f-154d376ff722 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:57.696179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758bef7-083d-4d20-88cc-df85b9fa71fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:57.696917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758bef7-083d-4d20-88cc-df85b9fa71fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:57.697908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-940d5717-7d94-4848-814d-06d93614f19c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a95ebf4622c541f181075af2388483c4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:57.698774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758bef7-083d-4d20-88cc-df85b9fa71fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:57.700739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758bef7-083d-4d20-88cc-df85b9fa71fc admin admin] PATH_INFO: `/v3/users/2f839356c7564779ac387f916fd83b43` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:57.704851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758bef7-083d-4d20-88cc-df85b9fa71fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f839356c7564779ac387f916fd83b43)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:57.707065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758bef7-083d-4d20-88cc-df85b9fa71fc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:57.711682 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3294/6568] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:12:57 2022] DELETE /identity/v3/users/a95ebf4622c541f181075af2388483c4 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:12:57.719577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964adae-05ce-46a1-890a-70663ee52c5d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:57.720050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964adae-05ce-46a1-890a-70663ee52c5d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:57.721252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964adae-05ce-46a1-890a-70663ee52c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:57.774904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f964adae-05ce-46a1-890a-70663ee52c5d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:12:57.774904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f964adae-05ce-46a1-890a-70663ee52c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:57.813576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3758bef7-083d-4d20-88cc-df85b9fa71fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f839356c7564779ac387f916fd83b43'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:57.830611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3758bef7-083d-4d20-88cc-df85b9fa71fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f839356c7564779ac387f916fd83b43'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:57.834388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3758bef7-083d-4d20-88cc-df85b9fa71fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f839356c7564779ac387f916fd83b43'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:57.856458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3758bef7-083d-4d20-88cc-df85b9fa71fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f839356c7564779ac387f916fd83b43'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:57.871852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3758bef7-083d-4d20-88cc-df85b9fa71fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f839356c7564779ac387f916fd83b43'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:12:57.885065 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3275/6569] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:12:57 2022] DELETE /identity/v3/users/2f839356c7564779ac387f916fd83b43 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:12:57.887266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7250faa-222d-4074-920a-c07844f6896f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:57.887557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7250faa-222d-4074-920a-c07844f6896f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:57.887835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7250faa-222d-4074-920a-c07844f6896f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:57.927981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d7250faa-222d-4074-920a-c07844f6896f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:12:57.929507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d7250faa-222d-4074-920a-c07844f6896f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:57.942243 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3295/6570] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:12:57.955604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964adae-05ce-46a1-890a-70663ee52c5d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:57.963492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f964adae-05ce-46a1-890a-70663ee52c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:58.078276 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:58.114429 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3276/6571] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:12:58.153746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964adae-05ce-46a1-890a-70663ee52c5d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:58.177358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7250faa-222d-4074-920a-c07844f6896f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:58.279738 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:12:58.340110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3217e0-6335-4c49-abe5-49318f638911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:58.346213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3217e0-6335-4c49-abe5-49318f638911 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:58.348702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3217e0-6335-4c49-abe5-49318f638911 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:58.351631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3217e0-6335-4c49-abe5-49318f638911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:58.417541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7250faa-222d-4074-920a-c07844f6896f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:58.427723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3217e0-6335-4c49-abe5-49318f638911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:58.429220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3217e0-6335-4c49-abe5-49318f638911 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:58.445512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd8997-5f7f-403d-a863-413dee2bdf4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:58.446169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd8997-5f7f-403d-a863-413dee2bdf4e service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:58.446448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd8997-5f7f-403d-a863-413dee2bdf4e service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:58.446720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd8997-5f7f-403d-a863-413dee2bdf4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:58.494825 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3296/6572] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:12:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:12:58.497212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd8997-5f7f-403d-a863-413dee2bdf4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:58.498656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd8997-5f7f-403d-a863-413dee2bdf4e service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:58.500533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3217e0-6335-4c49-abe5-49318f638911 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:12:58.507045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ec3217e0-6335-4c49-abe5-49318f638911 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:58.550575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3217e0-6335-4c49-abe5-49318f638911 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:12:58.555056 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3277/6573] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:12:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:12:58.559096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f164c-a80a-4c79-8139-e0dfa5503809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:12:58.559794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f164c-a80a-4c79-8139-e0dfa5503809 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:12:58.560145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f164c-a80a-4c79-8139-e0dfa5503809 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:12:58.560483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f164c-a80a-4c79-8139-e0dfa5503809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:12:58.562818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-975f164c-a80a-4c79-8139-e0dfa5503809 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:12:58.579886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f164c-a80a-4c79-8139-e0dfa5503809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:12:58.582617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f164c-a80a-4c79-8139-e0dfa5503809 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:12:58.634952 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3297/6574] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:12:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:13:00.750647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd8997-5f7f-403d-a863-413dee2bdf4e service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:00.753045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-07bd8997-5f7f-403d-a863-413dee2bdf4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:00.838169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd8997-5f7f-403d-a863-413dee2bdf4e service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:00.863003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f164c-a80a-4c79-8139-e0dfa5503809 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:00.865561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-975f164c-a80a-4c79-8139-e0dfa5503809 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:00.889818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f02307-921d-4fd4-819f-fe1b8fda53d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:00.894392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f02307-921d-4fd4-819f-fe1b8fda53d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:00.894989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f02307-921d-4fd4-819f-fe1b8fda53d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:00.895945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f02307-921d-4fd4-819f-fe1b8fda53d9 admin admin] PATH_INFO: `/v3/projects/3c1ba2fddf6c421c8bb41380e215c687` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:00.903841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f02307-921d-4fd4-819f-fe1b8fda53d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c1ba2fddf6c421c8bb41380e215c687)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:00.908656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f02307-921d-4fd4-819f-fe1b8fda53d9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:00.913329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f164c-a80a-4c79-8139-e0dfa5503809 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:00.931028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1345ff-7fd2-4ab6-a8a4-94732bc02def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:00.937559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1345ff-7fd2-4ab6-a8a4-94732bc02def admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:00.937842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1345ff-7fd2-4ab6-a8a4-94732bc02def admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:00.939015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1345ff-7fd2-4ab6-a8a4-94732bc02def admin admin] PATH_INFO: `/v3/projects/d8b60a261d8c406cbe3add91e8f34983` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:00.945686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1345ff-7fd2-4ab6-a8a4-94732bc02def admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8b60a261d8c406cbe3add91e8f34983)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:00.950500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1345ff-7fd2-4ab6-a8a4-94732bc02def admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:01.076216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0f02307-921d-4fd4-819f-fe1b8fda53d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c1ba2fddf6c421c8bb41380e215c687', 'request_id': 'req-d0f02307-921d-4fd4-819f-fe1b8fda53d9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:01.107455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0f02307-921d-4fd4-819f-fe1b8fda53d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c1ba2fddf6c421c8bb41380e215c687', 'request_id': 'req-d0f02307-921d-4fd4-819f-fe1b8fda53d9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:01.124659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0f02307-921d-4fd4-819f-fe1b8fda53d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c1ba2fddf6c421c8bb41380e215c687', 'request_id': 'req-d0f02307-921d-4fd4-819f-fe1b8fda53d9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:01.125404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-da1345ff-7fd2-4ab6-a8a4-94732bc02def admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8b60a261d8c406cbe3add91e8f34983', 'request_id': 'req-da1345ff-7fd2-4ab6-a8a4-94732bc02def'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:01.147089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-da1345ff-7fd2-4ab6-a8a4-94732bc02def admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8b60a261d8c406cbe3add91e8f34983', 'request_id': 'req-da1345ff-7fd2-4ab6-a8a4-94732bc02def'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:01.154061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0f02307-921d-4fd4-819f-fe1b8fda53d9 admin admin] The token cache is being invalidate because project 3c1ba2fddf6c421c8bb41380e215c687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:13:01.154359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0f02307-921d-4fd4-819f-fe1b8fda53d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:01.155046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0f02307-921d-4fd4-819f-fe1b8fda53d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:01.156917 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3278/6575] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:13:00 2022] DELETE /identity/v3/projects/3c1ba2fddf6c421c8bb41380e215c687 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:01.161198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f02307-921d-4fd4-819f-fe1b8fda53d9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:01.164140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d0f02307-921d-4fd4-819f-fe1b8fda53d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:01.169809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-da1345ff-7fd2-4ab6-a8a4-94732bc02def admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8b60a261d8c406cbe3add91e8f34983', 'request_id': 'req-da1345ff-7fd2-4ab6-a8a4-94732bc02def'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:01.199616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-da1345ff-7fd2-4ab6-a8a4-94732bc02def admin admin] The token cache is being invalidate because project d8b60a261d8c406cbe3add91e8f34983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:13:01.199905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-da1345ff-7fd2-4ab6-a8a4-94732bc02def admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:01.202130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-da1345ff-7fd2-4ab6-a8a4-94732bc02def admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:01.206765 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3298/6576] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:13:00 2022] DELETE /identity/v3/projects/d8b60a261d8c406cbe3add91e8f34983 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:01.211574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1345ff-7fd2-4ab6-a8a4-94732bc02def admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:01.213189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-da1345ff-7fd2-4ab6-a8a4-94732bc02def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:01.266287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f02307-921d-4fd4-819f-fe1b8fda53d9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:01.306349 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:01.358075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1345ff-7fd2-4ab6-a8a4-94732bc02def admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:01.370151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5c83c-007f-423f-bb87-e4ece6211ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:01.371164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d8b5d-6e6a-4a37-8d94-5602d1764451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:01.372030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5c83c-007f-423f-bb87-e4ece6211ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:01.373094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d8b5d-6e6a-4a37-8d94-5602d1764451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:01.373528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5c83c-007f-423f-bb87-e4ece6211ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:01.373986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5c83c-007f-423f-bb87-e4ece6211ab0 admin admin] PATH_INFO: `/v3/users/767c344521d245edbb6dffe21b50b46a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:01.374414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d8b5d-6e6a-4a37-8d94-5602d1764451 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:01.375525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d8b5d-6e6a-4a37-8d94-5602d1764451 admin admin] PATH_INFO: `/v3/users/afa2604c106e40ca81ff6dd6d24dd5a4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:01.376879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5c83c-007f-423f-bb87-e4ece6211ab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=767c344521d245edbb6dffe21b50b46a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:01.377655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d8b5d-6e6a-4a37-8d94-5602d1764451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afa2604c106e40ca81ff6dd6d24dd5a4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:01.381675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d8b5d-6e6a-4a37-8d94-5602d1764451 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:01.382930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5c83c-007f-423f-bb87-e4ece6211ab0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:01.489489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-29c5c83c-007f-423f-bb87-e4ece6211ab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '767c344521d245edbb6dffe21b50b46a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:01.498389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8e1d8b5d-6e6a-4a37-8d94-5602d1764451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afa2604c106e40ca81ff6dd6d24dd5a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:01.499255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8e1d8b5d-6e6a-4a37-8d94-5602d1764451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afa2604c106e40ca81ff6dd6d24dd5a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:01.502228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-29c5c83c-007f-423f-bb87-e4ece6211ab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '767c344521d245edbb6dffe21b50b46a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:01.502993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-29c5c83c-007f-423f-bb87-e4ece6211ab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '767c344521d245edbb6dffe21b50b46a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:01.510575 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:01.534840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8e1d8b5d-6e6a-4a37-8d94-5602d1764451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afa2604c106e40ca81ff6dd6d24dd5a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:01.561563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-29c5c83c-007f-423f-bb87-e4ece6211ab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '767c344521d245edbb6dffe21b50b46a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:01.571991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8e1d8b5d-6e6a-4a37-8d94-5602d1764451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afa2604c106e40ca81ff6dd6d24dd5a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:01.589932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-29c5c83c-007f-423f-bb87-e4ece6211ab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '767c344521d245edbb6dffe21b50b46a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:01.607874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8e1d8b5d-6e6a-4a37-8d94-5602d1764451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afa2604c106e40ca81ff6dd6d24dd5a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:01.612002 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3279/6577] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:13:01 2022] DELETE /identity/v3/users/767c344521d245edbb6dffe21b50b46a => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:01.623750 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3299/6578] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:13:01 2022] DELETE /identity/v3/users/afa2604c106e40ca81ff6dd6d24dd5a4 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:02.515497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5c83c-007f-423f-bb87-e4ece6211ab0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:02.516989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-29c5c83c-007f-423f-bb87-e4ece6211ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:02.658071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5c83c-007f-423f-bb87-e4ece6211ab0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:02.843493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10337a78-bf43-44c4-85e3-872585f12d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:02.846290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10337a78-bf43-44c4-85e3-872585f12d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:02.846290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10337a78-bf43-44c4-85e3-872585f12d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:02.852429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10337a78-bf43-44c4-85e3-872585f12d75 admin admin] PATH_INFO: `/v3/projects/16541a61177f4aa894a5369f1057b5b1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:02.855002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10337a78-bf43-44c4-85e3-872585f12d75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16541a61177f4aa894a5369f1057b5b1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:02.859779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10337a78-bf43-44c4-85e3-872585f12d75 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:02.878645 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:03.007247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-10337a78-bf43-44c4-85e3-872585f12d75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16541a61177f4aa894a5369f1057b5b1', 'request_id': 'req-10337a78-bf43-44c4-85e3-872585f12d75'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:03.028948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-10337a78-bf43-44c4-85e3-872585f12d75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16541a61177f4aa894a5369f1057b5b1', 'request_id': 'req-10337a78-bf43-44c4-85e3-872585f12d75'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:03.040211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-10337a78-bf43-44c4-85e3-872585f12d75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16541a61177f4aa894a5369f1057b5b1', 'request_id': 'req-10337a78-bf43-44c4-85e3-872585f12d75'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:03.061710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-10337a78-bf43-44c4-85e3-872585f12d75 admin admin] The token cache is being invalidate because project 16541a61177f4aa894a5369f1057b5b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:13:03.062008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-10337a78-bf43-44c4-85e3-872585f12d75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:03.062708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-10337a78-bf43-44c4-85e3-872585f12d75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:03.064800 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3280/6579] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:13:02 2022] DELETE /identity/v3/projects/16541a61177f4aa894a5369f1057b5b1 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:03.276961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d8b5d-6e6a-4a37-8d94-5602d1764451 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:03.279217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8e1d8b5d-6e6a-4a37-8d94-5602d1764451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:03.311895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d8b5d-6e6a-4a37-8d94-5602d1764451 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:03.507469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01ef02-91de-4277-8ab0-3a41ec3fb6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:03.508626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01ef02-91de-4277-8ab0-3a41ec3fb6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:03.510226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01ef02-91de-4277-8ab0-3a41ec3fb6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:03.510694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01ef02-91de-4277-8ab0-3a41ec3fb6f4 admin admin] PATH_INFO: `/v3/projects/9aca9e1291ef4f8abac326c346c9e72e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:03.513848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01ef02-91de-4277-8ab0-3a41ec3fb6f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aca9e1291ef4f8abac326c346c9e72e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:03.520429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01ef02-91de-4277-8ab0-3a41ec3fb6f4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:03.658817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dc01ef02-91de-4277-8ab0-3a41ec3fb6f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aca9e1291ef4f8abac326c346c9e72e', 'request_id': 'req-dc01ef02-91de-4277-8ab0-3a41ec3fb6f4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:03.676374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dc01ef02-91de-4277-8ab0-3a41ec3fb6f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aca9e1291ef4f8abac326c346c9e72e', 'request_id': 'req-dc01ef02-91de-4277-8ab0-3a41ec3fb6f4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:03.696369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dc01ef02-91de-4277-8ab0-3a41ec3fb6f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aca9e1291ef4f8abac326c346c9e72e', 'request_id': 'req-dc01ef02-91de-4277-8ab0-3a41ec3fb6f4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:03.715169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dc01ef02-91de-4277-8ab0-3a41ec3fb6f4 admin admin] The token cache is being invalidate because project 9aca9e1291ef4f8abac326c346c9e72e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:13:03.715557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dc01ef02-91de-4277-8ab0-3a41ec3fb6f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:03.716307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dc01ef02-91de-4277-8ab0-3a41ec3fb6f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:03.722552 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3300/6580] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:13:03 2022] DELETE /identity/v3/projects/9aca9e1291ef4f8abac326c346c9e72e => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:03.723759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8874c5b-faba-4d1c-9427-f1f6524838ca None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:03.724255 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8874c5b-faba-4d1c-9427-f1f6524838ca None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:03.724635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8874c5b-faba-4d1c-9427-f1f6524838ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:03.776433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e8874c5b-faba-4d1c-9427-f1f6524838ca None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:03.777734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e8874c5b-faba-4d1c-9427-f1f6524838ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:03.983427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01ef02-91de-4277-8ab0-3a41ec3fb6f4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:03.985342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dc01ef02-91de-4277-8ab0-3a41ec3fb6f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:04.032047 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3281/6581] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:13:04.039607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c416e-bac7-432c-8fdc-69c397b8aa09 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:04.039944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c416e-bac7-432c-8fdc-69c397b8aa09 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:04.040431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c416e-bac7-432c-8fdc-69c397b8aa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:04.072691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-116c416e-bac7-432c-8fdc-69c397b8aa09 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:04.074706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-116c416e-bac7-432c-8fdc-69c397b8aa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:04.086190 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3282/6582] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:04.091524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c416e-bac7-432c-8fdc-69c397b8aa09 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:04.116897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c416e-bac7-432c-8fdc-69c397b8aa09 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:04.128637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782afab-9473-42c7-b254-b2239fc87822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:04.129605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782afab-9473-42c7-b254-b2239fc87822 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:04.133455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782afab-9473-42c7-b254-b2239fc87822 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:04.134085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782afab-9473-42c7-b254-b2239fc87822 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:04.135020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782afab-9473-42c7-b254-b2239fc87822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:13:04.135746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782afab-9473-42c7-b254-b2239fc87822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:04.137360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01ef02-91de-4277-8ab0-3a41ec3fb6f4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:04.141256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782afab-9473-42c7-b254-b2239fc87822 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:04.146332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8170a-1fd8-4454-808c-ea3c8efbb701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:04.146963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8170a-1fd8-4454-808c-ea3c8efbb701 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:04.148218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8170a-1fd8-4454-808c-ea3c8efbb701 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:04.148452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8170a-1fd8-4454-808c-ea3c8efbb701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:04.161411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-97f8170a-1fd8-4454-808c-ea3c8efbb701 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:04.187779 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3283/6583] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:13:04.195598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782afab-9473-42c7-b254-b2239fc87822 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:04.200039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8170a-1fd8-4454-808c-ea3c8efbb701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:04.201605 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8170a-1fd8-4454-808c-ea3c8efbb701 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:04.217984 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:04.218320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782afab-9473-42c7-b254-b2239fc87822 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:04.227673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fd43b-22a5-4b9e-b21b-84eb0db1a69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:04.228332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fd43b-22a5-4b9e-b21b-84eb0db1a69e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:04.228686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fd43b-22a5-4b9e-b21b-84eb0db1a69e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:04.228965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fd43b-22a5-4b9e-b21b-84eb0db1a69e admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:04.229667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fd43b-22a5-4b9e-b21b-84eb0db1a69e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:04.231561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fd43b-22a5-4b9e-b21b-84eb0db1a69e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:04.235294 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3301/6584] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:13:04.308100 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3284/6585] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:13:04 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:13:04.312299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8170a-1fd8-4454-808c-ea3c8efbb701 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:04.332499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8170a-1fd8-4454-808c-ea3c8efbb701 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:04.533174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893d922-5c2b-4c69-af5e-2bea520ba865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:04.533174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893d922-5c2b-4c69-af5e-2bea520ba865 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:04.533174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893d922-5c2b-4c69-af5e-2bea520ba865 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:04.533174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893d922-5c2b-4c69-af5e-2bea520ba865 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:04.534348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893d922-5c2b-4c69-af5e-2bea520ba865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:04.534348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893d922-5c2b-4c69-af5e-2bea520ba865 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:04.605867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fd43b-22a5-4b9e-b21b-84eb0db1a69e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:04.606559 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3302/6586] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:13:04 2022] POST /identity/v3/users => generated 290 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:04.617803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893d922-5c2b-4c69-af5e-2bea520ba865 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:04.621607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1893d922-5c2b-4c69-af5e-2bea520ba865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:04.627361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fd43b-22a5-4b9e-b21b-84eb0db1a69e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:04.663358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1fcd3-8c0c-46dc-82b6-602330e9b44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:04.664409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1fcd3-8c0c-46dc-82b6-602330e9b44e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:04.664948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1fcd3-8c0c-46dc-82b6-602330e9b44e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:04.673080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1fcd3-8c0c-46dc-82b6-602330e9b44e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:04.674153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1fcd3-8c0c-46dc-82b6-602330e9b44e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:04.679245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1fcd3-8c0c-46dc-82b6-602330e9b44e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:04.714380 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3285/6587] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:04.725293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1fcd3-8c0c-46dc-82b6-602330e9b44e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:04.748398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1fcd3-8c0c-46dc-82b6-602330e9b44e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:04.759519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1fa92-e856-4afa-a3ab-3e7f7867a866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:04.760163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1fa92-e856-4afa-a3ab-3e7f7867a866 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:04.762216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1fa92-e856-4afa-a3ab-3e7f7867a866 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:04.762506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1fa92-e856-4afa-a3ab-3e7f7867a866 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:04.763164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1fa92-e856-4afa-a3ab-3e7f7867a866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:04.765353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893d922-5c2b-4c69-af5e-2bea520ba865 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:04.768363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1fa92-e856-4afa-a3ab-3e7f7867a866 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:04.774902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09524cc-699f-469c-9b66-5ed92ad64d76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:04.776827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09524cc-699f-469c-9b66-5ed92ad64d76 service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:04.779390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09524cc-699f-469c-9b66-5ed92ad64d76 service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:04.779677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09524cc-699f-469c-9b66-5ed92ad64d76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:04.781805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a09524cc-699f-469c-9b66-5ed92ad64d76 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:04.798755 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3286/6588] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:04.799777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1fa92-e856-4afa-a3ab-3e7f7867a866 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:04.822037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1fa92-e856-4afa-a3ab-3e7f7867a866 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:04.834134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5a9c9-8f35-49bd-a15b-4e580a779cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:04.834815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5a9c9-8f35-49bd-a15b-4e580a779cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:04.835087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5a9c9-8f35-49bd-a15b-4e580a779cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:04.835360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5a9c9-8f35-49bd-a15b-4e580a779cc2 admin admin] PATH_INFO: `/v3/projects/ed2cbd01622f4984b6723f27947a2980/users/669618e112d0454bb19765af2b8607f5/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:04.872024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5a9c9-8f35-49bd-a15b-4e580a779cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed2cbd01622f4984b6723f27947a2980, user_id=669618e112d0454bb19765af2b8607f5, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:04.880520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5a9c9-8f35-49bd-a15b-4e580a779cc2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:04.928865 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3287/6589] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:13:04 2022] PUT /identity/v3/projects/ed2cbd01622f4984b6723f27947a2980/users/669618e112d0454bb19765af2b8607f5/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:13:04.944393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14ecc1-8660-4b67-862e-58924f2641ac None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:04.944910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14ecc1-8660-4b67-862e-58924f2641ac None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:04.945093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14ecc1-8660-4b67-862e-58924f2641ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:04.961350 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:05.005810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09524cc-699f-469c-9b66-5ed92ad64d76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:05.007123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09524cc-699f-469c-9b66-5ed92ad64d76 service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:05.069679 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3303/6590] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:13:05.077342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cf14ecc1-8660-4b67-862e-58924f2641ac None None] MFA Rules not processed for user `669618e112d0454bb19765af2b8607f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:05.079110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cf14ecc1-8660-4b67-862e-58924f2641ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:05.245565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09524cc-699f-469c-9b66-5ed92ad64d76 service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:05.248051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a09524cc-699f-469c-9b66-5ed92ad64d76 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:05.327242 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:05.348417 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3288/6591] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:05.350150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14ecc1-8660-4b67-862e-58924f2641ac None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:05.400913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09524cc-699f-469c-9b66-5ed92ad64d76 service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:05.488699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c309d88-aec8-4c71-a137-460927174ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:05.490038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c309d88-aec8-4c71-a137-460927174ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:05.491046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c309d88-aec8-4c71-a137-460927174ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:05.492642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c309d88-aec8-4c71-a137-460927174ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:05.496157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5c309d88-aec8-4c71-a137-460927174ee2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:05.505544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14ecc1-8660-4b67-862e-58924f2641ac None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:05.517584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9e9ae-fa31-4505-849f-37e621946138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:05.524948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9e9ae-fa31-4505-849f-37e621946138 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:05.525234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9e9ae-fa31-4505-849f-37e621946138 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:05.525495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9e9ae-fa31-4505-849f-37e621946138 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:05.526218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9e9ae-fa31-4505-849f-37e621946138 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:05.530564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9e9ae-fa31-4505-849f-37e621946138 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:05.579396 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3289/6592] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:13:05 2022] POST /identity/v3/projects => generated 381 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:05.591986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9e9ae-fa31-4505-849f-37e621946138 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:05.598982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c309d88-aec8-4c71-a137-460927174ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:05.603752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c309d88-aec8-4c71-a137-460927174ee2 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:05.643756 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3304/6593] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:13:05.795498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9e9ae-fa31-4505-849f-37e621946138 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:05.805399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fcd58-5308-4b5e-bc46-2dd9fc5b5a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:05.805977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fcd58-5308-4b5e-bc46-2dd9fc5b5a7d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:05.806255 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fcd58-5308-4b5e-bc46-2dd9fc5b5a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:05.806524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fcd58-5308-4b5e-bc46-2dd9fc5b5a7d admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:05.807158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fcd58-5308-4b5e-bc46-2dd9fc5b5a7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:05.810213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fcd58-5308-4b5e-bc46-2dd9fc5b5a7d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:05.861724 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3290/6594] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:13:05 2022] POST /identity/v3/users => generated 297 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:05.865632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c309d88-aec8-4c71-a137-460927174ee2 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:05.890143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c309d88-aec8-4c71-a137-460927174ee2 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:05.905630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41255052-28d4-47fe-aa16-8f626e0ced94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:05.906322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41255052-28d4-47fe-aa16-8f626e0ced94 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:05.906677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41255052-28d4-47fe-aa16-8f626e0ced94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:05.907091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41255052-28d4-47fe-aa16-8f626e0ced94 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:05.908028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41255052-28d4-47fe-aa16-8f626e0ced94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:05.909836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41255052-28d4-47fe-aa16-8f626e0ced94 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:05.944905 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3305/6595] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:05.945771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fcd58-5308-4b5e-bc46-2dd9fc5b5a7d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:05.962806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fcd58-5308-4b5e-bc46-2dd9fc5b5a7d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:05.971792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2abe2-c5ba-4675-9dbe-f568ec6e556b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:05.972644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2abe2-c5ba-4675-9dbe-f568ec6e556b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:05.972920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2abe2-c5ba-4675-9dbe-f568ec6e556b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:05.973179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2abe2-c5ba-4675-9dbe-f568ec6e556b admin admin] PATH_INFO: `/v3/projects/25ba5a662b5e45968439df43b5026251/users/a0263c0b023b47778ab38781b3cce5cb/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:05.976082 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:06.011428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2abe2-c5ba-4675-9dbe-f568ec6e556b admin admin] RBAC: Authorizing `identity:create_grant(project_id=25ba5a662b5e45968439df43b5026251, user_id=a0263c0b023b47778ab38781b3cce5cb, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:06.018897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2abe2-c5ba-4675-9dbe-f568ec6e556b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:06.041419 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3291/6596] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:13:05 2022] PUT /identity/v3/projects/25ba5a662b5e45968439df43b5026251/users/a0263c0b023b47778ab38781b3cce5cb/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:13:06.042808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41255052-28d4-47fe-aa16-8f626e0ced94 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:06.057482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41255052-28d4-47fe-aa16-8f626e0ced94 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:06.244832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076cb42-b6c5-42b0-9de9-c3568b4c2280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:06.245470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076cb42-b6c5-42b0-9de9-c3568b4c2280 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:06.245756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076cb42-b6c5-42b0-9de9-c3568b4c2280 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:06.246105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076cb42-b6c5-42b0-9de9-c3568b4c2280 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:06.246675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076cb42-b6c5-42b0-9de9-c3568b4c2280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:06.248297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076cb42-b6c5-42b0-9de9-c3568b4c2280 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:06.277148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2abe2-c5ba-4675-9dbe-f568ec6e556b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:06.300273 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3306/6597] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:06.303927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076cb42-b6c5-42b0-9de9-c3568b4c2280 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:06.358004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076cb42-b6c5-42b0-9de9-c3568b4c2280 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:06.374002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d721647-b040-407f-9556-3c0dd68dca1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:06.375982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d721647-b040-407f-9556-3c0dd68dca1a admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:06.377159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d721647-b040-407f-9556-3c0dd68dca1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:06.377448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d721647-b040-407f-9556-3c0dd68dca1a admin admin] PATH_INFO: `/v3/projects/25ba5a662b5e45968439df43b5026251/users/a0263c0b023b47778ab38781b3cce5cb/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:06.399643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d721647-b040-407f-9556-3c0dd68dca1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=25ba5a662b5e45968439df43b5026251, user_id=a0263c0b023b47778ab38781b3cce5cb, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:06.412796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d721647-b040-407f-9556-3c0dd68dca1a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:06.457619 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3307/6598] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:13:06 2022] PUT /identity/v3/projects/25ba5a662b5e45968439df43b5026251/users/a0263c0b023b47778ab38781b3cce5cb/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:06.463555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2abe2-c5ba-4675-9dbe-f568ec6e556b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:06.475841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40559f0-9e67-4925-837f-b96e3291beb3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:06.479059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40559f0-9e67-4925-837f-b96e3291beb3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:06.484548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40559f0-9e67-4925-837f-b96e3291beb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:06.613551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f40559f0-9e67-4925-837f-b96e3291beb3 None None] MFA Rules not processed for user `a0263c0b023b47778ab38781b3cce5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:06.614832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f40559f0-9e67-4925-837f-b96e3291beb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:06.679864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efcc4d-380d-4c3c-b79d-3f60d5650d09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:06.683289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efcc4d-380d-4c3c-b79d-3f60d5650d09 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:06.683572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efcc4d-380d-4c3c-b79d-3f60d5650d09 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:06.683839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efcc4d-380d-4c3c-b79d-3f60d5650d09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:06.693964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-38efcc4d-380d-4c3c-b79d-3f60d5650d09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:06.791330 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:06.853883 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3308/6599] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:06.873886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40559f0-9e67-4925-837f-b96e3291beb3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:06.878030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f40559f0-9e67-4925-837f-b96e3291beb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:06.946038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efcc4d-380d-4c3c-b79d-3f60d5650d09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:06.946038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efcc4d-380d-4c3c-b79d-3f60d5650d09 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:06.976547 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3292/6600] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:13:07.062284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40559f0-9e67-4925-837f-b96e3291beb3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:07.073217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046236d8-8308-4858-9e01-5029ccb0a6af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:07.073850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046236d8-8308-4858-9e01-5029ccb0a6af service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:07.074120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046236d8-8308-4858-9e01-5029ccb0a6af service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:07.074390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046236d8-8308-4858-9e01-5029ccb0a6af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:07.090372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046236d8-8308-4858-9e01-5029ccb0a6af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:07.092380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046236d8-8308-4858-9e01-5029ccb0a6af service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:07.109323 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3309/6601] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:13:07.286455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efcc4d-380d-4c3c-b79d-3f60d5650d09 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:07.308537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efcc4d-380d-4c3c-b79d-3f60d5650d09 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:07.318860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d3738-0f49-4a10-b628-7e39ba7ab2ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:07.322502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d3738-0f49-4a10-b628-7e39ba7ab2ce service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:07.323044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d3738-0f49-4a10-b628-7e39ba7ab2ce service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:07.323536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d3738-0f49-4a10-b628-7e39ba7ab2ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:07.470598 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:07.567996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d3738-0f49-4a10-b628-7e39ba7ab2ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:07.569491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d3738-0f49-4a10-b628-7e39ba7ab2ce service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:07.588253 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3293/6602] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:13:13.056158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046236d8-8308-4858-9e01-5029ccb0a6af service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:13.057783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-046236d8-8308-4858-9e01-5029ccb0a6af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:13.117358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046236d8-8308-4858-9e01-5029ccb0a6af service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:13.124673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ded046-4185-421d-954c-f74f6e6da4b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:13.125223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ded046-4185-421d-954c-f74f6e6da4b0 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:13.125505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ded046-4185-421d-954c-f74f6e6da4b0 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:13.125777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ded046-4185-421d-954c-f74f6e6da4b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:13.128424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-19ded046-4185-421d-954c-f74f6e6da4b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:13.161697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ded046-4185-421d-954c-f74f6e6da4b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:13.163296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ded046-4185-421d-954c-f74f6e6da4b0 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:13.190039 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3310/6603] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:13:17.578702 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:18.577093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b422a5a-7615-40c7-9fc3-36e745de4d0f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:18.577533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b422a5a-7615-40c7-9fc3-36e745de4d0f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:18.577911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b422a5a-7615-40c7-9fc3-36e745de4d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:18.662098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1b422a5a-7615-40c7-9fc3-36e745de4d0f None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:18.663467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1b422a5a-7615-40c7-9fc3-36e745de4d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:18.788096 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3294/6604] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:13:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:18.804579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ded046-4185-421d-954c-f74f6e6da4b0 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:18.809076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-19ded046-4185-421d-954c-f74f6e6da4b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:19.007003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ded046-4185-421d-954c-f74f6e6da4b0 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:19.020067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821dcc41-f97c-4678-91b6-9442de794223 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:19.020856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821dcc41-f97c-4678-91b6-9442de794223 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:19.021141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821dcc41-f97c-4678-91b6-9442de794223 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:19.021563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821dcc41-f97c-4678-91b6-9442de794223 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:19.033439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821dcc41-f97c-4678-91b6-9442de794223 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:19.037337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821dcc41-f97c-4678-91b6-9442de794223 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:19.056994 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3311/6605] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:13:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:13:24.589280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b422a5a-7615-40c7-9fc3-36e745de4d0f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:24.608484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b422a5a-7615-40c7-9fc3-36e745de4d0f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:24.613460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d6950-d3bc-4877-84a7-92e2ab4a2bc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:24.614088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d6950-d3bc-4877-84a7-92e2ab4a2bc7 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:24.614446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d6950-d3bc-4877-84a7-92e2ab4a2bc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:24.614719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d6950-d3bc-4877-84a7-92e2ab4a2bc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:24.625637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d49d6950-d3bc-4877-84a7-92e2ab4a2bc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:24.821590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d6950-d3bc-4877-84a7-92e2ab4a2bc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:24.823323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d6950-d3bc-4877-84a7-92e2ab4a2bc7 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:24.856369 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3295/6606] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:13:26.937157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821dcc41-f97c-4678-91b6-9442de794223 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:26.954245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821dcc41-f97c-4678-91b6-9442de794223 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:26.961570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401e39b-c708-46da-8a46-d21ae82439cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:26.962950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401e39b-c708-46da-8a46-d21ae82439cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:26.963579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401e39b-c708-46da-8a46-d21ae82439cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:26.964203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401e39b-c708-46da-8a46-d21ae82439cd admin admin] PATH_INFO: `/v3/users/669618e112d0454bb19765af2b8607f5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:26.966060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401e39b-c708-46da-8a46-d21ae82439cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=669618e112d0454bb19765af2b8607f5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:26.969940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401e39b-c708-46da-8a46-d21ae82439cd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:27.053424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2401e39b-c708-46da-8a46-d21ae82439cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '669618e112d0454bb19765af2b8607f5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:27.054506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2401e39b-c708-46da-8a46-d21ae82439cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '669618e112d0454bb19765af2b8607f5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:27.060735 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:27.074473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2401e39b-c708-46da-8a46-d21ae82439cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '669618e112d0454bb19765af2b8607f5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:27.121447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2401e39b-c708-46da-8a46-d21ae82439cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '669618e112d0454bb19765af2b8607f5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:27.136881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2401e39b-c708-46da-8a46-d21ae82439cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '669618e112d0454bb19765af2b8607f5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:27.162110 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3312/6607] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:13:26 2022] DELETE /identity/v3/users/669618e112d0454bb19765af2b8607f5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:27.163462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fb321-5779-4aef-99c6-6b16a2aa7993 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:27.163912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fb321-5779-4aef-99c6-6b16a2aa7993 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:27.164205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fb321-5779-4aef-99c6-6b16a2aa7993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:27.226016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4c5fb321-5779-4aef-99c6-6b16a2aa7993 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:27.227470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4c5fb321-5779-4aef-99c6-6b16a2aa7993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:27.436768 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3296/6608] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:27.444958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401e39b-c708-46da-8a46-d21ae82439cd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:27.447223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2401e39b-c708-46da-8a46-d21ae82439cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:27.633199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401e39b-c708-46da-8a46-d21ae82439cd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:27.655326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d6d20-185e-4ecf-8219-4f1cfe5db72f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:27.655969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d6d20-185e-4ecf-8219-4f1cfe5db72f service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:27.656318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d6d20-185e-4ecf-8219-4f1cfe5db72f service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:27.656531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d6d20-185e-4ecf-8219-4f1cfe5db72f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:27.706486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d6d20-185e-4ecf-8219-4f1cfe5db72f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:27.707539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d6d20-185e-4ecf-8219-4f1cfe5db72f service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:27.757072 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3313/6609] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:13:28.449692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fb321-5779-4aef-99c6-6b16a2aa7993 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:28.452126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4c5fb321-5779-4aef-99c6-6b16a2aa7993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:28.489048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fb321-5779-4aef-99c6-6b16a2aa7993 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:28.523663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69d088-f87a-4ca2-9d1c-bb0912406c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:28.524364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69d088-f87a-4ca2-9d1c-bb0912406c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:28.524662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69d088-f87a-4ca2-9d1c-bb0912406c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:28.524942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69d088-f87a-4ca2-9d1c-bb0912406c85 admin admin] PATH_INFO: `/v3/projects/ed2cbd01622f4984b6723f27947a2980` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:28.526911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69d088-f87a-4ca2-9d1c-bb0912406c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed2cbd01622f4984b6723f27947a2980)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:28.530318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69d088-f87a-4ca2-9d1c-bb0912406c85 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:28.575787 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:28.665306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b69d088-f87a-4ca2-9d1c-bb0912406c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed2cbd01622f4984b6723f27947a2980', 'request_id': 'req-2b69d088-f87a-4ca2-9d1c-bb0912406c85'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:28.681256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b69d088-f87a-4ca2-9d1c-bb0912406c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed2cbd01622f4984b6723f27947a2980', 'request_id': 'req-2b69d088-f87a-4ca2-9d1c-bb0912406c85'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:28.698847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b69d088-f87a-4ca2-9d1c-bb0912406c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed2cbd01622f4984b6723f27947a2980', 'request_id': 'req-2b69d088-f87a-4ca2-9d1c-bb0912406c85'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:28.731218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b69d088-f87a-4ca2-9d1c-bb0912406c85 admin admin] The token cache is being invalidate because project ed2cbd01622f4984b6723f27947a2980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:13:28.731654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b69d088-f87a-4ca2-9d1c-bb0912406c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:28.735742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b69d088-f87a-4ca2-9d1c-bb0912406c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:28.738392 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3297/6610] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:13:28 2022] DELETE /identity/v3/projects/ed2cbd01622f4984b6723f27947a2980 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:28.749108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d6d20-185e-4ecf-8219-4f1cfe5db72f service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:28.779612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d6d20-185e-4ecf-8219-4f1cfe5db72f service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:29.022472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff6181-743b-4796-ac15-03b4bcb403d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:29.023349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff6181-743b-4796-ac15-03b4bcb403d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:29.023879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff6181-743b-4796-ac15-03b4bcb403d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:29.024331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff6181-743b-4796-ac15-03b4bcb403d9 admin admin] PATH_INFO: `/v3/users/a0263c0b023b47778ab38781b3cce5cb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:29.026019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff6181-743b-4796-ac15-03b4bcb403d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0263c0b023b47778ab38781b3cce5cb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:29.028479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff6181-743b-4796-ac15-03b4bcb403d9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:29.186901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-87ff6181-743b-4796-ac15-03b4bcb403d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0263c0b023b47778ab38781b3cce5cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:29.187754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-87ff6181-743b-4796-ac15-03b4bcb403d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0263c0b023b47778ab38781b3cce5cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:29.209471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-87ff6181-743b-4796-ac15-03b4bcb403d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0263c0b023b47778ab38781b3cce5cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:29.226352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-87ff6181-743b-4796-ac15-03b4bcb403d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0263c0b023b47778ab38781b3cce5cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:29.227781 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:29.243790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-87ff6181-743b-4796-ac15-03b4bcb403d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0263c0b023b47778ab38781b3cce5cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:29.260251 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3314/6611] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:13:28 2022] DELETE /identity/v3/users/a0263c0b023b47778ab38781b3cce5cb => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:29.733269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69d088-f87a-4ca2-9d1c-bb0912406c85 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:29.735766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2b69d088-f87a-4ca2-9d1c-bb0912406c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:29.762008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69d088-f87a-4ca2-9d1c-bb0912406c85 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:29.942230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9617c-6e0c-4602-9e2a-ad27bccf9fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:29.942889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9617c-6e0c-4602-9e2a-ad27bccf9fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:29.943168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9617c-6e0c-4602-9e2a-ad27bccf9fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:29.943444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9617c-6e0c-4602-9e2a-ad27bccf9fb8 admin admin] PATH_INFO: `/v3/projects/25ba5a662b5e45968439df43b5026251` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:29.959743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9617c-6e0c-4602-9e2a-ad27bccf9fb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25ba5a662b5e45968439df43b5026251)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:29.961716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9617c-6e0c-4602-9e2a-ad27bccf9fb8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:30.121818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91c9617c-6e0c-4602-9e2a-ad27bccf9fb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25ba5a662b5e45968439df43b5026251', 'request_id': 'req-91c9617c-6e0c-4602-9e2a-ad27bccf9fb8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:30.145942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91c9617c-6e0c-4602-9e2a-ad27bccf9fb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25ba5a662b5e45968439df43b5026251', 'request_id': 'req-91c9617c-6e0c-4602-9e2a-ad27bccf9fb8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:30.157773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91c9617c-6e0c-4602-9e2a-ad27bccf9fb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25ba5a662b5e45968439df43b5026251', 'request_id': 'req-91c9617c-6e0c-4602-9e2a-ad27bccf9fb8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:30.179898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91c9617c-6e0c-4602-9e2a-ad27bccf9fb8 admin admin] The token cache is being invalidate because project 25ba5a662b5e45968439df43b5026251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:13:30.180670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91c9617c-6e0c-4602-9e2a-ad27bccf9fb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:30.182468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91c9617c-6e0c-4602-9e2a-ad27bccf9fb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:30.188466 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3298/6612] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:13:29 2022] DELETE /identity/v3/projects/25ba5a662b5e45968439df43b5026251 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:30.189699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8217e-de39-4d2a-85f0-aa3bcec97c44 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:30.190456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8217e-de39-4d2a-85f0-aa3bcec97c44 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:30.190713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8217e-de39-4d2a-85f0-aa3bcec97c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:30.264222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2bd8217e-de39-4d2a-85f0-aa3bcec97c44 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:30.265483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2bd8217e-de39-4d2a-85f0-aa3bcec97c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:30.578576 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3315/6613] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:30.589394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdda079-1a8c-4446-8349-93f98fc2de84 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:30.589690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdda079-1a8c-4446-8349-93f98fc2de84 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:30.589936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdda079-1a8c-4446-8349-93f98fc2de84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:30.666753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9fdda079-1a8c-4446-8349-93f98fc2de84 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:30.674585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9fdda079-1a8c-4446-8349-93f98fc2de84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:30.708185 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3299/6614] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:30.712975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8217e-de39-4d2a-85f0-aa3bcec97c44 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:30.726867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8217e-de39-4d2a-85f0-aa3bcec97c44 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:30.763342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78547461-04ab-42a8-80a4-dd1d261ce6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:30.764191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78547461-04ab-42a8-80a4-dd1d261ce6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:30.764541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78547461-04ab-42a8-80a4-dd1d261ce6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:30.764909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78547461-04ab-42a8-80a4-dd1d261ce6d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:30.765635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78547461-04ab-42a8-80a4-dd1d261ce6d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:13:30.766007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78547461-04ab-42a8-80a4-dd1d261ce6d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:30.768002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78547461-04ab-42a8-80a4-dd1d261ce6d1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:30.828546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdda079-1a8c-4446-8349-93f98fc2de84 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:30.839403 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3316/6615] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:13:30.849527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdda079-1a8c-4446-8349-93f98fc2de84 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:30.866202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf43c8-4867-4cc7-81c0-faa816dc13a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:30.867189 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf43c8-4867-4cc7-81c0-faa816dc13a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:30.867707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf43c8-4867-4cc7-81c0-faa816dc13a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:30.871664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf43c8-4867-4cc7-81c0-faa816dc13a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:30.872578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf43c8-4867-4cc7-81c0-faa816dc13a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:30.874720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf43c8-4867-4cc7-81c0-faa816dc13a0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:30.924628 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:30.936649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78547461-04ab-42a8-80a4-dd1d261ce6d1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:30.942598 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3300/6616] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:13:30 2022] POST /identity/v3/projects => generated 363 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:30.948285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78547461-04ab-42a8-80a4-dd1d261ce6d1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:31.160899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3916ca-ae9c-46cc-bde0-3cef9cc28c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:31.161756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3916ca-ae9c-46cc-bde0-3cef9cc28c50 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:31.162226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3916ca-ae9c-46cc-bde0-3cef9cc28c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:31.162888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3916ca-ae9c-46cc-bde0-3cef9cc28c50 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:31.163837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3916ca-ae9c-46cc-bde0-3cef9cc28c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:31.167684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3916ca-ae9c-46cc-bde0-3cef9cc28c50 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:31.198456 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3317/6617] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:13:30 2022] POST /identity/v3/users => generated 282 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:13:31.202969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf43c8-4867-4cc7-81c0-faa816dc13a0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:31.226180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf43c8-4867-4cc7-81c0-faa816dc13a0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:31.245009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d8840-86af-44da-959b-21d5e7ecc105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:31.245844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d8840-86af-44da-959b-21d5e7ecc105 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:31.246276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d8840-86af-44da-959b-21d5e7ecc105 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:31.246700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d8840-86af-44da-959b-21d5e7ecc105 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:31.247559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d8840-86af-44da-959b-21d5e7ecc105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:31.249429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d8840-86af-44da-959b-21d5e7ecc105 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:31.298594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3916ca-ae9c-46cc-bde0-3cef9cc28c50 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:31.304197 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3301/6618] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:31.312477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3916ca-ae9c-46cc-bde0-3cef9cc28c50 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:31.325331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e30f00-abfd-4062-ac59-7b010f8107f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:31.326157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e30f00-abfd-4062-ac59-7b010f8107f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:31.326611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e30f00-abfd-4062-ac59-7b010f8107f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:31.327709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e30f00-abfd-4062-ac59-7b010f8107f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:31.328581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e30f00-abfd-4062-ac59-7b010f8107f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:31.330818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e30f00-abfd-4062-ac59-7b010f8107f3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:31.349404 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3318/6619] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:31.353350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d8840-86af-44da-959b-21d5e7ecc105 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:31.367473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d8840-86af-44da-959b-21d5e7ecc105 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:31.387539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee386063-d7db-4f92-986d-f5f091debbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:31.388506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee386063-d7db-4f92-986d-f5f091debbbd admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:31.388961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee386063-d7db-4f92-986d-f5f091debbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:31.389402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee386063-d7db-4f92-986d-f5f091debbbd admin admin] PATH_INFO: `/v3/projects/7c8e852460814dada3c4564ada83c316/users/c9ff7b15aba74b109bc7510f135f0dc2/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:31.433666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee386063-d7db-4f92-986d-f5f091debbbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c8e852460814dada3c4564ada83c316, user_id=c9ff7b15aba74b109bc7510f135f0dc2, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:31.436614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee386063-d7db-4f92-986d-f5f091debbbd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:31.470810 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3302/6620] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:13:31 2022] PUT /identity/v3/projects/7c8e852460814dada3c4564ada83c316/users/c9ff7b15aba74b109bc7510f135f0dc2/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:31.483832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad79e75-b379-4e90-a2f8-bb7839a6503a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:31.484480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad79e75-b379-4e90-a2f8-bb7839a6503a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:31.484935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad79e75-b379-4e90-a2f8-bb7839a6503a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:31.565754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5ad79e75-b379-4e90-a2f8-bb7839a6503a None None] MFA Rules not processed for user `c9ff7b15aba74b109bc7510f135f0dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:31.566944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5ad79e75-b379-4e90-a2f8-bb7839a6503a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:31.751211 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:31.819927 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3319/6621] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:31.821131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee386063-d7db-4f92-986d-f5f091debbbd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:32.013908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee386063-d7db-4f92-986d-f5f091debbbd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:32.044002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f77c30-1260-4386-b5b7-f4bc1f8ab8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:32.046089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f77c30-1260-4386-b5b7-f4bc1f8ab8ec admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:32.046561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f77c30-1260-4386-b5b7-f4bc1f8ab8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:32.048159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f77c30-1260-4386-b5b7-f4bc1f8ab8ec admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:32.050972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f77c30-1260-4386-b5b7-f4bc1f8ab8ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:32.054318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f77c30-1260-4386-b5b7-f4bc1f8ab8ec admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:32.139073 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3303/6622] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:13:31 2022] POST /identity/v3/projects => generated 365 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:32.143838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad79e75-b379-4e90-a2f8-bb7839a6503a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:32.165651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad79e75-b379-4e90-a2f8-bb7839a6503a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:32.353977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbca502-a5a6-447a-a641-cb42b09524cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:32.354626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbca502-a5a6-447a-a641-cb42b09524cc admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:32.354901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbca502-a5a6-447a-a641-cb42b09524cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:32.355087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbca502-a5a6-447a-a641-cb42b09524cc admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:32.355717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbca502-a5a6-447a-a641-cb42b09524cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:32.357789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbca502-a5a6-447a-a641-cb42b09524cc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:32.417510 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3320/6623] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:13:32 2022] POST /identity/v3/users => generated 289 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:32.417992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f77c30-1260-4386-b5b7-f4bc1f8ab8ec admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:32.436742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f77c30-1260-4386-b5b7-f4bc1f8ab8ec admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:32.449855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8f8cc-6ca4-43ac-a60a-8423dba14cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:32.450540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8f8cc-6ca4-43ac-a60a-8423dba14cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:32.450862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8f8cc-6ca4-43ac-a60a-8423dba14cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:32.451195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8f8cc-6ca4-43ac-a60a-8423dba14cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:32.452003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8f8cc-6ca4-43ac-a60a-8423dba14cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:32.453614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8f8cc-6ca4-43ac-a60a-8423dba14cf6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:32.481892 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3304/6624] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:32.486224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbca502-a5a6-447a-a641-cb42b09524cc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:32.500919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbca502-a5a6-447a-a641-cb42b09524cc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:32.520489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb4f7b-7257-4622-9537-3cdada1e29c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:32.521148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb4f7b-7257-4622-9537-3cdada1e29c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:32.521430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb4f7b-7257-4622-9537-3cdada1e29c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:32.521710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb4f7b-7257-4622-9537-3cdada1e29c5 admin admin] PATH_INFO: `/v3/projects/7f04bd6a4895454aaad4804d5df8ed83/users/f1d7e2efc91b4e9eb56e14d55df570ce/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:32.568455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb4f7b-7257-4622-9537-3cdada1e29c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f04bd6a4895454aaad4804d5df8ed83, user_id=f1d7e2efc91b4e9eb56e14d55df570ce, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:32.572230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb4f7b-7257-4622-9537-3cdada1e29c5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:32.609111 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3321/6625] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:13:32 2022] PUT /identity/v3/projects/7f04bd6a4895454aaad4804d5df8ed83/users/f1d7e2efc91b4e9eb56e14d55df570ce/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:13:32.613629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8f8cc-6ca4-43ac-a60a-8423dba14cf6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:32.638056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8f8cc-6ca4-43ac-a60a-8423dba14cf6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:32.840044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddb9c2-f701-4609-9f5a-fad1275a074c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:32.840703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddb9c2-f701-4609-9f5a-fad1275a074c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:32.841696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddb9c2-f701-4609-9f5a-fad1275a074c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:32.842163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddb9c2-f701-4609-9f5a-fad1275a074c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:32.842982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ddb9c2-f701-4609-9f5a-fad1275a074c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:32.845622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ddb9c2-f701-4609-9f5a-fad1275a074c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:32.887135 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3305/6626] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:32.891066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb4f7b-7257-4622-9537-3cdada1e29c5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:32.909565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb4f7b-7257-4622-9537-3cdada1e29c5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:32.938857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3df9d-a452-4e87-9df1-f826d13ad76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:32.939740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3df9d-a452-4e87-9df1-f826d13ad76a admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:32.940373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3df9d-a452-4e87-9df1-f826d13ad76a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:32.940590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3df9d-a452-4e87-9df1-f826d13ad76a admin admin] PATH_INFO: `/v3/projects/7f04bd6a4895454aaad4804d5df8ed83/users/f1d7e2efc91b4e9eb56e14d55df570ce/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:32.944251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3df9d-a452-4e87-9df1-f826d13ad76a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f04bd6a4895454aaad4804d5df8ed83, user_id=f1d7e2efc91b4e9eb56e14d55df570ce, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:32.946990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3df9d-a452-4e87-9df1-f826d13ad76a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:32.993553 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3322/6627] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:13:32 2022] PUT /identity/v3/projects/7f04bd6a4895454aaad4804d5df8ed83/users/f1d7e2efc91b4e9eb56e14d55df570ce/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:33.003586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92562d10-1287-4d36-b367-fd93be387b94 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:33.004106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92562d10-1287-4d36-b367-fd93be387b94 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:33.004552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92562d10-1287-4d36-b367-fd93be387b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:33.085119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-92562d10-1287-4d36-b367-fd93be387b94 None None] MFA Rules not processed for user `f1d7e2efc91b4e9eb56e14d55df570ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:33.088085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-92562d10-1287-4d36-b367-fd93be387b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:33.128712 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:33.272306 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3306/6628] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:33.290927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3df9d-a452-4e87-9df1-f826d13ad76a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:33.295945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a3b3df9d-a452-4e87-9df1-f826d13ad76a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:33.395545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3df9d-a452-4e87-9df1-f826d13ad76a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:33.402553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf058c-9c38-4789-9f8e-49733891ac32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:33.403883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf058c-9c38-4789-9f8e-49733891ac32 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:33.404862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf058c-9c38-4789-9f8e-49733891ac32 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:33.405513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf058c-9c38-4789-9f8e-49733891ac32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:33.423214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf058c-9c38-4789-9f8e-49733891ac32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:33.428154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf058c-9c38-4789-9f8e-49733891ac32 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:33.457717 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3323/6629] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:13:34.563680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199107a-b4a9-4a6b-96da-e6e90304b23f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:34.566249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199107a-b4a9-4a6b-96da-e6e90304b23f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:34.567391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199107a-b4a9-4a6b-96da-e6e90304b23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:34.604573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf058c-9c38-4789-9f8e-49733891ac32 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:34.678802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5199107a-b4a9-4a6b-96da-e6e90304b23f None None] MFA Rules not processed for user `bd2bba0db07140c0851cebb70631ce7c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:34.680861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5199107a-b4a9-4a6b-96da-e6e90304b23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:34.742000 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:34.801927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf058c-9c38-4789-9f8e-49733891ac32 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:34.816145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7d4c2-3edf-4b87-aa89-cb202fbecef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:34.816902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7d4c2-3edf-4b87-aa89-cb202fbecef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:34.817086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7d4c2-3edf-4b87-aa89-cb202fbecef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:34.817367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7d4c2-3edf-4b87-aa89-cb202fbecef4 admin admin] PATH_INFO: `/v3/users/c9ff7b15aba74b109bc7510f135f0dc2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:34.818510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7d4c2-3edf-4b87-aa89-cb202fbecef4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ff7b15aba74b109bc7510f135f0dc2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:34.822455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7d4c2-3edf-4b87-aa89-cb202fbecef4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:34.880652 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3307/6630] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:34.957739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fed7d4c2-3edf-4b87-aa89-cb202fbecef4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ff7b15aba74b109bc7510f135f0dc2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:34.959023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fed7d4c2-3edf-4b87-aa89-cb202fbecef4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ff7b15aba74b109bc7510f135f0dc2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:34.977676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fed7d4c2-3edf-4b87-aa89-cb202fbecef4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ff7b15aba74b109bc7510f135f0dc2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:35.006235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fed7d4c2-3edf-4b87-aa89-cb202fbecef4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ff7b15aba74b109bc7510f135f0dc2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:35.018562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fed7d4c2-3edf-4b87-aa89-cb202fbecef4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ff7b15aba74b109bc7510f135f0dc2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:35.027310 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3324/6631] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:13:34 2022] DELETE /identity/v3/users/c9ff7b15aba74b109bc7510f135f0dc2 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:35.031475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f521b8-8250-4ba8-8e2a-30a7862d01f6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:35.031794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f521b8-8250-4ba8-8e2a-30a7862d01f6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:35.032166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f521b8-8250-4ba8-8e2a-30a7862d01f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:35.085080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-89f521b8-8250-4ba8-8e2a-30a7862d01f6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:35.086541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-89f521b8-8250-4ba8-8e2a-30a7862d01f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:35.265874 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3308/6632] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:35.276411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7d4c2-3edf-4b87-aa89-cb202fbecef4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:35.278290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fed7d4c2-3edf-4b87-aa89-cb202fbecef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:35.440842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f521b8-8250-4ba8-8e2a-30a7862d01f6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:35.442652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-89f521b8-8250-4ba8-8e2a-30a7862d01f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:35.523313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f521b8-8250-4ba8-8e2a-30a7862d01f6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:35.544572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a8ab3-21ea-4fe6-aa2c-dcddcb8c2536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:35.546110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a8ab3-21ea-4fe6-aa2c-dcddcb8c2536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:35.546552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a8ab3-21ea-4fe6-aa2c-dcddcb8c2536 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:35.547298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a8ab3-21ea-4fe6-aa2c-dcddcb8c2536 admin admin] PATH_INFO: `/v3/users/f0e8405dde7241c8b6e1fe97702564fd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:35.548702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7d4c2-3edf-4b87-aa89-cb202fbecef4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:35.549222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a8ab3-21ea-4fe6-aa2c-dcddcb8c2536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0e8405dde7241c8b6e1fe97702564fd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:35.551585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a8ab3-21ea-4fe6-aa2c-dcddcb8c2536 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:35.589632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1c05e-421a-4cf1-95ab-273908864f2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:35.599130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c05e-421a-4cf1-95ab-273908864f2f service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:35.599606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c05e-421a-4cf1-95ab-273908864f2f service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:35.599985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c05e-421a-4cf1-95ab-273908864f2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:35.647657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1c05e-421a-4cf1-95ab-273908864f2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:35.653767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1c05e-421a-4cf1-95ab-273908864f2f service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:35.675635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-151a8ab3-21ea-4fe6-aa2c-dcddcb8c2536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0e8405dde7241c8b6e1fe97702564fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:35.694714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-151a8ab3-21ea-4fe6-aa2c-dcddcb8c2536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0e8405dde7241c8b6e1fe97702564fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:35.695937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-151a8ab3-21ea-4fe6-aa2c-dcddcb8c2536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0e8405dde7241c8b6e1fe97702564fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:35.701548 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3325/6633] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:13:35.711420 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:35.734999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-151a8ab3-21ea-4fe6-aa2c-dcddcb8c2536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0e8405dde7241c8b6e1fe97702564fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:35.753719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-151a8ab3-21ea-4fe6-aa2c-dcddcb8c2536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0e8405dde7241c8b6e1fe97702564fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:35.779094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1c05e-421a-4cf1-95ab-273908864f2f service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:35.781171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-28e1c05e-421a-4cf1-95ab-273908864f2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:35.783091 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3309/6634] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:13:35 2022] DELETE /identity/v3/users/f0e8405dde7241c8b6e1fe97702564fd => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:36.034221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1c05e-421a-4cf1-95ab-273908864f2f service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:36.038266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a8ab3-21ea-4fe6-aa2c-dcddcb8c2536 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:36.040283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-151a8ab3-21ea-4fe6-aa2c-dcddcb8c2536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:36.075304 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:36.213701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5641614-e23b-47df-873b-03ad62fb58af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:36.214341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5641614-e23b-47df-873b-03ad62fb58af service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:36.214625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5641614-e23b-47df-873b-03ad62fb58af service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:36.214901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5641614-e23b-47df-873b-03ad62fb58af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:36.215640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a8ab3-21ea-4fe6-aa2c-dcddcb8c2536 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:36.217612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f5641614-e23b-47df-873b-03ad62fb58af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:36.229520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0b02d-f74f-4fad-8d90-82a880a418f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:36.230319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0b02d-f74f-4fad-8d90-82a880a418f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:36.230905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0b02d-f74f-4fad-8d90-82a880a418f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:36.231437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0b02d-f74f-4fad-8d90-82a880a418f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:36.239930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3bb0b02d-f74f-4fad-8d90-82a880a418f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:36.273553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0b02d-f74f-4fad-8d90-82a880a418f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:36.277030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0b02d-f74f-4fad-8d90-82a880a418f9 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:36.305751 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3310/6635] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:13:36.426758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5641614-e23b-47df-873b-03ad62fb58af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:36.428128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5641614-e23b-47df-873b-03ad62fb58af service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:36.448556 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3326/6636] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:13:36.759474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0b02d-f74f-4fad-8d90-82a880a418f9 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:36.761362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3bb0b02d-f74f-4fad-8d90-82a880a418f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:36.800248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5641614-e23b-47df-873b-03ad62fb58af service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:36.801974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f5641614-e23b-47df-873b-03ad62fb58af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:36.962382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5641614-e23b-47df-873b-03ad62fb58af service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:36.963410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0b02d-f74f-4fad-8d90-82a880a418f9 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:36.967832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fbdec-6de4-4366-a427-3dbcb77c5f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:36.968789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fbdec-6de4-4366-a427-3dbcb77c5f6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:36.969469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fbdec-6de4-4366-a427-3dbcb77c5f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:36.970030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fbdec-6de4-4366-a427-3dbcb77c5f6b admin admin] PATH_INFO: `/v3/projects/7c8e852460814dada3c4564ada83c316` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:36.973133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fbdec-6de4-4366-a427-3dbcb77c5f6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c8e852460814dada3c4564ada83c316)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:36.974161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd301b09-77c1-4fe6-872a-26234b6dd0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:36.975959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd301b09-77c1-4fe6-872a-26234b6dd0bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:36.976278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd301b09-77c1-4fe6-872a-26234b6dd0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:36.976562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd301b09-77c1-4fe6-872a-26234b6dd0bc admin admin] PATH_INFO: `/v3/projects/74b0ed2a14674b7385b880282bafeab0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:36.977364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fbdec-6de4-4366-a427-3dbcb77c5f6b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:36.981401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd301b09-77c1-4fe6-872a-26234b6dd0bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=74b0ed2a14674b7385b880282bafeab0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:36.983801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd301b09-77c1-4fe6-872a-26234b6dd0bc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:37.076147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1b2fbdec-6de4-4366-a427-3dbcb77c5f6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c8e852460814dada3c4564ada83c316', 'request_id': 'req-1b2fbdec-6de4-4366-a427-3dbcb77c5f6b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:37.090898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1b2fbdec-6de4-4366-a427-3dbcb77c5f6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c8e852460814dada3c4564ada83c316', 'request_id': 'req-1b2fbdec-6de4-4366-a427-3dbcb77c5f6b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:37.093764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd301b09-77c1-4fe6-872a-26234b6dd0bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74b0ed2a14674b7385b880282bafeab0', 'request_id': 'req-bd301b09-77c1-4fe6-872a-26234b6dd0bc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:37.104944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1b2fbdec-6de4-4366-a427-3dbcb77c5f6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c8e852460814dada3c4564ada83c316', 'request_id': 'req-1b2fbdec-6de4-4366-a427-3dbcb77c5f6b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:37.110913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd301b09-77c1-4fe6-872a-26234b6dd0bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74b0ed2a14674b7385b880282bafeab0', 'request_id': 'req-bd301b09-77c1-4fe6-872a-26234b6dd0bc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:37.128800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd301b09-77c1-4fe6-872a-26234b6dd0bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74b0ed2a14674b7385b880282bafeab0', 'request_id': 'req-bd301b09-77c1-4fe6-872a-26234b6dd0bc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:37.133315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1b2fbdec-6de4-4366-a427-3dbcb77c5f6b admin admin] The token cache is being invalidate because project 7c8e852460814dada3c4564ada83c316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:13:37.133807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1b2fbdec-6de4-4366-a427-3dbcb77c5f6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:37.134633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1b2fbdec-6de4-4366-a427-3dbcb77c5f6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:37.136678 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3327/6637] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:13:36 2022] DELETE /identity/v3/projects/7c8e852460814dada3c4564ada83c316 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:37.142261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fbdec-6de4-4366-a427-3dbcb77c5f6b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:37.144963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1b2fbdec-6de4-4366-a427-3dbcb77c5f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:37.147090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd301b09-77c1-4fe6-872a-26234b6dd0bc admin admin] The token cache is being invalidate because project 74b0ed2a14674b7385b880282bafeab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:13:37.147689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd301b09-77c1-4fe6-872a-26234b6dd0bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:37.149317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd301b09-77c1-4fe6-872a-26234b6dd0bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:37.152489 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3311/6638] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:13:36 2022] DELETE /identity/v3/projects/74b0ed2a14674b7385b880282bafeab0 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:37.157306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa556d-610c-43bf-974b-97071576d74e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:37.157741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa556d-610c-43bf-974b-97071576d74e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:37.158221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa556d-610c-43bf-974b-97071576d74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:37.171386 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:37.209204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ceaa556d-610c-43bf-974b-97071576d74e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:37.210484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ceaa556d-610c-43bf-974b-97071576d74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:37.222733 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:37.323905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fbdec-6de4-4366-a427-3dbcb77c5f6b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:37.346921 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3312/6639] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:37.348157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05fed0-0402-4be2-acce-95c01a8e04ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:37.348778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f35dfd-3257-460f-bcf5-ee1ec0a74631 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:37.349052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05fed0-0402-4be2-acce-95c01a8e04ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:37.349181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f35dfd-3257-460f-bcf5-ee1ec0a74631 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:37.349321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f35dfd-3257-460f-bcf5-ee1ec0a74631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:37.349637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05fed0-0402-4be2-acce-95c01a8e04ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:37.350078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05fed0-0402-4be2-acce-95c01a8e04ec admin admin] PATH_INFO: `/v3/users/f1d7e2efc91b4e9eb56e14d55df570ce` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:37.351606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05fed0-0402-4be2-acce-95c01a8e04ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d7e2efc91b4e9eb56e14d55df570ce)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:37.353926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05fed0-0402-4be2-acce-95c01a8e04ec admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:37.398960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a0f35dfd-3257-460f-bcf5-ee1ec0a74631 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:37.400403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a0f35dfd-3257-460f-bcf5-ee1ec0a74631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:37.429192 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3313/6640] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:13:37.430528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f35dfd-3257-460f-bcf5-ee1ec0a74631 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:37.455110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f35dfd-3257-460f-bcf5-ee1ec0a74631 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:37.462626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f05fed0-0402-4be2-acce-95c01a8e04ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d7e2efc91b4e9eb56e14d55df570ce'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:37.463864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f05fed0-0402-4be2-acce-95c01a8e04ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d7e2efc91b4e9eb56e14d55df570ce'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:37.474685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d0d78-b9e5-4bc5-ba18-83bbf8026366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:37.475517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d0d78-b9e5-4bc5-ba18-83bbf8026366 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:37.476305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d0d78-b9e5-4bc5-ba18-83bbf8026366 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:37.476712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d0d78-b9e5-4bc5-ba18-83bbf8026366 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:37.477491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d0d78-b9e5-4bc5-ba18-83bbf8026366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:13:37.477906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d0d78-b9e5-4bc5-ba18-83bbf8026366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:37.479601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d0d78-b9e5-4bc5-ba18-83bbf8026366 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:37.491081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f05fed0-0402-4be2-acce-95c01a8e04ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d7e2efc91b4e9eb56e14d55df570ce'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:37.515910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f05fed0-0402-4be2-acce-95c01a8e04ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d7e2efc91b4e9eb56e14d55df570ce'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:37.522641 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3314/6641] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:13:37.523842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d0d78-b9e5-4bc5-ba18-83bbf8026366 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:37.524966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f05fed0-0402-4be2-acce-95c01a8e04ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d7e2efc91b4e9eb56e14d55df570ce'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:37.526037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1a4d0d78-b9e5-4bc5-ba18-83bbf8026366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:37.532701 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3328/6642] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:13:37 2022] DELETE /identity/v3/users/f1d7e2efc91b4e9eb56e14d55df570ce => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:37.561170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d0d78-b9e5-4bc5-ba18-83bbf8026366 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:37.729930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b38a30-fbe7-4a21-9298-a3e2daad1315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:37.730540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b38a30-fbe7-4a21-9298-a3e2daad1315 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:37.731913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b38a30-fbe7-4a21-9298-a3e2daad1315 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:37.732194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b38a30-fbe7-4a21-9298-a3e2daad1315 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:37.732991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b38a30-fbe7-4a21-9298-a3e2daad1315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:37.736207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b38a30-fbe7-4a21-9298-a3e2daad1315 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:37.779245 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3315/6643] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:13:37 2022] POST /identity/v3/projects => generated 371 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:13:37.784156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05fed0-0402-4be2-acce-95c01a8e04ec admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:37.803231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05fed0-0402-4be2-acce-95c01a8e04ec admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:37.934901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f48332-b49d-459c-92c6-e94bb331e6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:37.935522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f48332-b49d-459c-92c6-e94bb331e6bb admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:37.935796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f48332-b49d-459c-92c6-e94bb331e6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:37.936065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f48332-b49d-459c-92c6-e94bb331e6bb admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:37.936719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f48332-b49d-459c-92c6-e94bb331e6bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:37.938628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f48332-b49d-459c-92c6-e94bb331e6bb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:37.990451 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3329/6644] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:13:37 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:37.994520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b38a30-fbe7-4a21-9298-a3e2daad1315 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:38.012298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b38a30-fbe7-4a21-9298-a3e2daad1315 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:38.020447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedca69-479a-4736-8903-6b0a49fe0872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:38.022175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedca69-479a-4736-8903-6b0a49fe0872 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:38.024987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedca69-479a-4736-8903-6b0a49fe0872 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:38.025389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedca69-479a-4736-8903-6b0a49fe0872 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:38.026940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cedca69-479a-4736-8903-6b0a49fe0872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:38.031171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cedca69-479a-4736-8903-6b0a49fe0872 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:38.051784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f48332-b49d-459c-92c6-e94bb331e6bb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:38.052987 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3316/6645] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:38.064127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f48332-b49d-459c-92c6-e94bb331e6bb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:38.070610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3540c3-47de-4f44-82e2-0ef5dccc03f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:38.073050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3540c3-47de-4f44-82e2-0ef5dccc03f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:38.073593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3540c3-47de-4f44-82e2-0ef5dccc03f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:38.073863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3540c3-47de-4f44-82e2-0ef5dccc03f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:38.074514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3540c3-47de-4f44-82e2-0ef5dccc03f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:38.076099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3540c3-47de-4f44-82e2-0ef5dccc03f6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:38.083480 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:38.093415 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3330/6646] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:13:38.097444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedca69-479a-4736-8903-6b0a49fe0872 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:38.113864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedca69-479a-4736-8903-6b0a49fe0872 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:38.120320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d5639-0791-4ab9-b93b-4bd4c2868180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:38.120828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d5639-0791-4ab9-b93b-4bd4c2868180 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:38.121109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d5639-0791-4ab9-b93b-4bd4c2868180 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:38.121383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d5639-0791-4ab9-b93b-4bd4c2868180 admin admin] PATH_INFO: `/v3/projects/40120549886f420f8ece964a0aca434d/users/4fc53f77d49d404b999c8721cfe4e184/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:38.170712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d5639-0791-4ab9-b93b-4bd4c2868180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40120549886f420f8ece964a0aca434d, user_id=4fc53f77d49d404b999c8721cfe4e184, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:38.173391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d5639-0791-4ab9-b93b-4bd4c2868180 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:38.202912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3540c3-47de-4f44-82e2-0ef5dccc03f6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:38.204582 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3317/6647] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:13:38 2022] PUT /identity/v3/projects/40120549886f420f8ece964a0aca434d/users/4fc53f77d49d404b999c8721cfe4e184/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:38.205903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2e3540c3-47de-4f44-82e2-0ef5dccc03f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:38.218354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50df6f9-7f38-4334-927f-8e59beb58e5e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:38.218664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50df6f9-7f38-4334-927f-8e59beb58e5e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:38.220348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50df6f9-7f38-4334-927f-8e59beb58e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:38.233331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3540c3-47de-4f44-82e2-0ef5dccc03f6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:38.326129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e50df6f9-7f38-4334-927f-8e59beb58e5e None None] MFA Rules not processed for user `4fc53f77d49d404b999c8721cfe4e184`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:38.327366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e50df6f9-7f38-4334-927f-8e59beb58e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:38.354464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0854c86-61d7-438e-8b9a-4c4515f85698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:38.355175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0854c86-61d7-438e-8b9a-4c4515f85698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:38.364771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0854c86-61d7-438e-8b9a-4c4515f85698 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:38.366111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0854c86-61d7-438e-8b9a-4c4515f85698 admin admin] PATH_INFO: `/v3/projects/7f04bd6a4895454aaad4804d5df8ed83` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:38.369325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0854c86-61d7-438e-8b9a-4c4515f85698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f04bd6a4895454aaad4804d5df8ed83)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:38.372985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0854c86-61d7-438e-8b9a-4c4515f85698 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:38.378386 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:38.440102 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3318/6648] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:38.452401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50df6f9-7f38-4334-927f-8e59beb58e5e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:38.454713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e50df6f9-7f38-4334-927f-8e59beb58e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:38.456956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c0854c86-61d7-438e-8b9a-4c4515f85698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f04bd6a4895454aaad4804d5df8ed83', 'request_id': 'req-c0854c86-61d7-438e-8b9a-4c4515f85698'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:38.476852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c0854c86-61d7-438e-8b9a-4c4515f85698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f04bd6a4895454aaad4804d5df8ed83', 'request_id': 'req-c0854c86-61d7-438e-8b9a-4c4515f85698'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:38.485989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c0854c86-61d7-438e-8b9a-4c4515f85698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f04bd6a4895454aaad4804d5df8ed83', 'request_id': 'req-c0854c86-61d7-438e-8b9a-4c4515f85698'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:38.501090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c0854c86-61d7-438e-8b9a-4c4515f85698 admin admin] The token cache is being invalidate because project 7f04bd6a4895454aaad4804d5df8ed83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:13:38.501431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c0854c86-61d7-438e-8b9a-4c4515f85698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:38.502835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c0854c86-61d7-438e-8b9a-4c4515f85698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:38.504658 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3331/6649] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:13:38 2022] DELETE /identity/v3/projects/7f04bd6a4895454aaad4804d5df8ed83 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:38.509963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7e215-738a-4b51-8540-c2c8c9c1ada0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:38.510298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7e215-738a-4b51-8540-c2c8c9c1ada0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:38.510572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7e215-738a-4b51-8540-c2c8c9c1ada0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:38.536493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f9d7e215-738a-4b51-8540-c2c8c9c1ada0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:38.540388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f9d7e215-738a-4b51-8540-c2c8c9c1ada0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:38.547307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50df6f9-7f38-4334-927f-8e59beb58e5e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:38.635069 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3332/6650] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:38.635832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c126c90-1e24-45db-aae1-dcd22d9883fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:38.636456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c126c90-1e24-45db-aae1-dcd22d9883fe service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:38.636793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c126c90-1e24-45db-aae1-dcd22d9883fe service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:38.637218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c126c90-1e24-45db-aae1-dcd22d9883fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:38.639181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8c126c90-1e24-45db-aae1-dcd22d9883fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:38.642033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67526e25-2b69-4a9f-94dd-6f460c96aece None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:38.642513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67526e25-2b69-4a9f-94dd-6f460c96aece None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:38.644073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67526e25-2b69-4a9f-94dd-6f460c96aece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:38.673066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-67526e25-2b69-4a9f-94dd-6f460c96aece None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:38.674740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-67526e25-2b69-4a9f-94dd-6f460c96aece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:38.685068 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3333/6651] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:38.689356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67526e25-2b69-4a9f-94dd-6f460c96aece None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:38.707505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67526e25-2b69-4a9f-94dd-6f460c96aece None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:38.716028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdd95c-4249-4b1b-8de0-5aca881d94aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:38.717083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdd95c-4249-4b1b-8de0-5aca881d94aa admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:38.717541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdd95c-4249-4b1b-8de0-5aca881d94aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:38.717982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdd95c-4249-4b1b-8de0-5aca881d94aa admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:38.718935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdd95c-4249-4b1b-8de0-5aca881d94aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:13:38.719429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdd95c-4249-4b1b-8de0-5aca881d94aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:38.722470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdd95c-4249-4b1b-8de0-5aca881d94aa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:38.735223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c126c90-1e24-45db-aae1-dcd22d9883fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:38.740368 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3334/6652] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:13:38.740758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c126c90-1e24-45db-aae1-dcd22d9883fe service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:38.744338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdd95c-4249-4b1b-8de0-5aca881d94aa admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:38.759350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdd95c-4249-4b1b-8de0-5aca881d94aa admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:38.765617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19481b68-b3f8-46b8-875a-c4bd6ef0f32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:38.766599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19481b68-b3f8-46b8-875a-c4bd6ef0f32c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:38.767179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19481b68-b3f8-46b8-875a-c4bd6ef0f32c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:38.768205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19481b68-b3f8-46b8-875a-c4bd6ef0f32c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:38.769147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19481b68-b3f8-46b8-875a-c4bd6ef0f32c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:38.772177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19481b68-b3f8-46b8-875a-c4bd6ef0f32c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:38.776732 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3319/6653] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:13:38.790249 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:38.816566 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3335/6654] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:13:38 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:38.820483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c126c90-1e24-45db-aae1-dcd22d9883fe service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:38.833999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c126c90-1e24-45db-aae1-dcd22d9883fe service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:38.839204 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:38.975392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557574c-4508-465e-8a5a-7ceddd50122b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:38.976134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557574c-4508-465e-8a5a-7ceddd50122b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:38.976429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557574c-4508-465e-8a5a-7ceddd50122b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:38.976758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557574c-4508-465e-8a5a-7ceddd50122b admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:38.977584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557574c-4508-465e-8a5a-7ceddd50122b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:38.979545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557574c-4508-465e-8a5a-7ceddd50122b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:39.034128 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3320/6655] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:13:38 2022] POST /identity/v3/users => generated 283 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:39.038464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19481b68-b3f8-46b8-875a-c4bd6ef0f32c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:39.066595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19481b68-b3f8-46b8-875a-c4bd6ef0f32c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:39.089921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b6fe8-7987-4409-95e3-17509dec0489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:39.090711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b6fe8-7987-4409-95e3-17509dec0489 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:39.091138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b6fe8-7987-4409-95e3-17509dec0489 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:39.091409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b6fe8-7987-4409-95e3-17509dec0489 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:39.093038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b6fe8-7987-4409-95e3-17509dec0489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:39.095475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b6fe8-7987-4409-95e3-17509dec0489 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:39.132827 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3336/6656] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:39.136874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557574c-4508-465e-8a5a-7ceddd50122b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:39.152215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557574c-4508-465e-8a5a-7ceddd50122b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:39.182013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8430e-65c2-402a-9956-5b071ebe9471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:39.182886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8430e-65c2-402a-9956-5b071ebe9471 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:39.183178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8430e-65c2-402a-9956-5b071ebe9471 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:39.183545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8430e-65c2-402a-9956-5b071ebe9471 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:39.184353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8430e-65c2-402a-9956-5b071ebe9471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:39.188491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8430e-65c2-402a-9956-5b071ebe9471 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:39.248666 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3321/6657] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:39.253776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b6fe8-7987-4409-95e3-17509dec0489 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:39.276198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b6fe8-7987-4409-95e3-17509dec0489 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:39.294880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eadf2e-77b7-4ce0-9e4b-57148de1bcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:39.295900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eadf2e-77b7-4ce0-9e4b-57148de1bcb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:39.296180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eadf2e-77b7-4ce0-9e4b-57148de1bcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:39.296451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eadf2e-77b7-4ce0-9e4b-57148de1bcb9 admin admin] PATH_INFO: `/v3/projects/4ac5ca5d13d24d4684634911e67a3293/users/6af2054afe654356be821850a80d7642/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:39.341304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eadf2e-77b7-4ce0-9e4b-57148de1bcb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac5ca5d13d24d4684634911e67a3293, user_id=6af2054afe654356be821850a80d7642, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:39.350001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eadf2e-77b7-4ce0-9e4b-57148de1bcb9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:39.393275 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3337/6658] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:13:39 2022] PUT /identity/v3/projects/4ac5ca5d13d24d4684634911e67a3293/users/6af2054afe654356be821850a80d7642/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:39.404493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd984c5-87c3-4c27-b580-3e50c4cfafd6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:39.405292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd984c5-87c3-4c27-b580-3e50c4cfafd6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:39.405925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd984c5-87c3-4c27-b580-3e50c4cfafd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:39.474679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4cd984c5-87c3-4c27-b580-3e50c4cfafd6 None None] MFA Rules not processed for user `6af2054afe654356be821850a80d7642`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:39.476218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4cd984c5-87c3-4c27-b580-3e50c4cfafd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:39.566153 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3322/6659] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:39.570488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eadf2e-77b7-4ce0-9e4b-57148de1bcb9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:39.693404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eadf2e-77b7-4ce0-9e4b-57148de1bcb9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:39.717707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d9c03-ab8f-4aa4-8f32-0e6cbda885e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:39.719504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d9c03-ab8f-4aa4-8f32-0e6cbda885e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:39.719788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d9c03-ab8f-4aa4-8f32-0e6cbda885e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:39.720061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d9c03-ab8f-4aa4-8f32-0e6cbda885e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:39.720763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d9c03-ab8f-4aa4-8f32-0e6cbda885e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:39.725195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d9c03-ab8f-4aa4-8f32-0e6cbda885e1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:39.794670 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3338/6660] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:13:39 2022] POST /identity/v3/projects => generated 363 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:39.796400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd984c5-87c3-4c27-b580-3e50c4cfafd6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:39.854027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd984c5-87c3-4c27-b580-3e50c4cfafd6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:39.884148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d9c03-ab8f-4aa4-8f32-0e6cbda885e1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:39.886033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-201d9c03-ab8f-4aa4-8f32-0e6cbda885e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:40.012965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d9c03-ab8f-4aa4-8f32-0e6cbda885e1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:40.031692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1629eea-f899-4f69-bdcc-31e8c7fc4d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:40.032348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1629eea-f899-4f69-bdcc-31e8c7fc4d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:40.032649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1629eea-f899-4f69-bdcc-31e8c7fc4d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:40.032927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1629eea-f899-4f69-bdcc-31e8c7fc4d9c admin admin] PATH_INFO: `/v3/users/76b9388ed5d54ba4909ba8639f4fa218` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:40.034436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1629eea-f899-4f69-bdcc-31e8c7fc4d9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=76b9388ed5d54ba4909ba8639f4fa218)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:40.036374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1629eea-f899-4f69-bdcc-31e8c7fc4d9c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:40.054682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7285b26-e39f-46c0-aead-74545038e7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:40.055226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7285b26-e39f-46c0-aead-74545038e7be admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:40.055506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7285b26-e39f-46c0-aead-74545038e7be admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:40.055782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7285b26-e39f-46c0-aead-74545038e7be admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:40.056433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7285b26-e39f-46c0-aead-74545038e7be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:40.058379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7285b26-e39f-46c0-aead-74545038e7be admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:40.112063 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3323/6661] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:13:39 2022] POST /identity/v3/users => generated 288 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:13:40.115741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7285b26-e39f-46c0-aead-74545038e7be admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:40.129376 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:40.141746 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:40.146137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7285b26-e39f-46c0-aead-74545038e7be admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:40.157660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1629eea-f899-4f69-bdcc-31e8c7fc4d9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76b9388ed5d54ba4909ba8639f4fa218'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:40.159321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1629eea-f899-4f69-bdcc-31e8c7fc4d9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76b9388ed5d54ba4909ba8639f4fa218'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:40.163333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76f059-feee-41a4-a9ee-5583a9623acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:40.164345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76f059-feee-41a4-a9ee-5583a9623acb admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:40.164914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76f059-feee-41a4-a9ee-5583a9623acb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:40.165401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76f059-feee-41a4-a9ee-5583a9623acb admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:40.166506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76f059-feee-41a4-a9ee-5583a9623acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:40.172130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1629eea-f899-4f69-bdcc-31e8c7fc4d9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76b9388ed5d54ba4909ba8639f4fa218'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:40.180976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76f059-feee-41a4-a9ee-5583a9623acb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:40.194347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1629eea-f899-4f69-bdcc-31e8c7fc4d9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76b9388ed5d54ba4909ba8639f4fa218'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:40.210894 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3324/6662] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:40.214393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1629eea-f899-4f69-bdcc-31e8c7fc4d9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76b9388ed5d54ba4909ba8639f4fa218'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:40.214573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76f059-feee-41a4-a9ee-5583a9623acb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:40.217766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cd76f059-feee-41a4-a9ee-5583a9623acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:40.231607 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3339/6663] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:13:39 2022] DELETE /identity/v3/users/76b9388ed5d54ba4909ba8639f4fa218 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:13:40.236038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbcd13-a7d7-4a61-85a9-a68cb31d5f59 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:40.236898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbcd13-a7d7-4a61-85a9-a68cb31d5f59 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:40.237304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbcd13-a7d7-4a61-85a9-a68cb31d5f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:40.252590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76f059-feee-41a4-a9ee-5583a9623acb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:40.277068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7cbbcd13-a7d7-4a61-85a9-a68cb31d5f59 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:40.278296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7cbbcd13-a7d7-4a61-85a9-a68cb31d5f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:40.384284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a5835-d229-4f2a-95c1-6355ca250d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:40.384985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a5835-d229-4f2a-95c1-6355ca250d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:40.385263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a5835-d229-4f2a-95c1-6355ca250d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:40.385532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a5835-d229-4f2a-95c1-6355ca250d6d admin admin] PATH_INFO: `/v3/projects/2e75f42eae0d445296fd17382e3476e1/users/c289193cea3142519c5a2150129a54a5/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:40.399496 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3340/6664] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:13:40.411765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbcd13-a7d7-4a61-85a9-a68cb31d5f59 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:40.413577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7cbbcd13-a7d7-4a61-85a9-a68cb31d5f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:40.430261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a5835-d229-4f2a-95c1-6355ca250d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e75f42eae0d445296fd17382e3476e1, user_id=c289193cea3142519c5a2150129a54a5, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:40.437006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a5835-d229-4f2a-95c1-6355ca250d6d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:40.467572 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3325/6665] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:13:40 2022] PUT /identity/v3/projects/2e75f42eae0d445296fd17382e3476e1/users/c289193cea3142519c5a2150129a54a5/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:40.478204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a5835-d229-4f2a-95c1-6355ca250d6d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:40.572888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbcd13-a7d7-4a61-85a9-a68cb31d5f59 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:40.689560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a5835-d229-4f2a-95c1-6355ca250d6d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:40.714607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dd6e9-7572-41b0-95e4-5352bba6d708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:40.717341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dd6e9-7572-41b0-95e4-5352bba6d708 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:40.717685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dd6e9-7572-41b0-95e4-5352bba6d708 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:40.737067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dd6e9-7572-41b0-95e4-5352bba6d708 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:40.737067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066dd6e9-7572-41b0-95e4-5352bba6d708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:40.737067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066dd6e9-7572-41b0-95e4-5352bba6d708 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:40.794749 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3326/6666] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:13:40.802083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dd6e9-7572-41b0-95e4-5352bba6d708 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:40.828249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035faf3-e121-4b55-8636-8f196cde97a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:40.828960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035faf3-e121-4b55-8636-8f196cde97a9 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:40.831179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035faf3-e121-4b55-8636-8f196cde97a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:40.831467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035faf3-e121-4b55-8636-8f196cde97a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:40.832027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dd6e9-7572-41b0-95e4-5352bba6d708 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:40.847345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864bc97-9270-491d-bdd5-6d46fdb57c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:40.851243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864bc97-9270-491d-bdd5-6d46fdb57c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:40.851530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864bc97-9270-491d-bdd5-6d46fdb57c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:40.853814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864bc97-9270-491d-bdd5-6d46fdb57c2e admin admin] PATH_INFO: `/v3/projects/2e75f42eae0d445296fd17382e3476e1/users/c289193cea3142519c5a2150129a54a5/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:40.858057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864bc97-9270-491d-bdd5-6d46fdb57c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e75f42eae0d445296fd17382e3476e1, user_id=c289193cea3142519c5a2150129a54a5, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:40.860916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035faf3-e121-4b55-8636-8f196cde97a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:40.865938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035faf3-e121-4b55-8636-8f196cde97a9 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:40.867422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864bc97-9270-491d-bdd5-6d46fdb57c2e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:40.896992 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3341/6667] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:13:40.897547 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3327/6668] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:13:40 2022] PUT /identity/v3/projects/2e75f42eae0d445296fd17382e3476e1/users/c289193cea3142519c5a2150129a54a5/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:40.907698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85a85f-796c-4d34-8f86-7de6bb8f2e01 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:40.909651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85a85f-796c-4d34-8f86-7de6bb8f2e01 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:40.909651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85a85f-796c-4d34-8f86-7de6bb8f2e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:41.006499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8b85a85f-796c-4d34-8f86-7de6bb8f2e01 None None] MFA Rules not processed for user `c289193cea3142519c5a2150129a54a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:41.007755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8b85a85f-796c-4d34-8f86-7de6bb8f2e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:41.015665 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:41.187343 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3342/6669] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:41.200027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864bc97-9270-491d-bdd5-6d46fdb57c2e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:41.202623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3864bc97-9270-491d-bdd5-6d46fdb57c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:41.296976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864bc97-9270-491d-bdd5-6d46fdb57c2e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:41.304472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458dbdc-b3c5-4eb8-ad50-f86a3175a3c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:41.305032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458dbdc-b3c5-4eb8-ad50-f86a3175a3c5 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:41.305537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458dbdc-b3c5-4eb8-ad50-f86a3175a3c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:41.305906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458dbdc-b3c5-4eb8-ad50-f86a3175a3c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:41.321715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458dbdc-b3c5-4eb8-ad50-f86a3175a3c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:41.322046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458dbdc-b3c5-4eb8-ad50-f86a3175a3c5 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:41.337374 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3328/6670] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:13:41.442775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85a85f-796c-4d34-8f86-7de6bb8f2e01 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:41.459074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85a85f-796c-4d34-8f86-7de6bb8f2e01 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:41.466564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0fc15-5af4-4873-8616-7d838f826e64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:41.468156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0fc15-5af4-4873-8616-7d838f826e64 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:41.468490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0fc15-5af4-4873-8616-7d838f826e64 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:41.468859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0fc15-5af4-4873-8616-7d838f826e64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:41.480703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b5d0fc15-5af4-4873-8616-7d838f826e64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:41.561038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0fc15-5af4-4873-8616-7d838f826e64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:41.562872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0fc15-5af4-4873-8616-7d838f826e64 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:41.578000 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3343/6671] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:13:42.575564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458dbdc-b3c5-4eb8-ad50-f86a3175a3c5 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:42.577570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f458dbdc-b3c5-4eb8-ad50-f86a3175a3c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:42.587581 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:42.765898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458dbdc-b3c5-4eb8-ad50-f86a3175a3c5 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:42.785263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9507b2-5897-4974-94dc-5d740b658abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:42.787608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9507b2-5897-4974-94dc-5d740b658abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:42.788024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9507b2-5897-4974-94dc-5d740b658abc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:42.789229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9507b2-5897-4974-94dc-5d740b658abc admin admin] PATH_INFO: `/v3/projects/8b2f54ef0496490f82c8925d288d3ff4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:42.793130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9507b2-5897-4974-94dc-5d740b658abc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b2f54ef0496490f82c8925d288d3ff4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:42.801927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9507b2-5897-4974-94dc-5d740b658abc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:42.974549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1e9507b2-5897-4974-94dc-5d740b658abc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b2f54ef0496490f82c8925d288d3ff4', 'request_id': 'req-1e9507b2-5897-4974-94dc-5d740b658abc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:42.998918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1e9507b2-5897-4974-94dc-5d740b658abc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b2f54ef0496490f82c8925d288d3ff4', 'request_id': 'req-1e9507b2-5897-4974-94dc-5d740b658abc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:43.017998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1e9507b2-5897-4974-94dc-5d740b658abc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b2f54ef0496490f82c8925d288d3ff4', 'request_id': 'req-1e9507b2-5897-4974-94dc-5d740b658abc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:43.041081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1e9507b2-5897-4974-94dc-5d740b658abc admin admin] The token cache is being invalidate because project 8b2f54ef0496490f82c8925d288d3ff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:13:43.041373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1e9507b2-5897-4974-94dc-5d740b658abc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:43.042626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1e9507b2-5897-4974-94dc-5d740b658abc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:43.046365 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3329/6672] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:13:42 2022] DELETE /identity/v3/projects/8b2f54ef0496490f82c8925d288d3ff4 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:43.066228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af1999-2f0d-4d51-a3ee-5cfe09488759 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:43.066736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af1999-2f0d-4d51-a3ee-5cfe09488759 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:43.066736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af1999-2f0d-4d51-a3ee-5cfe09488759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:43.092500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c5af1999-2f0d-4d51-a3ee-5cfe09488759 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:43.094582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c5af1999-2f0d-4d51-a3ee-5cfe09488759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:43.232737 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3344/6673] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:43.241629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8a50e-c862-4694-ae48-4a7efc589a5d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:43.241997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8a50e-c862-4694-ae48-4a7efc589a5d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:43.242570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8a50e-c862-4694-ae48-4a7efc589a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:43.281753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-63a8a50e-c862-4694-ae48-4a7efc589a5d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:43.288902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-63a8a50e-c862-4694-ae48-4a7efc589a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:43.319374 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3330/6674] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:43.325030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af1999-2f0d-4d51-a3ee-5cfe09488759 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:43.339990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af1999-2f0d-4d51-a3ee-5cfe09488759 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:43.357516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecf920-bd28-44b6-b011-831047976455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:43.358154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecf920-bd28-44b6-b011-831047976455 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:43.359450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecf920-bd28-44b6-b011-831047976455 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:43.359760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecf920-bd28-44b6-b011-831047976455 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:43.361454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecf920-bd28-44b6-b011-831047976455 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:13:43.364045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecf920-bd28-44b6-b011-831047976455 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:43.366606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecf920-bd28-44b6-b011-831047976455 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:43.424936 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3345/6675] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:13:43.425388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8a50e-c862-4694-ae48-4a7efc589a5d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:43.455209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8a50e-c862-4694-ae48-4a7efc589a5d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:43.490549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756b9dd-2cd7-45af-8894-73edaa5f8a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:43.491012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756b9dd-2cd7-45af-8894-73edaa5f8a12 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:43.491294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756b9dd-2cd7-45af-8894-73edaa5f8a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:43.491640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756b9dd-2cd7-45af-8894-73edaa5f8a12 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:43.492202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756b9dd-2cd7-45af-8894-73edaa5f8a12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:43.495665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756b9dd-2cd7-45af-8894-73edaa5f8a12 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:43.628275 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3331/6676] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:13:43 2022] POST /identity/v3/projects => generated 365 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:13:43.631260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecf920-bd28-44b6-b011-831047976455 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:43.654565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecf920-bd28-44b6-b011-831047976455 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:43.721876 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:43.809418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209374dc-fddc-405b-8a06-d402d46436d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:43.810053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209374dc-fddc-405b-8a06-d402d46436d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:43.810336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209374dc-fddc-405b-8a06-d402d46436d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:43.810610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209374dc-fddc-405b-8a06-d402d46436d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:43.811247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209374dc-fddc-405b-8a06-d402d46436d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:43.813209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209374dc-fddc-405b-8a06-d402d46436d5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:43.863611 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3346/6677] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:13:43 2022] POST /identity/v3/users => generated 283 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:43.864536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756b9dd-2cd7-45af-8894-73edaa5f8a12 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:43.886099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756b9dd-2cd7-45af-8894-73edaa5f8a12 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:43.903821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e9924-036b-493b-a823-2dbc060d2732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:43.904729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e9924-036b-493b-a823-2dbc060d2732 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:43.905183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e9924-036b-493b-a823-2dbc060d2732 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:43.905629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e9924-036b-493b-a823-2dbc060d2732 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:43.906753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e9924-036b-493b-a823-2dbc060d2732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:43.910454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e9924-036b-493b-a823-2dbc060d2732 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:43.967945 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3332/6678] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:13:43.972417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209374dc-fddc-405b-8a06-d402d46436d5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:43.988001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209374dc-fddc-405b-8a06-d402d46436d5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:44.012703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87eecf6-4649-4970-892d-bb09f6187bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:44.013331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eecf6-4649-4970-892d-bb09f6187bee admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:44.013753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eecf6-4649-4970-892d-bb09f6187bee admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:44.014033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eecf6-4649-4970-892d-bb09f6187bee admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:44.014689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87eecf6-4649-4970-892d-bb09f6187bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:44.022183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87eecf6-4649-4970-892d-bb09f6187bee admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:44.063710 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3347/6679] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:44.069033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e9924-036b-493b-a823-2dbc060d2732 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:44.104031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e9924-036b-493b-a823-2dbc060d2732 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:44.117654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5814671-d0b7-44e6-a6b2-4d19c200b400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:44.118344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5814671-d0b7-44e6-a6b2-4d19c200b400 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:44.118631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5814671-d0b7-44e6-a6b2-4d19c200b400 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:44.118911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5814671-d0b7-44e6-a6b2-4d19c200b400 admin admin] PATH_INFO: `/v3/projects/bb576dc9e81045b88ce3a69e60ee3503/users/8c9df05ff1d2432e9f15777292f49197/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:44.162059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5814671-d0b7-44e6-a6b2-4d19c200b400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb576dc9e81045b88ce3a69e60ee3503, user_id=8c9df05ff1d2432e9f15777292f49197, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:44.167896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5814671-d0b7-44e6-a6b2-4d19c200b400 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:44.213326 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3333/6680] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:13:44 2022] PUT /identity/v3/projects/bb576dc9e81045b88ce3a69e60ee3503/users/8c9df05ff1d2432e9f15777292f49197/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:13:44.219074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12846ae3-6914-4980-8fed-8c6b70a86e6d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:44.219577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12846ae3-6914-4980-8fed-8c6b70a86e6d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:44.219814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12846ae3-6914-4980-8fed-8c6b70a86e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:44.261763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-12846ae3-6914-4980-8fed-8c6b70a86e6d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:44.268174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-12846ae3-6914-4980-8fed-8c6b70a86e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:44.381949 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3348/6681] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:44.393090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5814671-d0b7-44e6-a6b2-4d19c200b400 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:44.395563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a5814671-d0b7-44e6-a6b2-4d19c200b400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:44.439242 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:44.478763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5814671-d0b7-44e6-a6b2-4d19c200b400 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:44.484443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95050e53-bd41-4a8d-bb31-b481d7d3f9ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:44.485092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95050e53-bd41-4a8d-bb31-b481d7d3f9ff service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:44.485373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95050e53-bd41-4a8d-bb31-b481d7d3f9ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:44.487117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95050e53-bd41-4a8d-bb31-b481d7d3f9ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:44.499723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95050e53-bd41-4a8d-bb31-b481d7d3f9ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:44.501318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95050e53-bd41-4a8d-bb31-b481d7d3f9ff service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:44.515535 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3334/6682] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:13:45.499047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12846ae3-6914-4980-8fed-8c6b70a86e6d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:45.501219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-12846ae3-6914-4980-8fed-8c6b70a86e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:45.531188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12846ae3-6914-4980-8fed-8c6b70a86e6d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:45.549633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555184f0-0fb4-465a-9316-47531f1778b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:45.554778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555184f0-0fb4-465a-9316-47531f1778b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:45.560970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555184f0-0fb4-465a-9316-47531f1778b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:45.561253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555184f0-0fb4-465a-9316-47531f1778b5 admin admin] PATH_INFO: `/v3/users/6af2054afe654356be821850a80d7642` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:45.567317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555184f0-0fb4-465a-9316-47531f1778b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6af2054afe654356be821850a80d7642)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:45.569550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555184f0-0fb4-465a-9316-47531f1778b5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:45.589527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e398d-bc37-462a-a8b7-0dedf55361e0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:45.590027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e398d-bc37-462a-a8b7-0dedf55361e0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:45.590132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e398d-bc37-462a-a8b7-0dedf55361e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:45.635364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-060e398d-bc37-462a-a8b7-0dedf55361e0 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:45.641528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-060e398d-bc37-462a-a8b7-0dedf55361e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:45.740827 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3335/6683] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 10:13:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:13:45.741565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-555184f0-0fb4-465a-9316-47531f1778b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6af2054afe654356be821850a80d7642'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:45.742476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-555184f0-0fb4-465a-9316-47531f1778b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6af2054afe654356be821850a80d7642'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:45.763136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-555184f0-0fb4-465a-9316-47531f1778b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6af2054afe654356be821850a80d7642'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:45.793479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e398d-bc37-462a-a8b7-0dedf55361e0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:45.796357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-060e398d-bc37-462a-a8b7-0dedf55361e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:45.823788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-555184f0-0fb4-465a-9316-47531f1778b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6af2054afe654356be821850a80d7642'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:45.848663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-555184f0-0fb4-465a-9316-47531f1778b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6af2054afe654356be821850a80d7642'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:45.875249 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3349/6684] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:13:45 2022] DELETE /identity/v3/users/6af2054afe654356be821850a80d7642 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:45.880476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4465f-91b1-45b5-9468-e06715474822 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:45.881115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4465f-91b1-45b5-9468-e06715474822 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:45.881624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4465f-91b1-45b5-9468-e06715474822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:45.923768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9fc4465f-91b1-45b5-9468-e06715474822 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:45.925205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9fc4465f-91b1-45b5-9468-e06715474822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:45.962302 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:45.987631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e398d-bc37-462a-a8b7-0dedf55361e0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:46.035626 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3350/6685] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:13:46.045797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4465f-91b1-45b5-9468-e06715474822 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:46.051362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9fc4465f-91b1-45b5-9468-e06715474822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:46.182515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4465f-91b1-45b5-9468-e06715474822 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:46.187551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707afbeb-256e-4a0f-82e5-021299de36c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:46.188195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707afbeb-256e-4a0f-82e5-021299de36c7 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:46.188478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707afbeb-256e-4a0f-82e5-021299de36c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:46.188637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a443be-d7bd-4ba9-a1e4-81ab47dc526c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:46.188871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707afbeb-256e-4a0f-82e5-021299de36c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:46.189494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a443be-d7bd-4ba9-a1e4-81ab47dc526c service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:46.189883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a443be-d7bd-4ba9-a1e4-81ab47dc526c service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:46.190631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a443be-d7bd-4ba9-a1e4-81ab47dc526c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:46.198282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-94a443be-d7bd-4ba9-a1e4-81ab47dc526c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:46.226809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707afbeb-256e-4a0f-82e5-021299de36c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:46.232716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707afbeb-256e-4a0f-82e5-021299de36c7 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:46.262455 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:46.277578 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3351/6686] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:13:46.385995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a443be-d7bd-4ba9-a1e4-81ab47dc526c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:46.387885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a443be-d7bd-4ba9-a1e4-81ab47dc526c service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:46.415090 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3336/6687] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:13:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:13:47.085443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707afbeb-256e-4a0f-82e5-021299de36c7 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:47.087009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-707afbeb-256e-4a0f-82e5-021299de36c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:47.166888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707afbeb-256e-4a0f-82e5-021299de36c7 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:47.193620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec823231-35e5-4a7b-b210-726f835a3cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:47.194505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec823231-35e5-4a7b-b210-726f835a3cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:47.194944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec823231-35e5-4a7b-b210-726f835a3cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:47.195360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec823231-35e5-4a7b-b210-726f835a3cb6 admin admin] PATH_INFO: `/v3/projects/4ac5ca5d13d24d4684634911e67a3293` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:47.198691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec823231-35e5-4a7b-b210-726f835a3cb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac5ca5d13d24d4684634911e67a3293)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:47.200673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec823231-35e5-4a7b-b210-726f835a3cb6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:47.338411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec823231-35e5-4a7b-b210-726f835a3cb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac5ca5d13d24d4684634911e67a3293', 'request_id': 'req-ec823231-35e5-4a7b-b210-726f835a3cb6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:47.358539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec823231-35e5-4a7b-b210-726f835a3cb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac5ca5d13d24d4684634911e67a3293', 'request_id': 'req-ec823231-35e5-4a7b-b210-726f835a3cb6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:47.369007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec823231-35e5-4a7b-b210-726f835a3cb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac5ca5d13d24d4684634911e67a3293', 'request_id': 'req-ec823231-35e5-4a7b-b210-726f835a3cb6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:47.385315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec823231-35e5-4a7b-b210-726f835a3cb6 admin admin] The token cache is being invalidate because project 4ac5ca5d13d24d4684634911e67a3293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:13:47.385610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec823231-35e5-4a7b-b210-726f835a3cb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:47.386305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec823231-35e5-4a7b-b210-726f835a3cb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:47.390709 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3352/6688] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:13:47 2022] DELETE /identity/v3/projects/4ac5ca5d13d24d4684634911e67a3293 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:47.391915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a443be-d7bd-4ba9-a1e4-81ab47dc526c service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:47.413383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a443be-d7bd-4ba9-a1e4-81ab47dc526c service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:47.536166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ab1c6-4eb0-4f72-8b06-fd98c13ff266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:47.536937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ab1c6-4eb0-4f72-8b06-fd98c13ff266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:47.537298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ab1c6-4eb0-4f72-8b06-fd98c13ff266 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:47.537667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ab1c6-4eb0-4f72-8b06-fd98c13ff266 admin admin] PATH_INFO: `/v3/users/c289193cea3142519c5a2150129a54a5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:47.545177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ab1c6-4eb0-4f72-8b06-fd98c13ff266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c289193cea3142519c5a2150129a54a5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:47.547206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ab1c6-4eb0-4f72-8b06-fd98c13ff266 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:47.656353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f70ab1c6-4eb0-4f72-8b06-fd98c13ff266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c289193cea3142519c5a2150129a54a5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:47.678785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f70ab1c6-4eb0-4f72-8b06-fd98c13ff266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c289193cea3142519c5a2150129a54a5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:47.679482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f70ab1c6-4eb0-4f72-8b06-fd98c13ff266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c289193cea3142519c5a2150129a54a5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:47.708585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f70ab1c6-4eb0-4f72-8b06-fd98c13ff266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c289193cea3142519c5a2150129a54a5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:47.714252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec823231-35e5-4a7b-b210-726f835a3cb6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:47.716239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ec823231-35e5-4a7b-b210-726f835a3cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:47.727100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f70ab1c6-4eb0-4f72-8b06-fd98c13ff266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c289193cea3142519c5a2150129a54a5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:47.736920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec823231-35e5-4a7b-b210-726f835a3cb6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:47.738418 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3337/6689] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:13:47 2022] DELETE /identity/v3/users/c289193cea3142519c5a2150129a54a5 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:47.852005 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:47.874828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992eb488-c00c-4e8a-8fe6-6ec22293da5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:47.875488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992eb488-c00c-4e8a-8fe6-6ec22293da5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:47.875851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992eb488-c00c-4e8a-8fe6-6ec22293da5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:47.876191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992eb488-c00c-4e8a-8fe6-6ec22293da5a admin admin] PATH_INFO: `/v3/users/4fc53f77d49d404b999c8721cfe4e184` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:47.878277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992eb488-c00c-4e8a-8fe6-6ec22293da5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc53f77d49d404b999c8721cfe4e184)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:47.880328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992eb488-c00c-4e8a-8fe6-6ec22293da5a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:47.981424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-992eb488-c00c-4e8a-8fe6-6ec22293da5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc53f77d49d404b999c8721cfe4e184'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:47.982785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-992eb488-c00c-4e8a-8fe6-6ec22293da5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc53f77d49d404b999c8721cfe4e184'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:48.007086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-992eb488-c00c-4e8a-8fe6-6ec22293da5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc53f77d49d404b999c8721cfe4e184'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:48.030503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-992eb488-c00c-4e8a-8fe6-6ec22293da5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc53f77d49d404b999c8721cfe4e184'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:48.047334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-992eb488-c00c-4e8a-8fe6-6ec22293da5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc53f77d49d404b999c8721cfe4e184'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:48.061962 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3353/6690] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:13:47 2022] DELETE /identity/v3/users/4fc53f77d49d404b999c8721cfe4e184 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:13:48.066363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea7e13-4832-4e04-9d39-7200152eb1bd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:48.066940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea7e13-4832-4e04-9d39-7200152eb1bd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:48.067549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea7e13-4832-4e04-9d39-7200152eb1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:48.107097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-92ea7e13-4832-4e04-9d39-7200152eb1bd None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:48.109148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-92ea7e13-4832-4e04-9d39-7200152eb1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:48.207114 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:48.286919 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3338/6691] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:48.314619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992eb488-c00c-4e8a-8fe6-6ec22293da5a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:48.316263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-992eb488-c00c-4e8a-8fe6-6ec22293da5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:48.451098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992eb488-c00c-4e8a-8fe6-6ec22293da5a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:48.464123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea7e13-4832-4e04-9d39-7200152eb1bd None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:48.465875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f587b5d-1f4c-4723-ab54-e85520a349ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:48.466886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f587b5d-1f4c-4723-ab54-e85520a349ab service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:48.466886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f587b5d-1f4c-4723-ab54-e85520a349ab service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:48.467046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f587b5d-1f4c-4723-ab54-e85520a349ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:48.468242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-92ea7e13-4832-4e04-9d39-7200152eb1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:48.486961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f587b5d-1f4c-4723-ab54-e85520a349ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:48.488580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f587b5d-1f4c-4723-ab54-e85520a349ab service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:48.502356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea7e13-4832-4e04-9d39-7200152eb1bd None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:48.505576 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3354/6692] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:13:48.515801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b465d0-d07f-4d92-9e9d-39eb658c1f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:48.516511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b465d0-d07f-4d92-9e9d-39eb658c1f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:48.517053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b465d0-d07f-4d92-9e9d-39eb658c1f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:48.518013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b465d0-d07f-4d92-9e9d-39eb658c1f66 admin admin] PATH_INFO: `/v3/projects/2e75f42eae0d445296fd17382e3476e1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:48.520487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b465d0-d07f-4d92-9e9d-39eb658c1f66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e75f42eae0d445296fd17382e3476e1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:48.522535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b465d0-d07f-4d92-9e9d-39eb658c1f66 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:48.667887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-70b465d0-d07f-4d92-9e9d-39eb658c1f66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e75f42eae0d445296fd17382e3476e1', 'request_id': 'req-70b465d0-d07f-4d92-9e9d-39eb658c1f66'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:48.686023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-70b465d0-d07f-4d92-9e9d-39eb658c1f66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e75f42eae0d445296fd17382e3476e1', 'request_id': 'req-70b465d0-d07f-4d92-9e9d-39eb658c1f66'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:48.696200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-70b465d0-d07f-4d92-9e9d-39eb658c1f66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e75f42eae0d445296fd17382e3476e1', 'request_id': 'req-70b465d0-d07f-4d92-9e9d-39eb658c1f66'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:48.713028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-70b465d0-d07f-4d92-9e9d-39eb658c1f66 admin admin] The token cache is being invalidate because project 2e75f42eae0d445296fd17382e3476e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:13:48.713635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-70b465d0-d07f-4d92-9e9d-39eb658c1f66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:48.714766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-70b465d0-d07f-4d92-9e9d-39eb658c1f66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:48.718117 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3339/6693] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:13:48 2022] DELETE /identity/v3/projects/2e75f42eae0d445296fd17382e3476e1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:13:48.723980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a90908-84b4-4161-9c88-b5f94086da17 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:48.724266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a90908-84b4-4161-9c88-b5f94086da17 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:48.724817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a90908-84b4-4161-9c88-b5f94086da17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:48.750201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-34a90908-84b4-4161-9c88-b5f94086da17 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:48.751657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-34a90908-84b4-4161-9c88-b5f94086da17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:48.894049 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3355/6694] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:48.901401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d26b5-fd67-4c31-9359-e0b0dd8febd6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:48.901689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d26b5-fd67-4c31-9359-e0b0dd8febd6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:48.901965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d26b5-fd67-4c31-9359-e0b0dd8febd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:48.946477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b08d26b5-fd67-4c31-9359-e0b0dd8febd6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:48.951244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b08d26b5-fd67-4c31-9359-e0b0dd8febd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:48.972906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a90908-84b4-4161-9c88-b5f94086da17 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:48.973407 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3340/6695] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:48.989502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a90908-84b4-4161-9c88-b5f94086da17 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:49.002392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490484a4-282e-412d-93df-58076ea0f48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:49.003229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490484a4-282e-412d-93df-58076ea0f48e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:49.003608 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490484a4-282e-412d-93df-58076ea0f48e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:49.003890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490484a4-282e-412d-93df-58076ea0f48e admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:49.004563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490484a4-282e-412d-93df-58076ea0f48e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:13:49.004905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490484a4-282e-412d-93df-58076ea0f48e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:49.007113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490484a4-282e-412d-93df-58076ea0f48e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:49.011198 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:49.050321 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3356/6696] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:13:49.054641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d26b5-fd67-4c31-9359-e0b0dd8febd6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:49.064630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d26b5-fd67-4c31-9359-e0b0dd8febd6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:49.093004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff15eb-059e-4b14-96e2-f6048dcc7345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:49.093991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff15eb-059e-4b14-96e2-f6048dcc7345 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:49.093991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff15eb-059e-4b14-96e2-f6048dcc7345 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:49.094193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff15eb-059e-4b14-96e2-f6048dcc7345 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:49.094728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff15eb-059e-4b14-96e2-f6048dcc7345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:49.097586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff15eb-059e-4b14-96e2-f6048dcc7345 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:49.199340 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3341/6697] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:13:49 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:49.210280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490484a4-282e-412d-93df-58076ea0f48e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:49.244679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490484a4-282e-412d-93df-58076ea0f48e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:49.446772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a0413-78aa-44c2-97a6-b5bb46402279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:49.447531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a0413-78aa-44c2-97a6-b5bb46402279 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:49.447909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a0413-78aa-44c2-97a6-b5bb46402279 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:49.448306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a0413-78aa-44c2-97a6-b5bb46402279 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:49.449224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a0413-78aa-44c2-97a6-b5bb46402279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:49.452975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a0413-78aa-44c2-97a6-b5bb46402279 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:49.503328 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3357/6698] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:13:49 2022] POST /identity/v3/users => generated 289 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:49.504858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff15eb-059e-4b14-96e2-f6048dcc7345 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:49.535867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff15eb-059e-4b14-96e2-f6048dcc7345 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:49.565942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a0413-78aa-44c2-97a6-b5bb46402279 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:49.567816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fc2a0413-78aa-44c2-97a6-b5bb46402279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:49.590337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b8028-9678-44d9-af3b-7f14ec225f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:49.590977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b8028-9678-44d9-af3b-7f14ec225f3a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:49.591253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b8028-9678-44d9-af3b-7f14ec225f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:49.591525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b8028-9678-44d9-af3b-7f14ec225f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:49.592187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b8028-9678-44d9-af3b-7f14ec225f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:49.607625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b8028-9678-44d9-af3b-7f14ec225f3a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:49.611913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a0413-78aa-44c2-97a6-b5bb46402279 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:49.643517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad438d-9295-4fef-bc81-160e614fe25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:49.647424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad438d-9295-4fef-bc81-160e614fe25f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:49.648472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad438d-9295-4fef-bc81-160e614fe25f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:49.648872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad438d-9295-4fef-bc81-160e614fe25f admin admin] PATH_INFO: `/v3/projects/40120549886f420f8ece964a0aca434d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:49.653466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad438d-9295-4fef-bc81-160e614fe25f admin admin] RBAC: Authorizing `identity:delete_project(project_id=40120549886f420f8ece964a0aca434d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:49.658929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad438d-9295-4fef-bc81-160e614fe25f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:49.665164 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3342/6699] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:49.669675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b8028-9678-44d9-af3b-7f14ec225f3a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:49.696996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b8028-9678-44d9-af3b-7f14ec225f3a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:49.708483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb537d14-3d96-4d1e-8231-37e364d9e3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:49.709590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb537d14-3d96-4d1e-8231-37e364d9e3be admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:49.710284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb537d14-3d96-4d1e-8231-37e364d9e3be admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:49.710933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb537d14-3d96-4d1e-8231-37e364d9e3be admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:49.711855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb537d14-3d96-4d1e-8231-37e364d9e3be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:49.713777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb537d14-3d96-4d1e-8231-37e364d9e3be admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:49.733285 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3343/6700] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:49.735022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb537d14-3d96-4d1e-8231-37e364d9e3be admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:49.749540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb537d14-3d96-4d1e-8231-37e364d9e3be admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:49.757785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1fad438d-9295-4fef-bc81-160e614fe25f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40120549886f420f8ece964a0aca434d', 'request_id': 'req-1fad438d-9295-4fef-bc81-160e614fe25f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:49.767347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1fad438d-9295-4fef-bc81-160e614fe25f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40120549886f420f8ece964a0aca434d', 'request_id': 'req-1fad438d-9295-4fef-bc81-160e614fe25f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:49.774501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1fad438d-9295-4fef-bc81-160e614fe25f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40120549886f420f8ece964a0aca434d', 'request_id': 'req-1fad438d-9295-4fef-bc81-160e614fe25f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:49.791259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1fad438d-9295-4fef-bc81-160e614fe25f admin admin] The token cache is being invalidate because project 40120549886f420f8ece964a0aca434d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:13:49.792122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1fad438d-9295-4fef-bc81-160e614fe25f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:49.792566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1fad438d-9295-4fef-bc81-160e614fe25f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:49.794570 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3358/6701] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:13:49 2022] DELETE /identity/v3/projects/40120549886f420f8ece964a0aca434d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:49.802223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f80f64-d4f4-40fe-821a-64eeb37ee446 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:49.802589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f80f64-d4f4-40fe-821a-64eeb37ee446 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:49.802933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f80f64-d4f4-40fe-821a-64eeb37ee446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:49.827022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-46f80f64-d4f4-40fe-821a-64eeb37ee446 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:49.828402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-46f80f64-d4f4-40fe-821a-64eeb37ee446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:49.830628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81887594-0590-4fe8-bea8-d157ec2711ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:49.831369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81887594-0590-4fe8-bea8-d157ec2711ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:49.831719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81887594-0590-4fe8-bea8-d157ec2711ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:49.832140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81887594-0590-4fe8-bea8-d157ec2711ec admin admin] PATH_INFO: `/v3/projects/e72aa6cde05544869d43a3f19be20353/users/9421035986e44322ac70172fa08f72b1/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:49.847739 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3359/6702] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:49.849409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc41586-fc16-424c-8918-fd03ecb0268a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:49.849692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc41586-fc16-424c-8918-fd03ecb0268a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:49.849960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc41586-fc16-424c-8918-fd03ecb0268a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:49.854520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81887594-0590-4fe8-bea8-d157ec2711ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=e72aa6cde05544869d43a3f19be20353, user_id=9421035986e44322ac70172fa08f72b1, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:49.857467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81887594-0590-4fe8-bea8-d157ec2711ec admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:49.863512 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:49.871789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ecc41586-fc16-424c-8918-fd03ecb0268a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:49.873119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ecc41586-fc16-424c-8918-fd03ecb0268a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:49.882432 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3344/6703] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:13:49 2022] PUT /identity/v3/projects/e72aa6cde05544869d43a3f19be20353/users/9421035986e44322ac70172fa08f72b1/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:13:49.888559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176748ec-049d-4568-b2d6-7b1cadd242ec None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:49.889081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176748ec-049d-4568-b2d6-7b1cadd242ec None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:49.889420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176748ec-049d-4568-b2d6-7b1cadd242ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:49.935486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-176748ec-049d-4568-b2d6-7b1cadd242ec None None] MFA Rules not processed for user `9421035986e44322ac70172fa08f72b1`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:49.936844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-176748ec-049d-4568-b2d6-7b1cadd242ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:49.962979 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3360/6704] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:49.967188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc41586-fc16-424c-8918-fd03ecb0268a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:49.972415 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:49.986925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc41586-fc16-424c-8918-fd03ecb0268a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:49.997234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125914b-2527-4c63-bfe1-5337e532c05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:49.998611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125914b-2527-4c63-bfe1-5337e532c05c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:49.999027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125914b-2527-4c63-bfe1-5337e532c05c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:49.999307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125914b-2527-4c63-bfe1-5337e532c05c admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:49.999957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6125914b-2527-4c63-bfe1-5337e532c05c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:13:50.000259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6125914b-2527-4c63-bfe1-5337e532c05c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:50.001940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6125914b-2527-4c63-bfe1-5337e532c05c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:50.017856 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3361/6705] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:13:50.022317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125914b-2527-4c63-bfe1-5337e532c05c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:50.034608 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3345/6706] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:50.037122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125914b-2527-4c63-bfe1-5337e532c05c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:50.038722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176748ec-049d-4568-b2d6-7b1cadd242ec None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:50.040059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-176748ec-049d-4568-b2d6-7b1cadd242ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:50.044219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917e377-4cf4-4974-8a47-d3171aa3e4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:50.045055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917e377-4cf4-4974-8a47-d3171aa3e4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:50.045646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917e377-4cf4-4974-8a47-d3171aa3e4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:50.046069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917e377-4cf4-4974-8a47-d3171aa3e4c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:50.046845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917e377-4cf4-4974-8a47-d3171aa3e4c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:50.049525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917e377-4cf4-4974-8a47-d3171aa3e4c8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:50.054213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176748ec-049d-4568-b2d6-7b1cadd242ec None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:50.060180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1791c0-77d6-46f6-9006-23de38ac751f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:50.060927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1791c0-77d6-46f6-9006-23de38ac751f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:50.061275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1791c0-77d6-46f6-9006-23de38ac751f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:50.061613 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1791c0-77d6-46f6-9006-23de38ac751f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:50.062364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1791c0-77d6-46f6-9006-23de38ac751f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:50.065630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1791c0-77d6-46f6-9006-23de38ac751f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:50.110265 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3346/6707] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:13:50 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:13:50.110433 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3362/6708] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:13:50 2022] POST /identity/v3/projects => generated 367 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:13:50.110590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1791c0-77d6-46f6-9006-23de38ac751f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:50.111870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917e377-4cf4-4974-8a47-d3171aa3e4c8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:50.229771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917e377-4cf4-4974-8a47-d3171aa3e4c8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:50.274440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1791c0-77d6-46f6-9006-23de38ac751f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:50.280342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dd7e6-5cc1-4946-b73e-471831205b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:50.281068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dd7e6-5cc1-4946-b73e-471831205b60 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:50.281345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dd7e6-5cc1-4946-b73e-471831205b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:50.281617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dd7e6-5cc1-4946-b73e-471831205b60 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:50.282257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917dd7e6-5cc1-4946-b73e-471831205b60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:50.284641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917dd7e6-5cc1-4946-b73e-471831205b60 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:50.315425 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3347/6709] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:13:50 2022] POST /identity/v3/users => generated 284 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:50.319707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dd7e6-5cc1-4946-b73e-471831205b60 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:50.332977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dd7e6-5cc1-4946-b73e-471831205b60 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:50.338624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c637c84-aba0-4b6a-a286-da4cc147570a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:50.339381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c637c84-aba0-4b6a-a286-da4cc147570a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:50.339781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c637c84-aba0-4b6a-a286-da4cc147570a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:50.340562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c637c84-aba0-4b6a-a286-da4cc147570a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:50.341352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c637c84-aba0-4b6a-a286-da4cc147570a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:50.343137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c637c84-aba0-4b6a-a286-da4cc147570a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:50.357872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30915e-c5e4-4817-9797-461e54403ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:50.358103 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3348/6710] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:50.358546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30915e-c5e4-4817-9797-461e54403ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:50.358831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30915e-c5e4-4817-9797-461e54403ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:50.359098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30915e-c5e4-4817-9797-461e54403ac6 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:50.359723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30915e-c5e4-4817-9797-461e54403ac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:50.361904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30915e-c5e4-4817-9797-461e54403ac6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:50.362427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c637c84-aba0-4b6a-a286-da4cc147570a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:50.375337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c637c84-aba0-4b6a-a286-da4cc147570a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:50.382612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b1b65-6597-4a92-ab21-c9cf89098ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:50.383541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b1b65-6597-4a92-ab21-c9cf89098ceb admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:50.384005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b1b65-6597-4a92-ab21-c9cf89098ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:50.384685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b1b65-6597-4a92-ab21-c9cf89098ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:50.385719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b1b65-6597-4a92-ab21-c9cf89098ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:50.388073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b1b65-6597-4a92-ab21-c9cf89098ceb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:50.404001 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3363/6712] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:13:50 2022] POST /identity/v3/users => generated 294 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:50.406478 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3349/6712] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:50.407597 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30915e-c5e4-4817-9797-461e54403ac6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:50.408861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b1b65-6597-4a92-ab21-c9cf89098ceb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:50.420204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b1b65-6597-4a92-ab21-c9cf89098ceb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:50.425771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb729493-f5e3-4a58-93e3-73e78bfff738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:50.426442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb729493-f5e3-4a58-93e3-73e78bfff738 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:50.426795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb729493-f5e3-4a58-93e3-73e78bfff738 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:50.427068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb729493-f5e3-4a58-93e3-73e78bfff738 admin admin] PATH_INFO: `/v3/projects/a11842336bbb4cd08acdd2561d1121c0/users/14e5927d69ce4e64af8e60ffb1a18421/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:50.431523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30915e-c5e4-4817-9797-461e54403ac6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:50.439094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f96e1-be27-421e-b375-1b12470b008d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:50.439937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f96e1-be27-421e-b375-1b12470b008d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:50.440405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f96e1-be27-421e-b375-1b12470b008d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:50.440869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f96e1-be27-421e-b375-1b12470b008d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:50.441699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f96e1-be27-421e-b375-1b12470b008d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:50.443978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f96e1-be27-421e-b375-1b12470b008d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:50.451616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb729493-f5e3-4a58-93e3-73e78bfff738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a11842336bbb4cd08acdd2561d1121c0, user_id=14e5927d69ce4e64af8e60ffb1a18421, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:50.458310 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3364/6713] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:50.461742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb729493-f5e3-4a58-93e3-73e78bfff738 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:50.465052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f96e1-be27-421e-b375-1b12470b008d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:50.483809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f96e1-be27-421e-b375-1b12470b008d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:50.486548 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3350/6714] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:13:50 2022] PUT /identity/v3/projects/a11842336bbb4cd08acdd2561d1121c0/users/14e5927d69ce4e64af8e60ffb1a18421/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:50.498758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f7232-4d9b-4db8-9c67-180af6e9dfa3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:50.499043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f7232-4d9b-4db8-9c67-180af6e9dfa3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:50.499315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f7232-4d9b-4db8-9c67-180af6e9dfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:50.522135 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:50.553871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-499f7232-4d9b-4db8-9c67-180af6e9dfa3 None None] MFA Rules not processed for user `14e5927d69ce4e64af8e60ffb1a18421`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:50.555339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-499f7232-4d9b-4db8-9c67-180af6e9dfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:50.601979 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:50.625527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b82a55-abac-4a77-8d05-f955f2e7b2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:50.626458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b82a55-abac-4a77-8d05-f955f2e7b2b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:50.626974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b82a55-abac-4a77-8d05-f955f2e7b2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:50.627414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b82a55-abac-4a77-8d05-f955f2e7b2b8 admin admin] PATH_INFO: `/v3/projects/e150b62fa1874d1d8cc66ba53c511b27/users/bc3a50cb2d234444b2fe640f2b78baff/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:50.649366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b82a55-abac-4a77-8d05-f955f2e7b2b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e150b62fa1874d1d8cc66ba53c511b27, user_id=bc3a50cb2d234444b2fe640f2b78baff, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:50.652456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b82a55-abac-4a77-8d05-f955f2e7b2b8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:50.679155 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3365/6715] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:13:50 2022] PUT /identity/v3/projects/e150b62fa1874d1d8cc66ba53c511b27/users/bc3a50cb2d234444b2fe640f2b78baff/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:50.683281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b82a55-abac-4a77-8d05-f955f2e7b2b8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:50.727378 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3351/6716] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:50.731656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f7232-4d9b-4db8-9c67-180af6e9dfa3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:50.753788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f7232-4d9b-4db8-9c67-180af6e9dfa3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:50.764649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b82a55-abac-4a77-8d05-f955f2e7b2b8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:50.767668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fe883-f949-4ab2-bd89-5ea7e5feabdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:50.768627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fe883-f949-4ab2-bd89-5ea7e5feabdb admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:50.769126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fe883-f949-4ab2-bd89-5ea7e5feabdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:50.769515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fe883-f949-4ab2-bd89-5ea7e5feabdb admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:50.770595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845bdef-eeaf-4634-9501-9cb5663a6546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:50.771208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845bdef-eeaf-4634-9501-9cb5663a6546 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:50.771449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fe883-f949-4ab2-bd89-5ea7e5feabdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:50.771561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845bdef-eeaf-4634-9501-9cb5663a6546 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:50.771744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845bdef-eeaf-4634-9501-9cb5663a6546 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:50.772388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845bdef-eeaf-4634-9501-9cb5663a6546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:50.774693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845bdef-eeaf-4634-9501-9cb5663a6546 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:50.775079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fe883-f949-4ab2-bd89-5ea7e5feabdb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:50.791132 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3366/6717] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:50.794645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845bdef-eeaf-4634-9501-9cb5663a6546 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:50.812026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845bdef-eeaf-4634-9501-9cb5663a6546 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:50.827961 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3352/6718] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:13:50 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:13:50.833015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fe883-f949-4ab2-bd89-5ea7e5feabdb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:50.835469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635da6f-356e-4e9d-95c7-453ecef3a20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:50.836267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635da6f-356e-4e9d-95c7-453ecef3a20f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:50.836551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635da6f-356e-4e9d-95c7-453ecef3a20f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:50.836841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635da6f-356e-4e9d-95c7-453ecef3a20f admin admin] PATH_INFO: `/v3/projects/e150b62fa1874d1d8cc66ba53c511b27/users/bc3a50cb2d234444b2fe640f2b78baff/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:50.843176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635da6f-356e-4e9d-95c7-453ecef3a20f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e150b62fa1874d1d8cc66ba53c511b27, user_id=bc3a50cb2d234444b2fe640f2b78baff, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:50.846641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635da6f-356e-4e9d-95c7-453ecef3a20f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:50.870827 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3367/6719] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:13:50 2022] PUT /identity/v3/projects/e150b62fa1874d1d8cc66ba53c511b27/users/bc3a50cb2d234444b2fe640f2b78baff/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:50.883340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc82a62-8d67-4777-be06-8c85ad134ec9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:50.883585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc82a62-8d67-4777-be06-8c85ad134ec9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:50.883686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc82a62-8d67-4777-be06-8c85ad134ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:50.926546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fe883-f949-4ab2-bd89-5ea7e5feabdb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:50.938284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9bc82a62-8d67-4777-be06-8c85ad134ec9 None None] MFA Rules not processed for user `bc3a50cb2d234444b2fe640f2b78baff`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:50.940056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9bc82a62-8d67-4777-be06-8c85ad134ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:51.070456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04667e5-3961-43df-8e2a-edd7d66e6376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:51.071493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04667e5-3961-43df-8e2a-edd7d66e6376 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:51.071948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04667e5-3961-43df-8e2a-edd7d66e6376 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:51.072372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04667e5-3961-43df-8e2a-edd7d66e6376 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:51.073228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04667e5-3961-43df-8e2a-edd7d66e6376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:51.075655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04667e5-3961-43df-8e2a-edd7d66e6376 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:51.119434 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3353/6720] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:13:50 2022] POST /identity/v3/users => generated 291 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:13:51.128749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04667e5-3961-43df-8e2a-edd7d66e6376 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:51.156726 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3368/6721] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:51.167963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc82a62-8d67-4777-be06-8c85ad134ec9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:51.169260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04667e5-3961-43df-8e2a-edd7d66e6376 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:51.170222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9bc82a62-8d67-4777-be06-8c85ad134ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:51.185538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd48c2-256a-4c66-9cf0-435895cd0db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:51.186561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd48c2-256a-4c66-9cf0-435895cd0db3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:51.186561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd48c2-256a-4c66-9cf0-435895cd0db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:51.186796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd48c2-256a-4c66-9cf0-435895cd0db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:51.187340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd48c2-256a-4c66-9cf0-435895cd0db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:51.189297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd48c2-256a-4c66-9cf0-435895cd0db3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:51.201017 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:51.219949 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3354/6722] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:51.225572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd48c2-256a-4c66-9cf0-435895cd0db3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:51.264441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd48c2-256a-4c66-9cf0-435895cd0db3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:51.282267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d51e1e-15fd-4c71-a6d7-32be56b7e297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:51.283066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d51e1e-15fd-4c71-a6d7-32be56b7e297 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:51.283383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d51e1e-15fd-4c71-a6d7-32be56b7e297 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:51.283586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d51e1e-15fd-4c71-a6d7-32be56b7e297 admin admin] PATH_INFO: `/v3/projects/f63d9e60c52d477bbe097f51d6cd7ecf/users/fa62cc33415147bf921785d48a9e295d/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:51.344203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d51e1e-15fd-4c71-a6d7-32be56b7e297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f63d9e60c52d477bbe097f51d6cd7ecf, user_id=fa62cc33415147bf921785d48a9e295d, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:51.347697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d51e1e-15fd-4c71-a6d7-32be56b7e297 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:51.374665 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:51.391670 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3355/6723] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:13:51 2022] PUT /identity/v3/projects/f63d9e60c52d477bbe097f51d6cd7ecf/users/fa62cc33415147bf921785d48a9e295d/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:51.393714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d51e1e-15fd-4c71-a6d7-32be56b7e297 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:51.409854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc82a62-8d67-4777-be06-8c85ad134ec9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:51.533609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d51e1e-15fd-4c71-a6d7-32be56b7e297 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:51.543507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455ac5a-fdd0-4ae4-8361-5cc80ae058e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:51.544143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455ac5a-fdd0-4ae4-8361-5cc80ae058e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:51.544423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455ac5a-fdd0-4ae4-8361-5cc80ae058e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:51.544723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455ac5a-fdd0-4ae4-8361-5cc80ae058e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:51.545569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455ac5a-fdd0-4ae4-8361-5cc80ae058e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:51.547176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455ac5a-fdd0-4ae4-8361-5cc80ae058e9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:51.548901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17d640-91a3-46dc-bfd3-016f0d8ef6c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:51.549777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17d640-91a3-46dc-bfd3-016f0d8ef6c4 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:51.549879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17d640-91a3-46dc-bfd3-016f0d8ef6c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:51.550096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17d640-91a3-46dc-bfd3-016f0d8ef6c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:51.575026 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3356/6724] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:51.579813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455ac5a-fdd0-4ae4-8361-5cc80ae058e9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:51.605803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455ac5a-fdd0-4ae4-8361-5cc80ae058e9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:51.624896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055cb2aa-8029-481f-9f4b-5143eaafd8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:51.625585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cb2aa-8029-481f-9f4b-5143eaafd8a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:51.625862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cb2aa-8029-481f-9f4b-5143eaafd8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:51.630005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cb2aa-8029-481f-9f4b-5143eaafd8a8 admin admin] PATH_INFO: `/v3/projects/f63d9e60c52d477bbe097f51d6cd7ecf/users/fa62cc33415147bf921785d48a9e295d/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:51.632873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055cb2aa-8029-481f-9f4b-5143eaafd8a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f63d9e60c52d477bbe097f51d6cd7ecf, user_id=fa62cc33415147bf921785d48a9e295d, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:51.636677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055cb2aa-8029-481f-9f4b-5143eaafd8a8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:51.660361 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3357/6725] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:13:51 2022] PUT /identity/v3/projects/f63d9e60c52d477bbe097f51d6cd7ecf/users/fa62cc33415147bf921785d48a9e295d/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:13:51.670927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f35ba3-396c-4a84-91f2-746011b5494f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:51.671215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f35ba3-396c-4a84-91f2-746011b5494f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:51.671612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f35ba3-396c-4a84-91f2-746011b5494f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:51.718392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17d640-91a3-46dc-bfd3-016f0d8ef6c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:51.719855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17d640-91a3-46dc-bfd3-016f0d8ef6c4 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:51.724753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-87f35ba3-396c-4a84-91f2-746011b5494f None None] MFA Rules not processed for user `fa62cc33415147bf921785d48a9e295d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:51.727261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-87f35ba3-396c-4a84-91f2-746011b5494f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:51.745376 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3369/6726] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:13:51.911217 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3358/6727] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:51.914317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17d640-91a3-46dc-bfd3-016f0d8ef6c4 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:52.102576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17d640-91a3-46dc-bfd3-016f0d8ef6c4 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:52.151584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10c420-a1af-4421-8b31-a598844a223b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:52.152313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10c420-a1af-4421-8b31-a598844a223b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:52.152677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10c420-a1af-4421-8b31-a598844a223b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:52.153383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10c420-a1af-4421-8b31-a598844a223b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:52.154125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10c420-a1af-4421-8b31-a598844a223b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:52.155745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10c420-a1af-4421-8b31-a598844a223b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:52.202932 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3370/6728] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:13:51 2022] POST /identity/v3/domains => generated 276 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:52.205218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f35ba3-396c-4a84-91f2-746011b5494f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:52.222585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f35ba3-396c-4a84-91f2-746011b5494f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:52.294017 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:52.322264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6dd1b1-cd3c-47e9-b505-b3f01ba600b1 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:52.322911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dd1b1-cd3c-47e9-b505-b3f01ba600b1 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:52.323197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dd1b1-cd3c-47e9-b505-b3f01ba600b1 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:52.323474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dd1b1-cd3c-47e9-b505-b3f01ba600b1 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:52.324135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6dd1b1-cd3c-47e9-b505-b3f01ba600b1 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:52.347105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6dd1b1-cd3c-47e9-b505-b3f01ba600b1 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:52.426492 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3359/6729] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Sep 30 10:13:52 2022] POST /identity/v3/groups => generated 279 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:52.434001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10c420-a1af-4421-8b31-a598844a223b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:52.457106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10c420-a1af-4421-8b31-a598844a223b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:52.473843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e42878-4943-40d0-8d13-83f852f9dfc3 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:52.474502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e42878-4943-40d0-8d13-83f852f9dfc3 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:52.474785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e42878-4943-40d0-8d13-83f852f9dfc3 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:52.475064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e42878-4943-40d0-8d13-83f852f9dfc3 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups/f779f7ec5c2340fb9381dd9a8ed38d21` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:52.489114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e42878-4943-40d0-8d13-83f852f9dfc3 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:update_group(group_id=f779f7ec5c2340fb9381dd9a8ed38d21)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:52.490644 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-e6e42878-4943-40d0-8d13-83f852f9dfc3 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:13:52.490644 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:13:52.490644 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:13:52.491710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e42878-4943-40d0-8d13-83f852f9dfc3 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:52.528429 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3371/6730] 10.222.0.16 () {60 vars in 1247 bytes} [Fri Sep 30 10:13:52 2022] PATCH /identity/v3/groups/f779f7ec5c2340fb9381dd9a8ed38d21 => generated 293 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:13:52.532408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6dd1b1-cd3c-47e9-b505-b3f01ba600b1 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:52.549882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6dd1b1-cd3c-47e9-b505-b3f01ba600b1 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:52.555554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d63fe3-262c-4eff-8028-758acca3ddd7 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:52.556100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d63fe3-262c-4eff-8028-758acca3ddd7 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:52.556389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d63fe3-262c-4eff-8028-758acca3ddd7 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:52.556945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d63fe3-262c-4eff-8028-758acca3ddd7 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups/f779f7ec5c2340fb9381dd9a8ed38d21` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:52.563666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d63fe3-262c-4eff-8028-758acca3ddd7 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:get_group(group_id=f779f7ec5c2340fb9381dd9a8ed38d21)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:52.565581 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-24d63fe3-262c-4eff-8028-758acca3ddd7 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:13:52.565581 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:13:52.565581 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:13:52.567458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d63fe3-262c-4eff-8028-758acca3ddd7 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:52.572658 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3360/6731] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:13:52 2022] GET /identity/v3/groups/f779f7ec5c2340fb9381dd9a8ed38d21 => generated 293 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:13:52.574558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e42878-4943-40d0-8d13-83f852f9dfc3 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:52.591151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e42878-4943-40d0-8d13-83f852f9dfc3 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:52.599668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ff874-4ff9-4536-b6ee-17c7133ad088 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:52.601557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ff874-4ff9-4536-b6ee-17c7133ad088 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:52.601945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ff874-4ff9-4536-b6ee-17c7133ad088 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:52.602720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ff874-4ff9-4536-b6ee-17c7133ad088 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups/f779f7ec5c2340fb9381dd9a8ed38d21` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:52.604644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ff874-4ff9-4536-b6ee-17c7133ad088 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:update_group(group_id=f779f7ec5c2340fb9381dd9a8ed38d21)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:52.607720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ff874-4ff9-4536-b6ee-17c7133ad088 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:52.654325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d63fe3-262c-4eff-8028-758acca3ddd7 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:52.660807 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3372/6732] 10.222.0.16 () {60 vars in 1246 bytes} [Fri Sep 30 10:13:52 2022] PATCH /identity/v3/groups/f779f7ec5c2340fb9381dd9a8ed38d21 => generated 307 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:13:52.679325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d63fe3-262c-4eff-8028-758acca3ddd7 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:52.698122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e9315-719b-4d29-8c8f-6f37282a5b05 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:52.699973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e9315-719b-4d29-8c8f-6f37282a5b05 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:52.700852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e9315-719b-4d29-8c8f-6f37282a5b05 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:52.701690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e9315-719b-4d29-8c8f-6f37282a5b05 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups/f779f7ec5c2340fb9381dd9a8ed38d21` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:52.729640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e9315-719b-4d29-8c8f-6f37282a5b05 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:delete_group(group_id=f779f7ec5c2340fb9381dd9a8ed38d21)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:52.736835 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-687e9315-719b-4d29-8c8f-6f37282a5b05 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:13:52.736835 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:13:52.736835 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:13:52.738100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e9315-719b-4d29-8c8f-6f37282a5b05 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:52.849685 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3361/6733] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Sep 30 10:13:52 2022] DELETE /identity/v3/groups/f779f7ec5c2340fb9381dd9a8ed38d21 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:52.855643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ff874-4ff9-4536-b6ee-17c7133ad088 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:52.874101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ff874-4ff9-4536-b6ee-17c7133ad088 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:52.893882 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:UPDATE=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:53.030968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecbbb3-42da-431b-96b6-53a8deb5032d tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:53.031714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecbbb3-42da-431b-96b6-53a8deb5032d tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:53.032141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecbbb3-42da-431b-96b6-53a8deb5032d tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:53.032374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecbbb3-42da-431b-96b6-53a8deb5032d tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:53.034616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecbbb3-42da-431b-96b6-53a8deb5032d tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:53.035617 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-28ecbbb3-42da-431b-96b6-53a8deb5032d tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:13:53.035617 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:13:53.035617 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:13:53.037203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecbbb3-42da-431b-96b6-53a8deb5032d tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:53.059081 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3373/6734] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Sep 30 10:13:52 2022] POST /identity/v3/groups => generated 325 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:53.063224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e9315-719b-4d29-8c8f-6f37282a5b05 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:53.092908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e9315-719b-4d29-8c8f-6f37282a5b05 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:53.105446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86e986-b0e8-4e4d-bd3c-1dd3e7c927da tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:53.106088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86e986-b0e8-4e4d-bd3c-1dd3e7c927da tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:53.106369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86e986-b0e8-4e4d-bd3c-1dd3e7c927da tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:53.106645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86e986-b0e8-4e4d-bd3c-1dd3e7c927da tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:53.107288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86e986-b0e8-4e4d-bd3c-1dd3e7c927da tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:53.109175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86e986-b0e8-4e4d-bd3c-1dd3e7c927da tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:53.149067 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3362/6735] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:13:53 2022] POST /identity/v3/users => generated 323 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:13:53.154974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecbbb3-42da-431b-96b6-53a8deb5032d tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:53.189906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecbbb3-42da-431b-96b6-53a8deb5032d tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:53.196759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64faa1-1a7e-4229-9450-1286483b1a6d tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:53.197886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64faa1-1a7e-4229-9450-1286483b1a6d tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:53.198179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64faa1-1a7e-4229-9450-1286483b1a6d tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:53.199861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64faa1-1a7e-4229-9450-1286483b1a6d tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups/0d07b348aafb4ecf831584ad7b568969/users/9377eb42cf6849759fc1f61b10c5e857` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:53.230262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64faa1-1a7e-4229-9450-1286483b1a6d tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=0d07b348aafb4ecf831584ad7b568969, user_id=9377eb42cf6849759fc1f61b10c5e857)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:53.232503 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-da64faa1-1a7e-4229-9450-1286483b1a6d tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:13:53.232503 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:13:53.232503 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:13:53.234062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64faa1-1a7e-4229-9450-1286483b1a6d tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:53.280928 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3374/6736] 10.222.0.16 () {60 vars in 1360 bytes} [Fri Sep 30 10:13:53 2022] PUT /identity/v3/groups/0d07b348aafb4ecf831584ad7b568969/users/9377eb42cf6849759fc1f61b10c5e857 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:13:53.286503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86e986-b0e8-4e4d-bd3c-1dd3e7c927da tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:53.327584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86e986-b0e8-4e4d-bd3c-1dd3e7c927da tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:53.527973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ebaf4-3c51-4b09-9131-243849b9e167 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:53.528986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ebaf4-3c51-4b09-9131-243849b9e167 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:53.529514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ebaf4-3c51-4b09-9131-243849b9e167 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:53.530044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ebaf4-3c51-4b09-9131-243849b9e167 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:53.531153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ebaf4-3c51-4b09-9131-243849b9e167 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:53.543733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ebaf4-3c51-4b09-9131-243849b9e167 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:53.685651 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3363/6737] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:13:53 2022] POST /identity/v3/users => generated 323 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:53.686884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64faa1-1a7e-4229-9450-1286483b1a6d tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:53.702065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64faa1-1a7e-4229-9450-1286483b1a6d tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:53.737461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc2fb2-3f3e-4476-be4d-efe35e51d1c1 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:53.738133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc2fb2-3f3e-4476-be4d-efe35e51d1c1 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:53.738412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc2fb2-3f3e-4476-be4d-efe35e51d1c1 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:53.738682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc2fb2-3f3e-4476-be4d-efe35e51d1c1 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups/0d07b348aafb4ecf831584ad7b568969/users/2093041576b04ba995af091872b508db` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:53.792591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc2fb2-3f3e-4476-be4d-efe35e51d1c1 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=0d07b348aafb4ecf831584ad7b568969, user_id=2093041576b04ba995af091872b508db)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:53.794578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc2fb2-3f3e-4476-be4d-efe35e51d1c1 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:53.844487 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3375/6738] 10.222.0.16 () {60 vars in 1360 bytes} [Fri Sep 30 10:13:53 2022] PUT /identity/v3/groups/0d07b348aafb4ecf831584ad7b568969/users/2093041576b04ba995af091872b508db => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:53.852244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ebaf4-3c51-4b09-9131-243849b9e167 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:53.901027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ebaf4-3c51-4b09-9131-243849b9e167 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:54.029918 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:INSERT=7,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:54.069745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad52bb-2988-4a6a-aefa-cfedba1d0fad tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:54.070556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad52bb-2988-4a6a-aefa-cfedba1d0fad tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:54.070917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad52bb-2988-4a6a-aefa-cfedba1d0fad tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:54.071267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad52bb-2988-4a6a-aefa-cfedba1d0fad tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:54.071993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad52bb-2988-4a6a-aefa-cfedba1d0fad tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:54.074568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad52bb-2988-4a6a-aefa-cfedba1d0fad tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:54.125564 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3364/6739] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:13:53 2022] POST /identity/v3/users => generated 323 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:54.129058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc2fb2-3f3e-4476-be4d-efe35e51d1c1 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:54.158000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc2fb2-3f3e-4476-be4d-efe35e51d1c1 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:54.165047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e6ea4-6b7e-426c-a9f6-6044b9330398 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:54.166088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e6ea4-6b7e-426c-a9f6-6044b9330398 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:54.166578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e6ea4-6b7e-426c-a9f6-6044b9330398 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:54.167084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e6ea4-6b7e-426c-a9f6-6044b9330398 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups/0d07b348aafb4ecf831584ad7b568969/users/efae92fd42b04739aa041a506d9ee9d4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:54.188920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e6ea4-6b7e-426c-a9f6-6044b9330398 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=0d07b348aafb4ecf831584ad7b568969, user_id=efae92fd42b04739aa041a506d9ee9d4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:54.191991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e6ea4-6b7e-426c-a9f6-6044b9330398 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:54.234080 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3376/6740] 10.222.0.16 () {60 vars in 1360 bytes} [Fri Sep 30 10:13:54 2022] PUT /identity/v3/groups/0d07b348aafb4ecf831584ad7b568969/users/efae92fd42b04739aa041a506d9ee9d4 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:54.240842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad52bb-2988-4a6a-aefa-cfedba1d0fad tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:54.257453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad52bb-2988-4a6a-aefa-cfedba1d0fad tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:54.451938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1a9fc-f07d-439b-b8be-bb05e6f154a9 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:54.452971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1a9fc-f07d-439b-b8be-bb05e6f154a9 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:54.453493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1a9fc-f07d-439b-b8be-bb05e6f154a9 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:54.453984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1a9fc-f07d-439b-b8be-bb05e6f154a9 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups/0d07b348aafb4ecf831584ad7b568969/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:54.458558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1a9fc-f07d-439b-b8be-bb05e6f154a9 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=0d07b348aafb4ecf831584ad7b568969)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:54.460131 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-c4d1a9fc-f07d-439b-b8be-bb05e6f154a9 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:13:54.460131 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:13:54.460131 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:13:54.462363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1a9fc-f07d-439b-b8be-bb05e6f154a9 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:54.521626 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3365/6741] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Sep 30 10:13:54 2022] GET /identity/v3/groups/0d07b348aafb4ecf831584ad7b568969/users => generated 1085 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:54.525668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e6ea4-6b7e-426c-a9f6-6044b9330398 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:54.574131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e6ea4-6b7e-426c-a9f6-6044b9330398 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:54.604750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d2437-001f-421a-b873-dd761fae490f tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:54.605587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d2437-001f-421a-b873-dd761fae490f tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:54.605877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d2437-001f-421a-b873-dd761fae490f tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:54.606150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d2437-001f-421a-b873-dd761fae490f tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups/0d07b348aafb4ecf831584ad7b568969/users/9377eb42cf6849759fc1f61b10c5e857` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:54.608888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d2437-001f-421a-b873-dd761fae490f tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=0d07b348aafb4ecf831584ad7b568969, user_id=9377eb42cf6849759fc1f61b10c5e857)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:54.609921 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-dc6d2437-001f-421a-b873-dd761fae490f tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:13:54.609921 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:13:54.609921 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:13:54.612089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d2437-001f-421a-b873-dd761fae490f tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:54.714451 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3377/6742] 10.222.0.16 () {58 vars in 1342 bytes} [Fri Sep 30 10:13:54 2022] HEAD /identity/v3/groups/0d07b348aafb4ecf831584ad7b568969/users/9377eb42cf6849759fc1f61b10c5e857 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:54.718681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1a9fc-f07d-439b-b8be-bb05e6f154a9 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:54.736951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1a9fc-f07d-439b-b8be-bb05e6f154a9 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:54.749271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd8e9f-a80f-4b71-8808-11affda31a1f tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:54.749889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd8e9f-a80f-4b71-8808-11affda31a1f tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:54.750202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd8e9f-a80f-4b71-8808-11affda31a1f tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:54.750621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd8e9f-a80f-4b71-8808-11affda31a1f tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups/0d07b348aafb4ecf831584ad7b568969/users/9377eb42cf6849759fc1f61b10c5e857` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:54.756403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd8e9f-a80f-4b71-8808-11affda31a1f tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=0d07b348aafb4ecf831584ad7b568969, user_id=9377eb42cf6849759fc1f61b10c5e857)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:54.757480 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-b7fd8e9f-a80f-4b71-8808-11affda31a1f tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:13:54.757480 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:13:54.757480 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:13:54.758688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd8e9f-a80f-4b71-8808-11affda31a1f tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:54.799145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b7fd8e9f-a80f-4b71-8808-11affda31a1f tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9377eb42cf6849759fc1f61b10c5e857'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:54.842719 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3366/6743] 10.222.0.16 () {58 vars in 1344 bytes} [Fri Sep 30 10:13:54 2022] DELETE /identity/v3/groups/0d07b348aafb4ecf831584ad7b568969/users/9377eb42cf6849759fc1f61b10c5e857 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:54.849569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d2437-001f-421a-b873-dd761fae490f tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:54.865896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d2437-001f-421a-b873-dd761fae490f tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:54.968469 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:55.026674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e74ac-ef6d-4c41-9ddb-88abe1c9c997 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:55.026674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e74ac-ef6d-4c41-9ddb-88abe1c9c997 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:55.026674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e74ac-ef6d-4c41-9ddb-88abe1c9c997 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:55.027330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e74ac-ef6d-4c41-9ddb-88abe1c9c997 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups/0d07b348aafb4ecf831584ad7b568969/users/2093041576b04ba995af091872b508db` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:55.027330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e74ac-ef6d-4c41-9ddb-88abe1c9c997 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=0d07b348aafb4ecf831584ad7b568969, user_id=2093041576b04ba995af091872b508db)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:55.027330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e74ac-ef6d-4c41-9ddb-88abe1c9c997 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:55.028575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dd4c6-34d0-4187-b21d-29f7524f96ba None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:55.028878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dd4c6-34d0-4187-b21d-29f7524f96ba None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:55.029152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dd4c6-34d0-4187-b21d-29f7524f96ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:55.050066 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3378/6744] 10.222.0.16 () {58 vars in 1342 bytes} [Fri Sep 30 10:13:54 2022] HEAD /identity/v3/groups/0d07b348aafb4ecf831584ad7b568969/users/2093041576b04ba995af091872b508db => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:55.051156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e74ac-ef6d-4c41-9ddb-88abe1c9c997 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:55.062583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e74ac-ef6d-4c41-9ddb-88abe1c9c997 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:55.066722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-709dd4c6-34d0-4187-b21d-29f7524f96ba None None] MFA Rules not processed for user `8c9df05ff1d2432e9f15777292f49197`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:55.068225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-709dd4c6-34d0-4187-b21d-29f7524f96ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:55.068655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ef954-ed8e-4bd8-861b-f937e5801fe5 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:55.069380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ef954-ed8e-4bd8-861b-f937e5801fe5 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:55.069765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ef954-ed8e-4bd8-861b-f937e5801fe5 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:55.070350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ef954-ed8e-4bd8-861b-f937e5801fe5 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups/0d07b348aafb4ecf831584ad7b568969/users/2093041576b04ba995af091872b508db` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:55.072094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ef954-ed8e-4bd8-861b-f937e5801fe5 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=0d07b348aafb4ecf831584ad7b568969, user_id=2093041576b04ba995af091872b508db)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:55.073236 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-2b8ef954-ed8e-4bd8-861b-f937e5801fe5 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:13:55.073236 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:13:55.073236 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:13:55.075192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ef954-ed8e-4bd8-861b-f937e5801fe5 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:55.088611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2b8ef954-ed8e-4bd8-861b-f937e5801fe5 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2093041576b04ba995af091872b508db'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:55.108792 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3379/6745] 10.222.0.16 () {58 vars in 1344 bytes} [Fri Sep 30 10:13:55 2022] DELETE /identity/v3/groups/0d07b348aafb4ecf831584ad7b568969/users/2093041576b04ba995af091872b508db => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:55.113791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ef954-ed8e-4bd8-861b-f937e5801fe5 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:55.166635 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3367/6746] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:13:55.171657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dd4c6-34d0-4187-b21d-29f7524f96ba None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:55.175258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-709dd4c6-34d0-4187-b21d-29f7524f96ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:55.211832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ef954-ed8e-4bd8-861b-f937e5801fe5 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:55.217915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e128b9-568e-4305-aae4-9c55bafb5571 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:55.218775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e128b9-568e-4305-aae4-9c55bafb5571 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:55.219099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e128b9-568e-4305-aae4-9c55bafb5571 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:55.219472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e128b9-568e-4305-aae4-9c55bafb5571 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups/0d07b348aafb4ecf831584ad7b568969/users/efae92fd42b04739aa041a506d9ee9d4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:55.222300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e128b9-568e-4305-aae4-9c55bafb5571 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=0d07b348aafb4ecf831584ad7b568969, user_id=efae92fd42b04739aa041a506d9ee9d4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:55.224822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e128b9-568e-4305-aae4-9c55bafb5571 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:55.239641 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:55.258276 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3380/6747] 10.222.0.16 () {58 vars in 1342 bytes} [Fri Sep 30 10:13:55 2022] HEAD /identity/v3/groups/0d07b348aafb4ecf831584ad7b568969/users/efae92fd42b04739aa041a506d9ee9d4 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:55.259368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e128b9-568e-4305-aae4-9c55bafb5571 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:55.274936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e128b9-568e-4305-aae4-9c55bafb5571 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:55.281943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be558ef-47c9-432e-b23b-82303971ba5b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:55.281943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be558ef-47c9-432e-b23b-82303971ba5b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:55.281943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be558ef-47c9-432e-b23b-82303971ba5b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:55.282264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be558ef-47c9-432e-b23b-82303971ba5b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups/0d07b348aafb4ecf831584ad7b568969/users/efae92fd42b04739aa041a506d9ee9d4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:55.284859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be558ef-47c9-432e-b23b-82303971ba5b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=0d07b348aafb4ecf831584ad7b568969, user_id=efae92fd42b04739aa041a506d9ee9d4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:55.286821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be558ef-47c9-432e-b23b-82303971ba5b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:55.297081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dd4c6-34d0-4187-b21d-29f7524f96ba None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:55.300952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7be558ef-47c9-432e-b23b-82303971ba5b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'efae92fd42b04739aa041a506d9ee9d4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:55.322217 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3381/6748] 10.222.0.16 () {58 vars in 1344 bytes} [Fri Sep 30 10:13:55 2022] DELETE /identity/v3/groups/0d07b348aafb4ecf831584ad7b568969/users/efae92fd42b04739aa041a506d9ee9d4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:13:55.327640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be558ef-47c9-432e-b23b-82303971ba5b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:55.394245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75211b29-bff6-4901-8a00-41522555f2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:55.394887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75211b29-bff6-4901-8a00-41522555f2b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:55.395183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75211b29-bff6-4901-8a00-41522555f2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:55.395439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75211b29-bff6-4901-8a00-41522555f2b2 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:55.396084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75211b29-bff6-4901-8a00-41522555f2b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:55.398813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75211b29-bff6-4901-8a00-41522555f2b2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:55.448698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be558ef-47c9-432e-b23b-82303971ba5b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:55.455211 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3368/6749] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:13:55 2022] POST /identity/v3/users => generated 288 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:55.458434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75211b29-bff6-4901-8a00-41522555f2b2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:55.468177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703ce15-a1d1-4a18-8db7-e9abb112439e tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:55.469523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703ce15-a1d1-4a18-8db7-e9abb112439e tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:55.470010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703ce15-a1d1-4a18-8db7-e9abb112439e tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:55.470656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703ce15-a1d1-4a18-8db7-e9abb112439e tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups/0d07b348aafb4ecf831584ad7b568969/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:55.472635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703ce15-a1d1-4a18-8db7-e9abb112439e tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=0d07b348aafb4ecf831584ad7b568969)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:55.473902 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-d703ce15-a1d1-4a18-8db7-e9abb112439e tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:13:55.473902 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:13:55.473902 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:13:55.475458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703ce15-a1d1-4a18-8db7-e9abb112439e tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:55.481890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75211b29-bff6-4901-8a00-41522555f2b2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:55.512902 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3382/6750] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Sep 30 10:13:55 2022] GET /identity/v3/groups/0d07b348aafb4ecf831584ad7b568969/users => generated 145 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:13:55.517489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703ce15-a1d1-4a18-8db7-e9abb112439e tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:55.528516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703ce15-a1d1-4a18-8db7-e9abb112439e tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:55.534127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0055e09-0e71-4bd3-be01-8f7b7f2756fd tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:55.534909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0055e09-0e71-4bd3-be01-8f7b7f2756fd tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:55.535261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0055e09-0e71-4bd3-be01-8f7b7f2756fd tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:55.535589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0055e09-0e71-4bd3-be01-8f7b7f2756fd tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/users/efae92fd42b04739aa041a506d9ee9d4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:55.536848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0055e09-0e71-4bd3-be01-8f7b7f2756fd tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:delete_user(user_id=efae92fd42b04739aa041a506d9ee9d4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:55.538881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0055e09-0e71-4bd3-be01-8f7b7f2756fd tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:55.580241 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:55.594222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9d4b1-a6c9-47dd-a943-6690fd1e0655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:55.595374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9d4b1-a6c9-47dd-a943-6690fd1e0655 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:55.598326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9d4b1-a6c9-47dd-a943-6690fd1e0655 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:55.607436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9d4b1-a6c9-47dd-a943-6690fd1e0655 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:55.621974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9d4b1-a6c9-47dd-a943-6690fd1e0655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:55.643682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9d4b1-a6c9-47dd-a943-6690fd1e0655 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:55.676334 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3369/6751] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:55.678976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c0055e09-0e71-4bd3-be01-8f7b7f2756fd tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efae92fd42b04739aa041a506d9ee9d4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:55.679556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9d4b1-a6c9-47dd-a943-6690fd1e0655 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:55.681713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c0055e09-0e71-4bd3-be01-8f7b7f2756fd tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efae92fd42b04739aa041a506d9ee9d4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:55.685613 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f4b9d4b1-a6c9-47dd-a943-6690fd1e0655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:55.696413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c0055e09-0e71-4bd3-be01-8f7b7f2756fd tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efae92fd42b04739aa041a506d9ee9d4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:55.710472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9d4b1-a6c9-47dd-a943-6690fd1e0655 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:55.717714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c0055e09-0e71-4bd3-be01-8f7b7f2756fd tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efae92fd42b04739aa041a506d9ee9d4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:55.718310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a22508-07ff-4e40-a794-f229a18ae786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:55.719063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a22508-07ff-4e40-a794-f229a18ae786 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:55.719727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a22508-07ff-4e40-a794-f229a18ae786 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:55.719727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a22508-07ff-4e40-a794-f229a18ae786 admin admin] PATH_INFO: `/v3/system/users/6985d905e9084e598e078af7fac643bf/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:55.727880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c0055e09-0e71-4bd3-be01-8f7b7f2756fd tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efae92fd42b04739aa041a506d9ee9d4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:55.741205 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3383/6752] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:13:55 2022] DELETE /identity/v3/users/efae92fd42b04739aa041a506d9ee9d4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:13:55.742419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0055e09-0e71-4bd3-be01-8f7b7f2756fd tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:55.743919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a22508-07ff-4e40-a794-f229a18ae786 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6985d905e9084e598e078af7fac643bf, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:55.745262 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-e1a22508-07ff-4e40-a794-f229a18ae786 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:13:55.745262 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:13:55.745262 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:13:55.745840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a22508-07ff-4e40-a794-f229a18ae786 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:55.746733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c0055e09-0e71-4bd3-be01-8f7b7f2756fd tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:55.776531 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3370/6753] 10.222.0.16 () {60 vars in 1378 bytes} [Fri Sep 30 10:13:55 2022] PUT /identity/v3/system/users/6985d905e9084e598e078af7fac643bf/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:13:55.778341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab6419-c49c-4a59-abaa-3c8c80a9d49d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:55.778638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab6419-c49c-4a59-abaa-3c8c80a9d49d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:55.778914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab6419-c49c-4a59-abaa-3c8c80a9d49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:55.839426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d3ab6419-c49c-4a59-abaa-3c8c80a9d49d None None] MFA Rules not processed for user `6985d905e9084e598e078af7fac643bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:13:55.840672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d3ab6419-c49c-4a59-abaa-3c8c80a9d49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:55.892136 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:55.929142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0055e09-0e71-4bd3-be01-8f7b7f2756fd tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:55.950101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6da348-94a4-435a-a3f6-f33f3be96302 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:55.950816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6da348-94a4-435a-a3f6-f33f3be96302 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:55.951050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6da348-94a4-435a-a3f6-f33f3be96302 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:55.951327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6da348-94a4-435a-a3f6-f33f3be96302 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/users/2093041576b04ba995af091872b508db` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:55.952681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6da348-94a4-435a-a3f6-f33f3be96302 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2093041576b04ba995af091872b508db)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:55.955784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6da348-94a4-435a-a3f6-f33f3be96302 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:56.016267 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3371/6754] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:13:55 2022] POST /identity/v3/auth/tokens => generated 2415 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 10:13:56.019388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab6419-c49c-4a59-abaa-3c8c80a9d49d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:56.028956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a6da348-94a4-435a-a3f6-f33f3be96302 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2093041576b04ba995af091872b508db'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:56.030851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a6da348-94a4-435a-a3f6-f33f3be96302 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2093041576b04ba995af091872b508db'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:56.043635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a6da348-94a4-435a-a3f6-f33f3be96302 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2093041576b04ba995af091872b508db'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:56.077224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a6da348-94a4-435a-a3f6-f33f3be96302 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2093041576b04ba995af091872b508db'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:56.087684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a6da348-94a4-435a-a3f6-f33f3be96302 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2093041576b04ba995af091872b508db'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:56.101785 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3384/6755] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:13:55 2022] DELETE /identity/v3/users/2093041576b04ba995af091872b508db => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:56.108647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6da348-94a4-435a-a3f6-f33f3be96302 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:56.111408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4a6da348-94a4-435a-a3f6-f33f3be96302 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:56.161503 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:56.208940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab6419-c49c-4a59-abaa-3c8c80a9d49d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:56.259740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6da348-94a4-435a-a3f6-f33f3be96302 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:56.270567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9530a7-fe9e-4299-b75f-6167b4c1ca52 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:56.271320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9530a7-fe9e-4299-b75f-6167b4c1ca52 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:56.271599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9530a7-fe9e-4299-b75f-6167b4c1ca52 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:56.271733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e719f-ad73-489a-8e14-c5af2dae3c67 None tempest-ImageQuotaTest-1479841352-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6985d905e9084e598e078af7fac643bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:56.271991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9530a7-fe9e-4299-b75f-6167b4c1ca52 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/users/9377eb42cf6849759fc1f61b10c5e857` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:56.272285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e719f-ad73-489a-8e14-c5af2dae3c67 None tempest-ImageQuotaTest-1479841352-system-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:56.272717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e719f-ad73-489a-8e14-c5af2dae3c67 None tempest-ImageQuotaTest-1479841352-system-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:56.272989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e719f-ad73-489a-8e14-c5af2dae3c67 None tempest-ImageQuotaTest-1479841352-system-admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:56.273508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9530a7-fe9e-4299-b75f-6167b4c1ca52 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9377eb42cf6849759fc1f61b10c5e857)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:56.273634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e719f-ad73-489a-8e14-c5af2dae3c67 None tempest-ImageQuotaTest-1479841352-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:56.275003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e719f-ad73-489a-8e14-c5af2dae3c67 None tempest-ImageQuotaTest-1479841352-system-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:56.275566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9530a7-fe9e-4299-b75f-6167b4c1ca52 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:56.289981 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3372/6756] 10.222.0.16 () {58 vars in 1110 bytes} [Fri Sep 30 10:13:56 2022] GET /identity/v3/services => generated 2191 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:56.294394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e719f-ad73-489a-8e14-c5af2dae3c67 None tempest-ImageQuotaTest-1479841352-system-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:56.296283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d11e719f-ad73-489a-8e14-c5af2dae3c67 None tempest-ImageQuotaTest-1479841352-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:56.340726 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:56.367373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-db9530a7-fe9e-4299-b75f-6167b4c1ca52 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9377eb42cf6849759fc1f61b10c5e857'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:56.368338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-db9530a7-fe9e-4299-b75f-6167b4c1ca52 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9377eb42cf6849759fc1f61b10c5e857'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:56.381537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-db9530a7-fe9e-4299-b75f-6167b4c1ca52 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9377eb42cf6849759fc1f61b10c5e857'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:56.404076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-db9530a7-fe9e-4299-b75f-6167b4c1ca52 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9377eb42cf6849759fc1f61b10c5e857'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:56.413844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-db9530a7-fe9e-4299-b75f-6167b4c1ca52 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9377eb42cf6849759fc1f61b10c5e857'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:13:56.424825 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3385/6757] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:13:56 2022] DELETE /identity/v3/users/9377eb42cf6849759fc1f61b10c5e857 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:56.426215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9530a7-fe9e-4299-b75f-6167b4c1ca52 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:56.427835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-db9530a7-fe9e-4299-b75f-6167b4c1ca52 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:56.521683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9530a7-fe9e-4299-b75f-6167b4c1ca52 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:56.533725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88517d4-a75b-4310-84ed-77a9f30c3815 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:56.535329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88517d4-a75b-4310-84ed-77a9f30c3815 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:56.535608 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88517d4-a75b-4310-84ed-77a9f30c3815 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:56.535876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88517d4-a75b-4310-84ed-77a9f30c3815 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups/0d07b348aafb4ecf831584ad7b568969` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:56.552828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88517d4-a75b-4310-84ed-77a9f30c3815 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:delete_group(group_id=0d07b348aafb4ecf831584ad7b568969)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:56.552828 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-c88517d4-a75b-4310-84ed-77a9f30c3815 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:13:56.552828 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:13:56.552828 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:13:56.552828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88517d4-a75b-4310-84ed-77a9f30c3815 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:56.616732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e719f-ad73-489a-8e14-c5af2dae3c67 None tempest-ImageQuotaTest-1479841352-system-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:56.627163 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:56.652168 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3386/6758] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Sep 30 10:13:56 2022] DELETE /identity/v3/groups/0d07b348aafb4ecf831584ad7b568969 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:13:56.658769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88517d4-a75b-4310-84ed-77a9f30c3815 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:56.702248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bab3b-189d-4ef1-b075-29eb45c5238e None tempest-ImageQuotaTest-1479841352-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6985d905e9084e598e078af7fac643bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:56.703009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bab3b-189d-4ef1-b075-29eb45c5238e None tempest-ImageQuotaTest-1479841352-system-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:56.703440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bab3b-189d-4ef1-b075-29eb45c5238e None tempest-ImageQuotaTest-1479841352-system-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:56.703716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bab3b-189d-4ef1-b075-29eb45c5238e None tempest-ImageQuotaTest-1479841352-system-admin] PATH_INFO: `/v3/limits` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:56.705222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bab3b-189d-4ef1-b075-29eb45c5238e None tempest-ImageQuotaTest-1479841352-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:56.706616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bab3b-189d-4ef1-b075-29eb45c5238e None tempest-ImageQuotaTest-1479841352-system-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:56.775945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88517d4-a75b-4310-84ed-77a9f30c3815 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:56.790061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dab19-8db2-4f5a-8caa-7c39b327aad8 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:56.790770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dab19-8db2-4f5a-8caa-7c39b327aad8 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:56.791057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dab19-8db2-4f5a-8caa-7c39b327aad8 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:56.791424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dab19-8db2-4f5a-8caa-7c39b327aad8 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:56.791961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674dab19-8db2-4f5a-8caa-7c39b327aad8 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:56.793334 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-3e3bab3b-189d-4ef1-b075-29eb45c5238e None tempest-ImageQuotaTest-1479841352-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Sep 30 10:13:56.793334 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:13:56.793334 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:13:56.793334 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:13:56.793334 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:13:56.793334 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:13:56.793334 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:13:56.793334 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:13:56.793334 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:13:56.793334 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:13:56.793334 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:13:56.793334 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:13:56.793334 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Sep 30 10:13:56.793334 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Sep 30 10:13:56.794759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:13:56.794759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:13:56.794759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Sep 30 10:13:56.794759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Sep 30 10:13:56.794759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 30 10:13:56.794759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 30 10:13:56.794759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Sep 30 10:13:56.794759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Sep 30 10:13:56.794759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Sep 30 10:13:56.794759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.NoLimitReference Sep 30 10:13:56.794759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Sep 30 10:13:56.794759 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:13:56.795673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674dab19-8db2-4f5a-8caa-7c39b327aad8 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:56.804382 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3373/6759] 10.222.0.16 () {60 vars in 1126 bytes} [Fri Sep 30 10:13:56 2022] POST /identity/v3/limits => generated 124 bytes in 511 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:13:56.806075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bab3b-189d-4ef1-b075-29eb45c5238e None tempest-ImageQuotaTest-1479841352-system-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:56.808449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3e3bab3b-189d-4ef1-b075-29eb45c5238e None tempest-ImageQuotaTest-1479841352-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:56.828348 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3387/6760] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Sep 30 10:13:56 2022] POST /identity/v3/groups => generated 327 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:56.834819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dab19-8db2-4f5a-8caa-7c39b327aad8 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:56.874918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dab19-8db2-4f5a-8caa-7c39b327aad8 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:56.895039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0abdbf-e4b0-4d90-bede-358b7b7152de tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:56.902085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0abdbf-e4b0-4d90-bede-358b7b7152de tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:56.904055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0abdbf-e4b0-4d90-bede-358b7b7152de tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:56.905130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0abdbf-e4b0-4d90-bede-358b7b7152de tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:56.906198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0abdbf-e4b0-4d90-bede-358b7b7152de tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:56.913137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0abdbf-e4b0-4d90-bede-358b7b7152de tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:56.957145 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3388/6761] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Sep 30 10:13:56 2022] POST /identity/v3/groups => generated 327 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:56.960510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0abdbf-e4b0-4d90-bede-358b7b7152de tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:56.984391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0abdbf-e4b0-4d90-bede-358b7b7152de tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:57.002533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79710d-752f-4332-880e-50a4b7525013 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:57.003448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79710d-752f-4332-880e-50a4b7525013 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:57.003810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79710d-752f-4332-880e-50a4b7525013 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:57.005699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79710d-752f-4332-880e-50a4b7525013 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:57.006443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79710d-752f-4332-880e-50a4b7525013 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:57.008628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79710d-752f-4332-880e-50a4b7525013 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:57.018683 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:57.051854 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3389/6762] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Sep 30 10:13:56 2022] POST /identity/v3/groups => generated 326 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:13:57.054106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79710d-752f-4332-880e-50a4b7525013 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:57.089358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79710d-752f-4332-880e-50a4b7525013 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:57.106908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899e6a4-4476-4090-8799-ca61861c4a3c tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:57.110387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e6a4-4476-4090-8799-ca61861c4a3c tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:57.116109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e6a4-4476-4090-8799-ca61861c4a3c tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:57.116862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e6a4-4476-4090-8799-ca61861c4a3c tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:57.117354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899e6a4-4476-4090-8799-ca61861c4a3c tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:57.120764 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-2899e6a4-4476-4090-8799-ca61861c4a3c tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:13:57.120764 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:13:57.120764 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:13:57.128935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899e6a4-4476-4090-8799-ca61861c4a3c tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:57.133470 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3390/6763] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Sep 30 10:13:57 2022] GET /identity/v3/groups => generated 1490 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:13:57.137398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899e6a4-4476-4090-8799-ca61861c4a3c tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:57.151637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899e6a4-4476-4090-8799-ca61861c4a3c tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:57.162570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129fbd6-2e39-4647-bc1d-b30be7819c2e tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:57.163558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129fbd6-2e39-4647-bc1d-b30be7819c2e tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:57.163939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129fbd6-2e39-4647-bc1d-b30be7819c2e tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:57.164310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129fbd6-2e39-4647-bc1d-b30be7819c2e tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups/dfdf3887bcb04746b1cbd8bf406a0eb6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:57.172814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129fbd6-2e39-4647-bc1d-b30be7819c2e tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:delete_group(group_id=dfdf3887bcb04746b1cbd8bf406a0eb6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:57.176981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129fbd6-2e39-4647-bc1d-b30be7819c2e tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:57.253483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bab3b-189d-4ef1-b075-29eb45c5238e None tempest-ImageQuotaTest-1479841352-system-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:57.307729 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3391/6764] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Sep 30 10:13:57 2022] DELETE /identity/v3/groups/dfdf3887bcb04746b1cbd8bf406a0eb6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:57.311975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129fbd6-2e39-4647-bc1d-b30be7819c2e tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:57.339545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72379f0c-1abf-4ea7-89ff-b5f16085ac65 None tempest-ImageQuotaTest-1479841352-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6985d905e9084e598e078af7fac643bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:57.340444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72379f0c-1abf-4ea7-89ff-b5f16085ac65 None tempest-ImageQuotaTest-1479841352-system-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:57.340917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72379f0c-1abf-4ea7-89ff-b5f16085ac65 None tempest-ImageQuotaTest-1479841352-system-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:57.341362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72379f0c-1abf-4ea7-89ff-b5f16085ac65 None tempest-ImageQuotaTest-1479841352-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:57.342224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72379f0c-1abf-4ea7-89ff-b5f16085ac65 None tempest-ImageQuotaTest-1479841352-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:57.343456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72379f0c-1abf-4ea7-89ff-b5f16085ac65 None tempest-ImageQuotaTest-1479841352-system-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:57.354631 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3374/6765] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Sep 30 10:13:56 2022] GET /identity/v3/registered_limits => generated 129 bytes in 549 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:13:57.368307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72379f0c-1abf-4ea7-89ff-b5f16085ac65 None tempest-ImageQuotaTest-1479841352-system-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:57.505794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129fbd6-2e39-4647-bc1d-b30be7819c2e tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:57.531745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c46f3-2729-4163-b6e8-821a468c0b54 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:57.531745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c46f3-2729-4163-b6e8-821a468c0b54 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:57.531745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c46f3-2729-4163-b6e8-821a468c0b54 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:57.532149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c46f3-2729-4163-b6e8-821a468c0b54 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups/a07ddea10bd245699f1f37d47e8b35b8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:57.536145 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:57.545582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c46f3-2729-4163-b6e8-821a468c0b54 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:delete_group(group_id=a07ddea10bd245699f1f37d47e8b35b8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:57.549867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c46f3-2729-4163-b6e8-821a468c0b54 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:57.611472 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:57.671796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72379f0c-1abf-4ea7-89ff-b5f16085ac65 None tempest-ImageQuotaTest-1479841352-system-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:57.688258 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3392/6766] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Sep 30 10:13:57 2022] DELETE /identity/v3/groups/a07ddea10bd245699f1f37d47e8b35b8 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:57.693277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c46f3-2729-4163-b6e8-821a468c0b54 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:57.767596 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0fef0-af49-4085-81dd-403f24e19e56 None tempest-ImageQuotaTest-1479841352-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6985d905e9084e598e078af7fac643bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:57.769271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0fef0-af49-4085-81dd-403f24e19e56 None tempest-ImageQuotaTest-1479841352-system-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:57.770529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0fef0-af49-4085-81dd-403f24e19e56 None tempest-ImageQuotaTest-1479841352-system-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:57.771124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0fef0-af49-4085-81dd-403f24e19e56 None tempest-ImageQuotaTest-1479841352-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:57.774133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0fef0-af49-4085-81dd-403f24e19e56 None tempest-ImageQuotaTest-1479841352-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:57.781272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0fef0-af49-4085-81dd-403f24e19e56 None tempest-ImageQuotaTest-1479841352-system-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:57.796267 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3375/6767] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Sep 30 10:13:57 2022] GET /identity/v3/registered_limits => generated 129 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:13:57.841850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c46f3-2729-4163-b6e8-821a468c0b54 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:57.858114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc380a2-2c2a-4d79-b02b-d2ad3885c8c8 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:57.858798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc380a2-2c2a-4d79-b02b-d2ad3885c8c8 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:57.859082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc380a2-2c2a-4d79-b02b-d2ad3885c8c8 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:57.859523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc380a2-2c2a-4d79-b02b-d2ad3885c8c8 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups/1cf3043499c9417aa0f172f725368147` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:57.872846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc380a2-2c2a-4d79-b02b-d2ad3885c8c8 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:delete_group(group_id=1cf3043499c9417aa0f172f725368147)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:57.874834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc380a2-2c2a-4d79-b02b-d2ad3885c8c8 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:57.964251 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3393/6768] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Sep 30 10:13:57 2022] DELETE /identity/v3/groups/1cf3043499c9417aa0f172f725368147 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:13:57.969492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0fef0-af49-4085-81dd-403f24e19e56 None tempest-ImageQuotaTest-1479841352-system-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:58.152955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0fef0-af49-4085-81dd-403f24e19e56 None tempest-ImageQuotaTest-1479841352-system-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:58.164765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817abf8a-7f3e-454c-bbc8-51e279d5bf1b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:58.165402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817abf8a-7f3e-454c-bbc8-51e279d5bf1b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:58.165680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817abf8a-7f3e-454c-bbc8-51e279d5bf1b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:58.165954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817abf8a-7f3e-454c-bbc8-51e279d5bf1b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:58.166607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817abf8a-7f3e-454c-bbc8-51e279d5bf1b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:58.168845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817abf8a-7f3e-454c-bbc8-51e279d5bf1b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:58.228514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc380a2-2c2a-4d79-b02b-d2ad3885c8c8 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:58.230058 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3376/6769] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:13:57 2022] POST /identity/v3/users => generated 323 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:58.258194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc380a2-2c2a-4d79-b02b-d2ad3885c8c8 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:58.273789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf87573-aa04-4560-b3f3-cf0ecc049b50 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:58.275195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf87573-aa04-4560-b3f3-cf0ecc049b50 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:58.275686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf87573-aa04-4560-b3f3-cf0ecc049b50 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:58.276955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf87573-aa04-4560-b3f3-cf0ecc049b50 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:58.279492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf87573-aa04-4560-b3f3-cf0ecc049b50 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:58.285531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf87573-aa04-4560-b3f3-cf0ecc049b50 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:58.316426 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3394/6770] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Sep 30 10:13:58 2022] POST /identity/v3/groups => generated 327 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:58.320707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817abf8a-7f3e-454c-bbc8-51e279d5bf1b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:58.342021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817abf8a-7f3e-454c-bbc8-51e279d5bf1b tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:58.360635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62fbc2-78e9-40ca-9808-d50cb33861de tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:58.360635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62fbc2-78e9-40ca-9808-d50cb33861de tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:58.360635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62fbc2-78e9-40ca-9808-d50cb33861de tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:58.361749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62fbc2-78e9-40ca-9808-d50cb33861de tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups/dc78f6a1d19b4f6ea9a5640d4cd2a88b/users/ce260bb0410341d9baf61cc9ab197925` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:58.405673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62fbc2-78e9-40ca-9808-d50cb33861de tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=dc78f6a1d19b4f6ea9a5640d4cd2a88b, user_id=ce260bb0410341d9baf61cc9ab197925)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:58.409048 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-0a62fbc2-78e9-40ca-9808-d50cb33861de tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:13:58.409048 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:13:58.409048 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:13:58.410596 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62fbc2-78e9-40ca-9808-d50cb33861de tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:58.490308 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3377/6771] 10.222.0.16 () {60 vars in 1360 bytes} [Fri Sep 30 10:13:58 2022] PUT /identity/v3/groups/dc78f6a1d19b4f6ea9a5640d4cd2a88b/users/ce260bb0410341d9baf61cc9ab197925 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:58.490820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf87573-aa04-4560-b3f3-cf0ecc049b50 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:58.543564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf87573-aa04-4560-b3f3-cf0ecc049b50 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:58.769430 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:58.797439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504fec8-8009-46b0-8e61-32f1da932ace tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:58.799321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504fec8-8009-46b0-8e61-32f1da932ace tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:58.799994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504fec8-8009-46b0-8e61-32f1da932ace tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:58.800477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504fec8-8009-46b0-8e61-32f1da932ace tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:58.801402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504fec8-8009-46b0-8e61-32f1da932ace tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:58.804192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504fec8-8009-46b0-8e61-32f1da932ace tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:58.838711 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3395/6772] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Sep 30 10:13:58 2022] POST /identity/v3/groups => generated 327 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:13:58.843042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62fbc2-78e9-40ca-9808-d50cb33861de tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:58.859979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62fbc2-78e9-40ca-9808-d50cb33861de tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:58.884292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b737fd4-e746-49fe-b1f1-0ce87b93fbee tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:58.885150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b737fd4-e746-49fe-b1f1-0ce87b93fbee tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:58.885433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b737fd4-e746-49fe-b1f1-0ce87b93fbee tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:58.885703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b737fd4-e746-49fe-b1f1-0ce87b93fbee tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups/a1b505aa1e5844e390b3a99c3b2232f5/users/ce260bb0410341d9baf61cc9ab197925` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:58.901304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b737fd4-e746-49fe-b1f1-0ce87b93fbee tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=a1b505aa1e5844e390b3a99c3b2232f5, user_id=ce260bb0410341d9baf61cc9ab197925)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:58.903276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b737fd4-e746-49fe-b1f1-0ce87b93fbee tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:58.959354 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3378/6773] 10.222.0.16 () {60 vars in 1360 bytes} [Fri Sep 30 10:13:58 2022] PUT /identity/v3/groups/a1b505aa1e5844e390b3a99c3b2232f5/users/ce260bb0410341d9baf61cc9ab197925 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:58.963839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504fec8-8009-46b0-8e61-32f1da932ace tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:58.977490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504fec8-8009-46b0-8e61-32f1da932ace tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:59.117687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf479e-b17d-4cf9-9ce8-abc7ac4933fc tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:59.118432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf479e-b17d-4cf9-9ce8-abc7ac4933fc tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:59.118718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf479e-b17d-4cf9-9ce8-abc7ac4933fc tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:59.118990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf479e-b17d-4cf9-9ce8-abc7ac4933fc tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/users/ce260bb0410341d9baf61cc9ab197925/groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:59.121598 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf479e-b17d-4cf9-9ce8-abc7ac4933fc tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=ce260bb0410341d9baf61cc9ab197925)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:59.124299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf479e-b17d-4cf9-9ce8-abc7ac4933fc tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:59.159563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b737fd4-e746-49fe-b1f1-0ce87b93fbee tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:59.171529 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3396/6774] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Sep 30 10:13:58 2022] GET /identity/v3/users/ce260bb0410341d9baf61cc9ab197925/groups => generated 840 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:13:59.174968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b737fd4-e746-49fe-b1f1-0ce87b93fbee tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:59.186570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89b1e8-3edf-476c-98bf-a4a217c5088c tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:59.187124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89b1e8-3edf-476c-98bf-a4a217c5088c tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:59.187573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89b1e8-3edf-476c-98bf-a4a217c5088c tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:59.187698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89b1e8-3edf-476c-98bf-a4a217c5088c tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups/a1b505aa1e5844e390b3a99c3b2232f5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:59.189711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89b1e8-3edf-476c-98bf-a4a217c5088c tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:delete_group(group_id=a1b505aa1e5844e390b3a99c3b2232f5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:59.193625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89b1e8-3edf-476c-98bf-a4a217c5088c tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:59.258514 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:59.303069 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3379/6775] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Sep 30 10:13:59 2022] DELETE /identity/v3/groups/a1b505aa1e5844e390b3a99c3b2232f5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:13:59.306858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf479e-b17d-4cf9-9ce8-abc7ac4933fc tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:59.324889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf479e-b17d-4cf9-9ce8-abc7ac4933fc tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:59.356673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89b1e8-3edf-476c-98bf-a4a217c5088c tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:59.358732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ae89b1e8-3edf-476c-98bf-a4a217c5088c tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:59.443918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fee295-1d6c-4040-9e8c-1c90f795e5b6 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:59.444756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fee295-1d6c-4040-9e8c-1c90f795e5b6 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:59.445041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fee295-1d6c-4040-9e8c-1c90f795e5b6 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:59.445316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fee295-1d6c-4040-9e8c-1c90f795e5b6 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/groups/dc78f6a1d19b4f6ea9a5640d4cd2a88b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:59.447607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fee295-1d6c-4040-9e8c-1c90f795e5b6 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:delete_group(group_id=dc78f6a1d19b4f6ea9a5640d4cd2a88b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:59.449758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fee295-1d6c-4040-9e8c-1c90f795e5b6 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:59.484504 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89b1e8-3edf-476c-98bf-a4a217c5088c tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:59.490547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1291936-9608-418e-a0c0-014e5611fbde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:59.491189 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1291936-9608-418e-a0c0-014e5611fbde service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:59.491469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1291936-9608-418e-a0c0-014e5611fbde service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:59.491795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1291936-9608-418e-a0c0-014e5611fbde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:59.493840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e1291936-9608-418e-a0c0-014e5611fbde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:13:59.638662 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3397/6776] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Sep 30 10:13:59 2022] DELETE /identity/v3/groups/dc78f6a1d19b4f6ea9a5640d4cd2a88b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:13:59.643990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fee295-1d6c-4040-9e8c-1c90f795e5b6 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:13:59.698191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1291936-9608-418e-a0c0-014e5611fbde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:59.702607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1291936-9608-418e-a0c0-014e5611fbde service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:13:59.731114 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3380/6777] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:13:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:13:59.757706 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:13:59.824620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fee295-1d6c-4040-9e8c-1c90f795e5b6 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:13:59.838646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc1b03-443f-4aec-8e67-b9cae5103e56 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:13:59.839607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc1b03-443f-4aec-8e67-b9cae5103e56 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:13:59.839888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc1b03-443f-4aec-8e67-b9cae5103e56 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:13:59.840305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc1b03-443f-4aec-8e67-b9cae5103e56 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/users/ce260bb0410341d9baf61cc9ab197925` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:13:59.842210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc1b03-443f-4aec-8e67-b9cae5103e56 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ce260bb0410341d9baf61cc9ab197925)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:13:59.847964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc1b03-443f-4aec-8e67-b9cae5103e56 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:00.009852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-20fc1b03-443f-4aec-8e67-b9cae5103e56 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce260bb0410341d9baf61cc9ab197925'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:00.011718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-20fc1b03-443f-4aec-8e67-b9cae5103e56 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce260bb0410341d9baf61cc9ab197925'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:00.027742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-20fc1b03-443f-4aec-8e67-b9cae5103e56 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce260bb0410341d9baf61cc9ab197925'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:00.058274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-20fc1b03-443f-4aec-8e67-b9cae5103e56 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce260bb0410341d9baf61cc9ab197925'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:00.077289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-20fc1b03-443f-4aec-8e67-b9cae5103e56 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce260bb0410341d9baf61cc9ab197925'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:00.096634 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3398/6778] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:13:59 2022] DELETE /identity/v3/users/ce260bb0410341d9baf61cc9ab197925 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:00.097923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1291936-9608-418e-a0c0-014e5611fbde service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:00.125571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1291936-9608-418e-a0c0-014e5611fbde service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:00.237813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e9f18-bd8f-40be-b9a5-f2132fd73514 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:00.238689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e9f18-bd8f-40be-b9a5-f2132fd73514 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:00.238978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e9f18-bd8f-40be-b9a5-f2132fd73514 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:00.239279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e9f18-bd8f-40be-b9a5-f2132fd73514 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/domains/42f0169ea766499293bc8a14ae47d197` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:00.242006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e9f18-bd8f-40be-b9a5-f2132fd73514 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=42f0169ea766499293bc8a14ae47d197)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:00.243612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e9f18-bd8f-40be-b9a5-f2132fd73514 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:00.293389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d53e9f18-bd8f-40be-b9a5-f2132fd73514 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '42f0169ea766499293bc8a14ae47d197'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:00.295663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d53e9f18-bd8f-40be-b9a5-f2132fd73514 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '42f0169ea766499293bc8a14ae47d197'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:00.319025 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:00.373619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d53e9f18-bd8f-40be-b9a5-f2132fd73514 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '42f0169ea766499293bc8a14ae47d197'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:00.374237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d53e9f18-bd8f-40be-b9a5-f2132fd73514 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '42f0169ea766499293bc8a14ae47d197'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:00.382875 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3381/6779] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:14:00 2022] PATCH /identity/v3/domains/42f0169ea766499293bc8a14ae47d197 => generated 277 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:14:00.384148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc1b03-443f-4aec-8e67-b9cae5103e56 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:00.385552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-20fc1b03-443f-4aec-8e67-b9cae5103e56 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:00.406471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc1b03-443f-4aec-8e67-b9cae5103e56 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:00.549453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e4c75-940c-4a95-af27-8293b16c3fbf tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa62cc33415147bf921785d48a9e295d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:00.550300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e4c75-940c-4a95-af27-8293b16c3fbf tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:00.550741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e4c75-940c-4a95-af27-8293b16c3fbf tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:00.551172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e4c75-940c-4a95-af27-8293b16c3fbf tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] PATH_INFO: `/v3/domains/42f0169ea766499293bc8a14ae47d197` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:00.566825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e4c75-940c-4a95-af27-8293b16c3fbf tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=42f0169ea766499293bc8a14ae47d197)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:00.569331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e4c75-940c-4a95-af27-8293b16c3fbf tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:00.621827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8a7e4c75-940c-4a95-af27-8293b16c3fbf tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '42f0169ea766499293bc8a14ae47d197'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:00.626389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8a7e4c75-940c-4a95-af27-8293b16c3fbf tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '42f0169ea766499293bc8a14ae47d197'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:00.702631 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:00.759042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8a7e4c75-940c-4a95-af27-8293b16c3fbf tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42f0169ea766499293bc8a14ae47d197', 'request_id': 'req-8a7e4c75-940c-4a95-af27-8293b16c3fbf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:00.772525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8a7e4c75-940c-4a95-af27-8293b16c3fbf tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42f0169ea766499293bc8a14ae47d197', 'request_id': 'req-8a7e4c75-940c-4a95-af27-8293b16c3fbf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:00.786594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8a7e4c75-940c-4a95-af27-8293b16c3fbf tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42f0169ea766499293bc8a14ae47d197', 'request_id': 'req-8a7e4c75-940c-4a95-af27-8293b16c3fbf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:00.802784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8a7e4c75-940c-4a95-af27-8293b16c3fbf tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] The token cache is being invalidate because project 42f0169ea766499293bc8a14ae47d197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:14:00.803161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8a7e4c75-940c-4a95-af27-8293b16c3fbf tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:00.803887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8a7e4c75-940c-4a95-af27-8293b16c3fbf tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:00.821745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8a7e4c75-940c-4a95-af27-8293b16c3fbf tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '42f0169ea766499293bc8a14ae47d197', 'request_id': 'req-8a7e4c75-940c-4a95-af27-8293b16c3fbf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:00.822413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8a7e4c75-940c-4a95-af27-8293b16c3fbf tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '42f0169ea766499293bc8a14ae47d197', 'request_id': 'req-8a7e4c75-940c-4a95-af27-8293b16c3fbf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:00.832302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8a7e4c75-940c-4a95-af27-8293b16c3fbf tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '42f0169ea766499293bc8a14ae47d197', 'request_id': 'req-8a7e4c75-940c-4a95-af27-8293b16c3fbf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:00.846523 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3399/6780] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:14:00 2022] DELETE /identity/v3/domains/42f0169ea766499293bc8a14ae47d197 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:00.850820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e9f18-bd8f-40be-b9a5-f2132fd73514 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:00.852456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d53e9f18-bd8f-40be-b9a5-f2132fd73514 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:00.989579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e9f18-bd8f-40be-b9a5-f2132fd73514 tempest-GroupsV3TestJSON-2072862901 tempest-GroupsV3TestJSON-2072862901-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:01.100822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe7819-29a6-4470-9316-9646a80846ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:01.101627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe7819-29a6-4470-9316-9646a80846ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:01.102003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe7819-29a6-4470-9316-9646a80846ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:01.103077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe7819-29a6-4470-9316-9646a80846ce admin admin] PATH_INFO: `/v3/users/14e5927d69ce4e64af8e60ffb1a18421` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:01.104289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe7819-29a6-4470-9316-9646a80846ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=14e5927d69ce4e64af8e60ffb1a18421)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:01.106408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe7819-29a6-4470-9316-9646a80846ce admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:01.183336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0fe7819-29a6-4470-9316-9646a80846ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14e5927d69ce4e64af8e60ffb1a18421'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:01.194670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0fe7819-29a6-4470-9316-9646a80846ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14e5927d69ce4e64af8e60ffb1a18421'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:01.195557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0fe7819-29a6-4470-9316-9646a80846ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14e5927d69ce4e64af8e60ffb1a18421'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:01.213500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0fe7819-29a6-4470-9316-9646a80846ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14e5927d69ce4e64af8e60ffb1a18421'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:01.223064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0fe7819-29a6-4470-9316-9646a80846ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14e5927d69ce4e64af8e60ffb1a18421'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:01.231261 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3382/6781] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:14:00 2022] DELETE /identity/v3/users/14e5927d69ce4e64af8e60ffb1a18421 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:01.235773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6c4b1-da4f-47a5-addb-06aaafd27458 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:01.236235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6c4b1-da4f-47a5-addb-06aaafd27458 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:01.236320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6c4b1-da4f-47a5-addb-06aaafd27458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:01.261080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-93c6c4b1-da4f-47a5-addb-06aaafd27458 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:01.274319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-93c6c4b1-da4f-47a5-addb-06aaafd27458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:01.418072 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3400/6782] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:01.428739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe7819-29a6-4470-9316-9646a80846ce admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:01.430123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d0fe7819-29a6-4470-9316-9646a80846ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:01.478647 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:UPDATE=1,keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:01.574090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe7819-29a6-4470-9316-9646a80846ce admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:01.583847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966314eb-9a82-4def-87e1-02a1ae7e1eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:01.584477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966314eb-9a82-4def-87e1-02a1ae7e1eda service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:01.584854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966314eb-9a82-4def-87e1-02a1ae7e1eda service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:01.585127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966314eb-9a82-4def-87e1-02a1ae7e1eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:01.603632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966314eb-9a82-4def-87e1-02a1ae7e1eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:01.605119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966314eb-9a82-4def-87e1-02a1ae7e1eda service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:01.628886 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3383/6783] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:14:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:14:02.347408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6c4b1-da4f-47a5-addb-06aaafd27458 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:02.349208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-93c6c4b1-da4f-47a5-addb-06aaafd27458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:02.370670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6c4b1-da4f-47a5-addb-06aaafd27458 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:02.383984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fcd60-d392-41bb-bfef-ba7c8d178933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:02.384736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fcd60-d392-41bb-bfef-ba7c8d178933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:02.385084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fcd60-d392-41bb-bfef-ba7c8d178933 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:02.385423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fcd60-d392-41bb-bfef-ba7c8d178933 admin admin] PATH_INFO: `/v3/projects/a11842336bbb4cd08acdd2561d1121c0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:02.388085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fcd60-d392-41bb-bfef-ba7c8d178933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a11842336bbb4cd08acdd2561d1121c0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:02.390034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fcd60-d392-41bb-bfef-ba7c8d178933 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:02.538230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-753fcd60-d392-41bb-bfef-ba7c8d178933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a11842336bbb4cd08acdd2561d1121c0', 'request_id': 'req-753fcd60-d392-41bb-bfef-ba7c8d178933'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:02.556877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-753fcd60-d392-41bb-bfef-ba7c8d178933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a11842336bbb4cd08acdd2561d1121c0', 'request_id': 'req-753fcd60-d392-41bb-bfef-ba7c8d178933'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:02.569914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-753fcd60-d392-41bb-bfef-ba7c8d178933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a11842336bbb4cd08acdd2561d1121c0', 'request_id': 'req-753fcd60-d392-41bb-bfef-ba7c8d178933'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:02.588943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-753fcd60-d392-41bb-bfef-ba7c8d178933 admin admin] The token cache is being invalidate because project a11842336bbb4cd08acdd2561d1121c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:14:02.591320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-753fcd60-d392-41bb-bfef-ba7c8d178933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:02.593943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-753fcd60-d392-41bb-bfef-ba7c8d178933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:02.601216 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3401/6784] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:14:02 2022] DELETE /identity/v3/projects/a11842336bbb4cd08acdd2561d1121c0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:02.605093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966314eb-9a82-4def-87e1-02a1ae7e1eda service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:02.620068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966314eb-9a82-4def-87e1-02a1ae7e1eda service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:02.747093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4b94f-2f72-4690-94f4-209e2270566c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:02.747960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4b94f-2f72-4690-94f4-209e2270566c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:02.748436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4b94f-2f72-4690-94f4-209e2270566c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:02.748653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4b94f-2f72-4690-94f4-209e2270566c admin admin] PATH_INFO: `/v3/users/fa62cc33415147bf921785d48a9e295d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:02.750086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4b94f-2f72-4690-94f4-209e2270566c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa62cc33415147bf921785d48a9e295d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:02.761381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4b94f-2f72-4690-94f4-209e2270566c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:03.044018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-56d4b94f-2f72-4690-94f4-209e2270566c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa62cc33415147bf921785d48a9e295d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:03.070863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-56d4b94f-2f72-4690-94f4-209e2270566c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa62cc33415147bf921785d48a9e295d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:03.077122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-56d4b94f-2f72-4690-94f4-209e2270566c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa62cc33415147bf921785d48a9e295d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:03.126718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-56d4b94f-2f72-4690-94f4-209e2270566c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa62cc33415147bf921785d48a9e295d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:03.152152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-56d4b94f-2f72-4690-94f4-209e2270566c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa62cc33415147bf921785d48a9e295d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:03.172191 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3384/6785] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:14:02 2022] DELETE /identity/v3/users/fa62cc33415147bf921785d48a9e295d => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:03.798861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fcd60-d392-41bb-bfef-ba7c8d178933 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:03.800964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-753fcd60-d392-41bb-bfef-ba7c8d178933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:03.850071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fcd60-d392-41bb-bfef-ba7c8d178933 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:03.874103 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:03.990156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5904bf-f2d8-4f74-baa3-b9d1114ae411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:03.992291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5904bf-f2d8-4f74-baa3-b9d1114ae411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:03.993178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5904bf-f2d8-4f74-baa3-b9d1114ae411 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:03.993716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5904bf-f2d8-4f74-baa3-b9d1114ae411 admin admin] PATH_INFO: `/v3/projects/f63d9e60c52d477bbe097f51d6cd7ecf` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:03.995278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5904bf-f2d8-4f74-baa3-b9d1114ae411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f63d9e60c52d477bbe097f51d6cd7ecf)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:03.999184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5904bf-f2d8-4f74-baa3-b9d1114ae411 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:04.081849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4b94f-2f72-4690-94f4-209e2270566c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:04.088402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-56d4b94f-2f72-4690-94f4-209e2270566c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:04.116741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8c5904bf-f2d8-4f74-baa3-b9d1114ae411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'request_id': 'req-8c5904bf-f2d8-4f74-baa3-b9d1114ae411'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:04.121965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4b94f-2f72-4690-94f4-209e2270566c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:04.144766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8c5904bf-f2d8-4f74-baa3-b9d1114ae411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'request_id': 'req-8c5904bf-f2d8-4f74-baa3-b9d1114ae411'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:04.158942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8c5904bf-f2d8-4f74-baa3-b9d1114ae411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f63d9e60c52d477bbe097f51d6cd7ecf', 'request_id': 'req-8c5904bf-f2d8-4f74-baa3-b9d1114ae411'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:04.174923 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:04.179773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8c5904bf-f2d8-4f74-baa3-b9d1114ae411 admin admin] The token cache is being invalidate because project f63d9e60c52d477bbe097f51d6cd7ecf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:14:04.180197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8c5904bf-f2d8-4f74-baa3-b9d1114ae411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:04.180984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8c5904bf-f2d8-4f74-baa3-b9d1114ae411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:04.192895 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3402/6786] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:14:03 2022] DELETE /identity/v3/projects/f63d9e60c52d477bbe097f51d6cd7ecf => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:04.195839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582e634-791c-4e22-b532-6b8e939731be None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:04.196326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582e634-791c-4e22-b532-6b8e939731be None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:04.196719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582e634-791c-4e22-b532-6b8e939731be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:04.232281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8111787-092d-4a3d-90a7-57803c7a81e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:04.233708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8111787-092d-4a3d-90a7-57803c7a81e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:04.234763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8111787-092d-4a3d-90a7-57803c7a81e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:04.237349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8111787-092d-4a3d-90a7-57803c7a81e7 admin admin] PATH_INFO: `/v3/users/8c9df05ff1d2432e9f15777292f49197` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:04.239179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2582e634-791c-4e22-b532-6b8e939731be None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:04.239951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8111787-092d-4a3d-90a7-57803c7a81e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c9df05ff1d2432e9f15777292f49197)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:04.242147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8111787-092d-4a3d-90a7-57803c7a81e7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:04.243661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2582e634-791c-4e22-b532-6b8e939731be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:04.272959 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3403/6787] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:04.273419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0719d-58c9-420b-8ae0-15289c826571 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:04.273838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0719d-58c9-420b-8ae0-15289c826571 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:04.274184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0719d-58c9-420b-8ae0-15289c826571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:04.304697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5bc0719d-58c9-420b-8ae0-15289c826571 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:04.312882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5bc0719d-58c9-420b-8ae0-15289c826571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:04.337747 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3404/6788] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:04.340817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0719d-58c9-420b-8ae0-15289c826571 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:04.346337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d8111787-092d-4a3d-90a7-57803c7a81e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c9df05ff1d2432e9f15777292f49197'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:04.368646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d8111787-092d-4a3d-90a7-57803c7a81e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c9df05ff1d2432e9f15777292f49197'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:04.369529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d8111787-092d-4a3d-90a7-57803c7a81e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c9df05ff1d2432e9f15777292f49197'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:04.373382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0719d-58c9-420b-8ae0-15289c826571 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:04.390741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71e28b-4482-4882-b366-be6ca0e5c54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:04.393198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71e28b-4482-4882-b366-be6ca0e5c54a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:04.394002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71e28b-4482-4882-b366-be6ca0e5c54a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:04.394854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71e28b-4482-4882-b366-be6ca0e5c54a admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:04.395767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71e28b-4482-4882-b366-be6ca0e5c54a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:14:04.396790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71e28b-4482-4882-b366-be6ca0e5c54a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:04.409099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71e28b-4482-4882-b366-be6ca0e5c54a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:04.421249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d8111787-092d-4a3d-90a7-57803c7a81e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c9df05ff1d2432e9f15777292f49197'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:04.422412 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3405/6789] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:14:04.426450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71e28b-4482-4882-b366-be6ca0e5c54a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:04.445966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71e28b-4482-4882-b366-be6ca0e5c54a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:04.451254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d8111787-092d-4a3d-90a7-57803c7a81e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c9df05ff1d2432e9f15777292f49197'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:04.452505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f2322-b3f3-4981-95df-263beb39fde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:04.453334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f2322-b3f3-4981-95df-263beb39fde1 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:04.453764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f2322-b3f3-4981-95df-263beb39fde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:04.455273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f2322-b3f3-4981-95df-263beb39fde1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:04.456112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f2322-b3f3-4981-95df-263beb39fde1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:04.459638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f2322-b3f3-4981-95df-263beb39fde1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:04.468671 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3385/6790] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:14:04 2022] DELETE /identity/v3/users/8c9df05ff1d2432e9f15777292f49197 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:04.508703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8111787-092d-4a3d-90a7-57803c7a81e7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:04.511332 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3406/6791] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:14:04 2022] POST /identity/v3/projects => generated 365 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:04.511487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d8111787-092d-4a3d-90a7-57803c7a81e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:04.632851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8111787-092d-4a3d-90a7-57803c7a81e7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:04.788304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37f757-87c4-4627-86d8-704c7d47152a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:04.789012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37f757-87c4-4627-86d8-704c7d47152a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:04.789303 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37f757-87c4-4627-86d8-704c7d47152a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:04.789570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37f757-87c4-4627-86d8-704c7d47152a admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:04.790206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37f757-87c4-4627-86d8-704c7d47152a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:04.792397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37f757-87c4-4627-86d8-704c7d47152a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:04.810524 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:04.833591 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3386/6792] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:14:04 2022] POST /identity/v3/users => generated 283 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:04.838025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f2322-b3f3-4981-95df-263beb39fde1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:04.855248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f2322-b3f3-4981-95df-263beb39fde1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:04.872959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b09c18-5f4c-442a-b2c3-c3b24ba3d405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:04.874776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37f757-87c4-4627-86d8-704c7d47152a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:04.877434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7f37f757-87c4-4627-86d8-704c7d47152a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:04.878349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b09c18-5f4c-442a-b2c3-c3b24ba3d405 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:04.878635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b09c18-5f4c-442a-b2c3-c3b24ba3d405 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:04.878910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b09c18-5f4c-442a-b2c3-c3b24ba3d405 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:04.879575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b09c18-5f4c-442a-b2c3-c3b24ba3d405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:04.881213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b09c18-5f4c-442a-b2c3-c3b24ba3d405 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:04.890393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37f757-87c4-4627-86d8-704c7d47152a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:04.895930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64191b0d-20fd-439e-a9df-da206f726295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:04.896578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64191b0d-20fd-439e-a9df-da206f726295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:04.896901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64191b0d-20fd-439e-a9df-da206f726295 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:04.897172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64191b0d-20fd-439e-a9df-da206f726295 admin admin] PATH_INFO: `/v3/projects/bb576dc9e81045b88ce3a69e60ee3503` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:04.898315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64191b0d-20fd-439e-a9df-da206f726295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb576dc9e81045b88ce3a69e60ee3503)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:04.900209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64191b0d-20fd-439e-a9df-da206f726295 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:04.909845 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3407/6793] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:14:04.913358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b09c18-5f4c-442a-b2c3-c3b24ba3d405 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:04.928354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b09c18-5f4c-442a-b2c3-c3b24ba3d405 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:04.939009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa32301-0ff9-4ff2-81e8-04a6abb494d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:04.939970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa32301-0ff9-4ff2-81e8-04a6abb494d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:04.940416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa32301-0ff9-4ff2-81e8-04a6abb494d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:04.942191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa32301-0ff9-4ff2-81e8-04a6abb494d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:04.948578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa32301-0ff9-4ff2-81e8-04a6abb494d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:04.951347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa32301-0ff9-4ff2-81e8-04a6abb494d2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:04.968516 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3408/6794] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:14:04.972276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa32301-0ff9-4ff2-81e8-04a6abb494d2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:04.989262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64191b0d-20fd-439e-a9df-da206f726295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb576dc9e81045b88ce3a69e60ee3503', 'request_id': 'req-64191b0d-20fd-439e-a9df-da206f726295'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:05.001042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa32301-0ff9-4ff2-81e8-04a6abb494d2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:05.003115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64191b0d-20fd-439e-a9df-da206f726295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb576dc9e81045b88ce3a69e60ee3503', 'request_id': 'req-64191b0d-20fd-439e-a9df-da206f726295'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:05.012967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64191b0d-20fd-439e-a9df-da206f726295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb576dc9e81045b88ce3a69e60ee3503', 'request_id': 'req-64191b0d-20fd-439e-a9df-da206f726295'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:05.036844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64191b0d-20fd-439e-a9df-da206f726295 admin admin] The token cache is being invalidate because project bb576dc9e81045b88ce3a69e60ee3503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:14:05.037440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64191b0d-20fd-439e-a9df-da206f726295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:05.038323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64191b0d-20fd-439e-a9df-da206f726295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:05.041136 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3387/6795] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:14:04 2022] DELETE /identity/v3/projects/bb576dc9e81045b88ce3a69e60ee3503 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:14:05.045046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64191b0d-20fd-439e-a9df-da206f726295 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:05.049583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-64191b0d-20fd-439e-a9df-da206f726295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:05.080554 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:05.121200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ba6fa-3923-45f0-9330-6636a45c771a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:05.122090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ba6fa-3923-45f0-9330-6636a45c771a admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:05.122504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ba6fa-3923-45f0-9330-6636a45c771a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:05.122833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ba6fa-3923-45f0-9330-6636a45c771a admin admin] PATH_INFO: `/v3/projects/071f279646234ce881d0a41d2343a9b5/users/8395f9a327e342878d798de9204e2f0e/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:05.152710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ba6fa-3923-45f0-9330-6636a45c771a admin admin] RBAC: Authorizing `identity:create_grant(project_id=071f279646234ce881d0a41d2343a9b5, user_id=8395f9a327e342878d798de9204e2f0e, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:05.156665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ba6fa-3923-45f0-9330-6636a45c771a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:05.172980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64191b0d-20fd-439e-a9df-da206f726295 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:05.200723 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3409/6796] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:14:04 2022] PUT /identity/v3/projects/071f279646234ce881d0a41d2343a9b5/users/8395f9a327e342878d798de9204e2f0e/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:14:05.205021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05eb80-1054-4ba5-99e6-d37918330ee7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:05.208755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05eb80-1054-4ba5-99e6-d37918330ee7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:05.209140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05eb80-1054-4ba5-99e6-d37918330ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:05.265702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0e05eb80-1054-4ba5-99e6-d37918330ee7 None None] MFA Rules not processed for user `8395f9a327e342878d798de9204e2f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:05.267981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0e05eb80-1054-4ba5-99e6-d37918330ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:05.299780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd2d48-2246-4ba9-9cce-ee20defbfa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:05.309139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd2d48-2246-4ba9-9cce-ee20defbfa17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:05.309671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd2d48-2246-4ba9-9cce-ee20defbfa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:05.310111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd2d48-2246-4ba9-9cce-ee20defbfa17 admin admin] PATH_INFO: `/v3/users/6985d905e9084e598e078af7fac643bf` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:05.311531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd2d48-2246-4ba9-9cce-ee20defbfa17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6985d905e9084e598e078af7fac643bf)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:05.316037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd2d48-2246-4ba9-9cce-ee20defbfa17 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:05.381389 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=2,keystone:SELECT=87,keystone:DELETE=11 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:05.397685 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3410/6797] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:05.405601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05eb80-1054-4ba5-99e6-d37918330ee7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:05.409376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0e05eb80-1054-4ba5-99e6-d37918330ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:05.434393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05eb80-1054-4ba5-99e6-d37918330ee7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:05.440836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc7130-eb89-4eda-aef1-c399539e31e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:05.441794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc7130-eb89-4eda-aef1-c399539e31e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:05.442268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc7130-eb89-4eda-aef1-c399539e31e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:05.442743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc7130-eb89-4eda-aef1-c399539e31e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:05.443641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc7130-eb89-4eda-aef1-c399539e31e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:05.445989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc7130-eb89-4eda-aef1-c399539e31e2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:05.453706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-20dd2d48-2246-4ba9-9cce-ee20defbfa17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6985d905e9084e598e078af7fac643bf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:05.477251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-20dd2d48-2246-4ba9-9cce-ee20defbfa17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6985d905e9084e598e078af7fac643bf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:05.478325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-20dd2d48-2246-4ba9-9cce-ee20defbfa17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6985d905e9084e598e078af7fac643bf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:05.521740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-20dd2d48-2246-4ba9-9cce-ee20defbfa17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6985d905e9084e598e078af7fac643bf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:05.525702 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3411/6798] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:14:05 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:05.530303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc7130-eb89-4eda-aef1-c399539e31e2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:05.544277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-20dd2d48-2246-4ba9-9cce-ee20defbfa17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6985d905e9084e598e078af7fac643bf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:05.560714 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3388/6799] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:14:05 2022] DELETE /identity/v3/users/6985d905e9084e598e078af7fac643bf => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:05.567602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a281d03-3e8b-49a9-838d-64a67d30632f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:05.568117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a281d03-3e8b-49a9-838d-64a67d30632f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:05.568823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a281d03-3e8b-49a9-838d-64a67d30632f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:05.596196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1a281d03-3e8b-49a9-838d-64a67d30632f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:05.598310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1a281d03-3e8b-49a9-838d-64a67d30632f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:05.633486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc7130-eb89-4eda-aef1-c399539e31e2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:05.690093 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:05.733641 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3389/6800] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:05.737289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720031b3-ef06-439b-8f1f-cf8988122db1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:05.739220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720031b3-ef06-439b-8f1f-cf8988122db1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:05.741880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720031b3-ef06-439b-8f1f-cf8988122db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:05.746773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212a663-a3b4-4a1b-a3cf-69912efb1bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:05.748346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212a663-a3b4-4a1b-a3cf-69912efb1bcd admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:05.749376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212a663-a3b4-4a1b-a3cf-69912efb1bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:05.750628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212a663-a3b4-4a1b-a3cf-69912efb1bcd admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:05.754214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212a663-a3b4-4a1b-a3cf-69912efb1bcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:05.758122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212a663-a3b4-4a1b-a3cf-69912efb1bcd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:05.790856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-720031b3-ef06-439b-8f1f-cf8988122db1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:05.793860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-720031b3-ef06-439b-8f1f-cf8988122db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:05.810573 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3390/6801] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:05.815535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720031b3-ef06-439b-8f1f-cf8988122db1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:05.823199 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3412/6802] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:14:05 2022] POST /identity/v3/users => generated 289 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:05.823199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212a663-a3b4-4a1b-a3cf-69912efb1bcd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:05.831691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720031b3-ef06-439b-8f1f-cf8988122db1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:05.831915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3212a663-a3b4-4a1b-a3cf-69912efb1bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:05.842194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f38e2-9a53-4206-acd2-8dd62b7e070d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:05.842958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f38e2-9a53-4206-acd2-8dd62b7e070d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:05.843398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f38e2-9a53-4206-acd2-8dd62b7e070d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:05.843663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f38e2-9a53-4206-acd2-8dd62b7e070d admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:05.844632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f38e2-9a53-4206-acd2-8dd62b7e070d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:14:05.844858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f38e2-9a53-4206-acd2-8dd62b7e070d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:05.846576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f38e2-9a53-4206-acd2-8dd62b7e070d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:05.864009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212a663-a3b4-4a1b-a3cf-69912efb1bcd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:05.878664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2930d-ba5a-41a8-bf71-a22fd7559fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:05.881225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2930d-ba5a-41a8-bf71-a22fd7559fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:05.882622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2930d-ba5a-41a8-bf71-a22fd7559fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:05.883880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2930d-ba5a-41a8-bf71-a22fd7559fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:05.884753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2930d-ba5a-41a8-bf71-a22fd7559fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:05.886273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2930d-ba5a-41a8-bf71-a22fd7559fb2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:05.890554 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3391/6803] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:14:05.891248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f38e2-9a53-4206-acd2-8dd62b7e070d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:05.917492 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3413/6804] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:14:05.918732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2930d-ba5a-41a8-bf71-a22fd7559fb2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:05.923163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f38e2-9a53-4206-acd2-8dd62b7e070d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:05.944427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf3ad4-5bec-4b35-b782-29c1a7d29536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:05.946393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf3ad4-5bec-4b35-b782-29c1a7d29536 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:05.946678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf3ad4-5bec-4b35-b782-29c1a7d29536 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:05.950128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf3ad4-5bec-4b35-b782-29c1a7d29536 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:05.951285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf3ad4-5bec-4b35-b782-29c1a7d29536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:05.959834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf3ad4-5bec-4b35-b782-29c1a7d29536 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:05.968085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2930d-ba5a-41a8-bf71-a22fd7559fb2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:05.974346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119faad-82d6-478a-a993-94dfeb864d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:05.978076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119faad-82d6-478a-a993-94dfeb864d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:05.978750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119faad-82d6-478a-a993-94dfeb864d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:05.980691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119faad-82d6-478a-a993-94dfeb864d8c admin admin] PATH_INFO: `/v3/projects/a181eee39ea44ad38b812bdcde8b678d/users/a1b626770ab542a9a4dfe198f33ac02f/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:06.012236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119faad-82d6-478a-a993-94dfeb864d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a181eee39ea44ad38b812bdcde8b678d, user_id=a1b626770ab542a9a4dfe198f33ac02f, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:06.030248 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3392/6805] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:14:05 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:06.034981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119faad-82d6-478a-a993-94dfeb864d8c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:06.035907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf3ad4-5bec-4b35-b782-29c1a7d29536 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:06.067937 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3414/6806] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:14:05 2022] PUT /identity/v3/projects/a181eee39ea44ad38b812bdcde8b678d/users/a1b626770ab542a9a4dfe198f33ac02f/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:06.073454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119faad-82d6-478a-a993-94dfeb864d8c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:06.113964 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:06.140828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf3ad4-5bec-4b35-b782-29c1a7d29536 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:06.234528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119faad-82d6-478a-a993-94dfeb864d8c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:06.240139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de81c7-f679-49b0-85e8-d8d771f39c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:06.240795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de81c7-f679-49b0-85e8-d8d771f39c22 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:06.241109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de81c7-f679-49b0-85e8-d8d771f39c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:06.241353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de81c7-f679-49b0-85e8-d8d771f39c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:06.242000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de81c7-f679-49b0-85e8-d8d771f39c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:06.243628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de81c7-f679-49b0-85e8-d8d771f39c22 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:06.251864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917e7d7-4d8d-4823-a9f6-a4b7ab537845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:06.253365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917e7d7-4d8d-4823-a9f6-a4b7ab537845 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:06.253976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917e7d7-4d8d-4823-a9f6-a4b7ab537845 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:06.254406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917e7d7-4d8d-4823-a9f6-a4b7ab537845 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:06.255404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917e7d7-4d8d-4823-a9f6-a4b7ab537845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:06.257742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917e7d7-4d8d-4823-a9f6-a4b7ab537845 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:06.259016 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3415/6807] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:14:06.260166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de81c7-f679-49b0-85e8-d8d771f39c22 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:06.274438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de81c7-f679-49b0-85e8-d8d771f39c22 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:06.279722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbef1b-9566-456a-8fae-b01b3fa169e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:06.280456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbef1b-9566-456a-8fae-b01b3fa169e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:06.280793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbef1b-9566-456a-8fae-b01b3fa169e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:06.281068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbef1b-9566-456a-8fae-b01b3fa169e7 admin admin] PATH_INFO: `/v3/projects/a181eee39ea44ad38b812bdcde8b678d/users/a1b626770ab542a9a4dfe198f33ac02f/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:06.284057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbef1b-9566-456a-8fae-b01b3fa169e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a181eee39ea44ad38b812bdcde8b678d, user_id=a1b626770ab542a9a4dfe198f33ac02f, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:06.286954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbef1b-9566-456a-8fae-b01b3fa169e7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:06.291553 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3393/6808] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:14:06 2022] POST /identity/v3/users => generated 290 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:06.296000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917e7d7-4d8d-4823-a9f6-a4b7ab537845 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:06.304758 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3416/6809] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:14:06 2022] PUT /identity/v3/projects/a181eee39ea44ad38b812bdcde8b678d/users/a1b626770ab542a9a4dfe198f33ac02f/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:06.315407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1dba6-b4a1-4c46-9629-774eb6b5826c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:06.315773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1dba6-b4a1-4c46-9629-774eb6b5826c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:06.315971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1dba6-b4a1-4c46-9629-774eb6b5826c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:06.317160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917e7d7-4d8d-4823-a9f6-a4b7ab537845 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:06.349398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8dc1dba6-b4a1-4c46-9629-774eb6b5826c None None] MFA Rules not processed for user `a1b626770ab542a9a4dfe198f33ac02f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:06.350628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8dc1dba6-b4a1-4c46-9629-774eb6b5826c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:06.409480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819b93d-2b72-4f41-9b51-4dd774a628b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:06.410523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819b93d-2b72-4f41-9b51-4dd774a628b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:06.410976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819b93d-2b72-4f41-9b51-4dd774a628b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:06.411415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819b93d-2b72-4f41-9b51-4dd774a628b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:06.412246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819b93d-2b72-4f41-9b51-4dd774a628b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:06.414210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819b93d-2b72-4f41-9b51-4dd774a628b7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:06.431220 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3394/6810] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:14:06.434883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819b93d-2b72-4f41-9b51-4dd774a628b7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:06.459420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819b93d-2b72-4f41-9b51-4dd774a628b7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:06.472920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1964417-bc1c-4380-b43a-2fa0f31eef5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:06.474437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1964417-bc1c-4380-b43a-2fa0f31eef5a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:06.476531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1964417-bc1c-4380-b43a-2fa0f31eef5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:06.478564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1964417-bc1c-4380-b43a-2fa0f31eef5a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:06.479422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1964417-bc1c-4380-b43a-2fa0f31eef5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:06.482906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1964417-bc1c-4380-b43a-2fa0f31eef5a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:06.483603 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:06.498887 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3417/6811] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:06.503670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1dba6-b4a1-4c46-9629-774eb6b5826c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:06.512530 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3395/6812] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:14:06.513826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1964417-bc1c-4380-b43a-2fa0f31eef5a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:06.520239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1dba6-b4a1-4c46-9629-774eb6b5826c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:06.534983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1949d-4330-477f-bb7a-2c98f7acfcf1 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b626770ab542a9a4dfe198f33ac02f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a181eee39ea44ad38b812bdcde8b678d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:06.537617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1949d-4330-477f-bb7a-2c98f7acfcf1 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:06.537903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1949d-4330-477f-bb7a-2c98f7acfcf1 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:06.538182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1949d-4330-477f-bb7a-2c98f7acfcf1 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] PATH_INFO: `/v3/regions` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:06.538843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1949d-4330-477f-bb7a-2c98f7acfcf1 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:06.539862 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-0ff1949d-4330-477f-bb7a-2c98f7acfcf1 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:14:06.539862 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:14:06.539862 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:14:06.540774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1949d-4330-477f-bb7a-2c98f7acfcf1 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:06.544140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1964417-bc1c-4380-b43a-2fa0f31eef5a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:06.549595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0de21-bad1-4ca1-bdc9-01edf643ea9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:06.550273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0de21-bad1-4ca1-bdc9-01edf643ea9f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:06.550560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0de21-bad1-4ca1-bdc9-01edf643ea9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:06.550831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0de21-bad1-4ca1-bdc9-01edf643ea9f admin admin] PATH_INFO: `/v3/projects/7f28caf080c1463fb5b7de2902f9a4b5/users/45a25acf184b4bfc9f1b06dcf0e6d81b/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:06.575655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0de21-bad1-4ca1-bdc9-01edf643ea9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f28caf080c1463fb5b7de2902f9a4b5, user_id=45a25acf184b4bfc9f1b06dcf0e6d81b, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:06.584919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0de21-bad1-4ca1-bdc9-01edf643ea9f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:06.588851 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3418/6813] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:14:06 2022] POST /identity/v3/regions => generated 224 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:14:06.593727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1949d-4330-477f-bb7a-2c98f7acfcf1 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:06.627210 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3396/6814] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:14:06 2022] PUT /identity/v3/projects/7f28caf080c1463fb5b7de2902f9a4b5/users/45a25acf184b4bfc9f1b06dcf0e6d81b/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:06.628507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1949d-4330-477f-bb7a-2c98f7acfcf1 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:06.629817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8a120-60a4-4087-979b-37d1667d70f2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:06.630563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8a120-60a4-4087-979b-37d1667d70f2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:06.631031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8a120-60a4-4087-979b-37d1667d70f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:06.669748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ffb8a120-60a4-4087-979b-37d1667d70f2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:06.671450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ffb8a120-60a4-4087-979b-37d1667d70f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:06.735269 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:06.755927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef6b7d-5a06-457a-acf4-3ef3ea41ca5d tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b626770ab542a9a4dfe198f33ac02f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a181eee39ea44ad38b812bdcde8b678d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:06.756546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef6b7d-5a06-457a-acf4-3ef3ea41ca5d tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:06.757004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef6b7d-5a06-457a-acf4-3ef3ea41ca5d tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:06.757287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef6b7d-5a06-457a-acf4-3ef3ea41ca5d tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] PATH_INFO: `/v3/regions` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:06.757935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef6b7d-5a06-457a-acf4-3ef3ea41ca5d tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:06.760717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef6b7d-5a06-457a-acf4-3ef3ea41ca5d tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:06.775132 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3397/6815] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:06.783610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8a120-60a4-4087-979b-37d1667d70f2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:06.788348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ffb8a120-60a4-4087-979b-37d1667d70f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:06.794641 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3419/6816] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:14:06 2022] POST /identity/v3/regions => generated 224 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:06.796418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef6b7d-5a06-457a-acf4-3ef3ea41ca5d tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:06.827931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef6b7d-5a06-457a-acf4-3ef3ea41ca5d tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:06.833834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd18c2-3a2b-4983-b0e3-9173c09b7b0e tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b626770ab542a9a4dfe198f33ac02f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a181eee39ea44ad38b812bdcde8b678d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:06.834484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd18c2-3a2b-4983-b0e3-9173c09b7b0e tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:06.835037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd18c2-3a2b-4983-b0e3-9173c09b7b0e tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:06.835327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd18c2-3a2b-4983-b0e3-9173c09b7b0e tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] PATH_INFO: `/v3/regions/0d0f2dec-d29d-4a92-8eb7-950aade33fe2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:06.836002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd18c2-3a2b-4983-b0e3-9173c09b7b0e tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorizing `identity:create_region(region_id=0d0f2dec-d29d-4a92-8eb7-950aade33fe2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:06.837685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd18c2-3a2b-4983-b0e3-9173c09b7b0e tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:06.868935 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3420/6817] 10.222.0.16 () {60 vars in 1259 bytes} [Fri Sep 30 10:14:06 2022] PUT /identity/v3/regions/0d0f2dec-d29d-4a92-8eb7-950aade33fe2 => generated 232 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:06.870589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd18c2-3a2b-4983-b0e3-9173c09b7b0e tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:06.904941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd18c2-3a2b-4983-b0e3-9173c09b7b0e tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:06.913859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8a120-60a4-4087-979b-37d1667d70f2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:06.914881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d56369-f730-490c-804d-2df7e3ebf8e2 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b626770ab542a9a4dfe198f33ac02f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a181eee39ea44ad38b812bdcde8b678d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:06.915576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d56369-f730-490c-804d-2df7e3ebf8e2 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:06.915929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d56369-f730-490c-804d-2df7e3ebf8e2 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:06.916205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d56369-f730-490c-804d-2df7e3ebf8e2 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] PATH_INFO: `/v3/regions/0d0f2dec-d29d-4a92-8eb7-950aade33fe2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:06.917156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d56369-f730-490c-804d-2df7e3ebf8e2 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorizing `identity:delete_region(region_id=0d0f2dec-d29d-4a92-8eb7-950aade33fe2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:06.925404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d56369-f730-490c-804d-2df7e3ebf8e2 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:06.946815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69505f12-9ee1-4000-9b14-093213348eab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:06.947503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69505f12-9ee1-4000-9b14-093213348eab service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:06.947789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69505f12-9ee1-4000-9b14-093213348eab service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:06.948152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69505f12-9ee1-4000-9b14-093213348eab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:06.967189 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3421/6818] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Sep 30 10:14:06 2022] DELETE /identity/v3/regions/0d0f2dec-d29d-4a92-8eb7-950aade33fe2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:06.971840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d56369-f730-490c-804d-2df7e3ebf8e2 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:06.980276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69505f12-9ee1-4000-9b14-093213348eab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:06.982233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69505f12-9ee1-4000-9b14-093213348eab service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:07.009963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d56369-f730-490c-804d-2df7e3ebf8e2 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:07.015944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28974d2-24b5-4c71-be01-9e2f27fc4895 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b626770ab542a9a4dfe198f33ac02f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a181eee39ea44ad38b812bdcde8b678d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:07.016711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28974d2-24b5-4c71-be01-9e2f27fc4895 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:07.017001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28974d2-24b5-4c71-be01-9e2f27fc4895 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:07.017280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28974d2-24b5-4c71-be01-9e2f27fc4895 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] PATH_INFO: `/v3/regions` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:07.017935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28974d2-24b5-4c71-be01-9e2f27fc4895 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:07.019611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28974d2-24b5-4c71-be01-9e2f27fc4895 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:07.028828 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3398/6819] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:14:07.043714 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3422/6820] 10.222.0.16 () {60 vars in 1150 bytes} [Fri Sep 30 10:14:06 2022] POST /identity/v3/regions => generated 253 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:07.048063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69505f12-9ee1-4000-9b14-093213348eab service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:07.061424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69505f12-9ee1-4000-9b14-093213348eab service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:07.086869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca1701-089e-4239-bdb2-18c704b46660 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b626770ab542a9a4dfe198f33ac02f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a181eee39ea44ad38b812bdcde8b678d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:07.088195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca1701-089e-4239-bdb2-18c704b46660 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:07.090985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca1701-089e-4239-bdb2-18c704b46660 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:07.091636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca1701-089e-4239-bdb2-18c704b46660 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] PATH_INFO: `/v3/regions/fcf04dc3643446f2b2078958fbb3767b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:07.092419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca1701-089e-4239-bdb2-18c704b46660 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorizing `identity:update_region(region_id=fcf04dc3643446f2b2078958fbb3767b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:07.094159 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-38ca1701-089e-4239-bdb2-18c704b46660 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:14:07.094159 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:14:07.094159 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:14:07.095630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca1701-089e-4239-bdb2-18c704b46660 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:07.136756 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3399/6821] 10.222.0.16 () {60 vars in 1250 bytes} [Fri Sep 30 10:14:07 2022] PATCH /identity/v3/regions/fcf04dc3643446f2b2078958fbb3767b => generated 254 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:14:07.139131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28974d2-24b5-4c71-be01-9e2f27fc4895 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:07.157836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28974d2-24b5-4c71-be01-9e2f27fc4895 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:07.191623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e991bf-a04f-435a-ba5c-c5d886236425 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b626770ab542a9a4dfe198f33ac02f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a181eee39ea44ad38b812bdcde8b678d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:07.193165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e991bf-a04f-435a-ba5c-c5d886236425 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:07.194459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e991bf-a04f-435a-ba5c-c5d886236425 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:07.196066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e991bf-a04f-435a-ba5c-c5d886236425 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] PATH_INFO: `/v3/regions/fcf04dc3643446f2b2078958fbb3767b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:07.197624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e991bf-a04f-435a-ba5c-c5d886236425 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorizing `identity:get_region(region_id=fcf04dc3643446f2b2078958fbb3767b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:07.198934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e991bf-a04f-435a-ba5c-c5d886236425 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:07.218053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca1701-089e-4239-bdb2-18c704b46660 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:07.228918 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3423/6822] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Sep 30 10:14:07 2022] GET /identity/v3/regions/fcf04dc3643446f2b2078958fbb3767b => generated 254 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:14:07.237876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca1701-089e-4239-bdb2-18c704b46660 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:07.247573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7f08c-e274-498d-9d17-18065f96f80a tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b626770ab542a9a4dfe198f33ac02f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a181eee39ea44ad38b812bdcde8b678d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:07.249409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7f08c-e274-498d-9d17-18065f96f80a tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:07.250518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7f08c-e274-498d-9d17-18065f96f80a tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:07.253384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7f08c-e274-498d-9d17-18065f96f80a tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] PATH_INFO: `/v3/regions/fcf04dc3643446f2b2078958fbb3767b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:07.254957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7f08c-e274-498d-9d17-18065f96f80a tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorizing `identity:delete_region(region_id=fcf04dc3643446f2b2078958fbb3767b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:07.257259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7f08c-e274-498d-9d17-18065f96f80a tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:07.305365 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3400/6823] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:14:07 2022] DELETE /identity/v3/regions/fcf04dc3643446f2b2078958fbb3767b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:07.309202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e991bf-a04f-435a-ba5c-c5d886236425 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:07.323009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e991bf-a04f-435a-ba5c-c5d886236425 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:07.349260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacbb26-14ec-4444-bc8c-34359a8bb827 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b626770ab542a9a4dfe198f33ac02f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a181eee39ea44ad38b812bdcde8b678d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:07.350693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacbb26-14ec-4444-bc8c-34359a8bb827 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:07.351356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacbb26-14ec-4444-bc8c-34359a8bb827 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:07.351789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacbb26-14ec-4444-bc8c-34359a8bb827 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] PATH_INFO: `/v3/regions` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:07.352799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacbb26-14ec-4444-bc8c-34359a8bb827 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:07.354263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacbb26-14ec-4444-bc8c-34359a8bb827 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:07.359507 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:07.367563 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3424/6824] 10.222.0.16 () {58 vars in 1128 bytes} [Fri Sep 30 10:14:07 2022] GET /identity/v3/regions => generated 670 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:14:07.371371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7f08c-e274-498d-9d17-18065f96f80a tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:07.387857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7f08c-e274-498d-9d17-18065f96f80a tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:07.407936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5fbe4-cfe1-4e2e-a5b1-67a410747402 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b626770ab542a9a4dfe198f33ac02f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a181eee39ea44ad38b812bdcde8b678d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:07.408953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5fbe4-cfe1-4e2e-a5b1-67a410747402 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:07.409337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5fbe4-cfe1-4e2e-a5b1-67a410747402 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:07.409757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5fbe4-cfe1-4e2e-a5b1-67a410747402 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] PATH_INFO: `/v3/regions/fcf04dc3643446f2b2078958fbb3767b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:07.410461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5fbe4-cfe1-4e2e-a5b1-67a410747402 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorizing `identity:delete_region(region_id=fcf04dc3643446f2b2078958fbb3767b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:07.412231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5fbe4-cfe1-4e2e-a5b1-67a410747402 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:07.443811 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-17a5fbe4-cfe1-4e2e-a5b1-67a410747402 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Could not find region: fcf04dc3643446f2b2078958fbb3767b.: keystone.exception.RegionNotFound: Could not find region: fcf04dc3643446f2b2078958fbb3767b. Sep 30 10:14:07.443811 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:14:07.443811 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Sep 30 10:14:07.443811 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Sep 30 10:14:07.443811 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Sep 30 10:14:07.443811 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Sep 30 10:14:07.443811 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Sep 30 10:14:07.443811 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Sep 30 10:14:07.443811 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: fcf04dc3643446f2b2078958fbb3767b. Sep 30 10:14:07.443811 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:14:07.443811 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:14:07.443811 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:14:07.443811 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:14:07.443811 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:14:07.443811 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:14:07.443811 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:14:07.445247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:14:07.445247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:14:07.445247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:14:07.445247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:14:07.445247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:14:07.445247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:14:07.445247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:14:07.445247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Sep 30 10:14:07.445247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Sep 30 10:14:07.445247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:14:07.445247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:14:07.445247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Sep 30 10:14:07.445247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Sep 30 10:14:07.445247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: fcf04dc3643446f2b2078958fbb3767b. Sep 30 10:14:07.445247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:14:07.450534 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3401/6825] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:14:07 2022] DELETE /identity/v3/regions/fcf04dc3643446f2b2078958fbb3767b => generated 112 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:14:07.451433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacbb26-14ec-4444-bc8c-34359a8bb827 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:07.463943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacbb26-14ec-4444-bc8c-34359a8bb827 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:07.474506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9c555-45a4-4aeb-9d3b-660f2853ea67 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b626770ab542a9a4dfe198f33ac02f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a181eee39ea44ad38b812bdcde8b678d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:07.475498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9c555-45a4-4aeb-9d3b-660f2853ea67 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:07.475991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9c555-45a4-4aeb-9d3b-660f2853ea67 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:07.476484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9c555-45a4-4aeb-9d3b-660f2853ea67 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] PATH_INFO: `/v3/regions` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:07.477516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9c555-45a4-4aeb-9d3b-660f2853ea67 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:07.479415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9c555-45a4-4aeb-9d3b-660f2853ea67 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:07.488493 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3425/6826] 10.222.0.16 () {58 vars in 1128 bytes} [Fri Sep 30 10:14:07 2022] GET /identity/v3/regions => generated 670 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:14:07.492707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5fbe4-cfe1-4e2e-a5b1-67a410747402 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:07.504660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5fbe4-cfe1-4e2e-a5b1-67a410747402 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:07.511124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556e7b5-1fac-425e-8990-b4a3cf3c63f4 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b626770ab542a9a4dfe198f33ac02f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a181eee39ea44ad38b812bdcde8b678d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:07.511666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556e7b5-1fac-425e-8990-b4a3cf3c63f4 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:07.512355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556e7b5-1fac-425e-8990-b4a3cf3c63f4 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:07.512672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556e7b5-1fac-425e-8990-b4a3cf3c63f4 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] PATH_INFO: `/v3/regions` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:07.513327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556e7b5-1fac-425e-8990-b4a3cf3c63f4 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:07.514384 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-f556e7b5-1fac-425e-8990-b4a3cf3c63f4 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:14:07.514384 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:14:07.514384 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:14:07.515539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556e7b5-1fac-425e-8990-b4a3cf3c63f4 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:07.569969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9c555-45a4-4aeb-9d3b-660f2853ea67 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:07.572003 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3402/6827] 10.222.0.16 () {60 vars in 1150 bytes} [Fri Sep 30 10:14:07 2022] POST /identity/v3/regions => generated 254 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:07.592464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9c555-45a4-4aeb-9d3b-660f2853ea67 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:07.630945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808283a-277a-4d47-a75b-2bac60777d09 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b626770ab542a9a4dfe198f33ac02f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a181eee39ea44ad38b812bdcde8b678d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:07.631624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808283a-277a-4d47-a75b-2bac60777d09 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:07.631903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808283a-277a-4d47-a75b-2bac60777d09 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:07.632176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808283a-277a-4d47-a75b-2bac60777d09 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] PATH_INFO: `/v3/regions` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:07.632846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808283a-277a-4d47-a75b-2bac60777d09 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Adding query filter params (parent_region_id=cf77c8cad2cd4d35b1370c1f82e028df) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:14:07.633144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808283a-277a-4d47-a75b-2bac60777d09 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:07.634299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808283a-277a-4d47-a75b-2bac60777d09 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:07.643035 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3426/6828] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Sep 30 10:14:07 2022] GET /identity/v3/regions?parent_region_id=cf77c8cad2cd4d35b1370c1f82e028df => generated 400 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:14:07.644590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556e7b5-1fac-425e-8990-b4a3cf3c63f4 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:07.659095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556e7b5-1fac-425e-8990-b4a3cf3c63f4 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:07.662917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080532f-ee4a-4447-982f-5251e61c5b46 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b626770ab542a9a4dfe198f33ac02f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a181eee39ea44ad38b812bdcde8b678d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:07.663687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080532f-ee4a-4447-982f-5251e61c5b46 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:07.664056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080532f-ee4a-4447-982f-5251e61c5b46 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:07.664401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080532f-ee4a-4447-982f-5251e61c5b46 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] PATH_INFO: `/v3/regions/63440246d1a245129c9c0f20d2cf3f67` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:07.666187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080532f-ee4a-4447-982f-5251e61c5b46 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorizing `identity:delete_region(region_id=63440246d1a245129c9c0f20d2cf3f67)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:07.667665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080532f-ee4a-4447-982f-5251e61c5b46 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:07.710704 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3403/6829] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:14:07 2022] DELETE /identity/v3/regions/63440246d1a245129c9c0f20d2cf3f67 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:07.712148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808283a-277a-4d47-a75b-2bac60777d09 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:07.727760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808283a-277a-4d47-a75b-2bac60777d09 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:07.774305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192aaac1-2394-4960-bb62-0c2d2028fd40 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b626770ab542a9a4dfe198f33ac02f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a181eee39ea44ad38b812bdcde8b678d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:07.775040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192aaac1-2394-4960-bb62-0c2d2028fd40 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:07.775355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192aaac1-2394-4960-bb62-0c2d2028fd40 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:07.775710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192aaac1-2394-4960-bb62-0c2d2028fd40 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] PATH_INFO: `/v3/regions/d06da2d9127a4b06b9cdae1f389a0f11` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:07.776315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192aaac1-2394-4960-bb62-0c2d2028fd40 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorizing `identity:delete_region(region_id=d06da2d9127a4b06b9cdae1f389a0f11)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:07.782882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192aaac1-2394-4960-bb62-0c2d2028fd40 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:07.816965 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3427/6830] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:14:07 2022] DELETE /identity/v3/regions/d06da2d9127a4b06b9cdae1f389a0f11 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:07.820883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080532f-ee4a-4447-982f-5251e61c5b46 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:07.835004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080532f-ee4a-4447-982f-5251e61c5b46 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:07.856884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139abea1-44a6-4b78-ac65-d59b445fb03f tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b626770ab542a9a4dfe198f33ac02f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a181eee39ea44ad38b812bdcde8b678d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:07.857596 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139abea1-44a6-4b78-ac65-d59b445fb03f tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:07.858041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139abea1-44a6-4b78-ac65-d59b445fb03f tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:07.858329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139abea1-44a6-4b78-ac65-d59b445fb03f tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] PATH_INFO: `/v3/regions/cf77c8cad2cd4d35b1370c1f82e028df` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:07.858927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139abea1-44a6-4b78-ac65-d59b445fb03f tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorizing `identity:delete_region(region_id=cf77c8cad2cd4d35b1370c1f82e028df)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:07.861556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139abea1-44a6-4b78-ac65-d59b445fb03f tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:07.863287 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:07.908184 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3404/6831] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:14:07 2022] DELETE /identity/v3/regions/cf77c8cad2cd4d35b1370c1f82e028df => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:07.912325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192aaac1-2394-4960-bb62-0c2d2028fd40 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:07.937536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192aaac1-2394-4960-bb62-0c2d2028fd40 tempest-RegionsTestJSON-272781895 tempest-RegionsTestJSON-272781895-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:07.976852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c454a-989f-4b8b-ae2d-f697d0dda0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:07.977507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c454a-989f-4b8b-ae2d-f697d0dda0c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:07.977791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c454a-989f-4b8b-ae2d-f697d0dda0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:07.978071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c454a-989f-4b8b-ae2d-f697d0dda0c4 admin admin] PATH_INFO: `/v3/users/8395f9a327e342878d798de9204e2f0e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:08.005541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c454a-989f-4b8b-ae2d-f697d0dda0c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8395f9a327e342878d798de9204e2f0e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:08.011634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c454a-989f-4b8b-ae2d-f697d0dda0c4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:08.131655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-de5c454a-989f-4b8b-ae2d-f697d0dda0c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8395f9a327e342878d798de9204e2f0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:08.135612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-de5c454a-989f-4b8b-ae2d-f697d0dda0c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8395f9a327e342878d798de9204e2f0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:08.162944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-de5c454a-989f-4b8b-ae2d-f697d0dda0c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8395f9a327e342878d798de9204e2f0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:08.195867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-de5c454a-989f-4b8b-ae2d-f697d0dda0c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8395f9a327e342878d798de9204e2f0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:08.208338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-de5c454a-989f-4b8b-ae2d-f697d0dda0c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8395f9a327e342878d798de9204e2f0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:08.216235 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3428/6832] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:14:07 2022] DELETE /identity/v3/users/8395f9a327e342878d798de9204e2f0e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:08.221320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b569e-9f32-4ee5-a452-0a12aca81e76 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:08.222006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b569e-9f32-4ee5-a452-0a12aca81e76 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:08.222431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b569e-9f32-4ee5-a452-0a12aca81e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:08.245613 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-247b569e-9f32-4ee5-a452-0a12aca81e76 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:08.247286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-247b569e-9f32-4ee5-a452-0a12aca81e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:08.347704 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3405/6833] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:14:08.358009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c454a-989f-4b8b-ae2d-f697d0dda0c4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:08.359659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-de5c454a-989f-4b8b-ae2d-f697d0dda0c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:08.535033 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:08.541815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c454a-989f-4b8b-ae2d-f697d0dda0c4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:08.550382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1baab-6a83-4215-98ce-60ee65448343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:08.553510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1baab-6a83-4215-98ce-60ee65448343 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:08.553510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1baab-6a83-4215-98ce-60ee65448343 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:08.553510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1baab-6a83-4215-98ce-60ee65448343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:08.574660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1baab-6a83-4215-98ce-60ee65448343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:08.576348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1baab-6a83-4215-98ce-60ee65448343 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:08.593061 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3429/6834] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:14:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:14:09.369499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b569e-9f32-4ee5-a452-0a12aca81e76 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:09.371172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-247b569e-9f32-4ee5-a452-0a12aca81e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:09.405233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b569e-9f32-4ee5-a452-0a12aca81e76 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:09.413619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffab25b-3a3e-4d8f-8059-d820e87d5f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:09.414553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffab25b-3a3e-4d8f-8059-d820e87d5f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:09.415014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffab25b-3a3e-4d8f-8059-d820e87d5f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:09.415445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffab25b-3a3e-4d8f-8059-d820e87d5f36 admin admin] PATH_INFO: `/v3/projects/071f279646234ce881d0a41d2343a9b5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:09.416788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffab25b-3a3e-4d8f-8059-d820e87d5f36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=071f279646234ce881d0a41d2343a9b5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:09.419102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffab25b-3a3e-4d8f-8059-d820e87d5f36 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:09.505174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dffab25b-3a3e-4d8f-8059-d820e87d5f36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '071f279646234ce881d0a41d2343a9b5', 'request_id': 'req-dffab25b-3a3e-4d8f-8059-d820e87d5f36'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:09.517905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dffab25b-3a3e-4d8f-8059-d820e87d5f36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '071f279646234ce881d0a41d2343a9b5', 'request_id': 'req-dffab25b-3a3e-4d8f-8059-d820e87d5f36'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:09.527314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dffab25b-3a3e-4d8f-8059-d820e87d5f36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '071f279646234ce881d0a41d2343a9b5', 'request_id': 'req-dffab25b-3a3e-4d8f-8059-d820e87d5f36'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:09.544847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dffab25b-3a3e-4d8f-8059-d820e87d5f36 admin admin] The token cache is being invalidate because project 071f279646234ce881d0a41d2343a9b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:14:09.545140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dffab25b-3a3e-4d8f-8059-d820e87d5f36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:09.546828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dffab25b-3a3e-4d8f-8059-d820e87d5f36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:09.551913 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3406/6835] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:14:09 2022] DELETE /identity/v3/projects/071f279646234ce881d0a41d2343a9b5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:09.553187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1baab-6a83-4215-98ce-60ee65448343 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:09.568114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1baab-6a83-4215-98ce-60ee65448343 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:09.663868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b7302-7a5d-4b6f-8112-13a843e421f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:09.665724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b7302-7a5d-4b6f-8112-13a843e421f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:09.666261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b7302-7a5d-4b6f-8112-13a843e421f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:09.666790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b7302-7a5d-4b6f-8112-13a843e421f3 admin admin] PATH_INFO: `/v3/users/a1b626770ab542a9a4dfe198f33ac02f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:09.668281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b7302-7a5d-4b6f-8112-13a843e421f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b626770ab542a9a4dfe198f33ac02f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:09.670690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b7302-7a5d-4b6f-8112-13a843e421f3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:09.765309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-937b7302-7a5d-4b6f-8112-13a843e421f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b626770ab542a9a4dfe198f33ac02f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:09.766257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-937b7302-7a5d-4b6f-8112-13a843e421f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b626770ab542a9a4dfe198f33ac02f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:09.789062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-937b7302-7a5d-4b6f-8112-13a843e421f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b626770ab542a9a4dfe198f33ac02f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:09.803807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-937b7302-7a5d-4b6f-8112-13a843e421f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b626770ab542a9a4dfe198f33ac02f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:09.814108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-937b7302-7a5d-4b6f-8112-13a843e421f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b626770ab542a9a4dfe198f33ac02f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:09.827571 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3430/6836] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:14:09 2022] DELETE /identity/v3/users/a1b626770ab542a9a4dfe198f33ac02f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:10.260353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffab25b-3a3e-4d8f-8059-d820e87d5f36 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:10.262333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dffab25b-3a3e-4d8f-8059-d820e87d5f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:10.286488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffab25b-3a3e-4d8f-8059-d820e87d5f36 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:10.385290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd951836-37d9-421d-bdfb-de7d8f44af86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:10.386211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd951836-37d9-421d-bdfb-de7d8f44af86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:10.386495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd951836-37d9-421d-bdfb-de7d8f44af86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:10.386770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd951836-37d9-421d-bdfb-de7d8f44af86 admin admin] PATH_INFO: `/v3/projects/a181eee39ea44ad38b812bdcde8b678d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:10.388239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd951836-37d9-421d-bdfb-de7d8f44af86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a181eee39ea44ad38b812bdcde8b678d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:10.390459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd951836-37d9-421d-bdfb-de7d8f44af86 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:10.403854 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:10.468888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dd951836-37d9-421d-bdfb-de7d8f44af86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a181eee39ea44ad38b812bdcde8b678d', 'request_id': 'req-dd951836-37d9-421d-bdfb-de7d8f44af86'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:10.486276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dd951836-37d9-421d-bdfb-de7d8f44af86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a181eee39ea44ad38b812bdcde8b678d', 'request_id': 'req-dd951836-37d9-421d-bdfb-de7d8f44af86'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:10.497354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dd951836-37d9-421d-bdfb-de7d8f44af86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a181eee39ea44ad38b812bdcde8b678d', 'request_id': 'req-dd951836-37d9-421d-bdfb-de7d8f44af86'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:10.524155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dd951836-37d9-421d-bdfb-de7d8f44af86 admin admin] The token cache is being invalidate because project a181eee39ea44ad38b812bdcde8b678d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:14:10.525438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dd951836-37d9-421d-bdfb-de7d8f44af86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:10.528299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dd951836-37d9-421d-bdfb-de7d8f44af86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:10.529939 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3407/6837] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:14:10 2022] DELETE /identity/v3/projects/a181eee39ea44ad38b812bdcde8b678d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:10.538004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcae02-5333-4c56-adae-2b40417f1005 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:10.538525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcae02-5333-4c56-adae-2b40417f1005 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:10.538987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcae02-5333-4c56-adae-2b40417f1005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:10.584266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bffcae02-5333-4c56-adae-2b40417f1005 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:10.588733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bffcae02-5333-4c56-adae-2b40417f1005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:10.733550 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3431/6838] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:10.742620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a9e55-83dd-4c7b-8b54-c1afeef6c896 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:10.742905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a9e55-83dd-4c7b-8b54-c1afeef6c896 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:10.743183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a9e55-83dd-4c7b-8b54-c1afeef6c896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:10.801191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-096a9e55-83dd-4c7b-8b54-c1afeef6c896 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:10.802427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-096a9e55-83dd-4c7b-8b54-c1afeef6c896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:10.831576 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3408/6839] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:10.834913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcae02-5333-4c56-adae-2b40417f1005 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:10.848096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcae02-5333-4c56-adae-2b40417f1005 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:10.862033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff25ad-c5f6-4687-9f37-c39c8240211d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:10.862655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff25ad-c5f6-4687-9f37-c39c8240211d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:10.862935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff25ad-c5f6-4687-9f37-c39c8240211d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:10.863359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff25ad-c5f6-4687-9f37-c39c8240211d admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:10.864022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff25ad-c5f6-4687-9f37-c39c8240211d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:14:10.864323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff25ad-c5f6-4687-9f37-c39c8240211d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:10.866227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff25ad-c5f6-4687-9f37-c39c8240211d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:10.887628 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:10.902047 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3432/6840] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:14:10.903130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a9e55-83dd-4c7b-8b54-c1afeef6c896 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:10.917855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a9e55-83dd-4c7b-8b54-c1afeef6c896 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:10.937631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b12441-cbb2-4df3-bd4b-a33873e638d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:10.941774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b12441-cbb2-4df3-bd4b-a33873e638d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:10.942072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b12441-cbb2-4df3-bd4b-a33873e638d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:10.942342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b12441-cbb2-4df3-bd4b-a33873e638d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:10.943000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b12441-cbb2-4df3-bd4b-a33873e638d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:10.944957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b12441-cbb2-4df3-bd4b-a33873e638d5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:11.025180 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3409/6841] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:14:10 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:11.029407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff25ad-c5f6-4687-9f37-c39c8240211d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:11.058100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff25ad-c5f6-4687-9f37-c39c8240211d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:11.194957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f37030-ff9e-4220-b4a3-be5b96b26aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:11.195576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f37030-ff9e-4220-b4a3-be5b96b26aed admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:11.195857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f37030-ff9e-4220-b4a3-be5b96b26aed admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:11.197235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f37030-ff9e-4220-b4a3-be5b96b26aed admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:11.198401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f37030-ff9e-4220-b4a3-be5b96b26aed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:11.201464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f37030-ff9e-4220-b4a3-be5b96b26aed admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:11.235434 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3433/6842] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:14:11 2022] POST /identity/v3/users => generated 285 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:14:11.239560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b12441-cbb2-4df3-bd4b-a33873e638d5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:11.257177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b12441-cbb2-4df3-bd4b-a33873e638d5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:11.263693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a3589-7cb2-41ec-a235-2cdb073cf199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:11.265501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a3589-7cb2-41ec-a235-2cdb073cf199 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:11.266301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a3589-7cb2-41ec-a235-2cdb073cf199 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:11.266855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a3589-7cb2-41ec-a235-2cdb073cf199 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:11.267522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a3589-7cb2-41ec-a235-2cdb073cf199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:11.269735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a3589-7cb2-41ec-a235-2cdb073cf199 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:11.490786 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3410/6843] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:14:11.492182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f37030-ff9e-4220-b4a3-be5b96b26aed admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:11.508827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f37030-ff9e-4220-b4a3-be5b96b26aed admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:11.516383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5612ce-566a-4a2c-aad8-02c7b1872287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:11.518011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5612ce-566a-4a2c-aad8-02c7b1872287 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:11.518290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5612ce-566a-4a2c-aad8-02c7b1872287 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:11.518562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5612ce-566a-4a2c-aad8-02c7b1872287 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:11.519583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5612ce-566a-4a2c-aad8-02c7b1872287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:11.521910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5612ce-566a-4a2c-aad8-02c7b1872287 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:11.546541 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3434/6844] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:14:11.548397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a3589-7cb2-41ec-a235-2cdb073cf199 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:11.564092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a3589-7cb2-41ec-a235-2cdb073cf199 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:11.580286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de693a0-4e5d-45c3-97b3-d8de0563e915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:11.580986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de693a0-4e5d-45c3-97b3-d8de0563e915 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:11.581263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de693a0-4e5d-45c3-97b3-d8de0563e915 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:11.581529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de693a0-4e5d-45c3-97b3-d8de0563e915 admin admin] PATH_INFO: `/v3/projects/7654039d3e8a4902940fa3763f0247fe/users/c8b019eeca4c4cd69ac4a1c0e3dc8618/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:11.623177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de693a0-4e5d-45c3-97b3-d8de0563e915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7654039d3e8a4902940fa3763f0247fe, user_id=c8b019eeca4c4cd69ac4a1c0e3dc8618, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:11.631499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de693a0-4e5d-45c3-97b3-d8de0563e915 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:11.666438 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3411/6845] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:14:11 2022] PUT /identity/v3/projects/7654039d3e8a4902940fa3763f0247fe/users/c8b019eeca4c4cd69ac4a1c0e3dc8618/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:11.678032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8ab6c-6b6c-4b4b-bf91-0a6b211a60f6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:11.678573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8ab6c-6b6c-4b4b-bf91-0a6b211a60f6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:11.678695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8ab6c-6b6c-4b4b-bf91-0a6b211a60f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:11.742583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-62f8ab6c-6b6c-4b4b-bf91-0a6b211a60f6 None None] MFA Rules not processed for user `c8b019eeca4c4cd69ac4a1c0e3dc8618`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:11.743985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-62f8ab6c-6b6c-4b4b-bf91-0a6b211a60f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:11.931943 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3435/6846] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:11.936964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de693a0-4e5d-45c3-97b3-d8de0563e915 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:11.962800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de693a0-4e5d-45c3-97b3-d8de0563e915 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:11.976374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed554d-014f-49d7-b12e-dd3b8ac797a1 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b019eeca4c4cd69ac4a1c0e3dc8618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7654039d3e8a4902940fa3763f0247fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:11.977058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed554d-014f-49d7-b12e-dd3b8ac797a1 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:11.977337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed554d-014f-49d7-b12e-dd3b8ac797a1 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:11.977609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed554d-014f-49d7-b12e-dd3b8ac797a1 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] PATH_INFO: `/v3/users/c8b019eeca4c4cd69ac4a1c0e3dc8618/application_credentials` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:11.978282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed554d-014f-49d7-b12e-dd3b8ac797a1 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: Authorizing `identity:create_application_credential(user_id=c8b019eeca4c4cd69ac4a1c0e3dc8618)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:11.979432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed554d-014f-49d7-b12e-dd3b8ac797a1 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:12.299581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8ab6c-6b6c-4b4b-bf91-0a6b211a60f6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:12.300870 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3412/6847] 10.222.0.16 () {60 vars in 1315 bytes} [Fri Sep 30 10:14:11 2022] POST /identity/v3/users/c8b019eeca4c4cd69ac4a1c0e3dc8618/application_credentials => generated 921 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:12.311686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8ab6c-6b6c-4b4b-bf91-0a6b211a60f6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:12.331263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c0e05-686a-4b37-929e-3d25fb3d059c tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b019eeca4c4cd69ac4a1c0e3dc8618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7654039d3e8a4902940fa3763f0247fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:12.337188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c0e05-686a-4b37-929e-3d25fb3d059c tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:12.338757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c0e05-686a-4b37-929e-3d25fb3d059c tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:12.341914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c0e05-686a-4b37-929e-3d25fb3d059c tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] PATH_INFO: `/v3/users/c8b019eeca4c4cd69ac4a1c0e3dc8618/access_rules/f94c2fc4189a48f090e2497534ea8686` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:12.345433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c0e05-686a-4b37-929e-3d25fb3d059c tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: Authorizing `identity:delete_access_rule(user_id=c8b019eeca4c4cd69ac4a1c0e3dc8618, access_rule_id=f94c2fc4189a48f090e2497534ea8686)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:12.350951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c0e05-686a-4b37-929e-3d25fb3d059c tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:12.458335 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-2f3c0e05-686a-4b37-929e-3d25fb3d059c tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Sep 30 10:14:12.458335 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:14:12.458335 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Sep 30 10:14:12.458335 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application session.delete(ref) Sep 30 10:14:12.458335 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 10:14:12.458335 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application next(self.gen) Sep 30 10:14:12.458335 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 30 10:14:12.458335 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application yield resource Sep 30 10:14:12.458335 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 10:14:12.458335 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application next(self.gen) Sep 30 10:14:12.458335 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 30 10:14:12.458335 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.session.rollback() Sep 30 10:14:12.458335 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 30 10:14:12.458335 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.force_reraise() Sep 30 10:14:12.458335 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 30 10:14:12.458335 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise self.value Sep 30 10:14:12.459678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 30 10:14:12.459678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 30 10:14:12.459678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 30 10:14:12.459678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application session.commit() Sep 30 10:14:12.459678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 30 10:14:12.459678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 30 10:14:12.459678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 30 10:14:12.459678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._prepare_impl() Sep 30 10:14:12.459678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 30 10:14:12.459678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.session.flush() Sep 30 10:14:12.459678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 30 10:14:12.459678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._flush(objects) Sep 30 10:14:12.459678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 30 10:14:12.459678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 30 10:14:12.459678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 30 10:14:12.459678 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application compat.raise_( Sep 30 10:14:12.460949 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 10:14:12.460949 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception Sep 30 10:14:12.460949 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 30 10:14:12.460949 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application flush_context.execute() Sep 30 10:14:12.460949 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 30 10:14:12.460949 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rec.execute(self) Sep 30 10:14:12.460949 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Sep 30 10:14:12.460949 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Sep 30 10:14:12.460949 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Sep 30 10:14:12.460949 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._synchronize( Sep 30 10:14:12.460949 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Sep 30 10:14:12.460949 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Sep 30 10:14:12.460949 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Sep 30 10:14:12.460949 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise AssertionError( Sep 30 10:14:12.460949 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Sep 30 10:14:12.460949 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:14:12.462424 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:14:12.462424 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:14:12.462424 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:14:12.462424 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:14:12.462424 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:14:12.462424 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:14:12.462424 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:14:12.462424 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:14:12.462424 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:14:12.462424 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:14:12.462424 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:14:12.462424 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:14:12.462424 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:14:12.462424 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Sep 30 10:14:12.462424 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Sep 30 10:14:12.462424 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:14:12.462424 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:14:12.463706 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Sep 30 10:14:12.463706 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Sep 30 10:14:12.463706 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Sep 30 10:14:12.463706 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Sep 30 10:14:12.463706 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Sep 30 10:14:12.463706 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:14:12.470872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed554d-014f-49d7-b12e-dd3b8ac797a1 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:12.477636 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3436/6848] 10.222.0.16 () {58 vars in 1362 bytes} [Fri Sep 30 10:14:12 2022] DELETE /identity/v3/users/c8b019eeca4c4cd69ac4a1c0e3dc8618/access_rules/f94c2fc4189a48f090e2497534ea8686 => generated 89 bytes in 173 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Sep 30 10:14:12.483548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed554d-014f-49d7-b12e-dd3b8ac797a1 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:12.506296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656d6c5-d7ab-4a75-a3bc-f19cb84d03d1 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b019eeca4c4cd69ac4a1c0e3dc8618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7654039d3e8a4902940fa3763f0247fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:12.520685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656d6c5-d7ab-4a75-a3bc-f19cb84d03d1 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:12.520685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656d6c5-d7ab-4a75-a3bc-f19cb84d03d1 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:12.520685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656d6c5-d7ab-4a75-a3bc-f19cb84d03d1 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] PATH_INFO: `/v3/users/c8b019eeca4c4cd69ac4a1c0e3dc8618/application_credentials/0de43ec113744186806d4485464de816` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:12.579372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656d6c5-d7ab-4a75-a3bc-f19cb84d03d1 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: Authorizing `identity:delete_application_credential(user_id=c8b019eeca4c4cd69ac4a1c0e3dc8618, application_credential_id=0de43ec113744186806d4485464de816)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:12.581626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656d6c5-d7ab-4a75-a3bc-f19cb84d03d1 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:12.595580 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:12.675189 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3413/6849] 10.222.0.16 () {58 vars in 1395 bytes} [Fri Sep 30 10:14:12 2022] DELETE /identity/v3/users/c8b019eeca4c4cd69ac4a1c0e3dc8618/application_credentials/0de43ec113744186806d4485464de816 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:14:12.678449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c0e05-686a-4b37-929e-3d25fb3d059c tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:12.708360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c0e05-686a-4b37-929e-3d25fb3d059c tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:12.717265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238432f6-50a1-48ff-ac38-976988c6f026 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b019eeca4c4cd69ac4a1c0e3dc8618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7654039d3e8a4902940fa3763f0247fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:12.718292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238432f6-50a1-48ff-ac38-976988c6f026 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:12.721345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238432f6-50a1-48ff-ac38-976988c6f026 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:12.722350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238432f6-50a1-48ff-ac38-976988c6f026 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] PATH_INFO: `/v3/users/c8b019eeca4c4cd69ac4a1c0e3dc8618/access_rules` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:12.728462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238432f6-50a1-48ff-ac38-976988c6f026 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: Authorizing `identity:list_access_rules(user_id=c8b019eeca4c4cd69ac4a1c0e3dc8618)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:12.730884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238432f6-50a1-48ff-ac38-976988c6f026 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:12.744353 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3437/6850] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Sep 30 10:14:12 2022] GET /identity/v3/users/c8b019eeca4c4cd69ac4a1c0e3dc8618/access_rules => generated 369 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:14:12.749155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656d6c5-d7ab-4a75-a3bc-f19cb84d03d1 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:12.763955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656d6c5-d7ab-4a75-a3bc-f19cb84d03d1 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:12.772359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91368010-f732-4ee2-aead-7477de1fff6b tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b019eeca4c4cd69ac4a1c0e3dc8618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7654039d3e8a4902940fa3763f0247fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:12.773868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91368010-f732-4ee2-aead-7477de1fff6b tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:12.775262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91368010-f732-4ee2-aead-7477de1fff6b tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:12.776089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91368010-f732-4ee2-aead-7477de1fff6b tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] PATH_INFO: `/v3/users/c8b019eeca4c4cd69ac4a1c0e3dc8618/access_rules/f94c2fc4189a48f090e2497534ea8686` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:12.778486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91368010-f732-4ee2-aead-7477de1fff6b tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: Authorizing `identity:delete_access_rule(user_id=c8b019eeca4c4cd69ac4a1c0e3dc8618, access_rule_id=f94c2fc4189a48f090e2497534ea8686)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:12.780978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91368010-f732-4ee2-aead-7477de1fff6b tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:12.827876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238432f6-50a1-48ff-ac38-976988c6f026 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:12.830495 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3414/6851] 10.222.0.16 () {58 vars in 1362 bytes} [Fri Sep 30 10:14:12 2022] DELETE /identity/v3/users/c8b019eeca4c4cd69ac4a1c0e3dc8618/access_rules/f94c2fc4189a48f090e2497534ea8686 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:12.841582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238432f6-50a1-48ff-ac38-976988c6f026 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:12.849251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adaca07-8ca6-4670-aeb9-584eb94876d9 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b019eeca4c4cd69ac4a1c0e3dc8618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7654039d3e8a4902940fa3763f0247fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:12.850321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaca07-8ca6-4670-aeb9-584eb94876d9 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:12.851143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaca07-8ca6-4670-aeb9-584eb94876d9 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:12.851715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaca07-8ca6-4670-aeb9-584eb94876d9 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] PATH_INFO: `/v3/users/c8b019eeca4c4cd69ac4a1c0e3dc8618/access_rules` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:12.854919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adaca07-8ca6-4670-aeb9-584eb94876d9 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: Authorizing `identity:list_access_rules(user_id=c8b019eeca4c4cd69ac4a1c0e3dc8618)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:12.859321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adaca07-8ca6-4670-aeb9-584eb94876d9 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:12.879267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91368010-f732-4ee2-aead-7477de1fff6b tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:12.886980 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3438/6852] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Sep 30 10:14:12 2022] GET /identity/v3/users/c8b019eeca4c4cd69ac4a1c0e3dc8618/access_rules => generated 158 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:14:12.893190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91368010-f732-4ee2-aead-7477de1fff6b tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:12.900448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de18aa0-1158-4bd5-b178-8bb2b2e92758 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b019eeca4c4cd69ac4a1c0e3dc8618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7654039d3e8a4902940fa3763f0247fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:12.901710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de18aa0-1158-4bd5-b178-8bb2b2e92758 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:12.902318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de18aa0-1158-4bd5-b178-8bb2b2e92758 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:12.903232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de18aa0-1158-4bd5-b178-8bb2b2e92758 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] PATH_INFO: `/v3/users/c8b019eeca4c4cd69ac4a1c0e3dc8618/application_credentials` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:12.904139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de18aa0-1158-4bd5-b178-8bb2b2e92758 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: Authorizing `identity:create_application_credential(user_id=c8b019eeca4c4cd69ac4a1c0e3dc8618)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:12.905754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de18aa0-1158-4bd5-b178-8bb2b2e92758 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:13.083462 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3415/6853] 10.222.0.16 () {60 vars in 1315 bytes} [Fri Sep 30 10:14:12 2022] POST /identity/v3/users/c8b019eeca4c4cd69ac4a1c0e3dc8618/application_credentials => generated 921 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:13.088627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adaca07-8ca6-4670-aeb9-584eb94876d9 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:13.103497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adaca07-8ca6-4670-aeb9-584eb94876d9 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:13.118666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288ffaf-fdb7-4336-a274-7fe25ff1213f tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b019eeca4c4cd69ac4a1c0e3dc8618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7654039d3e8a4902940fa3763f0247fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:13.119570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288ffaf-fdb7-4336-a274-7fe25ff1213f tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:13.120143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288ffaf-fdb7-4336-a274-7fe25ff1213f tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:13.121150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288ffaf-fdb7-4336-a274-7fe25ff1213f tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] PATH_INFO: `/v3/users/c8b019eeca4c4cd69ac4a1c0e3dc8618/access_rules` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:13.123427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288ffaf-fdb7-4336-a274-7fe25ff1213f tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: Authorizing `identity:list_access_rules(user_id=c8b019eeca4c4cd69ac4a1c0e3dc8618)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:13.128747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288ffaf-fdb7-4336-a274-7fe25ff1213f tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:13.164051 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3439/6854] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Sep 30 10:14:13 2022] GET /identity/v3/users/c8b019eeca4c4cd69ac4a1c0e3dc8618/access_rules => generated 369 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:14:13.164391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de18aa0-1158-4bd5-b178-8bb2b2e92758 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:13.177247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de18aa0-1158-4bd5-b178-8bb2b2e92758 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:13.183270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef963fa-651c-40b7-a166-e4651d8a0865 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b019eeca4c4cd69ac4a1c0e3dc8618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7654039d3e8a4902940fa3763f0247fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:13.185347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef963fa-651c-40b7-a166-e4651d8a0865 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:13.185743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef963fa-651c-40b7-a166-e4651d8a0865 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:13.187354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef963fa-651c-40b7-a166-e4651d8a0865 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] PATH_INFO: `/v3/users/c8b019eeca4c4cd69ac4a1c0e3dc8618/application_credentials` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:13.188538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef963fa-651c-40b7-a166-e4651d8a0865 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: Authorizing `identity:create_application_credential(user_id=c8b019eeca4c4cd69ac4a1c0e3dc8618)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:13.190241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef963fa-651c-40b7-a166-e4651d8a0865 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:13.342306 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3416/6855] 10.222.0.16 () {60 vars in 1315 bytes} [Fri Sep 30 10:14:13 2022] POST /identity/v3/users/c8b019eeca4c4cd69ac4a1c0e3dc8618/application_credentials => generated 920 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:13.347678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288ffaf-fdb7-4336-a274-7fe25ff1213f tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:13.361442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288ffaf-fdb7-4336-a274-7fe25ff1213f tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:13.366063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8c533-fc25-4530-bbd2-2bde4b1ab730 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b019eeca4c4cd69ac4a1c0e3dc8618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7654039d3e8a4902940fa3763f0247fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:13.367744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8c533-fc25-4530-bbd2-2bde4b1ab730 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:13.368012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8c533-fc25-4530-bbd2-2bde4b1ab730 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:13.368286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8c533-fc25-4530-bbd2-2bde4b1ab730 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] PATH_INFO: `/v3/users/c8b019eeca4c4cd69ac4a1c0e3dc8618/access_rules/0a8da284fd5b4c16b7202adcec4dd691` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:13.370325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8c533-fc25-4530-bbd2-2bde4b1ab730 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: Authorizing `identity:get_access_rule(user_id=c8b019eeca4c4cd69ac4a1c0e3dc8618, access_rule_id=0a8da284fd5b4c16b7202adcec4dd691)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:13.372079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8c533-fc25-4530-bbd2-2bde4b1ab730 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:13.389881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef963fa-651c-40b7-a166-e4651d8a0865 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:13.390338 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3440/6856] 10.222.0.16 () {58 vars in 1359 bytes} [Fri Sep 30 10:14:13 2022] GET /identity/v3/users/c8b019eeca4c4cd69ac4a1c0e3dc8618/access_rules/0a8da284fd5b4c16b7202adcec4dd691 => generated 229 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:14:13.466906 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=4,keystone:INSERT=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:13.499880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef963fa-651c-40b7-a166-e4651d8a0865 tempest-AccessRulesV3Test-744466968 tempest-AccessRulesV3Test-744466968-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:13.513585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18e877-cb34-4b6a-b70f-5eb31e1e7315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:13.518805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18e877-cb34-4b6a-b70f-5eb31e1e7315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:13.519157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18e877-cb34-4b6a-b70f-5eb31e1e7315 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:13.522582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18e877-cb34-4b6a-b70f-5eb31e1e7315 admin admin] PATH_INFO: `/v3/users/c8b019eeca4c4cd69ac4a1c0e3dc8618` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:13.527995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18e877-cb34-4b6a-b70f-5eb31e1e7315 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8b019eeca4c4cd69ac4a1c0e3dc8618)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:13.530866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18e877-cb34-4b6a-b70f-5eb31e1e7315 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:13.654079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8c18e877-cb34-4b6a-b70f-5eb31e1e7315 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8b019eeca4c4cd69ac4a1c0e3dc8618'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:13.674988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8c18e877-cb34-4b6a-b70f-5eb31e1e7315 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8b019eeca4c4cd69ac4a1c0e3dc8618'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:13.676318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8c18e877-cb34-4b6a-b70f-5eb31e1e7315 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8b019eeca4c4cd69ac4a1c0e3dc8618'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:13.779711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8c18e877-cb34-4b6a-b70f-5eb31e1e7315 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8b019eeca4c4cd69ac4a1c0e3dc8618'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:13.798209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8c18e877-cb34-4b6a-b70f-5eb31e1e7315 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8b019eeca4c4cd69ac4a1c0e3dc8618'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:13.818083 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3417/6857] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:14:13 2022] DELETE /identity/v3/users/c8b019eeca4c4cd69ac4a1c0e3dc8618 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:13.822822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f50f41-0642-440e-bf5a-c34ba60702f1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:13.823335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f50f41-0642-440e-bf5a-c34ba60702f1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:13.823420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f50f41-0642-440e-bf5a-c34ba60702f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:13.875850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-72f50f41-0642-440e-bf5a-c34ba60702f1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:13.877340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-72f50f41-0642-440e-bf5a-c34ba60702f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:13.900068 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:14.004775 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3441/6858] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:14.016460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18e877-cb34-4b6a-b70f-5eb31e1e7315 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:14.018548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8c18e877-cb34-4b6a-b70f-5eb31e1e7315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:14.154011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18e877-cb34-4b6a-b70f-5eb31e1e7315 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:14.158904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1249032-81b5-4aa3-ac81-25a0733a2e87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:14.159524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1249032-81b5-4aa3-ac81-25a0733a2e87 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:14.159800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1249032-81b5-4aa3-ac81-25a0733a2e87 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:14.160070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1249032-81b5-4aa3-ac81-25a0733a2e87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:14.179628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1249032-81b5-4aa3-ac81-25a0733a2e87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:14.181166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1249032-81b5-4aa3-ac81-25a0733a2e87 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:14.197068 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3418/6859] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:14:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:14:14.810272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f50f41-0642-440e-bf5a-c34ba60702f1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:14.811739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-72f50f41-0642-440e-bf5a-c34ba60702f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:14.842742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f50f41-0642-440e-bf5a-c34ba60702f1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:14.882441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e884a0e-434c-43e0-8071-4a5803aadb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:14.883115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e884a0e-434c-43e0-8071-4a5803aadb4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:14.884018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e884a0e-434c-43e0-8071-4a5803aadb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:14.885047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e884a0e-434c-43e0-8071-4a5803aadb4c admin admin] PATH_INFO: `/v3/projects/7654039d3e8a4902940fa3763f0247fe` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:14.888535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e884a0e-434c-43e0-8071-4a5803aadb4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7654039d3e8a4902940fa3763f0247fe)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:14.892291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e884a0e-434c-43e0-8071-4a5803aadb4c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:14.981711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf28c7a-b4f3-4d26-9e74-307e4435bb55 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:14.982506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf28c7a-b4f3-4d26-9e74-307e4435bb55 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:14.982930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf28c7a-b4f3-4d26-9e74-307e4435bb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:15.097450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0cf28c7a-b4f3-4d26-9e74-307e4435bb55 None None] MFA Rules not processed for user `45a25acf184b4bfc9f1b06dcf0e6d81b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:15.098775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0cf28c7a-b4f3-4d26-9e74-307e4435bb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:15.104256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6e884a0e-434c-43e0-8071-4a5803aadb4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7654039d3e8a4902940fa3763f0247fe', 'request_id': 'req-6e884a0e-434c-43e0-8071-4a5803aadb4c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:15.133160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6e884a0e-434c-43e0-8071-4a5803aadb4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7654039d3e8a4902940fa3763f0247fe', 'request_id': 'req-6e884a0e-434c-43e0-8071-4a5803aadb4c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:15.151289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6e884a0e-434c-43e0-8071-4a5803aadb4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7654039d3e8a4902940fa3763f0247fe', 'request_id': 'req-6e884a0e-434c-43e0-8071-4a5803aadb4c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:15.193923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6e884a0e-434c-43e0-8071-4a5803aadb4c admin admin] The token cache is being invalidate because project 7654039d3e8a4902940fa3763f0247fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:14:15.194244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6e884a0e-434c-43e0-8071-4a5803aadb4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:15.197688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6e884a0e-434c-43e0-8071-4a5803aadb4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:15.205786 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3442/6860] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:14:14 2022] DELETE /identity/v3/projects/7654039d3e8a4902940fa3763f0247fe => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:15.206930 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:15.228586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc58c1-f0c5-4d0a-b152-47d3f24ec13f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:15.228936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc58c1-f0c5-4d0a-b152-47d3f24ec13f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:15.229228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc58c1-f0c5-4d0a-b152-47d3f24ec13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:15.282589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-72cc58c1-f0c5-4d0a-b152-47d3f24ec13f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:15.293661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-72cc58c1-f0c5-4d0a-b152-47d3f24ec13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:15.339729 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3419/6861] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:14:15.341466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf28c7a-b4f3-4d26-9e74-307e4435bb55 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:15.347423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0cf28c7a-b4f3-4d26-9e74-307e4435bb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:15.478949 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3443/6862] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:15.488277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf28c7a-b4f3-4d26-9e74-307e4435bb55 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:15.494110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0da86e-5384-4695-8568-3988a0d2034a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:15.494745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0da86e-5384-4695-8568-3988a0d2034a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:15.495024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0da86e-5384-4695-8568-3988a0d2034a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:15.495298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0da86e-5384-4695-8568-3988a0d2034a admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:15.495943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0da86e-5384-4695-8568-3988a0d2034a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:15.497889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0da86e-5384-4695-8568-3988a0d2034a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:15.499922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8d2c8-51de-47a4-b4c3-ad432f7d2784 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:15.500969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8d2c8-51de-47a4-b4c3-ad432f7d2784 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:15.501421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8d2c8-51de-47a4-b4c3-ad432f7d2784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:15.554293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-dac8d2c8-51de-47a4-b4c3-ad432f7d2784 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:15.556877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dac8d2c8-51de-47a4-b4c3-ad432f7d2784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:15.581883 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3444/6864] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:15.584282 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3420/6864] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:14:15 2022] POST /identity/v3/projects => generated 377 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:15.586170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0da86e-5384-4695-8568-3988a0d2034a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:15.586552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8d2c8-51de-47a4-b4c3-ad432f7d2784 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:15.624404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8d2c8-51de-47a4-b4c3-ad432f7d2784 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:15.754366 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:15.790420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8d7f7-9ebb-4c77-a7ab-f1b895e5b0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:15.791325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8d7f7-9ebb-4c77-a7ab-f1b895e5b0e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:15.791763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8d7f7-9ebb-4c77-a7ab-f1b895e5b0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:15.792187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8d7f7-9ebb-4c77-a7ab-f1b895e5b0e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:15.793041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8d7f7-9ebb-4c77-a7ab-f1b895e5b0e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:15.795466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8d7f7-9ebb-4c77-a7ab-f1b895e5b0e2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:15.801401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0da86e-5384-4695-8568-3988a0d2034a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:15.817600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83611ef-9eba-417e-afbd-6db7ac7061e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:15.818190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83611ef-9eba-417e-afbd-6db7ac7061e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:15.818469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83611ef-9eba-417e-afbd-6db7ac7061e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:15.818735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83611ef-9eba-417e-afbd-6db7ac7061e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:15.819396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83611ef-9eba-417e-afbd-6db7ac7061e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:14:15.819696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83611ef-9eba-417e-afbd-6db7ac7061e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:15.821459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83611ef-9eba-417e-afbd-6db7ac7061e6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:15.851960 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3445/6865] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:14:15 2022] POST /identity/v3/users => generated 295 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:15.853817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8d7f7-9ebb-4c77-a7ab-f1b895e5b0e2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:15.862361 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3421/6866] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:14:15.867236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8d7f7-9ebb-4c77-a7ab-f1b895e5b0e2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:15.869747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83611ef-9eba-417e-afbd-6db7ac7061e6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:15.877513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea9e4f-d85f-41a6-8319-37bf9a2b3d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:15.878504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea9e4f-d85f-41a6-8319-37bf9a2b3d3d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:15.878967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea9e4f-d85f-41a6-8319-37bf9a2b3d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:15.879412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea9e4f-d85f-41a6-8319-37bf9a2b3d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:15.880223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea9e4f-d85f-41a6-8319-37bf9a2b3d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:15.882462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea9e4f-d85f-41a6-8319-37bf9a2b3d3d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:15.895053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83611ef-9eba-417e-afbd-6db7ac7061e6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:15.900656 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3446/6867] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:14:15.901947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea9e4f-d85f-41a6-8319-37bf9a2b3d3d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:15.909311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31157f-98d1-4cf1-99cc-62452e596d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:15.910054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31157f-98d1-4cf1-99cc-62452e596d44 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:15.911293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31157f-98d1-4cf1-99cc-62452e596d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:15.911950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31157f-98d1-4cf1-99cc-62452e596d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:15.913957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31157f-98d1-4cf1-99cc-62452e596d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:15.919224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31157f-98d1-4cf1-99cc-62452e596d44 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:15.943555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea9e4f-d85f-41a6-8319-37bf9a2b3d3d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:15.960972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c7c9c-b549-4e5b-b1b1-e2a29c8ec50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:15.961748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c7c9c-b549-4e5b-b1b1-e2a29c8ec50b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:15.962090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c7c9c-b549-4e5b-b1b1-e2a29c8ec50b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:15.962510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c7c9c-b549-4e5b-b1b1-e2a29c8ec50b admin admin] PATH_INFO: `/v3/projects/1e5ffbc47c1f403699795e08c2b17f09/users/05df9e9246ef4678a32b0b1a796a448b/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:15.967258 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3422/6868] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:14:15 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:15.968379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31157f-98d1-4cf1-99cc-62452e596d44 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:15.990565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c7c9c-b549-4e5b-b1b1-e2a29c8ec50b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e5ffbc47c1f403699795e08c2b17f09, user_id=05df9e9246ef4678a32b0b1a796a448b, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:15.993594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c7c9c-b549-4e5b-b1b1-e2a29c8ec50b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:16.003530 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:16.021452 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3447/6869] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:14:15 2022] PUT /identity/v3/projects/1e5ffbc47c1f403699795e08c2b17f09/users/05df9e9246ef4678a32b0b1a796a448b/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:16.026371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c7c9c-b549-4e5b-b1b1-e2a29c8ec50b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:16.053299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31157f-98d1-4cf1-99cc-62452e596d44 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:16.111993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c7c9c-b549-4e5b-b1b1-e2a29c8ec50b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:16.120659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3c43f-4bf7-4a88-9e88-a23f24030003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:16.121950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3c43f-4bf7-4a88-9e88-a23f24030003 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:16.122516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3c43f-4bf7-4a88-9e88-a23f24030003 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:16.122929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3c43f-4bf7-4a88-9e88-a23f24030003 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:16.123904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3c43f-4bf7-4a88-9e88-a23f24030003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:16.126386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3c43f-4bf7-4a88-9e88-a23f24030003 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:16.138782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43366a2-7323-42e1-ac58-28044bc55c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:16.139551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43366a2-7323-42e1-ac58-28044bc55c61 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:16.139833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43366a2-7323-42e1-ac58-28044bc55c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:16.140151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43366a2-7323-42e1-ac58-28044bc55c61 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:16.141132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43366a2-7323-42e1-ac58-28044bc55c61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:16.143044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43366a2-7323-42e1-ac58-28044bc55c61 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:16.144586 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3448/6870] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:14:16.148282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3c43f-4bf7-4a88-9e88-a23f24030003 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:16.168562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3c43f-4bf7-4a88-9e88-a23f24030003 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:16.178573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4e7ea-3da8-4cfc-a090-79f0ae066098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:16.179183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4e7ea-3da8-4cfc-a090-79f0ae066098 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:16.179603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4e7ea-3da8-4cfc-a090-79f0ae066098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:16.179984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4e7ea-3da8-4cfc-a090-79f0ae066098 admin admin] PATH_INFO: `/v3/projects/1e5ffbc47c1f403699795e08c2b17f09/users/05df9e9246ef4678a32b0b1a796a448b/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:16.192052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4e7ea-3da8-4cfc-a090-79f0ae066098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e5ffbc47c1f403699795e08c2b17f09, user_id=05df9e9246ef4678a32b0b1a796a448b, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:16.192505 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3423/6871] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:14:15 2022] POST /identity/v3/users => generated 300 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:16.195511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4e7ea-3da8-4cfc-a090-79f0ae066098 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:16.196026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43366a2-7323-42e1-ac58-28044bc55c61 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:16.214877 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3449/6872] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:14:16 2022] PUT /identity/v3/projects/1e5ffbc47c1f403699795e08c2b17f09/users/05df9e9246ef4678a32b0b1a796a448b/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:16.220891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43366a2-7323-42e1-ac58-28044bc55c61 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:16.300422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732b150-50d5-4557-b925-de5598a5149e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:16.301083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732b150-50d5-4557-b925-de5598a5149e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:16.301361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732b150-50d5-4557-b925-de5598a5149e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:16.301632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732b150-50d5-4557-b925-de5598a5149e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:16.302283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732b150-50d5-4557-b925-de5598a5149e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:16.304323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732b150-50d5-4557-b925-de5598a5149e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:16.322758 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3424/6873] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:14:16.326737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4e7ea-3da8-4cfc-a090-79f0ae066098 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:16.363527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4e7ea-3da8-4cfc-a090-79f0ae066098 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:16.375786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732edc6-7f61-4271-b42a-7d409178a840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:16.377408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732edc6-7f61-4271-b42a-7d409178a840 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:16.378441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732edc6-7f61-4271-b42a-7d409178a840 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:16.379676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732edc6-7f61-4271-b42a-7d409178a840 admin admin] PATH_INFO: `/v3/projects/c4991cddc6cb41f3ab9b63668d19ab0b/users/155edad9c87c49b788df991392b07cb5/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:16.403294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732edc6-7f61-4271-b42a-7d409178a840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4991cddc6cb41f3ab9b63668d19ab0b, user_id=155edad9c87c49b788df991392b07cb5, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:16.406100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732edc6-7f61-4271-b42a-7d409178a840 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:16.433060 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3450/6874] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:14:16 2022] PUT /identity/v3/projects/c4991cddc6cb41f3ab9b63668d19ab0b/users/155edad9c87c49b788df991392b07cb5/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:16.436227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732b150-50d5-4557-b925-de5598a5149e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:16.450765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732b150-50d5-4557-b925-de5598a5149e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:16.598834 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:16.626943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cea24-425d-4ff0-8a39-5d120f6684d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:16.628393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cea24-425d-4ff0-8a39-5d120f6684d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:16.628740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cea24-425d-4ff0-8a39-5d120f6684d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:16.629102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cea24-425d-4ff0-8a39-5d120f6684d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:16.630473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cea24-425d-4ff0-8a39-5d120f6684d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:16.634467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cea24-425d-4ff0-8a39-5d120f6684d3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:16.688771 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3425/6875] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:14:16.689654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732edc6-7f61-4271-b42a-7d409178a840 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:16.723533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732edc6-7f61-4271-b42a-7d409178a840 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:16.786214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d11364-b8b0-434d-a574-945ad82ad0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:16.787250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d11364-b8b0-434d-a574-945ad82ad0ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:16.787537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d11364-b8b0-434d-a574-945ad82ad0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:16.787814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d11364-b8b0-434d-a574-945ad82ad0ca admin admin] PATH_INFO: `/v3/projects/c4991cddc6cb41f3ab9b63668d19ab0b/users/155edad9c87c49b788df991392b07cb5/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:16.805632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d11364-b8b0-434d-a574-945ad82ad0ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4991cddc6cb41f3ab9b63668d19ab0b, user_id=155edad9c87c49b788df991392b07cb5, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:16.808484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d11364-b8b0-434d-a574-945ad82ad0ca admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:16.826674 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3451/6876] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:14:16 2022] PUT /identity/v3/projects/c4991cddc6cb41f3ab9b63668d19ab0b/users/155edad9c87c49b788df991392b07cb5/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:16.837780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b9891-0813-41da-8c3c-5206428da1e5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:16.838270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b9891-0813-41da-8c3c-5206428da1e5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:16.839187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b9891-0813-41da-8c3c-5206428da1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:16.920538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-046b9891-0813-41da-8c3c-5206428da1e5 None None] MFA Rules not processed for user `155edad9c87c49b788df991392b07cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:16.929644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-046b9891-0813-41da-8c3c-5206428da1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:17.154904 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3426/6877] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:17.159040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d11364-b8b0-434d-a574-945ad82ad0ca admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:17.257819 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:17.334000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d11364-b8b0-434d-a574-945ad82ad0ca admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:17.353607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695d6d1-89fd-40a0-92e9-5a1dbe27d7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:17.355074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695d6d1-89fd-40a0-92e9-5a1dbe27d7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:17.355483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695d6d1-89fd-40a0-92e9-5a1dbe27d7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:17.357412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695d6d1-89fd-40a0-92e9-5a1dbe27d7a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:17.358850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695d6d1-89fd-40a0-92e9-5a1dbe27d7a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:17.364304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695d6d1-89fd-40a0-92e9-5a1dbe27d7a2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:17.436865 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3452/6878] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:14:17 2022] POST /identity/v3/projects => generated 387 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:17.441216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b9891-0813-41da-8c3c-5206428da1e5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:17.458444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b9891-0813-41da-8c3c-5206428da1e5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:17.649819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00eaa6d-3fc2-49e1-89a8-33171753ca2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:17.650436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00eaa6d-3fc2-49e1-89a8-33171753ca2c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:17.650713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00eaa6d-3fc2-49e1-89a8-33171753ca2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:17.650986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00eaa6d-3fc2-49e1-89a8-33171753ca2c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:17.651706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00eaa6d-3fc2-49e1-89a8-33171753ca2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:17.653676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00eaa6d-3fc2-49e1-89a8-33171753ca2c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:17.716064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695d6d1-89fd-40a0-92e9-5a1dbe27d7a2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:17.716294 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3427/6879] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:14:17 2022] POST /identity/v3/users => generated 294 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:17.730071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695d6d1-89fd-40a0-92e9-5a1dbe27d7a2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:17.741310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36eccca-6fd1-4409-816a-a3eeab2da0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:17.741942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36eccca-6fd1-4409-816a-a3eeab2da0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:17.742221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36eccca-6fd1-4409-816a-a3eeab2da0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:17.742489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36eccca-6fd1-4409-816a-a3eeab2da0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:17.746614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36eccca-6fd1-4409-816a-a3eeab2da0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:17.748275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36eccca-6fd1-4409-816a-a3eeab2da0a1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:17.773247 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3453/6880] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:14:17.777296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00eaa6d-3fc2-49e1-89a8-33171753ca2c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:17.794901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00eaa6d-3fc2-49e1-89a8-33171753ca2c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:17.809351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4015cbb9-4ca9-45a4-a0bf-22c2a77a479d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:17.810315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015cbb9-4ca9-45a4-a0bf-22c2a77a479d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:17.810699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015cbb9-4ca9-45a4-a0bf-22c2a77a479d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:17.810863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015cbb9-4ca9-45a4-a0bf-22c2a77a479d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:17.816112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4015cbb9-4ca9-45a4-a0bf-22c2a77a479d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:17.820642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4015cbb9-4ca9-45a4-a0bf-22c2a77a479d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:17.852631 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3428/6881] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:14:17.857401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36eccca-6fd1-4409-816a-a3eeab2da0a1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:17.877255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36eccca-6fd1-4409-816a-a3eeab2da0a1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:17.900649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4787ca-3458-4dd5-a9b6-692d9de73736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:17.901621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4787ca-3458-4dd5-a9b6-692d9de73736 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:17.902051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4787ca-3458-4dd5-a9b6-692d9de73736 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:17.902484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4787ca-3458-4dd5-a9b6-692d9de73736 admin admin] PATH_INFO: `/v3/projects/ea1ab281f29f42e0b0f475a90c7bd816/users/777b709d3c044645a0fc203dd52a347c/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:17.927495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4787ca-3458-4dd5-a9b6-692d9de73736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea1ab281f29f42e0b0f475a90c7bd816, user_id=777b709d3c044645a0fc203dd52a347c, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:17.930591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4787ca-3458-4dd5-a9b6-692d9de73736 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:17.966151 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3454/6882] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:14:17 2022] PUT /identity/v3/projects/ea1ab281f29f42e0b0f475a90c7bd816/users/777b709d3c044645a0fc203dd52a347c/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:14:17.977692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a814997-fe84-4abb-a889-b909ca1506c4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:17.977970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a814997-fe84-4abb-a889-b909ca1506c4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:17.978242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a814997-fe84-4abb-a889-b909ca1506c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:18.040412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4a814997-fe84-4abb-a889-b909ca1506c4 None None] MFA Rules not processed for user `777b709d3c044645a0fc203dd52a347c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:18.041695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4a814997-fe84-4abb-a889-b909ca1506c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:18.181567 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:18.229162 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3429/6883] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:18.241143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4787ca-3458-4dd5-a9b6-692d9de73736 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:18.243719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ca4787ca-3458-4dd5-a9b6-692d9de73736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:18.459810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4787ca-3458-4dd5-a9b6-692d9de73736 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:18.467811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300f602-6d7a-4f33-9b2d-f951f1b18cde service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:18.469456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300f602-6d7a-4f33-9b2d-f951f1b18cde service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:18.469966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300f602-6d7a-4f33-9b2d-f951f1b18cde service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:18.470877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300f602-6d7a-4f33-9b2d-f951f1b18cde service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:18.629639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300f602-6d7a-4f33-9b2d-f951f1b18cde service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:18.631765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300f602-6d7a-4f33-9b2d-f951f1b18cde service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:18.680879 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3455/6884] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:14:18 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:14:20.617999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a814997-fe84-4abb-a889-b909ca1506c4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:20.843219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a814997-fe84-4abb-a889-b909ca1506c4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:20.863650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d1003-48f8-4641-8d09-568860352321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:20.864315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d1003-48f8-4641-8d09-568860352321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:20.864674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d1003-48f8-4641-8d09-568860352321 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:20.865127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d1003-48f8-4641-8d09-568860352321 admin admin] PATH_INFO: `/v3/users/155edad9c87c49b788df991392b07cb5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:20.872330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d1003-48f8-4641-8d09-568860352321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=155edad9c87c49b788df991392b07cb5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:20.876664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d1003-48f8-4641-8d09-568860352321 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:21.079185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-645d1003-48f8-4641-8d09-568860352321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '155edad9c87c49b788df991392b07cb5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:21.101301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-645d1003-48f8-4641-8d09-568860352321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '155edad9c87c49b788df991392b07cb5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:21.102116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-645d1003-48f8-4641-8d09-568860352321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '155edad9c87c49b788df991392b07cb5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:21.150000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-645d1003-48f8-4641-8d09-568860352321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '155edad9c87c49b788df991392b07cb5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:21.179581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-645d1003-48f8-4641-8d09-568860352321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '155edad9c87c49b788df991392b07cb5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:21.212783 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3430/6885] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:14:20 2022] DELETE /identity/v3/users/155edad9c87c49b788df991392b07cb5 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:21.217016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ffcb8-5784-4be0-bf22-18f7f87be8b1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:21.217573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ffcb8-5784-4be0-bf22-18f7f87be8b1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:21.217805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ffcb8-5784-4be0-bf22-18f7f87be8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:21.283493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cb2ffcb8-5784-4be0-bf22-18f7f87be8b1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:21.285027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cb2ffcb8-5784-4be0-bf22-18f7f87be8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:21.404145 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:21.621603 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3456/6886] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:21.636713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d1003-48f8-4641-8d09-568860352321 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:21.638328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-645d1003-48f8-4641-8d09-568860352321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:21.906047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d1003-48f8-4641-8d09-568860352321 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:21.918823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fda32a-3544-4640-85e2-e9a2cd42cf5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:21.919470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fda32a-3544-4640-85e2-e9a2cd42cf5e service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:21.919754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fda32a-3544-4640-85e2-e9a2cd42cf5e service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:21.920046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fda32a-3544-4640-85e2-e9a2cd42cf5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:21.956211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fda32a-3544-4640-85e2-e9a2cd42cf5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:21.957947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fda32a-3544-4640-85e2-e9a2cd42cf5e service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:21.999181 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3431/6887] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:14:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:14:22.650783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ffcb8-5784-4be0-bf22-18f7f87be8b1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:22.652360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cb2ffcb8-5784-4be0-bf22-18f7f87be8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:22.687118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ffcb8-5784-4be0-bf22-18f7f87be8b1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:22.712128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56060bbd-5a5e-41c4-9414-4572f2301239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:22.713199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56060bbd-5a5e-41c4-9414-4572f2301239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:22.720692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56060bbd-5a5e-41c4-9414-4572f2301239 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:22.722548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56060bbd-5a5e-41c4-9414-4572f2301239 admin admin] PATH_INFO: `/v3/projects/c4991cddc6cb41f3ab9b63668d19ab0b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:22.725209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56060bbd-5a5e-41c4-9414-4572f2301239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4991cddc6cb41f3ab9b63668d19ab0b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:22.732543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56060bbd-5a5e-41c4-9414-4572f2301239 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:22.880818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-56060bbd-5a5e-41c4-9414-4572f2301239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4991cddc6cb41f3ab9b63668d19ab0b', 'request_id': 'req-56060bbd-5a5e-41c4-9414-4572f2301239'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:22.895601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-56060bbd-5a5e-41c4-9414-4572f2301239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4991cddc6cb41f3ab9b63668d19ab0b', 'request_id': 'req-56060bbd-5a5e-41c4-9414-4572f2301239'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:22.911657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-56060bbd-5a5e-41c4-9414-4572f2301239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4991cddc6cb41f3ab9b63668d19ab0b', 'request_id': 'req-56060bbd-5a5e-41c4-9414-4572f2301239'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:22.944884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-56060bbd-5a5e-41c4-9414-4572f2301239 admin admin] The token cache is being invalidate because project c4991cddc6cb41f3ab9b63668d19ab0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:14:22.945176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-56060bbd-5a5e-41c4-9414-4572f2301239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:22.946957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-56060bbd-5a5e-41c4-9414-4572f2301239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:22.952065 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3457/6888] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:14:22 2022] DELETE /identity/v3/projects/c4991cddc6cb41f3ab9b63668d19ab0b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:22.955885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fda32a-3544-4640-85e2-e9a2cd42cf5e service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:22.973473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fda32a-3544-4640-85e2-e9a2cd42cf5e service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:22.985317 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:23.136849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f947146-29d5-4441-8c18-4f426ba1a517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:23.137511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f947146-29d5-4441-8c18-4f426ba1a517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:23.137934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f947146-29d5-4441-8c18-4f426ba1a517 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:23.138235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f947146-29d5-4441-8c18-4f426ba1a517 admin admin] PATH_INFO: `/v3/users/777b709d3c044645a0fc203dd52a347c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:23.145595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f947146-29d5-4441-8c18-4f426ba1a517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=777b709d3c044645a0fc203dd52a347c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:23.148099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f947146-29d5-4441-8c18-4f426ba1a517 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:23.287264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0f947146-29d5-4441-8c18-4f426ba1a517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '777b709d3c044645a0fc203dd52a347c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:23.306149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0f947146-29d5-4441-8c18-4f426ba1a517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '777b709d3c044645a0fc203dd52a347c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:23.307484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0f947146-29d5-4441-8c18-4f426ba1a517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '777b709d3c044645a0fc203dd52a347c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:23.338154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0f947146-29d5-4441-8c18-4f426ba1a517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '777b709d3c044645a0fc203dd52a347c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:23.355557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0f947146-29d5-4441-8c18-4f426ba1a517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '777b709d3c044645a0fc203dd52a347c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:23.393035 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3432/6889] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:14:22 2022] DELETE /identity/v3/users/777b709d3c044645a0fc203dd52a347c => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:24.256612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56060bbd-5a5e-41c4-9414-4572f2301239 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:24.258245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-56060bbd-5a5e-41c4-9414-4572f2301239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:24.286642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56060bbd-5a5e-41c4-9414-4572f2301239 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:24.420686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df28b46-b33e-43e6-94ec-21ecf34ceea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:24.422444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df28b46-b33e-43e6-94ec-21ecf34ceea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:24.423532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df28b46-b33e-43e6-94ec-21ecf34ceea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:24.424194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df28b46-b33e-43e6-94ec-21ecf34ceea2 admin admin] PATH_INFO: `/v3/projects/ea1ab281f29f42e0b0f475a90c7bd816` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:24.428006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df28b46-b33e-43e6-94ec-21ecf34ceea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea1ab281f29f42e0b0f475a90c7bd816)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:24.430490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df28b46-b33e-43e6-94ec-21ecf34ceea2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:24.524908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6df28b46-b33e-43e6-94ec-21ecf34ceea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea1ab281f29f42e0b0f475a90c7bd816', 'request_id': 'req-6df28b46-b33e-43e6-94ec-21ecf34ceea2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:24.532919 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:24.541004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6df28b46-b33e-43e6-94ec-21ecf34ceea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea1ab281f29f42e0b0f475a90c7bd816', 'request_id': 'req-6df28b46-b33e-43e6-94ec-21ecf34ceea2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:24.553108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6df28b46-b33e-43e6-94ec-21ecf34ceea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea1ab281f29f42e0b0f475a90c7bd816', 'request_id': 'req-6df28b46-b33e-43e6-94ec-21ecf34ceea2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:24.569278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6df28b46-b33e-43e6-94ec-21ecf34ceea2 admin admin] The token cache is being invalidate because project ea1ab281f29f42e0b0f475a90c7bd816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:14:24.569974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6df28b46-b33e-43e6-94ec-21ecf34ceea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:24.570916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6df28b46-b33e-43e6-94ec-21ecf34ceea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:24.573244 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3458/6890] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:14:24 2022] DELETE /identity/v3/projects/ea1ab281f29f42e0b0f475a90c7bd816 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:24.577873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519230e-9be2-4a14-821f-580ce806a433 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:24.578426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519230e-9be2-4a14-821f-580ce806a433 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:24.578426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519230e-9be2-4a14-821f-580ce806a433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:24.623811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f519230e-9be2-4a14-821f-580ce806a433 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:24.627193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f519230e-9be2-4a14-821f-580ce806a433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:24.742974 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3433/6891] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:24.751644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad76bce-1876-4ae7-acd7-68177893dbda None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:24.752124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad76bce-1876-4ae7-acd7-68177893dbda None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:24.752965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad76bce-1876-4ae7-acd7-68177893dbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:24.810731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0ad76bce-1876-4ae7-acd7-68177893dbda None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:24.813651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0ad76bce-1876-4ae7-acd7-68177893dbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:24.832802 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3459/6892] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:24.837279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519230e-9be2-4a14-821f-580ce806a433 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:24.856672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519230e-9be2-4a14-821f-580ce806a433 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:24.869056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30182bc0-8760-451f-b58b-c001d5b60fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:24.869687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30182bc0-8760-451f-b58b-c001d5b60fff admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:24.869962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30182bc0-8760-451f-b58b-c001d5b60fff admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:24.871839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30182bc0-8760-451f-b58b-c001d5b60fff admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:24.873951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30182bc0-8760-451f-b58b-c001d5b60fff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:14:24.875840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30182bc0-8760-451f-b58b-c001d5b60fff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:24.878318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30182bc0-8760-451f-b58b-c001d5b60fff admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:24.926117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad76bce-1876-4ae7-acd7-68177893dbda None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:24.946369 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3434/6893] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:14:24.957219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad76bce-1876-4ae7-acd7-68177893dbda None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:24.963765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c637bc-2ef7-41c8-9f9f-482b2f3ba3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:24.965119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c637bc-2ef7-41c8-9f9f-482b2f3ba3d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:24.965398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c637bc-2ef7-41c8-9f9f-482b2f3ba3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:24.965669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c637bc-2ef7-41c8-9f9f-482b2f3ba3d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:24.966306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c637bc-2ef7-41c8-9f9f-482b2f3ba3d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:24.969412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c637bc-2ef7-41c8-9f9f-482b2f3ba3d5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:25.012042 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3460/6894] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:14:24 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:25.017508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30182bc0-8760-451f-b58b-c001d5b60fff admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:25.040543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30182bc0-8760-451f-b58b-c001d5b60fff admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:25.061097 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:25.189222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd4e32-c68b-4197-a4b0-8dca2dea3cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:25.194167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd4e32-c68b-4197-a4b0-8dca2dea3cfb admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:25.195402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd4e32-c68b-4197-a4b0-8dca2dea3cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:25.195689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd4e32-c68b-4197-a4b0-8dca2dea3cfb admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:25.196388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd4e32-c68b-4197-a4b0-8dca2dea3cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:25.198667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd4e32-c68b-4197-a4b0-8dca2dea3cfb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:25.251967 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3435/6895] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:14:25 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:25.252887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c637bc-2ef7-41c8-9f9f-482b2f3ba3d5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:25.285763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c637bc-2ef7-41c8-9f9f-482b2f3ba3d5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:25.293973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74490c-55e3-43b1-ad55-f29c09dba46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:25.294701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74490c-55e3-43b1-ad55-f29c09dba46d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:25.295056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74490c-55e3-43b1-ad55-f29c09dba46d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:25.295445 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74490c-55e3-43b1-ad55-f29c09dba46d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:25.296192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74490c-55e3-43b1-ad55-f29c09dba46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:25.298455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74490c-55e3-43b1-ad55-f29c09dba46d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:25.311022 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3461/6896] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:14:25.315878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd4e32-c68b-4197-a4b0-8dca2dea3cfb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:25.331371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd4e32-c68b-4197-a4b0-8dca2dea3cfb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:25.336986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfee783-a237-41c6-b295-90036c233418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:25.337624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfee783-a237-41c6-b295-90036c233418 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:25.337906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfee783-a237-41c6-b295-90036c233418 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:25.338173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfee783-a237-41c6-b295-90036c233418 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:25.338827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfee783-a237-41c6-b295-90036c233418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:25.342226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfee783-a237-41c6-b295-90036c233418 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:25.358360 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3436/6897] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:14:25.359067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74490c-55e3-43b1-ad55-f29c09dba46d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:25.373103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74490c-55e3-43b1-ad55-f29c09dba46d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:25.384448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c855a-f04a-4c21-8e42-444d1870028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:25.386072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c855a-f04a-4c21-8e42-444d1870028a admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:25.386351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c855a-f04a-4c21-8e42-444d1870028a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:25.386627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c855a-f04a-4c21-8e42-444d1870028a admin admin] PATH_INFO: `/v3/projects/d171d84cd5824458ad82fd8e873a05bf/users/fd7d51511dbe4b77ad7e0022be471f8e/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:25.420753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c855a-f04a-4c21-8e42-444d1870028a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d171d84cd5824458ad82fd8e873a05bf, user_id=fd7d51511dbe4b77ad7e0022be471f8e, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:25.425111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c855a-f04a-4c21-8e42-444d1870028a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:25.457443 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3462/6898] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:14:25 2022] PUT /identity/v3/projects/d171d84cd5824458ad82fd8e873a05bf/users/fd7d51511dbe4b77ad7e0022be471f8e/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:25.466405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463128c-6bee-4d2c-a453-9dc88ba572db None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:25.466694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463128c-6bee-4d2c-a453-9dc88ba572db None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:25.466967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463128c-6bee-4d2c-a453-9dc88ba572db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:25.527969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0463128c-6bee-4d2c-a453-9dc88ba572db None None] MFA Rules not processed for user `fd7d51511dbe4b77ad7e0022be471f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:25.530821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0463128c-6bee-4d2c-a453-9dc88ba572db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:25.756219 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3437/6899] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:25.757458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c855a-f04a-4c21-8e42-444d1870028a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:25.932180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c855a-f04a-4c21-8e42-444d1870028a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:25.958085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da998b-6546-4db9-aea1-ac4b5e777a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:25.960074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da998b-6546-4db9-aea1-ac4b5e777a25 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:25.960369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da998b-6546-4db9-aea1-ac4b5e777a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:25.960872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da998b-6546-4db9-aea1-ac4b5e777a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:25.973144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da998b-6546-4db9-aea1-ac4b5e777a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:25.975337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da998b-6546-4db9-aea1-ac4b5e777a25 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:26.042895 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3463/6900] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:14:25 2022] POST /identity/v3/projects => generated 385 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:26.046614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463128c-6bee-4d2c-a453-9dc88ba572db None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:26.062585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463128c-6bee-4d2c-a453-9dc88ba572db None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:26.256458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6925c-0a96-4564-acd8-0e3822f9dfb2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:26.256866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6925c-0a96-4564-acd8-0e3822f9dfb2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:26.257210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6925c-0a96-4564-acd8-0e3822f9dfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:26.265282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55e908-9505-49e4-bc98-a38329899332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:26.266805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55e908-9505-49e4-bc98-a38329899332 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:26.267170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55e908-9505-49e4-bc98-a38329899332 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:26.268542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55e908-9505-49e4-bc98-a38329899332 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:26.268542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55e908-9505-49e4-bc98-a38329899332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:26.271205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55e908-9505-49e4-bc98-a38329899332 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:26.294245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-75c6925c-0a96-4564-acd8-0e3822f9dfb2 None None] MFA Rules not processed for user `05df9e9246ef4678a32b0b1a796a448b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:26.296247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-75c6925c-0a96-4564-acd8-0e3822f9dfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:26.307261 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3438/6901] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:14:26 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:26.312067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55e908-9505-49e4-bc98-a38329899332 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:26.340035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55e908-9505-49e4-bc98-a38329899332 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:26.348004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a3e80-14b2-4b03-b914-f269265d26e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:26.348661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a3e80-14b2-4b03-b914-f269265d26e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:26.348994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a3e80-14b2-4b03-b914-f269265d26e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:26.349272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a3e80-14b2-4b03-b914-f269265d26e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:26.349982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a3e80-14b2-4b03-b914-f269265d26e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:26.357643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a3e80-14b2-4b03-b914-f269265d26e1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:26.389418 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:26.389654 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3439/6902] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:14:26.390935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a3e80-14b2-4b03-b914-f269265d26e1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:26.397500 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:26.407325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a3e80-14b2-4b03-b914-f269265d26e1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:26.413557 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3464/6903] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:26.419099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdc8c4-b9b0-4092-a934-ba1f3c9e5b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:26.419961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdc8c4-b9b0-4092-a934-ba1f3c9e5b4a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:26.420295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdc8c4-b9b0-4092-a934-ba1f3c9e5b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:26.420662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdc8c4-b9b0-4092-a934-ba1f3c9e5b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:26.421390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdc8c4-b9b0-4092-a934-ba1f3c9e5b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:26.423235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdc8c4-b9b0-4092-a934-ba1f3c9e5b4a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:26.437807 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3440/6904] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:14:26.442589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6925c-0a96-4564-acd8-0e3822f9dfb2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:26.455546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6925c-0a96-4564-acd8-0e3822f9dfb2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:26.460905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d077a9-d702-4b0b-99de-e25351ae0bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:26.465321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d077a9-d702-4b0b-99de-e25351ae0bce admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:26.465797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d077a9-d702-4b0b-99de-e25351ae0bce admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:26.466247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d077a9-d702-4b0b-99de-e25351ae0bce admin admin] PATH_INFO: `/v3/projects/359f77bc10704e99aa5b51e8469dd131/users/5ab703a9d68543f5a34af3886a8c1eb3/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:26.486061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d077a9-d702-4b0b-99de-e25351ae0bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=359f77bc10704e99aa5b51e8469dd131, user_id=5ab703a9d68543f5a34af3886a8c1eb3, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:26.489373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d077a9-d702-4b0b-99de-e25351ae0bce admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:26.520644 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3465/6905] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:14:26 2022] PUT /identity/v3/projects/359f77bc10704e99aa5b51e8469dd131/users/5ab703a9d68543f5a34af3886a8c1eb3/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:14:26.607235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb392d4-46b5-4fb4-b2c3-fbe8b0223ba0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:26.607541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb392d4-46b5-4fb4-b2c3-fbe8b0223ba0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:26.607779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb392d4-46b5-4fb4-b2c3-fbe8b0223ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:26.650592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0eb392d4-46b5-4fb4-b2c3-fbe8b0223ba0 None None] MFA Rules not processed for user `5ab703a9d68543f5a34af3886a8c1eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:26.652020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0eb392d4-46b5-4fb4-b2c3-fbe8b0223ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:26.741259 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3441/6906] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:26.753815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d077a9-d702-4b0b-99de-e25351ae0bce admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:26.757361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f7d077a9-d702-4b0b-99de-e25351ae0bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:26.906068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d077a9-d702-4b0b-99de-e25351ae0bce admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:26.924528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699da10d-8dd0-4565-9f81-9dc00e0c683c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:26.925189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699da10d-8dd0-4565-9f81-9dc00e0c683c service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:26.925467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699da10d-8dd0-4565-9f81-9dc00e0c683c service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:26.925758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699da10d-8dd0-4565-9f81-9dc00e0c683c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:27.053659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb392d4-46b5-4fb4-b2c3-fbe8b0223ba0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:27.055147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0eb392d4-46b5-4fb4-b2c3-fbe8b0223ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:27.071699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699da10d-8dd0-4565-9f81-9dc00e0c683c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:27.073032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699da10d-8dd0-4565-9f81-9dc00e0c683c service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:27.085487 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3466/6907] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:14:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:14:27.183349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb392d4-46b5-4fb4-b2c3-fbe8b0223ba0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:27.188516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892c3b4-8c5d-477f-824f-11b64d1f6299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:27.189351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892c3b4-8c5d-477f-824f-11b64d1f6299 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:27.189500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892c3b4-8c5d-477f-824f-11b64d1f6299 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:27.189659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892c3b4-8c5d-477f-824f-11b64d1f6299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:27.295497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699da10d-8dd0-4565-9f81-9dc00e0c683c service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:27.306098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892c3b4-8c5d-477f-824f-11b64d1f6299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:27.307848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892c3b4-8c5d-477f-824f-11b64d1f6299 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:27.316493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699da10d-8dd0-4565-9f81-9dc00e0c683c service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:27.320085 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3442/6908] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:14:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:14:27.333113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08268541-aa27-4190-81ae-9ae244766a61 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:27.333994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08268541-aa27-4190-81ae-9ae244766a61 service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:27.334285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08268541-aa27-4190-81ae-9ae244766a61 service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:27.334624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08268541-aa27-4190-81ae-9ae244766a61 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:27.348259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08268541-aa27-4190-81ae-9ae244766a61 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:27.349738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08268541-aa27-4190-81ae-9ae244766a61 service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:27.361289 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3467/6909] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:14:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:14:28.029483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892c3b4-8c5d-477f-824f-11b64d1f6299 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:28.108176 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:28.201210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892c3b4-8c5d-477f-824f-11b64d1f6299 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:28.229334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395feb8-6f83-43df-b4cb-e5f13feebd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:28.230005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395feb8-6f83-43df-b4cb-e5f13feebd49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:28.230284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395feb8-6f83-43df-b4cb-e5f13feebd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:28.230558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395feb8-6f83-43df-b4cb-e5f13feebd49 admin admin] PATH_INFO: `/v3/users/fd7d51511dbe4b77ad7e0022be471f8e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:28.233868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395feb8-6f83-43df-b4cb-e5f13feebd49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd7d51511dbe4b77ad7e0022be471f8e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:28.236634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395feb8-6f83-43df-b4cb-e5f13feebd49 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:28.349114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7395feb8-6f83-43df-b4cb-e5f13feebd49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd7d51511dbe4b77ad7e0022be471f8e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:28.371698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7395feb8-6f83-43df-b4cb-e5f13feebd49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd7d51511dbe4b77ad7e0022be471f8e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:28.371698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7395feb8-6f83-43df-b4cb-e5f13feebd49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd7d51511dbe4b77ad7e0022be471f8e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:28.404022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7395feb8-6f83-43df-b4cb-e5f13feebd49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd7d51511dbe4b77ad7e0022be471f8e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:28.414849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08268541-aa27-4190-81ae-9ae244766a61 service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:28.422309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7395feb8-6f83-43df-b4cb-e5f13feebd49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd7d51511dbe4b77ad7e0022be471f8e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:28.433026 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3443/6910] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:14:28 2022] DELETE /identity/v3/users/fd7d51511dbe4b77ad7e0022be471f8e => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:28.433939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08268541-aa27-4190-81ae-9ae244766a61 service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:28.436961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d5cf6-073e-48df-bd17-da55c84fea8b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:28.437808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d5cf6-073e-48df-bd17-da55c84fea8b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:28.438082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d5cf6-073e-48df-bd17-da55c84fea8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:28.462024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-081d5cf6-073e-48df-bd17-da55c84fea8b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:28.463237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-081d5cf6-073e-48df-bd17-da55c84fea8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:28.552391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea4806-0f5e-4695-8d53-90c627bd2fde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:28.553270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea4806-0f5e-4695-8d53-90c627bd2fde service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:28.553553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea4806-0f5e-4695-8d53-90c627bd2fde service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:28.553825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea4806-0f5e-4695-8d53-90c627bd2fde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:28.555431 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3444/6911] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:28.557622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5bea4806-0f5e-4695-8d53-90c627bd2fde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:28.563206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d5cf6-073e-48df-bd17-da55c84fea8b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:28.566520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-081d5cf6-073e-48df-bd17-da55c84fea8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:28.602536 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:28.651710 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:28.685938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d5cf6-073e-48df-bd17-da55c84fea8b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:28.698041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c796f-9f52-4d97-ad95-c1cb545ea00d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:28.698041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c796f-9f52-4d97-ad95-c1cb545ea00d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:28.698041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c796f-9f52-4d97-ad95-c1cb545ea00d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:28.698041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c796f-9f52-4d97-ad95-c1cb545ea00d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:28.698437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea4806-0f5e-4695-8d53-90c627bd2fde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:28.709250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea4806-0f5e-4695-8d53-90c627bd2fde service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:28.718003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c796f-9f52-4d97-ad95-c1cb545ea00d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:28.722314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c796f-9f52-4d97-ad95-c1cb545ea00d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:28.738313 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3445/6912] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:14:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:14:28.750938 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3468/6913] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:14:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:14:29.520395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c796f-9f52-4d97-ad95-c1cb545ea00d service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:29.533864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6a9c796f-9f52-4d97-ad95-c1cb545ea00d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:29.577335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c796f-9f52-4d97-ad95-c1cb545ea00d service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:29.623011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87a642-6e8a-40e4-84bd-88afb66d20d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:29.625188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87a642-6e8a-40e4-84bd-88afb66d20d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:29.625652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87a642-6e8a-40e4-84bd-88afb66d20d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:29.625759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87a642-6e8a-40e4-84bd-88afb66d20d7 admin admin] PATH_INFO: `/v3/projects/d171d84cd5824458ad82fd8e873a05bf` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:29.630693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87a642-6e8a-40e4-84bd-88afb66d20d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d171d84cd5824458ad82fd8e873a05bf)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:29.634169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87a642-6e8a-40e4-84bd-88afb66d20d7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:29.779767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c87a642-6e8a-40e4-84bd-88afb66d20d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd171d84cd5824458ad82fd8e873a05bf', 'request_id': 'req-6c87a642-6e8a-40e4-84bd-88afb66d20d7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:29.795065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c87a642-6e8a-40e4-84bd-88afb66d20d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd171d84cd5824458ad82fd8e873a05bf', 'request_id': 'req-6c87a642-6e8a-40e4-84bd-88afb66d20d7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:29.812486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c87a642-6e8a-40e4-84bd-88afb66d20d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd171d84cd5824458ad82fd8e873a05bf', 'request_id': 'req-6c87a642-6e8a-40e4-84bd-88afb66d20d7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:29.853862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c87a642-6e8a-40e4-84bd-88afb66d20d7 admin admin] The token cache is being invalidate because project d171d84cd5824458ad82fd8e873a05bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:14:29.854161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c87a642-6e8a-40e4-84bd-88afb66d20d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:29.855079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c87a642-6e8a-40e4-84bd-88afb66d20d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:29.862229 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3446/6914] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:14:29 2022] DELETE /identity/v3/projects/d171d84cd5824458ad82fd8e873a05bf => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:29.863676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea4806-0f5e-4695-8d53-90c627bd2fde service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:29.885971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea4806-0f5e-4695-8d53-90c627bd2fde service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:30.050830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3a200-58ca-48e3-96a7-795014493424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:30.051496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3a200-58ca-48e3-96a7-795014493424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:30.051776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3a200-58ca-48e3-96a7-795014493424 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:30.052050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3a200-58ca-48e3-96a7-795014493424 admin admin] PATH_INFO: `/v3/users/5ab703a9d68543f5a34af3886a8c1eb3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:30.053279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3a200-58ca-48e3-96a7-795014493424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab703a9d68543f5a34af3886a8c1eb3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:30.055255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3a200-58ca-48e3-96a7-795014493424 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:30.163311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d0c3a200-58ca-48e3-96a7-795014493424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab703a9d68543f5a34af3886a8c1eb3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:30.165261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d0c3a200-58ca-48e3-96a7-795014493424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab703a9d68543f5a34af3886a8c1eb3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:30.183992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d0c3a200-58ca-48e3-96a7-795014493424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab703a9d68543f5a34af3886a8c1eb3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:30.209072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d0c3a200-58ca-48e3-96a7-795014493424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab703a9d68543f5a34af3886a8c1eb3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:30.222856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d0c3a200-58ca-48e3-96a7-795014493424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab703a9d68543f5a34af3886a8c1eb3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:30.241926 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3469/6915] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:14:29 2022] DELETE /identity/v3/users/5ab703a9d68543f5a34af3886a8c1eb3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:31.092164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87a642-6e8a-40e4-84bd-88afb66d20d7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:31.094336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6c87a642-6e8a-40e4-84bd-88afb66d20d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:31.133926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87a642-6e8a-40e4-84bd-88afb66d20d7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:31.286249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330c374-2ffc-4d22-893e-b4b0eef6dce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:31.287107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330c374-2ffc-4d22-893e-b4b0eef6dce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:31.289090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330c374-2ffc-4d22-893e-b4b0eef6dce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:31.289388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330c374-2ffc-4d22-893e-b4b0eef6dce6 admin admin] PATH_INFO: `/v3/projects/359f77bc10704e99aa5b51e8469dd131` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:31.290715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330c374-2ffc-4d22-893e-b4b0eef6dce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=359f77bc10704e99aa5b51e8469dd131)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:31.294639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330c374-2ffc-4d22-893e-b4b0eef6dce6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:31.399471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5330c374-2ffc-4d22-893e-b4b0eef6dce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '359f77bc10704e99aa5b51e8469dd131', 'request_id': 'req-5330c374-2ffc-4d22-893e-b4b0eef6dce6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:31.415753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5330c374-2ffc-4d22-893e-b4b0eef6dce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '359f77bc10704e99aa5b51e8469dd131', 'request_id': 'req-5330c374-2ffc-4d22-893e-b4b0eef6dce6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:31.423176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5330c374-2ffc-4d22-893e-b4b0eef6dce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '359f77bc10704e99aa5b51e8469dd131', 'request_id': 'req-5330c374-2ffc-4d22-893e-b4b0eef6dce6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:31.446615 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:31.451563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5330c374-2ffc-4d22-893e-b4b0eef6dce6 admin admin] The token cache is being invalidate because project 359f77bc10704e99aa5b51e8469dd131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:14:31.452222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5330c374-2ffc-4d22-893e-b4b0eef6dce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:31.453404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5330c374-2ffc-4d22-893e-b4b0eef6dce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:31.456122 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3447/6916] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:14:31 2022] DELETE /identity/v3/projects/359f77bc10704e99aa5b51e8469dd131 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:31.461859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eff7a7-b8d5-4d51-9430-498895d6e326 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:31.462355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eff7a7-b8d5-4d51-9430-498895d6e326 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:31.462797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eff7a7-b8d5-4d51-9430-498895d6e326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:31.504836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-58eff7a7-b8d5-4d51-9430-498895d6e326 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:31.507912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-58eff7a7-b8d5-4d51-9430-498895d6e326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:31.583672 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:31.650538 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3470/6917] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:31.658999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12451fd-f4b5-4f16-8028-26b7d8f62dd7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:31.659347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12451fd-f4b5-4f16-8028-26b7d8f62dd7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:31.659725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12451fd-f4b5-4f16-8028-26b7d8f62dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:31.702811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f12451fd-f4b5-4f16-8028-26b7d8f62dd7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:31.705062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f12451fd-f4b5-4f16-8028-26b7d8f62dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:31.715777 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3448/6918] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:31.720240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eff7a7-b8d5-4d51-9430-498895d6e326 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:31.734604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eff7a7-b8d5-4d51-9430-498895d6e326 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:31.762987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e50c29-22c4-4ca1-987b-1e1d09e3b921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:31.763923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e50c29-22c4-4ca1-987b-1e1d09e3b921 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:31.765994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e50c29-22c4-4ca1-987b-1e1d09e3b921 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:31.766543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e50c29-22c4-4ca1-987b-1e1d09e3b921 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:31.769655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e50c29-22c4-4ca1-987b-1e1d09e3b921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:14:31.770183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e50c29-22c4-4ca1-987b-1e1d09e3b921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:31.777316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e50c29-22c4-4ca1-987b-1e1d09e3b921 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:31.872890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12451fd-f4b5-4f16-8028-26b7d8f62dd7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:31.873130 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3471/6919] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:14:31.882399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12451fd-f4b5-4f16-8028-26b7d8f62dd7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:31.901815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe57466-0810-4e24-9d20-4ceb55fa0ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:31.902462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe57466-0810-4e24-9d20-4ceb55fa0ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:31.902740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe57466-0810-4e24-9d20-4ceb55fa0ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:31.906068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe57466-0810-4e24-9d20-4ceb55fa0ab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:31.906922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe57466-0810-4e24-9d20-4ceb55fa0ab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:31.917997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe57466-0810-4e24-9d20-4ceb55fa0ab0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:32.044145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e50c29-22c4-4ca1-987b-1e1d09e3b921 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:32.052783 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3449/6920] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:14:31 2022] POST /identity/v3/projects => generated 359 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:14:32.059585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e50c29-22c4-4ca1-987b-1e1d09e3b921 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:32.117602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a5fd4-71f5-419b-adc2-f9157e13d512 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:32.118383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a5fd4-71f5-419b-adc2-f9157e13d512 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:32.118941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a5fd4-71f5-419b-adc2-f9157e13d512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:32.178822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c37a5fd4-71f5-419b-adc2-f9157e13d512 None None] MFA Rules not processed for user `45a25acf184b4bfc9f1b06dcf0e6d81b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:32.188761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c37a5fd4-71f5-419b-adc2-f9157e13d512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:32.254112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ceb511-b425-4d59-a4df-fb931bd27907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:32.254992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ceb511-b425-4d59-a4df-fb931bd27907 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:32.255841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ceb511-b425-4d59-a4df-fb931bd27907 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:32.257006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ceb511-b425-4d59-a4df-fb931bd27907 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:32.260108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ceb511-b425-4d59-a4df-fb931bd27907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:32.264009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ceb511-b425-4d59-a4df-fb931bd27907 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:32.367450 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3472/6921] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:14:32 2022] POST /identity/v3/users => generated 280 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:14:32.370124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ceb511-b425-4d59-a4df-fb931bd27907 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:32.394013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ceb511-b425-4d59-a4df-fb931bd27907 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:32.414409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72c986-5421-4f03-9bf2-82e0f62b9375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:32.415029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72c986-5421-4f03-9bf2-82e0f62b9375 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:32.415304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72c986-5421-4f03-9bf2-82e0f62b9375 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:32.415573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72c986-5421-4f03-9bf2-82e0f62b9375 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:32.416217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72c986-5421-4f03-9bf2-82e0f62b9375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:32.422715 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3450/6922] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:14:32.423394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72c986-5421-4f03-9bf2-82e0f62b9375 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:32.451700 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3473/6923] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:14:32.456227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a5fd4-71f5-419b-adc2-f9157e13d512 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:32.475618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a5fd4-71f5-419b-adc2-f9157e13d512 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:32.491160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2442d43-4979-4652-b251-d13b7909ed51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:32.492082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2442d43-4979-4652-b251-d13b7909ed51 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:32.492527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2442d43-4979-4652-b251-d13b7909ed51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:32.493008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2442d43-4979-4652-b251-d13b7909ed51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:32.493826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2442d43-4979-4652-b251-d13b7909ed51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:32.495684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2442d43-4979-4652-b251-d13b7909ed51 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:32.519320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72c986-5421-4f03-9bf2-82e0f62b9375 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:32.533642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72c986-5421-4f03-9bf2-82e0f62b9375 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:32.534365 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3451/6924] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:14:32.563596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec44a0-05a0-4de4-afd3-1348b7ba5448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:32.565209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec44a0-05a0-4de4-afd3-1348b7ba5448 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:32.565646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec44a0-05a0-4de4-afd3-1348b7ba5448 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:32.566208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec44a0-05a0-4de4-afd3-1348b7ba5448 admin admin] PATH_INFO: `/v3/projects/1c38cf974bda4370abecfb3d14e8d2bc/users/5c324c64cfe3475eabd746c075f9329c/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:32.615982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec44a0-05a0-4de4-afd3-1348b7ba5448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c38cf974bda4370abecfb3d14e8d2bc, user_id=5c324c64cfe3475eabd746c075f9329c, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:32.619107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec44a0-05a0-4de4-afd3-1348b7ba5448 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:32.651008 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3474/6925] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:14:32 2022] PUT /identity/v3/projects/1c38cf974bda4370abecfb3d14e8d2bc/users/5c324c64cfe3475eabd746c075f9329c/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:14:32.667623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216ce11-60eb-4dc1-bf9c-c6c95afe7f26 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:32.667853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216ce11-60eb-4dc1-bf9c-c6c95afe7f26 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:32.668263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216ce11-60eb-4dc1-bf9c-c6c95afe7f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:32.731516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1216ce11-60eb-4dc1-bf9c-c6c95afe7f26 None None] MFA Rules not processed for user `5c324c64cfe3475eabd746c075f9329c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:32.732957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1216ce11-60eb-4dc1-bf9c-c6c95afe7f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:32.903552 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3452/6926] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:32.935333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec44a0-05a0-4de4-afd3-1348b7ba5448 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:33.143741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec44a0-05a0-4de4-afd3-1348b7ba5448 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:33.169962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fc7f7-0830-4b61-9858-3ce3adbb6d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:33.170627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fc7f7-0830-4b61-9858-3ce3adbb6d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:33.171005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fc7f7-0830-4b61-9858-3ce3adbb6d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:33.171292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fc7f7-0830-4b61-9858-3ce3adbb6d3e admin admin] PATH_INFO: `/v3/users/5c324c64cfe3475eabd746c075f9329c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:33.174730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fc7f7-0830-4b61-9858-3ce3adbb6d3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c324c64cfe3475eabd746c075f9329c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:33.181061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fc7f7-0830-4b61-9858-3ce3adbb6d3e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:33.253504 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:33.310543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-077fc7f7-0830-4b61-9858-3ce3adbb6d3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c324c64cfe3475eabd746c075f9329c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:33.312487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-077fc7f7-0830-4b61-9858-3ce3adbb6d3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c324c64cfe3475eabd746c075f9329c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:33.339726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-077fc7f7-0830-4b61-9858-3ce3adbb6d3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c324c64cfe3475eabd746c075f9329c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:33.361101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-077fc7f7-0830-4b61-9858-3ce3adbb6d3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c324c64cfe3475eabd746c075f9329c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:33.377374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-077fc7f7-0830-4b61-9858-3ce3adbb6d3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c324c64cfe3475eabd746c075f9329c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:33.391695 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3475/6927] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:14:32 2022] DELETE /identity/v3/users/5c324c64cfe3475eabd746c075f9329c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:33.396243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a1b99-7b68-46a1-949f-dc11e2cffa78 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:33.397094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a1b99-7b68-46a1-949f-dc11e2cffa78 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:33.397503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a1b99-7b68-46a1-949f-dc11e2cffa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:33.440240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-448a1b99-7b68-46a1-949f-dc11e2cffa78 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:33.462562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-448a1b99-7b68-46a1-949f-dc11e2cffa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:33.580126 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:33.629542 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3453/6928] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:33.744576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fc7f7-0830-4b61-9858-3ce3adbb6d3e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:33.746380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-077fc7f7-0830-4b61-9858-3ce3adbb6d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:33.904721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fc7f7-0830-4b61-9858-3ce3adbb6d3e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:33.933735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f98d36-1e5a-4e17-a1fb-da1c5ac02625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:33.934378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f98d36-1e5a-4e17-a1fb-da1c5ac02625 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:33.934755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f98d36-1e5a-4e17-a1fb-da1c5ac02625 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:33.934946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f98d36-1e5a-4e17-a1fb-da1c5ac02625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:33.948102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f98d36-1e5a-4e17-a1fb-da1c5ac02625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:33.964163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f98d36-1e5a-4e17-a1fb-da1c5ac02625 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:33.994251 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3476/6929] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:14:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:14:34.728181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a1b99-7b68-46a1-949f-dc11e2cffa78 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:34.730057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-448a1b99-7b68-46a1-949f-dc11e2cffa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:34.951006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f98d36-1e5a-4e17-a1fb-da1c5ac02625 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:34.955277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-63f98d36-1e5a-4e17-a1fb-da1c5ac02625 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:34.978727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f98d36-1e5a-4e17-a1fb-da1c5ac02625 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:34.980440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a1b99-7b68-46a1-949f-dc11e2cffa78 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:35.011545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1822a2-127e-402b-9ba4-7074c0a61ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:35.011806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144af854-0a6b-41fa-9034-505751447be4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:35.012247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144af854-0a6b-41fa-9034-505751447be4 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:35.012537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144af854-0a6b-41fa-9034-505751447be4 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:35.012686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1822a2-127e-402b-9ba4-7074c0a61ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:35.012837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144af854-0a6b-41fa-9034-505751447be4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:35.013118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1822a2-127e-402b-9ba4-7074c0a61ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:35.013491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1822a2-127e-402b-9ba4-7074c0a61ffe admin admin] PATH_INFO: `/v3/projects/1c38cf974bda4370abecfb3d14e8d2bc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:35.015649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1822a2-127e-402b-9ba4-7074c0a61ffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c38cf974bda4370abecfb3d14e8d2bc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:35.016680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-144af854-0a6b-41fa-9034-505751447be4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:35.018229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1822a2-127e-402b-9ba4-7074c0a61ffe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:35.049786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144af854-0a6b-41fa-9034-505751447be4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:35.052200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144af854-0a6b-41fa-9034-505751447be4 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:35.108195 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3454/6930] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:14:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:14:35.263369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9e1822a2-127e-402b-9ba4-7074c0a61ffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c38cf974bda4370abecfb3d14e8d2bc', 'request_id': 'req-9e1822a2-127e-402b-9ba4-7074c0a61ffe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:35.303462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9e1822a2-127e-402b-9ba4-7074c0a61ffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c38cf974bda4370abecfb3d14e8d2bc', 'request_id': 'req-9e1822a2-127e-402b-9ba4-7074c0a61ffe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:35.331833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9e1822a2-127e-402b-9ba4-7074c0a61ffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c38cf974bda4370abecfb3d14e8d2bc', 'request_id': 'req-9e1822a2-127e-402b-9ba4-7074c0a61ffe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:35.385779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9e1822a2-127e-402b-9ba4-7074c0a61ffe admin admin] The token cache is being invalidate because project 1c38cf974bda4370abecfb3d14e8d2bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:14:35.386208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9e1822a2-127e-402b-9ba4-7074c0a61ffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:35.393056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9e1822a2-127e-402b-9ba4-7074c0a61ffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:35.397219 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3477/6931] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:14:34 2022] DELETE /identity/v3/projects/1c38cf974bda4370abecfb3d14e8d2bc => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:35.402977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176bbc5-9bcf-48f3-bb5e-b8eb0980397c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:35.403269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176bbc5-9bcf-48f3-bb5e-b8eb0980397c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:35.403535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176bbc5-9bcf-48f3-bb5e-b8eb0980397c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:35.486067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1176bbc5-9bcf-48f3-bb5e-b8eb0980397c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:35.487520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1176bbc5-9bcf-48f3-bb5e-b8eb0980397c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:35.807180 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3455/6932] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:35.811502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196ea00-e335-4419-921f-85a89a4631ac None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:35.812110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196ea00-e335-4419-921f-85a89a4631ac None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:35.812403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196ea00-e335-4419-921f-85a89a4631ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:35.878361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b196ea00-e335-4419-921f-85a89a4631ac None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:35.879430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b196ea00-e335-4419-921f-85a89a4631ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:35.905191 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3478/6933] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:35.910084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176bbc5-9bcf-48f3-bb5e-b8eb0980397c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:35.958049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176bbc5-9bcf-48f3-bb5e-b8eb0980397c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:36.003517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f1caa-3e27-457f-9868-e4500c88e377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:36.006634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f1caa-3e27-457f-9868-e4500c88e377 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:36.007086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f1caa-3e27-457f-9868-e4500c88e377 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:36.008465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f1caa-3e27-457f-9868-e4500c88e377 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:36.012594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f1caa-3e27-457f-9868-e4500c88e377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:14:36.012942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f1caa-3e27-457f-9868-e4500c88e377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:36.023389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f1caa-3e27-457f-9868-e4500c88e377 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:36.101360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196ea00-e335-4419-921f-85a89a4631ac None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:36.106182 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3456/6934] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:14:36.132051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196ea00-e335-4419-921f-85a89a4631ac None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:36.143836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff283a-6bb1-4be8-8cb3-1494450bef87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:36.144782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff283a-6bb1-4be8-8cb3-1494450bef87 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:36.181687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff283a-6bb1-4be8-8cb3-1494450bef87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:36.184046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff283a-6bb1-4be8-8cb3-1494450bef87 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:36.190582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff283a-6bb1-4be8-8cb3-1494450bef87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:36.201620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff283a-6bb1-4be8-8cb3-1494450bef87 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:36.294456 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:36.370268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f1caa-3e27-457f-9868-e4500c88e377 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:36.386125 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3479/6935] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:14:36 2022] POST /identity/v3/projects => generated 391 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:14:36.409310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f1caa-3e27-457f-9868-e4500c88e377 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:36.931394 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:36.958793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64e402-2545-4a87-9548-93abbb7f2e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:36.962150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64e402-2545-4a87-9548-93abbb7f2e9c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:36.964212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64e402-2545-4a87-9548-93abbb7f2e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:36.965391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64e402-2545-4a87-9548-93abbb7f2e9c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:36.966315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64e402-2545-4a87-9548-93abbb7f2e9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:36.974607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64e402-2545-4a87-9548-93abbb7f2e9c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:37.046065 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3457/6936] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:14:36 2022] POST /identity/v3/users => generated 296 bytes in 679 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:37.055933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff283a-6bb1-4be8-8cb3-1494450bef87 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:37.087023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff283a-6bb1-4be8-8cb3-1494450bef87 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:37.110937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d12ad7-dbfd-44fb-bc1d-8f5b60193875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:37.123874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d12ad7-dbfd-44fb-bc1d-8f5b60193875 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:37.125343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d12ad7-dbfd-44fb-bc1d-8f5b60193875 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:37.131631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d12ad7-dbfd-44fb-bc1d-8f5b60193875 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:37.135660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d12ad7-dbfd-44fb-bc1d-8f5b60193875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:37.164852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d12ad7-dbfd-44fb-bc1d-8f5b60193875 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:37.257050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64e402-2545-4a87-9548-93abbb7f2e9c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:37.266416 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3480/6937] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:14:37.281495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64e402-2545-4a87-9548-93abbb7f2e9c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:37.312247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c3c77-0758-4dec-bb58-314c8230b7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:37.313019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c3c77-0758-4dec-bb58-314c8230b7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:37.313300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c3c77-0758-4dec-bb58-314c8230b7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:37.313573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c3c77-0758-4dec-bb58-314c8230b7d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:37.314235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c3c77-0758-4dec-bb58-314c8230b7d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:37.315833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c3c77-0758-4dec-bb58-314c8230b7d7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:37.333761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d12ad7-dbfd-44fb-bc1d-8f5b60193875 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:37.334605 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3458/6938] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:14:37.346180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d12ad7-dbfd-44fb-bc1d-8f5b60193875 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:37.365522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5cd21-fcdc-4319-b4ca-3db35c28625d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:37.376929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5cd21-fcdc-4319-b4ca-3db35c28625d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:37.378032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5cd21-fcdc-4319-b4ca-3db35c28625d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:37.383163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5cd21-fcdc-4319-b4ca-3db35c28625d admin admin] PATH_INFO: `/v3/projects/e37ded0559814d3ea7b18eb6cd0bd892/users/b8062ae7f9eb45c4980d7eab7f9b491d/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:37.466229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5cd21-fcdc-4319-b4ca-3db35c28625d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e37ded0559814d3ea7b18eb6cd0bd892, user_id=b8062ae7f9eb45c4980d7eab7f9b491d, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:37.471337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5cd21-fcdc-4319-b4ca-3db35c28625d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:37.503490 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3481/6939] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:14:37 2022] PUT /identity/v3/projects/e37ded0559814d3ea7b18eb6cd0bd892/users/b8062ae7f9eb45c4980d7eab7f9b491d/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:14:37.513867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50827ad-f89e-4526-ad34-987636725fee None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:37.514148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50827ad-f89e-4526-ad34-987636725fee None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:37.514728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50827ad-f89e-4526-ad34-987636725fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:37.612948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d50827ad-f89e-4526-ad34-987636725fee None None] MFA Rules not processed for user `b8062ae7f9eb45c4980d7eab7f9b491d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:37.625503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d50827ad-f89e-4526-ad34-987636725fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:37.872877 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3459/6940] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:37.930560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5cd21-fcdc-4319-b4ca-3db35c28625d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:37.936237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-79a5cd21-fcdc-4319-b4ca-3db35c28625d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:38.155271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5cd21-fcdc-4319-b4ca-3db35c28625d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:38.160995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab24b7d-faa3-4b31-90e2-a78c572f5114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:38.162056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab24b7d-faa3-4b31-90e2-a78c572f5114 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:38.165669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab24b7d-faa3-4b31-90e2-a78c572f5114 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:38.166217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab24b7d-faa3-4b31-90e2-a78c572f5114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:38.221412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab24b7d-faa3-4b31-90e2-a78c572f5114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:38.223070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab24b7d-faa3-4b31-90e2-a78c572f5114 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:38.260648 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3482/6941] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:14:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:14:40.005180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50827ad-f89e-4526-ad34-987636725fee None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:40.022278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50827ad-f89e-4526-ad34-987636725fee None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:40.041819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640af99c-7d66-4672-9ef4-4126b0f95b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:40.042439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640af99c-7d66-4672-9ef4-4126b0f95b10 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:40.044031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640af99c-7d66-4672-9ef4-4126b0f95b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:40.044031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640af99c-7d66-4672-9ef4-4126b0f95b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:40.056035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-640af99c-7d66-4672-9ef4-4126b0f95b10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:40.120966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640af99c-7d66-4672-9ef4-4126b0f95b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:40.132559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640af99c-7d66-4672-9ef4-4126b0f95b10 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:40.141942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab24b7d-faa3-4b31-90e2-a78c572f5114 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:40.143374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1ab24b7d-faa3-4b31-90e2-a78c572f5114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:40.197149 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3460/6942] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:14:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:14:40.359198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab24b7d-faa3-4b31-90e2-a78c572f5114 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:40.370373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc28193-0f1e-430b-8dd0-138f55d4c75e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:40.371015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc28193-0f1e-430b-8dd0-138f55d4c75e service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:40.371298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc28193-0f1e-430b-8dd0-138f55d4c75e service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:40.371574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc28193-0f1e-430b-8dd0-138f55d4c75e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:40.377831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3dc28193-0f1e-430b-8dd0-138f55d4c75e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:40.585263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc28193-0f1e-430b-8dd0-138f55d4c75e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:40.587190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc28193-0f1e-430b-8dd0-138f55d4c75e service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:40.691305 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3483/6943] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:14:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:14:50.167858 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=46,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:50.674840 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:52.928954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640af99c-7d66-4672-9ef4-4126b0f95b10 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:53.004054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc28193-0f1e-430b-8dd0-138f55d4c75e service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:53.006423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3dc28193-0f1e-430b-8dd0-138f55d4c75e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:53.205931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640af99c-7d66-4672-9ef4-4126b0f95b10 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:53.210428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc28193-0f1e-430b-8dd0-138f55d4c75e service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:53.218863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a1fff-4a1c-41e3-9ba3-6abeed3ae4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:53.219735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a1fff-4a1c-41e3-9ba3-6abeed3ae4af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:53.220241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a1fff-4a1c-41e3-9ba3-6abeed3ae4af admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:53.220359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f660c-83ff-4051-af23-864eb04a8b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:53.220938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a1fff-4a1c-41e3-9ba3-6abeed3ae4af admin admin] PATH_INFO: `/v3/users/b8062ae7f9eb45c4980d7eab7f9b491d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:53.221075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f660c-83ff-4051-af23-864eb04a8b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:53.221342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f660c-83ff-4051-af23-864eb04a8b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:53.221618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f660c-83ff-4051-af23-864eb04a8b6e admin admin] PATH_INFO: `/v3/users/9421035986e44322ac70172fa08f72b1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:53.223586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a1fff-4a1c-41e3-9ba3-6abeed3ae4af admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8062ae7f9eb45c4980d7eab7f9b491d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:53.225483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f660c-83ff-4051-af23-864eb04a8b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9421035986e44322ac70172fa08f72b1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:53.227433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f660c-83ff-4051-af23-864eb04a8b6e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:53.229572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a1fff-4a1c-41e3-9ba3-6abeed3ae4af admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:53.326607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-487f660c-83ff-4051-af23-864eb04a8b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9421035986e44322ac70172fa08f72b1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:53.329203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-487f660c-83ff-4051-af23-864eb04a8b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9421035986e44322ac70172fa08f72b1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:53.346895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-487f660c-83ff-4051-af23-864eb04a8b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9421035986e44322ac70172fa08f72b1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:53.377383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-487f660c-83ff-4051-af23-864eb04a8b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9421035986e44322ac70172fa08f72b1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:53.378103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-587a1fff-4a1c-41e3-9ba3-6abeed3ae4af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8062ae7f9eb45c4980d7eab7f9b491d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:53.394594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-487f660c-83ff-4051-af23-864eb04a8b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9421035986e44322ac70172fa08f72b1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:53.405587 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3484/6944] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:14:53 2022] DELETE /identity/v3/users/9421035986e44322ac70172fa08f72b1 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:53.406876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070f8c3-6221-4ee0-aeef-97023f188b35 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:53.407288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070f8c3-6221-4ee0-aeef-97023f188b35 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:53.407570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070f8c3-6221-4ee0-aeef-97023f188b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:53.423624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-587a1fff-4a1c-41e3-9ba3-6abeed3ae4af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8062ae7f9eb45c4980d7eab7f9b491d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:53.426396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-587a1fff-4a1c-41e3-9ba3-6abeed3ae4af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8062ae7f9eb45c4980d7eab7f9b491d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:53.458721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6070f8c3-6221-4ee0-aeef-97023f188b35 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:53.459980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6070f8c3-6221-4ee0-aeef-97023f188b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:53.491896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-587a1fff-4a1c-41e3-9ba3-6abeed3ae4af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8062ae7f9eb45c4980d7eab7f9b491d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:53.548509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-587a1fff-4a1c-41e3-9ba3-6abeed3ae4af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8062ae7f9eb45c4980d7eab7f9b491d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:53.577494 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3461/6945] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:14:52 2022] DELETE /identity/v3/users/b8062ae7f9eb45c4980d7eab7f9b491d => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:53.585508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75126f8d-2e8f-442a-a8b1-200c548ef0ef None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:53.585508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75126f8d-2e8f-442a-a8b1-200c548ef0ef None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:53.585508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75126f8d-2e8f-442a-a8b1-200c548ef0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:53.666705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-75126f8d-2e8f-442a-a8b1-200c548ef0ef None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:53.668225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-75126f8d-2e8f-442a-a8b1-200c548ef0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:53.682599 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3485/6946] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:14:53.691846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070f8c3-6221-4ee0-aeef-97023f188b35 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:53.693297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6070f8c3-6221-4ee0-aeef-97023f188b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:53.750487 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:53.861935 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3462/6947] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:14:53.880832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75126f8d-2e8f-442a-a8b1-200c548ef0ef None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:53.880936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070f8c3-6221-4ee0-aeef-97023f188b35 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:53.919197 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:53.969689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd099f0-c993-450c-aab9-04515ab9a48d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:53.970062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd099f0-c993-450c-aab9-04515ab9a48d service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:53.970335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd099f0-c993-450c-aab9-04515ab9a48d service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:53.970609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd099f0-c993-450c-aab9-04515ab9a48d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:53.989479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd099f0-c993-450c-aab9-04515ab9a48d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:53.991029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd099f0-c993-450c-aab9-04515ab9a48d service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:54.006649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75126f8d-2e8f-442a-a8b1-200c548ef0ef None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:54.015675 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3486/6948] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:14:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:14:54.018861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b267ad-eb8c-41cc-b86f-23d34a0728ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:54.019676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b267ad-eb8c-41cc-b86f-23d34a0728ff service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:54.019962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b267ad-eb8c-41cc-b86f-23d34a0728ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:54.020235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b267ad-eb8c-41cc-b86f-23d34a0728ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:54.041763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b267ad-eb8c-41cc-b86f-23d34a0728ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:54.043519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b267ad-eb8c-41cc-b86f-23d34a0728ff service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:54.074818 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3463/6949] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:14:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:14:54.335931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3c813-3adf-42b0-aece-02554cf1be59 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:54.336209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3c813-3adf-42b0-aece-02554cf1be59 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:54.336757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3c813-3adf-42b0-aece-02554cf1be59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:54.377279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-57a3c813-3adf-42b0-aece-02554cf1be59 None None] MFA Rules not processed for user `c0f97633b6e94bbea9169cb3a2717624`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:54.378511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-57a3c813-3adf-42b0-aece-02554cf1be59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:54.481574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b267ad-eb8c-41cc-b86f-23d34a0728ff service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:54.483589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-84b267ad-eb8c-41cc-b86f-23d34a0728ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:54.519534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b267ad-eb8c-41cc-b86f-23d34a0728ff service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:54.544859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd1fae-62c3-40d6-9b5b-f198c7491cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:54.545782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd1fae-62c3-40d6-9b5b-f198c7491cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:54.546017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd1fae-62c3-40d6-9b5b-f198c7491cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:54.546323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd1fae-62c3-40d6-9b5b-f198c7491cb7 admin admin] PATH_INFO: `/v3/projects/e37ded0559814d3ea7b18eb6cd0bd892` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:54.547561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd1fae-62c3-40d6-9b5b-f198c7491cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e37ded0559814d3ea7b18eb6cd0bd892)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:54.550484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd1fae-62c3-40d6-9b5b-f198c7491cb7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:54.560748 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3487/6950] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:54.563266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3c813-3adf-42b0-aece-02554cf1be59 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:54.568946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-57a3c813-3adf-42b0-aece-02554cf1be59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:54.614427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3c813-3adf-42b0-aece-02554cf1be59 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:54.620384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f830f7b-5bb6-47b4-97bd-a6c12cb190c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:54.621422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f830f7b-5bb6-47b4-97bd-a6c12cb190c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:54.622552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f830f7b-5bb6-47b4-97bd-a6c12cb190c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:54.624000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f830f7b-5bb6-47b4-97bd-a6c12cb190c7 admin admin] PATH_INFO: `/v3/projects/e72aa6cde05544869d43a3f19be20353` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:54.625725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f830f7b-5bb6-47b4-97bd-a6c12cb190c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e72aa6cde05544869d43a3f19be20353)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:54.627975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f830f7b-5bb6-47b4-97bd-a6c12cb190c7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:54.674387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fadd1fae-62c3-40d6-9b5b-f198c7491cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e37ded0559814d3ea7b18eb6cd0bd892', 'request_id': 'req-fadd1fae-62c3-40d6-9b5b-f198c7491cb7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:54.696052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fadd1fae-62c3-40d6-9b5b-f198c7491cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e37ded0559814d3ea7b18eb6cd0bd892', 'request_id': 'req-fadd1fae-62c3-40d6-9b5b-f198c7491cb7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:54.706421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fadd1fae-62c3-40d6-9b5b-f198c7491cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e37ded0559814d3ea7b18eb6cd0bd892', 'request_id': 'req-fadd1fae-62c3-40d6-9b5b-f198c7491cb7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:54.734962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fadd1fae-62c3-40d6-9b5b-f198c7491cb7 admin admin] The token cache is being invalidate because project e37ded0559814d3ea7b18eb6cd0bd892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:14:54.736172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fadd1fae-62c3-40d6-9b5b-f198c7491cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:54.738888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fadd1fae-62c3-40d6-9b5b-f198c7491cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:54.745443 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3464/6951] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:14:54 2022] DELETE /identity/v3/projects/e37ded0559814d3ea7b18eb6cd0bd892 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:14:54.745676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f830f7b-5bb6-47b4-97bd-a6c12cb190c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e72aa6cde05544869d43a3f19be20353', 'request_id': 'req-8f830f7b-5bb6-47b4-97bd-a6c12cb190c7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:54.747429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e99ac6-0cf2-4541-a1d0-fdccc291e87b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:54.747718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e99ac6-0cf2-4541-a1d0-fdccc291e87b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:54.747988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e99ac6-0cf2-4541-a1d0-fdccc291e87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:54.761986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f830f7b-5bb6-47b4-97bd-a6c12cb190c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e72aa6cde05544869d43a3f19be20353', 'request_id': 'req-8f830f7b-5bb6-47b4-97bd-a6c12cb190c7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:54.775275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f830f7b-5bb6-47b4-97bd-a6c12cb190c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e72aa6cde05544869d43a3f19be20353', 'request_id': 'req-8f830f7b-5bb6-47b4-97bd-a6c12cb190c7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:54.792417 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:54.803479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f830f7b-5bb6-47b4-97bd-a6c12cb190c7 admin admin] The token cache is being invalidate because project e72aa6cde05544869d43a3f19be20353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:14:54.805803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f830f7b-5bb6-47b4-97bd-a6c12cb190c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:54.808981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f830f7b-5bb6-47b4-97bd-a6c12cb190c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:54.811970 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3488/6952] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:14:54 2022] DELETE /identity/v3/projects/e72aa6cde05544869d43a3f19be20353 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:54.817313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f830f7b-5bb6-47b4-97bd-a6c12cb190c7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:54.819895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8f830f7b-5bb6-47b4-97bd-a6c12cb190c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:54.835570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-76e99ac6-0cf2-4541-a1d0-fdccc291e87b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:54.839434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-76e99ac6-0cf2-4541-a1d0-fdccc291e87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:54.969132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f830f7b-5bb6-47b4-97bd-a6c12cb190c7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:54.980650 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3465/6953] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:54.997433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eede169-1d48-4025-b936-0db8b139441c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:54.997971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9df26-b206-4de9-b84e-68f76654742f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:54.998257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9df26-b206-4de9-b84e-68f76654742f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:54.998904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eede169-1d48-4025-b936-0db8b139441c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:54.999328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9df26-b206-4de9-b84e-68f76654742f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:54.999458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eede169-1d48-4025-b936-0db8b139441c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:54.999821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eede169-1d48-4025-b936-0db8b139441c admin admin] PATH_INFO: `/v3/users/bc3a50cb2d234444b2fe640f2b78baff` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:55.001193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eede169-1d48-4025-b936-0db8b139441c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc3a50cb2d234444b2fe640f2b78baff)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:55.005383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eede169-1d48-4025-b936-0db8b139441c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:55.057221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3be9df26-b206-4de9-b84e-68f76654742f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:55.060744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3be9df26-b206-4de9-b84e-68f76654742f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:55.089627 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3466/6954] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:55.094590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9df26-b206-4de9-b84e-68f76654742f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:55.111738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4eede169-1d48-4025-b936-0db8b139441c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc3a50cb2d234444b2fe640f2b78baff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:55.112469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4eede169-1d48-4025-b936-0db8b139441c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc3a50cb2d234444b2fe640f2b78baff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:55.118763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9df26-b206-4de9-b84e-68f76654742f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:55.126253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4eede169-1d48-4025-b936-0db8b139441c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc3a50cb2d234444b2fe640f2b78baff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:55.133298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a7298-1bb2-4330-9302-05bbf9381304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:55.134976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a7298-1bb2-4330-9302-05bbf9381304 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:55.136439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a7298-1bb2-4330-9302-05bbf9381304 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:55.136908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a7298-1bb2-4330-9302-05bbf9381304 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:55.138378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a7298-1bb2-4330-9302-05bbf9381304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:14:55.141033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a7298-1bb2-4330-9302-05bbf9381304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:55.144956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a7298-1bb2-4330-9302-05bbf9381304 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:55.149103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4eede169-1d48-4025-b936-0db8b139441c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc3a50cb2d234444b2fe640f2b78baff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:55.164783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4eede169-1d48-4025-b936-0db8b139441c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc3a50cb2d234444b2fe640f2b78baff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:55.178494 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3489/6955] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:14:54 2022] DELETE /identity/v3/users/bc3a50cb2d234444b2fe640f2b78baff => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:55.179718 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3467/6956] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:14:55.183120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eede169-1d48-4025-b936-0db8b139441c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:55.185879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4eede169-1d48-4025-b936-0db8b139441c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:55.351854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eede169-1d48-4025-b936-0db8b139441c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:55.363038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb47769-e389-4e9e-8bd4-1688f82c0905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:55.363903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb47769-e389-4e9e-8bd4-1688f82c0905 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:55.364735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb47769-e389-4e9e-8bd4-1688f82c0905 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:55.365287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb47769-e389-4e9e-8bd4-1688f82c0905 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:55.366335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb47769-e389-4e9e-8bd4-1688f82c0905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:55.368910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb47769-e389-4e9e-8bd4-1688f82c0905 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:55.455430 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3490/6957] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:14:55 2022] POST /identity/v3/projects => generated 371 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:55.459356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a7298-1bb2-4330-9302-05bbf9381304 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:55.480166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a7298-1bb2-4330-9302-05bbf9381304 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:55.546809 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:55.610149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cb18a-f6bb-4797-b6c4-3053b74417ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:55.611205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cb18a-f6bb-4797-b6c4-3053b74417ab admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:55.611940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cb18a-f6bb-4797-b6c4-3053b74417ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:55.612928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cb18a-f6bb-4797-b6c4-3053b74417ab admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:55.613831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cb18a-f6bb-4797-b6c4-3053b74417ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:55.616322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cb18a-f6bb-4797-b6c4-3053b74417ab admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:55.654465 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3468/6958] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:14:55 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:55.657125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb47769-e389-4e9e-8bd4-1688f82c0905 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:55.664128 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:55.677556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb47769-e389-4e9e-8bd4-1688f82c0905 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:55.695610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a58a2c-d34f-4804-8f01-ad9abb7a1240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:55.696270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a58a2c-d34f-4804-8f01-ad9abb7a1240 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:55.707004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a58a2c-d34f-4804-8f01-ad9abb7a1240 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:55.707639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a58a2c-d34f-4804-8f01-ad9abb7a1240 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:55.712422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a58a2c-d34f-4804-8f01-ad9abb7a1240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:55.721542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a58a2c-d34f-4804-8f01-ad9abb7a1240 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:55.747899 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3491/6959] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:14:55.753279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cb18a-f6bb-4797-b6c4-3053b74417ab admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:55.768300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cb18a-f6bb-4797-b6c4-3053b74417ab admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:55.774875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935d2a1-10a5-480f-b279-0e5dab265947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:55.775654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935d2a1-10a5-480f-b279-0e5dab265947 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:55.775938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935d2a1-10a5-480f-b279-0e5dab265947 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:55.776215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935d2a1-10a5-480f-b279-0e5dab265947 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:55.776955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935d2a1-10a5-480f-b279-0e5dab265947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:55.778949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935d2a1-10a5-480f-b279-0e5dab265947 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:55.794364 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3469/6960] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:14:55.800015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a58a2c-d34f-4804-8f01-ad9abb7a1240 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:55.827485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a58a2c-d34f-4804-8f01-ad9abb7a1240 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:55.841674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b995875-95ed-4b17-a796-2481541bae7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:55.844932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b995875-95ed-4b17-a796-2481541bae7d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:55.846567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b995875-95ed-4b17-a796-2481541bae7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:55.848230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b995875-95ed-4b17-a796-2481541bae7d admin admin] PATH_INFO: `/v3/projects/806048be31e646e2a5db7fadcce635d9/users/e61af13275a0474bba07fe74ae601101/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:55.899387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b995875-95ed-4b17-a796-2481541bae7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=806048be31e646e2a5db7fadcce635d9, user_id=e61af13275a0474bba07fe74ae601101, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:55.907464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b995875-95ed-4b17-a796-2481541bae7d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:55.916182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935d2a1-10a5-480f-b279-0e5dab265947 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:55.918911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9935d2a1-10a5-480f-b279-0e5dab265947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:55.935784 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3492/6961] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:14:55 2022] PUT /identity/v3/projects/806048be31e646e2a5db7fadcce635d9/users/e61af13275a0474bba07fe74ae601101/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:55.951052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3f642-dd72-437c-8ea2-0af6cb1c2de7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:55.952006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3f642-dd72-437c-8ea2-0af6cb1c2de7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:55.952367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3f642-dd72-437c-8ea2-0af6cb1c2de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:56.014865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-58e3f642-dd72-437c-8ea2-0af6cb1c2de7 None None] MFA Rules not processed for user `e61af13275a0474bba07fe74ae601101`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:56.016587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-58e3f642-dd72-437c-8ea2-0af6cb1c2de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:56.107217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935d2a1-10a5-480f-b279-0e5dab265947 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:56.164392 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3493/6962] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:14:56.222169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3f642-dd72-437c-8ea2-0af6cb1c2de7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:56.225551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-58e3f642-dd72-437c-8ea2-0af6cb1c2de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:56.246556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15695989-b7f2-4f18-8a4a-925dd78c66c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:56.257275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15695989-b7f2-4f18-8a4a-925dd78c66c2 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:56.257785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15695989-b7f2-4f18-8a4a-925dd78c66c2 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:56.259718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15695989-b7f2-4f18-8a4a-925dd78c66c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:56.269782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-15695989-b7f2-4f18-8a4a-925dd78c66c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:56.298837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15695989-b7f2-4f18-8a4a-925dd78c66c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:56.300444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15695989-b7f2-4f18-8a4a-925dd78c66c2 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:56.322541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3f642-dd72-437c-8ea2-0af6cb1c2de7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:56.325275 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3470/6963] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:14:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:14:56.330098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ae710-98ae-4573-800a-62aad494b47e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:56.330952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ae710-98ae-4573-800a-62aad494b47e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:56.331390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ae710-98ae-4573-800a-62aad494b47e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:56.331897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ae710-98ae-4573-800a-62aad494b47e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:56.380443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ae710-98ae-4573-800a-62aad494b47e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:56.388675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ae710-98ae-4573-800a-62aad494b47e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:56.438714 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3494/6964] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:14:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:14:56.638718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15695989-b7f2-4f18-8a4a-925dd78c66c2 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:56.641489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-15695989-b7f2-4f18-8a4a-925dd78c66c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:56.753413 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:56.844048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15695989-b7f2-4f18-8a4a-925dd78c66c2 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:56.864316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3719461-1add-4db9-91c3-1f1f2985ae43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:56.868804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3719461-1add-4db9-91c3-1f1f2985ae43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:56.869661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3719461-1add-4db9-91c3-1f1f2985ae43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:56.870918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3719461-1add-4db9-91c3-1f1f2985ae43 admin admin] PATH_INFO: `/v3/projects/e150b62fa1874d1d8cc66ba53c511b27` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:56.875766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3719461-1add-4db9-91c3-1f1f2985ae43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e150b62fa1874d1d8cc66ba53c511b27)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:56.881568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3719461-1add-4db9-91c3-1f1f2985ae43 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:57.031867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e3719461-1add-4db9-91c3-1f1f2985ae43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e150b62fa1874d1d8cc66ba53c511b27', 'request_id': 'req-e3719461-1add-4db9-91c3-1f1f2985ae43'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:57.055877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e3719461-1add-4db9-91c3-1f1f2985ae43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e150b62fa1874d1d8cc66ba53c511b27', 'request_id': 'req-e3719461-1add-4db9-91c3-1f1f2985ae43'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:57.093484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e3719461-1add-4db9-91c3-1f1f2985ae43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e150b62fa1874d1d8cc66ba53c511b27', 'request_id': 'req-e3719461-1add-4db9-91c3-1f1f2985ae43'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:57.136227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e3719461-1add-4db9-91c3-1f1f2985ae43 admin admin] The token cache is being invalidate because project e150b62fa1874d1d8cc66ba53c511b27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:14:57.136962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e3719461-1add-4db9-91c3-1f1f2985ae43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:57.165146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e3719461-1add-4db9-91c3-1f1f2985ae43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:14:57.167101 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3471/6965] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:14:56 2022] DELETE /identity/v3/projects/e150b62fa1874d1d8cc66ba53c511b27 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:57.173116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a15e28-4036-411f-b4d7-1ca54c29e0ae None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:57.173626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a15e28-4036-411f-b4d7-1ca54c29e0ae None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:57.173735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a15e28-4036-411f-b4d7-1ca54c29e0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:57.243250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-72a15e28-4036-411f-b4d7-1ca54c29e0ae None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:57.246379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-72a15e28-4036-411f-b4d7-1ca54c29e0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:57.369470 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:57.388189 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3495/6966] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:57.397256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d562f-77ad-4744-9df1-0c8914b27c5e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:57.397806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d562f-77ad-4744-9df1-0c8914b27c5e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:57.398240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d562f-77ad-4744-9df1-0c8914b27c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:57.476660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-813d562f-77ad-4744-9df1-0c8914b27c5e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:57.478774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-813d562f-77ad-4744-9df1-0c8914b27c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:57.507807 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3472/6967] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:57.512927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a15e28-4036-411f-b4d7-1ca54c29e0ae None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:57.527652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a15e28-4036-411f-b4d7-1ca54c29e0ae None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:57.532576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212160c6-2d40-45e4-89a0-e00d1eba2450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:57.533233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212160c6-2d40-45e4-89a0-e00d1eba2450 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:57.533513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212160c6-2d40-45e4-89a0-e00d1eba2450 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:57.535894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212160c6-2d40-45e4-89a0-e00d1eba2450 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:57.535894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212160c6-2d40-45e4-89a0-e00d1eba2450 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:14:57.535894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212160c6-2d40-45e4-89a0-e00d1eba2450 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:57.538305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212160c6-2d40-45e4-89a0-e00d1eba2450 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:57.557112 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3496/6968] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:14:57.564379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d562f-77ad-4744-9df1-0c8914b27c5e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:57.578991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d562f-77ad-4744-9df1-0c8914b27c5e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:57.599888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b192e3-b0e9-4323-ac7f-0ba8d16f7704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:57.600844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b192e3-b0e9-4323-ac7f-0ba8d16f7704 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:57.601190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b192e3-b0e9-4323-ac7f-0ba8d16f7704 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:57.601494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b192e3-b0e9-4323-ac7f-0ba8d16f7704 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:57.602260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b192e3-b0e9-4323-ac7f-0ba8d16f7704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:57.604515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b192e3-b0e9-4323-ac7f-0ba8d16f7704 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:57.644709 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3473/6969] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:14:57 2022] POST /identity/v3/projects => generated 379 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:57.648210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212160c6-2d40-45e4-89a0-e00d1eba2450 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:57.666940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212160c6-2d40-45e4-89a0-e00d1eba2450 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:57.895595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1980130-bd0b-4a15-89e5-281c7481402d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:57.897907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1980130-bd0b-4a15-89e5-281c7481402d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:57.898196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1980130-bd0b-4a15-89e5-281c7481402d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:57.898465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1980130-bd0b-4a15-89e5-281c7481402d admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:57.899130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1980130-bd0b-4a15-89e5-281c7481402d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:57.903443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1980130-bd0b-4a15-89e5-281c7481402d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:57.949189 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3497/6970] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:14:57 2022] POST /identity/v3/users => generated 290 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:57.957354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b192e3-b0e9-4323-ac7f-0ba8d16f7704 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:57.999454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b192e3-b0e9-4323-ac7f-0ba8d16f7704 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:58.016535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489ee73-bdb0-4fb2-9293-eebfbcc08af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:58.016836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489ee73-bdb0-4fb2-9293-eebfbcc08af8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:58.017072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489ee73-bdb0-4fb2-9293-eebfbcc08af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:58.017821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489ee73-bdb0-4fb2-9293-eebfbcc08af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:58.019624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489ee73-bdb0-4fb2-9293-eebfbcc08af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:58.020985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489ee73-bdb0-4fb2-9293-eebfbcc08af8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:58.033758 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3474/6971] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:14:58.039334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1980130-bd0b-4a15-89e5-281c7481402d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:58.052832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1980130-bd0b-4a15-89e5-281c7481402d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:58.063282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d20d5-b35f-48ec-937e-55b8bec24c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:58.064314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d20d5-b35f-48ec-937e-55b8bec24c2e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:58.064848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d20d5-b35f-48ec-937e-55b8bec24c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:58.065322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d20d5-b35f-48ec-937e-55b8bec24c2e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:58.066470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d20d5-b35f-48ec-937e-55b8bec24c2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:58.069450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d20d5-b35f-48ec-937e-55b8bec24c2e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:58.100794 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3498/6972] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:14:58.105242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489ee73-bdb0-4fb2-9293-eebfbcc08af8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:58.127525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489ee73-bdb0-4fb2-9293-eebfbcc08af8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:58.133000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f292f-8a09-42ad-a990-a7b89136465a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:58.134092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f292f-8a09-42ad-a990-a7b89136465a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:58.135511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f292f-8a09-42ad-a990-a7b89136465a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:58.136212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f292f-8a09-42ad-a990-a7b89136465a admin admin] PATH_INFO: `/v3/projects/2172717021a14ff0a8be58371bb11d71/users/abd895118f5a4a399a1a7e4c885eda8d/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:58.177109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f292f-8a09-42ad-a990-a7b89136465a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2172717021a14ff0a8be58371bb11d71, user_id=abd895118f5a4a399a1a7e4c885eda8d, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:58.181288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f292f-8a09-42ad-a990-a7b89136465a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:58.205901 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3475/6973] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:14:58 2022] PUT /identity/v3/projects/2172717021a14ff0a8be58371bb11d71/users/abd895118f5a4a399a1a7e4c885eda8d/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:14:58.216422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c56a-5ee1-4008-a1d3-f6b72edbefe7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:58.218267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c56a-5ee1-4008-a1d3-f6b72edbefe7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:58.218936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c56a-5ee1-4008-a1d3-f6b72edbefe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:58.279011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7e68c56a-5ee1-4008-a1d3-f6b72edbefe7 None None] MFA Rules not processed for user `abd895118f5a4a399a1a7e4c885eda8d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:58.282808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7e68c56a-5ee1-4008-a1d3-f6b72edbefe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:58.438399 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3499/6974] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:58.443005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f292f-8a09-42ad-a990-a7b89136465a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:58.585622 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:58.625351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f292f-8a09-42ad-a990-a7b89136465a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:58.631516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a4d32-184f-4d4b-9c35-14b27f5bc274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:58.632692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a4d32-184f-4d4b-9c35-14b27f5bc274 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:58.633365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a4d32-184f-4d4b-9c35-14b27f5bc274 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:58.633906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a4d32-184f-4d4b-9c35-14b27f5bc274 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:58.635621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a4d32-184f-4d4b-9c35-14b27f5bc274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:58.662526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a4d32-184f-4d4b-9c35-14b27f5bc274 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:58.746372 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3476/6975] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:14:58 2022] POST /identity/v3/projects => generated 381 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:58.750620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68c56a-5ee1-4008-a1d3-f6b72edbefe7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:58.796087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68c56a-5ee1-4008-a1d3-f6b72edbefe7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:58.901706 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:14:58.953070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68244e-12b6-4c54-9128-917ee8c7d41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:58.954132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68244e-12b6-4c54-9128-917ee8c7d41c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:58.954956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68244e-12b6-4c54-9128-917ee8c7d41c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:58.954956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68244e-12b6-4c54-9128-917ee8c7d41c admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:58.955300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68244e-12b6-4c54-9128-917ee8c7d41c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:58.957604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68244e-12b6-4c54-9128-917ee8c7d41c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:58.999421 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3500/6976] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:14:58 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:14:59.000036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a4d32-184f-4d4b-9c35-14b27f5bc274 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:59.023635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a4d32-184f-4d4b-9c35-14b27f5bc274 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:59.033519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a5743-2e39-4417-9042-56d7b74af436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:59.034277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a5743-2e39-4417-9042-56d7b74af436 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:59.034668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a5743-2e39-4417-9042-56d7b74af436 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:59.035022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a5743-2e39-4417-9042-56d7b74af436 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:59.035790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a5743-2e39-4417-9042-56d7b74af436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:59.043819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a5743-2e39-4417-9042-56d7b74af436 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:59.068331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68244e-12b6-4c54-9128-917ee8c7d41c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:59.068593 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3477/6977] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:14:59.086638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68244e-12b6-4c54-9128-917ee8c7d41c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:59.099977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d931c-e9ce-4501-94e6-4419612277b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:59.100685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d931c-e9ce-4501-94e6-4419612277b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:59.100970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d931c-e9ce-4501-94e6-4419612277b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:59.103121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d931c-e9ce-4501-94e6-4419612277b5 admin admin] PATH_INFO: `/v3/projects/2c437196cbe5448eac5c8aa2f5c68072/users/ddef05f20421461d8af59efcd9a6b30f/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:59.136072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d931c-e9ce-4501-94e6-4419612277b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c437196cbe5448eac5c8aa2f5c68072, user_id=ddef05f20421461d8af59efcd9a6b30f, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:59.148894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d931c-e9ce-4501-94e6-4419612277b5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:59.176434 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3501/6978] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:14:59 2022] PUT /identity/v3/projects/2c437196cbe5448eac5c8aa2f5c68072/users/ddef05f20421461d8af59efcd9a6b30f/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:59.181114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a5743-2e39-4417-9042-56d7b74af436 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:59.201092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a5743-2e39-4417-9042-56d7b74af436 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:59.317667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595ee6d-bad1-4d3a-9635-014570ff4b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:59.318635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595ee6d-bad1-4d3a-9635-014570ff4b06 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:59.319081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595ee6d-bad1-4d3a-9635-014570ff4b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:59.319751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595ee6d-bad1-4d3a-9635-014570ff4b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:59.320552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595ee6d-bad1-4d3a-9635-014570ff4b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:59.324015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595ee6d-bad1-4d3a-9635-014570ff4b06 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:59.339018 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3478/6979] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:14:59.344349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d931c-e9ce-4501-94e6-4419612277b5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:59.366130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d931c-e9ce-4501-94e6-4419612277b5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:59.389897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666b8e1-7538-46c7-a01c-4726cd36eecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:59.391243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666b8e1-7538-46c7-a01c-4726cd36eecb admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:59.391762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666b8e1-7538-46c7-a01c-4726cd36eecb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:59.392339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666b8e1-7538-46c7-a01c-4726cd36eecb admin admin] PATH_INFO: `/v3/projects/2c437196cbe5448eac5c8aa2f5c68072/users/ddef05f20421461d8af59efcd9a6b30f/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:59.396726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666b8e1-7538-46c7-a01c-4726cd36eecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c437196cbe5448eac5c8aa2f5c68072, user_id=ddef05f20421461d8af59efcd9a6b30f, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:59.402176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666b8e1-7538-46c7-a01c-4726cd36eecb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:59.424287 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3502/6980] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:14:59 2022] PUT /identity/v3/projects/2c437196cbe5448eac5c8aa2f5c68072/users/ddef05f20421461d8af59efcd9a6b30f/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:14:59.436316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6be95-f75f-4b80-9347-ca322f619353 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:59.436633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6be95-f75f-4b80-9347-ca322f619353 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:59.437550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6be95-f75f-4b80-9347-ca322f619353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:59.469352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-65f6be95-f75f-4b80-9347-ca322f619353 None None] MFA Rules not processed for user `ddef05f20421461d8af59efcd9a6b30f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:14:59.470474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-65f6be95-f75f-4b80-9347-ca322f619353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:59.665510 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3479/6981] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:14:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:14:59.666792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666b8e1-7538-46c7-a01c-4726cd36eecb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:14:59.668521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d666b8e1-7538-46c7-a01c-4726cd36eecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:14:59.782309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666b8e1-7538-46c7-a01c-4726cd36eecb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:14:59.802727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84244574-9c1a-4da0-b43c-7c7b60abfd47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:14:59.803365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84244574-9c1a-4da0-b43c-7c7b60abfd47 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:14:59.803655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84244574-9c1a-4da0-b43c-7c7b60abfd47 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:14:59.803928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84244574-9c1a-4da0-b43c-7c7b60abfd47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:14:59.829279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84244574-9c1a-4da0-b43c-7c7b60abfd47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:14:59.830832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84244574-9c1a-4da0-b43c-7c7b60abfd47 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:14:59.860958 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3503/6982] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:14:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:15:00.465085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6be95-f75f-4b80-9347-ca322f619353 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:00.485638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6be95-f75f-4b80-9347-ca322f619353 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:00.508429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd6087-c1ec-4d06-8db9-2f2ef712692f tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddef05f20421461d8af59efcd9a6b30f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c437196cbe5448eac5c8aa2f5c68072', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:00.509484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd6087-c1ec-4d06-8db9-2f2ef712692f tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:00.509985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd6087-c1ec-4d06-8db9-2f2ef712692f tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:00.510452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd6087-c1ec-4d06-8db9-2f2ef712692f tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:00.511801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd6087-c1ec-4d06-8db9-2f2ef712692f tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:15:00.512454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd6087-c1ec-4d06-8db9-2f2ef712692f tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:00.514954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd6087-c1ec-4d06-8db9-2f2ef712692f tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:00.532289 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3480/6983] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:15:00.536658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84244574-9c1a-4da0-b43c-7c7b60abfd47 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:00.555295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84244574-9c1a-4da0-b43c-7c7b60abfd47 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:00.570003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f3b6a-5a4f-444d-9594-891a39a12c6b tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddef05f20421461d8af59efcd9a6b30f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c437196cbe5448eac5c8aa2f5c68072', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:00.571030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f3b6a-5a4f-444d-9594-891a39a12c6b tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:00.572228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f3b6a-5a4f-444d-9594-891a39a12c6b tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:00.572512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f3b6a-5a4f-444d-9594-891a39a12c6b tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:00.573551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f3b6a-5a4f-444d-9594-891a39a12c6b tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:00.580583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f3b6a-5a4f-444d-9594-891a39a12c6b tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:00.635722 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3504/6984] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:15:00 2022] POST /identity/v3/projects => generated 354 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:00.641632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd6087-c1ec-4d06-8db9-2f2ef712692f tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:00.659804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd6087-c1ec-4d06-8db9-2f2ef712692f tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:00.752943 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:00.834470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78491d-2be4-4e0b-a126-ae03353513e8 tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddef05f20421461d8af59efcd9a6b30f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c437196cbe5448eac5c8aa2f5c68072', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:00.835100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78491d-2be4-4e0b-a126-ae03353513e8 tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:00.835388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78491d-2be4-4e0b-a126-ae03353513e8 tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:00.835667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78491d-2be4-4e0b-a126-ae03353513e8 tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:00.836321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78491d-2be4-4e0b-a126-ae03353513e8 tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:15:00.836647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78491d-2be4-4e0b-a126-ae03353513e8 tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:00.838238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78491d-2be4-4e0b-a126-ae03353513e8 tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:00.869576 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3481/6985] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:15:00.943450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f3b6a-5a4f-444d-9594-891a39a12c6b tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:00.985662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f3b6a-5a4f-444d-9594-891a39a12c6b tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:00.993054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b00464-87d1-4d04-b939-f63d421098ff tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddef05f20421461d8af59efcd9a6b30f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c437196cbe5448eac5c8aa2f5c68072', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:00.994224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b00464-87d1-4d04-b939-f63d421098ff tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:00.994798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b00464-87d1-4d04-b939-f63d421098ff tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:00.996366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b00464-87d1-4d04-b939-f63d421098ff tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] PATH_INFO: `/v3/projects/a0b0c04d108647c2a7e44033727d3d97` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:00.999004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b00464-87d1-4d04-b939-f63d421098ff tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a0b0c04d108647c2a7e44033727d3d97)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:01.009001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b00464-87d1-4d04-b939-f63d421098ff tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:01.090474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-56b00464-87d1-4d04-b939-f63d421098ff tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0b0c04d108647c2a7e44033727d3d97', 'request_id': 'req-56b00464-87d1-4d04-b939-f63d421098ff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:01.106096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-56b00464-87d1-4d04-b939-f63d421098ff tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0b0c04d108647c2a7e44033727d3d97', 'request_id': 'req-56b00464-87d1-4d04-b939-f63d421098ff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:01.116930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-56b00464-87d1-4d04-b939-f63d421098ff tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0b0c04d108647c2a7e44033727d3d97', 'request_id': 'req-56b00464-87d1-4d04-b939-f63d421098ff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:01.133763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-56b00464-87d1-4d04-b939-f63d421098ff tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] The token cache is being invalidate because project a0b0c04d108647c2a7e44033727d3d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:01.134811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-56b00464-87d1-4d04-b939-f63d421098ff tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:01.136383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-56b00464-87d1-4d04-b939-f63d421098ff tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:01.140040 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3505/6986] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:15:00 2022] DELETE /identity/v3/projects/a0b0c04d108647c2a7e44033727d3d97 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:01.551654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78491d-2be4-4e0b-a126-ae03353513e8 tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:01.553450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8b78491d-2be4-4e0b-a126-ae03353513e8 tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:01.647117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78491d-2be4-4e0b-a126-ae03353513e8 tempest-VolumeQuotaClassesTest-1561280900 tempest-VolumeQuotaClassesTest-1561280900-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:01.756455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14515026-3eec-4ad0-8a06-cc19cb274dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:01.759128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14515026-3eec-4ad0-8a06-cc19cb274dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:01.759916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14515026-3eec-4ad0-8a06-cc19cb274dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:01.760742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14515026-3eec-4ad0-8a06-cc19cb274dd9 admin admin] PATH_INFO: `/v3/users/abd895118f5a4a399a1a7e4c885eda8d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:01.767489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14515026-3eec-4ad0-8a06-cc19cb274dd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd895118f5a4a399a1a7e4c885eda8d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:01.773937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14515026-3eec-4ad0-8a06-cc19cb274dd9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:01.898537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-14515026-3eec-4ad0-8a06-cc19cb274dd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd895118f5a4a399a1a7e4c885eda8d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:01.926987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-14515026-3eec-4ad0-8a06-cc19cb274dd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd895118f5a4a399a1a7e4c885eda8d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:01.928677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-14515026-3eec-4ad0-8a06-cc19cb274dd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd895118f5a4a399a1a7e4c885eda8d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:01.981773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-14515026-3eec-4ad0-8a06-cc19cb274dd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd895118f5a4a399a1a7e4c885eda8d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:02.004528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-14515026-3eec-4ad0-8a06-cc19cb274dd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd895118f5a4a399a1a7e4c885eda8d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:02.006496 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:02.012307 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3482/6987] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:01 2022] DELETE /identity/v3/users/abd895118f5a4a399a1a7e4c885eda8d => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:02.019033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5177c-deed-4a65-8e90-85fe67444efb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:02.019601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5177c-deed-4a65-8e90-85fe67444efb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:02.019924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5177c-deed-4a65-8e90-85fe67444efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:02.105895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4ba5177c-deed-4a65-8e90-85fe67444efb None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:02.112986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4ba5177c-deed-4a65-8e90-85fe67444efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:02.126192 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:02.231779 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3506/6988] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:02.246000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14515026-3eec-4ad0-8a06-cc19cb274dd9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:02.247891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-14515026-3eec-4ad0-8a06-cc19cb274dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:02.348219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14515026-3eec-4ad0-8a06-cc19cb274dd9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:02.353338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7821def-00e9-4374-95a6-96f8e782cda4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:02.354138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7821def-00e9-4374-95a6-96f8e782cda4 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:02.354474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7821def-00e9-4374-95a6-96f8e782cda4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:02.354742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7821def-00e9-4374-95a6-96f8e782cda4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:02.371515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7821def-00e9-4374-95a6-96f8e782cda4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:02.373367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7821def-00e9-4374-95a6-96f8e782cda4 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:02.387108 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3483/6989] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:15:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:15:03.773346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5177c-deed-4a65-8e90-85fe67444efb None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:03.774792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4ba5177c-deed-4a65-8e90-85fe67444efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:03.803391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5177c-deed-4a65-8e90-85fe67444efb None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:03.816383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f4de8-edad-4729-a803-fdacfcde7722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:03.817773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f4de8-edad-4729-a803-fdacfcde7722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:03.818199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f4de8-edad-4729-a803-fdacfcde7722 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:03.818626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f4de8-edad-4729-a803-fdacfcde7722 admin admin] PATH_INFO: `/v3/projects/2172717021a14ff0a8be58371bb11d71` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:03.820701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f4de8-edad-4729-a803-fdacfcde7722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2172717021a14ff0a8be58371bb11d71)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:03.823258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f4de8-edad-4729-a803-fdacfcde7722 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:03.960301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-285f4de8-edad-4729-a803-fdacfcde7722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2172717021a14ff0a8be58371bb11d71', 'request_id': 'req-285f4de8-edad-4729-a803-fdacfcde7722'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:03.976867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-285f4de8-edad-4729-a803-fdacfcde7722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2172717021a14ff0a8be58371bb11d71', 'request_id': 'req-285f4de8-edad-4729-a803-fdacfcde7722'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:03.990495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-285f4de8-edad-4729-a803-fdacfcde7722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2172717021a14ff0a8be58371bb11d71', 'request_id': 'req-285f4de8-edad-4729-a803-fdacfcde7722'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:04.034752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-285f4de8-edad-4729-a803-fdacfcde7722 admin admin] The token cache is being invalidate because project 2172717021a14ff0a8be58371bb11d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:04.035688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-285f4de8-edad-4729-a803-fdacfcde7722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:04.036655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-285f4de8-edad-4729-a803-fdacfcde7722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:04.038664 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3507/6990] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:15:03 2022] DELETE /identity/v3/projects/2172717021a14ff0a8be58371bb11d71 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:04.042373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7821def-00e9-4374-95a6-96f8e782cda4 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:04.069040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7821def-00e9-4374-95a6-96f8e782cda4 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:04.267390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e86d31-817d-42be-a5ca-b359bca256c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:04.268327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e86d31-817d-42be-a5ca-b359bca256c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:04.268822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e86d31-817d-42be-a5ca-b359bca256c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:04.269157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e86d31-817d-42be-a5ca-b359bca256c3 admin admin] PATH_INFO: `/v3/users/ddef05f20421461d8af59efcd9a6b30f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:04.271941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e86d31-817d-42be-a5ca-b359bca256c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddef05f20421461d8af59efcd9a6b30f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:04.273878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e86d31-817d-42be-a5ca-b359bca256c3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:04.413204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-51e86d31-817d-42be-a5ca-b359bca256c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddef05f20421461d8af59efcd9a6b30f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:04.425870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-51e86d31-817d-42be-a5ca-b359bca256c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddef05f20421461d8af59efcd9a6b30f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:04.426966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-51e86d31-817d-42be-a5ca-b359bca256c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddef05f20421461d8af59efcd9a6b30f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:04.481140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-51e86d31-817d-42be-a5ca-b359bca256c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddef05f20421461d8af59efcd9a6b30f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:04.490183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-51e86d31-817d-42be-a5ca-b359bca256c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddef05f20421461d8af59efcd9a6b30f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:04.511380 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3484/6991] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:04 2022] DELETE /identity/v3/users/ddef05f20421461d8af59efcd9a6b30f => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:04.927973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f4de8-edad-4729-a803-fdacfcde7722 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:04.929555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-285f4de8-edad-4729-a803-fdacfcde7722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:05.032130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f4de8-edad-4729-a803-fdacfcde7722 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:05.100358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796a3e4-3160-4b33-946a-6f9e132fe75b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:05.101536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796a3e4-3160-4b33-946a-6f9e132fe75b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:05.101994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796a3e4-3160-4b33-946a-6f9e132fe75b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:05.102413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796a3e4-3160-4b33-946a-6f9e132fe75b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:05.104919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e796a3e4-3160-4b33-946a-6f9e132fe75b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:05.112431 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:05.228536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796a3e4-3160-4b33-946a-6f9e132fe75b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:05.231245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796a3e4-3160-4b33-946a-6f9e132fe75b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:05.280924 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3508/6992] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:15:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:15:05.707020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e86d31-817d-42be-a5ca-b359bca256c3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:05.712524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-51e86d31-817d-42be-a5ca-b359bca256c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:05.744970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e86d31-817d-42be-a5ca-b359bca256c3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:05.760172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5076d-85e6-4b31-94cd-d4b76f5f98f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:05.761177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5076d-85e6-4b31-94cd-d4b76f5f98f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:05.761774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5076d-85e6-4b31-94cd-d4b76f5f98f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:05.764751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5076d-85e6-4b31-94cd-d4b76f5f98f8 admin admin] PATH_INFO: `/v3/projects/2c437196cbe5448eac5c8aa2f5c68072` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:05.766388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5076d-85e6-4b31-94cd-d4b76f5f98f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c437196cbe5448eac5c8aa2f5c68072)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:05.770133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5076d-85e6-4b31-94cd-d4b76f5f98f8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:05.816739 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:05.947803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45f5076d-85e6-4b31-94cd-d4b76f5f98f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c437196cbe5448eac5c8aa2f5c68072', 'request_id': 'req-45f5076d-85e6-4b31-94cd-d4b76f5f98f8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:05.961917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45f5076d-85e6-4b31-94cd-d4b76f5f98f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c437196cbe5448eac5c8aa2f5c68072', 'request_id': 'req-45f5076d-85e6-4b31-94cd-d4b76f5f98f8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:05.982262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45f5076d-85e6-4b31-94cd-d4b76f5f98f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c437196cbe5448eac5c8aa2f5c68072', 'request_id': 'req-45f5076d-85e6-4b31-94cd-d4b76f5f98f8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:06.022857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45f5076d-85e6-4b31-94cd-d4b76f5f98f8 admin admin] The token cache is being invalidate because project 2c437196cbe5448eac5c8aa2f5c68072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:06.023728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45f5076d-85e6-4b31-94cd-d4b76f5f98f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:06.033709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45f5076d-85e6-4b31-94cd-d4b76f5f98f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:06.067797 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3485/6993] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:15:05 2022] DELETE /identity/v3/projects/2c437196cbe5448eac5c8aa2f5c68072 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:06.078065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96119d64-5cc5-4e5f-a469-e3d8a888e0b0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:06.078846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96119d64-5cc5-4e5f-a469-e3d8a888e0b0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:06.079009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96119d64-5cc5-4e5f-a469-e3d8a888e0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:06.148667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-96119d64-5cc5-4e5f-a469-e3d8a888e0b0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:06.153537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-96119d64-5cc5-4e5f-a469-e3d8a888e0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:06.343161 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3509/6994] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:06.351258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996c466-f6ef-4cef-a9f2-97bbff3822a3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:06.351859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996c466-f6ef-4cef-a9f2-97bbff3822a3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:06.352368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996c466-f6ef-4cef-a9f2-97bbff3822a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:06.383332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f996c466-f6ef-4cef-a9f2-97bbff3822a3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:06.387013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f996c466-f6ef-4cef-a9f2-97bbff3822a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:06.406391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96119d64-5cc5-4e5f-a469-e3d8a888e0b0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:06.413896 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3486/6995] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:06.424334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96119d64-5cc5-4e5f-a469-e3d8a888e0b0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:06.459330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04217f9c-1408-4422-80ec-2e8b46f95da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:06.459965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04217f9c-1408-4422-80ec-2e8b46f95da4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:06.460244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04217f9c-1408-4422-80ec-2e8b46f95da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:06.460515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04217f9c-1408-4422-80ec-2e8b46f95da4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:06.461200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04217f9c-1408-4422-80ec-2e8b46f95da4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:15:06.461502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04217f9c-1408-4422-80ec-2e8b46f95da4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:06.463110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04217f9c-1408-4422-80ec-2e8b46f95da4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:06.506340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996c466-f6ef-4cef-a9f2-97bbff3822a3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:06.521704 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3510/6996] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:15:06.552552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996c466-f6ef-4cef-a9f2-97bbff3822a3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:06.567027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3bb7e-e190-4299-9e33-7ec828aae7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:06.569551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3bb7e-e190-4299-9e33-7ec828aae7f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:06.571419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3bb7e-e190-4299-9e33-7ec828aae7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:06.573983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3bb7e-e190-4299-9e33-7ec828aae7f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:06.578357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee3bb7e-e190-4299-9e33-7ec828aae7f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:06.585157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee3bb7e-e190-4299-9e33-7ec828aae7f1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:06.697122 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3487/6997] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:15:06 2022] POST /identity/v3/projects => generated 391 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:06.706190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04217f9c-1408-4422-80ec-2e8b46f95da4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:06.721323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04217f9c-1408-4422-80ec-2e8b46f95da4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:06.860463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e7494-c5b2-4ee9-9a7e-066d3861eba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:06.861136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e7494-c5b2-4ee9-9a7e-066d3861eba2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:06.861421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e7494-c5b2-4ee9-9a7e-066d3861eba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:06.862392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e7494-c5b2-4ee9-9a7e-066d3861eba2 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:06.863120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e7494-c5b2-4ee9-9a7e-066d3861eba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:06.866180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e7494-c5b2-4ee9-9a7e-066d3861eba2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:06.990056 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3511/6998] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:15:06 2022] POST /identity/v3/users => generated 296 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:06.999134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3bb7e-e190-4299-9e33-7ec828aae7f1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:07.035435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3bb7e-e190-4299-9e33-7ec828aae7f1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:07.086186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d180d-d0e9-4aa7-8663-8436ab1f6397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:07.089046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d180d-d0e9-4aa7-8663-8436ab1f6397 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:07.108276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d180d-d0e9-4aa7-8663-8436ab1f6397 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:07.109178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d180d-d0e9-4aa7-8663-8436ab1f6397 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:07.109907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d180d-d0e9-4aa7-8663-8436ab1f6397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:07.111553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d180d-d0e9-4aa7-8663-8436ab1f6397 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:07.172264 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3488/6999] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:07.178189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e7494-c5b2-4ee9-9a7e-066d3861eba2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:07.192680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e7494-c5b2-4ee9-9a7e-066d3861eba2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:07.224701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbb090-2df8-42a7-bc60-bb02148dc14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:07.224701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbb090-2df8-42a7-bc60-bb02148dc14a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:07.224701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbb090-2df8-42a7-bc60-bb02148dc14a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:07.224701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbb090-2df8-42a7-bc60-bb02148dc14a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:07.225186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdbb090-2df8-42a7-bc60-bb02148dc14a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:07.225186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdbb090-2df8-42a7-bc60-bb02148dc14a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:07.244393 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3512/7000] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:07.246160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d180d-d0e9-4aa7-8663-8436ab1f6397 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:07.259733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d180d-d0e9-4aa7-8663-8436ab1f6397 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:07.274425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65f817-02a0-442c-98d4-976fca4de05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:07.275143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65f817-02a0-442c-98d4-976fca4de05d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:07.275417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65f817-02a0-442c-98d4-976fca4de05d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:07.275703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65f817-02a0-442c-98d4-976fca4de05d admin admin] PATH_INFO: `/v3/projects/bd251e577c664c88a7306086cc9c4b59/users/2ca9544b3ed74c1dbdfcb8fd6f451b3b/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:07.319125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65f817-02a0-442c-98d4-976fca4de05d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd251e577c664c88a7306086cc9c4b59, user_id=2ca9544b3ed74c1dbdfcb8fd6f451b3b, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:07.340450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65f817-02a0-442c-98d4-976fca4de05d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:07.417867 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3489/7001] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:15:07 2022] PUT /identity/v3/projects/bd251e577c664c88a7306086cc9c4b59/users/2ca9544b3ed74c1dbdfcb8fd6f451b3b/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:07.419462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2165e17-66dc-429f-a1eb-a30e71c69eb4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:07.420323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2165e17-66dc-429f-a1eb-a30e71c69eb4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:07.420631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2165e17-66dc-429f-a1eb-a30e71c69eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:07.443644 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:07.481747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e2165e17-66dc-429f-a1eb-a30e71c69eb4 None None] MFA Rules not processed for user `2ca9544b3ed74c1dbdfcb8fd6f451b3b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:07.484325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e2165e17-66dc-429f-a1eb-a30e71c69eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:07.707526 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3513/7002] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:07.712312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65f817-02a0-442c-98d4-976fca4de05d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:07.949499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65f817-02a0-442c-98d4-976fca4de05d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:07.972541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a531b67-0ab0-4af9-8950-c445161d2f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:07.976749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a531b67-0ab0-4af9-8950-c445161d2f6c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:07.977038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a531b67-0ab0-4af9-8950-c445161d2f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:07.977310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a531b67-0ab0-4af9-8950-c445161d2f6c admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:07.977959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a531b67-0ab0-4af9-8950-c445161d2f6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:07.989778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a531b67-0ab0-4af9-8950-c445161d2f6c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:08.046569 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3490/7003] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:15:07 2022] POST /identity/v3/projects => generated 391 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:08.050453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2165e17-66dc-429f-a1eb-a30e71c69eb4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:08.073329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2165e17-66dc-429f-a1eb-a30e71c69eb4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:08.282103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909523cc-e52e-486b-aa66-b8496aa73ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:08.282692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909523cc-e52e-486b-aa66-b8496aa73ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:08.282969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909523cc-e52e-486b-aa66-b8496aa73ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:08.283236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909523cc-e52e-486b-aa66-b8496aa73ed8 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:08.283866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909523cc-e52e-486b-aa66-b8496aa73ed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:08.290648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909523cc-e52e-486b-aa66-b8496aa73ed8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:08.384095 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3514/7004] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:15:08 2022] POST /identity/v3/users => generated 302 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:15:08.391818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a531b67-0ab0-4af9-8950-c445161d2f6c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:08.421208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a531b67-0ab0-4af9-8950-c445161d2f6c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:08.447819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f72f6-bbb8-417b-80d1-f77baddf79c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:08.449472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f72f6-bbb8-417b-80d1-f77baddf79c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:08.450033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f72f6-bbb8-417b-80d1-f77baddf79c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:08.450507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f72f6-bbb8-417b-80d1-f77baddf79c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:08.456028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f72f6-bbb8-417b-80d1-f77baddf79c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:08.461879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f72f6-bbb8-417b-80d1-f77baddf79c7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:08.499958 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3491/7005] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:08.507025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909523cc-e52e-486b-aa66-b8496aa73ed8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:08.540216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909523cc-e52e-486b-aa66-b8496aa73ed8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:08.565789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b17a0-0235-4b84-8099-672542fddc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:08.569996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b17a0-0235-4b84-8099-672542fddc04 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:08.570484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b17a0-0235-4b84-8099-672542fddc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:08.570823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b17a0-0235-4b84-8099-672542fddc04 admin admin] PATH_INFO: `/v3/projects/fcf08d3c3ac84a40b767eca3b6fe9051/users/b4d3543d75a343e09bc7445d7e24257c/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:08.621285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b17a0-0235-4b84-8099-672542fddc04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf08d3c3ac84a40b767eca3b6fe9051, user_id=b4d3543d75a343e09bc7445d7e24257c, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:08.629381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b17a0-0235-4b84-8099-672542fddc04 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:08.676846 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3515/7006] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:15:08 2022] PUT /identity/v3/projects/fcf08d3c3ac84a40b767eca3b6fe9051/users/b4d3543d75a343e09bc7445d7e24257c/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:08.681192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f72f6-bbb8-417b-80d1-f77baddf79c7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:08.694928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f72f6-bbb8-417b-80d1-f77baddf79c7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:08.731923 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:08.969225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c144759-40f0-464d-8839-15ed5fd387d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:08.970005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c144759-40f0-464d-8839-15ed5fd387d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:08.972032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c144759-40f0-464d-8839-15ed5fd387d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:08.972032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c144759-40f0-464d-8839-15ed5fd387d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:08.972032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c144759-40f0-464d-8839-15ed5fd387d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:08.973417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c144759-40f0-464d-8839-15ed5fd387d4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:08.998303 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3492/7007] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:09.006337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b17a0-0235-4b84-8099-672542fddc04 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:09.023409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b17a0-0235-4b84-8099-672542fddc04 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:09.045644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaec5c0-9e46-4f7d-9f05-b10cec01fbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:09.046923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaec5c0-9e46-4f7d-9f05-b10cec01fbd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:09.046923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaec5c0-9e46-4f7d-9f05-b10cec01fbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:09.047537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaec5c0-9e46-4f7d-9f05-b10cec01fbd9 admin admin] PATH_INFO: `/v3/projects/fcf08d3c3ac84a40b767eca3b6fe9051/users/b4d3543d75a343e09bc7445d7e24257c/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:09.065110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaec5c0-9e46-4f7d-9f05-b10cec01fbd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf08d3c3ac84a40b767eca3b6fe9051, user_id=b4d3543d75a343e09bc7445d7e24257c, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:09.079586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaec5c0-9e46-4f7d-9f05-b10cec01fbd9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:09.142185 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3516/7008] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:15:09 2022] PUT /identity/v3/projects/fcf08d3c3ac84a40b767eca3b6fe9051/users/b4d3543d75a343e09bc7445d7e24257c/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:09.166122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9a3dd-55e3-4ef7-ab14-4101f80f05dd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:09.167216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9a3dd-55e3-4ef7-ab14-4101f80f05dd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:09.168455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9a3dd-55e3-4ef7-ab14-4101f80f05dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:09.274160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8ad9a3dd-55e3-4ef7-ab14-4101f80f05dd None None] MFA Rules not processed for user `b4d3543d75a343e09bc7445d7e24257c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:09.308647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8ad9a3dd-55e3-4ef7-ab14-4101f80f05dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:09.472559 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3493/7009] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:09 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:09.481256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaec5c0-9e46-4f7d-9f05-b10cec01fbd9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:09.484379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eaaec5c0-9e46-4f7d-9f05-b10cec01fbd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:09.709702 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:09.728434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaec5c0-9e46-4f7d-9f05-b10cec01fbd9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:09.739758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922f032-fa8e-41cf-9371-bf21aa3c0463 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:09.740475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922f032-fa8e-41cf-9371-bf21aa3c0463 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:09.740795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922f032-fa8e-41cf-9371-bf21aa3c0463 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:09.741189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922f032-fa8e-41cf-9371-bf21aa3c0463 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:09.790629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922f032-fa8e-41cf-9371-bf21aa3c0463 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:09.792326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922f032-fa8e-41cf-9371-bf21aa3c0463 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:09.825037 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3517/7010] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:15:09 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:15:09.952742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9a3dd-55e3-4ef7-ab14-4101f80f05dd None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:09.954966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8ad9a3dd-55e3-4ef7-ab14-4101f80f05dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:09.980283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9a3dd-55e3-4ef7-ab14-4101f80f05dd None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:09.986350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d26de9-de2f-48e5-af32-b22b4cd822b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:09.987269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d26de9-de2f-48e5-af32-b22b4cd822b5 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:09.987783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d26de9-de2f-48e5-af32-b22b4cd822b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:09.988264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d26de9-de2f-48e5-af32-b22b4cd822b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:10.121920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d26de9-de2f-48e5-af32-b22b4cd822b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:10.125306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d26de9-de2f-48e5-af32-b22b4cd822b5 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:10.171852 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3494/7011] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:15:09 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:15:12.901364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922f032-fa8e-41cf-9371-bf21aa3c0463 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:12.902936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3922f032-fa8e-41cf-9371-bf21aa3c0463 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:13.118862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922f032-fa8e-41cf-9371-bf21aa3c0463 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:13.132100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728ee78-b24b-4881-9915-c26cc929e334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:13.132808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728ee78-b24b-4881-9915-c26cc929e334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:13.133236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728ee78-b24b-4881-9915-c26cc929e334 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:13.133775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728ee78-b24b-4881-9915-c26cc929e334 admin admin] PATH_INFO: `/v3/users/bd2bba0db07140c0851cebb70631ce7c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:13.137160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728ee78-b24b-4881-9915-c26cc929e334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2bba0db07140c0851cebb70631ce7c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:13.142675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728ee78-b24b-4881-9915-c26cc929e334 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:13.341911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c728ee78-b24b-4881-9915-c26cc929e334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2bba0db07140c0851cebb70631ce7c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:13.344246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c728ee78-b24b-4881-9915-c26cc929e334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2bba0db07140c0851cebb70631ce7c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:13.371027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c728ee78-b24b-4881-9915-c26cc929e334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2bba0db07140c0851cebb70631ce7c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:13.413663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c728ee78-b24b-4881-9915-c26cc929e334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2bba0db07140c0851cebb70631ce7c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:13.434138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c728ee78-b24b-4881-9915-c26cc929e334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2bba0db07140c0851cebb70631ce7c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:13.450500 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3518/7012] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:12 2022] DELETE /identity/v3/users/bd2bba0db07140c0851cebb70631ce7c => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:13.949572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d26de9-de2f-48e5-af32-b22b4cd822b5 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:13.951735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-18d26de9-de2f-48e5-af32-b22b4cd822b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:14.011924 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:14.170071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d26de9-de2f-48e5-af32-b22b4cd822b5 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:14.361117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728ee78-b24b-4881-9915-c26cc929e334 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:14.362732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c728ee78-b24b-4881-9915-c26cc929e334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:14.379654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deeb6be-4c99-4bee-a785-47f5b7e208b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:14.380962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deeb6be-4c99-4bee-a785-47f5b7e208b0 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:14.381548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deeb6be-4c99-4bee-a785-47f5b7e208b0 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:14.382021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deeb6be-4c99-4bee-a785-47f5b7e208b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:14.384420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7deeb6be-4c99-4bee-a785-47f5b7e208b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:14.438342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deeb6be-4c99-4bee-a785-47f5b7e208b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:14.443270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deeb6be-4c99-4bee-a785-47f5b7e208b0 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:14.500318 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3495/7013] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:15:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:15:14.540339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728ee78-b24b-4881-9915-c26cc929e334 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:14.553137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa8018-9ef2-4915-a479-6f7074093c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:14.553795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa8018-9ef2-4915-a479-6f7074093c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:14.554074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa8018-9ef2-4915-a479-6f7074093c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:14.554350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa8018-9ef2-4915-a479-6f7074093c67 admin admin] PATH_INFO: `/v3/projects/5ece34f9216a4ea7be7224098415b4a4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:14.560274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa8018-9ef2-4915-a479-6f7074093c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ece34f9216a4ea7be7224098415b4a4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:14.562682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa8018-9ef2-4915-a479-6f7074093c67 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:14.590661 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:14.698268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9aaa8018-9ef2-4915-a479-6f7074093c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ece34f9216a4ea7be7224098415b4a4', 'request_id': 'req-9aaa8018-9ef2-4915-a479-6f7074093c67'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:14.727198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9aaa8018-9ef2-4915-a479-6f7074093c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ece34f9216a4ea7be7224098415b4a4', 'request_id': 'req-9aaa8018-9ef2-4915-a479-6f7074093c67'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:14.736404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9aaa8018-9ef2-4915-a479-6f7074093c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ece34f9216a4ea7be7224098415b4a4', 'request_id': 'req-9aaa8018-9ef2-4915-a479-6f7074093c67'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:14.755676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9aaa8018-9ef2-4915-a479-6f7074093c67 admin admin] The token cache is being invalidate because project 5ece34f9216a4ea7be7224098415b4a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:14.758328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9aaa8018-9ef2-4915-a479-6f7074093c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:14.760629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9aaa8018-9ef2-4915-a479-6f7074093c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:14.772575 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3519/7014] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:15:14 2022] DELETE /identity/v3/projects/5ece34f9216a4ea7be7224098415b4a4 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:14.781945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98c8c3-1dbb-4aa8-8dbb-6fe608bffc8b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:14.782440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98c8c3-1dbb-4aa8-8dbb-6fe608bffc8b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:14.782956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98c8c3-1dbb-4aa8-8dbb-6fe608bffc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:14.854164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8d98c8c3-1dbb-4aa8-8dbb-6fe608bffc8b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:14.859969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8d98c8c3-1dbb-4aa8-8dbb-6fe608bffc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:15.039401 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3496/7015] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:15.048070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b171b0d-61d4-44b4-a5a9-6f4f5c8b2c86 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:15.049450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b171b0d-61d4-44b4-a5a9-6f4f5c8b2c86 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:15.049952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b171b0d-61d4-44b4-a5a9-6f4f5c8b2c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:15.088556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2b171b0d-61d4-44b4-a5a9-6f4f5c8b2c86 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:15.092952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2b171b0d-61d4-44b4-a5a9-6f4f5c8b2c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:15.117499 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3520/7016] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:15.118662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98c8c3-1dbb-4aa8-8dbb-6fe608bffc8b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:15.135622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98c8c3-1dbb-4aa8-8dbb-6fe608bffc8b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:15.151828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03408c66-b2cc-4220-866c-b02ec6d8e9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:15.155148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03408c66-b2cc-4220-866c-b02ec6d8e9de admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:15.155446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03408c66-b2cc-4220-866c-b02ec6d8e9de admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:15.156672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03408c66-b2cc-4220-866c-b02ec6d8e9de admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:15.158844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03408c66-b2cc-4220-866c-b02ec6d8e9de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:15:15.160625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03408c66-b2cc-4220-866c-b02ec6d8e9de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:15.163794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03408c66-b2cc-4220-866c-b02ec6d8e9de admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:15.195279 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3497/7017] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:15:15.199013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b171b0d-61d4-44b4-a5a9-6f4f5c8b2c86 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:15.209607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b171b0d-61d4-44b4-a5a9-6f4f5c8b2c86 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:15.227737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c4021-dee7-48d2-b59e-8f7e8f670f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:15.227737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c4021-dee7-48d2-b59e-8f7e8f670f8b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:15.228083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c4021-dee7-48d2-b59e-8f7e8f670f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:15.228168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c4021-dee7-48d2-b59e-8f7e8f670f8b admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:15.228794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c4021-dee7-48d2-b59e-8f7e8f670f8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:15.231190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c4021-dee7-48d2-b59e-8f7e8f670f8b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:15.295037 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3521/7018] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:15:15 2022] POST /identity/v3/projects => generated 401 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:15:15.299055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03408c66-b2cc-4220-866c-b02ec6d8e9de admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:15.311951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03408c66-b2cc-4220-866c-b02ec6d8e9de admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:15.401153 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:15.431011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31960955-f315-4be1-9635-7be6c2cfd0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:15.431645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31960955-f315-4be1-9635-7be6c2cfd0ad admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:15.431923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31960955-f315-4be1-9635-7be6c2cfd0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:15.432196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31960955-f315-4be1-9635-7be6c2cfd0ad admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:15.432877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31960955-f315-4be1-9635-7be6c2cfd0ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:15.434810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31960955-f315-4be1-9635-7be6c2cfd0ad admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:15.508874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c4021-dee7-48d2-b59e-8f7e8f670f8b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:15.516755 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3498/7019] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:15:15 2022] POST /identity/v3/users => generated 301 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:15:15.520595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c4021-dee7-48d2-b59e-8f7e8f670f8b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:15.540064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a6622-10c7-41dc-810d-a82ccb72d195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:15.540970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a6622-10c7-41dc-810d-a82ccb72d195 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:15.541448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a6622-10c7-41dc-810d-a82ccb72d195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:15.541949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a6622-10c7-41dc-810d-a82ccb72d195 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:15.542753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a6622-10c7-41dc-810d-a82ccb72d195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:15.546522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a6622-10c7-41dc-810d-a82ccb72d195 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:15.574390 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3522/7020] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:15.579990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31960955-f315-4be1-9635-7be6c2cfd0ad admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:15.594861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31960955-f315-4be1-9635-7be6c2cfd0ad admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:15.609741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c13b3-315e-4bd9-9dc5-c1596d64c303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:15.610602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c13b3-315e-4bd9-9dc5-c1596d64c303 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:15.611178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c13b3-315e-4bd9-9dc5-c1596d64c303 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:15.611606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c13b3-315e-4bd9-9dc5-c1596d64c303 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:15.612412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c13b3-315e-4bd9-9dc5-c1596d64c303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:15.614767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c13b3-315e-4bd9-9dc5-c1596d64c303 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:15.655104 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3499/7021] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:15.659391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a6622-10c7-41dc-810d-a82ccb72d195 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:15.671643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a6622-10c7-41dc-810d-a82ccb72d195 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:15.687811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e1e44-b400-419a-b9bc-3ffbd8aa11ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:15.688495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e1e44-b400-419a-b9bc-3ffbd8aa11ba admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:15.688811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e1e44-b400-419a-b9bc-3ffbd8aa11ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:15.689264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e1e44-b400-419a-b9bc-3ffbd8aa11ba admin admin] PATH_INFO: `/v3/projects/0974502ac0774a55b8f7d04ca429371f/users/55bc56bfb32c44c982c00737996fba40/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:15.721123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e1e44-b400-419a-b9bc-3ffbd8aa11ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=0974502ac0774a55b8f7d04ca429371f, user_id=55bc56bfb32c44c982c00737996fba40, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:15.736191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e1e44-b400-419a-b9bc-3ffbd8aa11ba admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:15.759725 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3523/7022] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:15:15 2022] PUT /identity/v3/projects/0974502ac0774a55b8f7d04ca429371f/users/55bc56bfb32c44c982c00737996fba40/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:15:15.771813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c696769-aedb-45de-95da-5881e1cd04ac None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:15.772943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c696769-aedb-45de-95da-5881e1cd04ac None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:15.775479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c696769-aedb-45de-95da-5881e1cd04ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:15.866535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1c696769-aedb-45de-95da-5881e1cd04ac None None] MFA Rules not processed for user `55bc56bfb32c44c982c00737996fba40`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:15.868242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1c696769-aedb-45de-95da-5881e1cd04ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:15.984245 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3500/7023] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:15 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:15.988410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e1e44-b400-419a-b9bc-3ffbd8aa11ba admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:16.159800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e1e44-b400-419a-b9bc-3ffbd8aa11ba admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:16.181822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247241e9-e0ef-436a-916a-614414d31822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:16.182213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247241e9-e0ef-436a-916a-614414d31822 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:16.182491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247241e9-e0ef-436a-916a-614414d31822 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:16.182763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247241e9-e0ef-436a-916a-614414d31822 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:16.183401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247241e9-e0ef-436a-916a-614414d31822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:16.190180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247241e9-e0ef-436a-916a-614414d31822 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:16.263716 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3524/7024] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:15:15 2022] POST /identity/v3/projects => generated 403 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:16.265105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c696769-aedb-45de-95da-5881e1cd04ac None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:16.280951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c696769-aedb-45de-95da-5881e1cd04ac None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:16.432217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe2a1b-6d1f-4b6e-aee5-81d191c8abfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:16.432895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe2a1b-6d1f-4b6e-aee5-81d191c8abfc admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:16.433186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe2a1b-6d1f-4b6e-aee5-81d191c8abfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:16.433468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe2a1b-6d1f-4b6e-aee5-81d191c8abfc admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:16.434270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe2a1b-6d1f-4b6e-aee5-81d191c8abfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:16.437232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe2a1b-6d1f-4b6e-aee5-81d191c8abfc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:16.472705 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3501/7025] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:15:16 2022] POST /identity/v3/users => generated 308 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:16.476254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247241e9-e0ef-436a-916a-614414d31822 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:16.491600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247241e9-e0ef-436a-916a-614414d31822 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:16.504315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cb16f-fa37-4c57-9a0c-e6b68e070780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:16.504972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cb16f-fa37-4c57-9a0c-e6b68e070780 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:16.505259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cb16f-fa37-4c57-9a0c-e6b68e070780 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:16.505528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cb16f-fa37-4c57-9a0c-e6b68e070780 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:16.506184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cb16f-fa37-4c57-9a0c-e6b68e070780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:16.507813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cb16f-fa37-4c57-9a0c-e6b68e070780 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:16.547609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe2a1b-6d1f-4b6e-aee5-81d191c8abfc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:16.554428 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3525/7026] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:16.561922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe2a1b-6d1f-4b6e-aee5-81d191c8abfc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:16.574567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388a460-3d35-4b28-96ef-4ece06a62bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:16.575408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388a460-3d35-4b28-96ef-4ece06a62bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:16.575929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388a460-3d35-4b28-96ef-4ece06a62bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:16.576327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388a460-3d35-4b28-96ef-4ece06a62bc0 admin admin] PATH_INFO: `/v3/projects/900a2820e755494eb9f3b9f4b2aaf6c5/users/74f90496785f48f6bad5c0cc3765e0a1/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:16.618569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388a460-3d35-4b28-96ef-4ece06a62bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=900a2820e755494eb9f3b9f4b2aaf6c5, user_id=74f90496785f48f6bad5c0cc3765e0a1, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:16.624895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388a460-3d35-4b28-96ef-4ece06a62bc0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:16.656383 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3502/7027] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:15:16 2022] PUT /identity/v3/projects/900a2820e755494eb9f3b9f4b2aaf6c5/users/74f90496785f48f6bad5c0cc3765e0a1/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:15:16.657596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cb16f-fa37-4c57-9a0c-e6b68e070780 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:16.675172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cb16f-fa37-4c57-9a0c-e6b68e070780 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:16.712926 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:16.879389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdc18e-36d1-4124-a43a-bad7712eb160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:16.880485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdc18e-36d1-4124-a43a-bad7712eb160 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:16.880728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdc18e-36d1-4124-a43a-bad7712eb160 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:16.881099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdc18e-36d1-4124-a43a-bad7712eb160 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:16.881851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fdc18e-36d1-4124-a43a-bad7712eb160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:16.883648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fdc18e-36d1-4124-a43a-bad7712eb160 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:16.910624 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3526/7028] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:16.919010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388a460-3d35-4b28-96ef-4ece06a62bc0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:16.926971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388a460-3d35-4b28-96ef-4ece06a62bc0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:16.940116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ade1f-0330-4b20-85e9-cc39cace2da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:16.942810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ade1f-0330-4b20-85e9-cc39cace2da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:16.943100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ade1f-0330-4b20-85e9-cc39cace2da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:16.944054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ade1f-0330-4b20-85e9-cc39cace2da2 admin admin] PATH_INFO: `/v3/projects/900a2820e755494eb9f3b9f4b2aaf6c5/users/74f90496785f48f6bad5c0cc3765e0a1/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:16.949392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ade1f-0330-4b20-85e9-cc39cace2da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=900a2820e755494eb9f3b9f4b2aaf6c5, user_id=74f90496785f48f6bad5c0cc3765e0a1, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:16.955421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ade1f-0330-4b20-85e9-cc39cace2da2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:16.980751 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3503/7029] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:15:16 2022] PUT /identity/v3/projects/900a2820e755494eb9f3b9f4b2aaf6c5/users/74f90496785f48f6bad5c0cc3765e0a1/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:16.990813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0784f-8cdd-4113-aefd-c0fb2769e6d5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:16.991106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0784f-8cdd-4113-aefd-c0fb2769e6d5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:16.991381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0784f-8cdd-4113-aefd-c0fb2769e6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:17.070952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-40c0784f-8cdd-4113-aefd-c0fb2769e6d5 None None] MFA Rules not processed for user `74f90496785f48f6bad5c0cc3765e0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:17.073293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-40c0784f-8cdd-4113-aefd-c0fb2769e6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:17.290298 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3527/7030] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:16 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:17.291486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ade1f-0330-4b20-85e9-cc39cace2da2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:17.299948 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:17.313775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ade1f-0330-4b20-85e9-cc39cace2da2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:17.325059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a327cd0-a61d-4a99-8117-04dc1b432f45 tempest-ApplicationCredentialsV3AdminTest-1615227423 tempest-ApplicationCredentialsV3AdminTest-1615227423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74f90496785f48f6bad5c0cc3765e0a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900a2820e755494eb9f3b9f4b2aaf6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:17.326124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a327cd0-a61d-4a99-8117-04dc1b432f45 tempest-ApplicationCredentialsV3AdminTest-1615227423 tempest-ApplicationCredentialsV3AdminTest-1615227423-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:17.326565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a327cd0-a61d-4a99-8117-04dc1b432f45 tempest-ApplicationCredentialsV3AdminTest-1615227423 tempest-ApplicationCredentialsV3AdminTest-1615227423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:17.327012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a327cd0-a61d-4a99-8117-04dc1b432f45 tempest-ApplicationCredentialsV3AdminTest-1615227423 tempest-ApplicationCredentialsV3AdminTest-1615227423-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:17.327892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a327cd0-a61d-4a99-8117-04dc1b432f45 tempest-ApplicationCredentialsV3AdminTest-1615227423 tempest-ApplicationCredentialsV3AdminTest-1615227423-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:17.331974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a327cd0-a61d-4a99-8117-04dc1b432f45 tempest-ApplicationCredentialsV3AdminTest-1615227423 tempest-ApplicationCredentialsV3AdminTest-1615227423-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:17.364513 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3504/7031] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 10:15:17 2022] POST /identity/v3/roles => generated 240 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:17.367420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0784f-8cdd-4113-aefd-c0fb2769e6d5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:17.382094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0784f-8cdd-4113-aefd-c0fb2769e6d5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:17.400865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85597375-c047-4a8a-b392-4f61f8d1b82c tempest-ApplicationCredentialsV3AdminTest-1615227423 tempest-ApplicationCredentialsV3AdminTest-1615227423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74f90496785f48f6bad5c0cc3765e0a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900a2820e755494eb9f3b9f4b2aaf6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:17.401993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85597375-c047-4a8a-b392-4f61f8d1b82c tempest-ApplicationCredentialsV3AdminTest-1615227423 tempest-ApplicationCredentialsV3AdminTest-1615227423-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:17.402451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85597375-c047-4a8a-b392-4f61f8d1b82c tempest-ApplicationCredentialsV3AdminTest-1615227423 tempest-ApplicationCredentialsV3AdminTest-1615227423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:17.402901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85597375-c047-4a8a-b392-4f61f8d1b82c tempest-ApplicationCredentialsV3AdminTest-1615227423 tempest-ApplicationCredentialsV3AdminTest-1615227423-project-admin] PATH_INFO: `/v3/projects/0974502ac0774a55b8f7d04ca429371f/users/55bc56bfb32c44c982c00737996fba40/roles/05f2674b5eef4d48a70a8d32b1ba15dd` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:17.407999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85597375-c047-4a8a-b392-4f61f8d1b82c tempest-ApplicationCredentialsV3AdminTest-1615227423 tempest-ApplicationCredentialsV3AdminTest-1615227423-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0974502ac0774a55b8f7d04ca429371f, user_id=55bc56bfb32c44c982c00737996fba40, role_id=05f2674b5eef4d48a70a8d32b1ba15dd)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:17.420575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85597375-c047-4a8a-b392-4f61f8d1b82c tempest-ApplicationCredentialsV3AdminTest-1615227423 tempest-ApplicationCredentialsV3AdminTest-1615227423-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:17.464291 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3528/7032] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:15:17 2022] PUT /identity/v3/projects/0974502ac0774a55b8f7d04ca429371f/users/55bc56bfb32c44c982c00737996fba40/roles/05f2674b5eef4d48a70a8d32b1ba15dd => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:17.468594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a327cd0-a61d-4a99-8117-04dc1b432f45 tempest-ApplicationCredentialsV3AdminTest-1615227423 tempest-ApplicationCredentialsV3AdminTest-1615227423-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:17.645582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a327cd0-a61d-4a99-8117-04dc1b432f45 tempest-ApplicationCredentialsV3AdminTest-1615227423 tempest-ApplicationCredentialsV3AdminTest-1615227423-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:17.859582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294311f3-216d-4bd2-a0da-7ee4301c7411 tempest-ApplicationCredentialsV3AdminTest-390356864 tempest-ApplicationCredentialsV3AdminTest-390356864-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55bc56bfb32c44c982c00737996fba40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0974502ac0774a55b8f7d04ca429371f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-1672766540'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:17.860343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294311f3-216d-4bd2-a0da-7ee4301c7411 tempest-ApplicationCredentialsV3AdminTest-390356864 tempest-ApplicationCredentialsV3AdminTest-390356864-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:17.860938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294311f3-216d-4bd2-a0da-7ee4301c7411 tempest-ApplicationCredentialsV3AdminTest-390356864 tempest-ApplicationCredentialsV3AdminTest-390356864-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:17.861237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294311f3-216d-4bd2-a0da-7ee4301c7411 tempest-ApplicationCredentialsV3AdminTest-390356864 tempest-ApplicationCredentialsV3AdminTest-390356864-project] PATH_INFO: `/v3/users/55bc56bfb32c44c982c00737996fba40/application_credentials` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:17.862179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294311f3-216d-4bd2-a0da-7ee4301c7411 tempest-ApplicationCredentialsV3AdminTest-390356864 tempest-ApplicationCredentialsV3AdminTest-390356864-project] RBAC: Authorizing `identity:create_application_credential(user_id=55bc56bfb32c44c982c00737996fba40)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:17.864090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294311f3-216d-4bd2-a0da-7ee4301c7411 tempest-ApplicationCredentialsV3AdminTest-390356864 tempest-ApplicationCredentialsV3AdminTest-390356864-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:18.031923 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3505/7033] 10.222.0.16 () {60 vars in 1315 bytes} [Fri Sep 30 10:15:17 2022] POST /identity/v3/users/55bc56bfb32c44c982c00737996fba40/application_credentials => generated 659 bytes in 564 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:18.034367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef81ce-1342-4c53-88e1-e6673e8b7909 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:18.034783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef81ce-1342-4c53-88e1-e6673e8b7909 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:18.034914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef81ce-1342-4c53-88e1-e6673e8b7909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:18.086583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5fef81ce-1342-4c53-88e1-e6673e8b7909 None None] MFA Rules not processed for user `55bc56bfb32c44c982c00737996fba40`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:18.087838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5fef81ce-1342-4c53-88e1-e6673e8b7909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:18.223392 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:18.360527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294311f3-216d-4bd2-a0da-7ee4301c7411 tempest-ApplicationCredentialsV3AdminTest-390356864 tempest-ApplicationCredentialsV3AdminTest-390356864-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:18.362447 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3529/7034] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:18 2022] POST /identity/v3/auth/tokens => generated 3394 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Sep 30 10:15:18.375725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294311f3-216d-4bd2-a0da-7ee4301c7411 tempest-ApplicationCredentialsV3AdminTest-390356864 tempest-ApplicationCredentialsV3AdminTest-390356864-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:18.391507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54dfd4-b231-42d9-b8ba-7e20ecd4d85d tempest-ApplicationCredentialsV3AdminTest-390356864 tempest-ApplicationCredentialsV3AdminTest-390356864-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55bc56bfb32c44c982c00737996fba40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0974502ac0774a55b8f7d04ca429371f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-1672766540'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:18.392406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54dfd4-b231-42d9-b8ba-7e20ecd4d85d tempest-ApplicationCredentialsV3AdminTest-390356864 tempest-ApplicationCredentialsV3AdminTest-390356864-project] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:18.392911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54dfd4-b231-42d9-b8ba-7e20ecd4d85d tempest-ApplicationCredentialsV3AdminTest-390356864 tempest-ApplicationCredentialsV3AdminTest-390356864-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:18.393350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54dfd4-b231-42d9-b8ba-7e20ecd4d85d tempest-ApplicationCredentialsV3AdminTest-390356864 tempest-ApplicationCredentialsV3AdminTest-390356864-project] PATH_INFO: `/v3/users/55bc56bfb32c44c982c00737996fba40/application_credentials/cd99442667a94705af6e73254c9e538e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:18.400124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54dfd4-b231-42d9-b8ba-7e20ecd4d85d tempest-ApplicationCredentialsV3AdminTest-390356864 tempest-ApplicationCredentialsV3AdminTest-390356864-project] RBAC: Authorizing `identity:delete_application_credential(user_id=55bc56bfb32c44c982c00737996fba40, application_credential_id=cd99442667a94705af6e73254c9e538e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:18.401895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54dfd4-b231-42d9-b8ba-7e20ecd4d85d tempest-ApplicationCredentialsV3AdminTest-390356864 tempest-ApplicationCredentialsV3AdminTest-390356864-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:18.440793 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3506/7035] 10.222.0.16 () {58 vars in 1395 bytes} [Fri Sep 30 10:15:18 2022] DELETE /identity/v3/users/55bc56bfb32c44c982c00737996fba40/application_credentials/cd99442667a94705af6e73254c9e538e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:15:18.442501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef81ce-1342-4c53-88e1-e6673e8b7909 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:18.584012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef81ce-1342-4c53-88e1-e6673e8b7909 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:18.595556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb2e99-3064-45a7-99af-66dc0460339b tempest-ApplicationCredentialsV3AdminTest-1615227423 tempest-ApplicationCredentialsV3AdminTest-1615227423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74f90496785f48f6bad5c0cc3765e0a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900a2820e755494eb9f3b9f4b2aaf6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:18.596219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb2e99-3064-45a7-99af-66dc0460339b tempest-ApplicationCredentialsV3AdminTest-1615227423 tempest-ApplicationCredentialsV3AdminTest-1615227423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:18.596505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb2e99-3064-45a7-99af-66dc0460339b tempest-ApplicationCredentialsV3AdminTest-1615227423 tempest-ApplicationCredentialsV3AdminTest-1615227423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:18.596813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb2e99-3064-45a7-99af-66dc0460339b tempest-ApplicationCredentialsV3AdminTest-1615227423 tempest-ApplicationCredentialsV3AdminTest-1615227423-project-admin] PATH_INFO: `/v3/roles/05f2674b5eef4d48a70a8d32b1ba15dd` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:18.598369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb2e99-3064-45a7-99af-66dc0460339b tempest-ApplicationCredentialsV3AdminTest-1615227423 tempest-ApplicationCredentialsV3AdminTest-1615227423-project-admin] RBAC: Authorizing `identity:delete_role(role_id=05f2674b5eef4d48a70a8d32b1ba15dd)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:18.601510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb2e99-3064-45a7-99af-66dc0460339b tempest-ApplicationCredentialsV3AdminTest-1615227423 tempest-ApplicationCredentialsV3AdminTest-1615227423-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:18.697198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-34fb2e99-3064-45a7-99af-66dc0460339b tempest-ApplicationCredentialsV3AdminTest-1615227423 tempest-ApplicationCredentialsV3AdminTest-1615227423-project-admin] Invalidating the token cache because role 05f2674b5eef4d48a70a8d32b1ba15dd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:18.697422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-34fb2e99-3064-45a7-99af-66dc0460339b tempest-ApplicationCredentialsV3AdminTest-1615227423 tempest-ApplicationCredentialsV3AdminTest-1615227423-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:18.698441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-34fb2e99-3064-45a7-99af-66dc0460339b tempest-ApplicationCredentialsV3AdminTest-1615227423 tempest-ApplicationCredentialsV3AdminTest-1615227423-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:18.708425 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3530/7036] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:18 2022] DELETE /identity/v3/roles/05f2674b5eef4d48a70a8d32b1ba15dd => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:18.709716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54dfd4-b231-42d9-b8ba-7e20ecd4d85d tempest-ApplicationCredentialsV3AdminTest-390356864 tempest-ApplicationCredentialsV3AdminTest-390356864-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:18.711655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1a54dfd4-b231-42d9-b8ba-7e20ecd4d85d tempest-ApplicationCredentialsV3AdminTest-390356864 tempest-ApplicationCredentialsV3AdminTest-390356864-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:18.747910 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:18.897474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54dfd4-b231-42d9-b8ba-7e20ecd4d85d tempest-ApplicationCredentialsV3AdminTest-390356864 tempest-ApplicationCredentialsV3AdminTest-390356864-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:19.027910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3408d9-dc42-4ca2-8a1c-fe75195d1cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:19.029519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3408d9-dc42-4ca2-8a1c-fe75195d1cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:19.029990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3408d9-dc42-4ca2-8a1c-fe75195d1cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:19.030438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3408d9-dc42-4ca2-8a1c-fe75195d1cf1 admin admin] PATH_INFO: `/v3/users/55bc56bfb32c44c982c00737996fba40` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:19.032965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3408d9-dc42-4ca2-8a1c-fe75195d1cf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55bc56bfb32c44c982c00737996fba40)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:19.035159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3408d9-dc42-4ca2-8a1c-fe75195d1cf1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:19.134410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a3408d9-dc42-4ca2-8a1c-fe75195d1cf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55bc56bfb32c44c982c00737996fba40'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:19.168116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a3408d9-dc42-4ca2-8a1c-fe75195d1cf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55bc56bfb32c44c982c00737996fba40'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:19.169076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a3408d9-dc42-4ca2-8a1c-fe75195d1cf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55bc56bfb32c44c982c00737996fba40'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:19.197235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a3408d9-dc42-4ca2-8a1c-fe75195d1cf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55bc56bfb32c44c982c00737996fba40'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:19.225571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a3408d9-dc42-4ca2-8a1c-fe75195d1cf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55bc56bfb32c44c982c00737996fba40'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:19.236833 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3507/7037] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:18 2022] DELETE /identity/v3/users/55bc56bfb32c44c982c00737996fba40 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:19.241930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb7554-1442-47b9-86b4-515d7d548a36 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:19.243023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb7554-1442-47b9-86b4-515d7d548a36 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:19.243613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb7554-1442-47b9-86b4-515d7d548a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:19.285786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bacb7554-1442-47b9-86b4-515d7d548a36 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:19.290289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bacb7554-1442-47b9-86b4-515d7d548a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:19.389541 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3531/7038] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:19.411965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3408d9-dc42-4ca2-8a1c-fe75195d1cf1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:19.413481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8a3408d9-dc42-4ca2-8a1c-fe75195d1cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:19.638629 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:19.670750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3408d9-dc42-4ca2-8a1c-fe75195d1cf1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:19.676231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1cdf5f-b4d5-4938-b097-397f925bc321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:19.677427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cdf5f-b4d5-4938-b097-397f925bc321 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:19.677807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cdf5f-b4d5-4938-b097-397f925bc321 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:19.678461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cdf5f-b4d5-4938-b097-397f925bc321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:19.700278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1cdf5f-b4d5-4938-b097-397f925bc321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:19.702656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1cdf5f-b4d5-4938-b097-397f925bc321 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:19.757452 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3508/7039] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:15:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:15:20.999916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb7554-1442-47b9-86b4-515d7d548a36 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:21.001936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bacb7554-1442-47b9-86b4-515d7d548a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:21.032219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb7554-1442-47b9-86b4-515d7d548a36 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:21.047050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427952de-c048-41e4-9ad2-cc36f7a391cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:21.047708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427952de-c048-41e4-9ad2-cc36f7a391cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:21.047985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427952de-c048-41e4-9ad2-cc36f7a391cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:21.048254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427952de-c048-41e4-9ad2-cc36f7a391cc admin admin] PATH_INFO: `/v3/users/2ca9544b3ed74c1dbdfcb8fd6f451b3b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:21.050682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427952de-c048-41e4-9ad2-cc36f7a391cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca9544b3ed74c1dbdfcb8fd6f451b3b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:21.054340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427952de-c048-41e4-9ad2-cc36f7a391cc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:21.106248 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:21.199158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-427952de-c048-41e4-9ad2-cc36f7a391cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca9544b3ed74c1dbdfcb8fd6f451b3b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:21.204009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-427952de-c048-41e4-9ad2-cc36f7a391cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca9544b3ed74c1dbdfcb8fd6f451b3b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:21.231814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-427952de-c048-41e4-9ad2-cc36f7a391cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca9544b3ed74c1dbdfcb8fd6f451b3b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:21.245984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1cdf5f-b4d5-4938-b097-397f925bc321 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:21.248941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1c1cdf5f-b4d5-4938-b097-397f925bc321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:21.326279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1cdf5f-b4d5-4938-b097-397f925bc321 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:21.365893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-427952de-c048-41e4-9ad2-cc36f7a391cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca9544b3ed74c1dbdfcb8fd6f451b3b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:21.409626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8716b3-21f8-4b29-9818-de256a440749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:21.410297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8716b3-21f8-4b29-9818-de256a440749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:21.410574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8716b3-21f8-4b29-9818-de256a440749 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:21.410841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8716b3-21f8-4b29-9818-de256a440749 admin admin] PATH_INFO: `/v3/projects/0974502ac0774a55b8f7d04ca429371f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:21.413335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8716b3-21f8-4b29-9818-de256a440749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0974502ac0774a55b8f7d04ca429371f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:21.415245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8716b3-21f8-4b29-9818-de256a440749 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:21.424305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-427952de-c048-41e4-9ad2-cc36f7a391cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca9544b3ed74c1dbdfcb8fd6f451b3b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:21.431876 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3532/7040] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:20 2022] DELETE /identity/v3/users/2ca9544b3ed74c1dbdfcb8fd6f451b3b => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:21.437374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbeb05-1abc-43f3-a011-ef37c5ca4f97 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:21.438725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbeb05-1abc-43f3-a011-ef37c5ca4f97 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:21.439496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbeb05-1abc-43f3-a011-ef37c5ca4f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:21.495119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-56bbeb05-1abc-43f3-a011-ef37c5ca4f97 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:21.495119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-56bbeb05-1abc-43f3-a011-ef37c5ca4f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:21.576203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a8716b3-21f8-4b29-9818-de256a440749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0974502ac0774a55b8f7d04ca429371f', 'request_id': 'req-0a8716b3-21f8-4b29-9818-de256a440749'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:21.589847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a8716b3-21f8-4b29-9818-de256a440749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0974502ac0774a55b8f7d04ca429371f', 'request_id': 'req-0a8716b3-21f8-4b29-9818-de256a440749'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:21.600466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a8716b3-21f8-4b29-9818-de256a440749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0974502ac0774a55b8f7d04ca429371f', 'request_id': 'req-0a8716b3-21f8-4b29-9818-de256a440749'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:21.638715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a8716b3-21f8-4b29-9818-de256a440749 admin admin] The token cache is being invalidate because project 0974502ac0774a55b8f7d04ca429371f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:21.639143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a8716b3-21f8-4b29-9818-de256a440749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:21.642621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a8716b3-21f8-4b29-9818-de256a440749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:21.647571 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3509/7041] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:15:21 2022] DELETE /identity/v3/projects/0974502ac0774a55b8f7d04ca429371f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:21.651602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8716b3-21f8-4b29-9818-de256a440749 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:21.657996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0a8716b3-21f8-4b29-9818-de256a440749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:21.679357 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3533/7042] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:15:21.688554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbeb05-1abc-43f3-a011-ef37c5ca4f97 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:21.690617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-56bbeb05-1abc-43f3-a011-ef37c5ca4f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:21.854823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbeb05-1abc-43f3-a011-ef37c5ca4f97 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:21.880869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8716b3-21f8-4b29-9818-de256a440749 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:21.893784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167da3c-1add-428f-8a25-9ba5afd21ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:21.894439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167da3c-1add-428f-8a25-9ba5afd21ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:21.894691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167da3c-1add-428f-8a25-9ba5afd21ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:21.894968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167da3c-1add-428f-8a25-9ba5afd21ff1 admin admin] PATH_INFO: `/v3/users/74f90496785f48f6bad5c0cc3765e0a1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:21.896545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8167da3c-1add-428f-8a25-9ba5afd21ff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f90496785f48f6bad5c0cc3765e0a1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:21.900769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8167da3c-1add-428f-8a25-9ba5afd21ff1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:21.976363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf86a7c-0d8d-4188-b326-7293e4fe74f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:21.979390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf86a7c-0d8d-4188-b326-7293e4fe74f5 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:21.979982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf86a7c-0d8d-4188-b326-7293e4fe74f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:21.981094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf86a7c-0d8d-4188-b326-7293e4fe74f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:21.991546 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:21.998199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8167da3c-1add-428f-8a25-9ba5afd21ff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f90496785f48f6bad5c0cc3765e0a1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:22.002394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf86a7c-0d8d-4188-b326-7293e4fe74f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:22.006167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf86a7c-0d8d-4188-b326-7293e4fe74f5 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:22.016742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8167da3c-1add-428f-8a25-9ba5afd21ff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f90496785f48f6bad5c0cc3765e0a1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:22.017815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8167da3c-1add-428f-8a25-9ba5afd21ff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f90496785f48f6bad5c0cc3765e0a1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:22.036965 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3534/7043] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:15:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:15:22.038466 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:22.042959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8167da3c-1add-428f-8a25-9ba5afd21ff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f90496785f48f6bad5c0cc3765e0a1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:22.065449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8167da3c-1add-428f-8a25-9ba5afd21ff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f90496785f48f6bad5c0cc3765e0a1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:22.079166 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3510/7044] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:21 2022] DELETE /identity/v3/users/74f90496785f48f6bad5c0cc3765e0a1 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:23.043709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf86a7c-0d8d-4188-b326-7293e4fe74f5 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:23.059040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf86a7c-0d8d-4188-b326-7293e4fe74f5 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:23.197930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36863365-d52b-4551-86d1-f162ba39a102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:23.198664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36863365-d52b-4551-86d1-f162ba39a102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:23.199015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36863365-d52b-4551-86d1-f162ba39a102 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:23.199347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36863365-d52b-4551-86d1-f162ba39a102 admin admin] PATH_INFO: `/v3/projects/900a2820e755494eb9f3b9f4b2aaf6c5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:23.201313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36863365-d52b-4551-86d1-f162ba39a102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=900a2820e755494eb9f3b9f4b2aaf6c5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:23.203481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36863365-d52b-4551-86d1-f162ba39a102 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:23.304150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36863365-d52b-4551-86d1-f162ba39a102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '900a2820e755494eb9f3b9f4b2aaf6c5', 'request_id': 'req-36863365-d52b-4551-86d1-f162ba39a102'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:23.326278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36863365-d52b-4551-86d1-f162ba39a102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '900a2820e755494eb9f3b9f4b2aaf6c5', 'request_id': 'req-36863365-d52b-4551-86d1-f162ba39a102'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:23.333466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36863365-d52b-4551-86d1-f162ba39a102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '900a2820e755494eb9f3b9f4b2aaf6c5', 'request_id': 'req-36863365-d52b-4551-86d1-f162ba39a102'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:23.349311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36863365-d52b-4551-86d1-f162ba39a102 admin admin] The token cache is being invalidate because project 900a2820e755494eb9f3b9f4b2aaf6c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:23.349681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36863365-d52b-4551-86d1-f162ba39a102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:23.350396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36863365-d52b-4551-86d1-f162ba39a102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:23.352216 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3535/7045] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:15:23 2022] DELETE /identity/v3/projects/900a2820e755494eb9f3b9f4b2aaf6c5 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:23.357042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daaddac-6ad0-4153-9083-abcad2529244 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:23.358016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daaddac-6ad0-4153-9083-abcad2529244 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:23.358444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daaddac-6ad0-4153-9083-abcad2529244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:23.397066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1daaddac-6ad0-4153-9083-abcad2529244 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:23.398623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1daaddac-6ad0-4153-9083-abcad2529244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:23.543819 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3511/7046] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:23.552262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9243d97-2419-44a5-ae13-25f974119205 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:23.552745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9243d97-2419-44a5-ae13-25f974119205 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:23.553031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9243d97-2419-44a5-ae13-25f974119205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:23.605214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e9243d97-2419-44a5-ae13-25f974119205 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:23.607582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e9243d97-2419-44a5-ae13-25f974119205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:23.624168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daaddac-6ad0-4153-9083-abcad2529244 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:23.625854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1daaddac-6ad0-4153-9083-abcad2529244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:23.626111 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3536/7047] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:23.627156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9243d97-2419-44a5-ae13-25f974119205 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:23.641934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9243d97-2419-44a5-ae13-25f974119205 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:23.645968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daaddac-6ad0-4153-9083-abcad2529244 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:23.653919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6f882-573e-47b1-a7b1-5cf0555b0697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:23.654662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6f882-573e-47b1-a7b1-5cf0555b0697 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:23.655050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6f882-573e-47b1-a7b1-5cf0555b0697 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:23.655382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6f882-573e-47b1-a7b1-5cf0555b0697 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:23.656143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6f882-573e-47b1-a7b1-5cf0555b0697 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:15:23.656508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6f882-573e-47b1-a7b1-5cf0555b0697 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:23.659713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984d8b2-9f77-4583-8c0b-6707bc6329f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:23.659862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6f882-573e-47b1-a7b1-5cf0555b0697 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:23.660368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984d8b2-9f77-4583-8c0b-6707bc6329f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:23.660671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984d8b2-9f77-4583-8c0b-6707bc6329f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:23.663511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984d8b2-9f77-4583-8c0b-6707bc6329f9 admin admin] PATH_INFO: `/v3/projects/bd251e577c664c88a7306086cc9c4b59` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:23.666020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984d8b2-9f77-4583-8c0b-6707bc6329f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd251e577c664c88a7306086cc9c4b59)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:23.675816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984d8b2-9f77-4583-8c0b-6707bc6329f9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:23.677927 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3537/7048] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:15:23.679141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6f882-573e-47b1-a7b1-5cf0555b0697 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:23.691482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6f882-573e-47b1-a7b1-5cf0555b0697 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:23.696999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1981df-ca7a-4af2-b19d-a8de730256cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:23.697597 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1981df-ca7a-4af2-b19d-a8de730256cb admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:23.697876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1981df-ca7a-4af2-b19d-a8de730256cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:23.698199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1981df-ca7a-4af2-b19d-a8de730256cb admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:23.699137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1981df-ca7a-4af2-b19d-a8de730256cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:23.701243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1981df-ca7a-4af2-b19d-a8de730256cb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:23.757136 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3538/7049] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:15:23 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:23.758034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1981df-ca7a-4af2-b19d-a8de730256cb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:23.788092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0984d8b2-9f77-4583-8c0b-6707bc6329f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd251e577c664c88a7306086cc9c4b59', 'request_id': 'req-0984d8b2-9f77-4583-8c0b-6707bc6329f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:23.803960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0984d8b2-9f77-4583-8c0b-6707bc6329f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd251e577c664c88a7306086cc9c4b59', 'request_id': 'req-0984d8b2-9f77-4583-8c0b-6707bc6329f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:23.811476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0984d8b2-9f77-4583-8c0b-6707bc6329f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd251e577c664c88a7306086cc9c4b59', 'request_id': 'req-0984d8b2-9f77-4583-8c0b-6707bc6329f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:23.817170 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:23.838495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0984d8b2-9f77-4583-8c0b-6707bc6329f9 admin admin] The token cache is being invalidate because project bd251e577c664c88a7306086cc9c4b59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:23.838794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0984d8b2-9f77-4583-8c0b-6707bc6329f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:23.839452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0984d8b2-9f77-4583-8c0b-6707bc6329f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:23.841895 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3512/7050] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:15:23 2022] DELETE /identity/v3/projects/bd251e577c664c88a7306086cc9c4b59 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:23.850492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984d8b2-9f77-4583-8c0b-6707bc6329f9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:23.855062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1981df-ca7a-4af2-b19d-a8de730256cb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:23.856288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0984d8b2-9f77-4583-8c0b-6707bc6329f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:23.864493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b0662-1d4f-4574-9ac2-046eb74ee974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:23.865633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b0662-1d4f-4574-9ac2-046eb74ee974 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:23.866181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b0662-1d4f-4574-9ac2-046eb74ee974 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:23.866741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b0662-1d4f-4574-9ac2-046eb74ee974 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:23.868146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b0662-1d4f-4574-9ac2-046eb74ee974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:23.870935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b0662-1d4f-4574-9ac2-046eb74ee974 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:23.933414 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3539/7051] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:15:23 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:23.935814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b0662-1d4f-4574-9ac2-046eb74ee974 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:23.938710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c94b0662-1d4f-4574-9ac2-046eb74ee974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:23.956319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b0662-1d4f-4574-9ac2-046eb74ee974 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:23.982169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0149d8-62b9-4fa5-b9fa-0f78bbbd626a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:23.983716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0149d8-62b9-4fa5-b9fa-0f78bbbd626a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:23.984589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0149d8-62b9-4fa5-b9fa-0f78bbbd626a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:23.985956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0149d8-62b9-4fa5-b9fa-0f78bbbd626a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:23.986825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0149d8-62b9-4fa5-b9fa-0f78bbbd626a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:23.989242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0149d8-62b9-4fa5-b9fa-0f78bbbd626a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:24.017330 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3540/7052] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:24.023352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0149d8-62b9-4fa5-b9fa-0f78bbbd626a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:24.024411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984d8b2-9f77-4583-8c0b-6707bc6329f9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:24.032369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3cde9-1a17-436b-8d20-429ca993c6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:24.032917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3cde9-1a17-436b-8d20-429ca993c6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:24.033203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3cde9-1a17-436b-8d20-429ca993c6df admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:24.033477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3cde9-1a17-436b-8d20-429ca993c6df admin admin] PATH_INFO: `/v3/users/b4d3543d75a343e09bc7445d7e24257c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:24.038158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0149d8-62b9-4fa5-b9fa-0f78bbbd626a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:24.041810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3cde9-1a17-436b-8d20-429ca993c6df admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4d3543d75a343e09bc7445d7e24257c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:24.043770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3cde9-1a17-436b-8d20-429ca993c6df admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:24.058203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab39dfa-bbcf-462e-b02a-3e7b8ddc94f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:24.062428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab39dfa-bbcf-462e-b02a-3e7b8ddc94f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:24.062712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab39dfa-bbcf-462e-b02a-3e7b8ddc94f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:24.063585 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:24.065921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab39dfa-bbcf-462e-b02a-3e7b8ddc94f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:24.066799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab39dfa-bbcf-462e-b02a-3e7b8ddc94f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:24.069813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab39dfa-bbcf-462e-b02a-3e7b8ddc94f7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:24.096010 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3541/7053] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:24.097838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab39dfa-bbcf-462e-b02a-3e7b8ddc94f7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:24.113824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab39dfa-bbcf-462e-b02a-3e7b8ddc94f7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:24.121907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3453f-93ce-4b12-8fc7-8d6a2f4ae9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:24.125037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3453f-93ce-4b12-8fc7-8d6a2f4ae9e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:24.125888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3453f-93ce-4b12-8fc7-8d6a2f4ae9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:24.126427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3453f-93ce-4b12-8fc7-8d6a2f4ae9e3 admin admin] PATH_INFO: `/v3/projects/9356315a4f8a4cd98b64187633581880/users/3a85945df56d48c7b43334e6f555f2b9/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:24.141319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9be3cde9-1a17-436b-8d20-429ca993c6df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d3543d75a343e09bc7445d7e24257c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:24.164947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9be3cde9-1a17-436b-8d20-429ca993c6df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d3543d75a343e09bc7445d7e24257c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:24.165661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9be3cde9-1a17-436b-8d20-429ca993c6df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d3543d75a343e09bc7445d7e24257c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:24.182650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3453f-93ce-4b12-8fc7-8d6a2f4ae9e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9356315a4f8a4cd98b64187633581880, user_id=3a85945df56d48c7b43334e6f555f2b9, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:24.183587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9be3cde9-1a17-436b-8d20-429ca993c6df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d3543d75a343e09bc7445d7e24257c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:24.192178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3453f-93ce-4b12-8fc7-8d6a2f4ae9e3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:24.204103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9be3cde9-1a17-436b-8d20-429ca993c6df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d3543d75a343e09bc7445d7e24257c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:24.220991 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3513/7055] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:23 2022] DELETE /identity/v3/users/b4d3543d75a343e09bc7445d7e24257c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:24.229183 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3542/7055] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:15:24 2022] PUT /identity/v3/projects/9356315a4f8a4cd98b64187633581880/users/3a85945df56d48c7b43334e6f555f2b9/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:24.230918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e66b9-55a9-4483-bbb8-cc1a82b7ba2f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:24.231435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e66b9-55a9-4483-bbb8-cc1a82b7ba2f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:24.231758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e66b9-55a9-4483-bbb8-cc1a82b7ba2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:24.290136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5a8e66b9-55a9-4483-bbb8-cc1a82b7ba2f None None] MFA Rules not processed for user `3a85945df56d48c7b43334e6f555f2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:24.291554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5a8e66b9-55a9-4483-bbb8-cc1a82b7ba2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:24.419654 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3514/7056] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:15:24.422173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3453f-93ce-4b12-8fc7-8d6a2f4ae9e3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:24.424253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d8a3453f-93ce-4b12-8fc7-8d6a2f4ae9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:24.571039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3453f-93ce-4b12-8fc7-8d6a2f4ae9e3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:24.727149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b631f2-85c3-493e-a279-7ef6999044a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:24.728130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b631f2-85c3-493e-a279-7ef6999044a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:24.728646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b631f2-85c3-493e-a279-7ef6999044a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:24.729126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b631f2-85c3-493e-a279-7ef6999044a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:24.729975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b631f2-85c3-493e-a279-7ef6999044a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:24.732207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b631f2-85c3-493e-a279-7ef6999044a8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:24.796576 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3543/7057] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:15:24 2022] POST /identity/v3/projects => generated 371 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:24.797698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e66b9-55a9-4483-bbb8-cc1a82b7ba2f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:24.812107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e66b9-55a9-4483-bbb8-cc1a82b7ba2f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:24.878702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b631f2-85c3-493e-a279-7ef6999044a8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:24.881055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e9b631f2-85c3-493e-a279-7ef6999044a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:24.943211 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:24.977442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3b91d-e83f-4962-9545-16e2f432ee38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:24.977970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3b91d-e83f-4962-9545-16e2f432ee38 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:24.978251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3b91d-e83f-4962-9545-16e2f432ee38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:24.978958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3b91d-e83f-4962-9545-16e2f432ee38 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:24.979296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3b91d-e83f-4962-9545-16e2f432ee38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:24.981461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3b91d-e83f-4962-9545-16e2f432ee38 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:25.013773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b631f2-85c3-493e-a279-7ef6999044a8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:25.019781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0c385-b506-49c6-a02e-0316e6dd778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:25.020431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0c385-b506-49c6-a02e-0316e6dd778c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:25.020750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0c385-b506-49c6-a02e-0316e6dd778c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:25.021030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0c385-b506-49c6-a02e-0316e6dd778c admin admin] PATH_INFO: `/v3/projects/fcf08d3c3ac84a40b767eca3b6fe9051` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:25.023114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0c385-b506-49c6-a02e-0316e6dd778c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcf08d3c3ac84a40b767eca3b6fe9051)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:25.025309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0c385-b506-49c6-a02e-0316e6dd778c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:25.034400 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3515/7058] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:15:24 2022] POST /identity/v3/users => generated 292 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:25.035626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3b91d-e83f-4962-9545-16e2f432ee38 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:25.066568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3b91d-e83f-4962-9545-16e2f432ee38 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:25.080571 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:25.092857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82d0c385-b506-49c6-a02e-0316e6dd778c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcf08d3c3ac84a40b767eca3b6fe9051', 'request_id': 'req-82d0c385-b506-49c6-a02e-0316e6dd778c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:25.114600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82d0c385-b506-49c6-a02e-0316e6dd778c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcf08d3c3ac84a40b767eca3b6fe9051', 'request_id': 'req-82d0c385-b506-49c6-a02e-0316e6dd778c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:25.128516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82d0c385-b506-49c6-a02e-0316e6dd778c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcf08d3c3ac84a40b767eca3b6fe9051', 'request_id': 'req-82d0c385-b506-49c6-a02e-0316e6dd778c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:25.167123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82d0c385-b506-49c6-a02e-0316e6dd778c admin admin] The token cache is being invalidate because project fcf08d3c3ac84a40b767eca3b6fe9051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:25.167452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82d0c385-b506-49c6-a02e-0316e6dd778c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:25.168170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82d0c385-b506-49c6-a02e-0316e6dd778c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:25.173615 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3544/7059] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:15:24 2022] DELETE /identity/v3/projects/fcf08d3c3ac84a40b767eca3b6fe9051 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:15:25.175220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e935e4-505e-4a77-872f-32914d3cfd5b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:25.175514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e935e4-505e-4a77-872f-32914d3cfd5b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:25.175791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e935e4-505e-4a77-872f-32914d3cfd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:25.203078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e96db-8f4d-41b6-9f8b-3cc8a455bf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:25.203078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e96db-8f4d-41b6-9f8b-3cc8a455bf1e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:25.203702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e96db-8f4d-41b6-9f8b-3cc8a455bf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:25.203985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e96db-8f4d-41b6-9f8b-3cc8a455bf1e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:25.204686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e96db-8f4d-41b6-9f8b-3cc8a455bf1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:25.206571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e96db-8f4d-41b6-9f8b-3cc8a455bf1e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:25.231020 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3516/7060] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:25.235090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e96db-8f4d-41b6-9f8b-3cc8a455bf1e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:25.239496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7c4e96db-8f4d-41b6-9f8b-3cc8a455bf1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:25.258987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b7e935e4-505e-4a77-872f-32914d3cfd5b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:25.260588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b7e935e4-505e-4a77-872f-32914d3cfd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:25.270250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e96db-8f4d-41b6-9f8b-3cc8a455bf1e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:25.278972 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3545/7061] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:25.280101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7522a-958c-4813-9686-f9978c48f045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:25.280818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7522a-958c-4813-9686-f9978c48f045 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:25.281105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7522a-958c-4813-9686-f9978c48f045 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:25.281381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7522a-958c-4813-9686-f9978c48f045 admin admin] PATH_INFO: `/v3/projects/c3b90256420c4cedb79b8867ad746d4f/users/e5a345a8237c489cace0d9b00eab852d/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:25.286433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b11061-91a1-4ec0-9850-5984c41a68d9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:25.286976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b11061-91a1-4ec0-9850-5984c41a68d9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:25.287480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b11061-91a1-4ec0-9850-5984c41a68d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:25.340311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7522a-958c-4813-9686-f9978c48f045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b90256420c4cedb79b8867ad746d4f, user_id=e5a345a8237c489cace0d9b00eab852d, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:25.346617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7522a-958c-4813-9686-f9978c48f045 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:25.354360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-74b11061-91a1-4ec0-9850-5984c41a68d9 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:25.358566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-74b11061-91a1-4ec0-9850-5984c41a68d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:25.372644 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3517/7062] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:15:25 2022] PUT /identity/v3/projects/c3b90256420c4cedb79b8867ad746d4f/users/e5a345a8237c489cace0d9b00eab852d/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:25.374722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7522a-958c-4813-9686-f9978c48f045 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:25.455523 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3546/7063] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:25.459236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b11061-91a1-4ec0-9850-5984c41a68d9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:25.470281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b11061-91a1-4ec0-9850-5984c41a68d9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:25.474503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7522a-958c-4813-9686-f9978c48f045 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:25.477107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21cce8-071a-49df-8ddd-10e362ed6bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:25.478025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21cce8-071a-49df-8ddd-10e362ed6bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:25.478511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21cce8-071a-49df-8ddd-10e362ed6bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:25.479207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21cce8-071a-49df-8ddd-10e362ed6bf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:25.480079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21cce8-071a-49df-8ddd-10e362ed6bf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:15:25.480587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21cce8-071a-49df-8ddd-10e362ed6bf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:25.482889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21cce8-071a-49df-8ddd-10e362ed6bf5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:25.488852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932460d-aa43-4c2e-b796-5bdc1e61dba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:25.494040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932460d-aa43-4c2e-b796-5bdc1e61dba0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:25.494403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932460d-aa43-4c2e-b796-5bdc1e61dba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:25.495536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932460d-aa43-4c2e-b796-5bdc1e61dba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:25.496297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932460d-aa43-4c2e-b796-5bdc1e61dba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:25.503907 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3547/7064] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:15:25.504449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932460d-aa43-4c2e-b796-5bdc1e61dba0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:25.508092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21cce8-071a-49df-8ddd-10e362ed6bf5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:25.524579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21cce8-071a-49df-8ddd-10e362ed6bf5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:25.530706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b57226-e9a8-4648-bf16-f6109062f1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:25.530957 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3518/7065] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:25.531852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b57226-e9a8-4648-bf16-f6109062f1b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:25.532455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b57226-e9a8-4648-bf16-f6109062f1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:25.533117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b57226-e9a8-4648-bf16-f6109062f1b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:25.534062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b57226-e9a8-4648-bf16-f6109062f1b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:25.534716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932460d-aa43-4c2e-b796-5bdc1e61dba0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:25.536763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b57226-e9a8-4648-bf16-f6109062f1b1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:25.556925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932460d-aa43-4c2e-b796-5bdc1e61dba0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:25.571115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd261692-fee5-483b-a8ee-c445a977f498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:25.571896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd261692-fee5-483b-a8ee-c445a977f498 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:25.572185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd261692-fee5-483b-a8ee-c445a977f498 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:25.572521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd261692-fee5-483b-a8ee-c445a977f498 admin admin] PATH_INFO: `/v3/projects/c3b90256420c4cedb79b8867ad746d4f/users/e5a345a8237c489cace0d9b00eab852d/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:25.577178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd261692-fee5-483b-a8ee-c445a977f498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b90256420c4cedb79b8867ad746d4f, user_id=e5a345a8237c489cace0d9b00eab852d, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:25.584727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd261692-fee5-483b-a8ee-c445a977f498 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:25.600536 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3548/7066] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:15:25 2022] POST /identity/v3/projects => generated 381 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:25.605781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b57226-e9a8-4648-bf16-f6109062f1b1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:25.606102 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3519/7067] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:15:25 2022] PUT /identity/v3/projects/c3b90256420c4cedb79b8867ad746d4f/users/e5a345a8237c489cace0d9b00eab852d/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:25.615614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaa16a-38c6-496d-b149-28c10b8d17b8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:25.615913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaa16a-38c6-496d-b149-28c10b8d17b8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:25.616190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaa16a-38c6-496d-b149-28c10b8d17b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:25.627160 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:25.678488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-09eaa16a-38c6-496d-b149-28c10b8d17b8 None None] MFA Rules not processed for user `e5a345a8237c489cace0d9b00eab852d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:25.680503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-09eaa16a-38c6-496d-b149-28c10b8d17b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:25.712312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b57226-e9a8-4648-bf16-f6109062f1b1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:25.809099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c814c37-65a6-4af2-8328-81897d5bdb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:25.809864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c814c37-65a6-4af2-8328-81897d5bdb2e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:25.811724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c814c37-65a6-4af2-8328-81897d5bdb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:25.812009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c814c37-65a6-4af2-8328-81897d5bdb2e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:25.812885 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:25.813553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c814c37-65a6-4af2-8328-81897d5bdb2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:25.817215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c814c37-65a6-4af2-8328-81897d5bdb2e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:25.877348 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3549/7068] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:15:25 2022] POST /identity/v3/users => generated 291 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:25.878241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c814c37-65a6-4af2-8328-81897d5bdb2e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:25.890179 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3520/7069] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:25.894830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eaa16a-38c6-496d-b149-28c10b8d17b8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:25.911854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eaa16a-38c6-496d-b149-28c10b8d17b8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:25.926727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf13d74-6744-45aa-a9c3-4da5b3fdcc47 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:25.927520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf13d74-6744-45aa-a9c3-4da5b3fdcc47 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:25.927893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf13d74-6744-45aa-a9c3-4da5b3fdcc47 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:25.928266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf13d74-6744-45aa-a9c3-4da5b3fdcc47 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:25.929994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf13d74-6744-45aa-a9c3-4da5b3fdcc47 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:25.933037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c814c37-65a6-4af2-8328-81897d5bdb2e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:25.934252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf13d74-6744-45aa-a9c3-4da5b3fdcc47 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:25.943781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede04815-1196-440b-9928-bc7fa6c16379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:25.944889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede04815-1196-440b-9928-bc7fa6c16379 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:25.945482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede04815-1196-440b-9928-bc7fa6c16379 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:25.946033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede04815-1196-440b-9928-bc7fa6c16379 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:25.946865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede04815-1196-440b-9928-bc7fa6c16379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:25.954268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede04815-1196-440b-9928-bc7fa6c16379 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:25.992713 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3521/7070] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:15:25 2022] POST /identity/v3/domains => generated 276 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:25.993939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf13d74-6744-45aa-a9c3-4da5b3fdcc47 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:26.008810 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3550/7071] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:26.010150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede04815-1196-440b-9928-bc7fa6c16379 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:26.038128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede04815-1196-440b-9928-bc7fa6c16379 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:26.114475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de853a-4f4f-4705-8ac5-b2f5f15b68c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:26.115979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de853a-4f4f-4705-8ac5-b2f5f15b68c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:26.116729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de853a-4f4f-4705-8ac5-b2f5f15b68c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:26.117322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de853a-4f4f-4705-8ac5-b2f5f15b68c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:26.118314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de853a-4f4f-4705-8ac5-b2f5f15b68c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:26.121515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de853a-4f4f-4705-8ac5-b2f5f15b68c0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:26.142153 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3551/7072] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:26.151417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de853a-4f4f-4705-8ac5-b2f5f15b68c0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:26.176388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de853a-4f4f-4705-8ac5-b2f5f15b68c0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:26.182760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82901d7e-232b-4fa3-aea1-38bf7bd32db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:26.184014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82901d7e-232b-4fa3-aea1-38bf7bd32db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:26.185007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82901d7e-232b-4fa3-aea1-38bf7bd32db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:26.185447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82901d7e-232b-4fa3-aea1-38bf7bd32db1 admin admin] PATH_INFO: `/v3/projects/e36991ce64634e3bb5dce4e755f635dd/users/1f47a736cf594ebf9e7ea5cb0f6bc5a7/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:26.194118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf13d74-6744-45aa-a9c3-4da5b3fdcc47 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:26.207848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82901d7e-232b-4fa3-aea1-38bf7bd32db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e36991ce64634e3bb5dce4e755f635dd, user_id=1f47a736cf594ebf9e7ea5cb0f6bc5a7, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:26.210764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82901d7e-232b-4fa3-aea1-38bf7bd32db1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:26.212723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac2d4a-18b7-4c30-b52c-2a591947efc0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:26.214042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac2d4a-18b7-4c30-b52c-2a591947efc0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:26.214557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac2d4a-18b7-4c30-b52c-2a591947efc0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:26.215572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac2d4a-18b7-4c30-b52c-2a591947efc0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:26.216662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac2d4a-18b7-4c30-b52c-2a591947efc0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:26.219367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac2d4a-18b7-4c30-b52c-2a591947efc0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:26.257426 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3552/7073] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:15:26 2022] PUT /identity/v3/projects/e36991ce64634e3bb5dce4e755f635dd/users/1f47a736cf594ebf9e7ea5cb0f6bc5a7/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:26.273584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fa0e5-37ff-4ce3-a3d8-55fe5e0fcb47 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:26.273885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fa0e5-37ff-4ce3-a3d8-55fe5e0fcb47 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:26.274137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fa0e5-37ff-4ce3-a3d8-55fe5e0fcb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:26.293746 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:26.310922 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3522/7074] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:15:25 2022] POST /identity/v3/projects => generated 402 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:26.314546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac2d4a-18b7-4c30-b52c-2a591947efc0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:26.351511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c29fa0e5-37ff-4ce3-a3d8-55fe5e0fcb47 None None] MFA Rules not processed for user `1f47a736cf594ebf9e7ea5cb0f6bc5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:26.353088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c29fa0e5-37ff-4ce3-a3d8-55fe5e0fcb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:26.486803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac2d4a-18b7-4c30-b52c-2a591947efc0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:26.490348 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3553/7075] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:26.494569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fa0e5-37ff-4ce3-a3d8-55fe5e0fcb47 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:26.519609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60026700-abb7-48aa-a60e-fc232c3084b8 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:26.520183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60026700-abb7-48aa-a60e-fc232c3084b8 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:26.520464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60026700-abb7-48aa-a60e-fc232c3084b8 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:26.520782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60026700-abb7-48aa-a60e-fc232c3084b8 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/groups` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:26.521440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60026700-abb7-48aa-a60e-fc232c3084b8 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:26.523526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60026700-abb7-48aa-a60e-fc232c3084b8 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:26.579917 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3523/7076] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Sep 30 10:15:26 2022] POST /identity/v3/groups => generated 302 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:26.583710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60026700-abb7-48aa-a60e-fc232c3084b8 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:26.610980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60026700-abb7-48aa-a60e-fc232c3084b8 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:26.632238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9838df2-759a-40c1-a48e-8ae9a72eb853 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:26.632895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9838df2-759a-40c1-a48e-8ae9a72eb853 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:26.633179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9838df2-759a-40c1-a48e-8ae9a72eb853 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:26.633453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9838df2-759a-40c1-a48e-8ae9a72eb853 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:26.634113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9838df2-759a-40c1-a48e-8ae9a72eb853 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:26.636021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9838df2-759a-40c1-a48e-8ae9a72eb853 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:26.692565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fa0e5-37ff-4ce3-a3d8-55fe5e0fcb47 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:26.697023 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3524/7077] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:15:26 2022] POST /identity/v3/users => generated 445 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:26.701879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9838df2-759a-40c1-a48e-8ae9a72eb853 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:26.719704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62830cc2-22a8-4997-bef0-1bf28cefb600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:26.720334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62830cc2-22a8-4997-bef0-1bf28cefb600 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:26.720635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62830cc2-22a8-4997-bef0-1bf28cefb600 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:26.720927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62830cc2-22a8-4997-bef0-1bf28cefb600 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:26.721577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62830cc2-22a8-4997-bef0-1bf28cefb600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:26.723483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62830cc2-22a8-4997-bef0-1bf28cefb600 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:26.729878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9838df2-759a-40c1-a48e-8ae9a72eb853 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:26.752458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64648052-5c9c-4a60-9219-157308187f11 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:26.753147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64648052-5c9c-4a60-9219-157308187f11 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:26.753426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64648052-5c9c-4a60-9219-157308187f11 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:26.753704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64648052-5c9c-4a60-9219-157308187f11 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:26.754381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64648052-5c9c-4a60-9219-157308187f11 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:26.755979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64648052-5c9c-4a60-9219-157308187f11 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:26.797407 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3525/7078] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 10:15:26 2022] POST /identity/v3/roles => generated 239 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:26.798619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64648052-5c9c-4a60-9219-157308187f11 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:26.805966 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3554/7079] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:15:26 2022] POST /identity/v3/projects => generated 381 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:15:26.813670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62830cc2-22a8-4997-bef0-1bf28cefb600 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:26.836043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64648052-5c9c-4a60-9219-157308187f11 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:26.884684 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:26.952535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62830cc2-22a8-4997-bef0-1bf28cefb600 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:26.967869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ae222-b065-4d02-b533-57fad1014035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:26.968233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ae222-b065-4d02-b533-57fad1014035 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:26.968521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ae222-b065-4d02-b533-57fad1014035 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:26.968826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ae222-b065-4d02-b533-57fad1014035 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:26.969466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ae222-b065-4d02-b533-57fad1014035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:26.971395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ae222-b065-4d02-b533-57fad1014035 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:27.018363 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3555/7080] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:15:26 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:27.019431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dfbf1-f00b-4718-bb00-781f543ae185 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:27.019589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ae222-b065-4d02-b533-57fad1014035 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:27.020201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dfbf1-f00b-4718-bb00-781f543ae185 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:27.020491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dfbf1-f00b-4718-bb00-781f543ae185 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:27.020793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dfbf1-f00b-4718-bb00-781f543ae185 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/3440cb68217e4924abd3cc02b0d85b0a/groups/2feb2f35db46430387e35aa56a4cc6a6/roles/cc49b2d989644a589608190e3d6c59df/inherited_to_projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:27.038083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ae222-b065-4d02-b533-57fad1014035 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:27.038429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687dfbf1-f00b-4718-bb00-781f543ae185 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3440cb68217e4924abd3cc02b0d85b0a, group_id=2feb2f35db46430387e35aa56a4cc6a6, role_id=cc49b2d989644a589608190e3d6c59df)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:27.041333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687dfbf1-f00b-4718-bb00-781f543ae185 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:27.054217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524eff0-3fcb-4aaf-ab9f-dec7f8d26d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:27.054767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524eff0-3fcb-4aaf-ab9f-dec7f8d26d5a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:27.055094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524eff0-3fcb-4aaf-ab9f-dec7f8d26d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:27.055369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524eff0-3fcb-4aaf-ab9f-dec7f8d26d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:27.056077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524eff0-3fcb-4aaf-ab9f-dec7f8d26d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:27.057914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524eff0-3fcb-4aaf-ab9f-dec7f8d26d5a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:27.064251 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:27.085715 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3526/7081] 10.222.0.16 () {60 vars in 1585 bytes} [Fri Sep 30 10:15:26 2022] PUT /identity/v3/OS-INHERIT/projects/3440cb68217e4924abd3cc02b0d85b0a/groups/2feb2f35db46430387e35aa56a4cc6a6/roles/cc49b2d989644a589608190e3d6c59df/inherited_to_projects => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:27.086719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dfbf1-f00b-4718-bb00-781f543ae185 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:27.101750 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3556/7082] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:27 2022] GET /identity/v3/roles => generated 1650 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:15:27.106345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524eff0-3fcb-4aaf-ab9f-dec7f8d26d5a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:27.143821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524eff0-3fcb-4aaf-ab9f-dec7f8d26d5a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:27.246772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7e5b1-ce08-4fa8-82d7-75da7124feb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:27.248067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7e5b1-ce08-4fa8-82d7-75da7124feb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:27.248417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7e5b1-ce08-4fa8-82d7-75da7124feb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:27.264295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7e5b1-ce08-4fa8-82d7-75da7124feb9 admin admin] PATH_INFO: `/v3/projects/333d9b44f1114c2caf8aa63f452e12ba/users/13e5206e17e042d08e0a55f32faeab0c/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:27.291258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dfbf1-f00b-4718-bb00-781f543ae185 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:27.304928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27406910-c9df-4fab-afc3-0a8d3b1a7a32 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:27.305595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27406910-c9df-4fab-afc3-0a8d3b1a7a32 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:27.305879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27406910-c9df-4fab-afc3-0a8d3b1a7a32 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:27.306158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27406910-c9df-4fab-afc3-0a8d3b1a7a32 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/3440cb68217e4924abd3cc02b0d85b0a/groups/2feb2f35db46430387e35aa56a4cc6a6/roles/cc49b2d989644a589608190e3d6c59df/inherited_to_projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:27.307380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7e5b1-ce08-4fa8-82d7-75da7124feb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=333d9b44f1114c2caf8aa63f452e12ba, user_id=13e5206e17e042d08e0a55f32faeab0c, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:27.310858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7e5b1-ce08-4fa8-82d7-75da7124feb9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:27.319158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27406910-c9df-4fab-afc3-0a8d3b1a7a32 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:check_grant(project_id=3440cb68217e4924abd3cc02b0d85b0a, group_id=2feb2f35db46430387e35aa56a4cc6a6, role_id=cc49b2d989644a589608190e3d6c59df)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:27.320796 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-27406910-c9df-4fab-afc3-0a8d3b1a7a32 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:15:27.320796 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:15:27.320796 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:15:27.323146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27406910-c9df-4fab-afc3-0a8d3b1a7a32 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:27.336505 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3527/7083] 10.222.0.16 () {58 vars in 1567 bytes} [Fri Sep 30 10:15:27 2022] HEAD /identity/v3/OS-INHERIT/projects/3440cb68217e4924abd3cc02b0d85b0a/groups/2feb2f35db46430387e35aa56a4cc6a6/roles/cc49b2d989644a589608190e3d6c59df/inherited_to_projects => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:27.340806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27406910-c9df-4fab-afc3-0a8d3b1a7a32 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:27.345258 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3557/7084] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:15:27 2022] PUT /identity/v3/projects/333d9b44f1114c2caf8aa63f452e12ba/users/13e5206e17e042d08e0a55f32faeab0c/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:15:27.348886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7e5b1-ce08-4fa8-82d7-75da7124feb9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:27.354969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27406910-c9df-4fab-afc3-0a8d3b1a7a32 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:27.434812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12212ac-84e4-4816-9c23-8c4304a517a6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:27.435585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12212ac-84e4-4816-9c23-8c4304a517a6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:27.435962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12212ac-84e4-4816-9c23-8c4304a517a6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:27.436346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12212ac-84e4-4816-9c23-8c4304a517a6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/3440cb68217e4924abd3cc02b0d85b0a/groups/2feb2f35db46430387e35aa56a4cc6a6/roles/cc49b2d989644a589608190e3d6c59df/inherited_to_projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:27.438954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12212ac-84e4-4816-9c23-8c4304a517a6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=3440cb68217e4924abd3cc02b0d85b0a, group_id=2feb2f35db46430387e35aa56a4cc6a6, role_id=cc49b2d989644a589608190e3d6c59df)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:27.450761 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-b12212ac-84e4-4816-9c23-8c4304a517a6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:15:27.450761 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:15:27.450761 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:15:27.450761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12212ac-84e4-4816-9c23-8c4304a517a6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:27.451304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b12212ac-84e4-4816-9c23-8c4304a517a6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invalidating the token cache because role cc49b2d989644a589608190e3d6c59df was removed from group 2feb2f35db46430387e35aa56a4cc6a6 on project 3440cb68217e4924abd3cc02b0d85b0a. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:27.451961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b12212ac-84e4-4816-9c23-8c4304a517a6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:27.460564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b12212ac-84e4-4816-9c23-8c4304a517a6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:27.492270 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3528/7085] 10.222.0.16 () {58 vars in 1569 bytes} [Fri Sep 30 10:15:27 2022] DELETE /identity/v3/OS-INHERIT/projects/3440cb68217e4924abd3cc02b0d85b0a/groups/2feb2f35db46430387e35aa56a4cc6a6/roles/cc49b2d989644a589608190e3d6c59df/inherited_to_projects => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:27.499018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12212ac-84e4-4816-9c23-8c4304a517a6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:27.503571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b12212ac-84e4-4816-9c23-8c4304a517a6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:27.540178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7e5b1-ce08-4fa8-82d7-75da7124feb9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:27.585048 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:27.654939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12212ac-84e4-4816-9c23-8c4304a517a6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:27.686372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3657aa-c7fc-4947-ae0b-a8d4acd3178b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:27.688148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3657aa-c7fc-4947-ae0b-a8d4acd3178b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:27.690822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c456b19-1c09-44f4-bcbf-a64baba10c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:27.691290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3657aa-c7fc-4947-ae0b-a8d4acd3178b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:27.691429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c456b19-1c09-44f4-bcbf-a64baba10c0a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:27.691691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c456b19-1c09-44f4-bcbf-a64baba10c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:27.691960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c456b19-1c09-44f4-bcbf-a64baba10c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:27.692335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3657aa-c7fc-4947-ae0b-a8d4acd3178b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/roles/cc49b2d989644a589608190e3d6c59df` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:27.692985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c456b19-1c09-44f4-bcbf-a64baba10c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:27.694429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c456b19-1c09-44f4-bcbf-a64baba10c0a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:27.696946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3657aa-c7fc-4947-ae0b-a8d4acd3178b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cc49b2d989644a589608190e3d6c59df)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:27.707071 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3558/7086] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:27 2022] GET /identity/v3/roles => generated 1650 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:15:27.711827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3657aa-c7fc-4947-ae0b-a8d4acd3178b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:27.712027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c456b19-1c09-44f4-bcbf-a64baba10c0a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:27.716850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7c456b19-1c09-44f4-bcbf-a64baba10c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:27.767550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c456b19-1c09-44f4-bcbf-a64baba10c0a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:27.782937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9c3657aa-c7fc-4947-ae0b-a8d4acd3178b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invalidating the token cache because role cc49b2d989644a589608190e3d6c59df has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:27.783661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9c3657aa-c7fc-4947-ae0b-a8d4acd3178b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:27.785776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9c3657aa-c7fc-4947-ae0b-a8d4acd3178b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:27.788742 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3529/7087] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:27 2022] DELETE /identity/v3/roles/cc49b2d989644a589608190e3d6c59df => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:27.796176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3657aa-c7fc-4947-ae0b-a8d4acd3178b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:27.797577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45a017-6b43-4c7c-b19a-d260c9c89fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:27.798269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45a017-6b43-4c7c-b19a-d260c9c89fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:27.798552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45a017-6b43-4c7c-b19a-d260c9c89fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:27.799996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45a017-6b43-4c7c-b19a-d260c9c89fcc admin admin] PATH_INFO: `/v3/projects/333d9b44f1114c2caf8aa63f452e12ba/users/13e5206e17e042d08e0a55f32faeab0c/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:27.801385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9c3657aa-c7fc-4947-ae0b-a8d4acd3178b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:27.805752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45a017-6b43-4c7c-b19a-d260c9c89fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=333d9b44f1114c2caf8aa63f452e12ba, user_id=13e5206e17e042d08e0a55f32faeab0c, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:27.813900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45a017-6b43-4c7c-b19a-d260c9c89fcc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:27.844648 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3559/7088] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:15:27 2022] PUT /identity/v3/projects/333d9b44f1114c2caf8aa63f452e12ba/users/13e5206e17e042d08e0a55f32faeab0c/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:27.854866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72751abd-b636-4005-bb9b-53f7a77320f9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:27.855408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72751abd-b636-4005-bb9b-53f7a77320f9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:27.855408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72751abd-b636-4005-bb9b-53f7a77320f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:27.895845 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:27.921446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-72751abd-b636-4005-bb9b-53f7a77320f9 None None] MFA Rules not processed for user `13e5206e17e042d08e0a55f32faeab0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:27.922846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-72751abd-b636-4005-bb9b-53f7a77320f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:27.975964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3657aa-c7fc-4947-ae0b-a8d4acd3178b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:28.039468 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3560/7089] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:27 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:15:28.051064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72751abd-b636-4005-bb9b-53f7a77320f9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:28.053394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-72751abd-b636-4005-bb9b-53f7a77320f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:28.134867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72751abd-b636-4005-bb9b-53f7a77320f9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:28.145134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb5e0b-5656-4b14-9ab3-cb6f013e591d tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:28.148006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb5e0b-5656-4b14-9ab3-cb6f013e591d tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:28.148560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb5e0b-5656-4b14-9ab3-cb6f013e591d tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:28.148866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb5e0b-5656-4b14-9ab3-cb6f013e591d tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:28.149559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb5e0b-5656-4b14-9ab3-cb6f013e591d tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:28.154497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb5e0b-5656-4b14-9ab3-cb6f013e591d tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:28.158282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba488ae-9b83-4bf1-a06f-f3b64ff8fd4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:28.159427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba488ae-9b83-4bf1-a06f-f3b64ff8fd4a service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:28.159877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba488ae-9b83-4bf1-a06f-f3b64ff8fd4a service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:28.160311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba488ae-9b83-4bf1-a06f-f3b64ff8fd4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:28.179328 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3530/7090] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 10:15:27 2022] POST /identity/v3/roles => generated 239 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:28.182542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba488ae-9b83-4bf1-a06f-f3b64ff8fd4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:28.183748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb5e0b-5656-4b14-9ab3-cb6f013e591d tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:28.183998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba488ae-9b83-4bf1-a06f-f3b64ff8fd4a service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:28.206286 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3561/7091] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:15:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:15:28.211002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb5e0b-5656-4b14-9ab3-cb6f013e591d tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:28.220988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1b48a-a37d-48f7-9d9e-a1a41b7f1104 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:28.222176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1b48a-a37d-48f7-9d9e-a1a41b7f1104 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:28.222658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1b48a-a37d-48f7-9d9e-a1a41b7f1104 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:28.223108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1b48a-a37d-48f7-9d9e-a1a41b7f1104 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/3440cb68217e4924abd3cc02b0d85b0a/users/ed97f3f7314b4ac9b387ba8a6d42233c/roles/c80c0728604443b88dc4bdca1303a206/inherited_to_projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:28.271598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1b48a-a37d-48f7-9d9e-a1a41b7f1104 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3440cb68217e4924abd3cc02b0d85b0a, user_id=ed97f3f7314b4ac9b387ba8a6d42233c, role_id=c80c0728604443b88dc4bdca1303a206)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:28.275413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1b48a-a37d-48f7-9d9e-a1a41b7f1104 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:28.305231 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3531/7092] 10.222.0.16 () {60 vars in 1582 bytes} [Fri Sep 30 10:15:28 2022] PUT /identity/v3/OS-INHERIT/projects/3440cb68217e4924abd3cc02b0d85b0a/users/ed97f3f7314b4ac9b387ba8a6d42233c/roles/c80c0728604443b88dc4bdca1303a206/inherited_to_projects => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:28.306757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba488ae-9b83-4bf1-a06f-f3b64ff8fd4a service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:28.318113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba488ae-9b83-4bf1-a06f-f3b64ff8fd4a service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:28.432536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf405c83-af85-4446-a010-1ffb6abda5c2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:28.433427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf405c83-af85-4446-a010-1ffb6abda5c2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:28.433721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf405c83-af85-4446-a010-1ffb6abda5c2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:28.435135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf405c83-af85-4446-a010-1ffb6abda5c2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/3440cb68217e4924abd3cc02b0d85b0a/users/ed97f3f7314b4ac9b387ba8a6d42233c/roles/c80c0728604443b88dc4bdca1303a206/inherited_to_projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:28.445871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf405c83-af85-4446-a010-1ffb6abda5c2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:check_grant(project_id=3440cb68217e4924abd3cc02b0d85b0a, user_id=ed97f3f7314b4ac9b387ba8a6d42233c, role_id=c80c0728604443b88dc4bdca1303a206)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:28.447368 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-bf405c83-af85-4446-a010-1ffb6abda5c2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:15:28.447368 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:15:28.447368 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:15:28.452811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf405c83-af85-4446-a010-1ffb6abda5c2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:28.476358 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3562/7093] 10.222.0.16 () {58 vars in 1564 bytes} [Fri Sep 30 10:15:28 2022] HEAD /identity/v3/OS-INHERIT/projects/3440cb68217e4924abd3cc02b0d85b0a/users/ed97f3f7314b4ac9b387ba8a6d42233c/roles/c80c0728604443b88dc4bdca1303a206/inherited_to_projects => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:28.477578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1b48a-a37d-48f7-9d9e-a1a41b7f1104 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:28.493376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1b48a-a37d-48f7-9d9e-a1a41b7f1104 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:28.508509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea7d9c-ac13-4de8-9d13-2d1e5ac9bab0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:28.518948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea7d9c-ac13-4de8-9d13-2d1e5ac9bab0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:28.519238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea7d9c-ac13-4de8-9d13-2d1e5ac9bab0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:28.519519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea7d9c-ac13-4de8-9d13-2d1e5ac9bab0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/3440cb68217e4924abd3cc02b0d85b0a/users/ed97f3f7314b4ac9b387ba8a6d42233c/roles/c80c0728604443b88dc4bdca1303a206/inherited_to_projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:28.522358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea7d9c-ac13-4de8-9d13-2d1e5ac9bab0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=3440cb68217e4924abd3cc02b0d85b0a, user_id=ed97f3f7314b4ac9b387ba8a6d42233c, role_id=c80c0728604443b88dc4bdca1303a206)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:28.526918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea7d9c-ac13-4de8-9d13-2d1e5ac9bab0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:28.547405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8bea7d9c-ac13-4de8-9d13-2d1e5ac9bab0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invalidating the token cache because role c80c0728604443b88dc4bdca1303a206 was removed from user ed97f3f7314b4ac9b387ba8a6d42233c on project 3440cb68217e4924abd3cc02b0d85b0a. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:28.547910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8bea7d9c-ac13-4de8-9d13-2d1e5ac9bab0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:28.548751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8bea7d9c-ac13-4de8-9d13-2d1e5ac9bab0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:28.559140 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:28.572405 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3532/7094] 10.222.0.16 () {58 vars in 1566 bytes} [Fri Sep 30 10:15:28 2022] DELETE /identity/v3/OS-INHERIT/projects/3440cb68217e4924abd3cc02b0d85b0a/users/ed97f3f7314b4ac9b387ba8a6d42233c/roles/c80c0728604443b88dc4bdca1303a206/inherited_to_projects => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:28.573769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf405c83-af85-4446-a010-1ffb6abda5c2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:28.575852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bf405c83-af85-4446-a010-1ffb6abda5c2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:28.601052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf405c83-af85-4446-a010-1ffb6abda5c2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:28.681297 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:28.731901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360d2c2-20f9-4e42-843e-db5c09ad049b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:28.732564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360d2c2-20f9-4e42-843e-db5c09ad049b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:28.733291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360d2c2-20f9-4e42-843e-db5c09ad049b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:28.733451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360d2c2-20f9-4e42-843e-db5c09ad049b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/roles/c80c0728604443b88dc4bdca1303a206` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:28.742685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360d2c2-20f9-4e42-843e-db5c09ad049b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c80c0728604443b88dc4bdca1303a206)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:28.744320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360d2c2-20f9-4e42-843e-db5c09ad049b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:28.841361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a360d2c2-20f9-4e42-843e-db5c09ad049b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invalidating the token cache because role c80c0728604443b88dc4bdca1303a206 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:28.842201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a360d2c2-20f9-4e42-843e-db5c09ad049b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:28.843385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a360d2c2-20f9-4e42-843e-db5c09ad049b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:28.848574 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3563/7095] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:28 2022] DELETE /identity/v3/roles/c80c0728604443b88dc4bdca1303a206 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:28.853969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea7d9c-ac13-4de8-9d13-2d1e5ac9bab0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:28.865462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea7d9c-ac13-4de8-9d13-2d1e5ac9bab0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:28.925120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360d2c2-20f9-4e42-843e-db5c09ad049b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:28.938682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a360d2c2-20f9-4e42-843e-db5c09ad049b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:29.099936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ba9f6-3e11-49f4-8c85-124269d1aba0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:29.100568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ba9f6-3e11-49f4-8c85-124269d1aba0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:29.100967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ba9f6-3e11-49f4-8c85-124269d1aba0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:29.101237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ba9f6-3e11-49f4-8c85-124269d1aba0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:29.101905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ba9f6-3e11-49f4-8c85-124269d1aba0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:29.103893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ba9f6-3e11-49f4-8c85-124269d1aba0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:29.129088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360d2c2-20f9-4e42-843e-db5c09ad049b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:29.129739 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3533/7096] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 10:15:28 2022] POST /identity/v3/roles => generated 240 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:29.135047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ba9f6-3e11-49f4-8c85-124269d1aba0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:29.139457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-581ba9f6-3e11-49f4-8c85-124269d1aba0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:29.148378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff33947-9a66-45a0-98d6-9dfc7576177d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:29.149063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff33947-9a66-45a0-98d6-9dfc7576177d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:29.149347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff33947-9a66-45a0-98d6-9dfc7576177d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:29.149620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff33947-9a66-45a0-98d6-9dfc7576177d admin admin] PATH_INFO: `/v3/users/1f47a736cf594ebf9e7ea5cb0f6bc5a7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:29.155041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff33947-9a66-45a0-98d6-9dfc7576177d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f47a736cf594ebf9e7ea5cb0f6bc5a7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:29.159244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff33947-9a66-45a0-98d6-9dfc7576177d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:29.161064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ba9f6-3e11-49f4-8c85-124269d1aba0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:29.167692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308e4d0-1ff7-4867-b17a-71aa32fa3e75 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:29.169363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308e4d0-1ff7-4867-b17a-71aa32fa3e75 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:29.199479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308e4d0-1ff7-4867-b17a-71aa32fa3e75 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:29.201558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308e4d0-1ff7-4867-b17a-71aa32fa3e75 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e251209901fa44e4bd23e19ddb3bc9d4/groups/2feb2f35db46430387e35aa56a4cc6a6/roles/ec7245cac76b4fd5807d2f495afc73a7/inherited_to_projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:29.211642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308e4d0-1ff7-4867-b17a-71aa32fa3e75 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e251209901fa44e4bd23e19ddb3bc9d4, group_id=2feb2f35db46430387e35aa56a4cc6a6, role_id=ec7245cac76b4fd5807d2f495afc73a7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:29.214965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308e4d0-1ff7-4867-b17a-71aa32fa3e75 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:29.259673 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3534/7097] 10.222.0.16 () {60 vars in 1582 bytes} [Fri Sep 30 10:15:29 2022] PUT /identity/v3/OS-INHERIT/domains/e251209901fa44e4bd23e19ddb3bc9d4/groups/2feb2f35db46430387e35aa56a4cc6a6/roles/ec7245cac76b4fd5807d2f495afc73a7/inherited_to_projects => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:15:29.264370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308e4d0-1ff7-4867-b17a-71aa32fa3e75 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:29.288082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5ff33947-9a66-45a0-98d6-9dfc7576177d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f47a736cf594ebf9e7ea5cb0f6bc5a7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:29.288823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5ff33947-9a66-45a0-98d6-9dfc7576177d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f47a736cf594ebf9e7ea5cb0f6bc5a7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:29.303837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5ff33947-9a66-45a0-98d6-9dfc7576177d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f47a736cf594ebf9e7ea5cb0f6bc5a7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:29.323695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5ff33947-9a66-45a0-98d6-9dfc7576177d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f47a736cf594ebf9e7ea5cb0f6bc5a7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:29.339222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5ff33947-9a66-45a0-98d6-9dfc7576177d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f47a736cf594ebf9e7ea5cb0f6bc5a7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:29.351935 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3564/7098] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:28 2022] DELETE /identity/v3/users/1f47a736cf594ebf9e7ea5cb0f6bc5a7 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:29.361349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db15c3-0cc9-418e-8c8f-cfbc22afca8a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:29.361630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db15c3-0cc9-418e-8c8f-cfbc22afca8a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:29.361908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db15c3-0cc9-418e-8c8f-cfbc22afca8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:29.404702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-39db15c3-0cc9-418e-8c8f-cfbc22afca8a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:29.406514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308e4d0-1ff7-4867-b17a-71aa32fa3e75 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:29.407298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-39db15c3-0cc9-418e-8c8f-cfbc22afca8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:29.450097 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:29.530903 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3565/7099] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:29.540359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db15c3-0cc9-418e-8c8f-cfbc22afca8a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:29.542389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-39db15c3-0cc9-418e-8c8f-cfbc22afca8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:29.558108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c422f-4799-43de-b2c6-eca4ec0817eb tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:29.561470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c422f-4799-43de-b2c6-eca4ec0817eb tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:29.561993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c422f-4799-43de-b2c6-eca4ec0817eb tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:29.562486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c422f-4799-43de-b2c6-eca4ec0817eb tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e251209901fa44e4bd23e19ddb3bc9d4/groups/2feb2f35db46430387e35aa56a4cc6a6/roles/inherited_to_projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:29.566235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c422f-4799-43de-b2c6-eca4ec0817eb tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=e251209901fa44e4bd23e19ddb3bc9d4, group_id=2feb2f35db46430387e35aa56a4cc6a6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:29.568752 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-3d8c422f-4799-43de-b2c6-eca4ec0817eb tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:15:29.568752 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:15:29.568752 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:15:29.574792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c422f-4799-43de-b2c6-eca4ec0817eb tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:29.609748 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3535/7100] 10.222.0.16 () {58 vars in 1464 bytes} [Fri Sep 30 10:15:29 2022] GET /identity/v3/OS-INHERIT/domains/e251209901fa44e4bd23e19ddb3bc9d4/groups/2feb2f35db46430387e35aa56a4cc6a6/roles/inherited_to_projects => generated 448 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:15:29.614359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c422f-4799-43de-b2c6-eca4ec0817eb tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:29.619352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3d8c422f-4799-43de-b2c6-eca4ec0817eb tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:29.639114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c422f-4799-43de-b2c6-eca4ec0817eb tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:29.645267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4abd3-de82-400e-bf45-68383cd5b4eb tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:29.646356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4abd3-de82-400e-bf45-68383cd5b4eb tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:29.647065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4abd3-de82-400e-bf45-68383cd5b4eb tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:29.647577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4abd3-de82-400e-bf45-68383cd5b4eb tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e251209901fa44e4bd23e19ddb3bc9d4/groups/2feb2f35db46430387e35aa56a4cc6a6/roles/ec7245cac76b4fd5807d2f495afc73a7/inherited_to_projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:29.650127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4abd3-de82-400e-bf45-68383cd5b4eb tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=e251209901fa44e4bd23e19ddb3bc9d4, group_id=2feb2f35db46430387e35aa56a4cc6a6, role_id=ec7245cac76b4fd5807d2f495afc73a7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:29.653710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4abd3-de82-400e-bf45-68383cd5b4eb tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:29.661608 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3536/7101] 10.222.0.16 () {58 vars in 1564 bytes} [Fri Sep 30 10:15:29 2022] HEAD /identity/v3/OS-INHERIT/domains/e251209901fa44e4bd23e19ddb3bc9d4/groups/2feb2f35db46430387e35aa56a4cc6a6/roles/ec7245cac76b4fd5807d2f495afc73a7/inherited_to_projects => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:29.666124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4abd3-de82-400e-bf45-68383cd5b4eb tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:29.680284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4abd3-de82-400e-bf45-68383cd5b4eb tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:29.681133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db15c3-0cc9-418e-8c8f-cfbc22afca8a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:29.686513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842d0ff-0c21-46fa-9c33-fd2c59e5231f tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:29.687543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842d0ff-0c21-46fa-9c33-fd2c59e5231f tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:29.688038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842d0ff-0c21-46fa-9c33-fd2c59e5231f tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:29.688546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842d0ff-0c21-46fa-9c33-fd2c59e5231f tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e251209901fa44e4bd23e19ddb3bc9d4/groups/2feb2f35db46430387e35aa56a4cc6a6/roles/ec7245cac76b4fd5807d2f495afc73a7/inherited_to_projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:29.691118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842d0ff-0c21-46fa-9c33-fd2c59e5231f tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e251209901fa44e4bd23e19ddb3bc9d4, group_id=2feb2f35db46430387e35aa56a4cc6a6, role_id=ec7245cac76b4fd5807d2f495afc73a7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:29.694379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842d0ff-0c21-46fa-9c33-fd2c59e5231f tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:29.694863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e71a4-7037-4695-9eca-f6b8f3f0b878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:29.695496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e71a4-7037-4695-9eca-f6b8f3f0b878 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:29.695756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e71a4-7037-4695-9eca-f6b8f3f0b878 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:29.696024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e71a4-7037-4695-9eca-f6b8f3f0b878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:29.699416 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:29.702378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3842d0ff-0c21-46fa-9c33-fd2c59e5231f tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invalidating the token cache because role ec7245cac76b4fd5807d2f495afc73a7 was removed from group 2feb2f35db46430387e35aa56a4cc6a6 on domain e251209901fa44e4bd23e19ddb3bc9d4. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:29.702955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3842d0ff-0c21-46fa-9c33-fd2c59e5231f tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:29.704096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3842d0ff-0c21-46fa-9c33-fd2c59e5231f tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:29.726699 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3537/7102] 10.222.0.16 () {58 vars in 1566 bytes} [Fri Sep 30 10:15:29 2022] DELETE /identity/v3/OS-INHERIT/domains/e251209901fa44e4bd23e19ddb3bc9d4/groups/2feb2f35db46430387e35aa56a4cc6a6/roles/ec7245cac76b4fd5807d2f495afc73a7/inherited_to_projects => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:29.726918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e71a4-7037-4695-9eca-f6b8f3f0b878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:29.728128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842d0ff-0c21-46fa-9c33-fd2c59e5231f tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:29.728271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e71a4-7037-4695-9eca-f6b8f3f0b878 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:29.729806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3842d0ff-0c21-46fa-9c33-fd2c59e5231f tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:29.745859 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3566/7103] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:15:29.908057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842d0ff-0c21-46fa-9c33-fd2c59e5231f tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:29.923564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce71fb-3e1e-4a6a-8d0e-bcd3f9fae3ed tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:29.924234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce71fb-3e1e-4a6a-8d0e-bcd3f9fae3ed tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:29.924517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce71fb-3e1e-4a6a-8d0e-bcd3f9fae3ed tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:29.925945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce71fb-3e1e-4a6a-8d0e-bcd3f9fae3ed tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/roles/ec7245cac76b4fd5807d2f495afc73a7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:29.929843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce71fb-3e1e-4a6a-8d0e-bcd3f9fae3ed tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ec7245cac76b4fd5807d2f495afc73a7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:29.933258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce71fb-3e1e-4a6a-8d0e-bcd3f9fae3ed tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:30.020236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-56ce71fb-3e1e-4a6a-8d0e-bcd3f9fae3ed tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invalidating the token cache because role ec7245cac76b4fd5807d2f495afc73a7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:30.021297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-56ce71fb-3e1e-4a6a-8d0e-bcd3f9fae3ed tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:30.021538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-56ce71fb-3e1e-4a6a-8d0e-bcd3f9fae3ed tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:30.023459 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3538/7104] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:29 2022] DELETE /identity/v3/roles/ec7245cac76b4fd5807d2f495afc73a7 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:30.029796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e71a4-7037-4695-9eca-f6b8f3f0b878 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:30.041144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e71a4-7037-4695-9eca-f6b8f3f0b878 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:30.129408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb93795-d995-4fba-a9a0-661589cc00e1 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:30.131428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb93795-d995-4fba-a9a0-661589cc00e1 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:30.131733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb93795-d995-4fba-a9a0-661589cc00e1 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:30.131988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb93795-d995-4fba-a9a0-661589cc00e1 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:30.132687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb93795-d995-4fba-a9a0-661589cc00e1 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:30.138665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb93795-d995-4fba-a9a0-661589cc00e1 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:30.201663 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3567/7105] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 10:15:30 2022] POST /identity/v3/roles => generated 239 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:30.210599 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce71fb-3e1e-4a6a-8d0e-bcd3f9fae3ed tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:30.212723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-56ce71fb-3e1e-4a6a-8d0e-bcd3f9fae3ed tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:30.235991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce71fb-3e1e-4a6a-8d0e-bcd3f9fae3ed tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:30.249338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9737049-a6c4-4902-8d44-47529a37d953 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:30.250053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9737049-a6c4-4902-8d44-47529a37d953 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:30.250335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9737049-a6c4-4902-8d44-47529a37d953 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:30.250613 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9737049-a6c4-4902-8d44-47529a37d953 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e251209901fa44e4bd23e19ddb3bc9d4/users/ed97f3f7314b4ac9b387ba8a6d42233c/roles/f878dac55bd347fc84303cc2c633db53/inherited_to_projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:30.258933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9737049-a6c4-4902-8d44-47529a37d953 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e251209901fa44e4bd23e19ddb3bc9d4, user_id=ed97f3f7314b4ac9b387ba8a6d42233c, role_id=f878dac55bd347fc84303cc2c633db53)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:30.261698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9737049-a6c4-4902-8d44-47529a37d953 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:30.302068 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3539/7106] 10.222.0.16 () {60 vars in 1579 bytes} [Fri Sep 30 10:15:30 2022] PUT /identity/v3/OS-INHERIT/domains/e251209901fa44e4bd23e19ddb3bc9d4/users/ed97f3f7314b4ac9b387ba8a6d42233c/roles/f878dac55bd347fc84303cc2c633db53/inherited_to_projects => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:30.306223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb93795-d995-4fba-a9a0-661589cc00e1 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:30.331857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb93795-d995-4fba-a9a0-661589cc00e1 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:30.348521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9737049-a6c4-4902-8d44-47529a37d953 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:30.350952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b9737049-a6c4-4902-8d44-47529a37d953 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:30.550979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b4fc7-659d-4141-801f-0be80be3c3f1 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:30.551670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b4fc7-659d-4141-801f-0be80be3c3f1 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:30.552111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b4fc7-659d-4141-801f-0be80be3c3f1 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:30.552371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b4fc7-659d-4141-801f-0be80be3c3f1 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e251209901fa44e4bd23e19ddb3bc9d4/users/ed97f3f7314b4ac9b387ba8a6d42233c/roles/inherited_to_projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:30.555769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b4fc7-659d-4141-801f-0be80be3c3f1 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=e251209901fa44e4bd23e19ddb3bc9d4, user_id=ed97f3f7314b4ac9b387ba8a6d42233c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:30.557971 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-5c4b4fc7-659d-4141-801f-0be80be3c3f1 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:15:30.557971 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:15:30.557971 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:15:30.559878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b4fc7-659d-4141-801f-0be80be3c3f1 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:30.571287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9737049-a6c4-4902-8d44-47529a37d953 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:30.577575 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:30.590620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31815c-fb65-4069-9475-937715390621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:30.592335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31815c-fb65-4069-9475-937715390621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:30.604406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31815c-fb65-4069-9475-937715390621 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:30.604888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31815c-fb65-4069-9475-937715390621 admin admin] PATH_INFO: `/v3/projects/e36991ce64634e3bb5dce4e755f635dd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:30.614337 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3568/7107] 10.222.0.16 () {58 vars in 1461 bytes} [Fri Sep 30 10:15:30 2022] GET /identity/v3/OS-INHERIT/domains/e251209901fa44e4bd23e19ddb3bc9d4/users/ed97f3f7314b4ac9b387ba8a6d42233c/roles/inherited_to_projects => generated 446 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:15:30.615297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31815c-fb65-4069-9475-937715390621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e36991ce64634e3bb5dce4e755f635dd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:30.617536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31815c-fb65-4069-9475-937715390621 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:30.618529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b4fc7-659d-4141-801f-0be80be3c3f1 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:30.630746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b4fc7-659d-4141-801f-0be80be3c3f1 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:30.635819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0766f6d-1dd3-4f97-9aac-376274e2a25e tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:30.637960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0766f6d-1dd3-4f97-9aac-376274e2a25e tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:30.638510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0766f6d-1dd3-4f97-9aac-376274e2a25e tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:30.638960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0766f6d-1dd3-4f97-9aac-376274e2a25e tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e251209901fa44e4bd23e19ddb3bc9d4/users/ed97f3f7314b4ac9b387ba8a6d42233c/roles/f878dac55bd347fc84303cc2c633db53/inherited_to_projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:30.641453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0766f6d-1dd3-4f97-9aac-376274e2a25e tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=e251209901fa44e4bd23e19ddb3bc9d4, user_id=ed97f3f7314b4ac9b387ba8a6d42233c, role_id=f878dac55bd347fc84303cc2c633db53)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:30.644281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0766f6d-1dd3-4f97-9aac-376274e2a25e tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:30.651672 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3569/7108] 10.222.0.16 () {58 vars in 1561 bytes} [Fri Sep 30 10:15:30 2022] HEAD /identity/v3/OS-INHERIT/domains/e251209901fa44e4bd23e19ddb3bc9d4/users/ed97f3f7314b4ac9b387ba8a6d42233c/roles/f878dac55bd347fc84303cc2c633db53/inherited_to_projects => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:30.656436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0766f6d-1dd3-4f97-9aac-376274e2a25e tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:30.668671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0766f6d-1dd3-4f97-9aac-376274e2a25e tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:30.675487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce75319-3969-4d7c-a82b-ccc538385930 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:30.677917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce75319-3969-4d7c-a82b-ccc538385930 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:30.678393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce75319-3969-4d7c-a82b-ccc538385930 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:30.678876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce75319-3969-4d7c-a82b-ccc538385930 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e251209901fa44e4bd23e19ddb3bc9d4/users/ed97f3f7314b4ac9b387ba8a6d42233c/roles/f878dac55bd347fc84303cc2c633db53/inherited_to_projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:30.681772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce75319-3969-4d7c-a82b-ccc538385930 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e251209901fa44e4bd23e19ddb3bc9d4, user_id=ed97f3f7314b4ac9b387ba8a6d42233c, role_id=f878dac55bd347fc84303cc2c633db53)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:30.683099 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-2ce75319-3969-4d7c-a82b-ccc538385930 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:15:30.683099 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:15:30.683099 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:15:30.686109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce75319-3969-4d7c-a82b-ccc538385930 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:30.693153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2ce75319-3969-4d7c-a82b-ccc538385930 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invalidating the token cache because role f878dac55bd347fc84303cc2c633db53 was removed from user ed97f3f7314b4ac9b387ba8a6d42233c on domain e251209901fa44e4bd23e19ddb3bc9d4. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:30.693711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2ce75319-3969-4d7c-a82b-ccc538385930 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:30.694676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2ce75319-3969-4d7c-a82b-ccc538385930 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:30.732807 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3570/7109] 10.222.0.16 () {58 vars in 1563 bytes} [Fri Sep 30 10:15:30 2022] DELETE /identity/v3/OS-INHERIT/domains/e251209901fa44e4bd23e19ddb3bc9d4/users/ed97f3f7314b4ac9b387ba8a6d42233c/roles/f878dac55bd347fc84303cc2c633db53/inherited_to_projects => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:30.736696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce75319-3969-4d7c-a82b-ccc538385930 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:30.738643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2ce75319-3969-4d7c-a82b-ccc538385930 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:30.744856 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:30.749402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6a31815c-fb65-4069-9475-937715390621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e36991ce64634e3bb5dce4e755f635dd', 'request_id': 'req-6a31815c-fb65-4069-9475-937715390621'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:30.769637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6a31815c-fb65-4069-9475-937715390621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e36991ce64634e3bb5dce4e755f635dd', 'request_id': 'req-6a31815c-fb65-4069-9475-937715390621'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:30.776724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6a31815c-fb65-4069-9475-937715390621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e36991ce64634e3bb5dce4e755f635dd', 'request_id': 'req-6a31815c-fb65-4069-9475-937715390621'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:30.798495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6a31815c-fb65-4069-9475-937715390621 admin admin] The token cache is being invalidate because project e36991ce64634e3bb5dce4e755f635dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:30.798879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6a31815c-fb65-4069-9475-937715390621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:30.800639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6a31815c-fb65-4069-9475-937715390621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:30.806537 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3540/7110] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:15:30 2022] DELETE /identity/v3/projects/e36991ce64634e3bb5dce4e755f635dd => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:30.811073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31815c-fb65-4069-9475-937715390621 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:30.812509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6a31815c-fb65-4069-9475-937715390621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:30.900551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce75319-3969-4d7c-a82b-ccc538385930 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:30.945292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31815c-fb65-4069-9475-937715390621 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:30.950165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cd590-9fca-40fd-8b8d-675d3176e752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:30.950830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cd590-9fca-40fd-8b8d-675d3176e752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:30.951298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cd590-9fca-40fd-8b8d-675d3176e752 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:30.951430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cd590-9fca-40fd-8b8d-675d3176e752 admin admin] PATH_INFO: `/v3/users/13e5206e17e042d08e0a55f32faeab0c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:30.952586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cd590-9fca-40fd-8b8d-675d3176e752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13e5206e17e042d08e0a55f32faeab0c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:30.955651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cd590-9fca-40fd-8b8d-675d3176e752 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:31.036341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c81cd590-9fca-40fd-8b8d-675d3176e752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13e5206e17e042d08e0a55f32faeab0c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:31.051309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c81cd590-9fca-40fd-8b8d-675d3176e752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13e5206e17e042d08e0a55f32faeab0c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:31.052068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c81cd590-9fca-40fd-8b8d-675d3176e752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13e5206e17e042d08e0a55f32faeab0c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:31.065668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626f4ac-b499-4c8a-a477-ec7b0fc26925 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:31.066916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626f4ac-b499-4c8a-a477-ec7b0fc26925 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:31.067204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626f4ac-b499-4c8a-a477-ec7b0fc26925 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:31.067475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626f4ac-b499-4c8a-a477-ec7b0fc26925 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/roles/f878dac55bd347fc84303cc2c633db53` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:31.071995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626f4ac-b499-4c8a-a477-ec7b0fc26925 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f878dac55bd347fc84303cc2c633db53)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:31.073635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626f4ac-b499-4c8a-a477-ec7b0fc26925 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:31.076839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c81cd590-9fca-40fd-8b8d-675d3176e752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13e5206e17e042d08e0a55f32faeab0c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:31.091239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c81cd590-9fca-40fd-8b8d-675d3176e752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13e5206e17e042d08e0a55f32faeab0c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:31.107750 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3541/7111] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:30 2022] DELETE /identity/v3/users/13e5206e17e042d08e0a55f32faeab0c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:31.148941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d626f4ac-b499-4c8a-a477-ec7b0fc26925 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invalidating the token cache because role f878dac55bd347fc84303cc2c633db53 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:31.149242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d626f4ac-b499-4c8a-a477-ec7b0fc26925 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:31.151105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d626f4ac-b499-4c8a-a477-ec7b0fc26925 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:31.154329 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3571/7112] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:30 2022] DELETE /identity/v3/roles/f878dac55bd347fc84303cc2c633db53 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:31.160118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cd590-9fca-40fd-8b8d-675d3176e752 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:31.161861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c81cd590-9fca-40fd-8b8d-675d3176e752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:31.317190 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:31.338068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cd590-9fca-40fd-8b8d-675d3176e752 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:31.477125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa3743-2bc7-476e-87b4-3cccbe1bfb36 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:31.478995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa3743-2bc7-476e-87b4-3cccbe1bfb36 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:31.479275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa3743-2bc7-476e-87b4-3cccbe1bfb36 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:31.479546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa3743-2bc7-476e-87b4-3cccbe1bfb36 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:31.480226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa3743-2bc7-476e-87b4-3cccbe1bfb36 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:31.481944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa3743-2bc7-476e-87b4-3cccbe1bfb36 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:31.524457 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3542/7113] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 10:15:31 2022] POST /identity/v3/roles => generated 239 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:31.533909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626f4ac-b499-4c8a-a477-ec7b0fc26925 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:31.533909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d626f4ac-b499-4c8a-a477-ec7b0fc26925 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:31.558492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626f4ac-b499-4c8a-a477-ec7b0fc26925 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:31.576839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eee229-d52f-4e44-a15a-5b9640d8fd13 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:31.577563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eee229-d52f-4e44-a15a-5b9640d8fd13 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:31.577858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eee229-d52f-4e44-a15a-5b9640d8fd13 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:31.578382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eee229-d52f-4e44-a15a-5b9640d8fd13 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:31.579046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eee229-d52f-4e44-a15a-5b9640d8fd13 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:31.581185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eee229-d52f-4e44-a15a-5b9640d8fd13 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:31.670098 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3572/7114] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:15:31 2022] POST /identity/v3/projects => generated 409 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:31.671294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa3743-2bc7-476e-87b4-3cccbe1bfb36 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:31.706260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eee229-d52f-4e44-a15a-5b9640d8fd13 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:31.712967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b2eee229-d52f-4e44-a15a-5b9640d8fd13 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:31.728422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa3743-2bc7-476e-87b4-3cccbe1bfb36 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:31.742666 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:31.866415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392ea8a-6f85-4b24-be4c-0fc43912bc20 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:31.867091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392ea8a-6f85-4b24-be4c-0fc43912bc20 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:31.867376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392ea8a-6f85-4b24-be4c-0fc43912bc20 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:31.867787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392ea8a-6f85-4b24-be4c-0fc43912bc20 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e251209901fa44e4bd23e19ddb3bc9d4/users/ed97f3f7314b4ac9b387ba8a6d42233c/roles/52bdad0676cb494aa7f7f0d08df88dee/inherited_to_projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:31.871039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eee229-d52f-4e44-a15a-5b9640d8fd13 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:31.871203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392ea8a-6f85-4b24-be4c-0fc43912bc20 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e251209901fa44e4bd23e19ddb3bc9d4, user_id=ed97f3f7314b4ac9b387ba8a6d42233c, role_id=52bdad0676cb494aa7f7f0d08df88dee)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:31.874332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392ea8a-6f85-4b24-be4c-0fc43912bc20 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:31.890671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269864c-e0e3-46d2-b7d2-d8502d7240f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:31.891328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269864c-e0e3-46d2-b7d2-d8502d7240f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:31.891609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269864c-e0e3-46d2-b7d2-d8502d7240f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:31.891883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269864c-e0e3-46d2-b7d2-d8502d7240f1 admin admin] PATH_INFO: `/v3/projects/333d9b44f1114c2caf8aa63f452e12ba` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:31.893078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269864c-e0e3-46d2-b7d2-d8502d7240f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=333d9b44f1114c2caf8aa63f452e12ba)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:31.894991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269864c-e0e3-46d2-b7d2-d8502d7240f1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:31.898261 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3543/7115] 10.222.0.16 () {60 vars in 1579 bytes} [Fri Sep 30 10:15:31 2022] PUT /identity/v3/OS-INHERIT/domains/e251209901fa44e4bd23e19ddb3bc9d4/users/ed97f3f7314b4ac9b387ba8a6d42233c/roles/52bdad0676cb494aa7f7f0d08df88dee/inherited_to_projects => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:31.902323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392ea8a-6f85-4b24-be4c-0fc43912bc20 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:31.989892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4269864c-e0e3-46d2-b7d2-d8502d7240f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '333d9b44f1114c2caf8aa63f452e12ba', 'request_id': 'req-4269864c-e0e3-46d2-b7d2-d8502d7240f1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:32.007871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392ea8a-6f85-4b24-be4c-0fc43912bc20 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:32.012951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4269864c-e0e3-46d2-b7d2-d8502d7240f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '333d9b44f1114c2caf8aa63f452e12ba', 'request_id': 'req-4269864c-e0e3-46d2-b7d2-d8502d7240f1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:32.019481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4269864c-e0e3-46d2-b7d2-d8502d7240f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '333d9b44f1114c2caf8aa63f452e12ba', 'request_id': 'req-4269864c-e0e3-46d2-b7d2-d8502d7240f1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:32.047010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4269864c-e0e3-46d2-b7d2-d8502d7240f1 admin admin] The token cache is being invalidate because project 333d9b44f1114c2caf8aa63f452e12ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:32.047304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4269864c-e0e3-46d2-b7d2-d8502d7240f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:32.047983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4269864c-e0e3-46d2-b7d2-d8502d7240f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:32.049840 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3573/7116] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:15:31 2022] DELETE /identity/v3/projects/333d9b44f1114c2caf8aa63f452e12ba => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:32.055829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf7e3e-af10-42b9-ad13-97dd2e2064be None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:32.056114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf7e3e-af10-42b9-ad13-97dd2e2064be None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:32.056389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf7e3e-af10-42b9-ad13-97dd2e2064be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:32.062037 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:32.104681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5fdf7e3e-af10-42b9-ad13-97dd2e2064be None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:32.105899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5fdf7e3e-af10-42b9-ad13-97dd2e2064be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:32.126086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5312f9-1189-477b-80f1-8080657fb169 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:32.126725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5312f9-1189-477b-80f1-8080657fb169 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:32.127018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5312f9-1189-477b-80f1-8080657fb169 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:32.127302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5312f9-1189-477b-80f1-8080657fb169 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:32.128039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5312f9-1189-477b-80f1-8080657fb169 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Adding query filter params (scope.project.id=3440cb68217e4924abd3cc02b0d85b0a, user.id=ed97f3f7314b4ac9b387ba8a6d42233c) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:15:32.128412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5312f9-1189-477b-80f1-8080657fb169 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:32.129579 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-1e5312f9-1189-477b-80f1-8080657fb169 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:15:32.129579 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:15:32.129579 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:15:32.130716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5312f9-1189-477b-80f1-8080657fb169 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:32.226021 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3574/7117] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:32.226315 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3544/7118] 10.222.0.16 () {58 vars in 1356 bytes} [Fri Sep 30 10:15:31 2022] GET /identity/v3/role_assignments?scope.project.id=3440cb68217e4924abd3cc02b0d85b0a&user.id=ed97f3f7314b4ac9b387ba8a6d42233c&effective => generated 648 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:15:32.227667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c895f-ecfa-4fe2-8605-64857cf62e15 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:32.228019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c895f-ecfa-4fe2-8605-64857cf62e15 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:32.228292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c895f-ecfa-4fe2-8605-64857cf62e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:32.229937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5312f9-1189-477b-80f1-8080657fb169 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:32.233524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1e5312f9-1189-477b-80f1-8080657fb169 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:32.259804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5312f9-1189-477b-80f1-8080657fb169 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:32.268705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0b1c895f-ecfa-4fe2-8605-64857cf62e15 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:32.270381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0b1c895f-ecfa-4fe2-8605-64857cf62e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:32.272545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9268921-15cd-49c8-9b1b-57631f1832e2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:32.273199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9268921-15cd-49c8-9b1b-57631f1832e2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:32.273485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9268921-15cd-49c8-9b1b-57631f1832e2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:32.273759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9268921-15cd-49c8-9b1b-57631f1832e2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:32.274495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9268921-15cd-49c8-9b1b-57631f1832e2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Adding query filter params (scope.project.id=ad7a6c6c0f0143d0a4467ea8d367c8ac, user.id=ed97f3f7314b4ac9b387ba8a6d42233c) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:15:32.274805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9268921-15cd-49c8-9b1b-57631f1832e2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:32.276663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9268921-15cd-49c8-9b1b-57631f1832e2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:32.290242 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3575/7119] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:32.296887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c895f-ecfa-4fe2-8605-64857cf62e15 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:32.325427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c895f-ecfa-4fe2-8605-64857cf62e15 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:32.353242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624e1e2-9ab6-44c9-9713-8cc8150e6349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:32.354240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624e1e2-9ab6-44c9-9713-8cc8150e6349 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:32.359664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624e1e2-9ab6-44c9-9713-8cc8150e6349 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:32.360096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624e1e2-9ab6-44c9-9713-8cc8150e6349 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:32.361662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624e1e2-9ab6-44c9-9713-8cc8150e6349 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:15:32.362157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624e1e2-9ab6-44c9-9713-8cc8150e6349 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:32.366110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624e1e2-9ab6-44c9-9713-8cc8150e6349 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:32.406757 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3576/7120] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:15:32.408671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624e1e2-9ab6-44c9-9713-8cc8150e6349 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:32.437910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624e1e2-9ab6-44c9-9713-8cc8150e6349 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:32.455639 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3545/7121] 10.222.0.16 () {58 vars in 1356 bytes} [Fri Sep 30 10:15:32 2022] GET /identity/v3/role_assignments?scope.project.id=ad7a6c6c0f0143d0a4467ea8d367c8ac&user.id=ed97f3f7314b4ac9b387ba8a6d42233c&effective => generated 648 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:15:32.459415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ca73d-5f4f-4229-ac48-232c969443e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:32.459668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9268921-15cd-49c8-9b1b-57631f1832e2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:32.460147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ca73d-5f4f-4229-ac48-232c969443e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:32.460569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ca73d-5f4f-4229-ac48-232c969443e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:32.460900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ca73d-5f4f-4229-ac48-232c969443e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:32.461686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ca73d-5f4f-4229-ac48-232c969443e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:32.463613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ca73d-5f4f-4229-ac48-232c969443e7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:32.481187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9268921-15cd-49c8-9b1b-57631f1832e2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:32.495011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73785503-36fb-492f-945f-260e073904ff tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:32.495714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73785503-36fb-492f-945f-260e073904ff tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:32.495995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73785503-36fb-492f-945f-260e073904ff tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:32.496268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73785503-36fb-492f-945f-260e073904ff tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e251209901fa44e4bd23e19ddb3bc9d4/users/ed97f3f7314b4ac9b387ba8a6d42233c/roles/52bdad0676cb494aa7f7f0d08df88dee/inherited_to_projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:32.499132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73785503-36fb-492f-945f-260e073904ff tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e251209901fa44e4bd23e19ddb3bc9d4, user_id=ed97f3f7314b4ac9b387ba8a6d42233c, role_id=52bdad0676cb494aa7f7f0d08df88dee)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:32.507746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73785503-36fb-492f-945f-260e073904ff tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:32.518615 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:32.519342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-73785503-36fb-492f-945f-260e073904ff tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invalidating the token cache because role 52bdad0676cb494aa7f7f0d08df88dee was removed from user ed97f3f7314b4ac9b387ba8a6d42233c on domain e251209901fa44e4bd23e19ddb3bc9d4. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:32.519659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-73785503-36fb-492f-945f-260e073904ff tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:32.521117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-73785503-36fb-492f-945f-260e073904ff tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:32.536301 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3577/7122] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:15:32 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:32.537153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ca73d-5f4f-4229-ac48-232c969443e7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:32.541775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9e3ca73d-5f4f-4229-ac48-232c969443e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:32.558225 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3546/7123] 10.222.0.16 () {58 vars in 1563 bytes} [Fri Sep 30 10:15:32 2022] DELETE /identity/v3/OS-INHERIT/domains/e251209901fa44e4bd23e19ddb3bc9d4/users/ed97f3f7314b4ac9b387ba8a6d42233c/roles/52bdad0676cb494aa7f7f0d08df88dee/inherited_to_projects => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:32.558225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73785503-36fb-492f-945f-260e073904ff tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:32.560782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-73785503-36fb-492f-945f-260e073904ff tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:32.690538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ca73d-5f4f-4229-ac48-232c969443e7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:32.693190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73785503-36fb-492f-945f-260e073904ff tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:32.705110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d06a0-39cd-478d-9db9-a64c840326f5 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:32.705786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d06a0-39cd-478d-9db9-a64c840326f5 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:32.706012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d06a0-39cd-478d-9db9-a64c840326f5 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:32.706307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d06a0-39cd-478d-9db9-a64c840326f5 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:32.707015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d06a0-39cd-478d-9db9-a64c840326f5 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Adding query filter params (scope.project.id=3440cb68217e4924abd3cc02b0d85b0a, user.id=ed97f3f7314b4ac9b387ba8a6d42233c) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:15:32.707321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d06a0-39cd-478d-9db9-a64c840326f5 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:32.711217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d06a0-39cd-478d-9db9-a64c840326f5 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:32.769570 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:32.826413 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3547/7124] 10.222.0.16 () {58 vars in 1356 bytes} [Fri Sep 30 10:15:32 2022] GET /identity/v3/role_assignments?scope.project.id=3440cb68217e4924abd3cc02b0d85b0a&user.id=ed97f3f7314b4ac9b387ba8a6d42233c&effective => generated 228 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:15:32.831634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d06a0-39cd-478d-9db9-a64c840326f5 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:32.837724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5f38b-5fec-4181-8acd-ba43e06800dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:32.842205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5f38b-5fec-4181-8acd-ba43e06800dd admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:32.842817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5f38b-5fec-4181-8acd-ba43e06800dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:32.844402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5f38b-5fec-4181-8acd-ba43e06800dd admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:32.848316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5f38b-5fec-4181-8acd-ba43e06800dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:32.856231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5f38b-5fec-4181-8acd-ba43e06800dd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:32.873949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d06a0-39cd-478d-9db9-a64c840326f5 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:32.895100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda6314-40dd-451b-9003-86fe2849a17c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:32.895895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda6314-40dd-451b-9003-86fe2849a17c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:32.896318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda6314-40dd-451b-9003-86fe2849a17c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:32.896646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda6314-40dd-451b-9003-86fe2849a17c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:32.898631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda6314-40dd-451b-9003-86fe2849a17c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Adding query filter params (scope.project.id=ad7a6c6c0f0143d0a4467ea8d367c8ac, user.id=ed97f3f7314b4ac9b387ba8a6d42233c) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:15:32.899207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda6314-40dd-451b-9003-86fe2849a17c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:32.901349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda6314-40dd-451b-9003-86fe2849a17c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:32.907417 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3578/7125] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:15:32 2022] POST /identity/v3/users => generated 284 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:32.911738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5f38b-5fec-4181-8acd-ba43e06800dd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:32.935769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5f38b-5fec-4181-8acd-ba43e06800dd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:32.946625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02602795-b36a-455f-aee1-5357e66e6a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:32.947212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02602795-b36a-455f-aee1-5357e66e6a70 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:32.947499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02602795-b36a-455f-aee1-5357e66e6a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:32.947774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02602795-b36a-455f-aee1-5357e66e6a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:32.948567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02602795-b36a-455f-aee1-5357e66e6a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:32.951555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02602795-b36a-455f-aee1-5357e66e6a70 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:32.966276 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3579/7126] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:32 2022] GET /identity/v3/roles => generated 1650 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:32.974213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02602795-b36a-455f-aee1-5357e66e6a70 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:33.013567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02602795-b36a-455f-aee1-5357e66e6a70 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:33.024220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e291ba-b675-4602-a96b-84d594d1d65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:33.025002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e291ba-b675-4602-a96b-84d594d1d65c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:33.025385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e291ba-b675-4602-a96b-84d594d1d65c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:33.025755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e291ba-b675-4602-a96b-84d594d1d65c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:33.026595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e291ba-b675-4602-a96b-84d594d1d65c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:33.036465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e291ba-b675-4602-a96b-84d594d1d65c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:33.054938 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3580/7127] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:32 2022] GET /identity/v3/roles => generated 1650 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:15:33.056349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e291ba-b675-4602-a96b-84d594d1d65c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:33.069222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e291ba-b675-4602-a96b-84d594d1d65c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:33.074199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429819a7-6f27-4778-a187-e61b6140f411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:33.075545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429819a7-6f27-4778-a187-e61b6140f411 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:33.075797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429819a7-6f27-4778-a187-e61b6140f411 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:33.076034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429819a7-6f27-4778-a187-e61b6140f411 admin admin] PATH_INFO: `/v3/projects/929f2f3cad0d4150acbf764f07e26cd0/users/6467e2597de7485bb777a74774e3b6dc/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:33.092673 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3548/7128] 10.222.0.16 () {58 vars in 1356 bytes} [Fri Sep 30 10:15:32 2022] GET /identity/v3/role_assignments?scope.project.id=ad7a6c6c0f0143d0a4467ea8d367c8ac&user.id=ed97f3f7314b4ac9b387ba8a6d42233c&effective => generated 228 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:15:33.094954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429819a7-6f27-4778-a187-e61b6140f411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=929f2f3cad0d4150acbf764f07e26cd0, user_id=6467e2597de7485bb777a74774e3b6dc, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:33.096519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda6314-40dd-451b-9003-86fe2849a17c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:33.097825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429819a7-6f27-4778-a187-e61b6140f411 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:33.126294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda6314-40dd-451b-9003-86fe2849a17c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:33.136673 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3581/7129] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:15:33 2022] PUT /identity/v3/projects/929f2f3cad0d4150acbf764f07e26cd0/users/6467e2597de7485bb777a74774e3b6dc/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:15:33.147236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f3d30-ff01-4368-975d-3b6aee6986c5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:33.147471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f3d30-ff01-4368-975d-3b6aee6986c5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:33.147689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f3d30-ff01-4368-975d-3b6aee6986c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:33.210268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3c6f3d30-ff01-4368-975d-3b6aee6986c5 None None] MFA Rules not processed for user `6467e2597de7485bb777a74774e3b6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:33.213062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3c6f3d30-ff01-4368-975d-3b6aee6986c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:33.256716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6e144-bf6d-4e08-baba-51a52ee62702 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:33.257371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6e144-bf6d-4e08-baba-51a52ee62702 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:33.257775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6e144-bf6d-4e08-baba-51a52ee62702 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:33.258054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6e144-bf6d-4e08-baba-51a52ee62702 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/projects/ad7a6c6c0f0143d0a4467ea8d367c8ac` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:33.261252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6e144-bf6d-4e08-baba-51a52ee62702 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ad7a6c6c0f0143d0a4467ea8d367c8ac)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:33.263810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6e144-bf6d-4e08-baba-51a52ee62702 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:33.305375 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:33.368205 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3582/7130] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:15:33.368437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45c6e144-bf6d-4e08-baba-51a52ee62702 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad7a6c6c0f0143d0a4467ea8d367c8ac', 'request_id': 'req-45c6e144-bf6d-4e08-baba-51a52ee62702'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:33.383794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45c6e144-bf6d-4e08-baba-51a52ee62702 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad7a6c6c0f0143d0a4467ea8d367c8ac', 'request_id': 'req-45c6e144-bf6d-4e08-baba-51a52ee62702'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:33.385878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f3d30-ff01-4368-975d-3b6aee6986c5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:33.390268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3c6f3d30-ff01-4368-975d-3b6aee6986c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:33.397823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45c6e144-bf6d-4e08-baba-51a52ee62702 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad7a6c6c0f0143d0a4467ea8d367c8ac', 'request_id': 'req-45c6e144-bf6d-4e08-baba-51a52ee62702'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:33.421455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45c6e144-bf6d-4e08-baba-51a52ee62702 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] The token cache is being invalidate because project ad7a6c6c0f0143d0a4467ea8d367c8ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:33.421836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45c6e144-bf6d-4e08-baba-51a52ee62702 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:33.422621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45c6e144-bf6d-4e08-baba-51a52ee62702 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:33.427361 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3549/7131] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:15:33 2022] DELETE /identity/v3/projects/ad7a6c6c0f0143d0a4467ea8d367c8ac => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:33.430734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6e144-bf6d-4e08-baba-51a52ee62702 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:33.433026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-45c6e144-bf6d-4e08-baba-51a52ee62702 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:33.478658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f3d30-ff01-4368-975d-3b6aee6986c5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:33.532731 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:33.551980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb44f8f-a946-4410-9436-b347a6e4f11b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:33.553538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb44f8f-a946-4410-9436-b347a6e4f11b service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:33.554115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb44f8f-a946-4410-9436-b347a6e4f11b service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:33.556203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb44f8f-a946-4410-9436-b347a6e4f11b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:33.583176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fdb44f8f-a946-4410-9436-b347a6e4f11b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:33.633956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6e144-bf6d-4e08-baba-51a52ee62702 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:33.653517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a3480-4a1f-470c-9868-507e37a6ed5b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:33.654178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a3480-4a1f-470c-9868-507e37a6ed5b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:33.654456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a3480-4a1f-470c-9868-507e37a6ed5b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:33.656497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a3480-4a1f-470c-9868-507e37a6ed5b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/roles/52bdad0676cb494aa7f7f0d08df88dee` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:33.659942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a3480-4a1f-470c-9868-507e37a6ed5b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:delete_role(role_id=52bdad0676cb494aa7f7f0d08df88dee)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:33.664221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a3480-4a1f-470c-9868-507e37a6ed5b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:33.734711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb44f8f-a946-4410-9436-b347a6e4f11b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:33.736351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb44f8f-a946-4410-9436-b347a6e4f11b service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:33.748653 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3583/7132] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:15:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:15:33.754738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aa0a3480-4a1f-470c-9868-507e37a6ed5b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invalidating the token cache because role 52bdad0676cb494aa7f7f0d08df88dee has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:33.755202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aa0a3480-4a1f-470c-9868-507e37a6ed5b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:33.756490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aa0a3480-4a1f-470c-9868-507e37a6ed5b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:33.759401 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3550/7133] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:33 2022] DELETE /identity/v3/roles/52bdad0676cb494aa7f7f0d08df88dee => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:15:33.765991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb44f8f-a946-4410-9436-b347a6e4f11b service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:33.780155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb44f8f-a946-4410-9436-b347a6e4f11b service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:33.891296 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:33.915256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec1679-0da0-4711-b269-0798f6866176 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:33.916342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec1679-0da0-4711-b269-0798f6866176 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:33.917033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec1679-0da0-4711-b269-0798f6866176 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:33.917586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec1679-0da0-4711-b269-0798f6866176 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:33.918621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec1679-0da0-4711-b269-0798f6866176 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:33.927087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec1679-0da0-4711-b269-0798f6866176 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:33.968869 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3584/7134] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 10:15:33 2022] POST /identity/v3/roles => generated 240 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:33.972882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a3480-4a1f-470c-9868-507e37a6ed5b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:33.974967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aa0a3480-4a1f-470c-9868-507e37a6ed5b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:34.004145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a3480-4a1f-470c-9868-507e37a6ed5b tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:34.009193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf2de1-f6a5-4369-9656-0966bc9aa8b2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:34.009960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf2de1-f6a5-4369-9656-0966bc9aa8b2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:34.010960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf2de1-f6a5-4369-9656-0966bc9aa8b2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:34.010960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf2de1-f6a5-4369-9656-0966bc9aa8b2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:34.011600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf2de1-f6a5-4369-9656-0966bc9aa8b2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:34.013891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf2de1-f6a5-4369-9656-0966bc9aa8b2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:34.104384 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3551/7135] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:15:33 2022] POST /identity/v3/projects => generated 409 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:34.109287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec1679-0da0-4711-b269-0798f6866176 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:34.129568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec1679-0da0-4711-b269-0798f6866176 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:34.269671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd2988-af30-4006-bcfb-794c5a13ef31 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:34.271012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd2988-af30-4006-bcfb-794c5a13ef31 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:34.271535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd2988-af30-4006-bcfb-794c5a13ef31 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:34.272948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd2988-af30-4006-bcfb-794c5a13ef31 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/3440cb68217e4924abd3cc02b0d85b0a/users/ed97f3f7314b4ac9b387ba8a6d42233c/roles/9e1d68a1bfe84abcb33816080bccebe7/inherited_to_projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:34.275865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd2988-af30-4006-bcfb-794c5a13ef31 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3440cb68217e4924abd3cc02b0d85b0a, user_id=ed97f3f7314b4ac9b387ba8a6d42233c, role_id=9e1d68a1bfe84abcb33816080bccebe7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:34.284044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd2988-af30-4006-bcfb-794c5a13ef31 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:34.311437 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3585/7136] 10.222.0.16 () {60 vars in 1582 bytes} [Fri Sep 30 10:15:34 2022] PUT /identity/v3/OS-INHERIT/projects/3440cb68217e4924abd3cc02b0d85b0a/users/ed97f3f7314b4ac9b387ba8a6d42233c/roles/9e1d68a1bfe84abcb33816080bccebe7/inherited_to_projects => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:34.315707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf2de1-f6a5-4369-9656-0966bc9aa8b2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:34.339831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf2de1-f6a5-4369-9656-0966bc9aa8b2 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:34.495135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6226b9-d5bc-4c68-b5c0-0d55ea2109c8 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:34.495762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6226b9-d5bc-4c68-b5c0-0d55ea2109c8 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:34.496093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6226b9-d5bc-4c68-b5c0-0d55ea2109c8 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:34.496368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6226b9-d5bc-4c68-b5c0-0d55ea2109c8 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:34.497907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6226b9-d5bc-4c68-b5c0-0d55ea2109c8 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Adding query filter params (scope.project.id=e483287f773245f79678c3334f6846b6, user.id=ed97f3f7314b4ac9b387ba8a6d42233c) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:15:34.498341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6226b9-d5bc-4c68-b5c0-0d55ea2109c8 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:34.500216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6226b9-d5bc-4c68-b5c0-0d55ea2109c8 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:34.600136 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3552/7137] 10.222.0.16 () {58 vars in 1356 bytes} [Fri Sep 30 10:15:34 2022] GET /identity/v3/role_assignments?scope.project.id=e483287f773245f79678c3334f6846b6&user.id=ed97f3f7314b4ac9b387ba8a6d42233c&effective => generated 649 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:15:34.602607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd2988-af30-4006-bcfb-794c5a13ef31 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:34.620919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd2988-af30-4006-bcfb-794c5a13ef31 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:34.639377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f156c-1702-4585-958b-d5e6e0230293 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:34.642489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f156c-1702-4585-958b-d5e6e0230293 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:34.642782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f156c-1702-4585-958b-d5e6e0230293 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:34.643057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f156c-1702-4585-958b-d5e6e0230293 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/3440cb68217e4924abd3cc02b0d85b0a/users/ed97f3f7314b4ac9b387ba8a6d42233c/roles/9e1d68a1bfe84abcb33816080bccebe7/inherited_to_projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:34.649092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f156c-1702-4585-958b-d5e6e0230293 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=3440cb68217e4924abd3cc02b0d85b0a, user_id=ed97f3f7314b4ac9b387ba8a6d42233c, role_id=9e1d68a1bfe84abcb33816080bccebe7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:34.671014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f156c-1702-4585-958b-d5e6e0230293 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:34.690457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-406f156c-1702-4585-958b-d5e6e0230293 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invalidating the token cache because role 9e1d68a1bfe84abcb33816080bccebe7 was removed from user ed97f3f7314b4ac9b387ba8a6d42233c on project 3440cb68217e4924abd3cc02b0d85b0a. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:34.693822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-406f156c-1702-4585-958b-d5e6e0230293 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:34.695916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-406f156c-1702-4585-958b-d5e6e0230293 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:34.736326 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3586/7138] 10.222.0.16 () {58 vars in 1566 bytes} [Fri Sep 30 10:15:34 2022] DELETE /identity/v3/OS-INHERIT/projects/3440cb68217e4924abd3cc02b0d85b0a/users/ed97f3f7314b4ac9b387ba8a6d42233c/roles/9e1d68a1bfe84abcb33816080bccebe7/inherited_to_projects => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:34.737652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6226b9-d5bc-4c68-b5c0-0d55ea2109c8 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:34.750244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fd6226b9-d5bc-4c68-b5c0-0d55ea2109c8 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:34.783423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6226b9-d5bc-4c68-b5c0-0d55ea2109c8 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:34.805266 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:34.978606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4cd18-6adc-4dd8-b675-f9ce117b205c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:34.979929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4cd18-6adc-4dd8-b675-f9ce117b205c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:34.979929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4cd18-6adc-4dd8-b675-f9ce117b205c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:34.979929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4cd18-6adc-4dd8-b675-f9ce117b205c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:34.981405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4cd18-6adc-4dd8-b675-f9ce117b205c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Adding query filter params (scope.project.id=e483287f773245f79678c3334f6846b6, user.id=ed97f3f7314b4ac9b387ba8a6d42233c) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:15:34.982858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4cd18-6adc-4dd8-b675-f9ce117b205c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:34.987418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4cd18-6adc-4dd8-b675-f9ce117b205c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:35.133849 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3553/7139] 10.222.0.16 () {58 vars in 1356 bytes} [Fri Sep 30 10:15:34 2022] GET /identity/v3/role_assignments?scope.project.id=e483287f773245f79678c3334f6846b6&user.id=ed97f3f7314b4ac9b387ba8a6d42233c&effective => generated 228 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:15:35.139406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f156c-1702-4585-958b-d5e6e0230293 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:35.155454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f156c-1702-4585-958b-d5e6e0230293 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:35.177965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22d646-b5a3-40ce-ab14-5960fab01eb9 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:35.178813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22d646-b5a3-40ce-ab14-5960fab01eb9 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:35.181423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22d646-b5a3-40ce-ab14-5960fab01eb9 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:35.181866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22d646-b5a3-40ce-ab14-5960fab01eb9 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/projects/e483287f773245f79678c3334f6846b6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:35.185328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22d646-b5a3-40ce-ab14-5960fab01eb9 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e483287f773245f79678c3334f6846b6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:35.187415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22d646-b5a3-40ce-ab14-5960fab01eb9 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:35.333605 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4c22d646-b5a3-40ce-ab14-5960fab01eb9 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e483287f773245f79678c3334f6846b6', 'request_id': 'req-4c22d646-b5a3-40ce-ab14-5960fab01eb9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:35.358169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4c22d646-b5a3-40ce-ab14-5960fab01eb9 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e483287f773245f79678c3334f6846b6', 'request_id': 'req-4c22d646-b5a3-40ce-ab14-5960fab01eb9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:35.372824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4c22d646-b5a3-40ce-ab14-5960fab01eb9 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e483287f773245f79678c3334f6846b6', 'request_id': 'req-4c22d646-b5a3-40ce-ab14-5960fab01eb9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:35.402624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4c22d646-b5a3-40ce-ab14-5960fab01eb9 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] The token cache is being invalidate because project e483287f773245f79678c3334f6846b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:35.403501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4c22d646-b5a3-40ce-ab14-5960fab01eb9 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:35.404278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4c22d646-b5a3-40ce-ab14-5960fab01eb9 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:35.408099 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3587/7140] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:15:35 2022] DELETE /identity/v3/projects/e483287f773245f79678c3334f6846b6 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:35.409873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4cd18-6adc-4dd8-b675-f9ce117b205c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:35.411890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f7b4cd18-6adc-4dd8-b675-f9ce117b205c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:35.437482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4cd18-6adc-4dd8-b675-f9ce117b205c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:35.657673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad836b-9e06-41a7-9b94-79350afb6bd0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:35.659738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad836b-9e06-41a7-9b94-79350afb6bd0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:35.661095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad836b-9e06-41a7-9b94-79350afb6bd0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:35.661577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad836b-9e06-41a7-9b94-79350afb6bd0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/roles/9e1d68a1bfe84abcb33816080bccebe7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:35.666070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad836b-9e06-41a7-9b94-79350afb6bd0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9e1d68a1bfe84abcb33816080bccebe7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:35.672656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad836b-9e06-41a7-9b94-79350afb6bd0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:35.764935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a9ad836b-9e06-41a7-9b94-79350afb6bd0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invalidating the token cache because role 9e1d68a1bfe84abcb33816080bccebe7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:35.768624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a9ad836b-9e06-41a7-9b94-79350afb6bd0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:35.770133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a9ad836b-9e06-41a7-9b94-79350afb6bd0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:35.776542 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3554/7141] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:35 2022] DELETE /identity/v3/roles/9e1d68a1bfe84abcb33816080bccebe7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:35.781920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22d646-b5a3-40ce-ab14-5960fab01eb9 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:35.801397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22d646-b5a3-40ce-ab14-5960fab01eb9 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:35.929033 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:35.967497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8cfdd-2290-4006-9a82-78940f56eb1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:35.968221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8cfdd-2290-4006-9a82-78940f56eb1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:35.968624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8cfdd-2290-4006-9a82-78940f56eb1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:35.968966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8cfdd-2290-4006-9a82-78940f56eb1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/users/ed97f3f7314b4ac9b387ba8a6d42233c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:35.970205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8cfdd-2290-4006-9a82-78940f56eb1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ed97f3f7314b4ac9b387ba8a6d42233c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:35.972253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8cfdd-2290-4006-9a82-78940f56eb1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:36.075285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29e8cfdd-2290-4006-9a82-78940f56eb1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed97f3f7314b4ac9b387ba8a6d42233c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:36.076499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29e8cfdd-2290-4006-9a82-78940f56eb1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed97f3f7314b4ac9b387ba8a6d42233c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:36.104101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29e8cfdd-2290-4006-9a82-78940f56eb1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed97f3f7314b4ac9b387ba8a6d42233c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:36.127557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29e8cfdd-2290-4006-9a82-78940f56eb1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed97f3f7314b4ac9b387ba8a6d42233c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:36.143246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29e8cfdd-2290-4006-9a82-78940f56eb1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed97f3f7314b4ac9b387ba8a6d42233c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:36.154871 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3588/7142] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:35 2022] DELETE /identity/v3/users/ed97f3f7314b4ac9b387ba8a6d42233c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:36.158541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad836b-9e06-41a7-9b94-79350afb6bd0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:36.160023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a9ad836b-9e06-41a7-9b94-79350afb6bd0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:36.190264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad836b-9e06-41a7-9b94-79350afb6bd0 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:36.312090 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:36.367414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc050b-0bf1-45dd-a589-66a58310df61 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:36.368136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc050b-0bf1-45dd-a589-66a58310df61 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:36.368421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc050b-0bf1-45dd-a589-66a58310df61 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:36.368716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc050b-0bf1-45dd-a589-66a58310df61 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/groups/2feb2f35db46430387e35aa56a4cc6a6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:36.380446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc050b-0bf1-45dd-a589-66a58310df61 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2feb2f35db46430387e35aa56a4cc6a6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:36.382432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc050b-0bf1-45dd-a589-66a58310df61 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:36.497883 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3555/7143] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Sep 30 10:15:36 2022] DELETE /identity/v3/groups/2feb2f35db46430387e35aa56a4cc6a6 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:36.501860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8cfdd-2290-4006-9a82-78940f56eb1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:36.503311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-29e8cfdd-2290-4006-9a82-78940f56eb1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:36.527539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8cfdd-2290-4006-9a82-78940f56eb1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:36.665388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef8168-72fc-46af-9b27-71a3aeb4a2b6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:36.666137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef8168-72fc-46af-9b27-71a3aeb4a2b6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:36.666487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef8168-72fc-46af-9b27-71a3aeb4a2b6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:36.666848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef8168-72fc-46af-9b27-71a3aeb4a2b6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/projects/3440cb68217e4924abd3cc02b0d85b0a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:36.668128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef8168-72fc-46af-9b27-71a3aeb4a2b6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3440cb68217e4924abd3cc02b0d85b0a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:36.670538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef8168-72fc-46af-9b27-71a3aeb4a2b6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:36.773356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c6ef8168-72fc-46af-9b27-71a3aeb4a2b6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3440cb68217e4924abd3cc02b0d85b0a', 'request_id': 'req-c6ef8168-72fc-46af-9b27-71a3aeb4a2b6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:36.789001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c6ef8168-72fc-46af-9b27-71a3aeb4a2b6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3440cb68217e4924abd3cc02b0d85b0a', 'request_id': 'req-c6ef8168-72fc-46af-9b27-71a3aeb4a2b6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:36.796091 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:36.797425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c6ef8168-72fc-46af-9b27-71a3aeb4a2b6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3440cb68217e4924abd3cc02b0d85b0a', 'request_id': 'req-c6ef8168-72fc-46af-9b27-71a3aeb4a2b6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:36.819166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c6ef8168-72fc-46af-9b27-71a3aeb4a2b6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] The token cache is being invalidate because project 3440cb68217e4924abd3cc02b0d85b0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:36.819538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c6ef8168-72fc-46af-9b27-71a3aeb4a2b6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:36.821414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c6ef8168-72fc-46af-9b27-71a3aeb4a2b6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:36.829806 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3589/7144] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:15:36 2022] DELETE /identity/v3/projects/3440cb68217e4924abd3cc02b0d85b0a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:36.834957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc050b-0bf1-45dd-a589-66a58310df61 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:36.837158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-46bc050b-0bf1-45dd-a589-66a58310df61 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:36.868762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc050b-0bf1-45dd-a589-66a58310df61 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:37.008870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c17744-b319-44fb-a7ec-8edb6ee50afe tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:37.009539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c17744-b319-44fb-a7ec-8edb6ee50afe tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:37.009818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c17744-b319-44fb-a7ec-8edb6ee50afe tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:37.010096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c17744-b319-44fb-a7ec-8edb6ee50afe tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/domains/e251209901fa44e4bd23e19ddb3bc9d4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:37.012797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c17744-b319-44fb-a7ec-8edb6ee50afe tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e251209901fa44e4bd23e19ddb3bc9d4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:37.014466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c17744-b319-44fb-a7ec-8edb6ee50afe tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:37.060203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-24c17744-b319-44fb-a7ec-8edb6ee50afe tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e251209901fa44e4bd23e19ddb3bc9d4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:37.065635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-24c17744-b319-44fb-a7ec-8edb6ee50afe tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e251209901fa44e4bd23e19ddb3bc9d4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:37.129464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-24c17744-b319-44fb-a7ec-8edb6ee50afe tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e251209901fa44e4bd23e19ddb3bc9d4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:37.130086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-24c17744-b319-44fb-a7ec-8edb6ee50afe tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e251209901fa44e4bd23e19ddb3bc9d4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:37.140724 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3556/7145] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:15:36 2022] PATCH /identity/v3/domains/e251209901fa44e4bd23e19ddb3bc9d4 => generated 277 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:15:37.142828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef8168-72fc-46af-9b27-71a3aeb4a2b6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:37.169234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef8168-72fc-46af-9b27-71a3aeb4a2b6 tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:37.302337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e20be-cf01-4fbf-8186-98aa2cee2f1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5a345a8237c489cace0d9b00eab852d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b90256420c4cedb79b8867ad746d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:37.303390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e20be-cf01-4fbf-8186-98aa2cee2f1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:37.303910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e20be-cf01-4fbf-8186-98aa2cee2f1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:37.304412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e20be-cf01-4fbf-8186-98aa2cee2f1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] PATH_INFO: `/v3/domains/e251209901fa44e4bd23e19ddb3bc9d4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:37.335375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e20be-cf01-4fbf-8186-98aa2cee2f1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e251209901fa44e4bd23e19ddb3bc9d4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:37.339147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e20be-cf01-4fbf-8186-98aa2cee2f1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:37.398433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-146e20be-cf01-4fbf-8186-98aa2cee2f1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e251209901fa44e4bd23e19ddb3bc9d4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:37.408374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-146e20be-cf01-4fbf-8186-98aa2cee2f1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e251209901fa44e4bd23e19ddb3bc9d4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:37.550848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-146e20be-cf01-4fbf-8186-98aa2cee2f1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e251209901fa44e4bd23e19ddb3bc9d4', 'request_id': 'req-146e20be-cf01-4fbf-8186-98aa2cee2f1c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:37.591003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-146e20be-cf01-4fbf-8186-98aa2cee2f1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e251209901fa44e4bd23e19ddb3bc9d4', 'request_id': 'req-146e20be-cf01-4fbf-8186-98aa2cee2f1c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:37.618584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-146e20be-cf01-4fbf-8186-98aa2cee2f1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e251209901fa44e4bd23e19ddb3bc9d4', 'request_id': 'req-146e20be-cf01-4fbf-8186-98aa2cee2f1c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:37.663651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-146e20be-cf01-4fbf-8186-98aa2cee2f1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] The token cache is being invalidate because project e251209901fa44e4bd23e19ddb3bc9d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:37.664139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-146e20be-cf01-4fbf-8186-98aa2cee2f1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:37.665413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-146e20be-cf01-4fbf-8186-98aa2cee2f1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:37.680459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-146e20be-cf01-4fbf-8186-98aa2cee2f1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e251209901fa44e4bd23e19ddb3bc9d4', 'request_id': 'req-146e20be-cf01-4fbf-8186-98aa2cee2f1c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:37.681551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-146e20be-cf01-4fbf-8186-98aa2cee2f1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e251209901fa44e4bd23e19ddb3bc9d4', 'request_id': 'req-146e20be-cf01-4fbf-8186-98aa2cee2f1c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:37.690848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-146e20be-cf01-4fbf-8186-98aa2cee2f1c tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e251209901fa44e4bd23e19ddb3bc9d4', 'request_id': 'req-146e20be-cf01-4fbf-8186-98aa2cee2f1c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:37.701855 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3590/7146] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:15:37 2022] DELETE /identity/v3/domains/e251209901fa44e4bd23e19ddb3bc9d4 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:37.706654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c17744-b319-44fb-a7ec-8edb6ee50afe tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:37.707831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-24c17744-b319-44fb-a7ec-8edb6ee50afe tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:37.823634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c17744-b319-44fb-a7ec-8edb6ee50afe tempest-InheritsV3TestJSON-864786068 tempest-InheritsV3TestJSON-864786068-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:37.828852 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:37.992375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd708088-c910-4e0a-a824-b56dc3fae3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:37.993697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd708088-c910-4e0a-a824-b56dc3fae3e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:37.994194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd708088-c910-4e0a-a824-b56dc3fae3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:37.994651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd708088-c910-4e0a-a824-b56dc3fae3e5 admin admin] PATH_INFO: `/v3/users/3a85945df56d48c7b43334e6f555f2b9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:37.997438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd708088-c910-4e0a-a824-b56dc3fae3e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a85945df56d48c7b43334e6f555f2b9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:37.999576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd708088-c910-4e0a-a824-b56dc3fae3e5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:38.123017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd708088-c910-4e0a-a824-b56dc3fae3e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a85945df56d48c7b43334e6f555f2b9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:38.153911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd708088-c910-4e0a-a824-b56dc3fae3e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a85945df56d48c7b43334e6f555f2b9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:38.155250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd708088-c910-4e0a-a824-b56dc3fae3e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a85945df56d48c7b43334e6f555f2b9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:38.175263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1961c-d43a-431b-81bf-6db8eaf17fc1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:38.176214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1961c-d43a-431b-81bf-6db8eaf17fc1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:38.176740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1961c-d43a-431b-81bf-6db8eaf17fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:38.183647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd708088-c910-4e0a-a824-b56dc3fae3e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a85945df56d48c7b43334e6f555f2b9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:38.207533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1ed1961c-d43a-431b-81bf-6db8eaf17fc1 None None] MFA Rules not processed for user `45a25acf184b4bfc9f1b06dcf0e6d81b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:38.210175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd708088-c910-4e0a-a824-b56dc3fae3e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a85945df56d48c7b43334e6f555f2b9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:38.211438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1ed1961c-d43a-431b-81bf-6db8eaf17fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:38.222419 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3557/7147] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:37 2022] DELETE /identity/v3/users/3a85945df56d48c7b43334e6f555f2b9 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:15:38.226726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7419fc2-d33b-42d5-bdb4-619dce7ed396 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:38.229172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7419fc2-d33b-42d5-bdb4-619dce7ed396 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:38.229466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7419fc2-d33b-42d5-bdb4-619dce7ed396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:38.277050 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:38.326756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b7419fc2-d33b-42d5-bdb4-619dce7ed396 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:38.330342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b7419fc2-d33b-42d5-bdb4-619dce7ed396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:38.351728 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3591/7148] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:38.465529 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3558/7149] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:38.476393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1961c-d43a-431b-81bf-6db8eaf17fc1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:38.478066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1ed1961c-d43a-431b-81bf-6db8eaf17fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:38.570943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1961c-d43a-431b-81bf-6db8eaf17fc1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:38.701422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a6c7f-0316-436f-b26b-34441fc409d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:38.702219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a6c7f-0316-436f-b26b-34441fc409d0 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:38.702563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a6c7f-0316-436f-b26b-34441fc409d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:38.703518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a6c7f-0316-436f-b26b-34441fc409d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:38.726049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a6c7f-0316-436f-b26b-34441fc409d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:38.728010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a6c7f-0316-436f-b26b-34441fc409d0 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:38.753901 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3592/7150] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:15:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:15:39.618775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7419fc2-d33b-42d5-bdb4-619dce7ed396 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:39.620195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b7419fc2-d33b-42d5-bdb4-619dce7ed396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:39.651258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7419fc2-d33b-42d5-bdb4-619dce7ed396 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:39.695743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c29436-36ca-48a7-bfed-8d2565b95a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:39.696403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c29436-36ca-48a7-bfed-8d2565b95a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:39.696704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c29436-36ca-48a7-bfed-8d2565b95a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:39.696984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c29436-36ca-48a7-bfed-8d2565b95a09 admin admin] PATH_INFO: `/v3/projects/9356315a4f8a4cd98b64187633581880` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:39.706058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c29436-36ca-48a7-bfed-8d2565b95a09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9356315a4f8a4cd98b64187633581880)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:39.713195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c29436-36ca-48a7-bfed-8d2565b95a09 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:39.787910 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:39.830629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e6c29436-36ca-48a7-bfed-8d2565b95a09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9356315a4f8a4cd98b64187633581880', 'request_id': 'req-e6c29436-36ca-48a7-bfed-8d2565b95a09'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:39.846851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e6c29436-36ca-48a7-bfed-8d2565b95a09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9356315a4f8a4cd98b64187633581880', 'request_id': 'req-e6c29436-36ca-48a7-bfed-8d2565b95a09'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:39.860514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e6c29436-36ca-48a7-bfed-8d2565b95a09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9356315a4f8a4cd98b64187633581880', 'request_id': 'req-e6c29436-36ca-48a7-bfed-8d2565b95a09'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:39.893913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e6c29436-36ca-48a7-bfed-8d2565b95a09 admin admin] The token cache is being invalidate because project 9356315a4f8a4cd98b64187633581880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:39.896256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e6c29436-36ca-48a7-bfed-8d2565b95a09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:39.897456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e6c29436-36ca-48a7-bfed-8d2565b95a09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:39.905410 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3559/7151] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:15:39 2022] DELETE /identity/v3/projects/9356315a4f8a4cd98b64187633581880 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:39.911361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a6c7f-0316-436f-b26b-34441fc409d0 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:39.934737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a6c7f-0316-436f-b26b-34441fc409d0 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:40.083145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf015e-5a12-45b0-8da0-cd4a3b466ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:40.084283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf015e-5a12-45b0-8da0-cd4a3b466ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:40.084677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf015e-5a12-45b0-8da0-cd4a3b466ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:40.085247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf015e-5a12-45b0-8da0-cd4a3b466ee6 admin admin] PATH_INFO: `/v3/users/e5a345a8237c489cace0d9b00eab852d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:40.087011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf015e-5a12-45b0-8da0-cd4a3b466ee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5a345a8237c489cace0d9b00eab852d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:40.089752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf015e-5a12-45b0-8da0-cd4a3b466ee6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:40.162674 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:40.188156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ddbf015e-5a12-45b0-8da0-cd4a3b466ee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a345a8237c489cace0d9b00eab852d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:40.188958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ddbf015e-5a12-45b0-8da0-cd4a3b466ee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a345a8237c489cace0d9b00eab852d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:40.226169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ddbf015e-5a12-45b0-8da0-cd4a3b466ee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a345a8237c489cace0d9b00eab852d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:40.254228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ddbf015e-5a12-45b0-8da0-cd4a3b466ee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a345a8237c489cace0d9b00eab852d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:40.275077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ddbf015e-5a12-45b0-8da0-cd4a3b466ee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a345a8237c489cace0d9b00eab852d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:40.289659 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3593/7152] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:39 2022] DELETE /identity/v3/users/e5a345a8237c489cace0d9b00eab852d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:40.776131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c29436-36ca-48a7-bfed-8d2565b95a09 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:40.783230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e6c29436-36ca-48a7-bfed-8d2565b95a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:40.810973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c29436-36ca-48a7-bfed-8d2565b95a09 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:40.943918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f8e97-5ef1-447d-aa01-675318e08bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:40.944586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f8e97-5ef1-447d-aa01-675318e08bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:40.944969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f8e97-5ef1-447d-aa01-675318e08bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:40.945183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f8e97-5ef1-447d-aa01-675318e08bc7 admin admin] PATH_INFO: `/v3/projects/c3b90256420c4cedb79b8867ad746d4f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:40.946827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f8e97-5ef1-447d-aa01-675318e08bc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3b90256420c4cedb79b8867ad746d4f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:40.950909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f8e97-5ef1-447d-aa01-675318e08bc7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:41.144321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c39f8e97-5ef1-447d-aa01-675318e08bc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3b90256420c4cedb79b8867ad746d4f', 'request_id': 'req-c39f8e97-5ef1-447d-aa01-675318e08bc7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:41.172532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c39f8e97-5ef1-447d-aa01-675318e08bc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3b90256420c4cedb79b8867ad746d4f', 'request_id': 'req-c39f8e97-5ef1-447d-aa01-675318e08bc7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:41.181429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c39f8e97-5ef1-447d-aa01-675318e08bc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3b90256420c4cedb79b8867ad746d4f', 'request_id': 'req-c39f8e97-5ef1-447d-aa01-675318e08bc7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:41.200406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c39f8e97-5ef1-447d-aa01-675318e08bc7 admin admin] The token cache is being invalidate because project c3b90256420c4cedb79b8867ad746d4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:41.200894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c39f8e97-5ef1-447d-aa01-675318e08bc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:41.211423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c39f8e97-5ef1-447d-aa01-675318e08bc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:41.216518 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3560/7153] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:15:40 2022] DELETE /identity/v3/projects/c3b90256420c4cedb79b8867ad746d4f => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:41.221679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72110f0c-6d5e-4387-9ec1-c71e1fa521b2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:41.222534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72110f0c-6d5e-4387-9ec1-c71e1fa521b2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:41.222983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72110f0c-6d5e-4387-9ec1-c71e1fa521b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:41.273630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-72110f0c-6d5e-4387-9ec1-c71e1fa521b2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:41.278222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-72110f0c-6d5e-4387-9ec1-c71e1fa521b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:41.500163 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3594/7154] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:41.507878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58d087-0c26-45f9-88d5-e85a6e15a0ce None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:41.508118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58d087-0c26-45f9-88d5-e85a6e15a0ce None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:41.508360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58d087-0c26-45f9-88d5-e85a6e15a0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:41.551867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6a58d087-0c26-45f9-88d5-e85a6e15a0ce None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:41.553408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6a58d087-0c26-45f9-88d5-e85a6e15a0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:41.587053 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3561/7155] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:41.591552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72110f0c-6d5e-4387-9ec1-c71e1fa521b2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:41.621490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72110f0c-6d5e-4387-9ec1-c71e1fa521b2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:41.654118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57886137-0a65-46db-9c2d-e3fe3e302304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:41.655312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57886137-0a65-46db-9c2d-e3fe3e302304 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:41.655787 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57886137-0a65-46db-9c2d-e3fe3e302304 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:41.656268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57886137-0a65-46db-9c2d-e3fe3e302304 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:41.657119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57886137-0a65-46db-9c2d-e3fe3e302304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:15:41.657677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57886137-0a65-46db-9c2d-e3fe3e302304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:41.659623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57886137-0a65-46db-9c2d-e3fe3e302304 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:41.676118 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3595/7156] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:15:41.680146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58d087-0c26-45f9-88d5-e85a6e15a0ce None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:41.694830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58d087-0c26-45f9-88d5-e85a6e15a0ce None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:41.707179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba7603-1ba5-4808-8b2d-7151e961eb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:41.707835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba7603-1ba5-4808-8b2d-7151e961eb09 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:41.708106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba7603-1ba5-4808-8b2d-7151e961eb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:41.708377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba7603-1ba5-4808-8b2d-7151e961eb09 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:41.712367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba7603-1ba5-4808-8b2d-7151e961eb09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:41.717642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba7603-1ba5-4808-8b2d-7151e961eb09 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:41.832014 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3562/7157] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:15:41 2022] POST /identity/v3/projects => generated 365 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:41.832775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57886137-0a65-46db-9c2d-e3fe3e302304 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:41.847707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57886137-0a65-46db-9c2d-e3fe3e302304 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:41.988593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958150f9-056b-467e-9c33-f49aa29238f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:41.989077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958150f9-056b-467e-9c33-f49aa29238f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:41.989596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958150f9-056b-467e-9c33-f49aa29238f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:41.989876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958150f9-056b-467e-9c33-f49aa29238f7 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:41.990536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958150f9-056b-467e-9c33-f49aa29238f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:41.992725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958150f9-056b-467e-9c33-f49aa29238f7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:42.043793 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3596/7158] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:15:41 2022] POST /identity/v3/users => generated 283 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:15:42.048388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba7603-1ba5-4808-8b2d-7151e961eb09 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:42.063410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba7603-1ba5-4808-8b2d-7151e961eb09 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:42.074688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45a090-4429-4d76-b968-b022269a8997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:42.076620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45a090-4429-4d76-b968-b022269a8997 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:42.077468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45a090-4429-4d76-b968-b022269a8997 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:42.080786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45a090-4429-4d76-b968-b022269a8997 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:42.080786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45a090-4429-4d76-b968-b022269a8997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:42.086236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45a090-4429-4d76-b968-b022269a8997 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:42.099650 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:42.116114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958150f9-056b-467e-9c33-f49aa29238f7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:42.143553 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3563/7159] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:42.151980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958150f9-056b-467e-9c33-f49aa29238f7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:42.176045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9b980-6453-458e-a24b-0734b9893e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:42.176704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9b980-6453-458e-a24b-0734b9893e12 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:42.176985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9b980-6453-458e-a24b-0734b9893e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:42.177259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9b980-6453-458e-a24b-0734b9893e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:42.177911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9b980-6453-458e-a24b-0734b9893e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:42.197051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9b980-6453-458e-a24b-0734b9893e12 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:42.229205 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3597/7160] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:42.234030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45a090-4429-4d76-b968-b022269a8997 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:42.251995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45a090-4429-4d76-b968-b022269a8997 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:42.263767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7579d7-b542-4163-8e86-241b52af5fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:42.265147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7579d7-b542-4163-8e86-241b52af5fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:42.265590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7579d7-b542-4163-8e86-241b52af5fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:42.266017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7579d7-b542-4163-8e86-241b52af5fb4 admin admin] PATH_INFO: `/v3/projects/7dd5f5c1b20548f0af04aaea0020e8fb/users/135d7563f262422eb23b1964dabfc24a/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:42.288855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7579d7-b542-4163-8e86-241b52af5fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd5f5c1b20548f0af04aaea0020e8fb, user_id=135d7563f262422eb23b1964dabfc24a, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:42.292361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7579d7-b542-4163-8e86-241b52af5fb4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:42.351900 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3564/7161] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:15:42 2022] PUT /identity/v3/projects/7dd5f5c1b20548f0af04aaea0020e8fb/users/135d7563f262422eb23b1964dabfc24a/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:42.364248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cb727-0e5f-4dea-9e4a-2359f9530c81 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:42.364517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cb727-0e5f-4dea-9e4a-2359f9530c81 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:42.365167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cb727-0e5f-4dea-9e4a-2359f9530c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:42.444849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fc4cb727-0e5f-4dea-9e4a-2359f9530c81 None None] MFA Rules not processed for user `135d7563f262422eb23b1964dabfc24a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:42.448132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fc4cb727-0e5f-4dea-9e4a-2359f9530c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:42.461247 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:42.664132 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3598/7162] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:42.665334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7579d7-b542-4163-8e86-241b52af5fb4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:42.878598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7579d7-b542-4163-8e86-241b52af5fb4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:42.897338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148d6d6-cf8d-4b01-bd78-c22a646865dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:42.897985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148d6d6-cf8d-4b01-bd78-c22a646865dc admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:42.898271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148d6d6-cf8d-4b01-bd78-c22a646865dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:42.898558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148d6d6-cf8d-4b01-bd78-c22a646865dc admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:42.899194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148d6d6-cf8d-4b01-bd78-c22a646865dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:42.901227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148d6d6-cf8d-4b01-bd78-c22a646865dc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:42.972998 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3565/7163] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:15:42 2022] POST /identity/v3/projects => generated 367 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:15:42.977032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cb727-0e5f-4dea-9e4a-2359f9530c81 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:42.994575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cb727-0e5f-4dea-9e4a-2359f9530c81 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:43.145041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d846c-6221-4d7c-915c-698b507ac6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:43.160790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d846c-6221-4d7c-915c-698b507ac6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:43.161083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d846c-6221-4d7c-915c-698b507ac6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:43.161366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d846c-6221-4d7c-915c-698b507ac6c4 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:43.162056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d846c-6221-4d7c-915c-698b507ac6c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:43.172286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d846c-6221-4d7c-915c-698b507ac6c4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:43.254765 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3599/7164] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:15:42 2022] POST /identity/v3/users => generated 290 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:43.259478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148d6d6-cf8d-4b01-bd78-c22a646865dc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:43.284033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148d6d6-cf8d-4b01-bd78-c22a646865dc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:43.298300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e432a6-5b65-437d-bf63-1f8ebab2f0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:43.300478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e432a6-5b65-437d-bf63-1f8ebab2f0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:43.300976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e432a6-5b65-437d-bf63-1f8ebab2f0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:43.302107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e432a6-5b65-437d-bf63-1f8ebab2f0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:43.303343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e432a6-5b65-437d-bf63-1f8ebab2f0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:43.315774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e432a6-5b65-437d-bf63-1f8ebab2f0e1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:43.351582 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3566/7165] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:43.356881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d846c-6221-4d7c-915c-698b507ac6c4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:43.374854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d846c-6221-4d7c-915c-698b507ac6c4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:43.399101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ba712-9038-4102-9c8c-b1b9025ab7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:43.400502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ba712-9038-4102-9c8c-b1b9025ab7a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:43.401188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ba712-9038-4102-9c8c-b1b9025ab7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:43.401646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ba712-9038-4102-9c8c-b1b9025ab7a5 admin admin] PATH_INFO: `/v3/projects/c675567a2c4f494b8ebcd4d36dba5f62/users/d61558581288402998d9ff43dc47c8e5/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:43.439235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ba712-9038-4102-9c8c-b1b9025ab7a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c675567a2c4f494b8ebcd4d36dba5f62, user_id=d61558581288402998d9ff43dc47c8e5, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:43.453625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ba712-9038-4102-9c8c-b1b9025ab7a5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:43.492656 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3600/7166] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:15:43 2022] PUT /identity/v3/projects/c675567a2c4f494b8ebcd4d36dba5f62/users/d61558581288402998d9ff43dc47c8e5/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:43.495016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e432a6-5b65-437d-bf63-1f8ebab2f0e1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:43.509778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e432a6-5b65-437d-bf63-1f8ebab2f0e1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:43.645610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c35b70-54b1-471f-a788-fd09bbccacb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:43.646240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c35b70-54b1-471f-a788-fd09bbccacb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:43.646524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c35b70-54b1-471f-a788-fd09bbccacb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:43.646799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c35b70-54b1-471f-a788-fd09bbccacb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:43.647457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c35b70-54b1-471f-a788-fd09bbccacb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:43.651531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c35b70-54b1-471f-a788-fd09bbccacb9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:43.686823 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3567/7167] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:15:43.691835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ba712-9038-4102-9c8c-b1b9025ab7a5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:43.711256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ba712-9038-4102-9c8c-b1b9025ab7a5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:43.728525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aba15-82fb-4ad0-9e08-3ced009c59b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:43.729709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aba15-82fb-4ad0-9e08-3ced009c59b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:43.729994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aba15-82fb-4ad0-9e08-3ced009c59b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:43.730626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aba15-82fb-4ad0-9e08-3ced009c59b4 admin admin] PATH_INFO: `/v3/projects/c675567a2c4f494b8ebcd4d36dba5f62/users/d61558581288402998d9ff43dc47c8e5/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:43.734764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982aba15-82fb-4ad0-9e08-3ced009c59b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c675567a2c4f494b8ebcd4d36dba5f62, user_id=d61558581288402998d9ff43dc47c8e5, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:43.738345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982aba15-82fb-4ad0-9e08-3ced009c59b4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:43.779855 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3601/7168] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:15:43 2022] PUT /identity/v3/projects/c675567a2c4f494b8ebcd4d36dba5f62/users/d61558581288402998d9ff43dc47c8e5/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:43.893200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0650e4a-4c29-4429-9dcc-be4cab7d42a7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:43.893690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0650e4a-4c29-4429-9dcc-be4cab7d42a7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:43.893791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0650e4a-4c29-4429-9dcc-be4cab7d42a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:43.932028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c0650e4a-4c29-4429-9dcc-be4cab7d42a7 None None] MFA Rules not processed for user `d61558581288402998d9ff43dc47c8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:43.933918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c0650e4a-4c29-4429-9dcc-be4cab7d42a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:44.046267 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:44.197422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aba15-82fb-4ad0-9e08-3ced009c59b4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:44.216109 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3568/7169] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:44.222942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aba15-82fb-4ad0-9e08-3ced009c59b4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:44.235405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b319cc7-0273-400c-9831-190567d6707e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61558581288402998d9ff43dc47c8e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c675567a2c4f494b8ebcd4d36dba5f62', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:44.236427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b319cc7-0273-400c-9831-190567d6707e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:44.236968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b319cc7-0273-400c-9831-190567d6707e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:44.237482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b319cc7-0273-400c-9831-190567d6707e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:44.238665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b319cc7-0273-400c-9831-190567d6707e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:44.240512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b319cc7-0273-400c-9831-190567d6707e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:44.289805 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3602/7170] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:15:44 2022] POST /identity/v3/domains => generated 276 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:44.294712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0650e4a-4c29-4429-9dcc-be4cab7d42a7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:44.305802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0650e4a-4c29-4429-9dcc-be4cab7d42a7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:44.458224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5744db-0ab6-4ea4-9939-4d4e3169446c tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61558581288402998d9ff43dc47c8e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c675567a2c4f494b8ebcd4d36dba5f62', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:44.458859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5744db-0ab6-4ea4-9939-4d4e3169446c tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:44.459137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5744db-0ab6-4ea4-9939-4d4e3169446c tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:44.459409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5744db-0ab6-4ea4-9939-4d4e3169446c tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:44.460203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5744db-0ab6-4ea4-9939-4d4e3169446c tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:44.462432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5744db-0ab6-4ea4-9939-4d4e3169446c tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:44.541192 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3569/7171] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:15:44 2022] POST /identity/v3/users => generated 345 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:44.541892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b319cc7-0273-400c-9831-190567d6707e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:44.557522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b319cc7-0273-400c-9831-190567d6707e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:44.575247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40314c-414a-450d-b1d2-639b94060c47 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61558581288402998d9ff43dc47c8e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c675567a2c4f494b8ebcd4d36dba5f62', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:44.581739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40314c-414a-450d-b1d2-639b94060c47 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:44.582550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40314c-414a-450d-b1d2-639b94060c47 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:44.585588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40314c-414a-450d-b1d2-639b94060c47 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:44.586078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40314c-414a-450d-b1d2-639b94060c47 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:44.603409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40314c-414a-450d-b1d2-639b94060c47 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:44.603633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5744db-0ab6-4ea4-9939-4d4e3169446c tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:44.606383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ef5744db-0ab6-4ea4-9939-4d4e3169446c tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:44.687003 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3603/7172] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:15:44 2022] POST /identity/v3/users => generated 321 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:15:44.692147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40314c-414a-450d-b1d2-639b94060c47 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:44.709066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40314c-414a-450d-b1d2-639b94060c47 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:44.724681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0742ddc-d42e-4a20-83fb-3ec5ece6100c tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61558581288402998d9ff43dc47c8e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c675567a2c4f494b8ebcd4d36dba5f62', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:44.725638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0742ddc-d42e-4a20-83fb-3ec5ece6100c tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:44.726125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0742ddc-d42e-4a20-83fb-3ec5ece6100c tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:44.726552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0742ddc-d42e-4a20-83fb-3ec5ece6100c tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] PATH_INFO: `/v3/users/30bc96d46511400d9d44de79ba699e76` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:44.741396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5744db-0ab6-4ea4-9939-4d4e3169446c tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:44.749100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11565768-0d12-4039-b716-74137fd16165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:44.749947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11565768-0d12-4039-b716-74137fd16165 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:44.750344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11565768-0d12-4039-b716-74137fd16165 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:44.750704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11565768-0d12-4039-b716-74137fd16165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:44.757887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-11565768-0d12-4039-b716-74137fd16165 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:44.764815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0742ddc-d42e-4a20-83fb-3ec5ece6100c tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorizing `identity:get_user(user_id=30bc96d46511400d9d44de79ba699e76)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:44.767303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0742ddc-d42e-4a20-83fb-3ec5ece6100c tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:44.772297 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3604/7173] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Sep 30 10:15:44 2022] GET /identity/v3/users/30bc96d46511400d9d44de79ba699e76 => generated 345 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:15:44.777866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0742ddc-d42e-4a20-83fb-3ec5ece6100c tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:44.814776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0742ddc-d42e-4a20-83fb-3ec5ece6100c tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:44.831109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8f8e2-48b9-4d2f-8bc8-75b097942dd8 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61558581288402998d9ff43dc47c8e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c675567a2c4f494b8ebcd4d36dba5f62', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:44.831957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8f8e2-48b9-4d2f-8bc8-75b097942dd8 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:44.832457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8f8e2-48b9-4d2f-8bc8-75b097942dd8 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:44.832918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8f8e2-48b9-4d2f-8bc8-75b097942dd8 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:44.835202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8f8e2-48b9-4d2f-8bc8-75b097942dd8 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Adding query filter params (domain_id=dfdab8a1cdc14ca88e62a73e620a674d) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:15:44.837958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8f8e2-48b9-4d2f-8bc8-75b097942dd8 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:44.842422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8f8e2-48b9-4d2f-8bc8-75b097942dd8 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:44.877543 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3605/7174] 10.222.0.16 () {58 vars in 1207 bytes} [Fri Sep 30 10:15:44 2022] GET /identity/v3/users?domain_id=dfdab8a1cdc14ca88e62a73e620a674d => generated 482 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:15:44.878682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8f8e2-48b9-4d2f-8bc8-75b097942dd8 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:44.883958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-35e8f8e2-48b9-4d2f-8bc8-75b097942dd8 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:44.902472 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:44.981526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11565768-0d12-4039-b716-74137fd16165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:44.983608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11565768-0d12-4039-b716-74137fd16165 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:45.031178 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:45.045046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8f8e2-48b9-4d2f-8bc8-75b097942dd8 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:45.053728 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3570/7175] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:15:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:15:45.054902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11565768-0d12-4039-b716-74137fd16165 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:45.069361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34edd92-3a8f-4ee4-a238-31425a59dce0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:45.072469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34edd92-3a8f-4ee4-a238-31425a59dce0 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:45.077811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11565768-0d12-4039-b716-74137fd16165 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:45.079470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34edd92-3a8f-4ee4-a238-31425a59dce0 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:45.079809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34edd92-3a8f-4ee4-a238-31425a59dce0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:45.088279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f34edd92-3a8f-4ee4-a238-31425a59dce0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:45.090632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a192c0-8334-42a8-9c02-5a5247dd9f75 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61558581288402998d9ff43dc47c8e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c675567a2c4f494b8ebcd4d36dba5f62', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:45.091269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a192c0-8334-42a8-9c02-5a5247dd9f75 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:45.099407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a192c0-8334-42a8-9c02-5a5247dd9f75 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:45.099760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a192c0-8334-42a8-9c02-5a5247dd9f75 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:45.100463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a192c0-8334-42a8-9c02-5a5247dd9f75 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:45.102986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a192c0-8334-42a8-9c02-5a5247dd9f75 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:45.135056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34edd92-3a8f-4ee4-a238-31425a59dce0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:45.141227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34edd92-3a8f-4ee4-a238-31425a59dce0 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:45.172440 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3571/7176] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:45 2022] GET /identity/v3/users => generated 8284 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:45.173404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a192c0-8334-42a8-9c02-5a5247dd9f75 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:45.188744 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3606/7177] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:15:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:15:45.194899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a192c0-8334-42a8-9c02-5a5247dd9f75 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:45.207378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d3c11-bc52-4949-ac50-af834b96016f tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61558581288402998d9ff43dc47c8e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c675567a2c4f494b8ebcd4d36dba5f62', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:45.208006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d3c11-bc52-4949-ac50-af834b96016f tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:45.208284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d3c11-bc52-4949-ac50-af834b96016f tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:45.208555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d3c11-bc52-4949-ac50-af834b96016f tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:45.209307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d3c11-bc52-4949-ac50-af834b96016f tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Adding query filter params (name=tempest-test_user-302860711) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:15:45.209607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d3c11-bc52-4949-ac50-af834b96016f tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:45.211422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d3c11-bc52-4949-ac50-af834b96016f tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:45.369881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34edd92-3a8f-4ee4-a238-31425a59dce0 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:45.370924 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3572/7178] 10.222.0.16 () {58 vars in 1187 bytes} [Fri Sep 30 10:15:45 2022] GET /identity/v3/users?name=tempest-test_user-302860711 => generated 472 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:15:45.390834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34edd92-3a8f-4ee4-a238-31425a59dce0 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:45.410453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c7eb1-abcb-488f-b3e8-bef7e4ea81de tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61558581288402998d9ff43dc47c8e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c675567a2c4f494b8ebcd4d36dba5f62', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:45.411160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c7eb1-abcb-488f-b3e8-bef7e4ea81de tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:45.411439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c7eb1-abcb-488f-b3e8-bef7e4ea81de tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:45.411713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c7eb1-abcb-488f-b3e8-bef7e4ea81de tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:45.412452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c7eb1-abcb-488f-b3e8-bef7e4ea81de tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:15:45.412790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c7eb1-abcb-488f-b3e8-bef7e4ea81de tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:45.414685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c7eb1-abcb-488f-b3e8-bef7e4ea81de tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:45.508399 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3607/7179] 10.222.0.16 () {58 vars in 1149 bytes} [Fri Sep 30 10:15:45 2022] GET /identity/v3/users?enabled=False => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:15:45.517196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d3c11-bc52-4949-ac50-af834b96016f tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:45.547295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d3c11-bc52-4949-ac50-af834b96016f tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:45.594210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a3d47-a461-467e-aa8f-d6cc5f5ff22e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61558581288402998d9ff43dc47c8e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c675567a2c4f494b8ebcd4d36dba5f62', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:45.595437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a3d47-a461-467e-aa8f-d6cc5f5ff22e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:45.595437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a3d47-a461-467e-aa8f-d6cc5f5ff22e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:45.595437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a3d47-a461-467e-aa8f-d6cc5f5ff22e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] PATH_INFO: `/v3/users/67b2b9614729460dbc4599879572a7b7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:45.659441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a3d47-a461-467e-aa8f-d6cc5f5ff22e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorizing `identity:delete_user(user_id=67b2b9614729460dbc4599879572a7b7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:45.661358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a3d47-a461-467e-aa8f-d6cc5f5ff22e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:45.768525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7c7a3d47-a461-467e-aa8f-d6cc5f5ff22e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67b2b9614729460dbc4599879572a7b7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:45.794273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7c7a3d47-a461-467e-aa8f-d6cc5f5ff22e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67b2b9614729460dbc4599879572a7b7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:45.797100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7c7a3d47-a461-467e-aa8f-d6cc5f5ff22e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67b2b9614729460dbc4599879572a7b7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:45.837819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7c7a3d47-a461-467e-aa8f-d6cc5f5ff22e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67b2b9614729460dbc4599879572a7b7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:45.854691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7c7a3d47-a461-467e-aa8f-d6cc5f5ff22e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67b2b9614729460dbc4599879572a7b7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:45.869624 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3573/7180] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:45 2022] DELETE /identity/v3/users/67b2b9614729460dbc4599879572a7b7 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:45.873957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c7eb1-abcb-488f-b3e8-bef7e4ea81de tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:45.875770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-135c7eb1-abcb-488f-b3e8-bef7e4ea81de tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:45.908523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c7eb1-abcb-488f-b3e8-bef7e4ea81de tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:46.046638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a074c3d-3cdc-4138-ab69-e07e259e0921 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61558581288402998d9ff43dc47c8e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c675567a2c4f494b8ebcd4d36dba5f62', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:46.046638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a074c3d-3cdc-4138-ab69-e07e259e0921 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:46.046638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a074c3d-3cdc-4138-ab69-e07e259e0921 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:46.047097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a074c3d-3cdc-4138-ab69-e07e259e0921 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] PATH_INFO: `/v3/users/30bc96d46511400d9d44de79ba699e76` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:46.050814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a074c3d-3cdc-4138-ab69-e07e259e0921 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorizing `identity:delete_user(user_id=30bc96d46511400d9d44de79ba699e76)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:46.056679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a074c3d-3cdc-4138-ab69-e07e259e0921 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:46.156407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a074c3d-3cdc-4138-ab69-e07e259e0921 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30bc96d46511400d9d44de79ba699e76'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:46.158887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a074c3d-3cdc-4138-ab69-e07e259e0921 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30bc96d46511400d9d44de79ba699e76'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:46.181798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a074c3d-3cdc-4138-ab69-e07e259e0921 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30bc96d46511400d9d44de79ba699e76'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:46.202923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a074c3d-3cdc-4138-ab69-e07e259e0921 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30bc96d46511400d9d44de79ba699e76'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:46.222208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a074c3d-3cdc-4138-ab69-e07e259e0921 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30bc96d46511400d9d44de79ba699e76'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:46.225350 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:46.236287 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3608/7181] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:45 2022] DELETE /identity/v3/users/30bc96d46511400d9d44de79ba699e76 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:46.243537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a3d47-a461-467e-aa8f-d6cc5f5ff22e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:46.272061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a3d47-a461-467e-aa8f-d6cc5f5ff22e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:46.390374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a889a27-31bf-428c-b0eb-6409e6ede7c7 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61558581288402998d9ff43dc47c8e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c675567a2c4f494b8ebcd4d36dba5f62', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:46.391516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a889a27-31bf-428c-b0eb-6409e6ede7c7 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:46.392118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a889a27-31bf-428c-b0eb-6409e6ede7c7 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:46.392593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a889a27-31bf-428c-b0eb-6409e6ede7c7 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] PATH_INFO: `/v3/domains/dfdab8a1cdc14ca88e62a73e620a674d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:46.394209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a889a27-31bf-428c-b0eb-6409e6ede7c7 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=dfdab8a1cdc14ca88e62a73e620a674d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:46.396008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a889a27-31bf-428c-b0eb-6409e6ede7c7 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:46.435277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3a889a27-31bf-428c-b0eb-6409e6ede7c7 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'dfdab8a1cdc14ca88e62a73e620a674d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:46.436346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3a889a27-31bf-428c-b0eb-6409e6ede7c7 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'dfdab8a1cdc14ca88e62a73e620a674d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:46.474540 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:46.508048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3a889a27-31bf-428c-b0eb-6409e6ede7c7 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'dfdab8a1cdc14ca88e62a73e620a674d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:46.509071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3a889a27-31bf-428c-b0eb-6409e6ede7c7 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'dfdab8a1cdc14ca88e62a73e620a674d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:46.518490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a074c3d-3cdc-4138-ab69-e07e259e0921 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:46.519563 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3574/7182] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:15:46 2022] PATCH /identity/v3/domains/dfdab8a1cdc14ca88e62a73e620a674d => generated 277 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:15:46.520661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3a074c3d-3cdc-4138-ab69-e07e259e0921 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:46.546358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a074c3d-3cdc-4138-ab69-e07e259e0921 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:46.670913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc1663-657a-4018-b451-b96531115a0e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd61558581288402998d9ff43dc47c8e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c675567a2c4f494b8ebcd4d36dba5f62', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:46.671570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc1663-657a-4018-b451-b96531115a0e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:46.671849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc1663-657a-4018-b451-b96531115a0e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:46.672119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc1663-657a-4018-b451-b96531115a0e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] PATH_INFO: `/v3/domains/dfdab8a1cdc14ca88e62a73e620a674d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:46.715675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc1663-657a-4018-b451-b96531115a0e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=dfdab8a1cdc14ca88e62a73e620a674d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:46.717488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc1663-657a-4018-b451-b96531115a0e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:46.776917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-66bc1663-657a-4018-b451-b96531115a0e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'dfdab8a1cdc14ca88e62a73e620a674d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:46.782966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-66bc1663-657a-4018-b451-b96531115a0e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'dfdab8a1cdc14ca88e62a73e620a674d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:46.956571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-66bc1663-657a-4018-b451-b96531115a0e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfdab8a1cdc14ca88e62a73e620a674d', 'request_id': 'req-66bc1663-657a-4018-b451-b96531115a0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:46.974889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-66bc1663-657a-4018-b451-b96531115a0e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfdab8a1cdc14ca88e62a73e620a674d', 'request_id': 'req-66bc1663-657a-4018-b451-b96531115a0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:46.999526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-66bc1663-657a-4018-b451-b96531115a0e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfdab8a1cdc14ca88e62a73e620a674d', 'request_id': 'req-66bc1663-657a-4018-b451-b96531115a0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:47.037837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-66bc1663-657a-4018-b451-b96531115a0e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] The token cache is being invalidate because project dfdab8a1cdc14ca88e62a73e620a674d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:47.038172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-66bc1663-657a-4018-b451-b96531115a0e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:47.046496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-66bc1663-657a-4018-b451-b96531115a0e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:47.067343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-66bc1663-657a-4018-b451-b96531115a0e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'dfdab8a1cdc14ca88e62a73e620a674d', 'request_id': 'req-66bc1663-657a-4018-b451-b96531115a0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:47.068649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-66bc1663-657a-4018-b451-b96531115a0e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'dfdab8a1cdc14ca88e62a73e620a674d', 'request_id': 'req-66bc1663-657a-4018-b451-b96531115a0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:47.075287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-66bc1663-657a-4018-b451-b96531115a0e tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'dfdab8a1cdc14ca88e62a73e620a674d', 'request_id': 'req-66bc1663-657a-4018-b451-b96531115a0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:47.089038 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3609/7183] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:15:46 2022] DELETE /identity/v3/domains/dfdab8a1cdc14ca88e62a73e620a674d => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:15:47.094215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a889a27-31bf-428c-b0eb-6409e6ede7c7 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:47.095659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3a889a27-31bf-428c-b0eb-6409e6ede7c7 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:47.294179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a889a27-31bf-428c-b0eb-6409e6ede7c7 tempest-UsersV3TestJSON-1783138877 tempest-UsersV3TestJSON-1783138877-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:47.487296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30f626-5af4-496f-908c-96777075bdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:47.488017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30f626-5af4-496f-908c-96777075bdb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:47.488299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30f626-5af4-496f-908c-96777075bdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:47.488571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30f626-5af4-496f-908c-96777075bdb4 admin admin] PATH_INFO: `/v3/users/135d7563f262422eb23b1964dabfc24a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:47.491872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30f626-5af4-496f-908c-96777075bdb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=135d7563f262422eb23b1964dabfc24a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:47.494283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30f626-5af4-496f-908c-96777075bdb4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:47.621217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6d30f626-5af4-496f-908c-96777075bdb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '135d7563f262422eb23b1964dabfc24a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:47.645512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6d30f626-5af4-496f-908c-96777075bdb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '135d7563f262422eb23b1964dabfc24a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:47.646648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6d30f626-5af4-496f-908c-96777075bdb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '135d7563f262422eb23b1964dabfc24a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:47.683716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6d30f626-5af4-496f-908c-96777075bdb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '135d7563f262422eb23b1964dabfc24a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:47.708639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6d30f626-5af4-496f-908c-96777075bdb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '135d7563f262422eb23b1964dabfc24a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:47.730189 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3575/7184] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:47 2022] DELETE /identity/v3/users/135d7563f262422eb23b1964dabfc24a => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:47.731156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25307c6e-938f-44e1-881b-dcde3eaf21ac None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:47.731701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25307c6e-938f-44e1-881b-dcde3eaf21ac None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:47.731806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25307c6e-938f-44e1-881b-dcde3eaf21ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:47.797861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-25307c6e-938f-44e1-881b-dcde3eaf21ac None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:47.799071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-25307c6e-938f-44e1-881b-dcde3eaf21ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:47.890271 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:47.984978 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3610/7185] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:48.037824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30f626-5af4-496f-908c-96777075bdb4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:48.039349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6d30f626-5af4-496f-908c-96777075bdb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:48.160999 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:48.238337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30f626-5af4-496f-908c-96777075bdb4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:48.247850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e483f-3e04-4001-8225-f961566f5284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:48.249857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e483f-3e04-4001-8225-f961566f5284 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:48.251537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e483f-3e04-4001-8225-f961566f5284 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:48.254232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e483f-3e04-4001-8225-f961566f5284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:48.285425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e483f-3e04-4001-8225-f961566f5284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:48.294589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e483f-3e04-4001-8225-f961566f5284 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:48.323072 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3576/7186] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:15:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:15:49.724002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25307c6e-938f-44e1-881b-dcde3eaf21ac None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:49.725522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-25307c6e-938f-44e1-881b-dcde3eaf21ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:49.739855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25307c6e-938f-44e1-881b-dcde3eaf21ac None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:49.747114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d0848-705e-4893-b193-c49f2f98ad3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:49.748592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d0848-705e-4893-b193-c49f2f98ad3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:49.749136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d0848-705e-4893-b193-c49f2f98ad3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:49.749800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d0848-705e-4893-b193-c49f2f98ad3b admin admin] PATH_INFO: `/v3/projects/7dd5f5c1b20548f0af04aaea0020e8fb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:49.751292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d0848-705e-4893-b193-c49f2f98ad3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dd5f5c1b20548f0af04aaea0020e8fb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:49.753749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d0848-705e-4893-b193-c49f2f98ad3b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:49.821220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-339d0848-705e-4893-b193-c49f2f98ad3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dd5f5c1b20548f0af04aaea0020e8fb', 'request_id': 'req-339d0848-705e-4893-b193-c49f2f98ad3b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:49.844696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-339d0848-705e-4893-b193-c49f2f98ad3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dd5f5c1b20548f0af04aaea0020e8fb', 'request_id': 'req-339d0848-705e-4893-b193-c49f2f98ad3b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:49.854199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-339d0848-705e-4893-b193-c49f2f98ad3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dd5f5c1b20548f0af04aaea0020e8fb', 'request_id': 'req-339d0848-705e-4893-b193-c49f2f98ad3b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:49.885378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-339d0848-705e-4893-b193-c49f2f98ad3b admin admin] The token cache is being invalidate because project 7dd5f5c1b20548f0af04aaea0020e8fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:49.886261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-339d0848-705e-4893-b193-c49f2f98ad3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:49.889082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-339d0848-705e-4893-b193-c49f2f98ad3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:49.894232 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3611/7187] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:15:49 2022] DELETE /identity/v3/projects/7dd5f5c1b20548f0af04aaea0020e8fb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:49.909223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e483f-3e04-4001-8225-f961566f5284 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:49.927375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e483f-3e04-4001-8225-f961566f5284 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:50.083282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e873217-fc45-4ef4-93de-bf395d0bb6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:50.083967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e873217-fc45-4ef4-93de-bf395d0bb6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:50.084245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e873217-fc45-4ef4-93de-bf395d0bb6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:50.086492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e873217-fc45-4ef4-93de-bf395d0bb6cc admin admin] PATH_INFO: `/v3/users/d61558581288402998d9ff43dc47c8e5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:50.092258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e873217-fc45-4ef4-93de-bf395d0bb6cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d61558581288402998d9ff43dc47c8e5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:50.094979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e873217-fc45-4ef4-93de-bf395d0bb6cc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:50.210860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4e873217-fc45-4ef4-93de-bf395d0bb6cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd61558581288402998d9ff43dc47c8e5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:50.223939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4e873217-fc45-4ef4-93de-bf395d0bb6cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd61558581288402998d9ff43dc47c8e5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:50.226970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4e873217-fc45-4ef4-93de-bf395d0bb6cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd61558581288402998d9ff43dc47c8e5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:50.258275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4e873217-fc45-4ef4-93de-bf395d0bb6cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd61558581288402998d9ff43dc47c8e5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:50.275477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4e873217-fc45-4ef4-93de-bf395d0bb6cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd61558581288402998d9ff43dc47c8e5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:50.284030 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3577/7188] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:49 2022] DELETE /identity/v3/users/d61558581288402998d9ff43dc47c8e5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:50.718713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d0848-705e-4893-b193-c49f2f98ad3b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:50.720185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-339d0848-705e-4893-b193-c49f2f98ad3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:50.748860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d0848-705e-4893-b193-c49f2f98ad3b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:50.833029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba3548-29a1-4f29-b81c-3c0811a675f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:50.833654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba3548-29a1-4f29-b81c-3c0811a675f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:50.833929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba3548-29a1-4f29-b81c-3c0811a675f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:50.834201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba3548-29a1-4f29-b81c-3c0811a675f9 admin admin] PATH_INFO: `/v3/projects/c675567a2c4f494b8ebcd4d36dba5f62` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:50.835383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba3548-29a1-4f29-b81c-3c0811a675f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c675567a2c4f494b8ebcd4d36dba5f62)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:50.837349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba3548-29a1-4f29-b81c-3c0811a675f9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:50.992532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-89ba3548-29a1-4f29-b81c-3c0811a675f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c675567a2c4f494b8ebcd4d36dba5f62', 'request_id': 'req-89ba3548-29a1-4f29-b81c-3c0811a675f9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:51.060559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-89ba3548-29a1-4f29-b81c-3c0811a675f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c675567a2c4f494b8ebcd4d36dba5f62', 'request_id': 'req-89ba3548-29a1-4f29-b81c-3c0811a675f9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:51.103359 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:51.111946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-89ba3548-29a1-4f29-b81c-3c0811a675f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c675567a2c4f494b8ebcd4d36dba5f62', 'request_id': 'req-89ba3548-29a1-4f29-b81c-3c0811a675f9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:51.159657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-89ba3548-29a1-4f29-b81c-3c0811a675f9 admin admin] The token cache is being invalidate because project c675567a2c4f494b8ebcd4d36dba5f62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:51.160247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-89ba3548-29a1-4f29-b81c-3c0811a675f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:51.169268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-89ba3548-29a1-4f29-b81c-3c0811a675f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:51.171595 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3612/7189] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:15:50 2022] DELETE /identity/v3/projects/c675567a2c4f494b8ebcd4d36dba5f62 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:51.176435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43140ccb-4c49-4a30-a830-78556a30c0d3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:51.176956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43140ccb-4c49-4a30-a830-78556a30c0d3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:51.177317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43140ccb-4c49-4a30-a830-78556a30c0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:51.239324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-43140ccb-4c49-4a30-a830-78556a30c0d3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:51.243191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-43140ccb-4c49-4a30-a830-78556a30c0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:51.389852 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:51.433582 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3578/7190] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:51.441846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbdb8b-d936-495c-ae45-3da6b64fe176 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:51.442169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbdb8b-d936-495c-ae45-3da6b64fe176 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:51.442398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbdb8b-d936-495c-ae45-3da6b64fe176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:51.492818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-68dbdb8b-d936-495c-ae45-3da6b64fe176 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:51.493962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-68dbdb8b-d936-495c-ae45-3da6b64fe176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:51.524522 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3613/7191] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:51.528908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43140ccb-4c49-4a30-a830-78556a30c0d3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:51.545680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43140ccb-4c49-4a30-a830-78556a30c0d3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:51.569732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792578c8-2380-49df-bd0d-a268ada3f833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:51.574530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792578c8-2380-49df-bd0d-a268ada3f833 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:51.574938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792578c8-2380-49df-bd0d-a268ada3f833 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:51.575223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792578c8-2380-49df-bd0d-a268ada3f833 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:51.575988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792578c8-2380-49df-bd0d-a268ada3f833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:15:51.576298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792578c8-2380-49df-bd0d-a268ada3f833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:51.583474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792578c8-2380-49df-bd0d-a268ada3f833 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:51.622408 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3579/7192] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:15:51.626668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbdb8b-d936-495c-ae45-3da6b64fe176 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:51.638272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbdb8b-d936-495c-ae45-3da6b64fe176 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:51.657161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad673c-0277-47ac-8a1c-6bd8dab3c9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:51.658158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad673c-0277-47ac-8a1c-6bd8dab3c9db admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:51.659766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad673c-0277-47ac-8a1c-6bd8dab3c9db admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:51.660224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad673c-0277-47ac-8a1c-6bd8dab3c9db admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:51.661361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad673c-0277-47ac-8a1c-6bd8dab3c9db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:51.664915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad673c-0277-47ac-8a1c-6bd8dab3c9db admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:51.745756 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3614/7193] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:15:51 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:51.749045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792578c8-2380-49df-bd0d-a268ada3f833 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:51.785629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792578c8-2380-49df-bd0d-a268ada3f833 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:51.950493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3411f-e468-4ece-a372-4bc5f8891c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:51.952429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3411f-e468-4ece-a372-4bc5f8891c07 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:51.952910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3411f-e468-4ece-a372-4bc5f8891c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:51.959460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3411f-e468-4ece-a372-4bc5f8891c07 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:51.960672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3411f-e468-4ece-a372-4bc5f8891c07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:51.963033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3411f-e468-4ece-a372-4bc5f8891c07 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:52.013345 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3580/7194] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:15:51 2022] POST /identity/v3/users => generated 292 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:52.014972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad673c-0277-47ac-8a1c-6bd8dab3c9db admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:52.047434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad673c-0277-47ac-8a1c-6bd8dab3c9db admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:52.071170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc9b53-a3d8-475d-88d3-6e32e095a997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:52.072177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc9b53-a3d8-475d-88d3-6e32e095a997 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:52.076125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc9b53-a3d8-475d-88d3-6e32e095a997 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:52.077191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc9b53-a3d8-475d-88d3-6e32e095a997 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:52.079524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc9b53-a3d8-475d-88d3-6e32e095a997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:52.083380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc9b53-a3d8-475d-88d3-6e32e095a997 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:52.128753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3411f-e468-4ece-a372-4bc5f8891c07 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:52.128984 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3615/7195] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:52.150039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3411f-e468-4ece-a372-4bc5f8891c07 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:52.165518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2e759-af31-4cc7-b390-f3cdc44b6e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:52.170228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2e759-af31-4cc7-b390-f3cdc44b6e74 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:52.170518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2e759-af31-4cc7-b390-f3cdc44b6e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:52.170794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2e759-af31-4cc7-b390-f3cdc44b6e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:52.171529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2e759-af31-4cc7-b390-f3cdc44b6e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:52.173140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2e759-af31-4cc7-b390-f3cdc44b6e74 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:52.204561 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3581/7196] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:52.207789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc9b53-a3d8-475d-88d3-6e32e095a997 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:52.227618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc9b53-a3d8-475d-88d3-6e32e095a997 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:52.244928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b140d37-438b-4e91-96ce-01a5b611871c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:52.245955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b140d37-438b-4e91-96ce-01a5b611871c admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:52.246245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b140d37-438b-4e91-96ce-01a5b611871c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:52.246513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b140d37-438b-4e91-96ce-01a5b611871c admin admin] PATH_INFO: `/v3/projects/23a574b8b90f4fc1b65e76d82d629916/users/c710cc9e97f2422da3610d80c7d80c68/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:52.291070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b140d37-438b-4e91-96ce-01a5b611871c admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a574b8b90f4fc1b65e76d82d629916, user_id=c710cc9e97f2422da3610d80c7d80c68, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:52.294736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b140d37-438b-4e91-96ce-01a5b611871c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:52.316820 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3616/7197] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:15:52 2022] PUT /identity/v3/projects/23a574b8b90f4fc1b65e76d82d629916/users/c710cc9e97f2422da3610d80c7d80c68/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:52.328345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28722c81-dd8d-4f79-96f8-47a68dee19b8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:52.328713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28722c81-dd8d-4f79-96f8-47a68dee19b8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:52.328917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28722c81-dd8d-4f79-96f8-47a68dee19b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:52.388795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-28722c81-dd8d-4f79-96f8-47a68dee19b8 None None] MFA Rules not processed for user `c710cc9e97f2422da3610d80c7d80c68`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:52.390044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-28722c81-dd8d-4f79-96f8-47a68dee19b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:52.552198 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3582/7198] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:52.555512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b140d37-438b-4e91-96ce-01a5b611871c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:52.732432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b140d37-438b-4e91-96ce-01a5b611871c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:52.741919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8f4cd-e835-4836-8a9a-7cef6f4dc73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:52.742810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8f4cd-e835-4836-8a9a-7cef6f4dc73d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:52.743273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8f4cd-e835-4836-8a9a-7cef6f4dc73d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:52.743718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8f4cd-e835-4836-8a9a-7cef6f4dc73d admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:52.744530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8f4cd-e835-4836-8a9a-7cef6f4dc73d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:52.747245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8f4cd-e835-4836-8a9a-7cef6f4dc73d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:52.817058 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3617/7199] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:15:52 2022] POST /identity/v3/projects => generated 385 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:52.821161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28722c81-dd8d-4f79-96f8-47a68dee19b8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:52.840473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28722c81-dd8d-4f79-96f8-47a68dee19b8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:52.971103 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:53.009302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f2173-b04c-40df-b2ef-f8e97acd6869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:53.010181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f2173-b04c-40df-b2ef-f8e97acd6869 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:53.010705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f2173-b04c-40df-b2ef-f8e97acd6869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:53.011211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f2173-b04c-40df-b2ef-f8e97acd6869 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:53.012987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f2173-b04c-40df-b2ef-f8e97acd6869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:53.015356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f2173-b04c-40df-b2ef-f8e97acd6869 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:53.072945 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3583/7200] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:15:52 2022] POST /identity/v3/users => generated 299 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:53.074884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8f4cd-e835-4836-8a9a-7cef6f4dc73d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:53.095700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8f4cd-e835-4836-8a9a-7cef6f4dc73d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:53.104789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af24581-1764-4c4f-a53e-65c103cc72cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:53.105575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af24581-1764-4c4f-a53e-65c103cc72cd admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:53.105915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af24581-1764-4c4f-a53e-65c103cc72cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:53.106261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af24581-1764-4c4f-a53e-65c103cc72cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:53.106991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af24581-1764-4c4f-a53e-65c103cc72cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:53.119704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af24581-1764-4c4f-a53e-65c103cc72cd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:53.143111 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3618/7201] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:53.144398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f2173-b04c-40df-b2ef-f8e97acd6869 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:53.159149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f2173-b04c-40df-b2ef-f8e97acd6869 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:53.175727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba5b7d-793f-475f-a010-9ba2d00ad5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:53.176489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5b7d-793f-475f-a010-9ba2d00ad5fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:53.176897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5b7d-793f-475f-a010-9ba2d00ad5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:53.177246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5b7d-793f-475f-a010-9ba2d00ad5fb admin admin] PATH_INFO: `/v3/projects/57a3b0dcad734414a3e43e543c7f8743/users/d5b06670ad3146799e8721d7ed1c1fa0/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:53.208811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba5b7d-793f-475f-a010-9ba2d00ad5fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a3b0dcad734414a3e43e543c7f8743, user_id=d5b06670ad3146799e8721d7ed1c1fa0, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:53.211463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba5b7d-793f-475f-a010-9ba2d00ad5fb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:53.247361 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3584/7202] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:15:53 2022] PUT /identity/v3/projects/57a3b0dcad734414a3e43e543c7f8743/users/d5b06670ad3146799e8721d7ed1c1fa0/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:53.251040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af24581-1764-4c4f-a53e-65c103cc72cd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:53.264526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af24581-1764-4c4f-a53e-65c103cc72cd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:53.439588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668be59-89f0-43de-8be4-139ed464de3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:53.440141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668be59-89f0-43de-8be4-139ed464de3e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:53.440544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668be59-89f0-43de-8be4-139ed464de3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:53.443091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668be59-89f0-43de-8be4-139ed464de3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:53.444144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668be59-89f0-43de-8be4-139ed464de3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:53.446117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668be59-89f0-43de-8be4-139ed464de3e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:53.459416 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:53.499745 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3619/7203] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:53.504273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba5b7d-793f-475f-a010-9ba2d00ad5fb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:53.524024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba5b7d-793f-475f-a010-9ba2d00ad5fb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:53.538519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb512e0e-5f73-4165-b7ce-ba96851340ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:53.539202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb512e0e-5f73-4165-b7ce-ba96851340ab admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:53.539478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb512e0e-5f73-4165-b7ce-ba96851340ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:53.539755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb512e0e-5f73-4165-b7ce-ba96851340ab admin admin] PATH_INFO: `/v3/projects/57a3b0dcad734414a3e43e543c7f8743/users/d5b06670ad3146799e8721d7ed1c1fa0/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:53.541934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb512e0e-5f73-4165-b7ce-ba96851340ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a3b0dcad734414a3e43e543c7f8743, user_id=d5b06670ad3146799e8721d7ed1c1fa0, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:53.544943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb512e0e-5f73-4165-b7ce-ba96851340ab admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:53.578594 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3585/7204] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:15:53 2022] PUT /identity/v3/projects/57a3b0dcad734414a3e43e543c7f8743/users/d5b06670ad3146799e8721d7ed1c1fa0/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:53.580428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f4bbd-d8ea-4103-877c-37bbb0e4bcdf None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:53.580797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f4bbd-d8ea-4103-877c-37bbb0e4bcdf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:53.581071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f4bbd-d8ea-4103-877c-37bbb0e4bcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:53.640453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-132f4bbd-d8ea-4103-877c-37bbb0e4bcdf None None] MFA Rules not processed for user `d5b06670ad3146799e8721d7ed1c1fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:53.641721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-132f4bbd-d8ea-4103-877c-37bbb0e4bcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:53.888211 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3620/7205] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:53.889428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb512e0e-5f73-4165-b7ce-ba96851340ab admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:53.900356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f4bbd-d8ea-4103-877c-37bbb0e4bcdf None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:53.901536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-132f4bbd-d8ea-4103-877c-37bbb0e4bcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:53.930194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb512e0e-5f73-4165-b7ce-ba96851340ab admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:53.936246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e46d1-ff0f-4672-a506-70212b87f259 tempest-ProjectsNegativeTestJSON-1234848351 tempest-ProjectsNegativeTestJSON-1234848351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b06670ad3146799e8721d7ed1c1fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57a3b0dcad734414a3e43e543c7f8743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:53.936896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e46d1-ff0f-4672-a506-70212b87f259 tempest-ProjectsNegativeTestJSON-1234848351 tempest-ProjectsNegativeTestJSON-1234848351-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:53.937180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e46d1-ff0f-4672-a506-70212b87f259 tempest-ProjectsNegativeTestJSON-1234848351 tempest-ProjectsNegativeTestJSON-1234848351-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:53.937454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e46d1-ff0f-4672-a506-70212b87f259 tempest-ProjectsNegativeTestJSON-1234848351 tempest-ProjectsNegativeTestJSON-1234848351-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:53.938087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e46d1-ff0f-4672-a506-70212b87f259 tempest-ProjectsNegativeTestJSON-1234848351 tempest-ProjectsNegativeTestJSON-1234848351-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:53.939948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e46d1-ff0f-4672-a506-70212b87f259 tempest-ProjectsNegativeTestJSON-1234848351 tempest-ProjectsNegativeTestJSON-1234848351-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:54.020434 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3586/7206] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:15:53 2022] POST /identity/v3/projects => generated 359 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:54.022217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e46d1-ff0f-4672-a506-70212b87f259 tempest-ProjectsNegativeTestJSON-1234848351 tempest-ProjectsNegativeTestJSON-1234848351-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:54.041182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f4bbd-d8ea-4103-877c-37bbb0e4bcdf None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:54.219432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffca10-e357-4c0b-a0a3-ab7858492556 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:54.220181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffca10-e357-4c0b-a0a3-ab7858492556 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:54.220563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffca10-e357-4c0b-a0a3-ab7858492556 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:54.220962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffca10-e357-4c0b-a0a3-ab7858492556 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:54.227916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-79ffca10-e357-4c0b-a0a3-ab7858492556 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:54.241409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e46d1-ff0f-4672-a506-70212b87f259 tempest-ProjectsNegativeTestJSON-1234848351 tempest-ProjectsNegativeTestJSON-1234848351-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:54.249634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1a909-7687-4637-9fee-2e3e215f2135 tempest-ProjectsNegativeTestJSON-928788683 tempest-ProjectsNegativeTestJSON-928788683-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c710cc9e97f2422da3610d80c7d80c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23a574b8b90f4fc1b65e76d82d629916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:54.250297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1a909-7687-4637-9fee-2e3e215f2135 tempest-ProjectsNegativeTestJSON-928788683 tempest-ProjectsNegativeTestJSON-928788683-project] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:54.250600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1a909-7687-4637-9fee-2e3e215f2135 tempest-ProjectsNegativeTestJSON-928788683 tempest-ProjectsNegativeTestJSON-928788683-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:54.250859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1a909-7687-4637-9fee-2e3e215f2135 tempest-ProjectsNegativeTestJSON-928788683 tempest-ProjectsNegativeTestJSON-928788683-project] PATH_INFO: `/v3/projects/149c2ac57103454e89bcc0e7c08277f1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:54.252112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1a909-7687-4637-9fee-2e3e215f2135 tempest-ProjectsNegativeTestJSON-928788683 tempest-ProjectsNegativeTestJSON-928788683-project] RBAC: Authorizing `identity:delete_project(project_id=149c2ac57103454e89bcc0e7c08277f1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:54.263399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-99b1a909-7687-4637-9fee-2e3e215f2135 tempest-ProjectsNegativeTestJSON-928788683 tempest-ProjectsNegativeTestJSON-928788683-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Sep 30 10:15:54.263399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:15:54.263399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:15:54.263399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:15:54.263399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:15:54.263399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:15:54.263399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:15:54.263399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:15:54.263399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:15:54.263399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:15:54.263399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:15:54.263399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:15:54.263399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Sep 30 10:15:54.263399 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Sep 30 10:15:54.264626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Sep 30 10:15:54.264626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application enforcer_obj._enforce( Sep 30 10:15:54.264626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Sep 30 10:15:54.264626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Sep 30 10:15:54.264626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 30 10:15:54.264626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Sep 30 10:15:54.264626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Sep 30 10:15:54.264626 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:15:54.270478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffca10-e357-4c0b-a0a3-ab7858492556 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:54.272359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffca10-e357-4c0b-a0a3-ab7858492556 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:54.272778 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3587/7207] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:15:54 2022] DELETE /identity/v3/projects/149c2ac57103454e89bcc0e7c08277f1 => generated 136 bytes in 251 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Sep 30 10:15:54.275151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1a909-7687-4637-9fee-2e3e215f2135 tempest-ProjectsNegativeTestJSON-928788683 tempest-ProjectsNegativeTestJSON-928788683-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:54.301498 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3621/7208] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:15:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:15:54.469552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1a909-7687-4637-9fee-2e3e215f2135 tempest-ProjectsNegativeTestJSON-928788683 tempest-ProjectsNegativeTestJSON-928788683-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:54.500245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae38d0c-fd88-427c-ab3a-79a84416d5ae tempest-ProjectsNegativeTestJSON-1234848351 tempest-ProjectsNegativeTestJSON-1234848351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b06670ad3146799e8721d7ed1c1fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57a3b0dcad734414a3e43e543c7f8743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:54.501622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae38d0c-fd88-427c-ab3a-79a84416d5ae tempest-ProjectsNegativeTestJSON-1234848351 tempest-ProjectsNegativeTestJSON-1234848351-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:54.502116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae38d0c-fd88-427c-ab3a-79a84416d5ae tempest-ProjectsNegativeTestJSON-1234848351 tempest-ProjectsNegativeTestJSON-1234848351-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:54.502275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae38d0c-fd88-427c-ab3a-79a84416d5ae tempest-ProjectsNegativeTestJSON-1234848351 tempest-ProjectsNegativeTestJSON-1234848351-project-admin] PATH_INFO: `/v3/projects/149c2ac57103454e89bcc0e7c08277f1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:54.507379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae38d0c-fd88-427c-ab3a-79a84416d5ae tempest-ProjectsNegativeTestJSON-1234848351 tempest-ProjectsNegativeTestJSON-1234848351-project-admin] RBAC: Authorizing `identity:delete_project(project_id=149c2ac57103454e89bcc0e7c08277f1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:54.513891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae38d0c-fd88-427c-ab3a-79a84416d5ae tempest-ProjectsNegativeTestJSON-1234848351 tempest-ProjectsNegativeTestJSON-1234848351-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:54.572772 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:54.578777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffca10-e357-4c0b-a0a3-ab7858492556 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:54.580409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-79ffca10-e357-4c0b-a0a3-ab7858492556 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:54.624589 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:54.626606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aae38d0c-fd88-427c-ab3a-79a84416d5ae tempest-ProjectsNegativeTestJSON-1234848351 tempest-ProjectsNegativeTestJSON-1234848351-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '149c2ac57103454e89bcc0e7c08277f1', 'request_id': 'req-aae38d0c-fd88-427c-ab3a-79a84416d5ae'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:54.644148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aae38d0c-fd88-427c-ab3a-79a84416d5ae tempest-ProjectsNegativeTestJSON-1234848351 tempest-ProjectsNegativeTestJSON-1234848351-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '149c2ac57103454e89bcc0e7c08277f1', 'request_id': 'req-aae38d0c-fd88-427c-ab3a-79a84416d5ae'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:54.653798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aae38d0c-fd88-427c-ab3a-79a84416d5ae tempest-ProjectsNegativeTestJSON-1234848351 tempest-ProjectsNegativeTestJSON-1234848351-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '149c2ac57103454e89bcc0e7c08277f1', 'request_id': 'req-aae38d0c-fd88-427c-ab3a-79a84416d5ae'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:54.682931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aae38d0c-fd88-427c-ab3a-79a84416d5ae tempest-ProjectsNegativeTestJSON-1234848351 tempest-ProjectsNegativeTestJSON-1234848351-project-admin] The token cache is being invalidate because project 149c2ac57103454e89bcc0e7c08277f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:54.685605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aae38d0c-fd88-427c-ab3a-79a84416d5ae tempest-ProjectsNegativeTestJSON-1234848351 tempest-ProjectsNegativeTestJSON-1234848351-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:54.687660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aae38d0c-fd88-427c-ab3a-79a84416d5ae tempest-ProjectsNegativeTestJSON-1234848351 tempest-ProjectsNegativeTestJSON-1234848351-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:54.697007 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3588/7209] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:15:54 2022] DELETE /identity/v3/projects/149c2ac57103454e89bcc0e7c08277f1 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:54.699730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae38d0c-fd88-427c-ab3a-79a84416d5ae tempest-ProjectsNegativeTestJSON-1234848351 tempest-ProjectsNegativeTestJSON-1234848351-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:54.705607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aae38d0c-fd88-427c-ab3a-79a84416d5ae tempest-ProjectsNegativeTestJSON-1234848351 tempest-ProjectsNegativeTestJSON-1234848351-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:54.723052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffca10-e357-4c0b-a0a3-ab7858492556 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:54.853242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7c3fe-0657-4a3d-9ac0-4a0aabd02860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:54.853860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7c3fe-0657-4a3d-9ac0-4a0aabd02860 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:54.854145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7c3fe-0657-4a3d-9ac0-4a0aabd02860 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:54.854421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7c3fe-0657-4a3d-9ac0-4a0aabd02860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:54.859560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0dd7c3fe-0657-4a3d-9ac0-4a0aabd02860 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:54.909285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae38d0c-fd88-427c-ab3a-79a84416d5ae tempest-ProjectsNegativeTestJSON-1234848351 tempest-ProjectsNegativeTestJSON-1234848351-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:54.920795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e0f9a-2b04-4965-9472-a7583ba8665f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:54.922701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e0f9a-2b04-4965-9472-a7583ba8665f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:54.924531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e0f9a-2b04-4965-9472-a7583ba8665f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:54.924941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e0f9a-2b04-4965-9472-a7583ba8665f admin admin] PATH_INFO: `/v3/users/c710cc9e97f2422da3610d80c7d80c68` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:54.929688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e0f9a-2b04-4965-9472-a7583ba8665f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c710cc9e97f2422da3610d80c7d80c68)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:54.931985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e0f9a-2b04-4965-9472-a7583ba8665f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:55.029970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7c3fe-0657-4a3d-9ac0-4a0aabd02860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:55.031437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7c3fe-0657-4a3d-9ac0-4a0aabd02860 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:55.038280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c49e0f9a-2b04-4965-9472-a7583ba8665f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c710cc9e97f2422da3610d80c7d80c68'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:55.051838 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3622/7210] 10.222.0.16 () {60 vars in 1396 bytes} [Fri Sep 30 10:15:54 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3266 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:15:55.055578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c49e0f9a-2b04-4965-9472-a7583ba8665f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c710cc9e97f2422da3610d80c7d80c68'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:55.056736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c49e0f9a-2b04-4965-9472-a7583ba8665f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c710cc9e97f2422da3610d80c7d80c68'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:55.098107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c49e0f9a-2b04-4965-9472-a7583ba8665f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c710cc9e97f2422da3610d80c7d80c68'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:55.108147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c49e0f9a-2b04-4965-9472-a7583ba8665f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c710cc9e97f2422da3610d80c7d80c68'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:55.121395 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3589/7211] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:54 2022] DELETE /identity/v3/users/c710cc9e97f2422da3610d80c7d80c68 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:55.125946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73174689-c6c2-41cc-b7ef-67580079ad9e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:55.126241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73174689-c6c2-41cc-b7ef-67580079ad9e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:55.126527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73174689-c6c2-41cc-b7ef-67580079ad9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:55.171543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-73174689-c6c2-41cc-b7ef-67580079ad9e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:55.172839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-73174689-c6c2-41cc-b7ef-67580079ad9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:55.255227 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3623/7212] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:55.263277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e0f9a-2b04-4965-9472-a7583ba8665f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:55.265405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c49e0f9a-2b04-4965-9472-a7583ba8665f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:55.310559 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:55.365268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e0f9a-2b04-4965-9472-a7583ba8665f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:55.376324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece792a-6a87-49a5-97e9-7a1287cee94d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:55.390399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece792a-6a87-49a5-97e9-7a1287cee94d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:55.390682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece792a-6a87-49a5-97e9-7a1287cee94d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:55.390961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece792a-6a87-49a5-97e9-7a1287cee94d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:55.431101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece792a-6a87-49a5-97e9-7a1287cee94d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:55.432888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece792a-6a87-49a5-97e9-7a1287cee94d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:55.461039 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3590/7213] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:15:55.469855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73174689-c6c2-41cc-b7ef-67580079ad9e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:55.487585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73174689-c6c2-41cc-b7ef-67580079ad9e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:55.495477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8e61c-cb5a-4e0f-958d-fd28b1642854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:55.498929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8e61c-cb5a-4e0f-958d-fd28b1642854 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:55.499403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8e61c-cb5a-4e0f-958d-fd28b1642854 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:55.500405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8e61c-cb5a-4e0f-958d-fd28b1642854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:55.505107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-39e8e61c-cb5a-4e0f-958d-fd28b1642854 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:55.528476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e8e61c-cb5a-4e0f-958d-fd28b1642854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:55.533646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e8e61c-cb5a-4e0f-958d-fd28b1642854 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:55.556183 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3624/7214] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:15:56.462517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece792a-6a87-49a5-97e9-7a1287cee94d service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:56.464078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3ece792a-6a87-49a5-97e9-7a1287cee94d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:56.486811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece792a-6a87-49a5-97e9-7a1287cee94d service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:56.492655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc5095-f300-443d-8e28-a5155f05fbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:56.493577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc5095-f300-443d-8e28-a5155f05fbc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:56.494022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc5095-f300-443d-8e28-a5155f05fbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:56.494470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc5095-f300-443d-8e28-a5155f05fbc8 admin admin] PATH_INFO: `/v3/projects/23a574b8b90f4fc1b65e76d82d629916` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:56.496128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc5095-f300-443d-8e28-a5155f05fbc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23a574b8b90f4fc1b65e76d82d629916)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:56.498578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc5095-f300-443d-8e28-a5155f05fbc8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:56.612623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45dc5095-f300-443d-8e28-a5155f05fbc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23a574b8b90f4fc1b65e76d82d629916', 'request_id': 'req-45dc5095-f300-443d-8e28-a5155f05fbc8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:56.626481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45dc5095-f300-443d-8e28-a5155f05fbc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23a574b8b90f4fc1b65e76d82d629916', 'request_id': 'req-45dc5095-f300-443d-8e28-a5155f05fbc8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:56.633133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45dc5095-f300-443d-8e28-a5155f05fbc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23a574b8b90f4fc1b65e76d82d629916', 'request_id': 'req-45dc5095-f300-443d-8e28-a5155f05fbc8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:56.659131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45dc5095-f300-443d-8e28-a5155f05fbc8 admin admin] The token cache is being invalidate because project 23a574b8b90f4fc1b65e76d82d629916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:56.659530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45dc5095-f300-443d-8e28-a5155f05fbc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:56.661264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45dc5095-f300-443d-8e28-a5155f05fbc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:56.671760 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3591/7215] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:15:56 2022] DELETE /identity/v3/projects/23a574b8b90f4fc1b65e76d82d629916 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:56.672753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8e61c-cb5a-4e0f-958d-fd28b1642854 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:56.688785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc5095-f300-443d-8e28-a5155f05fbc8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:56.690215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-45dc5095-f300-443d-8e28-a5155f05fbc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:56.705945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8e61c-cb5a-4e0f-958d-fd28b1642854 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:56.759410 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:56.822448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc5095-f300-443d-8e28-a5155f05fbc8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:56.828824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a880f-057e-4f50-8002-88d310528640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:56.829754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a880f-057e-4f50-8002-88d310528640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:56.830136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a880f-057e-4f50-8002-88d310528640 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:56.830572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a880f-057e-4f50-8002-88d310528640 admin admin] PATH_INFO: `/v3/users/40cea8ffee0e48aba3f0ce206768d1ef` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:56.831862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a880f-057e-4f50-8002-88d310528640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40cea8ffee0e48aba3f0ce206768d1ef)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:56.834008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a880f-057e-4f50-8002-88d310528640 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:56.878306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce14fd-fca9-4e06-9b48-016f73b2d3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:56.881055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce14fd-fca9-4e06-9b48-016f73b2d3b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:56.881447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce14fd-fca9-4e06-9b48-016f73b2d3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:56.882657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce14fd-fca9-4e06-9b48-016f73b2d3b0 admin admin] PATH_INFO: `/v3/users/d5b06670ad3146799e8721d7ed1c1fa0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:56.891053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce14fd-fca9-4e06-9b48-016f73b2d3b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5b06670ad3146799e8721d7ed1c1fa0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:56.893075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce14fd-fca9-4e06-9b48-016f73b2d3b0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:56.920813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c45a880f-057e-4f50-8002-88d310528640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40cea8ffee0e48aba3f0ce206768d1ef'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:56.943101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c45a880f-057e-4f50-8002-88d310528640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40cea8ffee0e48aba3f0ce206768d1ef'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:56.944264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c45a880f-057e-4f50-8002-88d310528640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40cea8ffee0e48aba3f0ce206768d1ef'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:56.949721 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:56.997338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c45a880f-057e-4f50-8002-88d310528640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40cea8ffee0e48aba3f0ce206768d1ef'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:57.013218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c45a880f-057e-4f50-8002-88d310528640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40cea8ffee0e48aba3f0ce206768d1ef'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:57.022516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01ce14fd-fca9-4e06-9b48-016f73b2d3b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5b06670ad3146799e8721d7ed1c1fa0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:57.024722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01ce14fd-fca9-4e06-9b48-016f73b2d3b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5b06670ad3146799e8721d7ed1c1fa0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:57.025794 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3592/7216] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:56 2022] DELETE /identity/v3/users/40cea8ffee0e48aba3f0ce206768d1ef => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:57.041426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01ce14fd-fca9-4e06-9b48-016f73b2d3b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5b06670ad3146799e8721d7ed1c1fa0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:57.064268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01ce14fd-fca9-4e06-9b48-016f73b2d3b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5b06670ad3146799e8721d7ed1c1fa0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:57.088126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01ce14fd-fca9-4e06-9b48-016f73b2d3b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5b06670ad3146799e8721d7ed1c1fa0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:57.104157 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3625/7217] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:15:56 2022] DELETE /identity/v3/users/d5b06670ad3146799e8721d7ed1c1fa0 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:57.478576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a880f-057e-4f50-8002-88d310528640 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:57.483863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c45a880f-057e-4f50-8002-88d310528640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:57.609912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a880f-057e-4f50-8002-88d310528640 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:57.697938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be90f7-28fd-4f56-a2e4-5c52403c719c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:57.699994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be90f7-28fd-4f56-a2e4-5c52403c719c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:57.701433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be90f7-28fd-4f56-a2e4-5c52403c719c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:57.702010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be90f7-28fd-4f56-a2e4-5c52403c719c admin admin] PATH_INFO: `/v3/projects/4194ee9a9a9c4dfc9b26ae18af2426cd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:57.706238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be90f7-28fd-4f56-a2e4-5c52403c719c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4194ee9a9a9c4dfc9b26ae18af2426cd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:57.711176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be90f7-28fd-4f56-a2e4-5c52403c719c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:57.744926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce14fd-fca9-4e06-9b48-016f73b2d3b0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:57.748728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-01ce14fd-fca9-4e06-9b48-016f73b2d3b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:57.784585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce14fd-fca9-4e06-9b48-016f73b2d3b0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:57.804735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29647b54-ddce-4145-b2e9-5346cae36120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:57.807891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29647b54-ddce-4145-b2e9-5346cae36120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:57.810657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29647b54-ddce-4145-b2e9-5346cae36120 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:57.811727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29647b54-ddce-4145-b2e9-5346cae36120 admin admin] PATH_INFO: `/v3/projects/57a3b0dcad734414a3e43e543c7f8743` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:57.817626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29647b54-ddce-4145-b2e9-5346cae36120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57a3b0dcad734414a3e43e543c7f8743)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:57.820086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29647b54-ddce-4145-b2e9-5346cae36120 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:57.887195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-37be90f7-28fd-4f56-a2e4-5c52403c719c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4194ee9a9a9c4dfc9b26ae18af2426cd', 'request_id': 'req-37be90f7-28fd-4f56-a2e4-5c52403c719c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:57.898452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-37be90f7-28fd-4f56-a2e4-5c52403c719c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4194ee9a9a9c4dfc9b26ae18af2426cd', 'request_id': 'req-37be90f7-28fd-4f56-a2e4-5c52403c719c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:57.913162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-37be90f7-28fd-4f56-a2e4-5c52403c719c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4194ee9a9a9c4dfc9b26ae18af2426cd', 'request_id': 'req-37be90f7-28fd-4f56-a2e4-5c52403c719c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:57.926124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-37be90f7-28fd-4f56-a2e4-5c52403c719c admin admin] The token cache is being invalidate because project 4194ee9a9a9c4dfc9b26ae18af2426cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:57.926341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-37be90f7-28fd-4f56-a2e4-5c52403c719c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:57.926972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-37be90f7-28fd-4f56-a2e4-5c52403c719c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:57.941596 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3593/7218] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:15:57 2022] DELETE /identity/v3/projects/4194ee9a9a9c4dfc9b26ae18af2426cd => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:57.959349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29647b54-ddce-4145-b2e9-5346cae36120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57a3b0dcad734414a3e43e543c7f8743', 'request_id': 'req-29647b54-ddce-4145-b2e9-5346cae36120'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:57.985821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29647b54-ddce-4145-b2e9-5346cae36120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57a3b0dcad734414a3e43e543c7f8743', 'request_id': 'req-29647b54-ddce-4145-b2e9-5346cae36120'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:58.003850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29647b54-ddce-4145-b2e9-5346cae36120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57a3b0dcad734414a3e43e543c7f8743', 'request_id': 'req-29647b54-ddce-4145-b2e9-5346cae36120'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:58.034446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29647b54-ddce-4145-b2e9-5346cae36120 admin admin] The token cache is being invalidate because project 57a3b0dcad734414a3e43e543c7f8743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:15:58.034775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29647b54-ddce-4145-b2e9-5346cae36120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:58.037984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29647b54-ddce-4145-b2e9-5346cae36120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:15:58.043306 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3626/7219] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:15:57 2022] DELETE /identity/v3/projects/57a3b0dcad734414a3e43e543c7f8743 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:58.050996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7cbe8-3592-4aa2-8606-66331e77919f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:58.051459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7cbe8-3592-4aa2-8606-66331e77919f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:58.051765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7cbe8-3592-4aa2-8606-66331e77919f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:58.115342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ecb7cbe8-3592-4aa2-8606-66331e77919f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:58.117561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ecb7cbe8-3592-4aa2-8606-66331e77919f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:58.127543 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:58.333081 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3594/7220] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:58.339602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fefa5-9d5f-427e-b880-c2d7430bf34b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:58.342432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fefa5-9d5f-427e-b880-c2d7430bf34b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:58.342740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fefa5-9d5f-427e-b880-c2d7430bf34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:58.424412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ef9fefa5-9d5f-427e-b880-c2d7430bf34b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:58.428807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ef9fefa5-9d5f-427e-b880-c2d7430bf34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:58.471898 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3627/7221] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:15:58.473294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7cbe8-3592-4aa2-8606-66331e77919f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:58.494234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7cbe8-3592-4aa2-8606-66331e77919f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:58.502593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b178e24-9929-4ceb-b627-73dda03d5f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:58.503653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b178e24-9929-4ceb-b627-73dda03d5f34 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:58.504259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b178e24-9929-4ceb-b627-73dda03d5f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:58.504792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b178e24-9929-4ceb-b627-73dda03d5f34 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:58.505867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b178e24-9929-4ceb-b627-73dda03d5f34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:15:58.506585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b178e24-9929-4ceb-b627-73dda03d5f34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:58.509208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b178e24-9929-4ceb-b627-73dda03d5f34 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:58.527970 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3595/7222] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:15:58.532592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fefa5-9d5f-427e-b880-c2d7430bf34b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:58.544140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fefa5-9d5f-427e-b880-c2d7430bf34b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:58.549274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce825c12-7901-484e-8d57-5ad8b335621c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:58.549993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce825c12-7901-484e-8d57-5ad8b335621c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:58.550370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce825c12-7901-484e-8d57-5ad8b335621c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:58.550736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce825c12-7901-484e-8d57-5ad8b335621c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:58.551457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce825c12-7901-484e-8d57-5ad8b335621c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:58.553514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce825c12-7901-484e-8d57-5ad8b335621c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:58.560386 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:58.600492 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3628/7223] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:15:58 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:58.601461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b178e24-9929-4ceb-b627-73dda03d5f34 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:58.618430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b178e24-9929-4ceb-b627-73dda03d5f34 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:58.753776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42931661-6069-41bc-9bb0-f36e87c70717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:58.755794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42931661-6069-41bc-9bb0-f36e87c70717 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:58.757012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42931661-6069-41bc-9bb0-f36e87c70717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:58.757586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42931661-6069-41bc-9bb0-f36e87c70717 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:58.759321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42931661-6069-41bc-9bb0-f36e87c70717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:58.762172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42931661-6069-41bc-9bb0-f36e87c70717 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:58.819660 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3596/7224] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:15:58 2022] POST /identity/v3/users => generated 285 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:15:58.823276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce825c12-7901-484e-8d57-5ad8b335621c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:58.837727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce825c12-7901-484e-8d57-5ad8b335621c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:58.852833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597e887-e868-4459-aed4-cb0e8f7321bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:58.853898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597e887-e868-4459-aed4-cb0e8f7321bf admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:58.854401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597e887-e868-4459-aed4-cb0e8f7321bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:58.855550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597e887-e868-4459-aed4-cb0e8f7321bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:58.856842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597e887-e868-4459-aed4-cb0e8f7321bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:58.858713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597e887-e868-4459-aed4-cb0e8f7321bf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:58.871926 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3629/7225] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:15:58.874971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42931661-6069-41bc-9bb0-f36e87c70717 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:58.892481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42931661-6069-41bc-9bb0-f36e87c70717 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:58.908944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214b279-9ff4-4854-93e6-a2f7c85847d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:58.909690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214b279-9ff4-4854-93e6-a2f7c85847d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:58.910070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214b279-9ff4-4854-93e6-a2f7c85847d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:58.910610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214b279-9ff4-4854-93e6-a2f7c85847d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:58.911367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214b279-9ff4-4854-93e6-a2f7c85847d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:58.930498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214b279-9ff4-4854-93e6-a2f7c85847d5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:58.944654 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3597/7226] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:58.948139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597e887-e868-4459-aed4-cb0e8f7321bf admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:58.959552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597e887-e868-4459-aed4-cb0e8f7321bf admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:58.965526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8126e0d-bd8e-4f21-829e-bbc81beb032e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:58.966286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8126e0d-bd8e-4f21-829e-bbc81beb032e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:58.966733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8126e0d-bd8e-4f21-829e-bbc81beb032e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:58.967051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8126e0d-bd8e-4f21-829e-bbc81beb032e admin admin] PATH_INFO: `/v3/projects/73f8d0f0646c47198b1af494cfb69b07/users/a1f7309f5b2c4456a30148f41830512c/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:58.983800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8126e0d-bd8e-4f21-829e-bbc81beb032e admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f8d0f0646c47198b1af494cfb69b07, user_id=a1f7309f5b2c4456a30148f41830512c, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:58.986807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8126e0d-bd8e-4f21-829e-bbc81beb032e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:59.016474 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3630/7227] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:15:58 2022] PUT /identity/v3/projects/73f8d0f0646c47198b1af494cfb69b07/users/a1f7309f5b2c4456a30148f41830512c/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:15:59.017832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740b24f-0775-434a-b1ee-21009eb24bc4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:59.018148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740b24f-0775-434a-b1ee-21009eb24bc4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:59.018424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740b24f-0775-434a-b1ee-21009eb24bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:59.052013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b740b24f-0775-434a-b1ee-21009eb24bc4 None None] MFA Rules not processed for user `a1f7309f5b2c4456a30148f41830512c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:59.053609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b740b24f-0775-434a-b1ee-21009eb24bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:15:59.134619 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3598/7228] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:15:59.139686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8126e0d-bd8e-4f21-829e-bbc81beb032e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:59.217857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8126e0d-bd8e-4f21-829e-bbc81beb032e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:59.224206 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b340312-b0d8-4895-9eb5-ad7b6530b02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:59.224879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b340312-b0d8-4895-9eb5-ad7b6530b02e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:59.225155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b340312-b0d8-4895-9eb5-ad7b6530b02e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:59.225424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b340312-b0d8-4895-9eb5-ad7b6530b02e admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:59.226052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b340312-b0d8-4895-9eb5-ad7b6530b02e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:59.228535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b340312-b0d8-4895-9eb5-ad7b6530b02e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:59.271796 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3631/7229] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:15:59 2022] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:59.274505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740b24f-0775-434a-b1ee-21009eb24bc4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:59.294482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740b24f-0775-434a-b1ee-21009eb24bc4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:59.299296 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:15:59.385927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32437a3-a247-4e01-bd40-be74f2a4277e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:59.388206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32437a3-a247-4e01-bd40-be74f2a4277e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:59.388811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32437a3-a247-4e01-bd40-be74f2a4277e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:59.389516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32437a3-a247-4e01-bd40-be74f2a4277e admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:59.391944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32437a3-a247-4e01-bd40-be74f2a4277e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:59.412164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32437a3-a247-4e01-bd40-be74f2a4277e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:59.476389 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3599/7230] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:15:59 2022] POST /identity/v3/users => generated 291 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:15:59.481693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b340312-b0d8-4895-9eb5-ad7b6530b02e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:59.505765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b340312-b0d8-4895-9eb5-ad7b6530b02e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:59.514018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd42331-be8d-489d-9a19-a501d2173d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:59.514717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd42331-be8d-489d-9a19-a501d2173d2a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:59.514997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd42331-be8d-489d-9a19-a501d2173d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:59.518129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd42331-be8d-489d-9a19-a501d2173d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:59.518820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd42331-be8d-489d-9a19-a501d2173d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:59.520435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd42331-be8d-489d-9a19-a501d2173d2a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:59.563779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32437a3-a247-4e01-bd40-be74f2a4277e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:59.564500 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3632/7231] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:59.587543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32437a3-a247-4e01-bd40-be74f2a4277e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:59.600622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23401b54-f64b-4f48-95f6-de2ea2d56673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:59.601723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23401b54-f64b-4f48-95f6-de2ea2d56673 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:59.602053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23401b54-f64b-4f48-95f6-de2ea2d56673 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:59.602544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23401b54-f64b-4f48-95f6-de2ea2d56673 admin admin] PATH_INFO: `/v3/projects/7e081a9d06834db38506346dd2d4d8bc/users/a406d8fae2fb4c6888ca26dc70327c78/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:59.655254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23401b54-f64b-4f48-95f6-de2ea2d56673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e081a9d06834db38506346dd2d4d8bc, user_id=a406d8fae2fb4c6888ca26dc70327c78, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:59.658223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23401b54-f64b-4f48-95f6-de2ea2d56673 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:59.686759 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3600/7232] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:15:59 2022] PUT /identity/v3/projects/7e081a9d06834db38506346dd2d4d8bc/users/a406d8fae2fb4c6888ca26dc70327c78/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:15:59.691202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd42331-be8d-489d-9a19-a501d2173d2a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:59.702819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd42331-be8d-489d-9a19-a501d2173d2a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:59.829754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94922365-f8ac-4f4f-8885-0ebbe2200a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:59.832976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94922365-f8ac-4f4f-8885-0ebbe2200a38 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:59.834339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94922365-f8ac-4f4f-8885-0ebbe2200a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:59.835390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94922365-f8ac-4f4f-8885-0ebbe2200a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:59.836702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94922365-f8ac-4f4f-8885-0ebbe2200a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:59.840242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94922365-f8ac-4f4f-8885-0ebbe2200a38 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:59.854337 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3633/7233] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:15:59.856197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23401b54-f64b-4f48-95f6-de2ea2d56673 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:15:59.869318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23401b54-f64b-4f48-95f6-de2ea2d56673 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:15:59.877362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f75ae-5f7e-4582-abcc-945229cf3358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:15:59.878333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f75ae-5f7e-4582-abcc-945229cf3358 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:59.878778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f75ae-5f7e-4582-abcc-945229cf3358 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:59.879216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f75ae-5f7e-4582-abcc-945229cf3358 admin admin] PATH_INFO: `/v3/projects/7e081a9d06834db38506346dd2d4d8bc/users/a406d8fae2fb4c6888ca26dc70327c78/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:59.881493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f75ae-5f7e-4582-abcc-945229cf3358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e081a9d06834db38506346dd2d4d8bc, user_id=a406d8fae2fb4c6888ca26dc70327c78, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:15:59.884306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f75ae-5f7e-4582-abcc-945229cf3358 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:15:59.905552 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3601/7234] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:15:59 2022] PUT /identity/v3/projects/7e081a9d06834db38506346dd2d4d8bc/users/a406d8fae2fb4c6888ca26dc70327c78/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:15:59.921105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e78bf-5717-4af5-9158-b2d998837e77 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:15:59.921714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e78bf-5717-4af5-9158-b2d998837e77 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:15:59.922204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e78bf-5717-4af5-9158-b2d998837e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:15:59.994209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-678e78bf-5717-4af5-9158-b2d998837e77 None None] MFA Rules not processed for user `a406d8fae2fb4c6888ca26dc70327c78`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:15:59.995867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-678e78bf-5717-4af5-9158-b2d998837e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:00.019594 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:00.132163 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3634/7235] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:15:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:16:00.133332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f75ae-5f7e-4582-abcc-945229cf3358 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:00.293980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f75ae-5f7e-4582-abcc-945229cf3358 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:00.313166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d7a7d-4f66-4317-9da3-56419327454b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:00.313996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d7a7d-4f66-4317-9da3-56419327454b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:00.315015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d7a7d-4f66-4317-9da3-56419327454b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:00.315461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d7a7d-4f66-4317-9da3-56419327454b admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:00.316639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d7a7d-4f66-4317-9da3-56419327454b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:00.318726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d7a7d-4f66-4317-9da3-56419327454b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:00.379286 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3602/7236] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:16:00 2022] POST /identity/v3/projects => generated 369 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:00.380770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e78bf-5717-4af5-9158-b2d998837e77 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:00.400699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e78bf-5717-4af5-9158-b2d998837e77 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:00.555758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942dae3-7e03-43e5-bddb-b3268366757e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:00.556734 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942dae3-7e03-43e5-bddb-b3268366757e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:00.557251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942dae3-7e03-43e5-bddb-b3268366757e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:00.559091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942dae3-7e03-43e5-bddb-b3268366757e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:00.560023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942dae3-7e03-43e5-bddb-b3268366757e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:00.562720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942dae3-7e03-43e5-bddb-b3268366757e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:00.600329 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3635/7237] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:16:00 2022] POST /identity/v3/users => generated 285 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:00.603966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d7a7d-4f66-4317-9da3-56419327454b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:00.617046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d7a7d-4f66-4317-9da3-56419327454b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:00.623057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f9bc9-849a-4188-b449-e067e1c1eb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:00.623950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f9bc9-849a-4188-b449-e067e1c1eb47 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:00.624454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f9bc9-849a-4188-b449-e067e1c1eb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:00.625726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f9bc9-849a-4188-b449-e067e1c1eb47 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:00.626629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f9bc9-849a-4188-b449-e067e1c1eb47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:00.628425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f9bc9-849a-4188-b449-e067e1c1eb47 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:00.641121 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3603/7238] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:16:00.645159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942dae3-7e03-43e5-bddb-b3268366757e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:00.659926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942dae3-7e03-43e5-bddb-b3268366757e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:00.666748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567743af-5a37-419c-bdd2-b12ea4c2704b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:00.668993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567743af-5a37-419c-bdd2-b12ea4c2704b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:00.669519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567743af-5a37-419c-bdd2-b12ea4c2704b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:00.670616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567743af-5a37-419c-bdd2-b12ea4c2704b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:00.671498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567743af-5a37-419c-bdd2-b12ea4c2704b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:00.674045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567743af-5a37-419c-bdd2-b12ea4c2704b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:00.714803 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3636/7239] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:16:00.719830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f9bc9-849a-4188-b449-e067e1c1eb47 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:00.732180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f9bc9-849a-4188-b449-e067e1c1eb47 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:00.737329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f11209-b68b-4bbb-9885-b799005f2393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:00.738381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f11209-b68b-4bbb-9885-b799005f2393 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:00.739253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f11209-b68b-4bbb-9885-b799005f2393 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:00.739764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f11209-b68b-4bbb-9885-b799005f2393 admin admin] PATH_INFO: `/v3/projects/05d13ad514a24b2ebe9464db287196d5/users/ee511d50453c4c7a908e29b2e2ec3127/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:00.762705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f11209-b68b-4bbb-9885-b799005f2393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d13ad514a24b2ebe9464db287196d5, user_id=ee511d50453c4c7a908e29b2e2ec3127, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:00.765784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f11209-b68b-4bbb-9885-b799005f2393 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:00.792975 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3604/7240] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:16:00 2022] PUT /identity/v3/projects/05d13ad514a24b2ebe9464db287196d5/users/ee511d50453c4c7a908e29b2e2ec3127/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:00.804169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba238b-22ab-42c6-ab55-b0fad355631c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:00.805147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba238b-22ab-42c6-ab55-b0fad355631c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:00.805735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba238b-22ab-42c6-ab55-b0fad355631c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:00.861382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-61ba238b-22ab-42c6-ab55-b0fad355631c None None] MFA Rules not processed for user `ee511d50453c4c7a908e29b2e2ec3127`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:00.862598 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-61ba238b-22ab-42c6-ab55-b0fad355631c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:01.008554 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3637/7241] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:01.014537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f11209-b68b-4bbb-9885-b799005f2393 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:01.041663 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:01.253999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f11209-b68b-4bbb-9885-b799005f2393 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:01.259148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c65cd-dfdd-4907-9722-a3e0a24dcf9c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:01.259943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c65cd-dfdd-4907-9722-a3e0a24dcf9c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:01.260326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c65cd-dfdd-4907-9722-a3e0a24dcf9c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:01.260750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c65cd-dfdd-4907-9722-a3e0a24dcf9c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:01.262488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c65cd-dfdd-4907-9722-a3e0a24dcf9c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:01.266838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c65cd-dfdd-4907-9722-a3e0a24dcf9c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:01.293964 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3605/7242] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:16:01 2022] POST /identity/v3/domains => generated 275 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:01.298302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba238b-22ab-42c6-ab55-b0fad355631c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:01.311312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba238b-22ab-42c6-ab55-b0fad355631c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:01.343128 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:01.441169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8d42a-cdf5-4eea-9d49-e83eecc2ee2a tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:01.442041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8d42a-cdf5-4eea-9d49-e83eecc2ee2a tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:01.442638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8d42a-cdf5-4eea-9d49-e83eecc2ee2a tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:01.443113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8d42a-cdf5-4eea-9d49-e83eecc2ee2a tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:01.443960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8d42a-cdf5-4eea-9d49-e83eecc2ee2a tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:01.446159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8d42a-cdf5-4eea-9d49-e83eecc2ee2a tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:01.471003 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3638/7243] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 10:16:01 2022] POST /identity/v3/roles => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:01.475532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c65cd-dfdd-4907-9722-a3e0a24dcf9c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:01.491031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c65cd-dfdd-4907-9722-a3e0a24dcf9c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:01.500192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b19c16-5c2f-44fa-936a-c0d5f49eb553 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:01.501121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b19c16-5c2f-44fa-936a-c0d5f49eb553 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:01.501449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b19c16-5c2f-44fa-936a-c0d5f49eb553 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:01.501779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b19c16-5c2f-44fa-936a-c0d5f49eb553 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains/9ecd380bb03044a495efdb53dd9b392a/users/ee511d50453c4c7a908e29b2e2ec3127/roles/b074fbbbb690432bb70628a7ee694c00` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:01.519766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b19c16-5c2f-44fa-936a-c0d5f49eb553 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=9ecd380bb03044a495efdb53dd9b392a, user_id=ee511d50453c4c7a908e29b2e2ec3127, role_id=b074fbbbb690432bb70628a7ee694c00)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:01.523257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b19c16-5c2f-44fa-936a-c0d5f49eb553 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:01.555949 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3606/7244] 10.222.0.16 () {60 vars in 1480 bytes} [Fri Sep 30 10:16:01 2022] PUT /identity/v3/domains/9ecd380bb03044a495efdb53dd9b392a/users/ee511d50453c4c7a908e29b2e2ec3127/roles/b074fbbbb690432bb70628a7ee694c00 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:01.560697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8d42a-cdf5-4eea-9d49-e83eecc2ee2a tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:01.587146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8d42a-cdf5-4eea-9d49-e83eecc2ee2a tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:01.677736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995d2c6-05bd-4fe2-bee8-2812183b9ddb tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:01.678468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995d2c6-05bd-4fe2-bee8-2812183b9ddb tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:01.678820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995d2c6-05bd-4fe2-bee8-2812183b9ddb tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:01.679168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995d2c6-05bd-4fe2-bee8-2812183b9ddb tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:01.679917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995d2c6-05bd-4fe2-bee8-2812183b9ddb tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:01.681607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995d2c6-05bd-4fe2-bee8-2812183b9ddb tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:01.708918 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3639/7245] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:16:01 2022] POST /identity/v3/domains => generated 276 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:01.710111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b19c16-5c2f-44fa-936a-c0d5f49eb553 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:01.735387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b19c16-5c2f-44fa-936a-c0d5f49eb553 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:01.875238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e466ec-419b-4413-8226-65d9ee0d0348 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:01.876238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e466ec-419b-4413-8226-65d9ee0d0348 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:01.876744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e466ec-419b-4413-8226-65d9ee0d0348 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:01.877198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e466ec-419b-4413-8226-65d9ee0d0348 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:01.878181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e466ec-419b-4413-8226-65d9ee0d0348 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:01.879963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e466ec-419b-4413-8226-65d9ee0d0348 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:01.926039 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3607/7246] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 10:16:01 2022] POST /identity/v3/roles => generated 239 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:01.927200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995d2c6-05bd-4fe2-bee8-2812183b9ddb tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:01.950659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995d2c6-05bd-4fe2-bee8-2812183b9ddb tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:01.955771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614de7d-6ecc-496a-a67b-f770f2b304ae tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:01.957376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614de7d-6ecc-496a-a67b-f770f2b304ae tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:01.957481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614de7d-6ecc-496a-a67b-f770f2b304ae tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:01.957749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614de7d-6ecc-496a-a67b-f770f2b304ae tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:01.958394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614de7d-6ecc-496a-a67b-f770f2b304ae tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:01.960472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614de7d-6ecc-496a-a67b-f770f2b304ae tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:02.000895 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3640/7247] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Sep 30 10:16:01 2022] POST /identity/v3/groups => generated 326 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:16:02.004676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e466ec-419b-4413-8226-65d9ee0d0348 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:02.023169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e466ec-419b-4413-8226-65d9ee0d0348 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:02.032886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d76d6-d417-4905-83a7-d5bce0351a12 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:02.034306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d76d6-d417-4905-83a7-d5bce0351a12 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:02.034598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d76d6-d417-4905-83a7-d5bce0351a12 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:02.034878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d76d6-d417-4905-83a7-d5bce0351a12 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/groups/3d0a79035eb1488fad34edc110d1ccde/users/ee511d50453c4c7a908e29b2e2ec3127` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:02.052735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d76d6-d417-4905-83a7-d5bce0351a12 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=3d0a79035eb1488fad34edc110d1ccde, user_id=ee511d50453c4c7a908e29b2e2ec3127)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:02.059569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d76d6-d417-4905-83a7-d5bce0351a12 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:02.107956 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3608/7248] 10.222.0.16 () {60 vars in 1360 bytes} [Fri Sep 30 10:16:02 2022] PUT /identity/v3/groups/3d0a79035eb1488fad34edc110d1ccde/users/ee511d50453c4c7a908e29b2e2ec3127 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:02.109047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614de7d-6ecc-496a-a67b-f770f2b304ae tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:02.123161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614de7d-6ecc-496a-a67b-f770f2b304ae tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:02.281759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71650a50-b5e1-4151-a0aa-407063c510c4 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:02.282609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71650a50-b5e1-4151-a0aa-407063c510c4 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:02.283007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71650a50-b5e1-4151-a0aa-407063c510c4 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:02.283733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71650a50-b5e1-4151-a0aa-407063c510c4 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains/6d271c7a54c34010ab17a353d97368a8/groups/3d0a79035eb1488fad34edc110d1ccde/roles/22c5acac8906427e9ad0befa7eda9c8e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:02.290632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71650a50-b5e1-4151-a0aa-407063c510c4 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=6d271c7a54c34010ab17a353d97368a8, group_id=3d0a79035eb1488fad34edc110d1ccde, role_id=22c5acac8906427e9ad0befa7eda9c8e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:02.293538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71650a50-b5e1-4151-a0aa-407063c510c4 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:02.333303 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3641/7249] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:16:02 2022] PUT /identity/v3/domains/6d271c7a54c34010ab17a353d97368a8/groups/3d0a79035eb1488fad34edc110d1ccde/roles/22c5acac8906427e9ad0befa7eda9c8e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:16:02.334113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d76d6-d417-4905-83a7-d5bce0351a12 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:02.355977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d76d6-d417-4905-83a7-d5bce0351a12 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:02.426977 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:02.446356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f92bbd-1f12-4d58-a8b4-c97b594f9252 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:02.447088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f92bbd-1f12-4d58-a8b4-c97b594f9252 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:02.447472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f92bbd-1f12-4d58-a8b4-c97b594f9252 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:02.447820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f92bbd-1f12-4d58-a8b4-c97b594f9252 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:02.450543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f92bbd-1f12-4d58-a8b4-c97b594f9252 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:02.452063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f92bbd-1f12-4d58-a8b4-c97b594f9252 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:02.476808 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3609/7250] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:16:02 2022] POST /identity/v3/domains => generated 275 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:02.479225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71650a50-b5e1-4151-a0aa-407063c510c4 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:02.494154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71650a50-b5e1-4151-a0aa-407063c510c4 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:02.515754 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:02.652142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d46ea-c2ca-46aa-9f24-3bfb7e24db39 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:02.653012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d46ea-c2ca-46aa-9f24-3bfb7e24db39 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:02.653397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d46ea-c2ca-46aa-9f24-3bfb7e24db39 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:02.653768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d46ea-c2ca-46aa-9f24-3bfb7e24db39 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:02.654562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d46ea-c2ca-46aa-9f24-3bfb7e24db39 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:02.656254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d46ea-c2ca-46aa-9f24-3bfb7e24db39 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:02.686480 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3642/7251] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 10:16:02 2022] POST /identity/v3/roles => generated 239 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:02.691039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f92bbd-1f12-4d58-a8b4-c97b594f9252 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:02.704966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f92bbd-1f12-4d58-a8b4-c97b594f9252 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:02.711034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19803673-42d5-438f-b364-b85c66578cda tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:02.711958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19803673-42d5-438f-b364-b85c66578cda tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:02.712248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19803673-42d5-438f-b364-b85c66578cda tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:02.712528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19803673-42d5-438f-b364-b85c66578cda tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains/b8979ca696154b32b0a8b26a2b4a793e/users/ee511d50453c4c7a908e29b2e2ec3127/roles/f888b916a0d84123be48a5a8f737de6b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:02.732553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19803673-42d5-438f-b364-b85c66578cda tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=b8979ca696154b32b0a8b26a2b4a793e, user_id=ee511d50453c4c7a908e29b2e2ec3127, role_id=f888b916a0d84123be48a5a8f737de6b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:02.736791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19803673-42d5-438f-b364-b85c66578cda tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:02.757895 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3610/7252] 10.222.0.16 () {60 vars in 1480 bytes} [Fri Sep 30 10:16:02 2022] PUT /identity/v3/domains/b8979ca696154b32b0a8b26a2b4a793e/users/ee511d50453c4c7a908e29b2e2ec3127/roles/f888b916a0d84123be48a5a8f737de6b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:02.762957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d46ea-c2ca-46aa-9f24-3bfb7e24db39 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:02.778315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d46ea-c2ca-46aa-9f24-3bfb7e24db39 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:02.885552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff092a-a1f3-4544-b875-73babcc2cad3 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:02.886922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff092a-a1f3-4544-b875-73babcc2cad3 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:02.887473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff092a-a1f3-4544-b875-73babcc2cad3 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:02.887649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff092a-a1f3-4544-b875-73babcc2cad3 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:02.888444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff092a-a1f3-4544-b875-73babcc2cad3 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:02.890235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff092a-a1f3-4544-b875-73babcc2cad3 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:02.919781 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3643/7253] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:16:02 2022] POST /identity/v3/domains => generated 276 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:02.920146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19803673-42d5-438f-b364-b85c66578cda tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:02.935606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19803673-42d5-438f-b364-b85c66578cda tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:03.068292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06a7a7-f99f-48e9-a6de-f281f1858c13 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:03.069428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06a7a7-f99f-48e9-a6de-f281f1858c13 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:03.069884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06a7a7-f99f-48e9-a6de-f281f1858c13 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:03.070257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06a7a7-f99f-48e9-a6de-f281f1858c13 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:03.071554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06a7a7-f99f-48e9-a6de-f281f1858c13 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:03.073680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06a7a7-f99f-48e9-a6de-f281f1858c13 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:03.108644 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3611/7254] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 10:16:02 2022] POST /identity/v3/roles => generated 240 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:03.112430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff092a-a1f3-4544-b875-73babcc2cad3 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:03.132402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff092a-a1f3-4544-b875-73babcc2cad3 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:03.140113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2b399-45a3-4e35-92fd-4dbe96a5aeb7 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:03.141293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2b399-45a3-4e35-92fd-4dbe96a5aeb7 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:03.142740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2b399-45a3-4e35-92fd-4dbe96a5aeb7 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:03.142740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2b399-45a3-4e35-92fd-4dbe96a5aeb7 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:03.142740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2b399-45a3-4e35-92fd-4dbe96a5aeb7 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:03.145038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2b399-45a3-4e35-92fd-4dbe96a5aeb7 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:03.231734 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3644/7255] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Sep 30 10:16:03 2022] POST /identity/v3/groups => generated 327 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:03.235531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06a7a7-f99f-48e9-a6de-f281f1858c13 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:03.250769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06a7a7-f99f-48e9-a6de-f281f1858c13 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:03.259779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f427e5c-6795-4d63-a599-2dcbe0918ea9 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:03.261891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f427e5c-6795-4d63-a599-2dcbe0918ea9 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:03.262065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f427e5c-6795-4d63-a599-2dcbe0918ea9 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:03.263439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f427e5c-6795-4d63-a599-2dcbe0918ea9 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/groups/f2c6291218f04bcc85f8f7de5e404679/users/ee511d50453c4c7a908e29b2e2ec3127` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:03.271655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f427e5c-6795-4d63-a599-2dcbe0918ea9 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=f2c6291218f04bcc85f8f7de5e404679, user_id=ee511d50453c4c7a908e29b2e2ec3127)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:03.274822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f427e5c-6795-4d63-a599-2dcbe0918ea9 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:03.322663 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3612/7256] 10.222.0.16 () {60 vars in 1360 bytes} [Fri Sep 30 10:16:03 2022] PUT /identity/v3/groups/f2c6291218f04bcc85f8f7de5e404679/users/ee511d50453c4c7a908e29b2e2ec3127 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:03.328449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2b399-45a3-4e35-92fd-4dbe96a5aeb7 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:03.356494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2b399-45a3-4e35-92fd-4dbe96a5aeb7 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:03.464117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa08b0-1e5a-4d10-9023-8a84894f685f tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:03.464872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa08b0-1e5a-4d10-9023-8a84894f685f tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:03.465161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa08b0-1e5a-4d10-9023-8a84894f685f tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:03.465837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa08b0-1e5a-4d10-9023-8a84894f685f tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains/6f184d4e7059466aac395ac5d8213d64/groups/f2c6291218f04bcc85f8f7de5e404679/roles/6e251d1ee5504eed9bc8a6086c0f21d1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:03.469576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa08b0-1e5a-4d10-9023-8a84894f685f tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=6f184d4e7059466aac395ac5d8213d64, group_id=f2c6291218f04bcc85f8f7de5e404679, role_id=6e251d1ee5504eed9bc8a6086c0f21d1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:03.473823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa08b0-1e5a-4d10-9023-8a84894f685f tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:03.500422 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3645/7257] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:16:03 2022] PUT /identity/v3/domains/6f184d4e7059466aac395ac5d8213d64/groups/f2c6291218f04bcc85f8f7de5e404679/roles/6e251d1ee5504eed9bc8a6086c0f21d1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:03.504642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f427e5c-6795-4d63-a599-2dcbe0918ea9 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:03.705013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f427e5c-6795-4d63-a599-2dcbe0918ea9 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:03.732224 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:03.868567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09693997-938a-4d0f-b6be-35e41407d028 tempest-TokensV3TestJSON-1238603553 tempest-TokensV3TestJSON-1238603553-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee511d50453c4c7a908e29b2e2ec3127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d13ad514a24b2ebe9464db287196d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:03.869619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09693997-938a-4d0f-b6be-35e41407d028 tempest-TokensV3TestJSON-1238603553 tempest-TokensV3TestJSON-1238603553-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:03.870063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09693997-938a-4d0f-b6be-35e41407d028 tempest-TokensV3TestJSON-1238603553 tempest-TokensV3TestJSON-1238603553-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:03.870581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09693997-938a-4d0f-b6be-35e41407d028 tempest-TokensV3TestJSON-1238603553 tempest-TokensV3TestJSON-1238603553-project] PATH_INFO: `/v3/auth/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:03.871329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09693997-938a-4d0f-b6be-35e41407d028 tempest-TokensV3TestJSON-1238603553 tempest-TokensV3TestJSON-1238603553-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:03.872732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09693997-938a-4d0f-b6be-35e41407d028 tempest-TokensV3TestJSON-1238603553 tempest-TokensV3TestJSON-1238603553-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:03.972223 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3613/7258] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Sep 30 10:16:03 2022] GET /identity/v3/auth/domains => generated 1170 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:16:03.976589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa08b0-1e5a-4d10-9023-8a84894f685f tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:04.028636 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:04.167505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa08b0-1e5a-4d10-9023-8a84894f685f tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:04.176580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301390b5-17d4-4ecc-b270-5d5ce3aa8aa8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:04.177290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301390b5-17d4-4ecc-b270-5d5ce3aa8aa8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:04.177573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301390b5-17d4-4ecc-b270-5d5ce3aa8aa8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:04.177886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301390b5-17d4-4ecc-b270-5d5ce3aa8aa8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains/6f184d4e7059466aac395ac5d8213d64/groups/f2c6291218f04bcc85f8f7de5e404679/roles/6e251d1ee5504eed9bc8a6086c0f21d1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:04.181094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301390b5-17d4-4ecc-b270-5d5ce3aa8aa8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=6f184d4e7059466aac395ac5d8213d64, group_id=f2c6291218f04bcc85f8f7de5e404679, role_id=6e251d1ee5504eed9bc8a6086c0f21d1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:04.184557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301390b5-17d4-4ecc-b270-5d5ce3aa8aa8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:04.193133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-301390b5-17d4-4ecc-b270-5d5ce3aa8aa8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invalidating the token cache because role 6e251d1ee5504eed9bc8a6086c0f21d1 was removed from group f2c6291218f04bcc85f8f7de5e404679 on domain 6f184d4e7059466aac395ac5d8213d64. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:04.193431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-301390b5-17d4-4ecc-b270-5d5ce3aa8aa8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:04.194140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-301390b5-17d4-4ecc-b270-5d5ce3aa8aa8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:04.219427 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3646/7259] 10.222.0.16 () {58 vars in 1467 bytes} [Fri Sep 30 10:16:03 2022] DELETE /identity/v3/domains/6f184d4e7059466aac395ac5d8213d64/groups/f2c6291218f04bcc85f8f7de5e404679/roles/6e251d1ee5504eed9bc8a6086c0f21d1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:16:04.223840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09693997-938a-4d0f-b6be-35e41407d028 tempest-TokensV3TestJSON-1238603553 tempest-TokensV3TestJSON-1238603553-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:04.227629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-09693997-938a-4d0f-b6be-35e41407d028 tempest-TokensV3TestJSON-1238603553 tempest-TokensV3TestJSON-1238603553-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:04.246170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09693997-938a-4d0f-b6be-35e41407d028 tempest-TokensV3TestJSON-1238603553 tempest-TokensV3TestJSON-1238603553-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:04.330099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a1df8-9828-4fe7-95ab-7432dd6ef116 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:04.331654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a1df8-9828-4fe7-95ab-7432dd6ef116 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:04.331951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a1df8-9828-4fe7-95ab-7432dd6ef116 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:04.332236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a1df8-9828-4fe7-95ab-7432dd6ef116 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/groups/f2c6291218f04bcc85f8f7de5e404679/users/ee511d50453c4c7a908e29b2e2ec3127` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:04.334860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a1df8-9828-4fe7-95ab-7432dd6ef116 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=f2c6291218f04bcc85f8f7de5e404679, user_id=ee511d50453c4c7a908e29b2e2ec3127)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:04.337683 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a1df8-9828-4fe7-95ab-7432dd6ef116 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:04.352174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c57a1df8-9828-4fe7-95ab-7432dd6ef116 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ee511d50453c4c7a908e29b2e2ec3127'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:04.383342 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3614/7260] 10.222.0.16 () {58 vars in 1344 bytes} [Fri Sep 30 10:16:04 2022] DELETE /identity/v3/groups/f2c6291218f04bcc85f8f7de5e404679/users/ee511d50453c4c7a908e29b2e2ec3127 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:04.384967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301390b5-17d4-4ecc-b270-5d5ce3aa8aa8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:04.397691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301390b5-17d4-4ecc-b270-5d5ce3aa8aa8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:04.519024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17db872-5647-447c-9a7a-c5ae82bccc1d tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:04.520189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17db872-5647-447c-9a7a-c5ae82bccc1d tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:04.520824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17db872-5647-447c-9a7a-c5ae82bccc1d tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:04.521317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17db872-5647-447c-9a7a-c5ae82bccc1d tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/groups/f2c6291218f04bcc85f8f7de5e404679` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:04.522814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17db872-5647-447c-9a7a-c5ae82bccc1d tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:delete_group(group_id=f2c6291218f04bcc85f8f7de5e404679)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:04.524969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17db872-5647-447c-9a7a-c5ae82bccc1d tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:04.583455 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3647/7261] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Sep 30 10:16:04 2022] DELETE /identity/v3/groups/f2c6291218f04bcc85f8f7de5e404679 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:04.583843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a1df8-9828-4fe7-95ab-7432dd6ef116 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:04.599669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a1df8-9828-4fe7-95ab-7432dd6ef116 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:04.615299 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:04.687384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfdc03-0792-4049-bfb3-d132c5726b3f tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:04.688783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfdc03-0792-4049-bfb3-d132c5726b3f tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:04.689420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfdc03-0792-4049-bfb3-d132c5726b3f tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:04.690531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfdc03-0792-4049-bfb3-d132c5726b3f tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/roles/6e251d1ee5504eed9bc8a6086c0f21d1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:04.691918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfdc03-0792-4049-bfb3-d132c5726b3f tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6e251d1ee5504eed9bc8a6086c0f21d1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:04.694229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfdc03-0792-4049-bfb3-d132c5726b3f tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:04.739438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-30dfdc03-0792-4049-bfb3-d132c5726b3f tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invalidating the token cache because role 6e251d1ee5504eed9bc8a6086c0f21d1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:04.740768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-30dfdc03-0792-4049-bfb3-d132c5726b3f tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:04.742444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-30dfdc03-0792-4049-bfb3-d132c5726b3f tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:04.752547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17db872-5647-447c-9a7a-c5ae82bccc1d tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:04.753573 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3615/7262] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:16:04 2022] DELETE /identity/v3/roles/6e251d1ee5504eed9bc8a6086c0f21d1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:16:04.757305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f17db872-5647-447c-9a7a-c5ae82bccc1d tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:04.775056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17db872-5647-447c-9a7a-c5ae82bccc1d tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:04.978816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a2472-8e8b-4779-a8c3-3d85f6b47332 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:04.981936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a2472-8e8b-4779-a8c3-3d85f6b47332 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:04.982341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a2472-8e8b-4779-a8c3-3d85f6b47332 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:04.982820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a2472-8e8b-4779-a8c3-3d85f6b47332 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains/6f184d4e7059466aac395ac5d8213d64` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:04.984433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a2472-8e8b-4779-a8c3-3d85f6b47332 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6f184d4e7059466aac395ac5d8213d64)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:04.986721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a2472-8e8b-4779-a8c3-3d85f6b47332 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:05.004417 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:05.041753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-656a2472-8e8b-4779-a8c3-3d85f6b47332 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6f184d4e7059466aac395ac5d8213d64'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:05.043537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-656a2472-8e8b-4779-a8c3-3d85f6b47332 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6f184d4e7059466aac395ac5d8213d64'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:05.102394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-656a2472-8e8b-4779-a8c3-3d85f6b47332 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6f184d4e7059466aac395ac5d8213d64'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:05.103108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-656a2472-8e8b-4779-a8c3-3d85f6b47332 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6f184d4e7059466aac395ac5d8213d64'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:05.109952 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3648/7263] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:16:04 2022] PATCH /identity/v3/domains/6f184d4e7059466aac395ac5d8213d64 => generated 277 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:16:05.115567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfdc03-0792-4049-bfb3-d132c5726b3f tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:05.141689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfdc03-0792-4049-bfb3-d132c5726b3f tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:05.246926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71951a75-e2e6-4796-8ae7-2aa1012db474 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:05.247384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71951a75-e2e6-4796-8ae7-2aa1012db474 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:05.247545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71951a75-e2e6-4796-8ae7-2aa1012db474 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:05.247933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71951a75-e2e6-4796-8ae7-2aa1012db474 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains/6f184d4e7059466aac395ac5d8213d64` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:05.267469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71951a75-e2e6-4796-8ae7-2aa1012db474 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6f184d4e7059466aac395ac5d8213d64)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:05.272016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71951a75-e2e6-4796-8ae7-2aa1012db474 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:05.317060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-71951a75-e2e6-4796-8ae7-2aa1012db474 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6f184d4e7059466aac395ac5d8213d64'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:05.327393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-71951a75-e2e6-4796-8ae7-2aa1012db474 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6f184d4e7059466aac395ac5d8213d64'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:05.464887 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:05.478327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-71951a75-e2e6-4796-8ae7-2aa1012db474 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f184d4e7059466aac395ac5d8213d64', 'request_id': 'req-71951a75-e2e6-4796-8ae7-2aa1012db474'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:05.500116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-71951a75-e2e6-4796-8ae7-2aa1012db474 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f184d4e7059466aac395ac5d8213d64', 'request_id': 'req-71951a75-e2e6-4796-8ae7-2aa1012db474'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:05.512640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-71951a75-e2e6-4796-8ae7-2aa1012db474 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f184d4e7059466aac395ac5d8213d64', 'request_id': 'req-71951a75-e2e6-4796-8ae7-2aa1012db474'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:05.546809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-71951a75-e2e6-4796-8ae7-2aa1012db474 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] The token cache is being invalidate because project 6f184d4e7059466aac395ac5d8213d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:05.547190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-71951a75-e2e6-4796-8ae7-2aa1012db474 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:05.548093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-71951a75-e2e6-4796-8ae7-2aa1012db474 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:05.568916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-71951a75-e2e6-4796-8ae7-2aa1012db474 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6f184d4e7059466aac395ac5d8213d64', 'request_id': 'req-71951a75-e2e6-4796-8ae7-2aa1012db474'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:05.578446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-71951a75-e2e6-4796-8ae7-2aa1012db474 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6f184d4e7059466aac395ac5d8213d64', 'request_id': 'req-71951a75-e2e6-4796-8ae7-2aa1012db474'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:05.579176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-71951a75-e2e6-4796-8ae7-2aa1012db474 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6f184d4e7059466aac395ac5d8213d64', 'request_id': 'req-71951a75-e2e6-4796-8ae7-2aa1012db474'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:05.589117 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3616/7264] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:16:05 2022] DELETE /identity/v3/domains/6f184d4e7059466aac395ac5d8213d64 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:05.593181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a2472-8e8b-4779-a8c3-3d85f6b47332 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:05.595774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-656a2472-8e8b-4779-a8c3-3d85f6b47332 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:05.627586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a2472-8e8b-4779-a8c3-3d85f6b47332 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:05.717386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd165dc-2794-43cc-bab8-bed4f6c0e95e tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:05.718075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd165dc-2794-43cc-bab8-bed4f6c0e95e tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:05.718353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd165dc-2794-43cc-bab8-bed4f6c0e95e tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:05.718627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd165dc-2794-43cc-bab8-bed4f6c0e95e tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains/b8979ca696154b32b0a8b26a2b4a793e/users/ee511d50453c4c7a908e29b2e2ec3127/roles/f888b916a0d84123be48a5a8f737de6b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:05.725941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd165dc-2794-43cc-bab8-bed4f6c0e95e tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=b8979ca696154b32b0a8b26a2b4a793e, user_id=ee511d50453c4c7a908e29b2e2ec3127, role_id=f888b916a0d84123be48a5a8f737de6b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:05.728889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd165dc-2794-43cc-bab8-bed4f6c0e95e tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:05.748293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4dd165dc-2794-43cc-bab8-bed4f6c0e95e tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invalidating the token cache because role f888b916a0d84123be48a5a8f737de6b was removed from user ee511d50453c4c7a908e29b2e2ec3127 on domain b8979ca696154b32b0a8b26a2b4a793e. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:05.748638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4dd165dc-2794-43cc-bab8-bed4f6c0e95e tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:05.749416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4dd165dc-2794-43cc-bab8-bed4f6c0e95e tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:05.770202 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3649/7265] 10.222.0.16 () {58 vars in 1464 bytes} [Fri Sep 30 10:16:05 2022] DELETE /identity/v3/domains/b8979ca696154b32b0a8b26a2b4a793e/users/ee511d50453c4c7a908e29b2e2ec3127/roles/f888b916a0d84123be48a5a8f737de6b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:05.775704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71951a75-e2e6-4796-8ae7-2aa1012db474 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:05.779275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-71951a75-e2e6-4796-8ae7-2aa1012db474 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:05.808468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71951a75-e2e6-4796-8ae7-2aa1012db474 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:05.962408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c554959-a1ee-483a-8505-270a4095e9e1 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:05.963318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c554959-a1ee-483a-8505-270a4095e9e1 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:05.964320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c554959-a1ee-483a-8505-270a4095e9e1 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:05.966364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c554959-a1ee-483a-8505-270a4095e9e1 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/roles/f888b916a0d84123be48a5a8f737de6b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:05.972549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c554959-a1ee-483a-8505-270a4095e9e1 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f888b916a0d84123be48a5a8f737de6b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:05.975923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c554959-a1ee-483a-8505-270a4095e9e1 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:06.124160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8c554959-a1ee-483a-8505-270a4095e9e1 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invalidating the token cache because role f888b916a0d84123be48a5a8f737de6b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:06.124488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8c554959-a1ee-483a-8505-270a4095e9e1 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:06.125189 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8c554959-a1ee-483a-8505-270a4095e9e1 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:06.128257 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3617/7266] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:16:05 2022] DELETE /identity/v3/roles/f888b916a0d84123be48a5a8f737de6b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:06.131096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd165dc-2794-43cc-bab8-bed4f6c0e95e tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:06.132501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4dd165dc-2794-43cc-bab8-bed4f6c0e95e tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:06.153004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd165dc-2794-43cc-bab8-bed4f6c0e95e tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:06.360844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1be0a-36de-4e06-ae21-10f3dbe7b105 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:06.362556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1be0a-36de-4e06-ae21-10f3dbe7b105 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:06.363661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1be0a-36de-4e06-ae21-10f3dbe7b105 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:06.364182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1be0a-36de-4e06-ae21-10f3dbe7b105 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains/b8979ca696154b32b0a8b26a2b4a793e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:06.366030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1be0a-36de-4e06-ae21-10f3dbe7b105 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b8979ca696154b32b0a8b26a2b4a793e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:06.368795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1be0a-36de-4e06-ae21-10f3dbe7b105 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:06.422302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-55a1be0a-36de-4e06-ae21-10f3dbe7b105 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b8979ca696154b32b0a8b26a2b4a793e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:06.425101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-55a1be0a-36de-4e06-ae21-10f3dbe7b105 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b8979ca696154b32b0a8b26a2b4a793e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:06.493984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-55a1be0a-36de-4e06-ae21-10f3dbe7b105 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b8979ca696154b32b0a8b26a2b4a793e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:06.496272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-55a1be0a-36de-4e06-ae21-10f3dbe7b105 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b8979ca696154b32b0a8b26a2b4a793e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:06.503091 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3650/7267] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:16:06 2022] PATCH /identity/v3/domains/b8979ca696154b32b0a8b26a2b4a793e => generated 276 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:16:06.506761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c554959-a1ee-483a-8505-270a4095e9e1 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:06.508329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8c554959-a1ee-483a-8505-270a4095e9e1 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:06.538673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c554959-a1ee-483a-8505-270a4095e9e1 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:06.695347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf4a28-b9d9-4861-ba92-947d93adfe95 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:06.696007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf4a28-b9d9-4861-ba92-947d93adfe95 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:06.696306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf4a28-b9d9-4861-ba92-947d93adfe95 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:06.696570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf4a28-b9d9-4861-ba92-947d93adfe95 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains/b8979ca696154b32b0a8b26a2b4a793e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:06.753732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf4a28-b9d9-4861-ba92-947d93adfe95 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b8979ca696154b32b0a8b26a2b4a793e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:06.756570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf4a28-b9d9-4861-ba92-947d93adfe95 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:06.806840 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:06.831044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6cbf4a28-b9d9-4861-ba92-947d93adfe95 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b8979ca696154b32b0a8b26a2b4a793e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:06.851600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6cbf4a28-b9d9-4861-ba92-947d93adfe95 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b8979ca696154b32b0a8b26a2b4a793e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:07.000333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6cbf4a28-b9d9-4861-ba92-947d93adfe95 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8979ca696154b32b0a8b26a2b4a793e', 'request_id': 'req-6cbf4a28-b9d9-4861-ba92-947d93adfe95'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:07.018094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d157812-d6f6-4194-a3a8-16e5ea138a4f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:07.018640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d157812-d6f6-4194-a3a8-16e5ea138a4f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:07.018976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d157812-d6f6-4194-a3a8-16e5ea138a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:07.019765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6cbf4a28-b9d9-4861-ba92-947d93adfe95 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8979ca696154b32b0a8b26a2b4a793e', 'request_id': 'req-6cbf4a28-b9d9-4861-ba92-947d93adfe95'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:07.045638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6cbf4a28-b9d9-4861-ba92-947d93adfe95 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8979ca696154b32b0a8b26a2b4a793e', 'request_id': 'req-6cbf4a28-b9d9-4861-ba92-947d93adfe95'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:07.046386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1d157812-d6f6-4194-a3a8-16e5ea138a4f None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:07.050430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1d157812-d6f6-4194-a3a8-16e5ea138a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:07.067753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6cbf4a28-b9d9-4861-ba92-947d93adfe95 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] The token cache is being invalidate because project b8979ca696154b32b0a8b26a2b4a793e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:07.068173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6cbf4a28-b9d9-4861-ba92-947d93adfe95 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:07.069103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6cbf4a28-b9d9-4861-ba92-947d93adfe95 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:07.081191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6cbf4a28-b9d9-4861-ba92-947d93adfe95 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b8979ca696154b32b0a8b26a2b4a793e', 'request_id': 'req-6cbf4a28-b9d9-4861-ba92-947d93adfe95'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:07.086293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6cbf4a28-b9d9-4861-ba92-947d93adfe95 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b8979ca696154b32b0a8b26a2b4a793e', 'request_id': 'req-6cbf4a28-b9d9-4861-ba92-947d93adfe95'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:07.089420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6cbf4a28-b9d9-4861-ba92-947d93adfe95 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b8979ca696154b32b0a8b26a2b4a793e', 'request_id': 'req-6cbf4a28-b9d9-4861-ba92-947d93adfe95'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:07.097584 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3618/7268] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:16:06 2022] DELETE /identity/v3/domains/b8979ca696154b32b0a8b26a2b4a793e => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:07.101822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf4a28-b9d9-4861-ba92-947d93adfe95 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:07.103418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6cbf4a28-b9d9-4861-ba92-947d93adfe95 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:07.195296 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:UPDATE=2,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:07.328911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf4a28-b9d9-4861-ba92-947d93adfe95 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:07.343897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f15c00-70a6-4ee7-ac3e-38ad6fc74702 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:07.344806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f15c00-70a6-4ee7-ac3e-38ad6fc74702 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:07.345112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f15c00-70a6-4ee7-ac3e-38ad6fc74702 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:07.345983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f15c00-70a6-4ee7-ac3e-38ad6fc74702 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains/6d271c7a54c34010ab17a353d97368a8/groups/3d0a79035eb1488fad34edc110d1ccde/roles/22c5acac8906427e9ad0befa7eda9c8e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:07.352375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f15c00-70a6-4ee7-ac3e-38ad6fc74702 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=6d271c7a54c34010ab17a353d97368a8, group_id=3d0a79035eb1488fad34edc110d1ccde, role_id=22c5acac8906427e9ad0befa7eda9c8e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:07.359388 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3651/7269] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:16:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:07.361424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f15c00-70a6-4ee7-ac3e-38ad6fc74702 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:07.378394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-12f15c00-70a6-4ee7-ac3e-38ad6fc74702 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invalidating the token cache because role 22c5acac8906427e9ad0befa7eda9c8e was removed from group 3d0a79035eb1488fad34edc110d1ccde on domain 6d271c7a54c34010ab17a353d97368a8. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:07.379338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-12f15c00-70a6-4ee7-ac3e-38ad6fc74702 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:07.384559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-12f15c00-70a6-4ee7-ac3e-38ad6fc74702 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:07.411715 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3619/7270] 10.222.0.16 () {58 vars in 1467 bytes} [Fri Sep 30 10:16:07 2022] DELETE /identity/v3/domains/6d271c7a54c34010ab17a353d97368a8/groups/3d0a79035eb1488fad34edc110d1ccde/roles/22c5acac8906427e9ad0befa7eda9c8e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:07.416020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d157812-d6f6-4194-a3a8-16e5ea138a4f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:07.438564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f15c00-70a6-4ee7-ac3e-38ad6fc74702 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:07.441201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d157812-d6f6-4194-a3a8-16e5ea138a4f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:07.444032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-12f15c00-70a6-4ee7-ac3e-38ad6fc74702 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:07.549092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc908c7c-3c85-42be-9265-da67767a9898 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:07.549323 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:07.550474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc908c7c-3c85-42be-9265-da67767a9898 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:07.551095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc908c7c-3c85-42be-9265-da67767a9898 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:07.551541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc908c7c-3c85-42be-9265-da67767a9898 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/groups/3d0a79035eb1488fad34edc110d1ccde/users/ee511d50453c4c7a908e29b2e2ec3127` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:07.554313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc908c7c-3c85-42be-9265-da67767a9898 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=3d0a79035eb1488fad34edc110d1ccde, user_id=ee511d50453c4c7a908e29b2e2ec3127)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:07.560403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc908c7c-3c85-42be-9265-da67767a9898 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:07.579346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dc908c7c-3c85-42be-9265-da67767a9898 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ee511d50453c4c7a908e29b2e2ec3127'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:07.628739 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3652/7271] 10.222.0.16 () {58 vars in 1344 bytes} [Fri Sep 30 10:16:07 2022] DELETE /identity/v3/groups/3d0a79035eb1488fad34edc110d1ccde/users/ee511d50453c4c7a908e29b2e2ec3127 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:07.633426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc908c7c-3c85-42be-9265-da67767a9898 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:07.638557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dc908c7c-3c85-42be-9265-da67767a9898 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:07.676887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f15c00-70a6-4ee7-ac3e-38ad6fc74702 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:07.788540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc908c7c-3c85-42be-9265-da67767a9898 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:07.808580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ced26c-8b55-4927-95d0-303c66451d37 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:07.808580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ced26c-8b55-4927-95d0-303c66451d37 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:07.808580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ced26c-8b55-4927-95d0-303c66451d37 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:07.809024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ced26c-8b55-4927-95d0-303c66451d37 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/groups/3d0a79035eb1488fad34edc110d1ccde` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:07.809024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ced26c-8b55-4927-95d0-303c66451d37 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:delete_group(group_id=3d0a79035eb1488fad34edc110d1ccde)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:07.809024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ced26c-8b55-4927-95d0-303c66451d37 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:07.812897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b8cc4-76be-4cd1-80bb-8220140dbfef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:07.813661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b8cc4-76be-4cd1-80bb-8220140dbfef service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:07.814330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b8cc4-76be-4cd1-80bb-8220140dbfef service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:07.814611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b8cc4-76be-4cd1-80bb-8220140dbfef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:07.817098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-380b8cc4-76be-4cd1-80bb-8220140dbfef service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:07.898266 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3653/7272] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Sep 30 10:16:07 2022] DELETE /identity/v3/groups/3d0a79035eb1488fad34edc110d1ccde => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:07.900288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ced26c-8b55-4927-95d0-303c66451d37 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:07.917420 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:07.966363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b8cc4-76be-4cd1-80bb-8220140dbfef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:07.968266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b8cc4-76be-4cd1-80bb-8220140dbfef service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:07.980886 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3620/7273] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:16:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:16:08.125033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ced26c-8b55-4927-95d0-303c66451d37 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:08.147388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dd1e0-5288-4630-b9d9-a1815478a7f8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:08.154407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dd1e0-5288-4630-b9d9-a1815478a7f8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:08.154660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dd1e0-5288-4630-b9d9-a1815478a7f8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:08.154976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dd1e0-5288-4630-b9d9-a1815478a7f8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/roles/22c5acac8906427e9ad0befa7eda9c8e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:08.161723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23dd1e0-5288-4630-b9d9-a1815478a7f8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:delete_role(role_id=22c5acac8906427e9ad0befa7eda9c8e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:08.164371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23dd1e0-5288-4630-b9d9-a1815478a7f8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:08.293982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f23dd1e0-5288-4630-b9d9-a1815478a7f8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invalidating the token cache because role 22c5acac8906427e9ad0befa7eda9c8e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:08.295092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f23dd1e0-5288-4630-b9d9-a1815478a7f8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:08.298815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f23dd1e0-5288-4630-b9d9-a1815478a7f8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:08.303422 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3654/7274] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:16:07 2022] DELETE /identity/v3/roles/22c5acac8906427e9ad0befa7eda9c8e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:08.308535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b8cc4-76be-4cd1-80bb-8220140dbfef service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:08.330170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b8cc4-76be-4cd1-80bb-8220140dbfef service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:08.535449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ab588-0f32-47d8-bb2b-987b72ae5e3c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:08.535449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ab588-0f32-47d8-bb2b-987b72ae5e3c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:08.535449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ab588-0f32-47d8-bb2b-987b72ae5e3c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:08.535867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ab588-0f32-47d8-bb2b-987b72ae5e3c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains/6d271c7a54c34010ab17a353d97368a8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:08.536060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ab588-0f32-47d8-bb2b-987b72ae5e3c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6d271c7a54c34010ab17a353d97368a8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:08.537823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ab588-0f32-47d8-bb2b-987b72ae5e3c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:08.586814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d4ab588-0f32-47d8-bb2b-987b72ae5e3c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6d271c7a54c34010ab17a353d97368a8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:08.588627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d4ab588-0f32-47d8-bb2b-987b72ae5e3c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6d271c7a54c34010ab17a353d97368a8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:08.607736 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:08.647079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d4ab588-0f32-47d8-bb2b-987b72ae5e3c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6d271c7a54c34010ab17a353d97368a8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:08.647832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d4ab588-0f32-47d8-bb2b-987b72ae5e3c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6d271c7a54c34010ab17a353d97368a8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:08.652398 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3621/7275] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:16:08 2022] PATCH /identity/v3/domains/6d271c7a54c34010ab17a353d97368a8 => generated 277 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:16:08.656911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dd1e0-5288-4630-b9d9-a1815478a7f8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:08.658529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f23dd1e0-5288-4630-b9d9-a1815478a7f8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:08.682753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dd1e0-5288-4630-b9d9-a1815478a7f8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:08.791020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944e45f-ff64-4f16-9603-ea7ea84168fa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:08.792081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944e45f-ff64-4f16-9603-ea7ea84168fa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:08.792705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944e45f-ff64-4f16-9603-ea7ea84168fa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:08.793141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944e45f-ff64-4f16-9603-ea7ea84168fa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains/6d271c7a54c34010ab17a353d97368a8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:08.816100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944e45f-ff64-4f16-9603-ea7ea84168fa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6d271c7a54c34010ab17a353d97368a8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:08.818287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944e45f-ff64-4f16-9603-ea7ea84168fa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:08.858909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b944e45f-ff64-4f16-9603-ea7ea84168fa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6d271c7a54c34010ab17a353d97368a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:08.863678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b944e45f-ff64-4f16-9603-ea7ea84168fa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6d271c7a54c34010ab17a353d97368a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:08.967224 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:09.002345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b944e45f-ff64-4f16-9603-ea7ea84168fa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d271c7a54c34010ab17a353d97368a8', 'request_id': 'req-b944e45f-ff64-4f16-9603-ea7ea84168fa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:09.022704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b944e45f-ff64-4f16-9603-ea7ea84168fa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d271c7a54c34010ab17a353d97368a8', 'request_id': 'req-b944e45f-ff64-4f16-9603-ea7ea84168fa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:09.034119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b944e45f-ff64-4f16-9603-ea7ea84168fa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d271c7a54c34010ab17a353d97368a8', 'request_id': 'req-b944e45f-ff64-4f16-9603-ea7ea84168fa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:09.057256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b944e45f-ff64-4f16-9603-ea7ea84168fa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] The token cache is being invalidate because project 6d271c7a54c34010ab17a353d97368a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:09.057256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b944e45f-ff64-4f16-9603-ea7ea84168fa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:09.061316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b944e45f-ff64-4f16-9603-ea7ea84168fa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:09.070685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b944e45f-ff64-4f16-9603-ea7ea84168fa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6d271c7a54c34010ab17a353d97368a8', 'request_id': 'req-b944e45f-ff64-4f16-9603-ea7ea84168fa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:09.071750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b944e45f-ff64-4f16-9603-ea7ea84168fa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6d271c7a54c34010ab17a353d97368a8', 'request_id': 'req-b944e45f-ff64-4f16-9603-ea7ea84168fa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:09.081309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b944e45f-ff64-4f16-9603-ea7ea84168fa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6d271c7a54c34010ab17a353d97368a8', 'request_id': 'req-b944e45f-ff64-4f16-9603-ea7ea84168fa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:09.095731 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3655/7276] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:16:08 2022] DELETE /identity/v3/domains/6d271c7a54c34010ab17a353d97368a8 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:09.100042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ab588-0f32-47d8-bb2b-987b72ae5e3c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:09.102056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5d4ab588-0f32-47d8-bb2b-987b72ae5e3c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:09.140222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ab588-0f32-47d8-bb2b-987b72ae5e3c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:09.336278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83370560-d6bf-4a3d-bf34-b10a9e3c1bce tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:09.336644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83370560-d6bf-4a3d-bf34-b10a9e3c1bce tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:09.336897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83370560-d6bf-4a3d-bf34-b10a9e3c1bce tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:09.337171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83370560-d6bf-4a3d-bf34-b10a9e3c1bce tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains/9ecd380bb03044a495efdb53dd9b392a/users/ee511d50453c4c7a908e29b2e2ec3127/roles/b074fbbbb690432bb70628a7ee694c00` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:09.342843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83370560-d6bf-4a3d-bf34-b10a9e3c1bce tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=9ecd380bb03044a495efdb53dd9b392a, user_id=ee511d50453c4c7a908e29b2e2ec3127, role_id=b074fbbbb690432bb70628a7ee694c00)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:09.346968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83370560-d6bf-4a3d-bf34-b10a9e3c1bce tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:09.360983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-83370560-d6bf-4a3d-bf34-b10a9e3c1bce tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invalidating the token cache because role b074fbbbb690432bb70628a7ee694c00 was removed from user ee511d50453c4c7a908e29b2e2ec3127 on domain 9ecd380bb03044a495efdb53dd9b392a. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:09.361363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-83370560-d6bf-4a3d-bf34-b10a9e3c1bce tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:09.365891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-83370560-d6bf-4a3d-bf34-b10a9e3c1bce tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:09.395150 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3622/7277] 10.222.0.16 () {58 vars in 1464 bytes} [Fri Sep 30 10:16:09 2022] DELETE /identity/v3/domains/9ecd380bb03044a495efdb53dd9b392a/users/ee511d50453c4c7a908e29b2e2ec3127/roles/b074fbbbb690432bb70628a7ee694c00 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:09.399308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944e45f-ff64-4f16-9603-ea7ea84168fa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:09.402585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b944e45f-ff64-4f16-9603-ea7ea84168fa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:09.439179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944e45f-ff64-4f16-9603-ea7ea84168fa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:09.574581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b76ac0-5518-437c-938f-bc378baa6226 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:09.577713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b76ac0-5518-437c-938f-bc378baa6226 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:09.581590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b76ac0-5518-437c-938f-bc378baa6226 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:09.581907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b76ac0-5518-437c-938f-bc378baa6226 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/roles/b074fbbbb690432bb70628a7ee694c00` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:09.590135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b76ac0-5518-437c-938f-bc378baa6226 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b074fbbbb690432bb70628a7ee694c00)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:09.600232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b76ac0-5518-437c-938f-bc378baa6226 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:09.676318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d7b76ac0-5518-437c-938f-bc378baa6226 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invalidating the token cache because role b074fbbbb690432bb70628a7ee694c00 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:09.676625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d7b76ac0-5518-437c-938f-bc378baa6226 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:09.679513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d7b76ac0-5518-437c-938f-bc378baa6226 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:09.684515 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3656/7278] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:16:09 2022] DELETE /identity/v3/roles/b074fbbbb690432bb70628a7ee694c00 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:09.689345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83370560-d6bf-4a3d-bf34-b10a9e3c1bce tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:09.690481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-83370560-d6bf-4a3d-bf34-b10a9e3c1bce tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:09.731856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83370560-d6bf-4a3d-bf34-b10a9e3c1bce tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:09.873347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab961dcb-3916-4ab8-ae97-f9440bd2d5fc tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:09.874175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab961dcb-3916-4ab8-ae97-f9440bd2d5fc tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:09.874808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab961dcb-3916-4ab8-ae97-f9440bd2d5fc tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:09.875172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab961dcb-3916-4ab8-ae97-f9440bd2d5fc tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains/9ecd380bb03044a495efdb53dd9b392a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:09.876517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab961dcb-3916-4ab8-ae97-f9440bd2d5fc tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9ecd380bb03044a495efdb53dd9b392a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:09.884213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab961dcb-3916-4ab8-ae97-f9440bd2d5fc tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:09.991408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ab961dcb-3916-4ab8-ae97-f9440bd2d5fc tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9ecd380bb03044a495efdb53dd9b392a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:09.998500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ab961dcb-3916-4ab8-ae97-f9440bd2d5fc tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9ecd380bb03044a495efdb53dd9b392a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:10.067677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ab961dcb-3916-4ab8-ae97-f9440bd2d5fc tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9ecd380bb03044a495efdb53dd9b392a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:10.068320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ab961dcb-3916-4ab8-ae97-f9440bd2d5fc tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9ecd380bb03044a495efdb53dd9b392a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:10.076675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b76ac0-5518-437c-938f-bc378baa6226 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:10.078392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d7b76ac0-5518-437c-938f-bc378baa6226 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:10.083175 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3623/7279] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:16:09 2022] PATCH /identity/v3/domains/9ecd380bb03044a495efdb53dd9b392a => generated 276 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:16:10.101484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b76ac0-5518-437c-938f-bc378baa6226 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:10.322082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddce90-401a-4193-a6bd-2e356de78f51 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:10.325889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddce90-401a-4193-a6bd-2e356de78f51 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:10.327009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddce90-401a-4193-a6bd-2e356de78f51 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:10.327439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddce90-401a-4193-a6bd-2e356de78f51 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains/9ecd380bb03044a495efdb53dd9b392a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:10.357626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddce90-401a-4193-a6bd-2e356de78f51 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9ecd380bb03044a495efdb53dd9b392a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:10.361619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddce90-401a-4193-a6bd-2e356de78f51 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:10.393760 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:10.433276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84ddce90-401a-4193-a6bd-2e356de78f51 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9ecd380bb03044a495efdb53dd9b392a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:10.436958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84ddce90-401a-4193-a6bd-2e356de78f51 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9ecd380bb03044a495efdb53dd9b392a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:10.493319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84ddce90-401a-4193-a6bd-2e356de78f51 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ecd380bb03044a495efdb53dd9b392a', 'request_id': 'req-84ddce90-401a-4193-a6bd-2e356de78f51'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:10.507952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84ddce90-401a-4193-a6bd-2e356de78f51 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ecd380bb03044a495efdb53dd9b392a', 'request_id': 'req-84ddce90-401a-4193-a6bd-2e356de78f51'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:10.522611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84ddce90-401a-4193-a6bd-2e356de78f51 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ecd380bb03044a495efdb53dd9b392a', 'request_id': 'req-84ddce90-401a-4193-a6bd-2e356de78f51'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:10.541920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84ddce90-401a-4193-a6bd-2e356de78f51 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] The token cache is being invalidate because project 9ecd380bb03044a495efdb53dd9b392a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:10.542329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84ddce90-401a-4193-a6bd-2e356de78f51 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:10.543000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84ddce90-401a-4193-a6bd-2e356de78f51 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:10.555588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84ddce90-401a-4193-a6bd-2e356de78f51 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9ecd380bb03044a495efdb53dd9b392a', 'request_id': 'req-84ddce90-401a-4193-a6bd-2e356de78f51'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:10.556442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84ddce90-401a-4193-a6bd-2e356de78f51 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9ecd380bb03044a495efdb53dd9b392a', 'request_id': 'req-84ddce90-401a-4193-a6bd-2e356de78f51'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:10.560862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84ddce90-401a-4193-a6bd-2e356de78f51 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9ecd380bb03044a495efdb53dd9b392a', 'request_id': 'req-84ddce90-401a-4193-a6bd-2e356de78f51'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:10.568035 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3657/7280] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:16:10 2022] DELETE /identity/v3/domains/9ecd380bb03044a495efdb53dd9b392a => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:10.580682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab961dcb-3916-4ab8-ae97-f9440bd2d5fc tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:10.587495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ab961dcb-3916-4ab8-ae97-f9440bd2d5fc tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:10.610822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab961dcb-3916-4ab8-ae97-f9440bd2d5fc tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:10.738742 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:UPDATE=2,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:10.790973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1493b-d041-43ee-a5ca-b9ee010a8c28 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:10.792459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1493b-d041-43ee-a5ca-b9ee010a8c28 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:10.792983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1493b-d041-43ee-a5ca-b9ee010a8c28 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:10.793488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1493b-d041-43ee-a5ca-b9ee010a8c28 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:10.794389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1493b-d041-43ee-a5ca-b9ee010a8c28 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:10.796217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1493b-d041-43ee-a5ca-b9ee010a8c28 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:10.808634 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3624/7281] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:16:10.812916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddce90-401a-4193-a6bd-2e356de78f51 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:10.814725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-84ddce90-401a-4193-a6bd-2e356de78f51 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:10.845422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddce90-401a-4193-a6bd-2e356de78f51 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:10.850788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd84875-c4e9-485d-9294-41651a81869c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:10.851559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd84875-c4e9-485d-9294-41651a81869c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:10.851975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd84875-c4e9-485d-9294-41651a81869c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:10.852465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd84875-c4e9-485d-9294-41651a81869c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/projects/73f8d0f0646c47198b1af494cfb69b07/users/a406d8fae2fb4c6888ca26dc70327c78/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:10.856640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd84875-c4e9-485d-9294-41651a81869c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:create_grant(project_id=73f8d0f0646c47198b1af494cfb69b07, user_id=a406d8fae2fb4c6888ca26dc70327c78, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:10.858660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd84875-c4e9-485d-9294-41651a81869c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:10.879870 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3658/7282] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:16:10 2022] PUT /identity/v3/projects/73f8d0f0646c47198b1af494cfb69b07/users/a406d8fae2fb4c6888ca26dc70327c78/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:10.889958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1493b-d041-43ee-a5ca-b9ee010a8c28 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:10.905152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1493b-d041-43ee-a5ca-b9ee010a8c28 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:11.061420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61012a84-a06c-470c-90ac-7ea78371186c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:11.062188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61012a84-a06c-470c-90ac-7ea78371186c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:11.062581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61012a84-a06c-470c-90ac-7ea78371186c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:11.063057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61012a84-a06c-470c-90ac-7ea78371186c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:11.063731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61012a84-a06c-470c-90ac-7ea78371186c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:11.064978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61012a84-a06c-470c-90ac-7ea78371186c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:11.169441 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3625/7283] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Sep 30 10:16:10 2022] GET /identity/v3/auth/projects => generated 828 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:16:11.174386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd84875-c4e9-485d-9294-41651a81869c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:11.199229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd84875-c4e9-485d-9294-41651a81869c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:11.210985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17740f-0527-4571-a414-539f4184279e tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:11.211813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17740f-0527-4571-a414-539f4184279e tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:11.212191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17740f-0527-4571-a414-539f4184279e tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:11.212565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17740f-0527-4571-a414-539f4184279e tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/projects/73f8d0f0646c47198b1af494cfb69b07/users/a406d8fae2fb4c6888ca26dc70327c78/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:11.216089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17740f-0527-4571-a414-539f4184279e tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=73f8d0f0646c47198b1af494cfb69b07, user_id=a406d8fae2fb4c6888ca26dc70327c78, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:11.223109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17740f-0527-4571-a414-539f4184279e tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:11.235805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7c17740f-0527-4571-a414-539f4184279e tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invalidating the token cache because role f06b5fed717d4b03a5083dd847274296 was removed from user a406d8fae2fb4c6888ca26dc70327c78 on project 73f8d0f0646c47198b1af494cfb69b07. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:11.236212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7c17740f-0527-4571-a414-539f4184279e tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:11.238136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7c17740f-0527-4571-a414-539f4184279e tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:11.261646 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3659/7284] 10.222.0.16 () {58 vars in 1467 bytes} [Fri Sep 30 10:16:11 2022] DELETE /identity/v3/projects/73f8d0f0646c47198b1af494cfb69b07/users/a406d8fae2fb4c6888ca26dc70327c78/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:11.266920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61012a84-a06c-470c-90ac-7ea78371186c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:11.271991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-61012a84-a06c-470c-90ac-7ea78371186c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:11.294762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61012a84-a06c-470c-90ac-7ea78371186c tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:11.479106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d686d64-8183-46d0-905e-b02e89cea1db tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:11.480315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d686d64-8183-46d0-905e-b02e89cea1db tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:11.480616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d686d64-8183-46d0-905e-b02e89cea1db tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:11.496126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d686d64-8183-46d0-905e-b02e89cea1db tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:11.501905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d686d64-8183-46d0-905e-b02e89cea1db tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:11.503842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d686d64-8183-46d0-905e-b02e89cea1db tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:11.584778 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3626/7285] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:16:11 2022] POST /identity/v3/users => generated 323 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:11.585687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17740f-0527-4571-a414-539f4184279e tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:11.610568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17740f-0527-4571-a414-539f4184279e tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:11.624954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198ceac-6322-445b-9c23-eaed9e9acd44 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:11.625660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198ceac-6322-445b-9c23-eaed9e9acd44 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:11.625958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198ceac-6322-445b-9c23-eaed9e9acd44 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:11.626247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198ceac-6322-445b-9c23-eaed9e9acd44 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:11.626879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198ceac-6322-445b-9c23-eaed9e9acd44 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:11.629050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198ceac-6322-445b-9c23-eaed9e9acd44 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:11.695152 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3660/7286] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:16:11 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:11.696306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d686d64-8183-46d0-905e-b02e89cea1db tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:11.711548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d686d64-8183-46d0-905e-b02e89cea1db tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:11.772934 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:11.826764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba9d22-02e1-463a-8861-07031639215a tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:11.827528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba9d22-02e1-463a-8861-07031639215a tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:11.828141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba9d22-02e1-463a-8861-07031639215a tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:11.828538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba9d22-02e1-463a-8861-07031639215a tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:11.829286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba9d22-02e1-463a-8861-07031639215a tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:11.831548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba9d22-02e1-463a-8861-07031639215a tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:11.897088 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3627/7287] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:16:11 2022] POST /identity/v3/projects => generated 364 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:11.901787 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198ceac-6322-445b-9c23-eaed9e9acd44 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:11.918827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198ceac-6322-445b-9c23-eaed9e9acd44 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:12.121014 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:12.142543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657d12f-b598-4643-a58a-221fe2756413 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:12.143180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657d12f-b598-4643-a58a-221fe2756413 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:12.143459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657d12f-b598-4643-a58a-221fe2756413 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:12.143728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657d12f-b598-4643-a58a-221fe2756413 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:12.146410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657d12f-b598-4643-a58a-221fe2756413 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:12.154945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657d12f-b598-4643-a58a-221fe2756413 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:12.208662 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3661/7288] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 10:16:11 2022] POST /identity/v3/roles => generated 240 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:12.210891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba9d22-02e1-463a-8861-07031639215a tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:12.292019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba9d22-02e1-463a-8861-07031639215a tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:12.309779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac8fa8-35d0-4805-a2b2-8e82fe3f5831 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:12.310651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac8fa8-35d0-4805-a2b2-8e82fe3f5831 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:12.311156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac8fa8-35d0-4805-a2b2-8e82fe3f5831 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:12.311536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac8fa8-35d0-4805-a2b2-8e82fe3f5831 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/projects/7aa4f589762747e08b99f959cda1c13f/users/6c0ba288e00a4d858894bf480775a468/roles/8a5fb44aa3574b179eff9ca361457a4a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:12.368686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac8fa8-35d0-4805-a2b2-8e82fe3f5831 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7aa4f589762747e08b99f959cda1c13f, user_id=6c0ba288e00a4d858894bf480775a468, role_id=8a5fb44aa3574b179eff9ca361457a4a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:12.374460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac8fa8-35d0-4805-a2b2-8e82fe3f5831 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:12.426458 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3628/7289] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:16:12 2022] PUT /identity/v3/projects/7aa4f589762747e08b99f959cda1c13f/users/6c0ba288e00a4d858894bf480775a468/roles/8a5fb44aa3574b179eff9ca361457a4a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:12.426834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657d12f-b598-4643-a58a-221fe2756413 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:12.447354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657d12f-b598-4643-a58a-221fe2756413 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:12.639816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399df460-f62f-4a14-92c9-ac0c06d6e7ae tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:12.641997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399df460-f62f-4a14-92c9-ac0c06d6e7ae tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:12.642869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399df460-f62f-4a14-92c9-ac0c06d6e7ae tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:12.643358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399df460-f62f-4a14-92c9-ac0c06d6e7ae tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/projects/83775e01c18740608e1f77ec01044675/users/6c0ba288e00a4d858894bf480775a468/roles/8a5fb44aa3574b179eff9ca361457a4a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:12.646154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399df460-f62f-4a14-92c9-ac0c06d6e7ae tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:create_grant(project_id=83775e01c18740608e1f77ec01044675, user_id=6c0ba288e00a4d858894bf480775a468, role_id=8a5fb44aa3574b179eff9ca361457a4a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:12.649173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399df460-f62f-4a14-92c9-ac0c06d6e7ae tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:12.680915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cdc24-6645-4979-a5d0-31f4c1722eb7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:12.682024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cdc24-6645-4979-a5d0-31f4c1722eb7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:12.683507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cdc24-6645-4979-a5d0-31f4c1722eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:12.692945 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3662/7290] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:16:12 2022] PUT /identity/v3/projects/83775e01c18740608e1f77ec01044675/users/6c0ba288e00a4d858894bf480775a468/roles/8a5fb44aa3574b179eff9ca361457a4a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:16:12.724967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-665cdc24-6645-4979-a5d0-31f4c1722eb7 None None] MFA Rules not processed for user `6c0ba288e00a4d858894bf480775a468`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:12.726618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-665cdc24-6645-4979-a5d0-31f4c1722eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:12.736335 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3629/7291] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:12 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 10:16:12.737636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aced9-1711-47ef-ab5f-73252fa6c3d3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:12.737921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aced9-1711-47ef-ab5f-73252fa6c3d3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:12.738216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aced9-1711-47ef-ab5f-73252fa6c3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:12.764132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0e9aced9-1711-47ef-ab5f-73252fa6c3d3 None None] MFA Rules not processed for user `6c0ba288e00a4d858894bf480775a468`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:12.765435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0e9aced9-1711-47ef-ab5f-73252fa6c3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:12.994985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cdc24-6645-4979-a5d0-31f4c1722eb7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:12.998001 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3663/7292] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:12 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Sep 30 10:16:13.090271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cdc24-6645-4979-a5d0-31f4c1722eb7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:13.095421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a803602-3977-45c8-96b5-ac0517e44ffa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:13.096044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a803602-3977-45c8-96b5-ac0517e44ffa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:13.096328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a803602-3977-45c8-96b5-ac0517e44ffa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:13.096635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a803602-3977-45c8-96b5-ac0517e44ffa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:13.110493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a803602-3977-45c8-96b5-ac0517e44ffa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:13.113134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a803602-3977-45c8-96b5-ac0517e44ffa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:13.159227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c86bb-e582-4ce3-873b-2c15a4140339 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:13.159612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c86bb-e582-4ce3-873b-2c15a4140339 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:13.159905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c86bb-e582-4ce3-873b-2c15a4140339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:13.165389 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3630/7293] 10.222.0.16 () {56 vars in 1308 bytes} [Fri Sep 30 10:16:12 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:13.181593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-542c86bb-e582-4ce3-873b-2c15a4140339 None None] MFA Rules not processed for user `6c0ba288e00a4d858894bf480775a468`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:13.184024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-542c86bb-e582-4ce3-873b-2c15a4140339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:13.432861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a803602-3977-45c8-96b5-ac0517e44ffa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:13.440266 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3664/7294] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:13 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Sep 30 10:16:13.459418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a803602-3977-45c8-96b5-ac0517e44ffa tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:13.484918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5f38b-eba9-4beb-8cb4-49a15026f4d7 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:13.485583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5f38b-eba9-4beb-8cb4-49a15026f4d7 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:13.485865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5f38b-eba9-4beb-8cb4-49a15026f4d7 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:13.486139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5f38b-eba9-4beb-8cb4-49a15026f4d7 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/roles/8a5fb44aa3574b179eff9ca361457a4a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:13.487809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5f38b-eba9-4beb-8cb4-49a15026f4d7 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8a5fb44aa3574b179eff9ca361457a4a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:13.489583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5f38b-eba9-4beb-8cb4-49a15026f4d7 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:13.644654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6ae5f38b-eba9-4beb-8cb4-49a15026f4d7 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invalidating the token cache because role 8a5fb44aa3574b179eff9ca361457a4a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:13.645051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6ae5f38b-eba9-4beb-8cb4-49a15026f4d7 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:13.647185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6ae5f38b-eba9-4beb-8cb4-49a15026f4d7 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:13.673870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c86bb-e582-4ce3-873b-2c15a4140339 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:13.676451 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3631/7295] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:16:13 2022] DELETE /identity/v3/roles/8a5fb44aa3574b179eff9ca361457a4a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:13.695262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c86bb-e582-4ce3-873b-2c15a4140339 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:13.747263 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:13.821790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abfe40-1f8f-4173-8daf-55421dc13fa0 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:13.822724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abfe40-1f8f-4173-8daf-55421dc13fa0 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:13.825258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abfe40-1f8f-4173-8daf-55421dc13fa0 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:13.825720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abfe40-1f8f-4173-8daf-55421dc13fa0 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/projects/83775e01c18740608e1f77ec01044675` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:13.827317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59abfe40-1f8f-4173-8daf-55421dc13fa0 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:delete_project(project_id=83775e01c18740608e1f77ec01044675)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:13.829807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59abfe40-1f8f-4173-8daf-55421dc13fa0 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:13.993360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-59abfe40-1f8f-4173-8daf-55421dc13fa0 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83775e01c18740608e1f77ec01044675', 'request_id': 'req-59abfe40-1f8f-4173-8daf-55421dc13fa0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:14.008258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-59abfe40-1f8f-4173-8daf-55421dc13fa0 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83775e01c18740608e1f77ec01044675', 'request_id': 'req-59abfe40-1f8f-4173-8daf-55421dc13fa0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:14.016051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-59abfe40-1f8f-4173-8daf-55421dc13fa0 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83775e01c18740608e1f77ec01044675', 'request_id': 'req-59abfe40-1f8f-4173-8daf-55421dc13fa0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:14.049532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-59abfe40-1f8f-4173-8daf-55421dc13fa0 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] The token cache is being invalidate because project 83775e01c18740608e1f77ec01044675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:14.049914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-59abfe40-1f8f-4173-8daf-55421dc13fa0 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:14.052834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-59abfe40-1f8f-4173-8daf-55421dc13fa0 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:14.063313 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3665/7296] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:16:13 2022] DELETE /identity/v3/projects/83775e01c18740608e1f77ec01044675 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:14.064507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5f38b-eba9-4beb-8cb4-49a15026f4d7 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:14.065975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6ae5f38b-eba9-4beb-8cb4-49a15026f4d7 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:14.088538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5f38b-eba9-4beb-8cb4-49a15026f4d7 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:14.158795 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:14.259021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb7854-13d3-4d84-b8ed-bacaa3fd753b tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:14.259675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb7854-13d3-4d84-b8ed-bacaa3fd753b tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:14.259957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb7854-13d3-4d84-b8ed-bacaa3fd753b tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:14.272680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb7854-13d3-4d84-b8ed-bacaa3fd753b tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/projects/83775e01c18740608e1f77ec01044675` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:14.281384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb7854-13d3-4d84-b8ed-bacaa3fd753b tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:delete_project(project_id=83775e01c18740608e1f77ec01044675)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:14.288048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb7854-13d3-4d84-b8ed-bacaa3fd753b tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:14.317001 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-addb7854-13d3-4d84-b8ed-bacaa3fd753b tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Could not find project: 83775e01c18740608e1f77ec01044675.: keystone.exception.ProjectNotFound: Could not find project: 83775e01c18740608e1f77ec01044675. Sep 30 10:16:14.317001 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:16:14.317001 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:16:14.317001 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:16:14.317001 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:16:14.317001 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:16:14.317001 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:16:14.317001 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:16:14.317001 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:16:14.317001 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:16:14.317001 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:16:14.317001 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:16:14.317001 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Sep 30 10:16:14.317001 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Sep 30 10:16:14.321322 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:16:14.321322 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:16:14.321322 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Sep 30 10:16:14.321322 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Sep 30 10:16:14.321322 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 10:16:14.321322 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 10:16:14.321322 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 10:16:14.321322 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 10:16:14.321322 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 83775e01c18740608e1f77ec01044675. Sep 30 10:16:14.321322 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:16:14.321322 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3632/7297] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:16:14 2022] DELETE /identity/v3/projects/83775e01c18740608e1f77ec01044675 => generated 113 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:16:14.322420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abfe40-1f8f-4173-8daf-55421dc13fa0 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:14.324862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-59abfe40-1f8f-4173-8daf-55421dc13fa0 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:14.350599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abfe40-1f8f-4173-8daf-55421dc13fa0 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:14.364170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5a555-1efc-45da-b60a-31244b8f8237 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:14.364849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5a555-1efc-45da-b60a-31244b8f8237 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:14.365133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5a555-1efc-45da-b60a-31244b8f8237 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:14.365407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5a555-1efc-45da-b60a-31244b8f8237 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/projects/7aa4f589762747e08b99f959cda1c13f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:14.366551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5a555-1efc-45da-b60a-31244b8f8237 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7aa4f589762747e08b99f959cda1c13f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:14.368444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5a555-1efc-45da-b60a-31244b8f8237 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:14.505584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a1f5a555-1efc-45da-b60a-31244b8f8237 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aa4f589762747e08b99f959cda1c13f', 'request_id': 'req-a1f5a555-1efc-45da-b60a-31244b8f8237'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:14.521666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a1f5a555-1efc-45da-b60a-31244b8f8237 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aa4f589762747e08b99f959cda1c13f', 'request_id': 'req-a1f5a555-1efc-45da-b60a-31244b8f8237'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:14.528414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a1f5a555-1efc-45da-b60a-31244b8f8237 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aa4f589762747e08b99f959cda1c13f', 'request_id': 'req-a1f5a555-1efc-45da-b60a-31244b8f8237'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:14.555681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a1f5a555-1efc-45da-b60a-31244b8f8237 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] The token cache is being invalidate because project 7aa4f589762747e08b99f959cda1c13f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:14.555681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a1f5a555-1efc-45da-b60a-31244b8f8237 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:14.556303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a1f5a555-1efc-45da-b60a-31244b8f8237 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:14.558678 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3666/7298] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:16:14 2022] DELETE /identity/v3/projects/7aa4f589762747e08b99f959cda1c13f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:14.563154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb7854-13d3-4d84-b8ed-bacaa3fd753b tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:14.564287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-addb7854-13d3-4d84-b8ed-bacaa3fd753b tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:14.593399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb7854-13d3-4d84-b8ed-bacaa3fd753b tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:14.740718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f9379-3b24-4c0c-98cf-7de5cde903c8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:14.741378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f9379-3b24-4c0c-98cf-7de5cde903c8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:14.741659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f9379-3b24-4c0c-98cf-7de5cde903c8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:14.741928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f9379-3b24-4c0c-98cf-7de5cde903c8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/users/6c0ba288e00a4d858894bf480775a468` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:14.743085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f9379-3b24-4c0c-98cf-7de5cde903c8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6c0ba288e00a4d858894bf480775a468)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:14.745635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f9379-3b24-4c0c-98cf-7de5cde903c8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:14.853017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a1f9379-3b24-4c0c-98cf-7de5cde903c8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c0ba288e00a4d858894bf480775a468'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:14.871509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a1f9379-3b24-4c0c-98cf-7de5cde903c8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c0ba288e00a4d858894bf480775a468'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:14.872236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a1f9379-3b24-4c0c-98cf-7de5cde903c8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c0ba288e00a4d858894bf480775a468'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:14.897164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a1f9379-3b24-4c0c-98cf-7de5cde903c8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c0ba288e00a4d858894bf480775a468'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:14.909939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a1f9379-3b24-4c0c-98cf-7de5cde903c8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c0ba288e00a4d858894bf480775a468'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:14.946347 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3633/7299] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:16:14 2022] DELETE /identity/v3/users/6c0ba288e00a4d858894bf480775a468 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:14.951451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5a555-1efc-45da-b60a-31244b8f8237 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:15.005313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5a555-1efc-45da-b60a-31244b8f8237 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:15.109921 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:15.145341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed6047-9335-4117-97d7-b51414b1d7de tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:15.145996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed6047-9335-4117-97d7-b51414b1d7de tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:15.146278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed6047-9335-4117-97d7-b51414b1d7de tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:15.146550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed6047-9335-4117-97d7-b51414b1d7de tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains/6f184d4e7059466aac395ac5d8213d64` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:15.160343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed6047-9335-4117-97d7-b51414b1d7de tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 10:16:15.182142 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-d0ed6047-9335-4117-97d7-b51414b1d7de tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Could not find domain: 6f184d4e7059466aac395ac5d8213d64.: keystone.exception.DomainNotFound: Could not find domain: 6f184d4e7059466aac395ac5d8213d64. Sep 30 10:16:15.182142 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:16:15.182142 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 30 10:16:15.182142 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 30 10:16:15.182142 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 10:16:15.182142 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 10:16:15.182142 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 10:16:15.182142 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 10:16:15.182142 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 6f184d4e7059466aac395ac5d8213d64. Sep 30 10:16:15.182142 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:16:15.182142 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:16:15.182142 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:16:15.182142 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:16:15.182142 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:16:15.182142 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:16:15.182142 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:16:15.183476 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:16:15.183476 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:16:15.183476 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:16:15.183476 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:16:15.183476 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:16:15.183476 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:16:15.183476 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:16:15.183476 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 30 10:16:15.183476 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 30 10:16:15.183476 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 10:16:15.183476 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 10:16:15.183476 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 10:16:15.183476 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 10:16:15.183476 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:16:15.183476 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:16:15.183476 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:16:15.184888 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:16:15.184888 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:16:15.184888 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:16:15.184888 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:16:15.184888 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 10:16:15.184888 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:16:15.184888 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:16:15.184888 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:16:15.184888 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:16:15.184888 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:16:15.184888 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:16:15.184888 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:16:15.184888 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:16:15.184888 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 30 10:16:15.184888 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 10:16:15.184888 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 6f184d4e7059466aac395ac5d8213d64. Sep 30 10:16:15.184888 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:16:15.187768 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3667/7300] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:16:14 2022] PATCH /identity/v3/domains/6f184d4e7059466aac395ac5d8213d64 => generated 112 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:16:15.191548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f9379-3b24-4c0c-98cf-7de5cde903c8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:15.193652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5a1f9379-3b24-4c0c-98cf-7de5cde903c8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:15.245118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f9379-3b24-4c0c-98cf-7de5cde903c8 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:15.269070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fdc4ba-7f11-4c91-a08a-45d3e04f6c54 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:15.270479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdc4ba-7f11-4c91-a08a-45d3e04f6c54 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:15.272261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdc4ba-7f11-4c91-a08a-45d3e04f6c54 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:15.272650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdc4ba-7f11-4c91-a08a-45d3e04f6c54 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains/b8979ca696154b32b0a8b26a2b4a793e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:15.304503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdc4ba-7f11-4c91-a08a-45d3e04f6c54 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 10:16:15.335367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-56fdc4ba-7f11-4c91-a08a-45d3e04f6c54 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Could not find domain: b8979ca696154b32b0a8b26a2b4a793e.: keystone.exception.DomainNotFound: Could not find domain: b8979ca696154b32b0a8b26a2b4a793e. Sep 30 10:16:15.335367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:16:15.335367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 30 10:16:15.335367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 30 10:16:15.335367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 10:16:15.335367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 10:16:15.335367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 10:16:15.335367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 10:16:15.335367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b8979ca696154b32b0a8b26a2b4a793e. Sep 30 10:16:15.335367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:16:15.335367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:16:15.335367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:16:15.335367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:16:15.335367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:16:15.335367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:16:15.335367 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:16:15.336863 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:16:15.336863 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:16:15.336863 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:16:15.336863 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:16:15.336863 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:16:15.336863 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:16:15.336863 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:16:15.336863 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 30 10:16:15.336863 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 30 10:16:15.336863 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 10:16:15.336863 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 10:16:15.336863 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 10:16:15.336863 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 10:16:15.336863 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:16:15.336863 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:16:15.336863 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:16:15.337967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:16:15.337967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:16:15.337967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:16:15.337967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:16:15.337967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 10:16:15.337967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:16:15.337967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:16:15.337967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:16:15.337967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:16:15.337967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:16:15.337967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:16:15.337967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:16:15.337967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:16:15.337967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 30 10:16:15.337967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 10:16:15.337967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b8979ca696154b32b0a8b26a2b4a793e. Sep 30 10:16:15.337967 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:16:15.339658 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3634/7301] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:16:15 2022] PATCH /identity/v3/domains/b8979ca696154b32b0a8b26a2b4a793e => generated 112 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:16:15.341450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed6047-9335-4117-97d7-b51414b1d7de tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:15.355005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed6047-9335-4117-97d7-b51414b1d7de tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:15.366837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5955ad-025e-4e95-a4f8-6ee2c39248d4 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:15.367487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5955ad-025e-4e95-a4f8-6ee2c39248d4 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:15.367837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5955ad-025e-4e95-a4f8-6ee2c39248d4 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:15.368305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5955ad-025e-4e95-a4f8-6ee2c39248d4 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains/6d271c7a54c34010ab17a353d97368a8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:15.383143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5955ad-025e-4e95-a4f8-6ee2c39248d4 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 10:16:15.406193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-4b5955ad-025e-4e95-a4f8-6ee2c39248d4 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Could not find domain: 6d271c7a54c34010ab17a353d97368a8.: keystone.exception.DomainNotFound: Could not find domain: 6d271c7a54c34010ab17a353d97368a8. Sep 30 10:16:15.406193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:16:15.406193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 30 10:16:15.406193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 30 10:16:15.406193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 10:16:15.406193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 10:16:15.406193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 10:16:15.406193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 10:16:15.406193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 6d271c7a54c34010ab17a353d97368a8. Sep 30 10:16:15.406193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:16:15.406193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:16:15.406193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:16:15.406193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:16:15.406193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:16:15.406193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:16:15.406193 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:16:15.407475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:16:15.407475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:16:15.407475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:16:15.407475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:16:15.407475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:16:15.407475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:16:15.407475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:16:15.407475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 30 10:16:15.407475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 30 10:16:15.407475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 10:16:15.407475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 10:16:15.407475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 10:16:15.407475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 10:16:15.407475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:16:15.407475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:16:15.407475 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:16:15.408511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:16:15.408511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:16:15.408511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:16:15.408511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:16:15.408511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Sep 30 10:16:15.408511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:16:15.408511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:16:15.408511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:16:15.408511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:16:15.408511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:16:15.408511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:16:15.408511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:16:15.408511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:16:15.408511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 30 10:16:15.408511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 10:16:15.408511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 6d271c7a54c34010ab17a353d97368a8. Sep 30 10:16:15.408511 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:16:15.414686 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3668/7302] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:16:15 2022] PATCH /identity/v3/domains/6d271c7a54c34010ab17a353d97368a8 => generated 112 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:16:15.415798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fdc4ba-7f11-4c91-a08a-45d3e04f6c54 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:15.444125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fdc4ba-7f11-4c91-a08a-45d3e04f6c54 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:15.466483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d005d-9df1-4504-9534-165634c25d42 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a406d8fae2fb4c6888ca26dc70327c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e081a9d06834db38506346dd2d4d8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:15.467296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d005d-9df1-4504-9534-165634c25d42 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:15.467645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d005d-9df1-4504-9534-165634c25d42 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:15.467988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d005d-9df1-4504-9534-165634c25d42 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] PATH_INFO: `/v3/domains/9ecd380bb03044a495efdb53dd9b392a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:15.477125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d005d-9df1-4504-9534-165634c25d42 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 10:16:15.484064 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-1e6d005d-9df1-4504-9534-165634c25d42 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Could not find domain: 9ecd380bb03044a495efdb53dd9b392a.: keystone.exception.DomainNotFound: Could not find domain: 9ecd380bb03044a495efdb53dd9b392a. Sep 30 10:16:15.484064 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:16:15.484064 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 30 10:16:15.484064 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 30 10:16:15.484064 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 10:16:15.484064 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 10:16:15.484064 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 10:16:15.484064 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 10:16:15.484064 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9ecd380bb03044a495efdb53dd9b392a. Sep 30 10:16:15.484064 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:16:15.484064 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:16:15.484064 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:16:15.484064 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:16:15.484064 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:16:15.484064 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:16:15.484064 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:16:15.485391 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:16:15.485391 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:16:15.485391 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:16:15.485391 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:16:15.485391 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:16:15.485391 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:16:15.485391 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:16:15.485391 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 30 10:16:15.485391 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 30 10:16:15.485391 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 10:16:15.485391 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 10:16:15.485391 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 10:16:15.485391 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 10:16:15.485391 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:16:15.485391 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:16:15.485391 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:16:15.486616 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:16:15.486616 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:16:15.486616 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:16:15.486616 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:16:15.486616 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 10:16:15.486616 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:16:15.486616 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:16:15.486616 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:16:15.486616 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:16:15.486616 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:16:15.486616 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:16:15.486616 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:16:15.486616 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:16:15.486616 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 30 10:16:15.486616 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 10:16:15.486616 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9ecd380bb03044a495efdb53dd9b392a. Sep 30 10:16:15.486616 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:16:15.487756 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3635/7303] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:16:15 2022] PATCH /identity/v3/domains/9ecd380bb03044a495efdb53dd9b392a => generated 112 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 30 10:16:15.489559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5955ad-025e-4e95-a4f8-6ee2c39248d4 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:15.491666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4b5955ad-025e-4e95-a4f8-6ee2c39248d4 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:15.661890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5955ad-025e-4e95-a4f8-6ee2c39248d4 tempest-TokensV3TestJSON-1978204224 tempest-TokensV3TestJSON-1978204224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:15.671513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b30872-60ee-4fd5-9e30-1c06abaae459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:15.672168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b30872-60ee-4fd5-9e30-1c06abaae459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:15.672438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b30872-60ee-4fd5-9e30-1c06abaae459 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:15.672742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b30872-60ee-4fd5-9e30-1c06abaae459 admin admin] PATH_INFO: `/v3/users/a1f7309f5b2c4456a30148f41830512c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:15.673873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b30872-60ee-4fd5-9e30-1c06abaae459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f7309f5b2c4456a30148f41830512c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:15.678647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b30872-60ee-4fd5-9e30-1c06abaae459 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:15.820761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-14b30872-60ee-4fd5-9e30-1c06abaae459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f7309f5b2c4456a30148f41830512c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:15.829513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-14b30872-60ee-4fd5-9e30-1c06abaae459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f7309f5b2c4456a30148f41830512c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:15.848354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-14b30872-60ee-4fd5-9e30-1c06abaae459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f7309f5b2c4456a30148f41830512c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:15.881103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-14b30872-60ee-4fd5-9e30-1c06abaae459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f7309f5b2c4456a30148f41830512c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:15.910091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-14b30872-60ee-4fd5-9e30-1c06abaae459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f7309f5b2c4456a30148f41830512c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:15.932879 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3669/7304] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:16:15 2022] DELETE /identity/v3/users/a1f7309f5b2c4456a30148f41830512c => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:15.939070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b224c-59ce-4fa7-abc2-87aa33f79205 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:15.939457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b224c-59ce-4fa7-abc2-87aa33f79205 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:15.939827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b224c-59ce-4fa7-abc2-87aa33f79205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:15.994816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5d4b224c-59ce-4fa7-abc2-87aa33f79205 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:16.005552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5d4b224c-59ce-4fa7-abc2-87aa33f79205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:16.049062 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:16.148127 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3636/7305] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:16.159260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b30872-60ee-4fd5-9e30-1c06abaae459 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:16.160903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-14b30872-60ee-4fd5-9e30-1c06abaae459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:16.255841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b30872-60ee-4fd5-9e30-1c06abaae459 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:16.269128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d0d58-1db8-4cba-9bb7-8751a927c32c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:16.271972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d0d58-1db8-4cba-9bb7-8751a927c32c service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:16.273354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d0d58-1db8-4cba-9bb7-8751a927c32c service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:16.275028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d0d58-1db8-4cba-9bb7-8751a927c32c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:16.307926 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:16.317696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d0d58-1db8-4cba-9bb7-8751a927c32c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:16.329324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d0d58-1db8-4cba-9bb7-8751a927c32c service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:16.369021 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3670/7306] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:16:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:16:17.437833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b224c-59ce-4fa7-abc2-87aa33f79205 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:17.439586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5d4b224c-59ce-4fa7-abc2-87aa33f79205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:17.466046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b224c-59ce-4fa7-abc2-87aa33f79205 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:17.496071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d220e9-40ab-4e4f-b4ab-fd5aaee82452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:17.497486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d220e9-40ab-4e4f-b4ab-fd5aaee82452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:17.497774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d220e9-40ab-4e4f-b4ab-fd5aaee82452 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:17.498044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d220e9-40ab-4e4f-b4ab-fd5aaee82452 admin admin] PATH_INFO: `/v3/projects/73f8d0f0646c47198b1af494cfb69b07` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:17.500945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d220e9-40ab-4e4f-b4ab-fd5aaee82452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73f8d0f0646c47198b1af494cfb69b07)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:17.502876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d220e9-40ab-4e4f-b4ab-fd5aaee82452 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:17.735312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0d220e9-40ab-4e4f-b4ab-fd5aaee82452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73f8d0f0646c47198b1af494cfb69b07', 'request_id': 'req-e0d220e9-40ab-4e4f-b4ab-fd5aaee82452'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:17.762062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0d220e9-40ab-4e4f-b4ab-fd5aaee82452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73f8d0f0646c47198b1af494cfb69b07', 'request_id': 'req-e0d220e9-40ab-4e4f-b4ab-fd5aaee82452'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:17.779968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0d220e9-40ab-4e4f-b4ab-fd5aaee82452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73f8d0f0646c47198b1af494cfb69b07', 'request_id': 'req-e0d220e9-40ab-4e4f-b4ab-fd5aaee82452'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:17.823058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0d220e9-40ab-4e4f-b4ab-fd5aaee82452 admin admin] The token cache is being invalidate because project 73f8d0f0646c47198b1af494cfb69b07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:17.823684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0d220e9-40ab-4e4f-b4ab-fd5aaee82452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:17.826530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0d220e9-40ab-4e4f-b4ab-fd5aaee82452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:17.829510 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3637/7307] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:16:17 2022] DELETE /identity/v3/projects/73f8d0f0646c47198b1af494cfb69b07 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:17.836937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d0d58-1db8-4cba-9bb7-8751a927c32c service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:17.872692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d0d58-1db8-4cba-9bb7-8751a927c32c service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:18.059441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1691bf8-32fc-44b5-9398-4bea57ebfc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:18.060443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1691bf8-32fc-44b5-9398-4bea57ebfc52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:18.060975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1691bf8-32fc-44b5-9398-4bea57ebfc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:18.061491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1691bf8-32fc-44b5-9398-4bea57ebfc52 admin admin] PATH_INFO: `/v3/users/a406d8fae2fb4c6888ca26dc70327c78` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:18.063794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1691bf8-32fc-44b5-9398-4bea57ebfc52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a406d8fae2fb4c6888ca26dc70327c78)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:18.069355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1691bf8-32fc-44b5-9398-4bea57ebfc52 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:18.194276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f1691bf8-32fc-44b5-9398-4bea57ebfc52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a406d8fae2fb4c6888ca26dc70327c78'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:18.196959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f1691bf8-32fc-44b5-9398-4bea57ebfc52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a406d8fae2fb4c6888ca26dc70327c78'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:18.222534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f1691bf8-32fc-44b5-9398-4bea57ebfc52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a406d8fae2fb4c6888ca26dc70327c78'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:18.265641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f1691bf8-32fc-44b5-9398-4bea57ebfc52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a406d8fae2fb4c6888ca26dc70327c78'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:18.318749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f1691bf8-32fc-44b5-9398-4bea57ebfc52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a406d8fae2fb4c6888ca26dc70327c78'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:18.341148 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3671/7308] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:16:17 2022] DELETE /identity/v3/users/a406d8fae2fb4c6888ca26dc70327c78 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:19.723950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d220e9-40ab-4e4f-b4ab-fd5aaee82452 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:19.725495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e0d220e9-40ab-4e4f-b4ab-fd5aaee82452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:19.782452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d220e9-40ab-4e4f-b4ab-fd5aaee82452 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:19.984041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba7b16-366c-4857-9c94-0e4f18f43e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:19.988576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba7b16-366c-4857-9c94-0e4f18f43e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:19.989112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba7b16-366c-4857-9c94-0e4f18f43e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:19.989547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba7b16-366c-4857-9c94-0e4f18f43e2f admin admin] PATH_INFO: `/v3/projects/7e081a9d06834db38506346dd2d4d8bc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:19.995923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba7b16-366c-4857-9c94-0e4f18f43e2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e081a9d06834db38506346dd2d4d8bc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:20.001895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba7b16-366c-4857-9c94-0e4f18f43e2f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:20.228876 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:20.258737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fcba7b16-366c-4857-9c94-0e4f18f43e2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e081a9d06834db38506346dd2d4d8bc', 'request_id': 'req-fcba7b16-366c-4857-9c94-0e4f18f43e2f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:20.310514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fcba7b16-366c-4857-9c94-0e4f18f43e2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e081a9d06834db38506346dd2d4d8bc', 'request_id': 'req-fcba7b16-366c-4857-9c94-0e4f18f43e2f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:20.355142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fcba7b16-366c-4857-9c94-0e4f18f43e2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e081a9d06834db38506346dd2d4d8bc', 'request_id': 'req-fcba7b16-366c-4857-9c94-0e4f18f43e2f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:20.409037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fcba7b16-366c-4857-9c94-0e4f18f43e2f admin admin] The token cache is being invalidate because project 7e081a9d06834db38506346dd2d4d8bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:20.409320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fcba7b16-366c-4857-9c94-0e4f18f43e2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:20.409984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fcba7b16-366c-4857-9c94-0e4f18f43e2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:20.411933 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3638/7309] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:16:19 2022] DELETE /identity/v3/projects/7e081a9d06834db38506346dd2d4d8bc => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:20.415809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1691bf8-32fc-44b5-9398-4bea57ebfc52 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:20.419738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f1691bf8-32fc-44b5-9398-4bea57ebfc52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:20.449870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1691bf8-32fc-44b5-9398-4bea57ebfc52 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:20.623767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadd3d4-d7fa-4c23-9e30-ec5d55f1b60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:20.624423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadd3d4-d7fa-4c23-9e30-ec5d55f1b60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:20.624729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadd3d4-d7fa-4c23-9e30-ec5d55f1b60d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:20.625006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadd3d4-d7fa-4c23-9e30-ec5d55f1b60d admin admin] PATH_INFO: `/v3/users/ee511d50453c4c7a908e29b2e2ec3127` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:20.628752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadd3d4-d7fa-4c23-9e30-ec5d55f1b60d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee511d50453c4c7a908e29b2e2ec3127)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:20.630948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadd3d4-d7fa-4c23-9e30-ec5d55f1b60d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:20.673971 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:20.748834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7fadd3d4-d7fa-4c23-9e30-ec5d55f1b60d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee511d50453c4c7a908e29b2e2ec3127'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:20.749627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7fadd3d4-d7fa-4c23-9e30-ec5d55f1b60d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee511d50453c4c7a908e29b2e2ec3127'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:20.770379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7fadd3d4-d7fa-4c23-9e30-ec5d55f1b60d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee511d50453c4c7a908e29b2e2ec3127'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:20.790819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7fadd3d4-d7fa-4c23-9e30-ec5d55f1b60d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee511d50453c4c7a908e29b2e2ec3127'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:20.811139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7fadd3d4-d7fa-4c23-9e30-ec5d55f1b60d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee511d50453c4c7a908e29b2e2ec3127'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:20.833263 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3672/7310] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:16:20 2022] DELETE /identity/v3/users/ee511d50453c4c7a908e29b2e2ec3127 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:21.568043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba7b16-366c-4857-9c94-0e4f18f43e2f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:21.570495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fcba7b16-366c-4857-9c94-0e4f18f43e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:21.662018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba7b16-366c-4857-9c94-0e4f18f43e2f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:21.911879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3d112-fac2-4ee4-97e4-a60fc6f12da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:21.915708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3d112-fac2-4ee4-97e4-a60fc6f12da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:21.915708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3d112-fac2-4ee4-97e4-a60fc6f12da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:21.915708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3d112-fac2-4ee4-97e4-a60fc6f12da8 admin admin] PATH_INFO: `/v3/projects/05d13ad514a24b2ebe9464db287196d5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:21.915708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3d112-fac2-4ee4-97e4-a60fc6f12da8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d13ad514a24b2ebe9464db287196d5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:21.925071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3d112-fac2-4ee4-97e4-a60fc6f12da8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:22.132233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-83f3d112-fac2-4ee4-97e4-a60fc6f12da8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d13ad514a24b2ebe9464db287196d5', 'request_id': 'req-83f3d112-fac2-4ee4-97e4-a60fc6f12da8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:22.175667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-83f3d112-fac2-4ee4-97e4-a60fc6f12da8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d13ad514a24b2ebe9464db287196d5', 'request_id': 'req-83f3d112-fac2-4ee4-97e4-a60fc6f12da8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:22.205495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-83f3d112-fac2-4ee4-97e4-a60fc6f12da8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d13ad514a24b2ebe9464db287196d5', 'request_id': 'req-83f3d112-fac2-4ee4-97e4-a60fc6f12da8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:22.237490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-83f3d112-fac2-4ee4-97e4-a60fc6f12da8 admin admin] The token cache is being invalidate because project 05d13ad514a24b2ebe9464db287196d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:22.237850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-83f3d112-fac2-4ee4-97e4-a60fc6f12da8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:22.242397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-83f3d112-fac2-4ee4-97e4-a60fc6f12da8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:22.249184 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3639/7311] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:16:21 2022] DELETE /identity/v3/projects/05d13ad514a24b2ebe9464db287196d5 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:22.256476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b842f-2f31-4e8b-a4ac-ad0199fb12f7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:22.259318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b842f-2f31-4e8b-a4ac-ad0199fb12f7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:22.259318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b842f-2f31-4e8b-a4ac-ad0199fb12f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:22.372067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-063b842f-2f31-4e8b-a4ac-ad0199fb12f7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:22.374856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-063b842f-2f31-4e8b-a4ac-ad0199fb12f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:22.596770 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3673/7312] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:22.612127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d491ad-6e4b-4061-ad5e-b74f759dbd25 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:22.613035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d491ad-6e4b-4061-ad5e-b74f759dbd25 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:22.613035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d491ad-6e4b-4061-ad5e-b74f759dbd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:22.694305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d6d491ad-6e4b-4061-ad5e-b74f759dbd25 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:22.696490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d6d491ad-6e4b-4061-ad5e-b74f759dbd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:22.725355 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3640/7313] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:22.734669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b842f-2f31-4e8b-a4ac-ad0199fb12f7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:22.810056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b842f-2f31-4e8b-a4ac-ad0199fb12f7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:22.834917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d09f1-c002-432d-9b97-815558a2d114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:22.836590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d09f1-c002-432d-9b97-815558a2d114 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:22.837400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d09f1-c002-432d-9b97-815558a2d114 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:22.838932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d09f1-c002-432d-9b97-815558a2d114 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:22.840501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d09f1-c002-432d-9b97-815558a2d114 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:16:22.841352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d09f1-c002-432d-9b97-815558a2d114 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:22.844559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d09f1-c002-432d-9b97-815558a2d114 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:22.901402 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3674/7314] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:16:22.904168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d491ad-6e4b-4061-ad5e-b74f759dbd25 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:22.956418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d491ad-6e4b-4061-ad5e-b74f759dbd25 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:22.965430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd42072-f1ec-43c6-952c-dbdefc0d3649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:22.966330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd42072-f1ec-43c6-952c-dbdefc0d3649 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:22.966750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd42072-f1ec-43c6-952c-dbdefc0d3649 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:22.967332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd42072-f1ec-43c6-952c-dbdefc0d3649 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:22.968413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd42072-f1ec-43c6-952c-dbdefc0d3649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:22.972529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd42072-f1ec-43c6-952c-dbdefc0d3649 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:23.037334 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3641/7315] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:16:22 2022] POST /identity/v3/projects => generated 393 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:23.038207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d09f1-c002-432d-9b97-815558a2d114 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:23.069093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d09f1-c002-432d-9b97-815558a2d114 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:23.237943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41136374-6746-4819-b58d-d938e64336f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:23.238567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41136374-6746-4819-b58d-d938e64336f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:23.238847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41136374-6746-4819-b58d-d938e64336f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:23.239118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41136374-6746-4819-b58d-d938e64336f5 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:23.239758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41136374-6746-4819-b58d-d938e64336f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:23.241715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41136374-6746-4819-b58d-d938e64336f5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:23.291709 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3675/7316] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:16:23 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:16:23.297062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd42072-f1ec-43c6-952c-dbdefc0d3649 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:23.324971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd42072-f1ec-43c6-952c-dbdefc0d3649 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:23.365576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064824b-156d-46c7-aa72-d456a939e73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:23.368219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064824b-156d-46c7-aa72-d456a939e73c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:23.368516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064824b-156d-46c7-aa72-d456a939e73c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:23.368813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064824b-156d-46c7-aa72-d456a939e73c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:23.374542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064824b-156d-46c7-aa72-d456a939e73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:23.376485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064824b-156d-46c7-aa72-d456a939e73c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:23.456985 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3642/7317] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:16:23.461920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41136374-6746-4819-b58d-d938e64336f5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:23.476494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41136374-6746-4819-b58d-d938e64336f5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:23.493762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5ad22-f1b6-4ff8-914f-840e358fe97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:23.495019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5ad22-f1b6-4ff8-914f-840e358fe97c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:23.495312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5ad22-f1b6-4ff8-914f-840e358fe97c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:23.495620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5ad22-f1b6-4ff8-914f-840e358fe97c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:23.496270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5ad22-f1b6-4ff8-914f-840e358fe97c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:23.498051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5ad22-f1b6-4ff8-914f-840e358fe97c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:23.512008 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:23.526631 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3676/7318] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:16:23.530961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064824b-156d-46c7-aa72-d456a939e73c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:23.596108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064824b-156d-46c7-aa72-d456a939e73c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:23.630905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b6cc8-c4e4-4501-90d1-5c72d986e12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:23.631996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b6cc8-c4e4-4501-90d1-5c72d986e12e admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:23.632312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b6cc8-c4e4-4501-90d1-5c72d986e12e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:23.632770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b6cc8-c4e4-4501-90d1-5c72d986e12e admin admin] PATH_INFO: `/v3/projects/ce6e0c2b40d3411ca3a5970644bacbd0/users/b245f1f680d74262ab4fe6fab284f410/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:23.690458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b6cc8-c4e4-4501-90d1-5c72d986e12e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce6e0c2b40d3411ca3a5970644bacbd0, user_id=b245f1f680d74262ab4fe6fab284f410, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:23.693502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b6cc8-c4e4-4501-90d1-5c72d986e12e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:23.726408 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:23.747167 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3643/7319] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:16:23 2022] PUT /identity/v3/projects/ce6e0c2b40d3411ca3a5970644bacbd0/users/b245f1f680d74262ab4fe6fab284f410/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:23.766621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5cc7e-b1d3-4a64-a3b5-0763e0fdf815 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:23.766932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5cc7e-b1d3-4a64-a3b5-0763e0fdf815 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:23.767227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5cc7e-b1d3-4a64-a3b5-0763e0fdf815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:23.878262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bdd5cc7e-b1d3-4a64-a3b5-0763e0fdf815 None None] MFA Rules not processed for user `b245f1f680d74262ab4fe6fab284f410`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:23.879935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bdd5cc7e-b1d3-4a64-a3b5-0763e0fdf815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:24.124178 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3677/7320] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:24.129894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b6cc8-c4e4-4501-90d1-5c72d986e12e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:24.163198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b6cc8-c4e4-4501-90d1-5c72d986e12e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:24.186587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b6a31-4443-4191-8839-6963da1d65d2 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b245f1f680d74262ab4fe6fab284f410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce6e0c2b40d3411ca3a5970644bacbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:24.191141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b6a31-4443-4191-8839-6963da1d65d2 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:24.191652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b6a31-4443-4191-8839-6963da1d65d2 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:24.192006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b6a31-4443-4191-8839-6963da1d65d2 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] PATH_INFO: `/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:24.193978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b6a31-4443-4191-8839-6963da1d65d2 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorizing `identity:create_application_credential(user_id=b245f1f680d74262ab4fe6fab284f410)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:24.198044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b6a31-4443-4191-8839-6963da1d65d2 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:24.549297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5cc7e-b1d3-4a64-a3b5-0763e0fdf815 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:24.589302 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3644/7321] 10.222.0.16 () {60 vars in 1314 bytes} [Fri Sep 30 10:16:24 2022] POST /identity/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials => generated 788 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:24.599827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5cc7e-b1d3-4a64-a3b5-0763e0fdf815 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:24.624064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0581dde-6b48-4dd4-b156-a1fc6becc0df tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b245f1f680d74262ab4fe6fab284f410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce6e0c2b40d3411ca3a5970644bacbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:24.628654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0581dde-6b48-4dd4-b156-a1fc6becc0df tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:24.631796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0581dde-6b48-4dd4-b156-a1fc6becc0df tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:24.637720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0581dde-6b48-4dd4-b156-a1fc6becc0df tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] PATH_INFO: `/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials/0151fca3125d4719bb5c04088c4a001d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:24.651105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0581dde-6b48-4dd4-b156-a1fc6becc0df tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorizing `identity:get_application_credential(user_id=b245f1f680d74262ab4fe6fab284f410, application_credential_id=0151fca3125d4719bb5c04088c4a001d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:24.655217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0581dde-6b48-4dd4-b156-a1fc6becc0df tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:24.662164 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3678/7322] 10.222.0.16 () {58 vars in 1392 bytes} [Fri Sep 30 10:16:24 2022] GET /identity/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials/0151fca3125d4719bb5c04088c4a001d => generated 688 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:16:24.670714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be65f4-331c-4cce-88df-fcda260959ce None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:24.671423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be65f4-331c-4cce-88df-fcda260959ce None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:24.676063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be65f4-331c-4cce-88df-fcda260959ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:24.704377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-30be65f4-331c-4cce-88df-fcda260959ce None None] MFA Rules not processed for user `b245f1f680d74262ab4fe6fab284f410`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:24.705675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-30be65f4-331c-4cce-88df-fcda260959ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:25.063914 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3645/7323] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:24 2022] POST /identity/v3/auth/tokens => generated 3426 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Sep 30 10:16:25.068642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0581dde-6b48-4dd4-b156-a1fc6becc0df tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:25.121957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0581dde-6b48-4dd4-b156-a1fc6becc0df tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:25.147132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb63686-0f1e-40e7-aac7-e10ec7c2e04a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b245f1f680d74262ab4fe6fab284f410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce6e0c2b40d3411ca3a5970644bacbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:25.148435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb63686-0f1e-40e7-aac7-e10ec7c2e04a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:25.149125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb63686-0f1e-40e7-aac7-e10ec7c2e04a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:25.153262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb63686-0f1e-40e7-aac7-e10ec7c2e04a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] PATH_INFO: `/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials/0151fca3125d4719bb5c04088c4a001d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:25.159569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb63686-0f1e-40e7-aac7-e10ec7c2e04a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b245f1f680d74262ab4fe6fab284f410, application_credential_id=0151fca3125d4719bb5c04088c4a001d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:25.166686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb63686-0f1e-40e7-aac7-e10ec7c2e04a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:25.312025 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3679/7324] 10.222.0.16 () {58 vars in 1395 bytes} [Fri Sep 30 10:16:25 2022] DELETE /identity/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials/0151fca3125d4719bb5c04088c4a001d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:25.321684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be65f4-331c-4cce-88df-fcda260959ce None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:25.361461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be65f4-331c-4cce-88df-fcda260959ce None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:25.460859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed88a3c-ec4e-43fc-8e92-1877ad1d8a9a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b245f1f680d74262ab4fe6fab284f410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce6e0c2b40d3411ca3a5970644bacbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:25.461622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed88a3c-ec4e-43fc-8e92-1877ad1d8a9a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:25.461941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed88a3c-ec4e-43fc-8e92-1877ad1d8a9a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:25.462186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed88a3c-ec4e-43fc-8e92-1877ad1d8a9a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] PATH_INFO: `/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:25.462919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed88a3c-ec4e-43fc-8e92-1877ad1d8a9a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorizing `identity:create_application_credential(user_id=b245f1f680d74262ab4fe6fab284f410)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:25.474867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed88a3c-ec4e-43fc-8e92-1877ad1d8a9a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:25.607311 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:25.662794 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3646/7325] 10.222.0.16 () {60 vars in 1315 bytes} [Fri Sep 30 10:16:25 2022] POST /identity/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials => generated 919 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:25.668699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb63686-0f1e-40e7-aac7-e10ec7c2e04a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:25.679896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb63686-0f1e-40e7-aac7-e10ec7c2e04a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:25.691067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541990c1-1079-4f38-9619-ccb6639c7fa8 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b245f1f680d74262ab4fe6fab284f410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce6e0c2b40d3411ca3a5970644bacbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:25.717956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541990c1-1079-4f38-9619-ccb6639c7fa8 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:25.718443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541990c1-1079-4f38-9619-ccb6639c7fa8 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:25.718579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541990c1-1079-4f38-9619-ccb6639c7fa8 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] PATH_INFO: `/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials/a973cd5ffa0f495d97c49fc537bb0e73` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:25.837186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541990c1-1079-4f38-9619-ccb6639c7fa8 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b245f1f680d74262ab4fe6fab284f410, application_credential_id=a973cd5ffa0f495d97c49fc537bb0e73)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:25.839687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541990c1-1079-4f38-9619-ccb6639c7fa8 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:25.912852 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3680/7326] 10.222.0.16 () {58 vars in 1395 bytes} [Fri Sep 30 10:16:25 2022] DELETE /identity/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials/a973cd5ffa0f495d97c49fc537bb0e73 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:25.918761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed88a3c-ec4e-43fc-8e92-1877ad1d8a9a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:25.939982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed88a3c-ec4e-43fc-8e92-1877ad1d8a9a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:25.953592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202be196-7800-422f-9de3-5b3094263fde tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b245f1f680d74262ab4fe6fab284f410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce6e0c2b40d3411ca3a5970644bacbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:25.954265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202be196-7800-422f-9de3-5b3094263fde tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:25.954555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202be196-7800-422f-9de3-5b3094263fde tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:25.954838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202be196-7800-422f-9de3-5b3094263fde tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] PATH_INFO: `/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:25.955606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202be196-7800-422f-9de3-5b3094263fde tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorizing `identity:create_application_credential(user_id=b245f1f680d74262ab4fe6fab284f410)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:25.959062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202be196-7800-422f-9de3-5b3094263fde tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:26.290891 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3647/7327] 10.222.0.16 () {60 vars in 1315 bytes} [Fri Sep 30 10:16:25 2022] POST /identity/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials => generated 812 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:26.295252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541990c1-1079-4f38-9619-ccb6639c7fa8 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:26.315140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541990c1-1079-4f38-9619-ccb6639c7fa8 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:26.325251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7b186-e9bd-4b71-8e6b-63565b107c60 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b245f1f680d74262ab4fe6fab284f410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce6e0c2b40d3411ca3a5970644bacbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:26.325923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7b186-e9bd-4b71-8e6b-63565b107c60 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:26.326345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7b186-e9bd-4b71-8e6b-63565b107c60 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:26.326629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7b186-e9bd-4b71-8e6b-63565b107c60 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] PATH_INFO: `/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials/a4051ade8898451bba363b82e1a2daa6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:26.377698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7b186-e9bd-4b71-8e6b-63565b107c60 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b245f1f680d74262ab4fe6fab284f410, application_credential_id=a4051ade8898451bba363b82e1a2daa6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:26.379210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7b186-e9bd-4b71-8e6b-63565b107c60 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:26.419032 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3681/7328] 10.222.0.16 () {58 vars in 1395 bytes} [Fri Sep 30 10:16:26 2022] DELETE /identity/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials/a4051ade8898451bba363b82e1a2daa6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:26.423851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202be196-7800-422f-9de3-5b3094263fde tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:26.436889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202be196-7800-422f-9de3-5b3094263fde tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:26.446854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b341eca-178e-4f9a-8623-d3a45ce2d75a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b245f1f680d74262ab4fe6fab284f410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce6e0c2b40d3411ca3a5970644bacbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:26.448718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b341eca-178e-4f9a-8623-d3a45ce2d75a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:26.448981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b341eca-178e-4f9a-8623-d3a45ce2d75a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:26.449260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b341eca-178e-4f9a-8623-d3a45ce2d75a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] PATH_INFO: `/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:26.449940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b341eca-178e-4f9a-8623-d3a45ce2d75a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorizing `identity:create_application_credential(user_id=b245f1f680d74262ab4fe6fab284f410)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:26.451102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b341eca-178e-4f9a-8623-d3a45ce2d75a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:26.602351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7b186-e9bd-4b71-8e6b-63565b107c60 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:26.605331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-26e7b186-e9bd-4b71-8e6b-63565b107c60 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:26.658359 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3648/7329] 10.222.0.16 () {60 vars in 1314 bytes} [Fri Sep 30 10:16:26 2022] POST /identity/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials => generated 787 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:16:26.664782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b341eca-178e-4f9a-8623-d3a45ce2d75a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:26.704659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b341eca-178e-4f9a-8623-d3a45ce2d75a tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:26.738419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b6c93-8ac1-4170-99e7-0a9c2b09796f tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b245f1f680d74262ab4fe6fab284f410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce6e0c2b40d3411ca3a5970644bacbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:26.739291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b6c93-8ac1-4170-99e7-0a9c2b09796f tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:26.739578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b6c93-8ac1-4170-99e7-0a9c2b09796f tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:26.739883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b6c93-8ac1-4170-99e7-0a9c2b09796f tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] PATH_INFO: `/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:26.754748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b6c93-8ac1-4170-99e7-0a9c2b09796f tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorizing `identity:create_application_credential(user_id=b245f1f680d74262ab4fe6fab284f410)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:26.759125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b6c93-8ac1-4170-99e7-0a9c2b09796f tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:26.858612 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:26.982685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7b186-e9bd-4b71-8e6b-63565b107c60 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:27.000829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff26950-9c92-44c9-99d9-ffa11db573ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:27.004255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff26950-9c92-44c9-99d9-ffa11db573ab service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:27.005033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff26950-9c92-44c9-99d9-ffa11db573ab service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:27.006608 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff26950-9c92-44c9-99d9-ffa11db573ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:27.017707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7ff26950-9c92-44c9-99d9-ffa11db573ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:27.053138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff26950-9c92-44c9-99d9-ffa11db573ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:27.059791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff26950-9c92-44c9-99d9-ffa11db573ab service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:27.083246 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3682/7330] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:16:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:16:27.094965 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3649/7331] 10.222.0.16 () {60 vars in 1314 bytes} [Fri Sep 30 10:16:26 2022] POST /identity/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials => generated 789 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:27.099167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff26950-9c92-44c9-99d9-ffa11db573ab service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:27.126701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff26950-9c92-44c9-99d9-ffa11db573ab service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:27.133507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648e0f6-fe10-494d-888b-cceea63c83bb tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b245f1f680d74262ab4fe6fab284f410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce6e0c2b40d3411ca3a5970644bacbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:27.134321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648e0f6-fe10-494d-888b-cceea63c83bb tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:27.134603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648e0f6-fe10-494d-888b-cceea63c83bb tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:27.135469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648e0f6-fe10-494d-888b-cceea63c83bb tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] PATH_INFO: `/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:27.136288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648e0f6-fe10-494d-888b-cceea63c83bb tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorizing `identity:list_application_credentials(user_id=b245f1f680d74262ab4fe6fab284f410)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:27.139563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648e0f6-fe10-494d-888b-cceea63c83bb tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:27.169131 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3683/7332] 10.222.0.16 () {58 vars in 1293 bytes} [Fri Sep 30 10:16:27 2022] GET /identity/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials => generated 1500 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:16:27.169393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b6c93-8ac1-4170-99e7-0a9c2b09796f tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:27.178592 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:27.192554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b6c93-8ac1-4170-99e7-0a9c2b09796f tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:27.216019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d69413-6d05-4ccf-9a1e-28b2758455c3 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b245f1f680d74262ab4fe6fab284f410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce6e0c2b40d3411ca3a5970644bacbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:27.217885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d69413-6d05-4ccf-9a1e-28b2758455c3 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:27.217885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d69413-6d05-4ccf-9a1e-28b2758455c3 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:27.217885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d69413-6d05-4ccf-9a1e-28b2758455c3 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] PATH_INFO: `/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials/23396b426a7d4fdca47efe7b1bd449a2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:27.235497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d69413-6d05-4ccf-9a1e-28b2758455c3 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b245f1f680d74262ab4fe6fab284f410, application_credential_id=23396b426a7d4fdca47efe7b1bd449a2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:27.237127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d69413-6d05-4ccf-9a1e-28b2758455c3 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:27.294380 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3650/7333] 10.222.0.16 () {58 vars in 1395 bytes} [Fri Sep 30 10:16:27 2022] DELETE /identity/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials/23396b426a7d4fdca47efe7b1bd449a2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:27.296215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648e0f6-fe10-494d-888b-cceea63c83bb tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:27.319835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648e0f6-fe10-494d-888b-cceea63c83bb tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:27.342327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513c24b-f7fc-4998-849e-34c8e669375d tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b245f1f680d74262ab4fe6fab284f410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce6e0c2b40d3411ca3a5970644bacbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:27.346837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513c24b-f7fc-4998-849e-34c8e669375d tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:27.347139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513c24b-f7fc-4998-849e-34c8e669375d tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:27.347402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513c24b-f7fc-4998-849e-34c8e669375d tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] PATH_INFO: `/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials/fde029eb75654275867493bc172fb51b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:27.381106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513c24b-f7fc-4998-849e-34c8e669375d tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b245f1f680d74262ab4fe6fab284f410, application_credential_id=fde029eb75654275867493bc172fb51b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:27.382659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513c24b-f7fc-4998-849e-34c8e669375d tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:27.476583 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3684/7334] 10.222.0.16 () {58 vars in 1395 bytes} [Fri Sep 30 10:16:27 2022] DELETE /identity/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials/fde029eb75654275867493bc172fb51b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:27.477949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d69413-6d05-4ccf-9a1e-28b2758455c3 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:27.488964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d69413-6d05-4ccf-9a1e-28b2758455c3 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:27.513455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ad692-887e-432f-b1a2-8d1edbf53f16 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b245f1f680d74262ab4fe6fab284f410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce6e0c2b40d3411ca3a5970644bacbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:27.513455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ad692-887e-432f-b1a2-8d1edbf53f16 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:27.513455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ad692-887e-432f-b1a2-8d1edbf53f16 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:27.516647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ad692-887e-432f-b1a2-8d1edbf53f16 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] PATH_INFO: `/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:27.516647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ad692-887e-432f-b1a2-8d1edbf53f16 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorizing `identity:create_application_credential(user_id=b245f1f680d74262ab4fe6fab284f410)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:27.517086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ad692-887e-432f-b1a2-8d1edbf53f16 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:27.707384 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3651/7335] 10.222.0.16 () {60 vars in 1314 bytes} [Fri Sep 30 10:16:27 2022] POST /identity/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials => generated 789 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:27.708581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513c24b-f7fc-4998-849e-34c8e669375d tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:27.719125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513c24b-f7fc-4998-849e-34c8e669375d tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:27.733443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40009a0-33a5-47b7-b68a-61219b5c6a8e tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b245f1f680d74262ab4fe6fab284f410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce6e0c2b40d3411ca3a5970644bacbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:27.735090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40009a0-33a5-47b7-b68a-61219b5c6a8e tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:27.735501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40009a0-33a5-47b7-b68a-61219b5c6a8e tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:27.735827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40009a0-33a5-47b7-b68a-61219b5c6a8e tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] PATH_INFO: `/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:27.738501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40009a0-33a5-47b7-b68a-61219b5c6a8e tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorizing `identity:create_application_credential(user_id=b245f1f680d74262ab4fe6fab284f410)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:27.749435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40009a0-33a5-47b7-b68a-61219b5c6a8e tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:27.986839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ad692-887e-432f-b1a2-8d1edbf53f16 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:27.988327 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3685/7336] 10.222.0.16 () {60 vars in 1314 bytes} [Fri Sep 30 10:16:27 2022] POST /identity/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials => generated 789 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:28.012518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ad692-887e-432f-b1a2-8d1edbf53f16 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:28.037230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a2ac5-44d6-4b89-ac1e-af190b8b6995 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b245f1f680d74262ab4fe6fab284f410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce6e0c2b40d3411ca3a5970644bacbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:28.037908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a2ac5-44d6-4b89-ac1e-af190b8b6995 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:28.038209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a2ac5-44d6-4b89-ac1e-af190b8b6995 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:28.038465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a2ac5-44d6-4b89-ac1e-af190b8b6995 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] PATH_INFO: `/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:28.039385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a2ac5-44d6-4b89-ac1e-af190b8b6995 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Adding query filter params (name=tempest-application_credential-1530591925) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:16:28.039702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a2ac5-44d6-4b89-ac1e-af190b8b6995 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorizing `identity:list_application_credentials(user_id=b245f1f680d74262ab4fe6fab284f410)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:28.041911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a2ac5-44d6-4b89-ac1e-af190b8b6995 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:28.068648 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3652/7337] 10.222.0.16 () {58 vars in 1386 bytes} [Fri Sep 30 10:16:27 2022] GET /identity/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials?name=tempest-application_credential-1530591925 => generated 887 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:16:28.072938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40009a0-33a5-47b7-b68a-61219b5c6a8e tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:28.090094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40009a0-33a5-47b7-b68a-61219b5c6a8e tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:28.111819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143a5eb-3928-42f7-bbda-9f9bfc157f8b tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b245f1f680d74262ab4fe6fab284f410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce6e0c2b40d3411ca3a5970644bacbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:28.115462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143a5eb-3928-42f7-bbda-9f9bfc157f8b tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:28.116978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143a5eb-3928-42f7-bbda-9f9bfc157f8b tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:28.117366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143a5eb-3928-42f7-bbda-9f9bfc157f8b tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] PATH_INFO: `/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials/eaad1c20dfac4884b78c55133a35d920` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:28.155135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c143a5eb-3928-42f7-bbda-9f9bfc157f8b tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b245f1f680d74262ab4fe6fab284f410, application_credential_id=eaad1c20dfac4884b78c55133a35d920)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:28.162358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c143a5eb-3928-42f7-bbda-9f9bfc157f8b tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:28.243775 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3686/7338] 10.222.0.16 () {58 vars in 1395 bytes} [Fri Sep 30 10:16:28 2022] DELETE /identity/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials/eaad1c20dfac4884b78c55133a35d920 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:28.248667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a2ac5-44d6-4b89-ac1e-af190b8b6995 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:28.285645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a2ac5-44d6-4b89-ac1e-af190b8b6995 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:28.315463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aff5f7-00a5-4ff2-a093-14dc94b44483 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b245f1f680d74262ab4fe6fab284f410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce6e0c2b40d3411ca3a5970644bacbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:28.316433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aff5f7-00a5-4ff2-a093-14dc94b44483 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:28.316972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aff5f7-00a5-4ff2-a093-14dc94b44483 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:28.318599 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aff5f7-00a5-4ff2-a093-14dc94b44483 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] PATH_INFO: `/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials/3a7cc3f875b94424b2c290a9df26bcc3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:28.353235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aff5f7-00a5-4ff2-a093-14dc94b44483 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b245f1f680d74262ab4fe6fab284f410, application_credential_id=3a7cc3f875b94424b2c290a9df26bcc3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:28.355730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aff5f7-00a5-4ff2-a093-14dc94b44483 tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:28.413393 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3653/7339] 10.222.0.16 () {58 vars in 1395 bytes} [Fri Sep 30 10:16:28 2022] DELETE /identity/v3/users/b245f1f680d74262ab4fe6fab284f410/application_credentials/3a7cc3f875b94424b2c290a9df26bcc3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:28.418226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143a5eb-3928-42f7-bbda-9f9bfc157f8b tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:28.667902 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:28.694897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143a5eb-3928-42f7-bbda-9f9bfc157f8b tempest-ApplicationCredentialsV3Test-1411116790 tempest-ApplicationCredentialsV3Test-1411116790-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:28.728278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fe8c3-f864-48e6-b6a3-119ba532036f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:28.733395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fe8c3-f864-48e6-b6a3-119ba532036f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:28.739959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fe8c3-f864-48e6-b6a3-119ba532036f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:28.740523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fe8c3-f864-48e6-b6a3-119ba532036f admin admin] PATH_INFO: `/v3/users/b245f1f680d74262ab4fe6fab284f410` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:28.749471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8fe8c3-f864-48e6-b6a3-119ba532036f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b245f1f680d74262ab4fe6fab284f410)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:28.751415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8fe8c3-f864-48e6-b6a3-119ba532036f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:28.895486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5d8fe8c3-f864-48e6-b6a3-119ba532036f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b245f1f680d74262ab4fe6fab284f410'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:28.897988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5d8fe8c3-f864-48e6-b6a3-119ba532036f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b245f1f680d74262ab4fe6fab284f410'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:28.932387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5d8fe8c3-f864-48e6-b6a3-119ba532036f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b245f1f680d74262ab4fe6fab284f410'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:28.975160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5d8fe8c3-f864-48e6-b6a3-119ba532036f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b245f1f680d74262ab4fe6fab284f410'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:28.993019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5d8fe8c3-f864-48e6-b6a3-119ba532036f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b245f1f680d74262ab4fe6fab284f410'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:29.015107 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3687/7340] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:16:28 2022] DELETE /identity/v3/users/b245f1f680d74262ab4fe6fab284f410 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:29.016885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3041cfb-e0fd-47a0-9c76-40f7d9a4c757 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:29.017197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3041cfb-e0fd-47a0-9c76-40f7d9a4c757 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:29.017511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3041cfb-e0fd-47a0-9c76-40f7d9a4c757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:29.069079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a3041cfb-e0fd-47a0-9c76-40f7d9a4c757 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:29.071938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a3041cfb-e0fd-47a0-9c76-40f7d9a4c757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:29.298410 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3654/7341] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:29.323521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fe8c3-f864-48e6-b6a3-119ba532036f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:29.325725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5d8fe8c3-f864-48e6-b6a3-119ba532036f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:29.517731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fe8c3-f864-48e6-b6a3-119ba532036f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:29.531860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6daaf-807a-466a-be7a-4ef4019352ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:29.532486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6daaf-807a-466a-be7a-4ef4019352ba service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:29.532792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6daaf-807a-466a-be7a-4ef4019352ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:29.533085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6daaf-807a-466a-be7a-4ef4019352ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:29.565457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6daaf-807a-466a-be7a-4ef4019352ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:29.567069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6daaf-807a-466a-be7a-4ef4019352ba service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:29.588973 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3688/7342] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:16:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:16:30.010537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3041cfb-e0fd-47a0-9c76-40f7d9a4c757 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:30.012157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a3041cfb-e0fd-47a0-9c76-40f7d9a4c757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:30.032092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3041cfb-e0fd-47a0-9c76-40f7d9a4c757 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:30.045389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa031be-54c5-4e68-98b3-1edd37a21629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:30.046053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa031be-54c5-4e68-98b3-1edd37a21629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:30.046388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa031be-54c5-4e68-98b3-1edd37a21629 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:30.046859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa031be-54c5-4e68-98b3-1edd37a21629 admin admin] PATH_INFO: `/v3/projects/ce6e0c2b40d3411ca3a5970644bacbd0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:30.048349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa031be-54c5-4e68-98b3-1edd37a21629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce6e0c2b40d3411ca3a5970644bacbd0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:30.050984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa031be-54c5-4e68-98b3-1edd37a21629 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:30.113504 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:30.172534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4aa031be-54c5-4e68-98b3-1edd37a21629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce6e0c2b40d3411ca3a5970644bacbd0', 'request_id': 'req-4aa031be-54c5-4e68-98b3-1edd37a21629'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:30.196312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4aa031be-54c5-4e68-98b3-1edd37a21629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce6e0c2b40d3411ca3a5970644bacbd0', 'request_id': 'req-4aa031be-54c5-4e68-98b3-1edd37a21629'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:30.207477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4aa031be-54c5-4e68-98b3-1edd37a21629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce6e0c2b40d3411ca3a5970644bacbd0', 'request_id': 'req-4aa031be-54c5-4e68-98b3-1edd37a21629'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:30.241735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4aa031be-54c5-4e68-98b3-1edd37a21629 admin admin] The token cache is being invalidate because project ce6e0c2b40d3411ca3a5970644bacbd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:30.242087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4aa031be-54c5-4e68-98b3-1edd37a21629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:30.245528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4aa031be-54c5-4e68-98b3-1edd37a21629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:30.249861 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3655/7343] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:16:30 2022] DELETE /identity/v3/projects/ce6e0c2b40d3411ca3a5970644bacbd0 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:30.255174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b720d6-9cf7-4322-b636-3cabfb6fcd67 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:30.256223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b720d6-9cf7-4322-b636-3cabfb6fcd67 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:30.256980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b720d6-9cf7-4322-b636-3cabfb6fcd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:30.336727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e8b720d6-9cf7-4322-b636-3cabfb6fcd67 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:30.341791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e8b720d6-9cf7-4322-b636-3cabfb6fcd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:30.485471 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3689/7344] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:30.493326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc893841-1669-45cc-8485-9ba4e56d51b0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:30.493817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc893841-1669-45cc-8485-9ba4e56d51b0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:30.494980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc893841-1669-45cc-8485-9ba4e56d51b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:30.532498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cc893841-1669-45cc-8485-9ba4e56d51b0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:30.533912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cc893841-1669-45cc-8485-9ba4e56d51b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:30.558842 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3656/7345] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:30.563949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b720d6-9cf7-4322-b636-3cabfb6fcd67 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:30.580369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b720d6-9cf7-4322-b636-3cabfb6fcd67 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:30.591958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa2315-b8bf-498b-befb-227f20794b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:30.592778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa2315-b8bf-498b-befb-227f20794b4f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:30.593249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa2315-b8bf-498b-befb-227f20794b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:30.593959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa2315-b8bf-498b-befb-227f20794b4f admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:30.594710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa2315-b8bf-498b-befb-227f20794b4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:16:30.595081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa2315-b8bf-498b-befb-227f20794b4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:30.598437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa2315-b8bf-498b-befb-227f20794b4f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:30.619142 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:30.627225 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3690/7346] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:16:30.629574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc893841-1669-45cc-8485-9ba4e56d51b0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:30.643369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc893841-1669-45cc-8485-9ba4e56d51b0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:30.658758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613ba4c-3de2-4b1d-8976-3cd326ad41b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:30.661471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613ba4c-3de2-4b1d-8976-3cd326ad41b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:30.661471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613ba4c-3de2-4b1d-8976-3cd326ad41b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:30.661471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613ba4c-3de2-4b1d-8976-3cd326ad41b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:30.661883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3613ba4c-3de2-4b1d-8976-3cd326ad41b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:30.667072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3613ba4c-3de2-4b1d-8976-3cd326ad41b5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:30.744844 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3657/7347] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:16:30 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:30.749232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa2315-b8bf-498b-befb-227f20794b4f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:30.765090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa2315-b8bf-498b-befb-227f20794b4f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:30.909889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d65308-1ba8-49c2-bb94-97a6c06d35c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:30.910638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d65308-1ba8-49c2-bb94-97a6c06d35c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:30.910989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d65308-1ba8-49c2-bb94-97a6c06d35c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:30.911322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d65308-1ba8-49c2-bb94-97a6c06d35c4 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:30.918626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d65308-1ba8-49c2-bb94-97a6c06d35c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:30.918626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d65308-1ba8-49c2-bb94-97a6c06d35c4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:30.944165 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3691/7348] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:16:30 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:30.948715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613ba4c-3de2-4b1d-8976-3cd326ad41b5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:30.964253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613ba4c-3de2-4b1d-8976-3cd326ad41b5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:30.974387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6e34a-3adf-4616-b3d5-01ee428730ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:30.976045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6e34a-3adf-4616-b3d5-01ee428730ae admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:30.976335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6e34a-3adf-4616-b3d5-01ee428730ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:30.976653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6e34a-3adf-4616-b3d5-01ee428730ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:30.977281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6e34a-3adf-4616-b3d5-01ee428730ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:30.983116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6e34a-3adf-4616-b3d5-01ee428730ae admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:31.013500 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3658/7349] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:16:31.017906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d65308-1ba8-49c2-bb94-97a6c06d35c4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:31.053600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d65308-1ba8-49c2-bb94-97a6c06d35c4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:31.071842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260fef5-54ae-44d6-8903-a4b71a1b71a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:31.075276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260fef5-54ae-44d6-8903-a4b71a1b71a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:31.076436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260fef5-54ae-44d6-8903-a4b71a1b71a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:31.079175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260fef5-54ae-44d6-8903-a4b71a1b71a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:31.080111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260fef5-54ae-44d6-8903-a4b71a1b71a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:31.092440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260fef5-54ae-44d6-8903-a4b71a1b71a9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:31.123378 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3692/7350] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:16:31.127222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6e34a-3adf-4616-b3d5-01ee428730ae admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:31.141974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6e34a-3adf-4616-b3d5-01ee428730ae admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:31.152784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af8ab3-55d2-40fa-ba6d-6b685cfc588c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:31.153515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af8ab3-55d2-40fa-ba6d-6b685cfc588c admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:31.153803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af8ab3-55d2-40fa-ba6d-6b685cfc588c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:31.154162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af8ab3-55d2-40fa-ba6d-6b685cfc588c admin admin] PATH_INFO: `/v3/projects/e7f1bf8580704e8e9a4f742eaccda5e4/users/d246a4fe6e394207bd312853348ddeb1/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:31.205924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af8ab3-55d2-40fa-ba6d-6b685cfc588c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7f1bf8580704e8e9a4f742eaccda5e4, user_id=d246a4fe6e394207bd312853348ddeb1, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:31.208758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af8ab3-55d2-40fa-ba6d-6b685cfc588c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:31.245558 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3659/7351] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:16:31 2022] PUT /identity/v3/projects/e7f1bf8580704e8e9a4f742eaccda5e4/users/d246a4fe6e394207bd312853348ddeb1/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:31.247216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbc645-17e7-4613-8caa-45f0ebcda351 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:31.247528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbc645-17e7-4613-8caa-45f0ebcda351 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:31.247783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbc645-17e7-4613-8caa-45f0ebcda351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:31.329585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-36cbc645-17e7-4613-8caa-45f0ebcda351 None None] MFA Rules not processed for user `d246a4fe6e394207bd312853348ddeb1`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:31.330797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-36cbc645-17e7-4613-8caa-45f0ebcda351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:31.497057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af8ab3-55d2-40fa-ba6d-6b685cfc588c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:31.506803 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3693/7352] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:31.514919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af8ab3-55d2-40fa-ba6d-6b685cfc588c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:31.519193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209e7aa-59dd-4fa5-a68b-2380a6262c82 tempest-IdentityCatalogTest-695798129 tempest-IdentityCatalogTest-695798129-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd246a4fe6e394207bd312853348ddeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7f1bf8580704e8e9a4f742eaccda5e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:31.519782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209e7aa-59dd-4fa5-a68b-2380a6262c82 tempest-IdentityCatalogTest-695798129 tempest-IdentityCatalogTest-695798129-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:31.520058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209e7aa-59dd-4fa5-a68b-2380a6262c82 tempest-IdentityCatalogTest-695798129 tempest-IdentityCatalogTest-695798129-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:31.520325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209e7aa-59dd-4fa5-a68b-2380a6262c82 tempest-IdentityCatalogTest-695798129 tempest-IdentityCatalogTest-695798129-project] PATH_INFO: `/v3/auth/catalog` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:31.520928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209e7aa-59dd-4fa5-a68b-2380a6262c82 tempest-IdentityCatalogTest-695798129 tempest-IdentityCatalogTest-695798129-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:31.521983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209e7aa-59dd-4fa5-a68b-2380a6262c82 tempest-IdentityCatalogTest-695798129 tempest-IdentityCatalogTest-695798129-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:31.533177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbc645-17e7-4613-8caa-45f0ebcda351 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:31.542144 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3660/7353] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Sep 30 10:16:31 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:16:31.708408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbc645-17e7-4613-8caa-45f0ebcda351 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:31.725038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aab8c8-471a-42df-b8a2-acb452d34efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:31.726129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aab8c8-471a-42df-b8a2-acb452d34efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:31.726658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aab8c8-471a-42df-b8a2-acb452d34efb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:31.727145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aab8c8-471a-42df-b8a2-acb452d34efb admin admin] PATH_INFO: `/v3/users/d246a4fe6e394207bd312853348ddeb1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:31.732891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aab8c8-471a-42df-b8a2-acb452d34efb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d246a4fe6e394207bd312853348ddeb1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:31.735703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aab8c8-471a-42df-b8a2-acb452d34efb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:31.765495 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:31.870620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76aab8c8-471a-42df-b8a2-acb452d34efb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd246a4fe6e394207bd312853348ddeb1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:31.878781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76aab8c8-471a-42df-b8a2-acb452d34efb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd246a4fe6e394207bd312853348ddeb1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:31.896729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76aab8c8-471a-42df-b8a2-acb452d34efb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd246a4fe6e394207bd312853348ddeb1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:31.945335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76aab8c8-471a-42df-b8a2-acb452d34efb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd246a4fe6e394207bd312853348ddeb1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:31.962163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76aab8c8-471a-42df-b8a2-acb452d34efb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd246a4fe6e394207bd312853348ddeb1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:31.972651 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3694/7354] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:16:31 2022] DELETE /identity/v3/users/d246a4fe6e394207bd312853348ddeb1 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:31.975333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57776db-381f-47b2-9b38-d502118ff85d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:31.976163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57776db-381f-47b2-9b38-d502118ff85d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:31.976629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57776db-381f-47b2-9b38-d502118ff85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:32.001817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e57776db-381f-47b2-9b38-d502118ff85d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:32.004470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e57776db-381f-47b2-9b38-d502118ff85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:32.214492 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3661/7355] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:32.223769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aab8c8-471a-42df-b8a2-acb452d34efb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:32.225475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-76aab8c8-471a-42df-b8a2-acb452d34efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:32.334302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aab8c8-471a-42df-b8a2-acb452d34efb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:32.344512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a0576-bdf2-4884-912f-3d74ecff9508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:32.346165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a0576-bdf2-4884-912f-3d74ecff9508 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:32.346445 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a0576-bdf2-4884-912f-3d74ecff9508 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:32.346714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a0576-bdf2-4884-912f-3d74ecff9508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:32.364030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a0576-bdf2-4884-912f-3d74ecff9508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:32.365703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a0576-bdf2-4884-912f-3d74ecff9508 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:32.389728 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3695/7356] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:16:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:16:33.085566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57776db-381f-47b2-9b38-d502118ff85d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:33.087445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e57776db-381f-47b2-9b38-d502118ff85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:33.109523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57776db-381f-47b2-9b38-d502118ff85d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:33.118402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce525a-d582-4027-b199-0fb17d2d6f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:33.119830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce525a-d582-4027-b199-0fb17d2d6f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:33.120289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce525a-d582-4027-b199-0fb17d2d6f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:33.121443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce525a-d582-4027-b199-0fb17d2d6f46 admin admin] PATH_INFO: `/v3/projects/e7f1bf8580704e8e9a4f742eaccda5e4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:33.123511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce525a-d582-4027-b199-0fb17d2d6f46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7f1bf8580704e8e9a4f742eaccda5e4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:33.126892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce525a-d582-4027-b199-0fb17d2d6f46 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:33.242600 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:33.294177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1cce525a-d582-4027-b199-0fb17d2d6f46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7f1bf8580704e8e9a4f742eaccda5e4', 'request_id': 'req-1cce525a-d582-4027-b199-0fb17d2d6f46'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:33.314056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1cce525a-d582-4027-b199-0fb17d2d6f46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7f1bf8580704e8e9a4f742eaccda5e4', 'request_id': 'req-1cce525a-d582-4027-b199-0fb17d2d6f46'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:33.323931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1cce525a-d582-4027-b199-0fb17d2d6f46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7f1bf8580704e8e9a4f742eaccda5e4', 'request_id': 'req-1cce525a-d582-4027-b199-0fb17d2d6f46'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:33.358792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1cce525a-d582-4027-b199-0fb17d2d6f46 admin admin] The token cache is being invalidate because project e7f1bf8580704e8e9a4f742eaccda5e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:33.359144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1cce525a-d582-4027-b199-0fb17d2d6f46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:33.362238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1cce525a-d582-4027-b199-0fb17d2d6f46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:33.364453 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3662/7357] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:16:33 2022] DELETE /identity/v3/projects/e7f1bf8580704e8e9a4f742eaccda5e4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:33.370869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80af43-c84d-4bf6-8d34-7efd6e7e0fc8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:33.372399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80af43-c84d-4bf6-8d34-7efd6e7e0fc8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:33.372908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80af43-c84d-4bf6-8d34-7efd6e7e0fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:33.460133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0a80af43-c84d-4bf6-8d34-7efd6e7e0fc8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:33.462244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0a80af43-c84d-4bf6-8d34-7efd6e7e0fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:33.647851 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3696/7358] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:33.656397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec8039-d518-47a5-8ba7-a3b267f63266 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:33.656713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec8039-d518-47a5-8ba7-a3b267f63266 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:33.657004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec8039-d518-47a5-8ba7-a3b267f63266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:33.698644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dcec8039-d518-47a5-8ba7-a3b267f63266 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:33.699986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dcec8039-d518-47a5-8ba7-a3b267f63266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:33.717425 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3663/7359] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:33.721415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80af43-c84d-4bf6-8d34-7efd6e7e0fc8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:33.740995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80af43-c84d-4bf6-8d34-7efd6e7e0fc8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:33.755769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c1710-a6b1-4ec0-a288-889456d83ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:33.756506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c1710-a6b1-4ec0-a288-889456d83ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:33.769027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c1710-a6b1-4ec0-a288-889456d83ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:33.769437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c1710-a6b1-4ec0-a288-889456d83ab1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:33.770232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c1710-a6b1-4ec0-a288-889456d83ab1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:16:33.772636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c1710-a6b1-4ec0-a288-889456d83ab1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:33.774170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c1710-a6b1-4ec0-a288-889456d83ab1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:33.802197 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3697/7360] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:16:33.803212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec8039-d518-47a5-8ba7-a3b267f63266 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:33.827792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec8039-d518-47a5-8ba7-a3b267f63266 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:33.864226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcdbe5-8258-4dbc-aa73-5ddd1963b5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:33.864226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcdbe5-8258-4dbc-aa73-5ddd1963b5f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:33.864226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcdbe5-8258-4dbc-aa73-5ddd1963b5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:33.864226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcdbe5-8258-4dbc-aa73-5ddd1963b5f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:33.864811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fcdbe5-8258-4dbc-aa73-5ddd1963b5f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:33.864811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fcdbe5-8258-4dbc-aa73-5ddd1963b5f6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:33.964976 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3664/7361] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:16:33 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:16:33.966238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c1710-a6b1-4ec0-a288-889456d83ab1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:33.982735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c1710-a6b1-4ec0-a288-889456d83ab1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:34.011941 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:34.171189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd3e23-7996-4910-ab64-d288779db2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:34.171855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd3e23-7996-4910-ab64-d288779db2fc admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:34.172152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd3e23-7996-4910-ab64-d288779db2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:34.172429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd3e23-7996-4910-ab64-d288779db2fc admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:34.173152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd3e23-7996-4910-ab64-d288779db2fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:34.175990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd3e23-7996-4910-ab64-d288779db2fc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:34.231751 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3698/7362] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:16:33 2022] POST /identity/v3/users => generated 288 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:34.235811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcdbe5-8258-4dbc-aa73-5ddd1963b5f6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:34.251134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcdbe5-8258-4dbc-aa73-5ddd1963b5f6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:34.271152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc8a82-3b79-4fcc-9336-d295874bb276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:34.272505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc8a82-3b79-4fcc-9336-d295874bb276 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:34.273421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc8a82-3b79-4fcc-9336-d295874bb276 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:34.274363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc8a82-3b79-4fcc-9336-d295874bb276 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:34.276115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc8a82-3b79-4fcc-9336-d295874bb276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:34.282348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc8a82-3b79-4fcc-9336-d295874bb276 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:34.319357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd3e23-7996-4910-ab64-d288779db2fc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:34.319867 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3665/7363] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:16:34.339146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd3e23-7996-4910-ab64-d288779db2fc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:34.360648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a16de-c141-451e-9399-977a659415ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:34.361166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a16de-c141-451e-9399-977a659415ed admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:34.363305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a16de-c141-451e-9399-977a659415ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:34.363602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a16de-c141-451e-9399-977a659415ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:34.364265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a16de-c141-451e-9399-977a659415ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:34.377735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a16de-c141-451e-9399-977a659415ed admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:34.404137 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3699/7364] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:16:34.410265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc8a82-3b79-4fcc-9336-d295874bb276 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:34.429277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc8a82-3b79-4fcc-9336-d295874bb276 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:34.443871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39333754-0954-4903-9ab7-0cfcd6dd78dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:34.444643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39333754-0954-4903-9ab7-0cfcd6dd78dc admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:34.445009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39333754-0954-4903-9ab7-0cfcd6dd78dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:34.445356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39333754-0954-4903-9ab7-0cfcd6dd78dc admin admin] PATH_INFO: `/v3/projects/30d0db532fef45969efde263308f7d3a/users/bdeae9385fdb4ec7a0408cc4aa6e1414/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:34.511063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39333754-0954-4903-9ab7-0cfcd6dd78dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d0db532fef45969efde263308f7d3a, user_id=bdeae9385fdb4ec7a0408cc4aa6e1414, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:34.513851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39333754-0954-4903-9ab7-0cfcd6dd78dc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:34.554586 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3666/7365] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:16:34 2022] PUT /identity/v3/projects/30d0db532fef45969efde263308f7d3a/users/bdeae9385fdb4ec7a0408cc4aa6e1414/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:34.565064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1c67f-e4a6-4cb1-bc57-3e5c8a8d0129 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:34.565284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1c67f-e4a6-4cb1-bc57-3e5c8a8d0129 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:34.565535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1c67f-e4a6-4cb1-bc57-3e5c8a8d0129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:34.625105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0ae1c67f-e4a6-4cb1-bc57-3e5c8a8d0129 None None] MFA Rules not processed for user `bdeae9385fdb4ec7a0408cc4aa6e1414`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:34.626925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0ae1c67f-e4a6-4cb1-bc57-3e5c8a8d0129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:34.770955 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3700/7366] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:34.779662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39333754-0954-4903-9ab7-0cfcd6dd78dc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:34.803226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39333754-0954-4903-9ab7-0cfcd6dd78dc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:34.830943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fdb9b-6d66-49b9-bb90-441b5e527f8e tempest-DefaultDomainTestJSON-30506398 tempest-DefaultDomainTestJSON-30506398-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdeae9385fdb4ec7a0408cc4aa6e1414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30d0db532fef45969efde263308f7d3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:34.842406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fdb9b-6d66-49b9-bb90-441b5e527f8e tempest-DefaultDomainTestJSON-30506398 tempest-DefaultDomainTestJSON-30506398-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:34.842715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fdb9b-6d66-49b9-bb90-441b5e527f8e tempest-DefaultDomainTestJSON-30506398 tempest-DefaultDomainTestJSON-30506398-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:34.843446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fdb9b-6d66-49b9-bb90-441b5e527f8e tempest-DefaultDomainTestJSON-30506398 tempest-DefaultDomainTestJSON-30506398-project] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:34.849582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fdb9b-6d66-49b9-bb90-441b5e527f8e tempest-DefaultDomainTestJSON-30506398 tempest-DefaultDomainTestJSON-30506398-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:34.851220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fdb9b-6d66-49b9-bb90-441b5e527f8e tempest-DefaultDomainTestJSON-30506398 tempest-DefaultDomainTestJSON-30506398-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:34.872153 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3667/7367] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Sep 30 10:16:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:16:34.875138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1c67f-e4a6-4cb1-bc57-3e5c8a8d0129 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:35.084663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1c67f-e4a6-4cb1-bc57-3e5c8a8d0129 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:35.114360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1158d4c-86b2-45e4-8d7b-0ce8109f727e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:35.138634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1158d4c-86b2-45e4-8d7b-0ce8109f727e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:35.138634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1158d4c-86b2-45e4-8d7b-0ce8109f727e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:35.138634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1158d4c-86b2-45e4-8d7b-0ce8109f727e admin admin] PATH_INFO: `/v3/users/bdeae9385fdb4ec7a0408cc4aa6e1414` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:35.143376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1158d4c-86b2-45e4-8d7b-0ce8109f727e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdeae9385fdb4ec7a0408cc4aa6e1414)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:35.145465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1158d4c-86b2-45e4-8d7b-0ce8109f727e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:35.222908 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:35.272537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f1158d4c-86b2-45e4-8d7b-0ce8109f727e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdeae9385fdb4ec7a0408cc4aa6e1414'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:35.273900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f1158d4c-86b2-45e4-8d7b-0ce8109f727e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdeae9385fdb4ec7a0408cc4aa6e1414'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:35.289671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f1158d4c-86b2-45e4-8d7b-0ce8109f727e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdeae9385fdb4ec7a0408cc4aa6e1414'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:35.312691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f1158d4c-86b2-45e4-8d7b-0ce8109f727e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdeae9385fdb4ec7a0408cc4aa6e1414'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:35.320799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f1158d4c-86b2-45e4-8d7b-0ce8109f727e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdeae9385fdb4ec7a0408cc4aa6e1414'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:35.329017 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3701/7368] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:16:34 2022] DELETE /identity/v3/users/bdeae9385fdb4ec7a0408cc4aa6e1414 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:35.333385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23239545-1768-4914-a251-25cb258eb170 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:35.334285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23239545-1768-4914-a251-25cb258eb170 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:35.334937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23239545-1768-4914-a251-25cb258eb170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:35.367974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-23239545-1768-4914-a251-25cb258eb170 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:35.372360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-23239545-1768-4914-a251-25cb258eb170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:35.537465 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3668/7369] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:16:35.548713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1158d4c-86b2-45e4-8d7b-0ce8109f727e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:35.550209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f1158d4c-86b2-45e4-8d7b-0ce8109f727e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:35.683238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1158d4c-86b2-45e4-8d7b-0ce8109f727e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:35.703396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe754b-5c9c-4cb7-b27e-5c7749cfffc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:35.705590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe754b-5c9c-4cb7-b27e-5c7749cfffc8 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:35.705884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe754b-5c9c-4cb7-b27e-5c7749cfffc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:35.706161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe754b-5c9c-4cb7-b27e-5c7749cfffc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:35.732551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe754b-5c9c-4cb7-b27e-5c7749cfffc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:35.734349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe754b-5c9c-4cb7-b27e-5c7749cfffc8 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:35.748298 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3702/7370] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:16:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:16:36.371024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23239545-1768-4914-a251-25cb258eb170 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:36.373628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-23239545-1768-4914-a251-25cb258eb170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:36.403134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23239545-1768-4914-a251-25cb258eb170 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:36.409223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2d999-a696-4d4e-871b-6cbeb9a02f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:36.410350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2d999-a696-4d4e-871b-6cbeb9a02f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:36.410876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2d999-a696-4d4e-871b-6cbeb9a02f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:36.411574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2d999-a696-4d4e-871b-6cbeb9a02f05 admin admin] PATH_INFO: `/v3/projects/30d0db532fef45969efde263308f7d3a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:36.413114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2d999-a696-4d4e-871b-6cbeb9a02f05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30d0db532fef45969efde263308f7d3a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:36.415839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2d999-a696-4d4e-871b-6cbeb9a02f05 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:36.502908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-01d2d999-a696-4d4e-871b-6cbeb9a02f05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d0db532fef45969efde263308f7d3a', 'request_id': 'req-01d2d999-a696-4d4e-871b-6cbeb9a02f05'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:36.505918 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:36.532514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-01d2d999-a696-4d4e-871b-6cbeb9a02f05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d0db532fef45969efde263308f7d3a', 'request_id': 'req-01d2d999-a696-4d4e-871b-6cbeb9a02f05'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:36.543412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-01d2d999-a696-4d4e-871b-6cbeb9a02f05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d0db532fef45969efde263308f7d3a', 'request_id': 'req-01d2d999-a696-4d4e-871b-6cbeb9a02f05'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:36.577323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-01d2d999-a696-4d4e-871b-6cbeb9a02f05 admin admin] The token cache is being invalidate because project 30d0db532fef45969efde263308f7d3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:36.579629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-01d2d999-a696-4d4e-871b-6cbeb9a02f05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:36.583614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-01d2d999-a696-4d4e-871b-6cbeb9a02f05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:36.587192 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3669/7371] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:16:36 2022] DELETE /identity/v3/projects/30d0db532fef45969efde263308f7d3a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:16:36.592541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668940b-aba3-4ffc-a336-f5edb0dbba22 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:36.593095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668940b-aba3-4ffc-a336-f5edb0dbba22 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:36.593095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668940b-aba3-4ffc-a336-f5edb0dbba22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:36.635791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c668940b-aba3-4ffc-a336-f5edb0dbba22 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:36.638059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c668940b-aba3-4ffc-a336-f5edb0dbba22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:36.802821 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3703/7372] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:36.811568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab93e4-10f5-40b9-8e6e-ca5f3b503111 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:36.811868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab93e4-10f5-40b9-8e6e-ca5f3b503111 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:36.812116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab93e4-10f5-40b9-8e6e-ca5f3b503111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:36.857565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8fab93e4-10f5-40b9-8e6e-ca5f3b503111 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:36.858795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8fab93e4-10f5-40b9-8e6e-ca5f3b503111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:36.882208 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3670/7373] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:36.886053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668940b-aba3-4ffc-a336-f5edb0dbba22 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:36.909745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668940b-aba3-4ffc-a336-f5edb0dbba22 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:36.916162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f0157-47ec-4c4e-9d61-4ed59efb862c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:36.924911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f0157-47ec-4c4e-9d61-4ed59efb862c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:36.925973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f0157-47ec-4c4e-9d61-4ed59efb862c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:36.926959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f0157-47ec-4c4e-9d61-4ed59efb862c admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:36.927908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f0157-47ec-4c4e-9d61-4ed59efb862c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:16:36.928386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f0157-47ec-4c4e-9d61-4ed59efb862c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:36.935931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f0157-47ec-4c4e-9d61-4ed59efb862c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:36.965323 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3704/7374] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:16:36.966987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab93e4-10f5-40b9-8e6e-ca5f3b503111 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:36.981054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab93e4-10f5-40b9-8e6e-ca5f3b503111 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:36.998315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717c870-0993-4047-8883-9bbe72c40f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:36.999007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717c870-0993-4047-8883-9bbe72c40f0c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:36.999276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717c870-0993-4047-8883-9bbe72c40f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:36.999593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717c870-0993-4047-8883-9bbe72c40f0c admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:37.000240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717c870-0993-4047-8883-9bbe72c40f0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:37.002342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717c870-0993-4047-8883-9bbe72c40f0c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:37.062212 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3671/7375] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:16:36 2022] POST /identity/v3/projects => generated 359 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:37.066207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f0157-47ec-4c4e-9d61-4ed59efb862c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:37.082680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f0157-47ec-4c4e-9d61-4ed59efb862c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:37.178018 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:37.239286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819591c-9488-4123-b45a-8c94be065c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:37.240356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819591c-9488-4123-b45a-8c94be065c5b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:37.240989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819591c-9488-4123-b45a-8c94be065c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:37.241288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819591c-9488-4123-b45a-8c94be065c5b admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:37.241994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819591c-9488-4123-b45a-8c94be065c5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:37.245168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819591c-9488-4123-b45a-8c94be065c5b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:37.274451 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3705/7376] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:16:37 2022] POST /identity/v3/users => generated 280 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:37.274579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717c870-0993-4047-8883-9bbe72c40f0c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:37.292383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717c870-0993-4047-8883-9bbe72c40f0c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:37.315154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47779944-a572-4547-843e-a0c4cc1a82f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:37.315791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47779944-a572-4547-843e-a0c4cc1a82f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:37.320036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47779944-a572-4547-843e-a0c4cc1a82f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:37.320632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47779944-a572-4547-843e-a0c4cc1a82f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:37.323094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47779944-a572-4547-843e-a0c4cc1a82f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:37.327999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47779944-a572-4547-843e-a0c4cc1a82f8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:37.364239 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3672/7377] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:16:37.369983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819591c-9488-4123-b45a-8c94be065c5b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:37.408743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819591c-9488-4123-b45a-8c94be065c5b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:37.408743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0eef5-2cc6-40a6-a0b3-23829e4c1ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:37.408743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0eef5-2cc6-40a6-a0b3-23829e4c1ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:37.408743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0eef5-2cc6-40a6-a0b3-23829e4c1ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:37.409248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0eef5-2cc6-40a6-a0b3-23829e4c1ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:37.409248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0eef5-2cc6-40a6-a0b3-23829e4c1ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:37.409638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0eef5-2cc6-40a6-a0b3-23829e4c1ec0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:37.425983 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3706/7378] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:16:37.427039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47779944-a572-4547-843e-a0c4cc1a82f8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:37.440192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47779944-a572-4547-843e-a0c4cc1a82f8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:37.453964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85439fd1-33dd-49b8-a945-9a5bb722aae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:37.458409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85439fd1-33dd-49b8-a945-9a5bb722aae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:37.458801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85439fd1-33dd-49b8-a945-9a5bb722aae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:37.459753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85439fd1-33dd-49b8-a945-9a5bb722aae3 admin admin] PATH_INFO: `/v3/projects/3bf7217637ec4d6e923847b7db918c11/users/093d46d632c94e0486f36ea8bbfd22d8/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:37.489491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85439fd1-33dd-49b8-a945-9a5bb722aae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf7217637ec4d6e923847b7db918c11, user_id=093d46d632c94e0486f36ea8bbfd22d8, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:37.492129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85439fd1-33dd-49b8-a945-9a5bb722aae3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:37.517079 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3673/7379] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:16:37 2022] PUT /identity/v3/projects/3bf7217637ec4d6e923847b7db918c11/users/093d46d632c94e0486f36ea8bbfd22d8/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:16:37.520110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba1050-bdc9-4170-9408-0e04ffa49109 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:37.520393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba1050-bdc9-4170-9408-0e04ffa49109 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:37.520879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba1050-bdc9-4170-9408-0e04ffa49109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:37.588843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e8ba1050-bdc9-4170-9408-0e04ffa49109 None None] MFA Rules not processed for user `093d46d632c94e0486f36ea8bbfd22d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:37.592981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e8ba1050-bdc9-4170-9408-0e04ffa49109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:37.763896 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3707/7380] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:37.765370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caa540-7c5d-4db5-96c3-2a3cde4b11d8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:37.765659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caa540-7c5d-4db5-96c3-2a3cde4b11d8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:37.765930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caa540-7c5d-4db5-96c3-2a3cde4b11d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:37.788752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-82caa540-7c5d-4db5-96c3-2a3cde4b11d8 None None] MFA Rules not processed for user `093d46d632c94e0486f36ea8bbfd22d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:37.791320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-82caa540-7c5d-4db5-96c3-2a3cde4b11d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:37.797820 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3674/7381] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:37 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 10:16:37.801606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fe929-7dab-4651-ada9-f4bcaebede4c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:37.801900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fe929-7dab-4651-ada9-f4bcaebede4c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:37.802655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fe929-7dab-4651-ada9-f4bcaebede4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:37.823826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d85fe929-7dab-4651-ada9-f4bcaebede4c None None] MFA Rules not processed for user `093d46d632c94e0486f36ea8bbfd22d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:37.825199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d85fe929-7dab-4651-ada9-f4bcaebede4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:37.829544 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3708/7382] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:37 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 10:16:37.833279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82caa540-7c5d-4db5-96c3-2a3cde4b11d8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:37.854640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82caa540-7c5d-4db5-96c3-2a3cde4b11d8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:37.867868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0e319-638c-4f76-afd1-8d0895f03d4c tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '093d46d632c94e0486f36ea8bbfd22d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bf7217637ec4d6e923847b7db918c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:37.869212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0e319-638c-4f76-afd1-8d0895f03d4c tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] REQUEST_METHOD: `HEAD` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:37.869353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0e319-638c-4f76-afd1-8d0895f03d4c tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:37.870002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0e319-638c-4f76-afd1-8d0895f03d4c tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:37.881315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0e319-638c-4f76-afd1-8d0895f03d4c tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] RBAC: Authorizing `identity:check_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:37.883071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0e319-638c-4f76-afd1-8d0895f03d4c tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:37.893679 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3675/7383] 10.222.0.16 () {56 vars in 1264 bytes} [Fri Sep 30 10:16:37 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Sep 30 10:16:37.898002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fe929-7dab-4651-ada9-f4bcaebede4c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:37.934138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0e319-638c-4f76-afd1-8d0895f03d4c tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:37.936312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fe929-7dab-4651-ada9-f4bcaebede4c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:37.938092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c3b0e319-638c-4f76-afd1-8d0895f03d4c tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:37.959647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8145e3-aac2-46a6-89e0-38b48d70041f tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '093d46d632c94e0486f36ea8bbfd22d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bf7217637ec4d6e923847b7db918c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:37.965678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8145e3-aac2-46a6-89e0-38b48d70041f tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:37.969635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8145e3-aac2-46a6-89e0-38b48d70041f tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:37.970503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8145e3-aac2-46a6-89e0-38b48d70041f tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:38.031507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8145e3-aac2-46a6-89e0-38b48d70041f tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:38.035834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8145e3-aac2-46a6-89e0-38b48d70041f tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:38.057222 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3709/7384] 10.222.0.16 () {56 vars in 1263 bytes} [Fri Sep 30 10:16:37 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 10:16:38.057972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8145e3-aac2-46a6-89e0-38b48d70041f tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:38.065996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5e8145e3-aac2-46a6-89e0-38b48d70041f tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:38.165329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0e319-638c-4f76-afd1-8d0895f03d4c tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:38.175709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597aea44-3cea-4835-8252-dc5262d57087 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:38.176963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597aea44-3cea-4835-8252-dc5262d57087 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:38.177466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597aea44-3cea-4835-8252-dc5262d57087 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:38.178100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597aea44-3cea-4835-8252-dc5262d57087 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:38.180268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-597aea44-3cea-4835-8252-dc5262d57087 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:38.217020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597aea44-3cea-4835-8252-dc5262d57087 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:38.220825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597aea44-3cea-4835-8252-dc5262d57087 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:38.239677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8145e3-aac2-46a6-89e0-38b48d70041f tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:38.250903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e756b9-f3a6-42c1-ae70-bb8facd0d1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:38.251547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e756b9-f3a6-42c1-ae70-bb8facd0d1b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:38.251822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e756b9-f3a6-42c1-ae70-bb8facd0d1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:38.252091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e756b9-f3a6-42c1-ae70-bb8facd0d1b6 admin admin] PATH_INFO: `/v3/users/e61af13275a0474bba07fe74ae601101` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:38.253256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e756b9-f3a6-42c1-ae70-bb8facd0d1b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e61af13275a0474bba07fe74ae601101)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:38.255164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e756b9-f3a6-42c1-ae70-bb8facd0d1b6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:38.292701 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3676/7385] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:16:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:16:38.293977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597aea44-3cea-4835-8252-dc5262d57087 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:38.312852 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:38.333923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597aea44-3cea-4835-8252-dc5262d57087 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:38.339950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63b488-f54b-4236-a178-f6bd37941167 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '093d46d632c94e0486f36ea8bbfd22d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bf7217637ec4d6e923847b7db918c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:38.340993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63b488-f54b-4236-a178-f6bd37941167 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:38.341674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63b488-f54b-4236-a178-f6bd37941167 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:38.344009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63b488-f54b-4236-a178-f6bd37941167 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:38.351872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63b488-f54b-4236-a178-f6bd37941167 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:38.354713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63b488-f54b-4236-a178-f6bd37941167 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:38.355684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-95e756b9-f3a6-42c1-ae70-bb8facd0d1b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e61af13275a0474bba07fe74ae601101'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:38.357151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-95e756b9-f3a6-42c1-ae70-bb8facd0d1b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e61af13275a0474bba07fe74ae601101'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:38.371257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-95e756b9-f3a6-42c1-ae70-bb8facd0d1b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e61af13275a0474bba07fe74ae601101'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:38.394489 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3677/7386] 10.222.0.16 () {56 vars in 1266 bytes} [Fri Sep 30 10:16:38 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:38.413959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63b488-f54b-4236-a178-f6bd37941167 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:38.427708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63b488-f54b-4236-a178-f6bd37941167 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:38.429956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-95e756b9-f3a6-42c1-ae70-bb8facd0d1b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e61af13275a0474bba07fe74ae601101'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:38.434760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916465e3-6c79-47eb-86ba-12fb77df0402 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '093d46d632c94e0486f36ea8bbfd22d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bf7217637ec4d6e923847b7db918c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:38.436127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916465e3-6c79-47eb-86ba-12fb77df0402 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] REQUEST_METHOD: `HEAD` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:38.436644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916465e3-6c79-47eb-86ba-12fb77df0402 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:38.437639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916465e3-6c79-47eb-86ba-12fb77df0402 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:38.469455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-95e756b9-f3a6-42c1-ae70-bb8facd0d1b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e61af13275a0474bba07fe74ae601101'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:38.477419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-916465e3-6c79-47eb-86ba-12fb77df0402 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:38.480134 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3710/7387] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:16:38 2022] DELETE /identity/v3/users/e61af13275a0474bba07fe74ae601101 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:38.486257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae69af2-8bfb-49a3-a390-cede8b55b33e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:38.493257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae69af2-8bfb-49a3-a390-cede8b55b33e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:38.494092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae69af2-8bfb-49a3-a390-cede8b55b33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:38.500038 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-916465e3-6c79-47eb-86ba-12fb77df0402 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Sep 30 10:16:38.500038 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:16:38.500038 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:16:38.500038 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:16:38.500038 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:16:38.500038 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:16:38.500038 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:16:38.500038 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:16:38.500038 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:16:38.500038 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:16:38.500038 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:16:38.500038 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:16:38.500038 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Sep 30 10:16:38.500038 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Sep 30 10:16:38.500038 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Sep 30 10:16:38.501757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Sep 30 10:16:38.501757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Sep 30 10:16:38.501757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Sep 30 10:16:38.501757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:16:38.501757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:16:38.501757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Sep 30 10:16:38.501757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Sep 30 10:16:38.501757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Sep 30 10:16:38.501757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.check_revocation(token) Sep 30 10:16:38.501757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:16:38.501757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:16:38.501757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Sep 30 10:16:38.501757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Sep 30 10:16:38.501757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:16:38.501757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:16:38.501757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Sep 30 10:16:38.501757 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Sep 30 10:16:38.502944 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:16:38.502944 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:16:38.502944 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Sep 30 10:16:38.502944 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Sep 30 10:16:38.502944 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Sep 30 10:16:38.502944 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:16:38.502944 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3678/7388] 10.222.0.16 () {56 vars in 1264 bytes} [Fri Sep 30 10:16:38 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Sep 30 10:16:38.511305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c93c98-4c2c-4d95-99dc-c8e5d25a635e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:38.512853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c93c98-4c2c-4d95-99dc-c8e5d25a635e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:38.513166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c93c98-4c2c-4d95-99dc-c8e5d25a635e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:38.542779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8ae69af2-8bfb-49a3-a390-cede8b55b33e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:38.544373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8ae69af2-8bfb-49a3-a390-cede8b55b33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:38.563313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-71c93c98-4c2c-4d95-99dc-c8e5d25a635e None None] MFA Rules not processed for user `093d46d632c94e0486f36ea8bbfd22d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:38.564820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-71c93c98-4c2c-4d95-99dc-c8e5d25a635e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:38.568620 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3679/7389] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:38 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 10:16:38.572525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c93c98-4c2c-4d95-99dc-c8e5d25a635e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:38.579433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-71c93c98-4c2c-4d95-99dc-c8e5d25a635e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:38.601230 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=4,keystone:DELETE=4,keystone:SELECT=92 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:38.725159 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3711/7390] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:38.736251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae69af2-8bfb-49a3-a390-cede8b55b33e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:38.738871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8ae69af2-8bfb-49a3-a390-cede8b55b33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:38.786026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c93c98-4c2c-4d95-99dc-c8e5d25a635e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:38.792110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e100e-8b35-4ec9-bb58-2f096e989839 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '093d46d632c94e0486f36ea8bbfd22d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bf7217637ec4d6e923847b7db918c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:38.792978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e100e-8b35-4ec9-bb58-2f096e989839 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:38.793363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e100e-8b35-4ec9-bb58-2f096e989839 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:38.793741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e100e-8b35-4ec9-bb58-2f096e989839 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:38.808822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e100e-8b35-4ec9-bb58-2f096e989839 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:38.810729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e100e-8b35-4ec9-bb58-2f096e989839 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:38.820760 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3680/7391] 10.222.0.16 () {56 vars in 1263 bytes} [Fri Sep 30 10:16:38 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 10:16:38.823405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e100e-8b35-4ec9-bb58-2f096e989839 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:38.836671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e100e-8b35-4ec9-bb58-2f096e989839 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:38.846120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f110e-428c-434d-aec7-7a5f4f725ae0 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '093d46d632c94e0486f36ea8bbfd22d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bf7217637ec4d6e923847b7db918c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:38.847206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f110e-428c-434d-aec7-7a5f4f725ae0 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:38.847470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f110e-428c-434d-aec7-7a5f4f725ae0 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:38.848286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f110e-428c-434d-aec7-7a5f4f725ae0 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:38.856801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f110e-428c-434d-aec7-7a5f4f725ae0 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:38.858528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f110e-428c-434d-aec7-7a5f4f725ae0 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:38.877592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae69af2-8bfb-49a3-a390-cede8b55b33e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:38.881880 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3681/7392] 10.222.0.16 () {56 vars in 1266 bytes} [Fri Sep 30 10:16:38 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:16:38.887101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f110e-428c-434d-aec7-7a5f4f725ae0 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:38.889318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b11635-313b-4a34-b311-9ec8d0ac880a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:38.890130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b11635-313b-4a34-b311-9ec8d0ac880a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:38.891416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b11635-313b-4a34-b311-9ec8d0ac880a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:38.892503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b11635-313b-4a34-b311-9ec8d0ac880a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:38.902945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f110e-428c-434d-aec7-7a5f4f725ae0 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:38.907842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b11635-313b-4a34-b311-9ec8d0ac880a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:38.909805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b11635-313b-4a34-b311-9ec8d0ac880a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:38.925614 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3712/7393] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:16:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:16:38.927320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d1dd7-8dae-4ae6-a232-debf0087fb15 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '093d46d632c94e0486f36ea8bbfd22d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bf7217637ec4d6e923847b7db918c11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:38.928047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d1dd7-8dae-4ae6-a232-debf0087fb15 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:38.928455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d1dd7-8dae-4ae6-a232-debf0087fb15 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:38.928662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d1dd7-8dae-4ae6-a232-debf0087fb15 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:38.930713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-af7d1dd7-8dae-4ae6-a232-debf0087fb15 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:38.955320 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-af7d1dd7-8dae-4ae6-a232-debf0087fb15 tempest-TokensV3Test-104595216 tempest-TokensV3Test-104595216-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Sep 30 10:16:38.955320 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:16:38.955320 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:16:38.955320 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:16:38.955320 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:16:38.955320 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:16:38.955320 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:16:38.955320 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:16:38.955320 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:16:38.955320 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:16:38.955320 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:16:38.955320 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:16:38.955320 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Sep 30 10:16:38.955320 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Sep 30 10:16:38.955320 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Sep 30 10:16:38.956739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Sep 30 10:16:38.956739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Sep 30 10:16:38.956739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Sep 30 10:16:38.956739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:16:38.956739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:16:38.956739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Sep 30 10:16:38.956739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Sep 30 10:16:38.956739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Sep 30 10:16:38.956739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.check_revocation(token) Sep 30 10:16:38.956739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:16:38.956739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:16:38.956739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Sep 30 10:16:38.956739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Sep 30 10:16:38.956739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:16:38.956739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:16:38.956739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Sep 30 10:16:38.956739 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Sep 30 10:16:38.958099 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:16:38.958099 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:16:38.958099 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Sep 30 10:16:38.958099 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Sep 30 10:16:38.958099 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Sep 30 10:16:38.958099 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:16:38.960190 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3682/7394] 10.222.0.16 () {56 vars in 1263 bytes} [Fri Sep 30 10:16:38 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 10:16:38.966117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b11635-313b-4a34-b311-9ec8d0ac880a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:38.967655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-11b11635-313b-4a34-b311-9ec8d0ac880a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:38.987343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b11635-313b-4a34-b311-9ec8d0ac880a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:38.996714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7479236-c4ab-4f94-9cc5-b9287030d53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:38.997354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7479236-c4ab-4f94-9cc5-b9287030d53c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:38.997635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7479236-c4ab-4f94-9cc5-b9287030d53c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:38.997906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7479236-c4ab-4f94-9cc5-b9287030d53c admin admin] PATH_INFO: `/v3/users/093d46d632c94e0486f36ea8bbfd22d8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:38.999282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7479236-c4ab-4f94-9cc5-b9287030d53c admin admin] RBAC: Authorizing `identity:delete_user(user_id=093d46d632c94e0486f36ea8bbfd22d8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:39.002128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7479236-c4ab-4f94-9cc5-b9287030d53c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:39.063327 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:39.076708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b7479236-c4ab-4f94-9cc5-b9287030d53c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093d46d632c94e0486f36ea8bbfd22d8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:39.080922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b7479236-c4ab-4f94-9cc5-b9287030d53c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093d46d632c94e0486f36ea8bbfd22d8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:39.093803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b7479236-c4ab-4f94-9cc5-b9287030d53c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093d46d632c94e0486f36ea8bbfd22d8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:39.111648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b7479236-c4ab-4f94-9cc5-b9287030d53c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093d46d632c94e0486f36ea8bbfd22d8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:39.120494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b7479236-c4ab-4f94-9cc5-b9287030d53c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093d46d632c94e0486f36ea8bbfd22d8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:39.131597 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3713/7395] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:16:38 2022] DELETE /identity/v3/users/093d46d632c94e0486f36ea8bbfd22d8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:39.133637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43108b77-eefd-40ee-aa9f-cc40c1a3d272 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:39.133928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43108b77-eefd-40ee-aa9f-cc40c1a3d272 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:39.134792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43108b77-eefd-40ee-aa9f-cc40c1a3d272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:39.186489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-43108b77-eefd-40ee-aa9f-cc40c1a3d272 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:39.188433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-43108b77-eefd-40ee-aa9f-cc40c1a3d272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:39.248874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7479236-c4ab-4f94-9cc5-b9287030d53c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:39.250340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b7479236-c4ab-4f94-9cc5-b9287030d53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:39.393950 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3683/7396] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:16:39.414165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43108b77-eefd-40ee-aa9f-cc40c1a3d272 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:39.418150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-43108b77-eefd-40ee-aa9f-cc40c1a3d272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:39.455961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7479236-c4ab-4f94-9cc5-b9287030d53c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:39.472522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869ef1b-9b27-428d-aa19-b8fa57597526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:39.473215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869ef1b-9b27-428d-aa19-b8fa57597526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:39.473498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869ef1b-9b27-428d-aa19-b8fa57597526 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:39.473772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869ef1b-9b27-428d-aa19-b8fa57597526 admin admin] PATH_INFO: `/v3/projects/806048be31e646e2a5db7fadcce635d9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:39.480868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869ef1b-9b27-428d-aa19-b8fa57597526 admin admin] RBAC: Authorizing `identity:delete_project(project_id=806048be31e646e2a5db7fadcce635d9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:39.482189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869ef1b-9b27-428d-aa19-b8fa57597526 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:39.597666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43108b77-eefd-40ee-aa9f-cc40c1a3d272 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:39.606203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64730690-425d-4e04-8de9-2d9eba45d1ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:39.608727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64730690-425d-4e04-8de9-2d9eba45d1ad service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:39.609589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64730690-425d-4e04-8de9-2d9eba45d1ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:39.610489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64730690-425d-4e04-8de9-2d9eba45d1ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:39.636023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64730690-425d-4e04-8de9-2d9eba45d1ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:39.637432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64730690-425d-4e04-8de9-2d9eba45d1ad service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:39.654179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1869ef1b-9b27-428d-aa19-b8fa57597526 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '806048be31e646e2a5db7fadcce635d9', 'request_id': 'req-1869ef1b-9b27-428d-aa19-b8fa57597526'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:39.660138 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3684/7397] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:16:39.684459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1869ef1b-9b27-428d-aa19-b8fa57597526 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '806048be31e646e2a5db7fadcce635d9', 'request_id': 'req-1869ef1b-9b27-428d-aa19-b8fa57597526'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:39.691423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1869ef1b-9b27-428d-aa19-b8fa57597526 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '806048be31e646e2a5db7fadcce635d9', 'request_id': 'req-1869ef1b-9b27-428d-aa19-b8fa57597526'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:39.705914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1869ef1b-9b27-428d-aa19-b8fa57597526 admin admin] The token cache is being invalidate because project 806048be31e646e2a5db7fadcce635d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:39.706496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1869ef1b-9b27-428d-aa19-b8fa57597526 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:39.706963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1869ef1b-9b27-428d-aa19-b8fa57597526 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:39.712731 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3714/7398] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:16:39 2022] DELETE /identity/v3/projects/806048be31e646e2a5db7fadcce635d9 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:39.714412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce06f5-d269-452c-a54a-b3b9be7d13d6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:39.714797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce06f5-d269-452c-a54a-b3b9be7d13d6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:39.715180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce06f5-d269-452c-a54a-b3b9be7d13d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:39.776874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9dce06f5-d269-452c-a54a-b3b9be7d13d6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:39.781792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9dce06f5-d269-452c-a54a-b3b9be7d13d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:39.831561 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:40.030667 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3685/7399] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:16:40.038262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049abe1-a613-4b25-8a75-2253ca24af0d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:40.038807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049abe1-a613-4b25-8a75-2253ca24af0d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:40.039026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049abe1-a613-4b25-8a75-2253ca24af0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:40.072034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c049abe1-a613-4b25-8a75-2253ca24af0d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:40.073774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c049abe1-a613-4b25-8a75-2253ca24af0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:40.085077 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3715/7400] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:40.089808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce06f5-d269-452c-a54a-b3b9be7d13d6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:40.104633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce06f5-d269-452c-a54a-b3b9be7d13d6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:40.113915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300a44d-56c4-4926-8d7d-eab223cc582a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:40.115257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300a44d-56c4-4926-8d7d-eab223cc582a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:40.115631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300a44d-56c4-4926-8d7d-eab223cc582a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:40.115976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300a44d-56c4-4926-8d7d-eab223cc582a admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:40.116783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300a44d-56c4-4926-8d7d-eab223cc582a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:16:40.117171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300a44d-56c4-4926-8d7d-eab223cc582a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:40.119522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300a44d-56c4-4926-8d7d-eab223cc582a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:40.137082 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3686/7401] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:16:40.141129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049abe1-a613-4b25-8a75-2253ca24af0d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:40.152231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049abe1-a613-4b25-8a75-2253ca24af0d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:40.170561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d26315-8f15-4a1b-ac0c-020d6afb7aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:40.172005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d26315-8f15-4a1b-ac0c-020d6afb7aba admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:40.172256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d26315-8f15-4a1b-ac0c-020d6afb7aba admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:40.172568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d26315-8f15-4a1b-ac0c-020d6afb7aba admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:40.175267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d26315-8f15-4a1b-ac0c-020d6afb7aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:40.180437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d26315-8f15-4a1b-ac0c-020d6afb7aba admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:40.268465 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3716/7402] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:16:40 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:16:40.272378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300a44d-56c4-4926-8d7d-eab223cc582a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:40.298231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300a44d-56c4-4926-8d7d-eab223cc582a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:40.395955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a5318-8436-4113-b025-3a4066be305c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:40.397357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a5318-8436-4113-b025-3a4066be305c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:40.397640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a5318-8436-4113-b025-3a4066be305c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:40.397911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a5318-8436-4113-b025-3a4066be305c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:40.398579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a5318-8436-4113-b025-3a4066be305c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:40.404293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a5318-8436-4113-b025-3a4066be305c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:40.456342 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3687/7403] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:16:40 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:40.458722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d26315-8f15-4a1b-ac0c-020d6afb7aba admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:40.471422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d26315-8f15-4a1b-ac0c-020d6afb7aba admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:40.489161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a28b82-606f-48df-8838-4c9cb51ad01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:40.490175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a28b82-606f-48df-8838-4c9cb51ad01f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:40.490486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a28b82-606f-48df-8838-4c9cb51ad01f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:40.490988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a28b82-606f-48df-8838-4c9cb51ad01f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:40.493192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a28b82-606f-48df-8838-4c9cb51ad01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:40.496028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a28b82-606f-48df-8838-4c9cb51ad01f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:40.508258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a5318-8436-4113-b025-3a4066be305c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:40.511163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eb7a5318-8436-4113-b025-3a4066be305c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:40.533797 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3717/7404] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:16:40.534999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a28b82-606f-48df-8838-4c9cb51ad01f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:40.538975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a5318-8436-4113-b025-3a4066be305c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:40.558836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03ec2b-8769-4bd0-8366-204547b211c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:40.559663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03ec2b-8769-4bd0-8366-204547b211c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:40.562545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a28b82-606f-48df-8838-4c9cb51ad01f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:40.563041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03ec2b-8769-4bd0-8366-204547b211c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:40.563506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03ec2b-8769-4bd0-8366-204547b211c5 admin admin] PATH_INFO: `/v3/projects/3bf7217637ec4d6e923847b7db918c11` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:40.573912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74857a65-9637-4300-bdc6-4cde8acbd3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:40.574919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74857a65-9637-4300-bdc6-4cde8acbd3da admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:40.575508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74857a65-9637-4300-bdc6-4cde8acbd3da admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:40.575852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74857a65-9637-4300-bdc6-4cde8acbd3da admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:40.576743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74857a65-9637-4300-bdc6-4cde8acbd3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:40.578703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74857a65-9637-4300-bdc6-4cde8acbd3da admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:40.582879 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:40.594180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03ec2b-8769-4bd0-8366-204547b211c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf7217637ec4d6e923847b7db918c11)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:40.599466 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3718/7405] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:16:40.602414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74857a65-9637-4300-bdc6-4cde8acbd3da admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:40.605969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03ec2b-8769-4bd0-8366-204547b211c5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:40.615216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74857a65-9637-4300-bdc6-4cde8acbd3da admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:40.639910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe72c4-9d53-48ad-8b7a-fb27009dc23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:40.643152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe72c4-9d53-48ad-8b7a-fb27009dc23d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:40.643501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe72c4-9d53-48ad-8b7a-fb27009dc23d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:40.645704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe72c4-9d53-48ad-8b7a-fb27009dc23d admin admin] PATH_INFO: `/v3/projects/4d040990642f4f0d9b06ea5cf218f958/users/bcc3699e4f3948a6bc27299e22ffaaf7/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:40.685257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe72c4-9d53-48ad-8b7a-fb27009dc23d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d040990642f4f0d9b06ea5cf218f958, user_id=bcc3699e4f3948a6bc27299e22ffaaf7, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:40.693501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe72c4-9d53-48ad-8b7a-fb27009dc23d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:40.730671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd03ec2b-8769-4bd0-8366-204547b211c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf7217637ec4d6e923847b7db918c11', 'request_id': 'req-cd03ec2b-8769-4bd0-8366-204547b211c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:40.753884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd03ec2b-8769-4bd0-8366-204547b211c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf7217637ec4d6e923847b7db918c11', 'request_id': 'req-cd03ec2b-8769-4bd0-8366-204547b211c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:40.767322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd03ec2b-8769-4bd0-8366-204547b211c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf7217637ec4d6e923847b7db918c11', 'request_id': 'req-cd03ec2b-8769-4bd0-8366-204547b211c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:40.769605 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3719/7406] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:16:40 2022] PUT /identity/v3/projects/4d040990642f4f0d9b06ea5cf218f958/users/bcc3699e4f3948a6bc27299e22ffaaf7/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:16:40.781407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32151e3e-6293-4ed9-b908-a6473e0750b1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:40.781895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32151e3e-6293-4ed9-b908-a6473e0750b1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:40.782178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32151e3e-6293-4ed9-b908-a6473e0750b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:40.842012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-32151e3e-6293-4ed9-b908-a6473e0750b1 None None] MFA Rules not processed for user `bcc3699e4f3948a6bc27299e22ffaaf7`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:40.845539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-32151e3e-6293-4ed9-b908-a6473e0750b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:40.848434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd03ec2b-8769-4bd0-8366-204547b211c5 admin admin] The token cache is being invalidate because project 3bf7217637ec4d6e923847b7db918c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:40.849131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd03ec2b-8769-4bd0-8366-204547b211c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:40.852996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd03ec2b-8769-4bd0-8366-204547b211c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:40.858465 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3688/7407] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:16:40 2022] DELETE /identity/v3/projects/3bf7217637ec4d6e923847b7db918c11 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:40.863968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f953e8b-30a2-4e8e-9260-915f99b987f4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:40.865415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f953e8b-30a2-4e8e-9260-915f99b987f4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:40.866628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f953e8b-30a2-4e8e-9260-915f99b987f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:40.905786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2f953e8b-30a2-4e8e-9260-915f99b987f4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:40.909348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2f953e8b-30a2-4e8e-9260-915f99b987f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:40.950126 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:40.997509 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3720/7408] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:41.018486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32151e3e-6293-4ed9-b908-a6473e0750b1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:41.021149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-32151e3e-6293-4ed9-b908-a6473e0750b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:41.045711 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3689/7409] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:41.053765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a61b01-74bc-4ea0-9644-32ad64162779 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:41.054211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a61b01-74bc-4ea0-9644-32ad64162779 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:41.054612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a61b01-74bc-4ea0-9644-32ad64162779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:41.101438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c4a61b01-74bc-4ea0-9644-32ad64162779 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:41.101438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c4a61b01-74bc-4ea0-9644-32ad64162779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:41.114428 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3690/7410] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:41.115347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a61b01-74bc-4ea0-9644-32ad64162779 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:41.128804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a61b01-74bc-4ea0-9644-32ad64162779 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:41.135343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32151e3e-6293-4ed9-b908-a6473e0750b1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:41.135872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84d47a-773f-4fee-abfe-999e2371e9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:41.136250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84d47a-773f-4fee-abfe-999e2371e9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:41.138192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84d47a-773f-4fee-abfe-999e2371e9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:41.138192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84d47a-773f-4fee-abfe-999e2371e9a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:41.138192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84d47a-773f-4fee-abfe-999e2371e9a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:16:41.138192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84d47a-773f-4fee-abfe-999e2371e9a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:41.139419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84d47a-773f-4fee-abfe-999e2371e9a5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:41.142713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a1467-4b6b-4e80-8206-43b548595fa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:41.144054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a1467-4b6b-4e80-8206-43b548595fa4 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:41.144217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a1467-4b6b-4e80-8206-43b548595fa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:41.144585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a1467-4b6b-4e80-8206-43b548595fa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:41.161788 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3691/7411] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:16:41.162445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84d47a-773f-4fee-abfe-999e2371e9a5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:41.180645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84d47a-773f-4fee-abfe-999e2371e9a5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:41.185520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a1467-4b6b-4e80-8206-43b548595fa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:41.188428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a1467-4b6b-4e80-8206-43b548595fa4 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:41.202105 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3721/7412] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:16:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:16:41.210195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0682d-c1d9-402f-94da-c3ec998c0ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:41.210891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0682d-c1d9-402f-94da-c3ec998c0ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:41.211210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0682d-c1d9-402f-94da-c3ec998c0ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:41.211502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0682d-c1d9-402f-94da-c3ec998c0ff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:41.213022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0682d-c1d9-402f-94da-c3ec998c0ff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:41.215296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0682d-c1d9-402f-94da-c3ec998c0ff5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:41.254444 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3692/7413] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:16:41 2022] POST /identity/v3/projects => generated 399 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:41.256087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a1467-4b6b-4e80-8206-43b548595fa4 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:41.271346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a1467-4b6b-4e80-8206-43b548595fa4 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:41.373496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc6198-5117-4e76-80b7-4a9476d11fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:41.374152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc6198-5117-4e76-80b7-4a9476d11fea admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:41.374493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc6198-5117-4e76-80b7-4a9476d11fea admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:41.374741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc6198-5117-4e76-80b7-4a9476d11fea admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:41.375632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc6198-5117-4e76-80b7-4a9476d11fea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:41.381137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc6198-5117-4e76-80b7-4a9476d11fea admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:41.401462 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:41.420934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0682d-c1d9-402f-94da-c3ec998c0ff5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:41.432862 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3722/7414] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:16:41 2022] POST /identity/v3/users => generated 306 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:16:41.435623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0682d-c1d9-402f-94da-c3ec998c0ff5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:41.450441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4355c-fdce-4bcc-bd0d-f8dc5ce87450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:41.453400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4355c-fdce-4bcc-bd0d-f8dc5ce87450 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:41.453919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4355c-fdce-4bcc-bd0d-f8dc5ce87450 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:41.455873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4355c-fdce-4bcc-bd0d-f8dc5ce87450 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:41.456799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4355c-fdce-4bcc-bd0d-f8dc5ce87450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:41.467567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4355c-fdce-4bcc-bd0d-f8dc5ce87450 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:41.489051 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3693/7415] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:16:41.490656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc6198-5117-4e76-80b7-4a9476d11fea admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:41.510043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc6198-5117-4e76-80b7-4a9476d11fea admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:41.516930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96089a68-90c5-4c5c-8170-6cbfa33a8cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:41.517638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96089a68-90c5-4c5c-8170-6cbfa33a8cac admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:41.517893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96089a68-90c5-4c5c-8170-6cbfa33a8cac admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:41.518162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96089a68-90c5-4c5c-8170-6cbfa33a8cac admin admin] PATH_INFO: `/v3/projects/cff6d14f411740b29fa9bb527d62e513/users/953c80714faf488ba328030075ee2e9e/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:41.568061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96089a68-90c5-4c5c-8170-6cbfa33a8cac admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff6d14f411740b29fa9bb527d62e513, user_id=953c80714faf488ba328030075ee2e9e, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:41.570150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96089a68-90c5-4c5c-8170-6cbfa33a8cac admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:41.602486 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3723/7416] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:16:41 2022] PUT /identity/v3/projects/cff6d14f411740b29fa9bb527d62e513/users/953c80714faf488ba328030075ee2e9e/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:41.608300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4355c-fdce-4bcc-bd0d-f8dc5ce87450 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:41.639077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4355c-fdce-4bcc-bd0d-f8dc5ce87450 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:41.844000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1af9c-a2ba-47dd-b1f1-2610173ea8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:41.845306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1af9c-a2ba-47dd-b1f1-2610173ea8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:41.845756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1af9c-a2ba-47dd-b1f1-2610173ea8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:41.846213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1af9c-a2ba-47dd-b1f1-2610173ea8a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:41.847220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1af9c-a2ba-47dd-b1f1-2610173ea8a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:41.852910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1af9c-a2ba-47dd-b1f1-2610173ea8a6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:41.872211 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3694/7417] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:16:41.873218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96089a68-90c5-4c5c-8170-6cbfa33a8cac admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:41.887596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96089a68-90c5-4c5c-8170-6cbfa33a8cac admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:41.903209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbe2c8-99eb-47ed-8d5a-c5a696cbd729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:41.906534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbe2c8-99eb-47ed-8d5a-c5a696cbd729 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:41.907741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbe2c8-99eb-47ed-8d5a-c5a696cbd729 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:41.908085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbe2c8-99eb-47ed-8d5a-c5a696cbd729 admin admin] PATH_INFO: `/v3/projects/cff6d14f411740b29fa9bb527d62e513/users/953c80714faf488ba328030075ee2e9e/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:41.913870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbe2c8-99eb-47ed-8d5a-c5a696cbd729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff6d14f411740b29fa9bb527d62e513, user_id=953c80714faf488ba328030075ee2e9e, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:41.917693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbe2c8-99eb-47ed-8d5a-c5a696cbd729 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:41.968637 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3724/7418] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:16:41 2022] PUT /identity/v3/projects/cff6d14f411740b29fa9bb527d62e513/users/953c80714faf488ba328030075ee2e9e/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:41.983330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f231a-daa1-41a6-82f9-45a673fb59e7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:41.985360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f231a-daa1-41a6-82f9-45a673fb59e7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:41.985865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f231a-daa1-41a6-82f9-45a673fb59e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:42.048268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-971f231a-daa1-41a6-82f9-45a673fb59e7 None None] MFA Rules not processed for user `953c80714faf488ba328030075ee2e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:42.049791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-971f231a-daa1-41a6-82f9-45a673fb59e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:42.237276 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:42.290075 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3695/7419] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:41 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:16:42.291898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbe2c8-99eb-47ed-8d5a-c5a696cbd729 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:42.423765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbe2c8-99eb-47ed-8d5a-c5a696cbd729 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:42.437894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b2473-3d3c-49b1-be29-383600794472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:42.439334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b2473-3d3c-49b1-be29-383600794472 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:42.440403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b2473-3d3c-49b1-be29-383600794472 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:42.440807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b2473-3d3c-49b1-be29-383600794472 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:42.441558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b2473-3d3c-49b1-be29-383600794472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:42.444593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b2473-3d3c-49b1-be29-383600794472 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:42.522278 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3725/7420] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:16:42 2022] POST /identity/v3/projects => generated 399 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:42.525904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f231a-daa1-41a6-82f9-45a673fb59e7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:42.541501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f231a-daa1-41a6-82f9-45a673fb59e7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:42.741637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61d7d5-2fe8-4e38-8d2e-8f94dcec003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:42.745279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61d7d5-2fe8-4e38-8d2e-8f94dcec003b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:42.745764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61d7d5-2fe8-4e38-8d2e-8f94dcec003b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:42.746219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61d7d5-2fe8-4e38-8d2e-8f94dcec003b admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:42.747047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61d7d5-2fe8-4e38-8d2e-8f94dcec003b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:42.750214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61d7d5-2fe8-4e38-8d2e-8f94dcec003b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:42.786590 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3696/7421] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:16:42 2022] POST /identity/v3/users => generated 300 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:42.790010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b2473-3d3c-49b1-be29-383600794472 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:42.815610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b2473-3d3c-49b1-be29-383600794472 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:42.869038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09c910-5fe8-4e32-bc89-67482e70b898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:42.881364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09c910-5fe8-4e32-bc89-67482e70b898 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:42.881648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09c910-5fe8-4e32-bc89-67482e70b898 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:42.882487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09c910-5fe8-4e32-bc89-67482e70b898 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:42.883395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09c910-5fe8-4e32-bc89-67482e70b898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:42.893736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09c910-5fe8-4e32-bc89-67482e70b898 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:42.943331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61d7d5-2fe8-4e38-8d2e-8f94dcec003b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:42.944920 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3726/7422] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:16:42.963204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61d7d5-2fe8-4e38-8d2e-8f94dcec003b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:42.976264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a7f6a-c424-49ea-983e-7c59d97a43c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:42.976926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a7f6a-c424-49ea-983e-7c59d97a43c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:42.977213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a7f6a-c424-49ea-983e-7c59d97a43c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:42.977492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a7f6a-c424-49ea-983e-7c59d97a43c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:42.978876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a7f6a-c424-49ea-983e-7c59d97a43c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:42.980586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a7f6a-c424-49ea-983e-7c59d97a43c5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:43.026954 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3697/7423] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:16:43.028175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09c910-5fe8-4e32-bc89-67482e70b898 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:43.042095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09c910-5fe8-4e32-bc89-67482e70b898 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:43.056963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21a5b4-8383-4b84-85b2-59fd3d64aa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:43.058676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21a5b4-8383-4b84-85b2-59fd3d64aa28 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:43.060273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21a5b4-8383-4b84-85b2-59fd3d64aa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:43.061056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21a5b4-8383-4b84-85b2-59fd3d64aa28 admin admin] PATH_INFO: `/v3/projects/5033b58a3ef146fea7a649e3958f0942/users/ce52d5a3abc04b76bab6731e38337d1a/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:43.097449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21a5b4-8383-4b84-85b2-59fd3d64aa28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5033b58a3ef146fea7a649e3958f0942, user_id=ce52d5a3abc04b76bab6731e38337d1a, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:43.100092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21a5b4-8383-4b84-85b2-59fd3d64aa28 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:43.119424 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3727/7424] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:16:43 2022] PUT /identity/v3/projects/5033b58a3ef146fea7a649e3958f0942/users/ce52d5a3abc04b76bab6731e38337d1a/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:43.129647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bbdbd-531d-4372-9747-a69e992ffb2a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:43.129935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bbdbd-531d-4372-9747-a69e992ffb2a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:43.130218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bbdbd-531d-4372-9747-a69e992ffb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:43.163892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f18bbdbd-531d-4372-9747-a69e992ffb2a None None] MFA Rules not processed for user `ce52d5a3abc04b76bab6731e38337d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:43.166643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f18bbdbd-531d-4372-9747-a69e992ffb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:43.273234 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3698/7425] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:43 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:43.288096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21a5b4-8383-4b84-85b2-59fd3d64aa28 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:43.291058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0a21a5b4-8383-4b84-85b2-59fd3d64aa28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:43.436274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21a5b4-8383-4b84-85b2-59fd3d64aa28 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:43.451322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2216f6c-2031-4e6a-9900-4a56c1820445 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:43.452329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2216f6c-2031-4e6a-9900-4a56c1820445 service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:43.453713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2216f6c-2031-4e6a-9900-4a56c1820445 service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:43.454260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2216f6c-2031-4e6a-9900-4a56c1820445 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:43.519391 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:43.630579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2216f6c-2031-4e6a-9900-4a56c1820445 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:43.636232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2216f6c-2031-4e6a-9900-4a56c1820445 service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:43.654250 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3728/7426] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:16:43 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:16:44.527144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18bbdbd-531d-4372-9747-a69e992ffb2a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:44.676462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18bbdbd-531d-4372-9747-a69e992ffb2a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:44.683970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df01eb-1930-4b59-9ccd-35d7184e866d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:44.685003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df01eb-1930-4b59-9ccd-35d7184e866d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:44.685329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df01eb-1930-4b59-9ccd-35d7184e866d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:44.685898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df01eb-1930-4b59-9ccd-35d7184e866d admin admin] PATH_INFO: `/v3/users/953c80714faf488ba328030075ee2e9e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:44.689660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df01eb-1930-4b59-9ccd-35d7184e866d admin admin] RBAC: Authorizing `identity:delete_user(user_id=953c80714faf488ba328030075ee2e9e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:44.693120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df01eb-1930-4b59-9ccd-35d7184e866d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:44.696046 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:44.857852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a2df01eb-1930-4b59-9ccd-35d7184e866d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '953c80714faf488ba328030075ee2e9e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:44.891952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a2df01eb-1930-4b59-9ccd-35d7184e866d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '953c80714faf488ba328030075ee2e9e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:44.893423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a2df01eb-1930-4b59-9ccd-35d7184e866d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '953c80714faf488ba328030075ee2e9e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:44.938186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a2df01eb-1930-4b59-9ccd-35d7184e866d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '953c80714faf488ba328030075ee2e9e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:44.955790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a2df01eb-1930-4b59-9ccd-35d7184e866d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '953c80714faf488ba328030075ee2e9e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:44.968524 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3699/7427] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:16:44 2022] DELETE /identity/v3/users/953c80714faf488ba328030075ee2e9e => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:44.972978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2c695-ff88-4559-b268-10dfd8d0debf None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:44.974382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2c695-ff88-4559-b268-10dfd8d0debf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:44.974824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2c695-ff88-4559-b268-10dfd8d0debf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:45.034504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-afb2c695-ff88-4559-b268-10dfd8d0debf None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:45.035742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-afb2c695-ff88-4559-b268-10dfd8d0debf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:45.302228 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3729/7428] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:45.328559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df01eb-1930-4b59-9ccd-35d7184e866d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:45.338734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a2df01eb-1930-4b59-9ccd-35d7184e866d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:45.501598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df01eb-1930-4b59-9ccd-35d7184e866d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:45.510810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357c057-315b-4f59-9c63-3b745e344e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:45.513666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357c057-315b-4f59-9c63-3b745e344e06 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:45.514259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357c057-315b-4f59-9c63-3b745e344e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:45.515777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357c057-315b-4f59-9c63-3b745e344e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:45.556188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357c057-315b-4f59-9c63-3b745e344e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:45.560094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357c057-315b-4f59-9c63-3b745e344e06 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:45.597985 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3700/7429] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:16:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:16:46.548348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2c695-ff88-4559-b268-10dfd8d0debf None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:46.550298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-afb2c695-ff88-4559-b268-10dfd8d0debf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:46.572307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2c695-ff88-4559-b268-10dfd8d0debf None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:46.596490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263b1c8-a2ff-44f8-b0e8-ed34b9004e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:46.597618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263b1c8-a2ff-44f8-b0e8-ed34b9004e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:46.598208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263b1c8-a2ff-44f8-b0e8-ed34b9004e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:46.598777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263b1c8-a2ff-44f8-b0e8-ed34b9004e3a admin admin] PATH_INFO: `/v3/projects/cff6d14f411740b29fa9bb527d62e513` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:46.617703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b263b1c8-a2ff-44f8-b0e8-ed34b9004e3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cff6d14f411740b29fa9bb527d62e513)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:46.639980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b263b1c8-a2ff-44f8-b0e8-ed34b9004e3a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:46.757314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b263b1c8-a2ff-44f8-b0e8-ed34b9004e3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cff6d14f411740b29fa9bb527d62e513', 'request_id': 'req-b263b1c8-a2ff-44f8-b0e8-ed34b9004e3a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:46.778004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b263b1c8-a2ff-44f8-b0e8-ed34b9004e3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cff6d14f411740b29fa9bb527d62e513', 'request_id': 'req-b263b1c8-a2ff-44f8-b0e8-ed34b9004e3a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:46.796219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b263b1c8-a2ff-44f8-b0e8-ed34b9004e3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cff6d14f411740b29fa9bb527d62e513', 'request_id': 'req-b263b1c8-a2ff-44f8-b0e8-ed34b9004e3a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:46.831564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b263b1c8-a2ff-44f8-b0e8-ed34b9004e3a admin admin] The token cache is being invalidate because project cff6d14f411740b29fa9bb527d62e513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:46.832062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b263b1c8-a2ff-44f8-b0e8-ed34b9004e3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:46.835094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b263b1c8-a2ff-44f8-b0e8-ed34b9004e3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:46.838289 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3730/7430] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:16:46 2022] DELETE /identity/v3/projects/cff6d14f411740b29fa9bb527d62e513 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:46.842842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357c057-315b-4f59-9c63-3b745e344e06 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:46.857296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357c057-315b-4f59-9c63-3b745e344e06 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:47.038058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba69338-2fc1-4645-9325-abcc0b71df4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:47.038427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba69338-2fc1-4645-9325-abcc0b71df4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:47.038732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba69338-2fc1-4645-9325-abcc0b71df4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:47.039081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba69338-2fc1-4645-9325-abcc0b71df4d admin admin] PATH_INFO: `/v3/users/ce52d5a3abc04b76bab6731e38337d1a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:47.040863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba69338-2fc1-4645-9325-abcc0b71df4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce52d5a3abc04b76bab6731e38337d1a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:47.042841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba69338-2fc1-4645-9325-abcc0b71df4d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:47.098032 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:47.138377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8ba69338-2fc1-4645-9325-abcc0b71df4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce52d5a3abc04b76bab6731e38337d1a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:47.154973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8ba69338-2fc1-4645-9325-abcc0b71df4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce52d5a3abc04b76bab6731e38337d1a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:47.156042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8ba69338-2fc1-4645-9325-abcc0b71df4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce52d5a3abc04b76bab6731e38337d1a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:47.218807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8ba69338-2fc1-4645-9325-abcc0b71df4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce52d5a3abc04b76bab6731e38337d1a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:47.254558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8ba69338-2fc1-4645-9325-abcc0b71df4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce52d5a3abc04b76bab6731e38337d1a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:47.280253 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3701/7431] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:16:46 2022] DELETE /identity/v3/users/ce52d5a3abc04b76bab6731e38337d1a => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:47.410856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013143c-e8df-4dc6-b3cb-5e04b1fd4960 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:47.411155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013143c-e8df-4dc6-b3cb-5e04b1fd4960 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:47.411435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013143c-e8df-4dc6-b3cb-5e04b1fd4960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:47.468359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7013143c-e8df-4dc6-b3cb-5e04b1fd4960 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:47.471618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7013143c-e8df-4dc6-b3cb-5e04b1fd4960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:47.598084 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:47.697284 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3731/7432] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:16:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:16:47.713821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba69338-2fc1-4645-9325-abcc0b71df4d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:47.715900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8ba69338-2fc1-4645-9325-abcc0b71df4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:48.003761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba69338-2fc1-4645-9325-abcc0b71df4d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:48.012205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e1d8e-fb62-4df0-95a1-f241f31ccf94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:48.013074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e1d8e-fb62-4df0-95a1-f241f31ccf94 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:48.013543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e1d8e-fb62-4df0-95a1-f241f31ccf94 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:48.013848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e1d8e-fb62-4df0-95a1-f241f31ccf94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:48.024874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e1d8e-fb62-4df0-95a1-f241f31ccf94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:48.026751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e1d8e-fb62-4df0-95a1-f241f31ccf94 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:48.042458 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3702/7433] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:16:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:16:48.858633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013143c-e8df-4dc6-b3cb-5e04b1fd4960 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:48.860441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7013143c-e8df-4dc6-b3cb-5e04b1fd4960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:49.224959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013143c-e8df-4dc6-b3cb-5e04b1fd4960 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:49.242073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd51ef-f31e-4fff-9fc9-81fe73f94a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:49.245983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd51ef-f31e-4fff-9fc9-81fe73f94a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:49.248879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd51ef-f31e-4fff-9fc9-81fe73f94a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:49.249963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd51ef-f31e-4fff-9fc9-81fe73f94a97 admin admin] PATH_INFO: `/v3/projects/5033b58a3ef146fea7a649e3958f0942` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:49.255340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd51ef-f31e-4fff-9fc9-81fe73f94a97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5033b58a3ef146fea7a649e3958f0942)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:49.258533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd51ef-f31e-4fff-9fc9-81fe73f94a97 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:49.431547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-65cd51ef-f31e-4fff-9fc9-81fe73f94a97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5033b58a3ef146fea7a649e3958f0942', 'request_id': 'req-65cd51ef-f31e-4fff-9fc9-81fe73f94a97'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:49.449304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-65cd51ef-f31e-4fff-9fc9-81fe73f94a97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5033b58a3ef146fea7a649e3958f0942', 'request_id': 'req-65cd51ef-f31e-4fff-9fc9-81fe73f94a97'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:49.461013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-65cd51ef-f31e-4fff-9fc9-81fe73f94a97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5033b58a3ef146fea7a649e3958f0942', 'request_id': 'req-65cd51ef-f31e-4fff-9fc9-81fe73f94a97'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:49.495344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-65cd51ef-f31e-4fff-9fc9-81fe73f94a97 admin admin] The token cache is being invalidate because project 5033b58a3ef146fea7a649e3958f0942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:16:49.496589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-65cd51ef-f31e-4fff-9fc9-81fe73f94a97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:49.497752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-65cd51ef-f31e-4fff-9fc9-81fe73f94a97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:16:49.501028 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3732/7434] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:16:48 2022] DELETE /identity/v3/projects/5033b58a3ef146fea7a649e3958f0942 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:16:49.505830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c947ccf-8cbc-4edc-8830-c2d9bdcac271 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:49.506905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c947ccf-8cbc-4edc-8830-c2d9bdcac271 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:49.507530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c947ccf-8cbc-4edc-8830-c2d9bdcac271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:49.581561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5c947ccf-8cbc-4edc-8830-c2d9bdcac271 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:49.592419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5c947ccf-8cbc-4edc-8830-c2d9bdcac271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:49.779174 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3703/7435] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:49.787497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089ca2b-3b41-412c-ace6-5806c63b767e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:49.788039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089ca2b-3b41-412c-ace6-5806c63b767e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:49.788531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089ca2b-3b41-412c-ace6-5806c63b767e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:49.858702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9089ca2b-3b41-412c-ace6-5806c63b767e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:49.860079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9089ca2b-3b41-412c-ace6-5806c63b767e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:49.917642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c947ccf-8cbc-4edc-8830-c2d9bdcac271 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:49.925650 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3733/7436] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:49.928842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c947ccf-8cbc-4edc-8830-c2d9bdcac271 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:49.936275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57c783-a8c5-4c78-a1a2-da6dfb08769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:49.936976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57c783-a8c5-4c78-a1a2-da6dfb08769f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:49.936976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57c783-a8c5-4c78-a1a2-da6dfb08769f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:49.936976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57c783-a8c5-4c78-a1a2-da6dfb08769f admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:49.938411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57c783-a8c5-4c78-a1a2-da6dfb08769f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:16:49.938411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57c783-a8c5-4c78-a1a2-da6dfb08769f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:49.947090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57c783-a8c5-4c78-a1a2-da6dfb08769f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:49.982846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089ca2b-3b41-412c-ace6-5806c63b767e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:49.990306 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3704/7437] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:16:49.996330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089ca2b-3b41-412c-ace6-5806c63b767e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:50.013705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc89d5e-8efa-4cf7-b89a-f414ab59461c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:50.014327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc89d5e-8efa-4cf7-b89a-f414ab59461c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:50.014609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc89d5e-8efa-4cf7-b89a-f414ab59461c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:50.015107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc89d5e-8efa-4cf7-b89a-f414ab59461c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:50.015753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc89d5e-8efa-4cf7-b89a-f414ab59461c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:50.017799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc89d5e-8efa-4cf7-b89a-f414ab59461c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:50.127291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57c783-a8c5-4c78-a1a2-da6dfb08769f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:50.128437 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3734/7438] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:16:49 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:50.141571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57c783-a8c5-4c78-a1a2-da6dfb08769f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:50.179050 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:50.359815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f7481-b762-4752-8683-6e4ce8a67ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:50.361612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f7481-b762-4752-8683-6e4ce8a67ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:50.362664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f7481-b762-4752-8683-6e4ce8a67ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:50.363513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f7481-b762-4752-8683-6e4ce8a67ca1 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:50.364292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f7481-b762-4752-8683-6e4ce8a67ca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:50.367725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f7481-b762-4752-8683-6e4ce8a67ca1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:50.423665 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3705/7439] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:16:50 2022] POST /identity/v3/users => generated 294 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:16:50.427102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc89d5e-8efa-4cf7-b89a-f414ab59461c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:50.451174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc89d5e-8efa-4cf7-b89a-f414ab59461c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:50.501513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9743f7-0715-49c5-a9e2-7c8f6dc60d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:50.502503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9743f7-0715-49c5-a9e2-7c8f6dc60d02 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:50.507062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9743f7-0715-49c5-a9e2-7c8f6dc60d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:50.507589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9743f7-0715-49c5-a9e2-7c8f6dc60d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:50.509178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9743f7-0715-49c5-a9e2-7c8f6dc60d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:50.511242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9743f7-0715-49c5-a9e2-7c8f6dc60d02 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:50.568244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f7481-b762-4752-8683-6e4ce8a67ca1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:50.577045 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3735/7440] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:16:50.589734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f7481-b762-4752-8683-6e4ce8a67ca1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:50.613690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea49a92-69e0-4272-8142-7c7e4395bdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:50.614325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea49a92-69e0-4272-8142-7c7e4395bdb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:50.614598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea49a92-69e0-4272-8142-7c7e4395bdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:50.614864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea49a92-69e0-4272-8142-7c7e4395bdb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:50.619750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea49a92-69e0-4272-8142-7c7e4395bdb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:50.625432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea49a92-69e0-4272-8142-7c7e4395bdb2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:50.690220 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3706/7441] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:16:50.694673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9743f7-0715-49c5-a9e2-7c8f6dc60d02 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:50.714485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9743f7-0715-49c5-a9e2-7c8f6dc60d02 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:50.745067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe297ca-31cb-4016-9ad0-6f78256cd5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:50.745846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe297ca-31cb-4016-9ad0-6f78256cd5ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:50.746106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe297ca-31cb-4016-9ad0-6f78256cd5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:50.746394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe297ca-31cb-4016-9ad0-6f78256cd5ad admin admin] PATH_INFO: `/v3/projects/d5de4d2931444a8cbb766259f73f9406/users/6f8d8d8fdc1240ed8d21a42b7ae56990/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:50.811099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe297ca-31cb-4016-9ad0-6f78256cd5ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5de4d2931444a8cbb766259f73f9406, user_id=6f8d8d8fdc1240ed8d21a42b7ae56990, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:50.813839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe297ca-31cb-4016-9ad0-6f78256cd5ad admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:50.864168 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3736/7442] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:16:50 2022] PUT /identity/v3/projects/d5de4d2931444a8cbb766259f73f9406/users/6f8d8d8fdc1240ed8d21a42b7ae56990/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:16:50.878074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e0b53-987a-4e24-9b15-9e8c2e229e57 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:50.878643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e0b53-987a-4e24-9b15-9e8c2e229e57 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:50.879233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e0b53-987a-4e24-9b15-9e8c2e229e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:51.000170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-942e0b53-987a-4e24-9b15-9e8c2e229e57 None None] MFA Rules not processed for user `6f8d8d8fdc1240ed8d21a42b7ae56990`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:16:51.003453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-942e0b53-987a-4e24-9b15-9e8c2e229e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:51.209480 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3707/7443] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:16:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:16:59.468426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe297ca-31cb-4016-9ad0-6f78256cd5ad admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:16:59.471126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7fe297ca-31cb-4016-9ad0-6f78256cd5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:16:59.518971 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:16:59.717300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe297ca-31cb-4016-9ad0-6f78256cd5ad admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:16:59.726403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a9992-ff3e-4a32-b437-8214f3ed0a94 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:16:59.729511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a9992-ff3e-4a32-b437-8214f3ed0a94 service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:16:59.730023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a9992-ff3e-4a32-b437-8214f3ed0a94 service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:16:59.731199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a9992-ff3e-4a32-b437-8214f3ed0a94 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:16:59.766792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a9992-ff3e-4a32-b437-8214f3ed0a94 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:16:59.768633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a9992-ff3e-4a32-b437-8214f3ed0a94 service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:16:59.806938 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3737/7444] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:16:59 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:17:00.166791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b073b-1711-4e6b-b431-54fabcff0667 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:00.167267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b073b-1711-4e6b-b431-54fabcff0667 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:00.167389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b073b-1711-4e6b-b431-54fabcff0667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:00.226136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7e9b073b-1711-4e6b-b431-54fabcff0667 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:00.227831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7e9b073b-1711-4e6b-b431-54fabcff0667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:00.372593 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3708/7445] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:17:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:00.410139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a9992-ff3e-4a32-b437-8214f3ed0a94 service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:00.411834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8f1a9992-ff3e-4a32-b437-8214f3ed0a94 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:00.596466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a9992-ff3e-4a32-b437-8214f3ed0a94 service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:00.606546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868a00b-2ef5-43ee-9e18-baae9b292800 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:00.607704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868a00b-2ef5-43ee-9e18-baae9b292800 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:00.608157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868a00b-2ef5-43ee-9e18-baae9b292800 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:00.608788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868a00b-2ef5-43ee-9e18-baae9b292800 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:00.630335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868a00b-2ef5-43ee-9e18-baae9b292800 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:00.634507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868a00b-2ef5-43ee-9e18-baae9b292800 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:00.655371 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3738/7446] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:17:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:17:01.011282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b073b-1711-4e6b-b431-54fabcff0667 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:01.013148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7e9b073b-1711-4e6b-b431-54fabcff0667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:01.133901 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:01.297062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b073b-1711-4e6b-b431-54fabcff0667 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:01.325649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25a7b1-7af0-4c98-9bac-4ceb10b1224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:01.332727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25a7b1-7af0-4c98-9bac-4ceb10b1224e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:01.334005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25a7b1-7af0-4c98-9bac-4ceb10b1224e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:01.335479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25a7b1-7af0-4c98-9bac-4ceb10b1224e admin admin] PATH_INFO: `/v3/users/bcc3699e4f3948a6bc27299e22ffaaf7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:01.342268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25a7b1-7af0-4c98-9bac-4ceb10b1224e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc3699e4f3948a6bc27299e22ffaaf7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:01.352838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25a7b1-7af0-4c98-9bac-4ceb10b1224e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:01.531616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aa25a7b1-7af0-4c98-9bac-4ceb10b1224e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc3699e4f3948a6bc27299e22ffaaf7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:01.553397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffea74d-76d8-4371-a5ba-8efa47ea7af3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:01.558416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffea74d-76d8-4371-a5ba-8efa47ea7af3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:01.558416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffea74d-76d8-4371-a5ba-8efa47ea7af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:01.565477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aa25a7b1-7af0-4c98-9bac-4ceb10b1224e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc3699e4f3948a6bc27299e22ffaaf7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:01.566332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aa25a7b1-7af0-4c98-9bac-4ceb10b1224e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc3699e4f3948a6bc27299e22ffaaf7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:01.585056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7ffea74d-76d8-4371-a5ba-8efa47ea7af3 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:01.587247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7ffea74d-76d8-4371-a5ba-8efa47ea7af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:01.596490 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3739/7447] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:17:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:17:01.625805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aa25a7b1-7af0-4c98-9bac-4ceb10b1224e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc3699e4f3948a6bc27299e22ffaaf7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:01.662038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aa25a7b1-7af0-4c98-9bac-4ceb10b1224e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc3699e4f3948a6bc27299e22ffaaf7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:01.664153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffea74d-76d8-4371-a5ba-8efa47ea7af3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:01.687932 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3709/7448] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:17:01 2022] DELETE /identity/v3/users/bcc3699e4f3948a6bc27299e22ffaaf7 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:01.689429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffea74d-76d8-4371-a5ba-8efa47ea7af3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:01.712363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e62bfc-201b-4a27-ab28-8f8b2ec280da None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:01.712746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e62bfc-201b-4a27-ab28-8f8b2ec280da None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:01.716281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e62bfc-201b-4a27-ab28-8f8b2ec280da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:01.790843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-36e62bfc-201b-4a27-ab28-8f8b2ec280da None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:01.797960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-36e62bfc-201b-4a27-ab28-8f8b2ec280da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:01.962614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1aaf8-650a-430f-99d5-4a6806578c21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:01.963646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1aaf8-650a-430f-99d5-4a6806578c21 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:01.964539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1aaf8-650a-430f-99d5-4a6806578c21 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:01.964998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1aaf8-650a-430f-99d5-4a6806578c21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:01.970988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-40b1aaf8-650a-430f-99d5-4a6806578c21 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:02.022081 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3710/7449] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:02.035765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e62bfc-201b-4a27-ab28-8f8b2ec280da None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:02.038114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-36e62bfc-201b-4a27-ab28-8f8b2ec280da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:02.097249 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:02.139892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1aaf8-650a-430f-99d5-4a6806578c21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:02.143344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1aaf8-650a-430f-99d5-4a6806578c21 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:02.165197 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3740/7450] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:17:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:17:02.183900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e62bfc-201b-4a27-ab28-8f8b2ec280da None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:02.205400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e0170-238a-4aea-bc94-10e57ce740fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:02.206037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e0170-238a-4aea-bc94-10e57ce740fa service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:02.206319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e0170-238a-4aea-bc94-10e57ce740fa service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:02.207242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e0170-238a-4aea-bc94-10e57ce740fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:02.218234 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:02.230318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e0170-238a-4aea-bc94-10e57ce740fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:02.233101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e0170-238a-4aea-bc94-10e57ce740fa service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:02.265357 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3711/7451] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:17:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:17:02.810790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1aaf8-650a-430f-99d5-4a6806578c21 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:02.813259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-40b1aaf8-650a-430f-99d5-4a6806578c21 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:02.855959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1aaf8-650a-430f-99d5-4a6806578c21 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:02.872706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be583a0-ed3f-4244-aa15-f2424aecc1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:02.874138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be583a0-ed3f-4244-aa15-f2424aecc1c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:02.874773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be583a0-ed3f-4244-aa15-f2424aecc1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:02.875218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be583a0-ed3f-4244-aa15-f2424aecc1c4 admin admin] PATH_INFO: `/v3/projects/4d040990642f4f0d9b06ea5cf218f958` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:02.890643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be583a0-ed3f-4244-aa15-f2424aecc1c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d040990642f4f0d9b06ea5cf218f958)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:02.900550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be583a0-ed3f-4244-aa15-f2424aecc1c4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:02.973295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03afab-ba3f-44de-bc46-927f9e05b731 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:02.974538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03afab-ba3f-44de-bc46-927f9e05b731 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:02.974538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03afab-ba3f-44de-bc46-927f9e05b731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:03.009749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7f03afab-ba3f-44de-bc46-927f9e05b731 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:03.010988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7f03afab-ba3f-44de-bc46-927f9e05b731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:03.012109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5be583a0-ed3f-4244-aa15-f2424aecc1c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d040990642f4f0d9b06ea5cf218f958', 'request_id': 'req-5be583a0-ed3f-4244-aa15-f2424aecc1c4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:03.024858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5be583a0-ed3f-4244-aa15-f2424aecc1c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d040990642f4f0d9b06ea5cf218f958', 'request_id': 'req-5be583a0-ed3f-4244-aa15-f2424aecc1c4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:03.043479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5be583a0-ed3f-4244-aa15-f2424aecc1c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d040990642f4f0d9b06ea5cf218f958', 'request_id': 'req-5be583a0-ed3f-4244-aa15-f2424aecc1c4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:03.074520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5be583a0-ed3f-4244-aa15-f2424aecc1c4 admin admin] The token cache is being invalidate because project 4d040990642f4f0d9b06ea5cf218f958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:17:03.075182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5be583a0-ed3f-4244-aa15-f2424aecc1c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:03.077737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5be583a0-ed3f-4244-aa15-f2424aecc1c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:03.079557 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3741/7452] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:17:02 2022] DELETE /identity/v3/projects/4d040990642f4f0d9b06ea5cf218f958 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:03.084621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d88ffb-a0bc-406c-8c48-018184c33ed3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:03.085215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d88ffb-a0bc-406c-8c48-018184c33ed3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:03.085724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d88ffb-a0bc-406c-8c48-018184c33ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:03.112367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-44d88ffb-a0bc-406c-8c48-018184c33ed3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:03.114125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-44d88ffb-a0bc-406c-8c48-018184c33ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:03.123283 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3712/7453] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:17:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:03.134294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03afab-ba3f-44de-bc46-927f9e05b731 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:03.136186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7f03afab-ba3f-44de-bc46-927f9e05b731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:03.228087 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3742/7454] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:17:03.229712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a29dee-4e25-4870-8082-a9cbd8272dc0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:03.230072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a29dee-4e25-4870-8082-a9cbd8272dc0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:03.230403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a29dee-4e25-4870-8082-a9cbd8272dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:03.255337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d7a29dee-4e25-4870-8082-a9cbd8272dc0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:03.256701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d7a29dee-4e25-4870-8082-a9cbd8272dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:03.268474 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3743/7455] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:03.273123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a29dee-4e25-4870-8082-a9cbd8272dc0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:03.300284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a29dee-4e25-4870-8082-a9cbd8272dc0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:03.306960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03afab-ba3f-44de-bc46-927f9e05b731 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:03.312180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6611c-abb6-4e7d-96ca-cb4cd99d5d5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:03.312841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6611c-abb6-4e7d-96ca-cb4cd99d5d5c service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:03.313657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6611c-abb6-4e7d-96ca-cb4cd99d5d5c service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:03.313657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6611c-abb6-4e7d-96ca-cb4cd99d5d5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:03.324023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6611c-abb6-4e7d-96ca-cb4cd99d5d5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:03.325067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6760e6-a822-4ae1-8e15-bb44cbab906f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:03.325844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6760e6-a822-4ae1-8e15-bb44cbab906f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:03.326123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6611c-abb6-4e7d-96ca-cb4cd99d5d5c service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:03.333168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6760e6-a822-4ae1-8e15-bb44cbab906f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:03.333461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6760e6-a822-4ae1-8e15-bb44cbab906f admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:03.334215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6760e6-a822-4ae1-8e15-bb44cbab906f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:17:03.334661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6760e6-a822-4ae1-8e15-bb44cbab906f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:03.335677 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3713/7456] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:17:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:17:03.346392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6760e6-a822-4ae1-8e15-bb44cbab906f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:03.385789 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3744/7457] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:17:03.387151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6611c-abb6-4e7d-96ca-cb4cd99d5d5c service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:03.403668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6611c-abb6-4e7d-96ca-cb4cd99d5d5c service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:03.421830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7584e-3efd-4d60-a162-3e98c04edfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:03.422504 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7584e-3efd-4d60-a162-3e98c04edfc1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:03.422798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7584e-3efd-4d60-a162-3e98c04edfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:03.423066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7584e-3efd-4d60-a162-3e98c04edfc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:03.423729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7584e-3efd-4d60-a162-3e98c04edfc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:03.425719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7584e-3efd-4d60-a162-3e98c04edfc1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:03.512117 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3714/7458] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:17:03 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:17:03.513468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6760e6-a822-4ae1-8e15-bb44cbab906f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:03.532406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6760e6-a822-4ae1-8e15-bb44cbab906f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:03.652935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c6d60-cb0a-4573-b5ef-62ddecc6a567 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:03.653488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c6d60-cb0a-4573-b5ef-62ddecc6a567 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:03.654015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c6d60-cb0a-4573-b5ef-62ddecc6a567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:03.689100 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:03.703736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4e9c6d60-cb0a-4573-b5ef-62ddecc6a567 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:03.705524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4e9c6d60-cb0a-4573-b5ef-62ddecc6a567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:03.747214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a795aef-a932-431b-9402-1f2c66675420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:03.748146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a795aef-a932-431b-9402-1f2c66675420 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:03.748658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a795aef-a932-431b-9402-1f2c66675420 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:03.749122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a795aef-a932-431b-9402-1f2c66675420 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:03.750421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a795aef-a932-431b-9402-1f2c66675420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:03.757573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a795aef-a932-431b-9402-1f2c66675420 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:03.825349 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3745/7459] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:17:03 2022] POST /identity/v3/users => generated 292 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:17:03.827505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a795aef-a932-431b-9402-1f2c66675420 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:03.852257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a795aef-a932-431b-9402-1f2c66675420 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:03.855047 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3715/7460] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:17:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:17:03.862683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1654a74-8406-4c9c-b83d-7f8e71f65bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:03.863513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1654a74-8406-4c9c-b83d-7f8e71f65bdb admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:03.863870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1654a74-8406-4c9c-b83d-7f8e71f65bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:03.864348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1654a74-8406-4c9c-b83d-7f8e71f65bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:03.865393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1654a74-8406-4c9c-b83d-7f8e71f65bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:03.868114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c6d60-cb0a-4573-b5ef-62ddecc6a567 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:03.869825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1654a74-8406-4c9c-b83d-7f8e71f65bdb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:03.889492 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:03.891445 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3746/7461] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:17:03.896496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1654a74-8406-4c9c-b83d-7f8e71f65bdb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:03.922278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1654a74-8406-4c9c-b83d-7f8e71f65bdb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:03.934345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04a3ca-771d-431e-a681-565aed3ee6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:03.935001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04a3ca-771d-431e-a681-565aed3ee6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:03.935276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04a3ca-771d-431e-a681-565aed3ee6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:03.935547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04a3ca-771d-431e-a681-565aed3ee6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:03.936201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04a3ca-771d-431e-a681-565aed3ee6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:03.937885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04a3ca-771d-431e-a681-565aed3ee6f7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:03.966917 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3747/7462] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:17:03.968251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04a3ca-771d-431e-a681-565aed3ee6f7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:03.989855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04a3ca-771d-431e-a681-565aed3ee6f7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:04.011113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c8ff4-f57a-4cad-b4ec-9402e0af7d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:04.011833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c8ff4-f57a-4cad-b4ec-9402e0af7d27 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:04.012066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c8ff4-f57a-4cad-b4ec-9402e0af7d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:04.012338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c8ff4-f57a-4cad-b4ec-9402e0af7d27 admin admin] PATH_INFO: `/v3/projects/fbb2414674434be4bd5308e7b0d6e141/users/9a134d5cb0134f67a03b7938b65856e9/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:04.031103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c6d60-cb0a-4573-b5ef-62ddecc6a567 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:04.037653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bea69-cfed-43d5-a595-de645ab87ecb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:04.039965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bea69-cfed-43d5-a595-de645ab87ecb service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:04.040118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c8ff4-f57a-4cad-b4ec-9402e0af7d27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbb2414674434be4bd5308e7b0d6e141, user_id=9a134d5cb0134f67a03b7938b65856e9, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:04.040750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bea69-cfed-43d5-a595-de645ab87ecb service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:04.041217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bea69-cfed-43d5-a595-de645ab87ecb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:04.050325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c8ff4-f57a-4cad-b4ec-9402e0af7d27 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:04.061941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bea69-cfed-43d5-a595-de645ab87ecb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:04.067375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bea69-cfed-43d5-a595-de645ab87ecb service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:04.085797 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3748/7463] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:17:03 2022] PUT /identity/v3/projects/fbb2414674434be4bd5308e7b0d6e141/users/9a134d5cb0134f67a03b7938b65856e9/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:04.088328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf413e-f74a-4c20-92eb-1fc4e1a24905 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:04.088620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf413e-f74a-4c20-92eb-1fc4e1a24905 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:04.088916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf413e-f74a-4c20-92eb-1fc4e1a24905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:04.089126 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3716/7464] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:17:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 10:17:04.146125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5fcf413e-f74a-4c20-92eb-1fc4e1a24905 None None] MFA Rules not processed for user `9a134d5cb0134f67a03b7938b65856e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:04.148154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5fcf413e-f74a-4c20-92eb-1fc4e1a24905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:04.236646 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3749/7465] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:04.248092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bea69-cfed-43d5-a595-de645ab87ecb service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:04.250872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-333bea69-cfed-43d5-a595-de645ab87ecb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:04.371169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bea69-cfed-43d5-a595-de645ab87ecb service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:04.458287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2192b-d858-4e41-9b9b-48fb00cb9977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:04.459009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2192b-d858-4e41-9b9b-48fb00cb9977 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:04.459366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2192b-d858-4e41-9b9b-48fb00cb9977 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:04.459712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2192b-d858-4e41-9b9b-48fb00cb9977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:04.471710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2192b-d858-4e41-9b9b-48fb00cb9977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:04.473830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2192b-d858-4e41-9b9b-48fb00cb9977 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:04.486473 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3717/7466] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:17:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:17:04.666858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54da9b7-93d9-447e-a2df-650e9d5e3801 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:04.667395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54da9b7-93d9-447e-a2df-650e9d5e3801 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:04.668377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54da9b7-93d9-447e-a2df-650e9d5e3801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:04.713485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a54da9b7-93d9-447e-a2df-650e9d5e3801 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:04.714725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a54da9b7-93d9-447e-a2df-650e9d5e3801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:04.840507 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3750/7467] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 10:17:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:04.856057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2192b-d858-4e41-9b9b-48fb00cb9977 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:04.977469 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:04.987068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2192b-d858-4e41-9b9b-48fb00cb9977 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:04.995181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e5b97-3d7b-40b7-acb0-4c9e1777f8bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:04.995805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e5b97-3d7b-40b7-acb0-4c9e1777f8bc service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:04.996190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e5b97-3d7b-40b7-acb0-4c9e1777f8bc service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:04.996464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e5b97-3d7b-40b7-acb0-4c9e1777f8bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:05.011356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e5b97-3d7b-40b7-acb0-4c9e1777f8bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:05.013734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e5b97-3d7b-40b7-acb0-4c9e1777f8bc service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:05.024165 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3718/7468] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:17:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:17:05.369559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0e79a-fbb8-4862-8751-ad3ccb767fca None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:05.369928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0e79a-fbb8-4862-8751-ad3ccb767fca None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:05.370271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0e79a-fbb8-4862-8751-ad3ccb767fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:05.424637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f9e0e79a-fbb8-4862-8751-ad3ccb767fca None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:05.430928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f9e0e79a-fbb8-4862-8751-ad3ccb767fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:05.459213 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3751/7469] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 10:17:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:05.473283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e5b97-3d7b-40b7-acb0-4c9e1777f8bc service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:05.490326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e5b97-3d7b-40b7-acb0-4c9e1777f8bc service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:05.496534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55768f4a-03f2-482e-9bcb-ab58eef160e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:05.497846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55768f4a-03f2-482e-9bcb-ab58eef160e0 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:05.498436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55768f4a-03f2-482e-9bcb-ab58eef160e0 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:05.498904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55768f4a-03f2-482e-9bcb-ab58eef160e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:05.525006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55768f4a-03f2-482e-9bcb-ab58eef160e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:05.528406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55768f4a-03f2-482e-9bcb-ab58eef160e0 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:05.551187 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3719/7470] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:17:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:17:05.764791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0e79a-fbb8-4862-8751-ad3ccb767fca None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:05.766251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f9e0e79a-fbb8-4862-8751-ad3ccb767fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:05.804112 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:05.927055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0e79a-fbb8-4862-8751-ad3ccb767fca None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:05.942048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564f739-aea7-4b1c-8c98-dfc6225bbd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:05.943311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564f739-aea7-4b1c-8c98-dfc6225bbd84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:05.943804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564f739-aea7-4b1c-8c98-dfc6225bbd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:05.944284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564f739-aea7-4b1c-8c98-dfc6225bbd84 admin admin] PATH_INFO: `/v3/users/6f8d8d8fdc1240ed8d21a42b7ae56990` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:05.946307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564f739-aea7-4b1c-8c98-dfc6225bbd84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f8d8d8fdc1240ed8d21a42b7ae56990)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:05.949236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564f739-aea7-4b1c-8c98-dfc6225bbd84 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:06.037857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2564f739-aea7-4b1c-8c98-dfc6225bbd84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f8d8d8fdc1240ed8d21a42b7ae56990'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:06.038749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2564f739-aea7-4b1c-8c98-dfc6225bbd84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f8d8d8fdc1240ed8d21a42b7ae56990'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:06.064819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2564f739-aea7-4b1c-8c98-dfc6225bbd84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f8d8d8fdc1240ed8d21a42b7ae56990'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:06.088794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2564f739-aea7-4b1c-8c98-dfc6225bbd84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f8d8d8fdc1240ed8d21a42b7ae56990'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:06.108436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2564f739-aea7-4b1c-8c98-dfc6225bbd84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f8d8d8fdc1240ed8d21a42b7ae56990'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:06.127501 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3752/7471] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:17:05 2022] DELETE /identity/v3/users/6f8d8d8fdc1240ed8d21a42b7ae56990 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:06.127710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14874f5-860f-4156-8521-35e04e913895 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:06.127905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14874f5-860f-4156-8521-35e04e913895 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:06.128407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14874f5-860f-4156-8521-35e04e913895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:06.178305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c14874f5-860f-4156-8521-35e04e913895 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:06.180856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c14874f5-860f-4156-8521-35e04e913895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:06.322193 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3720/7472] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:06.338865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564f739-aea7-4b1c-8c98-dfc6225bbd84 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:06.340390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2564f739-aea7-4b1c-8c98-dfc6225bbd84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:06.454097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564f739-aea7-4b1c-8c98-dfc6225bbd84 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:06.465389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd33e85-1501-4e6e-8714-7c475608d689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:06.466404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd33e85-1501-4e6e-8714-7c475608d689 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:06.466404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd33e85-1501-4e6e-8714-7c475608d689 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:06.466621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd33e85-1501-4e6e-8714-7c475608d689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:06.496488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd33e85-1501-4e6e-8714-7c475608d689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:06.500485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd33e85-1501-4e6e-8714-7c475608d689 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:06.528760 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3753/7473] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:17:08.295638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14874f5-860f-4156-8521-35e04e913895 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:08.297116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c14874f5-860f-4156-8521-35e04e913895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:08.349544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14874f5-860f-4156-8521-35e04e913895 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:08.390323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f239b-57f7-48ba-aee4-b786e9a2b1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:08.391158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f239b-57f7-48ba-aee4-b786e9a2b1cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:08.391597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f239b-57f7-48ba-aee4-b786e9a2b1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:08.392028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f239b-57f7-48ba-aee4-b786e9a2b1cd admin admin] PATH_INFO: `/v3/projects/d5de4d2931444a8cbb766259f73f9406` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:08.400380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f239b-57f7-48ba-aee4-b786e9a2b1cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5de4d2931444a8cbb766259f73f9406)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:08.418280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f239b-57f7-48ba-aee4-b786e9a2b1cd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:08.558016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d30f239b-57f7-48ba-aee4-b786e9a2b1cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5de4d2931444a8cbb766259f73f9406', 'request_id': 'req-d30f239b-57f7-48ba-aee4-b786e9a2b1cd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:08.596700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d30f239b-57f7-48ba-aee4-b786e9a2b1cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5de4d2931444a8cbb766259f73f9406', 'request_id': 'req-d30f239b-57f7-48ba-aee4-b786e9a2b1cd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:08.616225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d30f239b-57f7-48ba-aee4-b786e9a2b1cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5de4d2931444a8cbb766259f73f9406', 'request_id': 'req-d30f239b-57f7-48ba-aee4-b786e9a2b1cd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:08.686978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d30f239b-57f7-48ba-aee4-b786e9a2b1cd admin admin] The token cache is being invalidate because project d5de4d2931444a8cbb766259f73f9406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:17:08.687546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d30f239b-57f7-48ba-aee4-b786e9a2b1cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:08.691505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d30f239b-57f7-48ba-aee4-b786e9a2b1cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:08.695671 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3721/7474] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:17:08 2022] DELETE /identity/v3/projects/d5de4d2931444a8cbb766259f73f9406 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:08.700802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d49a3c-8b3c-4e5b-a534-021673ddf1a8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:08.701357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d49a3c-8b3c-4e5b-a534-021673ddf1a8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:08.701357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d49a3c-8b3c-4e5b-a534-021673ddf1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:08.753810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-56d49a3c-8b3c-4e5b-a534-021673ddf1a8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:08.755046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-56d49a3c-8b3c-4e5b-a534-021673ddf1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:08.825347 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:08.888280 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3754/7475] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:08.895765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62758222-87b0-41bd-9b5d-2ae504742068 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:08.896087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62758222-87b0-41bd-9b5d-2ae504742068 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:08.896324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62758222-87b0-41bd-9b5d-2ae504742068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:08.949773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-62758222-87b0-41bd-9b5d-2ae504742068 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:08.950982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-62758222-87b0-41bd-9b5d-2ae504742068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:08.986460 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3722/7476] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:08.990919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d49a3c-8b3c-4e5b-a534-021673ddf1a8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:09.004374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d49a3c-8b3c-4e5b-a534-021673ddf1a8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:09.016934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff493488-d5b7-4a90-b04d-27d89348b769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:09.017926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff493488-d5b7-4a90-b04d-27d89348b769 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:09.018420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff493488-d5b7-4a90-b04d-27d89348b769 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:09.018902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff493488-d5b7-4a90-b04d-27d89348b769 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:09.019788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff493488-d5b7-4a90-b04d-27d89348b769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:17:09.020313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff493488-d5b7-4a90-b04d-27d89348b769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:09.025055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff493488-d5b7-4a90-b04d-27d89348b769 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:09.055330 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3755/7477] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:17:09.060182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62758222-87b0-41bd-9b5d-2ae504742068 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:09.080076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62758222-87b0-41bd-9b5d-2ae504742068 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:09.097062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea04dd-a2e5-4736-8fb2-cecee83f4613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:09.097715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea04dd-a2e5-4736-8fb2-cecee83f4613 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:09.097985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea04dd-a2e5-4736-8fb2-cecee83f4613 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:09.098260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea04dd-a2e5-4736-8fb2-cecee83f4613 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:09.098907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea04dd-a2e5-4736-8fb2-cecee83f4613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:09.100850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea04dd-a2e5-4736-8fb2-cecee83f4613 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:09.187191 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3723/7478] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:17:09 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:17:09.188489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff493488-d5b7-4a90-b04d-27d89348b769 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:09.206093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff493488-d5b7-4a90-b04d-27d89348b769 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:09.349188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffeede-e79e-4797-885c-ff82be8a6701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:09.349889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffeede-e79e-4797-885c-ff82be8a6701 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:09.350175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffeede-e79e-4797-885c-ff82be8a6701 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:09.353384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffeede-e79e-4797-885c-ff82be8a6701 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:09.354819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffeede-e79e-4797-885c-ff82be8a6701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:09.359235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffeede-e79e-4797-885c-ff82be8a6701 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:09.400752 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3756/7479] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:17:09 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:17:09.401972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea04dd-a2e5-4736-8fb2-cecee83f4613 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:09.417658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea04dd-a2e5-4736-8fb2-cecee83f4613 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:09.431562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece3291-e520-4576-9b21-615b1514a033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:09.432203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece3291-e520-4576-9b21-615b1514a033 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:09.432482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece3291-e520-4576-9b21-615b1514a033 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:09.432799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece3291-e520-4576-9b21-615b1514a033 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:09.433457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece3291-e520-4576-9b21-615b1514a033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:09.435036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece3291-e520-4576-9b21-615b1514a033 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:09.466052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffeede-e79e-4797-885c-ff82be8a6701 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:09.470012 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3724/7480] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:17:09.482851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffeede-e79e-4797-885c-ff82be8a6701 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:09.497308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66a60f-579a-474d-9a1a-26dba031a75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:09.497944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66a60f-579a-474d-9a1a-26dba031a75e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:09.503379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66a60f-579a-474d-9a1a-26dba031a75e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:09.503728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66a60f-579a-474d-9a1a-26dba031a75e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:09.505544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66a60f-579a-474d-9a1a-26dba031a75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:09.510640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66a60f-579a-474d-9a1a-26dba031a75e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:09.530002 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3757/7481] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:17:09.531099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece3291-e520-4576-9b21-615b1514a033 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:09.551449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece3291-e520-4576-9b21-615b1514a033 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:09.565506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c075fe9-5ae8-4aee-8384-e564704defe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:09.566492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c075fe9-5ae8-4aee-8384-e564704defe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:09.566965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c075fe9-5ae8-4aee-8384-e564704defe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:09.567414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c075fe9-5ae8-4aee-8384-e564704defe8 admin admin] PATH_INFO: `/v3/projects/8bbb1f713aac4eb1808d048d9e4b6b90/users/bd7f2044fd394645a481809d4e482464/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:09.611904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c075fe9-5ae8-4aee-8384-e564704defe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bbb1f713aac4eb1808d048d9e4b6b90, user_id=bd7f2044fd394645a481809d4e482464, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:09.614769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c075fe9-5ae8-4aee-8384-e564704defe8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:09.621010 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:09.651226 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3725/7482] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:17:09 2022] PUT /identity/v3/projects/8bbb1f713aac4eb1808d048d9e4b6b90/users/bd7f2044fd394645a481809d4e482464/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:17:09.676923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf328e21-2519-4615-8700-7ebaebacb1f7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:09.677956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf328e21-2519-4615-8700-7ebaebacb1f7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:09.678375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf328e21-2519-4615-8700-7ebaebacb1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:09.761037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cf328e21-2519-4615-8700-7ebaebacb1f7 None None] MFA Rules not processed for user `bd7f2044fd394645a481809d4e482464`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:09.768856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cf328e21-2519-4615-8700-7ebaebacb1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:09.980393 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3758/7483] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:09.980593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c075fe9-5ae8-4aee-8384-e564704defe8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:10.138106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c075fe9-5ae8-4aee-8384-e564704defe8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:10.144093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2e83e-0035-4ee9-815d-2ef7b2bfbfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:10.145126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2e83e-0035-4ee9-815d-2ef7b2bfbfc8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:10.145679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2e83e-0035-4ee9-815d-2ef7b2bfbfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:10.146173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2e83e-0035-4ee9-815d-2ef7b2bfbfc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:10.147344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2e83e-0035-4ee9-815d-2ef7b2bfbfc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:10.152406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2e83e-0035-4ee9-815d-2ef7b2bfbfc8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:10.215687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf328e21-2519-4615-8700-7ebaebacb1f7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:10.236773 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf328e21-2519-4615-8700-7ebaebacb1f7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:10.237390 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3726/7484] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:17:09 2022] POST /identity/v3/projects => generated 381 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:17:10.319354 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:10.378047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4d0ad-6742-4fc8-a5b9-79f4b4434bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:10.378693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4d0ad-6742-4fc8-a5b9-79f4b4434bcc admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:10.379091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4d0ad-6742-4fc8-a5b9-79f4b4434bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:10.379374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4d0ad-6742-4fc8-a5b9-79f4b4434bcc admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:10.380086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4d0ad-6742-4fc8-a5b9-79f4b4434bcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:10.384715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4d0ad-6742-4fc8-a5b9-79f4b4434bcc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:10.436476 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3759/7485] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:17:10 2022] POST /identity/v3/users => generated 291 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:17:10.440447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2e83e-0035-4ee9-815d-2ef7b2bfbfc8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:10.455296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2e83e-0035-4ee9-815d-2ef7b2bfbfc8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:10.469836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6825b83-f338-47e7-bfc6-e10f5e097dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:10.470495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6825b83-f338-47e7-bfc6-e10f5e097dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:10.470779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6825b83-f338-47e7-bfc6-e10f5e097dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:10.471061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6825b83-f338-47e7-bfc6-e10f5e097dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:10.471729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6825b83-f338-47e7-bfc6-e10f5e097dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:10.473394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6825b83-f338-47e7-bfc6-e10f5e097dc2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:10.506821 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3727/7486] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:17:10.508981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4d0ad-6742-4fc8-a5b9-79f4b4434bcc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:10.529929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4d0ad-6742-4fc8-a5b9-79f4b4434bcc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:10.544312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336529d-4757-4722-90d3-839330b4b36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:10.545356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336529d-4757-4722-90d3-839330b4b36e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:10.546995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336529d-4757-4722-90d3-839330b4b36e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:10.547491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336529d-4757-4722-90d3-839330b4b36e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:10.548368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336529d-4757-4722-90d3-839330b4b36e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:10.551588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336529d-4757-4722-90d3-839330b4b36e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:10.586742 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3760/7487] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:17:10.592734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6825b83-f338-47e7-bfc6-e10f5e097dc2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:10.606794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6825b83-f338-47e7-bfc6-e10f5e097dc2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:10.622897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276c116-1653-4052-baa9-09feedaab46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:10.623866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276c116-1653-4052-baa9-09feedaab46b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:10.624146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276c116-1653-4052-baa9-09feedaab46b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:10.625289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276c116-1653-4052-baa9-09feedaab46b admin admin] PATH_INFO: `/v3/projects/725fa424ebcd4bff8bc6d3af72709f3a/users/9b3f1532d65a4c508930cfe19574b39d/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:10.655539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276c116-1653-4052-baa9-09feedaab46b admin admin] RBAC: Authorizing `identity:create_grant(project_id=725fa424ebcd4bff8bc6d3af72709f3a, user_id=9b3f1532d65a4c508930cfe19574b39d, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:10.662478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276c116-1653-4052-baa9-09feedaab46b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:10.696367 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3728/7488] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:17:10 2022] PUT /identity/v3/projects/725fa424ebcd4bff8bc6d3af72709f3a/users/9b3f1532d65a4c508930cfe19574b39d/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:10.708198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396977b-f67a-4f2e-ae41-a8167aa7fe42 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:10.708527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396977b-f67a-4f2e-ae41-a8167aa7fe42 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:10.708798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396977b-f67a-4f2e-ae41-a8167aa7fe42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:10.780531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f396977b-f67a-4f2e-ae41-a8167aa7fe42 None None] MFA Rules not processed for user `9b3f1532d65a4c508930cfe19574b39d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:10.781917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f396977b-f67a-4f2e-ae41-a8167aa7fe42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:11.023560 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3761/7489] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:11.023994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276c116-1653-4052-baa9-09feedaab46b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:11.199669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276c116-1653-4052-baa9-09feedaab46b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:11.210184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb9df3-8fe3-48bc-bcbd-5aec0ce0a5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:11.214282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb9df3-8fe3-48bc-bcbd-5aec0ce0a5cd admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:11.214516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb9df3-8fe3-48bc-bcbd-5aec0ce0a5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:11.214696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb9df3-8fe3-48bc-bcbd-5aec0ce0a5cd admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:11.215473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb9df3-8fe3-48bc-bcbd-5aec0ce0a5cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:11.220928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb9df3-8fe3-48bc-bcbd-5aec0ce0a5cd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:11.312236 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3729/7490] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:17:11 2022] POST /identity/v3/projects => generated 381 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:17:11.317466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396977b-f67a-4f2e-ae41-a8167aa7fe42 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:11.341690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396977b-f67a-4f2e-ae41-a8167aa7fe42 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:11.514916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ca216-99e2-421e-9564-f54736935f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:11.516975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ca216-99e2-421e-9564-f54736935f3f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:11.518387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ca216-99e2-421e-9564-f54736935f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:11.519030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ca216-99e2-421e-9564-f54736935f3f admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:11.520360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ca216-99e2-421e-9564-f54736935f3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:11.524824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ca216-99e2-421e-9564-f54736935f3f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:11.563842 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3762/7491] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:17:11 2022] POST /identity/v3/users => generated 297 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:17:11.568927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb9df3-8fe3-48bc-bcbd-5aec0ce0a5cd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:11.588254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb9df3-8fe3-48bc-bcbd-5aec0ce0a5cd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:11.594091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3881327-c61a-42bd-a393-42034f683367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:11.595010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3881327-c61a-42bd-a393-42034f683367 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:11.595475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3881327-c61a-42bd-a393-42034f683367 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:11.595925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3881327-c61a-42bd-a393-42034f683367 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:11.596798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3881327-c61a-42bd-a393-42034f683367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:11.598627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3881327-c61a-42bd-a393-42034f683367 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:11.617636 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3730/7492] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:17:11.618918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ca216-99e2-421e-9564-f54736935f3f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:11.631639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ca216-99e2-421e-9564-f54736935f3f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:11.637119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27915ed-189c-468b-8db8-dad153df9375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:11.638043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27915ed-189c-468b-8db8-dad153df9375 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:11.638515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27915ed-189c-468b-8db8-dad153df9375 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:11.638972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27915ed-189c-468b-8db8-dad153df9375 admin admin] PATH_INFO: `/v3/projects/15637e57d5e24685b048d6e23fa7a3f8/users/57fda603d6c2428294e3dc27444fa44c/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:11.677098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27915ed-189c-468b-8db8-dad153df9375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15637e57d5e24685b048d6e23fa7a3f8, user_id=57fda603d6c2428294e3dc27444fa44c, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:11.680350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27915ed-189c-468b-8db8-dad153df9375 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:11.720532 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3763/7493] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:17:11 2022] PUT /identity/v3/projects/15637e57d5e24685b048d6e23fa7a3f8/users/57fda603d6c2428294e3dc27444fa44c/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:11.722295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3881327-c61a-42bd-a393-42034f683367 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:11.740925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3881327-c61a-42bd-a393-42034f683367 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:11.785583 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:11.900055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708c0df-e441-41d5-a9e5-b71c6fb08376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:11.900724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708c0df-e441-41d5-a9e5-b71c6fb08376 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:11.902214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708c0df-e441-41d5-a9e5-b71c6fb08376 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:11.904742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708c0df-e441-41d5-a9e5-b71c6fb08376 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:11.905525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708c0df-e441-41d5-a9e5-b71c6fb08376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:11.919431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708c0df-e441-41d5-a9e5-b71c6fb08376 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:11.948784 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3731/7494] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:17:11.955978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27915ed-189c-468b-8db8-dad153df9375 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:11.983749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27915ed-189c-468b-8db8-dad153df9375 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:11.990738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e7572-8788-423b-96ab-21fc0aec9eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:11.992951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e7572-8788-423b-96ab-21fc0aec9eee admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:11.993530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e7572-8788-423b-96ab-21fc0aec9eee admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:11.993960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e7572-8788-423b-96ab-21fc0aec9eee admin admin] PATH_INFO: `/v3/projects/15637e57d5e24685b048d6e23fa7a3f8/users/57fda603d6c2428294e3dc27444fa44c/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:11.996500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e7572-8788-423b-96ab-21fc0aec9eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=15637e57d5e24685b048d6e23fa7a3f8, user_id=57fda603d6c2428294e3dc27444fa44c, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:11.999594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e7572-8788-423b-96ab-21fc0aec9eee admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:12.002442 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:12.025093 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3764/7495] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:17:11 2022] PUT /identity/v3/projects/15637e57d5e24685b048d6e23fa7a3f8/users/57fda603d6c2428294e3dc27444fa44c/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:12.041061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3cba3-2ac0-4461-a2b1-f5b50f6d0eb4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:12.042766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3cba3-2ac0-4461-a2b1-f5b50f6d0eb4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:12.043294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3cba3-2ac0-4461-a2b1-f5b50f6d0eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:12.106774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-afd3cba3-2ac0-4461-a2b1-f5b50f6d0eb4 None None] MFA Rules not processed for user `57fda603d6c2428294e3dc27444fa44c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:12.108718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-afd3cba3-2ac0-4461-a2b1-f5b50f6d0eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:12.337175 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3732/7496] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:12.349653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e7572-8788-423b-96ab-21fc0aec9eee admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:12.352481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-374e7572-8788-423b-96ab-21fc0aec9eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:12.527098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e7572-8788-423b-96ab-21fc0aec9eee admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:12.547087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f7aad-c787-46e3-a3a6-85b30ee5e4f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:12.547835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f7aad-c787-46e3-a3a6-85b30ee5e4f4 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:12.548120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f7aad-c787-46e3-a3a6-85b30ee5e4f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:12.548394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f7aad-c787-46e3-a3a6-85b30ee5e4f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:12.709659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f7aad-c787-46e3-a3a6-85b30ee5e4f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:12.711296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f7aad-c787-46e3-a3a6-85b30ee5e4f4 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:12.746892 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3765/7497] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:17:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:17:16.967489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3cba3-2ac0-4461-a2b1-f5b50f6d0eb4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:16.969092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-afd3cba3-2ac0-4461-a2b1-f5b50f6d0eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:17.144561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3cba3-2ac0-4461-a2b1-f5b50f6d0eb4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:17.144561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafef73-4926-4341-81e4-43261ec0b819 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:17.144561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafef73-4926-4341-81e4-43261ec0b819 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:17.144561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafef73-4926-4341-81e4-43261ec0b819 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:17.145363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafef73-4926-4341-81e4-43261ec0b819 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:17.145363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bdafef73-4926-4341-81e4-43261ec0b819 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:17.218507 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:17.247209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafef73-4926-4341-81e4-43261ec0b819 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:17.265226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafef73-4926-4341-81e4-43261ec0b819 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:17.290000 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3733/7498] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:17:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:17:17.598867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab79f2-fff5-4dc1-a927-88a9568a7d73 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:17.598867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab79f2-fff5-4dc1-a927-88a9568a7d73 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:17.598867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab79f2-fff5-4dc1-a927-88a9568a7d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:17.598867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-52ab79f2-fff5-4dc1-a927-88a9568a7d73 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:17.598867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-52ab79f2-fff5-4dc1-a927-88a9568a7d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:17.745517 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3766/7499] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 10:17:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:17:17.845584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafef73-4926-4341-81e4-43261ec0b819 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:17.869260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafef73-4926-4341-81e4-43261ec0b819 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:17.902719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724f4cc-dbee-4609-8e66-774ed857d00b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:17.903376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724f4cc-dbee-4609-8e66-774ed857d00b service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:17.903848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724f4cc-dbee-4609-8e66-774ed857d00b service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:17.904158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724f4cc-dbee-4609-8e66-774ed857d00b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:17.930823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724f4cc-dbee-4609-8e66-774ed857d00b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:17.934537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724f4cc-dbee-4609-8e66-774ed857d00b service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:17.959113 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3734/7500] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:17:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:17:18.183968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab79f2-fff5-4dc1-a927-88a9568a7d73 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:18.186692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-52ab79f2-fff5-4dc1-a927-88a9568a7d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:18.361550 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:18.427072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab79f2-fff5-4dc1-a927-88a9568a7d73 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:18.441328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bdae8-93eb-4279-8b9b-38e6dd3513d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:18.446883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bdae8-93eb-4279-8b9b-38e6dd3513d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:18.447927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bdae8-93eb-4279-8b9b-38e6dd3513d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:18.448369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bdae8-93eb-4279-8b9b-38e6dd3513d3 admin admin] PATH_INFO: `/v3/users/6467e2597de7485bb777a74774e3b6dc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:18.455403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bdae8-93eb-4279-8b9b-38e6dd3513d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6467e2597de7485bb777a74774e3b6dc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:18.466004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bdae8-93eb-4279-8b9b-38e6dd3513d3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:18.576242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-712bdae8-93eb-4279-8b9b-38e6dd3513d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6467e2597de7485bb777a74774e3b6dc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:18.579033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-712bdae8-93eb-4279-8b9b-38e6dd3513d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6467e2597de7485bb777a74774e3b6dc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:18.614792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-712bdae8-93eb-4279-8b9b-38e6dd3513d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6467e2597de7485bb777a74774e3b6dc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:18.638472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-712bdae8-93eb-4279-8b9b-38e6dd3513d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6467e2597de7485bb777a74774e3b6dc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:18.663175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-712bdae8-93eb-4279-8b9b-38e6dd3513d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6467e2597de7485bb777a74774e3b6dc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:18.683673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6017a0c-f7c5-4b7b-95a3-9edceb321480 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:18.684249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6017a0c-f7c5-4b7b-95a3-9edceb321480 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:18.684249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6017a0c-f7c5-4b7b-95a3-9edceb321480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:18.722579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c6017a0c-f7c5-4b7b-95a3-9edceb321480 None None] MFA Rules not processed for user `45a25acf184b4bfc9f1b06dcf0e6d81b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:18.725242 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3767/7501] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:17:18 2022] DELETE /identity/v3/users/6467e2597de7485bb777a74774e3b6dc => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:18.728705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c6017a0c-f7c5-4b7b-95a3-9edceb321480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:18.730310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ff8f6-619f-4942-931d-1dce86993beb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:18.730772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ff8f6-619f-4942-931d-1dce86993beb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:18.731210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ff8f6-619f-4942-931d-1dce86993beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:18.753136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-588ff8f6-619f-4942-931d-1dce86993beb None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:18.755061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-588ff8f6-619f-4942-931d-1dce86993beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:18.888947 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3735/7502] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:19.055175 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3768/7503] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:19.081532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6017a0c-f7c5-4b7b-95a3-9edceb321480 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:19.084419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c6017a0c-f7c5-4b7b-95a3-9edceb321480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:19.263614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6017a0c-f7c5-4b7b-95a3-9edceb321480 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:19.267506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d28ae3-77f9-4c68-b3fc-e8b75c939750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:19.268139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d28ae3-77f9-4c68-b3fc-e8b75c939750 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:19.268418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d28ae3-77f9-4c68-b3fc-e8b75c939750 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:19.268722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d28ae3-77f9-4c68-b3fc-e8b75c939750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:19.293049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d28ae3-77f9-4c68-b3fc-e8b75c939750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:19.308219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d28ae3-77f9-4c68-b3fc-e8b75c939750 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:19.350557 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3736/7504] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:17:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:17:21.075819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ff8f6-619f-4942-931d-1dce86993beb None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:21.077595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-588ff8f6-619f-4942-931d-1dce86993beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:21.098900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ff8f6-619f-4942-931d-1dce86993beb None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:21.113464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49f05e-520c-47d0-a4ce-11488da335d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:21.114513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49f05e-520c-47d0-a4ce-11488da335d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:21.114964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49f05e-520c-47d0-a4ce-11488da335d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:21.115453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49f05e-520c-47d0-a4ce-11488da335d2 admin admin] PATH_INFO: `/v3/projects/929f2f3cad0d4150acbf764f07e26cd0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:21.118916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49f05e-520c-47d0-a4ce-11488da335d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=929f2f3cad0d4150acbf764f07e26cd0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:21.130879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49f05e-520c-47d0-a4ce-11488da335d2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:21.249911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dc49f05e-520c-47d0-a4ce-11488da335d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '929f2f3cad0d4150acbf764f07e26cd0', 'request_id': 'req-dc49f05e-520c-47d0-a4ce-11488da335d2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:21.271134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dc49f05e-520c-47d0-a4ce-11488da335d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '929f2f3cad0d4150acbf764f07e26cd0', 'request_id': 'req-dc49f05e-520c-47d0-a4ce-11488da335d2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:21.282296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dc49f05e-520c-47d0-a4ce-11488da335d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '929f2f3cad0d4150acbf764f07e26cd0', 'request_id': 'req-dc49f05e-520c-47d0-a4ce-11488da335d2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:21.284638 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:21.308792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dc49f05e-520c-47d0-a4ce-11488da335d2 admin admin] The token cache is being invalidate because project 929f2f3cad0d4150acbf764f07e26cd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:17:21.310128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dc49f05e-520c-47d0-a4ce-11488da335d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:21.311622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dc49f05e-520c-47d0-a4ce-11488da335d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:21.317415 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3769/7505] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:17:21 2022] DELETE /identity/v3/projects/929f2f3cad0d4150acbf764f07e26cd0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:21.319166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d5610-0838-44bd-ba37-2ab0567306f4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:21.319714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d5610-0838-44bd-ba37-2ab0567306f4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:21.319905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d5610-0838-44bd-ba37-2ab0567306f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:21.353820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-516d5610-0838-44bd-ba37-2ab0567306f4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:21.355233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-516d5610-0838-44bd-ba37-2ab0567306f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:21.570931 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3737/7506] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:21.571498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccb316-f5e3-4001-a17f-86cc258bced0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:21.574965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccb316-f5e3-4001-a17f-86cc258bced0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:21.575280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccb316-f5e3-4001-a17f-86cc258bced0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:21.629500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-62ccb316-f5e3-4001-a17f-86cc258bced0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:21.631146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-62ccb316-f5e3-4001-a17f-86cc258bced0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:21.640554 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3770/7507] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:21.645423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d5610-0838-44bd-ba37-2ab0567306f4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:21.657551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d5610-0838-44bd-ba37-2ab0567306f4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:21.662681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f9b99-caac-49a2-b505-d1520561e294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:21.663526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f9b99-caac-49a2-b505-d1520561e294 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:21.664241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f9b99-caac-49a2-b505-d1520561e294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:21.664894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f9b99-caac-49a2-b505-d1520561e294 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:21.665799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f9b99-caac-49a2-b505-d1520561e294 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:17:21.666276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f9b99-caac-49a2-b505-d1520561e294 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:21.668724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f9b99-caac-49a2-b505-d1520561e294 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:21.694450 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3738/7508] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:17:21.698172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccb316-f5e3-4001-a17f-86cc258bced0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:21.729666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccb316-f5e3-4001-a17f-86cc258bced0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:21.751060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0b020-8085-47c1-9a1e-c1ced02071e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:21.762401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0b020-8085-47c1-9a1e-c1ced02071e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:21.762788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0b020-8085-47c1-9a1e-c1ced02071e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:21.764049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0b020-8085-47c1-9a1e-c1ced02071e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:21.765338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0b020-8085-47c1-9a1e-c1ced02071e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:21.772380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0b020-8085-47c1-9a1e-c1ced02071e0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:21.933851 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3771/7509] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:17:21 2022] POST /identity/v3/projects => generated 383 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:17:21.936365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f9b99-caac-49a2-b505-d1520561e294 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:21.943667 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:21.950081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f9b99-caac-49a2-b505-d1520561e294 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:22.061329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b18aa-5962-4580-9808-2db7d8dada62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:22.061961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b18aa-5962-4580-9808-2db7d8dada62 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:22.062290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b18aa-5962-4580-9808-2db7d8dada62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:22.062567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b18aa-5962-4580-9808-2db7d8dada62 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:22.063219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b18aa-5962-4580-9808-2db7d8dada62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:22.069190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b18aa-5962-4580-9808-2db7d8dada62 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:22.140071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0b020-8085-47c1-9a1e-c1ced02071e0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:22.142156 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3739/7510] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:17:21 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:17:22.157691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0b020-8085-47c1-9a1e-c1ced02071e0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:22.182677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3462b-bce1-4250-93ff-b0c449172f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:22.183255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3462b-bce1-4250-93ff-b0c449172f1a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:22.183613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3462b-bce1-4250-93ff-b0c449172f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:22.185948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3462b-bce1-4250-93ff-b0c449172f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:22.187286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3462b-bce1-4250-93ff-b0c449172f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:22.200311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3462b-bce1-4250-93ff-b0c449172f1a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:22.219607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b18aa-5962-4580-9808-2db7d8dada62 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:22.230443 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3772/7511] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:17:22.232295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b18aa-5962-4580-9808-2db7d8dada62 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:22.258820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc898ce1-ec52-4442-94bf-c25c14b7d62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:22.263648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc898ce1-ec52-4442-94bf-c25c14b7d62f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:22.264117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc898ce1-ec52-4442-94bf-c25c14b7d62f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:22.265664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc898ce1-ec52-4442-94bf-c25c14b7d62f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:22.266495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc898ce1-ec52-4442-94bf-c25c14b7d62f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:22.269389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc898ce1-ec52-4442-94bf-c25c14b7d62f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:22.287856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3462b-bce1-4250-93ff-b0c449172f1a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:22.295408 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3740/7512] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:17:22.300068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3462b-bce1-4250-93ff-b0c449172f1a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:22.306125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e2d3b-2393-41bf-b500-588cae5d9a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:22.308131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e2d3b-2393-41bf-b500-588cae5d9a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:22.309976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e2d3b-2393-41bf-b500-588cae5d9a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:22.310669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e2d3b-2393-41bf-b500-588cae5d9a09 admin admin] PATH_INFO: `/v3/projects/e643643847ce49efb33dea5bfb499958/users/717100f760f740628c077191be999626/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:22.345601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e2d3b-2393-41bf-b500-588cae5d9a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e643643847ce49efb33dea5bfb499958, user_id=717100f760f740628c077191be999626, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:22.348458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e2d3b-2393-41bf-b500-588cae5d9a09 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:22.392654 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3773/7513] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:17:22 2022] PUT /identity/v3/projects/e643643847ce49efb33dea5bfb499958/users/717100f760f740628c077191be999626/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:17:22.396415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35503ea8-650d-4d23-882b-296e289ee5a0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:22.396958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35503ea8-650d-4d23-882b-296e289ee5a0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:22.397227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35503ea8-650d-4d23-882b-296e289ee5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:22.464066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-35503ea8-650d-4d23-882b-296e289ee5a0 None None] MFA Rules not processed for user `717100f760f740628c077191be999626`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:22.466261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-35503ea8-650d-4d23-882b-296e289ee5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:22.568456 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3741/7514] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:22.570294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e2d3b-2393-41bf-b500-588cae5d9a09 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:22.572981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ad2e2d3b-2393-41bf-b500-588cae5d9a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:22.727943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e2d3b-2393-41bf-b500-588cae5d9a09 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:22.738821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576d070-558d-487d-b48e-ad24c0f1d2b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:22.740631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576d070-558d-487d-b48e-ad24c0f1d2b4 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:22.741174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576d070-558d-487d-b48e-ad24c0f1d2b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:22.741795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576d070-558d-487d-b48e-ad24c0f1d2b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:22.760365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576d070-558d-487d-b48e-ad24c0f1d2b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:22.763198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576d070-558d-487d-b48e-ad24c0f1d2b4 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:22.775400 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3774/7515] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:17:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:17:27.024216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35503ea8-650d-4d23-882b-296e289ee5a0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:27.025874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-35503ea8-650d-4d23-882b-296e289ee5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:27.223604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35503ea8-650d-4d23-882b-296e289ee5a0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:27.228000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9e574-5111-41bf-ac9d-d21219df4167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:27.228722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9e574-5111-41bf-ac9d-d21219df4167 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:27.229003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9e574-5111-41bf-ac9d-d21219df4167 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:27.229279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9e574-5111-41bf-ac9d-d21219df4167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:27.235667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f5b9e574-5111-41bf-ac9d-d21219df4167 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:27.325472 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:27.458243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9e574-5111-41bf-ac9d-d21219df4167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:27.459954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9e574-5111-41bf-ac9d-d21219df4167 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:27.508868 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3742/7516] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:17:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:17:31.017059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576d070-558d-487d-b48e-ad24c0f1d2b4 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:31.182329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576d070-558d-487d-b48e-ad24c0f1d2b4 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:31.208227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fd98f-72c8-4ae9-ac5b-e336d6596d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:31.209070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fd98f-72c8-4ae9-ac5b-e336d6596d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:31.213793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fd98f-72c8-4ae9-ac5b-e336d6596d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:31.214345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fd98f-72c8-4ae9-ac5b-e336d6596d91 admin admin] PATH_INFO: `/v3/users/717100f760f740628c077191be999626` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:31.220234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663fd98f-72c8-4ae9-ac5b-e336d6596d91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=717100f760f740628c077191be999626)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:31.228746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663fd98f-72c8-4ae9-ac5b-e336d6596d91 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:31.368286 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:31.417598 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-663fd98f-72c8-4ae9-ac5b-e336d6596d91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '717100f760f740628c077191be999626'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:31.418331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-663fd98f-72c8-4ae9-ac5b-e336d6596d91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '717100f760f740628c077191be999626'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:31.439042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-663fd98f-72c8-4ae9-ac5b-e336d6596d91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '717100f760f740628c077191be999626'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:31.465872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-663fd98f-72c8-4ae9-ac5b-e336d6596d91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '717100f760f740628c077191be999626'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:31.497080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-663fd98f-72c8-4ae9-ac5b-e336d6596d91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '717100f760f740628c077191be999626'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:31.517631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5f257-7a8a-4e7f-a277-02f6dc6902da None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:31.518151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5f257-7a8a-4e7f-a277-02f6dc6902da None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:31.518151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5f257-7a8a-4e7f-a277-02f6dc6902da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:31.527084 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3775/7517] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:17:31 2022] DELETE /identity/v3/users/717100f760f740628c077191be999626 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:31.556972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-92c5f257-7a8a-4e7f-a277-02f6dc6902da None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:31.558289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-92c5f257-7a8a-4e7f-a277-02f6dc6902da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:31.724684 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3743/7518] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:17:31.783532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fd98f-72c8-4ae9-ac5b-e336d6596d91 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:31.785723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-663fd98f-72c8-4ae9-ac5b-e336d6596d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:31.952223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5f257-7a8a-4e7f-a277-02f6dc6902da None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:31.957537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-92c5f257-7a8a-4e7f-a277-02f6dc6902da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:32.151379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fd98f-72c8-4ae9-ac5b-e336d6596d91 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:32.157537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd580fa-89bd-4746-b0f0-967d21901996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:32.158503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd580fa-89bd-4746-b0f0-967d21901996 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:32.159021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd580fa-89bd-4746-b0f0-967d21901996 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:32.160084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd580fa-89bd-4746-b0f0-967d21901996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:32.175464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd580fa-89bd-4746-b0f0-967d21901996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:32.178488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd580fa-89bd-4746-b0f0-967d21901996 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:32.221887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5f257-7a8a-4e7f-a277-02f6dc6902da None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:32.222688 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3776/7519] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:17:32.238655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094cd7bf-c992-4338-8c87-bb8762ea28ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:32.241759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094cd7bf-c992-4338-8c87-bb8762ea28ac service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:32.243616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094cd7bf-c992-4338-8c87-bb8762ea28ac service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:32.249565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094cd7bf-c992-4338-8c87-bb8762ea28ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:32.258981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-094cd7bf-c992-4338-8c87-bb8762ea28ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:32.548371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094cd7bf-c992-4338-8c87-bb8762ea28ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:32.550049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094cd7bf-c992-4338-8c87-bb8762ea28ac service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:32.583533 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3744/7520] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:17:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:17:33.249070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd580fa-89bd-4746-b0f0-967d21901996 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:33.250825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-edd580fa-89bd-4746-b0f0-967d21901996 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:33.277655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd580fa-89bd-4746-b0f0-967d21901996 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:33.308908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea232df-55ef-4016-8346-a2d2f8dab7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:33.313425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea232df-55ef-4016-8346-a2d2f8dab7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:33.315525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea232df-55ef-4016-8346-a2d2f8dab7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:33.328028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea232df-55ef-4016-8346-a2d2f8dab7f3 admin admin] PATH_INFO: `/v3/projects/e643643847ce49efb33dea5bfb499958` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:33.330289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea232df-55ef-4016-8346-a2d2f8dab7f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e643643847ce49efb33dea5bfb499958)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:33.335838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea232df-55ef-4016-8346-a2d2f8dab7f3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:33.474460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fea232df-55ef-4016-8346-a2d2f8dab7f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e643643847ce49efb33dea5bfb499958', 'request_id': 'req-fea232df-55ef-4016-8346-a2d2f8dab7f3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:33.487695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fea232df-55ef-4016-8346-a2d2f8dab7f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e643643847ce49efb33dea5bfb499958', 'request_id': 'req-fea232df-55ef-4016-8346-a2d2f8dab7f3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:33.509104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fea232df-55ef-4016-8346-a2d2f8dab7f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e643643847ce49efb33dea5bfb499958', 'request_id': 'req-fea232df-55ef-4016-8346-a2d2f8dab7f3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:33.540633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fea232df-55ef-4016-8346-a2d2f8dab7f3 admin admin] The token cache is being invalidate because project e643643847ce49efb33dea5bfb499958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:17:33.541202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fea232df-55ef-4016-8346-a2d2f8dab7f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:33.542601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fea232df-55ef-4016-8346-a2d2f8dab7f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:33.549043 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3777/7521] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:17:33 2022] DELETE /identity/v3/projects/e643643847ce49efb33dea5bfb499958 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:33.551276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac658f-ecc3-4cea-ada6-ce035558cab2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:33.553180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac658f-ecc3-4cea-ada6-ce035558cab2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:33.553180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac658f-ecc3-4cea-ada6-ce035558cab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:33.565953 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:33.589634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dfac658f-ecc3-4cea-ada6-ce035558cab2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:33.592444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dfac658f-ecc3-4cea-ada6-ce035558cab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:33.840041 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3745/7522] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:33.855838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e47a33-020d-4c58-87e8-c91a50098e34 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:33.857047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e47a33-020d-4c58-87e8-c91a50098e34 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:33.857553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e47a33-020d-4c58-87e8-c91a50098e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:33.949665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-36e47a33-020d-4c58-87e8-c91a50098e34 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:33.952810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-36e47a33-020d-4c58-87e8-c91a50098e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:33.972838 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3778/7523] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:33.977844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac658f-ecc3-4cea-ada6-ce035558cab2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:33.993563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac658f-ecc3-4cea-ada6-ce035558cab2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:34.008279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3435b0-3b8c-4beb-8d64-45186cb259c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:34.009935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3435b0-3b8c-4beb-8d64-45186cb259c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:34.010219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3435b0-3b8c-4beb-8d64-45186cb259c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:34.010508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3435b0-3b8c-4beb-8d64-45186cb259c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:34.013996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3435b0-3b8c-4beb-8d64-45186cb259c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:17:34.013996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3435b0-3b8c-4beb-8d64-45186cb259c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:34.013996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3435b0-3b8c-4beb-8d64-45186cb259c9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:34.042770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e47a33-020d-4c58-87e8-c91a50098e34 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:34.053915 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3746/7524] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:17:34.073724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e47a33-020d-4c58-87e8-c91a50098e34 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:34.097563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec281c-f346-4217-80d2-11af3014c583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:34.098423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec281c-f346-4217-80d2-11af3014c583 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:34.098818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec281c-f346-4217-80d2-11af3014c583 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:34.099205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec281c-f346-4217-80d2-11af3014c583 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:34.100890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec281c-f346-4217-80d2-11af3014c583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:34.103376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec281c-f346-4217-80d2-11af3014c583 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:34.191570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3435b0-3b8c-4beb-8d64-45186cb259c9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:34.205011 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3779/7525] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:17:34 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:17:34.225975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3435b0-3b8c-4beb-8d64-45186cb259c9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:34.372217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f76c0-4647-4923-9225-d267ab33586c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:34.372897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f76c0-4647-4923-9225-d267ab33586c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:34.373270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f76c0-4647-4923-9225-d267ab33586c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:34.373482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f76c0-4647-4923-9225-d267ab33586c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:34.374027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f76c0-4647-4923-9225-d267ab33586c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:34.375984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f76c0-4647-4923-9225-d267ab33586c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:34.510077 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3747/7526] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:17:34 2022] POST /identity/v3/users => generated 287 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:17:34.514274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec281c-f346-4217-80d2-11af3014c583 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:34.529568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec281c-f346-4217-80d2-11af3014c583 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:34.541416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d77c72-c1cf-4b63-b8f9-586cd94f0b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:34.542054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d77c72-c1cf-4b63-b8f9-586cd94f0b59 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:34.542333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d77c72-c1cf-4b63-b8f9-586cd94f0b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:34.542754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d77c72-c1cf-4b63-b8f9-586cd94f0b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:34.543815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d77c72-c1cf-4b63-b8f9-586cd94f0b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:34.545027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d77c72-c1cf-4b63-b8f9-586cd94f0b59 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:34.556712 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:34.581047 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3780/7527] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:17:34.581564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f76c0-4647-4923-9225-d267ab33586c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:34.606759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f76c0-4647-4923-9225-d267ab33586c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:34.620552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44b945-3083-4a1e-8e19-3980bbbbd126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:34.621344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44b945-3083-4a1e-8e19-3980bbbbd126 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:34.621730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44b945-3083-4a1e-8e19-3980bbbbd126 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:34.622093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44b945-3083-4a1e-8e19-3980bbbbd126 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:34.622852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44b945-3083-4a1e-8e19-3980bbbbd126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:34.624572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44b945-3083-4a1e-8e19-3980bbbbd126 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:34.660025 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3748/7528] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:17:34.665684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d77c72-c1cf-4b63-b8f9-586cd94f0b59 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:34.681730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d77c72-c1cf-4b63-b8f9-586cd94f0b59 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:34.693737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493608c-267e-486c-b7bd-4fbdc201c841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:34.694911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493608c-267e-486c-b7bd-4fbdc201c841 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:34.695228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493608c-267e-486c-b7bd-4fbdc201c841 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:34.695477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493608c-267e-486c-b7bd-4fbdc201c841 admin admin] PATH_INFO: `/v3/projects/b9f8a5ce58434179abe7455756b7ac8b/users/3c3a46b9053444e48a9f9ab9888a3503/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:34.733028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493608c-267e-486c-b7bd-4fbdc201c841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f8a5ce58434179abe7455756b7ac8b, user_id=3c3a46b9053444e48a9f9ab9888a3503, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:34.736793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493608c-267e-486c-b7bd-4fbdc201c841 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:34.796338 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3781/7529] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:17:34 2022] PUT /identity/v3/projects/b9f8a5ce58434179abe7455756b7ac8b/users/3c3a46b9053444e48a9f9ab9888a3503/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:34.814413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191205e-1db4-4d7f-b45f-6e870ec6d15f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:34.814682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191205e-1db4-4d7f-b45f-6e870ec6d15f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:34.814951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191205e-1db4-4d7f-b45f-6e870ec6d15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:34.915524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6191205e-1db4-4d7f-b45f-6e870ec6d15f None None] MFA Rules not processed for user `3c3a46b9053444e48a9f9ab9888a3503`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:34.916726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6191205e-1db4-4d7f-b45f-6e870ec6d15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:35.080930 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:35.097564 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3749/7530] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:35.105290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493608c-267e-486c-b7bd-4fbdc201c841 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:35.107218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9493608c-267e-486c-b7bd-4fbdc201c841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:35.242881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493608c-267e-486c-b7bd-4fbdc201c841 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:35.248943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e6ba1-3ad1-41e4-9852-2095cd9cfb25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:35.252830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e6ba1-3ad1-41e4-9852-2095cd9cfb25 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:35.253146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e6ba1-3ad1-41e4-9852-2095cd9cfb25 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:35.253843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e6ba1-3ad1-41e4-9852-2095cd9cfb25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:35.279509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e6ba1-3ad1-41e4-9852-2095cd9cfb25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:35.281494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e6ba1-3ad1-41e4-9852-2095cd9cfb25 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:35.321530 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3782/7531] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:17:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:17:35.364200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191205e-1db4-4d7f-b45f-6e870ec6d15f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:35.533952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191205e-1db4-4d7f-b45f-6e870ec6d15f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:35.595216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c3452-8ad2-4b9d-aacb-ecc8a9449ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:35.600368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c3452-8ad2-4b9d-aacb-ecc8a9449ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:35.600690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c3452-8ad2-4b9d-aacb-ecc8a9449ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:35.600970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c3452-8ad2-4b9d-aacb-ecc8a9449ad2 admin admin] PATH_INFO: `/v3/users/3c3a46b9053444e48a9f9ab9888a3503` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:35.610095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c3452-8ad2-4b9d-aacb-ecc8a9449ad2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c3a46b9053444e48a9f9ab9888a3503)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:35.612276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c3452-8ad2-4b9d-aacb-ecc8a9449ad2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:35.879879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b7c3452-8ad2-4b9d-aacb-ecc8a9449ad2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c3a46b9053444e48a9f9ab9888a3503'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:35.899429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b7c3452-8ad2-4b9d-aacb-ecc8a9449ad2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c3a46b9053444e48a9f9ab9888a3503'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:35.902714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b7c3452-8ad2-4b9d-aacb-ecc8a9449ad2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c3a46b9053444e48a9f9ab9888a3503'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:35.967153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b7c3452-8ad2-4b9d-aacb-ecc8a9449ad2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c3a46b9053444e48a9f9ab9888a3503'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:35.981479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b7c3452-8ad2-4b9d-aacb-ecc8a9449ad2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c3a46b9053444e48a9f9ab9888a3503'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:36.003060 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3750/7532] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:17:35 2022] DELETE /identity/v3/users/3c3a46b9053444e48a9f9ab9888a3503 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:36.009256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbe566-2e7a-463a-8b14-28a11b1d42cb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:36.009778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbe566-2e7a-463a-8b14-28a11b1d42cb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:36.009778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbe566-2e7a-463a-8b14-28a11b1d42cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:36.103421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e4bbe566-2e7a-463a-8b14-28a11b1d42cb None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:36.105892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e4bbe566-2e7a-463a-8b14-28a11b1d42cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:36.384922 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3783/7533] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:36.561574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c3452-8ad2-4b9d-aacb-ecc8a9449ad2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:36.563250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6b7c3452-8ad2-4b9d-aacb-ecc8a9449ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:36.705969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c3452-8ad2-4b9d-aacb-ecc8a9449ad2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:36.713641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f73ff1-0b44-45e8-aa4a-9c9e93874999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:36.717743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73ff1-0b44-45e8-aa4a-9c9e93874999 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:36.717919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73ff1-0b44-45e8-aa4a-9c9e93874999 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:36.718199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73ff1-0b44-45e8-aa4a-9c9e93874999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:36.742585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f73ff1-0b44-45e8-aa4a-9c9e93874999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:36.744058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f73ff1-0b44-45e8-aa4a-9c9e93874999 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:36.792353 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3751/7534] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:17:37.750528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbe566-2e7a-463a-8b14-28a11b1d42cb None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:37.752354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e4bbe566-2e7a-463a-8b14-28a11b1d42cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:37.769752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbe566-2e7a-463a-8b14-28a11b1d42cb None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:37.781056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7e75b-d4df-455b-87ca-7dcca078c541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:37.782425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7e75b-d4df-455b-87ca-7dcca078c541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:37.782862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7e75b-d4df-455b-87ca-7dcca078c541 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:37.783352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7e75b-d4df-455b-87ca-7dcca078c541 admin admin] PATH_INFO: `/v3/projects/b9f8a5ce58434179abe7455756b7ac8b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:37.784807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7e75b-d4df-455b-87ca-7dcca078c541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f8a5ce58434179abe7455756b7ac8b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:37.788839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7e75b-d4df-455b-87ca-7dcca078c541 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:37.949876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eda7e75b-d4df-455b-87ca-7dcca078c541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f8a5ce58434179abe7455756b7ac8b', 'request_id': 'req-eda7e75b-d4df-455b-87ca-7dcca078c541'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:37.977164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f73ff1-0b44-45e8-aa4a-9c9e93874999 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:37.993417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eda7e75b-d4df-455b-87ca-7dcca078c541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f8a5ce58434179abe7455756b7ac8b', 'request_id': 'req-eda7e75b-d4df-455b-87ca-7dcca078c541'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:37.993604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f73ff1-0b44-45e8-aa4a-9c9e93874999 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:38.019532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eda7e75b-d4df-455b-87ca-7dcca078c541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f8a5ce58434179abe7455756b7ac8b', 'request_id': 'req-eda7e75b-d4df-455b-87ca-7dcca078c541'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:38.043126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eda7e75b-d4df-455b-87ca-7dcca078c541 admin admin] The token cache is being invalidate because project b9f8a5ce58434179abe7455756b7ac8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:17:38.043717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eda7e75b-d4df-455b-87ca-7dcca078c541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:38.045012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eda7e75b-d4df-455b-87ca-7dcca078c541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:38.049951 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3784/7535] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:17:37 2022] DELETE /identity/v3/projects/b9f8a5ce58434179abe7455756b7ac8b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:38.058983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758b7b4-11fd-4bf8-a511-c3f4093a89a0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:38.059640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758b7b4-11fd-4bf8-a511-c3f4093a89a0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:38.060072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758b7b4-11fd-4bf8-a511-c3f4093a89a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:38.062416 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:38.084338 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:38.107883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f758b7b4-11fd-4bf8-a511-c3f4093a89a0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:38.112297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f758b7b4-11fd-4bf8-a511-c3f4093a89a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:38.153406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e72ab-5af6-4015-9e57-a34ab242936d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:38.155495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e72ab-5af6-4015-9e57-a34ab242936d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:38.155949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e72ab-5af6-4015-9e57-a34ab242936d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:38.156422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e72ab-5af6-4015-9e57-a34ab242936d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:38.179790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b61e72ab-5af6-4015-9e57-a34ab242936d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:38.359403 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3785/7536] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:38.370508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9b28b-7390-4a9e-acd4-2d4fdffdbd21 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:38.371632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9b28b-7390-4a9e-acd4-2d4fdffdbd21 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:38.371632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9b28b-7390-4a9e-acd4-2d4fdffdbd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:38.413774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e72ab-5af6-4015-9e57-a34ab242936d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:38.415228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e72ab-5af6-4015-9e57-a34ab242936d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:38.439806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-10c9b28b-7390-4a9e-acd4-2d4fdffdbd21 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:38.442745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-10c9b28b-7390-4a9e-acd4-2d4fdffdbd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:38.443358 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3752/7537] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:17:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:17:38.453343 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3786/7538] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:38.462585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e72ab-5af6-4015-9e57-a34ab242936d service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:38.477274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e72ab-5af6-4015-9e57-a34ab242936d service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:38.482681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffd3be-1895-4f93-b54d-b27454ec7ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:38.483316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffd3be-1895-4f93-b54d-b27454ec7ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:38.483600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffd3be-1895-4f93-b54d-b27454ec7ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:38.483872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffd3be-1895-4f93-b54d-b27454ec7ae9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:38.484756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffd3be-1895-4f93-b54d-b27454ec7ae9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:17:38.485071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffd3be-1895-4f93-b54d-b27454ec7ae9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:38.486660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffd3be-1895-4f93-b54d-b27454ec7ae9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:38.517524 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3753/7539] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:17:38.518767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9b28b-7390-4a9e-acd4-2d4fdffdbd21 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:38.533545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9b28b-7390-4a9e-acd4-2d4fdffdbd21 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:38.544341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef91026-99b3-4dbc-b250-5d161df37af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:38.545073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef91026-99b3-4dbc-b250-5d161df37af9 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:38.545359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef91026-99b3-4dbc-b250-5d161df37af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:38.545614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef91026-99b3-4dbc-b250-5d161df37af9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:38.546365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef91026-99b3-4dbc-b250-5d161df37af9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:38.555062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef91026-99b3-4dbc-b250-5d161df37af9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:38.628014 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3787/7540] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:17:38 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:17:38.628679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffd3be-1895-4f93-b54d-b27454ec7ae9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:38.644876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffd3be-1895-4f93-b54d-b27454ec7ae9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:38.784336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a40c70-0ff3-4bd8-8a4e-0bd4b1841e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:38.790693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a40c70-0ff3-4bd8-8a4e-0bd4b1841e3d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:38.791672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a40c70-0ff3-4bd8-8a4e-0bd4b1841e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:38.792145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a40c70-0ff3-4bd8-8a4e-0bd4b1841e3d admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:38.792859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a40c70-0ff3-4bd8-8a4e-0bd4b1841e3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:38.794803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a40c70-0ff3-4bd8-8a4e-0bd4b1841e3d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:38.869377 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3754/7541] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:17:38 2022] POST /identity/v3/users => generated 291 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:17:38.872379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef91026-99b3-4dbc-b250-5d161df37af9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:38.894541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef91026-99b3-4dbc-b250-5d161df37af9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:38.929454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017f6e7-4bf8-47bc-a240-8e33186440e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:38.933642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017f6e7-4bf8-47bc-a240-8e33186440e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:38.933931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017f6e7-4bf8-47bc-a240-8e33186440e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:38.934205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017f6e7-4bf8-47bc-a240-8e33186440e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:38.935984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017f6e7-4bf8-47bc-a240-8e33186440e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:38.938514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017f6e7-4bf8-47bc-a240-8e33186440e6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:38.996118 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3788/7542] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:17:39.000250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a40c70-0ff3-4bd8-8a4e-0bd4b1841e3d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:39.019293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a40c70-0ff3-4bd8-8a4e-0bd4b1841e3d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:39.027022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1333f5-2942-4a45-b277-5a7eb0cf8925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:39.028958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1333f5-2942-4a45-b277-5a7eb0cf8925 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:39.029680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1333f5-2942-4a45-b277-5a7eb0cf8925 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:39.030103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1333f5-2942-4a45-b277-5a7eb0cf8925 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:39.046771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1333f5-2942-4a45-b277-5a7eb0cf8925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:39.050478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1333f5-2942-4a45-b277-5a7eb0cf8925 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:39.096659 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3755/7543] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:17:39.101508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017f6e7-4bf8-47bc-a240-8e33186440e6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:39.119852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017f6e7-4bf8-47bc-a240-8e33186440e6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:39.133116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e608bf-8e16-4d56-8506-61334d006fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:39.135894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e608bf-8e16-4d56-8506-61334d006fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:39.136504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e608bf-8e16-4d56-8506-61334d006fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:39.139023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e608bf-8e16-4d56-8506-61334d006fe2 admin admin] PATH_INFO: `/v3/projects/3ee88bf9d31f42db864b32c89b5381bb/users/17d727ad88bb4c638a22af27155e240b/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:39.207599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e608bf-8e16-4d56-8506-61334d006fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee88bf9d31f42db864b32c89b5381bb, user_id=17d727ad88bb4c638a22af27155e240b, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:39.211146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e608bf-8e16-4d56-8506-61334d006fe2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:39.258426 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3789/7544] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:17:39 2022] PUT /identity/v3/projects/3ee88bf9d31f42db864b32c89b5381bb/users/17d727ad88bb4c638a22af27155e240b/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:39.259553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4676140-717c-4653-a77d-f27734526e95 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:39.259841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4676140-717c-4653-a77d-f27734526e95 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:39.260320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4676140-717c-4653-a77d-f27734526e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:39.297658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f4676140-717c-4653-a77d-f27734526e95 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:39.299191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f4676140-717c-4653-a77d-f27734526e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:39.349318 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:39.495220 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3756/7545] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:17:39.514032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e608bf-8e16-4d56-8506-61334d006fe2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:39.518348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a3e608bf-8e16-4d56-8506-61334d006fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:39.799816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e608bf-8e16-4d56-8506-61334d006fe2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:39.811597 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5e267-0e94-4a37-a82e-3ec0defdf3e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:39.812240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5e267-0e94-4a37-a82e-3ec0defdf3e7 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:39.812519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5e267-0e94-4a37-a82e-3ec0defdf3e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:39.812816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5e267-0e94-4a37-a82e-3ec0defdf3e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:39.837313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5e267-0e94-4a37-a82e-3ec0defdf3e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:39.838845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5e267-0e94-4a37-a82e-3ec0defdf3e7 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:39.867331 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3790/7546] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:17:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:17:40.947411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4676140-717c-4653-a77d-f27734526e95 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:40.949961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f4676140-717c-4653-a77d-f27734526e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:40.974811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4676140-717c-4653-a77d-f27734526e95 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:40.987693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61524d48-6134-4978-bd41-2efc25bd4786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:40.989296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61524d48-6134-4978-bd41-2efc25bd4786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:40.990212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61524d48-6134-4978-bd41-2efc25bd4786 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:40.990642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61524d48-6134-4978-bd41-2efc25bd4786 admin admin] PATH_INFO: `/v3/users/9a134d5cb0134f67a03b7938b65856e9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:40.992786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61524d48-6134-4978-bd41-2efc25bd4786 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a134d5cb0134f67a03b7938b65856e9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:40.996874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61524d48-6134-4978-bd41-2efc25bd4786 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:41.104341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-61524d48-6134-4978-bd41-2efc25bd4786 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a134d5cb0134f67a03b7938b65856e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:41.114369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-61524d48-6134-4978-bd41-2efc25bd4786 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a134d5cb0134f67a03b7938b65856e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:41.116789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-61524d48-6134-4978-bd41-2efc25bd4786 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a134d5cb0134f67a03b7938b65856e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:41.137457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-61524d48-6134-4978-bd41-2efc25bd4786 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a134d5cb0134f67a03b7938b65856e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:41.155061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-61524d48-6134-4978-bd41-2efc25bd4786 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a134d5cb0134f67a03b7938b65856e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:41.173470 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3757/7547] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:17:40 2022] DELETE /identity/v3/users/9a134d5cb0134f67a03b7938b65856e9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:41.178923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2d0a2-a9c0-4b93-b89c-b206d12075db None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:41.178923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2d0a2-a9c0-4b93-b89c-b206d12075db None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:41.179891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2d0a2-a9c0-4b93-b89c-b206d12075db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:41.246740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ade2d0a2-a9c0-4b93-b89c-b206d12075db None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:41.252173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ade2d0a2-a9c0-4b93-b89c-b206d12075db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:41.305646 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:41.353933 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3791/7548] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:41.371670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61524d48-6134-4978-bd41-2efc25bd4786 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:41.373530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-61524d48-6134-4978-bd41-2efc25bd4786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:41.534345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61524d48-6134-4978-bd41-2efc25bd4786 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:41.545810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe474c-bf0b-4d2b-bdeb-57c2c8bc5f3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:41.547594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe474c-bf0b-4d2b-bdeb-57c2c8bc5f3f service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:41.547594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe474c-bf0b-4d2b-bdeb-57c2c8bc5f3f service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:41.547594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe474c-bf0b-4d2b-bdeb-57c2c8bc5f3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:41.575071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe474c-bf0b-4d2b-bdeb-57c2c8bc5f3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:41.576707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe474c-bf0b-4d2b-bdeb-57c2c8bc5f3f service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:41.603299 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3758/7549] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:17:41.841374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2d0a2-a9c0-4b93-b89c-b206d12075db None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:41.863080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2d0a2-a9c0-4b93-b89c-b206d12075db None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:41.876303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26538e09-47a6-4508-a58a-0e49e1798dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:41.876971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26538e09-47a6-4508-a58a-0e49e1798dcf service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:41.880188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26538e09-47a6-4508-a58a-0e49e1798dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:41.880686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26538e09-47a6-4508-a58a-0e49e1798dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:41.884968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-26538e09-47a6-4508-a58a-0e49e1798dcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:42.016982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26538e09-47a6-4508-a58a-0e49e1798dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:42.021672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26538e09-47a6-4508-a58a-0e49e1798dcf service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:42.035546 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3792/7550] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:17:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:17:42.219444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe474c-bf0b-4d2b-bdeb-57c2c8bc5f3f service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:42.221824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-52fe474c-bf0b-4d2b-bdeb-57c2c8bc5f3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:42.251363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe474c-bf0b-4d2b-bdeb-57c2c8bc5f3f service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:42.259378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc75f54-7a01-4d35-895f-678d7a2d0638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:42.260429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc75f54-7a01-4d35-895f-678d7a2d0638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:42.260938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc75f54-7a01-4d35-895f-678d7a2d0638 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:42.261387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc75f54-7a01-4d35-895f-678d7a2d0638 admin admin] PATH_INFO: `/v3/projects/fbb2414674434be4bd5308e7b0d6e141` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:42.263506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc75f54-7a01-4d35-895f-678d7a2d0638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbb2414674434be4bd5308e7b0d6e141)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:42.265632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc75f54-7a01-4d35-895f-678d7a2d0638 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:42.360880 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:42.375793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7cc75f54-7a01-4d35-895f-678d7a2d0638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbb2414674434be4bd5308e7b0d6e141', 'request_id': 'req-7cc75f54-7a01-4d35-895f-678d7a2d0638'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:42.385722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7cc75f54-7a01-4d35-895f-678d7a2d0638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbb2414674434be4bd5308e7b0d6e141', 'request_id': 'req-7cc75f54-7a01-4d35-895f-678d7a2d0638'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:42.395172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7cc75f54-7a01-4d35-895f-678d7a2d0638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbb2414674434be4bd5308e7b0d6e141', 'request_id': 'req-7cc75f54-7a01-4d35-895f-678d7a2d0638'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:42.409891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7cc75f54-7a01-4d35-895f-678d7a2d0638 admin admin] The token cache is being invalidate because project fbb2414674434be4bd5308e7b0d6e141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:17:42.410182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7cc75f54-7a01-4d35-895f-678d7a2d0638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:42.410990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7cc75f54-7a01-4d35-895f-678d7a2d0638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:42.414486 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3759/7551] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:17:42 2022] DELETE /identity/v3/projects/fbb2414674434be4bd5308e7b0d6e141 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:42.419312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114817c8-9ed1-445a-a296-c74f131779a0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:42.419832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114817c8-9ed1-445a-a296-c74f131779a0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:42.419832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114817c8-9ed1-445a-a296-c74f131779a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:42.445268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-114817c8-9ed1-445a-a296-c74f131779a0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:42.446565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-114817c8-9ed1-445a-a296-c74f131779a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:42.562249 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3793/7552] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:42.570075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5feef-4c78-4150-bcef-44ce6821e7d6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:42.570364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5feef-4c78-4150-bcef-44ce6821e7d6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:42.570634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5feef-4c78-4150-bcef-44ce6821e7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:42.625210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d7e5feef-4c78-4150-bcef-44ce6821e7d6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:42.626867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d7e5feef-4c78-4150-bcef-44ce6821e7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:42.648632 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3760/7553] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:42.650414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114817c8-9ed1-445a-a296-c74f131779a0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:42.664283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114817c8-9ed1-445a-a296-c74f131779a0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:42.670246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8b819-7db3-4b82-a010-2b7a954829d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:42.670952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8b819-7db3-4b82-a010-2b7a954829d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:42.671361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8b819-7db3-4b82-a010-2b7a954829d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:42.671705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8b819-7db3-4b82-a010-2b7a954829d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:42.703927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8b819-7db3-4b82-a010-2b7a954829d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:17:42.704901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8b819-7db3-4b82-a010-2b7a954829d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:42.709708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8b819-7db3-4b82-a010-2b7a954829d0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:42.742724 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3794/7554] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:17:42.747400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5feef-4c78-4150-bcef-44ce6821e7d6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:42.764376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5feef-4c78-4150-bcef-44ce6821e7d6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:42.778347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9f107-e8c5-4ddb-aa9b-fc5a36bfffd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:42.778953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9f107-e8c5-4ddb-aa9b-fc5a36bfffd1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:42.779232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9f107-e8c5-4ddb-aa9b-fc5a36bfffd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:42.779499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9f107-e8c5-4ddb-aa9b-fc5a36bfffd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:42.780148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9f107-e8c5-4ddb-aa9b-fc5a36bfffd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:42.782245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9f107-e8c5-4ddb-aa9b-fc5a36bfffd1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:42.854837 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3761/7555] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:17:42 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:17:42.856026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8b819-7db3-4b82-a010-2b7a954829d0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:42.868634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8b819-7db3-4b82-a010-2b7a954829d0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:42.963363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a7c4b-a8ae-4261-adb3-309b90b28aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:42.964351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a7c4b-a8ae-4261-adb3-309b90b28aae admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:42.964903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a7c4b-a8ae-4261-adb3-309b90b28aae admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:42.965476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a7c4b-a8ae-4261-adb3-309b90b28aae admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:42.966144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a7c4b-a8ae-4261-adb3-309b90b28aae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:42.968068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a7c4b-a8ae-4261-adb3-309b90b28aae admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:42.999318 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:43.014150 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3795/7556] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:17:42 2022] POST /identity/v3/users => generated 284 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:17:43.016681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9f107-e8c5-4ddb-aa9b-fc5a36bfffd1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:43.041800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9f107-e8c5-4ddb-aa9b-fc5a36bfffd1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:43.048329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b426bd4-9da8-4241-a2ea-610eda24d933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:43.049239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b426bd4-9da8-4241-a2ea-610eda24d933 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:43.049717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b426bd4-9da8-4241-a2ea-610eda24d933 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:43.049988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b426bd4-9da8-4241-a2ea-610eda24d933 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:43.050641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b426bd4-9da8-4241-a2ea-610eda24d933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:43.052870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b426bd4-9da8-4241-a2ea-610eda24d933 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:43.068747 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3762/7557] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:17:43.073253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a7c4b-a8ae-4261-adb3-309b90b28aae admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:43.091732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a7c4b-a8ae-4261-adb3-309b90b28aae admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:43.100323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477dded1-7d41-4be3-8df5-d7b144001273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:43.101361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dded1-7d41-4be3-8df5-d7b144001273 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:43.102200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dded1-7d41-4be3-8df5-d7b144001273 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:43.102630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dded1-7d41-4be3-8df5-d7b144001273 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:43.103781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477dded1-7d41-4be3-8df5-d7b144001273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:43.105850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477dded1-7d41-4be3-8df5-d7b144001273 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:43.122887 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3796/7558] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:17:43.127305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b426bd4-9da8-4241-a2ea-610eda24d933 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:43.141790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b426bd4-9da8-4241-a2ea-610eda24d933 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:43.155174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669062ab-3f98-4f11-aed8-24b72a006bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:43.156294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669062ab-3f98-4f11-aed8-24b72a006bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:43.156849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669062ab-3f98-4f11-aed8-24b72a006bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:43.157300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669062ab-3f98-4f11-aed8-24b72a006bfb admin admin] PATH_INFO: `/v3/projects/1e794e3329d54a42ba8fd956b08e6a98/users/27728b0b46014b5ab41512ee302079fd/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:43.185097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669062ab-3f98-4f11-aed8-24b72a006bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e794e3329d54a42ba8fd956b08e6a98, user_id=27728b0b46014b5ab41512ee302079fd, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:43.188147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669062ab-3f98-4f11-aed8-24b72a006bfb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:43.216487 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3763/7559] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:17:43 2022] PUT /identity/v3/projects/1e794e3329d54a42ba8fd956b08e6a98/users/27728b0b46014b5ab41512ee302079fd/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:43.228379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714b550-3d63-421f-9780-1983abe8ca3f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:43.229328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714b550-3d63-421f-9780-1983abe8ca3f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:43.230071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714b550-3d63-421f-9780-1983abe8ca3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:43.329963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8714b550-3d63-421f-9780-1983abe8ca3f None None] MFA Rules not processed for user `27728b0b46014b5ab41512ee302079fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:43.331549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8714b550-3d63-421f-9780-1983abe8ca3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:43.432930 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3797/7560] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:43.445761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669062ab-3f98-4f11-aed8-24b72a006bfb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:43.447707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-669062ab-3f98-4f11-aed8-24b72a006bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:43.547224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669062ab-3f98-4f11-aed8-24b72a006bfb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:43.562311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b832f3-0465-42a7-8283-42d6fa0b7be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:43.562944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b832f3-0465-42a7-8283-42d6fa0b7be4 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:43.563228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b832f3-0465-42a7-8283-42d6fa0b7be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:43.563497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b832f3-0465-42a7-8283-42d6fa0b7be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:43.581287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b832f3-0465-42a7-8283-42d6fa0b7be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:43.593459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b832f3-0465-42a7-8283-42d6fa0b7be4 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:43.622779 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3764/7561] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:17:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:17:47.831668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6fb66-b2bd-4704-9e54-fa9bcfdfa249 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:47.832572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6fb66-b2bd-4704-9e54-fa9bcfdfa249 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:47.833053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6fb66-b2bd-4704-9e54-fa9bcfdfa249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:47.900020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-67f6fb66-b2bd-4704-9e54-fa9bcfdfa249 None None] MFA Rules not processed for user `17d727ad88bb4c638a22af27155e240b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:47.901380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-67f6fb66-b2bd-4704-9e54-fa9bcfdfa249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:48.037755 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3798/7562] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:48.039481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b832f3-0465-42a7-8283-42d6fa0b7be4 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:48.041646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-10b832f3-0465-42a7-8283-42d6fa0b7be4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:48.192329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b832f3-0465-42a7-8283-42d6fa0b7be4 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:48.203109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cafa22-4f46-40ff-821c-028d44066283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:48.203971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cafa22-4f46-40ff-821c-028d44066283 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:48.204439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cafa22-4f46-40ff-821c-028d44066283 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:48.204971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cafa22-4f46-40ff-821c-028d44066283 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:48.206866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cafa22-4f46-40ff-821c-028d44066283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:48.210599 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cafa22-4f46-40ff-821c-028d44066283 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:48.226806 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:48.255829 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3765/7563] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:17:48 2022] POST /identity/v3/projects => generated 381 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:17:48.259692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6fb66-b2bd-4704-9e54-fa9bcfdfa249 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:48.292673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6fb66-b2bd-4704-9e54-fa9bcfdfa249 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:48.387257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081d4e7-2678-4fb7-8a93-fba161a9d316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:48.387893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081d4e7-2678-4fb7-8a93-fba161a9d316 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:48.388182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081d4e7-2678-4fb7-8a93-fba161a9d316 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:48.388444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081d4e7-2678-4fb7-8a93-fba161a9d316 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:48.389338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081d4e7-2678-4fb7-8a93-fba161a9d316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:48.391281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081d4e7-2678-4fb7-8a93-fba161a9d316 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:48.406942 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:48.433641 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3799/7564] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:17:48 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:17:48.435400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cafa22-4f46-40ff-821c-028d44066283 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:48.452001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cafa22-4f46-40ff-821c-028d44066283 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:48.463672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f527d-bd3d-43fa-8ce1-6886bdfed443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:48.464953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f527d-bd3d-43fa-8ce1-6886bdfed443 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:48.465527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f527d-bd3d-43fa-8ce1-6886bdfed443 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:48.465963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f527d-bd3d-43fa-8ce1-6886bdfed443 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:48.467339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f527d-bd3d-43fa-8ce1-6886bdfed443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:48.469262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f527d-bd3d-43fa-8ce1-6886bdfed443 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:48.495652 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3766/7565] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:17:48.497175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081d4e7-2678-4fb7-8a93-fba161a9d316 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:48.512862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081d4e7-2678-4fb7-8a93-fba161a9d316 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:48.544765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b12b78-da03-452d-b6ee-1c4240d15cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:48.546328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b12b78-da03-452d-b6ee-1c4240d15cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:48.546667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b12b78-da03-452d-b6ee-1c4240d15cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:48.546955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b12b78-da03-452d-b6ee-1c4240d15cc8 admin admin] PATH_INFO: `/v3/projects/d3dd119dad364f6c86ca15562e9a6112/users/bc5baafc3ec34208bd29e8acf670f819/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:48.581489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b12b78-da03-452d-b6ee-1c4240d15cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3dd119dad364f6c86ca15562e9a6112, user_id=bc5baafc3ec34208bd29e8acf670f819, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:48.584707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b12b78-da03-452d-b6ee-1c4240d15cc8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:48.616318 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3800/7566] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:17:48 2022] PUT /identity/v3/projects/d3dd119dad364f6c86ca15562e9a6112/users/bc5baafc3ec34208bd29e8acf670f819/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:48.620852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f527d-bd3d-43fa-8ce1-6886bdfed443 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:48.637706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f527d-bd3d-43fa-8ce1-6886bdfed443 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:48.716823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb08bd-e14d-44e2-8b5b-b6fd4146e7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:48.717846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb08bd-e14d-44e2-8b5b-b6fd4146e7ad admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:48.718228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb08bd-e14d-44e2-8b5b-b6fd4146e7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:48.718637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb08bd-e14d-44e2-8b5b-b6fd4146e7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:48.719615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb08bd-e14d-44e2-8b5b-b6fd4146e7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:48.721430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb08bd-e14d-44e2-8b5b-b6fd4146e7ad admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:48.737880 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3767/7567] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:17:48.739191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b12b78-da03-452d-b6ee-1c4240d15cc8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:48.756353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b12b78-da03-452d-b6ee-1c4240d15cc8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:48.771164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396082a-5e14-4ed9-9bcb-acd3efc08b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:48.771968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396082a-5e14-4ed9-9bcb-acd3efc08b65 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:48.772252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396082a-5e14-4ed9-9bcb-acd3efc08b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:48.772623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396082a-5e14-4ed9-9bcb-acd3efc08b65 admin admin] PATH_INFO: `/v3/projects/d3dd119dad364f6c86ca15562e9a6112/users/bc5baafc3ec34208bd29e8acf670f819/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:48.777422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396082a-5e14-4ed9-9bcb-acd3efc08b65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3dd119dad364f6c86ca15562e9a6112, user_id=bc5baafc3ec34208bd29e8acf670f819, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:48.782534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396082a-5e14-4ed9-9bcb-acd3efc08b65 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:48.811714 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3801/7568] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:17:48 2022] PUT /identity/v3/projects/d3dd119dad364f6c86ca15562e9a6112/users/bc5baafc3ec34208bd29e8acf670f819/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:55.393731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb08bd-e14d-44e2-8b5b-b6fd4146e7ad admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:55.395540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-90cb08bd-e14d-44e2-8b5b-b6fd4146e7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:55.414233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb08bd-e14d-44e2-8b5b-b6fd4146e7ad admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:55.580914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f1dd3-b077-4298-b99e-ecc84733e33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:55.581571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f1dd3-b077-4298-b99e-ecc84733e33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:55.581850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f1dd3-b077-4298-b99e-ecc84733e33c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:55.584196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f1dd3-b077-4298-b99e-ecc84733e33c admin admin] PATH_INFO: `/v3/users/bd7f2044fd394645a481809d4e482464` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:55.585646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f1dd3-b077-4298-b99e-ecc84733e33c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd7f2044fd394645a481809d4e482464)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:55.590750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f1dd3-b077-4298-b99e-ecc84733e33c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:55.710198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0e3f1dd3-b077-4298-b99e-ecc84733e33c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd7f2044fd394645a481809d4e482464'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:55.720550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0e3f1dd3-b077-4298-b99e-ecc84733e33c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd7f2044fd394645a481809d4e482464'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:55.721227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0e3f1dd3-b077-4298-b99e-ecc84733e33c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd7f2044fd394645a481809d4e482464'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:55.747612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0e3f1dd3-b077-4298-b99e-ecc84733e33c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd7f2044fd394645a481809d4e482464'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:55.760648 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:55.765693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0e3f1dd3-b077-4298-b99e-ecc84733e33c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd7f2044fd394645a481809d4e482464'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:55.782867 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3768/7569] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:17:55 2022] DELETE /identity/v3/users/bd7f2044fd394645a481809d4e482464 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:55.786118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae03028-5bf0-49f5-acf1-ac0e28bd9cc5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:55.787528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae03028-5bf0-49f5-acf1-ac0e28bd9cc5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:55.788425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae03028-5bf0-49f5-acf1-ac0e28bd9cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:55.811637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7ae03028-5bf0-49f5-acf1-ac0e28bd9cc5 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:55.814223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7ae03028-5bf0-49f5-acf1-ac0e28bd9cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:55.927783 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3802/7570] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:55.953652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f1dd3-b077-4298-b99e-ecc84733e33c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:55.954682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0e3f1dd3-b077-4298-b99e-ecc84733e33c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:56.101034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f1dd3-b077-4298-b99e-ecc84733e33c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:56.106153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c0fec-83e8-4da8-9f42-616ca6399eb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:56.107069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c0fec-83e8-4da8-9f42-616ca6399eb8 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:56.107677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c0fec-83e8-4da8-9f42-616ca6399eb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:56.108129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c0fec-83e8-4da8-9f42-616ca6399eb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:56.124440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c0fec-83e8-4da8-9f42-616ca6399eb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:56.130213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c0fec-83e8-4da8-9f42-616ca6399eb8 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:56.161296 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3769/7571] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:17:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:17:57.005990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae03028-5bf0-49f5-acf1-ac0e28bd9cc5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:57.011355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7ae03028-5bf0-49f5-acf1-ac0e28bd9cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:57.029536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae03028-5bf0-49f5-acf1-ac0e28bd9cc5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:57.035159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629a69e-487d-433c-840c-1639f77998fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:57.036198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629a69e-487d-433c-840c-1639f77998fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:57.037419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629a69e-487d-433c-840c-1639f77998fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:57.037968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629a69e-487d-433c-840c-1639f77998fa admin admin] PATH_INFO: `/v3/projects/8bbb1f713aac4eb1808d048d9e4b6b90` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:57.040795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629a69e-487d-433c-840c-1639f77998fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bbb1f713aac4eb1808d048d9e4b6b90)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:57.043264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629a69e-487d-433c-840c-1639f77998fa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:57.141277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0629a69e-487d-433c-840c-1639f77998fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bbb1f713aac4eb1808d048d9e4b6b90', 'request_id': 'req-0629a69e-487d-433c-840c-1639f77998fa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:57.157178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0629a69e-487d-433c-840c-1639f77998fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bbb1f713aac4eb1808d048d9e4b6b90', 'request_id': 'req-0629a69e-487d-433c-840c-1639f77998fa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:57.173420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0629a69e-487d-433c-840c-1639f77998fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bbb1f713aac4eb1808d048d9e4b6b90', 'request_id': 'req-0629a69e-487d-433c-840c-1639f77998fa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:57.196824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0629a69e-487d-433c-840c-1639f77998fa admin admin] The token cache is being invalidate because project 8bbb1f713aac4eb1808d048d9e4b6b90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:17:57.197447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0629a69e-487d-433c-840c-1639f77998fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:57.198322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0629a69e-487d-433c-840c-1639f77998fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:57.204904 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3803/7572] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:17:57 2022] DELETE /identity/v3/projects/8bbb1f713aac4eb1808d048d9e4b6b90 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:57.205917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c0fec-83e8-4da8-9f42-616ca6399eb8 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:57.217002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c0fec-83e8-4da8-9f42-616ca6399eb8 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:57.281235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ed56e-bc55-4fab-9601-02d1ab580a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:57.281974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ed56e-bc55-4fab-9601-02d1ab580a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:57.282348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ed56e-bc55-4fab-9601-02d1ab580a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:57.282716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ed56e-bc55-4fab-9601-02d1ab580a57 admin admin] PATH_INFO: `/v3/users/9b3f1532d65a4c508930cfe19574b39d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:57.283949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ed56e-bc55-4fab-9601-02d1ab580a57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b3f1532d65a4c508930cfe19574b39d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:57.286238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ed56e-bc55-4fab-9601-02d1ab580a57 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:57.362998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2c9ed56e-bc55-4fab-9601-02d1ab580a57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b3f1532d65a4c508930cfe19574b39d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:57.384194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2c9ed56e-bc55-4fab-9601-02d1ab580a57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b3f1532d65a4c508930cfe19574b39d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:57.385238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2c9ed56e-bc55-4fab-9601-02d1ab580a57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b3f1532d65a4c508930cfe19574b39d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:57.403634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2c9ed56e-bc55-4fab-9601-02d1ab580a57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b3f1532d65a4c508930cfe19574b39d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:57.416751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2c9ed56e-bc55-4fab-9601-02d1ab580a57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b3f1532d65a4c508930cfe19574b39d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:57.429699 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3770/7573] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:17:57 2022] DELETE /identity/v3/users/9b3f1532d65a4c508930cfe19574b39d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:58.435191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629a69e-487d-433c-840c-1639f77998fa admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:58.436666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0629a69e-487d-433c-840c-1639f77998fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:58.455428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629a69e-487d-433c-840c-1639f77998fa admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:58.541281 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:58.586516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea95979-c832-4112-befa-b83eb48b92b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:58.588324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea95979-c832-4112-befa-b83eb48b92b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:58.589072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea95979-c832-4112-befa-b83eb48b92b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:58.589656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea95979-c832-4112-befa-b83eb48b92b9 admin admin] PATH_INFO: `/v3/projects/725fa424ebcd4bff8bc6d3af72709f3a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:58.591849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea95979-c832-4112-befa-b83eb48b92b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=725fa424ebcd4bff8bc6d3af72709f3a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:58.595615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea95979-c832-4112-befa-b83eb48b92b9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:58.664989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6ea95979-c832-4112-befa-b83eb48b92b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '725fa424ebcd4bff8bc6d3af72709f3a', 'request_id': 'req-6ea95979-c832-4112-befa-b83eb48b92b9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:58.677746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6ea95979-c832-4112-befa-b83eb48b92b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '725fa424ebcd4bff8bc6d3af72709f3a', 'request_id': 'req-6ea95979-c832-4112-befa-b83eb48b92b9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:58.687411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6ea95979-c832-4112-befa-b83eb48b92b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '725fa424ebcd4bff8bc6d3af72709f3a', 'request_id': 'req-6ea95979-c832-4112-befa-b83eb48b92b9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:58.702703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6ea95979-c832-4112-befa-b83eb48b92b9 admin admin] The token cache is being invalidate because project 725fa424ebcd4bff8bc6d3af72709f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:17:58.702947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6ea95979-c832-4112-befa-b83eb48b92b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:58.703966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6ea95979-c832-4112-befa-b83eb48b92b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:58.706112 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3804/7574] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:17:58 2022] DELETE /identity/v3/projects/725fa424ebcd4bff8bc6d3af72709f3a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:58.710789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ed56e-bc55-4fab-9601-02d1ab580a57 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:58.712415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2c9ed56e-bc55-4fab-9601-02d1ab580a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:58.728547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ed56e-bc55-4fab-9601-02d1ab580a57 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:58.737987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323b2e5-72d5-4e9f-8b17-d0ce7fd61ff5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:58.738319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323b2e5-72d5-4e9f-8b17-d0ce7fd61ff5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:58.738616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323b2e5-72d5-4e9f-8b17-d0ce7fd61ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:58.750137 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:58.785874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1323b2e5-72d5-4e9f-8b17-d0ce7fd61ff5 None None] MFA Rules not processed for user `bc5baafc3ec34208bd29e8acf670f819`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:58.788403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1323b2e5-72d5-4e9f-8b17-d0ce7fd61ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:58.814234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e828c-16d6-496e-be11-94c67c637e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:58.814910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e828c-16d6-496e-be11-94c67c637e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:58.815218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e828c-16d6-496e-be11-94c67c637e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:58.815495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e828c-16d6-496e-be11-94c67c637e1d admin admin] PATH_INFO: `/v3/users/57fda603d6c2428294e3dc27444fa44c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:58.816793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e828c-16d6-496e-be11-94c67c637e1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=57fda603d6c2428294e3dc27444fa44c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:58.819285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e828c-16d6-496e-be11-94c67c637e1d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:58.900757 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3805/7575] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:17:58.908077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-898e828c-16d6-496e-be11-94c67c637e1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57fda603d6c2428294e3dc27444fa44c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:58.918984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323b2e5-72d5-4e9f-8b17-d0ce7fd61ff5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:58.921841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1323b2e5-72d5-4e9f-8b17-d0ce7fd61ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:58.931296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-898e828c-16d6-496e-be11-94c67c637e1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57fda603d6c2428294e3dc27444fa44c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:58.932297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-898e828c-16d6-496e-be11-94c67c637e1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57fda603d6c2428294e3dc27444fa44c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:58.947725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-898e828c-16d6-496e-be11-94c67c637e1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57fda603d6c2428294e3dc27444fa44c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:58.956166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-898e828c-16d6-496e-be11-94c67c637e1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57fda603d6c2428294e3dc27444fa44c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:58.963219 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3771/7576] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:17:58 2022] DELETE /identity/v3/users/57fda603d6c2428294e3dc27444fa44c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:59.020403 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:59.073949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323b2e5-72d5-4e9f-8b17-d0ce7fd61ff5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:59.165744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3f455-bbbc-422e-8321-b2bb50a72c74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:59.166358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3f455-bbbc-422e-8321-b2bb50a72c74 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:59.167757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3f455-bbbc-422e-8321-b2bb50a72c74 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:59.168169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3f455-bbbc-422e-8321-b2bb50a72c74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:59.170826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-edf3f455-bbbc-422e-8321-b2bb50a72c74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:59.251675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3f455-bbbc-422e-8321-b2bb50a72c74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:59.254306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3f455-bbbc-422e-8321-b2bb50a72c74 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:59.272890 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3806/7577] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:17:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:17:59.444908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e828c-16d6-496e-be11-94c67c637e1d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:17:59.449513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-898e828c-16d6-496e-be11-94c67c637e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:59.631472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e828c-16d6-496e-be11-94c67c637e1d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:17:59.650798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d7fe5-2e2d-4df3-8b51-73e5d8441d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:17:59.652089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d7fe5-2e2d-4df3-8b51-73e5d8441d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:59.652489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d7fe5-2e2d-4df3-8b51-73e5d8441d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:59.653087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d7fe5-2e2d-4df3-8b51-73e5d8441d8a admin admin] PATH_INFO: `/v3/projects/15637e57d5e24685b048d6e23fa7a3f8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:59.655375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d7fe5-2e2d-4df3-8b51-73e5d8441d8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=15637e57d5e24685b048d6e23fa7a3f8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:17:59.658950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d7fe5-2e2d-4df3-8b51-73e5d8441d8a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:17:59.793568 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:17:59.808476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4d6d7fe5-2e2d-4df3-8b51-73e5d8441d8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15637e57d5e24685b048d6e23fa7a3f8', 'request_id': 'req-4d6d7fe5-2e2d-4df3-8b51-73e5d8441d8a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:59.822392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4d6d7fe5-2e2d-4df3-8b51-73e5d8441d8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15637e57d5e24685b048d6e23fa7a3f8', 'request_id': 'req-4d6d7fe5-2e2d-4df3-8b51-73e5d8441d8a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:59.831899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4d6d7fe5-2e2d-4df3-8b51-73e5d8441d8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15637e57d5e24685b048d6e23fa7a3f8', 'request_id': 'req-4d6d7fe5-2e2d-4df3-8b51-73e5d8441d8a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:59.848695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4d6d7fe5-2e2d-4df3-8b51-73e5d8441d8a admin admin] The token cache is being invalidate because project 15637e57d5e24685b048d6e23fa7a3f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:17:59.851367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4d6d7fe5-2e2d-4df3-8b51-73e5d8441d8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:59.853217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4d6d7fe5-2e2d-4df3-8b51-73e5d8441d8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:17:59.859997 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3772/7578] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:17:59 2022] DELETE /identity/v3/projects/15637e57d5e24685b048d6e23fa7a3f8 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:17:59.861304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6c24f-503c-4292-95e8-7c285f1eba9a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:17:59.861814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6c24f-503c-4292-95e8-7c285f1eba9a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:17:59.861814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6c24f-503c-4292-95e8-7c285f1eba9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:17:59.896454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-33b6c24f-503c-4292-95e8-7c285f1eba9a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:17:59.898271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-33b6c24f-503c-4292-95e8-7c285f1eba9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:17:59.999025 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3807/7579] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:00.008993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d592d2-30be-4827-a362-37bb24ad780e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:00.009388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d592d2-30be-4827-a362-37bb24ad780e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:00.009786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d592d2-30be-4827-a362-37bb24ad780e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:00.034050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-01d592d2-30be-4827-a362-37bb24ad780e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:00.035401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-01d592d2-30be-4827-a362-37bb24ad780e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:00.046821 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3773/7580] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:00.052385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6c24f-503c-4292-95e8-7c285f1eba9a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:00.064309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6c24f-503c-4292-95e8-7c285f1eba9a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:00.071688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4e9f6-e4b5-4ae0-b411-e3f50dc25d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:00.072509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4e9f6-e4b5-4ae0-b411-e3f50dc25d75 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:00.072947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4e9f6-e4b5-4ae0-b411-e3f50dc25d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:00.073831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4e9f6-e4b5-4ae0-b411-e3f50dc25d75 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:00.074164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4e9f6-e4b5-4ae0-b411-e3f50dc25d75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:18:00.074566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4e9f6-e4b5-4ae0-b411-e3f50dc25d75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:00.076453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4e9f6-e4b5-4ae0-b411-e3f50dc25d75 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:00.102245 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3808/7581] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:18:00.106996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d592d2-30be-4827-a362-37bb24ad780e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:00.122461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d592d2-30be-4827-a362-37bb24ad780e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:00.127238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51acffa-f51f-48d5-b410-af3bd636f041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:00.127870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51acffa-f51f-48d5-b410-af3bd636f041 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:00.128151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51acffa-f51f-48d5-b410-af3bd636f041 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:00.128427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51acffa-f51f-48d5-b410-af3bd636f041 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:00.129518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51acffa-f51f-48d5-b410-af3bd636f041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:00.132977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51acffa-f51f-48d5-b410-af3bd636f041 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:00.174475 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3774/7582] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:18:00 2022] POST /identity/v3/projects => generated 395 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:00.179826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4e9f6-e4b5-4ae0-b411-e3f50dc25d75 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:00.192672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4e9f6-e4b5-4ae0-b411-e3f50dc25d75 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:00.214543 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:00.281847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ca568-71ae-4fe7-94e4-621a4f50a9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:00.282470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ca568-71ae-4fe7-94e4-621a4f50a9ed admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:00.282760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ca568-71ae-4fe7-94e4-621a4f50a9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:00.283092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ca568-71ae-4fe7-94e4-621a4f50a9ed admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:00.283651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ca568-71ae-4fe7-94e4-621a4f50a9ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:00.286175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ca568-71ae-4fe7-94e4-621a4f50a9ed admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:00.341492 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3809/7583] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:18:00 2022] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:00.351204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51acffa-f51f-48d5-b410-af3bd636f041 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:00.382356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51acffa-f51f-48d5-b410-af3bd636f041 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:00.395199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d94742-2454-4f63-97bb-a7a4e695176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:00.397615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d94742-2454-4f63-97bb-a7a4e695176c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:00.397891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d94742-2454-4f63-97bb-a7a4e695176c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:00.398160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d94742-2454-4f63-97bb-a7a4e695176c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:00.399397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d94742-2454-4f63-97bb-a7a4e695176c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:00.401190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d94742-2454-4f63-97bb-a7a4e695176c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:00.420672 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3775/7584] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:00.422482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ca568-71ae-4fe7-94e4-621a4f50a9ed admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:00.444754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ca568-71ae-4fe7-94e4-621a4f50a9ed admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:00.451384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b19641-af09-48f7-bc67-a5bbac01806c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:00.452472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b19641-af09-48f7-bc67-a5bbac01806c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:00.452862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b19641-af09-48f7-bc67-a5bbac01806c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:00.453259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b19641-af09-48f7-bc67-a5bbac01806c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:00.457761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b19641-af09-48f7-bc67-a5bbac01806c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:00.457761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b19641-af09-48f7-bc67-a5bbac01806c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:00.476880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d94742-2454-4f63-97bb-a7a4e695176c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:00.477494 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3810/7585] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:00.496248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d94742-2454-4f63-97bb-a7a4e695176c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:00.503822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fce1e9-94d4-4f1f-a592-7668a54dd4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:00.504478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fce1e9-94d4-4f1f-a592-7668a54dd4eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:00.504787 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fce1e9-94d4-4f1f-a592-7668a54dd4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:00.505130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fce1e9-94d4-4f1f-a592-7668a54dd4eb admin admin] PATH_INFO: `/v3/projects/af899d93b865487992614e331fd37d45/users/ade7d5490be84235afe9c87687ad9846/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:00.533866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fce1e9-94d4-4f1f-a592-7668a54dd4eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=af899d93b865487992614e331fd37d45, user_id=ade7d5490be84235afe9c87687ad9846, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:00.536551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fce1e9-94d4-4f1f-a592-7668a54dd4eb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:00.559822 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3776/7586] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:18:00 2022] PUT /identity/v3/projects/af899d93b865487992614e331fd37d45/users/ade7d5490be84235afe9c87687ad9846/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:18:00.570092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480a3e2-0b67-419e-9f54-c7a932ed41f8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:00.570478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480a3e2-0b67-419e-9f54-c7a932ed41f8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:00.570863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480a3e2-0b67-419e-9f54-c7a932ed41f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:00.636046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4480a3e2-0b67-419e-9f54-c7a932ed41f8 None None] MFA Rules not processed for user `ade7d5490be84235afe9c87687ad9846`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:00.638768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4480a3e2-0b67-419e-9f54-c7a932ed41f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:00.658937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fce1e9-94d4-4f1f-a592-7668a54dd4eb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:00.660757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d9fce1e9-94d4-4f1f-a592-7668a54dd4eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:00.800884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fce1e9-94d4-4f1f-a592-7668a54dd4eb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:00.828982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5e156-3ea6-46f9-bd51-b322ecbe9f09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:00.829869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5e156-3ea6-46f9-bd51-b322ecbe9f09 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:00.830732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5e156-3ea6-46f9-bd51-b322ecbe9f09 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:00.831186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5e156-3ea6-46f9-bd51-b322ecbe9f09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:00.835087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f8b5e156-3ea6-46f9-bd51-b322ecbe9f09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:00.855632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5e156-3ea6-46f9-bd51-b322ecbe9f09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:00.857826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5e156-3ea6-46f9-bd51-b322ecbe9f09 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:00.876393 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3811/7587] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:00 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:00.889158 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3777/7588] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:18:00.902850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480a3e2-0b67-419e-9f54-c7a932ed41f8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:00.904384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4480a3e2-0b67-419e-9f54-c7a932ed41f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:01.027725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480a3e2-0b67-419e-9f54-c7a932ed41f8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:01.068363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9a4c2-841b-40f8-ac4b-80854c2cea37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:01.072279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9a4c2-841b-40f8-ac4b-80854c2cea37 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:01.073543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9a4c2-841b-40f8-ac4b-80854c2cea37 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:01.075060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9a4c2-841b-40f8-ac4b-80854c2cea37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:01.092567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9a4c2-841b-40f8-ac4b-80854c2cea37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:01.094408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9a4c2-841b-40f8-ac4b-80854c2cea37 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:01.122250 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3812/7589] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:00 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:18:04.679607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5e156-3ea6-46f9-bd51-b322ecbe9f09 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:04.682700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f8b5e156-3ea6-46f9-bd51-b322ecbe9f09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:04.787861 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:04.814645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5e156-3ea6-46f9-bd51-b322ecbe9f09 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:04.830867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08233fa-b735-4000-8585-e5dc47ff45d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:04.831832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08233fa-b735-4000-8585-e5dc47ff45d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:04.832362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08233fa-b735-4000-8585-e5dc47ff45d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:04.832957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08233fa-b735-4000-8585-e5dc47ff45d9 admin admin] PATH_INFO: `/v3/users/27728b0b46014b5ab41512ee302079fd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:04.839432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08233fa-b735-4000-8585-e5dc47ff45d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27728b0b46014b5ab41512ee302079fd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:04.844022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08233fa-b735-4000-8585-e5dc47ff45d9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:04.966244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d08233fa-b735-4000-8585-e5dc47ff45d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27728b0b46014b5ab41512ee302079fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:04.993059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d08233fa-b735-4000-8585-e5dc47ff45d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27728b0b46014b5ab41512ee302079fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:04.994208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d08233fa-b735-4000-8585-e5dc47ff45d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27728b0b46014b5ab41512ee302079fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:05.019364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d08233fa-b735-4000-8585-e5dc47ff45d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27728b0b46014b5ab41512ee302079fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:05.042413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d08233fa-b735-4000-8585-e5dc47ff45d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27728b0b46014b5ab41512ee302079fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:05.065634 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3778/7590] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:18:04 2022] DELETE /identity/v3/users/27728b0b46014b5ab41512ee302079fd => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:05.071230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f3457-60c2-43d4-8b21-6f99fdbacb84 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:05.071788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f3457-60c2-43d4-8b21-6f99fdbacb84 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:05.072934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f3457-60c2-43d4-8b21-6f99fdbacb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:05.128663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c87f3457-60c2-43d4-8b21-6f99fdbacb84 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:05.133120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c87f3457-60c2-43d4-8b21-6f99fdbacb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:05.186939 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:05.300525 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3813/7591] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:05.365752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08233fa-b735-4000-8585-e5dc47ff45d9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:05.372889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d08233fa-b735-4000-8585-e5dc47ff45d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:05.478855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08233fa-b735-4000-8585-e5dc47ff45d9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:05.492360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096eb1c1-432f-45ec-b00c-5ce7c47f5aa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:05.493444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096eb1c1-432f-45ec-b00c-5ce7c47f5aa1 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:05.494183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096eb1c1-432f-45ec-b00c-5ce7c47f5aa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:05.494749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096eb1c1-432f-45ec-b00c-5ce7c47f5aa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:05.508791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096eb1c1-432f-45ec-b00c-5ce7c47f5aa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:05.510903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096eb1c1-432f-45ec-b00c-5ce7c47f5aa1 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:05.552418 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3779/7592] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:18:06.571178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f3457-60c2-43d4-8b21-6f99fdbacb84 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:06.572784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c87f3457-60c2-43d4-8b21-6f99fdbacb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:06.596866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f3457-60c2-43d4-8b21-6f99fdbacb84 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:06.616153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bccb1d-2b67-4cfe-88a9-19dc6007451b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:06.618215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bccb1d-2b67-4cfe-88a9-19dc6007451b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:06.618500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bccb1d-2b67-4cfe-88a9-19dc6007451b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:06.618777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bccb1d-2b67-4cfe-88a9-19dc6007451b admin admin] PATH_INFO: `/v3/projects/1e794e3329d54a42ba8fd956b08e6a98` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:06.622408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bccb1d-2b67-4cfe-88a9-19dc6007451b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e794e3329d54a42ba8fd956b08e6a98)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:06.624590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bccb1d-2b67-4cfe-88a9-19dc6007451b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:06.751757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-04bccb1d-2b67-4cfe-88a9-19dc6007451b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e794e3329d54a42ba8fd956b08e6a98', 'request_id': 'req-04bccb1d-2b67-4cfe-88a9-19dc6007451b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:06.772436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-04bccb1d-2b67-4cfe-88a9-19dc6007451b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e794e3329d54a42ba8fd956b08e6a98', 'request_id': 'req-04bccb1d-2b67-4cfe-88a9-19dc6007451b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:06.789646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-04bccb1d-2b67-4cfe-88a9-19dc6007451b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e794e3329d54a42ba8fd956b08e6a98', 'request_id': 'req-04bccb1d-2b67-4cfe-88a9-19dc6007451b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:06.815144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-04bccb1d-2b67-4cfe-88a9-19dc6007451b admin admin] The token cache is being invalidate because project 1e794e3329d54a42ba8fd956b08e6a98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:18:06.816700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-04bccb1d-2b67-4cfe-88a9-19dc6007451b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:06.818527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-04bccb1d-2b67-4cfe-88a9-19dc6007451b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:06.822356 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3814/7593] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:18:06 2022] DELETE /identity/v3/projects/1e794e3329d54a42ba8fd956b08e6a98 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:06.829730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a21ed-25b8-4247-ba81-160c51774b23 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:06.830332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a21ed-25b8-4247-ba81-160c51774b23 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:06.830332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a21ed-25b8-4247-ba81-160c51774b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:06.869438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-593a21ed-25b8-4247-ba81-160c51774b23 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:06.870688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-593a21ed-25b8-4247-ba81-160c51774b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:07.011633 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3780/7594] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:07.019328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef261856-9722-499d-b882-188497284c89 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:07.019751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef261856-9722-499d-b882-188497284c89 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:07.020131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef261856-9722-499d-b882-188497284c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:07.061755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ef261856-9722-499d-b882-188497284c89 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:07.066511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ef261856-9722-499d-b882-188497284c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:07.091797 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3815/7595] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:07.097041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a21ed-25b8-4247-ba81-160c51774b23 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:07.111461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a21ed-25b8-4247-ba81-160c51774b23 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:07.152740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4272222-2deb-4434-9fbf-0f11624c4e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:07.153426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4272222-2deb-4434-9fbf-0f11624c4e69 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:07.153707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4272222-2deb-4434-9fbf-0f11624c4e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:07.153981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4272222-2deb-4434-9fbf-0f11624c4e69 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:07.154689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4272222-2deb-4434-9fbf-0f11624c4e69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:18:07.154987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4272222-2deb-4434-9fbf-0f11624c4e69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:07.156627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4272222-2deb-4434-9fbf-0f11624c4e69 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:07.209185 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3781/7596] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:18:07.213591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef261856-9722-499d-b882-188497284c89 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:07.234658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef261856-9722-499d-b882-188497284c89 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:07.244085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f95313-e74d-492e-8d91-3565e31c7f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:07.247290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f95313-e74d-492e-8d91-3565e31c7f50 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:07.247694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f95313-e74d-492e-8d91-3565e31c7f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:07.248074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f95313-e74d-492e-8d91-3565e31c7f50 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:07.249392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f95313-e74d-492e-8d91-3565e31c7f50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:07.257200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f95313-e74d-492e-8d91-3565e31c7f50 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:07.323092 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3816/7597] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:18:07 2022] POST /identity/v3/projects => generated 355 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:07.326439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4272222-2deb-4434-9fbf-0f11624c4e69 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:07.332167 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:07.342233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4272222-2deb-4434-9fbf-0f11624c4e69 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:07.477665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccb0cf-f460-4422-9091-209723d84ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:07.484024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccb0cf-f460-4422-9091-209723d84ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:07.489594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccb0cf-f460-4422-9091-209723d84ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:07.490137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccb0cf-f460-4422-9091-209723d84ee5 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:07.490928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccb0cf-f460-4422-9091-209723d84ee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:07.493088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccb0cf-f460-4422-9091-209723d84ee5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:07.556339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f95313-e74d-492e-8d91-3565e31c7f50 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:07.566477 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3782/7598] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:18:07 2022] POST /identity/v3/users => generated 278 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:07.574816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f95313-e74d-492e-8d91-3565e31c7f50 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:07.580896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d45d50-f0d6-4907-97ed-4bec02806dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:07.583746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d45d50-f0d6-4907-97ed-4bec02806dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:07.584265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d45d50-f0d6-4907-97ed-4bec02806dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:07.584857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d45d50-f0d6-4907-97ed-4bec02806dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:07.587804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d45d50-f0d6-4907-97ed-4bec02806dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:07.589764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d45d50-f0d6-4907-97ed-4bec02806dc1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:07.603076 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3817/7599] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:07.607933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccb0cf-f460-4422-9091-209723d84ee5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:07.621688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccb0cf-f460-4422-9091-209723d84ee5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:07.634533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e7a82-15ec-47a8-8ff1-6b73ef61bf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:07.635825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e7a82-15ec-47a8-8ff1-6b73ef61bf08 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:07.636222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e7a82-15ec-47a8-8ff1-6b73ef61bf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:07.636621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e7a82-15ec-47a8-8ff1-6b73ef61bf08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:07.637924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e7a82-15ec-47a8-8ff1-6b73ef61bf08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:07.640352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e7a82-15ec-47a8-8ff1-6b73ef61bf08 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:07.655385 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3783/7600] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:18:07.660623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d45d50-f0d6-4907-97ed-4bec02806dc1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:07.675531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d45d50-f0d6-4907-97ed-4bec02806dc1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:07.686762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a8ff6-4a97-43b3-913a-8af1d317b018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:07.688488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a8ff6-4a97-43b3-913a-8af1d317b018 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:07.689282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a8ff6-4a97-43b3-913a-8af1d317b018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:07.689282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a8ff6-4a97-43b3-913a-8af1d317b018 admin admin] PATH_INFO: `/v3/projects/c9c7ffc2d1ee453cb1398c4292aa26a2/users/2a226b4184204e01bdd8318acb1fd014/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:07.740694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a8ff6-4a97-43b3-913a-8af1d317b018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c7ffc2d1ee453cb1398c4292aa26a2, user_id=2a226b4184204e01bdd8318acb1fd014, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:07.740694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a8ff6-4a97-43b3-913a-8af1d317b018 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:07.763147 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3818/7601] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:18:07 2022] PUT /identity/v3/projects/c9c7ffc2d1ee453cb1398c4292aa26a2/users/2a226b4184204e01bdd8318acb1fd014/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:07.774993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976c814-16ff-4b54-a794-87a4532d8605 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:07.775239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976c814-16ff-4b54-a794-87a4532d8605 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:07.775485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976c814-16ff-4b54-a794-87a4532d8605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:07.874642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2976c814-16ff-4b54-a794-87a4532d8605 None None] MFA Rules not processed for user `2a226b4184204e01bdd8318acb1fd014`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:07.875820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2976c814-16ff-4b54-a794-87a4532d8605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:08.137971 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3784/7602] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:08.142227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a8ff6-4a97-43b3-913a-8af1d317b018 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:08.383943 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:08.444317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a8ff6-4a97-43b3-913a-8af1d317b018 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:08.454446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87d981-1d7c-4d5b-9e0f-8c0bf0e76d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:08.457120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87d981-1d7c-4d5b-9e0f-8c0bf0e76d65 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:08.457973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87d981-1d7c-4d5b-9e0f-8c0bf0e76d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:08.459753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87d981-1d7c-4d5b-9e0f-8c0bf0e76d65 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:08.460993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87d981-1d7c-4d5b-9e0f-8c0bf0e76d65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:08.463256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87d981-1d7c-4d5b-9e0f-8c0bf0e76d65 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:08.548304 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3819/7603] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:18:08 2022] POST /identity/v3/projects => generated 355 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:08.548963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976c814-16ff-4b54-a794-87a4532d8605 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:08.569755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976c814-16ff-4b54-a794-87a4532d8605 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:08.734935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ded80-81bc-4ce0-9787-c1ea5d189bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:08.735573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ded80-81bc-4ce0-9787-c1ea5d189bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:08.735850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ded80-81bc-4ce0-9787-c1ea5d189bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:08.736204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ded80-81bc-4ce0-9787-c1ea5d189bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:08.737109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ded80-81bc-4ce0-9787-c1ea5d189bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:08.752919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ded80-81bc-4ce0-9787-c1ea5d189bc7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:08.818929 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:08.827386 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3785/7604] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:18:08 2022] POST /identity/v3/users => generated 284 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:08.835676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87d981-1d7c-4d5b-9e0f-8c0bf0e76d65 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:08.854641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87d981-1d7c-4d5b-9e0f-8c0bf0e76d65 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:08.869496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88116cab-f1be-471b-b185-6147f27eee30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:08.870248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88116cab-f1be-471b-b185-6147f27eee30 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:08.870630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88116cab-f1be-471b-b185-6147f27eee30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:08.871002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88116cab-f1be-471b-b185-6147f27eee30 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:08.873908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88116cab-f1be-471b-b185-6147f27eee30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:08.906437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88116cab-f1be-471b-b185-6147f27eee30 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:08.952802 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3820/7605] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:08.954028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ded80-81bc-4ce0-9787-c1ea5d189bc7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:08.983419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ded80-81bc-4ce0-9787-c1ea5d189bc7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:08.997371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b56be-43bc-4e59-b02a-9799f120edad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:08.998060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b56be-43bc-4e59-b02a-9799f120edad admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:08.998574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b56be-43bc-4e59-b02a-9799f120edad admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:08.998574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b56be-43bc-4e59-b02a-9799f120edad admin admin] PATH_INFO: `/v3/projects/e4cc15c45cf34fd582d614a9386689e5/users/7dd6b7ccb57c4955ad94179b60599f4e/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:09.048681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b56be-43bc-4e59-b02a-9799f120edad admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4cc15c45cf34fd582d614a9386689e5, user_id=7dd6b7ccb57c4955ad94179b60599f4e, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:09.051362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b56be-43bc-4e59-b02a-9799f120edad admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:09.079773 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3786/7606] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:18:08 2022] PUT /identity/v3/projects/e4cc15c45cf34fd582d614a9386689e5/users/7dd6b7ccb57c4955ad94179b60599f4e/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:18:09.085244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88116cab-f1be-471b-b185-6147f27eee30 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:09.102539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88116cab-f1be-471b-b185-6147f27eee30 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:09.251346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0727f-393a-48be-b152-b2fb31ecd536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:09.252180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0727f-393a-48be-b152-b2fb31ecd536 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:09.252652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0727f-393a-48be-b152-b2fb31ecd536 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:09.253667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0727f-393a-48be-b152-b2fb31ecd536 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:09.255699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0727f-393a-48be-b152-b2fb31ecd536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:09.263443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0727f-393a-48be-b152-b2fb31ecd536 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:09.291623 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3821/7607] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:09.306540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b56be-43bc-4e59-b02a-9799f120edad admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:09.330675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b56be-43bc-4e59-b02a-9799f120edad admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:09.342488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2656f-a214-47ba-816c-7ca7d991a863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:09.343426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2656f-a214-47ba-816c-7ca7d991a863 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:09.343710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2656f-a214-47ba-816c-7ca7d991a863 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:09.343973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2656f-a214-47ba-816c-7ca7d991a863 admin admin] PATH_INFO: `/v3/projects/e4cc15c45cf34fd582d614a9386689e5/users/7dd6b7ccb57c4955ad94179b60599f4e/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:09.348070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2656f-a214-47ba-816c-7ca7d991a863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4cc15c45cf34fd582d614a9386689e5, user_id=7dd6b7ccb57c4955ad94179b60599f4e, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:09.352856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2656f-a214-47ba-816c-7ca7d991a863 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:09.366049 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3787/7608] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:18:09 2022] PUT /identity/v3/projects/e4cc15c45cf34fd582d614a9386689e5/users/7dd6b7ccb57c4955ad94179b60599f4e/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:09.377806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c842194-0637-4704-9982-effe680791ca None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:09.378401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c842194-0637-4704-9982-effe680791ca None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:09.378948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c842194-0637-4704-9982-effe680791ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:09.505530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3c842194-0637-4704-9982-effe680791ca None None] MFA Rules not processed for user `7dd6b7ccb57c4955ad94179b60599f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:09.506858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3c842194-0637-4704-9982-effe680791ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:09.681725 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3822/7609] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:09.689360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2656f-a214-47ba-816c-7ca7d991a863 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:09.693258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7fa2656f-a214-47ba-816c-7ca7d991a863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:09.788485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2656f-a214-47ba-816c-7ca7d991a863 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:09.792669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c236f-c1fe-46f4-8c52-3f4c91419f7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:09.793551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c236f-c1fe-46f4-8c52-3f4c91419f7c service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:09.793936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c236f-c1fe-46f4-8c52-3f4c91419f7c service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:09.794333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c236f-c1fe-46f4-8c52-3f4c91419f7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:09.805903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c236f-c1fe-46f4-8c52-3f4c91419f7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:09.807818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c236f-c1fe-46f4-8c52-3f4c91419f7c service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:09.834216 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3788/7610] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:09 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:18:09.952274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c842194-0637-4704-9982-effe680791ca None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:09.955420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3c842194-0637-4704-9982-effe680791ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:09.999433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c842194-0637-4704-9982-effe680791ca None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:10.013641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab34f2f-2db9-46c5-bbbb-7f08a998a693 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:10.014475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab34f2f-2db9-46c5-bbbb-7f08a998a693 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:10.016905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab34f2f-2db9-46c5-bbbb-7f08a998a693 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:10.017362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab34f2f-2db9-46c5-bbbb-7f08a998a693 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:10.109259 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:10.166049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab34f2f-2db9-46c5-bbbb-7f08a998a693 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:10.174273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab34f2f-2db9-46c5-bbbb-7f08a998a693 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:10.188749 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3823/7611] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:18:17.045503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c236f-c1fe-46f4-8c52-3f4c91419f7c service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:17.047569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6e9c236f-c1fe-46f4-8c52-3f4c91419f7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:17.249943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c236f-c1fe-46f4-8c52-3f4c91419f7c service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:17.265365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a49306-eec0-44f5-9249-c8d8c5d6d9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:17.265961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a49306-eec0-44f5-9249-c8d8c5d6d9a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:17.266244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a49306-eec0-44f5-9249-c8d8c5d6d9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:17.266516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a49306-eec0-44f5-9249-c8d8c5d6d9a0 admin admin] PATH_INFO: `/v3/users/17d727ad88bb4c638a22af27155e240b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:17.267710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a49306-eec0-44f5-9249-c8d8c5d6d9a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17d727ad88bb4c638a22af27155e240b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:17.269809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a49306-eec0-44f5-9249-c8d8c5d6d9a0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:17.378826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-73a49306-eec0-44f5-9249-c8d8c5d6d9a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17d727ad88bb4c638a22af27155e240b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:17.399438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-73a49306-eec0-44f5-9249-c8d8c5d6d9a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17d727ad88bb4c638a22af27155e240b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:17.400195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-73a49306-eec0-44f5-9249-c8d8c5d6d9a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17d727ad88bb4c638a22af27155e240b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:17.406287 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:17.427331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-73a49306-eec0-44f5-9249-c8d8c5d6d9a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17d727ad88bb4c638a22af27155e240b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:17.448782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-73a49306-eec0-44f5-9249-c8d8c5d6d9a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17d727ad88bb4c638a22af27155e240b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:17.457894 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3789/7612] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:18:17 2022] DELETE /identity/v3/users/17d727ad88bb4c638a22af27155e240b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:17.809725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab34f2f-2db9-46c5-bbbb-7f08a998a693 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:17.829946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab34f2f-2db9-46c5-bbbb-7f08a998a693 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:17.943497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e42c4-58f4-4430-9ac4-d260256dfb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:17.944463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e42c4-58f4-4430-9ac4-d260256dfb89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:17.944927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e42c4-58f4-4430-9ac4-d260256dfb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:17.945363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e42c4-58f4-4430-9ac4-d260256dfb89 admin admin] PATH_INFO: `/v3/projects/3ee88bf9d31f42db864b32c89b5381bb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:17.946752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e42c4-58f4-4430-9ac4-d260256dfb89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee88bf9d31f42db864b32c89b5381bb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:17.949369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e42c4-58f4-4430-9ac4-d260256dfb89 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:18.013642 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bb1e42c4-58f4-4430-9ac4-d260256dfb89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee88bf9d31f42db864b32c89b5381bb', 'request_id': 'req-bb1e42c4-58f4-4430-9ac4-d260256dfb89'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:18.029913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bb1e42c4-58f4-4430-9ac4-d260256dfb89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee88bf9d31f42db864b32c89b5381bb', 'request_id': 'req-bb1e42c4-58f4-4430-9ac4-d260256dfb89'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:18.041037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bb1e42c4-58f4-4430-9ac4-d260256dfb89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee88bf9d31f42db864b32c89b5381bb', 'request_id': 'req-bb1e42c4-58f4-4430-9ac4-d260256dfb89'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:18.069323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bb1e42c4-58f4-4430-9ac4-d260256dfb89 admin admin] The token cache is being invalidate because project 3ee88bf9d31f42db864b32c89b5381bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:18:18.069677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bb1e42c4-58f4-4430-9ac4-d260256dfb89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:18.071929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bb1e42c4-58f4-4430-9ac4-d260256dfb89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:18.075785 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3824/7613] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:18:17 2022] DELETE /identity/v3/projects/3ee88bf9d31f42db864b32c89b5381bb => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:18.079858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a49306-eec0-44f5-9249-c8d8c5d6d9a0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:18.082260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-73a49306-eec0-44f5-9249-c8d8c5d6d9a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:18.106488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a49306-eec0-44f5-9249-c8d8c5d6d9a0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:18.229872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327911b-1575-491a-a8ba-35145e646741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:18.230972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327911b-1575-491a-a8ba-35145e646741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:18.231419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327911b-1575-491a-a8ba-35145e646741 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:18.231855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327911b-1575-491a-a8ba-35145e646741 admin admin] PATH_INFO: `/v3/users/bc5baafc3ec34208bd29e8acf670f819` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:18.233863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327911b-1575-491a-a8ba-35145e646741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc5baafc3ec34208bd29e8acf670f819)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:18.253458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327911b-1575-491a-a8ba-35145e646741 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:18.364901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4327911b-1575-491a-a8ba-35145e646741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc5baafc3ec34208bd29e8acf670f819'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:18.378112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4327911b-1575-491a-a8ba-35145e646741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc5baafc3ec34208bd29e8acf670f819'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:18.378956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4327911b-1575-491a-a8ba-35145e646741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc5baafc3ec34208bd29e8acf670f819'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:18.433785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4327911b-1575-491a-a8ba-35145e646741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc5baafc3ec34208bd29e8acf670f819'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:18.444374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4327911b-1575-491a-a8ba-35145e646741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc5baafc3ec34208bd29e8acf670f819'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:18.468007 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3790/7614] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:18:18 2022] DELETE /identity/v3/users/bc5baafc3ec34208bd29e8acf670f819 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:19.008469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e42c4-58f4-4430-9ac4-d260256dfb89 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:19.011095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bb1e42c4-58f4-4430-9ac4-d260256dfb89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:19.033256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e42c4-58f4-4430-9ac4-d260256dfb89 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:19.210359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa44db5-560a-4d51-96e1-71e15d678441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:19.211003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa44db5-560a-4d51-96e1-71e15d678441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:19.211468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa44db5-560a-4d51-96e1-71e15d678441 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:19.211917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa44db5-560a-4d51-96e1-71e15d678441 admin admin] PATH_INFO: `/v3/projects/d3dd119dad364f6c86ca15562e9a6112` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:19.213658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa44db5-560a-4d51-96e1-71e15d678441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3dd119dad364f6c86ca15562e9a6112)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:19.217824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa44db5-560a-4d51-96e1-71e15d678441 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:19.243013 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:19.330232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-aaa44db5-560a-4d51-96e1-71e15d678441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3dd119dad364f6c86ca15562e9a6112', 'request_id': 'req-aaa44db5-560a-4d51-96e1-71e15d678441'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:19.352883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-aaa44db5-560a-4d51-96e1-71e15d678441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3dd119dad364f6c86ca15562e9a6112', 'request_id': 'req-aaa44db5-560a-4d51-96e1-71e15d678441'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:19.361001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-aaa44db5-560a-4d51-96e1-71e15d678441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3dd119dad364f6c86ca15562e9a6112', 'request_id': 'req-aaa44db5-560a-4d51-96e1-71e15d678441'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:19.389397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-aaa44db5-560a-4d51-96e1-71e15d678441 admin admin] The token cache is being invalidate because project d3dd119dad364f6c86ca15562e9a6112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:18:19.389736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-aaa44db5-560a-4d51-96e1-71e15d678441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:19.390392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-aaa44db5-560a-4d51-96e1-71e15d678441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:19.404635 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3825/7615] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:18:19 2022] DELETE /identity/v3/projects/d3dd119dad364f6c86ca15562e9a6112 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:22.469193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327911b-1575-491a-a8ba-35145e646741 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:22.470942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4327911b-1575-491a-a8ba-35145e646741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:22.499442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327911b-1575-491a-a8ba-35145e646741 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:22.622696 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:22.634411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc509d-ffba-4dd2-b4bd-2fab9c2564eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:22.635097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc509d-ffba-4dd2-b4bd-2fab9c2564eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:22.635415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc509d-ffba-4dd2-b4bd-2fab9c2564eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:22.635694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc509d-ffba-4dd2-b4bd-2fab9c2564eb admin admin] PATH_INFO: `/v3/users/ade7d5490be84235afe9c87687ad9846` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:22.637110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc509d-ffba-4dd2-b4bd-2fab9c2564eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ade7d5490be84235afe9c87687ad9846)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:22.639401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc509d-ffba-4dd2-b4bd-2fab9c2564eb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:22.762849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05cc509d-ffba-4dd2-b4bd-2fab9c2564eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ade7d5490be84235afe9c87687ad9846'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:22.774968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05cc509d-ffba-4dd2-b4bd-2fab9c2564eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ade7d5490be84235afe9c87687ad9846'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:22.774968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05cc509d-ffba-4dd2-b4bd-2fab9c2564eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ade7d5490be84235afe9c87687ad9846'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:22.814109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05cc509d-ffba-4dd2-b4bd-2fab9c2564eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ade7d5490be84235afe9c87687ad9846'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:22.853731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05cc509d-ffba-4dd2-b4bd-2fab9c2564eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ade7d5490be84235afe9c87687ad9846'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:22.873677 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3791/7616] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:18:22 2022] DELETE /identity/v3/users/ade7d5490be84235afe9c87687ad9846 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:22.877975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71684649-f34f-4d8f-9633-988c35a55d06 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:22.878411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71684649-f34f-4d8f-9633-988c35a55d06 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:22.878530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71684649-f34f-4d8f-9633-988c35a55d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:22.925367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-71684649-f34f-4d8f-9633-988c35a55d06 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:22.928643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-71684649-f34f-4d8f-9633-988c35a55d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:23.131685 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3826/7617] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:23.139464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc509d-ffba-4dd2-b4bd-2fab9c2564eb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:23.141517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-05cc509d-ffba-4dd2-b4bd-2fab9c2564eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:23.398207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc509d-ffba-4dd2-b4bd-2fab9c2564eb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:23.434459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa7530-38af-4873-9c4c-18b8135003a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:23.435962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa7530-38af-4873-9c4c-18b8135003a6 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:23.436249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa7530-38af-4873-9c4c-18b8135003a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:23.436535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa7530-38af-4873-9c4c-18b8135003a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:23.466791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa7530-38af-4873-9c4c-18b8135003a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:23.473971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa7530-38af-4873-9c4c-18b8135003a6 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:23.523455 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3792/7618] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:18:24.138107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71684649-f34f-4d8f-9633-988c35a55d06 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:24.139645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-71684649-f34f-4d8f-9633-988c35a55d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:24.163370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71684649-f34f-4d8f-9633-988c35a55d06 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:24.169512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce2462-0e09-4d90-9a2a-55549def8a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:24.173576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce2462-0e09-4d90-9a2a-55549def8a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:24.174692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce2462-0e09-4d90-9a2a-55549def8a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:24.175160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce2462-0e09-4d90-9a2a-55549def8a1f admin admin] PATH_INFO: `/v3/projects/af899d93b865487992614e331fd37d45` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:24.178723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce2462-0e09-4d90-9a2a-55549def8a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=af899d93b865487992614e331fd37d45)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:24.181415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce2462-0e09-4d90-9a2a-55549def8a1f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:24.264480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-31ce2462-0e09-4d90-9a2a-55549def8a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af899d93b865487992614e331fd37d45', 'request_id': 'req-31ce2462-0e09-4d90-9a2a-55549def8a1f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:24.291825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-31ce2462-0e09-4d90-9a2a-55549def8a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af899d93b865487992614e331fd37d45', 'request_id': 'req-31ce2462-0e09-4d90-9a2a-55549def8a1f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:24.306254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-31ce2462-0e09-4d90-9a2a-55549def8a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af899d93b865487992614e331fd37d45', 'request_id': 'req-31ce2462-0e09-4d90-9a2a-55549def8a1f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:24.340340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-31ce2462-0e09-4d90-9a2a-55549def8a1f admin admin] The token cache is being invalidate because project af899d93b865487992614e331fd37d45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:18:24.340686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-31ce2462-0e09-4d90-9a2a-55549def8a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:24.341638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-31ce2462-0e09-4d90-9a2a-55549def8a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:24.344649 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3827/7619] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:18:24 2022] DELETE /identity/v3/projects/af899d93b865487992614e331fd37d45 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:24.348177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66271d96-d488-4129-8dc1-4f33f3c24324 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:24.348817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66271d96-d488-4129-8dc1-4f33f3c24324 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:24.349128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66271d96-d488-4129-8dc1-4f33f3c24324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:24.374937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-66271d96-d488-4129-8dc1-4f33f3c24324 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:24.376383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-66271d96-d488-4129-8dc1-4f33f3c24324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:24.487019 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3793/7620] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:24.497194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006d3a9-8c36-4af4-9229-481267aa3cef None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:24.497639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006d3a9-8c36-4af4-9229-481267aa3cef None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:24.498036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006d3a9-8c36-4af4-9229-481267aa3cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:24.530222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7006d3a9-8c36-4af4-9229-481267aa3cef None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:24.531771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7006d3a9-8c36-4af4-9229-481267aa3cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:24.556100 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3828/7621] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:24.561130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66271d96-d488-4129-8dc1-4f33f3c24324 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:24.575846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66271d96-d488-4129-8dc1-4f33f3c24324 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:24.583366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf3af1-3196-443f-bf0b-ce9cf7309502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:24.584010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf3af1-3196-443f-bf0b-ce9cf7309502 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:24.584289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf3af1-3196-443f-bf0b-ce9cf7309502 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:24.585498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf3af1-3196-443f-bf0b-ce9cf7309502 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:24.586209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf3af1-3196-443f-bf0b-ce9cf7309502 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:18:24.586517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf3af1-3196-443f-bf0b-ce9cf7309502 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:24.588176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf3af1-3196-443f-bf0b-ce9cf7309502 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:24.610744 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3794/7622] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:18:24.611887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006d3a9-8c36-4af4-9229-481267aa3cef None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:24.627859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006d3a9-8c36-4af4-9229-481267aa3cef None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:24.634455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cd391-ea42-483f-b387-94a0b6aed59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:24.635254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cd391-ea42-483f-b387-94a0b6aed59e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:24.635601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cd391-ea42-483f-b387-94a0b6aed59e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:24.635957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cd391-ea42-483f-b387-94a0b6aed59e admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:24.636706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05cd391-ea42-483f-b387-94a0b6aed59e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:24.639184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05cd391-ea42-483f-b387-94a0b6aed59e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:24.658373 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:24.681261 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3829/7623] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:18:24 2022] POST /identity/v3/projects => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:24.685256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf3af1-3196-443f-bf0b-ce9cf7309502 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:24.695097 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:24.705663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf3af1-3196-443f-bf0b-ce9cf7309502 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:24.838367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea607b3-a90c-4d5d-b851-b610c8434bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:24.839724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea607b3-a90c-4d5d-b851-b610c8434bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:24.840128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea607b3-a90c-4d5d-b851-b610c8434bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:24.840652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea607b3-a90c-4d5d-b851-b610c8434bd1 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:24.841445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea607b3-a90c-4d5d-b851-b610c8434bd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:24.843852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea607b3-a90c-4d5d-b851-b610c8434bd1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:24.891639 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3795/7624] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:18:24 2022] POST /identity/v3/users => generated 291 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:18:24.895987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cd391-ea42-483f-b387-94a0b6aed59e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:24.937725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cd391-ea42-483f-b387-94a0b6aed59e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:24.953151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eea571-3c1c-4545-9233-9715604c46b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:24.953852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eea571-3c1c-4545-9233-9715604c46b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:24.954236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eea571-3c1c-4545-9233-9715604c46b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:24.954586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eea571-3c1c-4545-9233-9715604c46b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:24.955360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eea571-3c1c-4545-9233-9715604c46b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:24.958002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eea571-3c1c-4545-9233-9715604c46b2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:25.028113 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3830/7625] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:25.029577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea607b3-a90c-4d5d-b851-b610c8434bd1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:25.044964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea607b3-a90c-4d5d-b851-b610c8434bd1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:25.058759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221b2b9-b98d-48fe-936e-e18d461ee136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:25.059989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221b2b9-b98d-48fe-936e-e18d461ee136 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:25.060323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221b2b9-b98d-48fe-936e-e18d461ee136 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:25.060617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221b2b9-b98d-48fe-936e-e18d461ee136 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:25.061274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221b2b9-b98d-48fe-936e-e18d461ee136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:25.062862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221b2b9-b98d-48fe-936e-e18d461ee136 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:25.090763 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3796/7626] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:25.092160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eea571-3c1c-4545-9233-9715604c46b2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:25.116046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eea571-3c1c-4545-9233-9715604c46b2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:25.129421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee5103-8797-4473-8f10-03f3500f3246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:25.131009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee5103-8797-4473-8f10-03f3500f3246 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:25.131298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee5103-8797-4473-8f10-03f3500f3246 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:25.131571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee5103-8797-4473-8f10-03f3500f3246 admin admin] PATH_INFO: `/v3/projects/8ca361321771457fa38b7bb38919e8af/users/0d414815df5c4591954749e36c719d43/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:25.182111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee5103-8797-4473-8f10-03f3500f3246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca361321771457fa38b7bb38919e8af, user_id=0d414815df5c4591954749e36c719d43, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:25.184873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee5103-8797-4473-8f10-03f3500f3246 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:25.204754 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3831/7627] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:18:25 2022] PUT /identity/v3/projects/8ca361321771457fa38b7bb38919e8af/users/0d414815df5c4591954749e36c719d43/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:25.215628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b7b5c-fbd8-45f7-b20a-54f420f84db3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:25.215966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b7b5c-fbd8-45f7-b20a-54f420f84db3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:25.216246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b7b5c-fbd8-45f7-b20a-54f420f84db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:25.251985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-117b7b5c-fbd8-45f7-b20a-54f420f84db3 None None] MFA Rules not processed for user `0d414815df5c4591954749e36c719d43`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:25.257608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-117b7b5c-fbd8-45f7-b20a-54f420f84db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:25.349423 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3797/7628] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:25.360915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee5103-8797-4473-8f10-03f3500f3246 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:25.362875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2bee5103-8797-4473-8f10-03f3500f3246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:25.464573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee5103-8797-4473-8f10-03f3500f3246 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:25.485403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48ddbc-b3e9-4bf8-83f7-8fbb4ca1fa2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:25.486047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48ddbc-b3e9-4bf8-83f7-8fbb4ca1fa2a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:25.486331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48ddbc-b3e9-4bf8-83f7-8fbb4ca1fa2a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:25.486610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48ddbc-b3e9-4bf8-83f7-8fbb4ca1fa2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:25.510846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48ddbc-b3e9-4bf8-83f7-8fbb4ca1fa2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:25.512297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48ddbc-b3e9-4bf8-83f7-8fbb4ca1fa2a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:25.543601 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3832/7629] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:18:32.674549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b7b5c-fbd8-45f7-b20a-54f420f84db3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:32.690630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b7b5c-fbd8-45f7-b20a-54f420f84db3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:32.699761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a962739-d89e-41b8-b486-4fc023c1e503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:32.700387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a962739-d89e-41b8-b486-4fc023c1e503 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:32.700687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a962739-d89e-41b8-b486-4fc023c1e503 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:32.700960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a962739-d89e-41b8-b486-4fc023c1e503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:32.722223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3a962739-d89e-41b8-b486-4fc023c1e503 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:32.962106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a962739-d89e-41b8-b486-4fc023c1e503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:32.965914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a962739-d89e-41b8-b486-4fc023c1e503 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:32.995651 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3798/7630] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:18:35.522425 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:38.874879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48ddbc-b3e9-4bf8-83f7-8fbb4ca1fa2a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:38.878004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fd48ddbc-b3e9-4bf8-83f7-8fbb4ca1fa2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:38.949878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48ddbc-b3e9-4bf8-83f7-8fbb4ca1fa2a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:38.967651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b45bedc-2938-412d-ae00-c6785555abd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:38.968616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45bedc-2938-412d-ae00-c6785555abd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:38.970464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45bedc-2938-412d-ae00-c6785555abd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:38.973276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45bedc-2938-412d-ae00-c6785555abd7 admin admin] PATH_INFO: `/v3/users/c0f97633b6e94bbea9169cb3a2717624` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:38.974927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45bedc-2938-412d-ae00-c6785555abd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f97633b6e94bbea9169cb3a2717624)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:38.981751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45bedc-2938-412d-ae00-c6785555abd7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:39.110341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7b45bedc-2938-412d-ae00-c6785555abd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f97633b6e94bbea9169cb3a2717624'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:39.112537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7b45bedc-2938-412d-ae00-c6785555abd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f97633b6e94bbea9169cb3a2717624'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:39.135543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7b45bedc-2938-412d-ae00-c6785555abd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f97633b6e94bbea9169cb3a2717624'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:39.151994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7b45bedc-2938-412d-ae00-c6785555abd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f97633b6e94bbea9169cb3a2717624'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:39.180816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7b45bedc-2938-412d-ae00-c6785555abd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f97633b6e94bbea9169cb3a2717624'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:39.196693 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3833/7631] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:18:38 2022] DELETE /identity/v3/users/c0f97633b6e94bbea9169cb3a2717624 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:39.476211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a962739-d89e-41b8-b486-4fc023c1e503 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:39.484341 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:39.495478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a962739-d89e-41b8-b486-4fc023c1e503 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:39.678709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16f94f-6f9c-4fb4-88ac-aa67af243a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:39.679696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16f94f-6f9c-4fb4-88ac-aa67af243a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:39.682650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16f94f-6f9c-4fb4-88ac-aa67af243a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:39.683050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16f94f-6f9c-4fb4-88ac-aa67af243a00 admin admin] PATH_INFO: `/v3/projects/422723b5ef7b4e5b94d39e72cf32ccf9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:39.685404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16f94f-6f9c-4fb4-88ac-aa67af243a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=422723b5ef7b4e5b94d39e72cf32ccf9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:39.690051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16f94f-6f9c-4fb4-88ac-aa67af243a00 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:39.786096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8c16f94f-6f9c-4fb4-88ac-aa67af243a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '422723b5ef7b4e5b94d39e72cf32ccf9', 'request_id': 'req-8c16f94f-6f9c-4fb4-88ac-aa67af243a00'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:39.803007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8c16f94f-6f9c-4fb4-88ac-aa67af243a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '422723b5ef7b4e5b94d39e72cf32ccf9', 'request_id': 'req-8c16f94f-6f9c-4fb4-88ac-aa67af243a00'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:39.821928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8c16f94f-6f9c-4fb4-88ac-aa67af243a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '422723b5ef7b4e5b94d39e72cf32ccf9', 'request_id': 'req-8c16f94f-6f9c-4fb4-88ac-aa67af243a00'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:39.839819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8c16f94f-6f9c-4fb4-88ac-aa67af243a00 admin admin] The token cache is being invalidate because project 422723b5ef7b4e5b94d39e72cf32ccf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:18:39.840171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8c16f94f-6f9c-4fb4-88ac-aa67af243a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:39.840822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8c16f94f-6f9c-4fb4-88ac-aa67af243a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:39.850076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7c032-d9ea-474b-955c-69b1c044b24e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:39.850406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7c032-d9ea-474b-955c-69b1c044b24e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:39.850633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7c032-d9ea-474b-955c-69b1c044b24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:39.858793 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3799/7632] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:18:39 2022] DELETE /identity/v3/projects/422723b5ef7b4e5b94d39e72cf32ccf9 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:39.874582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7cb7c032-d9ea-474b-955c-69b1c044b24e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:39.875824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7cb7c032-d9ea-474b-955c-69b1c044b24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:40.031426 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3834/7633] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:40.042025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02fbda-2cbc-403f-8aeb-d3c31a7b6800 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:40.042331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02fbda-2cbc-403f-8aeb-d3c31a7b6800 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:40.042598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02fbda-2cbc-403f-8aeb-d3c31a7b6800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:40.068263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ea02fbda-2cbc-403f-8aeb-d3c31a7b6800 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:40.069512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ea02fbda-2cbc-403f-8aeb-d3c31a7b6800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:40.093883 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3800/7634] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:40.098638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7c032-d9ea-474b-955c-69b1c044b24e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:40.133653 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7c032-d9ea-474b-955c-69b1c044b24e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:40.142583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68728b3e-77a5-4b19-9720-252c38a130c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:40.143303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68728b3e-77a5-4b19-9720-252c38a130c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:40.143648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68728b3e-77a5-4b19-9720-252c38a130c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:40.144539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68728b3e-77a5-4b19-9720-252c38a130c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:40.145298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68728b3e-77a5-4b19-9720-252c38a130c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:18:40.145824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68728b3e-77a5-4b19-9720-252c38a130c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:40.147368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68728b3e-77a5-4b19-9720-252c38a130c3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:40.174603 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3835/7635] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:18:40.179695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02fbda-2cbc-403f-8aeb-d3c31a7b6800 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:40.190704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02fbda-2cbc-403f-8aeb-d3c31a7b6800 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:40.197411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaad2d5-eb58-4064-a6ad-545bba2971e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:40.198198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaad2d5-eb58-4064-a6ad-545bba2971e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:40.198618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaad2d5-eb58-4064-a6ad-545bba2971e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:40.198983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaad2d5-eb58-4064-a6ad-545bba2971e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:40.202190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaad2d5-eb58-4064-a6ad-545bba2971e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:40.204337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaad2d5-eb58-4064-a6ad-545bba2971e2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:40.270683 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3801/7636] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:18:40 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:40.273448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68728b3e-77a5-4b19-9720-252c38a130c3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:40.289303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68728b3e-77a5-4b19-9720-252c38a130c3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:40.405290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e638ab1-8ce3-42ca-8834-4a3abb79054c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:40.406071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e638ab1-8ce3-42ca-8834-4a3abb79054c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:40.406453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e638ab1-8ce3-42ca-8834-4a3abb79054c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:40.407057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e638ab1-8ce3-42ca-8834-4a3abb79054c admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:40.407799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e638ab1-8ce3-42ca-8834-4a3abb79054c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:40.410871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e638ab1-8ce3-42ca-8834-4a3abb79054c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:40.420697 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:40.452386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaad2d5-eb58-4064-a6ad-545bba2971e2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:40.465040 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3836/7637] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:18:40 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:40.467884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaad2d5-eb58-4064-a6ad-545bba2971e2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:40.475231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686e7be-5e18-404a-b303-6597990920fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:40.476302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686e7be-5e18-404a-b303-6597990920fd admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:40.477350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686e7be-5e18-404a-b303-6597990920fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:40.477827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686e7be-5e18-404a-b303-6597990920fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:40.478721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686e7be-5e18-404a-b303-6597990920fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:40.480576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686e7be-5e18-404a-b303-6597990920fd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:40.498950 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3802/7638] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:18:40.500446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e638ab1-8ce3-42ca-8834-4a3abb79054c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:40.522155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e638ab1-8ce3-42ca-8834-4a3abb79054c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:40.528052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11cef6-881b-4c4d-aae5-56fac3d244b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:40.528897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11cef6-881b-4c4d-aae5-56fac3d244b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:40.529299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11cef6-881b-4c4d-aae5-56fac3d244b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:40.529674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11cef6-881b-4c4d-aae5-56fac3d244b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:40.530432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11cef6-881b-4c4d-aae5-56fac3d244b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:40.532299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11cef6-881b-4c4d-aae5-56fac3d244b2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:40.563200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686e7be-5e18-404a-b303-6597990920fd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:40.577673 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3837/7639] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:40.579997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686e7be-5e18-404a-b303-6597990920fd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:40.586967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c7113-11a1-463c-a4e5-bce2ccee445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:40.587653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c7113-11a1-463c-a4e5-bce2ccee445d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:40.587935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c7113-11a1-463c-a4e5-bce2ccee445d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:40.588211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c7113-11a1-463c-a4e5-bce2ccee445d admin admin] PATH_INFO: `/v3/projects/c4d31ba5a00842c68ea2fe3ecefd1b4a/users/ff7af6b84f294f4589a604bcbcfa8b6c/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:40.620214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c7113-11a1-463c-a4e5-bce2ccee445d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4d31ba5a00842c68ea2fe3ecefd1b4a, user_id=ff7af6b84f294f4589a604bcbcfa8b6c, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:40.622916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c7113-11a1-463c-a4e5-bce2ccee445d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:40.665903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60206d-dba9-4668-9a44-14653d95c041 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:40.666224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60206d-dba9-4668-9a44-14653d95c041 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:40.666481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60206d-dba9-4668-9a44-14653d95c041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:40.669767 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3803/7640] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:18:40 2022] PUT /identity/v3/projects/c4d31ba5a00842c68ea2fe3ecefd1b4a/users/ff7af6b84f294f4589a604bcbcfa8b6c/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:40.736038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-af60206d-dba9-4668-9a44-14653d95c041 None None] MFA Rules not processed for user `ff7af6b84f294f4589a604bcbcfa8b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:40.750361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-af60206d-dba9-4668-9a44-14653d95c041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:41.012723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c7113-11a1-463c-a4e5-bce2ccee445d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:41.014847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-631c7113-11a1-463c-a4e5-bce2ccee445d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:41.029608 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3838/7641] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:41.114547 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:41.214800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c7113-11a1-463c-a4e5-bce2ccee445d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:41.235677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc904ed9-576c-4b8c-97ff-b7a1a25ee3a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:41.236366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc904ed9-576c-4b8c-97ff-b7a1a25ee3a2 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:41.236672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc904ed9-576c-4b8c-97ff-b7a1a25ee3a2 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:41.236954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc904ed9-576c-4b8c-97ff-b7a1a25ee3a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:41.256730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc904ed9-576c-4b8c-97ff-b7a1a25ee3a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:41.258609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc904ed9-576c-4b8c-97ff-b7a1a25ee3a2 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:41.278685 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3804/7642] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:18:41.672102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60206d-dba9-4668-9a44-14653d95c041 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:41.837980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60206d-dba9-4668-9a44-14653d95c041 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:41.866924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab6c40-5be4-4102-8631-ae0e774fdd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:41.868497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab6c40-5be4-4102-8631-ae0e774fdd18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:41.869452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab6c40-5be4-4102-8631-ae0e774fdd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:41.869969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab6c40-5be4-4102-8631-ae0e774fdd18 admin admin] PATH_INFO: `/v3/users/ff7af6b84f294f4589a604bcbcfa8b6c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:41.872091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab6c40-5be4-4102-8631-ae0e774fdd18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff7af6b84f294f4589a604bcbcfa8b6c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:41.874807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab6c40-5be4-4102-8631-ae0e774fdd18 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:42.020509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7bab6c40-5be4-4102-8631-ae0e774fdd18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff7af6b84f294f4589a604bcbcfa8b6c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:42.021459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7bab6c40-5be4-4102-8631-ae0e774fdd18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff7af6b84f294f4589a604bcbcfa8b6c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:42.040987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7bab6c40-5be4-4102-8631-ae0e774fdd18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff7af6b84f294f4589a604bcbcfa8b6c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:42.068207 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:42.070096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7bab6c40-5be4-4102-8631-ae0e774fdd18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff7af6b84f294f4589a604bcbcfa8b6c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:42.084106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7bab6c40-5be4-4102-8631-ae0e774fdd18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff7af6b84f294f4589a604bcbcfa8b6c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:42.094452 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3839/7643] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:18:41 2022] DELETE /identity/v3/users/ff7af6b84f294f4589a604bcbcfa8b6c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:42.099276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee49f3-6b6b-40dd-ba5b-0d34a51823a2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:42.099768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee49f3-6b6b-40dd-ba5b-0d34a51823a2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:42.099894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee49f3-6b6b-40dd-ba5b-0d34a51823a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:42.127601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-daee49f3-6b6b-40dd-ba5b-0d34a51823a2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:42.127686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-daee49f3-6b6b-40dd-ba5b-0d34a51823a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:42.258331 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3805/7644] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:42.264844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab6c40-5be4-4102-8631-ae0e774fdd18 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:42.266728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7bab6c40-5be4-4102-8631-ae0e774fdd18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:42.346209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab6c40-5be4-4102-8631-ae0e774fdd18 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:42.351187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d27ef-1278-4d23-919a-1708e62d88cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:42.352077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d27ef-1278-4d23-919a-1708e62d88cd service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:42.352360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d27ef-1278-4d23-919a-1708e62d88cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:42.352652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d27ef-1278-4d23-919a-1708e62d88cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:42.370255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d27ef-1278-4d23-919a-1708e62d88cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:42.372210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d27ef-1278-4d23-919a-1708e62d88cd service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:42.400723 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3840/7645] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:18:43.019964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee49f3-6b6b-40dd-ba5b-0d34a51823a2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:43.022039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-daee49f3-6b6b-40dd-ba5b-0d34a51823a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:43.038678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee49f3-6b6b-40dd-ba5b-0d34a51823a2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:43.078145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d27ef-1278-4d23-919a-1708e62d88cd service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:43.082095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a81d27ef-1278-4d23-919a-1708e62d88cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:43.095833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2eb12-fbe4-4e1f-b5eb-a3924b65cd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:43.098105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2eb12-fbe4-4e1f-b5eb-a3924b65cd07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:43.098398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2eb12-fbe4-4e1f-b5eb-a3924b65cd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:43.100532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2eb12-fbe4-4e1f-b5eb-a3924b65cd07 admin admin] PATH_INFO: `/v3/users/2a226b4184204e01bdd8318acb1fd014` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:43.107718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2eb12-fbe4-4e1f-b5eb-a3924b65cd07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a226b4184204e01bdd8318acb1fd014)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:43.126302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2eb12-fbe4-4e1f-b5eb-a3924b65cd07 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:43.147251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d27ef-1278-4d23-919a-1708e62d88cd service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:43.182818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd436e12-14ec-49c5-bb06-8778b1eaa29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:43.185938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd436e12-14ec-49c5-bb06-8778b1eaa29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:43.185938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd436e12-14ec-49c5-bb06-8778b1eaa29c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:43.185938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd436e12-14ec-49c5-bb06-8778b1eaa29c admin admin] PATH_INFO: `/v3/projects/c4d31ba5a00842c68ea2fe3ecefd1b4a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:43.189396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd436e12-14ec-49c5-bb06-8778b1eaa29c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4d31ba5a00842c68ea2fe3ecefd1b4a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:43.193287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd436e12-14ec-49c5-bb06-8778b1eaa29c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:43.258448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f6e2eb12-fbe4-4e1f-b5eb-a3924b65cd07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a226b4184204e01bdd8318acb1fd014'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:43.271767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f6e2eb12-fbe4-4e1f-b5eb-a3924b65cd07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a226b4184204e01bdd8318acb1fd014'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:43.274673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f6e2eb12-fbe4-4e1f-b5eb-a3924b65cd07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a226b4184204e01bdd8318acb1fd014'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:43.303647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f6e2eb12-fbe4-4e1f-b5eb-a3924b65cd07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a226b4184204e01bdd8318acb1fd014'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:43.316733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f6e2eb12-fbe4-4e1f-b5eb-a3924b65cd07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a226b4184204e01bdd8318acb1fd014'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:43.323614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dd436e12-14ec-49c5-bb06-8778b1eaa29c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4d31ba5a00842c68ea2fe3ecefd1b4a', 'request_id': 'req-dd436e12-14ec-49c5-bb06-8778b1eaa29c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:43.328032 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3806/7646] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:18:43 2022] DELETE /identity/v3/users/2a226b4184204e01bdd8318acb1fd014 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:43.333125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c37b91-37d6-43bf-878f-648627262f9b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:43.333949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c37b91-37d6-43bf-878f-648627262f9b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:43.334230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c37b91-37d6-43bf-878f-648627262f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:43.343760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dd436e12-14ec-49c5-bb06-8778b1eaa29c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4d31ba5a00842c68ea2fe3ecefd1b4a', 'request_id': 'req-dd436e12-14ec-49c5-bb06-8778b1eaa29c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:43.352705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dd436e12-14ec-49c5-bb06-8778b1eaa29c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4d31ba5a00842c68ea2fe3ecefd1b4a', 'request_id': 'req-dd436e12-14ec-49c5-bb06-8778b1eaa29c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:43.374145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-98c37b91-37d6-43bf-878f-648627262f9b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:43.378537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-98c37b91-37d6-43bf-878f-648627262f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:43.391990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dd436e12-14ec-49c5-bb06-8778b1eaa29c admin admin] The token cache is being invalidate because project c4d31ba5a00842c68ea2fe3ecefd1b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:18:43.392895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dd436e12-14ec-49c5-bb06-8778b1eaa29c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:43.394330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dd436e12-14ec-49c5-bb06-8778b1eaa29c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:43.397652 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3841/7647] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:18:43 2022] DELETE /identity/v3/projects/c4d31ba5a00842c68ea2fe3ecefd1b4a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:43.405104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86e6b1-36ab-470f-b3dd-dd9089cd4989 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:43.405329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86e6b1-36ab-470f-b3dd-dd9089cd4989 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:43.406740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86e6b1-36ab-470f-b3dd-dd9089cd4989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:43.435240 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:43.459029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ab86e6b1-36ab-470f-b3dd-dd9089cd4989 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:43.460269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ab86e6b1-36ab-470f-b3dd-dd9089cd4989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:43.553184 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3807/7648] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:43.565671 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3842/7649] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:18:43.572047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c37b91-37d6-43bf-878f-648627262f9b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:43.574406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-98c37b91-37d6-43bf-878f-648627262f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:43.575719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a599d4-5552-4c2a-8ec2-da7c12fc02d8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:43.576060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a599d4-5552-4c2a-8ec2-da7c12fc02d8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:43.576587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a599d4-5552-4c2a-8ec2-da7c12fc02d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:43.633847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-87a599d4-5552-4c2a-8ec2-da7c12fc02d8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:43.635099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-87a599d4-5552-4c2a-8ec2-da7c12fc02d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:43.663286 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3843/7650] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:43.664297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a599d4-5552-4c2a-8ec2-da7c12fc02d8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:43.675908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a599d4-5552-4c2a-8ec2-da7c12fc02d8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:43.693126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7a4de-a688-4379-8a89-cc65136c1564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:43.693759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7a4de-a688-4379-8a89-cc65136c1564 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:43.694038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7a4de-a688-4379-8a89-cc65136c1564 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:43.694310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7a4de-a688-4379-8a89-cc65136c1564 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:43.694974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7a4de-a688-4379-8a89-cc65136c1564 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:18:43.695277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7a4de-a688-4379-8a89-cc65136c1564 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:43.696940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7a4de-a688-4379-8a89-cc65136c1564 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:43.702276 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:43.732803 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3844/7651] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:18:43.735379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c37b91-37d6-43bf-878f-648627262f9b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:43.737165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7a4de-a688-4379-8a89-cc65136c1564 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:43.756464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece715fc-e351-4cbd-8c7a-a279a0133cd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:43.757131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece715fc-e351-4cbd-8c7a-a279a0133cd0 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:43.757412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece715fc-e351-4cbd-8c7a-a279a0133cd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:43.757683 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece715fc-e351-4cbd-8c7a-a279a0133cd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:43.765928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7a4de-a688-4379-8a89-cc65136c1564 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:43.775998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece715fc-e351-4cbd-8c7a-a279a0133cd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:43.777841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece715fc-e351-4cbd-8c7a-a279a0133cd0 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:43.782894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0de4e-c1af-4c50-9f8a-6b5ac7466099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:43.783607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0de4e-c1af-4c50-9f8a-6b5ac7466099 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:43.784005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0de4e-c1af-4c50-9f8a-6b5ac7466099 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:43.784949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0de4e-c1af-4c50-9f8a-6b5ac7466099 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:43.785893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0de4e-c1af-4c50-9f8a-6b5ac7466099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:43.787854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0de4e-c1af-4c50-9f8a-6b5ac7466099 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:43.814119 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3808/7652] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:18:43.830935 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3845/7653] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:18:43 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:43.832967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece715fc-e351-4cbd-8c7a-a279a0133cd0 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:43.844810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece715fc-e351-4cbd-8c7a-a279a0133cd0 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:43.994363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e7afe-010c-4c4d-95af-5416f8aadd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:43.995012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e7afe-010c-4c4d-95af-5416f8aadd2f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:43.995300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e7afe-010c-4c4d-95af-5416f8aadd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:43.995567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e7afe-010c-4c4d-95af-5416f8aadd2f admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:43.996211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e7afe-010c-4c4d-95af-5416f8aadd2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:43.998169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e7afe-010c-4c4d-95af-5416f8aadd2f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:44.048475 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3809/7654] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:18:43 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:44.053447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0de4e-c1af-4c50-9f8a-6b5ac7466099 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:44.070173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0de4e-c1af-4c50-9f8a-6b5ac7466099 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:44.079133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677480a6-ff72-4aba-af6d-70fe45f03568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:44.080171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677480a6-ff72-4aba-af6d-70fe45f03568 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:44.080292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677480a6-ff72-4aba-af6d-70fe45f03568 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:44.080670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677480a6-ff72-4aba-af6d-70fe45f03568 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:44.081534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677480a6-ff72-4aba-af6d-70fe45f03568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:44.083690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677480a6-ff72-4aba-af6d-70fe45f03568 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:44.096895 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3846/7655] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:18:44.101059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e7afe-010c-4c4d-95af-5416f8aadd2f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:44.117965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e7afe-010c-4c4d-95af-5416f8aadd2f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:44.126104 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd93548-e374-4d3b-856f-599e66747cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:44.127034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd93548-e374-4d3b-856f-599e66747cfe admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:44.127395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd93548-e374-4d3b-856f-599e66747cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:44.127752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd93548-e374-4d3b-856f-599e66747cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:44.129321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd93548-e374-4d3b-856f-599e66747cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:44.131937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd93548-e374-4d3b-856f-599e66747cfe admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:44.157392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677480a6-ff72-4aba-af6d-70fe45f03568 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:44.157656 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3810/7656] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:44.173859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677480a6-ff72-4aba-af6d-70fe45f03568 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:44.181163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f7c29-fa08-44fc-a424-21978e5776c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:44.182706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f7c29-fa08-44fc-a424-21978e5776c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:44.183170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f7c29-fa08-44fc-a424-21978e5776c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:44.183782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f7c29-fa08-44fc-a424-21978e5776c3 admin admin] PATH_INFO: `/v3/projects/0a2731eee31f4fc292d9523dcbad8e9d/users/4f9b6062104c445c8cdf87d03975bfcc/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:44.218387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f7c29-fa08-44fc-a424-21978e5776c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a2731eee31f4fc292d9523dcbad8e9d, user_id=4f9b6062104c445c8cdf87d03975bfcc, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:44.227186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f7c29-fa08-44fc-a424-21978e5776c3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:44.273319 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3847/7657] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:18:44 2022] PUT /identity/v3/projects/0a2731eee31f4fc292d9523dcbad8e9d/users/4f9b6062104c445c8cdf87d03975bfcc/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:44.276047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020808b-a3fe-4b3e-a957-a944fa4fa85a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:44.276899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020808b-a3fe-4b3e-a957-a944fa4fa85a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:44.277332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020808b-a3fe-4b3e-a957-a944fa4fa85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:44.313634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f020808b-a3fe-4b3e-a957-a944fa4fa85a None None] MFA Rules not processed for user `4f9b6062104c445c8cdf87d03975bfcc`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:44.315025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f020808b-a3fe-4b3e-a957-a944fa4fa85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:44.373064 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:44.432548 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3811/7658] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:44.436882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f7c29-fa08-44fc-a424-21978e5776c3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:44.466173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020808b-a3fe-4b3e-a957-a944fa4fa85a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:44.467764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f020808b-a3fe-4b3e-a957-a944fa4fa85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:44.561667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f7c29-fa08-44fc-a424-21978e5776c3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:44.570711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e893c-6f9b-4ead-ba1c-c0706f310b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:44.571617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e893c-6f9b-4ead-ba1c-c0706f310b11 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:44.571897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e893c-6f9b-4ead-ba1c-c0706f310b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:44.572172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e893c-6f9b-4ead-ba1c-c0706f310b11 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:44.572867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e893c-6f9b-4ead-ba1c-c0706f310b11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:44.575013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e893c-6f9b-4ead-ba1c-c0706f310b11 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:44.582851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020808b-a3fe-4b3e-a957-a944fa4fa85a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:44.598252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4064319-645c-4802-a172-e9f24eb83a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:44.598979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4064319-645c-4802-a172-e9f24eb83a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:44.599370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4064319-645c-4802-a172-e9f24eb83a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:44.599517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4064319-645c-4802-a172-e9f24eb83a7e admin admin] PATH_INFO: `/v3/users/0d414815df5c4591954749e36c719d43` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:44.603466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4064319-645c-4802-a172-e9f24eb83a7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d414815df5c4591954749e36c719d43)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:44.606053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4064319-645c-4802-a172-e9f24eb83a7e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:44.618805 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3848/7659] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:18:44 2022] POST /identity/v3/projects => generated 377 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:44.622787 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e893c-6f9b-4ead-ba1c-c0706f310b11 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:44.624814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c37e893c-6f9b-4ead-ba1c-c0706f310b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:44.683669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4064319-645c-4802-a172-e9f24eb83a7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d414815df5c4591954749e36c719d43'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:44.696901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4064319-645c-4802-a172-e9f24eb83a7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d414815df5c4591954749e36c719d43'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:44.698020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4064319-645c-4802-a172-e9f24eb83a7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d414815df5c4591954749e36c719d43'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:44.718250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e893c-6f9b-4ead-ba1c-c0706f310b11 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:44.718831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4064319-645c-4802-a172-e9f24eb83a7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d414815df5c4591954749e36c719d43'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:44.724216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863467c5-6c5a-4447-8034-62e759e53a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:44.724898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863467c5-6c5a-4447-8034-62e759e53a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:44.725170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863467c5-6c5a-4447-8034-62e759e53a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:44.725444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863467c5-6c5a-4447-8034-62e759e53a7e admin admin] PATH_INFO: `/v3/projects/c9c7ffc2d1ee453cb1398c4292aa26a2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:44.726572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863467c5-6c5a-4447-8034-62e759e53a7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c7ffc2d1ee453cb1398c4292aa26a2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:44.727710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4064319-645c-4802-a172-e9f24eb83a7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d414815df5c4591954749e36c719d43'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:44.728475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863467c5-6c5a-4447-8034-62e759e53a7e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:44.736192 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3812/7660] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:18:44 2022] DELETE /identity/v3/users/0d414815df5c4591954749e36c719d43 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:44.737267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4064319-645c-4802-a172-e9f24eb83a7e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:44.740195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a4064319-645c-4802-a172-e9f24eb83a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:44.795162 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:44.831914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-863467c5-6c5a-4447-8034-62e759e53a7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c7ffc2d1ee453cb1398c4292aa26a2', 'request_id': 'req-863467c5-6c5a-4447-8034-62e759e53a7e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:44.844639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-863467c5-6c5a-4447-8034-62e759e53a7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c7ffc2d1ee453cb1398c4292aa26a2', 'request_id': 'req-863467c5-6c5a-4447-8034-62e759e53a7e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:44.847864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4064319-645c-4802-a172-e9f24eb83a7e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:44.852906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-863467c5-6c5a-4447-8034-62e759e53a7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c7ffc2d1ee453cb1398c4292aa26a2', 'request_id': 'req-863467c5-6c5a-4447-8034-62e759e53a7e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:44.857743 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:44.868541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-863467c5-6c5a-4447-8034-62e759e53a7e admin admin] The token cache is being invalidate because project c9c7ffc2d1ee453cb1398c4292aa26a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:18:44.868541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-863467c5-6c5a-4447-8034-62e759e53a7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:44.868541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-863467c5-6c5a-4447-8034-62e759e53a7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:44.869708 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3849/7661] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:18:44 2022] DELETE /identity/v3/projects/c9c7ffc2d1ee453cb1398c4292aa26a2 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:44.870965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a718d-d556-4979-80b9-521c178a1c3c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:44.871253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a718d-d556-4979-80b9-521c178a1c3c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:44.871526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a718d-d556-4979-80b9-521c178a1c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:44.900264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-520a718d-d556-4979-80b9-521c178a1c3c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:44.901535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-520a718d-d556-4979-80b9-521c178a1c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:44.979237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10099d8-7410-47c5-aafc-bfa8461636c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:44.979887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10099d8-7410-47c5-aafc-bfa8461636c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:44.980150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10099d8-7410-47c5-aafc-bfa8461636c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:44.980423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10099d8-7410-47c5-aafc-bfa8461636c5 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:44.981107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10099d8-7410-47c5-aafc-bfa8461636c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:44.983116 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3850/7662] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:44.983375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10099d8-7410-47c5-aafc-bfa8461636c5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:44.984105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a718d-d556-4979-80b9-521c178a1c3c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:44.985864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-520a718d-d556-4979-80b9-521c178a1c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:45.007514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a718d-d556-4979-80b9-521c178a1c3c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:45.013440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b647ec-bd95-4c3c-a6ab-8998cbba800d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:45.014196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b647ec-bd95-4c3c-a6ab-8998cbba800d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:45.014592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b647ec-bd95-4c3c-a6ab-8998cbba800d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:45.014942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b647ec-bd95-4c3c-a6ab-8998cbba800d admin admin] PATH_INFO: `/v3/users/7dd6b7ccb57c4955ad94179b60599f4e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:45.018354 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3813/7663] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:18:44 2022] POST /identity/v3/users => generated 295 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:45.018354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10099d8-7410-47c5-aafc-bfa8461636c5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:45.020061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b647ec-bd95-4c3c-a6ab-8998cbba800d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dd6b7ccb57c4955ad94179b60599f4e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:45.020486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c10099d8-7410-47c5-aafc-bfa8461636c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:45.022026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b647ec-bd95-4c3c-a6ab-8998cbba800d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:45.106098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10099d8-7410-47c5-aafc-bfa8461636c5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:45.112240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267cd64-a823-4ead-848d-df2fe3c3c19b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:45.113537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267cd64-a823-4ead-848d-df2fe3c3c19b service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:45.113893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267cd64-a823-4ead-848d-df2fe3c3c19b service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:45.114351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267cd64-a823-4ead-848d-df2fe3c3c19b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:45.114806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3b647ec-bd95-4c3c-a6ab-8998cbba800d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dd6b7ccb57c4955ad94179b60599f4e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:45.115694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3b647ec-bd95-4c3c-a6ab-8998cbba800d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dd6b7ccb57c4955ad94179b60599f4e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:45.125950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267cd64-a823-4ead-848d-df2fe3c3c19b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:45.126821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3b647ec-bd95-4c3c-a6ab-8998cbba800d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dd6b7ccb57c4955ad94179b60599f4e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:45.127861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267cd64-a823-4ead-848d-df2fe3c3c19b service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:45.141128 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3814/7664] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:18:45.142101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267cd64-a823-4ead-848d-df2fe3c3c19b service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:45.144045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4267cd64-a823-4ead-848d-df2fe3c3c19b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:45.148859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3b647ec-bd95-4c3c-a6ab-8998cbba800d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dd6b7ccb57c4955ad94179b60599f4e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:45.166326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3b647ec-bd95-4c3c-a6ab-8998cbba800d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dd6b7ccb57c4955ad94179b60599f4e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:45.166889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267cd64-a823-4ead-848d-df2fe3c3c19b service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:45.174099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23939f13-03bc-4fb0-9b42-1684c1cf056d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:45.175582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23939f13-03bc-4fb0-9b42-1684c1cf056d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:45.175919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23939f13-03bc-4fb0-9b42-1684c1cf056d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:45.176142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23939f13-03bc-4fb0-9b42-1684c1cf056d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:45.178031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23939f13-03bc-4fb0-9b42-1684c1cf056d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:45.179849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23939f13-03bc-4fb0-9b42-1684c1cf056d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:45.180098 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3851/7665] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:18:44 2022] DELETE /identity/v3/users/7dd6b7ccb57c4955ad94179b60599f4e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:45.198512 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3815/7666] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:45.206643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b647ec-bd95-4c3c-a6ab-8998cbba800d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:45.208237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e3b647ec-bd95-4c3c-a6ab-8998cbba800d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:45.269306 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:45.370666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b647ec-bd95-4c3c-a6ab-8998cbba800d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:45.375852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4455e9-ec1a-4f8f-b851-475d2ff714cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:45.376703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4455e9-ec1a-4f8f-b851-475d2ff714cb admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:45.377005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4455e9-ec1a-4f8f-b851-475d2ff714cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:45.377471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4455e9-ec1a-4f8f-b851-475d2ff714cb admin admin] PATH_INFO: `/v3/projects/c15c7725a5e54d0bb52315e995cabe33/users/cd4c1fb28ad84ca8930250e265bdb483/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:45.397230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4455e9-ec1a-4f8f-b851-475d2ff714cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15c7725a5e54d0bb52315e995cabe33, user_id=cd4c1fb28ad84ca8930250e265bdb483, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:45.400692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4455e9-ec1a-4f8f-b851-475d2ff714cb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:45.427358 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3852/7667] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:18:45 2022] PUT /identity/v3/projects/c15c7725a5e54d0bb52315e995cabe33/users/cd4c1fb28ad84ca8930250e265bdb483/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:45.432146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23939f13-03bc-4fb0-9b42-1684c1cf056d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:45.442926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23939f13-03bc-4fb0-9b42-1684c1cf056d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:45.541074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4455e9-ec1a-4f8f-b851-475d2ff714cb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:45.542989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fc4455e9-ec1a-4f8f-b851-475d2ff714cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:45.580969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72ae74-7c1d-4854-8555-5174831c663c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:45.582234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72ae74-7c1d-4854-8555-5174831c663c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:45.582603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72ae74-7c1d-4854-8555-5174831c663c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:45.585695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72ae74-7c1d-4854-8555-5174831c663c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:45.587363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72ae74-7c1d-4854-8555-5174831c663c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:45.588978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72ae74-7c1d-4854-8555-5174831c663c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:45.614158 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3816/7668] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:45.618098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72ae74-7c1d-4854-8555-5174831c663c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:45.633268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72ae74-7c1d-4854-8555-5174831c663c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:45.638598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce878765-a81b-4695-8c4b-46a1064526ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:45.639316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce878765-a81b-4695-8c4b-46a1064526ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:45.639624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce878765-a81b-4695-8c4b-46a1064526ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:45.639867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce878765-a81b-4695-8c4b-46a1064526ec admin admin] PATH_INFO: `/v3/projects/c15c7725a5e54d0bb52315e995cabe33/users/cd4c1fb28ad84ca8930250e265bdb483/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:45.641834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce878765-a81b-4695-8c4b-46a1064526ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15c7725a5e54d0bb52315e995cabe33, user_id=cd4c1fb28ad84ca8930250e265bdb483, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:45.645536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce878765-a81b-4695-8c4b-46a1064526ec admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:45.660816 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3817/7669] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:18:45 2022] PUT /identity/v3/projects/c15c7725a5e54d0bb52315e995cabe33/users/cd4c1fb28ad84ca8930250e265bdb483/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:18:45.672104 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fde78-d505-4a5c-a9de-ff533d44e31a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:45.672512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fde78-d505-4a5c-a9de-ff533d44e31a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:45.673419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fde78-d505-4a5c-a9de-ff533d44e31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:45.711766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4455e9-ec1a-4f8f-b851-475d2ff714cb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:45.711949 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:45.726347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ba0fde78-d505-4a5c-a9de-ff533d44e31a None None] MFA Rules not processed for user `cd4c1fb28ad84ca8930250e265bdb483`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:45.728103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ba0fde78-d505-4a5c-a9de-ff533d44e31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:45.814258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152c160-57b5-431d-95dc-2c4c6e6e2d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:45.814904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152c160-57b5-431d-95dc-2c4c6e6e2d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:45.815188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152c160-57b5-431d-95dc-2c4c6e6e2d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:45.816403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152c160-57b5-431d-95dc-2c4c6e6e2d72 admin admin] PATH_INFO: `/v3/projects/8ca361321771457fa38b7bb38919e8af` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:45.817795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152c160-57b5-431d-95dc-2c4c6e6e2d72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca361321771457fa38b7bb38919e8af)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:45.820477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152c160-57b5-431d-95dc-2c4c6e6e2d72 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:45.857275 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3818/7670] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:45.862617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fde78-d505-4a5c-a9de-ff533d44e31a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:45.864397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ba0fde78-d505-4a5c-a9de-ff533d44e31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:45.880853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fde78-d505-4a5c-a9de-ff533d44e31a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:45.899886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c152c160-57b5-431d-95dc-2c4c6e6e2d72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca361321771457fa38b7bb38919e8af', 'request_id': 'req-c152c160-57b5-431d-95dc-2c4c6e6e2d72'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:45.912961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c152c160-57b5-431d-95dc-2c4c6e6e2d72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca361321771457fa38b7bb38919e8af', 'request_id': 'req-c152c160-57b5-431d-95dc-2c4c6e6e2d72'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:45.915017 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:45.925295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c152c160-57b5-431d-95dc-2c4c6e6e2d72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca361321771457fa38b7bb38919e8af', 'request_id': 'req-c152c160-57b5-431d-95dc-2c4c6e6e2d72'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:45.940386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c152c160-57b5-431d-95dc-2c4c6e6e2d72 admin admin] The token cache is being invalidate because project 8ca361321771457fa38b7bb38919e8af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:18:45.941404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c152c160-57b5-431d-95dc-2c4c6e6e2d72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:45.942202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c152c160-57b5-431d-95dc-2c4c6e6e2d72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:45.944264 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3853/7671] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:18:45 2022] DELETE /identity/v3/projects/8ca361321771457fa38b7bb38919e8af => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:18:45.944899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152c160-57b5-431d-95dc-2c4c6e6e2d72 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:45.948476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c152c160-57b5-431d-95dc-2c4c6e6e2d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:45.960553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb87c3-6d4a-4229-9f9d-0c18b5ac7e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:45.961231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb87c3-6d4a-4229-9f9d-0c18b5ac7e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:45.961503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb87c3-6d4a-4229-9f9d-0c18b5ac7e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:45.961939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb87c3-6d4a-4229-9f9d-0c18b5ac7e7e admin admin] PATH_INFO: `/v3/projects/e4cc15c45cf34fd582d614a9386689e5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:45.963275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb87c3-6d4a-4229-9f9d-0c18b5ac7e7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4cc15c45cf34fd582d614a9386689e5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:45.965684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb87c3-6d4a-4229-9f9d-0c18b5ac7e7e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:46.031645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fcfb87c3-6d4a-4229-9f9d-0c18b5ac7e7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4cc15c45cf34fd582d614a9386689e5', 'request_id': 'req-fcfb87c3-6d4a-4229-9f9d-0c18b5ac7e7e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:46.043652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fcfb87c3-6d4a-4229-9f9d-0c18b5ac7e7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4cc15c45cf34fd582d614a9386689e5', 'request_id': 'req-fcfb87c3-6d4a-4229-9f9d-0c18b5ac7e7e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:46.052076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fcfb87c3-6d4a-4229-9f9d-0c18b5ac7e7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4cc15c45cf34fd582d614a9386689e5', 'request_id': 'req-fcfb87c3-6d4a-4229-9f9d-0c18b5ac7e7e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:46.065232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fcfb87c3-6d4a-4229-9f9d-0c18b5ac7e7e admin admin] The token cache is being invalidate because project e4cc15c45cf34fd582d614a9386689e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:18:46.065904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fcfb87c3-6d4a-4229-9f9d-0c18b5ac7e7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:46.066712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fcfb87c3-6d4a-4229-9f9d-0c18b5ac7e7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:46.068857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152c160-57b5-431d-95dc-2c4c6e6e2d72 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:46.072834 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3819/7672] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:18:45 2022] DELETE /identity/v3/projects/e4cc15c45cf34fd582d614a9386689e5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:46.074195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f573e67-5339-40da-88b8-086c7b199a27 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:46.074473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f573e67-5339-40da-88b8-086c7b199a27 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:46.076891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f573e67-5339-40da-88b8-086c7b199a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:46.104853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2f573e67-5339-40da-88b8-086c7b199a27 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:46.106281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2f573e67-5339-40da-88b8-086c7b199a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:46.139912 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:46.185220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41934bb-78e7-4863-af10-94f4c5b271b0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4c1fb28ad84ca8930250e265bdb483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15c7725a5e54d0bb52315e995cabe33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:46.185950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41934bb-78e7-4863-af10-94f4c5b271b0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:46.186579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41934bb-78e7-4863-af10-94f4c5b271b0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:46.186947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41934bb-78e7-4863-af10-94f4c5b271b0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:46.187956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41934bb-78e7-4863-af10-94f4c5b271b0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:46.190807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41934bb-78e7-4863-af10-94f4c5b271b0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:46.217689 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3820/7673] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:46.222687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694edc76-7fbc-4325-9ffe-af0935ebf463 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:46.222977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694edc76-7fbc-4325-9ffe-af0935ebf463 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:46.223252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694edc76-7fbc-4325-9ffe-af0935ebf463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:46.227383 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3854/7674] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:18:45 2022] POST /identity/v3/domains => generated 246 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:46.227383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe43db7-6116-4046-9e7d-afa232dd29df None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:46.227383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe43db7-6116-4046-9e7d-afa232dd29df None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:46.227383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe43db7-6116-4046-9e7d-afa232dd29df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:46.256461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6fe43db7-6116-4046-9e7d-afa232dd29df None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:46.258001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6fe43db7-6116-4046-9e7d-afa232dd29df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:46.268009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-694edc76-7fbc-4325-9ffe-af0935ebf463 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:46.269943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-694edc76-7fbc-4325-9ffe-af0935ebf463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:46.347485 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3821/7675] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:46.361754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694edc76-7fbc-4325-9ffe-af0935ebf463 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:46.365400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-694edc76-7fbc-4325-9ffe-af0935ebf463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:46.371593 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3855/7676] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:46.371593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749df806-d664-422f-b644-3ab6d285fdfa None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:46.371593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749df806-d664-422f-b644-3ab6d285fdfa None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:46.371593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749df806-d664-422f-b644-3ab6d285fdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:46.416070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-749df806-d664-422f-b644-3ab6d285fdfa None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:46.417917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-749df806-d664-422f-b644-3ab6d285fdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:46.433453 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3856/7677] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:46.433453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749df806-d664-422f-b644-3ab6d285fdfa None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:46.447801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749df806-d664-422f-b644-3ab6d285fdfa None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:46.454411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662a5c0-d7ff-48c0-8585-47c5db983658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:46.455096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662a5c0-d7ff-48c0-8585-47c5db983658 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:46.455514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662a5c0-d7ff-48c0-8585-47c5db983658 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:46.455914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662a5c0-d7ff-48c0-8585-47c5db983658 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:46.456740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662a5c0-d7ff-48c0-8585-47c5db983658 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:18:46.457100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662a5c0-d7ff-48c0-8585-47c5db983658 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:46.458631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662a5c0-d7ff-48c0-8585-47c5db983658 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:46.475523 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3857/7678] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:18:46.477348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662a5c0-d7ff-48c0-8585-47c5db983658 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:46.497383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662a5c0-d7ff-48c0-8585-47c5db983658 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:46.506266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694edc76-7fbc-4325-9ffe-af0935ebf463 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:46.507590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb2982-a5f1-46d5-9a84-040d3bd7e779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:46.508362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb2982-a5f1-46d5-9a84-040d3bd7e779 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:46.508686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb2982-a5f1-46d5-9a84-040d3bd7e779 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:46.508979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb2982-a5f1-46d5-9a84-040d3bd7e779 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:46.509632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb2982-a5f1-46d5-9a84-040d3bd7e779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:18:46.510015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb2982-a5f1-46d5-9a84-040d3bd7e779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:46.511899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c403e-34ba-4525-a906-9e15936c6d19 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4c1fb28ad84ca8930250e265bdb483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15c7725a5e54d0bb52315e995cabe33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:46.512223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb2982-a5f1-46d5-9a84-040d3bd7e779 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:46.512516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c403e-34ba-4525-a906-9e15936c6d19 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:46.512833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c403e-34ba-4525-a906-9e15936c6d19 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:46.513136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c403e-34ba-4525-a906-9e15936c6d19 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:46.513754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c403e-34ba-4525-a906-9e15936c6d19 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:46.514755 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:46.515670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c403e-34ba-4525-a906-9e15936c6d19 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:46.538369 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3858/7679] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:18:46.540209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb2982-a5f1-46d5-9a84-040d3bd7e779 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:46.553162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb2982-a5f1-46d5-9a84-040d3bd7e779 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:46.559253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229198c-1fec-4bb9-851b-703553d7d998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:46.559925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229198c-1fec-4bb9-851b-703553d7d998 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:46.560163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229198c-1fec-4bb9-851b-703553d7d998 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:46.560438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229198c-1fec-4bb9-851b-703553d7d998 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:46.561106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229198c-1fec-4bb9-851b-703553d7d998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:46.563121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229198c-1fec-4bb9-851b-703553d7d998 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:46.572326 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3822/7680] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:18:46 2022] POST /identity/v3/projects => generated 407 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:46.573566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c403e-34ba-4525-a906-9e15936c6d19 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:46.603993 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3859/7681] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:18:46 2022] POST /identity/v3/projects => generated 361 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:46.604863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229198c-1fec-4bb9-851b-703553d7d998 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:46.640422 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:46.668808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c403e-34ba-4525-a906-9e15936c6d19 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:46.694857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229198c-1fec-4bb9-851b-703553d7d998 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:46.700658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518c0b4-0fbf-4c44-ac6a-d36b0553faf0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4c1fb28ad84ca8930250e265bdb483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15c7725a5e54d0bb52315e995cabe33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:46.700880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518c0b4-0fbf-4c44-ac6a-d36b0553faf0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:46.701410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518c0b4-0fbf-4c44-ac6a-d36b0553faf0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:46.701681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518c0b4-0fbf-4c44-ac6a-d36b0553faf0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:46.702318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518c0b4-0fbf-4c44-ac6a-d36b0553faf0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:46.704375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518c0b4-0fbf-4c44-ac6a-d36b0553faf0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:46.740130 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3860/7682] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:18:46 2022] POST /identity/v3/users => generated 348 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:46.740130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518c0b4-0fbf-4c44-ac6a-d36b0553faf0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:46.765421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012a766-5438-467b-a86d-d42eefc3d614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:46.766081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012a766-5438-467b-a86d-d42eefc3d614 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:46.766348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012a766-5438-467b-a86d-d42eefc3d614 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:46.767025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012a766-5438-467b-a86d-d42eefc3d614 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:46.767240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012a766-5438-467b-a86d-d42eefc3d614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:46.769319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012a766-5438-467b-a86d-d42eefc3d614 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:46.812579 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3823/7683] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:18:46 2022] POST /identity/v3/projects => generated 385 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:46.812579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012a766-5438-467b-a86d-d42eefc3d614 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:46.829779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518c0b4-0fbf-4c44-ac6a-d36b0553faf0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:46.901668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012a766-5438-467b-a86d-d42eefc3d614 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:46.906728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fccdb4-92f9-437a-8950-26557b5af95a tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4c1fb28ad84ca8930250e265bdb483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15c7725a5e54d0bb52315e995cabe33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:46.907593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fccdb4-92f9-437a-8950-26557b5af95a tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:46.907880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fccdb4-92f9-437a-8950-26557b5af95a tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:46.908156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fccdb4-92f9-437a-8950-26557b5af95a tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:46.908839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fccdb4-92f9-437a-8950-26557b5af95a tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:46.910466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1e7ff-fcbc-496e-8051-95df3f8fe315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:46.911022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1e7ff-fcbc-496e-8051-95df3f8fe315 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:46.911302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1e7ff-fcbc-496e-8051-95df3f8fe315 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:46.911573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1e7ff-fcbc-496e-8051-95df3f8fe315 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:46.911688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fccdb4-92f9-437a-8950-26557b5af95a tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:46.912670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1e7ff-fcbc-496e-8051-95df3f8fe315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:46.916727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1e7ff-fcbc-496e-8051-95df3f8fe315 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:46.938920 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:46.941292 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3824/7684] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:46.946081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fccdb4-92f9-437a-8950-26557b5af95a tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:46.947695 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3861/7685] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:18:46 2022] POST /identity/v3/users => generated 281 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:46.948550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1e7ff-fcbc-496e-8051-95df3f8fe315 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:46.968154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1e7ff-fcbc-496e-8051-95df3f8fe315 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:46.973189 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fccdb4-92f9-437a-8950-26557b5af95a tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:46.975205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921ae2b-652a-4de0-b72c-6f64075851b1 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4c1fb28ad84ca8930250e265bdb483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15c7725a5e54d0bb52315e995cabe33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:46.975882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921ae2b-652a-4de0-b72c-6f64075851b1 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:46.976166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921ae2b-652a-4de0-b72c-6f64075851b1 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:46.976442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921ae2b-652a-4de0-b72c-6f64075851b1 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] PATH_INFO: `/v3/projects/b342aba9ae224bee88749d77c106764a/users/ab289b0725714f4c9d01a6eaf4871cdd/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:46.978526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1ba06-3389-4644-88bb-79a9f64e00f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:46.979844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1ba06-3389-4644-88bb-79a9f64e00f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:46.980053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1ba06-3389-4644-88bb-79a9f64e00f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:46.980332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1ba06-3389-4644-88bb-79a9f64e00f5 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:46.982204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1ba06-3389-4644-88bb-79a9f64e00f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:46.984551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1ba06-3389-4644-88bb-79a9f64e00f5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:46.998724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921ae2b-652a-4de0-b72c-6f64075851b1 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b342aba9ae224bee88749d77c106764a, user_id=ab289b0725714f4c9d01a6eaf4871cdd, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:47.002994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921ae2b-652a-4de0-b72c-6f64075851b1 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:47.021442 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3825/7686] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:18:46 2022] POST /identity/v3/users => generated 293 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:47.022926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1ba06-3389-4644-88bb-79a9f64e00f5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:47.023349 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3862/7687] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:18:46 2022] PUT /identity/v3/projects/b342aba9ae224bee88749d77c106764a/users/ab289b0725714f4c9d01a6eaf4871cdd/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:47.024364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921ae2b-652a-4de0-b72c-6f64075851b1 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:47.037594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1ba06-3389-4644-88bb-79a9f64e00f5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:47.122389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921ae2b-652a-4de0-b72c-6f64075851b1 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:47.130315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b0015-f2fb-4775-b444-ffd32b159032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:47.131515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b0015-f2fb-4775-b444-ffd32b159032 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:47.131936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b0015-f2fb-4775-b444-ffd32b159032 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:47.132215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b0015-f2fb-4775-b444-ffd32b159032 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:47.133061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b0015-f2fb-4775-b444-ffd32b159032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:47.133929 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:47.135799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b0015-f2fb-4775-b444-ffd32b159032 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:47.146103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3323d-4d82-48aa-9ff6-d3ee5ffbd6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:47.146821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3323d-4d82-48aa-9ff6-d3ee5ffbd6bd admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:47.147169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3323d-4d82-48aa-9ff6-d3ee5ffbd6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:47.147860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3323d-4d82-48aa-9ff6-d3ee5ffbd6bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:47.148618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3323d-4d82-48aa-9ff6-d3ee5ffbd6bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:47.150544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3323d-4d82-48aa-9ff6-d3ee5ffbd6bd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:47.151668 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3863/7688] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:47.153179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23281c9f-ab4d-4a13-966d-7db7a44ba97e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:47.153834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23281c9f-ab4d-4a13-966d-7db7a44ba97e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:47.154108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23281c9f-ab4d-4a13-966d-7db7a44ba97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:47.167357 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3826/7689] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:47.169186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3323d-4d82-48aa-9ff6-d3ee5ffbd6bd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:47.182539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3323d-4d82-48aa-9ff6-d3ee5ffbd6bd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:47.191352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c98410-3782-47b3-ac89-e82100e957cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:47.192712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c98410-3782-47b3-ac89-e82100e957cf admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:47.193046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c98410-3782-47b3-ac89-e82100e957cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:47.193380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c98410-3782-47b3-ac89-e82100e957cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:47.194075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c98410-3782-47b3-ac89-e82100e957cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:47.195771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c98410-3782-47b3-ac89-e82100e957cf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:47.216271 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3827/7690] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:47.216271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c98410-3782-47b3-ac89-e82100e957cf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:47.226283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c98410-3782-47b3-ac89-e82100e957cf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:47.233685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1ccfa-27f8-43f3-900f-ec4a52f56ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:47.234299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1ccfa-27f8-43f3-900f-ec4a52f56ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:47.234639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1ccfa-27f8-43f3-900f-ec4a52f56ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:47.234915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1ccfa-27f8-43f3-900f-ec4a52f56ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:47.235566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1ccfa-27f8-43f3-900f-ec4a52f56ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:47.238387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1ccfa-27f8-43f3-900f-ec4a52f56ec9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:47.268198 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3828/7691] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:47.271418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1ccfa-27f8-43f3-900f-ec4a52f56ec9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:47.297147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1ccfa-27f8-43f3-900f-ec4a52f56ec9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:47.315096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-23281c9f-ab4d-4a13-966d-7db7a44ba97e None None] MFA Rules not processed for user `ab289b0725714f4c9d01a6eaf4871cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:47.315096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-23281c9f-ab4d-4a13-966d-7db7a44ba97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:47.317424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20087dc4-bd7e-4b25-a9d8-d647e2b9f290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:47.318112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20087dc4-bd7e-4b25-a9d8-d647e2b9f290 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:47.318409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20087dc4-bd7e-4b25-a9d8-d647e2b9f290 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:47.319635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20087dc4-bd7e-4b25-a9d8-d647e2b9f290 admin admin] PATH_INFO: `/v3/projects/15c8c680e20044be8fd6eb6133e7d139/users/2d62c5942e134df9bb109d4078d262d3/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:47.333885 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3864/7692] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:47 2022] POST /identity/v3/auth/tokens => generated 3361 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:47.334527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23281c9f-ab4d-4a13-966d-7db7a44ba97e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:47.349581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20087dc4-bd7e-4b25-a9d8-d647e2b9f290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15c8c680e20044be8fd6eb6133e7d139, user_id=2d62c5942e134df9bb109d4078d262d3, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:47.352269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20087dc4-bd7e-4b25-a9d8-d647e2b9f290 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:47.354444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23281c9f-ab4d-4a13-966d-7db7a44ba97e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:47.359964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644badfd-2240-494d-8535-825163d3bf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:47.360684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644badfd-2240-494d-8535-825163d3bf0f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:47.361022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644badfd-2240-494d-8535-825163d3bf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:47.361306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644badfd-2240-494d-8535-825163d3bf0f admin admin] PATH_INFO: `/v3/projects/fe68a9cf550a463a962a95045d1dadf9/users/4780213df80a4fe7806caedd22153026/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:47.381700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644badfd-2240-494d-8535-825163d3bf0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe68a9cf550a463a962a95045d1dadf9, user_id=4780213df80a4fe7806caedd22153026, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:47.388705 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3829/7693] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:18:47 2022] PUT /identity/v3/projects/15c8c680e20044be8fd6eb6133e7d139/users/2d62c5942e134df9bb109d4078d262d3/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:47.388705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be3d2d-ed39-4af1-a026-4f5027815635 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:47.389030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644badfd-2240-494d-8535-825163d3bf0f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:47.389120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be3d2d-ed39-4af1-a026-4f5027815635 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:47.389120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be3d2d-ed39-4af1-a026-4f5027815635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:47.418076 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3865/7694] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:18:47 2022] PUT /identity/v3/projects/fe68a9cf550a463a962a95045d1dadf9/users/4780213df80a4fe7806caedd22153026/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:47.418076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dbd43-19db-4264-a548-83b2efade0b3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:47.418076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dbd43-19db-4264-a548-83b2efade0b3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:47.418076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dbd43-19db-4264-a548-83b2efade0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:47.446965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-724dbd43-19db-4264-a548-83b2efade0b3 None None] MFA Rules not processed for user `2d62c5942e134df9bb109d4078d262d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:47.448476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-724dbd43-19db-4264-a548-83b2efade0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:47.453334 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:47.521665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-10be3d2d-ed39-4af1-a026-4f5027815635 None None] MFA Rules not processed for user `ab289b0725714f4c9d01a6eaf4871cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:47.523346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-10be3d2d-ed39-4af1-a026-4f5027815635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:47.539797 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3830/7695] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:47 2022] POST /identity/v3/auth/tokens => generated 3361 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:47.542811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec1169-f4c5-497a-862a-46e6273f4371 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:47.543251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec1169-f4c5-497a-862a-46e6273f4371 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:47.544450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec1169-f4c5-497a-862a-46e6273f4371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:47.581355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-81ec1169-f4c5-497a-862a-46e6273f4371 None None] MFA Rules not processed for user `4780213df80a4fe7806caedd22153026`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:47.582979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-81ec1169-f4c5-497a-862a-46e6273f4371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:47.589619 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3866/7696] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:47.590684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dbd43-19db-4264-a548-83b2efade0b3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:47.606684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dbd43-19db-4264-a548-83b2efade0b3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:47.613493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8ccb4-6d75-47ae-9cb5-4c81fba91cba tempest-test_project-31370482 tempest-user-1413296395] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab289b0725714f4c9d01a6eaf4871cdd', 'user_domain_id': '6ac3f81cdd8f4ba1b3c3c9b309d0e185', 'system_scope': None, 'project_id': 'b342aba9ae224bee88749d77c106764a', 'project_domain_id': '6ac3f81cdd8f4ba1b3c3c9b309d0e185', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:47.613493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8ccb4-6d75-47ae-9cb5-4c81fba91cba tempest-test_project-31370482 tempest-user-1413296395] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:47.613802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8ccb4-6d75-47ae-9cb5-4c81fba91cba tempest-test_project-31370482 tempest-user-1413296395] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:47.614027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8ccb4-6d75-47ae-9cb5-4c81fba91cba tempest-test_project-31370482 tempest-user-1413296395] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:47.626923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8ccb4-6d75-47ae-9cb5-4c81fba91cba tempest-test_project-31370482 tempest-user-1413296395] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:47.629296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8ccb4-6d75-47ae-9cb5-4c81fba91cba tempest-test_project-31370482 tempest-user-1413296395] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:47.641317 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3867/7697] 10.222.0.16 () {56 vars in 1284 bytes} [Fri Sep 30 10:18:47 2022] GET /identity/v3/auth/tokens => generated 3361 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:18:47.642151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8ccb4-6d75-47ae-9cb5-4c81fba91cba tempest-test_project-31370482 tempest-user-1413296395] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:47.685850 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3831/7698] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:47.686352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec1169-f4c5-497a-862a-46e6273f4371 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:47.745080 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:47.764210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8ccb4-6d75-47ae-9cb5-4c81fba91cba tempest-test_project-31370482 tempest-user-1413296395] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:47.773900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a6ec4-8983-4b1e-9a10-880d29832881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:47.774993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a6ec4-8983-4b1e-9a10-880d29832881 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:47.775396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a6ec4-8983-4b1e-9a10-880d29832881 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:47.775683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a6ec4-8983-4b1e-9a10-880d29832881 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:47.776632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a6ec4-8983-4b1e-9a10-880d29832881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:47.778194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec1169-f4c5-497a-862a-46e6273f4371 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:47.779908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a6ec4-8983-4b1e-9a10-880d29832881 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:47.785609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ab790-d36e-4a84-a8a7-e711316589a0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4c1fb28ad84ca8930250e265bdb483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15c7725a5e54d0bb52315e995cabe33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:47.787044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ab790-d36e-4a84-a8a7-e711316589a0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:47.788319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ab790-d36e-4a84-a8a7-e711316589a0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:47.788831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ab790-d36e-4a84-a8a7-e711316589a0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] PATH_INFO: `/v3/users/ab289b0725714f4c9d01a6eaf4871cdd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:47.798176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ab790-d36e-4a84-a8a7-e711316589a0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ab289b0725714f4c9d01a6eaf4871cdd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:47.802726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ab790-d36e-4a84-a8a7-e711316589a0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:47.820635 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3868/7699] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:18:47 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:47.821573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a6ec4-8983-4b1e-9a10-880d29832881 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:47.823173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-533a6ec4-8983-4b1e-9a10-880d29832881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:47.896388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3a6ab790-d36e-4a84-a8a7-e711316589a0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab289b0725714f4c9d01a6eaf4871cdd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:47.905437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3a6ab790-d36e-4a84-a8a7-e711316589a0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab289b0725714f4c9d01a6eaf4871cdd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:47.906132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3a6ab790-d36e-4a84-a8a7-e711316589a0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab289b0725714f4c9d01a6eaf4871cdd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:47.929441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a6ec4-8983-4b1e-9a10-880d29832881 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:47.933739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3a6ab790-d36e-4a84-a8a7-e711316589a0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab289b0725714f4c9d01a6eaf4871cdd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:47.935385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ea344-2808-4412-abd8-0a24e7886d1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:47.936004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ea344-2808-4412-abd8-0a24e7886d1c service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:47.936279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ea344-2808-4412-abd8-0a24e7886d1c service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:47.936548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ea344-2808-4412-abd8-0a24e7886d1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:47.947290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3a6ab790-d36e-4a84-a8a7-e711316589a0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab289b0725714f4c9d01a6eaf4871cdd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:47.954847 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3832/7700] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:18:47 2022] DELETE /identity/v3/users/ab289b0725714f4c9d01a6eaf4871cdd => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:47.955666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ab790-d36e-4a84-a8a7-e711316589a0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:47.957315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3a6ab790-d36e-4a84-a8a7-e711316589a0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:47.982316 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:48.037400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ab790-d36e-4a84-a8a7-e711316589a0 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:48.043058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360fbeb-5a4b-4a9f-8a04-77ef23d6436c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:48.043684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360fbeb-5a4b-4a9f-8a04-77ef23d6436c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:48.043968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360fbeb-5a4b-4a9f-8a04-77ef23d6436c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:48.044241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360fbeb-5a4b-4a9f-8a04-77ef23d6436c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:48.044914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360fbeb-5a4b-4a9f-8a04-77ef23d6436c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:48.046863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360fbeb-5a4b-4a9f-8a04-77ef23d6436c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:48.049276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ea344-2808-4412-abd8-0a24e7886d1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:48.051814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ea344-2808-4412-abd8-0a24e7886d1c service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:48.067587 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3869/7701] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:18:48.068465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ea344-2808-4412-abd8-0a24e7886d1c service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:48.098123 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3833/7702] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:18:47 2022] POST /identity/v3/users => generated 299 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:48.102186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360fbeb-5a4b-4a9f-8a04-77ef23d6436c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:48.129424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360fbeb-5a4b-4a9f-8a04-77ef23d6436c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:48.135424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd9ab1-0ed9-40eb-ae28-8e7bb36066fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:48.135978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd9ab1-0ed9-40eb-ae28-8e7bb36066fb admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:48.136069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd9ab1-0ed9-40eb-ae28-8e7bb36066fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:48.136299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd9ab1-0ed9-40eb-ae28-8e7bb36066fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:48.136988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd9ab1-0ed9-40eb-ae28-8e7bb36066fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:48.138562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd9ab1-0ed9-40eb-ae28-8e7bb36066fb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:48.155902 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3834/7703] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:48.157120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd9ab1-0ed9-40eb-ae28-8e7bb36066fb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:48.162062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ea344-2808-4412-abd8-0a24e7886d1c service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:48.169729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd9ab1-0ed9-40eb-ae28-8e7bb36066fb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:48.184438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ff992-f8c1-45de-8bd0-99cdccf503f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:48.185146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ff992-f8c1-45de-8bd0-99cdccf503f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:48.185430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ff992-f8c1-45de-8bd0-99cdccf503f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:48.188408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ff992-f8c1-45de-8bd0-99cdccf503f0 admin admin] PATH_INFO: `/v3/projects/3ce7382d0826495d8b4d00ee40ee6938/users/e1e92288e3d84693bdf72109994145b5/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:48.230805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ff992-f8c1-45de-8bd0-99cdccf503f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce7382d0826495d8b4d00ee40ee6938, user_id=e1e92288e3d84693bdf72109994145b5, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:48.239059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ff992-f8c1-45de-8bd0-99cdccf503f0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:48.258499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fe928-de1a-461a-a512-9b91f381747a tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4c1fb28ad84ca8930250e265bdb483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15c7725a5e54d0bb52315e995cabe33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:48.258738 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3835/7704] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:18:48 2022] PUT /identity/v3/projects/3ce7382d0826495d8b4d00ee40ee6938/users/e1e92288e3d84693bdf72109994145b5/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:48.261306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fe928-de1a-461a-a512-9b91f381747a tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:48.261730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fe928-de1a-461a-a512-9b91f381747a tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:48.262786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ff992-f8c1-45de-8bd0-99cdccf503f0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:48.263277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fe928-de1a-461a-a512-9b91f381747a tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] PATH_INFO: `/v3/projects/b342aba9ae224bee88749d77c106764a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:48.265903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297fe928-de1a-461a-a512-9b91f381747a tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b342aba9ae224bee88749d77c106764a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:48.269232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297fe928-de1a-461a-a512-9b91f381747a tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:48.289054 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:48.352666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-297fe928-de1a-461a-a512-9b91f381747a tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b342aba9ae224bee88749d77c106764a', 'request_id': 'req-297fe928-de1a-461a-a512-9b91f381747a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:48.368981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-297fe928-de1a-461a-a512-9b91f381747a tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b342aba9ae224bee88749d77c106764a', 'request_id': 'req-297fe928-de1a-461a-a512-9b91f381747a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:48.380342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-297fe928-de1a-461a-a512-9b91f381747a tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b342aba9ae224bee88749d77c106764a', 'request_id': 'req-297fe928-de1a-461a-a512-9b91f381747a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:48.414219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-297fe928-de1a-461a-a512-9b91f381747a tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] The token cache is being invalidate because project b342aba9ae224bee88749d77c106764a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:18:48.414518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-297fe928-de1a-461a-a512-9b91f381747a tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:48.416643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-297fe928-de1a-461a-a512-9b91f381747a tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:48.421367 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3870/7705] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:18:48 2022] DELETE /identity/v3/projects/b342aba9ae224bee88749d77c106764a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:48.426433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fe928-de1a-461a-a512-9b91f381747a tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:48.427923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-297fe928-de1a-461a-a512-9b91f381747a tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:48.431418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ff992-f8c1-45de-8bd0-99cdccf503f0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:48.453659 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:48.513337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9390d94-6c55-40bc-93a4-d75d44969ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:48.515150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9390d94-6c55-40bc-93a4-d75d44969ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:48.515856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9390d94-6c55-40bc-93a4-d75d44969ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:48.516333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9390d94-6c55-40bc-93a4-d75d44969ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:48.517185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9390d94-6c55-40bc-93a4-d75d44969ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:48.520002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9390d94-6c55-40bc-93a4-d75d44969ea0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:48.533474 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3836/7706] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:48.537106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9390d94-6c55-40bc-93a4-d75d44969ea0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:48.539646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fe928-de1a-461a-a512-9b91f381747a tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:48.545424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeace044-647d-4a13-a43d-550188fa0b73 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4c1fb28ad84ca8930250e265bdb483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15c7725a5e54d0bb52315e995cabe33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:48.546225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeace044-647d-4a13-a43d-550188fa0b73 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:48.548663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeace044-647d-4a13-a43d-550188fa0b73 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:48.548663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeace044-647d-4a13-a43d-550188fa0b73 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] PATH_INFO: `/v3/domains/6ac3f81cdd8f4ba1b3c3c9b309d0e185` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:48.548663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeace044-647d-4a13-a43d-550188fa0b73 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6ac3f81cdd8f4ba1b3c3c9b309d0e185)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:48.551650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeace044-647d-4a13-a43d-550188fa0b73 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:48.558271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f9390d94-6c55-40bc-93a4-d75d44969ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:48.579252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eeace044-647d-4a13-a43d-550188fa0b73 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6ac3f81cdd8f4ba1b3c3c9b309d0e185'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:48.579983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eeace044-647d-4a13-a43d-550188fa0b73 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6ac3f81cdd8f4ba1b3c3c9b309d0e185'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:48.590948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9390d94-6c55-40bc-93a4-d75d44969ea0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:48.637582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eeace044-647d-4a13-a43d-550188fa0b73 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6ac3f81cdd8f4ba1b3c3c9b309d0e185'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:48.638203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eeace044-647d-4a13-a43d-550188fa0b73 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6ac3f81cdd8f4ba1b3c3c9b309d0e185'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:48.644250 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3871/7707] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:18:48 2022] PATCH /identity/v3/domains/6ac3f81cdd8f4ba1b3c3c9b309d0e185 => generated 247 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:18:48.645330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeace044-647d-4a13-a43d-550188fa0b73 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:48.648622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eeace044-647d-4a13-a43d-550188fa0b73 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:48.743961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbeeb22-4ad4-47e9-b3ce-baf44b326595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:48.745655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeeb22-4ad4-47e9-b3ce-baf44b326595 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:48.746333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeeb22-4ad4-47e9-b3ce-baf44b326595 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:48.746691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeeb22-4ad4-47e9-b3ce-baf44b326595 admin admin] PATH_INFO: `/v3/projects/3ce7382d0826495d8b4d00ee40ee6938/users/e1e92288e3d84693bdf72109994145b5/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:48.750188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbeeb22-4ad4-47e9-b3ce-baf44b326595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce7382d0826495d8b4d00ee40ee6938, user_id=e1e92288e3d84693bdf72109994145b5, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:48.756545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbeeb22-4ad4-47e9-b3ce-baf44b326595 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:48.763136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeace044-647d-4a13-a43d-550188fa0b73 tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:48.772034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebcb26-0277-4527-a0aa-b222beec2caf tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd4c1fb28ad84ca8930250e265bdb483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c15c7725a5e54d0bb52315e995cabe33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:48.777044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebcb26-0277-4527-a0aa-b222beec2caf tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:48.777590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebcb26-0277-4527-a0aa-b222beec2caf tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:48.777872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebcb26-0277-4527-a0aa-b222beec2caf tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] PATH_INFO: `/v3/domains/6ac3f81cdd8f4ba1b3c3c9b309d0e185` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:48.784681 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3837/7708] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:18:48 2022] PUT /identity/v3/projects/3ce7382d0826495d8b4d00ee40ee6938/users/e1e92288e3d84693bdf72109994145b5/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:18:48.794269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14acd99-4ae4-4956-870b-2745a826c924 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:48.794520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14acd99-4ae4-4956-870b-2745a826c924 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:48.794752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14acd99-4ae4-4956-870b-2745a826c924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:48.798162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebcb26-0277-4527-a0aa-b222beec2caf tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6ac3f81cdd8f4ba1b3c3c9b309d0e185)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:48.799987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebcb26-0277-4527-a0aa-b222beec2caf tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:48.854036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7ebcb26-0277-4527-a0aa-b222beec2caf tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6ac3f81cdd8f4ba1b3c3c9b309d0e185'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:48.858200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7ebcb26-0277-4527-a0aa-b222beec2caf tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6ac3f81cdd8f4ba1b3c3c9b309d0e185'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:48.858474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b14acd99-4ae4-4956-870b-2745a826c924 None None] MFA Rules not processed for user `e1e92288e3d84693bdf72109994145b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:48.864173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b14acd99-4ae4-4956-870b-2745a826c924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:48.932880 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:48.935035 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:48.945949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7ebcb26-0277-4527-a0aa-b222beec2caf tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ac3f81cdd8f4ba1b3c3c9b309d0e185', 'request_id': 'req-a7ebcb26-0277-4527-a0aa-b222beec2caf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:48.960452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7ebcb26-0277-4527-a0aa-b222beec2caf tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ac3f81cdd8f4ba1b3c3c9b309d0e185', 'request_id': 'req-a7ebcb26-0277-4527-a0aa-b222beec2caf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:48.969650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7ebcb26-0277-4527-a0aa-b222beec2caf tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ac3f81cdd8f4ba1b3c3c9b309d0e185', 'request_id': 'req-a7ebcb26-0277-4527-a0aa-b222beec2caf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:48.987012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7ebcb26-0277-4527-a0aa-b222beec2caf tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] The token cache is being invalidate because project 6ac3f81cdd8f4ba1b3c3c9b309d0e185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:18:48.987519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7ebcb26-0277-4527-a0aa-b222beec2caf tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:48.990058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7ebcb26-0277-4527-a0aa-b222beec2caf tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:49.001272 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3838/7709] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:49.005212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7ebcb26-0277-4527-a0aa-b222beec2caf tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6ac3f81cdd8f4ba1b3c3c9b309d0e185', 'request_id': 'req-a7ebcb26-0277-4527-a0aa-b222beec2caf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:49.013811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7ebcb26-0277-4527-a0aa-b222beec2caf tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6ac3f81cdd8f4ba1b3c3c9b309d0e185', 'request_id': 'req-a7ebcb26-0277-4527-a0aa-b222beec2caf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:49.013968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14acd99-4ae4-4956-870b-2745a826c924 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:49.015935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b14acd99-4ae4-4956-870b-2745a826c924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:49.021268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7ebcb26-0277-4527-a0aa-b222beec2caf tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6ac3f81cdd8f4ba1b3c3c9b309d0e185', 'request_id': 'req-a7ebcb26-0277-4527-a0aa-b222beec2caf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:49.039640 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3872/7710] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:18:48 2022] DELETE /identity/v3/domains/6ac3f81cdd8f4ba1b3c3c9b309d0e185 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:18:49.046397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebcb26-0277-4527-a0aa-b222beec2caf tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:49.052085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a7ebcb26-0277-4527-a0aa-b222beec2caf tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:49.117309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14acd99-4ae4-4956-870b-2745a826c924 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:49.163257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebcb26-0277-4527-a0aa-b222beec2caf tempest-TestDefaultProjectId-1823507977 tempest-TestDefaultProjectId-1823507977-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:49.176011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724ee5a-5d3f-4c2c-bab0-22452793e685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:49.178172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724ee5a-5d3f-4c2c-bab0-22452793e685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:49.178459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724ee5a-5d3f-4c2c-bab0-22452793e685 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:49.178732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724ee5a-5d3f-4c2c-bab0-22452793e685 admin admin] PATH_INFO: `/v3/users/4f9b6062104c445c8cdf87d03975bfcc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:49.182869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724ee5a-5d3f-4c2c-bab0-22452793e685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f9b6062104c445c8cdf87d03975bfcc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:49.186659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724ee5a-5d3f-4c2c-bab0-22452793e685 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:49.203862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c8400-5496-4533-a193-dd3ebc06aaaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:49.206566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c8400-5496-4533-a193-dd3ebc06aaaa service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:49.206858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c8400-5496-4533-a193-dd3ebc06aaaa service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:49.207114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c8400-5496-4533-a193-dd3ebc06aaaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:49.215515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d34c8400-5496-4533-a193-dd3ebc06aaaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:49.277584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e724ee5a-5d3f-4c2c-bab0-22452793e685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f9b6062104c445c8cdf87d03975bfcc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:49.281430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e724ee5a-5d3f-4c2c-bab0-22452793e685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f9b6062104c445c8cdf87d03975bfcc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:49.298735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e724ee5a-5d3f-4c2c-bab0-22452793e685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f9b6062104c445c8cdf87d03975bfcc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:49.303721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c8400-5496-4533-a193-dd3ebc06aaaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:49.306199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c8400-5496-4533-a193-dd3ebc06aaaa service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:49.317947 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3839/7711] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:18:49.329394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e724ee5a-5d3f-4c2c-bab0-22452793e685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f9b6062104c445c8cdf87d03975bfcc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:49.339945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e724ee5a-5d3f-4c2c-bab0-22452793e685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f9b6062104c445c8cdf87d03975bfcc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:49.349968 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3873/7712] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:18:49 2022] DELETE /identity/v3/users/4f9b6062104c445c8cdf87d03975bfcc => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:49.354029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140923a-6de0-4116-b788-7bf3939c1898 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:49.354323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140923a-6de0-4116-b788-7bf3939c1898 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:49.354583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140923a-6de0-4116-b788-7bf3939c1898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:49.414085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7140923a-6de0-4116-b788-7bf3939c1898 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:49.415617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7140923a-6de0-4116-b788-7bf3939c1898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:49.493610 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:49.592534 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3840/7713] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:49.641387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724ee5a-5d3f-4c2c-bab0-22452793e685 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:49.645096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e724ee5a-5d3f-4c2c-bab0-22452793e685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:49.750176 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:49.804314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724ee5a-5d3f-4c2c-bab0-22452793e685 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:49.821737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc08c91-4af3-4da3-a090-71b16bd69870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:49.822296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc08c91-4af3-4da3-a090-71b16bd69870 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:49.822565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc08c91-4af3-4da3-a090-71b16bd69870 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:49.822843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc08c91-4af3-4da3-a090-71b16bd69870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:49.837775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc08c91-4af3-4da3-a090-71b16bd69870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:49.839493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc08c91-4af3-4da3-a090-71b16bd69870 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:49.861653 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3874/7714] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:18:50.368023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140923a-6de0-4116-b788-7bf3939c1898 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:50.369547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7140923a-6de0-4116-b788-7bf3939c1898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:50.383874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140923a-6de0-4116-b788-7bf3939c1898 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:50.398576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365a6aa-5eee-4e10-9716-ec1b54d24963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:50.400027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365a6aa-5eee-4e10-9716-ec1b54d24963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:50.400304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365a6aa-5eee-4e10-9716-ec1b54d24963 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:50.400576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365a6aa-5eee-4e10-9716-ec1b54d24963 admin admin] PATH_INFO: `/v3/users/2d62c5942e134df9bb109d4078d262d3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:50.404479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365a6aa-5eee-4e10-9716-ec1b54d24963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d62c5942e134df9bb109d4078d262d3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:50.407597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365a6aa-5eee-4e10-9716-ec1b54d24963 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:50.453190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc08c91-4af3-4da3-a090-71b16bd69870 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:50.454702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7cc08c91-4af3-4da3-a090-71b16bd69870 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:50.477780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc08c91-4af3-4da3-a090-71b16bd69870 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:50.493978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87811d6-2f6f-4197-bf41-8f9ad1eb8762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:50.496120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87811d6-2f6f-4197-bf41-8f9ad1eb8762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:50.496409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87811d6-2f6f-4197-bf41-8f9ad1eb8762 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:50.496702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87811d6-2f6f-4197-bf41-8f9ad1eb8762 admin admin] PATH_INFO: `/v3/projects/0a2731eee31f4fc292d9523dcbad8e9d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:50.500937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87811d6-2f6f-4197-bf41-8f9ad1eb8762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a2731eee31f4fc292d9523dcbad8e9d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:50.503478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87811d6-2f6f-4197-bf41-8f9ad1eb8762 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:50.528826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d365a6aa-5eee-4e10-9716-ec1b54d24963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d62c5942e134df9bb109d4078d262d3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:50.548936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d365a6aa-5eee-4e10-9716-ec1b54d24963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d62c5942e134df9bb109d4078d262d3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:50.550454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d365a6aa-5eee-4e10-9716-ec1b54d24963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d62c5942e134df9bb109d4078d262d3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:50.571269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d365a6aa-5eee-4e10-9716-ec1b54d24963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d62c5942e134df9bb109d4078d262d3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:50.590963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d365a6aa-5eee-4e10-9716-ec1b54d24963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d62c5942e134df9bb109d4078d262d3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:50.610089 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3841/7715] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:18:50 2022] DELETE /identity/v3/users/2d62c5942e134df9bb109d4078d262d3 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:50.610718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d87811d6-2f6f-4197-bf41-8f9ad1eb8762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a2731eee31f4fc292d9523dcbad8e9d', 'request_id': 'req-d87811d6-2f6f-4197-bf41-8f9ad1eb8762'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:50.611588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024f199-f3ab-47d4-9d26-ce84670b682e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:50.611946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024f199-f3ab-47d4-9d26-ce84670b682e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:50.612531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024f199-f3ab-47d4-9d26-ce84670b682e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:50.623216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d87811d6-2f6f-4197-bf41-8f9ad1eb8762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a2731eee31f4fc292d9523dcbad8e9d', 'request_id': 'req-d87811d6-2f6f-4197-bf41-8f9ad1eb8762'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:50.629665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d87811d6-2f6f-4197-bf41-8f9ad1eb8762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a2731eee31f4fc292d9523dcbad8e9d', 'request_id': 'req-d87811d6-2f6f-4197-bf41-8f9ad1eb8762'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:50.637040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a024f199-f3ab-47d4-9d26-ce84670b682e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:50.638326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a024f199-f3ab-47d4-9d26-ce84670b682e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:50.670399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d87811d6-2f6f-4197-bf41-8f9ad1eb8762 admin admin] The token cache is being invalidate because project 0a2731eee31f4fc292d9523dcbad8e9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:18:50.673050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d87811d6-2f6f-4197-bf41-8f9ad1eb8762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:50.674207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d87811d6-2f6f-4197-bf41-8f9ad1eb8762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:50.676186 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3875/7716] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:18:50 2022] DELETE /identity/v3/projects/0a2731eee31f4fc292d9523dcbad8e9d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:18:50.682003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87811d6-2f6f-4197-bf41-8f9ad1eb8762 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:50.686252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d87811d6-2f6f-4197-bf41-8f9ad1eb8762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:50.727022 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3842/7717] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:50.728474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024f199-f3ab-47d4-9d26-ce84670b682e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:50.731254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a024f199-f3ab-47d4-9d26-ce84670b682e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:50.859811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024f199-f3ab-47d4-9d26-ce84670b682e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:50.866718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6899cb-681e-4eec-bb6b-15f4a9ecfe39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:50.867336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6899cb-681e-4eec-bb6b-15f4a9ecfe39 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:50.867652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6899cb-681e-4eec-bb6b-15f4a9ecfe39 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:50.867870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87811d6-2f6f-4197-bf41-8f9ad1eb8762 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:50.867983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6899cb-681e-4eec-bb6b-15f4a9ecfe39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:50.873278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd523525-83a1-4d8d-aa0b-ba06abd2fef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:50.873925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd523525-83a1-4d8d-aa0b-ba06abd2fef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:50.874206 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd523525-83a1-4d8d-aa0b-ba06abd2fef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:50.874482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd523525-83a1-4d8d-aa0b-ba06abd2fef1 admin admin] PATH_INFO: `/v3/users/cd4c1fb28ad84ca8930250e265bdb483` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:50.875284 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:50.877931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd523525-83a1-4d8d-aa0b-ba06abd2fef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd4c1fb28ad84ca8930250e265bdb483)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:50.880996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6899cb-681e-4eec-bb6b-15f4a9ecfe39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:50.881629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd523525-83a1-4d8d-aa0b-ba06abd2fef1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:50.883166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6899cb-681e-4eec-bb6b-15f4a9ecfe39 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:50.904846 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3843/7718] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:18:50.993344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fd523525-83a1-4d8d-aa0b-ba06abd2fef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd4c1fb28ad84ca8930250e265bdb483'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:50.994900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fd523525-83a1-4d8d-aa0b-ba06abd2fef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd4c1fb28ad84ca8930250e265bdb483'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:51.012947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fd523525-83a1-4d8d-aa0b-ba06abd2fef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd4c1fb28ad84ca8930250e265bdb483'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:51.022684 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:51.040950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fd523525-83a1-4d8d-aa0b-ba06abd2fef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd4c1fb28ad84ca8930250e265bdb483'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:51.057375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fd523525-83a1-4d8d-aa0b-ba06abd2fef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd4c1fb28ad84ca8930250e265bdb483'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:51.074071 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3876/7719] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:18:50 2022] DELETE /identity/v3/users/cd4c1fb28ad84ca8930250e265bdb483 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:51.342176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6899cb-681e-4eec-bb6b-15f4a9ecfe39 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:51.344140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1d6899cb-681e-4eec-bb6b-15f4a9ecfe39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:51.363416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6899cb-681e-4eec-bb6b-15f4a9ecfe39 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:51.479390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a9e84-6fb6-4531-a489-da772e4466f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:51.480331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a9e84-6fb6-4531-a489-da772e4466f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:51.480780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a9e84-6fb6-4531-a489-da772e4466f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:51.481157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a9e84-6fb6-4531-a489-da772e4466f5 admin admin] PATH_INFO: `/v3/projects/15c8c680e20044be8fd6eb6133e7d139` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:51.482913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a9e84-6fb6-4531-a489-da772e4466f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15c8c680e20044be8fd6eb6133e7d139)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:51.486423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a9e84-6fb6-4531-a489-da772e4466f5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:51.614004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3e2a9e84-6fb6-4531-a489-da772e4466f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15c8c680e20044be8fd6eb6133e7d139', 'request_id': 'req-3e2a9e84-6fb6-4531-a489-da772e4466f5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:51.639559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3e2a9e84-6fb6-4531-a489-da772e4466f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15c8c680e20044be8fd6eb6133e7d139', 'request_id': 'req-3e2a9e84-6fb6-4531-a489-da772e4466f5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:51.648081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3e2a9e84-6fb6-4531-a489-da772e4466f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15c8c680e20044be8fd6eb6133e7d139', 'request_id': 'req-3e2a9e84-6fb6-4531-a489-da772e4466f5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:51.674360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3e2a9e84-6fb6-4531-a489-da772e4466f5 admin admin] The token cache is being invalidate because project 15c8c680e20044be8fd6eb6133e7d139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:18:51.675259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3e2a9e84-6fb6-4531-a489-da772e4466f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:51.676109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3e2a9e84-6fb6-4531-a489-da772e4466f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:51.680875 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3844/7720] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:18:51 2022] DELETE /identity/v3/projects/15c8c680e20044be8fd6eb6133e7d139 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:51.682522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd523525-83a1-4d8d-aa0b-ba06abd2fef1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:51.684977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fd523525-83a1-4d8d-aa0b-ba06abd2fef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:51.709623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd523525-83a1-4d8d-aa0b-ba06abd2fef1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:51.788575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a9e84-6fb6-4531-a489-da772e4466f5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:51.790235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3e2a9e84-6fb6-4531-a489-da772e4466f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:51.845496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345c584-deb6-4e7f-ba99-2604a2eb8f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:51.846153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345c584-deb6-4e7f-ba99-2604a2eb8f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:51.849643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345c584-deb6-4e7f-ba99-2604a2eb8f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:51.850010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345c584-deb6-4e7f-ba99-2604a2eb8f19 admin admin] PATH_INFO: `/v3/users/e1e92288e3d84693bdf72109994145b5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:51.853060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345c584-deb6-4e7f-ba99-2604a2eb8f19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1e92288e3d84693bdf72109994145b5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:51.860197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345c584-deb6-4e7f-ba99-2604a2eb8f19 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:51.959767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e345c584-deb6-4e7f-ba99-2604a2eb8f19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1e92288e3d84693bdf72109994145b5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:51.961795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e345c584-deb6-4e7f-ba99-2604a2eb8f19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1e92288e3d84693bdf72109994145b5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:51.969478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a9e84-6fb6-4531-a489-da772e4466f5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:51.973876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e345c584-deb6-4e7f-ba99-2604a2eb8f19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1e92288e3d84693bdf72109994145b5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:51.976581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c50a1-3615-4ae6-a3a1-21fcc31f66ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:51.977256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c50a1-3615-4ae6-a3a1-21fcc31f66ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:51.977535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c50a1-3615-4ae6-a3a1-21fcc31f66ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:51.977809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c50a1-3615-4ae6-a3a1-21fcc31f66ca admin admin] PATH_INFO: `/v3/projects/c15c7725a5e54d0bb52315e995cabe33` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:51.979146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c50a1-3615-4ae6-a3a1-21fcc31f66ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c15c7725a5e54d0bb52315e995cabe33)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:51.981073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c50a1-3615-4ae6-a3a1-21fcc31f66ca admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:52.010959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e345c584-deb6-4e7f-ba99-2604a2eb8f19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1e92288e3d84693bdf72109994145b5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:52.027137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e345c584-deb6-4e7f-ba99-2604a2eb8f19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1e92288e3d84693bdf72109994145b5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:52.030642 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:52.044651 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3877/7721] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:18:51 2022] DELETE /identity/v3/users/e1e92288e3d84693bdf72109994145b5 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:52.063600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fc7c50a1-3615-4ae6-a3a1-21fcc31f66ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c15c7725a5e54d0bb52315e995cabe33', 'request_id': 'req-fc7c50a1-3615-4ae6-a3a1-21fcc31f66ca'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:52.085537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fc7c50a1-3615-4ae6-a3a1-21fcc31f66ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c15c7725a5e54d0bb52315e995cabe33', 'request_id': 'req-fc7c50a1-3615-4ae6-a3a1-21fcc31f66ca'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:52.092354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fc7c50a1-3615-4ae6-a3a1-21fcc31f66ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c15c7725a5e54d0bb52315e995cabe33', 'request_id': 'req-fc7c50a1-3615-4ae6-a3a1-21fcc31f66ca'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:52.105816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fc7c50a1-3615-4ae6-a3a1-21fcc31f66ca admin admin] The token cache is being invalidate because project c15c7725a5e54d0bb52315e995cabe33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:18:52.106251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fc7c50a1-3615-4ae6-a3a1-21fcc31f66ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:52.106942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fc7c50a1-3615-4ae6-a3a1-21fcc31f66ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:52.109102 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3845/7722] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:18:51 2022] DELETE /identity/v3/projects/c15c7725a5e54d0bb52315e995cabe33 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:52.114529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce832687-840d-44ad-ada8-26586e43fea9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:52.115148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce832687-840d-44ad-ada8-26586e43fea9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:52.115148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce832687-840d-44ad-ada8-26586e43fea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:52.153544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ce832687-840d-44ad-ada8-26586e43fea9 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:52.157572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ce832687-840d-44ad-ada8-26586e43fea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:52.258025 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:52.285498 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3878/7723] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:18:52.288179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebe85f-691f-4e70-b2dd-b2e33e556e71 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:52.289245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebe85f-691f-4e70-b2dd-b2e33e556e71 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:52.289759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebe85f-691f-4e70-b2dd-b2e33e556e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:52.333657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7eebe85f-691f-4e70-b2dd-b2e33e556e71 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:52.335254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7eebe85f-691f-4e70-b2dd-b2e33e556e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:52.354245 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3846/7724] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:52.358398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce832687-840d-44ad-ada8-26586e43fea9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:52.372916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce832687-840d-44ad-ada8-26586e43fea9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:52.380945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abf39d-54d3-46be-b60f-b33ea5d3351e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:52.381879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abf39d-54d3-46be-b60f-b33ea5d3351e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:52.382581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abf39d-54d3-46be-b60f-b33ea5d3351e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:52.383243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abf39d-54d3-46be-b60f-b33ea5d3351e admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:52.384379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abf39d-54d3-46be-b60f-b33ea5d3351e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:18:52.385192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abf39d-54d3-46be-b60f-b33ea5d3351e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:52.387014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abf39d-54d3-46be-b60f-b33ea5d3351e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:52.414659 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3879/7725] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:18:52.418917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebe85f-691f-4e70-b2dd-b2e33e556e71 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:52.439097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebe85f-691f-4e70-b2dd-b2e33e556e71 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:52.451421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2007875-c2e3-477e-b401-c2675b860cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:52.452925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2007875-c2e3-477e-b401-c2675b860cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:52.453284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2007875-c2e3-477e-b401-c2675b860cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:52.453633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2007875-c2e3-477e-b401-c2675b860cb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:52.454407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2007875-c2e3-477e-b401-c2675b860cb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:52.460790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2007875-c2e3-477e-b401-c2675b860cb2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:52.507697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abf39d-54d3-46be-b60f-b33ea5d3351e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:52.510338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-73abf39d-54d3-46be-b60f-b33ea5d3351e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:52.536777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abf39d-54d3-46be-b60f-b33ea5d3351e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:52.551426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4004d-99d2-426a-bcb8-49785354f992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:52.552695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4004d-99d2-426a-bcb8-49785354f992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:52.553852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4004d-99d2-426a-bcb8-49785354f992 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:52.554704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4004d-99d2-426a-bcb8-49785354f992 admin admin] PATH_INFO: `/v3/projects/3ce7382d0826495d8b4d00ee40ee6938` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:52.557808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4004d-99d2-426a-bcb8-49785354f992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce7382d0826495d8b4d00ee40ee6938)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:52.561294 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3847/7726] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:18:52 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:52.561922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4004d-99d2-426a-bcb8-49785354f992 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:52.562189 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2007875-c2e3-477e-b401-c2675b860cb2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:52.670337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-18b4004d-99d2-426a-bcb8-49785354f992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce7382d0826495d8b4d00ee40ee6938', 'request_id': 'req-18b4004d-99d2-426a-bcb8-49785354f992'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:52.674285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2007875-c2e3-477e-b401-c2675b860cb2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:52.688553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-18b4004d-99d2-426a-bcb8-49785354f992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce7382d0826495d8b4d00ee40ee6938', 'request_id': 'req-18b4004d-99d2-426a-bcb8-49785354f992'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:52.699648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-18b4004d-99d2-426a-bcb8-49785354f992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce7382d0826495d8b4d00ee40ee6938', 'request_id': 'req-18b4004d-99d2-426a-bcb8-49785354f992'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:52.717520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-18b4004d-99d2-426a-bcb8-49785354f992 admin admin] The token cache is being invalidate because project 3ce7382d0826495d8b4d00ee40ee6938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:18:52.718113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-18b4004d-99d2-426a-bcb8-49785354f992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:52.719713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-18b4004d-99d2-426a-bcb8-49785354f992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:52.728150 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3880/7727] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:18:52 2022] DELETE /identity/v3/projects/3ce7382d0826495d8b4d00ee40ee6938 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:52.729939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddb770-94dc-4fc7-93be-292b6609a2df None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:52.730297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddb770-94dc-4fc7-93be-292b6609a2df None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:52.730637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddb770-94dc-4fc7-93be-292b6609a2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:52.766359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-84ddb770-94dc-4fc7-93be-292b6609a2df None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:52.767990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-84ddb770-94dc-4fc7-93be-292b6609a2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:52.801957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1597b0e-8a21-4a8c-b60f-bde625656726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:52.802835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1597b0e-8a21-4a8c-b60f-bde625656726 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:52.803523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1597b0e-8a21-4a8c-b60f-bde625656726 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:52.803958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1597b0e-8a21-4a8c-b60f-bde625656726 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:52.804770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1597b0e-8a21-4a8c-b60f-bde625656726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:52.807093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1597b0e-8a21-4a8c-b60f-bde625656726 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:52.877331 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3848/7728] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:18:52 2022] POST /identity/v3/users => generated 294 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:52.878820 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3881/7729] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:52.888940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddb770-94dc-4fc7-93be-292b6609a2df None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:52.890499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-84ddb770-94dc-4fc7-93be-292b6609a2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:52.901891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e97c52-91d9-42b5-bfbf-4c298e548198 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:52.902229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e97c52-91d9-42b5-bfbf-4c298e548198 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:52.902546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e97c52-91d9-42b5-bfbf-4c298e548198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:52.910022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddb770-94dc-4fc7-93be-292b6609a2df None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:52.918460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8de50c-41d4-4f4b-8c43-caa1556f23c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:52.918460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8de50c-41d4-4f4b-8c43-caa1556f23c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:52.918460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8de50c-41d4-4f4b-8c43-caa1556f23c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:52.919006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8de50c-41d4-4f4b-8c43-caa1556f23c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:52.919879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8de50c-41d4-4f4b-8c43-caa1556f23c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:52.921690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8de50c-41d4-4f4b-8c43-caa1556f23c4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:52.936953 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3882/7730] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:52.940676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8de50c-41d4-4f4b-8c43-caa1556f23c4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:52.954179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a9e97c52-91d9-42b5-bfbf-4c298e548198 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:52.955440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8de50c-41d4-4f4b-8c43-caa1556f23c4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:52.961860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fc5ce-5387-45e1-ab70-7a5eb30631d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:52.962826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fc5ce-5387-45e1-ab70-7a5eb30631d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:52.963276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fc5ce-5387-45e1-ab70-7a5eb30631d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:52.963638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fc5ce-5387-45e1-ab70-7a5eb30631d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:52.964455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fc5ce-5387-45e1-ab70-7a5eb30631d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:52.966323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fc5ce-5387-45e1-ab70-7a5eb30631d7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:52.973082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a9e97c52-91d9-42b5-bfbf-4c298e548198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:52.982348 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3883/7731] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:18:52.986373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fc5ce-5387-45e1-ab70-7a5eb30631d7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:53.003933 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3849/7732] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:53.008547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e97c52-91d9-42b5-bfbf-4c298e548198 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:53.019108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fc5ce-5387-45e1-ab70-7a5eb30631d7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:53.026165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e97c52-91d9-42b5-bfbf-4c298e548198 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:53.029446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a21b76-251f-4c12-8b8d-cca30c647548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:53.031550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951db1b-4316-47f8-9418-666c571c222d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:53.031895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a21b76-251f-4c12-8b8d-cca30c647548 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:53.032276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a21b76-251f-4c12-8b8d-cca30c647548 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:53.032533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951db1b-4316-47f8-9418-666c571c222d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:53.032739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a21b76-251f-4c12-8b8d-cca30c647548 admin admin] PATH_INFO: `/v3/projects/d2e778d61b6443fda1fcb9847c5a9d34/users/2433f33ef619438cbaa789528aab80c8/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:53.032853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951db1b-4316-47f8-9418-666c571c222d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:53.033353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951db1b-4316-47f8-9418-666c571c222d admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:53.035906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951db1b-4316-47f8-9418-666c571c222d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:18:53.036326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951db1b-4316-47f8-9418-666c571c222d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:53.038316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951db1b-4316-47f8-9418-666c571c222d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:53.053193 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3850/7733] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:18:53.057878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951db1b-4316-47f8-9418-666c571c222d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:53.059002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a21b76-251f-4c12-8b8d-cca30c647548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e778d61b6443fda1fcb9847c5a9d34, user_id=2433f33ef619438cbaa789528aab80c8, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:53.064349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a21b76-251f-4c12-8b8d-cca30c647548 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:53.066452 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:53.078842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951db1b-4316-47f8-9418-666c571c222d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:53.103843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3eb2d9-d82c-4217-b987-8a5ccdc14f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:53.104552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3eb2d9-d82c-4217-b987-8a5ccdc14f89 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:53.105052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3eb2d9-d82c-4217-b987-8a5ccdc14f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:53.105401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3eb2d9-d82c-4217-b987-8a5ccdc14f89 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:53.105974 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3884/7734] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:18:52 2022] PUT /identity/v3/projects/d2e778d61b6443fda1fcb9847c5a9d34/users/2433f33ef619438cbaa789528aab80c8/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:53.106088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3eb2d9-d82c-4217-b987-8a5ccdc14f89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:53.108150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3eb2d9-d82c-4217-b987-8a5ccdc14f89 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:53.117898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d25b3-0063-480e-b652-3f75b9d7491c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:53.118182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d25b3-0063-480e-b652-3f75b9d7491c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:53.118452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d25b3-0063-480e-b652-3f75b9d7491c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:53.181929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f81d25b3-0063-480e-b652-3f75b9d7491c None None] MFA Rules not processed for user `2433f33ef619438cbaa789528aab80c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:53.186805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f81d25b3-0063-480e-b652-3f75b9d7491c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:53.187435 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3851/7735] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:18:53 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:18:53.188799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3eb2d9-d82c-4217-b987-8a5ccdc14f89 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:53.207220 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:53.305071 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3885/7736] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:18:53.309911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d25b3-0063-480e-b652-3f75b9d7491c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:53.313180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3eb2d9-d82c-4217-b987-8a5ccdc14f89 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:53.325147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d25b3-0063-480e-b652-3f75b9d7491c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:53.327975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8960828-d6c3-426a-868f-06b2a7abe58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:53.329420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8960828-d6c3-426a-868f-06b2a7abe58c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:53.330450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8960828-d6c3-426a-868f-06b2a7abe58c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:53.331390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8960828-d6c3-426a-868f-06b2a7abe58c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:53.332384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8960828-d6c3-426a-868f-06b2a7abe58c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:53.333130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5364fef-c689-4ada-a9c3-3712432ea038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:53.333768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5364fef-c689-4ada-a9c3-3712432ea038 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:53.334113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5364fef-c689-4ada-a9c3-3712432ea038 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:53.334723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5364fef-c689-4ada-a9c3-3712432ea038 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:53.335540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5364fef-c689-4ada-a9c3-3712432ea038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:53.337843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5364fef-c689-4ada-a9c3-3712432ea038 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:53.339603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8960828-d6c3-426a-868f-06b2a7abe58c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:53.393741 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3852/7737] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:18:53 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:53.395965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8960828-d6c3-426a-868f-06b2a7abe58c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:53.406495 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3886/7738] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:18:53 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:18:53.414051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5364fef-c689-4ada-a9c3-3712432ea038 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:53.417888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8960828-d6c3-426a-868f-06b2a7abe58c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:53.518584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bc2c6-a69c-4870-b4bc-16cf15c864a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:53.520214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bc2c6-a69c-4870-b4bc-16cf15c864a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:53.520958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bc2c6-a69c-4870-b4bc-16cf15c864a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:53.522365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bc2c6-a69c-4870-b4bc-16cf15c864a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:53.524451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6bc2c6-a69c-4870-b4bc-16cf15c864a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:53.526695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6bc2c6-a69c-4870-b4bc-16cf15c864a1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:53.543311 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3853/7739] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:53.546666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bc2c6-a69c-4870-b4bc-16cf15c864a1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:53.555963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5364fef-c689-4ada-a9c3-3712432ea038 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:53.564593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fe2e0-5db6-4f9c-a97e-67c7a3e272dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:53.564784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bc2c6-a69c-4870-b4bc-16cf15c864a1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:53.566183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fe2e0-5db6-4f9c-a97e-67c7a3e272dc admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:53.566183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fe2e0-5db6-4f9c-a97e-67c7a3e272dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:53.566545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fe2e0-5db6-4f9c-a97e-67c7a3e272dc admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:53.567357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fe2e0-5db6-4f9c-a97e-67c7a3e272dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:53.570375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fe2e0-5db6-4f9c-a97e-67c7a3e272dc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:53.571366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79d4cb-118e-4b91-a87b-6517e80a89ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:53.571992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79d4cb-118e-4b91-a87b-6517e80a89ba admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:53.572327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79d4cb-118e-4b91-a87b-6517e80a89ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:53.572674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79d4cb-118e-4b91-a87b-6517e80a89ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:53.580171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79d4cb-118e-4b91-a87b-6517e80a89ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:53.583310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79d4cb-118e-4b91-a87b-6517e80a89ba admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:53.602808 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3854/7740] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:53.606838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79d4cb-118e-4b91-a87b-6517e80a89ba admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:53.626132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79d4cb-118e-4b91-a87b-6517e80a89ba admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:53.635552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811ed72-bdaa-4859-abb1-8f4f6c625c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:53.636654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811ed72-bdaa-4859-abb1-8f4f6c625c5d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:53.637042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811ed72-bdaa-4859-abb1-8f4f6c625c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:53.637435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811ed72-bdaa-4859-abb1-8f4f6c625c5d admin admin] PATH_INFO: `/v3/projects/a69a7851d6c6450f95c8489ecf0fb0cb/users/69db1e8d0ae14bc8bfa8461e23b631a5/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:53.638783 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3887/7741] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:18:53 2022] POST /identity/v3/users => generated 300 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:18:53.642823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fe2e0-5db6-4f9c-a97e-67c7a3e272dc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:53.671043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fe2e0-5db6-4f9c-a97e-67c7a3e272dc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:53.671688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811ed72-bdaa-4859-abb1-8f4f6c625c5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a69a7851d6c6450f95c8489ecf0fb0cb, user_id=69db1e8d0ae14bc8bfa8461e23b631a5, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:53.675903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811ed72-bdaa-4859-abb1-8f4f6c625c5d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:53.681963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902e0c8-85b1-4de0-a501-b9aed805f2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:53.683014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902e0c8-85b1-4de0-a501-b9aed805f2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:53.683444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902e0c8-85b1-4de0-a501-b9aed805f2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:53.683795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902e0c8-85b1-4de0-a501-b9aed805f2a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:53.684623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902e0c8-85b1-4de0-a501-b9aed805f2a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:53.686674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902e0c8-85b1-4de0-a501-b9aed805f2a0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:53.703893 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3888/7743] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:53.707498 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3855/7743] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:18:53 2022] PUT /identity/v3/projects/a69a7851d6c6450f95c8489ecf0fb0cb/users/69db1e8d0ae14bc8bfa8461e23b631a5/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:18:53.708036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902e0c8-85b1-4de0-a501-b9aed805f2a0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:53.709040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de186bad-e22b-4b0b-b80b-03b3b4cef9b2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:53.709218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de186bad-e22b-4b0b-b80b-03b3b4cef9b2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:53.709513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de186bad-e22b-4b0b-b80b-03b3b4cef9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:53.725744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902e0c8-85b1-4de0-a501-b9aed805f2a0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:53.747597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-de186bad-e22b-4b0b-b80b-03b3b4cef9b2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:53.748898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-de186bad-e22b-4b0b-b80b-03b3b4cef9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:53.786159 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:53.828707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fb07f-6d75-4e97-9ecf-fef381bda5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:53.829125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fb07f-6d75-4e97-9ecf-fef381bda5de admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:53.829413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fb07f-6d75-4e97-9ecf-fef381bda5de admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:53.829691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fb07f-6d75-4e97-9ecf-fef381bda5de admin admin] PATH_INFO: `/v3/projects/74c4ba33eaf44607a7cfe21a093918c3/users/2e6434bbcdb04ebf9138b1e7656cf2af/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:53.848655 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3856/7744] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:53.848854 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:53.856499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fb07f-6d75-4e97-9ecf-fef381bda5de admin admin] RBAC: Authorizing `identity:create_grant(project_id=74c4ba33eaf44607a7cfe21a093918c3, user_id=2e6434bbcdb04ebf9138b1e7656cf2af, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:53.860078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de186bad-e22b-4b0b-b80b-03b3b4cef9b2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:53.861554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-de186bad-e22b-4b0b-b80b-03b3b4cef9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:53.866622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fb07f-6d75-4e97-9ecf-fef381bda5de admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:53.891916 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3889/7745] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:18:53 2022] PUT /identity/v3/projects/74c4ba33eaf44607a7cfe21a093918c3/users/2e6434bbcdb04ebf9138b1e7656cf2af/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:18:53.896297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fb07f-6d75-4e97-9ecf-fef381bda5de admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:53.960051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de186bad-e22b-4b0b-b80b-03b3b4cef9b2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:53.992791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fb07f-6d75-4e97-9ecf-fef381bda5de admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:53.998668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701f708-5248-45de-9742-8cf39d355f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:53.999434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701f708-5248-45de-9742-8cf39d355f02 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:53.999781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701f708-5248-45de-9742-8cf39d355f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:54.000124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701f708-5248-45de-9742-8cf39d355f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:54.000999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701f708-5248-45de-9742-8cf39d355f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:54.003326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701f708-5248-45de-9742-8cf39d355f02 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:54.021402 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3890/7746] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:54.025419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701f708-5248-45de-9742-8cf39d355f02 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:54.045414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17ec24-9fe3-4e93-9902-1dea771c8088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:54.046449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17ec24-9fe3-4e93-9902-1dea771c8088 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:54.046798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17ec24-9fe3-4e93-9902-1dea771c8088 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:54.047139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17ec24-9fe3-4e93-9902-1dea771c8088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:54.059146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17ec24-9fe3-4e93-9902-1dea771c8088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:54.060973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17ec24-9fe3-4e93-9902-1dea771c8088 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:54.061601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701f708-5248-45de-9742-8cf39d355f02 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:54.078312 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3857/7747] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:18:54.087143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151e8c2-e16f-4c1e-b2ee-218d959e0af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:54.088079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151e8c2-e16f-4c1e-b2ee-218d959e0af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:54.088364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151e8c2-e16f-4c1e-b2ee-218d959e0af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:54.088666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151e8c2-e16f-4c1e-b2ee-218d959e0af2 admin admin] PATH_INFO: `/v3/projects/74c4ba33eaf44607a7cfe21a093918c3/users/2e6434bbcdb04ebf9138b1e7656cf2af/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:54.101744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151e8c2-e16f-4c1e-b2ee-218d959e0af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74c4ba33eaf44607a7cfe21a093918c3, user_id=2e6434bbcdb04ebf9138b1e7656cf2af, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:54.106718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151e8c2-e16f-4c1e-b2ee-218d959e0af2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:54.140649 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3891/7748] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:18:54 2022] PUT /identity/v3/projects/74c4ba33eaf44607a7cfe21a093918c3/users/2e6434bbcdb04ebf9138b1e7656cf2af/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:54.150710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ebee3-8095-4d19-88e8-ee64ab8e7e57 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:54.151077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ebee3-8095-4d19-88e8-ee64ab8e7e57 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:54.151425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ebee3-8095-4d19-88e8-ee64ab8e7e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:54.192200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-167ebee3-8095-4d19-88e8-ee64ab8e7e57 None None] MFA Rules not processed for user `2e6434bbcdb04ebf9138b1e7656cf2af`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:54.193915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-167ebee3-8095-4d19-88e8-ee64ab8e7e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:54.345987 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3858/7749] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:54 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:54.351123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151e8c2-e16f-4c1e-b2ee-218d959e0af2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:54.372221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151e8c2-e16f-4c1e-b2ee-218d959e0af2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:54.383032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1824124-88fd-4ee6-84cf-afe4ac7a90e0 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6434bbcdb04ebf9138b1e7656cf2af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c4ba33eaf44607a7cfe21a093918c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:54.383703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1824124-88fd-4ee6-84cf-afe4ac7a90e0 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:54.383984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1824124-88fd-4ee6-84cf-afe4ac7a90e0 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:54.384309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1824124-88fd-4ee6-84cf-afe4ac7a90e0 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:54.385026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1824124-88fd-4ee6-84cf-afe4ac7a90e0 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:54.387660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1824124-88fd-4ee6-84cf-afe4ac7a90e0 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:54.439306 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3892/7750] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:18:54 2022] POST /identity/v3/projects => generated 360 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:18:54.443842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ebee3-8095-4d19-88e8-ee64ab8e7e57 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:54.454262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ebee3-8095-4d19-88e8-ee64ab8e7e57 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:54.475946 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:54.558835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc503c3-36eb-4807-83d2-1e5eef2df68f tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6434bbcdb04ebf9138b1e7656cf2af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c4ba33eaf44607a7cfe21a093918c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:54.559866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc503c3-36eb-4807-83d2-1e5eef2df68f tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:54.560267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc503c3-36eb-4807-83d2-1e5eef2df68f tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:54.560962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc503c3-36eb-4807-83d2-1e5eef2df68f tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] PATH_INFO: `/v3/projects/0bed2afcd48a4230b377547cbbc08f20/tags/tempest-tag-1973344425` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:54.562642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc503c3-36eb-4807-83d2-1e5eef2df68f tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=0bed2afcd48a4230b377547cbbc08f20, value=tempest-tag-1973344425)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:54.566505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc503c3-36eb-4807-83d2-1e5eef2df68f tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:54.649568 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-7dc503c3-36eb-4807-83d2-1e5eef2df68f tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1973344425. To ensure interoperability, identifiers should be a valid uuid. Sep 30 10:18:54.649568 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 30 10:18:54.649568 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:18:54.661188 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3859/7751] 10.222.0.16 () {60 vars in 1333 bytes} [Fri Sep 30 10:18:54 2022] PUT /identity/v3/projects/0bed2afcd48a4230b377547cbbc08f20/tags/tempest-tag-1973344425 => generated 0 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) Sep 30 10:18:54.665589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1824124-88fd-4ee6-84cf-afe4ac7a90e0 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:54.678641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1824124-88fd-4ee6-84cf-afe4ac7a90e0 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:54.693741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c78d1-a2f1-4b54-8abf-3a6cc5ff4698 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6434bbcdb04ebf9138b1e7656cf2af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c4ba33eaf44607a7cfe21a093918c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:54.695019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c78d1-a2f1-4b54-8abf-3a6cc5ff4698 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:54.695448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c78d1-a2f1-4b54-8abf-3a6cc5ff4698 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:54.695890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c78d1-a2f1-4b54-8abf-3a6cc5ff4698 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] PATH_INFO: `/v3/projects/0bed2afcd48a4230b377547cbbc08f20/tags/tempest-tag-1973344425` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:54.715632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c78d1-a2f1-4b54-8abf-3a6cc5ff4698 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=0bed2afcd48a4230b377547cbbc08f20, value=tempest-tag-1973344425)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:54.720269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c78d1-a2f1-4b54-8abf-3a6cc5ff4698 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:54.737241 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3893/7752] 10.222.0.16 () {58 vars in 1314 bytes} [Fri Sep 30 10:18:54 2022] GET /identity/v3/projects/0bed2afcd48a4230b377547cbbc08f20/tags/tempest-tag-1973344425 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:18:54.742181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc503c3-36eb-4807-83d2-1e5eef2df68f tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:54.770170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc503c3-36eb-4807-83d2-1e5eef2df68f tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:54.781361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd841f-5f4c-46de-823c-fbe4db645cd8 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6434bbcdb04ebf9138b1e7656cf2af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c4ba33eaf44607a7cfe21a093918c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:54.782299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd841f-5f4c-46de-823c-fbe4db645cd8 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:54.782585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd841f-5f4c-46de-823c-fbe4db645cd8 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:54.782864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd841f-5f4c-46de-823c-fbe4db645cd8 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] PATH_INFO: `/v3/projects/0bed2afcd48a4230b377547cbbc08f20/tags` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:54.784634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd841f-5f4c-46de-823c-fbe4db645cd8 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=0bed2afcd48a4230b377547cbbc08f20)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:54.786815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd841f-5f4c-46de-823c-fbe4db645cd8 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:54.899256 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3860/7753] 10.222.0.16 () {60 vars in 1265 bytes} [Fri Sep 30 10:18:54 2022] PUT /identity/v3/projects/0bed2afcd48a4230b377547cbbc08f20/tags => generated 141 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:18:54.903515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c78d1-a2f1-4b54-8abf-3a6cc5ff4698 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:54.988066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c78d1-a2f1-4b54-8abf-3a6cc5ff4698 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:54.997821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b07ee-e4a5-4755-87a6-cda7286a35fe tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6434bbcdb04ebf9138b1e7656cf2af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c4ba33eaf44607a7cfe21a093918c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:54.998802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b07ee-e4a5-4755-87a6-cda7286a35fe tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:54.999226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b07ee-e4a5-4755-87a6-cda7286a35fe tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:54.999639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b07ee-e4a5-4755-87a6-cda7286a35fe tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] PATH_INFO: `/v3/projects/0bed2afcd48a4230b377547cbbc08f20/tags` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:55.043433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b07ee-e4a5-4755-87a6-cda7286a35fe tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=0bed2afcd48a4230b377547cbbc08f20)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:55.056972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b07ee-e4a5-4755-87a6-cda7286a35fe tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:55.096648 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3894/7754] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Sep 30 10:18:54 2022] GET /identity/v3/projects/0bed2afcd48a4230b377547cbbc08f20/tags => generated 141 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:18:55.100226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd841f-5f4c-46de-823c-fbe4db645cd8 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:55.115007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd841f-5f4c-46de-823c-fbe4db645cd8 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:55.128878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a988047-b675-4ebb-9066-278e89103a58 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6434bbcdb04ebf9138b1e7656cf2af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c4ba33eaf44607a7cfe21a093918c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:55.130326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a988047-b675-4ebb-9066-278e89103a58 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:55.131507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a988047-b675-4ebb-9066-278e89103a58 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:55.131809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a988047-b675-4ebb-9066-278e89103a58 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] PATH_INFO: `/v3/projects/0bed2afcd48a4230b377547cbbc08f20/tags/tempest-tag-961697972` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:55.134632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a988047-b675-4ebb-9066-278e89103a58 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=0bed2afcd48a4230b377547cbbc08f20, value=tempest-tag-961697972)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:55.137751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a988047-b675-4ebb-9066-278e89103a58 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:55.240733 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-2a988047-b675-4ebb-9066-278e89103a58 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-961697972. To ensure interoperability, identifiers should be a valid uuid. Sep 30 10:18:55.240733 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 30 10:18:55.240733 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:18:55.249197 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3861/7755] 10.222.0.16 () {58 vars in 1314 bytes} [Fri Sep 30 10:18:55 2022] DELETE /identity/v3/projects/0bed2afcd48a4230b377547cbbc08f20/tags/tempest-tag-961697972 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:18:55.253566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b07ee-e4a5-4755-87a6-cda7286a35fe tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:55.267800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b07ee-e4a5-4755-87a6-cda7286a35fe tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:55.279514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eeb940-cc1b-41d4-a726-c872229097fb tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6434bbcdb04ebf9138b1e7656cf2af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c4ba33eaf44607a7cfe21a093918c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:55.280763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eeb940-cc1b-41d4-a726-c872229097fb tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:55.281335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eeb940-cc1b-41d4-a726-c872229097fb tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:55.281335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eeb940-cc1b-41d4-a726-c872229097fb tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] PATH_INFO: `/v3/projects/0bed2afcd48a4230b377547cbbc08f20/tags/tempest-tag-961697972` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:55.329539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eeb940-cc1b-41d4-a726-c872229097fb tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=0bed2afcd48a4230b377547cbbc08f20, value=tempest-tag-961697972)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:55.332165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eeb940-cc1b-41d4-a726-c872229097fb tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:55.368776 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-73eeb940-cc1b-41d4-a726-c872229097fb tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Could not find project tag: tempest-tag-961697972.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-961697972. Sep 30 10:18:55.368776 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:18:55.368776 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:18:55.368776 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:18:55.368776 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:18:55.368776 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:18:55.368776 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:18:55.368776 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:18:55.368776 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:18:55.368776 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:18:55.368776 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:18:55.368776 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:18:55.368776 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Sep 30 10:18:55.368776 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Sep 30 10:18:55.369854 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:18:55.369854 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:18:55.369854 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Sep 30 10:18:55.369854 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Sep 30 10:18:55.369854 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-961697972. Sep 30 10:18:55.369854 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:18:55.370277 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3895/7756] 10.222.0.16 () {58 vars in 1311 bytes} [Fri Sep 30 10:18:55 2022] GET /identity/v3/projects/0bed2afcd48a4230b377547cbbc08f20/tags/tempest-tag-961697972 => generated 106 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:18:55.374259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a988047-b675-4ebb-9066-278e89103a58 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:55.403324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a988047-b675-4ebb-9066-278e89103a58 tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:55.414250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19f267-479e-48ed-aa97-115692bfbd2e tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6434bbcdb04ebf9138b1e7656cf2af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c4ba33eaf44607a7cfe21a093918c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:55.414906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19f267-479e-48ed-aa97-115692bfbd2e tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:55.415187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19f267-479e-48ed-aa97-115692bfbd2e tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:55.415462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19f267-479e-48ed-aa97-115692bfbd2e tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] PATH_INFO: `/v3/projects/0bed2afcd48a4230b377547cbbc08f20/tags` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:55.418983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19f267-479e-48ed-aa97-115692bfbd2e tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=0bed2afcd48a4230b377547cbbc08f20)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:55.424160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19f267-479e-48ed-aa97-115692bfbd2e tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:55.505434 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3862/7757] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Sep 30 10:18:55 2022] DELETE /identity/v3/projects/0bed2afcd48a4230b377547cbbc08f20/tags => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:55.506426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eeb940-cc1b-41d4-a726-c872229097fb tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:55.534879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eeb940-cc1b-41d4-a726-c872229097fb tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:55.540145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b9fc4-1a5b-4d6b-8350-1db9d5c09f3b tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6434bbcdb04ebf9138b1e7656cf2af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c4ba33eaf44607a7cfe21a093918c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:55.540145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b9fc4-1a5b-4d6b-8350-1db9d5c09f3b tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:55.540430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b9fc4-1a5b-4d6b-8350-1db9d5c09f3b tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:55.540573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b9fc4-1a5b-4d6b-8350-1db9d5c09f3b tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] PATH_INFO: `/v3/projects/0bed2afcd48a4230b377547cbbc08f20/tags` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:55.541304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d2162-32d9-42d1-a3f9-5dfa5b203a6e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:55.541857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d2162-32d9-42d1-a3f9-5dfa5b203a6e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:55.542286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d2162-32d9-42d1-a3f9-5dfa5b203a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:55.566565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b9fc4-1a5b-4d6b-8350-1db9d5c09f3b tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=0bed2afcd48a4230b377547cbbc08f20)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:55.568643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b9fc4-1a5b-4d6b-8350-1db9d5c09f3b tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:55.592988 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3896/7758] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Sep 30 10:18:55 2022] GET /identity/v3/projects/0bed2afcd48a4230b377547cbbc08f20/tags => generated 66 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 30 10:18:55.598090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b9fc4-1a5b-4d6b-8350-1db9d5c09f3b tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:55.610480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b9fc4-1a5b-4d6b-8350-1db9d5c09f3b tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:55.615471 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:55.618369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e26b49-cddd-4fe4-bd1e-ffeaefcee98d tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6434bbcdb04ebf9138b1e7656cf2af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c4ba33eaf44607a7cfe21a093918c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:55.620220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e26b49-cddd-4fe4-bd1e-ffeaefcee98d tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:55.620834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e26b49-cddd-4fe4-bd1e-ffeaefcee98d tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:55.621908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e26b49-cddd-4fe4-bd1e-ffeaefcee98d tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] PATH_INFO: `/v3/projects/0bed2afcd48a4230b377547cbbc08f20` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:55.622870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e26b49-cddd-4fe4-bd1e-ffeaefcee98d tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0bed2afcd48a4230b377547cbbc08f20)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:55.622993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6f2d2162-32d9-42d1-a3f9-5dfa5b203a6e None None] MFA Rules not processed for user `69db1e8d0ae14bc8bfa8461e23b631a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:55.626090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e26b49-cddd-4fe4-bd1e-ffeaefcee98d tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:55.626869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6f2d2162-32d9-42d1-a3f9-5dfa5b203a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:55.654046 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:55.765274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b4e26b49-cddd-4fe4-bd1e-ffeaefcee98d tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bed2afcd48a4230b377547cbbc08f20', 'request_id': 'req-b4e26b49-cddd-4fe4-bd1e-ffeaefcee98d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:55.785159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b4e26b49-cddd-4fe4-bd1e-ffeaefcee98d tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bed2afcd48a4230b377547cbbc08f20', 'request_id': 'req-b4e26b49-cddd-4fe4-bd1e-ffeaefcee98d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:55.788441 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3863/7759] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:55.793680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d2162-32d9-42d1-a3f9-5dfa5b203a6e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:55.797179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b4e26b49-cddd-4fe4-bd1e-ffeaefcee98d tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bed2afcd48a4230b377547cbbc08f20', 'request_id': 'req-b4e26b49-cddd-4fe4-bd1e-ffeaefcee98d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:55.823545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b4e26b49-cddd-4fe4-bd1e-ffeaefcee98d tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] The token cache is being invalidate because project 0bed2afcd48a4230b377547cbbc08f20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:18:55.824321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b4e26b49-cddd-4fe4-bd1e-ffeaefcee98d tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:55.844646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b4e26b49-cddd-4fe4-bd1e-ffeaefcee98d tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:55.864635 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3897/7760] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:18:55 2022] DELETE /identity/v3/projects/0bed2afcd48a4230b377547cbbc08f20 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:18:55.870364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e26b49-cddd-4fe4-bd1e-ffeaefcee98d tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:55.876458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b4e26b49-cddd-4fe4-bd1e-ffeaefcee98d tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:55.966273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d2162-32d9-42d1-a3f9-5dfa5b203a6e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:56.025446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e26b49-cddd-4fe4-bd1e-ffeaefcee98d tempest-IdentityV3ProjectTagsTest-2142059842 tempest-IdentityV3ProjectTagsTest-2142059842-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:56.032496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f6c5d-f46d-4e7f-8d97-c8b1a017a774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:56.033179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f6c5d-f46d-4e7f-8d97-c8b1a017a774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:56.033507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f6c5d-f46d-4e7f-8d97-c8b1a017a774 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:56.033968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f6c5d-f46d-4e7f-8d97-c8b1a017a774 admin admin] PATH_INFO: `/v3/users/2433f33ef619438cbaa789528aab80c8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:56.036406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f6c5d-f46d-4e7f-8d97-c8b1a017a774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2433f33ef619438cbaa789528aab80c8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:56.039707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f6c5d-f46d-4e7f-8d97-c8b1a017a774 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:56.069648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad3399-6f6e-4279-9f85-859882c71f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:56.070863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad3399-6f6e-4279-9f85-859882c71f81 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:56.072522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad3399-6f6e-4279-9f85-859882c71f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:56.072992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad3399-6f6e-4279-9f85-859882c71f81 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:56.075268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad3399-6f6e-4279-9f85-859882c71f81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:56.078505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad3399-6f6e-4279-9f85-859882c71f81 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:56.144388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-741f6c5d-f46d-4e7f-8d97-c8b1a017a774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2433f33ef619438cbaa789528aab80c8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:56.145703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-741f6c5d-f46d-4e7f-8d97-c8b1a017a774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2433f33ef619438cbaa789528aab80c8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:56.151025 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3864/7761] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:18:55 2022] POST /identity/v3/projects => generated 373 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:56.157172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad3399-6f6e-4279-9f85-859882c71f81 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:56.160462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a7ad3399-6f6e-4279-9f85-859882c71f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:56.162927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-741f6c5d-f46d-4e7f-8d97-c8b1a017a774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2433f33ef619438cbaa789528aab80c8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:56.197531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-741f6c5d-f46d-4e7f-8d97-c8b1a017a774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2433f33ef619438cbaa789528aab80c8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:56.213204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-741f6c5d-f46d-4e7f-8d97-c8b1a017a774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2433f33ef619438cbaa789528aab80c8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:56.228272 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:56.256232 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3898/7762] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:18:55 2022] DELETE /identity/v3/users/2433f33ef619438cbaa789528aab80c8 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:56.261446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce0a32-a5d8-4a6b-919e-521930e7121b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:56.263257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce0a32-a5d8-4a6b-919e-521930e7121b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:56.263622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce0a32-a5d8-4a6b-919e-521930e7121b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:56.318417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad3399-6f6e-4279-9f85-859882c71f81 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:56.363343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-51ce0a32-a5d8-4a6b-919e-521930e7121b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:56.366485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-51ce0a32-a5d8-4a6b-919e-521930e7121b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:56.441099 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:56.473990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0f390-3eee-423f-be4e-2dee62bb8b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:56.474632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0f390-3eee-423f-be4e-2dee62bb8b75 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:56.474914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0f390-3eee-423f-be4e-2dee62bb8b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:56.475204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0f390-3eee-423f-be4e-2dee62bb8b75 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:56.475836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0f390-3eee-423f-be4e-2dee62bb8b75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:56.485236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0f390-3eee-423f-be4e-2dee62bb8b75 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:56.537412 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3865/7763] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:18:56 2022] POST /identity/v3/users => generated 293 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:56.538325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0f390-3eee-423f-be4e-2dee62bb8b75 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:56.557127 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3899/7764] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:56.573633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce0a32-a5d8-4a6b-919e-521930e7121b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:56.575054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0f390-3eee-423f-be4e-2dee62bb8b75 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:56.575923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-51ce0a32-a5d8-4a6b-919e-521930e7121b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:56.591735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe00af-7737-45c9-9945-672642c808bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:56.593946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe00af-7737-45c9-9945-672642c808bb admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:56.594407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe00af-7737-45c9-9945-672642c808bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:56.595204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe00af-7737-45c9-9945-672642c808bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:56.597354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe00af-7737-45c9-9945-672642c808bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:56.621265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe00af-7737-45c9-9945-672642c808bb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:56.648738 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3866/7765] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:56.650297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe00af-7737-45c9-9945-672642c808bb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:56.676386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe00af-7737-45c9-9945-672642c808bb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:56.690751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5f838-7d96-4370-b667-fd4246523840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:56.691436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5f838-7d96-4370-b667-fd4246523840 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:56.691725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5f838-7d96-4370-b667-fd4246523840 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:56.692008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5f838-7d96-4370-b667-fd4246523840 admin admin] PATH_INFO: `/v3/projects/d67b9729fd8541d0bfe3db9724fc4a3d/users/eb4d1cce46954207adfcac2faf26876e/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:56.719460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5f838-7d96-4370-b667-fd4246523840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d67b9729fd8541d0bfe3db9724fc4a3d, user_id=eb4d1cce46954207adfcac2faf26876e, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:56.724145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce0a32-a5d8-4a6b-919e-521930e7121b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:56.727306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5f838-7d96-4370-b667-fd4246523840 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:56.728932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfb29d-b255-4dd0-8ff1-cc5944f96ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:56.729688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfb29d-b255-4dd0-8ff1-cc5944f96ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:56.730090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfb29d-b255-4dd0-8ff1-cc5944f96ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:56.730421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfb29d-b255-4dd0-8ff1-cc5944f96ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:56.754769 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3867/7766] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:18:56 2022] PUT /identity/v3/projects/d67b9729fd8541d0bfe3db9724fc4a3d/users/eb4d1cce46954207adfcac2faf26876e/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:56.759699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5f838-7d96-4370-b667-fd4246523840 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:56.761717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfb29d-b255-4dd0-8ff1-cc5944f96ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:56.763360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfb29d-b255-4dd0-8ff1-cc5944f96ee6 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:56.797585 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3900/7767] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:18:56.899992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5f838-7d96-4370-b667-fd4246523840 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:56.938693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc27b4-f352-4555-8df6-5780598c8514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:56.939316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc27b4-f352-4555-8df6-5780598c8514 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:56.939603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc27b4-f352-4555-8df6-5780598c8514 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:56.939872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc27b4-f352-4555-8df6-5780598c8514 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:56.942215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc27b4-f352-4555-8df6-5780598c8514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:56.944623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc27b4-f352-4555-8df6-5780598c8514 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:56.964364 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3868/7768] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:18:56.965584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfb29d-b255-4dd0-8ff1-cc5944f96ee6 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:56.986635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfb29d-b255-4dd0-8ff1-cc5944f96ee6 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:56.998879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2595510-c014-45e4-80e2-fe87ad94c379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:56.999540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2595510-c014-45e4-80e2-fe87ad94c379 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:56.999838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2595510-c014-45e4-80e2-fe87ad94c379 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:57.000101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2595510-c014-45e4-80e2-fe87ad94c379 admin admin] PATH_INFO: `/v3/projects/d67b9729fd8541d0bfe3db9724fc4a3d/users/eb4d1cce46954207adfcac2faf26876e/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:57.002205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2595510-c014-45e4-80e2-fe87ad94c379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d67b9729fd8541d0bfe3db9724fc4a3d, user_id=eb4d1cce46954207adfcac2faf26876e, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:57.006111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2595510-c014-45e4-80e2-fe87ad94c379 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:57.019616 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3901/7769] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:18:56 2022] PUT /identity/v3/projects/d67b9729fd8541d0bfe3db9724fc4a3d/users/eb4d1cce46954207adfcac2faf26876e/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:18:57.282492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc27b4-f352-4555-8df6-5780598c8514 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:57.286457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8ffc27b4-f352-4555-8df6-5780598c8514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:57.310359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc27b4-f352-4555-8df6-5780598c8514 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:57.419097 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:57.466257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687412e-ca9b-4e8c-a944-127c8388ac0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:57.467360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687412e-ca9b-4e8c-a944-127c8388ac0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:57.467792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687412e-ca9b-4e8c-a944-127c8388ac0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:57.468275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687412e-ca9b-4e8c-a944-127c8388ac0f admin admin] PATH_INFO: `/v3/projects/d2e778d61b6443fda1fcb9847c5a9d34` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:57.469727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687412e-ca9b-4e8c-a944-127c8388ac0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e778d61b6443fda1fcb9847c5a9d34)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:57.472773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687412e-ca9b-4e8c-a944-127c8388ac0f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:57.587942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3687412e-ca9b-4e8c-a944-127c8388ac0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e778d61b6443fda1fcb9847c5a9d34', 'request_id': 'req-3687412e-ca9b-4e8c-a944-127c8388ac0f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:57.601468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3687412e-ca9b-4e8c-a944-127c8388ac0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e778d61b6443fda1fcb9847c5a9d34', 'request_id': 'req-3687412e-ca9b-4e8c-a944-127c8388ac0f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:57.618535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3687412e-ca9b-4e8c-a944-127c8388ac0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e778d61b6443fda1fcb9847c5a9d34', 'request_id': 'req-3687412e-ca9b-4e8c-a944-127c8388ac0f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:57.659941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3687412e-ca9b-4e8c-a944-127c8388ac0f admin admin] The token cache is being invalidate because project d2e778d61b6443fda1fcb9847c5a9d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:18:57.660633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3687412e-ca9b-4e8c-a944-127c8388ac0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:57.662661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3687412e-ca9b-4e8c-a944-127c8388ac0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:57.666101 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3869/7770] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:18:57 2022] DELETE /identity/v3/projects/d2e778d61b6443fda1fcb9847c5a9d34 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:57.670404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2595510-c014-45e4-80e2-fe87ad94c379 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:57.672505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b2595510-c014-45e4-80e2-fe87ad94c379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:57.695746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2595510-c014-45e4-80e2-fe87ad94c379 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:57.866436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd64e55-840b-4cc5-b545-d7b7565fd1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:57.868832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd64e55-840b-4cc5-b545-d7b7565fd1b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:57.869115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd64e55-840b-4cc5-b545-d7b7565fd1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:57.869385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd64e55-840b-4cc5-b545-d7b7565fd1b7 admin admin] PATH_INFO: `/v3/users/2e6434bbcdb04ebf9138b1e7656cf2af` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:57.872338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd64e55-840b-4cc5-b545-d7b7565fd1b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e6434bbcdb04ebf9138b1e7656cf2af)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:57.875068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd64e55-840b-4cc5-b545-d7b7565fd1b7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:57.961100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2bd64e55-840b-4cc5-b545-d7b7565fd1b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e6434bbcdb04ebf9138b1e7656cf2af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:57.962898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2bd64e55-840b-4cc5-b545-d7b7565fd1b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e6434bbcdb04ebf9138b1e7656cf2af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:57.975539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2bd64e55-840b-4cc5-b545-d7b7565fd1b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e6434bbcdb04ebf9138b1e7656cf2af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:57.978951 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:57.999312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2bd64e55-840b-4cc5-b545-d7b7565fd1b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e6434bbcdb04ebf9138b1e7656cf2af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:58.015575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2bd64e55-840b-4cc5-b545-d7b7565fd1b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e6434bbcdb04ebf9138b1e7656cf2af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:58.025313 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3902/7771] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:18:57 2022] DELETE /identity/v3/users/2e6434bbcdb04ebf9138b1e7656cf2af => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:58.660887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe852f-4589-4189-b969-2b657815d003 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:58.661989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe852f-4589-4189-b969-2b657815d003 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:58.662413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe852f-4589-4189-b969-2b657815d003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:58.737750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5abe852f-4589-4189-b969-2b657815d003 None None] MFA Rules not processed for user `eb4d1cce46954207adfcac2faf26876e`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:58.740582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5abe852f-4589-4189-b969-2b657815d003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:58.849445 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd64e55-840b-4cc5-b545-d7b7565fd1b7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:58.851005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2bd64e55-840b-4cc5-b545-d7b7565fd1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:58.958720 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3870/7772] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:18:58.981465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48d37f-43d2-4126-b9d6-8c6036e729a4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:58.981465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48d37f-43d2-4126-b9d6-8c6036e729a4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:58.982556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48d37f-43d2-4126-b9d6-8c6036e729a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:59.029704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd64e55-840b-4cc5-b545-d7b7565fd1b7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:59.039645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ed48d37f-43d2-4126-b9d6-8c6036e729a4 None None] MFA Rules not processed for user `69db1e8d0ae14bc8bfa8461e23b631a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:59.042365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c0847-cb7c-4f6b-883a-bc6edb3b611a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:59.043670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ed48d37f-43d2-4126-b9d6-8c6036e729a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:59.044415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c0847-cb7c-4f6b-883a-bc6edb3b611a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:59.045469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c0847-cb7c-4f6b-883a-bc6edb3b611a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:59.046946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c0847-cb7c-4f6b-883a-bc6edb3b611a admin admin] PATH_INFO: `/v3/projects/74c4ba33eaf44607a7cfe21a093918c3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:59.049667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c0847-cb7c-4f6b-883a-bc6edb3b611a admin admin] RBAC: Authorizing `identity:delete_project(project_id=74c4ba33eaf44607a7cfe21a093918c3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:59.054903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c0847-cb7c-4f6b-883a-bc6edb3b611a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:59.161149 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:59.198487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f40c0847-cb7c-4f6b-883a-bc6edb3b611a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74c4ba33eaf44607a7cfe21a093918c3', 'request_id': 'req-f40c0847-cb7c-4f6b-883a-bc6edb3b611a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:59.203206 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3871/7773] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:59.217543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f40c0847-cb7c-4f6b-883a-bc6edb3b611a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74c4ba33eaf44607a7cfe21a093918c3', 'request_id': 'req-f40c0847-cb7c-4f6b-883a-bc6edb3b611a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:59.223798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48d37f-43d2-4126-b9d6-8c6036e729a4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:59.227543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ed48d37f-43d2-4126-b9d6-8c6036e729a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:59.264039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f40c0847-cb7c-4f6b-883a-bc6edb3b611a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74c4ba33eaf44607a7cfe21a093918c3', 'request_id': 'req-f40c0847-cb7c-4f6b-883a-bc6edb3b611a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:59.309103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f40c0847-cb7c-4f6b-883a-bc6edb3b611a admin admin] The token cache is being invalidate because project 74c4ba33eaf44607a7cfe21a093918c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:18:59.309644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f40c0847-cb7c-4f6b-883a-bc6edb3b611a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:59.310829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f40c0847-cb7c-4f6b-883a-bc6edb3b611a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:18:59.312857 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3903/7774] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:18:58 2022] DELETE /identity/v3/projects/74c4ba33eaf44607a7cfe21a093918c3 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:18:59.328264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a93c9b-b111-48dc-8740-fb321b654ec9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:59.328580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a93c9b-b111-48dc-8740-fb321b654ec9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:59.329059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a93c9b-b111-48dc-8740-fb321b654ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:59.378235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b0a93c9b-b111-48dc-8740-fb321b654ec9 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:59.379104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b0a93c9b-b111-48dc-8740-fb321b654ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:59.386620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48d37f-43d2-4126-b9d6-8c6036e729a4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:59.505336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd582e6-d147-4a89-87bf-07aaab2f12f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:59.506165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd582e6-d147-4a89-87bf-07aaab2f12f6 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:59.506451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd582e6-d147-4a89-87bf-07aaab2f12f6 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:59.506767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd582e6-d147-4a89-87bf-07aaab2f12f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:59.511423 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3904/7775] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:18:59.513388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47f781-ebd1-411a-b1ac-937742e2adae None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:59.516301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47f781-ebd1-411a-b1ac-937742e2adae None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:59.516582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47f781-ebd1-411a-b1ac-937742e2adae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:59.516799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9dd582e6-d147-4a89-87bf-07aaab2f12f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:59.528514 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:59.546010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0e47f781-ebd1-411a-b1ac-937742e2adae None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:18:59.547695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0e47f781-ebd1-411a-b1ac-937742e2adae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:18:59.577503 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3905/7776] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:18:59.578532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47f781-ebd1-411a-b1ac-937742e2adae None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:59.594220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47f781-ebd1-411a-b1ac-937742e2adae None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:59.605885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750abf7-cb54-43e1-a334-83628a8ee8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:59.606996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750abf7-cb54-43e1-a334-83628a8ee8bc admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:59.606996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750abf7-cb54-43e1-a334-83628a8ee8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:59.607253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750abf7-cb54-43e1-a334-83628a8ee8bc admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:59.608494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750abf7-cb54-43e1-a334-83628a8ee8bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:18:59.608835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750abf7-cb54-43e1-a334-83628a8ee8bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:59.610434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750abf7-cb54-43e1-a334-83628a8ee8bc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:59.646609 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3906/7777] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:18:59.647384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750abf7-cb54-43e1-a334-83628a8ee8bc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:59.682210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750abf7-cb54-43e1-a334-83628a8ee8bc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:59.713867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408d89b-64f6-47b3-8956-efc196611f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:59.714502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408d89b-64f6-47b3-8956-efc196611f84 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:59.714790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408d89b-64f6-47b3-8956-efc196611f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:59.715053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408d89b-64f6-47b3-8956-efc196611f84 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:59.715694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408d89b-64f6-47b3-8956-efc196611f84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:59.724623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd582e6-d147-4a89-87bf-07aaab2f12f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:59.726107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408d89b-64f6-47b3-8956-efc196611f84 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:59.729930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd582e6-d147-4a89-87bf-07aaab2f12f6 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:59.764346 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3872/7778] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:18:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:18:59.815712 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3907/7779] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:18:59 2022] POST /identity/v3/projects => generated 365 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:59.819335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd582e6-d147-4a89-87bf-07aaab2f12f6 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:59.836178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd582e6-d147-4a89-87bf-07aaab2f12f6 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:59.871573 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:18:59.916176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c35ae-8b61-4122-94fe-2259a58171e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:59.916891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c35ae-8b61-4122-94fe-2259a58171e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:59.917237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c35ae-8b61-4122-94fe-2259a58171e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:59.917598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c35ae-8b61-4122-94fe-2259a58171e0 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:59.918366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c35ae-8b61-4122-94fe-2259a58171e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:59.920338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c35ae-8b61-4122-94fe-2259a58171e0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:18:59.957129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408d89b-64f6-47b3-8956-efc196611f84 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:18:59.959523 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3873/7780] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:18:59 2022] POST /identity/v3/users => generated 283 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:18:59.976369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408d89b-64f6-47b3-8956-efc196611f84 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:18:59.983465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ec2ba-c8ee-4bb2-90dc-9c10a55ee686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:18:59.984159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ec2ba-c8ee-4bb2-90dc-9c10a55ee686 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:18:59.984510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ec2ba-c8ee-4bb2-90dc-9c10a55ee686 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:18:59.984923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ec2ba-c8ee-4bb2-90dc-9c10a55ee686 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:18:59.985777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ec2ba-c8ee-4bb2-90dc-9c10a55ee686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:18:59.987751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ec2ba-c8ee-4bb2-90dc-9c10a55ee686 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:00.003406 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3908/7781] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:19:00.004947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c35ae-8b61-4122-94fe-2259a58171e0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:00.021728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c35ae-8b61-4122-94fe-2259a58171e0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:00.036855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fc59d-8972-4f6f-b03f-a0ad5c26e843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:00.037936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fc59d-8972-4f6f-b03f-a0ad5c26e843 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:00.037936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fc59d-8972-4f6f-b03f-a0ad5c26e843 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:00.038330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fc59d-8972-4f6f-b03f-a0ad5c26e843 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:00.039862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fc59d-8972-4f6f-b03f-a0ad5c26e843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:00.042012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fc59d-8972-4f6f-b03f-a0ad5c26e843 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:00.057699 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3874/7782] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:19:00.062349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ec2ba-c8ee-4bb2-90dc-9c10a55ee686 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:00.075260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ec2ba-c8ee-4bb2-90dc-9c10a55ee686 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:00.081172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72058708-9314-4ede-b7f5-b065e4ab78ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:00.082061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72058708-9314-4ede-b7f5-b065e4ab78ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:00.082512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72058708-9314-4ede-b7f5-b065e4ab78ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:00.082969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72058708-9314-4ede-b7f5-b065e4ab78ec admin admin] PATH_INFO: `/v3/projects/1832e4d0cf21481896fa58d904cb78df/users/c75a304ff60048cf894d214e264f94dc/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:00.101830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72058708-9314-4ede-b7f5-b065e4ab78ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1832e4d0cf21481896fa58d904cb78df, user_id=c75a304ff60048cf894d214e264f94dc, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:00.104992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72058708-9314-4ede-b7f5-b065e4ab78ec admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:00.133578 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3909/7783] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:19:00 2022] PUT /identity/v3/projects/1832e4d0cf21481896fa58d904cb78df/users/c75a304ff60048cf894d214e264f94dc/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:00.145817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8030e1-cbe8-470b-a760-cbb72ab134d1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:00.146102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8030e1-cbe8-470b-a760-cbb72ab134d1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:00.146377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8030e1-cbe8-470b-a760-cbb72ab134d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:00.194912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ee8030e1-cbe8-470b-a760-cbb72ab134d1 None None] MFA Rules not processed for user `c75a304ff60048cf894d214e264f94dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:00.196477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ee8030e1-cbe8-470b-a760-cbb72ab134d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:00.336035 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3875/7784] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:00.338219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72058708-9314-4ede-b7f5-b065e4ab78ec admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:00.360335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8030e1-cbe8-470b-a760-cbb72ab134d1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:00.363187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ee8030e1-cbe8-470b-a760-cbb72ab134d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:00.470429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72058708-9314-4ede-b7f5-b065e4ab78ec admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:00.477840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97714b8b-17e7-4995-a13e-2037fae49e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:00.478805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97714b8b-17e7-4995-a13e-2037fae49e7d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:00.479338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8030e1-cbe8-470b-a760-cbb72ab134d1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:00.479798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97714b8b-17e7-4995-a13e-2037fae49e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:00.480571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97714b8b-17e7-4995-a13e-2037fae49e7d admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:00.482148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97714b8b-17e7-4995-a13e-2037fae49e7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:00.483938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b4604-121a-4135-ba15-9c11f9d59c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:00.484547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b4604-121a-4135-ba15-9c11f9d59c75 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:00.484861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b4604-121a-4135-ba15-9c11f9d59c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:00.485133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b4604-121a-4135-ba15-9c11f9d59c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:00.486187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97714b8b-17e7-4995-a13e-2037fae49e7d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:00.487559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-896b4604-121a-4135-ba15-9c11f9d59c75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:00.502188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b4604-121a-4135-ba15-9c11f9d59c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:00.504438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b4604-121a-4135-ba15-9c11f9d59c75 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:00.517605 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3876/7785] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:19:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:19:00.531003 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3910/7786] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:19:00 2022] POST /identity/v3/projects => generated 367 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:19:00.535323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b4604-121a-4135-ba15-9c11f9d59c75 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:00.553035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b4604-121a-4135-ba15-9c11f9d59c75 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:00.635887 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:00.673083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984899e3-6d9f-4cb3-b3a8-3debdec029e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:00.673901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984899e3-6d9f-4cb3-b3a8-3debdec029e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:00.674739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984899e3-6d9f-4cb3-b3a8-3debdec029e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:00.675128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984899e3-6d9f-4cb3-b3a8-3debdec029e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:00.676235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984899e3-6d9f-4cb3-b3a8-3debdec029e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:00.678349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984899e3-6d9f-4cb3-b3a8-3debdec029e4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:00.722335 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3877/7787] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:19:00 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:00.723842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97714b8b-17e7-4995-a13e-2037fae49e7d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:00.741072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97714b8b-17e7-4995-a13e-2037fae49e7d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:00.751768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e78a97-2c4c-4178-a1d5-e1bdaaca51a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:00.757611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e78a97-2c4c-4178-a1d5-e1bdaaca51a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:00.757974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e78a97-2c4c-4178-a1d5-e1bdaaca51a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:00.758250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e78a97-2c4c-4178-a1d5-e1bdaaca51a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:00.759110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e78a97-2c4c-4178-a1d5-e1bdaaca51a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:00.761647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e78a97-2c4c-4178-a1d5-e1bdaaca51a8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:00.788025 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3911/7788] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:19:00.792080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984899e3-6d9f-4cb3-b3a8-3debdec029e4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:00.805366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984899e3-6d9f-4cb3-b3a8-3debdec029e4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:00.810309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c03ba-5d3f-4465-988f-16dbc8fa8522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:00.810975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c03ba-5d3f-4465-988f-16dbc8fa8522 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:00.811257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c03ba-5d3f-4465-988f-16dbc8fa8522 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:00.811678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c03ba-5d3f-4465-988f-16dbc8fa8522 admin admin] PATH_INFO: `/v3/projects/f4b3717f33aa4bbd8556d204d5ee2ea7/users/2e944f762e0f4a4d9d36c3e42b6fa7eb/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:00.847985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c03ba-5d3f-4465-988f-16dbc8fa8522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b3717f33aa4bbd8556d204d5ee2ea7, user_id=2e944f762e0f4a4d9d36c3e42b6fa7eb, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:00.850595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c03ba-5d3f-4465-988f-16dbc8fa8522 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:00.901340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e78a97-2c4c-4178-a1d5-e1bdaaca51a8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:00.916519 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3878/7789] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:19:00 2022] PUT /identity/v3/projects/f4b3717f33aa4bbd8556d204d5ee2ea7/users/2e944f762e0f4a4d9d36c3e42b6fa7eb/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:00.922910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e78a97-2c4c-4178-a1d5-e1bdaaca51a8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:01.048920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010cb21-2df1-497f-b334-c3fb85f4ba51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:01.048920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010cb21-2df1-497f-b334-c3fb85f4ba51 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:01.048920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010cb21-2df1-497f-b334-c3fb85f4ba51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:01.048920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010cb21-2df1-497f-b334-c3fb85f4ba51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:01.049466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010cb21-2df1-497f-b334-c3fb85f4ba51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:01.051989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010cb21-2df1-497f-b334-c3fb85f4ba51 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:01.057822 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:01.092548 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3912/7790] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:19:01.097369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c03ba-5d3f-4465-988f-16dbc8fa8522 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:01.114960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c03ba-5d3f-4465-988f-16dbc8fa8522 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:01.129683 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2b928-2266-4a0c-932d-38bbd438a514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:01.130347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2b928-2266-4a0c-932d-38bbd438a514 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:01.130623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2b928-2266-4a0c-932d-38bbd438a514 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:01.130895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2b928-2266-4a0c-932d-38bbd438a514 admin admin] PATH_INFO: `/v3/projects/f4b3717f33aa4bbd8556d204d5ee2ea7/users/2e944f762e0f4a4d9d36c3e42b6fa7eb/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:01.135620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2b928-2266-4a0c-932d-38bbd438a514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b3717f33aa4bbd8556d204d5ee2ea7, user_id=2e944f762e0f4a4d9d36c3e42b6fa7eb, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:01.145059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2b928-2266-4a0c-932d-38bbd438a514 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:01.164309 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3879/7791] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:19:01 2022] PUT /identity/v3/projects/f4b3717f33aa4bbd8556d204d5ee2ea7/users/2e944f762e0f4a4d9d36c3e42b6fa7eb/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:01.175103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b6b5f-c0df-4e17-8d22-02c8c9d7d939 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:01.175386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b6b5f-c0df-4e17-8d22-02c8c9d7d939 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:01.175926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b6b5f-c0df-4e17-8d22-02c8c9d7d939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:01.208710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0a9b6b5f-c0df-4e17-8d22-02c8c9d7d939 None None] MFA Rules not processed for user `2e944f762e0f4a4d9d36c3e42b6fa7eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:01.210076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0a9b6b5f-c0df-4e17-8d22-02c8c9d7d939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:01.347866 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3913/7792] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:01.350108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2b928-2266-4a0c-932d-38bbd438a514 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:01.363845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2b928-2266-4a0c-932d-38bbd438a514 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:01.369583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41651094-6e6e-4617-8409-3298351f8170 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:01.370212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41651094-6e6e-4617-8409-3298351f8170 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:01.370477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41651094-6e6e-4617-8409-3298351f8170 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:01.370751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41651094-6e6e-4617-8409-3298351f8170 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:01.371425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41651094-6e6e-4617-8409-3298351f8170 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:01.373487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41651094-6e6e-4617-8409-3298351f8170 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:01.400155 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3880/7793] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 10:19:01 2022] POST /identity/v3/roles => generated 235 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:01.404291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b6b5f-c0df-4e17-8d22-02c8c9d7d939 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:01.418179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b6b5f-c0df-4e17-8d22-02c8c9d7d939 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:01.424415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd08d38-3e03-4671-80a0-017e487f8959 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:01.425341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd08d38-3e03-4671-80a0-017e487f8959 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:01.425715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd08d38-3e03-4671-80a0-017e487f8959 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:01.426377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd08d38-3e03-4671-80a0-017e487f8959 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:01.427201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd08d38-3e03-4671-80a0-017e487f8959 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:01.429293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd08d38-3e03-4671-80a0-017e487f8959 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:01.455829 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3914/7794] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 10:19:01 2022] POST /identity/v3/roles => generated 234 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:01.460023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41651094-6e6e-4617-8409-3298351f8170 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:01.494277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41651094-6e6e-4617-8409-3298351f8170 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:01.503234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db9b35-4d79-4f53-bb9a-9a569f28a6f4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:01.504234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db9b35-4d79-4f53-bb9a-9a569f28a6f4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:01.504234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db9b35-4d79-4f53-bb9a-9a569f28a6f4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:01.504397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db9b35-4d79-4f53-bb9a-9a569f28a6f4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:01.506162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db9b35-4d79-4f53-bb9a-9a569f28a6f4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:01.509971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db9b35-4d79-4f53-bb9a-9a569f28a6f4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:01.531747 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3881/7795] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 10:19:01 2022] POST /identity/v3/roles => generated 234 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:01.537987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd08d38-3e03-4671-80a0-017e487f8959 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:01.559969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd08d38-3e03-4671-80a0-017e487f8959 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:01.577311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98f783-99db-4fd3-b85a-3ed4eb47d945 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:01.577955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98f783-99db-4fd3-b85a-3ed4eb47d945 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:01.578244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98f783-99db-4fd3-b85a-3ed4eb47d945 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:01.581790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98f783-99db-4fd3-b85a-3ed4eb47d945 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:01.586245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98f783-99db-4fd3-b85a-3ed4eb47d945 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:01.594800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98f783-99db-4fd3-b85a-3ed4eb47d945 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:01.635922 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3915/7796] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:19:01 2022] POST /identity/v3/domains => generated 276 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:01.639875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db9b35-4d79-4f53-bb9a-9a569f28a6f4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:01.651711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db9b35-4d79-4f53-bb9a-9a569f28a6f4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:01.744087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06f62d-21db-4bf5-a71e-b8261688c68c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:01.748086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06f62d-21db-4bf5-a71e-b8261688c68c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:01.748628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06f62d-21db-4bf5-a71e-b8261688c68c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:01.749005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06f62d-21db-4bf5-a71e-b8261688c68c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:01.749748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06f62d-21db-4bf5-a71e-b8261688c68c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:01.770089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06f62d-21db-4bf5-a71e-b8261688c68c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:01.882645 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3882/7797] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:19:01 2022] POST /identity/v3/projects => generated 400 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:01.883289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98f783-99db-4fd3-b85a-3ed4eb47d945 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:01.899832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98f783-99db-4fd3-b85a-3ed4eb47d945 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:02.078513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1018b-05d3-4676-8f36-331cc615bb80 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:02.079448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1018b-05d3-4676-8f36-331cc615bb80 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:02.079950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1018b-05d3-4676-8f36-331cc615bb80 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:02.081095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1018b-05d3-4676-8f36-331cc615bb80 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:02.082164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1018b-05d3-4676-8f36-331cc615bb80 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:02.084628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1018b-05d3-4676-8f36-331cc615bb80 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:02.125807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06f62d-21db-4bf5-a71e-b8261688c68c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:02.133856 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3916/7798] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Sep 30 10:19:01 2022] POST /identity/v3/groups => generated 301 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:02.143496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06f62d-21db-4bf5-a71e-b8261688c68c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:02.158584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb6c83-c442-4f60-a801-d51f0ea99ff8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:02.159539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb6c83-c442-4f60-a801-d51f0ea99ff8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:02.159971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb6c83-c442-4f60-a801-d51f0ea99ff8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:02.161409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb6c83-c442-4f60-a801-d51f0ea99ff8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:02.163266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb6c83-c442-4f60-a801-d51f0ea99ff8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:02.168737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb6c83-c442-4f60-a801-d51f0ea99ff8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:02.198749 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3883/7799] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 10:19:02 2022] POST /identity/v3/roles => generated 234 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:19:02.204201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1018b-05d3-4676-8f36-331cc615bb80 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:02.225199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1018b-05d3-4676-8f36-331cc615bb80 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:02.240748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9e682-d71c-48a3-aa5b-f745f78c2e52 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:02.242231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9e682-d71c-48a3-aa5b-f745f78c2e52 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:02.244342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9e682-d71c-48a3-aa5b-f745f78c2e52 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:02.244838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9e682-d71c-48a3-aa5b-f745f78c2e52 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:02.247058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9e682-d71c-48a3-aa5b-f745f78c2e52 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:02.251138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9e682-d71c-48a3-aa5b-f745f78c2e52 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:02.294488 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3917/7800] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:19:02 2022] POST /identity/v3/users => generated 442 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:02.299918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb6c83-c442-4f60-a801-d51f0ea99ff8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:02.335332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb6c83-c442-4f60-a801-d51f0ea99ff8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:02.350201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731edadb-4ecd-4e44-a978-c21f1387a0b7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:02.359986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731edadb-4ecd-4e44-a978-c21f1387a0b7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:02.361505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731edadb-4ecd-4e44-a978-c21f1387a0b7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:02.363596 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731edadb-4ecd-4e44-a978-c21f1387a0b7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:02.368323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731edadb-4ecd-4e44-a978-c21f1387a0b7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:02.371823 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-731edadb-4ecd-4e44-a978-c21f1387a0b7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:02.371823 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:19:02.371823 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:19:02.372769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731edadb-4ecd-4e44-a978-c21f1387a0b7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:02.416088 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3884/7801] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 10:19:02 2022] POST /identity/v3/roles => generated 269 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:02.418270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9e682-d71c-48a3-aa5b-f745f78c2e52 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:02.437461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9e682-d71c-48a3-aa5b-f745f78c2e52 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:02.459087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1dc40-4a0f-4677-b272-2c8c9cce5017 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:02.461638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1dc40-4a0f-4677-b272-2c8c9cce5017 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:02.462962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1dc40-4a0f-4677-b272-2c8c9cce5017 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:02.532933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1dc40-4a0f-4677-b272-2c8c9cce5017 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/projects/df7c2a9575914fabb81fe9af8b466311/users/cde74028f39f46a08fc8d515b44b4bf1/roles/ea8fb91a92fb40c2a33699aaccd3902d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:02.642525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1dc40-4a0f-4677-b272-2c8c9cce5017 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_grant(project_id=df7c2a9575914fabb81fe9af8b466311, user_id=cde74028f39f46a08fc8d515b44b4bf1, role_id=ea8fb91a92fb40c2a33699aaccd3902d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:02.646420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1dc40-4a0f-4677-b272-2c8c9cce5017 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:02.685108 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3918/7802] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:19:02 2022] PUT /identity/v3/projects/df7c2a9575914fabb81fe9af8b466311/users/cde74028f39f46a08fc8d515b44b4bf1/roles/ea8fb91a92fb40c2a33699aaccd3902d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:02.686863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731edadb-4ecd-4e44-a978-c21f1387a0b7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:02.710433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731edadb-4ecd-4e44-a978-c21f1387a0b7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:02.744077 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:02.852556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040c85d-8b35-4ccc-9c86-d4273af928f5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:02.853240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040c85d-8b35-4ccc-9c86-d4273af928f5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:02.853530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040c85d-8b35-4ccc-9c86-d4273af928f5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:02.853793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040c85d-8b35-4ccc-9c86-d4273af928f5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:02.854877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040c85d-8b35-4ccc-9c86-d4273af928f5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Adding query filter params (scope.project.id=df7c2a9575914fabb81fe9af8b466311, user.id=cde74028f39f46a08fc8d515b44b4bf1) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:19:02.855614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040c85d-8b35-4ccc-9c86-d4273af928f5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:02.857765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040c85d-8b35-4ccc-9c86-d4273af928f5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:03.000727 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3885/7803] 10.222.0.16 () {58 vars in 1356 bytes} [Fri Sep 30 10:19:02 2022] GET /identity/v3/role_assignments?scope.project.id=df7c2a9575914fabb81fe9af8b466311&user.id=cde74028f39f46a08fc8d515b44b4bf1&effective => generated 228 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:03.005551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1dc40-4a0f-4677-b272-2c8c9cce5017 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:03.029302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1dc40-4a0f-4677-b272-2c8c9cce5017 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:03.065459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aca3c1-517b-4ef6-a4d7-dbf949364690 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:03.067579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aca3c1-517b-4ef6-a4d7-dbf949364690 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:03.067879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aca3c1-517b-4ef6-a4d7-dbf949364690 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:03.068231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aca3c1-517b-4ef6-a4d7-dbf949364690 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/projects/df7c2a9575914fabb81fe9af8b466311/users/cde74028f39f46a08fc8d515b44b4bf1/roles/ea8fb91a92fb40c2a33699aaccd3902d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:03.083380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aca3c1-517b-4ef6-a4d7-dbf949364690 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=df7c2a9575914fabb81fe9af8b466311, user_id=cde74028f39f46a08fc8d515b44b4bf1, role_id=ea8fb91a92fb40c2a33699aaccd3902d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:03.086094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aca3c1-517b-4ef6-a4d7-dbf949364690 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:03.104837 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:03.108733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c0aca3c1-517b-4ef6-a4d7-dbf949364690 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invalidating the token cache because role ea8fb91a92fb40c2a33699aaccd3902d was removed from user cde74028f39f46a08fc8d515b44b4bf1 on project df7c2a9575914fabb81fe9af8b466311. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:03.109044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c0aca3c1-517b-4ef6-a4d7-dbf949364690 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:03.111578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c0aca3c1-517b-4ef6-a4d7-dbf949364690 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:03.173280 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3919/7804] 10.222.0.16 () {58 vars in 1467 bytes} [Fri Sep 30 10:19:03 2022] DELETE /identity/v3/projects/df7c2a9575914fabb81fe9af8b466311/users/cde74028f39f46a08fc8d515b44b4bf1/roles/ea8fb91a92fb40c2a33699aaccd3902d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:19:03.179085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040c85d-8b35-4ccc-9c86-d4273af928f5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:03.180899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e040c85d-8b35-4ccc-9c86-d4273af928f5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:03.224332 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040c85d-8b35-4ccc-9c86-d4273af928f5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:03.398757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c454dfb-2df7-435a-9327-740b9a59fba6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:03.399537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c454dfb-2df7-435a-9327-740b9a59fba6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:03.400124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c454dfb-2df7-435a-9327-740b9a59fba6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:03.400371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c454dfb-2df7-435a-9327-740b9a59fba6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/ea8fb91a92fb40c2a33699aaccd3902d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:03.403324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c454dfb-2df7-435a-9327-740b9a59fba6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=ea8fb91a92fb40c2a33699aaccd3902d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:03.405714 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-4c454dfb-2df7-435a-9327-740b9a59fba6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:03.405714 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:19:03.405714 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:19:03.410193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c454dfb-2df7-435a-9327-740b9a59fba6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:03.494553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4c454dfb-2df7-435a-9327-740b9a59fba6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invalidating the token cache because role ea8fb91a92fb40c2a33699aaccd3902d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:03.495349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4c454dfb-2df7-435a-9327-740b9a59fba6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:03.496470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4c454dfb-2df7-435a-9327-740b9a59fba6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:03.499106 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3886/7805] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:03 2022] DELETE /identity/v3/roles/ea8fb91a92fb40c2a33699aaccd3902d => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:03.504071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aca3c1-517b-4ef6-a4d7-dbf949364690 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:03.519901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aca3c1-517b-4ef6-a4d7-dbf949364690 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:03.668803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6d75e-0df0-4410-8bda-7e7d3d28d139 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:03.669498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6d75e-0df0-4410-8bda-7e7d3d28d139 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:03.669781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6d75e-0df0-4410-8bda-7e7d3d28d139 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:03.670059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6d75e-0df0-4410-8bda-7e7d3d28d139 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/projects/df7c2a9575914fabb81fe9af8b466311/users/cde74028f39f46a08fc8d515b44b4bf1/roles/960ff815a9a7405290b6c72e7141fbe3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:03.678139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6d75e-0df0-4410-8bda-7e7d3d28d139 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_grant(project_id=df7c2a9575914fabb81fe9af8b466311, user_id=cde74028f39f46a08fc8d515b44b4bf1, role_id=960ff815a9a7405290b6c72e7141fbe3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:03.687556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6d75e-0df0-4410-8bda-7e7d3d28d139 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:03.728400 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3920/7806] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:19:03 2022] PUT /identity/v3/projects/df7c2a9575914fabb81fe9af8b466311/users/cde74028f39f46a08fc8d515b44b4bf1/roles/960ff815a9a7405290b6c72e7141fbe3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:03.730990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c454dfb-2df7-435a-9327-740b9a59fba6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:03.733743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4c454dfb-2df7-435a-9327-740b9a59fba6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:03.760474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c454dfb-2df7-435a-9327-740b9a59fba6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:03.864131 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:03.913615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d1637-cfcd-465f-bf83-30b7bce48ed2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:03.914443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d1637-cfcd-465f-bf83-30b7bce48ed2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:03.914814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d1637-cfcd-465f-bf83-30b7bce48ed2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:03.915170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d1637-cfcd-465f-bf83-30b7bce48ed2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:03.918373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d1637-cfcd-465f-bf83-30b7bce48ed2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=960ff815a9a7405290b6c72e7141fbe3, implied_role_id=511387bef84a4f099693b71cdfa55883)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:03.922323 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-ce4d1637-cfcd-465f-bf83-30b7bce48ed2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:03.922323 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:19:03.922323 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:19:03.925872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d1637-cfcd-465f-bf83-30b7bce48ed2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:03.992308 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3887/7807] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Sep 30 10:19:03 2022] PUT /identity/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883 => generated 520 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:03.993301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6d75e-0df0-4410-8bda-7e7d3d28d139 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:04.029140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6d75e-0df0-4410-8bda-7e7d3d28d139 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:04.200311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8eac1d-f06c-4f98-82c0-f7efd18de5f4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:04.201989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8eac1d-f06c-4f98-82c0-f7efd18de5f4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:04.202512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8eac1d-f06c-4f98-82c0-f7efd18de5f4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:04.203014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8eac1d-f06c-4f98-82c0-f7efd18de5f4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:04.204517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8eac1d-f06c-4f98-82c0-f7efd18de5f4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Adding query filter params (scope.project.id=df7c2a9575914fabb81fe9af8b466311, user.id=cde74028f39f46a08fc8d515b44b4bf1) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:19:04.204998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8eac1d-f06c-4f98-82c0-f7efd18de5f4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:04.206705 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-7c8eac1d-f06c-4f98-82c0-f7efd18de5f4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:04.206705 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:19:04.206705 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:19:04.208768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8eac1d-f06c-4f98-82c0-f7efd18de5f4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:04.301474 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3921/7808] 10.222.0.16 () {58 vars in 1356 bytes} [Fri Sep 30 10:19:03 2022] GET /identity/v3/role_assignments?scope.project.id=df7c2a9575914fabb81fe9af8b466311&user.id=cde74028f39f46a08fc8d515b44b4bf1&effective => generated 1061 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:19:04.305921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d1637-cfcd-465f-bf83-30b7bce48ed2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:04.323162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d1637-cfcd-465f-bf83-30b7bce48ed2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:04.341180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb1e51-5b22-404f-abc7-f008c1036907 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:04.341948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb1e51-5b22-404f-abc7-f008c1036907 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:04.342388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb1e51-5b22-404f-abc7-f008c1036907 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:04.342681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb1e51-5b22-404f-abc7-f008c1036907 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:04.345209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb1e51-5b22-404f-abc7-f008c1036907 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=960ff815a9a7405290b6c72e7141fbe3, implied_role_id=511387bef84a4f099693b71cdfa55883)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:04.346466 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-80eb1e51-5b22-404f-abc7-f008c1036907 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:04.346466 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:19:04.346466 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:19:04.347645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb1e51-5b22-404f-abc7-f008c1036907 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:04.369282 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3888/7809] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Sep 30 10:19:04 2022] DELETE /identity/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:04.373557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8eac1d-f06c-4f98-82c0-f7efd18de5f4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:04.386913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8eac1d-f06c-4f98-82c0-f7efd18de5f4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:04.465562 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:04.498500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30920f5-fcf0-43c8-8781-70274c3fd1e7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:04.499648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30920f5-fcf0-43c8-8781-70274c3fd1e7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:04.500081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30920f5-fcf0-43c8-8781-70274c3fd1e7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:04.500547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30920f5-fcf0-43c8-8781-70274c3fd1e7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:04.501634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30920f5-fcf0-43c8-8781-70274c3fd1e7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Adding query filter params (scope.project.id=df7c2a9575914fabb81fe9af8b466311, user.id=cde74028f39f46a08fc8d515b44b4bf1) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:19:04.502798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30920f5-fcf0-43c8-8781-70274c3fd1e7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:04.505979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30920f5-fcf0-43c8-8781-70274c3fd1e7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:04.589197 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3922/7810] 10.222.0.16 () {58 vars in 1356 bytes} [Fri Sep 30 10:19:04 2022] GET /identity/v3/role_assignments?scope.project.id=df7c2a9575914fabb81fe9af8b466311&user.id=cde74028f39f46a08fc8d515b44b4bf1&effective => generated 577 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:19:04.592849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb1e51-5b22-404f-abc7-f008c1036907 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:04.608666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb1e51-5b22-404f-abc7-f008c1036907 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:04.615437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60150e49-db31-4f13-a11a-e5a51861b46f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:04.616179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60150e49-db31-4f13-a11a-e5a51861b46f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:04.616790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60150e49-db31-4f13-a11a-e5a51861b46f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:04.617179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60150e49-db31-4f13-a11a-e5a51861b46f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:04.630350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60150e49-db31-4f13-a11a-e5a51861b46f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=960ff815a9a7405290b6c72e7141fbe3, implied_role_id=511387bef84a4f099693b71cdfa55883)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:04.632975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60150e49-db31-4f13-a11a-e5a51861b46f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:04.660815 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-60150e49-db31-4f13-a11a-e5a51861b46f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] 960ff815a9a7405290b6c72e7141fbe3 does not imply 511387bef84a4f099693b71cdfa55883.: keystone.exception.ImpliedRoleNotFound: 960ff815a9a7405290b6c72e7141fbe3 does not imply 511387bef84a4f099693b71cdfa55883. Sep 30 10:19:04.660815 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:19:04.660815 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Sep 30 10:19:04.660815 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = query.one() Sep 30 10:19:04.660815 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Sep 30 10:19:04.660815 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._iter().one() Sep 30 10:19:04.660815 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Sep 30 10:19:04.660815 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._only_one_row( Sep 30 10:19:04.660815 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Sep 30 10:19:04.660815 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exc.NoResultFound( Sep 30 10:19:04.660815 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Sep 30 10:19:04.660815 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:19:04.660815 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:19:04.660815 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:19:04.660815 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:19:04.660815 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:19:04.661847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:19:04.661847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:19:04.661847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:19:04.661847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:19:04.661847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:19:04.661847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:19:04.661847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:19:04.661847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:19:04.661847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:19:04.661847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Sep 30 10:19:04.661847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Sep 30 10:19:04.661847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:19:04.661847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:19:04.661847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Sep 30 10:19:04.661847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Sep 30 10:19:04.661847 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Sep 30 10:19:04.662697 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Sep 30 10:19:04.662697 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Sep 30 10:19:04.662697 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Sep 30 10:19:04.662697 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 960ff815a9a7405290b6c72e7141fbe3 does not imply 511387bef84a4f099693b71cdfa55883. Sep 30 10:19:04.662697 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:19:04.665709 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3889/7811] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Sep 30 10:19:04 2022] DELETE /identity/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883 => generated 137 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 30 10:19:04.670873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30920f5-fcf0-43c8-8781-70274c3fd1e7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:04.686690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30920f5-fcf0-43c8-8781-70274c3fd1e7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:04.694505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee43c1-4c00-4c64-b1d0-f36fc2cb81b3 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:04.695350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee43c1-4c00-4c64-b1d0-f36fc2cb81b3 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:04.695735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee43c1-4c00-4c64-b1d0-f36fc2cb81b3 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:04.696248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee43c1-4c00-4c64-b1d0-f36fc2cb81b3 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/projects/df7c2a9575914fabb81fe9af8b466311/users/cde74028f39f46a08fc8d515b44b4bf1/roles/960ff815a9a7405290b6c72e7141fbe3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:04.699091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee43c1-4c00-4c64-b1d0-f36fc2cb81b3 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=df7c2a9575914fabb81fe9af8b466311, user_id=cde74028f39f46a08fc8d515b44b4bf1, role_id=960ff815a9a7405290b6c72e7141fbe3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:04.709080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee43c1-4c00-4c64-b1d0-f36fc2cb81b3 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:04.717608 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4fee43c1-4c00-4c64-b1d0-f36fc2cb81b3 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invalidating the token cache because role 960ff815a9a7405290b6c72e7141fbe3 was removed from user cde74028f39f46a08fc8d515b44b4bf1 on project df7c2a9575914fabb81fe9af8b466311. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:04.717908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4fee43c1-4c00-4c64-b1d0-f36fc2cb81b3 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:04.719144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4fee43c1-4c00-4c64-b1d0-f36fc2cb81b3 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:04.750137 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3923/7812] 10.222.0.16 () {58 vars in 1467 bytes} [Fri Sep 30 10:19:04 2022] DELETE /identity/v3/projects/df7c2a9575914fabb81fe9af8b466311/users/cde74028f39f46a08fc8d515b44b4bf1/roles/960ff815a9a7405290b6c72e7141fbe3 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:04.756665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60150e49-db31-4f13-a11a-e5a51861b46f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:04.759220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-60150e49-db31-4f13-a11a-e5a51861b46f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:04.774736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60150e49-db31-4f13-a11a-e5a51861b46f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:04.893692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdaa6c-8d0c-4ab6-8ada-d5c38f041bb6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:04.894707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdaa6c-8d0c-4ab6-8ada-d5c38f041bb6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:04.895225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdaa6c-8d0c-4ab6-8ada-d5c38f041bb6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:04.895697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdaa6c-8d0c-4ab6-8ada-d5c38f041bb6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:04.896587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bdaa6c-8d0c-4ab6-8ada-d5c38f041bb6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:04.899685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bdaa6c-8d0c-4ab6-8ada-d5c38f041bb6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:04.954225 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3890/7813] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:19:04 2022] POST /identity/v3/roles => generated 272 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:04.959023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee43c1-4c00-4c64-b1d0-f36fc2cb81b3 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:04.977193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee43c1-4c00-4c64-b1d0-f36fc2cb81b3 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:04.985136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe90a0c-b6f4-4fcf-8eec-f579a8a54712 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:04.985860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe90a0c-b6f4-4fcf-8eec-f579a8a54712 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:04.986375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe90a0c-b6f4-4fcf-8eec-f579a8a54712 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:04.986803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe90a0c-b6f4-4fcf-8eec-f579a8a54712 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:04.989040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe90a0c-b6f4-4fcf-8eec-f579a8a54712 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Adding query filter params (domain_id=99fcf18b279e43d9b011aa640640c61d) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:19:04.989461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe90a0c-b6f4-4fcf-8eec-f579a8a54712 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:04.990941 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-ffe90a0c-b6f4-4fcf-8eec-f579a8a54712 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:04.990941 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:19:04.990941 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:19:04.995560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe90a0c-b6f4-4fcf-8eec-f579a8a54712 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:05.016491 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3924/7814] 10.222.0.16 () {58 vars in 1207 bytes} [Fri Sep 30 10:19:04 2022] GET /identity/v3/roles?domain_id=99fcf18b279e43d9b011aa640640c61d => generated 409 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:05.020967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdaa6c-8d0c-4ab6-8ada-d5c38f041bb6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:05.036688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdaa6c-8d0c-4ab6-8ada-d5c38f041bb6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:05.044007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe90a0c-b6f4-4fcf-8eec-f579a8a54712 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:05.046600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ffe90a0c-b6f4-4fcf-8eec-f579a8a54712 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:05.058892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026565bb-f2ee-40d4-b4ed-c0408d4e1228 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:05.062139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026565bb-f2ee-40d4-b4ed-c0408d4e1228 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:05.062373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026565bb-f2ee-40d4-b4ed-c0408d4e1228 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:05.062648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026565bb-f2ee-40d4-b4ed-c0408d4e1228 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/cd500188072b4eb682f689bab21498d8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:05.066956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026565bb-f2ee-40d4-b4ed-c0408d4e1228 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=cd500188072b4eb682f689bab21498d8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:05.068571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026565bb-f2ee-40d4-b4ed-c0408d4e1228 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:05.168354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-026565bb-f2ee-40d4-b4ed-c0408d4e1228 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invalidating the token cache because role cd500188072b4eb682f689bab21498d8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:05.168737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-026565bb-f2ee-40d4-b4ed-c0408d4e1228 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:05.170029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-026565bb-f2ee-40d4-b4ed-c0408d4e1228 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:05.176259 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3891/7815] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:05 2022] DELETE /identity/v3/roles/cd500188072b4eb682f689bab21498d8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:19:05.180552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026565bb-f2ee-40d4-b4ed-c0408d4e1228 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:05.185003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-026565bb-f2ee-40d4-b4ed-c0408d4e1228 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:05.188425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe90a0c-b6f4-4fcf-8eec-f579a8a54712 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:05.305626 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:05.332655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026565bb-f2ee-40d4-b4ed-c0408d4e1228 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:05.336169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183b61d-7832-43f4-83b8-02af8b901586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:05.336831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183b61d-7832-43f4-83b8-02af8b901586 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:05.337118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183b61d-7832-43f4-83b8-02af8b901586 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:05.337393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183b61d-7832-43f4-83b8-02af8b901586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:05.339214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1183b61d-7832-43f4-83b8-02af8b901586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:05.352371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99bbdd-c2f1-4673-ab79-ea5036bb8343 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:05.352940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99bbdd-c2f1-4673-ab79-ea5036bb8343 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:05.353214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99bbdd-c2f1-4673-ab79-ea5036bb8343 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:05.353488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99bbdd-c2f1-4673-ab79-ea5036bb8343 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:05.354181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99bbdd-c2f1-4673-ab79-ea5036bb8343 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Adding query filter params (domain_id=99fcf18b279e43d9b011aa640640c61d) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:19:05.354493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99bbdd-c2f1-4673-ab79-ea5036bb8343 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:05.355533 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-1e99bbdd-c2f1-4673-ab79-ea5036bb8343 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:05.355533 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:19:05.355533 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:19:05.356801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99bbdd-c2f1-4673-ab79-ea5036bb8343 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:05.374297 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3892/7816] 10.222.0.16 () {58 vars in 1207 bytes} [Fri Sep 30 10:19:05 2022] GET /identity/v3/roles?domain_id=99fcf18b279e43d9b011aa640640c61d => generated 148 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:05.378702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99bbdd-c2f1-4673-ab79-ea5036bb8343 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:05.395796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183b61d-7832-43f4-83b8-02af8b901586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:05.397302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183b61d-7832-43f4-83b8-02af8b901586 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:05.400925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99bbdd-c2f1-4673-ab79-ea5036bb8343 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:05.418321 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3925/7817] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:19:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:19:05.419975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f25e7e-70ee-4f41-a014-409438f326d5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:05.420819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f25e7e-70ee-4f41-a014-409438f326d5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:05.421197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f25e7e-70ee-4f41-a014-409438f326d5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:05.421575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f25e7e-70ee-4f41-a014-409438f326d5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/cd500188072b4eb682f689bab21498d8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:05.449869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f25e7e-70ee-4f41-a014-409438f326d5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 10:19:05.457325 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-97f25e7e-70ee-4f41-a014-409438f326d5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Could not find role: cd500188072b4eb682f689bab21498d8.: keystone.exception.RoleNotFound: Could not find role: cd500188072b4eb682f689bab21498d8. Sep 30 10:19:05.457325 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:19:05.457325 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:19:05.457325 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:19:05.457325 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:19:05.457325 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:19:05.457325 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:19:05.457325 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:19:05.457325 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:19:05.457325 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:19:05.457325 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:19:05.457325 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:19:05.457325 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Sep 30 10:19:05.457325 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Sep 30 10:19:05.458407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 10:19:05.458407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 10:19:05.458407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 10:19:05.458407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 10:19:05.458407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:19:05.458407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:19:05.458407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:19:05.458407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:19:05.458407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:19:05.458407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:19:05.458407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:19:05.458407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 10:19:05.458407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:19:05.458407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:19:05.458407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:19:05.458407 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:19:05.459247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:19:05.459247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:19:05.459247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:19:05.459247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:19:05.459247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 10:19:05.459247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 10:19:05.459247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 10:19:05.459247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 10:19:05.459247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 10:19:05.459247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 10:19:05.459247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: cd500188072b4eb682f689bab21498d8. Sep 30 10:19:05.459247 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:19:05.459247 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3893/7818] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:05 2022] DELETE /identity/v3/roles/cd500188072b4eb682f689bab21498d8 => generated 110 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 30 10:19:05.464344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183b61d-7832-43f4-83b8-02af8b901586 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:05.481334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183b61d-7832-43f4-83b8-02af8b901586 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:05.487020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923eb21c-6265-4c44-98e1-4c55ee4ef2b8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:05.487845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923eb21c-6265-4c44-98e1-4c55ee4ef2b8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:05.488235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923eb21c-6265-4c44-98e1-4c55ee4ef2b8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:05.488627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923eb21c-6265-4c44-98e1-4c55ee4ef2b8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/domains/99fcf18b279e43d9b011aa640640c61d/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:05.497147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923eb21c-6265-4c44-98e1-4c55ee4ef2b8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=99fcf18b279e43d9b011aa640640c61d, group_id=2a3b16f18ec34d7ba5a7201e7bee5a68, role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:05.499929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923eb21c-6265-4c44-98e1-4c55ee4ef2b8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:05.528193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f25e7e-70ee-4f41-a014-409438f326d5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:05.538871 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3926/7819] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:19:05 2022] PUT /identity/v3/domains/99fcf18b279e43d9b011aa640640c61d/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles/3c40facd180f4ddab5d1b39d36a54f55 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:05.541768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f25e7e-70ee-4f41-a014-409438f326d5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:05.618058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d060acd-b669-4933-a6d4-364e5020519c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:05.619135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d060acd-b669-4933-a6d4-364e5020519c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:05.619523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d060acd-b669-4933-a6d4-364e5020519c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:05.619917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d060acd-b669-4933-a6d4-364e5020519c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/domains/99fcf18b279e43d9b011aa640640c61d/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:05.622154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d060acd-b669-4933-a6d4-364e5020519c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=99fcf18b279e43d9b011aa640640c61d, group_id=2a3b16f18ec34d7ba5a7201e7bee5a68)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:05.625537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d060acd-b669-4933-a6d4-364e5020519c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:05.647266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923eb21c-6265-4c44-98e1-4c55ee4ef2b8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:05.658031 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3894/7820] 10.222.0.16 () {58 vars in 1365 bytes} [Fri Sep 30 10:19:05 2022] GET /identity/v3/domains/99fcf18b279e43d9b011aa640640c61d/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles => generated 409 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:05.661821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923eb21c-6265-4c44-98e1-4c55ee4ef2b8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:05.668085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4cf8e-e901-4e1f-8570-c09e7830bed3 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:05.668954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4cf8e-e901-4e1f-8570-c09e7830bed3 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:05.669339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4cf8e-e901-4e1f-8570-c09e7830bed3 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:05.669840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4cf8e-e901-4e1f-8570-c09e7830bed3 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/domains/99fcf18b279e43d9b011aa640640c61d/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:05.672573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4cf8e-e901-4e1f-8570-c09e7830bed3 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=99fcf18b279e43d9b011aa640640c61d, group_id=2a3b16f18ec34d7ba5a7201e7bee5a68, role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:05.676229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4cf8e-e901-4e1f-8570-c09e7830bed3 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:05.708176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d060acd-b669-4933-a6d4-364e5020519c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:05.720181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d060acd-b669-4933-a6d4-364e5020519c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:05.720459 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3927/7821] 10.222.0.16 () {58 vars in 1465 bytes} [Fri Sep 30 10:19:05 2022] HEAD /identity/v3/domains/99fcf18b279e43d9b011aa640640c61d/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles/3c40facd180f4ddab5d1b39d36a54f55 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:05.735098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e69b6a-afa5-40fd-94a8-d876bd3520e4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:05.735948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e69b6a-afa5-40fd-94a8-d876bd3520e4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:05.736341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e69b6a-afa5-40fd-94a8-d876bd3520e4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:05.737705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e69b6a-afa5-40fd-94a8-d876bd3520e4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/domains/99fcf18b279e43d9b011aa640640c61d/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:05.744410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e69b6a-afa5-40fd-94a8-d876bd3520e4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=99fcf18b279e43d9b011aa640640c61d, group_id=2a3b16f18ec34d7ba5a7201e7bee5a68, role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:05.750047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e69b6a-afa5-40fd-94a8-d876bd3520e4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:05.765838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b0e69b6a-afa5-40fd-94a8-d876bd3520e4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invalidating the token cache because role 3c40facd180f4ddab5d1b39d36a54f55 was removed from group 2a3b16f18ec34d7ba5a7201e7bee5a68 on domain 99fcf18b279e43d9b011aa640640c61d. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:05.767230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b0e69b6a-afa5-40fd-94a8-d876bd3520e4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:05.768869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b0e69b6a-afa5-40fd-94a8-d876bd3520e4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:05.800835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4cf8e-e901-4e1f-8570-c09e7830bed3 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:05.801374 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3895/7822] 10.222.0.16 () {58 vars in 1467 bytes} [Fri Sep 30 10:19:05 2022] DELETE /identity/v3/domains/99fcf18b279e43d9b011aa640640c61d/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles/3c40facd180f4ddab5d1b39d36a54f55 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:05.802838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d9f4cf8e-e901-4e1f-8570-c09e7830bed3 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:05.811899 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:05.822758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4cf8e-e901-4e1f-8570-c09e7830bed3 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:05.952818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7deb57c-1d33-4c5c-b7ec-28e302b1a2e5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:05.953976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7deb57c-1d33-4c5c-b7ec-28e302b1a2e5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:05.954330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7deb57c-1d33-4c5c-b7ec-28e302b1a2e5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:05.954685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7deb57c-1d33-4c5c-b7ec-28e302b1a2e5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/projects/df7c2a9575914fabb81fe9af8b466311/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:05.957300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7deb57c-1d33-4c5c-b7ec-28e302b1a2e5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_grant(project_id=df7c2a9575914fabb81fe9af8b466311, group_id=2a3b16f18ec34d7ba5a7201e7bee5a68, role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:05.960427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7deb57c-1d33-4c5c-b7ec-28e302b1a2e5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:05.985559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e69b6a-afa5-40fd-94a8-d876bd3520e4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:05.988177 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3928/7823] 10.222.0.16 () {60 vars in 1486 bytes} [Fri Sep 30 10:19:05 2022] PUT /identity/v3/projects/df7c2a9575914fabb81fe9af8b466311/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles/3c40facd180f4ddab5d1b39d36a54f55 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:06.001531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e69b6a-afa5-40fd-94a8-d876bd3520e4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:06.138341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d3999-93bc-4f5a-85ff-84a17b0eb39b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:06.139016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d3999-93bc-4f5a-85ff-84a17b0eb39b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:06.139916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d3999-93bc-4f5a-85ff-84a17b0eb39b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:06.140198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d3999-93bc-4f5a-85ff-84a17b0eb39b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/projects/df7c2a9575914fabb81fe9af8b466311/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:06.142074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d3999-93bc-4f5a-85ff-84a17b0eb39b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:list_grants(project_id=df7c2a9575914fabb81fe9af8b466311, group_id=2a3b16f18ec34d7ba5a7201e7bee5a68)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:06.145391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d3999-93bc-4f5a-85ff-84a17b0eb39b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:06.171229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7deb57c-1d33-4c5c-b7ec-28e302b1a2e5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:06.182617 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3896/7824] 10.222.0.16 () {58 vars in 1368 bytes} [Fri Sep 30 10:19:05 2022] GET /identity/v3/projects/df7c2a9575914fabb81fe9af8b466311/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles => generated 410 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:06.184093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7deb57c-1d33-4c5c-b7ec-28e302b1a2e5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:06.189259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5d3f5-0be5-4937-b9d4-090be49d330e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:06.190770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5d3f5-0be5-4937-b9d4-090be49d330e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:06.191057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5d3f5-0be5-4937-b9d4-090be49d330e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:06.191333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5d3f5-0be5-4937-b9d4-090be49d330e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/users/cde74028f39f46a08fc8d515b44b4bf1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:06.195185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5d3f5-0be5-4937-b9d4-090be49d330e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=2a3b16f18ec34d7ba5a7201e7bee5a68, user_id=cde74028f39f46a08fc8d515b44b4bf1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:06.202662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5d3f5-0be5-4937-b9d4-090be49d330e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:06.245792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cfcc3-fc61-490f-af93-18e3dfd0b0a0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:06.247062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cfcc3-fc61-490f-af93-18e3dfd0b0a0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:06.248870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cfcc3-fc61-490f-af93-18e3dfd0b0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:06.254622 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3929/7825] 10.222.0.16 () {60 vars in 1360 bytes} [Fri Sep 30 10:19:06 2022] PUT /identity/v3/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/users/cde74028f39f46a08fc8d515b44b4bf1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:06.316585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e47cfcc3-fc61-490f-af93-18e3dfd0b0a0 None None] MFA Rules not processed for user `cde74028f39f46a08fc8d515b44b4bf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:06.317896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e47cfcc3-fc61-490f-af93-18e3dfd0b0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:06.364360 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:06.505483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5d3f5-0be5-4937-b9d4-090be49d330e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:06.505904 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3897/7826] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:06 2022] POST /identity/v3/auth/tokens => generated 3265 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:06.630048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5d3f5-0be5-4937-b9d4-090be49d330e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:06.635796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fa5af-0893-4fa3-a76d-68202dd10ac8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:06.636571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fa5af-0893-4fa3-a76d-68202dd10ac8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:06.637045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fa5af-0893-4fa3-a76d-68202dd10ac8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:06.637472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fa5af-0893-4fa3-a76d-68202dd10ac8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/projects/df7c2a9575914fabb81fe9af8b466311/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:06.639845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fa5af-0893-4fa3-a76d-68202dd10ac8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:check_grant(project_id=df7c2a9575914fabb81fe9af8b466311, group_id=2a3b16f18ec34d7ba5a7201e7bee5a68, role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:06.644344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fa5af-0893-4fa3-a76d-68202dd10ac8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:06.652157 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3930/7827] 10.222.0.16 () {58 vars in 1468 bytes} [Fri Sep 30 10:19:06 2022] HEAD /identity/v3/projects/df7c2a9575914fabb81fe9af8b466311/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles/3c40facd180f4ddab5d1b39d36a54f55 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:06.656305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cfcc3-fc61-490f-af93-18e3dfd0b0a0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:06.671782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cfcc3-fc61-490f-af93-18e3dfd0b0a0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:06.677706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f9de1-f2da-42fb-b393-c4168116688d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:06.678605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f9de1-f2da-42fb-b393-c4168116688d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:06.678879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f9de1-f2da-42fb-b393-c4168116688d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:06.679167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f9de1-f2da-42fb-b393-c4168116688d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/projects/df7c2a9575914fabb81fe9af8b466311/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:06.682582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f9de1-f2da-42fb-b393-c4168116688d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=df7c2a9575914fabb81fe9af8b466311, group_id=2a3b16f18ec34d7ba5a7201e7bee5a68, role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:06.686215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f9de1-f2da-42fb-b393-c4168116688d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:06.697048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b1f9de1-f2da-42fb-b393-c4168116688d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invalidating the token cache because role 3c40facd180f4ddab5d1b39d36a54f55 was removed from group 2a3b16f18ec34d7ba5a7201e7bee5a68 on project df7c2a9575914fabb81fe9af8b466311. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:06.697421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b1f9de1-f2da-42fb-b393-c4168116688d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:06.698265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b1f9de1-f2da-42fb-b393-c4168116688d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:06.717312 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3898/7828] 10.222.0.16 () {58 vars in 1470 bytes} [Fri Sep 30 10:19:06 2022] DELETE /identity/v3/projects/df7c2a9575914fabb81fe9af8b466311/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles/3c40facd180f4ddab5d1b39d36a54f55 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:06.722602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fa5af-0893-4fa3-a76d-68202dd10ac8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:06.725145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4a2fa5af-0893-4fa3-a76d-68202dd10ac8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:06.740994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fa5af-0893-4fa3-a76d-68202dd10ac8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:06.877610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97fdbb-0255-432a-bd3d-f4170205475f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:06.879095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97fdbb-0255-432a-bd3d-f4170205475f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:06.879401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97fdbb-0255-432a-bd3d-f4170205475f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:06.879668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97fdbb-0255-432a-bd3d-f4170205475f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/users/cde74028f39f46a08fc8d515b44b4bf1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:06.882222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97fdbb-0255-432a-bd3d-f4170205475f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=2a3b16f18ec34d7ba5a7201e7bee5a68, user_id=cde74028f39f46a08fc8d515b44b4bf1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:06.884269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97fdbb-0255-432a-bd3d-f4170205475f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:06.898979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8e97fdbb-0255-432a-bd3d-f4170205475f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cde74028f39f46a08fc8d515b44b4bf1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:06.934903 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3931/7829] 10.222.0.16 () {58 vars in 1344 bytes} [Fri Sep 30 10:19:06 2022] DELETE /identity/v3/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/users/cde74028f39f46a08fc8d515b44b4bf1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:19:06.936131 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:06.936261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f9de1-f2da-42fb-b393-c4168116688d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:06.955775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f9de1-f2da-42fb-b393-c4168116688d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:07.116337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c4430-a9a8-4b75-96c7-abc5f76c6a2f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:07.117262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c4430-a9a8-4b75-96c7-abc5f76c6a2f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:07.117549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c4430-a9a8-4b75-96c7-abc5f76c6a2f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:07.117830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c4430-a9a8-4b75-96c7-abc5f76c6a2f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/system/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:07.123331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c4430-a9a8-4b75-96c7-abc5f76c6a2f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=2a3b16f18ec34d7ba5a7201e7bee5a68, role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:07.124364 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-de2c4430-a9a8-4b75-96c7-abc5f76c6a2f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:07.124364 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:19:07.124364 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:19:07.125354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c4430-a9a8-4b75-96c7-abc5f76c6a2f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:07.140397 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3899/7830] 10.222.0.16 () {60 vars in 1381 bytes} [Fri Sep 30 10:19:06 2022] PUT /identity/v3/system/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles/3c40facd180f4ddab5d1b39d36a54f55 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:07.145524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97fdbb-0255-432a-bd3d-f4170205475f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:07.162516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97fdbb-0255-432a-bd3d-f4170205475f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:07.167848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e4ac1-1bc7-4a47-881a-26c0cf868f63 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:07.168687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e4ac1-1bc7-4a47-881a-26c0cf868f63 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:07.169301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e4ac1-1bc7-4a47-881a-26c0cf868f63 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:07.169472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e4ac1-1bc7-4a47-881a-26c0cf868f63 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/system/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:07.172758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e4ac1-1bc7-4a47-881a-26c0cf868f63 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=2a3b16f18ec34d7ba5a7201e7bee5a68)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:07.174065 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-0e5e4ac1-1bc7-4a47-881a-26c0cf868f63 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:07.174065 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:19:07.174065 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:19:07.175699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e4ac1-1bc7-4a47-881a-26c0cf868f63 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:07.191611 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3932/7831] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Sep 30 10:19:07 2022] GET /identity/v3/system/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles => generated 375 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:07.195501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c4430-a9a8-4b75-96c7-abc5f76c6a2f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:07.215507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c4430-a9a8-4b75-96c7-abc5f76c6a2f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:07.229965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c6e56-945b-4137-88d4-34cf84570e4c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:07.230824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c6e56-945b-4137-88d4-34cf84570e4c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:07.232778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c6e56-945b-4137-88d4-34cf84570e4c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:07.233293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c6e56-945b-4137-88d4-34cf84570e4c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/system/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:07.235301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c6e56-945b-4137-88d4-34cf84570e4c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=2a3b16f18ec34d7ba5a7201e7bee5a68, role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:07.245572 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-b40c6e56-945b-4137-88d4-34cf84570e4c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:07.245572 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:19:07.245572 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:19:07.249913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c6e56-945b-4137-88d4-34cf84570e4c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:07.274373 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3900/7832] 10.222.0.16 () {58 vars in 1363 bytes} [Fri Sep 30 10:19:07 2022] HEAD /identity/v3/system/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles/3c40facd180f4ddab5d1b39d36a54f55 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:19:07.278320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e4ac1-1bc7-4a47-881a-26c0cf868f63 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:07.294317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e4ac1-1bc7-4a47-881a-26c0cf868f63 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:07.312188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18620bb2-a93e-4b4c-be4d-f2030e7fe7a7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:07.312805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18620bb2-a93e-4b4c-be4d-f2030e7fe7a7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:07.313096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18620bb2-a93e-4b4c-be4d-f2030e7fe7a7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:07.313362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18620bb2-a93e-4b4c-be4d-f2030e7fe7a7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/system/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:07.319544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18620bb2-a93e-4b4c-be4d-f2030e7fe7a7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=2a3b16f18ec34d7ba5a7201e7bee5a68, role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:07.320576 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-18620bb2-a93e-4b4c-be4d-f2030e7fe7a7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:07.320576 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:19:07.320576 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:19:07.321485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18620bb2-a93e-4b4c-be4d-f2030e7fe7a7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:07.338528 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3933/7833] 10.222.0.16 () {58 vars in 1365 bytes} [Fri Sep 30 10:19:07 2022] DELETE /identity/v3/system/groups/2a3b16f18ec34d7ba5a7201e7bee5a68/roles/3c40facd180f4ddab5d1b39d36a54f55 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:07.343668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c6e56-945b-4137-88d4-34cf84570e4c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:07.359344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c6e56-945b-4137-88d4-34cf84570e4c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:07.367876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919f225-3515-4c4b-8aea-7904ae3db44e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:07.369560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919f225-3515-4c4b-8aea-7904ae3db44e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:07.370242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919f225-3515-4c4b-8aea-7904ae3db44e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:07.370723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919f225-3515-4c4b-8aea-7904ae3db44e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/domains/99fcf18b279e43d9b011aa640640c61d/users/cde74028f39f46a08fc8d515b44b4bf1/roles/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:07.377175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919f225-3515-4c4b-8aea-7904ae3db44e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=99fcf18b279e43d9b011aa640640c61d, user_id=cde74028f39f46a08fc8d515b44b4bf1, role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:07.383290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919f225-3515-4c4b-8aea-7904ae3db44e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:07.426479 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3901/7834] 10.222.0.16 () {60 vars in 1480 bytes} [Fri Sep 30 10:19:07 2022] PUT /identity/v3/domains/99fcf18b279e43d9b011aa640640c61d/users/cde74028f39f46a08fc8d515b44b4bf1/roles/3c40facd180f4ddab5d1b39d36a54f55 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:07.431325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18620bb2-a93e-4b4c-be4d-f2030e7fe7a7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:07.454149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18620bb2-a93e-4b4c-be4d-f2030e7fe7a7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:07.546983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec7b63-36be-4c01-bcef-d364a199dbdf tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:07.547572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec7b63-36be-4c01-bcef-d364a199dbdf tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:07.547851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec7b63-36be-4c01-bcef-d364a199dbdf tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:07.548714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec7b63-36be-4c01-bcef-d364a199dbdf tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/domains/99fcf18b279e43d9b011aa640640c61d/users/cde74028f39f46a08fc8d515b44b4bf1/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:07.550705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec7b63-36be-4c01-bcef-d364a199dbdf tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=99fcf18b279e43d9b011aa640640c61d, user_id=cde74028f39f46a08fc8d515b44b4bf1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:07.553252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec7b63-36be-4c01-bcef-d364a199dbdf tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:07.569197 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3934/7835] 10.222.0.16 () {58 vars in 1362 bytes} [Fri Sep 30 10:19:07 2022] GET /identity/v3/domains/99fcf18b279e43d9b011aa640640c61d/users/cde74028f39f46a08fc8d515b44b4bf1/roles => generated 408 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:07.573084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919f225-3515-4c4b-8aea-7904ae3db44e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:07.585665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919f225-3515-4c4b-8aea-7904ae3db44e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:07.592299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5abf7c-7d29-4a0a-8512-e4e2b9092481 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:07.593686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5abf7c-7d29-4a0a-8512-e4e2b9092481 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:07.594240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5abf7c-7d29-4a0a-8512-e4e2b9092481 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:07.594679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5abf7c-7d29-4a0a-8512-e4e2b9092481 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/domains/99fcf18b279e43d9b011aa640640c61d/users/cde74028f39f46a08fc8d515b44b4bf1/roles/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:07.599487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5abf7c-7d29-4a0a-8512-e4e2b9092481 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=99fcf18b279e43d9b011aa640640c61d, user_id=cde74028f39f46a08fc8d515b44b4bf1, role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:07.603977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5abf7c-7d29-4a0a-8512-e4e2b9092481 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:07.633271 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3902/7836] 10.222.0.16 () {58 vars in 1462 bytes} [Fri Sep 30 10:19:07 2022] HEAD /identity/v3/domains/99fcf18b279e43d9b011aa640640c61d/users/cde74028f39f46a08fc8d515b44b4bf1/roles/3c40facd180f4ddab5d1b39d36a54f55 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:07.637233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec7b63-36be-4c01-bcef-d364a199dbdf tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:07.660586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec7b63-36be-4c01-bcef-d364a199dbdf tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:07.685262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790c479-651e-4e63-976b-edf363d83f7f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:07.685943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790c479-651e-4e63-976b-edf363d83f7f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:07.686235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790c479-651e-4e63-976b-edf363d83f7f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:07.686556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790c479-651e-4e63-976b-edf363d83f7f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/domains/99fcf18b279e43d9b011aa640640c61d/users/cde74028f39f46a08fc8d515b44b4bf1/roles/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:07.692089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790c479-651e-4e63-976b-edf363d83f7f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=99fcf18b279e43d9b011aa640640c61d, user_id=cde74028f39f46a08fc8d515b44b4bf1, role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:07.701897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790c479-651e-4e63-976b-edf363d83f7f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:07.715392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d790c479-651e-4e63-976b-edf363d83f7f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invalidating the token cache because role 3c40facd180f4ddab5d1b39d36a54f55 was removed from user cde74028f39f46a08fc8d515b44b4bf1 on domain 99fcf18b279e43d9b011aa640640c61d. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:07.715704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d790c479-651e-4e63-976b-edf363d83f7f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:07.716470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d790c479-651e-4e63-976b-edf363d83f7f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:07.788502 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3935/7837] 10.222.0.16 () {58 vars in 1464 bytes} [Fri Sep 30 10:19:07 2022] DELETE /identity/v3/domains/99fcf18b279e43d9b011aa640640c61d/users/cde74028f39f46a08fc8d515b44b4bf1/roles/3c40facd180f4ddab5d1b39d36a54f55 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:07.789789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5abf7c-7d29-4a0a-8512-e4e2b9092481 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:07.792193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6e5abf7c-7d29-4a0a-8512-e4e2b9092481 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:07.822089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5abf7c-7d29-4a0a-8512-e4e2b9092481 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:07.938243 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:07.959832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e667e4b-cb9d-4946-ae4a-144764b56e90 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:07.961012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e667e4b-cb9d-4946-ae4a-144764b56e90 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:07.961295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e667e4b-cb9d-4946-ae4a-144764b56e90 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:07.961567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e667e4b-cb9d-4946-ae4a-144764b56e90 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/projects/df7c2a9575914fabb81fe9af8b466311/users/cde74028f39f46a08fc8d515b44b4bf1/roles/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:07.964079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e667e4b-cb9d-4946-ae4a-144764b56e90 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_grant(project_id=df7c2a9575914fabb81fe9af8b466311, user_id=cde74028f39f46a08fc8d515b44b4bf1, role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:07.966954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e667e4b-cb9d-4946-ae4a-144764b56e90 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:07.990920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790c479-651e-4e63-976b-edf363d83f7f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:07.997020 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3903/7838] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:19:07 2022] PUT /identity/v3/projects/df7c2a9575914fabb81fe9af8b466311/users/cde74028f39f46a08fc8d515b44b4bf1/roles/3c40facd180f4ddab5d1b39d36a54f55 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:19:08.003512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790c479-651e-4e63-976b-edf363d83f7f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:08.078447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65f13b-c059-4c41-8236-d504b4120fe2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:08.079988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65f13b-c059-4c41-8236-d504b4120fe2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:08.081199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65f13b-c059-4c41-8236-d504b4120fe2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:08.081884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65f13b-c059-4c41-8236-d504b4120fe2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/projects/df7c2a9575914fabb81fe9af8b466311/users/cde74028f39f46a08fc8d515b44b4bf1/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:08.085647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65f13b-c059-4c41-8236-d504b4120fe2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:list_grants(project_id=df7c2a9575914fabb81fe9af8b466311, user_id=cde74028f39f46a08fc8d515b44b4bf1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:08.088494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65f13b-c059-4c41-8236-d504b4120fe2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:08.108368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e667e4b-cb9d-4946-ae4a-144764b56e90 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:08.121327 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3936/7839] 10.222.0.16 () {58 vars in 1365 bytes} [Fri Sep 30 10:19:07 2022] GET /identity/v3/projects/df7c2a9575914fabb81fe9af8b466311/users/cde74028f39f46a08fc8d515b44b4bf1/roles => generated 409 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:08.124697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e667e4b-cb9d-4946-ae4a-144764b56e90 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:08.131010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba5f44-2df1-4c3e-b679-2f783c8de38b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:08.132566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba5f44-2df1-4c3e-b679-2f783c8de38b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:08.133237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba5f44-2df1-4c3e-b679-2f783c8de38b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:08.133660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba5f44-2df1-4c3e-b679-2f783c8de38b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/projects/df7c2a9575914fabb81fe9af8b466311/users/cde74028f39f46a08fc8d515b44b4bf1/roles/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:08.136132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba5f44-2df1-4c3e-b679-2f783c8de38b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:check_grant(project_id=df7c2a9575914fabb81fe9af8b466311, user_id=cde74028f39f46a08fc8d515b44b4bf1, role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:08.139962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba5f44-2df1-4c3e-b679-2f783c8de38b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:08.153852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65f13b-c059-4c41-8236-d504b4120fe2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:08.165994 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3904/7840] 10.222.0.16 () {58 vars in 1465 bytes} [Fri Sep 30 10:19:08 2022] HEAD /identity/v3/projects/df7c2a9575914fabb81fe9af8b466311/users/cde74028f39f46a08fc8d515b44b4bf1/roles/3c40facd180f4ddab5d1b39d36a54f55 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:19:08.168996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65f13b-c059-4c41-8236-d504b4120fe2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:08.176093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4517d6-1b94-49d6-a07d-72e4567d9ee2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:08.178143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4517d6-1b94-49d6-a07d-72e4567d9ee2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:08.178739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4517d6-1b94-49d6-a07d-72e4567d9ee2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:08.179197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4517d6-1b94-49d6-a07d-72e4567d9ee2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/projects/df7c2a9575914fabb81fe9af8b466311/users/cde74028f39f46a08fc8d515b44b4bf1/roles/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:08.181858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4517d6-1b94-49d6-a07d-72e4567d9ee2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=df7c2a9575914fabb81fe9af8b466311, user_id=cde74028f39f46a08fc8d515b44b4bf1, role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:08.184911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4517d6-1b94-49d6-a07d-72e4567d9ee2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:08.201353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b4517d6-1b94-49d6-a07d-72e4567d9ee2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invalidating the token cache because role 3c40facd180f4ddab5d1b39d36a54f55 was removed from user cde74028f39f46a08fc8d515b44b4bf1 on project df7c2a9575914fabb81fe9af8b466311. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:08.202673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b4517d6-1b94-49d6-a07d-72e4567d9ee2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:08.208550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b4517d6-1b94-49d6-a07d-72e4567d9ee2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:08.240999 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3937/7841] 10.222.0.16 () {58 vars in 1467 bytes} [Fri Sep 30 10:19:08 2022] DELETE /identity/v3/projects/df7c2a9575914fabb81fe9af8b466311/users/cde74028f39f46a08fc8d515b44b4bf1/roles/3c40facd180f4ddab5d1b39d36a54f55 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:08.244955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba5f44-2df1-4c3e-b679-2f783c8de38b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:08.246804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-03ba5f44-2df1-4c3e-b679-2f783c8de38b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:08.266487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba5f44-2df1-4c3e-b679-2f783c8de38b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:08.368764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0022c16-9c01-4aa4-b27c-80fd783c7418 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:08.369791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0022c16-9c01-4aa4-b27c-80fd783c7418 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:08.369791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0022c16-9c01-4aa4-b27c-80fd783c7418 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:08.370044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0022c16-9c01-4aa4-b27c-80fd783c7418 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/system/users/cde74028f39f46a08fc8d515b44b4bf1/roles/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:08.372236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0022c16-9c01-4aa4-b27c-80fd783c7418 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cde74028f39f46a08fc8d515b44b4bf1, role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:08.374626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0022c16-9c01-4aa4-b27c-80fd783c7418 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:08.399383 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3905/7842] 10.222.0.16 () {60 vars in 1378 bytes} [Fri Sep 30 10:19:08 2022] PUT /identity/v3/system/users/cde74028f39f46a08fc8d515b44b4bf1/roles/3c40facd180f4ddab5d1b39d36a54f55 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:08.400426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4517d6-1b94-49d6-a07d-72e4567d9ee2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:08.449961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4517d6-1b94-49d6-a07d-72e4567d9ee2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:08.462072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18badc-b410-4275-801a-80851847d1a8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:08.469691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18badc-b410-4275-801a-80851847d1a8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:08.470216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18badc-b410-4275-801a-80851847d1a8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:08.471206 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18badc-b410-4275-801a-80851847d1a8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/system/users/cde74028f39f46a08fc8d515b44b4bf1/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:08.478883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18badc-b410-4275-801a-80851847d1a8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=cde74028f39f46a08fc8d515b44b4bf1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:08.480883 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-dd18badc-b410-4275-801a-80851847d1a8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:08.480883 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:19:08.480883 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:19:08.484782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18badc-b410-4275-801a-80851847d1a8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:08.531152 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3938/7843] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Sep 30 10:19:08 2022] GET /identity/v3/system/users/cde74028f39f46a08fc8d515b44b4bf1/roles => generated 374 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:08.535234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0022c16-9c01-4aa4-b27c-80fd783c7418 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:08.548734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0022c16-9c01-4aa4-b27c-80fd783c7418 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:08.555036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffc9df-a846-4b06-a6c1-b2d628fd8793 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:08.555726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffc9df-a846-4b06-a6c1-b2d628fd8793 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:08.556009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffc9df-a846-4b06-a6c1-b2d628fd8793 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:08.556290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffc9df-a846-4b06-a6c1-b2d628fd8793 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/system/users/cde74028f39f46a08fc8d515b44b4bf1/roles/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:08.558856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffc9df-a846-4b06-a6c1-b2d628fd8793 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=cde74028f39f46a08fc8d515b44b4bf1, role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:08.559880 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-39ffc9df-a846-4b06-a6c1-b2d628fd8793 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:08.559880 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:19:08.559880 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:19:08.561221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffc9df-a846-4b06-a6c1-b2d628fd8793 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:08.568798 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3906/7844] 10.222.0.16 () {58 vars in 1360 bytes} [Fri Sep 30 10:19:08 2022] HEAD /identity/v3/system/users/cde74028f39f46a08fc8d515b44b4bf1/roles/3c40facd180f4ddab5d1b39d36a54f55 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:19:08.572881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18badc-b410-4275-801a-80851847d1a8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:08.586829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18badc-b410-4275-801a-80851847d1a8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:08.595053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35d3da-45ba-4ec8-a3b3-1b702ea60ed0 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:08.596780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35d3da-45ba-4ec8-a3b3-1b702ea60ed0 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:08.596780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35d3da-45ba-4ec8-a3b3-1b702ea60ed0 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:08.602443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35d3da-45ba-4ec8-a3b3-1b702ea60ed0 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/system/users/cde74028f39f46a08fc8d515b44b4bf1/roles/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:08.602443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35d3da-45ba-4ec8-a3b3-1b702ea60ed0 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=cde74028f39f46a08fc8d515b44b4bf1, role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:08.602443 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-8a35d3da-45ba-4ec8-a3b3-1b702ea60ed0 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:08.602443 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:19:08.602443 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:19:08.602443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35d3da-45ba-4ec8-a3b3-1b702ea60ed0 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:08.604256 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:08.630779 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3939/7845] 10.222.0.16 () {58 vars in 1362 bytes} [Fri Sep 30 10:19:08 2022] DELETE /identity/v3/system/users/cde74028f39f46a08fc8d515b44b4bf1/roles/3c40facd180f4ddab5d1b39d36a54f55 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:19:08.635638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffc9df-a846-4b06-a6c1-b2d628fd8793 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:08.652277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffc9df-a846-4b06-a6c1-b2d628fd8793 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:08.662738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e7fc2-4ffb-47d1-b5d8-8c297c87ff27 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:08.663628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e7fc2-4ffb-47d1-b5d8-8c297c87ff27 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:08.663995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e7fc2-4ffb-47d1-b5d8-8c297c87ff27 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:08.664357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e7fc2-4ffb-47d1-b5d8-8c297c87ff27 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:08.665591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e7fc2-4ffb-47d1-b5d8-8c297c87ff27 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:08.669093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e7fc2-4ffb-47d1-b5d8-8c297c87ff27 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:08.705001 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3907/7846] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 10:19:08 2022] POST /identity/v3/roles => generated 270 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:08.709630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35d3da-45ba-4ec8-a3b3-1b702ea60ed0 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:08.746778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35d3da-45ba-4ec8-a3b3-1b702ea60ed0 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:08.780292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f504fa-a96c-49df-b515-30a787b9ae44 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:08.781054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f504fa-a96c-49df-b515-30a787b9ae44 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:08.781439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f504fa-a96c-49df-b515-30a787b9ae44 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:08.782763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f504fa-a96c-49df-b515-30a787b9ae44 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:08.783857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f504fa-a96c-49df-b515-30a787b9ae44 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:08.785568 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-d7f504fa-a96c-49df-b515-30a787b9ae44 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:08.785568 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:19:08.785568 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:19:08.786556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f504fa-a96c-49df-b515-30a787b9ae44 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:08.828836 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3940/7847] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 10:19:08 2022] POST /identity/v3/roles => generated 269 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:19:08.840027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e7fc2-4ffb-47d1-b5d8-8c297c87ff27 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:08.853562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e7fc2-4ffb-47d1-b5d8-8c297c87ff27 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:08.878642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f25941-245f-4bf6-9f2e-1eabfc663bfa tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:08.879631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f25941-245f-4bf6-9f2e-1eabfc663bfa tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:08.880073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f25941-245f-4bf6-9f2e-1eabfc663bfa tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:08.880520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f25941-245f-4bf6-9f2e-1eabfc663bfa tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/bcf45d2d348d452ebaf048b3a8bee655/implies/85ae983573c143fb84319026600266a2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:08.882713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f25941-245f-4bf6-9f2e-1eabfc663bfa tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bcf45d2d348d452ebaf048b3a8bee655, implied_role_id=85ae983573c143fb84319026600266a2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:08.884835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f25941-245f-4bf6-9f2e-1eabfc663bfa tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:08.965646 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3908/7848] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Sep 30 10:19:08 2022] PUT /identity/v3/roles/bcf45d2d348d452ebaf048b3a8bee655/implies/85ae983573c143fb84319026600266a2 => generated 530 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:08.969771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f504fa-a96c-49df-b515-30a787b9ae44 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:08.989849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f504fa-a96c-49df-b515-30a787b9ae44 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:09.166950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee22e8e-0178-4b44-b34c-2a492d9f2627 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:09.167997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee22e8e-0178-4b44-b34c-2a492d9f2627 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:09.168925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee22e8e-0178-4b44-b34c-2a492d9f2627 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:09.169444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee22e8e-0178-4b44-b34c-2a492d9f2627 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:09.170381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee22e8e-0178-4b44-b34c-2a492d9f2627 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:09.172433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee22e8e-0178-4b44-b34c-2a492d9f2627 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:09.206908 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3941/7849] 10.222.0.16 () {60 vars in 1149 bytes} [Fri Sep 30 10:19:08 2022] POST /identity/v3/domains => generated 277 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:09.211219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f25941-245f-4bf6-9f2e-1eabfc663bfa tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:09.229738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f25941-245f-4bf6-9f2e-1eabfc663bfa tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:09.318210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caf198-b1bd-4c37-bc64-5e9f76cd4908 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:09.319205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caf198-b1bd-4c37-bc64-5e9f76cd4908 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:09.319865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caf198-b1bd-4c37-bc64-5e9f76cd4908 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:09.320348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caf198-b1bd-4c37-bc64-5e9f76cd4908 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:09.321529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28caf198-b1bd-4c37-bc64-5e9f76cd4908 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:09.323368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28caf198-b1bd-4c37-bc64-5e9f76cd4908 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:09.347831 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3909/7850] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 10:19:09 2022] POST /identity/v3/roles => generated 269 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:09.351594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee22e8e-0178-4b44-b34c-2a492d9f2627 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:09.367013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee22e8e-0178-4b44-b34c-2a492d9f2627 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:09.372129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c270450-fae2-4d4a-8970-3e23fd9c97a2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:09.372846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c270450-fae2-4d4a-8970-3e23fd9c97a2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:09.373130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c270450-fae2-4d4a-8970-3e23fd9c97a2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:09.373413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c270450-fae2-4d4a-8970-3e23fd9c97a2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/bcf45d2d348d452ebaf048b3a8bee655/implies/b07efab223704c61a35d9bb19e8df0de` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:09.375046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c270450-fae2-4d4a-8970-3e23fd9c97a2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bcf45d2d348d452ebaf048b3a8bee655, implied_role_id=b07efab223704c61a35d9bb19e8df0de)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:09.376059 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-6c270450-fae2-4d4a-8970-3e23fd9c97a2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:09.376059 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:19:09.376059 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:19:09.377178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c270450-fae2-4d4a-8970-3e23fd9c97a2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:09.416543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caf198-b1bd-4c37-bc64-5e9f76cd4908 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:09.424694 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3942/7851] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Sep 30 10:19:09 2022] PUT /identity/v3/roles/bcf45d2d348d452ebaf048b3a8bee655/implies/b07efab223704c61a35d9bb19e8df0de => generated 530 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:09.430671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caf198-b1bd-4c37-bc64-5e9f76cd4908 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:09.475940 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:09.571076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53eea25-5f78-4d0c-9c35-5296fafa1f6e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:09.571758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eea25-5f78-4d0c-9c35-5296fafa1f6e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:09.572040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eea25-5f78-4d0c-9c35-5296fafa1f6e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:09.572539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eea25-5f78-4d0c-9c35-5296fafa1f6e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/bcf45d2d348d452ebaf048b3a8bee655/implies/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:09.578092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53eea25-5f78-4d0c-9c35-5296fafa1f6e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bcf45d2d348d452ebaf048b3a8bee655, implied_role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:09.581729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53eea25-5f78-4d0c-9c35-5296fafa1f6e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:09.639351 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3910/7852] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Sep 30 10:19:09 2022] PUT /identity/v3/roles/bcf45d2d348d452ebaf048b3a8bee655/implies/3c40facd180f4ddab5d1b39d36a54f55 => generated 525 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:09.640765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c270450-fae2-4d4a-8970-3e23fd9c97a2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:09.654738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c270450-fae2-4d4a-8970-3e23fd9c97a2 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:09.767544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4ee91-c13e-449b-a6a3-72c97df4638f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:09.768230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4ee91-c13e-449b-a6a3-72c97df4638f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:09.768517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4ee91-c13e-449b-a6a3-72c97df4638f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:09.768814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4ee91-c13e-449b-a6a3-72c97df4638f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/3c40facd180f4ddab5d1b39d36a54f55/implies/bcf45d2d348d452ebaf048b3a8bee655` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:09.773956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4ee91-c13e-449b-a6a3-72c97df4638f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=3c40facd180f4ddab5d1b39d36a54f55, implied_role_id=bcf45d2d348d452ebaf048b3a8bee655)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:09.777992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4ee91-c13e-449b-a6a3-72c97df4638f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:09.815123 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-7aa4ee91-c13e-449b-a6a3-72c97df4638f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] bcf45d2d348d452ebaf048b3a8bee655 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: bcf45d2d348d452ebaf048b3a8bee655 cannot be an implied roles. Sep 30 10:19:09.815123 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:19:09.815123 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:19:09.815123 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:19:09.815123 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:19:09.815123 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:19:09.815123 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:19:09.815123 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:19:09.815123 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:19:09.815123 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:19:09.815123 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:19:09.815123 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:19:09.815123 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Sep 30 10:19:09.815123 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Sep 30 10:19:09.816054 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:19:09.816054 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:19:09.816054 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Sep 30 10:19:09.816054 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Sep 30 10:19:09.816054 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: bcf45d2d348d452ebaf048b3a8bee655 cannot be an implied roles. Sep 30 10:19:09.816054 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:19:09.819856 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3943/7853] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Sep 30 10:19:09 2022] PUT /identity/v3/roles/3c40facd180f4ddab5d1b39d36a54f55/implies/bcf45d2d348d452ebaf048b3a8bee655 => generated 116 bytes in 180 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:19:09.820899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53eea25-5f78-4d0c-9c35-5296fafa1f6e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:09.835972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53eea25-5f78-4d0c-9c35-5296fafa1f6e tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:09.842969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e628efd-e023-4ae9-a38d-a8be97341414 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:09.842969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e628efd-e023-4ae9-a38d-a8be97341414 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:09.842969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e628efd-e023-4ae9-a38d-a8be97341414 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:09.855490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e628efd-e023-4ae9-a38d-a8be97341414 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/bcf45d2d348d452ebaf048b3a8bee655/implies/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:09.860065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e628efd-e023-4ae9-a38d-a8be97341414 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bcf45d2d348d452ebaf048b3a8bee655, implied_role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:09.865925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e628efd-e023-4ae9-a38d-a8be97341414 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:09.887294 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3911/7854] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Sep 30 10:19:09 2022] DELETE /identity/v3/roles/bcf45d2d348d452ebaf048b3a8bee655/implies/3c40facd180f4ddab5d1b39d36a54f55 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:09.891276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4ee91-c13e-449b-a6a3-72c97df4638f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:09.905371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4ee91-c13e-449b-a6a3-72c97df4638f tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:09.980078 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:10.026525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d5437-b21a-4eb9-9f19-83bb01357dff tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:10.027165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d5437-b21a-4eb9-9f19-83bb01357dff tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:10.027444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d5437-b21a-4eb9-9f19-83bb01357dff tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:10.027715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d5437-b21a-4eb9-9f19-83bb01357dff tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/bcf45d2d348d452ebaf048b3a8bee655/implies/b07efab223704c61a35d9bb19e8df0de` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:10.029581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d5437-b21a-4eb9-9f19-83bb01357dff tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bcf45d2d348d452ebaf048b3a8bee655, implied_role_id=b07efab223704c61a35d9bb19e8df0de)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:10.031327 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-381d5437-b21a-4eb9-9f19-83bb01357dff tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:10.031327 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:19:10.031327 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:19:10.032396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d5437-b21a-4eb9-9f19-83bb01357dff tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:10.048794 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3944/7855] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Sep 30 10:19:09 2022] DELETE /identity/v3/roles/bcf45d2d348d452ebaf048b3a8bee655/implies/b07efab223704c61a35d9bb19e8df0de => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:10.054295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e628efd-e023-4ae9-a38d-a8be97341414 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:10.067241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e628efd-e023-4ae9-a38d-a8be97341414 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:10.201850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65175a0c-2894-4a54-96fb-60152379f074 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:10.203205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65175a0c-2894-4a54-96fb-60152379f074 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:10.203646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65175a0c-2894-4a54-96fb-60152379f074 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:10.204208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65175a0c-2894-4a54-96fb-60152379f074 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/b07efab223704c61a35d9bb19e8df0de` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:10.222978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65175a0c-2894-4a54-96fb-60152379f074 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=b07efab223704c61a35d9bb19e8df0de)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:10.226521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65175a0c-2894-4a54-96fb-60152379f074 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:10.319044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65175a0c-2894-4a54-96fb-60152379f074 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invalidating the token cache because role b07efab223704c61a35d9bb19e8df0de has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:10.319610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65175a0c-2894-4a54-96fb-60152379f074 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:10.320480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65175a0c-2894-4a54-96fb-60152379f074 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:10.322689 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3912/7856] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:10 2022] DELETE /identity/v3/roles/b07efab223704c61a35d9bb19e8df0de => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:10.327099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d5437-b21a-4eb9-9f19-83bb01357dff tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:10.329174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-381d5437-b21a-4eb9-9f19-83bb01357dff tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:10.347819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d5437-b21a-4eb9-9f19-83bb01357dff tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:10.445492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f43e1-4506-43ed-902a-207366254fc6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:10.446766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f43e1-4506-43ed-902a-207366254fc6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:10.447174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f43e1-4506-43ed-902a-207366254fc6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:10.447661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f43e1-4506-43ed-902a-207366254fc6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/domains/7aa996c8ed674ca2ad8de616b1d254c5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:10.464760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f43e1-4506-43ed-902a-207366254fc6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7aa996c8ed674ca2ad8de616b1d254c5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:10.467279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f43e1-4506-43ed-902a-207366254fc6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:10.496463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-634f43e1-4506-43ed-902a-207366254fc6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7aa996c8ed674ca2ad8de616b1d254c5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:10.497498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-634f43e1-4506-43ed-902a-207366254fc6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7aa996c8ed674ca2ad8de616b1d254c5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:10.538205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-634f43e1-4506-43ed-902a-207366254fc6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7aa996c8ed674ca2ad8de616b1d254c5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:10.539812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-634f43e1-4506-43ed-902a-207366254fc6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7aa996c8ed674ca2ad8de616b1d254c5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:10.548323 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3945/7857] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:19:10 2022] PATCH /identity/v3/domains/7aa996c8ed674ca2ad8de616b1d254c5 => generated 278 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:10.549627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65175a0c-2894-4a54-96fb-60152379f074 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:10.572449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65175a0c-2894-4a54-96fb-60152379f074 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:10.641122 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:10.651806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa60eee-41a2-412a-9046-fd226f37d17b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:10.653188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa60eee-41a2-412a-9046-fd226f37d17b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:10.653812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa60eee-41a2-412a-9046-fd226f37d17b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:10.654639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa60eee-41a2-412a-9046-fd226f37d17b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/domains/7aa996c8ed674ca2ad8de616b1d254c5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:10.673280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa60eee-41a2-412a-9046-fd226f37d17b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7aa996c8ed674ca2ad8de616b1d254c5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:10.675700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa60eee-41a2-412a-9046-fd226f37d17b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:10.706081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cfa60eee-41a2-412a-9046-fd226f37d17b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7aa996c8ed674ca2ad8de616b1d254c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:10.712174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cfa60eee-41a2-412a-9046-fd226f37d17b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7aa996c8ed674ca2ad8de616b1d254c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:10.806049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cfa60eee-41a2-412a-9046-fd226f37d17b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aa996c8ed674ca2ad8de616b1d254c5', 'request_id': 'req-cfa60eee-41a2-412a-9046-fd226f37d17b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:10.817262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cfa60eee-41a2-412a-9046-fd226f37d17b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aa996c8ed674ca2ad8de616b1d254c5', 'request_id': 'req-cfa60eee-41a2-412a-9046-fd226f37d17b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:10.826805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cfa60eee-41a2-412a-9046-fd226f37d17b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aa996c8ed674ca2ad8de616b1d254c5', 'request_id': 'req-cfa60eee-41a2-412a-9046-fd226f37d17b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:10.841626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cfa60eee-41a2-412a-9046-fd226f37d17b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] The token cache is being invalidate because project 7aa996c8ed674ca2ad8de616b1d254c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:10.842004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cfa60eee-41a2-412a-9046-fd226f37d17b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:10.843288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cfa60eee-41a2-412a-9046-fd226f37d17b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:10.853192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cfa60eee-41a2-412a-9046-fd226f37d17b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7aa996c8ed674ca2ad8de616b1d254c5', 'request_id': 'req-cfa60eee-41a2-412a-9046-fd226f37d17b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:10.856919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cfa60eee-41a2-412a-9046-fd226f37d17b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7aa996c8ed674ca2ad8de616b1d254c5', 'request_id': 'req-cfa60eee-41a2-412a-9046-fd226f37d17b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:10.857761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cfa60eee-41a2-412a-9046-fd226f37d17b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7aa996c8ed674ca2ad8de616b1d254c5', 'request_id': 'req-cfa60eee-41a2-412a-9046-fd226f37d17b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:10.865489 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3913/7858] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:19:10 2022] DELETE /identity/v3/domains/7aa996c8ed674ca2ad8de616b1d254c5 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:10.869532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f43e1-4506-43ed-902a-207366254fc6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:10.871302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-634f43e1-4506-43ed-902a-207366254fc6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:10.884211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f43e1-4506-43ed-902a-207366254fc6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:10.959399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af15c6c-0e8d-4404-8985-9cbc27c2654d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:10.960631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af15c6c-0e8d-4404-8985-9cbc27c2654d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:10.961040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af15c6c-0e8d-4404-8985-9cbc27c2654d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:10.961569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af15c6c-0e8d-4404-8985-9cbc27c2654d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/bcf45d2d348d452ebaf048b3a8bee655/implies/85ae983573c143fb84319026600266a2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:10.963488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af15c6c-0e8d-4404-8985-9cbc27c2654d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bcf45d2d348d452ebaf048b3a8bee655, implied_role_id=85ae983573c143fb84319026600266a2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:10.965843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af15c6c-0e8d-4404-8985-9cbc27c2654d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:10.986123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa60eee-41a2-412a-9046-fd226f37d17b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:10.987538 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3946/7859] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Sep 30 10:19:10 2022] DELETE /identity/v3/roles/bcf45d2d348d452ebaf048b3a8bee655/implies/85ae983573c143fb84319026600266a2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:10.989040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cfa60eee-41a2-412a-9046-fd226f37d17b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:11.012338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa60eee-41a2-412a-9046-fd226f37d17b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:11.125783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05ae08-62cd-4183-8ecb-77329c9b7e67 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:11.126071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05ae08-62cd-4183-8ecb-77329c9b7e67 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:11.126343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9fe603-0b94-4fd5-8ef7-0d501127f452 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:11.126487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05ae08-62cd-4183-8ecb-77329c9b7e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:11.127404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fe603-0b94-4fd5-8ef7-0d501127f452 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:11.127916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fe603-0b94-4fd5-8ef7-0d501127f452 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:11.128133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fe603-0b94-4fd5-8ef7-0d501127f452 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/85ae983573c143fb84319026600266a2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:11.129543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9fe603-0b94-4fd5-8ef7-0d501127f452 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=85ae983573c143fb84319026600266a2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:11.131407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9fe603-0b94-4fd5-8ef7-0d501127f452 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:11.154741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1e05ae08-62cd-4183-8ecb-77329c9b7e67 None None] MFA Rules not processed for user `45a25acf184b4bfc9f1b06dcf0e6d81b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:11.155991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1e05ae08-62cd-4183-8ecb-77329c9b7e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:11.185181 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:11.195775 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:11.198019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0d9fe603-0b94-4fd5-8ef7-0d501127f452 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invalidating the token cache because role 85ae983573c143fb84319026600266a2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:11.198615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0d9fe603-0b94-4fd5-8ef7-0d501127f452 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:11.199610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0d9fe603-0b94-4fd5-8ef7-0d501127f452 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:11.207025 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3914/7860] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:10 2022] DELETE /identity/v3/roles/85ae983573c143fb84319026600266a2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:19:11.210916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9fe603-0b94-4fd5-8ef7-0d501127f452 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:11.213371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0d9fe603-0b94-4fd5-8ef7-0d501127f452 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:11.264358 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3947/7861] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:11.304406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9fe603-0b94-4fd5-8ef7-0d501127f452 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:11.309841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97427ad8-7ace-4c7e-a98c-330f530706ea tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:11.310590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97427ad8-7ace-4c7e-a98c-330f530706ea tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:11.310899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97427ad8-7ace-4c7e-a98c-330f530706ea tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:11.311258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97427ad8-7ace-4c7e-a98c-330f530706ea tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/bcf45d2d348d452ebaf048b3a8bee655` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:11.312474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97427ad8-7ace-4c7e-a98c-330f530706ea tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=bcf45d2d348d452ebaf048b3a8bee655)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:11.314215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97427ad8-7ace-4c7e-a98c-330f530706ea tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:11.356001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-97427ad8-7ace-4c7e-a98c-330f530706ea tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invalidating the token cache because role bcf45d2d348d452ebaf048b3a8bee655 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:11.356387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-97427ad8-7ace-4c7e-a98c-330f530706ea tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:11.357102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-97427ad8-7ace-4c7e-a98c-330f530706ea tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:11.359514 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3915/7862] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:11 2022] DELETE /identity/v3/roles/bcf45d2d348d452ebaf048b3a8bee655 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:11.365864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05ae08-62cd-4183-8ecb-77329c9b7e67 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:11.377818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05ae08-62cd-4183-8ecb-77329c9b7e67 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:11.441970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a1456-d68b-48b1-9753-97ce6e6abfa9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:11.442643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a1456-d68b-48b1-9753-97ce6e6abfa9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:11.442931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a1456-d68b-48b1-9753-97ce6e6abfa9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:11.443208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a1456-d68b-48b1-9753-97ce6e6abfa9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:11.445886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a1456-d68b-48b1-9753-97ce6e6abfa9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=960ff815a9a7405290b6c72e7141fbe3, implied_role_id=511387bef84a4f099693b71cdfa55883)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:11.447579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a1456-d68b-48b1-9753-97ce6e6abfa9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:11.484870 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3948/7863] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Sep 30 10:19:11 2022] PUT /identity/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883 => generated 520 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:11.487859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97427ad8-7ace-4c7e-a98c-330f530706ea tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:11.489333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-97427ad8-7ace-4c7e-a98c-330f530706ea tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:11.503857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97427ad8-7ace-4c7e-a98c-330f530706ea tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:11.673071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc0731-59de-4af7-8d0f-bf040ff4a9d9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:11.674286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc0731-59de-4af7-8d0f-bf040ff4a9d9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:11.674756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc0731-59de-4af7-8d0f-bf040ff4a9d9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:11.675114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc0731-59de-4af7-8d0f-bf040ff4a9d9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:11.678669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc0731-59de-4af7-8d0f-bf040ff4a9d9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=960ff815a9a7405290b6c72e7141fbe3, implied_role_id=511387bef84a4f099693b71cdfa55883)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:11.679784 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-56cc0731-59de-4af7-8d0f-bf040ff4a9d9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:11.679784 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:19:11.679784 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:19:11.680896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc0731-59de-4af7-8d0f-bf040ff4a9d9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:11.681879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc0731-59de-4af7-8d0f-bf040ff4a9d9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=960ff815a9a7405290b6c72e7141fbe3, implied_role_id=511387bef84a4f099693b71cdfa55883)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:11.682905 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-56cc0731-59de-4af7-8d0f-bf040ff4a9d9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:11.682905 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:19:11.682905 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:19:11.683734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc0731-59de-4af7-8d0f-bf040ff4a9d9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:11.693735 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3916/7864] 10.222.0.16 () {58 vars in 1345 bytes} [Fri Sep 30 10:19:11 2022] HEAD /identity/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:11.698730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a1456-d68b-48b1-9753-97ce6e6abfa9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:11.711999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a1456-d68b-48b1-9753-97ce6e6abfa9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:11.722591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5086bd6-c145-44bd-87dc-82eb2eb88181 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:11.723614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5086bd6-c145-44bd-87dc-82eb2eb88181 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:11.724118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5086bd6-c145-44bd-87dc-82eb2eb88181 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:11.724678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5086bd6-c145-44bd-87dc-82eb2eb88181 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:11.726587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5086bd6-c145-44bd-87dc-82eb2eb88181 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=960ff815a9a7405290b6c72e7141fbe3, implied_role_id=511387bef84a4f099693b71cdfa55883)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:11.727942 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-d5086bd6-c145-44bd-87dc-82eb2eb88181 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:11.727942 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:19:11.727942 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:19:11.729381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5086bd6-c145-44bd-87dc-82eb2eb88181 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:11.757437 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3949/7865] 10.222.0.16 () {58 vars in 1344 bytes} [Fri Sep 30 10:19:11 2022] GET /identity/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883 => generated 520 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:11.761887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc0731-59de-4af7-8d0f-bf040ff4a9d9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:11.778505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc0731-59de-4af7-8d0f-bf040ff4a9d9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:11.795159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca23d47-a6ac-4b00-bf0d-6b1c23b3d755 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:11.795159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca23d47-a6ac-4b00-bf0d-6b1c23b3d755 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:11.795159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca23d47-a6ac-4b00-bf0d-6b1c23b3d755 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:11.795462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca23d47-a6ac-4b00-bf0d-6b1c23b3d755 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:11.800039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca23d47-a6ac-4b00-bf0d-6b1c23b3d755 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=960ff815a9a7405290b6c72e7141fbe3, implied_role_id=511387bef84a4f099693b71cdfa55883)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:11.809772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca23d47-a6ac-4b00-bf0d-6b1c23b3d755 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:11.827453 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3917/7866] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Sep 30 10:19:11 2022] DELETE /identity/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:19:11.832477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5086bd6-c145-44bd-87dc-82eb2eb88181 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:11.846768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5086bd6-c145-44bd-87dc-82eb2eb88181 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:11.928629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd3525-3ec9-4bc4-969b-02c2cc42b649 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:11.929213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd3525-3ec9-4bc4-969b-02c2cc42b649 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:11.929566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd3525-3ec9-4bc4-969b-02c2cc42b649 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:11.929910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd3525-3ec9-4bc4-969b-02c2cc42b649 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:11.934354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd3525-3ec9-4bc4-969b-02c2cc42b649 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=960ff815a9a7405290b6c72e7141fbe3, implied_role_id=511387bef84a4f099693b71cdfa55883)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:11.936113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd3525-3ec9-4bc4-969b-02c2cc42b649 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:11.958988 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-2cfd3525-3ec9-4bc4-969b-02c2cc42b649 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] 960ff815a9a7405290b6c72e7141fbe3 does not imply 511387bef84a4f099693b71cdfa55883.: keystone.exception.ImpliedRoleNotFound: 960ff815a9a7405290b6c72e7141fbe3 does not imply 511387bef84a4f099693b71cdfa55883. Sep 30 10:19:11.958988 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:19:11.958988 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Sep 30 10:19:11.958988 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = query.one() Sep 30 10:19:11.958988 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Sep 30 10:19:11.958988 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._iter().one() Sep 30 10:19:11.958988 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Sep 30 10:19:11.958988 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._only_one_row( Sep 30 10:19:11.958988 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Sep 30 10:19:11.958988 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exc.NoResultFound( Sep 30 10:19:11.958988 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Sep 30 10:19:11.958988 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:19:11.958988 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:19:11.958988 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:19:11.958988 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:19:11.958988 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:19:11.960205 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:19:11.960205 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:19:11.960205 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:19:11.960205 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:19:11.960205 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:19:11.960205 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:19:11.960205 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:19:11.960205 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:19:11.960205 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:19:11.960205 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Sep 30 10:19:11.960205 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Sep 30 10:19:11.960205 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Sep 30 10:19:11.960205 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Sep 30 10:19:11.960205 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Sep 30 10:19:11.960205 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Sep 30 10:19:11.960205 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Sep 30 10:19:11.961283 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Sep 30 10:19:11.961283 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 960ff815a9a7405290b6c72e7141fbe3 does not imply 511387bef84a4f099693b71cdfa55883. Sep 30 10:19:11.961283 n-d-master-1 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Sep 30 10:19:11.970084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca23d47-a6ac-4b00-bf0d-6b1c23b3d755 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:11.973187 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3950/7867] 10.222.0.16 () {58 vars in 1344 bytes} [Fri Sep 30 10:19:11 2022] GET /identity/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883 => generated 137 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:19:11.997331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca23d47-a6ac-4b00-bf0d-6b1c23b3d755 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:12.007519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a01d7-dd39-46fb-8754-a47691414997 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:12.008219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a01d7-dd39-46fb-8754-a47691414997 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:12.008521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a01d7-dd39-46fb-8754-a47691414997 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:12.008835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a01d7-dd39-46fb-8754-a47691414997 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:12.010651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a01d7-dd39-46fb-8754-a47691414997 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=960ff815a9a7405290b6c72e7141fbe3, implied_role_id=511387bef84a4f099693b71cdfa55883)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:12.012121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a01d7-dd39-46fb-8754-a47691414997 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:12.026223 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-f03a01d7-dd39-46fb-8754-a47691414997 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] 960ff815a9a7405290b6c72e7141fbe3 does not imply 511387bef84a4f099693b71cdfa55883.: keystone.exception.ImpliedRoleNotFound: 960ff815a9a7405290b6c72e7141fbe3 does not imply 511387bef84a4f099693b71cdfa55883. Sep 30 10:19:12.026223 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:19:12.026223 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Sep 30 10:19:12.026223 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = query.one() Sep 30 10:19:12.026223 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Sep 30 10:19:12.026223 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._iter().one() Sep 30 10:19:12.026223 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Sep 30 10:19:12.026223 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._only_one_row( Sep 30 10:19:12.026223 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Sep 30 10:19:12.026223 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exc.NoResultFound( Sep 30 10:19:12.026223 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Sep 30 10:19:12.026223 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:19:12.026223 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:19:12.026223 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:19:12.026223 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:19:12.026223 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:19:12.027166 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:19:12.027166 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:19:12.027166 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:19:12.027166 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:19:12.027166 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:19:12.027166 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:19:12.027166 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:19:12.027166 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:19:12.027166 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:19:12.027166 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Sep 30 10:19:12.027166 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Sep 30 10:19:12.027166 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:19:12.027166 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:19:12.027166 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Sep 30 10:19:12.027166 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Sep 30 10:19:12.027166 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Sep 30 10:19:12.028008 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Sep 30 10:19:12.028008 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Sep 30 10:19:12.028008 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Sep 30 10:19:12.028008 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 960ff815a9a7405290b6c72e7141fbe3 does not imply 511387bef84a4f099693b71cdfa55883. Sep 30 10:19:12.028008 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:19:12.028762 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3918/7868] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Sep 30 10:19:11 2022] DELETE /identity/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883 => generated 137 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 30 10:19:12.032748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd3525-3ec9-4bc4-969b-02c2cc42b649 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:12.047363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd3525-3ec9-4bc4-969b-02c2cc42b649 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:12.054850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e098b-635b-474f-8b4e-e77d721eaeb4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:12.055549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e098b-635b-474f-8b4e-e77d721eaeb4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:12.055838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e098b-635b-474f-8b4e-e77d721eaeb4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:12.057164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e098b-635b-474f-8b4e-e77d721eaeb4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:12.059188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e098b-635b-474f-8b4e-e77d721eaeb4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=960ff815a9a7405290b6c72e7141fbe3, implied_role_id=511387bef84a4f099693b71cdfa55883)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:12.061149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e098b-635b-474f-8b4e-e77d721eaeb4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:12.109393 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3951/7869] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Sep 30 10:19:12 2022] PUT /identity/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883 => generated 520 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:12.111039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a01d7-dd39-46fb-8754-a47691414997 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:12.129204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a01d7-dd39-46fb-8754-a47691414997 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:12.218600 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:12.269283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ae77e-73ca-424c-845c-c809ded08294 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:12.269499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ae77e-73ca-424c-845c-c809ded08294 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:12.269751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ae77e-73ca-424c-845c-c809ded08294 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:12.270030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ae77e-73ca-424c-845c-c809ded08294 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/7beb411df3ff47ed95a9de78184c7082` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:12.273226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ae77e-73ca-424c-845c-c809ded08294 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=960ff815a9a7405290b6c72e7141fbe3, implied_role_id=7beb411df3ff47ed95a9de78184c7082)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:12.275016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ae77e-73ca-424c-845c-c809ded08294 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:12.323226 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3919/7870] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Sep 30 10:19:12 2022] PUT /identity/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/7beb411df3ff47ed95a9de78184c7082 => generated 520 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:12.328197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e098b-635b-474f-8b4e-e77d721eaeb4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:12.344715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e098b-635b-474f-8b4e-e77d721eaeb4 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:12.391405 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:12.418790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ae77e-73ca-424c-845c-c809ded08294 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:12.421266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e04ae77e-73ca-424c-845c-c809ded08294 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:12.460919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d24cf-a049-4832-97ba-124c03c62013 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:12.462302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d24cf-a049-4832-97ba-124c03c62013 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:12.462807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d24cf-a049-4832-97ba-124c03c62013 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:12.463281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d24cf-a049-4832-97ba-124c03c62013 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/7beb411df3ff47ed95a9de78184c7082/implies/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:12.466173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d24cf-a049-4832-97ba-124c03c62013 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7beb411df3ff47ed95a9de78184c7082, implied_role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:12.468385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d24cf-a049-4832-97ba-124c03c62013 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:12.527118 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3952/7871] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Sep 30 10:19:12 2022] PUT /identity/v3/roles/7beb411df3ff47ed95a9de78184c7082/implies/3c40facd180f4ddab5d1b39d36a54f55 => generated 519 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:12.530779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d24cf-a049-4832-97ba-124c03c62013 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:12.591358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ae77e-73ca-424c-845c-c809ded08294 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:12.698552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d24cf-a049-4832-97ba-124c03c62013 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:12.704313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572d3c8-4946-4fcf-aed8-26f90c31e441 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:12.705507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572d3c8-4946-4fcf-aed8-26f90c31e441 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:12.705929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572d3c8-4946-4fcf-aed8-26f90c31e441 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:12.706465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572d3c8-4946-4fcf-aed8-26f90c31e441 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:12.708840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9572d3c8-4946-4fcf-aed8-26f90c31e441 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:12.709935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a876904-09a7-4917-9d1e-88f3e70b5952 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:12.711097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a876904-09a7-4917-9d1e-88f3e70b5952 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:12.711401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a876904-09a7-4917-9d1e-88f3e70b5952 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:12.711714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a876904-09a7-4917-9d1e-88f3e70b5952 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:12.719258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a876904-09a7-4917-9d1e-88f3e70b5952 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:12.722127 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-1a876904-09a7-4917-9d1e-88f3e70b5952 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:12.722127 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:19:12.722127 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:19:12.723102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a876904-09a7-4917-9d1e-88f3e70b5952 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:12.743300 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3953/7872] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Sep 30 10:19:12 2022] GET /identity/v3/role_inferences => generated 1604 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:19:12.747500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a876904-09a7-4917-9d1e-88f3e70b5952 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:12.757016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572d3c8-4946-4fcf-aed8-26f90c31e441 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:12.759055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572d3c8-4946-4fcf-aed8-26f90c31e441 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:12.772921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a876904-09a7-4917-9d1e-88f3e70b5952 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:12.793453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59586bb-5b18-4d60-8d41-22e90a5b3647 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:12.795869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59586bb-5b18-4d60-8d41-22e90a5b3647 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:12.796157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59586bb-5b18-4d60-8d41-22e90a5b3647 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:12.796432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59586bb-5b18-4d60-8d41-22e90a5b3647 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/7beb411df3ff47ed95a9de78184c7082/implies/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:12.796820 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3920/7873] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:19:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:19:12.800083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59586bb-5b18-4d60-8d41-22e90a5b3647 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7beb411df3ff47ed95a9de78184c7082, implied_role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:12.802080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59586bb-5b18-4d60-8d41-22e90a5b3647 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:12.824840 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3954/7874] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Sep 30 10:19:12 2022] DELETE /identity/v3/roles/7beb411df3ff47ed95a9de78184c7082/implies/3c40facd180f4ddab5d1b39d36a54f55 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:12.831160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572d3c8-4946-4fcf-aed8-26f90c31e441 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:12.849037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572d3c8-4946-4fcf-aed8-26f90c31e441 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:12.970273 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:13.017557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45facf7c-f36d-451f-b57c-81171b4824af tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:13.022387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45facf7c-f36d-451f-b57c-81171b4824af tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:13.023044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45facf7c-f36d-451f-b57c-81171b4824af tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:13.023561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45facf7c-f36d-451f-b57c-81171b4824af tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/7beb411df3ff47ed95a9de78184c7082` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:13.027886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45facf7c-f36d-451f-b57c-81171b4824af tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=960ff815a9a7405290b6c72e7141fbe3, implied_role_id=7beb411df3ff47ed95a9de78184c7082)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:13.035113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45facf7c-f36d-451f-b57c-81171b4824af tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:13.050826 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3921/7875] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Sep 30 10:19:12 2022] DELETE /identity/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/7beb411df3ff47ed95a9de78184c7082 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:13.052020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59586bb-5b18-4d60-8d41-22e90a5b3647 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:13.071194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59586bb-5b18-4d60-8d41-22e90a5b3647 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:13.184404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ad583-8951-4fb7-8847-a7ea9a0c7525 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:13.185367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ad583-8951-4fb7-8847-a7ea9a0c7525 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:13.185768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ad583-8951-4fb7-8847-a7ea9a0c7525 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:13.186245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ad583-8951-4fb7-8847-a7ea9a0c7525 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:13.188698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ad583-8951-4fb7-8847-a7ea9a0c7525 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=960ff815a9a7405290b6c72e7141fbe3, implied_role_id=511387bef84a4f099693b71cdfa55883)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:13.192744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ad583-8951-4fb7-8847-a7ea9a0c7525 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:13.216426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45facf7c-f36d-451f-b57c-81171b4824af tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:13.217599 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3955/7876] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Sep 30 10:19:13 2022] DELETE /identity/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:13.229579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45facf7c-f36d-451f-b57c-81171b4824af tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:13.342236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c328409-973e-45bb-8f79-b3d328718e76 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:13.342236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c328409-973e-45bb-8f79-b3d328718e76 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:13.342236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c328409-973e-45bb-8f79-b3d328718e76 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:13.342597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c328409-973e-45bb-8f79-b3d328718e76 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:13.342903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c328409-973e-45bb-8f79-b3d328718e76 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:13.346101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c328409-973e-45bb-8f79-b3d328718e76 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:13.384726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ad583-8951-4fb7-8847-a7ea9a0c7525 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:13.395125 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3922/7877] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:19:13 2022] GET /identity/v3/roles => generated 2321 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:19:13.400328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ad583-8951-4fb7-8847-a7ea9a0c7525 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:13.408570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd5ca7-dd42-497a-b93e-c4d7d12b3c4b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:13.409412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd5ca7-dd42-497a-b93e-c4d7d12b3c4b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:13.409699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd5ca7-dd42-497a-b93e-c4d7d12b3c4b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:13.410001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd5ca7-dd42-497a-b93e-c4d7d12b3c4b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:13.410765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd5ca7-dd42-497a-b93e-c4d7d12b3c4b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:13.412454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd5ca7-dd42-497a-b93e-c4d7d12b3c4b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:13.448223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c328409-973e-45bb-8f79-b3d328718e76 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:13.462056 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3956/7878] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 10:19:13 2022] POST /identity/v3/roles => generated 234 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:19:13.467422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c328409-973e-45bb-8f79-b3d328718e76 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:13.475920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affe023-ad1c-4249-beef-83f89c0794c6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:13.476863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affe023-ad1c-4249-beef-83f89c0794c6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:13.477423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affe023-ad1c-4249-beef-83f89c0794c6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:13.477899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affe023-ad1c-4249-beef-83f89c0794c6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/90aebaa90175453b858bd443caae4e0e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:13.480083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affe023-ad1c-4249-beef-83f89c0794c6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:update_role(role_id=90aebaa90175453b858bd443caae4e0e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:13.482188 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-2affe023-ad1c-4249-beef-83f89c0794c6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:13.482188 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:19:13.482188 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:19:13.483529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affe023-ad1c-4249-beef-83f89c0794c6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:13.528020 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3923/7879] 10.222.0.16 () {60 vars in 1243 bytes} [Fri Sep 30 10:19:13 2022] PATCH /identity/v3/roles/90aebaa90175453b858bd443caae4e0e => generated 238 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:13.532079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd5ca7-dd42-497a-b93e-c4d7d12b3c4b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:13.539772 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:13.546952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd5ca7-dd42-497a-b93e-c4d7d12b3c4b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:13.557707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4b090-4c7e-4b0b-83ce-fb686a6fc183 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:13.558441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4b090-4c7e-4b0b-83ce-fb686a6fc183 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:13.558731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4b090-4c7e-4b0b-83ce-fb686a6fc183 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:13.559012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4b090-4c7e-4b0b-83ce-fb686a6fc183 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/90aebaa90175453b858bd443caae4e0e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:13.573505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4b090-4c7e-4b0b-83ce-fb686a6fc183 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:get_role(role_id=90aebaa90175453b858bd443caae4e0e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:13.574870 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-91c4b090-4c7e-4b0b-83ce-fb686a6fc183 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:13.574870 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:19:13.574870 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:19:13.576137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4b090-4c7e-4b0b-83ce-fb686a6fc183 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:13.578110 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3957/7880] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Sep 30 10:19:13 2022] GET /identity/v3/roles/90aebaa90175453b858bd443caae4e0e => generated 238 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:13.581966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affe023-ad1c-4249-beef-83f89c0794c6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:13.608139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affe023-ad1c-4249-beef-83f89c0794c6 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:13.621507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc6c8e-8688-496a-af05-31a03220ef28 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:13.622924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc6c8e-8688-496a-af05-31a03220ef28 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:13.623656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc6c8e-8688-496a-af05-31a03220ef28 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:13.623941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc6c8e-8688-496a-af05-31a03220ef28 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:13.624667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc6c8e-8688-496a-af05-31a03220ef28 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:13.627895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc6c8e-8688-496a-af05-31a03220ef28 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:13.642626 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3924/7881] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:19:13 2022] GET /identity/v3/roles => generated 2550 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:19:13.647035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4b090-4c7e-4b0b-83ce-fb686a6fc183 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:13.662479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4b090-4c7e-4b0b-83ce-fb686a6fc183 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:13.670884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa641c90-b787-48b7-9af7-0b306a9aed39 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:13.671883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa641c90-b787-48b7-9af7-0b306a9aed39 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:13.672271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa641c90-b787-48b7-9af7-0b306a9aed39 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:13.672732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa641c90-b787-48b7-9af7-0b306a9aed39 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/90aebaa90175453b858bd443caae4e0e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:13.676748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa641c90-b787-48b7-9af7-0b306a9aed39 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_role(role_id=90aebaa90175453b858bd443caae4e0e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:13.678867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa641c90-b787-48b7-9af7-0b306a9aed39 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:13.941546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-aa641c90-b787-48b7-9af7-0b306a9aed39 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invalidating the token cache because role 90aebaa90175453b858bd443caae4e0e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:13.941989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-aa641c90-b787-48b7-9af7-0b306a9aed39 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:13.942757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-aa641c90-b787-48b7-9af7-0b306a9aed39 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:13.945170 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3958/7882] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:13 2022] DELETE /identity/v3/roles/90aebaa90175453b858bd443caae4e0e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:13.951079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc6c8e-8688-496a-af05-31a03220ef28 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:13.953224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-74dc6c8e-8688-496a-af05-31a03220ef28 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:13.978012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc6c8e-8688-496a-af05-31a03220ef28 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:14.074997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be64f4-4945-4b78-9839-c8be97c74927 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:14.075660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be64f4-4945-4b78-9839-c8be97c74927 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:14.076195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be64f4-4945-4b78-9839-c8be97c74927 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:14.076469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be64f4-4945-4b78-9839-c8be97c74927 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:14.078922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be64f4-4945-4b78-9839-c8be97c74927 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=960ff815a9a7405290b6c72e7141fbe3, implied_role_id=511387bef84a4f099693b71cdfa55883)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:14.081823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be64f4-4945-4b78-9839-c8be97c74927 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:14.132777 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3925/7883] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Sep 30 10:19:13 2022] PUT /identity/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883 => generated 520 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:14.136892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa641c90-b787-48b7-9af7-0b306a9aed39 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:14.162776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa641c90-b787-48b7-9af7-0b306a9aed39 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:14.250457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a5635-bc3f-43fe-b2ae-de705932803c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:14.251278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a5635-bc3f-43fe-b2ae-de705932803c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:14.253581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a5635-bc3f-43fe-b2ae-de705932803c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:14.253940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a5635-bc3f-43fe-b2ae-de705932803c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/7beb411df3ff47ed95a9de78184c7082` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:14.255856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a5635-bc3f-43fe-b2ae-de705932803c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=960ff815a9a7405290b6c72e7141fbe3, implied_role_id=7beb411df3ff47ed95a9de78184c7082)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:14.259387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a5635-bc3f-43fe-b2ae-de705932803c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:14.340645 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3959/7884] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Sep 30 10:19:14 2022] PUT /identity/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/7beb411df3ff47ed95a9de78184c7082 => generated 520 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:19:14.343139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be64f4-4945-4b78-9839-c8be97c74927 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:14.354118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be64f4-4945-4b78-9839-c8be97c74927 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:14.379291 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:14.433966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a20d3-799e-4270-bc88-e6bf275b14c8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:14.435482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a20d3-799e-4270-bc88-e6bf275b14c8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:14.436427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a20d3-799e-4270-bc88-e6bf275b14c8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:14.437086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a20d3-799e-4270-bc88-e6bf275b14c8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/7beb411df3ff47ed95a9de78184c7082/implies/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:14.439275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a20d3-799e-4270-bc88-e6bf275b14c8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7beb411df3ff47ed95a9de78184c7082, implied_role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:14.441270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a20d3-799e-4270-bc88-e6bf275b14c8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:14.474921 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3926/7885] 10.222.0.16 () {60 vars in 1363 bytes} [Fri Sep 30 10:19:14 2022] PUT /identity/v3/roles/7beb411df3ff47ed95a9de78184c7082/implies/3c40facd180f4ddab5d1b39d36a54f55 => generated 519 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:14.477435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a5635-bc3f-43fe-b2ae-de705932803c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:14.510127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a5635-bc3f-43fe-b2ae-de705932803c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:14.653418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34d2e5-9c44-444b-9557-bfea159a3d4a tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:14.655644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34d2e5-9c44-444b-9557-bfea159a3d4a tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:14.655644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34d2e5-9c44-444b-9557-bfea159a3d4a tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:14.655644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34d2e5-9c44-444b-9557-bfea159a3d4a tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/7beb411df3ff47ed95a9de78184c7082/implies` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:14.656630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34d2e5-9c44-444b-9557-bfea159a3d4a tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=7beb411df3ff47ed95a9de78184c7082)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:14.657673 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-7f34d2e5-9c44-444b-9557-bfea159a3d4a tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:14.657673 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:19:14.657673 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:19:14.658790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34d2e5-9c44-444b-9557-bfea159a3d4a tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:14.671043 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3960/7886] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Sep 30 10:19:14 2022] GET /identity/v3/roles/7beb411df3ff47ed95a9de78184c7082/implies => generated 488 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:14.675891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a20d3-799e-4270-bc88-e6bf275b14c8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:14.696539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a20d3-799e-4270-bc88-e6bf275b14c8 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:14.718288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382b1bb-bfd3-48ed-b98e-e20fdf6961a1 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:14.719210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382b1bb-bfd3-48ed-b98e-e20fdf6961a1 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:14.719558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382b1bb-bfd3-48ed-b98e-e20fdf6961a1 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:14.719909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382b1bb-bfd3-48ed-b98e-e20fdf6961a1 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:14.721896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1382b1bb-bfd3-48ed-b98e-e20fdf6961a1 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=960ff815a9a7405290b6c72e7141fbe3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:14.723017 n-d-master-1 devstack@keystone.service[82080]: WARNING py.warnings [None req-1382b1bb-bfd3-48ed-b98e-e20fdf6961a1 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:14.723017 n-d-master-1 devstack@keystone.service[82080]: warnings.warn(msg) Sep 30 10:19:14.723017 n-d-master-1 devstack@keystone.service[82080]: Sep 30 10:19:14.725710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1382b1bb-bfd3-48ed-b98e-e20fdf6961a1 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:14.736964 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3927/7887] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Sep 30 10:19:14 2022] GET /identity/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies => generated 659 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:14.740940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34d2e5-9c44-444b-9557-bfea159a3d4a tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:14.768439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34d2e5-9c44-444b-9557-bfea159a3d4a tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:14.786012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720515a-181c-47d2-94b3-e9eab36c45fd tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:14.786820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720515a-181c-47d2-94b3-e9eab36c45fd tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:14.787154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720515a-181c-47d2-94b3-e9eab36c45fd tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:14.787433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720515a-181c-47d2-94b3-e9eab36c45fd tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/7beb411df3ff47ed95a9de78184c7082/implies/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:14.789391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720515a-181c-47d2-94b3-e9eab36c45fd tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7beb411df3ff47ed95a9de78184c7082, implied_role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:14.791355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720515a-181c-47d2-94b3-e9eab36c45fd tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:14.822005 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3961/7888] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Sep 30 10:19:14 2022] DELETE /identity/v3/roles/7beb411df3ff47ed95a9de78184c7082/implies/3c40facd180f4ddab5d1b39d36a54f55 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:14.826450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382b1bb-bfd3-48ed-b98e-e20fdf6961a1 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:14.857083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382b1bb-bfd3-48ed-b98e-e20fdf6961a1 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:15.040906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65be03-2483-4fa4-bc58-c1f2a66d529c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:15.041584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65be03-2483-4fa4-bc58-c1f2a66d529c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:15.041872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65be03-2483-4fa4-bc58-c1f2a66d529c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:15.042328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65be03-2483-4fa4-bc58-c1f2a66d529c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/7beb411df3ff47ed95a9de78184c7082` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:15.045828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65be03-2483-4fa4-bc58-c1f2a66d529c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=960ff815a9a7405290b6c72e7141fbe3, implied_role_id=7beb411df3ff47ed95a9de78184c7082)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:15.048080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65be03-2483-4fa4-bc58-c1f2a66d529c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:15.087044 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3928/7889] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Sep 30 10:19:14 2022] DELETE /identity/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/7beb411df3ff47ed95a9de78184c7082 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:15.091065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720515a-181c-47d2-94b3-e9eab36c45fd tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:15.108156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720515a-181c-47d2-94b3-e9eab36c45fd tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:15.151991 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:15.258462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb57cc-3d27-44b3-bb39-ec99dce55b75 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:15.259358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb57cc-3d27-44b3-bb39-ec99dce55b75 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:15.259721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb57cc-3d27-44b3-bb39-ec99dce55b75 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:15.260047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb57cc-3d27-44b3-bb39-ec99dce55b75 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:15.265805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb57cc-3d27-44b3-bb39-ec99dce55b75 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=960ff815a9a7405290b6c72e7141fbe3, implied_role_id=511387bef84a4f099693b71cdfa55883)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:15.274589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb57cc-3d27-44b3-bb39-ec99dce55b75 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:15.300931 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3962/7890] 10.222.0.16 () {58 vars in 1347 bytes} [Fri Sep 30 10:19:15 2022] DELETE /identity/v3/roles/960ff815a9a7405290b6c72e7141fbe3/implies/511387bef84a4f099693b71cdfa55883 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:15.305795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65be03-2483-4fa4-bc58-c1f2a66d529c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:15.319047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65be03-2483-4fa4-bc58-c1f2a66d529c tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:15.486823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c85c9-3381-477e-9ead-aef9298e6af5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:15.487595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c85c9-3381-477e-9ead-aef9298e6af5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:15.487943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c85c9-3381-477e-9ead-aef9298e6af5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:15.488287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c85c9-3381-477e-9ead-aef9298e6af5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/domains/7aa996c8ed674ca2ad8de616b1d254c5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:15.503877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c85c9-3381-477e-9ead-aef9298e6af5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 10:19:15.509545 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-469c85c9-3381-477e-9ead-aef9298e6af5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Could not find domain: 7aa996c8ed674ca2ad8de616b1d254c5.: keystone.exception.DomainNotFound: Could not find domain: 7aa996c8ed674ca2ad8de616b1d254c5. Sep 30 10:19:15.509545 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:19:15.509545 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 30 10:19:15.509545 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 30 10:19:15.509545 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 10:19:15.509545 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 10:19:15.509545 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 10:19:15.509545 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 10:19:15.509545 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 7aa996c8ed674ca2ad8de616b1d254c5. Sep 30 10:19:15.509545 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:19:15.509545 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 10:19:15.509545 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:19:15.509545 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 10:19:15.509545 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 10:19:15.509545 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 10:19:15.509545 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 10:19:15.510499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 10:19:15.510499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 10:19:15.510499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 10:19:15.510499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 10:19:15.510499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 10:19:15.510499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 10:19:15.510499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 10:19:15.510499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 30 10:19:15.510499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 30 10:19:15.510499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 10:19:15.510499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 10:19:15.510499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 10:19:15.510499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 10:19:15.510499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 10:19:15.510499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 10:19:15.510499 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 10:19:15.514916 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 10:19:15.514916 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 10:19:15.514916 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 10:19:15.514916 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 10:19:15.514916 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Sep 30 10:19:15.514916 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 10:19:15.514916 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Sep 30 10:19:15.514916 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 10:19:15.514916 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 10:19:15.514916 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 10:19:15.514916 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Sep 30 10:19:15.514916 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 10:19:15.514916 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Sep 30 10:19:15.514916 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 30 10:19:15.514916 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 10:19:15.514916 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 7aa996c8ed674ca2ad8de616b1d254c5. Sep 30 10:19:15.514916 n-d-master-1 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Sep 30 10:19:15.515837 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3929/7891] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:19:15 2022] PATCH /identity/v3/domains/7aa996c8ed674ca2ad8de616b1d254c5 => generated 112 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 30 10:19:15.515905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb57cc-3d27-44b3-bb39-ec99dce55b75 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:15.546355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb57cc-3d27-44b3-bb39-ec99dce55b75 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:15.566703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fa208-32e2-4eec-87ff-41cee9da8b45 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:15.567379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fa208-32e2-4eec-87ff-41cee9da8b45 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:15.567667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fa208-32e2-4eec-87ff-41cee9da8b45 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:15.567945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fa208-32e2-4eec-87ff-41cee9da8b45 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/users/cde74028f39f46a08fc8d515b44b4bf1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:15.571180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2fa208-32e2-4eec-87ff-41cee9da8b45 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cde74028f39f46a08fc8d515b44b4bf1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:15.572378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2fa208-32e2-4eec-87ff-41cee9da8b45 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:15.679710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a2fa208-32e2-4eec-87ff-41cee9da8b45 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cde74028f39f46a08fc8d515b44b4bf1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:15.680407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a2fa208-32e2-4eec-87ff-41cee9da8b45 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cde74028f39f46a08fc8d515b44b4bf1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:15.692588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a2fa208-32e2-4eec-87ff-41cee9da8b45 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cde74028f39f46a08fc8d515b44b4bf1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:15.711855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a2fa208-32e2-4eec-87ff-41cee9da8b45 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cde74028f39f46a08fc8d515b44b4bf1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:15.737434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a2fa208-32e2-4eec-87ff-41cee9da8b45 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cde74028f39f46a08fc8d515b44b4bf1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:15.768041 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3963/7892] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:15 2022] DELETE /identity/v3/users/cde74028f39f46a08fc8d515b44b4bf1 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:15.773129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c85c9-3381-477e-9ead-aef9298e6af5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:15.775210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-469c85c9-3381-477e-9ead-aef9298e6af5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:15.796393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c85c9-3381-477e-9ead-aef9298e6af5 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:15.863697 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:15.922981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be359ce2-ca46-4e26-9e72-e2679a9ce3c7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:15.923775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be359ce2-ca46-4e26-9e72-e2679a9ce3c7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:15.924731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be359ce2-ca46-4e26-9e72-e2679a9ce3c7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:15.924731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be359ce2-ca46-4e26-9e72-e2679a9ce3c7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/3c40facd180f4ddab5d1b39d36a54f55` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:15.926018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be359ce2-ca46-4e26-9e72-e2679a9ce3c7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3c40facd180f4ddab5d1b39d36a54f55)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:15.927758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be359ce2-ca46-4e26-9e72-e2679a9ce3c7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:15.999595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-be359ce2-ca46-4e26-9e72-e2679a9ce3c7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invalidating the token cache because role 3c40facd180f4ddab5d1b39d36a54f55 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:16.000627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-be359ce2-ca46-4e26-9e72-e2679a9ce3c7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:16.004297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-be359ce2-ca46-4e26-9e72-e2679a9ce3c7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:16.012386 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3930/7893] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:15 2022] DELETE /identity/v3/roles/3c40facd180f4ddab5d1b39d36a54f55 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:16.016501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fa208-32e2-4eec-87ff-41cee9da8b45 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:16.032223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fa208-32e2-4eec-87ff-41cee9da8b45 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:16.177064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c5c15-e6ce-4acf-b98a-415e14bd9c86 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:16.177724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c5c15-e6ce-4acf-b98a-415e14bd9c86 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:16.178022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c5c15-e6ce-4acf-b98a-415e14bd9c86 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:16.178297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c5c15-e6ce-4acf-b98a-415e14bd9c86 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/groups/2a3b16f18ec34d7ba5a7201e7bee5a68` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:16.179549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c5c15-e6ce-4acf-b98a-415e14bd9c86 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2a3b16f18ec34d7ba5a7201e7bee5a68)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:16.183928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c5c15-e6ce-4acf-b98a-415e14bd9c86 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:16.264645 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:16.295283 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3964/7894] 10.222.0.16 () {58 vars in 1227 bytes} [Fri Sep 30 10:19:16 2022] DELETE /identity/v3/groups/2a3b16f18ec34d7ba5a7201e7bee5a68 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:16.299784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be359ce2-ca46-4e26-9e72-e2679a9ce3c7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:16.303674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-be359ce2-ca46-4e26-9e72-e2679a9ce3c7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:16.341695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be359ce2-ca46-4e26-9e72-e2679a9ce3c7 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:16.499775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698b223-ef98-4e30-af8c-6c7d1bbc9c8b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:16.500560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698b223-ef98-4e30-af8c-6c7d1bbc9c8b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:16.500933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698b223-ef98-4e30-af8c-6c7d1bbc9c8b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:16.501310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698b223-ef98-4e30-af8c-6c7d1bbc9c8b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/projects/df7c2a9575914fabb81fe9af8b466311` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:16.503273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698b223-ef98-4e30-af8c-6c7d1bbc9c8b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_project(project_id=df7c2a9575914fabb81fe9af8b466311)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:16.505316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698b223-ef98-4e30-af8c-6c7d1bbc9c8b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:16.640656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4698b223-ef98-4e30-af8c-6c7d1bbc9c8b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df7c2a9575914fabb81fe9af8b466311', 'request_id': 'req-4698b223-ef98-4e30-af8c-6c7d1bbc9c8b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:16.654597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4698b223-ef98-4e30-af8c-6c7d1bbc9c8b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df7c2a9575914fabb81fe9af8b466311', 'request_id': 'req-4698b223-ef98-4e30-af8c-6c7d1bbc9c8b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:16.664484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4698b223-ef98-4e30-af8c-6c7d1bbc9c8b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df7c2a9575914fabb81fe9af8b466311', 'request_id': 'req-4698b223-ef98-4e30-af8c-6c7d1bbc9c8b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:16.679342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4698b223-ef98-4e30-af8c-6c7d1bbc9c8b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] The token cache is being invalidate because project df7c2a9575914fabb81fe9af8b466311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:16.679980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4698b223-ef98-4e30-af8c-6c7d1bbc9c8b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:16.681694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4698b223-ef98-4e30-af8c-6c7d1bbc9c8b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:16.684858 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3931/7895] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:19:16 2022] DELETE /identity/v3/projects/df7c2a9575914fabb81fe9af8b466311 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:16.688821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c5c15-e6ce-4acf-b98a-415e14bd9c86 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:16.691890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8c6c5c15-e6ce-4acf-b98a-415e14bd9c86 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:16.712717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c5c15-e6ce-4acf-b98a-415e14bd9c86 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:16.785500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b232b-bc10-445f-a0bc-933a22ccfe2b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:16.786320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b232b-bc10-445f-a0bc-933a22ccfe2b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:16.786693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b232b-bc10-445f-a0bc-933a22ccfe2b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:16.787067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b232b-bc10-445f-a0bc-933a22ccfe2b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/domains/99fcf18b279e43d9b011aa640640c61d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:16.788590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b232b-bc10-445f-a0bc-933a22ccfe2b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=99fcf18b279e43d9b011aa640640c61d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:16.790502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b232b-bc10-445f-a0bc-933a22ccfe2b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:16.817111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1c2b232b-bc10-445f-a0bc-933a22ccfe2b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '99fcf18b279e43d9b011aa640640c61d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:16.818683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1c2b232b-bc10-445f-a0bc-933a22ccfe2b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '99fcf18b279e43d9b011aa640640c61d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:16.865440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1c2b232b-bc10-445f-a0bc-933a22ccfe2b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '99fcf18b279e43d9b011aa640640c61d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:16.866094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1c2b232b-bc10-445f-a0bc-933a22ccfe2b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '99fcf18b279e43d9b011aa640640c61d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:16.874950 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3965/7896] 10.222.0.16 () {60 vars in 1249 bytes} [Fri Sep 30 10:19:16 2022] PATCH /identity/v3/domains/99fcf18b279e43d9b011aa640640c61d => generated 277 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:16.875709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698b223-ef98-4e30-af8c-6c7d1bbc9c8b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:16.889570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698b223-ef98-4e30-af8c-6c7d1bbc9c8b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:16.942812 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:17.005351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092657a-45b5-452c-b37c-8f41c529689b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:17.006262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092657a-45b5-452c-b37c-8f41c529689b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:17.006616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092657a-45b5-452c-b37c-8f41c529689b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:17.006958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092657a-45b5-452c-b37c-8f41c529689b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/domains/99fcf18b279e43d9b011aa640640c61d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:17.034082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092657a-45b5-452c-b37c-8f41c529689b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=99fcf18b279e43d9b011aa640640c61d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:17.035853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092657a-45b5-452c-b37c-8f41c529689b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:17.117011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3092657a-45b5-452c-b37c-8f41c529689b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '99fcf18b279e43d9b011aa640640c61d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:17.127309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3092657a-45b5-452c-b37c-8f41c529689b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '99fcf18b279e43d9b011aa640640c61d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:17.248094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3092657a-45b5-452c-b37c-8f41c529689b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99fcf18b279e43d9b011aa640640c61d', 'request_id': 'req-3092657a-45b5-452c-b37c-8f41c529689b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:17.260939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3092657a-45b5-452c-b37c-8f41c529689b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99fcf18b279e43d9b011aa640640c61d', 'request_id': 'req-3092657a-45b5-452c-b37c-8f41c529689b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:17.271507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3092657a-45b5-452c-b37c-8f41c529689b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99fcf18b279e43d9b011aa640640c61d', 'request_id': 'req-3092657a-45b5-452c-b37c-8f41c529689b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:17.292870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3092657a-45b5-452c-b37c-8f41c529689b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] The token cache is being invalidate because project 99fcf18b279e43d9b011aa640640c61d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:17.293073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3092657a-45b5-452c-b37c-8f41c529689b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:17.293803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3092657a-45b5-452c-b37c-8f41c529689b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:17.305910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3092657a-45b5-452c-b37c-8f41c529689b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '99fcf18b279e43d9b011aa640640c61d', 'request_id': 'req-3092657a-45b5-452c-b37c-8f41c529689b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:17.310478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3092657a-45b5-452c-b37c-8f41c529689b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '99fcf18b279e43d9b011aa640640c61d', 'request_id': 'req-3092657a-45b5-452c-b37c-8f41c529689b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:17.311238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3092657a-45b5-452c-b37c-8f41c529689b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '99fcf18b279e43d9b011aa640640c61d', 'request_id': 'req-3092657a-45b5-452c-b37c-8f41c529689b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:17.324363 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3932/7897] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:19:16 2022] DELETE /identity/v3/domains/99fcf18b279e43d9b011aa640640c61d => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:17.325632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b232b-bc10-445f-a0bc-933a22ccfe2b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:17.327713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1c2b232b-bc10-445f-a0bc-933a22ccfe2b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:17.347997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b232b-bc10-445f-a0bc-933a22ccfe2b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:17.534990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd157d-0134-47ab-8257-bc2db9f8ac9b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:17.536881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd157d-0134-47ab-8257-bc2db9f8ac9b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:17.537176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd157d-0134-47ab-8257-bc2db9f8ac9b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:17.538328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd157d-0134-47ab-8257-bc2db9f8ac9b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/7beb411df3ff47ed95a9de78184c7082` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:17.545914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd157d-0134-47ab-8257-bc2db9f8ac9b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7beb411df3ff47ed95a9de78184c7082)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:17.547931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd157d-0134-47ab-8257-bc2db9f8ac9b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:17.641314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bacd157d-0134-47ab-8257-bc2db9f8ac9b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invalidating the token cache because role 7beb411df3ff47ed95a9de78184c7082 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:17.641603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bacd157d-0134-47ab-8257-bc2db9f8ac9b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:17.642853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bacd157d-0134-47ab-8257-bc2db9f8ac9b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:17.647129 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3966/7898] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:17 2022] DELETE /identity/v3/roles/7beb411df3ff47ed95a9de78184c7082 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:17.651303 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092657a-45b5-452c-b37c-8f41c529689b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:17.652718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3092657a-45b5-452c-b37c-8f41c529689b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:17.679294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092657a-45b5-452c-b37c-8f41c529689b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:17.910752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb6676-0aa7-4dbc-be52-c4d26d0126b9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:17.910752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb6676-0aa7-4dbc-be52-c4d26d0126b9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:17.930489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb6676-0aa7-4dbc-be52-c4d26d0126b9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:17.930786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb6676-0aa7-4dbc-be52-c4d26d0126b9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/511387bef84a4f099693b71cdfa55883` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:17.935747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb6676-0aa7-4dbc-be52-c4d26d0126b9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_role(role_id=511387bef84a4f099693b71cdfa55883)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:17.937392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb6676-0aa7-4dbc-be52-c4d26d0126b9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:17.963410 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:18.104313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-94fb6676-0aa7-4dbc-be52-c4d26d0126b9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invalidating the token cache because role 511387bef84a4f099693b71cdfa55883 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:18.104896 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-94fb6676-0aa7-4dbc-be52-c4d26d0126b9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:18.108652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-94fb6676-0aa7-4dbc-be52-c4d26d0126b9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:18.126762 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3933/7899] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:17 2022] DELETE /identity/v3/roles/511387bef84a4f099693b71cdfa55883 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:18.131063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd157d-0134-47ab-8257-bc2db9f8ac9b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:18.132693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bacd157d-0134-47ab-8257-bc2db9f8ac9b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:18.167635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd157d-0134-47ab-8257-bc2db9f8ac9b tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:18.196715 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:18.354449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccfdc4-787b-497f-a2d7-5017c8d8e60d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e944f762e0f4a4d9d36c3e42b6fa7eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:18.355137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccfdc4-787b-497f-a2d7-5017c8d8e60d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:18.355420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccfdc4-787b-497f-a2d7-5017c8d8e60d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:18.355689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccfdc4-787b-497f-a2d7-5017c8d8e60d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] PATH_INFO: `/v3/roles/960ff815a9a7405290b6c72e7141fbe3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:18.357156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ccfdc4-787b-497f-a2d7-5017c8d8e60d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorizing `identity:delete_role(role_id=960ff815a9a7405290b6c72e7141fbe3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:18.358930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ccfdc4-787b-497f-a2d7-5017c8d8e60d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:18.432273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2ccfdc4-787b-497f-a2d7-5017c8d8e60d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invalidating the token cache because role 960ff815a9a7405290b6c72e7141fbe3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:18.432567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2ccfdc4-787b-497f-a2d7-5017c8d8e60d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:18.434222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2ccfdc4-787b-497f-a2d7-5017c8d8e60d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:18.449218 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3967/7900] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:18 2022] DELETE /identity/v3/roles/960ff815a9a7405290b6c72e7141fbe3 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:18.453576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb6676-0aa7-4dbc-be52-c4d26d0126b9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:18.455232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-94fb6676-0aa7-4dbc-be52-c4d26d0126b9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:18.464543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccfdc4-787b-497f-a2d7-5017c8d8e60d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:18.466334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d2ccfdc4-787b-497f-a2d7-5017c8d8e60d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:18.630264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccfdc4-787b-497f-a2d7-5017c8d8e60d tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:18.631653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb6676-0aa7-4dbc-be52-c4d26d0126b9 tempest-RolesV3TestJSON-1153408649 tempest-RolesV3TestJSON-1153408649-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:18.641238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7fb81-ae3c-4ad4-a9da-b7ada289836b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:18.646601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7fb81-ae3c-4ad4-a9da-b7ada289836b service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:18.647434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7fb81-ae3c-4ad4-a9da-b7ada289836b service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:18.647915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7fb81-ae3c-4ad4-a9da-b7ada289836b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:18.650545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-38b7fb81-ae3c-4ad4-a9da-b7ada289836b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:18.763772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291c7ae-05cc-4f36-96ec-955b49ce5727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:18.768217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291c7ae-05cc-4f36-96ec-955b49ce5727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:18.768509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291c7ae-05cc-4f36-96ec-955b49ce5727 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:18.768823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291c7ae-05cc-4f36-96ec-955b49ce5727 admin admin] PATH_INFO: `/v3/users/c75a304ff60048cf894d214e264f94dc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:18.770114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291c7ae-05cc-4f36-96ec-955b49ce5727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c75a304ff60048cf894d214e264f94dc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:18.773884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291c7ae-05cc-4f36-96ec-955b49ce5727 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:18.817585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7fb81-ae3c-4ad4-a9da-b7ada289836b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:18.822896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7fb81-ae3c-4ad4-a9da-b7ada289836b service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:18.842497 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3968/7901] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:19:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:19:18.905304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e291c7ae-05cc-4f36-96ec-955b49ce5727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c75a304ff60048cf894d214e264f94dc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:18.925861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e291c7ae-05cc-4f36-96ec-955b49ce5727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c75a304ff60048cf894d214e264f94dc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:18.926594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e291c7ae-05cc-4f36-96ec-955b49ce5727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c75a304ff60048cf894d214e264f94dc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:18.948215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e291c7ae-05cc-4f36-96ec-955b49ce5727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c75a304ff60048cf894d214e264f94dc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:18.960650 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:18.966289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e291c7ae-05cc-4f36-96ec-955b49ce5727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c75a304ff60048cf894d214e264f94dc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:18.978556 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3934/7902] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:18 2022] DELETE /identity/v3/users/c75a304ff60048cf894d214e264f94dc => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:18.986732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba955f-2965-4d61-911a-5e1304e35af7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:18.988920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba955f-2965-4d61-911a-5e1304e35af7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:18.990167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba955f-2965-4d61-911a-5e1304e35af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:19.064177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0dba955f-2965-4d61-911a-5e1304e35af7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:19.066441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0dba955f-2965-4d61-911a-5e1304e35af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:19.146466 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:19.232198 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3969/7903] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:19.275155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291c7ae-05cc-4f36-96ec-955b49ce5727 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:19.276927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e291c7ae-05cc-4f36-96ec-955b49ce5727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:19.443289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291c7ae-05cc-4f36-96ec-955b49ce5727 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:19.467419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f679c1-3d9f-489d-8d0b-4bd21bc82a2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:19.467419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f679c1-3d9f-489d-8d0b-4bd21bc82a2c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:19.467419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f679c1-3d9f-489d-8d0b-4bd21bc82a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:19.467419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f679c1-3d9f-489d-8d0b-4bd21bc82a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:19.489267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f679c1-3d9f-489d-8d0b-4bd21bc82a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:19.490848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f679c1-3d9f-489d-8d0b-4bd21bc82a2c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:19.511593 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3935/7904] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:19:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:19:20.455462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba955f-2965-4d61-911a-5e1304e35af7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:20.457239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0dba955f-2965-4d61-911a-5e1304e35af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:20.499082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba955f-2965-4d61-911a-5e1304e35af7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:20.513374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721f32d-87be-4bd6-8dcc-185b82f63318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:20.514799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721f32d-87be-4bd6-8dcc-185b82f63318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:20.515432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721f32d-87be-4bd6-8dcc-185b82f63318 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:20.515899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721f32d-87be-4bd6-8dcc-185b82f63318 admin admin] PATH_INFO: `/v3/projects/1832e4d0cf21481896fa58d904cb78df` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:20.518767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721f32d-87be-4bd6-8dcc-185b82f63318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1832e4d0cf21481896fa58d904cb78df)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:20.521436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721f32d-87be-4bd6-8dcc-185b82f63318 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:20.602926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b721f32d-87be-4bd6-8dcc-185b82f63318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1832e4d0cf21481896fa58d904cb78df', 'request_id': 'req-b721f32d-87be-4bd6-8dcc-185b82f63318'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:20.618682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b721f32d-87be-4bd6-8dcc-185b82f63318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1832e4d0cf21481896fa58d904cb78df', 'request_id': 'req-b721f32d-87be-4bd6-8dcc-185b82f63318'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:20.651545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b721f32d-87be-4bd6-8dcc-185b82f63318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1832e4d0cf21481896fa58d904cb78df', 'request_id': 'req-b721f32d-87be-4bd6-8dcc-185b82f63318'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:20.694791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b721f32d-87be-4bd6-8dcc-185b82f63318 admin admin] The token cache is being invalidate because project 1832e4d0cf21481896fa58d904cb78df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:20.695426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b721f32d-87be-4bd6-8dcc-185b82f63318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:20.696541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b721f32d-87be-4bd6-8dcc-185b82f63318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:20.703143 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3970/7905] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:19:20 2022] DELETE /identity/v3/projects/1832e4d0cf21481896fa58d904cb78df => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:20.703955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f679c1-3d9f-489d-8d0b-4bd21bc82a2c service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:20.726228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f679c1-3d9f-489d-8d0b-4bd21bc82a2c service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:20.809089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e35c5-10b3-4272-b760-9b469b9ef3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:20.809744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e35c5-10b3-4272-b760-9b469b9ef3cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:20.810165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e35c5-10b3-4272-b760-9b469b9ef3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:20.810561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e35c5-10b3-4272-b760-9b469b9ef3cd admin admin] PATH_INFO: `/v3/users/2e944f762e0f4a4d9d36c3e42b6fa7eb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:20.811777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e35c5-10b3-4272-b760-9b469b9ef3cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e944f762e0f4a4d9d36c3e42b6fa7eb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:20.814491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e35c5-10b3-4272-b760-9b469b9ef3cd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:20.883358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2c9e35c5-10b3-4272-b760-9b469b9ef3cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e944f762e0f4a4d9d36c3e42b6fa7eb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:20.894043 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2c9e35c5-10b3-4272-b760-9b469b9ef3cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e944f762e0f4a4d9d36c3e42b6fa7eb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:20.894845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2c9e35c5-10b3-4272-b760-9b469b9ef3cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e944f762e0f4a4d9d36c3e42b6fa7eb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:20.917502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2c9e35c5-10b3-4272-b760-9b469b9ef3cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e944f762e0f4a4d9d36c3e42b6fa7eb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:20.926419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2c9e35c5-10b3-4272-b760-9b469b9ef3cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e944f762e0f4a4d9d36c3e42b6fa7eb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:20.936400 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3936/7906] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:20 2022] DELETE /identity/v3/users/2e944f762e0f4a4d9d36c3e42b6fa7eb => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:21.513796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721f32d-87be-4bd6-8dcc-185b82f63318 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:21.515760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b721f32d-87be-4bd6-8dcc-185b82f63318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:21.541806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721f32d-87be-4bd6-8dcc-185b82f63318 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:21.635520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc38539-3d9d-49b5-9b3b-b1828825cf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:21.636100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc38539-3d9d-49b5-9b3b-b1828825cf78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:21.636381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc38539-3d9d-49b5-9b3b-b1828825cf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:21.636698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc38539-3d9d-49b5-9b3b-b1828825cf78 admin admin] PATH_INFO: `/v3/projects/f4b3717f33aa4bbd8556d204d5ee2ea7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:21.638042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc38539-3d9d-49b5-9b3b-b1828825cf78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4b3717f33aa4bbd8556d204d5ee2ea7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:21.640314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc38539-3d9d-49b5-9b3b-b1828825cf78 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:21.701579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6fc38539-3d9d-49b5-9b3b-b1828825cf78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'request_id': 'req-6fc38539-3d9d-49b5-9b3b-b1828825cf78'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:21.714177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6fc38539-3d9d-49b5-9b3b-b1828825cf78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'request_id': 'req-6fc38539-3d9d-49b5-9b3b-b1828825cf78'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:21.717353 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:21.723928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6fc38539-3d9d-49b5-9b3b-b1828825cf78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4b3717f33aa4bbd8556d204d5ee2ea7', 'request_id': 'req-6fc38539-3d9d-49b5-9b3b-b1828825cf78'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:21.742586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6fc38539-3d9d-49b5-9b3b-b1828825cf78 admin admin] The token cache is being invalidate because project f4b3717f33aa4bbd8556d204d5ee2ea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:21.742960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6fc38539-3d9d-49b5-9b3b-b1828825cf78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:21.743724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6fc38539-3d9d-49b5-9b3b-b1828825cf78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:21.745691 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3971/7907] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:19:21 2022] DELETE /identity/v3/projects/f4b3717f33aa4bbd8556d204d5ee2ea7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:19:21.750729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd76ac-ad54-4d0e-95a6-3f380989b7d6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:21.751226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd76ac-ad54-4d0e-95a6-3f380989b7d6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:21.752677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd76ac-ad54-4d0e-95a6-3f380989b7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:21.780209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-55cd76ac-ad54-4d0e-95a6-3f380989b7d6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:21.781605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-55cd76ac-ad54-4d0e-95a6-3f380989b7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:21.799039 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:21.894532 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3937/7908] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:21.900014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9419d7-8eea-4da7-a481-c8777b645694 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:21.900301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9419d7-8eea-4da7-a481-c8777b645694 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:21.900578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9419d7-8eea-4da7-a481-c8777b645694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:21.942198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cf9419d7-8eea-4da7-a481-c8777b645694 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:21.943507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cf9419d7-8eea-4da7-a481-c8777b645694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:21.968171 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3972/7909] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:21.973608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd76ac-ad54-4d0e-95a6-3f380989b7d6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:21.999164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd76ac-ad54-4d0e-95a6-3f380989b7d6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:22.020176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac4d4a-f0e8-491a-9813-d31dc6a42c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:22.022382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac4d4a-f0e8-491a-9813-d31dc6a42c57 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:22.025430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac4d4a-f0e8-491a-9813-d31dc6a42c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:22.026068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac4d4a-f0e8-491a-9813-d31dc6a42c57 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:22.029452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac4d4a-f0e8-491a-9813-d31dc6a42c57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:19:22.030186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac4d4a-f0e8-491a-9813-d31dc6a42c57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:22.037546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac4d4a-f0e8-491a-9813-d31dc6a42c57 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:22.066237 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3938/7910] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:22.072010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9419d7-8eea-4da7-a481-c8777b645694 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:22.089589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9419d7-8eea-4da7-a481-c8777b645694 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:22.103104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fe4e4-df38-41c7-8a05-db73e84c5ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:22.104176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fe4e4-df38-41c7-8a05-db73e84c5ffb admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:22.105146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fe4e4-df38-41c7-8a05-db73e84c5ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:22.106177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fe4e4-df38-41c7-8a05-db73e84c5ffb admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:22.108063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fe4e4-df38-41c7-8a05-db73e84c5ffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:22.113748 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fe4e4-df38-41c7-8a05-db73e84c5ffb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:22.206162 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3973/7911] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:19:22 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:22.207475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac4d4a-f0e8-491a-9813-d31dc6a42c57 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:22.238821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac4d4a-f0e8-491a-9813-d31dc6a42c57 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:22.324626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead3189-7b16-4772-9d69-aadff6380c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:22.326293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead3189-7b16-4772-9d69-aadff6380c26 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:22.326293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead3189-7b16-4772-9d69-aadff6380c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:22.326792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead3189-7b16-4772-9d69-aadff6380c26 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:22.327529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead3189-7b16-4772-9d69-aadff6380c26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:22.330757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead3189-7b16-4772-9d69-aadff6380c26 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:22.393966 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3939/7912] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:19:22 2022] POST /identity/v3/users => generated 283 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:22.406862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fe4e4-df38-41c7-8a05-db73e84c5ffb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:22.421411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fe4e4-df38-41c7-8a05-db73e84c5ffb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:22.443401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c565de9-c2b2-494b-afb2-bfa68a879575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:22.445131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c565de9-c2b2-494b-afb2-bfa68a879575 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:22.445619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c565de9-c2b2-494b-afb2-bfa68a879575 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:22.446082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c565de9-c2b2-494b-afb2-bfa68a879575 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:22.447181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c565de9-c2b2-494b-afb2-bfa68a879575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:22.449426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c565de9-c2b2-494b-afb2-bfa68a879575 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:22.477916 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3974/7913] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:19:22.478945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead3189-7b16-4772-9d69-aadff6380c26 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:22.491812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead3189-7b16-4772-9d69-aadff6380c26 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:22.504467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b98310-5b5a-4b67-bef2-3273760acdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:22.505110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b98310-5b5a-4b67-bef2-3273760acdc4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:22.505385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b98310-5b5a-4b67-bef2-3273760acdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:22.505661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b98310-5b5a-4b67-bef2-3273760acdc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:22.506304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b98310-5b5a-4b67-bef2-3273760acdc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:22.507886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b98310-5b5a-4b67-bef2-3273760acdc4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:22.561134 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3940/7914] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:19:22.563163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c565de9-c2b2-494b-afb2-bfa68a879575 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:22.577907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c565de9-c2b2-494b-afb2-bfa68a879575 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:22.584342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1333d5b-47af-4a4b-9232-93f96030e044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:22.585315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1333d5b-47af-4a4b-9232-93f96030e044 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:22.585808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1333d5b-47af-4a4b-9232-93f96030e044 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:22.586307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1333d5b-47af-4a4b-9232-93f96030e044 admin admin] PATH_INFO: `/v3/projects/e7ee9c6323324444af2bb0abf7111414/users/e1adf5c5cce44e3ab01b610c73b04043/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:22.608084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1333d5b-47af-4a4b-9232-93f96030e044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ee9c6323324444af2bb0abf7111414, user_id=e1adf5c5cce44e3ab01b610c73b04043, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:22.612282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1333d5b-47af-4a4b-9232-93f96030e044 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:22.640534 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3975/7915] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:19:22 2022] PUT /identity/v3/projects/e7ee9c6323324444af2bb0abf7111414/users/e1adf5c5cce44e3ab01b610c73b04043/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:22.742970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddce16-b752-4057-95bc-8e92594485dc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:22.742970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddce16-b752-4057-95bc-8e92594485dc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:22.742970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddce16-b752-4057-95bc-8e92594485dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:22.778381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b1ddce16-b752-4057-95bc-8e92594485dc None None] MFA Rules not processed for user `e1adf5c5cce44e3ab01b610c73b04043`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:22.779849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b1ddce16-b752-4057-95bc-8e92594485dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:22.864657 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3941/7916] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:22.865882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1333d5b-47af-4a4b-9232-93f96030e044 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:22.948426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1333d5b-47af-4a4b-9232-93f96030e044 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:22.953341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2857eac-bfbf-45f2-b10c-f99807672e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:22.953949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2857eac-bfbf-45f2-b10c-f99807672e97 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:22.954221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2857eac-bfbf-45f2-b10c-f99807672e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:22.954530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2857eac-bfbf-45f2-b10c-f99807672e97 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:22.955772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2857eac-bfbf-45f2-b10c-f99807672e97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:22.957661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2857eac-bfbf-45f2-b10c-f99807672e97 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:22.994899 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3976/7917] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:19:22 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:22.995386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddce16-b752-4057-95bc-8e92594485dc None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:23.007606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddce16-b752-4057-95bc-8e92594485dc None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:23.019498 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:23.108147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c2459-7959-4098-9d53-5b97fc3be561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:23.108828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c2459-7959-4098-9d53-5b97fc3be561 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:23.109107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c2459-7959-4098-9d53-5b97fc3be561 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:23.109376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c2459-7959-4098-9d53-5b97fc3be561 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:23.110022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c2459-7959-4098-9d53-5b97fc3be561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:23.112970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c2459-7959-4098-9d53-5b97fc3be561 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:23.153019 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3942/7918] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:19:22 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:23.154381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2857eac-bfbf-45f2-b10c-f99807672e97 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:23.168500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2857eac-bfbf-45f2-b10c-f99807672e97 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:23.179349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7461c-ec89-4c00-81f6-21c759a0b5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:23.180267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7461c-ec89-4c00-81f6-21c759a0b5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:23.180755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7461c-ec89-4c00-81f6-21c759a0b5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:23.181241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7461c-ec89-4c00-81f6-21c759a0b5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:23.182068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7461c-ec89-4c00-81f6-21c759a0b5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:23.184059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7461c-ec89-4c00-81f6-21c759a0b5f7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:23.203417 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3977/7919] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:19:23.203588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c2459-7959-4098-9d53-5b97fc3be561 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:23.218118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c2459-7959-4098-9d53-5b97fc3be561 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:23.232648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c27294-e5cd-423f-b79f-761a72d86e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:23.232648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c27294-e5cd-423f-b79f-761a72d86e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:23.232648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c27294-e5cd-423f-b79f-761a72d86e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:23.232648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c27294-e5cd-423f-b79f-761a72d86e68 admin admin] PATH_INFO: `/v3/projects/c74ecf9660ca4c168c3a22276569ea1b/users/63f13226fd644916864799b081cf42f1/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:23.250888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c27294-e5cd-423f-b79f-761a72d86e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74ecf9660ca4c168c3a22276569ea1b, user_id=63f13226fd644916864799b081cf42f1, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:23.255201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c27294-e5cd-423f-b79f-761a72d86e68 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:23.270783 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3943/7920] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:19:23 2022] PUT /identity/v3/projects/c74ecf9660ca4c168c3a22276569ea1b/users/63f13226fd644916864799b081cf42f1/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:19:23.275518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7461c-ec89-4c00-81f6-21c759a0b5f7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:23.286308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7461c-ec89-4c00-81f6-21c759a0b5f7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:23.348371 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:23.355760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ca90e-d7bf-4df7-b4f2-aa5f3eb9e89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:23.357131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ca90e-d7bf-4df7-b4f2-aa5f3eb9e89f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:23.357727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ca90e-d7bf-4df7-b4f2-aa5f3eb9e89f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:23.358071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ca90e-d7bf-4df7-b4f2-aa5f3eb9e89f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:23.359037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ca90e-d7bf-4df7-b4f2-aa5f3eb9e89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:23.362062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ca90e-d7bf-4df7-b4f2-aa5f3eb9e89f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:23.374926 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3978/7921] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:19:23.379546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c27294-e5cd-423f-b79f-761a72d86e68 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:23.391108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c27294-e5cd-423f-b79f-761a72d86e68 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:23.397918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b10c5-6aa3-4366-9eee-f5ee192dc1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:23.398617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b10c5-6aa3-4366-9eee-f5ee192dc1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:23.398900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b10c5-6aa3-4366-9eee-f5ee192dc1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:23.399179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b10c5-6aa3-4366-9eee-f5ee192dc1d5 admin admin] PATH_INFO: `/v3/projects/c74ecf9660ca4c168c3a22276569ea1b/users/63f13226fd644916864799b081cf42f1/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:23.401391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b10c5-6aa3-4366-9eee-f5ee192dc1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74ecf9660ca4c168c3a22276569ea1b, user_id=63f13226fd644916864799b081cf42f1, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:23.404283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b10c5-6aa3-4366-9eee-f5ee192dc1d5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:23.419119 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3944/7922] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:19:23 2022] PUT /identity/v3/projects/c74ecf9660ca4c168c3a22276569ea1b/users/63f13226fd644916864799b081cf42f1/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:23.429197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18712b01-63a6-4fae-ae51-674c48c0cd35 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:23.429724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18712b01-63a6-4fae-ae51-674c48c0cd35 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:23.430227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18712b01-63a6-4fae-ae51-674c48c0cd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:23.462726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-18712b01-63a6-4fae-ae51-674c48c0cd35 None None] MFA Rules not processed for user `63f13226fd644916864799b081cf42f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:23.464097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-18712b01-63a6-4fae-ae51-674c48c0cd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:23.552036 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3979/7923] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:23.555449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b10c5-6aa3-4366-9eee-f5ee192dc1d5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:23.574891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b10c5-6aa3-4366-9eee-f5ee192dc1d5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:23.583877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c829b2-4692-4d42-9219-81eba2cc42ac tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:23.584500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c829b2-4692-4d42-9219-81eba2cc42ac tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:23.584810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c829b2-4692-4d42-9219-81eba2cc42ac tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:23.585086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c829b2-4692-4d42-9219-81eba2cc42ac tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:23.585985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c829b2-4692-4d42-9219-81eba2cc42ac tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:23.589053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c829b2-4692-4d42-9219-81eba2cc42ac tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:23.652982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18712b01-63a6-4fae-ae51-674c48c0cd35 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:23.662994 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3945/7924] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:19:23 2022] POST /identity/v3/projects => generated 359 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:23.668687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18712b01-63a6-4fae-ae51-674c48c0cd35 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:23.820398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b51b3-443e-4262-b4b1-76e8c47a412b tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:23.821141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b51b3-443e-4262-b4b1-76e8c47a412b tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:23.821619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b51b3-443e-4262-b4b1-76e8c47a412b tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:23.822140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b51b3-443e-4262-b4b1-76e8c47a412b tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:23.822860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b51b3-443e-4262-b4b1-76e8c47a412b tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:23.825521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b51b3-443e-4262-b4b1-76e8c47a412b tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:23.875217 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3980/7925] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:19:23 2022] POST /identity/v3/users => generated 371 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:23.891744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c829b2-4692-4d42-9219-81eba2cc42ac tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:23.910780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c829b2-4692-4d42-9219-81eba2cc42ac tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:23.918456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b5090-5afa-452b-bcfc-901891887c58 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:23.919491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b5090-5afa-452b-bcfc-901891887c58 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:23.919777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b5090-5afa-452b-bcfc-901891887c58 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:23.920062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b5090-5afa-452b-bcfc-901891887c58 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/users/36b6538d31dc4e539ce4d1d3e8c8a817` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:23.951071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b5090-5afa-452b-bcfc-901891887c58 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:get_user(user_id=36b6538d31dc4e539ce4d1d3e8c8a817)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:23.954354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b5090-5afa-452b-bcfc-901891887c58 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:23.959958 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3946/7926] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Sep 30 10:19:23 2022] GET /identity/v3/users/36b6538d31dc4e539ce4d1d3e8c8a817 => generated 371 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:23.964956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b51b3-443e-4262-b4b1-76e8c47a412b tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:23.978694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b51b3-443e-4262-b4b1-76e8c47a412b tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:23.992431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9678265-3309-443b-a0c1-cd101e46ef45 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:23.994085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9678265-3309-443b-a0c1-cd101e46ef45 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:23.994377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9678265-3309-443b-a0c1-cd101e46ef45 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:23.995370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9678265-3309-443b-a0c1-cd101e46ef45 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/users/36b6538d31dc4e539ce4d1d3e8c8a817` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:23.998174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9678265-3309-443b-a0c1-cd101e46ef45 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:delete_user(user_id=36b6538d31dc4e539ce4d1d3e8c8a817)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:24.004824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9678265-3309-443b-a0c1-cd101e46ef45 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:24.109679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c9678265-3309-443b-a0c1-cd101e46ef45 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b6538d31dc4e539ce4d1d3e8c8a817'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:24.112411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c9678265-3309-443b-a0c1-cd101e46ef45 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b6538d31dc4e539ce4d1d3e8c8a817'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:24.123799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c9678265-3309-443b-a0c1-cd101e46ef45 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b6538d31dc4e539ce4d1d3e8c8a817'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:24.135288 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:24.146634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c9678265-3309-443b-a0c1-cd101e46ef45 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b6538d31dc4e539ce4d1d3e8c8a817'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:24.161325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c9678265-3309-443b-a0c1-cd101e46ef45 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b6538d31dc4e539ce4d1d3e8c8a817'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:24.169993 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3981/7927] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:23 2022] DELETE /identity/v3/users/36b6538d31dc4e539ce4d1d3e8c8a817 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:24.174803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b5090-5afa-452b-bcfc-901891887c58 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:24.178412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-be1b5090-5afa-452b-bcfc-901891887c58 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:24.196735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b5090-5afa-452b-bcfc-901891887c58 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:24.293913 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932968c0-f69c-4c29-ae3d-ee34360192e2 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:24.294919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932968c0-f69c-4c29-ae3d-ee34360192e2 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:24.295617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932968c0-f69c-4c29-ae3d-ee34360192e2 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:24.296169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932968c0-f69c-4c29-ae3d-ee34360192e2 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/projects/35828b5e87d142e282b45198bd3a43f8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:24.297562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932968c0-f69c-4c29-ae3d-ee34360192e2 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:delete_project(project_id=35828b5e87d142e282b45198bd3a43f8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:24.301244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932968c0-f69c-4c29-ae3d-ee34360192e2 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:24.343737 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:24.363439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-932968c0-f69c-4c29-ae3d-ee34360192e2 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35828b5e87d142e282b45198bd3a43f8', 'request_id': 'req-932968c0-f69c-4c29-ae3d-ee34360192e2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:24.378536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-932968c0-f69c-4c29-ae3d-ee34360192e2 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35828b5e87d142e282b45198bd3a43f8', 'request_id': 'req-932968c0-f69c-4c29-ae3d-ee34360192e2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:24.387360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-932968c0-f69c-4c29-ae3d-ee34360192e2 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35828b5e87d142e282b45198bd3a43f8', 'request_id': 'req-932968c0-f69c-4c29-ae3d-ee34360192e2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:24.408481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-932968c0-f69c-4c29-ae3d-ee34360192e2 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] The token cache is being invalidate because project 35828b5e87d142e282b45198bd3a43f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:24.408803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-932968c0-f69c-4c29-ae3d-ee34360192e2 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:24.412282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-932968c0-f69c-4c29-ae3d-ee34360192e2 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:24.417982 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3947/7928] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:19:24 2022] DELETE /identity/v3/projects/35828b5e87d142e282b45198bd3a43f8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:24.425601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9678265-3309-443b-a0c1-cd101e46ef45 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:24.439147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9678265-3309-443b-a0c1-cd101e46ef45 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:24.526540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4942b8-0856-4718-9961-d62b57edb308 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:24.527170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4942b8-0856-4718-9961-d62b57edb308 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:24.527455 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4942b8-0856-4718-9961-d62b57edb308 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:24.527730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4942b8-0856-4718-9961-d62b57edb308 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:24.528363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4942b8-0856-4718-9961-d62b57edb308 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:24.530314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4942b8-0856-4718-9961-d62b57edb308 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:24.568095 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3982/7929] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:19:24 2022] POST /identity/v3/projects => generated 360 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:24.572499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932968c0-f69c-4c29-ae3d-ee34360192e2 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:24.573792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-932968c0-f69c-4c29-ae3d-ee34360192e2 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:24.595588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932968c0-f69c-4c29-ae3d-ee34360192e2 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:24.682127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709df9b3-2a6f-4d97-bd85-ba711291eb39 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:24.683222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709df9b3-2a6f-4d97-bd85-ba711291eb39 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:24.683820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709df9b3-2a6f-4d97-bd85-ba711291eb39 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:24.684228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709df9b3-2a6f-4d97-bd85-ba711291eb39 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:24.685246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709df9b3-2a6f-4d97-bd85-ba711291eb39 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:24.687273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709df9b3-2a6f-4d97-bd85-ba711291eb39 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:24.734734 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3948/7930] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:19:24 2022] POST /identity/v3/users => generated 411 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:24.738618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4942b8-0856-4718-9961-d62b57edb308 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:24.758655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4942b8-0856-4718-9961-d62b57edb308 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:24.775448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6fd0f-e667-439c-8141-6e933fb4cfe5 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:24.776686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6fd0f-e667-439c-8141-6e933fb4cfe5 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:24.777317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6fd0f-e667-439c-8141-6e933fb4cfe5 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:24.778234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6fd0f-e667-439c-8141-6e933fb4cfe5 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:24.779621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6fd0f-e667-439c-8141-6e933fb4cfe5 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:24.784116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6fd0f-e667-439c-8141-6e933fb4cfe5 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:24.826747 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3983/7931] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 10:19:24 2022] POST /identity/v3/roles => generated 237 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:24.831148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709df9b3-2a6f-4d97-bd85-ba711291eb39 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:24.849588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709df9b3-2a6f-4d97-bd85-ba711291eb39 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:24.882136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bf325-42f4-420e-ad42-800aebc8b0ac tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:24.884455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bf325-42f4-420e-ad42-800aebc8b0ac tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:24.885644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bf325-42f4-420e-ad42-800aebc8b0ac tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:24.893447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bf325-42f4-420e-ad42-800aebc8b0ac tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/users/1b8ebce07d04431b93abcfc1a1dcc346` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:24.951203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bf325-42f4-420e-ad42-800aebc8b0ac tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:get_user(user_id=1b8ebce07d04431b93abcfc1a1dcc346)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:24.954125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bf325-42f4-420e-ad42-800aebc8b0ac tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:24.956092 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3949/7932] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Sep 30 10:19:24 2022] GET /identity/v3/users/1b8ebce07d04431b93abcfc1a1dcc346 => generated 411 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:24.960438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6fd0f-e667-439c-8141-6e933fb4cfe5 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:24.976616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6fd0f-e667-439c-8141-6e933fb4cfe5 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:24.989798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a9bce-435b-4cf6-b8d4-66cf524502e4 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:24.990612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a9bce-435b-4cf6-b8d4-66cf524502e4 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:24.990999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a9bce-435b-4cf6-b8d4-66cf524502e4 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:24.991839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a9bce-435b-4cf6-b8d4-66cf524502e4 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/roles/c96c3158743f4689a7173bced9dbef68` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:25.008218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a9bce-435b-4cf6-b8d4-66cf524502e4 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:get_role(role_id=c96c3158743f4689a7173bced9dbef68)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:25.014010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a9bce-435b-4cf6-b8d4-66cf524502e4 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:25.021639 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3984/7933] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Sep 30 10:19:24 2022] GET /identity/v3/roles/c96c3158743f4689a7173bced9dbef68 => generated 237 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:25.025825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bf325-42f4-420e-ad42-800aebc8b0ac tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:25.044151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bf325-42f4-420e-ad42-800aebc8b0ac tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:25.082758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2d491-5172-495f-b062-07dc67c2054c tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:25.082758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2d491-5172-495f-b062-07dc67c2054c tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:25.082758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2d491-5172-495f-b062-07dc67c2054c tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:25.083323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2d491-5172-495f-b062-07dc67c2054c tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:25.096354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2d491-5172-495f-b062-07dc67c2054c tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:25.100239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2d491-5172-495f-b062-07dc67c2054c tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:25.199682 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3950/7934] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:19:25 2022] POST /identity/v3/projects => generated 360 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:25.205039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a9bce-435b-4cf6-b8d4-66cf524502e4 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:25.222815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a9bce-435b-4cf6-b8d4-66cf524502e4 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:25.355411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9f03a-002d-4174-9ad8-e1a60b6289d1 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:25.357180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9f03a-002d-4174-9ad8-e1a60b6289d1 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:25.357705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9f03a-002d-4174-9ad8-e1a60b6289d1 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:25.358139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9f03a-002d-4174-9ad8-e1a60b6289d1 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/projects/ca058b6698584f77ba611457b87a6575` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:25.359708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9f03a-002d-4174-9ad8-e1a60b6289d1 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:get_project(project_id=ca058b6698584f77ba611457b87a6575)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:25.362799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9f03a-002d-4174-9ad8-e1a60b6289d1 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:25.365951 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3985/7935] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:19:25 2022] GET /identity/v3/projects/ca058b6698584f77ba611457b87a6575 => generated 360 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:25.370273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2d491-5172-495f-b062-07dc67c2054c tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:25.383599 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2d491-5172-495f-b062-07dc67c2054c tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:25.388521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf2e05-4b33-4935-86d2-f7293f8c0385 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:25.389272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf2e05-4b33-4935-86d2-f7293f8c0385 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:25.389557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf2e05-4b33-4935-86d2-f7293f8c0385 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:25.389835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf2e05-4b33-4935-86d2-f7293f8c0385 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/projects/ca058b6698584f77ba611457b87a6575/users/1b8ebce07d04431b93abcfc1a1dcc346/roles/c96c3158743f4689a7173bced9dbef68` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:25.393052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf2e05-4b33-4935-86d2-f7293f8c0385 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ca058b6698584f77ba611457b87a6575, user_id=1b8ebce07d04431b93abcfc1a1dcc346, role_id=c96c3158743f4689a7173bced9dbef68)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:25.395958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf2e05-4b33-4935-86d2-f7293f8c0385 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:25.434863 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3951/7936] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:19:25 2022] PUT /identity/v3/projects/ca058b6698584f77ba611457b87a6575/users/1b8ebce07d04431b93abcfc1a1dcc346/roles/c96c3158743f4689a7173bced9dbef68 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:25.435994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9f03a-002d-4174-9ad8-e1a60b6289d1 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:25.448480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9f03a-002d-4174-9ad8-e1a60b6289d1 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:25.509084 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:25.533714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8d025-bc9c-4e4c-829e-73e1bb229fb9 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:25.534429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8d025-bc9c-4e4c-829e-73e1bb229fb9 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:25.534712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8d025-bc9c-4e4c-829e-73e1bb229fb9 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:25.534985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8d025-bc9c-4e4c-829e-73e1bb229fb9 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:25.536109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8d025-bc9c-4e4c-829e-73e1bb229fb9 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:25.538107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8d025-bc9c-4e4c-829e-73e1bb229fb9 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:25.577047 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3986/7937] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:19:25 2022] POST /identity/v3/projects => generated 359 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:25.581866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf2e05-4b33-4935-86d2-f7293f8c0385 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:25.593382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf2e05-4b33-4935-86d2-f7293f8c0385 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:25.728954 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:25.752882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ec79c-df84-4508-b7e6-eb6a69acfa82 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:25.753796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ec79c-df84-4508-b7e6-eb6a69acfa82 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:25.754121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ec79c-df84-4508-b7e6-eb6a69acfa82 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:25.754501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ec79c-df84-4508-b7e6-eb6a69acfa82 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/projects/14806cbb7a0241cca40c74d92a40987f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:25.757781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ec79c-df84-4508-b7e6-eb6a69acfa82 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:get_project(project_id=14806cbb7a0241cca40c74d92a40987f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:25.759997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ec79c-df84-4508-b7e6-eb6a69acfa82 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:25.765675 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3952/7938] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Sep 30 10:19:25 2022] GET /identity/v3/projects/14806cbb7a0241cca40c74d92a40987f => generated 359 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:19:25.767390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8d025-bc9c-4e4c-829e-73e1bb229fb9 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:25.780631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8d025-bc9c-4e4c-829e-73e1bb229fb9 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:25.786814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5878c-3e67-4d70-84d4-88916d7a0d8d tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:25.787597 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5878c-3e67-4d70-84d4-88916d7a0d8d tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:25.788393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5878c-3e67-4d70-84d4-88916d7a0d8d tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:25.788509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5878c-3e67-4d70-84d4-88916d7a0d8d tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/projects/14806cbb7a0241cca40c74d92a40987f/users/1b8ebce07d04431b93abcfc1a1dcc346/roles/c96c3158743f4689a7173bced9dbef68` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:25.790976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5878c-3e67-4d70-84d4-88916d7a0d8d tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:create_grant(project_id=14806cbb7a0241cca40c74d92a40987f, user_id=1b8ebce07d04431b93abcfc1a1dcc346, role_id=c96c3158743f4689a7173bced9dbef68)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:25.794617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5878c-3e67-4d70-84d4-88916d7a0d8d tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:25.816681 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3987/7939] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:19:25 2022] PUT /identity/v3/projects/14806cbb7a0241cca40c74d92a40987f/users/1b8ebce07d04431b93abcfc1a1dcc346/roles/c96c3158743f4689a7173bced9dbef68 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:25.821062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ec79c-df84-4508-b7e6-eb6a69acfa82 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:25.845985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ec79c-df84-4508-b7e6-eb6a69acfa82 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:25.945316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe3334-9ebe-4fb8-b620-899eb7d042e5 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:25.946010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe3334-9ebe-4fb8-b620-899eb7d042e5 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:25.946509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe3334-9ebe-4fb8-b620-899eb7d042e5 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:25.946908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe3334-9ebe-4fb8-b620-899eb7d042e5 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/users/1b8ebce07d04431b93abcfc1a1dcc346/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:25.948250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe3334-9ebe-4fb8-b620-899eb7d042e5 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=1b8ebce07d04431b93abcfc1a1dcc346)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:25.951165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe3334-9ebe-4fb8-b620-899eb7d042e5 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:26.038629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5878c-3e67-4d70-84d4-88916d7a0d8d tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:26.038909 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3953/7940] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Sep 30 10:19:25 2022] GET /identity/v3/users/1b8ebce07d04431b93abcfc1a1dcc346/projects => generated 843 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:26.054982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5878c-3e67-4d70-84d4-88916d7a0d8d tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:26.066595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ba5e1-616e-46d5-8489-706ab472a3f7 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:26.067721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ba5e1-616e-46d5-8489-706ab472a3f7 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:26.067826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ba5e1-616e-46d5-8489-706ab472a3f7 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:26.068269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ba5e1-616e-46d5-8489-706ab472a3f7 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/projects/14806cbb7a0241cca40c74d92a40987f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:26.069592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ba5e1-616e-46d5-8489-706ab472a3f7 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:delete_project(project_id=14806cbb7a0241cca40c74d92a40987f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:26.071808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ba5e1-616e-46d5-8489-706ab472a3f7 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:26.155226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c62ba5e1-616e-46d5-8489-706ab472a3f7 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14806cbb7a0241cca40c74d92a40987f', 'request_id': 'req-c62ba5e1-616e-46d5-8489-706ab472a3f7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:26.169247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c62ba5e1-616e-46d5-8489-706ab472a3f7 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14806cbb7a0241cca40c74d92a40987f', 'request_id': 'req-c62ba5e1-616e-46d5-8489-706ab472a3f7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:26.178586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c62ba5e1-616e-46d5-8489-706ab472a3f7 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14806cbb7a0241cca40c74d92a40987f', 'request_id': 'req-c62ba5e1-616e-46d5-8489-706ab472a3f7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:26.196155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c62ba5e1-616e-46d5-8489-706ab472a3f7 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] The token cache is being invalidate because project 14806cbb7a0241cca40c74d92a40987f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:26.196534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c62ba5e1-616e-46d5-8489-706ab472a3f7 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:26.197810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c62ba5e1-616e-46d5-8489-706ab472a3f7 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:26.205620 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3988/7941] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:19:26 2022] DELETE /identity/v3/projects/14806cbb7a0241cca40c74d92a40987f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:19:26.210890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe3334-9ebe-4fb8-b620-899eb7d042e5 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:26.214386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0fbe3334-9ebe-4fb8-b620-899eb7d042e5 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:26.247710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe3334-9ebe-4fb8-b620-899eb7d042e5 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:26.339335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4a3c1-0b7a-444f-b378-2e6c07fdc5ae tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:26.340563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4a3c1-0b7a-444f-b378-2e6c07fdc5ae tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:26.341350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4a3c1-0b7a-444f-b378-2e6c07fdc5ae tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:26.342796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4a3c1-0b7a-444f-b378-2e6c07fdc5ae tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/projects/ca058b6698584f77ba611457b87a6575` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:26.344248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4a3c1-0b7a-444f-b378-2e6c07fdc5ae tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ca058b6698584f77ba611457b87a6575)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:26.347164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4a3c1-0b7a-444f-b378-2e6c07fdc5ae tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:26.440091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-34f4a3c1-0b7a-444f-b378-2e6c07fdc5ae tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca058b6698584f77ba611457b87a6575', 'request_id': 'req-34f4a3c1-0b7a-444f-b378-2e6c07fdc5ae'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:26.454982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-34f4a3c1-0b7a-444f-b378-2e6c07fdc5ae tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca058b6698584f77ba611457b87a6575', 'request_id': 'req-34f4a3c1-0b7a-444f-b378-2e6c07fdc5ae'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:26.467453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-34f4a3c1-0b7a-444f-b378-2e6c07fdc5ae tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca058b6698584f77ba611457b87a6575', 'request_id': 'req-34f4a3c1-0b7a-444f-b378-2e6c07fdc5ae'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:26.495259 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:26.520661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-34f4a3c1-0b7a-444f-b378-2e6c07fdc5ae tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] The token cache is being invalidate because project ca058b6698584f77ba611457b87a6575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:26.520661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-34f4a3c1-0b7a-444f-b378-2e6c07fdc5ae tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:26.520661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-34f4a3c1-0b7a-444f-b378-2e6c07fdc5ae tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:26.520661 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3954/7942] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:19:26 2022] DELETE /identity/v3/projects/ca058b6698584f77ba611457b87a6575 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:26.521214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ba5e1-616e-46d5-8489-706ab472a3f7 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:26.531848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ba5e1-616e-46d5-8489-706ab472a3f7 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:26.690057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b21b3-fd1e-44bb-a9ab-d9cf16c99746 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:26.690724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b21b3-fd1e-44bb-a9ab-d9cf16c99746 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:26.691008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b21b3-fd1e-44bb-a9ab-d9cf16c99746 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:26.691284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b21b3-fd1e-44bb-a9ab-d9cf16c99746 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/roles/c96c3158743f4689a7173bced9dbef68` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:26.692805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b21b3-fd1e-44bb-a9ab-d9cf16c99746 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c96c3158743f4689a7173bced9dbef68)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:26.694756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b21b3-fd1e-44bb-a9ab-d9cf16c99746 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:26.756279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d71b21b3-fd1e-44bb-a9ab-d9cf16c99746 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invalidating the token cache because role c96c3158743f4689a7173bced9dbef68 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:26.757163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d71b21b3-fd1e-44bb-a9ab-d9cf16c99746 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:26.758181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d71b21b3-fd1e-44bb-a9ab-d9cf16c99746 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:26.760510 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3989/7943] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:26 2022] DELETE /identity/v3/roles/c96c3158743f4689a7173bced9dbef68 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:26.765013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4a3c1-0b7a-444f-b378-2e6c07fdc5ae tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:26.767391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-34f4a3c1-0b7a-444f-b378-2e6c07fdc5ae tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:26.792707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4a3c1-0b7a-444f-b378-2e6c07fdc5ae tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:26.946243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127cad6-673e-4fa0-b45f-8b1d20b14e81 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:26.946897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127cad6-673e-4fa0-b45f-8b1d20b14e81 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:26.947313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127cad6-673e-4fa0-b45f-8b1d20b14e81 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:26.947590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127cad6-673e-4fa0-b45f-8b1d20b14e81 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/users/1b8ebce07d04431b93abcfc1a1dcc346` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:26.948782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127cad6-673e-4fa0-b45f-8b1d20b14e81 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1b8ebce07d04431b93abcfc1a1dcc346)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:26.950934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127cad6-673e-4fa0-b45f-8b1d20b14e81 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:27.040800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f127cad6-673e-4fa0-b45f-8b1d20b14e81 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b8ebce07d04431b93abcfc1a1dcc346'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:27.056217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f127cad6-673e-4fa0-b45f-8b1d20b14e81 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b8ebce07d04431b93abcfc1a1dcc346'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:27.057023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f127cad6-673e-4fa0-b45f-8b1d20b14e81 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b8ebce07d04431b93abcfc1a1dcc346'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:27.096373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f127cad6-673e-4fa0-b45f-8b1d20b14e81 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b8ebce07d04431b93abcfc1a1dcc346'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:27.125472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f127cad6-673e-4fa0-b45f-8b1d20b14e81 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b8ebce07d04431b93abcfc1a1dcc346'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:27.140587 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3955/7944] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:26 2022] DELETE /identity/v3/users/1b8ebce07d04431b93abcfc1a1dcc346 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:27.145006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b21b3-fd1e-44bb-a9ab-d9cf16c99746 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:27.147196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d71b21b3-fd1e-44bb-a9ab-d9cf16c99746 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:27.169899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b21b3-fd1e-44bb-a9ab-d9cf16c99746 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:27.187851 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:27.323445 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad74a94-616e-404b-ac13-265b81f0a3ba tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:27.324469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad74a94-616e-404b-ac13-265b81f0a3ba tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:27.324933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad74a94-616e-404b-ac13-265b81f0a3ba tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:27.325387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad74a94-616e-404b-ac13-265b81f0a3ba tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/projects/3bff18f01277464dbfbc934840a1e423` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:27.331372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad74a94-616e-404b-ac13-265b81f0a3ba tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3bff18f01277464dbfbc934840a1e423)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:27.333804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad74a94-616e-404b-ac13-265b81f0a3ba tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:27.459624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ad74a94-616e-404b-ac13-265b81f0a3ba tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bff18f01277464dbfbc934840a1e423', 'request_id': 'req-9ad74a94-616e-404b-ac13-265b81f0a3ba'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:27.473847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ad74a94-616e-404b-ac13-265b81f0a3ba tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bff18f01277464dbfbc934840a1e423', 'request_id': 'req-9ad74a94-616e-404b-ac13-265b81f0a3ba'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:27.486332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ad74a94-616e-404b-ac13-265b81f0a3ba tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bff18f01277464dbfbc934840a1e423', 'request_id': 'req-9ad74a94-616e-404b-ac13-265b81f0a3ba'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:27.504398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ad74a94-616e-404b-ac13-265b81f0a3ba tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] The token cache is being invalidate because project 3bff18f01277464dbfbc934840a1e423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:27.504856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ad74a94-616e-404b-ac13-265b81f0a3ba tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:27.505614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ad74a94-616e-404b-ac13-265b81f0a3ba tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:27.508079 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3990/7945] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:19:27 2022] DELETE /identity/v3/projects/3bff18f01277464dbfbc934840a1e423 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:27.514027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127cad6-673e-4fa0-b45f-8b1d20b14e81 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:27.515445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f127cad6-673e-4fa0-b45f-8b1d20b14e81 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:27.536111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad74a94-616e-404b-ac13-265b81f0a3ba tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:27.537689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9ad74a94-616e-404b-ac13-265b81f0a3ba tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:27.541758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127cad6-673e-4fa0-b45f-8b1d20b14e81 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:27.706191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf117eb-99d5-48c1-9e82-4d896d9fd839 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:27.706448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf117eb-99d5-48c1-9e82-4d896d9fd839 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:27.706578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf117eb-99d5-48c1-9e82-4d896d9fd839 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:27.706854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf117eb-99d5-48c1-9e82-4d896d9fd839 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/users/e1adf5c5cce44e3ab01b610c73b04043` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:27.709207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf117eb-99d5-48c1-9e82-4d896d9fd839 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:update_user(user_id=e1adf5c5cce44e3ab01b610c73b04043)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:27.714460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf117eb-99d5-48c1-9e82-4d896d9fd839 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:27.773834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad74a94-616e-404b-ac13-265b81f0a3ba tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:27.804625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097e1ac-4c61-4c85-91bf-083309a8204b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:27.804625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097e1ac-4c61-4c85-91bf-083309a8204b service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:27.804625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097e1ac-4c61-4c85-91bf-083309a8204b service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:27.804625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097e1ac-4c61-4c85-91bf-083309a8204b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:27.808025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0097e1ac-4c61-4c85-91bf-083309a8204b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:27.813006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cdf117eb-99d5-48c1-9e82-4d896d9fd839 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'e1adf5c5cce44e3ab01b610c73b04043'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:27.817658 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:27.838575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cdf117eb-99d5-48c1-9e82-4d896d9fd839 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invalidating the token cache because user e1adf5c5cce44e3ab01b610c73b04043 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:27.838874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cdf117eb-99d5-48c1-9e82-4d896d9fd839 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:27.841419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cdf117eb-99d5-48c1-9e82-4d896d9fd839 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:27.847727 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3956/7946] 10.222.0.16 () {60 vars in 1243 bytes} [Fri Sep 30 10:19:27 2022] PATCH /identity/v3/users/e1adf5c5cce44e3ab01b610c73b04043 => generated 296 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:27.853120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72bac8-16e3-4285-93dd-a86b2d199d13 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:27.853406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72bac8-16e3-4285-93dd-a86b2d199d13 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:27.853680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72bac8-16e3-4285-93dd-a86b2d199d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:27.949920 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:27.954573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1c72bac8-16e3-4285-93dd-a86b2d199d13 None None] MFA Rules not processed for user `e1adf5c5cce44e3ab01b610c73b04043`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:27.955875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1c72bac8-16e3-4285-93dd-a86b2d199d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:27.966304 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3957/7947] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:27 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 10:19:27.972053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72bac8-16e3-4285-93dd-a86b2d199d13 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:27.984862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1c72bac8-16e3-4285-93dd-a86b2d199d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:28.031556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097e1ac-4c61-4c85-91bf-083309a8204b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:28.033689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72bac8-16e3-4285-93dd-a86b2d199d13 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:28.037049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097e1ac-4c61-4c85-91bf-083309a8204b service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:28.045170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f323de-cb85-40a9-8682-4ca09a15e4a9 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:28.045813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f323de-cb85-40a9-8682-4ca09a15e4a9 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:28.046092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f323de-cb85-40a9-8682-4ca09a15e4a9 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:28.046375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f323de-cb85-40a9-8682-4ca09a15e4a9 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/users/e1adf5c5cce44e3ab01b610c73b04043` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:28.047619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f323de-cb85-40a9-8682-4ca09a15e4a9 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:update_user(user_id=e1adf5c5cce44e3ab01b610c73b04043)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:28.050909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f323de-cb85-40a9-8682-4ca09a15e4a9 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:28.060592 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3991/7948] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:19:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:19:28.151900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-57f323de-cb85-40a9-8682-4ca09a15e4a9 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'e1adf5c5cce44e3ab01b610c73b04043'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:28.164378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-57f323de-cb85-40a9-8682-4ca09a15e4a9 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invalidating the token cache because user e1adf5c5cce44e3ab01b610c73b04043 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:28.165205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-57f323de-cb85-40a9-8682-4ca09a15e4a9 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:28.166265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-57f323de-cb85-40a9-8682-4ca09a15e4a9 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:28.174733 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3958/7949] 10.222.0.16 () {60 vars in 1243 bytes} [Fri Sep 30 10:19:27 2022] PATCH /identity/v3/users/e1adf5c5cce44e3ab01b610c73b04043 => generated 296 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:28.176946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097e1ac-4c61-4c85-91bf-083309a8204b service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:28.178568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0097e1ac-4c61-4c85-91bf-083309a8204b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:28.202028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097e1ac-4c61-4c85-91bf-083309a8204b service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:28.210127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e233b-811c-4c40-a45f-ecbad40a8954 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:28.210844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e233b-811c-4c40-a45f-ecbad40a8954 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:28.211171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e233b-811c-4c40-a45f-ecbad40a8954 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:28.211458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e233b-811c-4c40-a45f-ecbad40a8954 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/users/e1adf5c5cce44e3ab01b610c73b04043` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:28.232728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e233b-811c-4c40-a45f-ecbad40a8954 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:update_user(user_id=e1adf5c5cce44e3ab01b610c73b04043)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:28.233784 n-d-master-1 devstack@keystone.service[82079]: WARNING py.warnings [None req-d09e233b-811c-4c40-a45f-ecbad40a8954 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 10:19:28.233784 n-d-master-1 devstack@keystone.service[82079]: warnings.warn(msg) Sep 30 10:19:28.233784 n-d-master-1 devstack@keystone.service[82079]: Sep 30 10:19:28.235006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e233b-811c-4c40-a45f-ecbad40a8954 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:28.308911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d09e233b-811c-4c40-a45f-ecbad40a8954 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'e1adf5c5cce44e3ab01b610c73b04043'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:28.331459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d09e233b-811c-4c40-a45f-ecbad40a8954 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invalidating the token cache because user e1adf5c5cce44e3ab01b610c73b04043 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:28.332751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d09e233b-811c-4c40-a45f-ecbad40a8954 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:28.333869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d09e233b-811c-4c40-a45f-ecbad40a8954 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:28.336399 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3992/7950] 10.222.0.16 () {60 vars in 1243 bytes} [Fri Sep 30 10:19:28 2022] PATCH /identity/v3/users/e1adf5c5cce44e3ab01b610c73b04043 => generated 296 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:28.340566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21eadd2-cb14-4c5c-a688-8113e4574cd3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:28.340893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21eadd2-cb14-4c5c-a688-8113e4574cd3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:28.341357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21eadd2-cb14-4c5c-a688-8113e4574cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:28.386272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b21eadd2-cb14-4c5c-a688-8113e4574cd3 None None] MFA Rules not processed for user `e1adf5c5cce44e3ab01b610c73b04043`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:28.387480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b21eadd2-cb14-4c5c-a688-8113e4574cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:28.398252 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3959/7951] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:28 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 10:19:28.402411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e233b-811c-4c40-a45f-ecbad40a8954 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:28.403836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d09e233b-811c-4c40-a45f-ecbad40a8954 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:28.418707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e233b-811c-4c40-a45f-ecbad40a8954 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:28.426853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f4be1-80ef-4cc7-8459-656d9a65aa63 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:28.427511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f4be1-80ef-4cc7-8459-656d9a65aa63 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:28.427933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f4be1-80ef-4cc7-8459-656d9a65aa63 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:28.428214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f4be1-80ef-4cc7-8459-656d9a65aa63 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/users/e1adf5c5cce44e3ab01b610c73b04043` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:28.432589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f4be1-80ef-4cc7-8459-656d9a65aa63 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:update_user(user_id=e1adf5c5cce44e3ab01b610c73b04043)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:28.434564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f4be1-80ef-4cc7-8459-656d9a65aa63 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:28.537870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-348f4be1-80ef-4cc7-8459-656d9a65aa63 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'e1adf5c5cce44e3ab01b610c73b04043'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:28.548538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-348f4be1-80ef-4cc7-8459-656d9a65aa63 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invalidating the token cache because user e1adf5c5cce44e3ab01b610c73b04043 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:28.549180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-348f4be1-80ef-4cc7-8459-656d9a65aa63 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:28.551765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-348f4be1-80ef-4cc7-8459-656d9a65aa63 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:28.563069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21eadd2-cb14-4c5c-a688-8113e4574cd3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:28.597412 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3993/7952] 10.222.0.16 () {60 vars in 1243 bytes} [Fri Sep 30 10:19:28 2022] PATCH /identity/v3/users/e1adf5c5cce44e3ab01b610c73b04043 => generated 296 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:28.606960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21eadd2-cb14-4c5c-a688-8113e4574cd3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:28.613714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63487839-6cf3-4606-b3c7-15b672c39bc5 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:28.614606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63487839-6cf3-4606-b3c7-15b672c39bc5 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:28.615299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63487839-6cf3-4606-b3c7-15b672c39bc5 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:28.615722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63487839-6cf3-4606-b3c7-15b672c39bc5 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:28.616515 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63487839-6cf3-4606-b3c7-15b672c39bc5 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:28.618589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63487839-6cf3-4606-b3c7-15b672c39bc5 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:28.660801 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3960/7953] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Sep 30 10:19:28 2022] POST /identity/v3/users => generated 265 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:28.662725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f4be1-80ef-4cc7-8459-656d9a65aa63 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:28.664518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-348f4be1-80ef-4cc7-8459-656d9a65aa63 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:28.683386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f4be1-80ef-4cc7-8459-656d9a65aa63 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:28.689771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbae3bd-054d-4362-b279-90c927b69e75 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:28.690954 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbae3bd-054d-4362-b279-90c927b69e75 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:28.691553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbae3bd-054d-4362-b279-90c927b69e75 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:28.692151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbae3bd-054d-4362-b279-90c927b69e75 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/users/121bc25bde5c4a4ab24fe65fadd8c127/password` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:28.803624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6dbae3bd-054d-4362-b279-90c927b69e75 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '121bc25bde5c4a4ab24fe65fadd8c127'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:28.828261 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3994/7954] 10.222.0.16 () {60 vars in 1269 bytes} [Fri Sep 30 10:19:28 2022] POST /identity/v3/users/121bc25bde5c4a4ab24fe65fadd8c127/password => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:29.833099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2600164-411d-46bf-9870-39e13a348ce7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:29.833600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2600164-411d-46bf-9870-39e13a348ce7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:29.833709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2600164-411d-46bf-9870-39e13a348ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:29.873412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c2600164-411d-46bf-9870-39e13a348ce7 None None] MFA Rules not processed for user `121bc25bde5c4a4ab24fe65fadd8c127`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:29.875280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c2600164-411d-46bf-9870-39e13a348ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:29.879558 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3961/7955] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:29 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 10:19:29.885262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbae3bd-054d-4362-b279-90c927b69e75 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:29.899884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbae3bd-054d-4362-b279-90c927b69e75 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:29.925827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7533e-1c25-4eda-902d-6aa4ff12f56f tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:29.928913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7533e-1c25-4eda-902d-6aa4ff12f56f tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:29.929438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7533e-1c25-4eda-902d-6aa4ff12f56f tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:29.929924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7533e-1c25-4eda-902d-6aa4ff12f56f tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:29.953053 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7533e-1c25-4eda-902d-6aa4ff12f56f tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:29.962040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7533e-1c25-4eda-902d-6aa4ff12f56f tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:29.990610 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3995/7956] 10.222.0.16 () {56 vars in 1263 bytes} [Fri Sep 30 10:19:29 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 10:19:29.991694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2600164-411d-46bf-9870-39e13a348ce7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:30.029364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2600164-411d-46bf-9870-39e13a348ce7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:30.038023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f8c4e-79c2-4d81-b049-3a4560ae22be tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:30.038915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f8c4e-79c2-4d81-b049-3a4560ae22be tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:30.039290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f8c4e-79c2-4d81-b049-3a4560ae22be tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:30.039741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f8c4e-79c2-4d81-b049-3a4560ae22be tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/users/121bc25bde5c4a4ab24fe65fadd8c127` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:30.054782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f8c4e-79c2-4d81-b049-3a4560ae22be tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:delete_user(user_id=121bc25bde5c4a4ab24fe65fadd8c127)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:30.058256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f8c4e-79c2-4d81-b049-3a4560ae22be tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:30.186915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f96f8c4e-79c2-4d81-b049-3a4560ae22be tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '121bc25bde5c4a4ab24fe65fadd8c127'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:30.226488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f96f8c4e-79c2-4d81-b049-3a4560ae22be tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '121bc25bde5c4a4ab24fe65fadd8c127'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:30.229596 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f96f8c4e-79c2-4d81-b049-3a4560ae22be tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '121bc25bde5c4a4ab24fe65fadd8c127'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:30.291677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f96f8c4e-79c2-4d81-b049-3a4560ae22be tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '121bc25bde5c4a4ab24fe65fadd8c127'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:30.307524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f96f8c4e-79c2-4d81-b049-3a4560ae22be tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '121bc25bde5c4a4ab24fe65fadd8c127'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:30.320485 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3962/7957] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:29 2022] DELETE /identity/v3/users/121bc25bde5c4a4ab24fe65fadd8c127 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:30.322740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7533e-1c25-4eda-902d-6aa4ff12f56f tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:30.341002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7533e-1c25-4eda-902d-6aa4ff12f56f tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:30.463436 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:UPDATE=3,keystone:INSERT=6,keystone:DELETE=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:30.479033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8fbbd-a3fa-4ff4-95e5-ae288f2ea0e4 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:30.479897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8fbbd-a3fa-4ff4-95e5-ae288f2ea0e4 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:30.481202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8fbbd-a3fa-4ff4-95e5-ae288f2ea0e4 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:30.481874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8fbbd-a3fa-4ff4-95e5-ae288f2ea0e4 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:30.484444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8fbbd-a3fa-4ff4-95e5-ae288f2ea0e4 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:30.487089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8fbbd-a3fa-4ff4-95e5-ae288f2ea0e4 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:30.559630 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3996/7958] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:19:30 2022] POST /identity/v3/users => generated 364 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:30.564570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f8c4e-79c2-4d81-b049-3a4560ae22be tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:30.566552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f96f8c4e-79c2-4d81-b049-3a4560ae22be tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:30.588697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f8c4e-79c2-4d81-b049-3a4560ae22be tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:30.615835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c0bb3-40d5-445b-93f0-717e989d2201 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:30.617002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c0bb3-40d5-445b-93f0-717e989d2201 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:30.618743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c0bb3-40d5-445b-93f0-717e989d2201 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:30.619026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c0bb3-40d5-445b-93f0-717e989d2201 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:30.622465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c0bb3-40d5-445b-93f0-717e989d2201 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:30.627218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c0bb3-40d5-445b-93f0-717e989d2201 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:30.695778 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3963/7959] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:19:30 2022] POST /identity/v3/projects => generated 359 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:30.697542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8fbbd-a3fa-4ff4-95e5-ae288f2ea0e4 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:30.721976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8fbbd-a3fa-4ff4-95e5-ae288f2ea0e4 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:30.921879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b8e2d-e5a1-4744-86a5-45dc76b95ccc tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:30.923358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b8e2d-e5a1-4744-86a5-45dc76b95ccc tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:30.923796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b8e2d-e5a1-4744-86a5-45dc76b95ccc tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:30.924221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b8e2d-e5a1-4744-86a5-45dc76b95ccc tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/users/ecd93ac513774b52a2570ce68f7de373` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:30.960575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b8e2d-e5a1-4744-86a5-45dc76b95ccc tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:update_user(user_id=ecd93ac513774b52a2570ce68f7de373)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:30.963761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b8e2d-e5a1-4744-86a5-45dc76b95ccc tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:31.022385 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3997/7960] 10.222.0.16 () {60 vars in 1244 bytes} [Fri Sep 30 10:19:30 2022] PATCH /identity/v3/users/ecd93ac513774b52a2570ce68f7de373 => generated 523 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:31.026748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c0bb3-40d5-445b-93f0-717e989d2201 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:31.044566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c0bb3-40d5-445b-93f0-717e989d2201 tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:31.052907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b71af-60da-4cda-b5df-eaa776256c6d tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:31.053646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b71af-60da-4cda-b5df-eaa776256c6d tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:31.054003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b71af-60da-4cda-b5df-eaa776256c6d tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:31.054361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b71af-60da-4cda-b5df-eaa776256c6d tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/users/ecd93ac513774b52a2570ce68f7de373` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:31.077277 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=8,keystone:DELETE=12,keystone:SELECT=79,keystone:UPDATE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:31.083379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b71af-60da-4cda-b5df-eaa776256c6d tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:get_user(user_id=ecd93ac513774b52a2570ce68f7de373)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:31.087727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b71af-60da-4cda-b5df-eaa776256c6d tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:31.094263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b8e2d-e5a1-4744-86a5-45dc76b95ccc tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:31.114268 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3964/7961] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Sep 30 10:19:31 2022] GET /identity/v3/users/ecd93ac513774b52a2570ce68f7de373 => generated 389 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:31.124090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b8e2d-e5a1-4744-86a5-45dc76b95ccc tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:31.151051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bb7c9-3e10-4c03-ab7a-2a1102d6191f tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:31.152160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bb7c9-3e10-4c03-ab7a-2a1102d6191f tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:31.152719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bb7c9-3e10-4c03-ab7a-2a1102d6191f tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:31.153213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bb7c9-3e10-4c03-ab7a-2a1102d6191f tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/projects/e4854870885f40ac901680b6dfcfae24` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:31.155333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bb7c9-3e10-4c03-ab7a-2a1102d6191f tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e4854870885f40ac901680b6dfcfae24)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:31.158249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bb7c9-3e10-4c03-ab7a-2a1102d6191f tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:31.237906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-302bb7c9-3e10-4c03-ab7a-2a1102d6191f tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4854870885f40ac901680b6dfcfae24', 'request_id': 'req-302bb7c9-3e10-4c03-ab7a-2a1102d6191f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:31.250140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-302bb7c9-3e10-4c03-ab7a-2a1102d6191f tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4854870885f40ac901680b6dfcfae24', 'request_id': 'req-302bb7c9-3e10-4c03-ab7a-2a1102d6191f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:31.264308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-302bb7c9-3e10-4c03-ab7a-2a1102d6191f tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4854870885f40ac901680b6dfcfae24', 'request_id': 'req-302bb7c9-3e10-4c03-ab7a-2a1102d6191f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:31.302538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-302bb7c9-3e10-4c03-ab7a-2a1102d6191f tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] The token cache is being invalidate because project e4854870885f40ac901680b6dfcfae24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:31.302848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-302bb7c9-3e10-4c03-ab7a-2a1102d6191f tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:31.349363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-302bb7c9-3e10-4c03-ab7a-2a1102d6191f tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:31.354870 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3998/7962] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:19:31 2022] DELETE /identity/v3/projects/e4854870885f40ac901680b6dfcfae24 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:19:31.359982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b71af-60da-4cda-b5df-eaa776256c6d tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:31.363202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-559b71af-60da-4cda-b5df-eaa776256c6d tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:31.396810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b71af-60da-4cda-b5df-eaa776256c6d tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:31.564153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1930a-38f1-41e0-b118-effcee06f65e tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f13226fd644916864799b081cf42f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74ecf9660ca4c168c3a22276569ea1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:31.564544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1930a-38f1-41e0-b118-effcee06f65e tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:31.566614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1930a-38f1-41e0-b118-effcee06f65e tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:31.567046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1930a-38f1-41e0-b118-effcee06f65e tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] PATH_INFO: `/v3/users/ecd93ac513774b52a2570ce68f7de373` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:31.568711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1930a-38f1-41e0-b118-effcee06f65e tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ecd93ac513774b52a2570ce68f7de373)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:31.571347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1930a-38f1-41e0-b118-effcee06f65e tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:31.650768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9fa1930a-38f1-41e0-b118-effcee06f65e tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecd93ac513774b52a2570ce68f7de373'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:31.673375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9fa1930a-38f1-41e0-b118-effcee06f65e tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecd93ac513774b52a2570ce68f7de373'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:31.678858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9fa1930a-38f1-41e0-b118-effcee06f65e tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecd93ac513774b52a2570ce68f7de373'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:31.709134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9fa1930a-38f1-41e0-b118-effcee06f65e tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecd93ac513774b52a2570ce68f7de373'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:31.725629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9fa1930a-38f1-41e0-b118-effcee06f65e tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecd93ac513774b52a2570ce68f7de373'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:31.751520 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3965/7963] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:31 2022] DELETE /identity/v3/users/ecd93ac513774b52a2570ce68f7de373 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:31.765873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bb7c9-3e10-4c03-ab7a-2a1102d6191f tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:31.767965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-302bb7c9-3e10-4c03-ab7a-2a1102d6191f tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:31.870604 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:UPDATE=2,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:31.922747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bb7c9-3e10-4c03-ab7a-2a1102d6191f tempest-UsersV3TestJSON-452586986 tempest-UsersV3TestJSON-452586986-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:32.084345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d260cc-1d0d-4bc9-9585-c8e01d2b68d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:32.084345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d260cc-1d0d-4bc9-9585-c8e01d2b68d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:32.084345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d260cc-1d0d-4bc9-9585-c8e01d2b68d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:32.084345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d260cc-1d0d-4bc9-9585-c8e01d2b68d7 admin admin] PATH_INFO: `/v3/users/e1adf5c5cce44e3ab01b610c73b04043` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:32.116127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d260cc-1d0d-4bc9-9585-c8e01d2b68d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1adf5c5cce44e3ab01b610c73b04043)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:32.119830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d260cc-1d0d-4bc9-9585-c8e01d2b68d7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:32.196098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a8d260cc-1d0d-4bc9-9585-c8e01d2b68d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1adf5c5cce44e3ab01b610c73b04043'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:32.197595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a8d260cc-1d0d-4bc9-9585-c8e01d2b68d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1adf5c5cce44e3ab01b610c73b04043'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:32.213997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a8d260cc-1d0d-4bc9-9585-c8e01d2b68d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1adf5c5cce44e3ab01b610c73b04043'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:32.238659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a8d260cc-1d0d-4bc9-9585-c8e01d2b68d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1adf5c5cce44e3ab01b610c73b04043'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:32.263366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a8d260cc-1d0d-4bc9-9585-c8e01d2b68d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1adf5c5cce44e3ab01b610c73b04043'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:32.272533 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3999/7964] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:31 2022] DELETE /identity/v3/users/e1adf5c5cce44e3ab01b610c73b04043 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:32.277696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60a626-b980-4d5f-a6aa-4f6663b55803 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:32.278166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60a626-b980-4d5f-a6aa-4f6663b55803 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:32.278461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60a626-b980-4d5f-a6aa-4f6663b55803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:32.304459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3c60a626-b980-4d5f-a6aa-4f6663b55803 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:32.305730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3c60a626-b980-4d5f-a6aa-4f6663b55803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:32.412512 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3966/7965] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:32.424284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d260cc-1d0d-4bc9-9585-c8e01d2b68d7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:32.426016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a8d260cc-1d0d-4bc9-9585-c8e01d2b68d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:32.510602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d260cc-1d0d-4bc9-9585-c8e01d2b68d7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:32.515020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e432a8-eeb0-4c5d-9b6d-27f3af1851e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:32.515703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e432a8-eeb0-4c5d-9b6d-27f3af1851e1 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:32.515987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e432a8-eeb0-4c5d-9b6d-27f3af1851e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:32.516256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e432a8-eeb0-4c5d-9b6d-27f3af1851e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:32.528468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e432a8-eeb0-4c5d-9b6d-27f3af1851e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:32.530253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e432a8-eeb0-4c5d-9b6d-27f3af1851e1 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:32.536942 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:32.560299 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4000/7966] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:19:33.113422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60a626-b980-4d5f-a6aa-4f6663b55803 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:33.114989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3c60a626-b980-4d5f-a6aa-4f6663b55803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:33.137338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60a626-b980-4d5f-a6aa-4f6663b55803 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:33.146472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472d3d1-d1f9-4c28-a13b-936f12f2bc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:33.147295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472d3d1-d1f9-4c28-a13b-936f12f2bc52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:33.147816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472d3d1-d1f9-4c28-a13b-936f12f2bc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:33.148315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472d3d1-d1f9-4c28-a13b-936f12f2bc52 admin admin] PATH_INFO: `/v3/projects/e7ee9c6323324444af2bb0abf7111414` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:33.149854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472d3d1-d1f9-4c28-a13b-936f12f2bc52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7ee9c6323324444af2bb0abf7111414)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:33.155079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472d3d1-d1f9-4c28-a13b-936f12f2bc52 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:33.220373 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:33.333280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f472d3d1-d1f9-4c28-a13b-936f12f2bc52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7ee9c6323324444af2bb0abf7111414', 'request_id': 'req-f472d3d1-d1f9-4c28-a13b-936f12f2bc52'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:33.335505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f472d3d1-d1f9-4c28-a13b-936f12f2bc52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7ee9c6323324444af2bb0abf7111414', 'request_id': 'req-f472d3d1-d1f9-4c28-a13b-936f12f2bc52'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:33.344009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f472d3d1-d1f9-4c28-a13b-936f12f2bc52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7ee9c6323324444af2bb0abf7111414', 'request_id': 'req-f472d3d1-d1f9-4c28-a13b-936f12f2bc52'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:33.357485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f472d3d1-d1f9-4c28-a13b-936f12f2bc52 admin admin] The token cache is being invalidate because project e7ee9c6323324444af2bb0abf7111414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:33.358026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f472d3d1-d1f9-4c28-a13b-936f12f2bc52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:33.358686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f472d3d1-d1f9-4c28-a13b-936f12f2bc52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:33.367806 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3967/7967] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:19:33 2022] DELETE /identity/v3/projects/e7ee9c6323324444af2bb0abf7111414 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:33.368901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e432a8-eeb0-4c5d-9b6d-27f3af1851e1 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:33.381026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e432a8-eeb0-4c5d-9b6d-27f3af1851e1 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:33.513217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636044d-31fa-4fba-ac37-3d56bd73cc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:33.516352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636044d-31fa-4fba-ac37-3d56bd73cc27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:33.518730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636044d-31fa-4fba-ac37-3d56bd73cc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:33.522506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636044d-31fa-4fba-ac37-3d56bd73cc27 admin admin] PATH_INFO: `/v3/users/63f13226fd644916864799b081cf42f1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:33.525401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636044d-31fa-4fba-ac37-3d56bd73cc27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f13226fd644916864799b081cf42f1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:33.529986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636044d-31fa-4fba-ac37-3d56bd73cc27 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:33.661801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1636044d-31fa-4fba-ac37-3d56bd73cc27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f13226fd644916864799b081cf42f1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:33.662507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1636044d-31fa-4fba-ac37-3d56bd73cc27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f13226fd644916864799b081cf42f1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:33.710530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1636044d-31fa-4fba-ac37-3d56bd73cc27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f13226fd644916864799b081cf42f1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:33.747567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1636044d-31fa-4fba-ac37-3d56bd73cc27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f13226fd644916864799b081cf42f1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:33.765733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1636044d-31fa-4fba-ac37-3d56bd73cc27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f13226fd644916864799b081cf42f1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:33.774725 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4001/7968] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:33 2022] DELETE /identity/v3/users/63f13226fd644916864799b081cf42f1 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:34.550323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472d3d1-d1f9-4c28-a13b-936f12f2bc52 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:34.552150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f472d3d1-d1f9-4c28-a13b-936f12f2bc52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:34.572582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472d3d1-d1f9-4c28-a13b-936f12f2bc52 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:34.674248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af436d3c-5a09-433e-9dc4-e0e9d87e1b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:34.675075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af436d3c-5a09-433e-9dc4-e0e9d87e1b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:34.675494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af436d3c-5a09-433e-9dc4-e0e9d87e1b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:34.675854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af436d3c-5a09-433e-9dc4-e0e9d87e1b7c admin admin] PATH_INFO: `/v3/projects/c74ecf9660ca4c168c3a22276569ea1b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:34.677475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af436d3c-5a09-433e-9dc4-e0e9d87e1b7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c74ecf9660ca4c168c3a22276569ea1b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:34.679696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af436d3c-5a09-433e-9dc4-e0e9d87e1b7c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:34.769575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af436d3c-5a09-433e-9dc4-e0e9d87e1b7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c74ecf9660ca4c168c3a22276569ea1b', 'request_id': 'req-af436d3c-5a09-433e-9dc4-e0e9d87e1b7c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:34.795619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af436d3c-5a09-433e-9dc4-e0e9d87e1b7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c74ecf9660ca4c168c3a22276569ea1b', 'request_id': 'req-af436d3c-5a09-433e-9dc4-e0e9d87e1b7c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:34.803944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af436d3c-5a09-433e-9dc4-e0e9d87e1b7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c74ecf9660ca4c168c3a22276569ea1b', 'request_id': 'req-af436d3c-5a09-433e-9dc4-e0e9d87e1b7c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:34.819383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af436d3c-5a09-433e-9dc4-e0e9d87e1b7c admin admin] The token cache is being invalidate because project c74ecf9660ca4c168c3a22276569ea1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:34.819850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af436d3c-5a09-433e-9dc4-e0e9d87e1b7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:34.820626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af436d3c-5a09-433e-9dc4-e0e9d87e1b7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:34.823089 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3968/7969] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:19:34 2022] DELETE /identity/v3/projects/c74ecf9660ca4c168c3a22276569ea1b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:34.833864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dd603-d6ef-47da-acd8-c09134c3a092 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:34.835548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dd603-d6ef-47da-acd8-c09134c3a092 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:34.836084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dd603-d6ef-47da-acd8-c09134c3a092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:34.874220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-302dd603-d6ef-47da-acd8-c09134c3a092 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:34.878990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-302dd603-d6ef-47da-acd8-c09134c3a092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:35.050101 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4002/7970] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:35.059654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a243e18-d0bf-4820-8a67-1de190e4301e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:35.060260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a243e18-d0bf-4820-8a67-1de190e4301e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:35.060778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a243e18-d0bf-4820-8a67-1de190e4301e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:35.116846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6a243e18-d0bf-4820-8a67-1de190e4301e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:35.118369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6a243e18-d0bf-4820-8a67-1de190e4301e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:35.136946 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3969/7971] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:35.141081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dd603-d6ef-47da-acd8-c09134c3a092 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:35.177400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dd603-d6ef-47da-acd8-c09134c3a092 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:35.185002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dc9fc-c58e-4a50-b8a4-560eb3ae798b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:35.186203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dc9fc-c58e-4a50-b8a4-560eb3ae798b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:35.186663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dc9fc-c58e-4a50-b8a4-560eb3ae798b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:35.190901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dc9fc-c58e-4a50-b8a4-560eb3ae798b admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:35.191720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2dc9fc-c58e-4a50-b8a4-560eb3ae798b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:19:35.192097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2dc9fc-c58e-4a50-b8a4-560eb3ae798b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:35.195300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2dc9fc-c58e-4a50-b8a4-560eb3ae798b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:35.214772 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4003/7972] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:35.219124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a243e18-d0bf-4820-8a67-1de190e4301e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:35.238748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a243e18-d0bf-4820-8a67-1de190e4301e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:35.250062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8db9c-5436-4abf-a7fb-2090bcc743be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:35.252261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8db9c-5436-4abf-a7fb-2090bcc743be admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:35.252561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8db9c-5436-4abf-a7fb-2090bcc743be admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:35.252873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8db9c-5436-4abf-a7fb-2090bcc743be admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:35.253522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8db9c-5436-4abf-a7fb-2090bcc743be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:35.256685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8db9c-5436-4abf-a7fb-2090bcc743be admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:35.300488 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3970/7973] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:19:35 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:19:35.304563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dc9fc-c58e-4a50-b8a4-560eb3ae798b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:35.334884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dc9fc-c58e-4a50-b8a4-560eb3ae798b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:35.342965 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:35.484694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b456353-a9bc-4396-953f-ac2ee658508d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:35.489530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b456353-a9bc-4396-953f-ac2ee658508d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:35.489889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b456353-a9bc-4396-953f-ac2ee658508d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:35.490074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b456353-a9bc-4396-953f-ac2ee658508d admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:35.490745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b456353-a9bc-4396-953f-ac2ee658508d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:35.512825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b456353-a9bc-4396-953f-ac2ee658508d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:35.580137 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4004/7974] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:19:35 2022] POST /identity/v3/users => generated 288 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:19:35.583562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8db9c-5436-4abf-a7fb-2090bcc743be admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:35.593237 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:35.599929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8db9c-5436-4abf-a7fb-2090bcc743be admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:35.619978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea9f2d-e1c8-4fc7-b598-bbf2e35a5833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:35.620982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea9f2d-e1c8-4fc7-b598-bbf2e35a5833 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:35.621411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea9f2d-e1c8-4fc7-b598-bbf2e35a5833 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:35.622039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea9f2d-e1c8-4fc7-b598-bbf2e35a5833 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:35.622970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea9f2d-e1c8-4fc7-b598-bbf2e35a5833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:35.625163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea9f2d-e1c8-4fc7-b598-bbf2e35a5833 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:35.656437 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3971/7975] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:19:35.660473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b456353-a9bc-4396-953f-ac2ee658508d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:35.681336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b456353-a9bc-4396-953f-ac2ee658508d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:35.695350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03133e-b82e-410d-a8d1-91c40bc93cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:35.696493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03133e-b82e-410d-a8d1-91c40bc93cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:35.696898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03133e-b82e-410d-a8d1-91c40bc93cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:35.697271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03133e-b82e-410d-a8d1-91c40bc93cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:35.698023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03133e-b82e-410d-a8d1-91c40bc93cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:35.704771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03133e-b82e-410d-a8d1-91c40bc93cb9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:35.731505 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4005/7976] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:19:35.737316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea9f2d-e1c8-4fc7-b598-bbf2e35a5833 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:35.757833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea9f2d-e1c8-4fc7-b598-bbf2e35a5833 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:35.773174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c9a59-4ea2-4e88-9055-7126ef3cd82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:35.773965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c9a59-4ea2-4e88-9055-7126ef3cd82b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:35.774160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c9a59-4ea2-4e88-9055-7126ef3cd82b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:35.774446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c9a59-4ea2-4e88-9055-7126ef3cd82b admin admin] PATH_INFO: `/v3/projects/3a75a6c21d3d448bb38bbc81591431ed/users/1e68197f3e0e4d32b0ceb1d6b3462355/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:35.808012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c9a59-4ea2-4e88-9055-7126ef3cd82b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a75a6c21d3d448bb38bbc81591431ed, user_id=1e68197f3e0e4d32b0ceb1d6b3462355, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:35.810732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c9a59-4ea2-4e88-9055-7126ef3cd82b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:35.834834 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3972/7977] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:19:35 2022] PUT /identity/v3/projects/3a75a6c21d3d448bb38bbc81591431ed/users/1e68197f3e0e4d32b0ceb1d6b3462355/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:35.845794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b305569-453c-4a22-85d2-e9796e859715 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:35.846360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b305569-453c-4a22-85d2-e9796e859715 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:35.846469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b305569-453c-4a22-85d2-e9796e859715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:35.915427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6b305569-453c-4a22-85d2-e9796e859715 None None] MFA Rules not processed for user `1e68197f3e0e4d32b0ceb1d6b3462355`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:35.916756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6b305569-453c-4a22-85d2-e9796e859715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:36.098614 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4006/7978] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:36.100089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c9a59-4ea2-4e88-9055-7126ef3cd82b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:36.241511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c9a59-4ea2-4e88-9055-7126ef3cd82b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:36.249652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd52d2-da9b-473d-a339-b38c729b5e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:36.250457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd52d2-da9b-473d-a339-b38c729b5e8c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:36.251342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd52d2-da9b-473d-a339-b38c729b5e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:36.251703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd52d2-da9b-473d-a339-b38c729b5e8c admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:36.252629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd52d2-da9b-473d-a339-b38c729b5e8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:36.254959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd52d2-da9b-473d-a339-b38c729b5e8c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:36.344256 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3973/7979] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:19:36 2022] POST /identity/v3/projects => generated 377 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:36.349362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b305569-453c-4a22-85d2-e9796e859715 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:36.367343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b305569-453c-4a22-85d2-e9796e859715 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:36.529781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199a9b2-ad5f-4892-8962-af9a9cba6f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:36.543166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199a9b2-ad5f-4892-8962-af9a9cba6f9f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:36.545719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199a9b2-ad5f-4892-8962-af9a9cba6f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:36.546811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199a9b2-ad5f-4892-8962-af9a9cba6f9f admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:36.548896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199a9b2-ad5f-4892-8962-af9a9cba6f9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:36.567603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199a9b2-ad5f-4892-8962-af9a9cba6f9f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:36.636029 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4007/7980] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:19:36 2022] POST /identity/v3/users => generated 289 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:36.637238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd52d2-da9b-473d-a339-b38c729b5e8c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:36.650032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd52d2-da9b-473d-a339-b38c729b5e8c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:36.655187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54e5d1-0fd3-46aa-8ae8-34178e5878d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:36.656058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54e5d1-0fd3-46aa-8ae8-34178e5878d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:36.656687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54e5d1-0fd3-46aa-8ae8-34178e5878d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:36.657228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54e5d1-0fd3-46aa-8ae8-34178e5878d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:36.658073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54e5d1-0fd3-46aa-8ae8-34178e5878d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:36.660225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54e5d1-0fd3-46aa-8ae8-34178e5878d9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:36.682658 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3974/7981] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:19:36.684206 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199a9b2-ad5f-4892-8962-af9a9cba6f9f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:36.696705 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:36.703097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199a9b2-ad5f-4892-8962-af9a9cba6f9f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:36.720895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a665cd-a30e-4c87-90d4-eaa0a44c0a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:36.721650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a665cd-a30e-4c87-90d4-eaa0a44c0a53 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:36.722007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a665cd-a30e-4c87-90d4-eaa0a44c0a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:36.722434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a665cd-a30e-4c87-90d4-eaa0a44c0a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:36.723451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a665cd-a30e-4c87-90d4-eaa0a44c0a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:36.725331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a665cd-a30e-4c87-90d4-eaa0a44c0a53 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:36.740635 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4008/7982] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:19:36.742010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54e5d1-0fd3-46aa-8ae8-34178e5878d9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:36.755375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54e5d1-0fd3-46aa-8ae8-34178e5878d9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:36.769777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ba1b1-d612-4214-8d72-a8480bcbab8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:36.770844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ba1b1-d612-4214-8d72-a8480bcbab8b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:36.771103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ba1b1-d612-4214-8d72-a8480bcbab8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:36.771404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ba1b1-d612-4214-8d72-a8480bcbab8b admin admin] PATH_INFO: `/v3/projects/3df1cc1933ab46888987e125093b38a0/users/56db36b731b5489993acde1a2d68c5e3/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:36.809906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ba1b1-d612-4214-8d72-a8480bcbab8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df1cc1933ab46888987e125093b38a0, user_id=56db36b731b5489993acde1a2d68c5e3, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:36.814294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ba1b1-d612-4214-8d72-a8480bcbab8b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:36.862694 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3975/7983] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:19:36 2022] PUT /identity/v3/projects/3df1cc1933ab46888987e125093b38a0/users/56db36b731b5489993acde1a2d68c5e3/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:36.873001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4676d6-51fd-4ca6-a2bf-307f900e07ef None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:36.873500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4676d6-51fd-4ca6-a2bf-307f900e07ef None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:36.874026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4676d6-51fd-4ca6-a2bf-307f900e07ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:36.943808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bb4676d6-51fd-4ca6-a2bf-307f900e07ef None None] MFA Rules not processed for user `56db36b731b5489993acde1a2d68c5e3`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:36.946652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bb4676d6-51fd-4ca6-a2bf-307f900e07ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:37.080626 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4009/7984] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:37.106966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ba1b1-d612-4214-8d72-a8480bcbab8b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:37.108809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-009ba1b1-d612-4214-8d72-a8480bcbab8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:37.288915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ba1b1-d612-4214-8d72-a8480bcbab8b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:37.300833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe76b9-b554-4997-904e-87ee463f4fce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:37.301550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe76b9-b554-4997-904e-87ee463f4fce service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:37.301901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe76b9-b554-4997-904e-87ee463f4fce service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:37.302243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe76b9-b554-4997-904e-87ee463f4fce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:37.354298 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:37.399632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe76b9-b554-4997-904e-87ee463f4fce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:37.401539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe76b9-b554-4997-904e-87ee463f4fce service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:37.412930 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3976/7985] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:19:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:19:37.585101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68a928-95b9-4517-9077-521aea0eb0e5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:37.585444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68a928-95b9-4517-9077-521aea0eb0e5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:37.585719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68a928-95b9-4517-9077-521aea0eb0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:37.618101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4c68a928-95b9-4517-9077-521aea0eb0e5 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:37.640593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4c68a928-95b9-4517-9077-521aea0eb0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:37.803757 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4010/7986] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:19:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:37.921356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe76b9-b554-4997-904e-87ee463f4fce service glance] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:37.923052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5afe76b9-b554-4997-904e-87ee463f4fce service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:38.242725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe76b9-b554-4997-904e-87ee463f4fce service glance] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:38.250080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38562d-ea15-4616-92d4-1ac254accae9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:38.268418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38562d-ea15-4616-92d4-1ac254accae9 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:38.268865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38562d-ea15-4616-92d4-1ac254accae9 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:38.269242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38562d-ea15-4616-92d4-1ac254accae9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:38.300932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38562d-ea15-4616-92d4-1ac254accae9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:38.307324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38562d-ea15-4616-92d4-1ac254accae9 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:38.334117 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3977/7987] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:19:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:19:38.634860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68a928-95b9-4517-9077-521aea0eb0e5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:38.636481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4c68a928-95b9-4517-9077-521aea0eb0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:38.659039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68a928-95b9-4517-9077-521aea0eb0e5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:38.667424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63648eee-afd2-4179-8819-a2790cbb20e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:38.668440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63648eee-afd2-4179-8819-a2790cbb20e5 service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:38.668835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63648eee-afd2-4179-8819-a2790cbb20e5 service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:38.669177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63648eee-afd2-4179-8819-a2790cbb20e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:38.694639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63648eee-afd2-4179-8819-a2790cbb20e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:38.701315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63648eee-afd2-4179-8819-a2790cbb20e5 service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:38.718943 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4011/7988] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:19:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:19:38.845162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4f4a1-0cc0-4011-b52b-75fc071575f2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:38.845657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4f4a1-0cc0-4011-b52b-75fc071575f2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:38.845900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4f4a1-0cc0-4011-b52b-75fc071575f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:38.887904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-65c4f4a1-0cc0-4011-b52b-75fc071575f2 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:38.889142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-65c4f4a1-0cc0-4011-b52b-75fc071575f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:38.916330 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3978/7989] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 10:19:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:19:38.942998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63648eee-afd2-4179-8819-a2790cbb20e5 service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:38.970495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63648eee-afd2-4179-8819-a2790cbb20e5 service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:38.981855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0e16f-a6f0-42d5-a34b-5f87f12ad142 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:38.982515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0e16f-a6f0-42d5-a34b-5f87f12ad142 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:38.982793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0e16f-a6f0-42d5-a34b-5f87f12ad142 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:38.983223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0e16f-a6f0-42d5-a34b-5f87f12ad142 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:39.002382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0e16f-a6f0-42d5-a34b-5f87f12ad142 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:39.003989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0e16f-a6f0-42d5-a34b-5f87f12ad142 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:39.028681 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4012/7990] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:19:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:19:39.168176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4f4a1-0cc0-4011-b52b-75fc071575f2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:39.357209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4f4a1-0cc0-4011-b52b-75fc071575f2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:39.380768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffabc82-75b4-4f57-8176-cd333138b1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:39.384241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffabc82-75b4-4f57-8176-cd333138b1b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:39.384501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffabc82-75b4-4f57-8176-cd333138b1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:39.385019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffabc82-75b4-4f57-8176-cd333138b1b5 admin admin] PATH_INFO: `/v3/users/1e68197f3e0e4d32b0ceb1d6b3462355` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:39.398073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffabc82-75b4-4f57-8176-cd333138b1b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e68197f3e0e4d32b0ceb1d6b3462355)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:39.401943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffabc82-75b4-4f57-8176-cd333138b1b5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:39.555433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3ffabc82-75b4-4f57-8176-cd333138b1b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e68197f3e0e4d32b0ceb1d6b3462355'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:39.563935 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:39.576159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3ffabc82-75b4-4f57-8176-cd333138b1b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e68197f3e0e4d32b0ceb1d6b3462355'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:39.578219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3ffabc82-75b4-4f57-8176-cd333138b1b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e68197f3e0e4d32b0ceb1d6b3462355'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:39.612096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3ffabc82-75b4-4f57-8176-cd333138b1b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e68197f3e0e4d32b0ceb1d6b3462355'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:39.622988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3ffabc82-75b4-4f57-8176-cd333138b1b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e68197f3e0e4d32b0ceb1d6b3462355'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:39.642730 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3979/7991] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:39 2022] DELETE /identity/v3/users/1e68197f3e0e4d32b0ceb1d6b3462355 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:39.647411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc2a69-14eb-4483-9a27-6e9ca68c05e1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:39.647871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc2a69-14eb-4483-9a27-6e9ca68c05e1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:39.647958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc2a69-14eb-4483-9a27-6e9ca68c05e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:39.703339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2ecc2a69-14eb-4483-9a27-6e9ca68c05e1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:39.705312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2ecc2a69-14eb-4483-9a27-6e9ca68c05e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:39.800935 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4013/7992] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:39.815211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffabc82-75b4-4f57-8176-cd333138b1b5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:39.818906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3ffabc82-75b4-4f57-8176-cd333138b1b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:39.915085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffabc82-75b4-4f57-8176-cd333138b1b5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:39.919678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb2acf-e886-47b2-a69e-0cf26ef3d02d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:39.920732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb2acf-e886-47b2-a69e-0cf26ef3d02d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:39.921147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb2acf-e886-47b2-a69e-0cf26ef3d02d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:39.921732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb2acf-e886-47b2-a69e-0cf26ef3d02d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:39.955193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb2acf-e886-47b2-a69e-0cf26ef3d02d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:39.957059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb2acf-e886-47b2-a69e-0cf26ef3d02d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:39.970998 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3980/7993] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:19:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:19:40.465710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc2a69-14eb-4483-9a27-6e9ca68c05e1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:40.467194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2ecc2a69-14eb-4483-9a27-6e9ca68c05e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:40.477868 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:40.486187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc2a69-14eb-4483-9a27-6e9ca68c05e1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:40.493288 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6288542-eb05-44db-9935-a95c6f85e131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:40.494334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6288542-eb05-44db-9935-a95c6f85e131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:40.494799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6288542-eb05-44db-9935-a95c6f85e131 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:40.495268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6288542-eb05-44db-9935-a95c6f85e131 admin admin] PATH_INFO: `/v3/projects/3a75a6c21d3d448bb38bbc81591431ed` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:40.508214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6288542-eb05-44db-9935-a95c6f85e131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a75a6c21d3d448bb38bbc81591431ed)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:40.510635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6288542-eb05-44db-9935-a95c6f85e131 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:40.590698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6288542-eb05-44db-9935-a95c6f85e131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a75a6c21d3d448bb38bbc81591431ed', 'request_id': 'req-f6288542-eb05-44db-9935-a95c6f85e131'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:40.606507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6288542-eb05-44db-9935-a95c6f85e131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a75a6c21d3d448bb38bbc81591431ed', 'request_id': 'req-f6288542-eb05-44db-9935-a95c6f85e131'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:40.617440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6288542-eb05-44db-9935-a95c6f85e131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a75a6c21d3d448bb38bbc81591431ed', 'request_id': 'req-f6288542-eb05-44db-9935-a95c6f85e131'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:40.635381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6288542-eb05-44db-9935-a95c6f85e131 admin admin] The token cache is being invalidate because project 3a75a6c21d3d448bb38bbc81591431ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:40.636033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6288542-eb05-44db-9935-a95c6f85e131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:40.637576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6288542-eb05-44db-9935-a95c6f85e131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:40.657248 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4014/7994] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:19:40 2022] DELETE /identity/v3/projects/3a75a6c21d3d448bb38bbc81591431ed => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:40.659326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb2acf-e886-47b2-a69e-0cf26ef3d02d service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:40.674727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb2acf-e886-47b2-a69e-0cf26ef3d02d service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:40.787225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018593f-4b82-4953-a0af-47035f6f55b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:40.788271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018593f-4b82-4953-a0af-47035f6f55b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:40.789152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018593f-4b82-4953-a0af-47035f6f55b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:40.790103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018593f-4b82-4953-a0af-47035f6f55b5 admin admin] PATH_INFO: `/v3/users/56db36b731b5489993acde1a2d68c5e3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:40.792013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018593f-4b82-4953-a0af-47035f6f55b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56db36b731b5489993acde1a2d68c5e3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:40.794841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018593f-4b82-4953-a0af-47035f6f55b5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:40.880661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9018593f-4b82-4953-a0af-47035f6f55b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56db36b731b5489993acde1a2d68c5e3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:40.893981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9018593f-4b82-4953-a0af-47035f6f55b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56db36b731b5489993acde1a2d68c5e3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:40.895313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9018593f-4b82-4953-a0af-47035f6f55b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56db36b731b5489993acde1a2d68c5e3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:40.935853 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:40.939671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9018593f-4b82-4953-a0af-47035f6f55b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56db36b731b5489993acde1a2d68c5e3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:40.959425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9018593f-4b82-4953-a0af-47035f6f55b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56db36b731b5489993acde1a2d68c5e3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:40.982727 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3981/7995] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:40 2022] DELETE /identity/v3/users/56db36b731b5489993acde1a2d68c5e3 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:41.087819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6288542-eb05-44db-9935-a95c6f85e131 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:41.089322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f6288542-eb05-44db-9935-a95c6f85e131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:41.223310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6288542-eb05-44db-9935-a95c6f85e131 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:41.318890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d2a0c-1a49-436b-aec1-b1d18219bfca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:41.319598 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d2a0c-1a49-436b-aec1-b1d18219bfca service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:41.320059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d2a0c-1a49-436b-aec1-b1d18219bfca service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:41.320332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d2a0c-1a49-436b-aec1-b1d18219bfca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:41.322456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5f2d2a0c-1a49-436b-aec1-b1d18219bfca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:41.340413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d2a0c-1a49-436b-aec1-b1d18219bfca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:41.342100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d2a0c-1a49-436b-aec1-b1d18219bfca service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:41.411886 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4015/7996] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:19:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:19:41.523985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018593f-4b82-4953-a0af-47035f6f55b5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:41.525609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9018593f-4b82-4953-a0af-47035f6f55b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:41.679529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018593f-4b82-4953-a0af-47035f6f55b5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:41.685396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584f971-6c8f-4aa8-98e0-bdeb0cc76860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:41.687672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584f971-6c8f-4aa8-98e0-bdeb0cc76860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:41.688854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584f971-6c8f-4aa8-98e0-bdeb0cc76860 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:41.690038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584f971-6c8f-4aa8-98e0-bdeb0cc76860 admin admin] PATH_INFO: `/v3/projects/3df1cc1933ab46888987e125093b38a0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:41.691841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584f971-6c8f-4aa8-98e0-bdeb0cc76860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3df1cc1933ab46888987e125093b38a0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:41.695156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584f971-6c8f-4aa8-98e0-bdeb0cc76860 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:41.793972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3584f971-6c8f-4aa8-98e0-bdeb0cc76860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3df1cc1933ab46888987e125093b38a0', 'request_id': 'req-3584f971-6c8f-4aa8-98e0-bdeb0cc76860'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:41.811593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3584f971-6c8f-4aa8-98e0-bdeb0cc76860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3df1cc1933ab46888987e125093b38a0', 'request_id': 'req-3584f971-6c8f-4aa8-98e0-bdeb0cc76860'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:41.826799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3584f971-6c8f-4aa8-98e0-bdeb0cc76860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3df1cc1933ab46888987e125093b38a0', 'request_id': 'req-3584f971-6c8f-4aa8-98e0-bdeb0cc76860'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:41.854838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3584f971-6c8f-4aa8-98e0-bdeb0cc76860 admin admin] The token cache is being invalidate because project 3df1cc1933ab46888987e125093b38a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:41.855133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3584f971-6c8f-4aa8-98e0-bdeb0cc76860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:41.855983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3584f971-6c8f-4aa8-98e0-bdeb0cc76860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:41.860766 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3982/7997] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:19:41 2022] DELETE /identity/v3/projects/3df1cc1933ab46888987e125093b38a0 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:41.869137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d52401-f6ec-4d46-8097-fc2fb0ce0214 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:41.871180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d52401-f6ec-4d46-8097-fc2fb0ce0214 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:41.871465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d52401-f6ec-4d46-8097-fc2fb0ce0214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:41.946095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-85d52401-f6ec-4d46-8097-fc2fb0ce0214 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:41.948939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-85d52401-f6ec-4d46-8097-fc2fb0ce0214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:42.087950 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:42.131968 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4016/7998] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:42.141807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e1676-fee2-45ba-83c2-046980c2892d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:42.142089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e1676-fee2-45ba-83c2-046980c2892d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:42.142362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e1676-fee2-45ba-83c2-046980c2892d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:42.180488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-283e1676-fee2-45ba-83c2-046980c2892d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:42.181934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-283e1676-fee2-45ba-83c2-046980c2892d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:42.195394 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3983/7999] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:19:42.199844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d52401-f6ec-4d46-8097-fc2fb0ce0214 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:42.211781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d52401-f6ec-4d46-8097-fc2fb0ce0214 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:42.217398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5cdf4-a1ec-43d8-8478-36fa9fc7040f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:42.218189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5cdf4-a1ec-43d8-8478-36fa9fc7040f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:42.218542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5cdf4-a1ec-43d8-8478-36fa9fc7040f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:42.218883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5cdf4-a1ec-43d8-8478-36fa9fc7040f admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:42.220580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5cdf4-a1ec-43d8-8478-36fa9fc7040f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:19:42.220580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5cdf4-a1ec-43d8-8478-36fa9fc7040f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:42.223148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5cdf4-a1ec-43d8-8478-36fa9fc7040f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:42.243033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e1676-fee2-45ba-83c2-046980c2892d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:42.249596 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4017/8000] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:42.254616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e1676-fee2-45ba-83c2-046980c2892d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:42.259701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46c34d-92a6-452c-9549-4c4188ae83b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:42.261249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46c34d-92a6-452c-9549-4c4188ae83b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:42.261924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46c34d-92a6-452c-9549-4c4188ae83b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:42.262627 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46c34d-92a6-452c-9549-4c4188ae83b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:42.264531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46c34d-92a6-452c-9549-4c4188ae83b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:42.267457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46c34d-92a6-452c-9549-4c4188ae83b2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:42.322826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5cdf4-a1ec-43d8-8478-36fa9fc7040f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:42.341579 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3984/8001] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:19:42 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:42.341897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5cdf4-a1ec-43d8-8478-36fa9fc7040f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:42.430204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409112a7-ba70-4903-bdb5-e135cd2a1550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:42.430892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409112a7-ba70-4903-bdb5-e135cd2a1550 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:42.431109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409112a7-ba70-4903-bdb5-e135cd2a1550 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:42.431553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409112a7-ba70-4903-bdb5-e135cd2a1550 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:42.432547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409112a7-ba70-4903-bdb5-e135cd2a1550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:42.435868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409112a7-ba70-4903-bdb5-e135cd2a1550 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:42.481339 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4018/8002] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:19:42 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:19:42.482473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46c34d-92a6-452c-9549-4c4188ae83b2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:42.498730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46c34d-92a6-452c-9549-4c4188ae83b2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:42.513480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637480c2-67f7-4811-9c04-83c7b5cc3ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:42.515132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637480c2-67f7-4811-9c04-83c7b5cc3ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:42.515609 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637480c2-67f7-4811-9c04-83c7b5cc3ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:42.516916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637480c2-67f7-4811-9c04-83c7b5cc3ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:42.517694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637480c2-67f7-4811-9c04-83c7b5cc3ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:42.519514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637480c2-67f7-4811-9c04-83c7b5cc3ac6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:42.535236 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3985/8003] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:19:42.536534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409112a7-ba70-4903-bdb5-e135cd2a1550 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:42.554777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409112a7-ba70-4903-bdb5-e135cd2a1550 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:42.560725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc172c18-45b9-4d10-b695-22b2f0d47fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:42.562079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc172c18-45b9-4d10-b695-22b2f0d47fff admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:42.562599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc172c18-45b9-4d10-b695-22b2f0d47fff admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:42.563251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc172c18-45b9-4d10-b695-22b2f0d47fff admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:42.564716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc172c18-45b9-4d10-b695-22b2f0d47fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:42.566870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc172c18-45b9-4d10-b695-22b2f0d47fff admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:42.582584 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4019/8004] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:19:42.586547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637480c2-67f7-4811-9c04-83c7b5cc3ac6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:42.601036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637480c2-67f7-4811-9c04-83c7b5cc3ac6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:42.611006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f063ba1-af00-4c1f-8ea7-7647aaf0eaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:42.612009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f063ba1-af00-4c1f-8ea7-7647aaf0eaec admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:42.612437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f063ba1-af00-4c1f-8ea7-7647aaf0eaec admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:42.613010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f063ba1-af00-4c1f-8ea7-7647aaf0eaec admin admin] PATH_INFO: `/v3/projects/92b550de550242f1862da8eabf13082f/users/9ccbc1e22aec43cdbd2fe864fc3b4111/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:42.636176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f063ba1-af00-4c1f-8ea7-7647aaf0eaec admin admin] RBAC: Authorizing `identity:create_grant(project_id=92b550de550242f1862da8eabf13082f, user_id=9ccbc1e22aec43cdbd2fe864fc3b4111, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:42.638867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f063ba1-af00-4c1f-8ea7-7647aaf0eaec admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:42.658948 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3986/8005] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:19:42 2022] PUT /identity/v3/projects/92b550de550242f1862da8eabf13082f/users/9ccbc1e22aec43cdbd2fe864fc3b4111/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:19:42.670841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dc8e0-439c-4bd2-bc7e-77fe979bea15 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:42.671341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dc8e0-439c-4bd2-bc7e-77fe979bea15 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:42.671809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dc8e0-439c-4bd2-bc7e-77fe979bea15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:42.744000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9a5dc8e0-439c-4bd2-bc7e-77fe979bea15 None None] MFA Rules not processed for user `9ccbc1e22aec43cdbd2fe864fc3b4111`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:42.745776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9a5dc8e0-439c-4bd2-bc7e-77fe979bea15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:42.866800 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4020/8006] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:19:42.880374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f063ba1-af00-4c1f-8ea7-7647aaf0eaec admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:42.884518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8f063ba1-af00-4c1f-8ea7-7647aaf0eaec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:42.932938 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:43.013697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f063ba1-af00-4c1f-8ea7-7647aaf0eaec admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:43.018895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb94eb-e860-4a29-b585-f097f970f7cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:43.019727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb94eb-e860-4a29-b585-f097f970f7cb service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:43.021629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb94eb-e860-4a29-b585-f097f970f7cb service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:43.022202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb94eb-e860-4a29-b585-f097f970f7cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:43.035263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb94eb-e860-4a29-b585-f097f970f7cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:43.037173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb94eb-e860-4a29-b585-f097f970f7cb service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:43.069986 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3987/8007] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:19:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:19:43.202632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dc8e0-439c-4bd2-bc7e-77fe979bea15 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:43.301878 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:43.325157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dc8e0-439c-4bd2-bc7e-77fe979bea15 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:43.335548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542cd47-62bc-44d1-b49b-0fc0fee0dbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:43.336294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542cd47-62bc-44d1-b49b-0fc0fee0dbe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:43.336670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542cd47-62bc-44d1-b49b-0fc0fee0dbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:43.337563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542cd47-62bc-44d1-b49b-0fc0fee0dbe2 admin admin] PATH_INFO: `/v3/users/9ccbc1e22aec43cdbd2fe864fc3b4111` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:43.339153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542cd47-62bc-44d1-b49b-0fc0fee0dbe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ccbc1e22aec43cdbd2fe864fc3b4111)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:43.341982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542cd47-62bc-44d1-b49b-0fc0fee0dbe2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:43.457715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3542cd47-62bc-44d1-b49b-0fc0fee0dbe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ccbc1e22aec43cdbd2fe864fc3b4111'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:43.458408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3542cd47-62bc-44d1-b49b-0fc0fee0dbe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ccbc1e22aec43cdbd2fe864fc3b4111'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:43.473062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3542cd47-62bc-44d1-b49b-0fc0fee0dbe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ccbc1e22aec43cdbd2fe864fc3b4111'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:43.498246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3542cd47-62bc-44d1-b49b-0fc0fee0dbe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ccbc1e22aec43cdbd2fe864fc3b4111'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:43.508999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3542cd47-62bc-44d1-b49b-0fc0fee0dbe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ccbc1e22aec43cdbd2fe864fc3b4111'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:43.515671 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4021/8008] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:43 2022] DELETE /identity/v3/users/9ccbc1e22aec43cdbd2fe864fc3b4111 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:43.520426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a515e-8838-4666-935c-3ae272edec90 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:43.520817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a515e-8838-4666-935c-3ae272edec90 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:43.521183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a515e-8838-4666-935c-3ae272edec90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:43.544845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-031a515e-8838-4666-935c-3ae272edec90 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:43.546408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-031a515e-8838-4666-935c-3ae272edec90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:43.648062 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3988/8009] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:43.661977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542cd47-62bc-44d1-b49b-0fc0fee0dbe2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:43.663471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3542cd47-62bc-44d1-b49b-0fc0fee0dbe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:43.840803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542cd47-62bc-44d1-b49b-0fc0fee0dbe2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:43.854209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc91bb-69e2-4206-af4c-b390b7b5dfe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:43.857415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc91bb-69e2-4206-af4c-b390b7b5dfe2 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:43.857759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc91bb-69e2-4206-af4c-b390b7b5dfe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:43.858042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc91bb-69e2-4206-af4c-b390b7b5dfe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:43.884944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc91bb-69e2-4206-af4c-b390b7b5dfe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:43.886721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc91bb-69e2-4206-af4c-b390b7b5dfe2 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:43.901945 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4022/8010] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:19:44.557768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a515e-8838-4666-935c-3ae272edec90 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:44.560229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-031a515e-8838-4666-935c-3ae272edec90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:44.592546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a515e-8838-4666-935c-3ae272edec90 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:44.606901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d64f1-0a35-455f-a8b5-9b0c52eb120c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:44.609024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d64f1-0a35-455f-a8b5-9b0c52eb120c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:44.612487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d64f1-0a35-455f-a8b5-9b0c52eb120c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:44.613086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d64f1-0a35-455f-a8b5-9b0c52eb120c admin admin] PATH_INFO: `/v3/projects/92b550de550242f1862da8eabf13082f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:44.614839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d64f1-0a35-455f-a8b5-9b0c52eb120c admin admin] RBAC: Authorizing `identity:delete_project(project_id=92b550de550242f1862da8eabf13082f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:44.619705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d64f1-0a35-455f-a8b5-9b0c52eb120c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:44.813002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ad7d64f1-0a35-455f-a8b5-9b0c52eb120c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92b550de550242f1862da8eabf13082f', 'request_id': 'req-ad7d64f1-0a35-455f-a8b5-9b0c52eb120c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:44.843123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ad7d64f1-0a35-455f-a8b5-9b0c52eb120c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92b550de550242f1862da8eabf13082f', 'request_id': 'req-ad7d64f1-0a35-455f-a8b5-9b0c52eb120c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:44.877081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ad7d64f1-0a35-455f-a8b5-9b0c52eb120c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92b550de550242f1862da8eabf13082f', 'request_id': 'req-ad7d64f1-0a35-455f-a8b5-9b0c52eb120c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:44.927738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ad7d64f1-0a35-455f-a8b5-9b0c52eb120c admin admin] The token cache is being invalidate because project 92b550de550242f1862da8eabf13082f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:44.927738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ad7d64f1-0a35-455f-a8b5-9b0c52eb120c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:44.931985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ad7d64f1-0a35-455f-a8b5-9b0c52eb120c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:44.933673 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3989/8011] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:19:44 2022] DELETE /identity/v3/projects/92b550de550242f1862da8eabf13082f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:44.940926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b8052-1c72-4fdc-8cb2-4b3b0c4ca0af None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:44.941404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b8052-1c72-4fdc-8cb2-4b3b0c4ca0af None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:44.941481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b8052-1c72-4fdc-8cb2-4b3b0c4ca0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:44.991793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-756b8052-1c72-4fdc-8cb2-4b3b0c4ca0af None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:44.993513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-756b8052-1c72-4fdc-8cb2-4b3b0c4ca0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:45.108816 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4023/8012] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:45.111971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fdf2d-9000-4dd3-acea-20b1e8983a85 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:45.113569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fdf2d-9000-4dd3-acea-20b1e8983a85 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:45.114039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fdf2d-9000-4dd3-acea-20b1e8983a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:45.143320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b46fdf2d-9000-4dd3-acea-20b1e8983a85 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:45.144559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b46fdf2d-9000-4dd3-acea-20b1e8983a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:45.155467 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3990/8013] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:45.160542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b8052-1c72-4fdc-8cb2-4b3b0c4ca0af None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:45.166151 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:45.184245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b8052-1c72-4fdc-8cb2-4b3b0c4ca0af None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:45.196166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6b13b-da79-4e1c-be93-739a377e7f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:45.196846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6b13b-da79-4e1c-be93-739a377e7f42 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:45.197131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6b13b-da79-4e1c-be93-739a377e7f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:45.197402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6b13b-da79-4e1c-be93-739a377e7f42 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:45.198089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6b13b-da79-4e1c-be93-739a377e7f42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:19:45.198391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6b13b-da79-4e1c-be93-739a377e7f42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:45.202005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6b13b-da79-4e1c-be93-739a377e7f42 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:45.233642 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4024/8014] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:45.238419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fdf2d-9000-4dd3-acea-20b1e8983a85 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:45.270602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fdf2d-9000-4dd3-acea-20b1e8983a85 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:45.286438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafb35b-0fd5-4123-897e-bfd78edb7a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:45.287071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafb35b-0fd5-4123-897e-bfd78edb7a57 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:45.287702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafb35b-0fd5-4123-897e-bfd78edb7a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:45.287702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafb35b-0fd5-4123-897e-bfd78edb7a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:45.288249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafb35b-0fd5-4123-897e-bfd78edb7a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:45.292166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafb35b-0fd5-4123-897e-bfd78edb7a57 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:45.354180 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3991/8015] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:19:45 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:45.354368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6b13b-da79-4e1c-be93-739a377e7f42 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:45.374852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6b13b-da79-4e1c-be93-739a377e7f42 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:45.479221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1e19b-912c-4f13-9bc6-d6d2836a94e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:45.479835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1e19b-912c-4f13-9bc6-d6d2836a94e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:45.480111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1e19b-912c-4f13-9bc6-d6d2836a94e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:45.481226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1e19b-912c-4f13-9bc6-d6d2836a94e9 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:45.481876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1e19b-912c-4f13-9bc6-d6d2836a94e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:45.484087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1e19b-912c-4f13-9bc6-d6d2836a94e9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:45.516281 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4025/8016] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:19:45 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:19:45.520919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafb35b-0fd5-4123-897e-bfd78edb7a57 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:45.534147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafb35b-0fd5-4123-897e-bfd78edb7a57 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:45.551238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43609ae7-da6c-4a91-ba90-8bbec59253d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:45.552097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43609ae7-da6c-4a91-ba90-8bbec59253d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:45.552380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43609ae7-da6c-4a91-ba90-8bbec59253d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:45.552738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43609ae7-da6c-4a91-ba90-8bbec59253d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:45.553400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43609ae7-da6c-4a91-ba90-8bbec59253d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:45.555036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43609ae7-da6c-4a91-ba90-8bbec59253d7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:45.565772 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:45.577727 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3992/8017] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:19:45.579631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1e19b-912c-4f13-9bc6-d6d2836a94e9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:45.597115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1e19b-912c-4f13-9bc6-d6d2836a94e9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:45.609337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f0996-2abb-4bd6-9e81-adb468b05f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:45.610636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f0996-2abb-4bd6-9e81-adb468b05f33 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:45.610849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f0996-2abb-4bd6-9e81-adb468b05f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:45.611113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f0996-2abb-4bd6-9e81-adb468b05f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:45.611830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f0996-2abb-4bd6-9e81-adb468b05f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:45.627442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f0996-2abb-4bd6-9e81-adb468b05f33 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:45.671247 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4026/8018] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:19:45.675441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43609ae7-da6c-4a91-ba90-8bbec59253d7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:45.698840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43609ae7-da6c-4a91-ba90-8bbec59253d7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:45.728587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdbb6d-10c9-49f2-bfbd-ed18ef8e168d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:45.729313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdbb6d-10c9-49f2-bfbd-ed18ef8e168d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:45.729623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdbb6d-10c9-49f2-bfbd-ed18ef8e168d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:45.729876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdbb6d-10c9-49f2-bfbd-ed18ef8e168d admin admin] PATH_INFO: `/v3/projects/513d29a272784869be857d104d9f9d95/users/773ad588334d44699140bcabfecd9db0/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:45.777456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdbb6d-10c9-49f2-bfbd-ed18ef8e168d admin admin] RBAC: Authorizing `identity:create_grant(project_id=513d29a272784869be857d104d9f9d95, user_id=773ad588334d44699140bcabfecd9db0, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:45.784446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdbb6d-10c9-49f2-bfbd-ed18ef8e168d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:45.882994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd536909-654f-409b-9e88-e77816e0ce09 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:45.883191 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3993/8019] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:19:45 2022] PUT /identity/v3/projects/513d29a272784869be857d104d9f9d95/users/773ad588334d44699140bcabfecd9db0/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:45.883279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd536909-654f-409b-9e88-e77816e0ce09 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:45.883453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd536909-654f-409b-9e88-e77816e0ce09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:45.970652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-dd536909-654f-409b-9e88-e77816e0ce09 None None] MFA Rules not processed for user `773ad588334d44699140bcabfecd9db0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:45.971897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dd536909-654f-409b-9e88-e77816e0ce09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:46.173253 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4027/8020] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:46.184244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdbb6d-10c9-49f2-bfbd-ed18ef8e168d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:46.189980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d2bdbb6d-10c9-49f2-bfbd-ed18ef8e168d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:46.303520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdbb6d-10c9-49f2-bfbd-ed18ef8e168d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:46.308493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3721d86-23ed-40ba-9379-f814a2fa4faa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:46.309473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3721d86-23ed-40ba-9379-f814a2fa4faa service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:46.310561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3721d86-23ed-40ba-9379-f814a2fa4faa service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:46.311064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3721d86-23ed-40ba-9379-f814a2fa4faa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:46.322756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3721d86-23ed-40ba-9379-f814a2fa4faa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:46.324693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3721d86-23ed-40ba-9379-f814a2fa4faa service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:46.350826 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3994/8021] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:19:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:19:47.116811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994aed3-fbb1-412e-a62a-96aa2a0cbd2f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:47.117406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994aed3-fbb1-412e-a62a-96aa2a0cbd2f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:47.117406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994aed3-fbb1-412e-a62a-96aa2a0cbd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:47.165007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d994aed3-fbb1-412e-a62a-96aa2a0cbd2f None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:47.166217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d994aed3-fbb1-412e-a62a-96aa2a0cbd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:47.286637 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4028/8022] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:19:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:47.304239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3721d86-23ed-40ba-9379-f814a2fa4faa service glance] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:47.305112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b3721d86-23ed-40ba-9379-f814a2fa4faa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:47.440187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3721d86-23ed-40ba-9379-f814a2fa4faa service glance] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:47.455823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0cd32-0ebd-48ff-b2c9-58fa5f0025ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:47.457021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0cd32-0ebd-48ff-b2c9-58fa5f0025ef service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:47.457451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0cd32-0ebd-48ff-b2c9-58fa5f0025ef service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:47.457886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0cd32-0ebd-48ff-b2c9-58fa5f0025ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:47.470215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0cd32-0ebd-48ff-b2c9-58fa5f0025ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:47.471952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0cd32-0ebd-48ff-b2c9-58fa5f0025ef service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:47.493615 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3995/8023] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:19:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:19:47.868501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994aed3-fbb1-412e-a62a-96aa2a0cbd2f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:47.873229 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:48.038587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994aed3-fbb1-412e-a62a-96aa2a0cbd2f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:48.050423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f1b28-9320-4bd1-bc55-2a3625ac3bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:48.051076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f1b28-9320-4bd1-bc55-2a3625ac3bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:48.051356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f1b28-9320-4bd1-bc55-2a3625ac3bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:48.051635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f1b28-9320-4bd1-bc55-2a3625ac3bdb admin admin] PATH_INFO: `/v3/users/773ad588334d44699140bcabfecd9db0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:48.053301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f1b28-9320-4bd1-bc55-2a3625ac3bdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=773ad588334d44699140bcabfecd9db0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:48.055378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f1b28-9320-4bd1-bc55-2a3625ac3bdb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:48.149879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-466f1b28-9320-4bd1-bc55-2a3625ac3bdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '773ad588334d44699140bcabfecd9db0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:48.150958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-466f1b28-9320-4bd1-bc55-2a3625ac3bdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '773ad588334d44699140bcabfecd9db0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:48.171662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-466f1b28-9320-4bd1-bc55-2a3625ac3bdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '773ad588334d44699140bcabfecd9db0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:48.192232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-466f1b28-9320-4bd1-bc55-2a3625ac3bdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '773ad588334d44699140bcabfecd9db0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:48.209719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-466f1b28-9320-4bd1-bc55-2a3625ac3bdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '773ad588334d44699140bcabfecd9db0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:48.222713 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4029/8024] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:47 2022] DELETE /identity/v3/users/773ad588334d44699140bcabfecd9db0 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:48.229005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad9a7d-b4d9-4c2e-8aae-dcb8cdb2a131 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:48.229313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad9a7d-b4d9-4c2e-8aae-dcb8cdb2a131 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:48.229597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad9a7d-b4d9-4c2e-8aae-dcb8cdb2a131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:48.253297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-86ad9a7d-b4d9-4c2e-8aae-dcb8cdb2a131 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:48.255159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-86ad9a7d-b4d9-4c2e-8aae-dcb8cdb2a131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:48.406185 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3996/8025] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:48.418995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f1b28-9320-4bd1-bc55-2a3625ac3bdb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:48.420878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-466f1b28-9320-4bd1-bc55-2a3625ac3bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:48.539944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f1b28-9320-4bd1-bc55-2a3625ac3bdb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:48.544366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f0b84-9101-4056-9dfa-0027a844d0f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:48.545349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f0b84-9101-4056-9dfa-0027a844d0f3 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:48.545840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f0b84-9101-4056-9dfa-0027a844d0f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:48.546449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f0b84-9101-4056-9dfa-0027a844d0f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:48.559965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f0b84-9101-4056-9dfa-0027a844d0f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:48.561690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f0b84-9101-4056-9dfa-0027a844d0f3 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:48.596172 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4030/8026] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:19:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:19:49.379074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad9a7d-b4d9-4c2e-8aae-dcb8cdb2a131 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:49.381069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-86ad9a7d-b4d9-4c2e-8aae-dcb8cdb2a131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:49.398249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad9a7d-b4d9-4c2e-8aae-dcb8cdb2a131 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:49.421271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae4fa9-c78e-4a85-bf0c-e85b88ea2492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:49.435287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae4fa9-c78e-4a85-bf0c-e85b88ea2492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:49.435811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae4fa9-c78e-4a85-bf0c-e85b88ea2492 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:49.436163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae4fa9-c78e-4a85-bf0c-e85b88ea2492 admin admin] PATH_INFO: `/v3/projects/513d29a272784869be857d104d9f9d95` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:49.439651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae4fa9-c78e-4a85-bf0c-e85b88ea2492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=513d29a272784869be857d104d9f9d95)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:49.441561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae4fa9-c78e-4a85-bf0c-e85b88ea2492 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:49.446051 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:49.512740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1cae4fa9-c78e-4a85-bf0c-e85b88ea2492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '513d29a272784869be857d104d9f9d95', 'request_id': 'req-1cae4fa9-c78e-4a85-bf0c-e85b88ea2492'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:49.526661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1cae4fa9-c78e-4a85-bf0c-e85b88ea2492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '513d29a272784869be857d104d9f9d95', 'request_id': 'req-1cae4fa9-c78e-4a85-bf0c-e85b88ea2492'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:49.546615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1cae4fa9-c78e-4a85-bf0c-e85b88ea2492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '513d29a272784869be857d104d9f9d95', 'request_id': 'req-1cae4fa9-c78e-4a85-bf0c-e85b88ea2492'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:49.571544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1cae4fa9-c78e-4a85-bf0c-e85b88ea2492 admin admin] The token cache is being invalidate because project 513d29a272784869be857d104d9f9d95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:19:49.572275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1cae4fa9-c78e-4a85-bf0c-e85b88ea2492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:49.573344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1cae4fa9-c78e-4a85-bf0c-e85b88ea2492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:49.577189 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3997/8027] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:19:49 2022] DELETE /identity/v3/projects/513d29a272784869be857d104d9f9d95 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:49.582233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c20e3-7ffe-4c07-9da0-f91cce80766a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:49.583225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c20e3-7ffe-4c07-9da0-f91cce80766a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:49.583819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c20e3-7ffe-4c07-9da0-f91cce80766a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:49.611357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-141c20e3-7ffe-4c07-9da0-f91cce80766a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:49.612771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-141c20e3-7ffe-4c07-9da0-f91cce80766a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:49.639426 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:49.720755 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4031/8028] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:19:49.730976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97044b4-ffba-4154-8d73-bace80322b97 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:49.731622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97044b4-ffba-4154-8d73-bace80322b97 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:49.732103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97044b4-ffba-4154-8d73-bace80322b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:49.762536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a97044b4-ffba-4154-8d73-bace80322b97 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:49.764110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a97044b4-ffba-4154-8d73-bace80322b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:49.776939 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3998/8029] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:49.780887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c20e3-7ffe-4c07-9da0-f91cce80766a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:49.806337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c20e3-7ffe-4c07-9da0-f91cce80766a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:49.817201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e5e7a-6172-4b1d-a5e1-1eabe2101088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:49.817930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e5e7a-6172-4b1d-a5e1-1eabe2101088 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:49.818208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e5e7a-6172-4b1d-a5e1-1eabe2101088 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:49.818475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e5e7a-6172-4b1d-a5e1-1eabe2101088 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:49.819129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e5e7a-6172-4b1d-a5e1-1eabe2101088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:19:49.819420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e5e7a-6172-4b1d-a5e1-1eabe2101088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:49.824776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e5e7a-6172-4b1d-a5e1-1eabe2101088 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:49.848869 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4032/8030] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:19:49.853373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97044b4-ffba-4154-8d73-bace80322b97 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:49.867006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97044b4-ffba-4154-8d73-bace80322b97 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:49.872162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b92e9d-6c8f-480e-86ec-beb5b6df82df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:49.873646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b92e9d-6c8f-480e-86ec-beb5b6df82df admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:49.873646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b92e9d-6c8f-480e-86ec-beb5b6df82df admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:49.873646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b92e9d-6c8f-480e-86ec-beb5b6df82df admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:49.874600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b92e9d-6c8f-480e-86ec-beb5b6df82df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:49.877101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b92e9d-6c8f-480e-86ec-beb5b6df82df admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:49.916449 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3999/8031] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:19:49 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:49.917827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e5e7a-6172-4b1d-a5e1-1eabe2101088 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:49.932329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e5e7a-6172-4b1d-a5e1-1eabe2101088 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:50.005998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d29e0-359e-43a2-8bbb-fd9da4a6f0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:50.007327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d29e0-359e-43a2-8bbb-fd9da4a6f0f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:50.007619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d29e0-359e-43a2-8bbb-fd9da4a6f0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:50.007894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d29e0-359e-43a2-8bbb-fd9da4a6f0f4 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:50.008535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d29e0-359e-43a2-8bbb-fd9da4a6f0f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:50.010549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d29e0-359e-43a2-8bbb-fd9da4a6f0f4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:50.044260 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4033/8032] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:19:49 2022] POST /identity/v3/users => generated 283 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:50.049900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b92e9d-6c8f-480e-86ec-beb5b6df82df admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:50.064383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b92e9d-6c8f-480e-86ec-beb5b6df82df admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:50.070497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba2294-34b1-4f92-8a52-a838ad7bcdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:50.072438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba2294-34b1-4f92-8a52-a838ad7bcdae admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:50.072807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba2294-34b1-4f92-8a52-a838ad7bcdae admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:50.073270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba2294-34b1-4f92-8a52-a838ad7bcdae admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:50.074611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba2294-34b1-4f92-8a52-a838ad7bcdae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:50.077635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba2294-34b1-4f92-8a52-a838ad7bcdae admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:50.116123 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4000/8033] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:19:50.119781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d29e0-359e-43a2-8bbb-fd9da4a6f0f4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:50.134410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d29e0-359e-43a2-8bbb-fd9da4a6f0f4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:50.143517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949a97c-fdc1-4e6c-ac24-194e97b731ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:50.144764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949a97c-fdc1-4e6c-ac24-194e97b731ca admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:50.145121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949a97c-fdc1-4e6c-ac24-194e97b731ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:50.145465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949a97c-fdc1-4e6c-ac24-194e97b731ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:50.147436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949a97c-fdc1-4e6c-ac24-194e97b731ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:50.149155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949a97c-fdc1-4e6c-ac24-194e97b731ca admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:50.165180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250ee59-9bef-4de4-8830-74568fa4ea2e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:50.165446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250ee59-9bef-4de4-8830-74568fa4ea2e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:50.166070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250ee59-9bef-4de4-8830-74568fa4ea2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:50.188860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7250ee59-9bef-4de4-8830-74568fa4ea2e None None] MFA Rules not processed for user `45a25acf184b4bfc9f1b06dcf0e6d81b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:50.190210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7250ee59-9bef-4de4-8830-74568fa4ea2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:50.196267 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4034/8034] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:19:50.201814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949a97c-fdc1-4e6c-ac24-194e97b731ca admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:50.223215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949a97c-fdc1-4e6c-ac24-194e97b731ca admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:50.242888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1321a2-6b63-42a6-9c7d-800cc82427fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:50.243598 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1321a2-6b63-42a6-9c7d-800cc82427fa admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:50.243872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1321a2-6b63-42a6-9c7d-800cc82427fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:50.244143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1321a2-6b63-42a6-9c7d-800cc82427fa admin admin] PATH_INFO: `/v3/projects/619835ee2c714ce8843e22a8b6e17a8b/users/6dbcb019f2534a97bbfd1cf22fc62f4c/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:50.278257 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4001/8035] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:50.284180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1321a2-6b63-42a6-9c7d-800cc82427fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=619835ee2c714ce8843e22a8b6e17a8b, user_id=6dbcb019f2534a97bbfd1cf22fc62f4c, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:50.287088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1321a2-6b63-42a6-9c7d-800cc82427fa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:50.333124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d81249-7fd9-4988-a4ff-4704acae5363 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:50.333734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d81249-7fd9-4988-a4ff-4704acae5363 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:50.333973 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4035/8036] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:19:50 2022] PUT /identity/v3/projects/619835ee2c714ce8843e22a8b6e17a8b/users/6dbcb019f2534a97bbfd1cf22fc62f4c/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:50.334199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d81249-7fd9-4988-a4ff-4704acae5363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:50.382911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a1d81249-7fd9-4988-a4ff-4704acae5363 None None] MFA Rules not processed for user `6dbcb019f2534a97bbfd1cf22fc62f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:50.384355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a1d81249-7fd9-4988-a4ff-4704acae5363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:50.473500 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:50.547824 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4002/8037] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:19:50.549345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1321a2-6b63-42a6-9c7d-800cc82427fa admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:50.667638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1321a2-6b63-42a6-9c7d-800cc82427fa admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:50.684327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355025a-cd35-4258-b376-2d12fde3998c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:50.685075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355025a-cd35-4258-b376-2d12fde3998c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:50.685592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355025a-cd35-4258-b376-2d12fde3998c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:50.685877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355025a-cd35-4258-b376-2d12fde3998c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:50.686513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355025a-cd35-4258-b376-2d12fde3998c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:50.689105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355025a-cd35-4258-b376-2d12fde3998c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:50.707852 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:50.732960 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4036/8038] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:19:50 2022] POST /identity/v3/projects => generated 365 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:50.738177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d81249-7fd9-4988-a4ff-4704acae5363 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:50.769518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d81249-7fd9-4988-a4ff-4704acae5363 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:50.875341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa17c1-3756-49d3-be19-d1bf844e90fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:50.876136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa17c1-3756-49d3-be19-d1bf844e90fb admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:50.876416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa17c1-3756-49d3-be19-d1bf844e90fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:50.876709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa17c1-3756-49d3-be19-d1bf844e90fb admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:50.879955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa17c1-3756-49d3-be19-d1bf844e90fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:50.881936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa17c1-3756-49d3-be19-d1bf844e90fb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:50.934431 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4003/8039] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:19:50 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:19:50.936177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355025a-cd35-4258-b376-2d12fde3998c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:50.948398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355025a-cd35-4258-b376-2d12fde3998c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:50.955506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556755f7-2d41-41e3-b9b8-017de61f4c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:50.956499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556755f7-2d41-41e3-b9b8-017de61f4c9d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:50.956974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556755f7-2d41-41e3-b9b8-017de61f4c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:50.957392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556755f7-2d41-41e3-b9b8-017de61f4c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:50.958298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556755f7-2d41-41e3-b9b8-017de61f4c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:50.960182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556755f7-2d41-41e3-b9b8-017de61f4c9d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:50.979425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa17c1-3756-49d3-be19-d1bf844e90fb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:50.987417 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4037/8040] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:19:50.993511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa17c1-3756-49d3-be19-d1bf844e90fb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:51.001811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c33708-873c-4b0a-a75f-eedc4bd22b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:51.002768 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c33708-873c-4b0a-a75f-eedc4bd22b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:51.003259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c33708-873c-4b0a-a75f-eedc4bd22b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:51.003606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c33708-873c-4b0a-a75f-eedc4bd22b66 admin admin] PATH_INFO: `/v3/projects/a4655bf0f79241f995ea3b58d0a68379/users/d8f8ec19181a4b47bcb10867c29cac3a/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:51.035710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c33708-873c-4b0a-a75f-eedc4bd22b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4655bf0f79241f995ea3b58d0a68379, user_id=d8f8ec19181a4b47bcb10867c29cac3a, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:51.040122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c33708-873c-4b0a-a75f-eedc4bd22b66 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:51.065372 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4004/8041] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:19:50 2022] PUT /identity/v3/projects/a4655bf0f79241f995ea3b58d0a68379/users/d8f8ec19181a4b47bcb10867c29cac3a/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:51.066781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556755f7-2d41-41e3-b9b8-017de61f4c9d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:51.083869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556755f7-2d41-41e3-b9b8-017de61f4c9d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:51.154941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c33708-873c-4b0a-a75f-eedc4bd22b66 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:51.158707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-35c33708-873c-4b0a-a75f-eedc4bd22b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:51.227243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5759a-c06d-41d9-877e-d181aec9a610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:51.227841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5759a-c06d-41d9-877e-d181aec9a610 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:51.228124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5759a-c06d-41d9-877e-d181aec9a610 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:51.228389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5759a-c06d-41d9-877e-d181aec9a610 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:51.229069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5759a-c06d-41d9-877e-d181aec9a610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:51.237362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5759a-c06d-41d9-877e-d181aec9a610 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:51.258459 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4038/8042] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:19:51.266247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5759a-c06d-41d9-877e-d181aec9a610 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:51.288047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5759a-c06d-41d9-877e-d181aec9a610 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:51.301103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c777ed-aa07-4408-aca2-ed135e1df110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:51.301712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c777ed-aa07-4408-aca2-ed135e1df110 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:51.302131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c777ed-aa07-4408-aca2-ed135e1df110 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:51.302409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c777ed-aa07-4408-aca2-ed135e1df110 admin admin] PATH_INFO: `/v3/projects/a4655bf0f79241f995ea3b58d0a68379/users/d8f8ec19181a4b47bcb10867c29cac3a/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:51.307082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c777ed-aa07-4408-aca2-ed135e1df110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4655bf0f79241f995ea3b58d0a68379, user_id=d8f8ec19181a4b47bcb10867c29cac3a, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:51.312420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c777ed-aa07-4408-aca2-ed135e1df110 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:51.322842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c33708-873c-4b0a-a75f-eedc4bd22b66 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:51.336459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238cb4c8-50d0-4182-97bf-8536c9e49039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:51.338368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cb4c8-50d0-4182-97bf-8536c9e49039 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:51.338537 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4039/8043] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:19:51 2022] PUT /identity/v3/projects/a4655bf0f79241f995ea3b58d0a68379/users/d8f8ec19181a4b47bcb10867c29cac3a/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:51.339347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cb4c8-50d0-4182-97bf-8536c9e49039 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:51.340116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cb4c8-50d0-4182-97bf-8536c9e49039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:51.344690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-238cb4c8-50d0-4182-97bf-8536c9e49039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:51.349539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c46dd-2939-4e19-a0ab-67c67042b966 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:51.349828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c46dd-2939-4e19-a0ab-67c67042b966 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:51.350137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c46dd-2939-4e19-a0ab-67c67042b966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:51.396084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238cb4c8-50d0-4182-97bf-8536c9e49039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:51.400010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238cb4c8-50d0-4182-97bf-8536c9e49039 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:51.429583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-434c46dd-2939-4e19-a0ab-67c67042b966 None None] MFA Rules not processed for user `d8f8ec19181a4b47bcb10867c29cac3a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:51.431006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-434c46dd-2939-4e19-a0ab-67c67042b966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:51.433296 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4005/8044] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:19:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:19:51.645268 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4040/8045] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:51.657726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238cb4c8-50d0-4182-97bf-8536c9e49039 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:51.660798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-238cb4c8-50d0-4182-97bf-8536c9e49039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:51.697416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238cb4c8-50d0-4182-97bf-8536c9e49039 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:51.887551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc922a-47d7-4760-98a7-9252f1eb87f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:51.888461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc922a-47d7-4760-98a7-9252f1eb87f5 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:51.888963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc922a-47d7-4760-98a7-9252f1eb87f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:51.889410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc922a-47d7-4760-98a7-9252f1eb87f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:51.908556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc922a-47d7-4760-98a7-9252f1eb87f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:51.913750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc922a-47d7-4760-98a7-9252f1eb87f5 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:51.934069 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:51.963516 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4006/8046] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:19:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:19:55.678118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c46dd-2939-4e19-a0ab-67c67042b966 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:55.698914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c46dd-2939-4e19-a0ab-67c67042b966 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:55.706128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f902a0-4e11-4227-9efb-fbad7783f3cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:55.707016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f902a0-4e11-4227-9efb-fbad7783f3cb service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:55.708373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f902a0-4e11-4227-9efb-fbad7783f3cb service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:55.708913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f902a0-4e11-4227-9efb-fbad7783f3cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:55.816352 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:19:55.833788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f902a0-4e11-4227-9efb-fbad7783f3cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:55.846174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f902a0-4e11-4227-9efb-fbad7783f3cb service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:55.885581 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4041/8047] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:19:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:19:57.574752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc922a-47d7-4760-98a7-9252f1eb87f5 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:57.658698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc922a-47d7-4760-98a7-9252f1eb87f5 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:57.663664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3328a0d-ba2d-4b80-9e2a-c2c924443865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:57.664486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3328a0d-ba2d-4b80-9e2a-c2c924443865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:57.664907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3328a0d-ba2d-4b80-9e2a-c2c924443865 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:57.665281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3328a0d-ba2d-4b80-9e2a-c2c924443865 admin admin] PATH_INFO: `/v3/users/6dbcb019f2534a97bbfd1cf22fc62f4c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:57.666871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3328a0d-ba2d-4b80-9e2a-c2c924443865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dbcb019f2534a97bbfd1cf22fc62f4c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:57.669392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3328a0d-ba2d-4b80-9e2a-c2c924443865 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:57.755806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e3328a0d-ba2d-4b80-9e2a-c2c924443865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dbcb019f2534a97bbfd1cf22fc62f4c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:57.777977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e3328a0d-ba2d-4b80-9e2a-c2c924443865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dbcb019f2534a97bbfd1cf22fc62f4c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:57.778790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e3328a0d-ba2d-4b80-9e2a-c2c924443865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dbcb019f2534a97bbfd1cf22fc62f4c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:57.806592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e3328a0d-ba2d-4b80-9e2a-c2c924443865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dbcb019f2534a97bbfd1cf22fc62f4c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:57.826840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e3328a0d-ba2d-4b80-9e2a-c2c924443865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dbcb019f2534a97bbfd1cf22fc62f4c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:19:57.850251 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4007/8048] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:19:57 2022] DELETE /identity/v3/users/6dbcb019f2534a97bbfd1cf22fc62f4c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:19:57.854540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf10a0-bad7-404c-a057-45575a3001af None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:57.855030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf10a0-bad7-404c-a057-45575a3001af None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:57.855131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf10a0-bad7-404c-a057-45575a3001af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:57.918849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-aebf10a0-bad7-404c-a057-45575a3001af None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:19:57.932150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-aebf10a0-bad7-404c-a057-45575a3001af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:58.176003 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4042/8049] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:19:58.198603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3328a0d-ba2d-4b80-9e2a-c2c924443865 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:58.200976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e3328a0d-ba2d-4b80-9e2a-c2c924443865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:58.355850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3328a0d-ba2d-4b80-9e2a-c2c924443865 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:58.361753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb8a63-a205-4db1-9dd6-4345d14af168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:58.362435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb8a63-a205-4db1-9dd6-4345d14af168 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:58.362740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb8a63-a205-4db1-9dd6-4345d14af168 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:58.363012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb8a63-a205-4db1-9dd6-4345d14af168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:58.382321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb8a63-a205-4db1-9dd6-4345d14af168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:58.383365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb8a63-a205-4db1-9dd6-4345d14af168 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:58.395295 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4008/8050] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:19:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:19:58.597961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf10a0-bad7-404c-a057-45575a3001af None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:19:58.600354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-aebf10a0-bad7-404c-a057-45575a3001af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:58.873303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf10a0-bad7-404c-a057-45575a3001af None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:19:58.885960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144631a6-b443-4528-8759-c563957db5a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:19:58.888177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144631a6-b443-4528-8759-c563957db5a4 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:19:58.888541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144631a6-b443-4528-8759-c563957db5a4 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:19:58.889039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144631a6-b443-4528-8759-c563957db5a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:19:58.897304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-144631a6-b443-4528-8759-c563957db5a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:19:58.941403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144631a6-b443-4528-8759-c563957db5a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:19:58.943444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144631a6-b443-4528-8759-c563957db5a4 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:19:58.982607 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4043/8051] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:19:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:20:00.706355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb8a63-a205-4db1-9dd6-4345d14af168 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:00.708194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6dbb8a63-a205-4db1-9dd6-4345d14af168 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:00.746274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb8a63-a205-4db1-9dd6-4345d14af168 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:00.773727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5862a-864c-4788-b3be-bf9096a08a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:00.776544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5862a-864c-4788-b3be-bf9096a08a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:00.779166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5862a-864c-4788-b3be-bf9096a08a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:00.779484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5862a-864c-4788-b3be-bf9096a08a46 admin admin] PATH_INFO: `/v3/projects/619835ee2c714ce8843e22a8b6e17a8b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:00.783495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5862a-864c-4788-b3be-bf9096a08a46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=619835ee2c714ce8843e22a8b6e17a8b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:00.793541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5862a-864c-4788-b3be-bf9096a08a46 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:00.871437 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:01.009199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0cf5862a-864c-4788-b3be-bf9096a08a46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '619835ee2c714ce8843e22a8b6e17a8b', 'request_id': 'req-0cf5862a-864c-4788-b3be-bf9096a08a46'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:01.031955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0cf5862a-864c-4788-b3be-bf9096a08a46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '619835ee2c714ce8843e22a8b6e17a8b', 'request_id': 'req-0cf5862a-864c-4788-b3be-bf9096a08a46'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:01.070240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0cf5862a-864c-4788-b3be-bf9096a08a46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '619835ee2c714ce8843e22a8b6e17a8b', 'request_id': 'req-0cf5862a-864c-4788-b3be-bf9096a08a46'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:01.106921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0cf5862a-864c-4788-b3be-bf9096a08a46 admin admin] The token cache is being invalidate because project 619835ee2c714ce8843e22a8b6e17a8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:20:01.108857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0cf5862a-864c-4788-b3be-bf9096a08a46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:01.110902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0cf5862a-864c-4788-b3be-bf9096a08a46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:01.116232 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4009/8052] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:20:00 2022] DELETE /identity/v3/projects/619835ee2c714ce8843e22a8b6e17a8b => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:01.121059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144631a6-b443-4528-8759-c563957db5a4 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:01.155475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144631a6-b443-4528-8759-c563957db5a4 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:01.334719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631db3d6-e6aa-4df1-806d-9c5e1845b160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:01.335526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631db3d6-e6aa-4df1-806d-9c5e1845b160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:01.335946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631db3d6-e6aa-4df1-806d-9c5e1845b160 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:01.340657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631db3d6-e6aa-4df1-806d-9c5e1845b160 admin admin] PATH_INFO: `/v3/users/d8f8ec19181a4b47bcb10867c29cac3a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:01.342384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631db3d6-e6aa-4df1-806d-9c5e1845b160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f8ec19181a4b47bcb10867c29cac3a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:01.345045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631db3d6-e6aa-4df1-806d-9c5e1845b160 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:01.408077 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:01.577511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-631db3d6-e6aa-4df1-806d-9c5e1845b160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f8ec19181a4b47bcb10867c29cac3a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:01.579454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-631db3d6-e6aa-4df1-806d-9c5e1845b160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f8ec19181a4b47bcb10867c29cac3a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:01.599977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-631db3d6-e6aa-4df1-806d-9c5e1845b160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f8ec19181a4b47bcb10867c29cac3a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:01.653578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-631db3d6-e6aa-4df1-806d-9c5e1845b160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f8ec19181a4b47bcb10867c29cac3a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:01.691341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-631db3d6-e6aa-4df1-806d-9c5e1845b160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f8ec19181a4b47bcb10867c29cac3a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:01.719739 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4044/8053] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:20:01 2022] DELETE /identity/v3/users/d8f8ec19181a4b47bcb10867c29cac3a => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:02.564135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5862a-864c-4788-b3be-bf9096a08a46 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:02.565782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0cf5862a-864c-4788-b3be-bf9096a08a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:02.589533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5862a-864c-4788-b3be-bf9096a08a46 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:02.756753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9908ec8-048e-4090-af7d-a70bb23eb0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:02.758963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9908ec8-048e-4090-af7d-a70bb23eb0b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:02.761059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9908ec8-048e-4090-af7d-a70bb23eb0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:02.761635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9908ec8-048e-4090-af7d-a70bb23eb0b7 admin admin] PATH_INFO: `/v3/projects/a4655bf0f79241f995ea3b58d0a68379` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:02.764820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9908ec8-048e-4090-af7d-a70bb23eb0b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4655bf0f79241f995ea3b58d0a68379)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:02.770849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9908ec8-048e-4090-af7d-a70bb23eb0b7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:02.951205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9908ec8-048e-4090-af7d-a70bb23eb0b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4655bf0f79241f995ea3b58d0a68379', 'request_id': 'req-b9908ec8-048e-4090-af7d-a70bb23eb0b7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:02.976748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9908ec8-048e-4090-af7d-a70bb23eb0b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4655bf0f79241f995ea3b58d0a68379', 'request_id': 'req-b9908ec8-048e-4090-af7d-a70bb23eb0b7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:03.016286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9908ec8-048e-4090-af7d-a70bb23eb0b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4655bf0f79241f995ea3b58d0a68379', 'request_id': 'req-b9908ec8-048e-4090-af7d-a70bb23eb0b7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:03.064932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9908ec8-048e-4090-af7d-a70bb23eb0b7 admin admin] The token cache is being invalidate because project a4655bf0f79241f995ea3b58d0a68379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:20:03.065400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9908ec8-048e-4090-af7d-a70bb23eb0b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:03.068304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9908ec8-048e-4090-af7d-a70bb23eb0b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:03.078983 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4010/8054] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:20:02 2022] DELETE /identity/v3/projects/a4655bf0f79241f995ea3b58d0a68379 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:03.084814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0aa2d-4f21-4983-b7a8-dcbb271c4801 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:03.087102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0aa2d-4f21-4983-b7a8-dcbb271c4801 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:03.087619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0aa2d-4f21-4983-b7a8-dcbb271c4801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:03.132012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cde0aa2d-4f21-4983-b7a8-dcbb271c4801 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:03.133411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cde0aa2d-4f21-4983-b7a8-dcbb271c4801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:03.295674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30637f-8232-45b8-a0fa-5818f2942dd2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:03.295887 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4045/8055] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:03.296286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30637f-8232-45b8-a0fa-5818f2942dd2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:03.296942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30637f-8232-45b8-a0fa-5818f2942dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:03.345906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5b30637f-8232-45b8-a0fa-5818f2942dd2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:03.348434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5b30637f-8232-45b8-a0fa-5818f2942dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:03.367882 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4011/8056] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:20:03.377875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0aa2d-4f21-4983-b7a8-dcbb271c4801 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:03.405067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0aa2d-4f21-4983-b7a8-dcbb271c4801 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:03.427899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce9240-7d7a-404a-9818-a5b892eda7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:03.429593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce9240-7d7a-404a-9818-a5b892eda7ff admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:03.429593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce9240-7d7a-404a-9818-a5b892eda7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:03.430764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce9240-7d7a-404a-9818-a5b892eda7ff admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:03.430764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce9240-7d7a-404a-9818-a5b892eda7ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:20:03.431027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce9240-7d7a-404a-9818-a5b892eda7ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:03.433209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce9240-7d7a-404a-9818-a5b892eda7ff admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:03.505208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30637f-8232-45b8-a0fa-5818f2942dd2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:03.505806 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4046/8057] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:20:03.545084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30637f-8232-45b8-a0fa-5818f2942dd2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:03.589272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff863a-20a5-4756-9036-30715395e8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:03.600008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff863a-20a5-4756-9036-30715395e8ec admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:03.600309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff863a-20a5-4756-9036-30715395e8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:03.600742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff863a-20a5-4756-9036-30715395e8ec admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:03.601613 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff863a-20a5-4756-9036-30715395e8ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:03.603793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff863a-20a5-4756-9036-30715395e8ec admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:03.801009 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4012/8058] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:20:03 2022] POST /identity/v3/projects => generated 387 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:03.810158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce9240-7d7a-404a-9818-a5b892eda7ff admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:03.832770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce9240-7d7a-404a-9818-a5b892eda7ff admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:04.035958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1599d0-3af0-497c-aff6-2793299a665e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:04.036617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1599d0-3af0-497c-aff6-2793299a665e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:04.040171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1599d0-3af0-497c-aff6-2793299a665e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:04.042868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1599d0-3af0-497c-aff6-2793299a665e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:04.045780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1599d0-3af0-497c-aff6-2793299a665e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:04.053261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1599d0-3af0-497c-aff6-2793299a665e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:04.128003 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4047/8059] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:20:03 2022] POST /identity/v3/users => generated 294 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:04.133573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff863a-20a5-4756-9036-30715395e8ec admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:04.148728 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:04.159549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff863a-20a5-4756-9036-30715395e8ec admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:04.174386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3af9f4-7939-4507-88ff-7255d03f18db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:04.178460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3af9f4-7939-4507-88ff-7255d03f18db admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:04.179651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3af9f4-7939-4507-88ff-7255d03f18db admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:04.180086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3af9f4-7939-4507-88ff-7255d03f18db admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:04.184140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3af9f4-7939-4507-88ff-7255d03f18db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:04.190854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3af9f4-7939-4507-88ff-7255d03f18db admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:04.236063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1599d0-3af0-497c-aff6-2793299a665e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:04.246844 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4013/8060] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:20:04.254743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1599d0-3af0-497c-aff6-2793299a665e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:04.271283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bca5f5-4bfe-4425-a4c7-942cc4a1c915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:04.271919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bca5f5-4bfe-4425-a4c7-942cc4a1c915 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:04.272201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bca5f5-4bfe-4425-a4c7-942cc4a1c915 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:04.272467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bca5f5-4bfe-4425-a4c7-942cc4a1c915 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:04.273160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bca5f5-4bfe-4425-a4c7-942cc4a1c915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:04.282919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bca5f5-4bfe-4425-a4c7-942cc4a1c915 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:04.294372 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:04.335715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3af9f4-7939-4507-88ff-7255d03f18db admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:04.347818 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4048/8061] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:20:04.355647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3af9f4-7939-4507-88ff-7255d03f18db admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:04.372112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285356b7-1ea4-4c2c-b853-7236cda2c967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:04.372831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285356b7-1ea4-4c2c-b853-7236cda2c967 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:04.373116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285356b7-1ea4-4c2c-b853-7236cda2c967 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:04.373470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285356b7-1ea4-4c2c-b853-7236cda2c967 admin admin] PATH_INFO: `/v3/projects/915e3350d5574d8a8db0607819f36013/users/7f7029459a0b46f2b13636766a8d052a/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:04.423898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285356b7-1ea4-4c2c-b853-7236cda2c967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=915e3350d5574d8a8db0607819f36013, user_id=7f7029459a0b46f2b13636766a8d052a, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:04.439977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285356b7-1ea4-4c2c-b853-7236cda2c967 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:04.489931 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4014/8062] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:20:04 2022] PUT /identity/v3/projects/915e3350d5574d8a8db0607819f36013/users/7f7029459a0b46f2b13636766a8d052a/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:04.494174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189eb7d0-c03d-4571-9ec1-8cf98593f188 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:04.494391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189eb7d0-c03d-4571-9ec1-8cf98593f188 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:04.495149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189eb7d0-c03d-4571-9ec1-8cf98593f188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:04.557593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-189eb7d0-c03d-4571-9ec1-8cf98593f188 None None] MFA Rules not processed for user `7f7029459a0b46f2b13636766a8d052a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:04.559154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-189eb7d0-c03d-4571-9ec1-8cf98593f188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:04.888271 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4049/8063] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:04.924206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285356b7-1ea4-4c2c-b853-7236cda2c967 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:04.928034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-285356b7-1ea4-4c2c-b853-7236cda2c967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:05.322530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285356b7-1ea4-4c2c-b853-7236cda2c967 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:05.346605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004a443-70ba-4f18-a8c4-07d707f342e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:05.348574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004a443-70ba-4f18-a8c4-07d707f342e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:05.349601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004a443-70ba-4f18-a8c4-07d707f342e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:05.351302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004a443-70ba-4f18-a8c4-07d707f342e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:05.386996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004a443-70ba-4f18-a8c4-07d707f342e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:05.391033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004a443-70ba-4f18-a8c4-07d707f342e9 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:05.432233 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4015/8064] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:20:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:20:09.016169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189eb7d0-c03d-4571-9ec1-8cf98593f188 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:09.018806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-189eb7d0-c03d-4571-9ec1-8cf98593f188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:09.352647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189eb7d0-c03d-4571-9ec1-8cf98593f188 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:09.366556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51ed26-9d02-490f-8f95-963754327311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:09.372432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51ed26-9d02-490f-8f95-963754327311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:09.372881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51ed26-9d02-490f-8f95-963754327311 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:09.373306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51ed26-9d02-490f-8f95-963754327311 admin admin] PATH_INFO: `/v3/users/69db1e8d0ae14bc8bfa8461e23b631a5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:09.376361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51ed26-9d02-490f-8f95-963754327311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69db1e8d0ae14bc8bfa8461e23b631a5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:09.386330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51ed26-9d02-490f-8f95-963754327311 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:09.605830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bb51ed26-9d02-490f-8f95-963754327311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69db1e8d0ae14bc8bfa8461e23b631a5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:09.606958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bb51ed26-9d02-490f-8f95-963754327311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69db1e8d0ae14bc8bfa8461e23b631a5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:09.631145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bb51ed26-9d02-490f-8f95-963754327311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69db1e8d0ae14bc8bfa8461e23b631a5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:09.685947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bb51ed26-9d02-490f-8f95-963754327311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69db1e8d0ae14bc8bfa8461e23b631a5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:09.705846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bb51ed26-9d02-490f-8f95-963754327311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69db1e8d0ae14bc8bfa8461e23b631a5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:09.736070 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4050/8065] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:20:09 2022] DELETE /identity/v3/users/69db1e8d0ae14bc8bfa8461e23b631a5 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:10.527045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004a443-70ba-4f18-a8c4-07d707f342e9 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:10.551778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004a443-70ba-4f18-a8c4-07d707f342e9 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:10.760905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9c6df-9553-497c-a7ab-84ed5924c9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:10.765946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9c6df-9553-497c-a7ab-84ed5924c9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:10.766528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9c6df-9553-497c-a7ab-84ed5924c9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:10.771381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9c6df-9553-497c-a7ab-84ed5924c9fd admin admin] PATH_INFO: `/v3/projects/a69a7851d6c6450f95c8489ecf0fb0cb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:10.774487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9c6df-9553-497c-a7ab-84ed5924c9fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a69a7851d6c6450f95c8489ecf0fb0cb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:10.786110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9c6df-9553-497c-a7ab-84ed5924c9fd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:10.880053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c1c9c6df-9553-497c-a7ab-84ed5924c9fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a69a7851d6c6450f95c8489ecf0fb0cb', 'request_id': 'req-c1c9c6df-9553-497c-a7ab-84ed5924c9fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:10.907826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c1c9c6df-9553-497c-a7ab-84ed5924c9fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a69a7851d6c6450f95c8489ecf0fb0cb', 'request_id': 'req-c1c9c6df-9553-497c-a7ab-84ed5924c9fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:10.934245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c1c9c6df-9553-497c-a7ab-84ed5924c9fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a69a7851d6c6450f95c8489ecf0fb0cb', 'request_id': 'req-c1c9c6df-9553-497c-a7ab-84ed5924c9fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:10.999139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c1c9c6df-9553-497c-a7ab-84ed5924c9fd admin admin] The token cache is being invalidate because project a69a7851d6c6450f95c8489ecf0fb0cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:20:10.999739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c1c9c6df-9553-497c-a7ab-84ed5924c9fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:11.000655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c1c9c6df-9553-497c-a7ab-84ed5924c9fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:11.008276 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4016/8066] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:20:10 2022] DELETE /identity/v3/projects/a69a7851d6c6450f95c8489ecf0fb0cb => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:11.009625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51ed26-9d02-490f-8f95-963754327311 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:11.011233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bb51ed26-9d02-490f-8f95-963754327311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:11.033108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51ed26-9d02-490f-8f95-963754327311 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:11.045507 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:11.246650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f2286-8288-454e-adf0-c7505959ca38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:11.247408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f2286-8288-454e-adf0-c7505959ca38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:11.247603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f2286-8288-454e-adf0-c7505959ca38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:11.247877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f2286-8288-454e-adf0-c7505959ca38 admin admin] PATH_INFO: `/v3/users/eb4d1cce46954207adfcac2faf26876e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:11.251798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f2286-8288-454e-adf0-c7505959ca38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb4d1cce46954207adfcac2faf26876e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:11.258570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f2286-8288-454e-adf0-c7505959ca38 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:11.432303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1c0f2286-8288-454e-adf0-c7505959ca38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb4d1cce46954207adfcac2faf26876e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:11.433357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1c0f2286-8288-454e-adf0-c7505959ca38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb4d1cce46954207adfcac2faf26876e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:11.446486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1c0f2286-8288-454e-adf0-c7505959ca38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb4d1cce46954207adfcac2faf26876e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:11.480010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1c0f2286-8288-454e-adf0-c7505959ca38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb4d1cce46954207adfcac2faf26876e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:11.493329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1c0f2286-8288-454e-adf0-c7505959ca38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb4d1cce46954207adfcac2faf26876e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:11.504048 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4051/8067] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:20:11 2022] DELETE /identity/v3/users/eb4d1cce46954207adfcac2faf26876e => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:11.872798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9c6df-9553-497c-a7ab-84ed5924c9fd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:11.875696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c1c9c6df-9553-497c-a7ab-84ed5924c9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:11.886770 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:11.899497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9c6df-9553-497c-a7ab-84ed5924c9fd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:12.044460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9961a-35de-459e-8caa-4dc437a24c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:12.046224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9961a-35de-459e-8caa-4dc437a24c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:12.047208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9961a-35de-459e-8caa-4dc437a24c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:12.049000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9961a-35de-459e-8caa-4dc437a24c8e admin admin] PATH_INFO: `/v3/projects/d67b9729fd8541d0bfe3db9724fc4a3d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:12.060886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9961a-35de-459e-8caa-4dc437a24c8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d67b9729fd8541d0bfe3db9724fc4a3d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:12.065280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9961a-35de-459e-8caa-4dc437a24c8e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:12.159781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0ab9961a-35de-459e-8caa-4dc437a24c8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd67b9729fd8541d0bfe3db9724fc4a3d', 'request_id': 'req-0ab9961a-35de-459e-8caa-4dc437a24c8e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:12.182006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0ab9961a-35de-459e-8caa-4dc437a24c8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd67b9729fd8541d0bfe3db9724fc4a3d', 'request_id': 'req-0ab9961a-35de-459e-8caa-4dc437a24c8e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:12.195639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0ab9961a-35de-459e-8caa-4dc437a24c8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd67b9729fd8541d0bfe3db9724fc4a3d', 'request_id': 'req-0ab9961a-35de-459e-8caa-4dc437a24c8e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:12.224239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0ab9961a-35de-459e-8caa-4dc437a24c8e admin admin] The token cache is being invalidate because project d67b9729fd8541d0bfe3db9724fc4a3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:20:12.224567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0ab9961a-35de-459e-8caa-4dc437a24c8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:12.227501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0ab9961a-35de-459e-8caa-4dc437a24c8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:12.236282 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4017/8068] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:20:11 2022] DELETE /identity/v3/projects/d67b9729fd8541d0bfe3db9724fc4a3d => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:12.236998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf297c3a-3381-4c2e-b369-3cea6f36fc88 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:12.237867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf297c3a-3381-4c2e-b369-3cea6f36fc88 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:12.238350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf297c3a-3381-4c2e-b369-3cea6f36fc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:12.283846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bf297c3a-3381-4c2e-b369-3cea6f36fc88 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:12.288579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bf297c3a-3381-4c2e-b369-3cea6f36fc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:12.484186 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4052/8069] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:20:12.486193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6126ccf-6920-41ac-a94b-efb8d805a98b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:12.486643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6126ccf-6920-41ac-a94b-efb8d805a98b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:12.486943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6126ccf-6920-41ac-a94b-efb8d805a98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:12.543254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a6126ccf-6920-41ac-a94b-efb8d805a98b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:12.547260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a6126ccf-6920-41ac-a94b-efb8d805a98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:12.572552 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4018/8070] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:12.588938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf297c3a-3381-4c2e-b369-3cea6f36fc88 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:12.604412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf297c3a-3381-4c2e-b369-3cea6f36fc88 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:12.615526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24838e4e-b895-49ea-bea9-dfe6ab7361fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:12.616437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24838e4e-b895-49ea-bea9-dfe6ab7361fd admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:12.616437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24838e4e-b895-49ea-bea9-dfe6ab7361fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:12.619410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24838e4e-b895-49ea-bea9-dfe6ab7361fd admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:12.620219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24838e4e-b895-49ea-bea9-dfe6ab7361fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:20:12.623285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24838e4e-b895-49ea-bea9-dfe6ab7361fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:12.625852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24838e4e-b895-49ea-bea9-dfe6ab7361fd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:12.673064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6126ccf-6920-41ac-a94b-efb8d805a98b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:12.673275 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4053/8071] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:20:12.700715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6126ccf-6920-41ac-a94b-efb8d805a98b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:12.719293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da9903-04b0-4e02-9e64-279a8ed98c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:12.720385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da9903-04b0-4e02-9e64-279a8ed98c26 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:12.723522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da9903-04b0-4e02-9e64-279a8ed98c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:12.724143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da9903-04b0-4e02-9e64-279a8ed98c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:12.725148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da9903-04b0-4e02-9e64-279a8ed98c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:12.728280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da9903-04b0-4e02-9e64-279a8ed98c26 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:12.772132 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4019/8072] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:20:12 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:12.776531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24838e4e-b895-49ea-bea9-dfe6ab7361fd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:12.791933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24838e4e-b895-49ea-bea9-dfe6ab7361fd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:12.807142 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:12.924244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b69240-869d-4d6a-8a9f-3e1dfbfaf4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:12.925167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b69240-869d-4d6a-8a9f-3e1dfbfaf4f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:12.925510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b69240-869d-4d6a-8a9f-3e1dfbfaf4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:12.925785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b69240-869d-4d6a-8a9f-3e1dfbfaf4f9 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:12.926592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b69240-869d-4d6a-8a9f-3e1dfbfaf4f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:12.928982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b69240-869d-4d6a-8a9f-3e1dfbfaf4f9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:12.985791 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4054/8073] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:20:12 2022] POST /identity/v3/users => generated 291 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:12.989706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da9903-04b0-4e02-9e64-279a8ed98c26 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:13.010046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da9903-04b0-4e02-9e64-279a8ed98c26 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:13.017667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c9830-5b96-461a-afc3-ceffca3e73f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:13.019225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c9830-5b96-461a-afc3-ceffca3e73f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:13.020141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c9830-5b96-461a-afc3-ceffca3e73f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:13.021334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c9830-5b96-461a-afc3-ceffca3e73f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:13.022683 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c9830-5b96-461a-afc3-ceffca3e73f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:13.024769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c9830-5b96-461a-afc3-ceffca3e73f4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:13.043699 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4020/8074] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:20:13.047882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b69240-869d-4d6a-8a9f-3e1dfbfaf4f9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:13.060342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b69240-869d-4d6a-8a9f-3e1dfbfaf4f9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:13.071559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd225436-c77a-4c9b-aba2-400a45053b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:13.072340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd225436-c77a-4c9b-aba2-400a45053b65 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:13.072872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd225436-c77a-4c9b-aba2-400a45053b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:13.073273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd225436-c77a-4c9b-aba2-400a45053b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:13.074065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd225436-c77a-4c9b-aba2-400a45053b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:13.076415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd225436-c77a-4c9b-aba2-400a45053b65 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:13.094075 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4055/8075] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:20:13.096574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c9830-5b96-461a-afc3-ceffca3e73f4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:13.110795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c9830-5b96-461a-afc3-ceffca3e73f4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:13.135808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2508f-5711-4617-99c9-e01b5aa9273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:13.137530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2508f-5711-4617-99c9-e01b5aa9273b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:13.137916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2508f-5711-4617-99c9-e01b5aa9273b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:13.138858 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2508f-5711-4617-99c9-e01b5aa9273b admin admin] PATH_INFO: `/v3/projects/f8173a31d9ca430e9d236f5bc9c57bb4/users/d7dbb392d728499c92e58aec0afb676f/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:13.180673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2508f-5711-4617-99c9-e01b5aa9273b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8173a31d9ca430e9d236f5bc9c57bb4, user_id=d7dbb392d728499c92e58aec0afb676f, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:13.188748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2508f-5711-4617-99c9-e01b5aa9273b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:13.230131 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4021/8076] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:20:13 2022] PUT /identity/v3/projects/f8173a31d9ca430e9d236f5bc9c57bb4/users/d7dbb392d728499c92e58aec0afb676f/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:13.241576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db501c0d-7b9a-4a7c-9f16-da562ad6fb58 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:13.242114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db501c0d-7b9a-4a7c-9f16-da562ad6fb58 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:13.242231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db501c0d-7b9a-4a7c-9f16-da562ad6fb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:13.287752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-db501c0d-7b9a-4a7c-9f16-da562ad6fb58 None None] MFA Rules not processed for user `d7dbb392d728499c92e58aec0afb676f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:13.290162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-db501c0d-7b9a-4a7c-9f16-da562ad6fb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:13.425232 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4056/8077] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:13.427110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2508f-5711-4617-99c9-e01b5aa9273b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:13.474280 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:13.559645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2508f-5711-4617-99c9-e01b5aa9273b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:13.574618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4140a-5bbd-46cb-8023-55b6b70df7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:13.575670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4140a-5bbd-46cb-8023-55b6b70df7cc admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:13.576108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4140a-5bbd-46cb-8023-55b6b70df7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:13.576450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4140a-5bbd-46cb-8023-55b6b70df7cc admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:13.577659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4140a-5bbd-46cb-8023-55b6b70df7cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:13.579593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4140a-5bbd-46cb-8023-55b6b70df7cc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:13.644125 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4022/8078] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:20:13 2022] POST /identity/v3/projects => generated 381 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:13.649103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db501c0d-7b9a-4a7c-9f16-da562ad6fb58 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:13.671373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db501c0d-7b9a-4a7c-9f16-da562ad6fb58 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:13.826764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c08bba-2c02-45f7-b5d9-48215c2ed237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:13.828155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c08bba-2c02-45f7-b5d9-48215c2ed237 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:13.828445 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c08bba-2c02-45f7-b5d9-48215c2ed237 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:13.828823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c08bba-2c02-45f7-b5d9-48215c2ed237 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:13.830595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c08bba-2c02-45f7-b5d9-48215c2ed237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:13.833728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c08bba-2c02-45f7-b5d9-48215c2ed237 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:13.867820 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4057/8079] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:20:13 2022] POST /identity/v3/users => generated 297 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:13.872061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4140a-5bbd-46cb-8023-55b6b70df7cc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:13.887103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4140a-5bbd-46cb-8023-55b6b70df7cc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:13.896683 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795994c-6b8e-43c8-b3aa-83c2ef854653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:13.897722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795994c-6b8e-43c8-b3aa-83c2ef854653 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:13.898154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795994c-6b8e-43c8-b3aa-83c2ef854653 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:13.898656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795994c-6b8e-43c8-b3aa-83c2ef854653 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:13.899480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795994c-6b8e-43c8-b3aa-83c2ef854653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:13.901524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795994c-6b8e-43c8-b3aa-83c2ef854653 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:13.920308 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4023/8080] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:20:13.922929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c08bba-2c02-45f7-b5d9-48215c2ed237 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:13.937481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c08bba-2c02-45f7-b5d9-48215c2ed237 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:13.953510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca2041-3958-4986-a0b4-fb6cc74b39d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:13.953744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca2041-3958-4986-a0b4-fb6cc74b39d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:13.954322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca2041-3958-4986-a0b4-fb6cc74b39d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:13.954733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca2041-3958-4986-a0b4-fb6cc74b39d0 admin admin] PATH_INFO: `/v3/projects/0cd81dde89da40b1a0ae34a87e5c8a54/users/301ff724f24740f982abe55e994d534a/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:13.971217 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:13.986538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca2041-3958-4986-a0b4-fb6cc74b39d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd81dde89da40b1a0ae34a87e5c8a54, user_id=301ff724f24740f982abe55e994d534a, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:13.994147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca2041-3958-4986-a0b4-fb6cc74b39d0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:14.035095 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4058/8081] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:20:13 2022] PUT /identity/v3/projects/0cd81dde89da40b1a0ae34a87e5c8a54/users/301ff724f24740f982abe55e994d534a/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:14.036496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795994c-6b8e-43c8-b3aa-83c2ef854653 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:14.052447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795994c-6b8e-43c8-b3aa-83c2ef854653 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:14.222446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93ab35-9266-4d68-81f9-35deef69ce75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:14.223792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93ab35-9266-4d68-81f9-35deef69ce75 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:14.224277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93ab35-9266-4d68-81f9-35deef69ce75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:14.224817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93ab35-9266-4d68-81f9-35deef69ce75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:14.226041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93ab35-9266-4d68-81f9-35deef69ce75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:14.234739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93ab35-9266-4d68-81f9-35deef69ce75 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:14.272142 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4024/8082] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:20:14.276568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca2041-3958-4986-a0b4-fb6cc74b39d0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:14.299567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca2041-3958-4986-a0b4-fb6cc74b39d0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:14.317270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010dbfa-f7e6-40f9-89cd-bf96ef74db26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:14.323263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010dbfa-f7e6-40f9-89cd-bf96ef74db26 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:14.325869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010dbfa-f7e6-40f9-89cd-bf96ef74db26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:14.326261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010dbfa-f7e6-40f9-89cd-bf96ef74db26 admin admin] PATH_INFO: `/v3/projects/0cd81dde89da40b1a0ae34a87e5c8a54/users/301ff724f24740f982abe55e994d534a/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:14.335624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010dbfa-f7e6-40f9-89cd-bf96ef74db26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd81dde89da40b1a0ae34a87e5c8a54, user_id=301ff724f24740f982abe55e994d534a, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:14.351821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010dbfa-f7e6-40f9-89cd-bf96ef74db26 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:14.401183 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4059/8083] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:20:14 2022] PUT /identity/v3/projects/0cd81dde89da40b1a0ae34a87e5c8a54/users/301ff724f24740f982abe55e994d534a/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:14.403059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56117303-57aa-4eaf-b74c-26f947352959 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:14.403346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56117303-57aa-4eaf-b74c-26f947352959 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:14.403619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56117303-57aa-4eaf-b74c-26f947352959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:14.475862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-56117303-57aa-4eaf-b74c-26f947352959 None None] MFA Rules not processed for user `301ff724f24740f982abe55e994d534a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:14.476980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-56117303-57aa-4eaf-b74c-26f947352959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:14.643382 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4025/8084] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:20:14.656350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010dbfa-f7e6-40f9-89cd-bf96ef74db26 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:14.658423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f010dbfa-f7e6-40f9-89cd-bf96ef74db26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:14.790794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010dbfa-f7e6-40f9-89cd-bf96ef74db26 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:14.799666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadd7b1-d625-45e0-95fd-75852b02ceff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:14.800359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadd7b1-d625-45e0-95fd-75852b02ceff service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:14.801293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadd7b1-d625-45e0-95fd-75852b02ceff service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:14.801585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadd7b1-d625-45e0-95fd-75852b02ceff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:14.946923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fadd7b1-d625-45e0-95fd-75852b02ceff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:14.948366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fadd7b1-d625-45e0-95fd-75852b02ceff service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:14.981268 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4060/8085] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:20:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:20:21.340941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56117303-57aa-4eaf-b74c-26f947352959 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:21.343390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-56117303-57aa-4eaf-b74c-26f947352959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:21.395221 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:21.463386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56117303-57aa-4eaf-b74c-26f947352959 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:21.472191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4836e46-b4e4-4c92-9e63-a830419b9528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:21.473524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4836e46-b4e4-4c92-9e63-a830419b9528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:21.474080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4836e46-b4e4-4c92-9e63-a830419b9528 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:21.474366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4836e46-b4e4-4c92-9e63-a830419b9528 admin admin] PATH_INFO: `/v3/users/4780213df80a4fe7806caedd22153026` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:21.476078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4836e46-b4e4-4c92-9e63-a830419b9528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4780213df80a4fe7806caedd22153026)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:21.478655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4836e46-b4e4-4c92-9e63-a830419b9528 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:21.547368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e4836e46-b4e4-4c92-9e63-a830419b9528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4780213df80a4fe7806caedd22153026'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:21.563572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e4836e46-b4e4-4c92-9e63-a830419b9528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4780213df80a4fe7806caedd22153026'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:21.564324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e4836e46-b4e4-4c92-9e63-a830419b9528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4780213df80a4fe7806caedd22153026'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:21.587058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e4836e46-b4e4-4c92-9e63-a830419b9528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4780213df80a4fe7806caedd22153026'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:21.599544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e4836e46-b4e4-4c92-9e63-a830419b9528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4780213df80a4fe7806caedd22153026'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:21.612929 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4026/8086] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:20:21 2022] DELETE /identity/v3/users/4780213df80a4fe7806caedd22153026 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:21.617273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28be34-c482-416a-80ba-694adffe313b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:21.618086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28be34-c482-416a-80ba-694adffe313b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:21.618510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28be34-c482-416a-80ba-694adffe313b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:21.641006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5d28be34-c482-416a-80ba-694adffe313b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:21.644882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5d28be34-c482-416a-80ba-694adffe313b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:21.831778 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4061/8087] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:21.844711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4836e46-b4e4-4c92-9e63-a830419b9528 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:21.846363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e4836e46-b4e4-4c92-9e63-a830419b9528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:22.012450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4836e46-b4e4-4c92-9e63-a830419b9528 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:22.017660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439a382-2df1-46fb-a201-4c05786ae982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:22.018565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439a382-2df1-46fb-a201-4c05786ae982 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:22.018853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439a382-2df1-46fb-a201-4c05786ae982 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:22.019157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439a382-2df1-46fb-a201-4c05786ae982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:22.030836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439a382-2df1-46fb-a201-4c05786ae982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:22.032452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439a382-2df1-46fb-a201-4c05786ae982 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:22.044026 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4027/8088] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:20:22.305640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28be34-c482-416a-80ba-694adffe313b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:22.307423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5d28be34-c482-416a-80ba-694adffe313b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:22.358988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28be34-c482-416a-80ba-694adffe313b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:22.370276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb6556-2756-43f1-aec4-6f7f48aefac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:22.370961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb6556-2756-43f1-aec4-6f7f48aefac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:22.371350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb6556-2756-43f1-aec4-6f7f48aefac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:22.371929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb6556-2756-43f1-aec4-6f7f48aefac1 admin admin] PATH_INFO: `/v3/projects/fe68a9cf550a463a962a95045d1dadf9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:22.373420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb6556-2756-43f1-aec4-6f7f48aefac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe68a9cf550a463a962a95045d1dadf9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:22.376181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb6556-2756-43f1-aec4-6f7f48aefac1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:22.409516 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:22.440229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-06bb6556-2756-43f1-aec4-6f7f48aefac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe68a9cf550a463a962a95045d1dadf9', 'request_id': 'req-06bb6556-2756-43f1-aec4-6f7f48aefac1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:22.451056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-06bb6556-2756-43f1-aec4-6f7f48aefac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe68a9cf550a463a962a95045d1dadf9', 'request_id': 'req-06bb6556-2756-43f1-aec4-6f7f48aefac1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:22.461551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-06bb6556-2756-43f1-aec4-6f7f48aefac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe68a9cf550a463a962a95045d1dadf9', 'request_id': 'req-06bb6556-2756-43f1-aec4-6f7f48aefac1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:22.481298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-06bb6556-2756-43f1-aec4-6f7f48aefac1 admin admin] The token cache is being invalidate because project fe68a9cf550a463a962a95045d1dadf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:20:22.482388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-06bb6556-2756-43f1-aec4-6f7f48aefac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:22.484914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-06bb6556-2756-43f1-aec4-6f7f48aefac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:22.489492 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4062/8089] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:20:22 2022] DELETE /identity/v3/projects/fe68a9cf550a463a962a95045d1dadf9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:22.494029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72015735-6aef-4a9a-bd2a-2f84065d3a4c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:22.494639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72015735-6aef-4a9a-bd2a-2f84065d3a4c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:22.494639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72015735-6aef-4a9a-bd2a-2f84065d3a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:22.526265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-72015735-6aef-4a9a-bd2a-2f84065d3a4c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:22.527617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-72015735-6aef-4a9a-bd2a-2f84065d3a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:22.606245 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:22.651129 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4028/8090] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:22.661663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b7577-afd4-4b2e-af24-faf720d54161 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:22.662638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b7577-afd4-4b2e-af24-faf720d54161 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:22.663266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b7577-afd4-4b2e-af24-faf720d54161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:22.693141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fd5b7577-afd4-4b2e-af24-faf720d54161 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:22.694928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fd5b7577-afd4-4b2e-af24-faf720d54161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:22.706474 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4063/8091] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:22.711163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72015735-6aef-4a9a-bd2a-2f84065d3a4c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:22.727492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72015735-6aef-4a9a-bd2a-2f84065d3a4c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:22.733547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd62f7-88f5-420a-90e7-0b6d93d68ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:22.734390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd62f7-88f5-420a-90e7-0b6d93d68ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:22.734898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd62f7-88f5-420a-90e7-0b6d93d68ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:22.735271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd62f7-88f5-420a-90e7-0b6d93d68ca9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:22.736041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd62f7-88f5-420a-90e7-0b6d93d68ca9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:20:22.736458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd62f7-88f5-420a-90e7-0b6d93d68ca9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:22.738203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd62f7-88f5-420a-90e7-0b6d93d68ca9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:22.766782 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4029/8092] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:20:22.773304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b7577-afd4-4b2e-af24-faf720d54161 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:22.786625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b7577-afd4-4b2e-af24-faf720d54161 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:22.802146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e881b-57fc-48c1-a0a7-c358a12bfa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:22.802860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e881b-57fc-48c1-a0a7-c358a12bfa59 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:22.803172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e881b-57fc-48c1-a0a7-c358a12bfa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:22.803891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e881b-57fc-48c1-a0a7-c358a12bfa59 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:22.804488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e881b-57fc-48c1-a0a7-c358a12bfa59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:22.808458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e881b-57fc-48c1-a0a7-c358a12bfa59 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:22.877509 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4064/8093] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:20:22 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:22.877994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd62f7-88f5-420a-90e7-0b6d93d68ca9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:22.896359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd62f7-88f5-420a-90e7-0b6d93d68ca9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:23.028699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd591a08-c395-4ce6-86b2-c3bc22cac37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:23.029421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd591a08-c395-4ce6-86b2-c3bc22cac37d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:23.030471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd591a08-c395-4ce6-86b2-c3bc22cac37d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:23.030965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd591a08-c395-4ce6-86b2-c3bc22cac37d admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:23.031873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd591a08-c395-4ce6-86b2-c3bc22cac37d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:23.034297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd591a08-c395-4ce6-86b2-c3bc22cac37d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:23.066481 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4030/8094] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:20:22 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:23.068020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e881b-57fc-48c1-a0a7-c358a12bfa59 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:23.082850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e881b-57fc-48c1-a0a7-c358a12bfa59 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:23.088338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfc8a5-4f11-4dc7-a4b9-21d86d2ee189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:23.089058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfc8a5-4f11-4dc7-a4b9-21d86d2ee189 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:23.089446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfc8a5-4f11-4dc7-a4b9-21d86d2ee189 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:23.089808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfc8a5-4f11-4dc7-a4b9-21d86d2ee189 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:23.090553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfc8a5-4f11-4dc7-a4b9-21d86d2ee189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:23.093650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfc8a5-4f11-4dc7-a4b9-21d86d2ee189 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:23.106752 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4065/8095] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:20:23.111317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd591a08-c395-4ce6-86b2-c3bc22cac37d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:23.122348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd591a08-c395-4ce6-86b2-c3bc22cac37d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:23.127382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777f640-1179-4b11-8515-b7b4f6d49e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:23.128025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777f640-1179-4b11-8515-b7b4f6d49e90 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:23.128305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777f640-1179-4b11-8515-b7b4f6d49e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:23.128580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777f640-1179-4b11-8515-b7b4f6d49e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:23.129251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777f640-1179-4b11-8515-b7b4f6d49e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:23.130836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777f640-1179-4b11-8515-b7b4f6d49e90 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:23.144553 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4031/8096] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:20:23.149584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfc8a5-4f11-4dc7-a4b9-21d86d2ee189 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:23.161482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfc8a5-4f11-4dc7-a4b9-21d86d2ee189 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:23.167142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59387406-971b-448e-9d2c-9aaed64deb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:23.167948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59387406-971b-448e-9d2c-9aaed64deb54 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:23.168309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59387406-971b-448e-9d2c-9aaed64deb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:23.168692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59387406-971b-448e-9d2c-9aaed64deb54 admin admin] PATH_INFO: `/v3/projects/e31aad344ee24846af72019d0a22b835/users/77fe33f2ff1e4c2d87d690228343a4f6/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:23.192195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59387406-971b-448e-9d2c-9aaed64deb54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e31aad344ee24846af72019d0a22b835, user_id=77fe33f2ff1e4c2d87d690228343a4f6, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:23.195805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59387406-971b-448e-9d2c-9aaed64deb54 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:23.218484 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4066/8097] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:20:23 2022] PUT /identity/v3/projects/e31aad344ee24846af72019d0a22b835/users/77fe33f2ff1e4c2d87d690228343a4f6/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:23.229339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3ceba-f1bf-4b34-8103-1fcbb83ae600 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:23.229634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3ceba-f1bf-4b34-8103-1fcbb83ae600 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:23.229967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3ceba-f1bf-4b34-8103-1fcbb83ae600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:23.272504 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a7f3ceba-f1bf-4b34-8103-1fcbb83ae600 None None] MFA Rules not processed for user `77fe33f2ff1e4c2d87d690228343a4f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:23.274528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a7f3ceba-f1bf-4b34-8103-1fcbb83ae600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:23.395357 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4032/8098] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:23.399765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59387406-971b-448e-9d2c-9aaed64deb54 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:23.537917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59387406-971b-448e-9d2c-9aaed64deb54 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:23.545339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1fc80-dc34-4c3b-bc78-69d9eadc2242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:23.546127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1fc80-dc34-4c3b-bc78-69d9eadc2242 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:23.546421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1fc80-dc34-4c3b-bc78-69d9eadc2242 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:23.546742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1fc80-dc34-4c3b-bc78-69d9eadc2242 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:23.547878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1fc80-dc34-4c3b-bc78-69d9eadc2242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:23.549555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1fc80-dc34-4c3b-bc78-69d9eadc2242 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:23.615401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3ceba-f1bf-4b34-8103-1fcbb83ae600 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:23.616030 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4067/8099] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:20:23 2022] POST /identity/v3/projects => generated 387 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:23.643727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3ceba-f1bf-4b34-8103-1fcbb83ae600 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:23.726537 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:23.781922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee33f1-8aa0-4040-9e3e-834969508389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:23.782619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee33f1-8aa0-4040-9e3e-834969508389 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:23.782897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee33f1-8aa0-4040-9e3e-834969508389 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:23.783306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee33f1-8aa0-4040-9e3e-834969508389 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:23.783974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee33f1-8aa0-4040-9e3e-834969508389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:23.785904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee33f1-8aa0-4040-9e3e-834969508389 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:23.825580 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4033/8100] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:20:23 2022] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:23.829105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1fc80-dc34-4c3b-bc78-69d9eadc2242 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:23.841310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1fc80-dc34-4c3b-bc78-69d9eadc2242 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:23.846721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d091d1a-25b7-41af-af05-0025611c9865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:23.847720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d091d1a-25b7-41af-af05-0025611c9865 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:23.847720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d091d1a-25b7-41af-af05-0025611c9865 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:23.847720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d091d1a-25b7-41af-af05-0025611c9865 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:23.848273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d091d1a-25b7-41af-af05-0025611c9865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:23.849922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d091d1a-25b7-41af-af05-0025611c9865 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:23.863024 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4068/8101] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:20:23.867022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee33f1-8aa0-4040-9e3e-834969508389 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:23.878829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee33f1-8aa0-4040-9e3e-834969508389 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:23.891675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8af72-bff8-4714-bb45-f32564c8000c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:23.892495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8af72-bff8-4714-bb45-f32564c8000c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:23.893036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8af72-bff8-4714-bb45-f32564c8000c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:23.893036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8af72-bff8-4714-bb45-f32564c8000c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:23.894344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8af72-bff8-4714-bb45-f32564c8000c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:23.898037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8af72-bff8-4714-bb45-f32564c8000c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:23.947387 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4034/8102] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:20:23.948155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d091d1a-25b7-41af-af05-0025611c9865 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:23.964500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d091d1a-25b7-41af-af05-0025611c9865 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:23.995127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd42c4-8320-4ee0-af50-040161bc1bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:24.002423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd42c4-8320-4ee0-af50-040161bc1bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:24.002423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd42c4-8320-4ee0-af50-040161bc1bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:24.003003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd42c4-8320-4ee0-af50-040161bc1bf2 admin admin] PATH_INFO: `/v3/projects/367208930d334b5aaaa5ec5afd47091b/users/0d8442a625a7452dbacad6309a3f0ca4/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:24.049991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd42c4-8320-4ee0-af50-040161bc1bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=367208930d334b5aaaa5ec5afd47091b, user_id=0d8442a625a7452dbacad6309a3f0ca4, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:24.056287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd42c4-8320-4ee0-af50-040161bc1bf2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:24.068690 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:24.083347 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4069/8103] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:20:23 2022] PUT /identity/v3/projects/367208930d334b5aaaa5ec5afd47091b/users/0d8442a625a7452dbacad6309a3f0ca4/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:24.094115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312b53b-daa4-4f76-8922-d736b20812ed None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:24.094939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312b53b-daa4-4f76-8922-d736b20812ed None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:24.095368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312b53b-daa4-4f76-8922-d736b20812ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:24.143752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a312b53b-daa4-4f76-8922-d736b20812ed None None] MFA Rules not processed for user `0d8442a625a7452dbacad6309a3f0ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:24.145499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a312b53b-daa4-4f76-8922-d736b20812ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:24.279285 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4035/8104] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:20:24.281467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd42c4-8320-4ee0-af50-040161bc1bf2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:24.383453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd42c4-8320-4ee0-af50-040161bc1bf2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:24.391190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defe65e-f24a-44b2-ac13-333dd77a404a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:24.391825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defe65e-f24a-44b2-ac13-333dd77a404a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:24.392258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defe65e-f24a-44b2-ac13-333dd77a404a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:24.393199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defe65e-f24a-44b2-ac13-333dd77a404a admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:24.393851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8defe65e-f24a-44b2-ac13-333dd77a404a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:24.396827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8defe65e-f24a-44b2-ac13-333dd77a404a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:24.434814 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4070/8105] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:20:24 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:24.438849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312b53b-daa4-4f76-8922-d736b20812ed None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:24.455058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312b53b-daa4-4f76-8922-d736b20812ed None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:24.526352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97c5c5-6e54-4e38-a95d-03ddd051d5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:24.526996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97c5c5-6e54-4e38-a95d-03ddd051d5bf admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:24.527279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97c5c5-6e54-4e38-a95d-03ddd051d5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:24.527631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97c5c5-6e54-4e38-a95d-03ddd051d5bf admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:24.528370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97c5c5-6e54-4e38-a95d-03ddd051d5bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:24.530658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97c5c5-6e54-4e38-a95d-03ddd051d5bf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:24.563335 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4036/8106] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:20:24 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:24.564571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defe65e-f24a-44b2-ac13-333dd77a404a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:24.575840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defe65e-f24a-44b2-ac13-333dd77a404a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:24.581515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5899a6-fbe1-45e5-82d1-898c6b8e4d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:24.582138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5899a6-fbe1-45e5-82d1-898c6b8e4d69 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:24.582418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5899a6-fbe1-45e5-82d1-898c6b8e4d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:24.582689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5899a6-fbe1-45e5-82d1-898c6b8e4d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:24.583503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5899a6-fbe1-45e5-82d1-898c6b8e4d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:24.585138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5899a6-fbe1-45e5-82d1-898c6b8e4d69 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:24.605753 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4071/8107] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:20:24.611130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97c5c5-6e54-4e38-a95d-03ddd051d5bf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:24.627012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97c5c5-6e54-4e38-a95d-03ddd051d5bf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:24.632682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac6669-2037-47ba-ac34-8ad95619e3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:24.633435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac6669-2037-47ba-ac34-8ad95619e3d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:24.633721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac6669-2037-47ba-ac34-8ad95619e3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:24.634071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac6669-2037-47ba-ac34-8ad95619e3d6 admin admin] PATH_INFO: `/v3/projects/903b79c0a9b54b008fa6e67ca452f878/users/3264006e56934970b804208a5ab5e042/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:24.657338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac6669-2037-47ba-ac34-8ad95619e3d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=903b79c0a9b54b008fa6e67ca452f878, user_id=3264006e56934970b804208a5ab5e042, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:24.662608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac6669-2037-47ba-ac34-8ad95619e3d6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:24.690335 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4037/8108] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:20:24 2022] PUT /identity/v3/projects/903b79c0a9b54b008fa6e67ca452f878/users/3264006e56934970b804208a5ab5e042/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:24.694735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5899a6-fbe1-45e5-82d1-898c6b8e4d69 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:24.707547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5899a6-fbe1-45e5-82d1-898c6b8e4d69 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:24.842955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb0872e-4dc7-41a0-b4d9-09067c80db3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:24.844645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0872e-4dc7-41a0-b4d9-09067c80db3f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:24.845166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0872e-4dc7-41a0-b4d9-09067c80db3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:24.845652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0872e-4dc7-41a0-b4d9-09067c80db3f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:24.847311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb0872e-4dc7-41a0-b4d9-09067c80db3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:24.849266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb0872e-4dc7-41a0-b4d9-09067c80db3f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:24.869142 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4072/8109] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:20:24.869540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac6669-2037-47ba-ac34-8ad95619e3d6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:24.884360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac6669-2037-47ba-ac34-8ad95619e3d6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:24.896707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e17ae-9e84-4168-a27b-ce046d21aa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:24.897398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e17ae-9e84-4168-a27b-ce046d21aa2d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:24.897679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e17ae-9e84-4168-a27b-ce046d21aa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:24.897955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e17ae-9e84-4168-a27b-ce046d21aa2d admin admin] PATH_INFO: `/v3/projects/903b79c0a9b54b008fa6e67ca452f878/users/3264006e56934970b804208a5ab5e042/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:24.903257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e17ae-9e84-4168-a27b-ce046d21aa2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=903b79c0a9b54b008fa6e67ca452f878, user_id=3264006e56934970b804208a5ab5e042, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:24.920991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e17ae-9e84-4168-a27b-ce046d21aa2d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:24.958037 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4038/8110] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:20:24 2022] PUT /identity/v3/projects/903b79c0a9b54b008fa6e67ca452f878/users/3264006e56934970b804208a5ab5e042/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:24.971502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587e073-a50f-40bb-af08-dbb916de8579 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:24.972052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587e073-a50f-40bb-af08-dbb916de8579 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:24.972486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587e073-a50f-40bb-af08-dbb916de8579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:25.029678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0587e073-a50f-40bb-af08-dbb916de8579 None None] MFA Rules not processed for user `3264006e56934970b804208a5ab5e042`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:25.031062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0587e073-a50f-40bb-af08-dbb916de8579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:25.071053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e17ae-9e84-4168-a27b-ce046d21aa2d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:25.074072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f33e17ae-9e84-4168-a27b-ce046d21aa2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:25.083319 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:25.198616 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:25.218671 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4073/8111] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:25.234794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587e073-a50f-40bb-af08-dbb916de8579 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:25.237199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0587e073-a50f-40bb-af08-dbb916de8579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:25.245009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e17ae-9e84-4168-a27b-ce046d21aa2d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:25.251616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b824e30-6a10-4cbe-8ab2-cf754661e18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:25.252860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b824e30-6a10-4cbe-8ab2-cf754661e18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:25.253228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b824e30-6a10-4cbe-8ab2-cf754661e18e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:25.253492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b824e30-6a10-4cbe-8ab2-cf754661e18e admin admin] PATH_INFO: `/v3/users/26573c021b9f4c6ea54ee87dc4f38f68` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:25.255121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b824e30-6a10-4cbe-8ab2-cf754661e18e admin admin] RBAC: Authorizing `identity:delete_user(user_id=26573c021b9f4c6ea54ee87dc4f38f68)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:25.258000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b824e30-6a10-4cbe-8ab2-cf754661e18e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:25.374392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b824e30-6a10-4cbe-8ab2-cf754661e18e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26573c021b9f4c6ea54ee87dc4f38f68'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:25.400450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b824e30-6a10-4cbe-8ab2-cf754661e18e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26573c021b9f4c6ea54ee87dc4f38f68'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:25.401206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b824e30-6a10-4cbe-8ab2-cf754661e18e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26573c021b9f4c6ea54ee87dc4f38f68'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:25.405545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587e073-a50f-40bb-af08-dbb916de8579 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:25.413654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c2359-6de9-4600-bc24-209c76d2cb3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:25.414470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c2359-6de9-4600-bc24-209c76d2cb3a service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:25.414774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c2359-6de9-4600-bc24-209c76d2cb3a service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:25.415077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c2359-6de9-4600-bc24-209c76d2cb3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:25.429191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b824e30-6a10-4cbe-8ab2-cf754661e18e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26573c021b9f4c6ea54ee87dc4f38f68'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:25.429751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c2359-6de9-4600-bc24-209c76d2cb3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:25.431778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c2359-6de9-4600-bc24-209c76d2cb3a service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:25.453095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b824e30-6a10-4cbe-8ab2-cf754661e18e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26573c021b9f4c6ea54ee87dc4f38f68'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:25.464340 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4039/8112] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:20:25 2022] DELETE /identity/v3/users/26573c021b9f4c6ea54ee87dc4f38f68 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:25.469130 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4074/8113] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:20:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:20:25.471580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80e9f9-d23c-4574-b453-85924ebe9f29 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:25.471580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80e9f9-d23c-4574-b453-85924ebe9f29 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:25.471580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80e9f9-d23c-4574-b453-85924ebe9f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:25.515511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-af80e9f9-d23c-4574-b453-85924ebe9f29 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:25.517163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-af80e9f9-d23c-4574-b453-85924ebe9f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:25.657702 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4040/8114] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:20:25.669220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c2359-6de9-4600-bc24-209c76d2cb3a service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:25.672916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ff5c2359-6de9-4600-bc24-209c76d2cb3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:25.808376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c2359-6de9-4600-bc24-209c76d2cb3a service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:25.891894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acedea4-66ed-46e1-a2fb-8299548f84c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:25.892618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acedea4-66ed-46e1-a2fb-8299548f84c6 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:25.892830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acedea4-66ed-46e1-a2fb-8299548f84c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:25.893103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acedea4-66ed-46e1-a2fb-8299548f84c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:25.903795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acedea4-66ed-46e1-a2fb-8299548f84c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:25.905589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acedea4-66ed-46e1-a2fb-8299548f84c6 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:25.921477 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4075/8115] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:20:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:20:26.226571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80e9f9-d23c-4574-b453-85924ebe9f29 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:26.228162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-af80e9f9-d23c-4574-b453-85924ebe9f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:26.250439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80e9f9-d23c-4574-b453-85924ebe9f29 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:26.283934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9c35f-d6a4-4326-b670-f77e9c2b3fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:26.284734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9c35f-d6a4-4326-b670-f77e9c2b3fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:26.286283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9c35f-d6a4-4326-b670-f77e9c2b3fad admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:26.286573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9c35f-d6a4-4326-b670-f77e9c2b3fad admin admin] PATH_INFO: `/v3/projects/7e5064adf8794d6795b456fa4811c7fd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:26.290495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9c35f-d6a4-4326-b670-f77e9c2b3fad admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e5064adf8794d6795b456fa4811c7fd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:26.293577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9c35f-d6a4-4326-b670-f77e9c2b3fad admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:26.345123 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:26.423882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b1e9c35f-d6a4-4326-b670-f77e9c2b3fad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e5064adf8794d6795b456fa4811c7fd', 'request_id': 'req-b1e9c35f-d6a4-4326-b670-f77e9c2b3fad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:26.424223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acedea4-66ed-46e1-a2fb-8299548f84c6 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:26.425754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0acedea4-66ed-46e1-a2fb-8299548f84c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:26.442119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b1e9c35f-d6a4-4326-b670-f77e9c2b3fad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e5064adf8794d6795b456fa4811c7fd', 'request_id': 'req-b1e9c35f-d6a4-4326-b670-f77e9c2b3fad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:26.452759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b1e9c35f-d6a4-4326-b670-f77e9c2b3fad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e5064adf8794d6795b456fa4811c7fd', 'request_id': 'req-b1e9c35f-d6a4-4326-b670-f77e9c2b3fad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:26.488839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b1e9c35f-d6a4-4326-b670-f77e9c2b3fad admin admin] The token cache is being invalidate because project 7e5064adf8794d6795b456fa4811c7fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:20:26.489102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b1e9c35f-d6a4-4326-b670-f77e9c2b3fad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:26.492357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b1e9c35f-d6a4-4326-b670-f77e9c2b3fad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:26.496341 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4041/8116] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:20:26 2022] DELETE /identity/v3/projects/7e5064adf8794d6795b456fa4811c7fd => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:26.501921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248308a0-29a4-40cc-bc08-dee901ef97fc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:26.502395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248308a0-29a4-40cc-bc08-dee901ef97fc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:26.502819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248308a0-29a4-40cc-bc08-dee901ef97fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:26.508796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acedea4-66ed-46e1-a2fb-8299548f84c6 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:26.520150 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:26.526955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-248308a0-29a4-40cc-bc08-dee901ef97fc None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:26.528458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-248308a0-29a4-40cc-bc08-dee901ef97fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:26.578500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17209cb7-5f70-42eb-ac96-bddd14ebb087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:26.579339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17209cb7-5f70-42eb-ac96-bddd14ebb087 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:26.579477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17209cb7-5f70-42eb-ac96-bddd14ebb087 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:26.579741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17209cb7-5f70-42eb-ac96-bddd14ebb087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:26.581594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-17209cb7-5f70-42eb-ac96-bddd14ebb087 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:26.645670 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4042/8117] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:26.653897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd427a7-7343-4f53-9f5f-26cac983b8b3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:26.654190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd427a7-7343-4f53-9f5f-26cac983b8b3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:26.654540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd427a7-7343-4f53-9f5f-26cac983b8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:26.686530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6fd427a7-7343-4f53-9f5f-26cac983b8b3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:26.688221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6fd427a7-7343-4f53-9f5f-26cac983b8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:26.703699 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4043/8118] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:20:26.705003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd427a7-7343-4f53-9f5f-26cac983b8b3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:26.713342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17209cb7-5f70-42eb-ac96-bddd14ebb087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:26.714901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17209cb7-5f70-42eb-ac96-bddd14ebb087 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:26.722544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd427a7-7343-4f53-9f5f-26cac983b8b3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:26.732457 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4076/8119] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:20:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:20:26.733532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d897ef-78d2-42ce-be9d-f26654d70b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:26.734877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d897ef-78d2-42ce-be9d-f26654d70b7c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:26.735311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d897ef-78d2-42ce-be9d-f26654d70b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:26.735735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d897ef-78d2-42ce-be9d-f26654d70b7c admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:26.736617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d897ef-78d2-42ce-be9d-f26654d70b7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:20:26.737073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d897ef-78d2-42ce-be9d-f26654d70b7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:26.739494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d897ef-78d2-42ce-be9d-f26654d70b7c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:26.771337 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4044/8120] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:20:26.773151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17209cb7-5f70-42eb-ac96-bddd14ebb087 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:26.786729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17209cb7-5f70-42eb-ac96-bddd14ebb087 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:26.793394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c4142-af28-4eae-9042-61c7b49dbf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:26.794238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c4142-af28-4eae-9042-61c7b49dbf0c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:26.794526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c4142-af28-4eae-9042-61c7b49dbf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:26.794796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c4142-af28-4eae-9042-61c7b49dbf0c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:26.796009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c4142-af28-4eae-9042-61c7b49dbf0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:26.798186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c4142-af28-4eae-9042-61c7b49dbf0c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:26.833766 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4077/8121] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:20:26 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:26.837440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d897ef-78d2-42ce-be9d-f26654d70b7c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:26.853475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d897ef-78d2-42ce-be9d-f26654d70b7c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:26.947290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ebcc2-7337-47e5-917d-c5bb9760cb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:26.947931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ebcc2-7337-47e5-917d-c5bb9760cb3b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:26.948288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ebcc2-7337-47e5-917d-c5bb9760cb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:26.948564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ebcc2-7337-47e5-917d-c5bb9760cb3b admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:26.949438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ebcc2-7337-47e5-917d-c5bb9760cb3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:26.952839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ebcc2-7337-47e5-917d-c5bb9760cb3b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:26.985404 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4045/8122] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:20:26 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:26.989706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c4142-af28-4eae-9042-61c7b49dbf0c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:27.004936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c4142-af28-4eae-9042-61c7b49dbf0c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:27.011004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b4a3b-f99e-4f7a-88ae-d4e3b5300a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:27.012239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b4a3b-f99e-4f7a-88ae-d4e3b5300a65 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:27.012815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b4a3b-f99e-4f7a-88ae-d4e3b5300a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:27.013322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b4a3b-f99e-4f7a-88ae-d4e3b5300a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:27.014973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b4a3b-f99e-4f7a-88ae-d4e3b5300a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:27.017809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b4a3b-f99e-4f7a-88ae-d4e3b5300a65 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:27.034876 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4078/8123] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:20:27.038522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ebcc2-7337-47e5-917d-c5bb9760cb3b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:27.050228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ebcc2-7337-47e5-917d-c5bb9760cb3b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:27.056033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20c716-55f3-4990-9fd2-31021c7c96e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:27.056794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20c716-55f3-4990-9fd2-31021c7c96e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:27.057130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20c716-55f3-4990-9fd2-31021c7c96e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:27.057442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20c716-55f3-4990-9fd2-31021c7c96e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:27.058087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20c716-55f3-4990-9fd2-31021c7c96e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:27.060018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20c716-55f3-4990-9fd2-31021c7c96e2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:27.076542 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4046/8124] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:20:27.080303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b4a3b-f99e-4f7a-88ae-d4e3b5300a65 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:27.092427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b4a3b-f99e-4f7a-88ae-d4e3b5300a65 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:27.116163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d30d7-5664-4ee0-a117-fc86635186fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:27.117287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d30d7-5664-4ee0-a117-fc86635186fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:27.117767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d30d7-5664-4ee0-a117-fc86635186fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:27.118222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d30d7-5664-4ee0-a117-fc86635186fe admin admin] PATH_INFO: `/v3/projects/f2ee78188cec44e7a00822f4771ce020/users/fb9dee808083429a999cadea57b31908/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:27.146925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d30d7-5664-4ee0-a117-fc86635186fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ee78188cec44e7a00822f4771ce020, user_id=fb9dee808083429a999cadea57b31908, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:27.150480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d30d7-5664-4ee0-a117-fc86635186fe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:27.175524 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4079/8125] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:20:27 2022] PUT /identity/v3/projects/f2ee78188cec44e7a00822f4771ce020/users/fb9dee808083429a999cadea57b31908/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:27.187652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a2cf2-3871-4930-8f8e-09b0693b502f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:27.187994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a2cf2-3871-4930-8f8e-09b0693b502f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:27.188202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a2cf2-3871-4930-8f8e-09b0693b502f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:27.200968 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:27.253400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1a0a2cf2-3871-4930-8f8e-09b0693b502f None None] MFA Rules not processed for user `fb9dee808083429a999cadea57b31908`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:27.254853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1a0a2cf2-3871-4930-8f8e-09b0693b502f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:27.418281 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4047/8126] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:27.419559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d30d7-5664-4ee0-a117-fc86635186fe admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:27.552314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d30d7-5664-4ee0-a117-fc86635186fe admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:27.560062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485fd23-4065-435a-b425-4174fd53ab80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:27.561462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485fd23-4065-435a-b425-4174fd53ab80 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:27.562297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485fd23-4065-435a-b425-4174fd53ab80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:27.562578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485fd23-4065-435a-b425-4174fd53ab80 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:27.563590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485fd23-4065-435a-b425-4174fd53ab80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:27.567696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485fd23-4065-435a-b425-4174fd53ab80 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:27.612225 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:27.643094 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4080/8127] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:20:27 2022] POST /identity/v3/projects => generated 373 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:27.644665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a2cf2-3871-4930-8f8e-09b0693b502f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:27.661414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a2cf2-3871-4930-8f8e-09b0693b502f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:27.738633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f997b0-3b06-41bf-be4a-d0858ef320c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:27.739784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f997b0-3b06-41bf-be4a-d0858ef320c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:27.740127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f997b0-3b06-41bf-be4a-d0858ef320c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:27.740628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f997b0-3b06-41bf-be4a-d0858ef320c1 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:27.741339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f997b0-3b06-41bf-be4a-d0858ef320c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:27.743672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f997b0-3b06-41bf-be4a-d0858ef320c1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:27.780649 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4048/8128] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:20:27 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:27.783749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485fd23-4065-435a-b425-4174fd53ab80 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:27.796733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485fd23-4065-435a-b425-4174fd53ab80 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:27.804661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d3b07-0231-4b01-85a9-2d36729986b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:27.805356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d3b07-0231-4b01-85a9-2d36729986b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:27.805645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d3b07-0231-4b01-85a9-2d36729986b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:27.805917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d3b07-0231-4b01-85a9-2d36729986b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:27.806580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d3b07-0231-4b01-85a9-2d36729986b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:27.808671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d3b07-0231-4b01-85a9-2d36729986b2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:27.832929 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4081/8129] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:20:27.834695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f997b0-3b06-41bf-be4a-d0858ef320c1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:27.846935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f997b0-3b06-41bf-be4a-d0858ef320c1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:27.859077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424689f0-9223-498f-8f6a-85a5dd743a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:27.859860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424689f0-9223-498f-8f6a-85a5dd743a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:27.860232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424689f0-9223-498f-8f6a-85a5dd743a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:27.860561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424689f0-9223-498f-8f6a-85a5dd743a22 admin admin] PATH_INFO: `/v3/projects/411dc3434f1a4514a4856986eb8826d1/users/831d3697224b4a2f80df344aba1fad54/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:27.890762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424689f0-9223-498f-8f6a-85a5dd743a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=411dc3434f1a4514a4856986eb8826d1, user_id=831d3697224b4a2f80df344aba1fad54, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:27.894009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424689f0-9223-498f-8f6a-85a5dd743a22 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:27.939492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d3b07-0231-4b01-85a9-2d36729986b2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:27.939930 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4049/8130] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:20:27 2022] PUT /identity/v3/projects/411dc3434f1a4514a4856986eb8826d1/users/831d3697224b4a2f80df344aba1fad54/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:27.953654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d3b07-0231-4b01-85a9-2d36729986b2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:28.086101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c340b-3745-4dfb-91a8-11ef3cf909cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:28.087057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c340b-3745-4dfb-91a8-11ef3cf909cb admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:28.087359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c340b-3745-4dfb-91a8-11ef3cf909cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:28.087637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c340b-3745-4dfb-91a8-11ef3cf909cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:28.088394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c340b-3745-4dfb-91a8-11ef3cf909cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:28.090942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c340b-3745-4dfb-91a8-11ef3cf909cb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:28.113713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424689f0-9223-498f-8f6a-85a5dd743a22 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:28.122247 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4082/8131] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:20:28.129692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424689f0-9223-498f-8f6a-85a5dd743a22 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:28.148159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae57494-aa2f-4c60-9264-23f89d156f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:28.148890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae57494-aa2f-4c60-9264-23f89d156f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:28.149170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae57494-aa2f-4c60-9264-23f89d156f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:28.149444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae57494-aa2f-4c60-9264-23f89d156f5a admin admin] PATH_INFO: `/v3/projects/411dc3434f1a4514a4856986eb8826d1/users/831d3697224b4a2f80df344aba1fad54/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:28.154234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae57494-aa2f-4c60-9264-23f89d156f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=411dc3434f1a4514a4856986eb8826d1, user_id=831d3697224b4a2f80df344aba1fad54, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:28.161425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae57494-aa2f-4c60-9264-23f89d156f5a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:28.178539 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4050/8132] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:20:28 2022] PUT /identity/v3/projects/411dc3434f1a4514a4856986eb8826d1/users/831d3697224b4a2f80df344aba1fad54/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:28.190661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b52acd-e4e7-48e7-a8e2-141296af7ca1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:28.190952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b52acd-e4e7-48e7-a8e2-141296af7ca1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:28.191235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b52acd-e4e7-48e7-a8e2-141296af7ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:28.258324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b9b52acd-e4e7-48e7-a8e2-141296af7ca1 None None] MFA Rules not processed for user `831d3697224b4a2f80df344aba1fad54`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:28.261170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b9b52acd-e4e7-48e7-a8e2-141296af7ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:28.528034 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4083/8133] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:28.535918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae57494-aa2f-4c60-9264-23f89d156f5a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:28.537841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bae57494-aa2f-4c60-9264-23f89d156f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:28.650834 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:28.702237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae57494-aa2f-4c60-9264-23f89d156f5a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:28.713328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a04ee-48bf-444d-a9ff-76951158c55d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:28.714080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a04ee-48bf-444d-a9ff-76951158c55d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:28.714424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a04ee-48bf-444d-a9ff-76951158c55d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:28.714855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a04ee-48bf-444d-a9ff-76951158c55d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:28.805899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a04ee-48bf-444d-a9ff-76951158c55d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:28.808020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a04ee-48bf-444d-a9ff-76951158c55d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:28.820541 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4051/8134] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:20:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:20:29.029087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b52acd-e4e7-48e7-a8e2-141296af7ca1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:29.031704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b9b52acd-e4e7-48e7-a8e2-141296af7ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:29.109438 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:29.128730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b52acd-e4e7-48e7-a8e2-141296af7ca1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:29.133240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52aeb7e-ef7f-46a1-a701-2b0654e26742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:29.133869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52aeb7e-ef7f-46a1-a701-2b0654e26742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:29.134144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52aeb7e-ef7f-46a1-a701-2b0654e26742 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:29.134417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52aeb7e-ef7f-46a1-a701-2b0654e26742 admin admin] PATH_INFO: `/v3/users/7f7029459a0b46f2b13636766a8d052a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:29.135640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52aeb7e-ef7f-46a1-a701-2b0654e26742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f7029459a0b46f2b13636766a8d052a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:29.139343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52aeb7e-ef7f-46a1-a701-2b0654e26742 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:29.208568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a52aeb7e-ef7f-46a1-a701-2b0654e26742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f7029459a0b46f2b13636766a8d052a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:29.209464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a52aeb7e-ef7f-46a1-a701-2b0654e26742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f7029459a0b46f2b13636766a8d052a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:29.219094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a52aeb7e-ef7f-46a1-a701-2b0654e26742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f7029459a0b46f2b13636766a8d052a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:29.234684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a52aeb7e-ef7f-46a1-a701-2b0654e26742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f7029459a0b46f2b13636766a8d052a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:29.243082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a52aeb7e-ef7f-46a1-a701-2b0654e26742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f7029459a0b46f2b13636766a8d052a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:29.250839 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4084/8135] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:20:29 2022] DELETE /identity/v3/users/7f7029459a0b46f2b13636766a8d052a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:29.255391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77266783-e002-4726-9d73-e773c39a33f5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:29.255681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77266783-e002-4726-9d73-e773c39a33f5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:29.255957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77266783-e002-4726-9d73-e773c39a33f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:29.276954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-77266783-e002-4726-9d73-e773c39a33f5 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:29.278881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-77266783-e002-4726-9d73-e773c39a33f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:29.367373 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4052/8136] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:29.377097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52aeb7e-ef7f-46a1-a701-2b0654e26742 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:29.378601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a52aeb7e-ef7f-46a1-a701-2b0654e26742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:29.556726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52aeb7e-ef7f-46a1-a701-2b0654e26742 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:29.561212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca230c9-4ab2-4e5b-86ec-bf66a3ed14cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:29.562035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca230c9-4ab2-4e5b-86ec-bf66a3ed14cd service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:29.562376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca230c9-4ab2-4e5b-86ec-bf66a3ed14cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:29.562713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca230c9-4ab2-4e5b-86ec-bf66a3ed14cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:29.573891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca230c9-4ab2-4e5b-86ec-bf66a3ed14cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:29.575609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca230c9-4ab2-4e5b-86ec-bf66a3ed14cd service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:29.587322 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4085/8137] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:20:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:20:29.864018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77266783-e002-4726-9d73-e773c39a33f5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:29.865519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-77266783-e002-4726-9d73-e773c39a33f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:29.901158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77266783-e002-4726-9d73-e773c39a33f5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:29.906912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525dae8-1058-4dac-8c8c-e75719b2e376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:29.907613 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525dae8-1058-4dac-8c8c-e75719b2e376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:29.907912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525dae8-1058-4dac-8c8c-e75719b2e376 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:29.908187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525dae8-1058-4dac-8c8c-e75719b2e376 admin admin] PATH_INFO: `/v3/projects/915e3350d5574d8a8db0607819f36013` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:29.909530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525dae8-1058-4dac-8c8c-e75719b2e376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=915e3350d5574d8a8db0607819f36013)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:29.911752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525dae8-1058-4dac-8c8c-e75719b2e376 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:30.021922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e525dae8-1058-4dac-8c8c-e75719b2e376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '915e3350d5574d8a8db0607819f36013', 'request_id': 'req-e525dae8-1058-4dac-8c8c-e75719b2e376'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:30.043841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e525dae8-1058-4dac-8c8c-e75719b2e376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '915e3350d5574d8a8db0607819f36013', 'request_id': 'req-e525dae8-1058-4dac-8c8c-e75719b2e376'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:30.053897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e525dae8-1058-4dac-8c8c-e75719b2e376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '915e3350d5574d8a8db0607819f36013', 'request_id': 'req-e525dae8-1058-4dac-8c8c-e75719b2e376'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:30.069299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e525dae8-1058-4dac-8c8c-e75719b2e376 admin admin] The token cache is being invalidate because project 915e3350d5574d8a8db0607819f36013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:20:30.069597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e525dae8-1058-4dac-8c8c-e75719b2e376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:30.070267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e525dae8-1058-4dac-8c8c-e75719b2e376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:30.075487 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4053/8138] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:20:29 2022] DELETE /identity/v3/projects/915e3350d5574d8a8db0607819f36013 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:30.078072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3864e-256d-4e55-ab14-fbc7b76f29b5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:30.078387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3864e-256d-4e55-ab14-fbc7b76f29b5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:30.078671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3864e-256d-4e55-ab14-fbc7b76f29b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:30.115252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-71a3864e-256d-4e55-ab14-fbc7b76f29b5 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:30.116582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-71a3864e-256d-4e55-ab14-fbc7b76f29b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:30.222705 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4086/8139] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:20:30.224456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c136a-9916-4797-b0fb-581669c4da8b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:30.225086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c136a-9916-4797-b0fb-581669c4da8b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:30.225086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c136a-9916-4797-b0fb-581669c4da8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:30.252074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a08c136a-9916-4797-b0fb-581669c4da8b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:30.254355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a08c136a-9916-4797-b0fb-581669c4da8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:30.273735 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4054/8140] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:20:30.276272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3864e-256d-4e55-ab14-fbc7b76f29b5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:30.290178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3864e-256d-4e55-ab14-fbc7b76f29b5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:30.295266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38d1b6-1875-4db7-86ba-b0350e3db582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:30.295922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38d1b6-1875-4db7-86ba-b0350e3db582 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:30.296684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38d1b6-1875-4db7-86ba-b0350e3db582 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:30.296684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38d1b6-1875-4db7-86ba-b0350e3db582 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:30.297102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38d1b6-1875-4db7-86ba-b0350e3db582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:20:30.297403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38d1b6-1875-4db7-86ba-b0350e3db582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:30.298995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38d1b6-1875-4db7-86ba-b0350e3db582 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:30.307127 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:30.319621 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4087/8141] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:20:30.320838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c136a-9916-4797-b0fb-581669c4da8b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:30.326692 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:30.333957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c136a-9916-4797-b0fb-581669c4da8b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:30.358322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fc94a-ef6b-4fc3-9318-fa1ea9ad70ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:30.359150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fc94a-ef6b-4fc3-9318-fa1ea9ad70ac admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:30.359422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fc94a-ef6b-4fc3-9318-fa1ea9ad70ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:30.359691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fc94a-ef6b-4fc3-9318-fa1ea9ad70ac admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:30.360328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fc94a-ef6b-4fc3-9318-fa1ea9ad70ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:30.362304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fc94a-ef6b-4fc3-9318-fa1ea9ad70ac admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:30.449844 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4055/8142] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:20:30 2022] POST /identity/v3/projects => generated 357 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:30.455474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38d1b6-1875-4db7-86ba-b0350e3db582 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:30.469933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38d1b6-1875-4db7-86ba-b0350e3db582 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:30.541366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67aa35-d2db-43b1-8298-522c17574b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:30.541977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67aa35-d2db-43b1-8298-522c17574b82 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:30.542256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67aa35-d2db-43b1-8298-522c17574b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:30.542528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67aa35-d2db-43b1-8298-522c17574b82 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:30.543188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67aa35-d2db-43b1-8298-522c17574b82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:30.545229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67aa35-d2db-43b1-8298-522c17574b82 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:30.568186 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4088/8143] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:20:30 2022] POST /identity/v3/users => generated 279 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:30.571958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fc94a-ef6b-4fc3-9318-fa1ea9ad70ac admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:30.583394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fc94a-ef6b-4fc3-9318-fa1ea9ad70ac admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:30.587988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bfb57-4249-41fe-8dfd-b3750a4e1c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:30.588585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bfb57-4249-41fe-8dfd-b3750a4e1c0a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:30.588907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bfb57-4249-41fe-8dfd-b3750a4e1c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:30.589175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bfb57-4249-41fe-8dfd-b3750a4e1c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:30.589810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bfb57-4249-41fe-8dfd-b3750a4e1c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:30.591365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bfb57-4249-41fe-8dfd-b3750a4e1c0a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:30.602257 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4056/8144] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:20:30.606207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67aa35-d2db-43b1-8298-522c17574b82 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:30.617425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67aa35-d2db-43b1-8298-522c17574b82 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:30.622888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1af63-27ff-425b-bdcd-275b1f478fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:30.623663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1af63-27ff-425b-bdcd-275b1f478fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:30.623948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1af63-27ff-425b-bdcd-275b1f478fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:30.624228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1af63-27ff-425b-bdcd-275b1f478fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:30.624983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1af63-27ff-425b-bdcd-275b1f478fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:30.626785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1af63-27ff-425b-bdcd-275b1f478fb6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:30.640469 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4089/8145] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:20:30.644714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bfb57-4249-41fe-8dfd-b3750a4e1c0a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:30.657037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bfb57-4249-41fe-8dfd-b3750a4e1c0a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:30.661833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548f5be-539c-4ba5-bada-88034c2622d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:30.662506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548f5be-539c-4ba5-bada-88034c2622d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:30.662783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548f5be-539c-4ba5-bada-88034c2622d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:30.663054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548f5be-539c-4ba5-bada-88034c2622d9 admin admin] PATH_INFO: `/v3/projects/7243139ae23b4639aea75bd8c26116c4/users/ea643b6aa318485bb9d5a92f2f3c5f03/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:30.683987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548f5be-539c-4ba5-bada-88034c2622d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7243139ae23b4639aea75bd8c26116c4, user_id=ea643b6aa318485bb9d5a92f2f3c5f03, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:30.687994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548f5be-539c-4ba5-bada-88034c2622d9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:30.711096 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4057/8146] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:20:30 2022] PUT /identity/v3/projects/7243139ae23b4639aea75bd8c26116c4/users/ea643b6aa318485bb9d5a92f2f3c5f03/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:30.714778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c61cd1-3daa-448b-9d4f-f41599031b58 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:30.715065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c61cd1-3daa-448b-9d4f-f41599031b58 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:30.715346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c61cd1-3daa-448b-9d4f-f41599031b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:30.749583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-56c61cd1-3daa-448b-9d4f-f41599031b58 None None] MFA Rules not processed for user `ea643b6aa318485bb9d5a92f2f3c5f03`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:30.750796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-56c61cd1-3daa-448b-9d4f-f41599031b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:30.849450 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4090/8147] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:30.863859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548f5be-539c-4ba5-bada-88034c2622d9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:30.866013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d548f5be-539c-4ba5-bada-88034c2622d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:30.944614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548f5be-539c-4ba5-bada-88034c2622d9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:30.948534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f572150-33a1-4dfe-af70-ee0b0bb51f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:30.949382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f572150-33a1-4dfe-af70-ee0b0bb51f34 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:30.949801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f572150-33a1-4dfe-af70-ee0b0bb51f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:30.950394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f572150-33a1-4dfe-af70-ee0b0bb51f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:30.960235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f572150-33a1-4dfe-af70-ee0b0bb51f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:30.961809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f572150-33a1-4dfe-af70-ee0b0bb51f34 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:30.972272 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4058/8148] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:20:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:20:31.375044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c61cd1-3daa-448b-9d4f-f41599031b58 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:31.393817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c61cd1-3daa-448b-9d4f-f41599031b58 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:31.409401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70286595-8fe1-482a-b541-181a7167745b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:31.410754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70286595-8fe1-482a-b541-181a7167745b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:31.411051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70286595-8fe1-482a-b541-181a7167745b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:31.411780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70286595-8fe1-482a-b541-181a7167745b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:31.414098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-70286595-8fe1-482a-b541-181a7167745b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:31.597298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70286595-8fe1-482a-b541-181a7167745b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:31.598695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70286595-8fe1-482a-b541-181a7167745b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:31.606402 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:31.619836 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4091/8149] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:20:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:20:32.228263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f572150-33a1-4dfe-af70-ee0b0bb51f34 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:32.229892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3f572150-33a1-4dfe-af70-ee0b0bb51f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:32.406171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f572150-33a1-4dfe-af70-ee0b0bb51f34 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:32.425042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d5104-7d5c-4af9-bb1d-24426157408f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:32.425711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d5104-7d5c-4af9-bb1d-24426157408f service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:32.426057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d5104-7d5c-4af9-bb1d-24426157408f service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:32.426318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d5104-7d5c-4af9-bb1d-24426157408f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:32.436111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5d7d5104-7d5c-4af9-bb1d-24426157408f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:32.570465 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:32.594473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d5104-7d5c-4af9-bb1d-24426157408f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:32.596589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d5104-7d5c-4af9-bb1d-24426157408f service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:32.616950 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4059/8150] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:20:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:20:36.299807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70286595-8fe1-482a-b541-181a7167745b service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:36.302624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-70286595-8fe1-482a-b541-181a7167745b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:36.540295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70286595-8fe1-482a-b541-181a7167745b service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:36.547007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e855d-3d99-48b2-aeb8-1042d5f79e05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:36.547804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e855d-3d99-48b2-aeb8-1042d5f79e05 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:36.548094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e855d-3d99-48b2-aeb8-1042d5f79e05 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:36.548473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e855d-3d99-48b2-aeb8-1042d5f79e05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:36.552284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-117e855d-3d99-48b2-aeb8-1042d5f79e05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:36.746130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e855d-3d99-48b2-aeb8-1042d5f79e05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:36.749839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e855d-3d99-48b2-aeb8-1042d5f79e05 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:36.791757 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4092/8151] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:20:36 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:20:42.330599 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe16a5c-36f8-4cc5-9bb5-1c33e130a00f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:42.331579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe16a5c-36f8-4cc5-9bb5-1c33e130a00f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:42.332693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe16a5c-36f8-4cc5-9bb5-1c33e130a00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:42.365078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dbe16a5c-36f8-4cc5-9bb5-1c33e130a00f None None] MFA Rules not processed for user `fb9dee808083429a999cadea57b31908`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:42.370650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dbe16a5c-36f8-4cc5-9bb5-1c33e130a00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:42.533320 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4060/8152] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:45.204334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e855d-3d99-48b2-aeb8-1042d5f79e05 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:45.207167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-117e855d-3d99-48b2-aeb8-1042d5f79e05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:45.374604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e855d-3d99-48b2-aeb8-1042d5f79e05 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:45.409720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a093d81-86c1-40d3-9c98-ebc9fcc15f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:45.413472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a093d81-86c1-40d3-9c98-ebc9fcc15f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:45.415899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a093d81-86c1-40d3-9c98-ebc9fcc15f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:45.416412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a093d81-86c1-40d3-9c98-ebc9fcc15f3b admin admin] PATH_INFO: `/v3/users/77fe33f2ff1e4c2d87d690228343a4f6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:45.423557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a093d81-86c1-40d3-9c98-ebc9fcc15f3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=77fe33f2ff1e4c2d87d690228343a4f6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:45.427394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a093d81-86c1-40d3-9c98-ebc9fcc15f3b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:45.521769 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:45.539378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a093d81-86c1-40d3-9c98-ebc9fcc15f3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77fe33f2ff1e4c2d87d690228343a4f6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:45.540151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a093d81-86c1-40d3-9c98-ebc9fcc15f3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77fe33f2ff1e4c2d87d690228343a4f6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:45.558522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a093d81-86c1-40d3-9c98-ebc9fcc15f3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77fe33f2ff1e4c2d87d690228343a4f6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:45.584808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a093d81-86c1-40d3-9c98-ebc9fcc15f3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77fe33f2ff1e4c2d87d690228343a4f6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:45.603045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a093d81-86c1-40d3-9c98-ebc9fcc15f3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77fe33f2ff1e4c2d87d690228343a4f6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:45.612808 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4093/8153] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:20:45 2022] DELETE /identity/v3/users/77fe33f2ff1e4c2d87d690228343a4f6 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:45.614853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf14e5-f355-4715-9f5d-c7c20905cc50 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:45.615668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf14e5-f355-4715-9f5d-c7c20905cc50 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:45.616088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf14e5-f355-4715-9f5d-c7c20905cc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:45.641543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-88cf14e5-f355-4715-9f5d-c7c20905cc50 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:45.643163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-88cf14e5-f355-4715-9f5d-c7c20905cc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:45.811339 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4061/8154] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:45.842030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a093d81-86c1-40d3-9c98-ebc9fcc15f3b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:45.843463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3a093d81-86c1-40d3-9c98-ebc9fcc15f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:45.946364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a093d81-86c1-40d3-9c98-ebc9fcc15f3b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:45.957457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8f6b4-fc19-43ea-8027-e31b590b24f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:45.958955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8f6b4-fc19-43ea-8027-e31b590b24f5 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:45.964407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8f6b4-fc19-43ea-8027-e31b590b24f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:45.964992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8f6b4-fc19-43ea-8027-e31b590b24f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:45.975969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf14e5-f355-4715-9f5d-c7c20905cc50 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:45.977659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-88cf14e5-f355-4715-9f5d-c7c20905cc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:45.999079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8f6b4-fc19-43ea-8027-e31b590b24f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:46.002070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8f6b4-fc19-43ea-8027-e31b590b24f5 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:46.017769 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4094/8155] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:20:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:20:46.131797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf14e5-f355-4715-9f5d-c7c20905cc50 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:46.138647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c045135-a992-4813-832a-fe6514142449 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:46.139510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c045135-a992-4813-832a-fe6514142449 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:46.139949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c045135-a992-4813-832a-fe6514142449 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:46.140383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c045135-a992-4813-832a-fe6514142449 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:46.142806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2c045135-a992-4813-832a-fe6514142449 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:46.162681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c045135-a992-4813-832a-fe6514142449 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:46.164359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c045135-a992-4813-832a-fe6514142449 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:46.182525 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4062/8156] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:20:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:20:46.571179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8f6b4-fc19-43ea-8027-e31b590b24f5 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:46.572873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e7d8f6b4-fc19-43ea-8027-e31b590b24f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:46.610029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8f6b4-fc19-43ea-8027-e31b590b24f5 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:46.619445 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd3164-2eb2-4143-843b-9641b6efbc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:46.620550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd3164-2eb2-4143-843b-9641b6efbc8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:46.621039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd3164-2eb2-4143-843b-9641b6efbc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:46.621467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd3164-2eb2-4143-843b-9641b6efbc8e admin admin] PATH_INFO: `/v3/projects/e31aad344ee24846af72019d0a22b835` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:46.622830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd3164-2eb2-4143-843b-9641b6efbc8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e31aad344ee24846af72019d0a22b835)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:46.624905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd3164-2eb2-4143-843b-9641b6efbc8e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:46.746212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11cd3164-2eb2-4143-843b-9641b6efbc8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e31aad344ee24846af72019d0a22b835', 'request_id': 'req-11cd3164-2eb2-4143-843b-9641b6efbc8e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:46.757805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11cd3164-2eb2-4143-843b-9641b6efbc8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e31aad344ee24846af72019d0a22b835', 'request_id': 'req-11cd3164-2eb2-4143-843b-9641b6efbc8e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:46.768872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11cd3164-2eb2-4143-843b-9641b6efbc8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e31aad344ee24846af72019d0a22b835', 'request_id': 'req-11cd3164-2eb2-4143-843b-9641b6efbc8e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:46.789385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11cd3164-2eb2-4143-843b-9641b6efbc8e admin admin] The token cache is being invalidate because project e31aad344ee24846af72019d0a22b835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:20:46.789385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11cd3164-2eb2-4143-843b-9641b6efbc8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:46.790054 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-11cd3164-2eb2-4143-843b-9641b6efbc8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:46.791875 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4095/8157] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:20:46 2022] DELETE /identity/v3/projects/e31aad344ee24846af72019d0a22b835 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:46.796584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c045135-a992-4813-832a-fe6514142449 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:46.823604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c045135-a992-4813-832a-fe6514142449 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:46.844695 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:46.980675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bd418-6759-42b1-b1cd-3dd296d9ef30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:46.981484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bd418-6759-42b1-b1cd-3dd296d9ef30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:46.983636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bd418-6759-42b1-b1cd-3dd296d9ef30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:46.983902 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bd418-6759-42b1-b1cd-3dd296d9ef30 admin admin] PATH_INFO: `/v3/users/0d8442a625a7452dbacad6309a3f0ca4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:46.991289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bd418-6759-42b1-b1cd-3dd296d9ef30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d8442a625a7452dbacad6309a3f0ca4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:46.994335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bd418-6759-42b1-b1cd-3dd296d9ef30 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:47.097082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af5bd418-6759-42b1-b1cd-3dd296d9ef30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d8442a625a7452dbacad6309a3f0ca4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:47.111623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af5bd418-6759-42b1-b1cd-3dd296d9ef30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d8442a625a7452dbacad6309a3f0ca4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:47.112283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af5bd418-6759-42b1-b1cd-3dd296d9ef30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d8442a625a7452dbacad6309a3f0ca4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:47.135267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af5bd418-6759-42b1-b1cd-3dd296d9ef30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d8442a625a7452dbacad6309a3f0ca4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:47.150208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af5bd418-6759-42b1-b1cd-3dd296d9ef30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d8442a625a7452dbacad6309a3f0ca4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:47.175166 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4063/8158] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:20:46 2022] DELETE /identity/v3/users/0d8442a625a7452dbacad6309a3f0ca4 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:47.992543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd3164-2eb2-4143-843b-9641b6efbc8e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:47.994139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-11cd3164-2eb2-4143-843b-9641b6efbc8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:48.015164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd3164-2eb2-4143-843b-9641b6efbc8e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:48.087129 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:48.114989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fea8c-3c72-40df-9adc-98a5ea12f8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:48.116448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fea8c-3c72-40df-9adc-98a5ea12f8ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:48.116590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fea8c-3c72-40df-9adc-98a5ea12f8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:48.116978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fea8c-3c72-40df-9adc-98a5ea12f8ab admin admin] PATH_INFO: `/v3/projects/367208930d334b5aaaa5ec5afd47091b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:48.123730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202fea8c-3c72-40df-9adc-98a5ea12f8ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=367208930d334b5aaaa5ec5afd47091b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:48.126756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202fea8c-3c72-40df-9adc-98a5ea12f8ab admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:48.222557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-202fea8c-3c72-40df-9adc-98a5ea12f8ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '367208930d334b5aaaa5ec5afd47091b', 'request_id': 'req-202fea8c-3c72-40df-9adc-98a5ea12f8ab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:48.230652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-202fea8c-3c72-40df-9adc-98a5ea12f8ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '367208930d334b5aaaa5ec5afd47091b', 'request_id': 'req-202fea8c-3c72-40df-9adc-98a5ea12f8ab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:48.238232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-202fea8c-3c72-40df-9adc-98a5ea12f8ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '367208930d334b5aaaa5ec5afd47091b', 'request_id': 'req-202fea8c-3c72-40df-9adc-98a5ea12f8ab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:48.253317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-202fea8c-3c72-40df-9adc-98a5ea12f8ab admin admin] The token cache is being invalidate because project 367208930d334b5aaaa5ec5afd47091b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:20:48.253317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-202fea8c-3c72-40df-9adc-98a5ea12f8ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:48.254039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-202fea8c-3c72-40df-9adc-98a5ea12f8ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:48.259458 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4096/8159] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:20:47 2022] DELETE /identity/v3/projects/367208930d334b5aaaa5ec5afd47091b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:48.260364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bd418-6759-42b1-b1cd-3dd296d9ef30 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:48.262031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-af5bd418-6759-42b1-b1cd-3dd296d9ef30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:48.277044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bd418-6759-42b1-b1cd-3dd296d9ef30 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:48.343729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987341d-eeb1-45fc-9fc5-8b37deb024af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:48.344288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987341d-eeb1-45fc-9fc5-8b37deb024af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:48.344636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987341d-eeb1-45fc-9fc5-8b37deb024af admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:48.344927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987341d-eeb1-45fc-9fc5-8b37deb024af admin admin] PATH_INFO: `/v3/users/3264006e56934970b804208a5ab5e042` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:48.346904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987341d-eeb1-45fc-9fc5-8b37deb024af admin admin] RBAC: Authorizing `identity:delete_user(user_id=3264006e56934970b804208a5ab5e042)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:48.348851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987341d-eeb1-45fc-9fc5-8b37deb024af admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:48.415788 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:48.427892 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a987341d-eeb1-45fc-9fc5-8b37deb024af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3264006e56934970b804208a5ab5e042'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:48.444565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a987341d-eeb1-45fc-9fc5-8b37deb024af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3264006e56934970b804208a5ab5e042'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:48.445401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a987341d-eeb1-45fc-9fc5-8b37deb024af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3264006e56934970b804208a5ab5e042'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:48.463492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a987341d-eeb1-45fc-9fc5-8b37deb024af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3264006e56934970b804208a5ab5e042'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:48.473155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a987341d-eeb1-45fc-9fc5-8b37deb024af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3264006e56934970b804208a5ab5e042'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:48.480653 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4064/8160] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:20:48 2022] DELETE /identity/v3/users/3264006e56934970b804208a5ab5e042 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:49.487189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fea8c-3c72-40df-9adc-98a5ea12f8ab admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:49.488698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-202fea8c-3c72-40df-9adc-98a5ea12f8ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:49.505842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fea8c-3c72-40df-9adc-98a5ea12f8ab admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:49.588554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc668d7b-0be7-483a-9e37-827e3792fe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:49.592843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc668d7b-0be7-483a-9e37-827e3792fe12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:49.593148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc668d7b-0be7-483a-9e37-827e3792fe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:49.593586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc668d7b-0be7-483a-9e37-827e3792fe12 admin admin] PATH_INFO: `/v3/projects/903b79c0a9b54b008fa6e67ca452f878` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:49.595382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc668d7b-0be7-483a-9e37-827e3792fe12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=903b79c0a9b54b008fa6e67ca452f878)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:49.597336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc668d7b-0be7-483a-9e37-827e3792fe12 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:49.661328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc668d7b-0be7-483a-9e37-827e3792fe12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '903b79c0a9b54b008fa6e67ca452f878', 'request_id': 'req-bc668d7b-0be7-483a-9e37-827e3792fe12'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:49.693755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc668d7b-0be7-483a-9e37-827e3792fe12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '903b79c0a9b54b008fa6e67ca452f878', 'request_id': 'req-bc668d7b-0be7-483a-9e37-827e3792fe12'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:49.706444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc668d7b-0be7-483a-9e37-827e3792fe12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '903b79c0a9b54b008fa6e67ca452f878', 'request_id': 'req-bc668d7b-0be7-483a-9e37-827e3792fe12'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:49.728220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc668d7b-0be7-483a-9e37-827e3792fe12 admin admin] The token cache is being invalidate because project 903b79c0a9b54b008fa6e67ca452f878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:20:49.728848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc668d7b-0be7-483a-9e37-827e3792fe12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:49.729573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc668d7b-0be7-483a-9e37-827e3792fe12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:49.731140 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4097/8161] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:20:49 2022] DELETE /identity/v3/projects/903b79c0a9b54b008fa6e67ca452f878 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:49.738702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626723a-aca7-4b35-a70d-7f8092047bb8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:49.739907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626723a-aca7-4b35-a70d-7f8092047bb8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:49.741452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626723a-aca7-4b35-a70d-7f8092047bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:49.789258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2626723a-aca7-4b35-a70d-7f8092047bb8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:49.791467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2626723a-aca7-4b35-a70d-7f8092047bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:49.884315 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4065/8162] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:49.893149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e9299-ae93-46f0-9eaf-11a4080d0da8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:49.893382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e9299-ae93-46f0-9eaf-11a4080d0da8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:49.893755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e9299-ae93-46f0-9eaf-11a4080d0da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:49.905286 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:49.926128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3e3e9299-ae93-46f0-9eaf-11a4080d0da8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:49.927697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3e3e9299-ae93-46f0-9eaf-11a4080d0da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:49.936069 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4098/8163] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:49.940407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626723a-aca7-4b35-a70d-7f8092047bb8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:49.951461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626723a-aca7-4b35-a70d-7f8092047bb8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:49.956899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af5a6f-46ef-4bef-bceb-3413a6a20855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:49.957836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af5a6f-46ef-4bef-bceb-3413a6a20855 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:49.957953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af5a6f-46ef-4bef-bceb-3413a6a20855 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:49.958187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af5a6f-46ef-4bef-bceb-3413a6a20855 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:49.958843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af5a6f-46ef-4bef-bceb-3413a6a20855 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:20:49.959142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af5a6f-46ef-4bef-bceb-3413a6a20855 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:49.960815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af5a6f-46ef-4bef-bceb-3413a6a20855 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:50.004649 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4066/8164] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:20:50.007849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e9299-ae93-46f0-9eaf-11a4080d0da8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:50.017648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e9299-ae93-46f0-9eaf-11a4080d0da8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:50.022793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3da614-29c3-4f87-812b-2581a0d776d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:50.024117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3da614-29c3-4f87-812b-2581a0d776d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:50.024502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3da614-29c3-4f87-812b-2581a0d776d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:50.024895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3da614-29c3-4f87-812b-2581a0d776d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:50.025638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3da614-29c3-4f87-812b-2581a0d776d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:50.029732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3da614-29c3-4f87-812b-2581a0d776d2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:50.074178 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4099/8165] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:20:50 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:50.074727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af5a6f-46ef-4bef-bceb-3413a6a20855 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:50.089567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af5a6f-46ef-4bef-bceb-3413a6a20855 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:50.176217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a06c04-00b9-4837-8ce0-ea48f7ee99f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:50.177606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a06c04-00b9-4837-8ce0-ea48f7ee99f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:50.178074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a06c04-00b9-4837-8ce0-ea48f7ee99f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:50.178454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a06c04-00b9-4837-8ce0-ea48f7ee99f6 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:50.179204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a06c04-00b9-4837-8ce0-ea48f7ee99f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:50.183654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a06c04-00b9-4837-8ce0-ea48f7ee99f6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:50.232981 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4067/8166] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:20:50 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:20:50.237584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3da614-29c3-4f87-812b-2581a0d776d2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:50.287943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3da614-29c3-4f87-812b-2581a0d776d2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:50.307037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918b485-56e7-4ab1-831d-f59955d0b70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:50.307806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918b485-56e7-4ab1-831d-f59955d0b70d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:50.308111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918b485-56e7-4ab1-831d-f59955d0b70d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:50.308388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918b485-56e7-4ab1-831d-f59955d0b70d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:50.309088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918b485-56e7-4ab1-831d-f59955d0b70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:50.311929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918b485-56e7-4ab1-831d-f59955d0b70d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:50.356684 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4100/8167] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:20:50.356898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a06c04-00b9-4837-8ce0-ea48f7ee99f6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:50.386287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a06c04-00b9-4837-8ce0-ea48f7ee99f6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:50.393127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6045905-da96-4caf-a160-3ce88087af05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:50.396272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6045905-da96-4caf-a160-3ce88087af05 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:50.397342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6045905-da96-4caf-a160-3ce88087af05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:50.397860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6045905-da96-4caf-a160-3ce88087af05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:50.400958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6045905-da96-4caf-a160-3ce88087af05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:50.405722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6045905-da96-4caf-a160-3ce88087af05 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:50.445014 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4068/8168] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:20:50.452973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918b485-56e7-4ab1-831d-f59955d0b70d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:50.498260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918b485-56e7-4ab1-831d-f59955d0b70d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:50.524794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af1c34-c250-4e35-b607-2896bdbfceb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:50.525654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af1c34-c250-4e35-b607-2896bdbfceb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:50.525770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af1c34-c250-4e35-b607-2896bdbfceb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:50.529848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af1c34-c250-4e35-b607-2896bdbfceb1 admin admin] PATH_INFO: `/v3/projects/a8849a5178bc4545ac421be97690e12e/users/14a160b7a17e4c3cb2f5a3ab61cd2119/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:50.573826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af1c34-c250-4e35-b607-2896bdbfceb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8849a5178bc4545ac421be97690e12e, user_id=14a160b7a17e4c3cb2f5a3ab61cd2119, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:50.579789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af1c34-c250-4e35-b607-2896bdbfceb1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:50.609813 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4101/8169] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:20:50 2022] PUT /identity/v3/projects/a8849a5178bc4545ac421be97690e12e/users/14a160b7a17e4c3cb2f5a3ab61cd2119/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:50.631010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a484de2-e1c7-4f80-93c7-11711f223ea8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:50.631490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a484de2-e1c7-4f80-93c7-11711f223ea8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:50.631642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a484de2-e1c7-4f80-93c7-11711f223ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:50.726403 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:50.764356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4a484de2-e1c7-4f80-93c7-11711f223ea8 None None] MFA Rules not processed for user `14a160b7a17e4c3cb2f5a3ab61cd2119`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:50.771218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4a484de2-e1c7-4f80-93c7-11711f223ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:50.963515 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4069/8170] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:50.970212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af1c34-c250-4e35-b607-2896bdbfceb1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:51.097382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af1c34-c250-4e35-b607-2896bdbfceb1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:51.103782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff41a30-f099-494d-b595-5b49ff932364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:51.104577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff41a30-f099-494d-b595-5b49ff932364 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:51.104932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff41a30-f099-494d-b595-5b49ff932364 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:51.105221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff41a30-f099-494d-b595-5b49ff932364 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:51.105857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff41a30-f099-494d-b595-5b49ff932364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:51.108986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff41a30-f099-494d-b595-5b49ff932364 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:51.151520 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4102/8171] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:20:50 2022] POST /identity/v3/projects => generated 389 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:51.155593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a484de2-e1c7-4f80-93c7-11711f223ea8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:51.173985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a484de2-e1c7-4f80-93c7-11711f223ea8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:51.282403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897eccd-b505-4363-8a14-23edfa7c3d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:51.283193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897eccd-b505-4363-8a14-23edfa7c3d4c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:51.285242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897eccd-b505-4363-8a14-23edfa7c3d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:51.286806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897eccd-b505-4363-8a14-23edfa7c3d4c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:51.287631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897eccd-b505-4363-8a14-23edfa7c3d4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:51.295559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897eccd-b505-4363-8a14-23edfa7c3d4c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:51.350733 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4070/8172] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:20:51 2022] POST /identity/v3/users => generated 301 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:51.354963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff41a30-f099-494d-b595-5b49ff932364 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:51.371494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff41a30-f099-494d-b595-5b49ff932364 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:51.383138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3c787-5615-40fd-b35a-ac11a83acf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:51.383880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3c787-5615-40fd-b35a-ac11a83acf51 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:51.384434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3c787-5615-40fd-b35a-ac11a83acf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:51.384832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3c787-5615-40fd-b35a-ac11a83acf51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:51.385837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3c787-5615-40fd-b35a-ac11a83acf51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:51.387666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3c787-5615-40fd-b35a-ac11a83acf51 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:51.408662 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4103/8173] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:20:51.412763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897eccd-b505-4363-8a14-23edfa7c3d4c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:51.425199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897eccd-b505-4363-8a14-23edfa7c3d4c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:51.431192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20240773-db37-4910-8bbe-734e6b2c1be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:51.432171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20240773-db37-4910-8bbe-734e6b2c1be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:51.432527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20240773-db37-4910-8bbe-734e6b2c1be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:51.432930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20240773-db37-4910-8bbe-734e6b2c1be8 admin admin] PATH_INFO: `/v3/projects/314c36f5d4914fb7ab72b21f4fb3dcc6/users/2bbfd50fca024d998db883f033f6ae1a/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:51.454354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20240773-db37-4910-8bbe-734e6b2c1be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=314c36f5d4914fb7ab72b21f4fb3dcc6, user_id=2bbfd50fca024d998db883f033f6ae1a, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:51.457950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20240773-db37-4910-8bbe-734e6b2c1be8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:51.519450 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4071/8174] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:20:51 2022] PUT /identity/v3/projects/314c36f5d4914fb7ab72b21f4fb3dcc6/users/2bbfd50fca024d998db883f033f6ae1a/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:20:51.523833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3c787-5615-40fd-b35a-ac11a83acf51 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:51.537080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3c787-5615-40fd-b35a-ac11a83acf51 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:51.682816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2f1d5-3e0f-47fa-b080-b389016e1ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:51.684409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2f1d5-3e0f-47fa-b080-b389016e1ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:51.685840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2f1d5-3e0f-47fa-b080-b389016e1ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:51.686490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2f1d5-3e0f-47fa-b080-b389016e1ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:51.687363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2f1d5-3e0f-47fa-b080-b389016e1ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:51.690164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2f1d5-3e0f-47fa-b080-b389016e1ba7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:51.706125 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4104/8175] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:20:51.710452 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20240773-db37-4910-8bbe-734e6b2c1be8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:51.727695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20240773-db37-4910-8bbe-734e6b2c1be8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:51.738620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02de213-86a8-41d9-b418-8d3223b9b1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:51.740560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02de213-86a8-41d9-b418-8d3223b9b1c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:51.745034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02de213-86a8-41d9-b418-8d3223b9b1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:51.745516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02de213-86a8-41d9-b418-8d3223b9b1c3 admin admin] PATH_INFO: `/v3/projects/314c36f5d4914fb7ab72b21f4fb3dcc6/users/2bbfd50fca024d998db883f033f6ae1a/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:51.749000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02de213-86a8-41d9-b418-8d3223b9b1c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=314c36f5d4914fb7ab72b21f4fb3dcc6, user_id=2bbfd50fca024d998db883f033f6ae1a, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:51.756466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02de213-86a8-41d9-b418-8d3223b9b1c3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:51.793508 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4072/8176] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:20:51 2022] PUT /identity/v3/projects/314c36f5d4914fb7ab72b21f4fb3dcc6/users/2bbfd50fca024d998db883f033f6ae1a/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:51.803776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b730651-6a67-42e6-bfeb-95aabdf4ace4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:51.804126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b730651-6a67-42e6-bfeb-95aabdf4ace4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:51.804341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b730651-6a67-42e6-bfeb-95aabdf4ace4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:51.841438 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:51.869430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4b730651-6a67-42e6-bfeb-95aabdf4ace4 None None] MFA Rules not processed for user `2bbfd50fca024d998db883f033f6ae1a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:51.871228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4b730651-6a67-42e6-bfeb-95aabdf4ace4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:52.038742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02de213-86a8-41d9-b418-8d3223b9b1c3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:52.041018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f02de213-86a8-41d9-b418-8d3223b9b1c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:52.075519 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4105/8177] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:51 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:52.084415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b730651-6a67-42e6-bfeb-95aabdf4ace4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:52.087555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4b730651-6a67-42e6-bfeb-95aabdf4ace4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:52.187470 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:52.220789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b730651-6a67-42e6-bfeb-95aabdf4ace4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:52.231770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514b361-d2e1-428a-8df9-463e3ce82c3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:52.232661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514b361-d2e1-428a-8df9-463e3ce82c3a service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:52.233040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514b361-d2e1-428a-8df9-463e3ce82c3a service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:52.233405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514b361-d2e1-428a-8df9-463e3ce82c3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:52.254717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02de213-86a8-41d9-b418-8d3223b9b1c3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:52.258015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514b361-d2e1-428a-8df9-463e3ce82c3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:52.259618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514b361-d2e1-428a-8df9-463e3ce82c3a service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:52.268279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388df09b-5316-40fc-a259-b6c15d643dcf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:52.268856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388df09b-5316-40fc-a259-b6c15d643dcf service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:52.269132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388df09b-5316-40fc-a259-b6c15d643dcf service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:52.269398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388df09b-5316-40fc-a259-b6c15d643dcf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:52.272051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-388df09b-5316-40fc-a259-b6c15d643dcf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:52.290562 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4106/8178] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:20:52 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:20:52.302949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388df09b-5316-40fc-a259-b6c15d643dcf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:52.305177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388df09b-5316-40fc-a259-b6c15d643dcf service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:52.342500 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4073/8179] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:20:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:20:52.643925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514b361-d2e1-428a-8df9-463e3ce82c3a service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:52.772766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514b361-d2e1-428a-8df9-463e3ce82c3a service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:52.781970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a2f85-a017-46cd-91f5-2a1610bc8a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:52.782620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a2f85-a017-46cd-91f5-2a1610bc8a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:52.782897 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a2f85-a017-46cd-91f5-2a1610bc8a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:52.783166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a2f85-a017-46cd-91f5-2a1610bc8a53 admin admin] PATH_INFO: `/v3/users/14a160b7a17e4c3cb2f5a3ab61cd2119` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:52.784302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a2f85-a017-46cd-91f5-2a1610bc8a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a160b7a17e4c3cb2f5a3ab61cd2119)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:52.786245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a2f85-a017-46cd-91f5-2a1610bc8a53 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:52.850215 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:52.859413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-590a2f85-a017-46cd-91f5-2a1610bc8a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a160b7a17e4c3cb2f5a3ab61cd2119'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:52.861113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-590a2f85-a017-46cd-91f5-2a1610bc8a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a160b7a17e4c3cb2f5a3ab61cd2119'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:52.873210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-590a2f85-a017-46cd-91f5-2a1610bc8a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a160b7a17e4c3cb2f5a3ab61cd2119'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:52.891851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-590a2f85-a017-46cd-91f5-2a1610bc8a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a160b7a17e4c3cb2f5a3ab61cd2119'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:52.904696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-590a2f85-a017-46cd-91f5-2a1610bc8a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a160b7a17e4c3cb2f5a3ab61cd2119'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:52.941679 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4107/8180] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:20:52 2022] DELETE /identity/v3/users/14a160b7a17e4c3cb2f5a3ab61cd2119 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:52.943676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ef2a3-d35b-4fd6-9da3-943716591b2d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:52.944136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ef2a3-d35b-4fd6-9da3-943716591b2d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:52.944272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ef2a3-d35b-4fd6-9da3-943716591b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:52.966097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bb3ef2a3-d35b-4fd6-9da3-943716591b2d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:52.967314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bb3ef2a3-d35b-4fd6-9da3-943716591b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:53.058055 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4074/8181] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:53.065178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a2f85-a017-46cd-91f5-2a1610bc8a53 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:53.066595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-590a2f85-a017-46cd-91f5-2a1610bc8a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:53.172397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a2f85-a017-46cd-91f5-2a1610bc8a53 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:53.176848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bb534-d599-45a8-aa27-b5d9050dfa8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:53.177921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bb534-d599-45a8-aa27-b5d9050dfa8a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:53.178448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bb534-d599-45a8-aa27-b5d9050dfa8a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:53.178929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bb534-d599-45a8-aa27-b5d9050dfa8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:53.193462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758bb534-d599-45a8-aa27-b5d9050dfa8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:53.203237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758bb534-d599-45a8-aa27-b5d9050dfa8a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:53.218013 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4108/8182] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:20:53.621270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ef2a3-d35b-4fd6-9da3-943716591b2d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:53.623826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bb3ef2a3-d35b-4fd6-9da3-943716591b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:53.653885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ef2a3-d35b-4fd6-9da3-943716591b2d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:53.662472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b92a23-c1bd-4fa8-bb5b-40e2dc508840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:53.663485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b92a23-c1bd-4fa8-bb5b-40e2dc508840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:53.663970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b92a23-c1bd-4fa8-bb5b-40e2dc508840 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:53.664471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b92a23-c1bd-4fa8-bb5b-40e2dc508840 admin admin] PATH_INFO: `/v3/projects/a8849a5178bc4545ac421be97690e12e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:53.679381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b92a23-c1bd-4fa8-bb5b-40e2dc508840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8849a5178bc4545ac421be97690e12e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:53.681738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b92a23-c1bd-4fa8-bb5b-40e2dc508840 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:53.786156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a5b92a23-c1bd-4fa8-bb5b-40e2dc508840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8849a5178bc4545ac421be97690e12e', 'request_id': 'req-a5b92a23-c1bd-4fa8-bb5b-40e2dc508840'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:53.798929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a5b92a23-c1bd-4fa8-bb5b-40e2dc508840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8849a5178bc4545ac421be97690e12e', 'request_id': 'req-a5b92a23-c1bd-4fa8-bb5b-40e2dc508840'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:53.807071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a5b92a23-c1bd-4fa8-bb5b-40e2dc508840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8849a5178bc4545ac421be97690e12e', 'request_id': 'req-a5b92a23-c1bd-4fa8-bb5b-40e2dc508840'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:53.827160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a5b92a23-c1bd-4fa8-bb5b-40e2dc508840 admin admin] The token cache is being invalidate because project a8849a5178bc4545ac421be97690e12e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:20:53.827444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a5b92a23-c1bd-4fa8-bb5b-40e2dc508840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:53.828076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a5b92a23-c1bd-4fa8-bb5b-40e2dc508840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:53.833815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bb534-d599-45a8-aa27-b5d9050dfa8a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:53.834638 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4075/8183] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:20:53 2022] DELETE /identity/v3/projects/a8849a5178bc4545ac421be97690e12e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:53.844641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bb534-d599-45a8-aa27-b5d9050dfa8a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:53.909934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe502d4-a0e3-42db-8225-ee314492784d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:53.910666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe502d4-a0e3-42db-8225-ee314492784d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:53.911173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe502d4-a0e3-42db-8225-ee314492784d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:53.911659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe502d4-a0e3-42db-8225-ee314492784d admin admin] PATH_INFO: `/v3/users/2bbfd50fca024d998db883f033f6ae1a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:53.913091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe502d4-a0e3-42db-8225-ee314492784d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bbfd50fca024d998db883f033f6ae1a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:53.916480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe502d4-a0e3-42db-8225-ee314492784d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:53.988512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-abe502d4-a0e3-42db-8225-ee314492784d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bbfd50fca024d998db883f033f6ae1a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:53.989330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-abe502d4-a0e3-42db-8225-ee314492784d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bbfd50fca024d998db883f033f6ae1a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:54.001233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-abe502d4-a0e3-42db-8225-ee314492784d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bbfd50fca024d998db883f033f6ae1a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:54.027197 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:54.048778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-abe502d4-a0e3-42db-8225-ee314492784d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bbfd50fca024d998db883f033f6ae1a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:54.065420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-abe502d4-a0e3-42db-8225-ee314492784d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bbfd50fca024d998db883f033f6ae1a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:54.084505 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4109/8184] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:20:53 2022] DELETE /identity/v3/users/2bbfd50fca024d998db883f033f6ae1a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:20:54.651999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b92a23-c1bd-4fa8-bb5b-40e2dc508840 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:54.655590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a5b92a23-c1bd-4fa8-bb5b-40e2dc508840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:54.690398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b92a23-c1bd-4fa8-bb5b-40e2dc508840 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:54.829333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddec9bd-bff9-4dd7-9879-fa9d9a5fd4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:54.830016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddec9bd-bff9-4dd7-9879-fa9d9a5fd4bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:54.830297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddec9bd-bff9-4dd7-9879-fa9d9a5fd4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:54.830725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddec9bd-bff9-4dd7-9879-fa9d9a5fd4bb admin admin] PATH_INFO: `/v3/projects/314c36f5d4914fb7ab72b21f4fb3dcc6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:54.831962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddec9bd-bff9-4dd7-9879-fa9d9a5fd4bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=314c36f5d4914fb7ab72b21f4fb3dcc6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:54.838083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddec9bd-bff9-4dd7-9879-fa9d9a5fd4bb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:54.856733 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:54.941971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9ddec9bd-bff9-4dd7-9879-fa9d9a5fd4bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '314c36f5d4914fb7ab72b21f4fb3dcc6', 'request_id': 'req-9ddec9bd-bff9-4dd7-9879-fa9d9a5fd4bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:54.954947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9ddec9bd-bff9-4dd7-9879-fa9d9a5fd4bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '314c36f5d4914fb7ab72b21f4fb3dcc6', 'request_id': 'req-9ddec9bd-bff9-4dd7-9879-fa9d9a5fd4bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:54.963342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9ddec9bd-bff9-4dd7-9879-fa9d9a5fd4bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '314c36f5d4914fb7ab72b21f4fb3dcc6', 'request_id': 'req-9ddec9bd-bff9-4dd7-9879-fa9d9a5fd4bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:54.979027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9ddec9bd-bff9-4dd7-9879-fa9d9a5fd4bb admin admin] The token cache is being invalidate because project 314c36f5d4914fb7ab72b21f4fb3dcc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:20:54.979455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9ddec9bd-bff9-4dd7-9879-fa9d9a5fd4bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:54.980281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9ddec9bd-bff9-4dd7-9879-fa9d9a5fd4bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:20:54.984207 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4076/8185] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:20:54 2022] DELETE /identity/v3/projects/314c36f5d4914fb7ab72b21f4fb3dcc6 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:54.989067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa447f4d-3918-421c-87cb-e2c71d472449 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:54.989572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa447f4d-3918-421c-87cb-e2c71d472449 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:54.990170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa447f4d-3918-421c-87cb-e2c71d472449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:55.034646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fa447f4d-3918-421c-87cb-e2c71d472449 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:55.037345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fa447f4d-3918-421c-87cb-e2c71d472449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:55.178315 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4110/8186] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:55.187859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45f1ff-10f9-42cb-9471-32d4be7cc103 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:55.188525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45f1ff-10f9-42cb-9471-32d4be7cc103 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:55.188843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45f1ff-10f9-42cb-9471-32d4be7cc103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:55.233057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5d45f1ff-10f9-42cb-9471-32d4be7cc103 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:55.234275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5d45f1ff-10f9-42cb-9471-32d4be7cc103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:55.243163 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4077/8187] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:55.248317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa447f4d-3918-421c-87cb-e2c71d472449 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:55.265612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa447f4d-3918-421c-87cb-e2c71d472449 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:55.277576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67489c73-c1e8-4b4c-b8aa-9ec1bc0a364b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:55.278771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67489c73-c1e8-4b4c-b8aa-9ec1bc0a364b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:55.280957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67489c73-c1e8-4b4c-b8aa-9ec1bc0a364b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:55.281261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67489c73-c1e8-4b4c-b8aa-9ec1bc0a364b admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:55.281949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67489c73-c1e8-4b4c-b8aa-9ec1bc0a364b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:20:55.282259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67489c73-c1e8-4b4c-b8aa-9ec1bc0a364b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:55.283882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67489c73-c1e8-4b4c-b8aa-9ec1bc0a364b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:55.363510 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4111/8188] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:20:55.367843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45f1ff-10f9-42cb-9471-32d4be7cc103 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:55.382513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45f1ff-10f9-42cb-9471-32d4be7cc103 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:55.406229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed6952-d449-415d-b3fb-5f599dd60bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:55.408121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed6952-d449-415d-b3fb-5f599dd60bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:55.409273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed6952-d449-415d-b3fb-5f599dd60bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:55.409791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed6952-d449-415d-b3fb-5f599dd60bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:55.412628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed6952-d449-415d-b3fb-5f599dd60bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:55.416166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed6952-d449-415d-b3fb-5f599dd60bd6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:55.498421 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4078/8189] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:20:55 2022] POST /identity/v3/projects => generated 409 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:20:55.503353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67489c73-c1e8-4b4c-b8aa-9ec1bc0a364b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:55.518320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67489c73-c1e8-4b4c-b8aa-9ec1bc0a364b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:55.681622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708c8db-ee92-4def-aec8-fca3fe403de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:55.682254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708c8db-ee92-4def-aec8-fca3fe403de9 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:55.682533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708c8db-ee92-4def-aec8-fca3fe403de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:55.682805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708c8db-ee92-4def-aec8-fca3fe403de9 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:55.683495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708c8db-ee92-4def-aec8-fca3fe403de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:55.686195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708c8db-ee92-4def-aec8-fca3fe403de9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:55.744480 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4112/8190] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:20:55 2022] POST /identity/v3/users => generated 305 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:55.748739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed6952-d449-415d-b3fb-5f599dd60bd6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:55.763278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed6952-d449-415d-b3fb-5f599dd60bd6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:55.776508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c8f9a-a589-42c0-93f2-4628a4413db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:55.777169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c8f9a-a589-42c0-93f2-4628a4413db9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:55.777742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c8f9a-a589-42c0-93f2-4628a4413db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:55.778124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c8f9a-a589-42c0-93f2-4628a4413db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:55.778805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c8f9a-a589-42c0-93f2-4628a4413db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:55.780437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c8f9a-a589-42c0-93f2-4628a4413db9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:55.822714 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4079/8191] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:20:55.825903 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708c8db-ee92-4def-aec8-fca3fe403de9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:55.847554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708c8db-ee92-4def-aec8-fca3fe403de9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:55.858648 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7c9f9-a802-47e9-ae6f-ce15529861c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:55.859283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7c9f9-a802-47e9-ae6f-ce15529861c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:55.860250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7c9f9-a802-47e9-ae6f-ce15529861c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:55.860250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7c9f9-a802-47e9-ae6f-ce15529861c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:55.860940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7c9f9-a802-47e9-ae6f-ce15529861c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:55.862651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7c9f9-a802-47e9-ae6f-ce15529861c2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:55.908665 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4113/8192] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:20:55.912501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c8f9a-a589-42c0-93f2-4628a4413db9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:55.928067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c8f9a-a589-42c0-93f2-4628a4413db9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:55.939219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5156d-6798-44bc-9246-1e5a3fa2f7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:55.940005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5156d-6798-44bc-9246-1e5a3fa2f7cb admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:55.940380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5156d-6798-44bc-9246-1e5a3fa2f7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:55.940779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5156d-6798-44bc-9246-1e5a3fa2f7cb admin admin] PATH_INFO: `/v3/projects/01e663f160f740d0b2f897230dc90adc/users/d561b6a096d44bd0aa1ae3bd23ac367b/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:55.995933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5156d-6798-44bc-9246-1e5a3fa2f7cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e663f160f740d0b2f897230dc90adc, user_id=d561b6a096d44bd0aa1ae3bd23ac367b, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:56.001750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5156d-6798-44bc-9246-1e5a3fa2f7cb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:56.034435 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4080/8193] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:20:55 2022] PUT /identity/v3/projects/01e663f160f740d0b2f897230dc90adc/users/d561b6a096d44bd0aa1ae3bd23ac367b/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:56.044778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da54a0a-853c-4488-9024-61b63df49b30 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:56.045265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da54a0a-853c-4488-9024-61b63df49b30 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:56.045457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da54a0a-853c-4488-9024-61b63df49b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:56.081263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5da54a0a-853c-4488-9024-61b63df49b30 None None] MFA Rules not processed for user `d561b6a096d44bd0aa1ae3bd23ac367b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:56.082706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5da54a0a-853c-4488-9024-61b63df49b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:56.137552 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:56.184416 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4114/8194] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:56 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:56.188974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5156d-6798-44bc-9246-1e5a3fa2f7cb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:56.295718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5156d-6798-44bc-9246-1e5a3fa2f7cb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:56.303643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44d2ba-9ad2-418b-b5ab-ab1d2d590a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:56.304395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44d2ba-9ad2-418b-b5ab-ab1d2d590a90 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:56.304774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44d2ba-9ad2-418b-b5ab-ab1d2d590a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:56.305157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44d2ba-9ad2-418b-b5ab-ab1d2d590a90 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:56.306522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44d2ba-9ad2-418b-b5ab-ab1d2d590a90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:56.308835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44d2ba-9ad2-418b-b5ab-ab1d2d590a90 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:56.343787 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4081/8195] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:20:56 2022] POST /identity/v3/projects => generated 409 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:56.347667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da54a0a-853c-4488-9024-61b63df49b30 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:56.393038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da54a0a-853c-4488-9024-61b63df49b30 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:56.477615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f630fd-2e00-4f28-9ada-4adaec2f12d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:56.478255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f630fd-2e00-4f28-9ada-4adaec2f12d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:56.478529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f630fd-2e00-4f28-9ada-4adaec2f12d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:56.478795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f630fd-2e00-4f28-9ada-4adaec2f12d4 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:56.479690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f630fd-2e00-4f28-9ada-4adaec2f12d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:56.482166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f630fd-2e00-4f28-9ada-4adaec2f12d4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:56.532394 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4115/8196] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:20:56 2022] POST /identity/v3/users => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:20:56.537085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44d2ba-9ad2-418b-b5ab-ab1d2d590a90 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:56.555441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44d2ba-9ad2-418b-b5ab-ab1d2d590a90 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:56.562051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568dcf9c-0c3f-4f78-8b2b-6085fbdf1dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:56.562958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dcf9c-0c3f-4f78-8b2b-6085fbdf1dfa admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:56.563428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dcf9c-0c3f-4f78-8b2b-6085fbdf1dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:56.563908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dcf9c-0c3f-4f78-8b2b-6085fbdf1dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:56.569446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f630fd-2e00-4f28-9ada-4adaec2f12d4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:56.571630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-13f630fd-2e00-4f28-9ada-4adaec2f12d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:56.572818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568dcf9c-0c3f-4f78-8b2b-6085fbdf1dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:56.582029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568dcf9c-0c3f-4f78-8b2b-6085fbdf1dfa admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:56.608469 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4082/8197] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:20:56.612458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568dcf9c-0c3f-4f78-8b2b-6085fbdf1dfa admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:56.631222 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:56.640821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568dcf9c-0c3f-4f78-8b2b-6085fbdf1dfa admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:56.655628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d062a62-cdf3-401f-8d98-aea875dcd5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:56.656316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d062a62-cdf3-401f-8d98-aea875dcd5ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:56.656681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d062a62-cdf3-401f-8d98-aea875dcd5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:56.656996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d062a62-cdf3-401f-8d98-aea875dcd5ea admin admin] PATH_INFO: `/v3/projects/af013377752a42998294b4aaea20cfa6/users/52053df54e6b4b6b94ba6f6ad68277f7/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:56.683234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d062a62-cdf3-401f-8d98-aea875dcd5ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=af013377752a42998294b4aaea20cfa6, user_id=52053df54e6b4b6b94ba6f6ad68277f7, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:56.698888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d062a62-cdf3-401f-8d98-aea875dcd5ea admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:56.717655 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4083/8198] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:20:56 2022] PUT /identity/v3/projects/af013377752a42998294b4aaea20cfa6/users/52053df54e6b4b6b94ba6f6ad68277f7/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:56.721591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d062a62-cdf3-401f-8d98-aea875dcd5ea admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:56.780378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f630fd-2e00-4f28-9ada-4adaec2f12d4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:56.915686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d062a62-cdf3-401f-8d98-aea875dcd5ea admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:56.928733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910545e5-7e4c-40e5-9834-cdc48b5b0ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:56.929363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910545e5-7e4c-40e5-9834-cdc48b5b0ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:56.929641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910545e5-7e4c-40e5-9834-cdc48b5b0ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:56.929911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910545e5-7e4c-40e5-9834-cdc48b5b0ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:56.930873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910545e5-7e4c-40e5-9834-cdc48b5b0ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:56.932568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910545e5-7e4c-40e5-9834-cdc48b5b0ec7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:56.946467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50c654-1211-4c88-9a7c-f58eefb71568 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:56.948516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50c654-1211-4c88-9a7c-f58eefb71568 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:56.949281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50c654-1211-4c88-9a7c-f58eefb71568 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:56.950779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50c654-1211-4c88-9a7c-f58eefb71568 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:56.953923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1d50c654-1211-4c88-9a7c-f58eefb71568 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:56.965561 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4084/8199] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:20:56.966569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910545e5-7e4c-40e5-9834-cdc48b5b0ec7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:56.968160 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:20:56.977407 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50c654-1211-4c88-9a7c-f58eefb71568 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:56.979604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50c654-1211-4c88-9a7c-f58eefb71568 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:56.996396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910545e5-7e4c-40e5-9834-cdc48b5b0ec7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:57.001159 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4116/8200] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:20:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:20:57.025037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac18c4e-cd3e-4ce6-bb4b-312eff16846d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:57.026235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac18c4e-cd3e-4ce6-bb4b-312eff16846d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:57.026531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac18c4e-cd3e-4ce6-bb4b-312eff16846d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:57.029819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac18c4e-cd3e-4ce6-bb4b-312eff16846d admin admin] PATH_INFO: `/v3/projects/af013377752a42998294b4aaea20cfa6/users/52053df54e6b4b6b94ba6f6ad68277f7/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:57.035560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac18c4e-cd3e-4ce6-bb4b-312eff16846d admin admin] RBAC: Authorizing `identity:create_grant(project_id=af013377752a42998294b4aaea20cfa6, user_id=52053df54e6b4b6b94ba6f6ad68277f7, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:57.054619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac18c4e-cd3e-4ce6-bb4b-312eff16846d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:57.072085 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4085/8201] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:20:56 2022] PUT /identity/v3/projects/af013377752a42998294b4aaea20cfa6/users/52053df54e6b4b6b94ba6f6ad68277f7/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:20:57.082858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c7226-1bf4-4c7c-a096-713263174d8e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:57.083296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c7226-1bf4-4c7c-a096-713263174d8e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:57.083406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c7226-1bf4-4c7c-a096-713263174d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:57.159636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e37c7226-1bf4-4c7c-a096-713263174d8e None None] MFA Rules not processed for user `52053df54e6b4b6b94ba6f6ad68277f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:20:57.161167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e37c7226-1bf4-4c7c-a096-713263174d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:57.360019 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4117/8202] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:20:57 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:20:57.371522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac18c4e-cd3e-4ce6-bb4b-312eff16846d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:57.373583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dac18c4e-cd3e-4ce6-bb4b-312eff16846d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:20:57.466509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac18c4e-cd3e-4ce6-bb4b-312eff16846d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:57.471297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d6416-db9b-4205-b7a8-4aae1b6c0760 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:57.472366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d6416-db9b-4205-b7a8-4aae1b6c0760 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:57.472850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d6416-db9b-4205-b7a8-4aae1b6c0760 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:57.473281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d6416-db9b-4205-b7a8-4aae1b6c0760 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:57.484563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d6416-db9b-4205-b7a8-4aae1b6c0760 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:57.486535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d6416-db9b-4205-b7a8-4aae1b6c0760 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:57.500711 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4086/8203] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:20:57 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:20:57.785246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c7226-1bf4-4c7c-a096-713263174d8e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:20:57.803047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c7226-1bf4-4c7c-a096-713263174d8e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:20:57.807589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bbfb4-6522-4a7d-b04c-9eba84a1ad2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:20:57.808263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bbfb4-6522-4a7d-b04c-9eba84a1ad2f service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:20:57.808678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bbfb4-6522-4a7d-b04c-9eba84a1ad2f service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:20:57.809467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bbfb4-6522-4a7d-b04c-9eba84a1ad2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:20:57.985190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bbfb4-6522-4a7d-b04c-9eba84a1ad2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:20:57.987359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bbfb4-6522-4a7d-b04c-9eba84a1ad2f service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:20:58.002344 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4118/8204] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:20:57 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:21:06.167940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d6416-db9b-4205-b7a8-4aae1b6c0760 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:06.170100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c58d6416-db9b-4205-b7a8-4aae1b6c0760 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:06.341509 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:06.462994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d6416-db9b-4205-b7a8-4aae1b6c0760 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:06.510877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3812b7-f6d9-4932-8b38-c134923ce39c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:06.511756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3812b7-f6d9-4932-8b38-c134923ce39c service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:06.512405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3812b7-f6d9-4932-8b38-c134923ce39c service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:06.512962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3812b7-f6d9-4932-8b38-c134923ce39c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:06.515822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8f3812b7-f6d9-4932-8b38-c134923ce39c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:06.566611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3812b7-f6d9-4932-8b38-c134923ce39c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:06.584244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3812b7-f6d9-4932-8b38-c134923ce39c service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:06.613696 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4087/8205] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:21:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:21:07.994752 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=64 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:12.228286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bbfb4-6522-4a7d-b04c-9eba84a1ad2f service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:12.322274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bbfb4-6522-4a7d-b04c-9eba84a1ad2f service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:12.333042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173519b-0e5f-4e5e-9dda-a55125285702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:12.334154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173519b-0e5f-4e5e-9dda-a55125285702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:12.334585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173519b-0e5f-4e5e-9dda-a55125285702 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:12.335077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173519b-0e5f-4e5e-9dda-a55125285702 admin admin] PATH_INFO: `/v3/users/d561b6a096d44bd0aa1ae3bd23ac367b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:12.336472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173519b-0e5f-4e5e-9dda-a55125285702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d561b6a096d44bd0aa1ae3bd23ac367b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:12.338788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173519b-0e5f-4e5e-9dda-a55125285702 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:12.445951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c173519b-0e5f-4e5e-9dda-a55125285702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd561b6a096d44bd0aa1ae3bd23ac367b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:12.446969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c173519b-0e5f-4e5e-9dda-a55125285702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd561b6a096d44bd0aa1ae3bd23ac367b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:12.468010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c173519b-0e5f-4e5e-9dda-a55125285702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd561b6a096d44bd0aa1ae3bd23ac367b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:12.499268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c173519b-0e5f-4e5e-9dda-a55125285702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd561b6a096d44bd0aa1ae3bd23ac367b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:12.508369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c173519b-0e5f-4e5e-9dda-a55125285702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd561b6a096d44bd0aa1ae3bd23ac367b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:12.519222 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4119/8206] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:21:12 2022] DELETE /identity/v3/users/d561b6a096d44bd0aa1ae3bd23ac367b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:21:12.520970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67551ca3-36ba-4419-9ff9-14bf6e1b659b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:12.521725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67551ca3-36ba-4419-9ff9-14bf6e1b659b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:12.522223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67551ca3-36ba-4419-9ff9-14bf6e1b659b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:12.572513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-67551ca3-36ba-4419-9ff9-14bf6e1b659b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:21:12.577758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-67551ca3-36ba-4419-9ff9-14bf6e1b659b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:12.789981 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4088/8207] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:21:12.815052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173519b-0e5f-4e5e-9dda-a55125285702 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:12.816531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c173519b-0e5f-4e5e-9dda-a55125285702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:12.999096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173519b-0e5f-4e5e-9dda-a55125285702 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:13.004174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339f0a4-4644-4c1a-89fd-9ab3d3b659f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:13.004818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339f0a4-4644-4c1a-89fd-9ab3d3b659f2 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:13.005192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339f0a4-4644-4c1a-89fd-9ab3d3b659f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:13.005916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339f0a4-4644-4c1a-89fd-9ab3d3b659f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:13.018516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339f0a4-4644-4c1a-89fd-9ab3d3b659f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:13.021001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339f0a4-4644-4c1a-89fd-9ab3d3b659f2 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:13.033693 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4120/8208] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:21:13.575180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67551ca3-36ba-4419-9ff9-14bf6e1b659b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:13.576901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-67551ca3-36ba-4419-9ff9-14bf6e1b659b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:13.602988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67551ca3-36ba-4419-9ff9-14bf6e1b659b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:13.614151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c739c71-f95e-40af-a382-36398883c23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:13.614815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c739c71-f95e-40af-a382-36398883c23a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:13.615089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c739c71-f95e-40af-a382-36398883c23a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:13.615355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c739c71-f95e-40af-a382-36398883c23a admin admin] PATH_INFO: `/v3/projects/01e663f160f740d0b2f897230dc90adc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:13.617117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c739c71-f95e-40af-a382-36398883c23a admin admin] RBAC: Authorizing `identity:delete_project(project_id=01e663f160f740d0b2f897230dc90adc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:13.623208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c739c71-f95e-40af-a382-36398883c23a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:13.733401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1c739c71-f95e-40af-a382-36398883c23a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e663f160f740d0b2f897230dc90adc', 'request_id': 'req-1c739c71-f95e-40af-a382-36398883c23a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:13.751793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1c739c71-f95e-40af-a382-36398883c23a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e663f160f740d0b2f897230dc90adc', 'request_id': 'req-1c739c71-f95e-40af-a382-36398883c23a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:13.766917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1c739c71-f95e-40af-a382-36398883c23a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e663f160f740d0b2f897230dc90adc', 'request_id': 'req-1c739c71-f95e-40af-a382-36398883c23a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:13.795727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1c739c71-f95e-40af-a382-36398883c23a admin admin] The token cache is being invalidate because project 01e663f160f740d0b2f897230dc90adc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:21:13.796271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1c739c71-f95e-40af-a382-36398883c23a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:13.797537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1c739c71-f95e-40af-a382-36398883c23a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:13.800387 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4089/8209] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:21:13 2022] DELETE /identity/v3/projects/01e663f160f740d0b2f897230dc90adc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:21:13.804498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339f0a4-4644-4c1a-89fd-9ab3d3b659f2 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:13.818286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339f0a4-4644-4c1a-89fd-9ab3d3b659f2 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:13.838532 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:14.011291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea8a82-b12a-4dfc-839b-3ecb9f82e061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:14.011291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea8a82-b12a-4dfc-839b-3ecb9f82e061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:14.011291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea8a82-b12a-4dfc-839b-3ecb9f82e061 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:14.011291 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea8a82-b12a-4dfc-839b-3ecb9f82e061 admin admin] PATH_INFO: `/v3/users/52053df54e6b4b6b94ba6f6ad68277f7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:14.016351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea8a82-b12a-4dfc-839b-3ecb9f82e061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52053df54e6b4b6b94ba6f6ad68277f7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:14.035559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea8a82-b12a-4dfc-839b-3ecb9f82e061 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:14.210641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7bea8a82-b12a-4dfc-839b-3ecb9f82e061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52053df54e6b4b6b94ba6f6ad68277f7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:14.211383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7bea8a82-b12a-4dfc-839b-3ecb9f82e061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52053df54e6b4b6b94ba6f6ad68277f7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:14.229269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7bea8a82-b12a-4dfc-839b-3ecb9f82e061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52053df54e6b4b6b94ba6f6ad68277f7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:14.254668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7bea8a82-b12a-4dfc-839b-3ecb9f82e061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52053df54e6b4b6b94ba6f6ad68277f7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:14.264290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7bea8a82-b12a-4dfc-839b-3ecb9f82e061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52053df54e6b4b6b94ba6f6ad68277f7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:14.271156 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4121/8210] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:21:13 2022] DELETE /identity/v3/users/52053df54e6b4b6b94ba6f6ad68277f7 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:21:14.839387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c739c71-f95e-40af-a382-36398883c23a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:14.842592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1c739c71-f95e-40af-a382-36398883c23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:14.869987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c739c71-f95e-40af-a382-36398883c23a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:15.015436 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:15.033323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593fc5d-a3b9-4d85-92af-1c379ad2cd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:15.036761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593fc5d-a3b9-4d85-92af-1c379ad2cd88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:15.037073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593fc5d-a3b9-4d85-92af-1c379ad2cd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:15.037358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593fc5d-a3b9-4d85-92af-1c379ad2cd88 admin admin] PATH_INFO: `/v3/projects/af013377752a42998294b4aaea20cfa6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:15.041226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593fc5d-a3b9-4d85-92af-1c379ad2cd88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af013377752a42998294b4aaea20cfa6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:15.045287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593fc5d-a3b9-4d85-92af-1c379ad2cd88 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:15.154521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d593fc5d-a3b9-4d85-92af-1c379ad2cd88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af013377752a42998294b4aaea20cfa6', 'request_id': 'req-d593fc5d-a3b9-4d85-92af-1c379ad2cd88'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:15.181292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d593fc5d-a3b9-4d85-92af-1c379ad2cd88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af013377752a42998294b4aaea20cfa6', 'request_id': 'req-d593fc5d-a3b9-4d85-92af-1c379ad2cd88'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:15.194828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d593fc5d-a3b9-4d85-92af-1c379ad2cd88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af013377752a42998294b4aaea20cfa6', 'request_id': 'req-d593fc5d-a3b9-4d85-92af-1c379ad2cd88'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:15.218800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d593fc5d-a3b9-4d85-92af-1c379ad2cd88 admin admin] The token cache is being invalidate because project af013377752a42998294b4aaea20cfa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:21:15.219471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d593fc5d-a3b9-4d85-92af-1c379ad2cd88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:15.220433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d593fc5d-a3b9-4d85-92af-1c379ad2cd88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:15.225947 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4090/8211] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:21:14 2022] DELETE /identity/v3/projects/af013377752a42998294b4aaea20cfa6 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:21:15.227770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828ad8c-0393-443d-8b08-1674aba5c187 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:15.228615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828ad8c-0393-443d-8b08-1674aba5c187 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:15.229090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828ad8c-0393-443d-8b08-1674aba5c187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:15.253706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4828ad8c-0393-443d-8b08-1674aba5c187 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:21:15.255448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4828ad8c-0393-443d-8b08-1674aba5c187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:15.356318 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4122/8212] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:21:15.363390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbe370-e19d-4ccf-a091-9567de4bb4da None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:15.363674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbe370-e19d-4ccf-a091-9567de4bb4da None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:15.363947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbe370-e19d-4ccf-a091-9567de4bb4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:15.389716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6cdbe370-e19d-4ccf-a091-9567de4bb4da None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:21:15.391369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6cdbe370-e19d-4ccf-a091-9567de4bb4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:15.414770 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4091/8213] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:21:15.420222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828ad8c-0393-443d-8b08-1674aba5c187 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:15.441075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828ad8c-0393-443d-8b08-1674aba5c187 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:15.461038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fba03-a1cc-4707-959f-d8c2ae13d5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:15.461830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fba03-a1cc-4707-959f-d8c2ae13d5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:15.462113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fba03-a1cc-4707-959f-d8c2ae13d5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:15.462384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fba03-a1cc-4707-959f-d8c2ae13d5a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:15.463037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fba03-a1cc-4707-959f-d8c2ae13d5a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:21:15.463336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fba03-a1cc-4707-959f-d8c2ae13d5a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:15.465036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fba03-a1cc-4707-959f-d8c2ae13d5a2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:15.495459 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4123/8214] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:21:15.502428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbe370-e19d-4ccf-a091-9567de4bb4da None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:15.515123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbe370-e19d-4ccf-a091-9567de4bb4da None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:15.522535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d247da-eecc-408f-8cf8-d0040ca6e55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:15.528587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d247da-eecc-408f-8cf8-d0040ca6e55d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:15.535136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d247da-eecc-408f-8cf8-d0040ca6e55d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:15.535136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d247da-eecc-408f-8cf8-d0040ca6e55d admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:15.535136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d247da-eecc-408f-8cf8-d0040ca6e55d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:15.537148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d247da-eecc-408f-8cf8-d0040ca6e55d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:15.613356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fba03-a1cc-4707-959f-d8c2ae13d5a2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:15.613894 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4092/8215] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:21:15 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:21:15.625202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fba03-a1cc-4707-959f-d8c2ae13d5a2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:15.648211 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:15.704855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f97d50-4564-4e15-8650-fc36d47b744e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:15.705640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f97d50-4564-4e15-8650-fc36d47b744e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:15.706025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f97d50-4564-4e15-8650-fc36d47b744e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:15.707004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f97d50-4564-4e15-8650-fc36d47b744e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:15.707743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f97d50-4564-4e15-8650-fc36d47b744e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:15.710139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f97d50-4564-4e15-8650-fc36d47b744e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:15.747652 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4124/8216] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:21:15 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:21:15.752554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d247da-eecc-408f-8cf8-d0040ca6e55d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:15.770245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d247da-eecc-408f-8cf8-d0040ca6e55d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:15.776705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a81eb-9a41-4c57-afa6-728516a8b2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:15.778190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a81eb-9a41-4c57-afa6-728516a8b2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:15.778190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a81eb-9a41-4c57-afa6-728516a8b2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:15.778567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a81eb-9a41-4c57-afa6-728516a8b2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:15.779323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a81eb-9a41-4c57-afa6-728516a8b2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:15.781246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a81eb-9a41-4c57-afa6-728516a8b2e2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:15.800835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f97d50-4564-4e15-8650-fc36d47b744e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:15.812679 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4093/8217] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:21:15.818113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f97d50-4564-4e15-8650-fc36d47b744e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:15.825706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0c010-42d7-4c32-a7a1-6fe332f63e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:15.826193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0c010-42d7-4c32-a7a1-6fe332f63e7d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:15.826565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0c010-42d7-4c32-a7a1-6fe332f63e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:15.826928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0c010-42d7-4c32-a7a1-6fe332f63e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:15.827677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0c010-42d7-4c32-a7a1-6fe332f63e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:15.829568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0c010-42d7-4c32-a7a1-6fe332f63e7d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:15.850919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a81eb-9a41-4c57-afa6-728516a8b2e2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:15.877543 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4125/8218] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:21:15.883628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a81eb-9a41-4c57-afa6-728516a8b2e2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:15.889757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34709d5c-7d43-4871-9902-f2cde8f6bb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:15.890530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34709d5c-7d43-4871-9902-f2cde8f6bb31 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:15.890815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34709d5c-7d43-4871-9902-f2cde8f6bb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:15.891088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34709d5c-7d43-4871-9902-f2cde8f6bb31 admin admin] PATH_INFO: `/v3/projects/d70bddd20dac4a7e86efda4d13305ecd/users/397ada81c50e49a09997e801b70932aa/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:15.914836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34709d5c-7d43-4871-9902-f2cde8f6bb31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70bddd20dac4a7e86efda4d13305ecd, user_id=397ada81c50e49a09997e801b70932aa, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:15.918334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34709d5c-7d43-4871-9902-f2cde8f6bb31 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:15.946758 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4094/8219] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:21:15 2022] PUT /identity/v3/projects/d70bddd20dac4a7e86efda4d13305ecd/users/397ada81c50e49a09997e801b70932aa/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:21:15.957877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e437ba-5e94-43f9-bb58-e62078c95276 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:15.958222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e437ba-5e94-43f9-bb58-e62078c95276 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:15.958442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e437ba-5e94-43f9-bb58-e62078c95276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:16.022715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-00e437ba-5e94-43f9-bb58-e62078c95276 None None] MFA Rules not processed for user `397ada81c50e49a09997e801b70932aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:21:16.024064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-00e437ba-5e94-43f9-bb58-e62078c95276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:16.107329 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4126/8220] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:21:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:21:16.111704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34709d5c-7d43-4871-9902-f2cde8f6bb31 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:16.189524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34709d5c-7d43-4871-9902-f2cde8f6bb31 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:16.195370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27b7da-98d2-4256-81fa-a8900f94cf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:16.196241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27b7da-98d2-4256-81fa-a8900f94cf5a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:16.196715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27b7da-98d2-4256-81fa-a8900f94cf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:16.197141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27b7da-98d2-4256-81fa-a8900f94cf5a admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:16.197926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27b7da-98d2-4256-81fa-a8900f94cf5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:16.200585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27b7da-98d2-4256-81fa-a8900f94cf5a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:16.253233 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4095/8221] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:21:16 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:21:16.253660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e437ba-5e94-43f9-bb58-e62078c95276 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:16.269745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e437ba-5e94-43f9-bb58-e62078c95276 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:16.431383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d1d9f-267c-4bc8-a65f-be6325975851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:16.432020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d1d9f-267c-4bc8-a65f-be6325975851 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:16.432305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d1d9f-267c-4bc8-a65f-be6325975851 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:16.432582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d1d9f-267c-4bc8-a65f-be6325975851 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:16.436780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d1d9f-267c-4bc8-a65f-be6325975851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:16.438728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d1d9f-267c-4bc8-a65f-be6325975851 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:16.513121 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4127/8222] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:21:16 2022] POST /identity/v3/users => generated 292 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:21:16.514564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27b7da-98d2-4256-81fa-a8900f94cf5a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:16.531171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27b7da-98d2-4256-81fa-a8900f94cf5a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:16.541774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c3ebd-eff1-46d9-9bb0-b26fccab69e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:16.543311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c3ebd-eff1-46d9-9bb0-b26fccab69e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:16.544466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c3ebd-eff1-46d9-9bb0-b26fccab69e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:16.545031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c3ebd-eff1-46d9-9bb0-b26fccab69e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:16.545987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c3ebd-eff1-46d9-9bb0-b26fccab69e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:16.549845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c3ebd-eff1-46d9-9bb0-b26fccab69e4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:16.553195 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:16.579386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d1d9f-267c-4bc8-a65f-be6325975851 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:16.587954 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4096/8223] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:21:16.611548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d1d9f-267c-4bc8-a65f-be6325975851 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:16.621664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badc930-9884-4f98-84dc-9da1dd56caf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:16.622690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badc930-9884-4f98-84dc-9da1dd56caf1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:16.623132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badc930-9884-4f98-84dc-9da1dd56caf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:16.623557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badc930-9884-4f98-84dc-9da1dd56caf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:16.624352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0badc930-9884-4f98-84dc-9da1dd56caf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:16.626973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0badc930-9884-4f98-84dc-9da1dd56caf1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:16.641222 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4128/8224] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:21:16.646078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c3ebd-eff1-46d9-9bb0-b26fccab69e4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:16.658886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c3ebd-eff1-46d9-9bb0-b26fccab69e4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:16.678956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e4cba-e849-43ea-9e23-4c45f5f78331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:16.683834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e4cba-e849-43ea-9e23-4c45f5f78331 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:16.684758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e4cba-e849-43ea-9e23-4c45f5f78331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:16.684758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e4cba-e849-43ea-9e23-4c45f5f78331 admin admin] PATH_INFO: `/v3/projects/ef59f8f61d3a4fb7af3bb962ed93e72e/users/68e29c2f68c04f56be7f1e23fa381709/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:16.719141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e4cba-e849-43ea-9e23-4c45f5f78331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef59f8f61d3a4fb7af3bb962ed93e72e, user_id=68e29c2f68c04f56be7f1e23fa381709, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:16.723267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e4cba-e849-43ea-9e23-4c45f5f78331 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:16.773791 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4097/8225] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:21:16 2022] PUT /identity/v3/projects/ef59f8f61d3a4fb7af3bb962ed93e72e/users/68e29c2f68c04f56be7f1e23fa381709/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:21:16.775270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d3c45-e408-49e8-86ad-d2fc170cd4cf None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:16.775562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d3c45-e408-49e8-86ad-d2fc170cd4cf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:16.775840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d3c45-e408-49e8-86ad-d2fc170cd4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:16.787440 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:16.833850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-552d3c45-e408-49e8-86ad-d2fc170cd4cf None None] MFA Rules not processed for user `68e29c2f68c04f56be7f1e23fa381709`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:21:16.835837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-552d3c45-e408-49e8-86ad-d2fc170cd4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:16.977917 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4129/8226] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:21:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:21:16.980402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e4cba-e849-43ea-9e23-4c45f5f78331 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:17.118737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e4cba-e849-43ea-9e23-4c45f5f78331 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:17.127092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823b551-2d25-4f62-8dfa-b837220b320c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:17.127990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823b551-2d25-4f62-8dfa-b837220b320c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:17.128494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823b551-2d25-4f62-8dfa-b837220b320c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:17.128893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823b551-2d25-4f62-8dfa-b837220b320c admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:17.129686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823b551-2d25-4f62-8dfa-b837220b320c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:17.132092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823b551-2d25-4f62-8dfa-b837220b320c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:17.189147 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4098/8227] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:21:16 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:21:17.193488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d3c45-e408-49e8-86ad-d2fc170cd4cf None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:17.211462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d3c45-e408-49e8-86ad-d2fc170cd4cf None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:17.286062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa31b7-3f43-44b7-a5dc-8f3c0b5f2814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:17.287564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa31b7-3f43-44b7-a5dc-8f3c0b5f2814 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:17.288768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa31b7-3f43-44b7-a5dc-8f3c0b5f2814 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:17.289247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa31b7-3f43-44b7-a5dc-8f3c0b5f2814 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:17.291021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa31b7-3f43-44b7-a5dc-8f3c0b5f2814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:17.294451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa31b7-3f43-44b7-a5dc-8f3c0b5f2814 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:17.323667 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4130/8228] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:21:17 2022] POST /identity/v3/users => generated 299 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:21:17.328448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823b551-2d25-4f62-8dfa-b837220b320c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:17.339853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823b551-2d25-4f62-8dfa-b837220b320c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:17.345640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b5b86-3bcc-4fdc-a86d-4a4de7e4a05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:17.346308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b5b86-3bcc-4fdc-a86d-4a4de7e4a05e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:17.346599 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b5b86-3bcc-4fdc-a86d-4a4de7e4a05e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:17.346929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b5b86-3bcc-4fdc-a86d-4a4de7e4a05e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:17.347680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b5b86-3bcc-4fdc-a86d-4a4de7e4a05e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:17.349628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b5b86-3bcc-4fdc-a86d-4a4de7e4a05e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:17.362566 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4099/8229] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:21:17.366525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa31b7-3f43-44b7-a5dc-8f3c0b5f2814 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:17.379639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa31b7-3f43-44b7-a5dc-8f3c0b5f2814 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:17.395088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f103426-0548-4148-aaca-b102458267cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:17.395798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f103426-0548-4148-aaca-b102458267cb admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:17.396085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f103426-0548-4148-aaca-b102458267cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:17.396364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f103426-0548-4148-aaca-b102458267cb admin admin] PATH_INFO: `/v3/projects/a9eca601635a4152ba45f3971f70fe57/users/869b903393a94c2fb3deeb642f842abc/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:17.437723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f103426-0548-4148-aaca-b102458267cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9eca601635a4152ba45f3971f70fe57, user_id=869b903393a94c2fb3deeb642f842abc, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:17.443867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f103426-0548-4148-aaca-b102458267cb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:17.479956 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4131/8230] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:21:17 2022] PUT /identity/v3/projects/a9eca601635a4152ba45f3971f70fe57/users/869b903393a94c2fb3deeb642f842abc/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:21:17.484316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b5b86-3bcc-4fdc-a86d-4a4de7e4a05e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:17.503791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b5b86-3bcc-4fdc-a86d-4a4de7e4a05e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:17.668861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856eb5b-550a-4c2f-91c3-b2d8836a7606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:17.669499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856eb5b-550a-4c2f-91c3-b2d8836a7606 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:17.669785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856eb5b-550a-4c2f-91c3-b2d8836a7606 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:17.671015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856eb5b-550a-4c2f-91c3-b2d8836a7606 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:17.671673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856eb5b-550a-4c2f-91c3-b2d8836a7606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:17.674092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856eb5b-550a-4c2f-91c3-b2d8836a7606 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:17.700083 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4100/8231] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:21:17.711925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f103426-0548-4148-aaca-b102458267cb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:17.734242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f103426-0548-4148-aaca-b102458267cb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:17.747603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea00e25-152b-4ec7-8a6b-cd3f568ee9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:17.748349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea00e25-152b-4ec7-8a6b-cd3f568ee9f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:17.748711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea00e25-152b-4ec7-8a6b-cd3f568ee9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:17.748985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea00e25-152b-4ec7-8a6b-cd3f568ee9f2 admin admin] PATH_INFO: `/v3/projects/a9eca601635a4152ba45f3971f70fe57/users/869b903393a94c2fb3deeb642f842abc/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:17.751071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea00e25-152b-4ec7-8a6b-cd3f568ee9f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9eca601635a4152ba45f3971f70fe57, user_id=869b903393a94c2fb3deeb642f842abc, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:17.755014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea00e25-152b-4ec7-8a6b-cd3f568ee9f2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:17.775100 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4132/8232] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:21:17 2022] PUT /identity/v3/projects/a9eca601635a4152ba45f3971f70fe57/users/869b903393a94c2fb3deeb642f842abc/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:21:17.786766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842c0d2-0eb6-4de3-8e59-22433299fff6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:17.787058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842c0d2-0eb6-4de3-8e59-22433299fff6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:17.787351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842c0d2-0eb6-4de3-8e59-22433299fff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:17.827765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4842c0d2-0eb6-4de3-8e59-22433299fff6 None None] MFA Rules not processed for user `869b903393a94c2fb3deeb642f842abc`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:21:17.829281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4842c0d2-0eb6-4de3-8e59-22433299fff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:17.855711 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:18.012643 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4101/8233] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:21:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:21:18.018097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea00e25-152b-4ec7-8a6b-cd3f568ee9f2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:18.020300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cea00e25-152b-4ec7-8a6b-cd3f568ee9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:18.123721 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:18.137172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea00e25-152b-4ec7-8a6b-cd3f568ee9f2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:18.141496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba46a29-d7c0-456b-8824-a6575b7f94f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:18.142209 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba46a29-d7c0-456b-8824-a6575b7f94f7 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:18.142645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba46a29-d7c0-456b-8824-a6575b7f94f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:18.142985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba46a29-d7c0-456b-8824-a6575b7f94f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:18.250911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba46a29-d7c0-456b-8824-a6575b7f94f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:18.252852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba46a29-d7c0-456b-8824-a6575b7f94f7 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:18.285516 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4133/8234] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:21:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:21:21.248512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842c0d2-0eb6-4de3-8e59-22433299fff6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:21.267482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842c0d2-0eb6-4de3-8e59-22433299fff6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:21.279384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb64aa-8b46-47f0-b0cc-4049327bf3d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:21.280017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb64aa-8b46-47f0-b0cc-4049327bf3d8 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:21.280292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb64aa-8b46-47f0-b0cc-4049327bf3d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:21.280556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb64aa-8b46-47f0-b0cc-4049327bf3d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:21.350554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb64aa-8b46-47f0-b0cc-4049327bf3d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:21.352535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb64aa-8b46-47f0-b0cc-4049327bf3d8 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:21.374240 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4102/8235] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:21:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:21:22.142831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba46a29-d7c0-456b-8824-a6575b7f94f7 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:22.149976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eba46a29-d7c0-456b-8824-a6575b7f94f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:22.191347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba46a29-d7c0-456b-8824-a6575b7f94f7 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:22.211201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b870e-e04b-4d5c-bd59-5ab379e76c53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:22.212900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b870e-e04b-4d5c-bd59-5ab379e76c53 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:22.213403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b870e-e04b-4d5c-bd59-5ab379e76c53 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:22.213896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b870e-e04b-4d5c-bd59-5ab379e76c53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:22.258155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b870e-e04b-4d5c-bd59-5ab379e76c53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:22.268077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b870e-e04b-4d5c-bd59-5ab379e76c53 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:22.322591 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4134/8236] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:21:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:21:22.478733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc295c-473a-4b6d-b844-b9b58793e260 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:22.479502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc295c-473a-4b6d-b844-b9b58793e260 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:22.481294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc295c-473a-4b6d-b844-b9b58793e260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:22.518943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-43bc295c-473a-4b6d-b844-b9b58793e260 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:21:22.520679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-43bc295c-473a-4b6d-b844-b9b58793e260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:22.604515 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4103/8237] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 10:21:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:21:22.671314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b870e-e04b-4d5c-bd59-5ab379e76c53 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:22.672840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c79b870e-e04b-4d5c-bd59-5ab379e76c53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:22.829490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b870e-e04b-4d5c-bd59-5ab379e76c53 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:22.838195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8176dd4-697f-49e6-9302-46f60f5f6885 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:22.838940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8176dd4-697f-49e6-9302-46f60f5f6885 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:22.839845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8176dd4-697f-49e6-9302-46f60f5f6885 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:22.840143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8176dd4-697f-49e6-9302-46f60f5f6885 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:22.851692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8176dd4-697f-49e6-9302-46f60f5f6885 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:22.855915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8176dd4-697f-49e6-9302-46f60f5f6885 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:22.866367 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4135/8238] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:21:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:21:24.437812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc295c-473a-4b6d-b844-b9b58793e260 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:24.461908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc295c-473a-4b6d-b844-b9b58793e260 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:24.472593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b072298-e8e3-467a-a27a-bf5d392f756d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:24.473331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b072298-e8e3-467a-a27a-bf5d392f756d service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:24.473979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b072298-e8e3-467a-a27a-bf5d392f756d service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:24.474788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b072298-e8e3-467a-a27a-bf5d392f756d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:24.480032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1b072298-e8e3-467a-a27a-bf5d392f756d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:24.620958 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:24.643773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b072298-e8e3-467a-a27a-bf5d392f756d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:24.645543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b072298-e8e3-467a-a27a-bf5d392f756d service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:24.660168 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4104/8239] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:21:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:21:32.061770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8176dd4-697f-49e6-9302-46f60f5f6885 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:32.063742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c8176dd4-697f-49e6-9302-46f60f5f6885 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:32.214448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8176dd4-697f-49e6-9302-46f60f5f6885 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:32.227482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273fbba-d07c-4fb2-82a0-8d41ad5b52f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:32.228967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273fbba-d07c-4fb2-82a0-8d41ad5b52f2 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:32.229250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273fbba-d07c-4fb2-82a0-8d41ad5b52f2 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:32.230939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273fbba-d07c-4fb2-82a0-8d41ad5b52f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:32.234437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6273fbba-d07c-4fb2-82a0-8d41ad5b52f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:32.262507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b072298-e8e3-467a-a27a-bf5d392f756d service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:32.271996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273fbba-d07c-4fb2-82a0-8d41ad5b52f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:32.278720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273fbba-d07c-4fb2-82a0-8d41ad5b52f2 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:32.329900 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4136/8240] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:21:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:21:32.369884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b072298-e8e3-467a-a27a-bf5d392f756d service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:32.379224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03174d2c-1ce0-4631-ac9c-a897862bfc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:32.380206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03174d2c-1ce0-4631-ac9c-a897862bfc7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:32.380494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03174d2c-1ce0-4631-ac9c-a897862bfc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:32.380852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03174d2c-1ce0-4631-ac9c-a897862bfc7a admin admin] PATH_INFO: `/v3/users/397ada81c50e49a09997e801b70932aa` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:32.387887 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03174d2c-1ce0-4631-ac9c-a897862bfc7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=397ada81c50e49a09997e801b70932aa)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:32.391106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03174d2c-1ce0-4631-ac9c-a897862bfc7a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:32.477556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-03174d2c-1ce0-4631-ac9c-a897862bfc7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '397ada81c50e49a09997e801b70932aa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:32.504550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-03174d2c-1ce0-4631-ac9c-a897862bfc7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '397ada81c50e49a09997e801b70932aa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:32.507256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-03174d2c-1ce0-4631-ac9c-a897862bfc7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '397ada81c50e49a09997e801b70932aa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:32.530374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-03174d2c-1ce0-4631-ac9c-a897862bfc7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '397ada81c50e49a09997e801b70932aa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:32.541132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-03174d2c-1ce0-4631-ac9c-a897862bfc7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '397ada81c50e49a09997e801b70932aa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:32.553554 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4105/8241] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:21:32 2022] DELETE /identity/v3/users/397ada81c50e49a09997e801b70932aa => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:21:32.559122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc4ee4-4fd2-4edf-bd20-6ba61afff1a1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:32.559791 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc4ee4-4fd2-4edf-bd20-6ba61afff1a1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:32.560240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc4ee4-4fd2-4edf-bd20-6ba61afff1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:32.578947 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:32.629723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-eedc4ee4-4fd2-4edf-bd20-6ba61afff1a1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:21:32.633610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eedc4ee4-4fd2-4edf-bd20-6ba61afff1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:32.790249 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4137/8242] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:21:32.801548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03174d2c-1ce0-4631-ac9c-a897862bfc7a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:32.803543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-03174d2c-1ce0-4631-ac9c-a897862bfc7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:32.941693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03174d2c-1ce0-4631-ac9c-a897862bfc7a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:32.953685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acfca1-9f8f-42f7-8fd8-d257a775f908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:32.954328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acfca1-9f8f-42f7-8fd8-d257a775f908 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:32.954613 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acfca1-9f8f-42f7-8fd8-d257a775f908 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:32.954890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acfca1-9f8f-42f7-8fd8-d257a775f908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:32.982285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acfca1-9f8f-42f7-8fd8-d257a775f908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:32.984056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acfca1-9f8f-42f7-8fd8-d257a775f908 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:33.007606 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4106/8243] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:21:33.459347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc4ee4-4fd2-4edf-bd20-6ba61afff1a1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:33.461234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eedc4ee4-4fd2-4edf-bd20-6ba61afff1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:33.482449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc4ee4-4fd2-4edf-bd20-6ba61afff1a1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:33.491181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b4cc7-46ac-4534-b03c-517efd906a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:33.492265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b4cc7-46ac-4534-b03c-517efd906a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:33.492788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b4cc7-46ac-4534-b03c-517efd906a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:33.493330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b4cc7-46ac-4534-b03c-517efd906a5c admin admin] PATH_INFO: `/v3/projects/d70bddd20dac4a7e86efda4d13305ecd` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:33.495783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b4cc7-46ac-4534-b03c-517efd906a5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d70bddd20dac4a7e86efda4d13305ecd)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:33.498434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b4cc7-46ac-4534-b03c-517efd906a5c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:33.625634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2e0b4cc7-46ac-4534-b03c-517efd906a5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd70bddd20dac4a7e86efda4d13305ecd', 'request_id': 'req-2e0b4cc7-46ac-4534-b03c-517efd906a5c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:33.644622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2e0b4cc7-46ac-4534-b03c-517efd906a5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd70bddd20dac4a7e86efda4d13305ecd', 'request_id': 'req-2e0b4cc7-46ac-4534-b03c-517efd906a5c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:33.656437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2e0b4cc7-46ac-4534-b03c-517efd906a5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd70bddd20dac4a7e86efda4d13305ecd', 'request_id': 'req-2e0b4cc7-46ac-4534-b03c-517efd906a5c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:33.681371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2e0b4cc7-46ac-4534-b03c-517efd906a5c admin admin] The token cache is being invalidate because project d70bddd20dac4a7e86efda4d13305ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:21:33.682253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2e0b4cc7-46ac-4534-b03c-517efd906a5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:33.683224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2e0b4cc7-46ac-4534-b03c-517efd906a5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:33.686716 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4138/8244] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:21:33 2022] DELETE /identity/v3/projects/d70bddd20dac4a7e86efda4d13305ecd => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:21:33.690969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acfca1-9f8f-42f7-8fd8-d257a775f908 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:33.704278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acfca1-9f8f-42f7-8fd8-d257a775f908 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:33.712791 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:33.840470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531657e-5119-423e-8fb5-bf63c2ebe94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:33.841760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531657e-5119-423e-8fb5-bf63c2ebe94f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:33.842272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531657e-5119-423e-8fb5-bf63c2ebe94f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:33.842772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531657e-5119-423e-8fb5-bf63c2ebe94f admin admin] PATH_INFO: `/v3/users/68e29c2f68c04f56be7f1e23fa381709` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:33.844349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531657e-5119-423e-8fb5-bf63c2ebe94f admin admin] RBAC: Authorizing `identity:delete_user(user_id=68e29c2f68c04f56be7f1e23fa381709)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:33.846671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531657e-5119-423e-8fb5-bf63c2ebe94f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:33.960352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5531657e-5119-423e-8fb5-bf63c2ebe94f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68e29c2f68c04f56be7f1e23fa381709'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:33.976856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5531657e-5119-423e-8fb5-bf63c2ebe94f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68e29c2f68c04f56be7f1e23fa381709'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:33.978156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5531657e-5119-423e-8fb5-bf63c2ebe94f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68e29c2f68c04f56be7f1e23fa381709'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:34.007953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5531657e-5119-423e-8fb5-bf63c2ebe94f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68e29c2f68c04f56be7f1e23fa381709'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:34.025706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5531657e-5119-423e-8fb5-bf63c2ebe94f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68e29c2f68c04f56be7f1e23fa381709'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:34.043034 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4107/8245] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:21:33 2022] DELETE /identity/v3/users/68e29c2f68c04f56be7f1e23fa381709 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:21:34.606569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b4cc7-46ac-4534-b03c-517efd906a5c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:34.608640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2e0b4cc7-46ac-4534-b03c-517efd906a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:34.627032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b4cc7-46ac-4534-b03c-517efd906a5c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:34.761786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f2733-2e2d-474e-9607-d87c2ce20d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:34.762869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f2733-2e2d-474e-9607-d87c2ce20d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:34.763698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f2733-2e2d-474e-9607-d87c2ce20d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:34.764159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f2733-2e2d-474e-9607-d87c2ce20d07 admin admin] PATH_INFO: `/v3/projects/ef59f8f61d3a4fb7af3bb962ed93e72e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:34.769998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f2733-2e2d-474e-9607-d87c2ce20d07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef59f8f61d3a4fb7af3bb962ed93e72e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:34.771952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f2733-2e2d-474e-9607-d87c2ce20d07 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:34.883950 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:34.924210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0d0f2733-2e2d-474e-9607-d87c2ce20d07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef59f8f61d3a4fb7af3bb962ed93e72e', 'request_id': 'req-0d0f2733-2e2d-474e-9607-d87c2ce20d07'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:34.957676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0d0f2733-2e2d-474e-9607-d87c2ce20d07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef59f8f61d3a4fb7af3bb962ed93e72e', 'request_id': 'req-0d0f2733-2e2d-474e-9607-d87c2ce20d07'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:34.974655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0d0f2733-2e2d-474e-9607-d87c2ce20d07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef59f8f61d3a4fb7af3bb962ed93e72e', 'request_id': 'req-0d0f2733-2e2d-474e-9607-d87c2ce20d07'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:34.991243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0d0f2733-2e2d-474e-9607-d87c2ce20d07 admin admin] The token cache is being invalidate because project ef59f8f61d3a4fb7af3bb962ed93e72e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:21:34.991579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0d0f2733-2e2d-474e-9607-d87c2ce20d07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:34.992698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0d0f2733-2e2d-474e-9607-d87c2ce20d07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:34.994271 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4139/8246] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:21:34 2022] DELETE /identity/v3/projects/ef59f8f61d3a4fb7af3bb962ed93e72e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:21:34.999456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531657e-5119-423e-8fb5-bf63c2ebe94f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:35.001025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5531657e-5119-423e-8fb5-bf63c2ebe94f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:35.024722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531657e-5119-423e-8fb5-bf63c2ebe94f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:35.119458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513fd5b-df4a-4da6-bbc1-32fdb3975d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:35.123556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513fd5b-df4a-4da6-bbc1-32fdb3975d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:35.123842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513fd5b-df4a-4da6-bbc1-32fdb3975d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:35.124122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513fd5b-df4a-4da6-bbc1-32fdb3975d0f admin admin] PATH_INFO: `/v3/users/869b903393a94c2fb3deeb642f842abc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:35.125439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513fd5b-df4a-4da6-bbc1-32fdb3975d0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=869b903393a94c2fb3deeb642f842abc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:35.127380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513fd5b-df4a-4da6-bbc1-32fdb3975d0f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:35.200970 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:35.228320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a513fd5b-df4a-4da6-bbc1-32fdb3975d0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '869b903393a94c2fb3deeb642f842abc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:35.239606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a513fd5b-df4a-4da6-bbc1-32fdb3975d0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '869b903393a94c2fb3deeb642f842abc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:35.240250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a513fd5b-df4a-4da6-bbc1-32fdb3975d0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '869b903393a94c2fb3deeb642f842abc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:35.257808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a513fd5b-df4a-4da6-bbc1-32fdb3975d0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '869b903393a94c2fb3deeb642f842abc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:35.267153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a513fd5b-df4a-4da6-bbc1-32fdb3975d0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '869b903393a94c2fb3deeb642f842abc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:35.279067 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4108/8247] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:21:34 2022] DELETE /identity/v3/users/869b903393a94c2fb3deeb642f842abc => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:21:35.710349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f2733-2e2d-474e-9607-d87c2ce20d07 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:35.712273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0d0f2733-2e2d-474e-9607-d87c2ce20d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:35.731322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f2733-2e2d-474e-9607-d87c2ce20d07 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:35.877005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713f58e-0700-4faf-9ae1-3065213fec9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:35.877774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713f58e-0700-4faf-9ae1-3065213fec9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:35.878231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713f58e-0700-4faf-9ae1-3065213fec9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:35.878670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713f58e-0700-4faf-9ae1-3065213fec9a admin admin] PATH_INFO: `/v3/projects/a9eca601635a4152ba45f3971f70fe57` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:35.881939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713f58e-0700-4faf-9ae1-3065213fec9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9eca601635a4152ba45f3971f70fe57)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:35.885478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713f58e-0700-4faf-9ae1-3065213fec9a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:35.981713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e713f58e-0700-4faf-9ae1-3065213fec9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9eca601635a4152ba45f3971f70fe57', 'request_id': 'req-e713f58e-0700-4faf-9ae1-3065213fec9a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:35.991204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e713f58e-0700-4faf-9ae1-3065213fec9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9eca601635a4152ba45f3971f70fe57', 'request_id': 'req-e713f58e-0700-4faf-9ae1-3065213fec9a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:36.012334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e713f58e-0700-4faf-9ae1-3065213fec9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9eca601635a4152ba45f3971f70fe57', 'request_id': 'req-e713f58e-0700-4faf-9ae1-3065213fec9a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:36.028569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e713f58e-0700-4faf-9ae1-3065213fec9a admin admin] The token cache is being invalidate because project a9eca601635a4152ba45f3971f70fe57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:21:36.028949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e713f58e-0700-4faf-9ae1-3065213fec9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:36.029582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e713f58e-0700-4faf-9ae1-3065213fec9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:21:36.031493 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4140/8248] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:21:35 2022] DELETE /identity/v3/projects/a9eca601635a4152ba45f3971f70fe57 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:21:36.036719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b16765-8396-4c58-b167-2cb68ee65c4d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:36.037190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b16765-8396-4c58-b167-2cb68ee65c4d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:36.037301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b16765-8396-4c58-b167-2cb68ee65c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:36.094726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b2b16765-8396-4c58-b167-2cb68ee65c4d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:21:36.096241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b2b16765-8396-4c58-b167-2cb68ee65c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:36.206300 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4109/8249] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:21:36.219321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa445e0-0afb-4c35-af93-0e44bea5fa88 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:36.222156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa445e0-0afb-4c35-af93-0e44bea5fa88 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:36.223246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa445e0-0afb-4c35-af93-0e44bea5fa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:36.253610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0aa445e0-0afb-4c35-af93-0e44bea5fa88 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:21:36.255078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0aa445e0-0afb-4c35-af93-0e44bea5fa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:36.267170 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4141/8250] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:21:36.271296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b16765-8396-4c58-b167-2cb68ee65c4d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:36.285410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b16765-8396-4c58-b167-2cb68ee65c4d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:36.291315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d24635-9e5b-4bf5-936f-1ee80fc7358b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:36.293171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d24635-9e5b-4bf5-936f-1ee80fc7358b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:36.293525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d24635-9e5b-4bf5-936f-1ee80fc7358b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:36.293848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d24635-9e5b-4bf5-936f-1ee80fc7358b admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:36.294756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d24635-9e5b-4bf5-936f-1ee80fc7358b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:21:36.296028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d24635-9e5b-4bf5-936f-1ee80fc7358b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:36.297925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d24635-9e5b-4bf5-936f-1ee80fc7358b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:36.325498 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4110/8251] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:21:36.330100 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa445e0-0afb-4c35-af93-0e44bea5fa88 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:36.341849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa445e0-0afb-4c35-af93-0e44bea5fa88 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:36.348324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed346c-7fe5-4b3d-906c-c9cdbe648948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:36.349136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed346c-7fe5-4b3d-906c-c9cdbe648948 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:36.349820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed346c-7fe5-4b3d-906c-c9cdbe648948 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:36.350345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed346c-7fe5-4b3d-906c-c9cdbe648948 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:36.351237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed346c-7fe5-4b3d-906c-c9cdbe648948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:36.353767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed346c-7fe5-4b3d-906c-c9cdbe648948 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:36.419371 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4142/8252] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:21:36 2022] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:21:36.423908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d24635-9e5b-4bf5-936f-1ee80fc7358b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:36.442853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d24635-9e5b-4bf5-936f-1ee80fc7358b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:36.606190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4aa39e-5b7c-49da-b650-7f9843dc128d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:36.612670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4aa39e-5b7c-49da-b650-7f9843dc128d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:36.613136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4aa39e-5b7c-49da-b650-7f9843dc128d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:36.613514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4aa39e-5b7c-49da-b650-7f9843dc128d admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:36.614648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4aa39e-5b7c-49da-b650-7f9843dc128d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:36.624364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4aa39e-5b7c-49da-b650-7f9843dc128d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:36.687945 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4111/8253] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:21:36 2022] POST /identity/v3/users => generated 290 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:21:36.694015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed346c-7fe5-4b3d-906c-c9cdbe648948 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:36.718750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed346c-7fe5-4b3d-906c-c9cdbe648948 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:36.734195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68d718-8350-4ce6-8509-3c7bf35c8a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:36.737186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68d718-8350-4ce6-8509-3c7bf35c8a53 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:36.737639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68d718-8350-4ce6-8509-3c7bf35c8a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:36.738063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68d718-8350-4ce6-8509-3c7bf35c8a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:36.739942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68d718-8350-4ce6-8509-3c7bf35c8a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:36.746853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68d718-8350-4ce6-8509-3c7bf35c8a53 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:36.780633 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4143/8254] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:21:36.781532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4aa39e-5b7c-49da-b650-7f9843dc128d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:36.796163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4aa39e-5b7c-49da-b650-7f9843dc128d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:36.803478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7db00-0065-444e-8ef0-8a86eb1e245b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:36.804302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7db00-0065-444e-8ef0-8a86eb1e245b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:36.804769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7db00-0065-444e-8ef0-8a86eb1e245b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:36.805273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7db00-0065-444e-8ef0-8a86eb1e245b admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:36.806168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7db00-0065-444e-8ef0-8a86eb1e245b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:36.808829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7db00-0065-444e-8ef0-8a86eb1e245b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:36.813499 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:36.830516 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4112/8255] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:21:36.836320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68d718-8350-4ce6-8509-3c7bf35c8a53 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:36.849719 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:36.859034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68d718-8350-4ce6-8509-3c7bf35c8a53 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:36.868423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5086da1-7856-44f8-963e-29a482c055b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:36.869428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5086da1-7856-44f8-963e-29a482c055b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:36.870009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5086da1-7856-44f8-963e-29a482c055b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:36.870765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5086da1-7856-44f8-963e-29a482c055b2 admin admin] PATH_INFO: `/v3/projects/427b354a9d5e4ac99feb5b0b442fe2db/users/59228858ebcb4248953f52a1a4086cbc/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:36.897719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5086da1-7856-44f8-963e-29a482c055b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=427b354a9d5e4ac99feb5b0b442fe2db, user_id=59228858ebcb4248953f52a1a4086cbc, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:36.908543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5086da1-7856-44f8-963e-29a482c055b2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:36.954651 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4144/8256] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:21:36 2022] PUT /identity/v3/projects/427b354a9d5e4ac99feb5b0b442fe2db/users/59228858ebcb4248953f52a1a4086cbc/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:21:36.966099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946e383-6450-4d7d-9a7a-be96b8f5811c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:36.966598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946e383-6450-4d7d-9a7a-be96b8f5811c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:36.967053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946e383-6450-4d7d-9a7a-be96b8f5811c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:37.032383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d946e383-6450-4d7d-9a7a-be96b8f5811c None None] MFA Rules not processed for user `59228858ebcb4248953f52a1a4086cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:21:37.033819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d946e383-6450-4d7d-9a7a-be96b8f5811c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:37.166522 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4113/8257] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:21:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:21:37.175676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5086da1-7856-44f8-963e-29a482c055b2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:37.177538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d5086da1-7856-44f8-963e-29a482c055b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:37.345032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5086da1-7856-44f8-963e-29a482c055b2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:37.356720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca13d76-b70e-4584-8ad2-1e8b55aac920 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:37.357382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca13d76-b70e-4584-8ad2-1e8b55aac920 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:37.357815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca13d76-b70e-4584-8ad2-1e8b55aac920 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:37.358097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca13d76-b70e-4584-8ad2-1e8b55aac920 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:37.374272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca13d76-b70e-4584-8ad2-1e8b55aac920 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:37.376003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca13d76-b70e-4584-8ad2-1e8b55aac920 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:37.389488 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4145/8258] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:21:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:21:47.158585 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=33 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:47.382012 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=34,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:21:53.590139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946e383-6450-4d7d-9a7a-be96b8f5811c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:21:53.592853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d946e383-6450-4d7d-9a7a-be96b8f5811c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:53.782579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946e383-6450-4d7d-9a7a-be96b8f5811c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:21:53.804715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38318839-6f9f-495b-9c34-7408cea37252 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:21:53.806199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38318839-6f9f-495b-9c34-7408cea37252 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:53.806552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38318839-6f9f-495b-9c34-7408cea37252 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:53.806819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38318839-6f9f-495b-9c34-7408cea37252 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:53.816958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38318839-6f9f-495b-9c34-7408cea37252 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:21:53.818579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38318839-6f9f-495b-9c34-7408cea37252 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:21:53.831182 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4114/8259] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:21:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:21:58.045796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd07aa-2cd3-4c90-ad3f-fd6b28c38ced None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:21:58.046314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd07aa-2cd3-4c90-ad3f-fd6b28c38ced None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:21:58.046919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd07aa-2cd3-4c90-ad3f-fd6b28c38ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:21:58.100592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f1dd07aa-2cd3-4c90-ad3f-fd6b28c38ced None None] MFA Rules not processed for user `45a25acf184b4bfc9f1b06dcf0e6d81b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:21:58.102063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f1dd07aa-2cd3-4c90-ad3f-fd6b28c38ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:21:58.216925 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4146/8260] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:21:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:22:00.893372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38318839-6f9f-495b-9c34-7408cea37252 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:00.895681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-38318839-6f9f-495b-9c34-7408cea37252 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:01.063373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38318839-6f9f-495b-9c34-7408cea37252 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:01.077729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcdc07-3521-4143-a14a-617fb3849d1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:01.078488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcdc07-3521-4143-a14a-617fb3849d1c service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:01.079165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcdc07-3521-4143-a14a-617fb3849d1c service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:01.079760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcdc07-3521-4143-a14a-617fb3849d1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:01.081847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bbfcdc07-3521-4143-a14a-617fb3849d1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:01.127052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcdc07-3521-4143-a14a-617fb3849d1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:01.129226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcdc07-3521-4143-a14a-617fb3849d1c service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:01.156815 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4115/8261] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:22:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:22:05.094579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd07aa-2cd3-4c90-ad3f-fd6b28c38ced None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:05.137536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd07aa-2cd3-4c90-ad3f-fd6b28c38ced None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:05.145351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bcd41-f2b1-43ba-9ea3-216dfd0a90bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:05.146862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bcd41-f2b1-43ba-9ea3-216dfd0a90bf service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:05.147535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bcd41-f2b1-43ba-9ea3-216dfd0a90bf service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:05.148051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bcd41-f2b1-43ba-9ea3-216dfd0a90bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:05.151670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-573bcd41-f2b1-43ba-9ea3-216dfd0a90bf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:05.275988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bcd41-f2b1-43ba-9ea3-216dfd0a90bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:05.277882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bcd41-f2b1-43ba-9ea3-216dfd0a90bf service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:05.289483 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4147/8262] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:22:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 734 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:22:11.141289 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=64 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:15.285384 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=55 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:16.051046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227c5e2-403b-41b7-ae17-91da785aea36 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:16.051712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227c5e2-403b-41b7-ae17-91da785aea36 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:16.054248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227c5e2-403b-41b7-ae17-91da785aea36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:16.085567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5227c5e2-403b-41b7-ae17-91da785aea36 None None] MFA Rules not processed for user `fb9dee808083429a999cadea57b31908`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:16.087503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5227c5e2-403b-41b7-ae17-91da785aea36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:16.209739 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4116/8263] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:22:21.952460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bcd41-f2b1-43ba-9ea3-216dfd0a90bf service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:21.955703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-573bcd41-f2b1-43ba-9ea3-216dfd0a90bf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:22.191982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bcd41-f2b1-43ba-9ea3-216dfd0a90bf service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:22.202518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5167b-9097-4619-a7c3-f982e5c978ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:22.203183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5167b-9097-4619-a7c3-f982e5c978ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:22.203463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5167b-9097-4619-a7c3-f982e5c978ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:22.203884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5167b-9097-4619-a7c3-f982e5c978ac admin admin] PATH_INFO: `/v3/users/ea643b6aa318485bb9d5a92f2f3c5f03` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:22.205237 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5167b-9097-4619-a7c3-f982e5c978ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea643b6aa318485bb9d5a92f2f3c5f03)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:22.207333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5167b-9097-4619-a7c3-f982e5c978ac admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:22.297546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5da5167b-9097-4619-a7c3-f982e5c978ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea643b6aa318485bb9d5a92f2f3c5f03'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:22.298538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5da5167b-9097-4619-a7c3-f982e5c978ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea643b6aa318485bb9d5a92f2f3c5f03'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:22.307687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5da5167b-9097-4619-a7c3-f982e5c978ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea643b6aa318485bb9d5a92f2f3c5f03'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:22.323609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5da5167b-9097-4619-a7c3-f982e5c978ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea643b6aa318485bb9d5a92f2f3c5f03'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:22.332032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5da5167b-9097-4619-a7c3-f982e5c978ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea643b6aa318485bb9d5a92f2f3c5f03'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:22.341753 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4148/8264] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:22:21 2022] DELETE /identity/v3/users/ea643b6aa318485bb9d5a92f2f3c5f03 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:22:22.346288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b414679-59fc-4bae-9912-f493d819b398 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:22.346784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b414679-59fc-4bae-9912-f493d819b398 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:22.346911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b414679-59fc-4bae-9912-f493d819b398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:22.401348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4b414679-59fc-4bae-9912-f493d819b398 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:22.403706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4b414679-59fc-4bae-9912-f493d819b398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:22.529089 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4117/8265] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:22:22.540931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5167b-9097-4619-a7c3-f982e5c978ac admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:22.542464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5da5167b-9097-4619-a7c3-f982e5c978ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:22.713628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5167b-9097-4619-a7c3-f982e5c978ac admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:22.721225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c0322-1a57-42bc-b7c4-6f42c76da6fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:22.721857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c0322-1a57-42bc-b7c4-6f42c76da6fb service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:22.722497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c0322-1a57-42bc-b7c4-6f42c76da6fb service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:22.722917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c0322-1a57-42bc-b7c4-6f42c76da6fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:22.748430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c0322-1a57-42bc-b7c4-6f42c76da6fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:22.749987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c0322-1a57-42bc-b7c4-6f42c76da6fb service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:22.771206 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4149/8266] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:22:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:22:23.035031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b414679-59fc-4bae-9912-f493d819b398 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:23.036932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4b414679-59fc-4bae-9912-f493d819b398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:23.052288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b414679-59fc-4bae-9912-f493d819b398 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:23.058987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a113d-4188-4177-aee1-3fb5f35f6483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:23.060891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a113d-4188-4177-aee1-3fb5f35f6483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:23.061348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a113d-4188-4177-aee1-3fb5f35f6483 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:23.061795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a113d-4188-4177-aee1-3fb5f35f6483 admin admin] PATH_INFO: `/v3/projects/7243139ae23b4639aea75bd8c26116c4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:23.063230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a113d-4188-4177-aee1-3fb5f35f6483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7243139ae23b4639aea75bd8c26116c4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:23.065575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a113d-4188-4177-aee1-3fb5f35f6483 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:23.152426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f44a113d-4188-4177-aee1-3fb5f35f6483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7243139ae23b4639aea75bd8c26116c4', 'request_id': 'req-f44a113d-4188-4177-aee1-3fb5f35f6483'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:23.169101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f44a113d-4188-4177-aee1-3fb5f35f6483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7243139ae23b4639aea75bd8c26116c4', 'request_id': 'req-f44a113d-4188-4177-aee1-3fb5f35f6483'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:23.185881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f44a113d-4188-4177-aee1-3fb5f35f6483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7243139ae23b4639aea75bd8c26116c4', 'request_id': 'req-f44a113d-4188-4177-aee1-3fb5f35f6483'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:23.222477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f44a113d-4188-4177-aee1-3fb5f35f6483 admin admin] The token cache is being invalidate because project 7243139ae23b4639aea75bd8c26116c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:22:23.222771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f44a113d-4188-4177-aee1-3fb5f35f6483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:23.224997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f44a113d-4188-4177-aee1-3fb5f35f6483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:23.244209 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4118/8267] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:22:23 2022] DELETE /identity/v3/projects/7243139ae23b4639aea75bd8c26116c4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:22:23.249270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a8cd7-55f0-469a-a064-4445d496f781 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:23.249785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a8cd7-55f0-469a-a064-4445d496f781 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:23.249785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a8cd7-55f0-469a-a064-4445d496f781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:23.287195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-173a8cd7-55f0-469a-a064-4445d496f781 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:23.291226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-173a8cd7-55f0-469a-a064-4445d496f781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:23.319184 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:23.434363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2c5e5-13d4-4d75-9463-38d2539b7fad None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:23.435260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2c5e5-13d4-4d75-9463-38d2539b7fad None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:23.435686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2c5e5-13d4-4d75-9463-38d2539b7fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:23.437208 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4150/8268] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:22:23.482386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8ca2c5e5-13d4-4d75-9463-38d2539b7fad None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:23.484322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8ca2c5e5-13d4-4d75-9463-38d2539b7fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:23.501012 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4119/8269] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:22:23.503930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a8cd7-55f0-469a-a064-4445d496f781 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:23.523278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a8cd7-55f0-469a-a064-4445d496f781 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:23.535391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fe17b-c63f-4bcb-90f0-d11ed28f9f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:23.536178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fe17b-c63f-4bcb-90f0-d11ed28f9f8b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:23.536547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fe17b-c63f-4bcb-90f0-d11ed28f9f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:23.538019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fe17b-c63f-4bcb-90f0-d11ed28f9f8b admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:23.538768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419fe17b-c63f-4bcb-90f0-d11ed28f9f8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:22:23.539143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419fe17b-c63f-4bcb-90f0-d11ed28f9f8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:23.541012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419fe17b-c63f-4bcb-90f0-d11ed28f9f8b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:23.555953 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4151/8270] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:22:23.560469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2c5e5-13d4-4d75-9463-38d2539b7fad None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:23.579102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2c5e5-13d4-4d75-9463-38d2539b7fad None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:23.585769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ecf58-4043-4983-ba12-91700dbc4a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:23.587155 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ecf58-4043-4983-ba12-91700dbc4a9f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:23.587658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ecf58-4043-4983-ba12-91700dbc4a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:23.588131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ecf58-4043-4983-ba12-91700dbc4a9f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:23.589292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ecf58-4043-4983-ba12-91700dbc4a9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:23.591447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ecf58-4043-4983-ba12-91700dbc4a9f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:23.627408 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:23.640339 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4120/8271] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:22:23 2022] POST /identity/v3/projects => generated 359 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:22:23.641828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fe17b-c63f-4bcb-90f0-d11ed28f9f8b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:23.655689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fe17b-c63f-4bcb-90f0-d11ed28f9f8b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:23.731343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd6a80-9ed1-4dd5-8419-4cc570450905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:23.731981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd6a80-9ed1-4dd5-8419-4cc570450905 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:23.732241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd6a80-9ed1-4dd5-8419-4cc570450905 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:23.732519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd6a80-9ed1-4dd5-8419-4cc570450905 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:23.733475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd6a80-9ed1-4dd5-8419-4cc570450905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:23.735640 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd6a80-9ed1-4dd5-8419-4cc570450905 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:23.769835 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4152/8272] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:22:23 2022] POST /identity/v3/users => generated 280 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:22:23.771026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ecf58-4043-4983-ba12-91700dbc4a9f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:23.791697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ecf58-4043-4983-ba12-91700dbc4a9f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:23.799614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27148547-f85d-48af-858e-5be1be89c3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:23.800245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27148547-f85d-48af-858e-5be1be89c3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:23.800522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27148547-f85d-48af-858e-5be1be89c3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:23.800832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27148547-f85d-48af-858e-5be1be89c3c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:23.802203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27148547-f85d-48af-858e-5be1be89c3c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:23.804137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27148547-f85d-48af-858e-5be1be89c3c1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:23.818529 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4121/8273] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:22:23.823067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd6a80-9ed1-4dd5-8419-4cc570450905 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:23.847847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd6a80-9ed1-4dd5-8419-4cc570450905 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:23.858272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf07980-6be1-4519-aae4-d23130492c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:23.859341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf07980-6be1-4519-aae4-d23130492c84 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:23.859815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf07980-6be1-4519-aae4-d23130492c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:23.860282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf07980-6be1-4519-aae4-d23130492c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:23.861691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf07980-6be1-4519-aae4-d23130492c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:23.863427 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf07980-6be1-4519-aae4-d23130492c84 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:23.879823 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4153/8274] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:22:23.881010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27148547-f85d-48af-858e-5be1be89c3c1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:23.892297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27148547-f85d-48af-858e-5be1be89c3c1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:23.897678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a38daf-2aa1-4805-8330-5ac17f0db491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:23.898564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a38daf-2aa1-4805-8330-5ac17f0db491 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:23.899578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a38daf-2aa1-4805-8330-5ac17f0db491 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:23.900041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a38daf-2aa1-4805-8330-5ac17f0db491 admin admin] PATH_INFO: `/v3/projects/9c1e1c6855d2460baed5523cb12afd13/users/f60c91e7326c49d29739c074f9f00940/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:23.933533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a38daf-2aa1-4805-8330-5ac17f0db491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1e1c6855d2460baed5523cb12afd13, user_id=f60c91e7326c49d29739c074f9f00940, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:23.936438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a38daf-2aa1-4805-8330-5ac17f0db491 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:23.959681 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4122/8275] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:22:23 2022] PUT /identity/v3/projects/9c1e1c6855d2460baed5523cb12afd13/users/f60c91e7326c49d29739c074f9f00940/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:22:23.970278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9321a-6e38-4c3a-af75-3e159bcb5642 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:23.970568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9321a-6e38-4c3a-af75-3e159bcb5642 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:23.970844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9321a-6e38-4c3a-af75-3e159bcb5642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:24.016187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-87c9321a-6e38-4c3a-af75-3e159bcb5642 None None] MFA Rules not processed for user `f60c91e7326c49d29739c074f9f00940`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:24.017671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-87c9321a-6e38-4c3a-af75-3e159bcb5642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:24.124446 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4154/8276] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:22:24.145704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a38daf-2aa1-4805-8330-5ac17f0db491 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:24.148383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-14a38daf-2aa1-4805-8330-5ac17f0db491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:24.244764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a38daf-2aa1-4805-8330-5ac17f0db491 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:24.251156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53b5c7-0e35-4d0b-80eb-e3ca8730eba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:24.252618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53b5c7-0e35-4d0b-80eb-e3ca8730eba6 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:24.253092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53b5c7-0e35-4d0b-80eb-e3ca8730eba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:24.253512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53b5c7-0e35-4d0b-80eb-e3ca8730eba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:24.264780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53b5c7-0e35-4d0b-80eb-e3ca8730eba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:24.266547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53b5c7-0e35-4d0b-80eb-e3ca8730eba6 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:24.277119 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4123/8277] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:22:24 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:22:26.917745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9321a-6e38-4c3a-af75-3e159bcb5642 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:26.937999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9321a-6e38-4c3a-af75-3e159bcb5642 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:26.956796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be258f-adbc-4def-be84-5cb0543ffc12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:26.957874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be258f-adbc-4def-be84-5cb0543ffc12 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:26.958559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be258f-adbc-4def-be84-5cb0543ffc12 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:26.959061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be258f-adbc-4def-be84-5cb0543ffc12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:26.965035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-79be258f-adbc-4def-be84-5cb0543ffc12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:27.015525 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:27.093236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be258f-adbc-4def-be84-5cb0543ffc12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:27.095914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be258f-adbc-4def-be84-5cb0543ffc12 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:27.135133 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4155/8278] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:22:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:22:29.069101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53b5c7-0e35-4d0b-80eb-e3ca8730eba6 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:29.071695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6b53b5c7-0e35-4d0b-80eb-e3ca8730eba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:29.092862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53b5c7-0e35-4d0b-80eb-e3ca8730eba6 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:29.101381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7e5a3-eb10-4e78-aa07-9d3cb456306e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:29.101381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7e5a3-eb10-4e78-aa07-9d3cb456306e service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:29.101381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7e5a3-eb10-4e78-aa07-9d3cb456306e service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:29.101381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7e5a3-eb10-4e78-aa07-9d3cb456306e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:29.102371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-25f7e5a3-eb10-4e78-aa07-9d3cb456306e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:29.305831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7e5a3-eb10-4e78-aa07-9d3cb456306e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:29.307608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7e5a3-eb10-4e78-aa07-9d3cb456306e service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:29.332379 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4124/8279] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:22:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:22:35.697929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be258f-adbc-4def-be84-5cb0543ffc12 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:35.858855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be258f-adbc-4def-be84-5cb0543ffc12 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:35.880587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f792239-8deb-4108-8ad3-a690479c271a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:35.881637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f792239-8deb-4108-8ad3-a690479c271a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:35.882086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f792239-8deb-4108-8ad3-a690479c271a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:35.883146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f792239-8deb-4108-8ad3-a690479c271a admin admin] PATH_INFO: `/v3/users/f60c91e7326c49d29739c074f9f00940` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:35.884783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f792239-8deb-4108-8ad3-a690479c271a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f60c91e7326c49d29739c074f9f00940)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:35.887006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f792239-8deb-4108-8ad3-a690479c271a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:35.962637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3f792239-8deb-4108-8ad3-a690479c271a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f60c91e7326c49d29739c074f9f00940'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:35.964196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3f792239-8deb-4108-8ad3-a690479c271a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f60c91e7326c49d29739c074f9f00940'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:35.990854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3f792239-8deb-4108-8ad3-a690479c271a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f60c91e7326c49d29739c074f9f00940'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:36.015663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3f792239-8deb-4108-8ad3-a690479c271a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f60c91e7326c49d29739c074f9f00940'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:36.027085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3f792239-8deb-4108-8ad3-a690479c271a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f60c91e7326c49d29739c074f9f00940'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:36.035730 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4156/8280] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:22:35 2022] DELETE /identity/v3/users/f60c91e7326c49d29739c074f9f00940 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:22:36.042313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422cba3-c9b0-40a0-a107-3c9a6cd94107 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:36.043266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422cba3-c9b0-40a0-a107-3c9a6cd94107 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:36.043789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422cba3-c9b0-40a0-a107-3c9a6cd94107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:36.074149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f422cba3-c9b0-40a0-a107-3c9a6cd94107 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:36.075805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f422cba3-c9b0-40a0-a107-3c9a6cd94107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:36.300395 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:36.314918 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4125/8281] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:22:36.336543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f792239-8deb-4108-8ad3-a690479c271a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:36.341665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3f792239-8deb-4108-8ad3-a690479c271a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:36.468034 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:36.510458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f792239-8deb-4108-8ad3-a690479c271a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:36.515213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4688e-af90-4efb-9d64-eacc82a1f3ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:36.515961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4688e-af90-4efb-9d64-eacc82a1f3ef service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:36.516276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4688e-af90-4efb-9d64-eacc82a1f3ef service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:36.516592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4688e-af90-4efb-9d64-eacc82a1f3ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:36.528308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4688e-af90-4efb-9d64-eacc82a1f3ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:36.529836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4688e-af90-4efb-9d64-eacc82a1f3ef service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:36.541515 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4157/8282] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:22:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:22:36.868068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422cba3-c9b0-40a0-a107-3c9a6cd94107 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:36.869681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f422cba3-c9b0-40a0-a107-3c9a6cd94107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:36.889084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422cba3-c9b0-40a0-a107-3c9a6cd94107 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:36.905616 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e35f5-8b7a-4146-be0f-8cba9899fc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:36.906552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e35f5-8b7a-4146-be0f-8cba9899fc63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:36.906682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e35f5-8b7a-4146-be0f-8cba9899fc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:36.908532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e35f5-8b7a-4146-be0f-8cba9899fc63 admin admin] PATH_INFO: `/v3/projects/9c1e1c6855d2460baed5523cb12afd13` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:36.909576 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e35f5-8b7a-4146-be0f-8cba9899fc63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c1e1c6855d2460baed5523cb12afd13)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:36.911254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e35f5-8b7a-4146-be0f-8cba9899fc63 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:37.032788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f89e35f5-8b7a-4146-be0f-8cba9899fc63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c1e1c6855d2460baed5523cb12afd13', 'request_id': 'req-f89e35f5-8b7a-4146-be0f-8cba9899fc63'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:37.043093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f89e35f5-8b7a-4146-be0f-8cba9899fc63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c1e1c6855d2460baed5523cb12afd13', 'request_id': 'req-f89e35f5-8b7a-4146-be0f-8cba9899fc63'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:37.050501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f89e35f5-8b7a-4146-be0f-8cba9899fc63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c1e1c6855d2460baed5523cb12afd13', 'request_id': 'req-f89e35f5-8b7a-4146-be0f-8cba9899fc63'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:37.063757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f89e35f5-8b7a-4146-be0f-8cba9899fc63 admin admin] The token cache is being invalidate because project 9c1e1c6855d2460baed5523cb12afd13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:22:37.064107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f89e35f5-8b7a-4146-be0f-8cba9899fc63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:37.064830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f89e35f5-8b7a-4146-be0f-8cba9899fc63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:37.066896 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4126/8283] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:22:36 2022] DELETE /identity/v3/projects/9c1e1c6855d2460baed5523cb12afd13 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:22:37.072383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750d26d-04c7-4605-8afc-52225af51ed2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:37.073268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750d26d-04c7-4605-8afc-52225af51ed2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:37.073815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750d26d-04c7-4605-8afc-52225af51ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:37.098809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d750d26d-04c7-4605-8afc-52225af51ed2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:37.100257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d750d26d-04c7-4605-8afc-52225af51ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:37.198183 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4158/8284] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:22:37.206440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5070a1e-7df9-460c-9bdc-0c7708a13457 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:37.206738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5070a1e-7df9-460c-9bdc-0c7708a13457 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:37.207015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5070a1e-7df9-460c-9bdc-0c7708a13457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:37.233904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a5070a1e-7df9-460c-9bdc-0c7708a13457 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:37.236151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a5070a1e-7df9-460c-9bdc-0c7708a13457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:37.247873 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4127/8285] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:22:37.251997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750d26d-04c7-4605-8afc-52225af51ed2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:37.264091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750d26d-04c7-4605-8afc-52225af51ed2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:37.270834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78b963-f02d-41bd-8dd1-7df7449ad812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:37.271573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78b963-f02d-41bd-8dd1-7df7449ad812 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:37.271949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78b963-f02d-41bd-8dd1-7df7449ad812 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:37.272320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78b963-f02d-41bd-8dd1-7df7449ad812 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:37.273755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78b963-f02d-41bd-8dd1-7df7449ad812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:22:37.274269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78b963-f02d-41bd-8dd1-7df7449ad812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:37.275974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78b963-f02d-41bd-8dd1-7df7449ad812 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:37.291514 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4159/8286] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:22:37.295644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5070a1e-7df9-460c-9bdc-0c7708a13457 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:37.306941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5070a1e-7df9-460c-9bdc-0c7708a13457 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:37.312327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5738d4d-d757-45a1-b652-a6dd12992ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:37.313321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5738d4d-d757-45a1-b652-a6dd12992ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:37.313927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5738d4d-d757-45a1-b652-a6dd12992ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:37.314297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5738d4d-d757-45a1-b652-a6dd12992ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:37.315034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5738d4d-d757-45a1-b652-a6dd12992ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:37.317115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5738d4d-d757-45a1-b652-a6dd12992ca0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:37.356701 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4128/8287] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:22:37 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:22:37.357472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78b963-f02d-41bd-8dd1-7df7449ad812 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:37.370167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78b963-f02d-41bd-8dd1-7df7449ad812 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:37.449127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ba0b0-9dda-42ea-8148-c82d53a44073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:37.449883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ba0b0-9dda-42ea-8148-c82d53a44073 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:37.450276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ba0b0-9dda-42ea-8148-c82d53a44073 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:37.450637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ba0b0-9dda-42ea-8148-c82d53a44073 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:37.451529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ba0b0-9dda-42ea-8148-c82d53a44073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:37.453933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ba0b0-9dda-42ea-8148-c82d53a44073 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:37.486125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5738d4d-d757-45a1-b652-a6dd12992ca0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:37.496233 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4160/8288] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:22:37 2022] POST /identity/v3/users => generated 286 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:22:37.499016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5738d4d-d757-45a1-b652-a6dd12992ca0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:37.511269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01b2af-882f-48df-9af9-95b73d855d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:37.512127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01b2af-882f-48df-9af9-95b73d855d0b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:37.512487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01b2af-882f-48df-9af9-95b73d855d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:37.513024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01b2af-882f-48df-9af9-95b73d855d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:37.513758 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01b2af-882f-48df-9af9-95b73d855d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:37.515535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01b2af-882f-48df-9af9-95b73d855d0b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:37.528109 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4129/8289] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:22:37.532007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ba0b0-9dda-42ea-8148-c82d53a44073 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:37.542804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ba0b0-9dda-42ea-8148-c82d53a44073 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:37.548002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733be090-08af-4ed5-a5d9-4ec5d1dd783a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:37.549017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733be090-08af-4ed5-a5d9-4ec5d1dd783a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:37.549560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733be090-08af-4ed5-a5d9-4ec5d1dd783a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:37.549980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733be090-08af-4ed5-a5d9-4ec5d1dd783a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:37.550782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733be090-08af-4ed5-a5d9-4ec5d1dd783a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:37.552786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733be090-08af-4ed5-a5d9-4ec5d1dd783a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:37.573201 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4161/8290] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:22:37.573800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01b2af-882f-48df-9af9-95b73d855d0b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:37.584735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01b2af-882f-48df-9af9-95b73d855d0b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:37.590204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5fb6f-19ad-4529-a6cf-0da0100f9ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:37.591059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5fb6f-19ad-4529-a6cf-0da0100f9ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:37.591439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5fb6f-19ad-4529-a6cf-0da0100f9ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:37.591823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5fb6f-19ad-4529-a6cf-0da0100f9ee1 admin admin] PATH_INFO: `/v3/projects/c2c7de80310a4464b57e343fdb7c1f68/users/80ee9312e09f4322a8e878d7857844ad/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:37.608982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5fb6f-19ad-4529-a6cf-0da0100f9ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c7de80310a4464b57e343fdb7c1f68, user_id=80ee9312e09f4322a8e878d7857844ad, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:37.611842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5fb6f-19ad-4529-a6cf-0da0100f9ee1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:37.628648 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4130/8291] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:22:37 2022] PUT /identity/v3/projects/c2c7de80310a4464b57e343fdb7c1f68/users/80ee9312e09f4322a8e878d7857844ad/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:22:37.640364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f7dbf-50c6-423b-8c0e-6d0f5a516377 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:37.640698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f7dbf-50c6-423b-8c0e-6d0f5a516377 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:37.641038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f7dbf-50c6-423b-8c0e-6d0f5a516377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:37.670305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-535f7dbf-50c6-423b-8c0e-6d0f5a516377 None None] MFA Rules not processed for user `80ee9312e09f4322a8e878d7857844ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:37.671637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-535f7dbf-50c6-423b-8c0e-6d0f5a516377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:37.722711 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:37.764268 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4162/8292] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:22:37.769526 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5fb6f-19ad-4529-a6cf-0da0100f9ee1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:37.856983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5fb6f-19ad-4529-a6cf-0da0100f9ee1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:37.862669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bafa1-d315-454d-81ab-febbb297ede0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:37.863348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bafa1-d315-454d-81ab-febbb297ede0 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:37.863692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bafa1-d315-454d-81ab-febbb297ede0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:37.864023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bafa1-d315-454d-81ab-febbb297ede0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:37.864750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bafa1-d315-454d-81ab-febbb297ede0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:37.867337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bafa1-d315-454d-81ab-febbb297ede0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:37.905364 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:37.922275 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4131/8293] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:22:37 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:22:37.926200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f7dbf-50c6-423b-8c0e-6d0f5a516377 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:37.941408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f7dbf-50c6-423b-8c0e-6d0f5a516377 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:38.028392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5b752-feda-44f9-97f9-004d6b52737a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:38.028959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5b752-feda-44f9-97f9-004d6b52737a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:38.029251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5b752-feda-44f9-97f9-004d6b52737a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:38.029521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5b752-feda-44f9-97f9-004d6b52737a admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:38.030168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5b752-feda-44f9-97f9-004d6b52737a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:38.033560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5b752-feda-44f9-97f9-004d6b52737a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:38.072441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bafa1-d315-454d-81ab-febbb297ede0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:38.081776 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4163/8294] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:22:37 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:22:38.088749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bafa1-d315-454d-81ab-febbb297ede0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:38.095258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ce603-dfb4-4b44-94fc-da4d43ee99c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:38.096301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ce603-dfb4-4b44-94fc-da4d43ee99c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:38.096817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ce603-dfb4-4b44-94fc-da4d43ee99c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:38.097263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ce603-dfb4-4b44-94fc-da4d43ee99c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:38.098196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ce603-dfb4-4b44-94fc-da4d43ee99c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:38.100018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ce603-dfb4-4b44-94fc-da4d43ee99c1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:38.121244 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4132/8295] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:22:38.124502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5b752-feda-44f9-97f9-004d6b52737a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:38.154070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5b752-feda-44f9-97f9-004d6b52737a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:38.161940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103d42f-c048-4a19-83d3-360783ba4092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:38.162710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103d42f-c048-4a19-83d3-360783ba4092 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:38.163067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103d42f-c048-4a19-83d3-360783ba4092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:38.163532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103d42f-c048-4a19-83d3-360783ba4092 admin admin] PATH_INFO: `/v3/projects/5cd43ebb6c8c4355a3952151dbaec69e/users/c468b57863ba4ab1a6a6b02d1fac1363/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:38.202373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103d42f-c048-4a19-83d3-360783ba4092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd43ebb6c8c4355a3952151dbaec69e, user_id=c468b57863ba4ab1a6a6b02d1fac1363, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:38.206928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103d42f-c048-4a19-83d3-360783ba4092 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:38.236326 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4164/8296] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:22:38 2022] PUT /identity/v3/projects/5cd43ebb6c8c4355a3952151dbaec69e/users/c468b57863ba4ab1a6a6b02d1fac1363/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:22:38.238317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ce603-dfb4-4b44-94fc-da4d43ee99c1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:38.260486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ce603-dfb4-4b44-94fc-da4d43ee99c1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:38.357388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce47cc-7484-4a6b-b1be-b32b2bbb8b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:38.358143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce47cc-7484-4a6b-b1be-b32b2bbb8b19 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:38.358563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce47cc-7484-4a6b-b1be-b32b2bbb8b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:38.358942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce47cc-7484-4a6b-b1be-b32b2bbb8b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:38.359996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce47cc-7484-4a6b-b1be-b32b2bbb8b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:38.366590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce47cc-7484-4a6b-b1be-b32b2bbb8b19 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:38.392228 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4133/8297] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:22:38.393532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103d42f-c048-4a19-83d3-360783ba4092 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:38.406241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103d42f-c048-4a19-83d3-360783ba4092 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:38.411202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91580dfd-9ed9-48b1-ad8d-3f4407db651d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:38.415157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91580dfd-9ed9-48b1-ad8d-3f4407db651d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:38.415595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91580dfd-9ed9-48b1-ad8d-3f4407db651d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:38.417285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91580dfd-9ed9-48b1-ad8d-3f4407db651d admin admin] PATH_INFO: `/v3/projects/5cd43ebb6c8c4355a3952151dbaec69e/users/c468b57863ba4ab1a6a6b02d1fac1363/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:38.424242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91580dfd-9ed9-48b1-ad8d-3f4407db651d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd43ebb6c8c4355a3952151dbaec69e, user_id=c468b57863ba4ab1a6a6b02d1fac1363, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:38.436532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91580dfd-9ed9-48b1-ad8d-3f4407db651d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:38.449316 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4165/8298] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:22:38 2022] PUT /identity/v3/projects/5cd43ebb6c8c4355a3952151dbaec69e/users/c468b57863ba4ab1a6a6b02d1fac1363/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:22:38.459730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baa2c4-4db8-4b57-ae2c-05eab82e399a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:38.460015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baa2c4-4db8-4b57-ae2c-05eab82e399a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:38.460297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baa2c4-4db8-4b57-ae2c-05eab82e399a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:38.503487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-43baa2c4-4db8-4b57-ae2c-05eab82e399a None None] MFA Rules not processed for user `c468b57863ba4ab1a6a6b02d1fac1363`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:38.504890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-43baa2c4-4db8-4b57-ae2c-05eab82e399a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:38.600760 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4134/8299] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:22:38.613504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91580dfd-9ed9-48b1-ad8d-3f4407db651d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:38.621717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-91580dfd-9ed9-48b1-ad8d-3f4407db651d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:38.709912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91580dfd-9ed9-48b1-ad8d-3f4407db651d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:38.730580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f38e4-6fd9-470f-9097-6a43ae48b7e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:38.731509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f38e4-6fd9-470f-9097-6a43ae48b7e0 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:38.731944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f38e4-6fd9-470f-9097-6a43ae48b7e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:38.732372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f38e4-6fd9-470f-9097-6a43ae48b7e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:38.793607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f38e4-6fd9-470f-9097-6a43ae48b7e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:38.795235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f38e4-6fd9-470f-9097-6a43ae48b7e0 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:38.806792 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4166/8300] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:22:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:22:39.335512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baa2c4-4db8-4b57-ae2c-05eab82e399a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:39.424329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baa2c4-4db8-4b57-ae2c-05eab82e399a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:39.433049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d5ec2-3f4e-4cc0-b1df-003c518d4c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:39.434198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d5ec2-3f4e-4cc0-b1df-003c518d4c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:39.434667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d5ec2-3f4e-4cc0-b1df-003c518d4c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:39.441473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d5ec2-3f4e-4cc0-b1df-003c518d4c51 admin admin] PATH_INFO: `/v3/users/80ee9312e09f4322a8e878d7857844ad` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:39.443195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d5ec2-3f4e-4cc0-b1df-003c518d4c51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80ee9312e09f4322a8e878d7857844ad)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:39.445349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d5ec2-3f4e-4cc0-b1df-003c518d4c51 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:39.465504 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:39.518383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0c8d5ec2-3f4e-4cc0-b1df-003c518d4c51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80ee9312e09f4322a8e878d7857844ad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:39.536148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0c8d5ec2-3f4e-4cc0-b1df-003c518d4c51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80ee9312e09f4322a8e878d7857844ad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:39.537003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0c8d5ec2-3f4e-4cc0-b1df-003c518d4c51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80ee9312e09f4322a8e878d7857844ad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:39.555290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0c8d5ec2-3f4e-4cc0-b1df-003c518d4c51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80ee9312e09f4322a8e878d7857844ad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:39.569532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0c8d5ec2-3f4e-4cc0-b1df-003c518d4c51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80ee9312e09f4322a8e878d7857844ad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:39.580383 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4135/8301] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:22:39 2022] DELETE /identity/v3/users/80ee9312e09f4322a8e878d7857844ad => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:22:39.582614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79274e77-6b8d-4f77-a935-004ee375e1a4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:39.583106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79274e77-6b8d-4f77-a935-004ee375e1a4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:39.583203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79274e77-6b8d-4f77-a935-004ee375e1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:39.609175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-79274e77-6b8d-4f77-a935-004ee375e1a4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:39.609175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-79274e77-6b8d-4f77-a935-004ee375e1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:39.640768 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:39.696771 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4167/8302] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:22:39.707375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d5ec2-3f4e-4cc0-b1df-003c518d4c51 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:39.708831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0c8d5ec2-3f4e-4cc0-b1df-003c518d4c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:39.788465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d5ec2-3f4e-4cc0-b1df-003c518d4c51 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:39.798602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f128c10-266c-44f4-a0bd-588c5ada90a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:39.799626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f128c10-266c-44f4-a0bd-588c5ada90a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:39.799907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f128c10-266c-44f4-a0bd-588c5ada90a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:39.800179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f128c10-266c-44f4-a0bd-588c5ada90a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:39.815942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f128c10-266c-44f4-a0bd-588c5ada90a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:39.817904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f128c10-266c-44f4-a0bd-588c5ada90a7 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:39.828913 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4136/8303] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:22:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:22:40.218967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79274e77-6b8d-4f77-a935-004ee375e1a4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:40.229491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-79274e77-6b8d-4f77-a935-004ee375e1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:40.253780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79274e77-6b8d-4f77-a935-004ee375e1a4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:40.260868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa8ee0-95d6-4062-b4f9-292524b11f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:40.262083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa8ee0-95d6-4062-b4f9-292524b11f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:40.262845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa8ee0-95d6-4062-b4f9-292524b11f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:40.263299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa8ee0-95d6-4062-b4f9-292524b11f85 admin admin] PATH_INFO: `/v3/projects/c2c7de80310a4464b57e343fdb7c1f68` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:40.274517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa8ee0-95d6-4062-b4f9-292524b11f85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2c7de80310a4464b57e343fdb7c1f68)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:40.277368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa8ee0-95d6-4062-b4f9-292524b11f85 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:40.339359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-acfa8ee0-95d6-4062-b4f9-292524b11f85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2c7de80310a4464b57e343fdb7c1f68', 'request_id': 'req-acfa8ee0-95d6-4062-b4f9-292524b11f85'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:40.349318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-acfa8ee0-95d6-4062-b4f9-292524b11f85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2c7de80310a4464b57e343fdb7c1f68', 'request_id': 'req-acfa8ee0-95d6-4062-b4f9-292524b11f85'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:40.357530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-acfa8ee0-95d6-4062-b4f9-292524b11f85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2c7de80310a4464b57e343fdb7c1f68', 'request_id': 'req-acfa8ee0-95d6-4062-b4f9-292524b11f85'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:40.371496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-acfa8ee0-95d6-4062-b4f9-292524b11f85 admin admin] The token cache is being invalidate because project c2c7de80310a4464b57e343fdb7c1f68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:22:40.371794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-acfa8ee0-95d6-4062-b4f9-292524b11f85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:40.372517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-acfa8ee0-95d6-4062-b4f9-292524b11f85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:40.374177 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4168/8304] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:22:40 2022] DELETE /identity/v3/projects/c2c7de80310a4464b57e343fdb7c1f68 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:22:40.378228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f128c10-266c-44f4-a0bd-588c5ada90a7 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:40.389763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f128c10-266c-44f4-a0bd-588c5ada90a7 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:40.451744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2118c-71e4-495e-9bbb-2562db945cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:40.452388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2118c-71e4-495e-9bbb-2562db945cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:40.453154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2118c-71e4-495e-9bbb-2562db945cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:40.453611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2118c-71e4-495e-9bbb-2562db945cbf admin admin] PATH_INFO: `/v3/users/c468b57863ba4ab1a6a6b02d1fac1363` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:40.454785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2118c-71e4-495e-9bbb-2562db945cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c468b57863ba4ab1a6a6b02d1fac1363)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:40.456739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2118c-71e4-495e-9bbb-2562db945cbf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:40.522472 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:40.540475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d4a2118c-71e4-495e-9bbb-2562db945cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c468b57863ba4ab1a6a6b02d1fac1363'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:40.550384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d4a2118c-71e4-495e-9bbb-2562db945cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c468b57863ba4ab1a6a6b02d1fac1363'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:40.551022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d4a2118c-71e4-495e-9bbb-2562db945cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c468b57863ba4ab1a6a6b02d1fac1363'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:40.566976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d4a2118c-71e4-495e-9bbb-2562db945cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c468b57863ba4ab1a6a6b02d1fac1363'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:40.577379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d4a2118c-71e4-495e-9bbb-2562db945cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c468b57863ba4ab1a6a6b02d1fac1363'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:40.593710 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4137/8305] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:22:40 2022] DELETE /identity/v3/users/c468b57863ba4ab1a6a6b02d1fac1363 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:22:40.975183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa8ee0-95d6-4062-b4f9-292524b11f85 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:40.976908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-acfa8ee0-95d6-4062-b4f9-292524b11f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:40.990365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa8ee0-95d6-4062-b4f9-292524b11f85 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:41.064306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149d009-10f8-4317-8b14-85a775ca09be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:41.065333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149d009-10f8-4317-8b14-85a775ca09be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:41.065685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149d009-10f8-4317-8b14-85a775ca09be admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:41.066157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149d009-10f8-4317-8b14-85a775ca09be admin admin] PATH_INFO: `/v3/projects/5cd43ebb6c8c4355a3952151dbaec69e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:41.067357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149d009-10f8-4317-8b14-85a775ca09be admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd43ebb6c8c4355a3952151dbaec69e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:41.069368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149d009-10f8-4317-8b14-85a775ca09be admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:41.134397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9149d009-10f8-4317-8b14-85a775ca09be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd43ebb6c8c4355a3952151dbaec69e', 'request_id': 'req-9149d009-10f8-4317-8b14-85a775ca09be'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:41.137896 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:41.146415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9149d009-10f8-4317-8b14-85a775ca09be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd43ebb6c8c4355a3952151dbaec69e', 'request_id': 'req-9149d009-10f8-4317-8b14-85a775ca09be'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:41.155745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9149d009-10f8-4317-8b14-85a775ca09be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd43ebb6c8c4355a3952151dbaec69e', 'request_id': 'req-9149d009-10f8-4317-8b14-85a775ca09be'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:41.183342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9149d009-10f8-4317-8b14-85a775ca09be admin admin] The token cache is being invalidate because project 5cd43ebb6c8c4355a3952151dbaec69e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:22:41.183590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9149d009-10f8-4317-8b14-85a775ca09be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:41.184386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9149d009-10f8-4317-8b14-85a775ca09be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:41.186161 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4169/8306] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:22:40 2022] DELETE /identity/v3/projects/5cd43ebb6c8c4355a3952151dbaec69e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:22:41.192535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e334ea-2852-4a67-9735-e65c269acec4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:41.192835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e334ea-2852-4a67-9735-e65c269acec4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:41.192946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e334ea-2852-4a67-9735-e65c269acec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:41.215941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-23e334ea-2852-4a67-9735-e65c269acec4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:41.217266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-23e334ea-2852-4a67-9735-e65c269acec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:41.300807 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4138/8307] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:22:41.303393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881ddbf-7e9c-4014-9548-f0cc98184104 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:41.303871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881ddbf-7e9c-4014-9548-f0cc98184104 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:41.304343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881ddbf-7e9c-4014-9548-f0cc98184104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:41.328122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3881ddbf-7e9c-4014-9548-f0cc98184104 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:41.329542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3881ddbf-7e9c-4014-9548-f0cc98184104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:41.339065 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4170/8308] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:22:41.343884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e334ea-2852-4a67-9735-e65c269acec4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:41.354699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e334ea-2852-4a67-9735-e65c269acec4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:41.359523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb67bc6-1ea7-44d0-a20e-fdbbc5ba0a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:41.360330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb67bc6-1ea7-44d0-a20e-fdbbc5ba0a0b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:41.360716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb67bc6-1ea7-44d0-a20e-fdbbc5ba0a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:41.360969 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb67bc6-1ea7-44d0-a20e-fdbbc5ba0a0b admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:41.361753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb67bc6-1ea7-44d0-a20e-fdbbc5ba0a0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:22:41.362191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb67bc6-1ea7-44d0-a20e-fdbbc5ba0a0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:41.363691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb67bc6-1ea7-44d0-a20e-fdbbc5ba0a0b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:41.378854 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4139/8309] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:22:41.384708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881ddbf-7e9c-4014-9548-f0cc98184104 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:41.396873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881ddbf-7e9c-4014-9548-f0cc98184104 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:41.403480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003a7d3-9814-479d-ace0-5a75789df6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:41.404155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003a7d3-9814-479d-ace0-5a75789df6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:41.404472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003a7d3-9814-479d-ace0-5a75789df6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:41.404883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003a7d3-9814-479d-ace0-5a75789df6b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:41.405819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003a7d3-9814-479d-ace0-5a75789df6b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:41.408111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003a7d3-9814-479d-ace0-5a75789df6b5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:41.439912 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4171/8310] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:22:41 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:22:41.455161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb67bc6-1ea7-44d0-a20e-fdbbc5ba0a0b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:41.478951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb67bc6-1ea7-44d0-a20e-fdbbc5ba0a0b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:41.546738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc932bc8-44dd-411a-bf2e-839fb57f7899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:41.547349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc932bc8-44dd-411a-bf2e-839fb57f7899 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:41.547631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc932bc8-44dd-411a-bf2e-839fb57f7899 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:41.547905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc932bc8-44dd-411a-bf2e-839fb57f7899 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:41.548538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc932bc8-44dd-411a-bf2e-839fb57f7899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:41.550460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc932bc8-44dd-411a-bf2e-839fb57f7899 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:41.575213 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4140/8311] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:22:41 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:22:41.579095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003a7d3-9814-479d-ace0-5a75789df6b5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:41.590235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003a7d3-9814-479d-ace0-5a75789df6b5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:41.595033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb26e3-2de2-4d87-8c06-a75700f1c36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:41.595633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb26e3-2de2-4d87-8c06-a75700f1c36d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:41.595916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb26e3-2de2-4d87-8c06-a75700f1c36d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:41.596219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb26e3-2de2-4d87-8c06-a75700f1c36d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:41.596898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb26e3-2de2-4d87-8c06-a75700f1c36d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:41.598475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb26e3-2de2-4d87-8c06-a75700f1c36d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:41.608947 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4172/8312] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:22:41.612717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc932bc8-44dd-411a-bf2e-839fb57f7899 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:41.623545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc932bc8-44dd-411a-bf2e-839fb57f7899 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:41.629133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc51ea-a22f-4b11-89d9-4420c390f77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:41.629800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc51ea-a22f-4b11-89d9-4420c390f77b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:41.630094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc51ea-a22f-4b11-89d9-4420c390f77b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:41.630349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc51ea-a22f-4b11-89d9-4420c390f77b admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:41.630983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc51ea-a22f-4b11-89d9-4420c390f77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:41.633373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc51ea-a22f-4b11-89d9-4420c390f77b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:41.649808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb26e3-2de2-4d87-8c06-a75700f1c36d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:41.652710 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4141/8313] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:22:41.660357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb26e3-2de2-4d87-8c06-a75700f1c36d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:41.666008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7ffc4-0d8f-43fa-bf27-c6727cd66b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:41.666666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7ffc4-0d8f-43fa-bf27-c6727cd66b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:41.666949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7ffc4-0d8f-43fa-bf27-c6727cd66b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:41.667231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7ffc4-0d8f-43fa-bf27-c6727cd66b37 admin admin] PATH_INFO: `/v3/projects/61e20b2b504a4f80af35506e47c9ab4d/users/5528a2649af648e8ba3f3e8ed1bba025/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:41.683292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7ffc4-0d8f-43fa-bf27-c6727cd66b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e20b2b504a4f80af35506e47c9ab4d, user_id=5528a2649af648e8ba3f3e8ed1bba025, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:41.686023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7ffc4-0d8f-43fa-bf27-c6727cd66b37 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:41.708987 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4173/8314] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:22:41 2022] PUT /identity/v3/projects/61e20b2b504a4f80af35506e47c9ab4d/users/5528a2649af648e8ba3f3e8ed1bba025/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:22:41.715118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eadf6b-4af6-46fc-8575-08ff885945ad None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:41.715405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eadf6b-4af6-46fc-8575-08ff885945ad None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:41.715679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eadf6b-4af6-46fc-8575-08ff885945ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:41.751983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-28eadf6b-4af6-46fc-8575-08ff885945ad None None] MFA Rules not processed for user `5528a2649af648e8ba3f3e8ed1bba025`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:41.753380 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-28eadf6b-4af6-46fc-8575-08ff885945ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:41.758397 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:41.852747 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4142/8315] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:22:41.855692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7ffc4-0d8f-43fa-bf27-c6727cd66b37 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:41.946165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7ffc4-0d8f-43fa-bf27-c6727cd66b37 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:41.953728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32760b95-c890-4dee-a7a6-5fe370046b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:41.954637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32760b95-c890-4dee-a7a6-5fe370046b4d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:41.955033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32760b95-c890-4dee-a7a6-5fe370046b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:41.955405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32760b95-c890-4dee-a7a6-5fe370046b4d admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:41.956564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32760b95-c890-4dee-a7a6-5fe370046b4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:41.958978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32760b95-c890-4dee-a7a6-5fe370046b4d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:41.999943 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4174/8316] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:22:41 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:22:42.003737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eadf6b-4af6-46fc-8575-08ff885945ad None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:42.025256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eadf6b-4af6-46fc-8575-08ff885945ad None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:42.095123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25dd7d-dae4-4b52-8abb-49ae6e190401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:42.095739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25dd7d-dae4-4b52-8abb-49ae6e190401 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:42.096020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25dd7d-dae4-4b52-8abb-49ae6e190401 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:42.096339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25dd7d-dae4-4b52-8abb-49ae6e190401 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:42.097013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25dd7d-dae4-4b52-8abb-49ae6e190401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:42.098909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25dd7d-dae4-4b52-8abb-49ae6e190401 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:42.121966 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4143/8317] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:22:42 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:22:42.126145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32760b95-c890-4dee-a7a6-5fe370046b4d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:42.137951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32760b95-c890-4dee-a7a6-5fe370046b4d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:42.142703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ff082-950b-4755-b808-492f4195278c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:42.143324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ff082-950b-4755-b808-492f4195278c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:42.143599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ff082-950b-4755-b808-492f4195278c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:42.143869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ff082-950b-4755-b808-492f4195278c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:42.144517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ff082-950b-4755-b808-492f4195278c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:42.146243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ff082-950b-4755-b808-492f4195278c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:42.158053 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4175/8318] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:22:42.163052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25dd7d-dae4-4b52-8abb-49ae6e190401 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:42.174330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25dd7d-dae4-4b52-8abb-49ae6e190401 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:42.180213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933e828-c48a-4af0-a19d-5730b97dcdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:42.181181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933e828-c48a-4af0-a19d-5730b97dcdda admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:42.181469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933e828-c48a-4af0-a19d-5730b97dcdda admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:42.181830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933e828-c48a-4af0-a19d-5730b97dcdda admin admin] PATH_INFO: `/v3/projects/73fc0a95665248d98c949b38faf285e2/users/8d5cff905eb14aeea35dfe24de4bce83/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:42.205470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933e828-c48a-4af0-a19d-5730b97dcdda admin admin] RBAC: Authorizing `identity:create_grant(project_id=73fc0a95665248d98c949b38faf285e2, user_id=8d5cff905eb14aeea35dfe24de4bce83, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:42.208340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933e828-c48a-4af0-a19d-5730b97dcdda admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:42.225780 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4144/8319] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:22:42 2022] PUT /identity/v3/projects/73fc0a95665248d98c949b38faf285e2/users/8d5cff905eb14aeea35dfe24de4bce83/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:22:42.230048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ff082-950b-4755-b808-492f4195278c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:42.242116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ff082-950b-4755-b808-492f4195278c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:42.302845 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:42.320507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920a581-fa5a-4be2-8d5d-cce68ab5a137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:42.321309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920a581-fa5a-4be2-8d5d-cce68ab5a137 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:42.321669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920a581-fa5a-4be2-8d5d-cce68ab5a137 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:42.322222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920a581-fa5a-4be2-8d5d-cce68ab5a137 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:42.322929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920a581-fa5a-4be2-8d5d-cce68ab5a137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:42.324872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920a581-fa5a-4be2-8d5d-cce68ab5a137 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:42.340705 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4176/8320] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:22:42.342643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933e828-c48a-4af0-a19d-5730b97dcdda admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:42.354857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933e828-c48a-4af0-a19d-5730b97dcdda admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:42.359835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b3f7c-5794-48e8-bb65-886542a455e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:42.360648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b3f7c-5794-48e8-bb65-886542a455e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:42.360997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b3f7c-5794-48e8-bb65-886542a455e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:42.361330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b3f7c-5794-48e8-bb65-886542a455e0 admin admin] PATH_INFO: `/v3/projects/73fc0a95665248d98c949b38faf285e2/users/8d5cff905eb14aeea35dfe24de4bce83/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:42.363679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b3f7c-5794-48e8-bb65-886542a455e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73fc0a95665248d98c949b38faf285e2, user_id=8d5cff905eb14aeea35dfe24de4bce83, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:42.366493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b3f7c-5794-48e8-bb65-886542a455e0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:42.385116 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4145/8321] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:22:42 2022] PUT /identity/v3/projects/73fc0a95665248d98c949b38faf285e2/users/8d5cff905eb14aeea35dfe24de4bce83/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:22:42.395362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c33c27-4efb-42b1-9efd-d23f63f36643 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:42.395647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c33c27-4efb-42b1-9efd-d23f63f36643 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:42.395920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c33c27-4efb-42b1-9efd-d23f63f36643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:42.431802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-65c33c27-4efb-42b1-9efd-d23f63f36643 None None] MFA Rules not processed for user `8d5cff905eb14aeea35dfe24de4bce83`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:42.432959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-65c33c27-4efb-42b1-9efd-d23f63f36643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:42.529862 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4177/8322] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:42 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:22:42.538879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b3f7c-5794-48e8-bb65-886542a455e0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:42.540865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8f0b3f7c-5794-48e8-bb65-886542a455e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:42.649899 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b3f7c-5794-48e8-bb65-886542a455e0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:42.657622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd04657-ffb0-4052-ae61-b4fc2f33eaf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:42.659436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd04657-ffb0-4052-ae61-b4fc2f33eaf3 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:42.659717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd04657-ffb0-4052-ae61-b4fc2f33eaf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:42.660146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd04657-ffb0-4052-ae61-b4fc2f33eaf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:42.672480 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:42.731024 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd04657-ffb0-4052-ae61-b4fc2f33eaf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:42.732783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd04657-ffb0-4052-ae61-b4fc2f33eaf3 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:42.744475 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4146/8323] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:22:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:22:46.559227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c33c27-4efb-42b1-9efd-d23f63f36643 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:46.577116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c33c27-4efb-42b1-9efd-d23f63f36643 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:46.580927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b23eb-31b3-48b5-8c32-e8c9a679084c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:46.581922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b23eb-31b3-48b5-8c32-e8c9a679084c service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:46.582222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b23eb-31b3-48b5-8c32-e8c9a679084c service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:46.582494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b23eb-31b3-48b5-8c32-e8c9a679084c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:46.595097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b23eb-31b3-48b5-8c32-e8c9a679084c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:46.596836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b23eb-31b3-48b5-8c32-e8c9a679084c service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:46.608840 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4178/8324] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:22:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:22:51.579886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd04657-ffb0-4052-ae61-b4fc2f33eaf3 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:51.581624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0bd04657-ffb0-4052-ae61-b4fc2f33eaf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:51.673586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd04657-ffb0-4052-ae61-b4fc2f33eaf3 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:51.680319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b843c-ac78-4ac6-9dc6-b32918f1b684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:51.681207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b843c-ac78-4ac6-9dc6-b32918f1b684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:51.681499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b843c-ac78-4ac6-9dc6-b32918f1b684 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:51.681950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b843c-ac78-4ac6-9dc6-b32918f1b684 admin admin] PATH_INFO: `/v3/users/59228858ebcb4248953f52a1a4086cbc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:51.683756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b843c-ac78-4ac6-9dc6-b32918f1b684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59228858ebcb4248953f52a1a4086cbc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:51.687261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b843c-ac78-4ac6-9dc6-b32918f1b684 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:51.771866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-377b843c-ac78-4ac6-9dc6-b32918f1b684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59228858ebcb4248953f52a1a4086cbc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:51.782852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-377b843c-ac78-4ac6-9dc6-b32918f1b684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59228858ebcb4248953f52a1a4086cbc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:51.783662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-377b843c-ac78-4ac6-9dc6-b32918f1b684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59228858ebcb4248953f52a1a4086cbc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:51.801612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-377b843c-ac78-4ac6-9dc6-b32918f1b684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59228858ebcb4248953f52a1a4086cbc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:51.818308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-377b843c-ac78-4ac6-9dc6-b32918f1b684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59228858ebcb4248953f52a1a4086cbc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:51.839169 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4147/8325] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:22:51 2022] DELETE /identity/v3/users/59228858ebcb4248953f52a1a4086cbc => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:22:51.843606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0e01b-fd7e-4aa3-a932-53c7aaddb04d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:51.844227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0e01b-fd7e-4aa3-a932-53c7aaddb04d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:51.845059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0e01b-fd7e-4aa3-a932-53c7aaddb04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:51.868906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d8c0e01b-fd7e-4aa3-a932-53c7aaddb04d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:51.870294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d8c0e01b-fd7e-4aa3-a932-53c7aaddb04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:51.958190 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4179/8326] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:22:51.968693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b843c-ac78-4ac6-9dc6-b32918f1b684 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:51.970093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-377b843c-ac78-4ac6-9dc6-b32918f1b684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:52.010143 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:52.060809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b843c-ac78-4ac6-9dc6-b32918f1b684 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:52.066206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4b3e5-6458-4835-a2b8-a9e694e53d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:52.067040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4b3e5-6458-4835-a2b8-a9e694e53d3b service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:52.067475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4b3e5-6458-4835-a2b8-a9e694e53d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:52.067893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4b3e5-6458-4835-a2b8-a9e694e53d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:52.082026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4b3e5-6458-4835-a2b8-a9e694e53d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:52.083696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4b3e5-6458-4835-a2b8-a9e694e53d3b service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:52.095423 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4148/8327] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:22:52.469167 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0e01b-fd7e-4aa3-a932-53c7aaddb04d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:52.471438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d8c0e01b-fd7e-4aa3-a932-53c7aaddb04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:52.493425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0e01b-fd7e-4aa3-a932-53c7aaddb04d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:52.498666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6443bbc-93f7-4ffb-bbb2-65662856c0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:52.499703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6443bbc-93f7-4ffb-bbb2-65662856c0fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:52.499992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6443bbc-93f7-4ffb-bbb2-65662856c0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:52.500267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6443bbc-93f7-4ffb-bbb2-65662856c0fa admin admin] PATH_INFO: `/v3/projects/427b354a9d5e4ac99feb5b0b442fe2db` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:52.501505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6443bbc-93f7-4ffb-bbb2-65662856c0fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=427b354a9d5e4ac99feb5b0b442fe2db)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:52.503624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6443bbc-93f7-4ffb-bbb2-65662856c0fa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:52.589201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b6443bbc-93f7-4ffb-bbb2-65662856c0fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '427b354a9d5e4ac99feb5b0b442fe2db', 'request_id': 'req-b6443bbc-93f7-4ffb-bbb2-65662856c0fa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:52.593334 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:52.601630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b6443bbc-93f7-4ffb-bbb2-65662856c0fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '427b354a9d5e4ac99feb5b0b442fe2db', 'request_id': 'req-b6443bbc-93f7-4ffb-bbb2-65662856c0fa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:52.618398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b6443bbc-93f7-4ffb-bbb2-65662856c0fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '427b354a9d5e4ac99feb5b0b442fe2db', 'request_id': 'req-b6443bbc-93f7-4ffb-bbb2-65662856c0fa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:52.634592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b6443bbc-93f7-4ffb-bbb2-65662856c0fa admin admin] The token cache is being invalidate because project 427b354a9d5e4ac99feb5b0b442fe2db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:22:52.635072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b6443bbc-93f7-4ffb-bbb2-65662856c0fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:52.635870 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b6443bbc-93f7-4ffb-bbb2-65662856c0fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:52.638239 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4180/8328] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:22:52 2022] DELETE /identity/v3/projects/427b354a9d5e4ac99feb5b0b442fe2db => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:22:52.642897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c52c32-1394-416f-b4d0-5e841335f77a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:52.643705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c52c32-1394-416f-b4d0-5e841335f77a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:52.644134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c52c32-1394-416f-b4d0-5e841335f77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:52.665370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d8c52c32-1394-416f-b4d0-5e841335f77a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:52.666804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d8c52c32-1394-416f-b4d0-5e841335f77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:52.749862 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4149/8329] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:22:52.759680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f3293-c4a8-4839-a51a-b85de97dd3c0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:52.760004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f3293-c4a8-4839-a51a-b85de97dd3c0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:52.760286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f3293-c4a8-4839-a51a-b85de97dd3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:52.786057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-449f3293-c4a8-4839-a51a-b85de97dd3c0 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:52.796134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-449f3293-c4a8-4839-a51a-b85de97dd3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:52.810755 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4181/8330] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:22:52.817908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c52c32-1394-416f-b4d0-5e841335f77a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:52.854795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c52c32-1394-416f-b4d0-5e841335f77a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:52.867479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001764d2-afdc-44d6-83e5-b507de821189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:52.869127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001764d2-afdc-44d6-83e5-b507de821189 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:52.871268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001764d2-afdc-44d6-83e5-b507de821189 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:52.871802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001764d2-afdc-44d6-83e5-b507de821189 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:52.873039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001764d2-afdc-44d6-83e5-b507de821189 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:22:52.874676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001764d2-afdc-44d6-83e5-b507de821189 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:52.877473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001764d2-afdc-44d6-83e5-b507de821189 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:52.893421 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4150/8331] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:22:52.897662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f3293-c4a8-4839-a51a-b85de97dd3c0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:52.909553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f3293-c4a8-4839-a51a-b85de97dd3c0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:52.916973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fb698-84c5-4256-9b7b-41b9980c731d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:52.917796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fb698-84c5-4256-9b7b-41b9980c731d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:52.918186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fb698-84c5-4256-9b7b-41b9980c731d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:52.918462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fb698-84c5-4256-9b7b-41b9980c731d admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:52.919772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fb698-84c5-4256-9b7b-41b9980c731d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:52.922789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fb698-84c5-4256-9b7b-41b9980c731d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:53.015924 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4182/8332] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:22:52 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:22:53.017129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001764d2-afdc-44d6-83e5-b507de821189 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:53.039541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001764d2-afdc-44d6-83e5-b507de821189 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:53.128379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54710a95-10b7-4765-85a9-5f94de4e67c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:53.129191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54710a95-10b7-4765-85a9-5f94de4e67c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:53.129655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54710a95-10b7-4765-85a9-5f94de4e67c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:53.130070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54710a95-10b7-4765-85a9-5f94de4e67c4 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:53.131182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54710a95-10b7-4765-85a9-5f94de4e67c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:53.134304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54710a95-10b7-4765-85a9-5f94de4e67c4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:53.168648 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4151/8333] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:22:53 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:22:53.172705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fb698-84c5-4256-9b7b-41b9980c731d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:53.189367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fb698-84c5-4256-9b7b-41b9980c731d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:53.197812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1e5c4-9d74-4575-a97c-9fde6562a944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:53.198739 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1e5c4-9d74-4575-a97c-9fde6562a944 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:53.199199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1e5c4-9d74-4575-a97c-9fde6562a944 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:53.199477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1e5c4-9d74-4575-a97c-9fde6562a944 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:53.200221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1e5c4-9d74-4575-a97c-9fde6562a944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:53.202334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1e5c4-9d74-4575-a97c-9fde6562a944 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:53.215484 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4183/8334] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:22:53.220095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54710a95-10b7-4765-85a9-5f94de4e67c4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:53.234104 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54710a95-10b7-4765-85a9-5f94de4e67c4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:53.247124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaca4df-fbb5-4603-a617-ce20e6da133e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:53.248482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaca4df-fbb5-4603-a617-ce20e6da133e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:53.248994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaca4df-fbb5-4603-a617-ce20e6da133e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:53.249522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaca4df-fbb5-4603-a617-ce20e6da133e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:53.250600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaca4df-fbb5-4603-a617-ce20e6da133e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:53.253939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaca4df-fbb5-4603-a617-ce20e6da133e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:53.276807 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4152/8335] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:22:53.283438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1e5c4-9d74-4575-a97c-9fde6562a944 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:53.298258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1e5c4-9d74-4575-a97c-9fde6562a944 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:53.304812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd539f-8c9f-481b-b296-c4368c85c2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:53.305989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd539f-8c9f-481b-b296-c4368c85c2a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:53.306373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd539f-8c9f-481b-b296-c4368c85c2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:53.306745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd539f-8c9f-481b-b296-c4368c85c2a1 admin admin] PATH_INFO: `/v3/projects/240737c114e64e60aea490650707f2a4/users/f6fbeacf96384842aa7bf98023052b20/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:53.329148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd539f-8c9f-481b-b296-c4368c85c2a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=240737c114e64e60aea490650707f2a4, user_id=f6fbeacf96384842aa7bf98023052b20, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:53.332728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd539f-8c9f-481b-b296-c4368c85c2a1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:53.354209 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4184/8336] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:22:53 2022] PUT /identity/v3/projects/240737c114e64e60aea490650707f2a4/users/f6fbeacf96384842aa7bf98023052b20/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:22:53.365755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565c403-dff6-492e-ab5d-36fe6aec2eb5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:53.369090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565c403-dff6-492e-ab5d-36fe6aec2eb5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:53.369729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565c403-dff6-492e-ab5d-36fe6aec2eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:53.418255 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3565c403-dff6-492e-ab5d-36fe6aec2eb5 None None] MFA Rules not processed for user `f6fbeacf96384842aa7bf98023052b20`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:53.419499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3565c403-dff6-492e-ab5d-36fe6aec2eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:53.459547 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:53.526385 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4153/8337] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:22:53.539501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd539f-8c9f-481b-b296-c4368c85c2a1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:53.541301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-34cd539f-8c9f-481b-b296-c4368c85c2a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:53.629812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd539f-8c9f-481b-b296-c4368c85c2a1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:53.634813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ec897-5308-4ac1-afbd-8090ba6bb3aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:53.634813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ec897-5308-4ac1-afbd-8090ba6bb3aa service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:53.634813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ec897-5308-4ac1-afbd-8090ba6bb3aa service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:53.634813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ec897-5308-4ac1-afbd-8090ba6bb3aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:53.646150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ec897-5308-4ac1-afbd-8090ba6bb3aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:53.649283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ec897-5308-4ac1-afbd-8090ba6bb3aa service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:53.661099 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4185/8338] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:22:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:22:55.745761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565c403-dff6-492e-ab5d-36fe6aec2eb5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:55.747320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3565c403-dff6-492e-ab5d-36fe6aec2eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:55.827668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565c403-dff6-492e-ab5d-36fe6aec2eb5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:55.836773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42168127-c2d9-4226-9bda-f6b2b812350a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:55.837438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42168127-c2d9-4226-9bda-f6b2b812350a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:55.837788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42168127-c2d9-4226-9bda-f6b2b812350a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:55.841390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42168127-c2d9-4226-9bda-f6b2b812350a admin admin] PATH_INFO: `/v3/users/5528a2649af648e8ba3f3e8ed1bba025` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:55.842747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42168127-c2d9-4226-9bda-f6b2b812350a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5528a2649af648e8ba3f3e8ed1bba025)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:55.847375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42168127-c2d9-4226-9bda-f6b2b812350a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:55.948073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-42168127-c2d9-4226-9bda-f6b2b812350a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5528a2649af648e8ba3f3e8ed1bba025'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:55.961472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-42168127-c2d9-4226-9bda-f6b2b812350a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5528a2649af648e8ba3f3e8ed1bba025'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:55.963314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-42168127-c2d9-4226-9bda-f6b2b812350a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5528a2649af648e8ba3f3e8ed1bba025'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:55.996733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-42168127-c2d9-4226-9bda-f6b2b812350a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5528a2649af648e8ba3f3e8ed1bba025'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:56.008816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-42168127-c2d9-4226-9bda-f6b2b812350a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5528a2649af648e8ba3f3e8ed1bba025'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:56.015706 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4154/8339] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:22:55 2022] DELETE /identity/v3/users/5528a2649af648e8ba3f3e8ed1bba025 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:22:56.020417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d7a4a-630a-4b2e-9127-ed0c1bcc4ac4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:56.020922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d7a4a-630a-4b2e-9127-ed0c1bcc4ac4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:56.021028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d7a4a-630a-4b2e-9127-ed0c1bcc4ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:56.043127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-014d7a4a-630a-4b2e-9127-ed0c1bcc4ac4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:56.044489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-014d7a4a-630a-4b2e-9127-ed0c1bcc4ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:56.129922 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4186/8340] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:22:56.130790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42168127-c2d9-4226-9bda-f6b2b812350a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:56.133067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-42168127-c2d9-4226-9bda-f6b2b812350a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:56.219579 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:56.226574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42168127-c2d9-4226-9bda-f6b2b812350a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:56.236755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38275266-13b7-4a0b-98fe-ad489cb93660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:56.238420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38275266-13b7-4a0b-98fe-ad489cb93660 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:56.238960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38275266-13b7-4a0b-98fe-ad489cb93660 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:56.239511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38275266-13b7-4a0b-98fe-ad489cb93660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:56.258927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38275266-13b7-4a0b-98fe-ad489cb93660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:56.260484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38275266-13b7-4a0b-98fe-ad489cb93660 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:56.274758 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4155/8341] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:22:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:22:56.625807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d7a4a-630a-4b2e-9127-ed0c1bcc4ac4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:56.629271 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-014d7a4a-630a-4b2e-9127-ed0c1bcc4ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:56.651970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d7a4a-630a-4b2e-9127-ed0c1bcc4ac4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:56.658603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed665abf-32de-46f0-afc8-b2a4d8ab24a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:56.659430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed665abf-32de-46f0-afc8-b2a4d8ab24a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:56.659718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed665abf-32de-46f0-afc8-b2a4d8ab24a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:56.659991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed665abf-32de-46f0-afc8-b2a4d8ab24a4 admin admin] PATH_INFO: `/v3/projects/61e20b2b504a4f80af35506e47c9ab4d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:56.661610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed665abf-32de-46f0-afc8-b2a4d8ab24a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61e20b2b504a4f80af35506e47c9ab4d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:56.664680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed665abf-32de-46f0-afc8-b2a4d8ab24a4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:56.677079 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:56.727923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ed665abf-32de-46f0-afc8-b2a4d8ab24a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61e20b2b504a4f80af35506e47c9ab4d', 'request_id': 'req-ed665abf-32de-46f0-afc8-b2a4d8ab24a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:56.736056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ed665abf-32de-46f0-afc8-b2a4d8ab24a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61e20b2b504a4f80af35506e47c9ab4d', 'request_id': 'req-ed665abf-32de-46f0-afc8-b2a4d8ab24a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:56.750321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ed665abf-32de-46f0-afc8-b2a4d8ab24a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61e20b2b504a4f80af35506e47c9ab4d', 'request_id': 'req-ed665abf-32de-46f0-afc8-b2a4d8ab24a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:56.765125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ed665abf-32de-46f0-afc8-b2a4d8ab24a4 admin admin] The token cache is being invalidate because project 61e20b2b504a4f80af35506e47c9ab4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:22:56.765576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ed665abf-32de-46f0-afc8-b2a4d8ab24a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:56.766326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ed665abf-32de-46f0-afc8-b2a4d8ab24a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:56.768678 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4187/8342] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:22:56 2022] DELETE /identity/v3/projects/61e20b2b504a4f80af35506e47c9ab4d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:22:56.772014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38275266-13b7-4a0b-98fe-ad489cb93660 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:56.782265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38275266-13b7-4a0b-98fe-ad489cb93660 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:56.850131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e7b77-58a0-4976-88e0-9f4989189790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:56.850880 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e7b77-58a0-4976-88e0-9f4989189790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:56.851161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e7b77-58a0-4976-88e0-9f4989189790 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:56.851459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e7b77-58a0-4976-88e0-9f4989189790 admin admin] PATH_INFO: `/v3/users/8d5cff905eb14aeea35dfe24de4bce83` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:56.852756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e7b77-58a0-4976-88e0-9f4989189790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d5cff905eb14aeea35dfe24de4bce83)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:56.854757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e7b77-58a0-4976-88e0-9f4989189790 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:56.950524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f23e7b77-58a0-4976-88e0-9f4989189790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d5cff905eb14aeea35dfe24de4bce83'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:56.964066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f23e7b77-58a0-4976-88e0-9f4989189790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d5cff905eb14aeea35dfe24de4bce83'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:56.965305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f23e7b77-58a0-4976-88e0-9f4989189790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d5cff905eb14aeea35dfe24de4bce83'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:56.983911 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f23e7b77-58a0-4976-88e0-9f4989189790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d5cff905eb14aeea35dfe24de4bce83'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:56.993182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f23e7b77-58a0-4976-88e0-9f4989189790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d5cff905eb14aeea35dfe24de4bce83'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:57.000027 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4156/8343] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:22:56 2022] DELETE /identity/v3/users/8d5cff905eb14aeea35dfe24de4bce83 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:22:57.406751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed665abf-32de-46f0-afc8-b2a4d8ab24a4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:57.409249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ed665abf-32de-46f0-afc8-b2a4d8ab24a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:57.430571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed665abf-32de-46f0-afc8-b2a4d8ab24a4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:57.511137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de85bd-9641-4e7a-8eb1-d18dc661d5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:57.511993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de85bd-9641-4e7a-8eb1-d18dc661d5f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:57.512374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de85bd-9641-4e7a-8eb1-d18dc661d5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:57.512830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de85bd-9641-4e7a-8eb1-d18dc661d5f5 admin admin] PATH_INFO: `/v3/projects/73fc0a95665248d98c949b38faf285e2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:57.514385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de85bd-9641-4e7a-8eb1-d18dc661d5f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73fc0a95665248d98c949b38faf285e2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:57.516373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de85bd-9641-4e7a-8eb1-d18dc661d5f5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:57.593972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36de85bd-9641-4e7a-8eb1-d18dc661d5f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73fc0a95665248d98c949b38faf285e2', 'request_id': 'req-36de85bd-9641-4e7a-8eb1-d18dc661d5f5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:57.604751 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36de85bd-9641-4e7a-8eb1-d18dc661d5f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73fc0a95665248d98c949b38faf285e2', 'request_id': 'req-36de85bd-9641-4e7a-8eb1-d18dc661d5f5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:57.620941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36de85bd-9641-4e7a-8eb1-d18dc661d5f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73fc0a95665248d98c949b38faf285e2', 'request_id': 'req-36de85bd-9641-4e7a-8eb1-d18dc661d5f5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:57.634816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36de85bd-9641-4e7a-8eb1-d18dc661d5f5 admin admin] The token cache is being invalidate because project 73fc0a95665248d98c949b38faf285e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:22:57.635179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36de85bd-9641-4e7a-8eb1-d18dc661d5f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:57.635780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36de85bd-9641-4e7a-8eb1-d18dc661d5f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:22:57.637886 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4188/8344] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:22:57 2022] DELETE /identity/v3/projects/73fc0a95665248d98c949b38faf285e2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:22:57.643681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229d447-c7b2-41de-a76d-795d6e909b30 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:57.644001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229d447-c7b2-41de-a76d-795d6e909b30 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:57.644278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229d447-c7b2-41de-a76d-795d6e909b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:57.666330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2229d447-c7b2-41de-a76d-795d6e909b30 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:57.668153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2229d447-c7b2-41de-a76d-795d6e909b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:57.733150 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4157/8345] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:22:57.743699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e4313-8daf-49a8-9833-fadb80184297 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:57.747107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e4313-8daf-49a8-9833-fadb80184297 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:57.747621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e4313-8daf-49a8-9833-fadb80184297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:57.786862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a32e4313-8daf-49a8-9833-fadb80184297 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:57.789070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a32e4313-8daf-49a8-9833-fadb80184297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:57.797718 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4189/8346] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:22:57.801844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229d447-c7b2-41de-a76d-795d6e909b30 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:57.813674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229d447-c7b2-41de-a76d-795d6e909b30 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:57.820225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e6acd-f171-47cf-bafd-1506c7209f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:57.820904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e6acd-f171-47cf-bafd-1506c7209f54 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:57.821185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e6acd-f171-47cf-bafd-1506c7209f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:57.821462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e6acd-f171-47cf-bafd-1506c7209f54 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:57.822126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e6acd-f171-47cf-bafd-1506c7209f54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:22:57.822433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e6acd-f171-47cf-bafd-1506c7209f54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:57.824541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e6acd-f171-47cf-bafd-1506c7209f54 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:57.840942 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4158/8347] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:22:57.841400 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:57.848120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e4313-8daf-49a8-9833-fadb80184297 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:57.868264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e4313-8daf-49a8-9833-fadb80184297 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:57.873422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e352bca-43b5-452a-a616-524ba9108e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:57.874037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e352bca-43b5-452a-a616-524ba9108e53 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:57.874314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e352bca-43b5-452a-a616-524ba9108e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:57.874583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e352bca-43b5-452a-a616-524ba9108e53 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:57.875282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e352bca-43b5-452a-a616-524ba9108e53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:57.877352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e352bca-43b5-452a-a616-524ba9108e53 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:57.896902 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:57.926113 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4190/8348] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:22:57 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:22:57.931933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e6acd-f171-47cf-bafd-1506c7209f54 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:57.947396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e6acd-f171-47cf-bafd-1506c7209f54 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:58.014617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de367d8-dd87-4929-8783-a5c96e24cea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:58.015385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de367d8-dd87-4929-8783-a5c96e24cea5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:58.015726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de367d8-dd87-4929-8783-a5c96e24cea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:58.016273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de367d8-dd87-4929-8783-a5c96e24cea5 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:58.017033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de367d8-dd87-4929-8783-a5c96e24cea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:58.019333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de367d8-dd87-4929-8783-a5c96e24cea5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:58.055389 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4159/8349] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:22:57 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:22:58.064058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e352bca-43b5-452a-a616-524ba9108e53 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:58.077326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e352bca-43b5-452a-a616-524ba9108e53 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:58.082937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b18ba-ee5c-4403-b20f-71b0e7148651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:58.083630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b18ba-ee5c-4403-b20f-71b0e7148651 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:58.083961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b18ba-ee5c-4403-b20f-71b0e7148651 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:58.084298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b18ba-ee5c-4403-b20f-71b0e7148651 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:58.085529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b18ba-ee5c-4403-b20f-71b0e7148651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:58.087367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b18ba-ee5c-4403-b20f-71b0e7148651 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:58.098964 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4191/8350] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:22:58.103246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de367d8-dd87-4929-8783-a5c96e24cea5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:58.113844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de367d8-dd87-4929-8783-a5c96e24cea5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:58.119871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194af687-5b2a-4ee5-9671-008179af2f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:58.120724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af687-5b2a-4ee5-9671-008179af2f19 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:58.121076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af687-5b2a-4ee5-9671-008179af2f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:58.121418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af687-5b2a-4ee5-9671-008179af2f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:58.122131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194af687-5b2a-4ee5-9671-008179af2f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:58.123782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194af687-5b2a-4ee5-9671-008179af2f19 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:58.139659 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4160/8351] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:22:58.140851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b18ba-ee5c-4403-b20f-71b0e7148651 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:58.155827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b18ba-ee5c-4403-b20f-71b0e7148651 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:58.169069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3465d-1c77-4991-ac0d-ce5313c59540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:58.169778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3465d-1c77-4991-ac0d-ce5313c59540 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:58.170184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3465d-1c77-4991-ac0d-ce5313c59540 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:58.170467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3465d-1c77-4991-ac0d-ce5313c59540 admin admin] PATH_INFO: `/v3/projects/76a5f603fea24163b4ed2e648b3bf456/users/6e7c5ae2834543a4967899d6e2e13b82/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:58.188060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3465d-1c77-4991-ac0d-ce5313c59540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76a5f603fea24163b4ed2e648b3bf456, user_id=6e7c5ae2834543a4967899d6e2e13b82, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:58.190796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3465d-1c77-4991-ac0d-ce5313c59540 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:58.207990 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4192/8352] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:22:58 2022] PUT /identity/v3/projects/76a5f603fea24163b4ed2e648b3bf456/users/6e7c5ae2834543a4967899d6e2e13b82/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:22:58.219124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35a823-bf1a-4e37-8b9a-066b2b59f910 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:58.219413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35a823-bf1a-4e37-8b9a-066b2b59f910 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:58.219741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35a823-bf1a-4e37-8b9a-066b2b59f910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:58.254020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5a35a823-bf1a-4e37-8b9a-066b2b59f910 None None] MFA Rules not processed for user `6e7c5ae2834543a4967899d6e2e13b82`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:58.255411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5a35a823-bf1a-4e37-8b9a-066b2b59f910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:58.332638 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4161/8353] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:22:58.336008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3465d-1c77-4991-ac0d-ce5313c59540 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:58.415716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3465d-1c77-4991-ac0d-ce5313c59540 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:58.421980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d4229-ab70-4b45-977f-56d39e471421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:58.422765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d4229-ab70-4b45-977f-56d39e471421 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:58.430175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d4229-ab70-4b45-977f-56d39e471421 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:58.430175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d4229-ab70-4b45-977f-56d39e471421 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:58.430175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d4229-ab70-4b45-977f-56d39e471421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:58.430175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d4229-ab70-4b45-977f-56d39e471421 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:58.465698 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4193/8354] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:22:58 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:22:58.466230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35a823-bf1a-4e37-8b9a-066b2b59f910 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:58.485471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35a823-bf1a-4e37-8b9a-066b2b59f910 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:58.547863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c903ed-98b7-4924-870e-375af970a1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:58.548476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c903ed-98b7-4924-870e-375af970a1a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:58.548792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c903ed-98b7-4924-870e-375af970a1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:58.549064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c903ed-98b7-4924-870e-375af970a1a7 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:58.549704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c903ed-98b7-4924-870e-375af970a1a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:58.552041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c903ed-98b7-4924-870e-375af970a1a7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:58.564491 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:58.586030 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4162/8355] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:22:58 2022] POST /identity/v3/users => generated 299 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:22:58.587546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d4229-ab70-4b45-977f-56d39e471421 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:58.601368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d4229-ab70-4b45-977f-56d39e471421 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:58.606750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4daa7-1d80-46bf-91fb-ba8c86e76694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:58.607435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4daa7-1d80-46bf-91fb-ba8c86e76694 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:58.607780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4daa7-1d80-46bf-91fb-ba8c86e76694 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:58.608145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4daa7-1d80-46bf-91fb-ba8c86e76694 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:58.609055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4daa7-1d80-46bf-91fb-ba8c86e76694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:58.611079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4daa7-1d80-46bf-91fb-ba8c86e76694 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:58.634046 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4194/8356] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:22:58.638205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c903ed-98b7-4924-870e-375af970a1a7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:58.648888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c903ed-98b7-4924-870e-375af970a1a7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:58.653736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260f8c7-08c9-49b1-9d06-557cb98257ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:58.654522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260f8c7-08c9-49b1-9d06-557cb98257ff admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:58.655017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260f8c7-08c9-49b1-9d06-557cb98257ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:58.655394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260f8c7-08c9-49b1-9d06-557cb98257ff admin admin] PATH_INFO: `/v3/projects/5d8073d7e8254ce3844eb6b8ac26eee6/users/6901952fa579437eab2f92775304eab1/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:58.671341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260f8c7-08c9-49b1-9d06-557cb98257ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8073d7e8254ce3844eb6b8ac26eee6, user_id=6901952fa579437eab2f92775304eab1, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:58.674246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260f8c7-08c9-49b1-9d06-557cb98257ff admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:58.692179 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4163/8357] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:22:58 2022] PUT /identity/v3/projects/5d8073d7e8254ce3844eb6b8ac26eee6/users/6901952fa579437eab2f92775304eab1/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:22:58.697927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4daa7-1d80-46bf-91fb-ba8c86e76694 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:58.716064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4daa7-1d80-46bf-91fb-ba8c86e76694 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:58.782197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b996cad-52e2-44b2-86d5-bbc1649540ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:58.782811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b996cad-52e2-44b2-86d5-bbc1649540ee admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:58.783092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b996cad-52e2-44b2-86d5-bbc1649540ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:58.783374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b996cad-52e2-44b2-86d5-bbc1649540ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:58.784011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b996cad-52e2-44b2-86d5-bbc1649540ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:58.785675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b996cad-52e2-44b2-86d5-bbc1649540ee admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:58.797217 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4195/8358] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:22:58.801157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260f8c7-08c9-49b1-9d06-557cb98257ff admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:58.813602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260f8c7-08c9-49b1-9d06-557cb98257ff admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:58.818800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e0737-d7bb-4e92-a739-142579f2c45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:58.819680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e0737-d7bb-4e92-a739-142579f2c45b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:58.820072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e0737-d7bb-4e92-a739-142579f2c45b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:58.820533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e0737-d7bb-4e92-a739-142579f2c45b admin admin] PATH_INFO: `/v3/projects/5d8073d7e8254ce3844eb6b8ac26eee6/users/6901952fa579437eab2f92775304eab1/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:58.822625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e0737-d7bb-4e92-a739-142579f2c45b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8073d7e8254ce3844eb6b8ac26eee6, user_id=6901952fa579437eab2f92775304eab1, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:58.827393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e0737-d7bb-4e92-a739-142579f2c45b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:58.840061 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4164/8359] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:22:58 2022] PUT /identity/v3/projects/5d8073d7e8254ce3844eb6b8ac26eee6/users/6901952fa579437eab2f92775304eab1/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:22:58.851098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd660288-e0de-4d29-9f48-a8ce6c67d8f1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:58.851442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd660288-e0de-4d29-9f48-a8ce6c67d8f1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:58.851722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd660288-e0de-4d29-9f48-a8ce6c67d8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:58.885086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-dd660288-e0de-4d29-9f48-a8ce6c67d8f1 None None] MFA Rules not processed for user `6901952fa579437eab2f92775304eab1`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:22:58.886589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dd660288-e0de-4d29-9f48-a8ce6c67d8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:58.921687 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:22:58.976488 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4196/8360] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:22:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:22:58.987434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e0737-d7bb-4e92-a739-142579f2c45b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:22:58.989215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-626e0737-d7bb-4e92-a739-142579f2c45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:22:59.066790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e0737-d7bb-4e92-a739-142579f2c45b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:22:59.072284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f1ba8-1294-4149-94f6-3d05f1917b94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:22:59.072957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f1ba8-1294-4149-94f6-3d05f1917b94 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:22:59.073228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f1ba8-1294-4149-94f6-3d05f1917b94 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:22:59.073759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f1ba8-1294-4149-94f6-3d05f1917b94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:22:59.149048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f1ba8-1294-4149-94f6-3d05f1917b94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:22:59.152370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f1ba8-1294-4149-94f6-3d05f1917b94 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:22:59.164778 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4165/8361] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:22:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:23:03.681329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd660288-e0de-4d29-9f48-a8ce6c67d8f1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:03.694466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd660288-e0de-4d29-9f48-a8ce6c67d8f1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:03.698165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a3c34-491b-441c-ba25-f0b69238e756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:03.699029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a3c34-491b-441c-ba25-f0b69238e756 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:03.699304 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a3c34-491b-441c-ba25-f0b69238e756 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:03.699577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a3c34-491b-441c-ba25-f0b69238e756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:03.709066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a3c34-491b-441c-ba25-f0b69238e756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:03.710926 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a3c34-491b-441c-ba25-f0b69238e756 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:03.720684 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4197/8362] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:23:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:23:09.159044 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=65,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:09.750946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f1ba8-1294-4149-94f6-3d05f1917b94 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:09.754222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-758f1ba8-1294-4149-94f6-3d05f1917b94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:09.894985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f1ba8-1294-4149-94f6-3d05f1917b94 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:09.903272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c364bb7-37e7-4659-b137-5354f4afff52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:09.904373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c364bb7-37e7-4659-b137-5354f4afff52 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:09.905001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c364bb7-37e7-4659-b137-5354f4afff52 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:09.905462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c364bb7-37e7-4659-b137-5354f4afff52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:09.907885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7c364bb7-37e7-4659-b137-5354f4afff52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:10.102981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c364bb7-37e7-4659-b137-5354f4afff52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:10.107485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c364bb7-37e7-4659-b137-5354f4afff52 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:10.166703 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4166/8363] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:23:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:23:12.392340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a3c34-491b-441c-ba25-f0b69238e756 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:12.394607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eb9a3c34-491b-441c-ba25-f0b69238e756 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:12.682007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a3c34-491b-441c-ba25-f0b69238e756 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:12.712356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c8cd5-1ba5-44ba-ba0f-55ec86335b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:12.714132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c8cd5-1ba5-44ba-ba0f-55ec86335b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:12.720893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c8cd5-1ba5-44ba-ba0f-55ec86335b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:12.721565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c8cd5-1ba5-44ba-ba0f-55ec86335b22 admin admin] PATH_INFO: `/v3/users/f6fbeacf96384842aa7bf98023052b20` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:12.724146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c8cd5-1ba5-44ba-ba0f-55ec86335b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6fbeacf96384842aa7bf98023052b20)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:12.729535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c8cd5-1ba5-44ba-ba0f-55ec86335b22 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:12.863763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-302c8cd5-1ba5-44ba-ba0f-55ec86335b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6fbeacf96384842aa7bf98023052b20'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:12.864649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-302c8cd5-1ba5-44ba-ba0f-55ec86335b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6fbeacf96384842aa7bf98023052b20'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:12.877199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-302c8cd5-1ba5-44ba-ba0f-55ec86335b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6fbeacf96384842aa7bf98023052b20'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:12.905056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-302c8cd5-1ba5-44ba-ba0f-55ec86335b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6fbeacf96384842aa7bf98023052b20'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:12.925977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-302c8cd5-1ba5-44ba-ba0f-55ec86335b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6fbeacf96384842aa7bf98023052b20'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:12.942466 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4198/8364] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:23:12 2022] DELETE /identity/v3/users/f6fbeacf96384842aa7bf98023052b20 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:12.947093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1f364-b940-41db-b16d-9db3a0f375ae None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:12.947606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1f364-b940-41db-b16d-9db3a0f375ae None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:12.947693 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1f364-b940-41db-b16d-9db3a0f375ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:12.973481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4ac1f364-b940-41db-b16d-9db3a0f375ae None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:12.975158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4ac1f364-b940-41db-b16d-9db3a0f375ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:13.091598 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4167/8365] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:23:13.101585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c8cd5-1ba5-44ba-ba0f-55ec86335b22 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:13.103609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-302c8cd5-1ba5-44ba-ba0f-55ec86335b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:13.138644 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:13.202371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c8cd5-1ba5-44ba-ba0f-55ec86335b22 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:13.211444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943891f7-8ea3-4d58-96fc-8b79b205c4a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:13.213485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943891f7-8ea3-4d58-96fc-8b79b205c4a5 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:13.213878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943891f7-8ea3-4d58-96fc-8b79b205c4a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:13.215193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943891f7-8ea3-4d58-96fc-8b79b205c4a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:13.237245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943891f7-8ea3-4d58-96fc-8b79b205c4a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:13.239081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943891f7-8ea3-4d58-96fc-8b79b205c4a5 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:13.264619 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4199/8366] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:23:13.653625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1f364-b940-41db-b16d-9db3a0f375ae None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:13.655273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4ac1f364-b940-41db-b16d-9db3a0f375ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:13.668338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1f364-b940-41db-b16d-9db3a0f375ae None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:13.673173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc4424-49e3-45d9-9e2f-774fe1744e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:13.673815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc4424-49e3-45d9-9e2f-774fe1744e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:13.674672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc4424-49e3-45d9-9e2f-774fe1744e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:13.674948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc4424-49e3-45d9-9e2f-774fe1744e34 admin admin] PATH_INFO: `/v3/projects/240737c114e64e60aea490650707f2a4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:13.676535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc4424-49e3-45d9-9e2f-774fe1744e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=240737c114e64e60aea490650707f2a4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:13.679090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc4424-49e3-45d9-9e2f-774fe1744e34 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:13.743066 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:13.764153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-defc4424-49e3-45d9-9e2f-774fe1744e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '240737c114e64e60aea490650707f2a4', 'request_id': 'req-defc4424-49e3-45d9-9e2f-774fe1744e34'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:13.779729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-defc4424-49e3-45d9-9e2f-774fe1744e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '240737c114e64e60aea490650707f2a4', 'request_id': 'req-defc4424-49e3-45d9-9e2f-774fe1744e34'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:13.790131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-defc4424-49e3-45d9-9e2f-774fe1744e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '240737c114e64e60aea490650707f2a4', 'request_id': 'req-defc4424-49e3-45d9-9e2f-774fe1744e34'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:13.811419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-defc4424-49e3-45d9-9e2f-774fe1744e34 admin admin] The token cache is being invalidate because project 240737c114e64e60aea490650707f2a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:23:13.811736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-defc4424-49e3-45d9-9e2f-774fe1744e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:13.812364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-defc4424-49e3-45d9-9e2f-774fe1744e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:13.814090 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4168/8367] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:23:13 2022] DELETE /identity/v3/projects/240737c114e64e60aea490650707f2a4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:13.819646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39bd12-148b-414e-9993-c97e67344ba1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:13.820156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39bd12-148b-414e-9993-c97e67344ba1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:13.820255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39bd12-148b-414e-9993-c97e67344ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:13.849177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-af39bd12-148b-414e-9993-c97e67344ba1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:13.851076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-af39bd12-148b-414e-9993-c97e67344ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:13.925030 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4200/8368] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:23:13.930488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fe949-9172-483d-98bc-853830dfbd08 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:13.930822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fe949-9172-483d-98bc-853830dfbd08 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:13.931035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fe949-9172-483d-98bc-853830dfbd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:13.952246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5e1fe949-9172-483d-98bc-853830dfbd08 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:13.953632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5e1fe949-9172-483d-98bc-853830dfbd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:13.962657 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4169/8369] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:23:13.967496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39bd12-148b-414e-9993-c97e67344ba1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:13.979538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39bd12-148b-414e-9993-c97e67344ba1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:13.984714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1c86b-82a7-4eec-a040-9771b5dd6da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:13.985702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1c86b-82a7-4eec-a040-9771b5dd6da8 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:13.985986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1c86b-82a7-4eec-a040-9771b5dd6da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:13.986264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1c86b-82a7-4eec-a040-9771b5dd6da8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:13.987072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1c86b-82a7-4eec-a040-9771b5dd6da8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:23:13.987380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1c86b-82a7-4eec-a040-9771b5dd6da8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:13.989057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1c86b-82a7-4eec-a040-9771b5dd6da8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:14.004730 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4201/8370] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:23:14.009631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fe949-9172-483d-98bc-853830dfbd08 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:14.019810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fe949-9172-483d-98bc-853830dfbd08 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:14.024966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d811f43-6300-4097-bc74-061937b3e923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:14.025582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d811f43-6300-4097-bc74-061937b3e923 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:14.025856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d811f43-6300-4097-bc74-061937b3e923 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:14.026122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d811f43-6300-4097-bc74-061937b3e923 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:14.026748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d811f43-6300-4097-bc74-061937b3e923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:14.028669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d811f43-6300-4097-bc74-061937b3e923 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:14.061492 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4170/8371] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:23:14 2022] POST /identity/v3/projects => generated 393 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:23:14.065819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1c86b-82a7-4eec-a040-9771b5dd6da8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:14.077965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1c86b-82a7-4eec-a040-9771b5dd6da8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:14.144525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f988f70-d53a-43db-aeba-06c4812e628a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:14.145180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f988f70-d53a-43db-aeba-06c4812e628a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:14.145519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f988f70-d53a-43db-aeba-06c4812e628a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:14.145806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f988f70-d53a-43db-aeba-06c4812e628a admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:14.146973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f988f70-d53a-43db-aeba-06c4812e628a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:14.149110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f988f70-d53a-43db-aeba-06c4812e628a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:14.173697 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4202/8372] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:23:14 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:23:14.177725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d811f43-6300-4097-bc74-061937b3e923 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:14.188822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d811f43-6300-4097-bc74-061937b3e923 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:14.194117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d833d-f7ed-40b9-9e18-d7d2de5475cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:14.194792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d833d-f7ed-40b9-9e18-d7d2de5475cb admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:14.195008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d833d-f7ed-40b9-9e18-d7d2de5475cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:14.195260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d833d-f7ed-40b9-9e18-d7d2de5475cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:14.195905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d833d-f7ed-40b9-9e18-d7d2de5475cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:14.197555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d833d-f7ed-40b9-9e18-d7d2de5475cb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:14.215834 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4171/8373] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:23:14.219899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f988f70-d53a-43db-aeba-06c4812e628a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:14.231028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f988f70-d53a-43db-aeba-06c4812e628a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:14.235597 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e1737-59bf-4c6d-ab16-4b4a2647fd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:14.236382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e1737-59bf-4c6d-ab16-4b4a2647fd99 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:14.236694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e1737-59bf-4c6d-ab16-4b4a2647fd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:14.236970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e1737-59bf-4c6d-ab16-4b4a2647fd99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:14.237846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e1737-59bf-4c6d-ab16-4b4a2647fd99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:14.239426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e1737-59bf-4c6d-ab16-4b4a2647fd99 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:14.251277 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4203/8374] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:23:14.255432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d833d-f7ed-40b9-9e18-d7d2de5475cb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:14.268211 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d833d-f7ed-40b9-9e18-d7d2de5475cb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:14.273624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc20511-ed7c-49b9-8fd6-a886f3d1daa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:14.274253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc20511-ed7c-49b9-8fd6-a886f3d1daa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:14.274531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc20511-ed7c-49b9-8fd6-a886f3d1daa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:14.274800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc20511-ed7c-49b9-8fd6-a886f3d1daa5 admin admin] PATH_INFO: `/v3/projects/9b18ef923690468286b022f737f60931/users/b50b27cd8feb4fbabc4a562103fa3d65/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:14.292078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc20511-ed7c-49b9-8fd6-a886f3d1daa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b18ef923690468286b022f737f60931, user_id=b50b27cd8feb4fbabc4a562103fa3d65, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:14.294755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc20511-ed7c-49b9-8fd6-a886f3d1daa5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:14.311819 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4172/8375] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:23:14 2022] PUT /identity/v3/projects/9b18ef923690468286b022f737f60931/users/b50b27cd8feb4fbabc4a562103fa3d65/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:14.322869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be334478-d9df-4caf-9c08-96830b838a21 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:14.323465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be334478-d9df-4caf-9c08-96830b838a21 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:14.323740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be334478-d9df-4caf-9c08-96830b838a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:14.353604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-be334478-d9df-4caf-9c08-96830b838a21 None None] MFA Rules not processed for user `b50b27cd8feb4fbabc4a562103fa3d65`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:14.354813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-be334478-d9df-4caf-9c08-96830b838a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:14.375434 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:14.434395 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4204/8376] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:23:14.439071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc20511-ed7c-49b9-8fd6-a886f3d1daa5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:14.527401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc20511-ed7c-49b9-8fd6-a886f3d1daa5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:14.532275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62faf4c-a92f-4abb-892d-43ae9a6b8c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:14.533040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62faf4c-a92f-4abb-892d-43ae9a6b8c6e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:14.533382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62faf4c-a92f-4abb-892d-43ae9a6b8c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:14.533712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62faf4c-a92f-4abb-892d-43ae9a6b8c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:14.534345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62faf4c-a92f-4abb-892d-43ae9a6b8c6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:14.536376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62faf4c-a92f-4abb-892d-43ae9a6b8c6e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:14.569534 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4173/8377] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:23:14 2022] POST /identity/v3/projects => generated 393 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:23:14.571151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be334478-d9df-4caf-9c08-96830b838a21 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:14.585034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be334478-d9df-4caf-9c08-96830b838a21 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:14.698654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a7ce8-6836-422e-97cc-35a355696ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:14.699441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a7ce8-6836-422e-97cc-35a355696ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:14.699817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a7ce8-6836-422e-97cc-35a355696ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:14.700415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a7ce8-6836-422e-97cc-35a355696ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:14.701312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a7ce8-6836-422e-97cc-35a355696ee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:14.703725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a7ce8-6836-422e-97cc-35a355696ee3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:14.743151 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4205/8378] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:23:14 2022] POST /identity/v3/users => generated 303 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:23:14.747648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62faf4c-a92f-4abb-892d-43ae9a6b8c6e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:14.765414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62faf4c-a92f-4abb-892d-43ae9a6b8c6e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:14.778704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d44ab0-faea-4d96-b301-116c2585471d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:14.779487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d44ab0-faea-4d96-b301-116c2585471d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:14.779844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d44ab0-faea-4d96-b301-116c2585471d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:14.780182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d44ab0-faea-4d96-b301-116c2585471d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:14.781227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d44ab0-faea-4d96-b301-116c2585471d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:14.783176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d44ab0-faea-4d96-b301-116c2585471d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:14.797250 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4174/8379] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:23:14.801444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a7ce8-6836-422e-97cc-35a355696ee3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:14.814717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a7ce8-6836-422e-97cc-35a355696ee3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:14.822015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23d86c-ceac-4abf-8226-013a559c81ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:14.822882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23d86c-ceac-4abf-8226-013a559c81ef admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:14.823521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23d86c-ceac-4abf-8226-013a559c81ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:14.823889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23d86c-ceac-4abf-8226-013a559c81ef admin admin] PATH_INFO: `/v3/projects/256ea25f0319434faa49eeb6191231f0/users/ef440f27b74b41988ec655dfdffa49d3/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:14.851610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23d86c-ceac-4abf-8226-013a559c81ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=256ea25f0319434faa49eeb6191231f0, user_id=ef440f27b74b41988ec655dfdffa49d3, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:14.851610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23d86c-ceac-4abf-8226-013a559c81ef admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:14.871031 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4206/8380] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:23:14 2022] PUT /identity/v3/projects/256ea25f0319434faa49eeb6191231f0/users/ef440f27b74b41988ec655dfdffa49d3/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:14.874864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d44ab0-faea-4d96-b301-116c2585471d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:14.890728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d44ab0-faea-4d96-b301-116c2585471d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:14.965098 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:15.032364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff76215-1ad1-432c-b7e2-3a7e4570d2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:15.033459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff76215-1ad1-432c-b7e2-3a7e4570d2ab admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:15.033807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff76215-1ad1-432c-b7e2-3a7e4570d2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:15.034152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff76215-1ad1-432c-b7e2-3a7e4570d2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:15.034935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff76215-1ad1-432c-b7e2-3a7e4570d2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:15.036634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff76215-1ad1-432c-b7e2-3a7e4570d2ab admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:15.050155 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4175/8381] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:23:15.054639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23d86c-ceac-4abf-8226-013a559c81ef admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:15.076141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23d86c-ceac-4abf-8226-013a559c81ef admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:15.089338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba041d-1c25-4543-a3dd-44ab5e9fac6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:15.090301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba041d-1c25-4543-a3dd-44ab5e9fac6f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:15.090768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba041d-1c25-4543-a3dd-44ab5e9fac6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:15.091257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba041d-1c25-4543-a3dd-44ab5e9fac6f admin admin] PATH_INFO: `/v3/projects/256ea25f0319434faa49eeb6191231f0/users/ef440f27b74b41988ec655dfdffa49d3/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:15.094361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba041d-1c25-4543-a3dd-44ab5e9fac6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=256ea25f0319434faa49eeb6191231f0, user_id=ef440f27b74b41988ec655dfdffa49d3, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:15.097379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba041d-1c25-4543-a3dd-44ab5e9fac6f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:15.122581 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4207/8382] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:23:15 2022] PUT /identity/v3/projects/256ea25f0319434faa49eeb6191231f0/users/ef440f27b74b41988ec655dfdffa49d3/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:15.124701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04611b-f49e-48b9-901e-bf40dea7449d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:15.125174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04611b-f49e-48b9-901e-bf40dea7449d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:15.125521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04611b-f49e-48b9-901e-bf40dea7449d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:15.214642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bc04611b-f49e-48b9-901e-bf40dea7449d None None] MFA Rules not processed for user `ef440f27b74b41988ec655dfdffa49d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:15.215852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bc04611b-f49e-48b9-901e-bf40dea7449d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:15.352470 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4176/8383] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:15 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:23:15.360243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba041d-1c25-4543-a3dd-44ab5e9fac6f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:15.363365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c9ba041d-1c25-4543-a3dd-44ab5e9fac6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:15.523949 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba041d-1c25-4543-a3dd-44ab5e9fac6f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:15.535335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ed246-19e7-48d2-891e-b4b0d9f35b71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:15.536433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ed246-19e7-48d2-891e-b4b0d9f35b71 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:15.537542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ed246-19e7-48d2-891e-b4b0d9f35b71 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:15.538058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ed246-19e7-48d2-891e-b4b0d9f35b71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:15.548945 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:15.651367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ed246-19e7-48d2-891e-b4b0d9f35b71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:15.655195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ed246-19e7-48d2-891e-b4b0d9f35b71 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:15.687580 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4208/8384] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:23:15 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:23:19.364462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04611b-f49e-48b9-901e-bf40dea7449d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:19.366304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bc04611b-f49e-48b9-901e-bf40dea7449d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:19.496789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04611b-f49e-48b9-901e-bf40dea7449d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:19.508042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d97d9b-350f-4610-b8a1-a73f63c6b331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:19.508961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d97d9b-350f-4610-b8a1-a73f63c6b331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:19.512923 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d97d9b-350f-4610-b8a1-a73f63c6b331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:19.513351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d97d9b-350f-4610-b8a1-a73f63c6b331 admin admin] PATH_INFO: `/v3/users/6e7c5ae2834543a4967899d6e2e13b82` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:19.514748 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d97d9b-350f-4610-b8a1-a73f63c6b331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e7c5ae2834543a4967899d6e2e13b82)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:19.518224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d97d9b-350f-4610-b8a1-a73f63c6b331 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:19.660161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d3d97d9b-350f-4610-b8a1-a73f63c6b331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e7c5ae2834543a4967899d6e2e13b82'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:19.680972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d3d97d9b-350f-4610-b8a1-a73f63c6b331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e7c5ae2834543a4967899d6e2e13b82'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:19.683384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d3d97d9b-350f-4610-b8a1-a73f63c6b331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e7c5ae2834543a4967899d6e2e13b82'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:19.708214 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:19.735326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d3d97d9b-350f-4610-b8a1-a73f63c6b331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e7c5ae2834543a4967899d6e2e13b82'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:19.756041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d3d97d9b-350f-4610-b8a1-a73f63c6b331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e7c5ae2834543a4967899d6e2e13b82'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:19.774286 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4177/8385] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:23:19 2022] DELETE /identity/v3/users/6e7c5ae2834543a4967899d6e2e13b82 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:19.778673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63807361-0fab-43dd-98d6-fa51321d1aa2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:19.779198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63807361-0fab-43dd-98d6-fa51321d1aa2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:19.779198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63807361-0fab-43dd-98d6-fa51321d1aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:19.813984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-63807361-0fab-43dd-98d6-fa51321d1aa2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:19.815349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-63807361-0fab-43dd-98d6-fa51321d1aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:19.950603 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4209/8386] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:23:19.967650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d97d9b-350f-4610-b8a1-a73f63c6b331 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:19.969427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d3d97d9b-350f-4610-b8a1-a73f63c6b331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:20.091171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d97d9b-350f-4610-b8a1-a73f63c6b331 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:20.102803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc71d8-3f43-4587-93cd-ae6d2bab5945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:20.103749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc71d8-3f43-4587-93cd-ae6d2bab5945 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:20.104243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc71d8-3f43-4587-93cd-ae6d2bab5945 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:20.104751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc71d8-3f43-4587-93cd-ae6d2bab5945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:20.126572 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc71d8-3f43-4587-93cd-ae6d2bab5945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:20.131791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc71d8-3f43-4587-93cd-ae6d2bab5945 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:20.154040 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4178/8387] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:23:20.877966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63807361-0fab-43dd-98d6-fa51321d1aa2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:20.881196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-63807361-0fab-43dd-98d6-fa51321d1aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:20.902475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63807361-0fab-43dd-98d6-fa51321d1aa2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:20.920349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c11bf3-72ab-4a91-bcbd-23bd4b64aef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:20.920349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c11bf3-72ab-4a91-bcbd-23bd4b64aef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:20.920349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c11bf3-72ab-4a91-bcbd-23bd4b64aef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:20.920349 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c11bf3-72ab-4a91-bcbd-23bd4b64aef7 admin admin] PATH_INFO: `/v3/projects/76a5f603fea24163b4ed2e648b3bf456` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:20.920901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c11bf3-72ab-4a91-bcbd-23bd4b64aef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76a5f603fea24163b4ed2e648b3bf456)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:20.920901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c11bf3-72ab-4a91-bcbd-23bd4b64aef7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:20.977916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b0c11bf3-72ab-4a91-bcbd-23bd4b64aef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76a5f603fea24163b4ed2e648b3bf456', 'request_id': 'req-b0c11bf3-72ab-4a91-bcbd-23bd4b64aef7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:20.989135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b0c11bf3-72ab-4a91-bcbd-23bd4b64aef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76a5f603fea24163b4ed2e648b3bf456', 'request_id': 'req-b0c11bf3-72ab-4a91-bcbd-23bd4b64aef7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:21.003896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b0c11bf3-72ab-4a91-bcbd-23bd4b64aef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76a5f603fea24163b4ed2e648b3bf456', 'request_id': 'req-b0c11bf3-72ab-4a91-bcbd-23bd4b64aef7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:21.021553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b0c11bf3-72ab-4a91-bcbd-23bd4b64aef7 admin admin] The token cache is being invalidate because project 76a5f603fea24163b4ed2e648b3bf456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:23:21.021853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b0c11bf3-72ab-4a91-bcbd-23bd4b64aef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:21.022752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b0c11bf3-72ab-4a91-bcbd-23bd4b64aef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:21.025239 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4210/8388] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:23:20 2022] DELETE /identity/v3/projects/76a5f603fea24163b4ed2e648b3bf456 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:21.029229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc71d8-3f43-4587-93cd-ae6d2bab5945 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:21.046699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc71d8-3f43-4587-93cd-ae6d2bab5945 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:21.132190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0471e-b3dc-4cea-9a5e-60f5c4ebd5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:21.133067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0471e-b3dc-4cea-9a5e-60f5c4ebd5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:21.133652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0471e-b3dc-4cea-9a5e-60f5c4ebd5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:21.134153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0471e-b3dc-4cea-9a5e-60f5c4ebd5b4 admin admin] PATH_INFO: `/v3/users/6901952fa579437eab2f92775304eab1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:21.135531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0471e-b3dc-4cea-9a5e-60f5c4ebd5b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6901952fa579437eab2f92775304eab1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:21.137916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0471e-b3dc-4cea-9a5e-60f5c4ebd5b4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:21.236971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-10c0471e-b3dc-4cea-9a5e-60f5c4ebd5b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6901952fa579437eab2f92775304eab1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:21.255364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-10c0471e-b3dc-4cea-9a5e-60f5c4ebd5b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6901952fa579437eab2f92775304eab1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:21.256280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-10c0471e-b3dc-4cea-9a5e-60f5c4ebd5b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6901952fa579437eab2f92775304eab1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:21.280655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-10c0471e-b3dc-4cea-9a5e-60f5c4ebd5b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6901952fa579437eab2f92775304eab1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:21.293475 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-10c0471e-b3dc-4cea-9a5e-60f5c4ebd5b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6901952fa579437eab2f92775304eab1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:21.296103 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:21.304636 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4179/8389] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:23:21 2022] DELETE /identity/v3/users/6901952fa579437eab2f92775304eab1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:21.634649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c11bf3-72ab-4a91-bcbd-23bd4b64aef7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:21.635814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0471e-b3dc-4cea-9a5e-60f5c4ebd5b4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:21.637948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b0c11bf3-72ab-4a91-bcbd-23bd4b64aef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:21.639424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-10c0471e-b3dc-4cea-9a5e-60f5c4ebd5b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:21.669494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c11bf3-72ab-4a91-bcbd-23bd4b64aef7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:21.719594 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:21.741751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0471e-b3dc-4cea-9a5e-60f5c4ebd5b4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:21.748013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f74e1-cbc0-48af-9eff-727cd76281f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:21.749383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f74e1-cbc0-48af-9eff-727cd76281f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:21.750138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f74e1-cbc0-48af-9eff-727cd76281f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:21.750620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f74e1-cbc0-48af-9eff-727cd76281f9 admin admin] PATH_INFO: `/v3/projects/5d8073d7e8254ce3844eb6b8ac26eee6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:21.752174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f74e1-cbc0-48af-9eff-727cd76281f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8073d7e8254ce3844eb6b8ac26eee6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:21.754632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f74e1-cbc0-48af-9eff-727cd76281f9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:21.764845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e83e3a-f3c3-47a9-9fa8-611d423797c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:21.765488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e83e3a-f3c3-47a9-9fa8-611d423797c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:21.765985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e83e3a-f3c3-47a9-9fa8-611d423797c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:21.766125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e83e3a-f3c3-47a9-9fa8-611d423797c5 admin admin] PATH_INFO: `/v3/users/d7dbb392d728499c92e58aec0afb676f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:21.768706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e83e3a-f3c3-47a9-9fa8-611d423797c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7dbb392d728499c92e58aec0afb676f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:21.771346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e83e3a-f3c3-47a9-9fa8-611d423797c5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:21.837822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-54e83e3a-f3c3-47a9-9fa8-611d423797c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7dbb392d728499c92e58aec0afb676f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:21.838723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-54e83e3a-f3c3-47a9-9fa8-611d423797c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7dbb392d728499c92e58aec0afb676f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:21.844999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-972f74e1-cbc0-48af-9eff-727cd76281f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8073d7e8254ce3844eb6b8ac26eee6', 'request_id': 'req-972f74e1-cbc0-48af-9eff-727cd76281f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:21.850758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-54e83e3a-f3c3-47a9-9fa8-611d423797c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7dbb392d728499c92e58aec0afb676f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:21.855172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-972f74e1-cbc0-48af-9eff-727cd76281f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8073d7e8254ce3844eb6b8ac26eee6', 'request_id': 'req-972f74e1-cbc0-48af-9eff-727cd76281f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:21.862626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-972f74e1-cbc0-48af-9eff-727cd76281f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8073d7e8254ce3844eb6b8ac26eee6', 'request_id': 'req-972f74e1-cbc0-48af-9eff-727cd76281f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:21.871471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-54e83e3a-f3c3-47a9-9fa8-611d423797c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7dbb392d728499c92e58aec0afb676f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:21.877158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-972f74e1-cbc0-48af-9eff-727cd76281f9 admin admin] The token cache is being invalidate because project 5d8073d7e8254ce3844eb6b8ac26eee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:23:21.877564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-972f74e1-cbc0-48af-9eff-727cd76281f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:21.878324 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-972f74e1-cbc0-48af-9eff-727cd76281f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:21.879973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-54e83e3a-f3c3-47a9-9fa8-611d423797c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7dbb392d728499c92e58aec0afb676f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:21.880532 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4180/8390] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:23:21 2022] DELETE /identity/v3/projects/5d8073d7e8254ce3844eb6b8ac26eee6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:21.887127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50426947-40e3-42ae-93bd-7a4c9079e61b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:21.887632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50426947-40e3-42ae-93bd-7a4c9079e61b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:21.887910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50426947-40e3-42ae-93bd-7a4c9079e61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:21.898781 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4211/8391] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:23:21 2022] DELETE /identity/v3/users/d7dbb392d728499c92e58aec0afb676f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:21.900945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cd8e4-ed51-4937-8024-9b82d8abf1d7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:21.901579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cd8e4-ed51-4937-8024-9b82d8abf1d7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:21.901860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cd8e4-ed51-4937-8024-9b82d8abf1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:21.916679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-50426947-40e3-42ae-93bd-7a4c9079e61b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:21.918011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-50426947-40e3-42ae-93bd-7a4c9079e61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:21.932836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1c3cd8e4-ed51-4937-8024-9b82d8abf1d7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:21.935186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1c3cd8e4-ed51-4937-8024-9b82d8abf1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:22.029342 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4212/8392] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:23:22.036017 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4181/8393] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:23:22.036017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50426947-40e3-42ae-93bd-7a4c9079e61b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:22.036017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-50426947-40e3-42ae-93bd-7a4c9079e61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:22.038931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97611a8b-1e07-4be5-a4cf-52b79308a9a4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:22.039416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97611a8b-1e07-4be5-a4cf-52b79308a9a4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:22.039858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97611a8b-1e07-4be5-a4cf-52b79308a9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:22.062420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-97611a8b-1e07-4be5-a4cf-52b79308a9a4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:22.064229 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-97611a8b-1e07-4be5-a4cf-52b79308a9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:22.090037 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4213/8394] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:23:22.091371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97611a8b-1e07-4be5-a4cf-52b79308a9a4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:22.093175 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:22.094050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-97611a8b-1e07-4be5-a4cf-52b79308a9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:22.148402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50426947-40e3-42ae-93bd-7a4c9079e61b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:22.153488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b832d27-3d6f-4534-b877-125943c5a4d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:22.154103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b832d27-3d6f-4534-b877-125943c5a4d0 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:22.154378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b832d27-3d6f-4534-b877-125943c5a4d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:22.156008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b832d27-3d6f-4534-b877-125943c5a4d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:22.160707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6b832d27-3d6f-4534-b877-125943c5a4d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:22.169029 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:22.180302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97611a8b-1e07-4be5-a4cf-52b79308a9a4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:22.186917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668cabf-deed-42fe-990f-c8b678508981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:22.187935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668cabf-deed-42fe-990f-c8b678508981 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:22.188406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668cabf-deed-42fe-990f-c8b678508981 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:22.188721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668cabf-deed-42fe-990f-c8b678508981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:22.200308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668cabf-deed-42fe-990f-c8b678508981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:22.201979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668cabf-deed-42fe-990f-c8b678508981 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:22.214603 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4214/8395] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:23:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:23:22.214902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668cabf-deed-42fe-990f-c8b678508981 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:22.225678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668cabf-deed-42fe-990f-c8b678508981 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:22.232420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9852e-01db-448b-aef5-944098dc83f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:22.233986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9852e-01db-448b-aef5-944098dc83f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:22.235226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9852e-01db-448b-aef5-944098dc83f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:22.235633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9852e-01db-448b-aef5-944098dc83f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:22.236394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9852e-01db-448b-aef5-944098dc83f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:23:22.237826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9852e-01db-448b-aef5-944098dc83f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:22.241559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9852e-01db-448b-aef5-944098dc83f5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:22.261477 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4215/8396] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:23:22.265768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9852e-01db-448b-aef5-944098dc83f5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:22.271574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b832d27-3d6f-4534-b877-125943c5a4d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:22.273340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b832d27-3d6f-4534-b877-125943c5a4d0 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:22.277615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9852e-01db-448b-aef5-944098dc83f5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:22.283052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1ebf6-6bea-4a38-93bc-d5c05820be9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:22.283688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1ebf6-6bea-4a38-93bc-d5c05820be9c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:22.284316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1ebf6-6bea-4a38-93bc-d5c05820be9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:22.284615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1ebf6-6bea-4a38-93bc-d5c05820be9c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:22.285379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1ebf6-6bea-4a38-93bc-d5c05820be9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:22.287351 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4182/8397] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:23:22 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:23:22.288360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1ebf6-6bea-4a38-93bc-d5c05820be9c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:22.324001 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4216/8398] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:23:22 2022] POST /identity/v3/projects => generated 361 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:23:22.327839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b832d27-3d6f-4534-b877-125943c5a4d0 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:22.339822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b832d27-3d6f-4534-b877-125943c5a4d0 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:22.439364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374eeed2-a4ef-40fb-940f-69bcc97a9ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:22.440001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374eeed2-a4ef-40fb-940f-69bcc97a9ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:22.440334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374eeed2-a4ef-40fb-940f-69bcc97a9ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:22.441150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374eeed2-a4ef-40fb-940f-69bcc97a9ed0 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:22.442029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374eeed2-a4ef-40fb-940f-69bcc97a9ed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:22.448429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374eeed2-a4ef-40fb-940f-69bcc97a9ed0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:22.486000 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4183/8399] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:23:22 2022] POST /identity/v3/users => generated 281 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:23:22.487856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1ebf6-6bea-4a38-93bc-d5c05820be9c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:22.501962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1ebf6-6bea-4a38-93bc-d5c05820be9c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:22.509666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a301c4-264d-45ea-b10b-4d2c2deb2471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:22.510295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a301c4-264d-45ea-b10b-4d2c2deb2471 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:22.510573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a301c4-264d-45ea-b10b-4d2c2deb2471 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:22.510848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a301c4-264d-45ea-b10b-4d2c2deb2471 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:22.512046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a301c4-264d-45ea-b10b-4d2c2deb2471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:22.515190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a301c4-264d-45ea-b10b-4d2c2deb2471 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:22.530971 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4217/8400] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:23:22.535070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374eeed2-a4ef-40fb-940f-69bcc97a9ed0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:22.549776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374eeed2-a4ef-40fb-940f-69bcc97a9ed0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:22.558867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0c90c-42e8-47d0-8ee2-7db7097d921a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:22.558867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0c90c-42e8-47d0-8ee2-7db7097d921a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:22.558867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0c90c-42e8-47d0-8ee2-7db7097d921a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:22.558867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0c90c-42e8-47d0-8ee2-7db7097d921a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:22.559451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0c90c-42e8-47d0-8ee2-7db7097d921a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:22.559632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0c90c-42e8-47d0-8ee2-7db7097d921a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:22.576501 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4184/8401] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:23:22.577509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a301c4-264d-45ea-b10b-4d2c2deb2471 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:22.588702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a301c4-264d-45ea-b10b-4d2c2deb2471 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:22.594543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cb109-f9af-4c15-b27e-2751d657f3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:22.595373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cb109-f9af-4c15-b27e-2751d657f3a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:22.595663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cb109-f9af-4c15-b27e-2751d657f3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:22.595986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cb109-f9af-4c15-b27e-2751d657f3a6 admin admin] PATH_INFO: `/v3/projects/1c470efe3cfa43b182d92a46ea5cc010/users/b7967fc40b2a43798ec6c2a01275af5d/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:22.612432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cb109-f9af-4c15-b27e-2751d657f3a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c470efe3cfa43b182d92a46ea5cc010, user_id=b7967fc40b2a43798ec6c2a01275af5d, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:22.615675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cb109-f9af-4c15-b27e-2751d657f3a6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:22.638235 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4218/8402] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:23:22 2022] PUT /identity/v3/projects/1c470efe3cfa43b182d92a46ea5cc010/users/b7967fc40b2a43798ec6c2a01275af5d/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:22.651450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5862550-a2b6-46b6-a1fb-c639f9257c17 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:22.651800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5862550-a2b6-46b6-a1fb-c639f9257c17 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:22.652279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5862550-a2b6-46b6-a1fb-c639f9257c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:22.670420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cb109-f9af-4c15-b27e-2751d657f3a6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:22.672230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-174cb109-f9af-4c15-b27e-2751d657f3a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:22.719958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f5862550-a2b6-46b6-a1fb-c639f9257c17 None None] MFA Rules not processed for user `b7967fc40b2a43798ec6c2a01275af5d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:22.722833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f5862550-a2b6-46b6-a1fb-c639f9257c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:22.789262 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:22.806300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cb109-f9af-4c15-b27e-2751d657f3a6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:22.812016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dfe30-2e13-4a32-bc6f-69515ec72c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:22.813032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dfe30-2e13-4a32-bc6f-69515ec72c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:22.813494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dfe30-2e13-4a32-bc6f-69515ec72c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:22.817960 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4185/8403] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:23:22.818181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dfe30-2e13-4a32-bc6f-69515ec72c2b admin admin] PATH_INFO: `/v3/projects/f8173a31d9ca430e9d236f5bc9c57bb4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:22.820676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542dfe30-2e13-4a32-bc6f-69515ec72c2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8173a31d9ca430e9d236f5bc9c57bb4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:22.830650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542dfe30-2e13-4a32-bc6f-69515ec72c2b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:22.851649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5862550-a2b6-46b6-a1fb-c639f9257c17 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:22.853337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f5862550-a2b6-46b6-a1fb-c639f9257c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:22.909472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-542dfe30-2e13-4a32-bc6f-69515ec72c2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8173a31d9ca430e9d236f5bc9c57bb4', 'request_id': 'req-542dfe30-2e13-4a32-bc6f-69515ec72c2b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:22.924413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-542dfe30-2e13-4a32-bc6f-69515ec72c2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8173a31d9ca430e9d236f5bc9c57bb4', 'request_id': 'req-542dfe30-2e13-4a32-bc6f-69515ec72c2b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:22.939405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-542dfe30-2e13-4a32-bc6f-69515ec72c2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8173a31d9ca430e9d236f5bc9c57bb4', 'request_id': 'req-542dfe30-2e13-4a32-bc6f-69515ec72c2b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:22.959675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-542dfe30-2e13-4a32-bc6f-69515ec72c2b admin admin] The token cache is being invalidate because project f8173a31d9ca430e9d236f5bc9c57bb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:23:22.959675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-542dfe30-2e13-4a32-bc6f-69515ec72c2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:22.960294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-542dfe30-2e13-4a32-bc6f-69515ec72c2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:22.964652 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4219/8404] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:23:22 2022] DELETE /identity/v3/projects/f8173a31d9ca430e9d236f5bc9c57bb4 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:23:22.967553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dfe30-2e13-4a32-bc6f-69515ec72c2b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:22.970119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-542dfe30-2e13-4a32-bc6f-69515ec72c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:22.971871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5862550-a2b6-46b6-a1fb-c639f9257c17 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:22.990475 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:23.075874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38600234-2bf9-47d1-a83f-90cbe683f6a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:23.076708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38600234-2bf9-47d1-a83f-90cbe683f6a6 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:23.076990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38600234-2bf9-47d1-a83f-90cbe683f6a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:23.077335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38600234-2bf9-47d1-a83f-90cbe683f6a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:23.079423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-38600234-2bf9-47d1-a83f-90cbe683f6a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:23.092633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dfe30-2e13-4a32-bc6f-69515ec72c2b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:23.102337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6c9e4-e76e-41b5-b19d-472d4a58f14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:23.104328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6c9e4-e76e-41b5-b19d-472d4a58f14c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:23.105250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6c9e4-e76e-41b5-b19d-472d4a58f14c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:23.105970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6c9e4-e76e-41b5-b19d-472d4a58f14c admin admin] PATH_INFO: `/v3/users/301ff724f24740f982abe55e994d534a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:23.108547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6c9e4-e76e-41b5-b19d-472d4a58f14c admin admin] RBAC: Authorizing `identity:delete_user(user_id=301ff724f24740f982abe55e994d534a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:23.112538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6c9e4-e76e-41b5-b19d-472d4a58f14c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:23.200842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38600234-2bf9-47d1-a83f-90cbe683f6a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:23.202606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38600234-2bf9-47d1-a83f-90cbe683f6a6 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:23.233215 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4186/8405] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:23:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:23:23.233215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38600234-2bf9-47d1-a83f-90cbe683f6a6 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:23.234548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-38600234-2bf9-47d1-a83f-90cbe683f6a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:23.259066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f7f6c9e4-e76e-41b5-b19d-472d4a58f14c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '301ff724f24740f982abe55e994d534a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:23.260079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f7f6c9e4-e76e-41b5-b19d-472d4a58f14c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '301ff724f24740f982abe55e994d534a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:23.267256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38600234-2bf9-47d1-a83f-90cbe683f6a6 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:23.272732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66108467-bd0b-4b8b-ae6d-1e1324c38c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:23.273539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66108467-bd0b-4b8b-ae6d-1e1324c38c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:23.273826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66108467-bd0b-4b8b-ae6d-1e1324c38c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:23.274097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66108467-bd0b-4b8b-ae6d-1e1324c38c99 admin admin] PATH_INFO: `/v3/users/b7967fc40b2a43798ec6c2a01275af5d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:23.275947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66108467-bd0b-4b8b-ae6d-1e1324c38c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7967fc40b2a43798ec6c2a01275af5d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:23.277930 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66108467-bd0b-4b8b-ae6d-1e1324c38c99 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:23.287767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f7f6c9e4-e76e-41b5-b19d-472d4a58f14c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '301ff724f24740f982abe55e994d534a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:23.315460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f7f6c9e4-e76e-41b5-b19d-472d4a58f14c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '301ff724f24740f982abe55e994d534a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:23.329241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f7f6c9e4-e76e-41b5-b19d-472d4a58f14c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '301ff724f24740f982abe55e994d534a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:23.348444 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4220/8406] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:23:22 2022] DELETE /identity/v3/users/301ff724f24740f982abe55e994d534a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:23.372350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-66108467-bd0b-4b8b-ae6d-1e1324c38c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7967fc40b2a43798ec6c2a01275af5d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:23.377765 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:23.386874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-66108467-bd0b-4b8b-ae6d-1e1324c38c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7967fc40b2a43798ec6c2a01275af5d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:23.387719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-66108467-bd0b-4b8b-ae6d-1e1324c38c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7967fc40b2a43798ec6c2a01275af5d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:23.409792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-66108467-bd0b-4b8b-ae6d-1e1324c38c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7967fc40b2a43798ec6c2a01275af5d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:23.425982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-66108467-bd0b-4b8b-ae6d-1e1324c38c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7967fc40b2a43798ec6c2a01275af5d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:23.441279 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4187/8407] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:23:23 2022] DELETE /identity/v3/users/b7967fc40b2a43798ec6c2a01275af5d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:23:23.442375 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef7a60-d295-4ed6-a65d-0780f7ae4f16 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:23.442756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef7a60-d295-4ed6-a65d-0780f7ae4f16 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:23.443617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef7a60-d295-4ed6-a65d-0780f7ae4f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:23.480128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b1ef7a60-d295-4ed6-a65d-0780f7ae4f16 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:23.483779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b1ef7a60-d295-4ed6-a65d-0780f7ae4f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:23.592532 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4221/8408] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:23:23.612525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66108467-bd0b-4b8b-ae6d-1e1324c38c99 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:23.615467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-66108467-bd0b-4b8b-ae6d-1e1324c38c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:23.759674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66108467-bd0b-4b8b-ae6d-1e1324c38c99 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:23.766365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b25fa2-7d82-493b-b64d-909a53c28c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:23.766991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b25fa2-7d82-493b-b64d-909a53c28c25 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:23.767265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b25fa2-7d82-493b-b64d-909a53c28c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:23.767532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b25fa2-7d82-493b-b64d-909a53c28c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:23.779351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b25fa2-7d82-493b-b64d-909a53c28c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:23.780856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b25fa2-7d82-493b-b64d-909a53c28c25 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:23.798944 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4188/8409] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:23:24.254094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef7a60-d295-4ed6-a65d-0780f7ae4f16 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:24.258477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b1ef7a60-d295-4ed6-a65d-0780f7ae4f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:24.278154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef7a60-d295-4ed6-a65d-0780f7ae4f16 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:24.294871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663117b-3a58-41a1-96dc-3ce945d0f864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:24.298024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663117b-3a58-41a1-96dc-3ce945d0f864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:24.298492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663117b-3a58-41a1-96dc-3ce945d0f864 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:24.298927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663117b-3a58-41a1-96dc-3ce945d0f864 admin admin] PATH_INFO: `/v3/projects/0cd81dde89da40b1a0ae34a87e5c8a54` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:24.300684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663117b-3a58-41a1-96dc-3ce945d0f864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cd81dde89da40b1a0ae34a87e5c8a54)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:24.304369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663117b-3a58-41a1-96dc-3ce945d0f864 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:24.346090 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:24.409546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2663117b-3a58-41a1-96dc-3ce945d0f864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cd81dde89da40b1a0ae34a87e5c8a54', 'request_id': 'req-2663117b-3a58-41a1-96dc-3ce945d0f864'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:24.430957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2663117b-3a58-41a1-96dc-3ce945d0f864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cd81dde89da40b1a0ae34a87e5c8a54', 'request_id': 'req-2663117b-3a58-41a1-96dc-3ce945d0f864'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:24.439990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2663117b-3a58-41a1-96dc-3ce945d0f864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cd81dde89da40b1a0ae34a87e5c8a54', 'request_id': 'req-2663117b-3a58-41a1-96dc-3ce945d0f864'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:24.468003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2663117b-3a58-41a1-96dc-3ce945d0f864 admin admin] The token cache is being invalidate because project 0cd81dde89da40b1a0ae34a87e5c8a54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:23:24.468654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2663117b-3a58-41a1-96dc-3ce945d0f864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:24.470287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2663117b-3a58-41a1-96dc-3ce945d0f864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:24.477361 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4222/8410] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:23:24 2022] DELETE /identity/v3/projects/0cd81dde89da40b1a0ae34a87e5c8a54 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:24.483125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db3570-d9a1-4c8f-b4e4-b7016b1e8d1f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:24.484117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db3570-d9a1-4c8f-b4e4-b7016b1e8d1f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:24.484550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db3570-d9a1-4c8f-b4e4-b7016b1e8d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:24.532827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d1db3570-d9a1-4c8f-b4e4-b7016b1e8d1f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:24.537857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d1db3570-d9a1-4c8f-b4e4-b7016b1e8d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:24.746503 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4189/8411] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:23:24.748279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714d2cc-f056-4f9c-8b12-836e7754b584 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:24.748549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714d2cc-f056-4f9c-8b12-836e7754b584 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:24.748901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714d2cc-f056-4f9c-8b12-836e7754b584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:24.781387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b714d2cc-f056-4f9c-8b12-836e7754b584 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:24.794423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b714d2cc-f056-4f9c-8b12-836e7754b584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:24.803381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db3570-d9a1-4c8f-b4e4-b7016b1e8d1f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:24.804866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d1db3570-d9a1-4c8f-b4e4-b7016b1e8d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:24.820732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db3570-d9a1-4c8f-b4e4-b7016b1e8d1f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:24.843124 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4223/8412] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:23:24.843310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66018d93-207c-40e5-afba-2915b8b066f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:24.843310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66018d93-207c-40e5-afba-2915b8b066f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:24.843310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66018d93-207c-40e5-afba-2915b8b066f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:24.843310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66018d93-207c-40e5-afba-2915b8b066f7 admin admin] PATH_INFO: `/v3/projects/1c470efe3cfa43b182d92a46ea5cc010` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:24.844319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714d2cc-f056-4f9c-8b12-836e7754b584 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:24.853119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66018d93-207c-40e5-afba-2915b8b066f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c470efe3cfa43b182d92a46ea5cc010)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:24.867245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66018d93-207c-40e5-afba-2915b8b066f7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:24.877814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714d2cc-f056-4f9c-8b12-836e7754b584 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:24.900191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa35e4-4ec8-4d9b-b98f-4531bb2e7a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:24.900977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa35e4-4ec8-4d9b-b98f-4531bb2e7a48 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:24.904063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa35e4-4ec8-4d9b-b98f-4531bb2e7a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:24.908700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa35e4-4ec8-4d9b-b98f-4531bb2e7a48 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:24.908700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa35e4-4ec8-4d9b-b98f-4531bb2e7a48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:23:24.908700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa35e4-4ec8-4d9b-b98f-4531bb2e7a48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:24.917320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa35e4-4ec8-4d9b-b98f-4531bb2e7a48 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:24.974502 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4224/8413] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:23:24.993594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa35e4-4ec8-4d9b-b98f-4531bb2e7a48 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:25.008547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa35e4-4ec8-4d9b-b98f-4531bb2e7a48 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:25.009879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-66018d93-207c-40e5-afba-2915b8b066f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c470efe3cfa43b182d92a46ea5cc010', 'request_id': 'req-66018d93-207c-40e5-afba-2915b8b066f7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:25.025387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-66018d93-207c-40e5-afba-2915b8b066f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c470efe3cfa43b182d92a46ea5cc010', 'request_id': 'req-66018d93-207c-40e5-afba-2915b8b066f7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:25.041253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-66018d93-207c-40e5-afba-2915b8b066f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c470efe3cfa43b182d92a46ea5cc010', 'request_id': 'req-66018d93-207c-40e5-afba-2915b8b066f7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:25.049738 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:25.082370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-66018d93-207c-40e5-afba-2915b8b066f7 admin admin] The token cache is being invalidate because project 1c470efe3cfa43b182d92a46ea5cc010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:23:25.082699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-66018d93-207c-40e5-afba-2915b8b066f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:25.083891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-66018d93-207c-40e5-afba-2915b8b066f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:25.089146 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4190/8414] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:23:24 2022] DELETE /identity/v3/projects/1c470efe3cfa43b182d92a46ea5cc010 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:25.092684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46849927-366c-4afa-81e3-6175cb86e91c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:25.092977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46849927-366c-4afa-81e3-6175cb86e91c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:25.093307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46849927-366c-4afa-81e3-6175cb86e91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:25.143946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-46849927-366c-4afa-81e3-6175cb86e91c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:25.146585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-46849927-366c-4afa-81e3-6175cb86e91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:25.199377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70aa8b-4515-4d0b-a4e3-4452777c7899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:25.199999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70aa8b-4515-4d0b-a4e3-4452777c7899 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:25.200274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70aa8b-4515-4d0b-a4e3-4452777c7899 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:25.200541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70aa8b-4515-4d0b-a4e3-4452777c7899 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:25.203068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70aa8b-4515-4d0b-a4e3-4452777c7899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:25.216138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70aa8b-4515-4d0b-a4e3-4452777c7899 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:25.313646 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4191/8415] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:23:25.315943 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4225/8416] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:23:24 2022] POST /identity/v3/projects => generated 375 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:23:25.317497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46849927-366c-4afa-81e3-6175cb86e91c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:25.330171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-46849927-366c-4afa-81e3-6175cb86e91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:25.351641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46849927-366c-4afa-81e3-6175cb86e91c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:25.404829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306da567-8255-4b32-ab0d-855fd2a6da68 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:25.405297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306da567-8255-4b32-ab0d-855fd2a6da68 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:25.405415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306da567-8255-4b32-ab0d-855fd2a6da68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:25.456474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-306da567-8255-4b32-ab0d-855fd2a6da68 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:25.459829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-306da567-8255-4b32-ab0d-855fd2a6da68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:25.468116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010623c1-200a-4f71-901a-0c7b236bcf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:25.468933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010623c1-200a-4f71-901a-0c7b236bcf82 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:25.470463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010623c1-200a-4f71-901a-0c7b236bcf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:25.470852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010623c1-200a-4f71-901a-0c7b236bcf82 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:25.471984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010623c1-200a-4f71-901a-0c7b236bcf82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:25.475536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010623c1-200a-4f71-901a-0c7b236bcf82 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:25.510237 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4192/8417] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:23:25 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:23:25.513027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010623c1-200a-4f71-901a-0c7b236bcf82 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:25.524099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010623c1-200a-4f71-901a-0c7b236bcf82 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:25.529656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c5de8-db27-4eea-8d01-474076853a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:25.530181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c5de8-db27-4eea-8d01-474076853a2b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:25.530568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c5de8-db27-4eea-8d01-474076853a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:25.531086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c5de8-db27-4eea-8d01-474076853a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:25.531861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c5de8-db27-4eea-8d01-474076853a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:25.533649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c5de8-db27-4eea-8d01-474076853a2b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:25.554750 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4193/8418] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:23:25.556278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c5de8-db27-4eea-8d01-474076853a2b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:25.570029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c5de8-db27-4eea-8d01-474076853a2b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:25.576634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedbe3c-9f49-433c-b064-2370b91ff6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:25.577544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedbe3c-9f49-433c-b064-2370b91ff6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:25.577959 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedbe3c-9f49-433c-b064-2370b91ff6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:25.578344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedbe3c-9f49-433c-b064-2370b91ff6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:25.578984 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4226/8419] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:23:25.581192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fedbe3c-9f49-433c-b064-2370b91ff6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:25.583141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306da567-8255-4b32-ab0d-855fd2a6da68 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:25.587014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fedbe3c-9f49-433c-b064-2370b91ff6b2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:25.603377 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4194/8420] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:23:25.603625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306da567-8255-4b32-ab0d-855fd2a6da68 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:25.605228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedbe3c-9f49-433c-b064-2370b91ff6b2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:25.616099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b7fbc-b907-49e5-b674-9d3a7ec7a0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:25.616345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b7fbc-b907-49e5-b674-9d3a7ec7a0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:25.616572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b7fbc-b907-49e5-b674-9d3a7ec7a0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:25.617579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b7fbc-b907-49e5-b674-9d3a7ec7a0e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:25.618116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b7fbc-b907-49e5-b674-9d3a7ec7a0e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:23:25.618417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b7fbc-b907-49e5-b674-9d3a7ec7a0e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:25.620055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b7fbc-b907-49e5-b674-9d3a7ec7a0e8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:25.625335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedbe3c-9f49-433c-b064-2370b91ff6b2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:25.638360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76bc1d-bc10-42b0-bf3f-7a909bac00e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:25.639038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76bc1d-bc10-42b0-bf3f-7a909bac00e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:25.639313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76bc1d-bc10-42b0-bf3f-7a909bac00e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:25.639589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76bc1d-bc10-42b0-bf3f-7a909bac00e3 admin admin] PATH_INFO: `/v3/projects/c2c27a5bcfdc441b8b72990840d6fcd6/users/f9a96af71cfe485ea094ab1f91ca06c0/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:25.647998 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4227/8421] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:23:25.653651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b7fbc-b907-49e5-b674-9d3a7ec7a0e8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:25.661191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76bc1d-bc10-42b0-bf3f-7a909bac00e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c27a5bcfdc441b8b72990840d6fcd6, user_id=f9a96af71cfe485ea094ab1f91ca06c0, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:25.664897 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:25.665759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76bc1d-bc10-42b0-bf3f-7a909bac00e3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:25.669560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b7fbc-b907-49e5-b674-9d3a7ec7a0e8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:25.675170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42356b7d-3482-4849-b81e-c8f2c9b62ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:25.676318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42356b7d-3482-4849-b81e-c8f2c9b62ceb admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:25.676625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42356b7d-3482-4849-b81e-c8f2c9b62ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:25.677353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42356b7d-3482-4849-b81e-c8f2c9b62ceb admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:25.678181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42356b7d-3482-4849-b81e-c8f2c9b62ceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:25.680846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42356b7d-3482-4849-b81e-c8f2c9b62ceb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:25.690950 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4195/8422] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:23:25 2022] PUT /identity/v3/projects/c2c27a5bcfdc441b8b72990840d6fcd6/users/f9a96af71cfe485ea094ab1f91ca06c0/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:25.709695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10708c6-03ee-41f2-8463-569206495fd3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:25.710022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10708c6-03ee-41f2-8463-569206495fd3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:25.710305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10708c6-03ee-41f2-8463-569206495fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:25.728758 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4228/8423] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:23:25 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:23:25.736549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42356b7d-3482-4849-b81e-c8f2c9b62ceb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:25.757932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d10708c6-03ee-41f2-8463-569206495fd3 None None] MFA Rules not processed for user `f9a96af71cfe485ea094ab1f91ca06c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:25.761414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d10708c6-03ee-41f2-8463-569206495fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:25.805400 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:25.835104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42356b7d-3482-4849-b81e-c8f2c9b62ceb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:25.841251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ac950-be11-4726-9ca7-0f51d6dc02c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:25.842215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ac950-be11-4726-9ca7-0f51d6dc02c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:25.842371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ac950-be11-4726-9ca7-0f51d6dc02c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:25.842579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ac950-be11-4726-9ca7-0f51d6dc02c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:25.843206 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ac950-be11-4726-9ca7-0f51d6dc02c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:25.845741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ac950-be11-4726-9ca7-0f51d6dc02c0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:25.870035 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4196/8424] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:23:25.884903 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4229/8425] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:23:25 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:23:25.888685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10708c6-03ee-41f2-8463-569206495fd3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:25.891354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ac950-be11-4726-9ca7-0f51d6dc02c0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:25.893068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f16ac950-be11-4726-9ca7-0f51d6dc02c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:25.905791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10708c6-03ee-41f2-8463-569206495fd3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:25.910767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380cdae-617d-4d52-9445-4864924596bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:25.911612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380cdae-617d-4d52-9445-4864924596bd admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:25.912064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380cdae-617d-4d52-9445-4864924596bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:25.912345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380cdae-617d-4d52-9445-4864924596bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:25.913228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380cdae-617d-4d52-9445-4864924596bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:25.914886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380cdae-617d-4d52-9445-4864924596bd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:25.938297 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4197/8426] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:23:25.944482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380cdae-617d-4d52-9445-4864924596bd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:25.960732 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380cdae-617d-4d52-9445-4864924596bd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:25.971705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c6029-657d-4e94-b85f-bd513d1d755e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:25.972337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c6029-657d-4e94-b85f-bd513d1d755e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:25.972645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c6029-657d-4e94-b85f-bd513d1d755e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:25.972926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c6029-657d-4e94-b85f-bd513d1d755e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:25.973585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c6029-657d-4e94-b85f-bd513d1d755e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:25.976002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c6029-657d-4e94-b85f-bd513d1d755e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:25.990107 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4198/8427] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:23:25.996209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c6029-657d-4e94-b85f-bd513d1d755e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:26.013717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ac950-be11-4726-9ca7-0f51d6dc02c0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:26.015316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c6029-657d-4e94-b85f-bd513d1d755e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:26.021899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928197f-644d-45eb-adf2-1e511d351566 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:26.023190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928197f-644d-45eb-adf2-1e511d351566 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:26.023190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928197f-644d-45eb-adf2-1e511d351566 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:26.023190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928197f-644d-45eb-adf2-1e511d351566 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:26.030037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b922ffc-10fc-4e92-b97c-fd90e430cc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:26.030918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b922ffc-10fc-4e92-b97c-fd90e430cc40 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:26.031206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b922ffc-10fc-4e92-b97c-fd90e430cc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:26.031479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b922ffc-10fc-4e92-b97c-fd90e430cc40 admin admin] PATH_INFO: `/v3/projects/a911295272504e4685e3ed6a67ffd8e8/users/51eaa29a4ed543119d36d9cb1c0aa9f4/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:26.049004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928197f-644d-45eb-adf2-1e511d351566 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:26.049215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928197f-644d-45eb-adf2-1e511d351566 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:26.062239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b922ffc-10fc-4e92-b97c-fd90e430cc40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a911295272504e4685e3ed6a67ffd8e8, user_id=51eaa29a4ed543119d36d9cb1c0aa9f4, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:26.065912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b922ffc-10fc-4e92-b97c-fd90e430cc40 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:26.068344 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4230/8428] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:23:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:23:26.092491 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4199/8429] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:23:25 2022] PUT /identity/v3/projects/a911295272504e4685e3ed6a67ffd8e8/users/51eaa29a4ed543119d36d9cb1c0aa9f4/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:26.103222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec611c2-0b93-43bf-9283-3ba15a69c301 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:26.103647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec611c2-0b93-43bf-9283-3ba15a69c301 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:26.103932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec611c2-0b93-43bf-9283-3ba15a69c301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:26.148080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-dec611c2-0b93-43bf-9283-3ba15a69c301 None None] MFA Rules not processed for user `51eaa29a4ed543119d36d9cb1c0aa9f4`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:26.149941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dec611c2-0b93-43bf-9283-3ba15a69c301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:26.315314 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4231/8430] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:23:26.323662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b922ffc-10fc-4e92-b97c-fd90e430cc40 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:26.501014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b922ffc-10fc-4e92-b97c-fd90e430cc40 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:26.510158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4bd13-a74d-4869-9e0d-a46c7f1a547d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:26.510789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4bd13-a74d-4869-9e0d-a46c7f1a547d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:26.511333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4bd13-a74d-4869-9e0d-a46c7f1a547d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:26.511333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4bd13-a74d-4869-9e0d-a46c7f1a547d admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:26.511947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4bd13-a74d-4869-9e0d-a46c7f1a547d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:26.513873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4bd13-a74d-4869-9e0d-a46c7f1a547d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:26.580558 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4200/8431] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:23:26 2022] POST /identity/v3/projects => generated 375 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:23:26.584901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec611c2-0b93-43bf-9283-3ba15a69c301 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:26.591840 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:26.605448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec611c2-0b93-43bf-9283-3ba15a69c301 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:26.823690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8470b-3314-40f2-a833-f7b14a38a4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:26.825070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8470b-3314-40f2-a833-f7b14a38a4ef admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:26.825367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8470b-3314-40f2-a833-f7b14a38a4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:26.825643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8470b-3314-40f2-a833-f7b14a38a4ef admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:26.826301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8470b-3314-40f2-a833-f7b14a38a4ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:26.831800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8470b-3314-40f2-a833-f7b14a38a4ef admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:26.907030 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4232/8432] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:23:26 2022] POST /identity/v3/users => generated 288 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:23:26.909140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4bd13-a74d-4869-9e0d-a46c7f1a547d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:26.921893 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4bd13-a74d-4869-9e0d-a46c7f1a547d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:26.929243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e2fe3-aad2-402e-93bd-fe22f5dfc101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:26.930390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e2fe3-aad2-402e-93bd-fe22f5dfc101 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:26.930934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e2fe3-aad2-402e-93bd-fe22f5dfc101 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:26.931465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e2fe3-aad2-402e-93bd-fe22f5dfc101 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:26.932412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e2fe3-aad2-402e-93bd-fe22f5dfc101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:26.934503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e2fe3-aad2-402e-93bd-fe22f5dfc101 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:26.949496 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4201/8433] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:23:26.954728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8470b-3314-40f2-a833-f7b14a38a4ef admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:26.967018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8470b-3314-40f2-a833-f7b14a38a4ef admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:26.989529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30aff0e-6aec-4f42-8222-0816b4744694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:26.992741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30aff0e-6aec-4f42-8222-0816b4744694 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:26.993083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30aff0e-6aec-4f42-8222-0816b4744694 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:26.993509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30aff0e-6aec-4f42-8222-0816b4744694 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:26.994884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30aff0e-6aec-4f42-8222-0816b4744694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:26.998511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30aff0e-6aec-4f42-8222-0816b4744694 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:27.025147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e2fe3-aad2-402e-93bd-fe22f5dfc101 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:27.027040 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4233/8434] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:23:27.050473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e2fe3-aad2-402e-93bd-fe22f5dfc101 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:27.075907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0612f2-e048-4fc1-923e-860cf609f10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:27.076990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0612f2-e048-4fc1-923e-860cf609f10f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:27.077544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0612f2-e048-4fc1-923e-860cf609f10f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:27.078036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0612f2-e048-4fc1-923e-860cf609f10f admin admin] PATH_INFO: `/v3/projects/70ee62394e32462f82bc67abd1597ffc/users/aabef92bd0be48a3aeaa12b99b9e081a/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:27.113590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0612f2-e048-4fc1-923e-860cf609f10f admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ee62394e32462f82bc67abd1597ffc, user_id=aabef92bd0be48a3aeaa12b99b9e081a, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:27.118048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0612f2-e048-4fc1-923e-860cf609f10f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:27.156657 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4202/8435] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:23:27 2022] PUT /identity/v3/projects/70ee62394e32462f82bc67abd1597ffc/users/aabef92bd0be48a3aeaa12b99b9e081a/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:23:27.158871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8160dbd-7008-4793-9314-cec8f8c43721 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:27.159220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8160dbd-7008-4793-9314-cec8f8c43721 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:27.159578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8160dbd-7008-4793-9314-cec8f8c43721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:27.204777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d8160dbd-7008-4793-9314-cec8f8c43721 None None] MFA Rules not processed for user `aabef92bd0be48a3aeaa12b99b9e081a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:27.206216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d8160dbd-7008-4793-9314-cec8f8c43721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:27.306925 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4234/8436] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:23:27.311900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0612f2-e048-4fc1-923e-860cf609f10f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:27.362404 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:27.423064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0612f2-e048-4fc1-923e-860cf609f10f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:27.436363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b561c65-a5f2-4de9-965e-3e4922d0fb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:27.437401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b561c65-a5f2-4de9-965e-3e4922d0fb38 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:27.437751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b561c65-a5f2-4de9-965e-3e4922d0fb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:27.438090 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b561c65-a5f2-4de9-965e-3e4922d0fb38 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:27.438801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b561c65-a5f2-4de9-965e-3e4922d0fb38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:27.440851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b561c65-a5f2-4de9-965e-3e4922d0fb38 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:27.494094 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4203/8437] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:23:27 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:23:27.497701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8160dbd-7008-4793-9314-cec8f8c43721 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:27.530428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8160dbd-7008-4793-9314-cec8f8c43721 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:27.629832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14497f39-9ae6-41f7-9faa-84e107b7e72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:27.630754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b466091-123f-488f-aca0-13593590acfe None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:27.631122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b466091-123f-488f-aca0-13593590acfe None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:27.631290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b466091-123f-488f-aca0-13593590acfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:27.631463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14497f39-9ae6-41f7-9faa-84e107b7e72e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:27.631896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14497f39-9ae6-41f7-9faa-84e107b7e72e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:27.632175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14497f39-9ae6-41f7-9faa-84e107b7e72e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:27.632893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14497f39-9ae6-41f7-9faa-84e107b7e72e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:27.638768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14497f39-9ae6-41f7-9faa-84e107b7e72e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:27.667151 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7b466091-123f-488f-aca0-13593590acfe None None] MFA Rules not processed for user `b50b27cd8feb4fbabc4a562103fa3d65`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:27.668494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7b466091-123f-488f-aca0-13593590acfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:27.695780 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4235/8438] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:23:27 2022] POST /identity/v3/users => generated 295 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:23:27.701081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14497f39-9ae6-41f7-9faa-84e107b7e72e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:27.708495 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:27.719699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14497f39-9ae6-41f7-9faa-84e107b7e72e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:27.726797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd49691-549a-4a51-9dbc-988526bd34d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:27.727426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd49691-549a-4a51-9dbc-988526bd34d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:27.728346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd49691-549a-4a51-9dbc-988526bd34d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:27.728759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd49691-549a-4a51-9dbc-988526bd34d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:27.729852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd49691-549a-4a51-9dbc-988526bd34d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:27.732218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd49691-549a-4a51-9dbc-988526bd34d1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:27.745378 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4236/8439] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:23:27.749976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd49691-549a-4a51-9dbc-988526bd34d1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:27.768080 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd49691-549a-4a51-9dbc-988526bd34d1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:27.775785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7dc8b-c101-4b79-bc07-18a0f8f8d38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:27.776564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7dc8b-c101-4b79-bc07-18a0f8f8d38f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:27.776875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7dc8b-c101-4b79-bc07-18a0f8f8d38f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:27.777149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7dc8b-c101-4b79-bc07-18a0f8f8d38f admin admin] PATH_INFO: `/v3/projects/3b2d53e6e62e40e791d9bc762475f2d9/users/35edf59cd5384f53a01d83c28fbcfa0f/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:27.798531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7dc8b-c101-4b79-bc07-18a0f8f8d38f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b2d53e6e62e40e791d9bc762475f2d9, user_id=35edf59cd5384f53a01d83c28fbcfa0f, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:27.801894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7dc8b-c101-4b79-bc07-18a0f8f8d38f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:27.808973 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4204/8440] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:23:27.839780 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4237/8441] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:23:27 2022] PUT /identity/v3/projects/3b2d53e6e62e40e791d9bc762475f2d9/users/35edf59cd5384f53a01d83c28fbcfa0f/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:27.844095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b466091-123f-488f-aca0-13593590acfe None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:27.861966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b466091-123f-488f-aca0-13593590acfe None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:27.972335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb767ab2-0390-479e-ae23-d53b64fe1bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:27.973358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb767ab2-0390-479e-ae23-d53b64fe1bca admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:27.973945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb767ab2-0390-479e-ae23-d53b64fe1bca admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:27.974400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb767ab2-0390-479e-ae23-d53b64fe1bca admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:27.975346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb767ab2-0390-479e-ae23-d53b64fe1bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:27.977272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb767ab2-0390-479e-ae23-d53b64fe1bca admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:27.991733 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4205/8442] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:23:27.995314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7dc8b-c101-4b79-bc07-18a0f8f8d38f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:28.008527 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7dc8b-c101-4b79-bc07-18a0f8f8d38f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:28.014576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b04bb-bd2a-4886-b151-ba938b5100c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:28.015518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b04bb-bd2a-4886-b151-ba938b5100c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:28.016023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b04bb-bd2a-4886-b151-ba938b5100c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:28.016500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b04bb-bd2a-4886-b151-ba938b5100c0 admin admin] PATH_INFO: `/v3/projects/3b2d53e6e62e40e791d9bc762475f2d9/users/35edf59cd5384f53a01d83c28fbcfa0f/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:28.018766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b04bb-bd2a-4886-b151-ba938b5100c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b2d53e6e62e40e791d9bc762475f2d9, user_id=35edf59cd5384f53a01d83c28fbcfa0f, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:28.024557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b04bb-bd2a-4886-b151-ba938b5100c0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:28.040163 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4238/8443] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:23:27 2022] PUT /identity/v3/projects/3b2d53e6e62e40e791d9bc762475f2d9/users/35edf59cd5384f53a01d83c28fbcfa0f/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:23:28.051470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32445dd5-3ba0-4eb2-bb96-f65b16e951bc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:28.055336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32445dd5-3ba0-4eb2-bb96-f65b16e951bc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:28.055845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32445dd5-3ba0-4eb2-bb96-f65b16e951bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:28.105644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-32445dd5-3ba0-4eb2-bb96-f65b16e951bc None None] MFA Rules not processed for user `35edf59cd5384f53a01d83c28fbcfa0f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:28.107254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-32445dd5-3ba0-4eb2-bb96-f65b16e951bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:28.195510 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:28.239974 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4206/8444] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:23:28.261661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b04bb-bd2a-4886-b151-ba938b5100c0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:28.264516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-770b04bb-bd2a-4886-b151-ba938b5100c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:28.431048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b04bb-bd2a-4886-b151-ba938b5100c0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:28.437311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43537861-7c6d-42ee-81f4-60be9f1eb7f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:28.438166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43537861-7c6d-42ee-81f4-60be9f1eb7f8 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:28.438720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43537861-7c6d-42ee-81f4-60be9f1eb7f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:28.439175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43537861-7c6d-42ee-81f4-60be9f1eb7f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:28.576215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43537861-7c6d-42ee-81f4-60be9f1eb7f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:28.577983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43537861-7c6d-42ee-81f4-60be9f1eb7f8 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:28.611926 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4239/8445] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:23:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:23:31.680342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32445dd5-3ba0-4eb2-bb96-f65b16e951bc None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:31.698869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32445dd5-3ba0-4eb2-bb96-f65b16e951bc None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:31.703963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd9e62-a081-45d8-b9c2-9273a68b0a65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:31.704958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd9e62-a081-45d8-b9c2-9273a68b0a65 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:31.705429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd9e62-a081-45d8-b9c2-9273a68b0a65 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:31.706098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd9e62-a081-45d8-b9c2-9273a68b0a65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:31.831274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd9e62-a081-45d8-b9c2-9273a68b0a65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:31.833860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd9e62-a081-45d8-b9c2-9273a68b0a65 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:31.846823 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4207/8446] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:23:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:23:32.724158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43537861-7c6d-42ee-81f4-60be9f1eb7f8 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:32.736857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43537861-7c6d-42ee-81f4-60be9f1eb7f8 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:32.743475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80ab84-8152-424f-bca1-077792d49387 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:32.744364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80ab84-8152-424f-bca1-077792d49387 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:32.744673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80ab84-8152-424f-bca1-077792d49387 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:32.744946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80ab84-8152-424f-bca1-077792d49387 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:32.755904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80ab84-8152-424f-bca1-077792d49387 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:32.757556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80ab84-8152-424f-bca1-077792d49387 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:32.768378 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4240/8447] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:23:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:23:41.744315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5f538-d560-41c7-8269-0549b8daf2b8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:41.744927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5f538-d560-41c7-8269-0549b8daf2b8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:41.745050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5f538-d560-41c7-8269-0549b8daf2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:41.803800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-23d5f538-d560-41c7-8269-0549b8daf2b8 None None] MFA Rules not processed for user `fb9dee808083429a999cadea57b31908`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:41.805474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-23d5f538-d560-41c7-8269-0549b8daf2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:41.955713 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4208/8448] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:23:42.763451 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=73,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:43.095435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80ab84-8152-424f-bca1-077792d49387 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:43.211016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80ab84-8152-424f-bca1-077792d49387 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:43.222602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9a1e4-14b4-4d14-8c06-bd1c4acceced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:43.226460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9a1e4-14b4-4d14-8c06-bd1c4acceced admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:43.227047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9a1e4-14b4-4d14-8c06-bd1c4acceced admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:43.227538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9a1e4-14b4-4d14-8c06-bd1c4acceced admin admin] PATH_INFO: `/v3/users/51eaa29a4ed543119d36d9cb1c0aa9f4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:43.229329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9a1e4-14b4-4d14-8c06-bd1c4acceced admin admin] RBAC: Authorizing `identity:delete_user(user_id=51eaa29a4ed543119d36d9cb1c0aa9f4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:43.240050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9a1e4-14b4-4d14-8c06-bd1c4acceced admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:43.321280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6d9a1e4-14b4-4d14-8c06-bd1c4acceced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51eaa29a4ed543119d36d9cb1c0aa9f4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:43.321840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6d9a1e4-14b4-4d14-8c06-bd1c4acceced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51eaa29a4ed543119d36d9cb1c0aa9f4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:43.334512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6d9a1e4-14b4-4d14-8c06-bd1c4acceced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51eaa29a4ed543119d36d9cb1c0aa9f4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:43.367857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6d9a1e4-14b4-4d14-8c06-bd1c4acceced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51eaa29a4ed543119d36d9cb1c0aa9f4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:43.376394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6d9a1e4-14b4-4d14-8c06-bd1c4acceced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51eaa29a4ed543119d36d9cb1c0aa9f4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:43.384405 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4241/8449] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:23:43 2022] DELETE /identity/v3/users/51eaa29a4ed543119d36d9cb1c0aa9f4 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:43.388618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523627d3-f8e9-4abd-a832-06e1bb91bfe1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:43.389078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523627d3-f8e9-4abd-a832-06e1bb91bfe1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:43.389175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523627d3-f8e9-4abd-a832-06e1bb91bfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:43.424537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-523627d3-f8e9-4abd-a832-06e1bb91bfe1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:43.428815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-523627d3-f8e9-4abd-a832-06e1bb91bfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:43.514697 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4209/8450] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:23:43.527289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9a1e4-14b4-4d14-8c06-bd1c4acceced admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:43.528836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a6d9a1e4-14b4-4d14-8c06-bd1c4acceced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:43.670418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9a1e4-14b4-4d14-8c06-bd1c4acceced admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:43.680845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd555b-517c-4702-9642-a5ad8126a029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:43.682188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd555b-517c-4702-9642-a5ad8126a029 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:43.682838 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd555b-517c-4702-9642-a5ad8126a029 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:43.683353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd555b-517c-4702-9642-a5ad8126a029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:43.695846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd555b-517c-4702-9642-a5ad8126a029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:43.697740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd555b-517c-4702-9642-a5ad8126a029 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:43.721133 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4242/8451] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:23:44.380784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523627d3-f8e9-4abd-a832-06e1bb91bfe1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:44.382789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-523627d3-f8e9-4abd-a832-06e1bb91bfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:44.401032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523627d3-f8e9-4abd-a832-06e1bb91bfe1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:44.435895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d0f7b-3c8c-481f-b881-b9991198fa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:44.437145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d0f7b-3c8c-481f-b881-b9991198fa00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:44.437493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d0f7b-3c8c-481f-b881-b9991198fa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:44.437988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d0f7b-3c8c-481f-b881-b9991198fa00 admin admin] PATH_INFO: `/v3/projects/a911295272504e4685e3ed6a67ffd8e8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:44.439352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d0f7b-3c8c-481f-b881-b9991198fa00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a911295272504e4685e3ed6a67ffd8e8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:44.441460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d0f7b-3c8c-481f-b881-b9991198fa00 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:44.470920 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:44.502735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ad8d0f7b-3c8c-481f-b881-b9991198fa00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a911295272504e4685e3ed6a67ffd8e8', 'request_id': 'req-ad8d0f7b-3c8c-481f-b881-b9991198fa00'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:44.514583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ad8d0f7b-3c8c-481f-b881-b9991198fa00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a911295272504e4685e3ed6a67ffd8e8', 'request_id': 'req-ad8d0f7b-3c8c-481f-b881-b9991198fa00'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:44.523444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ad8d0f7b-3c8c-481f-b881-b9991198fa00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a911295272504e4685e3ed6a67ffd8e8', 'request_id': 'req-ad8d0f7b-3c8c-481f-b881-b9991198fa00'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:44.550311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ad8d0f7b-3c8c-481f-b881-b9991198fa00 admin admin] The token cache is being invalidate because project a911295272504e4685e3ed6a67ffd8e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:23:44.552023 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ad8d0f7b-3c8c-481f-b881-b9991198fa00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:44.553251 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ad8d0f7b-3c8c-481f-b881-b9991198fa00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:44.558725 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4210/8452] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:23:44 2022] DELETE /identity/v3/projects/a911295272504e4685e3ed6a67ffd8e8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:44.559250 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd555b-517c-4702-9642-a5ad8126a029 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:44.577103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd555b-517c-4702-9642-a5ad8126a029 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:44.601252 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:44.662409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adcd65-a252-45c6-956b-773c1783db0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:44.663421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adcd65-a252-45c6-956b-773c1783db0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:44.663705 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adcd65-a252-45c6-956b-773c1783db0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:44.663978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adcd65-a252-45c6-956b-773c1783db0e admin admin] PATH_INFO: `/v3/users/aabef92bd0be48a3aeaa12b99b9e081a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:44.665386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adcd65-a252-45c6-956b-773c1783db0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aabef92bd0be48a3aeaa12b99b9e081a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:44.667694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adcd65-a252-45c6-956b-773c1783db0e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:44.737839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1adcd65-a252-45c6-956b-773c1783db0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aabef92bd0be48a3aeaa12b99b9e081a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:44.740357 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1adcd65-a252-45c6-956b-773c1783db0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aabef92bd0be48a3aeaa12b99b9e081a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:44.750848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1adcd65-a252-45c6-956b-773c1783db0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aabef92bd0be48a3aeaa12b99b9e081a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:44.773520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1adcd65-a252-45c6-956b-773c1783db0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aabef92bd0be48a3aeaa12b99b9e081a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:44.783495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1adcd65-a252-45c6-956b-773c1783db0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aabef92bd0be48a3aeaa12b99b9e081a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:44.791957 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4243/8453] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:23:44 2022] DELETE /identity/v3/users/aabef92bd0be48a3aeaa12b99b9e081a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:45.112181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d0f7b-3c8c-481f-b881-b9991198fa00 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:45.114197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ad8d0f7b-3c8c-481f-b881-b9991198fa00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:45.127262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d0f7b-3c8c-481f-b881-b9991198fa00 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:45.219360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae790c4a-d158-4128-9e74-c89f4b1b18e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:45.221468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae790c4a-d158-4128-9e74-c89f4b1b18e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:45.221915 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae790c4a-d158-4128-9e74-c89f4b1b18e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:45.222277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae790c4a-d158-4128-9e74-c89f4b1b18e8 admin admin] PATH_INFO: `/v3/projects/70ee62394e32462f82bc67abd1597ffc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:45.223764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae790c4a-d158-4128-9e74-c89f4b1b18e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70ee62394e32462f82bc67abd1597ffc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:45.225917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae790c4a-d158-4128-9e74-c89f4b1b18e8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:45.299377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ae790c4a-d158-4128-9e74-c89f4b1b18e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70ee62394e32462f82bc67abd1597ffc', 'request_id': 'req-ae790c4a-d158-4128-9e74-c89f4b1b18e8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:45.322250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ae790c4a-d158-4128-9e74-c89f4b1b18e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70ee62394e32462f82bc67abd1597ffc', 'request_id': 'req-ae790c4a-d158-4128-9e74-c89f4b1b18e8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:45.331940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ae790c4a-d158-4128-9e74-c89f4b1b18e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70ee62394e32462f82bc67abd1597ffc', 'request_id': 'req-ae790c4a-d158-4128-9e74-c89f4b1b18e8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:45.355690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ae790c4a-d158-4128-9e74-c89f4b1b18e8 admin admin] The token cache is being invalidate because project 70ee62394e32462f82bc67abd1597ffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:23:45.355999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ae790c4a-d158-4128-9e74-c89f4b1b18e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:45.357814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ae790c4a-d158-4128-9e74-c89f4b1b18e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:45.361716 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4211/8454] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:23:45 2022] DELETE /identity/v3/projects/70ee62394e32462f82bc67abd1597ffc => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:45.366906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adcd65-a252-45c6-956b-773c1783db0e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:45.368475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b1adcd65-a252-45c6-956b-773c1783db0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:45.387873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adcd65-a252-45c6-956b-773c1783db0e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:45.507545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cd9fb-1f9d-42b7-a4dd-5943e526f44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:45.508616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cd9fb-1f9d-42b7-a4dd-5943e526f44e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:45.510577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cd9fb-1f9d-42b7-a4dd-5943e526f44e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:45.510923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cd9fb-1f9d-42b7-a4dd-5943e526f44e admin admin] PATH_INFO: `/v3/users/35edf59cd5384f53a01d83c28fbcfa0f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:45.512819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cd9fb-1f9d-42b7-a4dd-5943e526f44e admin admin] RBAC: Authorizing `identity:delete_user(user_id=35edf59cd5384f53a01d83c28fbcfa0f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:45.515599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cd9fb-1f9d-42b7-a4dd-5943e526f44e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:45.605405 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:45.616174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ff1cd9fb-1f9d-42b7-a4dd-5943e526f44e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35edf59cd5384f53a01d83c28fbcfa0f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:45.617383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ff1cd9fb-1f9d-42b7-a4dd-5943e526f44e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35edf59cd5384f53a01d83c28fbcfa0f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:45.634768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ff1cd9fb-1f9d-42b7-a4dd-5943e526f44e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35edf59cd5384f53a01d83c28fbcfa0f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:45.666669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ff1cd9fb-1f9d-42b7-a4dd-5943e526f44e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35edf59cd5384f53a01d83c28fbcfa0f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:45.681608 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ff1cd9fb-1f9d-42b7-a4dd-5943e526f44e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35edf59cd5384f53a01d83c28fbcfa0f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:45.697082 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4244/8455] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:23:45 2022] DELETE /identity/v3/users/35edf59cd5384f53a01d83c28fbcfa0f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:46.294331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae790c4a-d158-4128-9e74-c89f4b1b18e8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:46.295886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ae790c4a-d158-4128-9e74-c89f4b1b18e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:46.315993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae790c4a-d158-4128-9e74-c89f4b1b18e8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:46.400113 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:46.431437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7994c-1bba-4839-914a-6e4009a27342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:46.432381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7994c-1bba-4839-914a-6e4009a27342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:46.432882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7994c-1bba-4839-914a-6e4009a27342 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:46.433321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7994c-1bba-4839-914a-6e4009a27342 admin admin] PATH_INFO: `/v3/projects/3b2d53e6e62e40e791d9bc762475f2d9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:46.434513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7994c-1bba-4839-914a-6e4009a27342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b2d53e6e62e40e791d9bc762475f2d9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:46.436728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7994c-1bba-4839-914a-6e4009a27342 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:46.492888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d6c7994c-1bba-4839-914a-6e4009a27342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b2d53e6e62e40e791d9bc762475f2d9', 'request_id': 'req-d6c7994c-1bba-4839-914a-6e4009a27342'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:46.501300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d6c7994c-1bba-4839-914a-6e4009a27342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b2d53e6e62e40e791d9bc762475f2d9', 'request_id': 'req-d6c7994c-1bba-4839-914a-6e4009a27342'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:46.509048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d6c7994c-1bba-4839-914a-6e4009a27342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b2d53e6e62e40e791d9bc762475f2d9', 'request_id': 'req-d6c7994c-1bba-4839-914a-6e4009a27342'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:46.528527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d6c7994c-1bba-4839-914a-6e4009a27342 admin admin] The token cache is being invalidate because project 3b2d53e6e62e40e791d9bc762475f2d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:23:46.529002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d6c7994c-1bba-4839-914a-6e4009a27342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:46.529785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d6c7994c-1bba-4839-914a-6e4009a27342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:23:46.531527 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4212/8456] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:23:46 2022] DELETE /identity/v3/projects/3b2d53e6e62e40e791d9bc762475f2d9 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:46.538019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2c14e-b9af-4b05-95db-054c8532022d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:46.538360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2c14e-b9af-4b05-95db-054c8532022d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:46.538720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2c14e-b9af-4b05-95db-054c8532022d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:46.579874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-20e2c14e-b9af-4b05-95db-054c8532022d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:46.581970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-20e2c14e-b9af-4b05-95db-054c8532022d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:46.707970 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4245/8457] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:23:46.709976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf99f5-3693-48c0-9849-93e2cbb9dcb5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:46.710258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf99f5-3693-48c0-9849-93e2cbb9dcb5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:46.710534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf99f5-3693-48c0-9849-93e2cbb9dcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:46.737214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2adf99f5-3693-48c0-9849-93e2cbb9dcb5 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:46.739034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2adf99f5-3693-48c0-9849-93e2cbb9dcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:46.762901 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4213/8458] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:23:46.767171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2c14e-b9af-4b05-95db-054c8532022d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:46.779826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2c14e-b9af-4b05-95db-054c8532022d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:46.786151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cee648-2fdc-4c96-8be8-1186ff35fce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:46.786800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cee648-2fdc-4c96-8be8-1186ff35fce3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:46.787101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cee648-2fdc-4c96-8be8-1186ff35fce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:46.787356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cee648-2fdc-4c96-8be8-1186ff35fce3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:46.788034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cee648-2fdc-4c96-8be8-1186ff35fce3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:23:46.788540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cee648-2fdc-4c96-8be8-1186ff35fce3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:46.790180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cee648-2fdc-4c96-8be8-1186ff35fce3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:46.808196 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4246/8459] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:23:46.809113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf99f5-3693-48c0-9849-93e2cbb9dcb5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:46.820509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf99f5-3693-48c0-9849-93e2cbb9dcb5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:46.825949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49d54e-c042-4f60-8db6-d2ea85e094f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:46.826561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49d54e-c042-4f60-8db6-d2ea85e094f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:46.826842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49d54e-c042-4f60-8db6-d2ea85e094f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:46.827114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49d54e-c042-4f60-8db6-d2ea85e094f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:46.827754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49d54e-c042-4f60-8db6-d2ea85e094f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:46.829698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49d54e-c042-4f60-8db6-d2ea85e094f1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:46.868318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cee648-2fdc-4c96-8be8-1186ff35fce3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:46.872769 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4214/8460] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:23:46 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:23:46.882289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cee648-2fdc-4c96-8be8-1186ff35fce3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:47.010789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea3c98-4bb8-4ed5-977c-d541b5f710cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:47.012589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea3c98-4bb8-4ed5-977c-d541b5f710cb admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:47.014091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea3c98-4bb8-4ed5-977c-d541b5f710cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:47.014423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea3c98-4bb8-4ed5-977c-d541b5f710cb admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:47.016985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea3c98-4bb8-4ed5-977c-d541b5f710cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:47.020400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea3c98-4bb8-4ed5-977c-d541b5f710cb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:47.063849 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4247/8461] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:23:46 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:23:47.065626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49d54e-c042-4f60-8db6-d2ea85e094f1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:47.079330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49d54e-c042-4f60-8db6-d2ea85e094f1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:47.092210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120bbb9-47ce-4c0a-a4ef-e5306362a8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:47.095368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120bbb9-47ce-4c0a-a4ef-e5306362a8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:47.096051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120bbb9-47ce-4c0a-a4ef-e5306362a8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:47.096709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120bbb9-47ce-4c0a-a4ef-e5306362a8f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:47.101073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120bbb9-47ce-4c0a-a4ef-e5306362a8f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:47.105512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120bbb9-47ce-4c0a-a4ef-e5306362a8f3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:47.139841 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4215/8462] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:23:47.146020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea3c98-4bb8-4ed5-977c-d541b5f710cb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:47.159069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea3c98-4bb8-4ed5-977c-d541b5f710cb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:47.166418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459391fd-7a64-4639-95fb-8b3aeefbe179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:47.167234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459391fd-7a64-4639-95fb-8b3aeefbe179 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:47.168041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459391fd-7a64-4639-95fb-8b3aeefbe179 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:47.169347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459391fd-7a64-4639-95fb-8b3aeefbe179 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:47.171993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459391fd-7a64-4639-95fb-8b3aeefbe179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:47.178610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459391fd-7a64-4639-95fb-8b3aeefbe179 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:47.194877 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4248/8463] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:23:47.198848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120bbb9-47ce-4c0a-a4ef-e5306362a8f3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:47.212769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120bbb9-47ce-4c0a-a4ef-e5306362a8f3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:47.218397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac9e71-642c-4845-b28c-afe756701123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:47.219181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac9e71-642c-4845-b28c-afe756701123 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:47.219534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac9e71-642c-4845-b28c-afe756701123 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:47.219890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac9e71-642c-4845-b28c-afe756701123 admin admin] PATH_INFO: `/v3/projects/b83db86fb1ff478ca66e30f0c8b1a7ed/users/dcbf85ea97c24d068f886e2b0b5e9f50/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:47.237523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac9e71-642c-4845-b28c-afe756701123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b83db86fb1ff478ca66e30f0c8b1a7ed, user_id=dcbf85ea97c24d068f886e2b0b5e9f50, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:47.241510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac9e71-642c-4845-b28c-afe756701123 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:47.264924 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4216/8464] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:23:47 2022] PUT /identity/v3/projects/b83db86fb1ff478ca66e30f0c8b1a7ed/users/dcbf85ea97c24d068f886e2b0b5e9f50/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:23:47.273820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79491cd-feeb-4b97-87b8-3a73d72aa49f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:47.274170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79491cd-feeb-4b97-87b8-3a73d72aa49f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:47.274363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79491cd-feeb-4b97-87b8-3a73d72aa49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:47.315260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d79491cd-feeb-4b97-87b8-3a73d72aa49f None None] MFA Rules not processed for user `dcbf85ea97c24d068f886e2b0b5e9f50`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:47.316560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d79491cd-feeb-4b97-87b8-3a73d72aa49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:47.334258 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:47.425731 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4249/8465] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:23:47.434016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac9e71-642c-4845-b28c-afe756701123 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:23:47.436491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eaac9e71-642c-4845-b28c-afe756701123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:47.517312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac9e71-642c-4845-b28c-afe756701123 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:23:47.523853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b2e6d-ffb1-49e7-9d9b-55f5ad2ac1ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:23:47.524615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b2e6d-ffb1-49e7-9d9b-55f5ad2ac1ae service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:47.525070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b2e6d-ffb1-49e7-9d9b-55f5ad2ac1ae service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:47.525346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b2e6d-ffb1-49e7-9d9b-55f5ad2ac1ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:47.545362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b2e6d-ffb1-49e7-9d9b-55f5ad2ac1ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:23:47.546701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b2e6d-ffb1-49e7-9d9b-55f5ad2ac1ae service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:23:47.558770 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4217/8466] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:23:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:23:49.080886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a1585-8aac-4a1c-ba58-9dee77894881 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:23:49.082605 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a1585-8aac-4a1c-ba58-9dee77894881 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:23:49.082936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a1585-8aac-4a1c-ba58-9dee77894881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:23:49.107476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-299a1585-8aac-4a1c-ba58-9dee77894881 None None] MFA Rules not processed for user `dcbf85ea97c24d068f886e2b0b5e9f50`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:23:49.109121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-299a1585-8aac-4a1c-ba58-9dee77894881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:23:49.122060 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4250/8467] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:23:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:23:57.553990 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:23:59.101001 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=23 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:05.139830 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b2e6d-ffb1-49e7-9d9b-55f5ad2ac1ae service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:05.141568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3a9b2e6d-ffb1-49e7-9d9b-55f5ad2ac1ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:05.229205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b2e6d-ffb1-49e7-9d9b-55f5ad2ac1ae service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:05.236085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc26917-16d1-463f-a564-a5311ce1bc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:05.236816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc26917-16d1-463f-a564-a5311ce1bc46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:05.237157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc26917-16d1-463f-a564-a5311ce1bc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:05.237453 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc26917-16d1-463f-a564-a5311ce1bc46 admin admin] PATH_INFO: `/v3/users/f9a96af71cfe485ea094ab1f91ca06c0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:05.239216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc26917-16d1-463f-a564-a5311ce1bc46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a96af71cfe485ea094ab1f91ca06c0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:05.241248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc26917-16d1-463f-a564-a5311ce1bc46 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:05.301243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bfc26917-16d1-463f-a564-a5311ce1bc46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a96af71cfe485ea094ab1f91ca06c0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:05.310169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bfc26917-16d1-463f-a564-a5311ce1bc46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a96af71cfe485ea094ab1f91ca06c0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:05.310843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bfc26917-16d1-463f-a564-a5311ce1bc46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a96af71cfe485ea094ab1f91ca06c0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:05.324698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bfc26917-16d1-463f-a564-a5311ce1bc46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a96af71cfe485ea094ab1f91ca06c0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:05.333550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bfc26917-16d1-463f-a564-a5311ce1bc46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a96af71cfe485ea094ab1f91ca06c0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:05.340653 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4218/8468] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:24:05 2022] DELETE /identity/v3/users/f9a96af71cfe485ea094ab1f91ca06c0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:24:05.346723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c51ac-0a3a-4f70-aab6-263183f5c6d2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:05.348487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c51ac-0a3a-4f70-aab6-263183f5c6d2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:05.349127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c51ac-0a3a-4f70-aab6-263183f5c6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:05.372059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b92c51ac-0a3a-4f70-aab6-263183f5c6d2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:05.373880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b92c51ac-0a3a-4f70-aab6-263183f5c6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:05.441511 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4251/8469] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:24:05.451566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc26917-16d1-463f-a564-a5311ce1bc46 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:05.453390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bfc26917-16d1-463f-a564-a5311ce1bc46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:05.519244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc26917-16d1-463f-a564-a5311ce1bc46 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:05.524164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8f736-5363-46ec-a884-e88678aa2ef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:05.524650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8f736-5363-46ec-a884-e88678aa2ef5 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:05.525089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8f736-5363-46ec-a884-e88678aa2ef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:05.525357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8f736-5363-46ec-a884-e88678aa2ef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:05.536021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8f736-5363-46ec-a884-e88678aa2ef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:05.537563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8f736-5363-46ec-a884-e88678aa2ef5 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:05.547977 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4219/8470] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:24:05.830630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c51ac-0a3a-4f70-aab6-263183f5c6d2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:05.832406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b92c51ac-0a3a-4f70-aab6-263183f5c6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:05.845245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c51ac-0a3a-4f70-aab6-263183f5c6d2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:05.851710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9aac51-4d57-4c9f-9587-68708becc772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:05.852369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9aac51-4d57-4c9f-9587-68708becc772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:05.852678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9aac51-4d57-4c9f-9587-68708becc772 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:05.852962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9aac51-4d57-4c9f-9587-68708becc772 admin admin] PATH_INFO: `/v3/projects/c2c27a5bcfdc441b8b72990840d6fcd6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:05.854078 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9aac51-4d57-4c9f-9587-68708becc772 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2c27a5bcfdc441b8b72990840d6fcd6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:05.855956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9aac51-4d57-4c9f-9587-68708becc772 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:05.927378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e9aac51-4d57-4c9f-9587-68708becc772 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2c27a5bcfdc441b8b72990840d6fcd6', 'request_id': 'req-7e9aac51-4d57-4c9f-9587-68708becc772'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:05.936259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e9aac51-4d57-4c9f-9587-68708becc772 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2c27a5bcfdc441b8b72990840d6fcd6', 'request_id': 'req-7e9aac51-4d57-4c9f-9587-68708becc772'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:05.942989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e9aac51-4d57-4c9f-9587-68708becc772 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2c27a5bcfdc441b8b72990840d6fcd6', 'request_id': 'req-7e9aac51-4d57-4c9f-9587-68708becc772'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:05.954917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e9aac51-4d57-4c9f-9587-68708becc772 admin admin] The token cache is being invalidate because project c2c27a5bcfdc441b8b72990840d6fcd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:24:05.955279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e9aac51-4d57-4c9f-9587-68708becc772 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:05.955972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e9aac51-4d57-4c9f-9587-68708becc772 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:05.958146 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4252/8471] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:24:05 2022] DELETE /identity/v3/projects/c2c27a5bcfdc441b8b72990840d6fcd6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:24:05.963126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca7740-1274-4949-b712-17091d7158c4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:05.963414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca7740-1274-4949-b712-17091d7158c4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:05.963690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca7740-1274-4949-b712-17091d7158c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:05.983681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-43ca7740-1274-4949-b712-17091d7158c4 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:05.984934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-43ca7740-1274-4949-b712-17091d7158c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:06.003871 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:06.053212 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4220/8472] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:24:06.063038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31c737-7b82-42f6-a7d0-409f59c36b96 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:06.063376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31c737-7b82-42f6-a7d0-409f59c36b96 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:06.063650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31c737-7b82-42f6-a7d0-409f59c36b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:06.087489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4d31c737-7b82-42f6-a7d0-409f59c36b96 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:06.088930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4d31c737-7b82-42f6-a7d0-409f59c36b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:06.098123 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4253/8473] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:24:06.102995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca7740-1274-4949-b712-17091d7158c4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:06.115000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca7740-1274-4949-b712-17091d7158c4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:06.120262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00a3b3-ce53-493d-95fa-ebefb1cc5fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:06.120971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00a3b3-ce53-493d-95fa-ebefb1cc5fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:06.121252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00a3b3-ce53-493d-95fa-ebefb1cc5fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:06.121646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00a3b3-ce53-493d-95fa-ebefb1cc5fc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:06.122379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00a3b3-ce53-493d-95fa-ebefb1cc5fc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:24:06.122696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00a3b3-ce53-493d-95fa-ebefb1cc5fc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:06.124513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00a3b3-ce53-493d-95fa-ebefb1cc5fc0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:06.142362 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4221/8474] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:24:06.150550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31c737-7b82-42f6-a7d0-409f59c36b96 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:06.171583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31c737-7b82-42f6-a7d0-409f59c36b96 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:06.177904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f763203-9334-49a7-9781-c2d41f07d6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:06.178676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f763203-9334-49a7-9781-c2d41f07d6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:06.179197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f763203-9334-49a7-9781-c2d41f07d6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:06.179564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f763203-9334-49a7-9781-c2d41f07d6b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:06.180504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f763203-9334-49a7-9781-c2d41f07d6b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:06.183046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f763203-9334-49a7-9781-c2d41f07d6b4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:06.222553 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4254/8475] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:24:06 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:24:06.224025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00a3b3-ce53-493d-95fa-ebefb1cc5fc0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:06.234836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00a3b3-ce53-493d-95fa-ebefb1cc5fc0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:06.298340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8983bc6-1fef-4e7c-9067-7fe8c4f57b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:06.298945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8983bc6-1fef-4e7c-9067-7fe8c4f57b03 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:06.299223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8983bc6-1fef-4e7c-9067-7fe8c4f57b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:06.299494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8983bc6-1fef-4e7c-9067-7fe8c4f57b03 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:06.300701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8983bc6-1fef-4e7c-9067-7fe8c4f57b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:06.302578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8983bc6-1fef-4e7c-9067-7fe8c4f57b03 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:06.329526 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4222/8476] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:24:06 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:24:06.332168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f763203-9334-49a7-9781-c2d41f07d6b4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:06.335784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87a873-074e-4f71-b3e5-dbbc59b86bea None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:06.336099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87a873-074e-4f71-b3e5-dbbc59b86bea None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:06.336372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87a873-074e-4f71-b3e5-dbbc59b86bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:06.343218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f763203-9334-49a7-9781-c2d41f07d6b4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:06.348880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a974f-5895-4375-8be8-ae1684a30e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:06.349487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a974f-5895-4375-8be8-ae1684a30e8f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:06.349755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a974f-5895-4375-8be8-ae1684a30e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:06.350023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a974f-5895-4375-8be8-ae1684a30e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:06.350744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a974f-5895-4375-8be8-ae1684a30e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:06.352435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a974f-5895-4375-8be8-ae1684a30e8f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:06.362987 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4255/8477] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:24:06.366898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a974f-5895-4375-8be8-ae1684a30e8f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:06.376563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a974f-5895-4375-8be8-ae1684a30e8f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:06.381503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a2bb0-f22d-4796-87f0-37e5b66d3f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:06.382023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a2bb0-f22d-4796-87f0-37e5b66d3f34 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:06.382324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a2bb0-f22d-4796-87f0-37e5b66d3f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:06.382576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a2bb0-f22d-4796-87f0-37e5b66d3f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:06.383211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a2bb0-f22d-4796-87f0-37e5b66d3f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:06.384817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a2bb0-f22d-4796-87f0-37e5b66d3f34 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:06.399206 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4256/8478] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:24:06.400185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a2bb0-f22d-4796-87f0-37e5b66d3f34 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:06.400886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3d87a873-074e-4f71-b3e5-dbbc59b86bea None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:06.402238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3d87a873-074e-4f71-b3e5-dbbc59b86bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:06.411358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a2bb0-f22d-4796-87f0-37e5b66d3f34 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:06.416505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a2171-0ff4-46dd-9082-4be1ecb032ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:06.417201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a2171-0ff4-46dd-9082-4be1ecb032ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:06.417658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a2171-0ff4-46dd-9082-4be1ecb032ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:06.417827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a2171-0ff4-46dd-9082-4be1ecb032ea admin admin] PATH_INFO: `/v3/projects/b689c9415d244b608e04dfede7931fab/users/93e5c4dcc972445ca844254fb75024b8/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:06.434839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a2171-0ff4-46dd-9082-4be1ecb032ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b689c9415d244b608e04dfede7931fab, user_id=93e5c4dcc972445ca844254fb75024b8, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:06.437662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a2171-0ff4-46dd-9082-4be1ecb032ea admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:06.452247 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4257/8479] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:24:06 2022] PUT /identity/v3/projects/b689c9415d244b608e04dfede7931fab/users/93e5c4dcc972445ca844254fb75024b8/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:24:06.463181 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4223/8480] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:24:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:24:06.463636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b71bf3-5672-4c17-affd-6e2f8ec41e9b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:06.463922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b71bf3-5672-4c17-affd-6e2f8ec41e9b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:06.464192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b71bf3-5672-4c17-affd-6e2f8ec41e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:06.487559 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:06.499918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-70b71bf3-5672-4c17-affd-6e2f8ec41e9b None None] MFA Rules not processed for user `93e5c4dcc972445ca844254fb75024b8`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:06.501706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-70b71bf3-5672-4c17-affd-6e2f8ec41e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:06.519841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87a873-074e-4f71-b3e5-dbbc59b86bea None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:06.521797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3d87a873-074e-4f71-b3e5-dbbc59b86bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:06.535835 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:06.575434 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4258/8481] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:24:06.577134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b71bf3-5672-4c17-affd-6e2f8ec41e9b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:06.618239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87a873-074e-4f71-b3e5-dbbc59b86bea None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:06.643446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b71bf3-5672-4c17-affd-6e2f8ec41e9b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:06.649825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf101f3-237d-49b2-adea-bd8f762fd51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:06.650524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf101f3-237d-49b2-adea-bd8f762fd51c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:06.650984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf101f3-237d-49b2-adea-bd8f762fd51c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:06.651224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf101f3-237d-49b2-adea-bd8f762fd51c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:06.651853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf101f3-237d-49b2-adea-bd8f762fd51c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:06.654551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf101f3-237d-49b2-adea-bd8f762fd51c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:06.691181 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4259/8482] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:24:06 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:24:06.691789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6831d2-214e-4448-a28f-1d40afe00d2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:06.691789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6831d2-214e-4448-a28f-1d40afe00d2f service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:06.691789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6831d2-214e-4448-a28f-1d40afe00d2f service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:06.692249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6831d2-214e-4448-a28f-1d40afe00d2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:06.692935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf101f3-237d-49b2-adea-bd8f762fd51c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:06.754202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6831d2-214e-4448-a28f-1d40afe00d2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:06.756131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6831d2-214e-4448-a28f-1d40afe00d2f service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:06.758843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf101f3-237d-49b2-adea-bd8f762fd51c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:06.764672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42148493-52aa-4ac7-9e15-b2b661b40d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:06.765378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42148493-52aa-4ac7-9e15-b2b661b40d89 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:06.765756 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4224/8483] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:24:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 10:24:06.765937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42148493-52aa-4ac7-9e15-b2b661b40d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:06.766065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42148493-52aa-4ac7-9e15-b2b661b40d89 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:06.766646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42148493-52aa-4ac7-9e15-b2b661b40d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:06.769307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42148493-52aa-4ac7-9e15-b2b661b40d89 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:06.792918 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4260/8484] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:24:06 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:24:06.797143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6831d2-214e-4448-a28f-1d40afe00d2f service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:06.809334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6831d2-214e-4448-a28f-1d40afe00d2f service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:06.814360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee49ff9-8572-4be7-9431-8ee3a7fbfb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:06.814968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee49ff9-8572-4be7-9431-8ee3a7fbfb32 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:06.815243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee49ff9-8572-4be7-9431-8ee3a7fbfb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:06.816278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee49ff9-8572-4be7-9431-8ee3a7fbfb32 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:06.816859 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee49ff9-8572-4be7-9431-8ee3a7fbfb32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:06.819316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee49ff9-8572-4be7-9431-8ee3a7fbfb32 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:06.832313 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4225/8485] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:24:06.837029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42148493-52aa-4ac7-9e15-b2b661b40d89 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:06.850222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42148493-52aa-4ac7-9e15-b2b661b40d89 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:06.856267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad24197-4282-4448-affe-5d2e9ccdc404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:06.857067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad24197-4282-4448-affe-5d2e9ccdc404 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:06.857417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad24197-4282-4448-affe-5d2e9ccdc404 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:06.857755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad24197-4282-4448-affe-5d2e9ccdc404 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:06.858613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad24197-4282-4448-affe-5d2e9ccdc404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:06.860313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad24197-4282-4448-affe-5d2e9ccdc404 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:06.873656 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4261/8486] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:24:06.878008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee49ff9-8572-4be7-9431-8ee3a7fbfb32 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:06.888866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee49ff9-8572-4be7-9431-8ee3a7fbfb32 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:06.894169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e4053-0d95-4182-b36d-ba51ac441bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:06.894824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e4053-0d95-4182-b36d-ba51ac441bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:06.895335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e4053-0d95-4182-b36d-ba51ac441bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:06.895472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e4053-0d95-4182-b36d-ba51ac441bc6 admin admin] PATH_INFO: `/v3/projects/f7dea298ef894b2c87d86a8731c9194a/users/50d449c6f4184837acea2404409fa19a/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:06.913048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e4053-0d95-4182-b36d-ba51ac441bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7dea298ef894b2c87d86a8731c9194a, user_id=50d449c6f4184837acea2404409fa19a, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:06.916197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e4053-0d95-4182-b36d-ba51ac441bc6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:06.933670 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4226/8487] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:24:06 2022] PUT /identity/v3/projects/f7dea298ef894b2c87d86a8731c9194a/users/50d449c6f4184837acea2404409fa19a/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:24:06.945102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a742f-2878-4781-ad12-326d48873d39 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:06.945471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a742f-2878-4781-ad12-326d48873d39 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:06.945891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a742f-2878-4781-ad12-326d48873d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:06.953937 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:06.980498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7e0a742f-2878-4781-ad12-326d48873d39 None None] MFA Rules not processed for user `50d449c6f4184837acea2404409fa19a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:06.981843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7e0a742f-2878-4781-ad12-326d48873d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:07.051290 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4262/8488] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:24:07.055710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e4053-0d95-4182-b36d-ba51ac441bc6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:07.066426 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:07.127191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e4053-0d95-4182-b36d-ba51ac441bc6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:07.132145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb38b8b-0911-4811-a470-52f9351cb0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:07.132788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb38b8b-0911-4811-a470-52f9351cb0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:07.133071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb38b8b-0911-4811-a470-52f9351cb0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:07.133343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb38b8b-0911-4811-a470-52f9351cb0d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:07.133977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb38b8b-0911-4811-a470-52f9351cb0d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:07.135931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb38b8b-0911-4811-a470-52f9351cb0d4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:07.164862 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4227/8489] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:24:07 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:24:07.169848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a742f-2878-4781-ad12-326d48873d39 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:07.181886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a742f-2878-4781-ad12-326d48873d39 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:07.243440 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626523f9-731a-4000-877a-4e0ec6ef960b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:07.244162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626523f9-731a-4000-877a-4e0ec6ef960b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:07.244503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626523f9-731a-4000-877a-4e0ec6ef960b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:07.244871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626523f9-731a-4000-877a-4e0ec6ef960b admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:07.245602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626523f9-731a-4000-877a-4e0ec6ef960b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:07.247867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626523f9-731a-4000-877a-4e0ec6ef960b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:07.278196 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4263/8490] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:24:07 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:24:07.282010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb38b8b-0911-4811-a470-52f9351cb0d4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:07.292963 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb38b8b-0911-4811-a470-52f9351cb0d4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:07.297635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cf0e4-ea7c-43ac-ab44-2f417f02efa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:07.298228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cf0e4-ea7c-43ac-ab44-2f417f02efa4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:07.298509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cf0e4-ea7c-43ac-ab44-2f417f02efa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:07.298782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cf0e4-ea7c-43ac-ab44-2f417f02efa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:07.299420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cf0e4-ea7c-43ac-ab44-2f417f02efa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:07.301308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cf0e4-ea7c-43ac-ab44-2f417f02efa4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:07.306889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ded1a-bc98-465a-82b5-ec0f1d1716fa None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:07.307177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ded1a-bc98-465a-82b5-ec0f1d1716fa None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:07.307453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ded1a-bc98-465a-82b5-ec0f1d1716fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:07.319985 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4228/8491] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:24:07.321004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cf0e4-ea7c-43ac-ab44-2f417f02efa4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:07.328728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-da5ded1a-bc98-465a-82b5-ec0f1d1716fa None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:07.330073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-da5ded1a-bc98-465a-82b5-ec0f1d1716fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:07.330968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cf0e4-ea7c-43ac-ab44-2f417f02efa4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:07.336094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f53ea-acb0-4e64-842c-a98fe34357b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:07.336839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f53ea-acb0-4e64-842c-a98fe34357b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:07.337115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f53ea-acb0-4e64-842c-a98fe34357b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:07.337385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f53ea-acb0-4e64-842c-a98fe34357b5 admin admin] PATH_INFO: `/v3/projects/b24b4c6e3641469e9d1f91975ede4e34/users/4531456cfab1410294b2d434bc0c2119/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:07.352861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f53ea-acb0-4e64-842c-a98fe34357b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b24b4c6e3641469e9d1f91975ede4e34, user_id=4531456cfab1410294b2d434bc0c2119, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:07.355395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f53ea-acb0-4e64-842c-a98fe34357b5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:07.368119 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4229/8492] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:24:07 2022] PUT /identity/v3/projects/b24b4c6e3641469e9d1f91975ede4e34/users/4531456cfab1410294b2d434bc0c2119/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:24:07.372107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f53ea-acb0-4e64-842c-a98fe34357b5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:07.391782 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4264/8493] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 10:24:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:24:07.406128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ded1a-bc98-465a-82b5-ec0f1d1716fa None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:07.437231 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:07.439634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f53ea-acb0-4e64-842c-a98fe34357b5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:07.445320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c78891-84b5-4c5d-a124-a7e9149e6559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:07.445938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c78891-84b5-4c5d-a124-a7e9149e6559 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:07.446246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c78891-84b5-4c5d-a124-a7e9149e6559 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:07.446520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c78891-84b5-4c5d-a124-a7e9149e6559 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:07.447343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c78891-84b5-4c5d-a124-a7e9149e6559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:07.449363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c78891-84b5-4c5d-a124-a7e9149e6559 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:07.461483 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4230/8494] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:24:07.464906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c78891-84b5-4c5d-a124-a7e9149e6559 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:07.476399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c78891-84b5-4c5d-a124-a7e9149e6559 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:07.481017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa13051-7435-48d9-aca6-4503082b1b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:07.481655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa13051-7435-48d9-aca6-4503082b1b3d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:07.481932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa13051-7435-48d9-aca6-4503082b1b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:07.482204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa13051-7435-48d9-aca6-4503082b1b3d admin admin] PATH_INFO: `/v3/projects/b24b4c6e3641469e9d1f91975ede4e34/users/4531456cfab1410294b2d434bc0c2119/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:07.484252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa13051-7435-48d9-aca6-4503082b1b3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b24b4c6e3641469e9d1f91975ede4e34, user_id=4531456cfab1410294b2d434bc0c2119, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:07.485077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ded1a-bc98-465a-82b5-ec0f1d1716fa None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:07.486925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa13051-7435-48d9-aca6-4503082b1b3d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:07.497929 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4231/8495] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:24:07 2022] PUT /identity/v3/projects/b24b4c6e3641469e9d1f91975ede4e34/users/4531456cfab1410294b2d434bc0c2119/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:24:07.498770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa13051-7435-48d9-aca6-4503082b1b3d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:07.500351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-faa13051-7435-48d9-aca6-4503082b1b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:07.548695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0867f6-51d4-4eac-8ae8-1cc881249032 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:07.549464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0867f6-51d4-4eac-8ae8-1cc881249032 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:07.549741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0867f6-51d4-4eac-8ae8-1cc881249032 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:07.550113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0867f6-51d4-4eac-8ae8-1cc881249032 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:07.550730 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:07.566807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa13051-7435-48d9-aca6-4503082b1b3d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:07.570546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddab43-e020-4f1d-815d-ad921f316248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:07.571179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddab43-e020-4f1d-815d-ad921f316248 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:07.571463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddab43-e020-4f1d-815d-ad921f316248 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:07.571737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddab43-e020-4f1d-815d-ad921f316248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:07.573843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f3ddab43-e020-4f1d-815d-ad921f316248 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:07.587492 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddab43-e020-4f1d-815d-ad921f316248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:07.588925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddab43-e020-4f1d-815d-ad921f316248 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:07.600491 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4232/8496] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:24:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:24:07.602048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054e5b2-7924-4a83-b56d-f339c76e4e0c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:07.602330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054e5b2-7924-4a83-b56d-f339c76e4e0c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:07.602737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054e5b2-7924-4a83-b56d-f339c76e4e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:07.609852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0867f6-51d4-4eac-8ae8-1cc881249032 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:07.611366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0867f6-51d4-4eac-8ae8-1cc881249032 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:07.621238 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4265/8497] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:24:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 10:24:07.634247 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f054e5b2-7924-4a83-b56d-f339c76e4e0c None None] MFA Rules not processed for user `4531456cfab1410294b2d434bc0c2119`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:07.635527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f054e5b2-7924-4a83-b56d-f339c76e4e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:07.725162 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4233/8498] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:24:07.736715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0867f6-51d4-4eac-8ae8-1cc881249032 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:07.738938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4c0867f6-51d4-4eac-8ae8-1cc881249032 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:07.818559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0867f6-51d4-4eac-8ae8-1cc881249032 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:07.849188 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:07.881789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d2aee-a667-4fc9-8ba8-09f153909480 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:07.882756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d2aee-a667-4fc9-8ba8-09f153909480 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:07.883039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d2aee-a667-4fc9-8ba8-09f153909480 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:07.883314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d2aee-a667-4fc9-8ba8-09f153909480 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:07.902950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57882f53-73b7-4948-82b6-63b606eb003f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:07.903237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57882f53-73b7-4948-82b6-63b606eb003f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:07.903513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57882f53-73b7-4948-82b6-63b606eb003f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:07.928688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-57882f53-73b7-4948-82b6-63b606eb003f None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:07.929954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-57882f53-73b7-4948-82b6-63b606eb003f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:07.961919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d2aee-a667-4fc9-8ba8-09f153909480 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:07.963517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d2aee-a667-4fc9-8ba8-09f153909480 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:07.974548 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4266/8499] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:24:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:24:07.997703 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4234/8500] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:24:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:24:08.010256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d2aee-a667-4fc9-8ba8-09f153909480 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:08.101771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d2aee-a667-4fc9-8ba8-09f153909480 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:08.109025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e748a1-6b96-45d9-85ba-7747b9a3e3e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:08.109777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e748a1-6b96-45d9-85ba-7747b9a3e3e8 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:08.110220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e748a1-6b96-45d9-85ba-7747b9a3e3e8 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:08.110615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e748a1-6b96-45d9-85ba-7747b9a3e3e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:08.120889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e748a1-6b96-45d9-85ba-7747b9a3e3e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:08.122571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e748a1-6b96-45d9-85ba-7747b9a3e3e8 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:08.133771 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4267/8501] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:24:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:24:08.556367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870be73d-d8d3-4c44-8b8f-b323843a61ea None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:08.556912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870be73d-d8d3-4c44-8b8f-b323843a61ea None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:08.557021 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870be73d-d8d3-4c44-8b8f-b323843a61ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:08.578534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-870be73d-d8d3-4c44-8b8f-b323843a61ea None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:08.579740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-870be73d-d8d3-4c44-8b8f-b323843a61ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:08.587334 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4235/8502] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 10:24:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:24:08.600358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e748a1-6b96-45d9-85ba-7747b9a3e3e8 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:08.615408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e748a1-6b96-45d9-85ba-7747b9a3e3e8 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:08.620670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dd2f2-6da6-4d72-82cd-b29f2fc3b839 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:08.622130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dd2f2-6da6-4d72-82cd-b29f2fc3b839 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:08.622130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dd2f2-6da6-4d72-82cd-b29f2fc3b839 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:08.622130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dd2f2-6da6-4d72-82cd-b29f2fc3b839 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:08.632165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dd2f2-6da6-4d72-82cd-b29f2fc3b839 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:08.633771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dd2f2-6da6-4d72-82cd-b29f2fc3b839 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:08.642474 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4268/8503] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:24:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:24:09.569532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870be73d-d8d3-4c44-8b8f-b323843a61ea None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:09.582596 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870be73d-d8d3-4c44-8b8f-b323843a61ea None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:09.586123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc1a92-283b-4424-93a9-8fb799e5e0fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:09.586727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc1a92-283b-4424-93a9-8fb799e5e0fd service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:09.587038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc1a92-283b-4424-93a9-8fb799e5e0fd service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:09.587305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc1a92-283b-4424-93a9-8fb799e5e0fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:09.656877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc1a92-283b-4424-93a9-8fb799e5e0fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:09.658240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc1a92-283b-4424-93a9-8fb799e5e0fd service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:09.668366 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4236/8504] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:24:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:24:10.405049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dd2f2-6da6-4d72-82cd-b29f2fc3b839 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:10.418186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dd2f2-6da6-4d72-82cd-b29f2fc3b839 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:10.422116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36d910-a76f-40c3-8ec8-002f4e3593c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:10.422759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36d910-a76f-40c3-8ec8-002f4e3593c1 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:10.423058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36d910-a76f-40c3-8ec8-002f4e3593c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:10.423329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36d910-a76f-40c3-8ec8-002f4e3593c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:10.433966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36d910-a76f-40c3-8ec8-002f4e3593c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:10.435416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36d910-a76f-40c3-8ec8-002f4e3593c1 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:10.446480 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4269/8505] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:24:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:24:11.971889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc1a92-283b-4424-93a9-8fb799e5e0fd service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:11.973643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-43cc1a92-283b-4424-93a9-8fb799e5e0fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:11.984338 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:12.061389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc1a92-283b-4424-93a9-8fb799e5e0fd service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:12.067351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b88f7-a62c-4f50-b205-a0dc470ecb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:12.068105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b88f7-a62c-4f50-b205-a0dc470ecb7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:12.068390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b88f7-a62c-4f50-b205-a0dc470ecb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:12.068685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b88f7-a62c-4f50-b205-a0dc470ecb7d admin admin] PATH_INFO: `/v3/users/dcbf85ea97c24d068f886e2b0b5e9f50` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:12.069831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b88f7-a62c-4f50-b205-a0dc470ecb7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcbf85ea97c24d068f886e2b0b5e9f50)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:12.071782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b88f7-a62c-4f50-b205-a0dc470ecb7d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:12.131993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd2b88f7-a62c-4f50-b205-a0dc470ecb7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcbf85ea97c24d068f886e2b0b5e9f50'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:12.140869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd2b88f7-a62c-4f50-b205-a0dc470ecb7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcbf85ea97c24d068f886e2b0b5e9f50'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:12.141570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd2b88f7-a62c-4f50-b205-a0dc470ecb7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcbf85ea97c24d068f886e2b0b5e9f50'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:12.158931 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd2b88f7-a62c-4f50-b205-a0dc470ecb7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcbf85ea97c24d068f886e2b0b5e9f50'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:12.166406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd2b88f7-a62c-4f50-b205-a0dc470ecb7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcbf85ea97c24d068f886e2b0b5e9f50'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:12.176810 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4237/8506] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:24:11 2022] DELETE /identity/v3/users/dcbf85ea97c24d068f886e2b0b5e9f50 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:24:12.180285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4c920-d533-48a9-95ff-5486c09984a6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:12.180794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4c920-d533-48a9-95ff-5486c09984a6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:12.181017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4c920-d533-48a9-95ff-5486c09984a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:12.202721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fea4c920-d533-48a9-95ff-5486c09984a6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:12.203953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fea4c920-d533-48a9-95ff-5486c09984a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:12.251023 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:12.276174 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4270/8507] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:24:12.287665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b88f7-a62c-4f50-b205-a0dc470ecb7d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:12.291391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cd2b88f7-a62c-4f50-b205-a0dc470ecb7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:12.375903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b88f7-a62c-4f50-b205-a0dc470ecb7d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:12.384038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aac82a-89ea-423c-ae7d-0834bb37ed24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:12.384908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aac82a-89ea-423c-ae7d-0834bb37ed24 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:12.385260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aac82a-89ea-423c-ae7d-0834bb37ed24 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:12.385606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aac82a-89ea-423c-ae7d-0834bb37ed24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:12.396909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aac82a-89ea-423c-ae7d-0834bb37ed24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:12.398686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aac82a-89ea-423c-ae7d-0834bb37ed24 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:12.410290 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4238/8508] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:24:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:24:12.614067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4c920-d533-48a9-95ff-5486c09984a6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:12.615932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fea4c920-d533-48a9-95ff-5486c09984a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:12.640928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4c920-d533-48a9-95ff-5486c09984a6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:12.665630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38e6fb-63de-46b0-87a8-5f1f1ebff4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:12.666816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38e6fb-63de-46b0-87a8-5f1f1ebff4d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:12.667429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38e6fb-63de-46b0-87a8-5f1f1ebff4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:12.667991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38e6fb-63de-46b0-87a8-5f1f1ebff4d5 admin admin] PATH_INFO: `/v3/projects/b83db86fb1ff478ca66e30f0c8b1a7ed` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:12.671864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38e6fb-63de-46b0-87a8-5f1f1ebff4d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b83db86fb1ff478ca66e30f0c8b1a7ed)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:12.673914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38e6fb-63de-46b0-87a8-5f1f1ebff4d5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:12.743930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a38e6fb-63de-46b0-87a8-5f1f1ebff4d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b83db86fb1ff478ca66e30f0c8b1a7ed', 'request_id': 'req-1a38e6fb-63de-46b0-87a8-5f1f1ebff4d5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:12.755888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a38e6fb-63de-46b0-87a8-5f1f1ebff4d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b83db86fb1ff478ca66e30f0c8b1a7ed', 'request_id': 'req-1a38e6fb-63de-46b0-87a8-5f1f1ebff4d5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:12.764224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a38e6fb-63de-46b0-87a8-5f1f1ebff4d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b83db86fb1ff478ca66e30f0c8b1a7ed', 'request_id': 'req-1a38e6fb-63de-46b0-87a8-5f1f1ebff4d5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:12.779077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a38e6fb-63de-46b0-87a8-5f1f1ebff4d5 admin admin] The token cache is being invalidate because project b83db86fb1ff478ca66e30f0c8b1a7ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:24:12.779621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a38e6fb-63de-46b0-87a8-5f1f1ebff4d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:12.780476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a38e6fb-63de-46b0-87a8-5f1f1ebff4d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:12.782246 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4271/8509] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:24:12 2022] DELETE /identity/v3/projects/b83db86fb1ff478ca66e30f0c8b1a7ed => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:24:12.791760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee88f30-5ba7-418c-a0eb-825e511efd32 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:12.792060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee88f30-5ba7-418c-a0eb-825e511efd32 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:12.792310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee88f30-5ba7-418c-a0eb-825e511efd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:12.820137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fee88f30-5ba7-418c-a0eb-825e511efd32 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:12.821877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fee88f30-5ba7-418c-a0eb-825e511efd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:12.830023 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:12.912804 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4239/8510] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:24:12.923277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d069247-da7b-4563-a1fd-dd5565e4d39f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:12.923277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d069247-da7b-4563-a1fd-dd5565e4d39f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:12.923554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d069247-da7b-4563-a1fd-dd5565e4d39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:12.984240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4d069247-da7b-4563-a1fd-dd5565e4d39f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:12.986195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4d069247-da7b-4563-a1fd-dd5565e4d39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:13.003759 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4272/8511] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:24:13.008537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee88f30-5ba7-418c-a0eb-825e511efd32 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:13.028520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee88f30-5ba7-418c-a0eb-825e511efd32 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:13.041425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be6989-fe30-437e-b883-f687950dc643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:13.042077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be6989-fe30-437e-b883-f687950dc643 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:13.042356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be6989-fe30-437e-b883-f687950dc643 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:13.042633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be6989-fe30-437e-b883-f687950dc643 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:13.043426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be6989-fe30-437e-b883-f687950dc643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:24:13.043739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be6989-fe30-437e-b883-f687950dc643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:13.045434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be6989-fe30-437e-b883-f687950dc643 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:13.068306 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4240/8512] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:24:13.073404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d069247-da7b-4563-a1fd-dd5565e4d39f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:13.086827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d069247-da7b-4563-a1fd-dd5565e4d39f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:13.102182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c977a64-9336-41f4-a070-148f6f3365e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:13.102928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c977a64-9336-41f4-a070-148f6f3365e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:13.103273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c977a64-9336-41f4-a070-148f6f3365e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:13.103672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c977a64-9336-41f4-a070-148f6f3365e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:13.104522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c977a64-9336-41f4-a070-148f6f3365e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:13.106582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c977a64-9336-41f4-a070-148f6f3365e4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:13.149999 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4273/8513] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:24:13 2022] POST /identity/v3/projects => generated 389 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:24:13.153753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be6989-fe30-437e-b883-f687950dc643 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:13.166075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be6989-fe30-437e-b883-f687950dc643 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:13.235811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3698528-16a4-4746-9596-7dc58eca3074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:13.236520 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3698528-16a4-4746-9596-7dc58eca3074 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:13.236906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3698528-16a4-4746-9596-7dc58eca3074 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:13.237825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3698528-16a4-4746-9596-7dc58eca3074 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:13.238689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3698528-16a4-4746-9596-7dc58eca3074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:13.240774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3698528-16a4-4746-9596-7dc58eca3074 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:13.270810 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4241/8514] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:24:13 2022] POST /identity/v3/users => generated 295 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:24:13.275339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c977a64-9336-41f4-a070-148f6f3365e4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:13.292161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c977a64-9336-41f4-a070-148f6f3365e4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:13.301480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c43954-c85d-4402-bf7d-993d5788e5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:13.302578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c43954-c85d-4402-bf7d-993d5788e5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:13.303082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c43954-c85d-4402-bf7d-993d5788e5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:13.303553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c43954-c85d-4402-bf7d-993d5788e5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:13.304406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c43954-c85d-4402-bf7d-993d5788e5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:13.306343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c43954-c85d-4402-bf7d-993d5788e5b0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:13.324352 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4274/8515] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:24:13.328447 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3698528-16a4-4746-9596-7dc58eca3074 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:13.341629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3698528-16a4-4746-9596-7dc58eca3074 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:13.353938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b526f-32d1-4b9c-8bb4-dc17d5e11cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:13.355074 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b526f-32d1-4b9c-8bb4-dc17d5e11cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:13.355183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b526f-32d1-4b9c-8bb4-dc17d5e11cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:13.355534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b526f-32d1-4b9c-8bb4-dc17d5e11cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:13.356273 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b526f-32d1-4b9c-8bb4-dc17d5e11cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:13.358051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b526f-32d1-4b9c-8bb4-dc17d5e11cf1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:13.378130 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4242/8516] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:24:13.382395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c43954-c85d-4402-bf7d-993d5788e5b0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:13.393410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c43954-c85d-4402-bf7d-993d5788e5b0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:13.398409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6e43c-2b8b-45c1-80af-b46b060a9878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:13.399335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6e43c-2b8b-45c1-80af-b46b060a9878 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:13.399736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6e43c-2b8b-45c1-80af-b46b060a9878 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:13.400069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6e43c-2b8b-45c1-80af-b46b060a9878 admin admin] PATH_INFO: `/v3/projects/7c3f7bc820ac4d648c57ad9b1c4f6e85/users/2174e4cf2b644ad7b2dfa3218448d71b/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:13.419322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6e43c-2b8b-45c1-80af-b46b060a9878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c3f7bc820ac4d648c57ad9b1c4f6e85, user_id=2174e4cf2b644ad7b2dfa3218448d71b, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:13.422227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6e43c-2b8b-45c1-80af-b46b060a9878 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:13.446477 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4275/8517] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:24:13 2022] PUT /identity/v3/projects/7c3f7bc820ac4d648c57ad9b1c4f6e85/users/2174e4cf2b644ad7b2dfa3218448d71b/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:24:13.450493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083bbf6-6916-40e4-b246-a8a6d5ec4685 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:13.450772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083bbf6-6916-40e4-b246-a8a6d5ec4685 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:13.451042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083bbf6-6916-40e4-b246-a8a6d5ec4685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:13.481466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8083bbf6-6916-40e4-b246-a8a6d5ec4685 None None] MFA Rules not processed for user `2174e4cf2b644ad7b2dfa3218448d71b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:13.482703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8083bbf6-6916-40e4-b246-a8a6d5ec4685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:13.551757 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4243/8518] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:24:13.562583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6e43c-2b8b-45c1-80af-b46b060a9878 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:13.564253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a7e6e43c-2b8b-45c1-80af-b46b060a9878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:13.628866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6e43c-2b8b-45c1-80af-b46b060a9878 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:13.632508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f401c4-2d72-44c3-a836-6029e1aa863d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:13.633401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f401c4-2d72-44c3-a836-6029e1aa863d service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:13.633683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f401c4-2d72-44c3-a836-6029e1aa863d service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:13.633950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f401c4-2d72-44c3-a836-6029e1aa863d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:13.644826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f401c4-2d72-44c3-a836-6029e1aa863d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:13.654400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f401c4-2d72-44c3-a836-6029e1aa863d service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:13.665829 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4276/8519] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:24:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:24:16.641677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083bbf6-6916-40e4-b246-a8a6d5ec4685 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:16.646032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8083bbf6-6916-40e4-b246-a8a6d5ec4685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:16.656480 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:16.724885 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083bbf6-6916-40e4-b246-a8a6d5ec4685 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:16.729552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d7a42-9b56-4fa7-8c6e-10ce6ecdab38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:16.730207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d7a42-9b56-4fa7-8c6e-10ce6ecdab38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:16.730486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d7a42-9b56-4fa7-8c6e-10ce6ecdab38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:16.730760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d7a42-9b56-4fa7-8c6e-10ce6ecdab38 admin admin] PATH_INFO: `/v3/users/93e5c4dcc972445ca844254fb75024b8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:16.732085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d7a42-9b56-4fa7-8c6e-10ce6ecdab38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93e5c4dcc972445ca844254fb75024b8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:16.734059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d7a42-9b56-4fa7-8c6e-10ce6ecdab38 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:16.788349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-129d7a42-9b56-4fa7-8c6e-10ce6ecdab38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93e5c4dcc972445ca844254fb75024b8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:16.796218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-129d7a42-9b56-4fa7-8c6e-10ce6ecdab38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93e5c4dcc972445ca844254fb75024b8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:16.796854 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-129d7a42-9b56-4fa7-8c6e-10ce6ecdab38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93e5c4dcc972445ca844254fb75024b8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:16.810834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-129d7a42-9b56-4fa7-8c6e-10ce6ecdab38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93e5c4dcc972445ca844254fb75024b8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:16.819499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-129d7a42-9b56-4fa7-8c6e-10ce6ecdab38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93e5c4dcc972445ca844254fb75024b8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:16.825901 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4244/8520] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:24:16 2022] DELETE /identity/v3/users/93e5c4dcc972445ca844254fb75024b8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:24:16.830236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0580e45-5096-4024-8780-242928b3593a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:16.831297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0580e45-5096-4024-8780-242928b3593a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:16.832669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0580e45-5096-4024-8780-242928b3593a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:16.847052 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:16.854948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a0580e45-5096-4024-8780-242928b3593a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:16.856884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a0580e45-5096-4024-8780-242928b3593a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:16.921878 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4277/8521] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:24:16.932377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d7a42-9b56-4fa7-8c6e-10ce6ecdab38 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:16.933793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-129d7a42-9b56-4fa7-8c6e-10ce6ecdab38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:16.993487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d7a42-9b56-4fa7-8c6e-10ce6ecdab38 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:16.997152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c114a33-2454-4c68-979b-f68c8dffc054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:16.997738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c114a33-2454-4c68-979b-f68c8dffc054 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:16.998011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c114a33-2454-4c68-979b-f68c8dffc054 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:16.998276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c114a33-2454-4c68-979b-f68c8dffc054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:17.008439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c114a33-2454-4c68-979b-f68c8dffc054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:17.009866 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c114a33-2454-4c68-979b-f68c8dffc054 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:17.021783 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4245/8522] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:24:17.354826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0580e45-5096-4024-8780-242928b3593a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:17.357099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a0580e45-5096-4024-8780-242928b3593a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:17.376509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0580e45-5096-4024-8780-242928b3593a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:17.398134 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a5cdc-1fcf-467a-8d47-ff1f7c945b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:17.398782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a5cdc-1fcf-467a-8d47-ff1f7c945b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:17.399061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a5cdc-1fcf-467a-8d47-ff1f7c945b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:17.399335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a5cdc-1fcf-467a-8d47-ff1f7c945b30 admin admin] PATH_INFO: `/v3/projects/b689c9415d244b608e04dfede7931fab` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:17.400560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a5cdc-1fcf-467a-8d47-ff1f7c945b30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b689c9415d244b608e04dfede7931fab)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:17.402579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a5cdc-1fcf-467a-8d47-ff1f7c945b30 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:17.468550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3e3a5cdc-1fcf-467a-8d47-ff1f7c945b30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b689c9415d244b608e04dfede7931fab', 'request_id': 'req-3e3a5cdc-1fcf-467a-8d47-ff1f7c945b30'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:17.477442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3e3a5cdc-1fcf-467a-8d47-ff1f7c945b30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b689c9415d244b608e04dfede7931fab', 'request_id': 'req-3e3a5cdc-1fcf-467a-8d47-ff1f7c945b30'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:17.484521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3e3a5cdc-1fcf-467a-8d47-ff1f7c945b30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b689c9415d244b608e04dfede7931fab', 'request_id': 'req-3e3a5cdc-1fcf-467a-8d47-ff1f7c945b30'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:17.497365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3e3a5cdc-1fcf-467a-8d47-ff1f7c945b30 admin admin] The token cache is being invalidate because project b689c9415d244b608e04dfede7931fab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:24:17.497775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3e3a5cdc-1fcf-467a-8d47-ff1f7c945b30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:17.498483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3e3a5cdc-1fcf-467a-8d47-ff1f7c945b30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:17.500314 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4278/8523] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:24:17 2022] DELETE /identity/v3/projects/b689c9415d244b608e04dfede7931fab => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:24:17.505164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c114a33-2454-4c68-979b-f68c8dffc054 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:17.517815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c114a33-2454-4c68-979b-f68c8dffc054 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:17.547203 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:17.592330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05c813-1847-44c8-bd41-a2bfd459dd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:17.592925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05c813-1847-44c8-bd41-a2bfd459dd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:17.593345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05c813-1847-44c8-bd41-a2bfd459dd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:17.593647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05c813-1847-44c8-bd41-a2bfd459dd46 admin admin] PATH_INFO: `/v3/users/50d449c6f4184837acea2404409fa19a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:17.594766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05c813-1847-44c8-bd41-a2bfd459dd46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50d449c6f4184837acea2404409fa19a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:17.597857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05c813-1847-44c8-bd41-a2bfd459dd46 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:17.652112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1b05c813-1847-44c8-bd41-a2bfd459dd46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50d449c6f4184837acea2404409fa19a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:17.663409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1b05c813-1847-44c8-bd41-a2bfd459dd46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50d449c6f4184837acea2404409fa19a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:17.664679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1b05c813-1847-44c8-bd41-a2bfd459dd46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50d449c6f4184837acea2404409fa19a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:17.681449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1b05c813-1847-44c8-bd41-a2bfd459dd46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50d449c6f4184837acea2404409fa19a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:17.689548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1b05c813-1847-44c8-bd41-a2bfd459dd46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50d449c6f4184837acea2404409fa19a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:17.702668 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4246/8524] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:24:17 2022] DELETE /identity/v3/users/50d449c6f4184837acea2404409fa19a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:24:18.007817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a5cdc-1fcf-467a-8d47-ff1f7c945b30 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:18.009425 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3e3a5cdc-1fcf-467a-8d47-ff1f7c945b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:18.035812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a5cdc-1fcf-467a-8d47-ff1f7c945b30 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:18.106442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b2b7c-6531-42a3-9bf3-dcf7f1960fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:18.107087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b2b7c-6531-42a3-9bf3-dcf7f1960fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:18.107365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b2b7c-6531-42a3-9bf3-dcf7f1960fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:18.107635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b2b7c-6531-42a3-9bf3-dcf7f1960fbc admin admin] PATH_INFO: `/v3/projects/f7dea298ef894b2c87d86a8731c9194a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:18.108844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b2b7c-6531-42a3-9bf3-dcf7f1960fbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7dea298ef894b2c87d86a8731c9194a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:18.110686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b2b7c-6531-42a3-9bf3-dcf7f1960fbc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:18.148794 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:18.162639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-de8b2b7c-6531-42a3-9bf3-dcf7f1960fbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7dea298ef894b2c87d86a8731c9194a', 'request_id': 'req-de8b2b7c-6531-42a3-9bf3-dcf7f1960fbc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:18.169932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-de8b2b7c-6531-42a3-9bf3-dcf7f1960fbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7dea298ef894b2c87d86a8731c9194a', 'request_id': 'req-de8b2b7c-6531-42a3-9bf3-dcf7f1960fbc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:18.176477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-de8b2b7c-6531-42a3-9bf3-dcf7f1960fbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7dea298ef894b2c87d86a8731c9194a', 'request_id': 'req-de8b2b7c-6531-42a3-9bf3-dcf7f1960fbc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:18.188091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-de8b2b7c-6531-42a3-9bf3-dcf7f1960fbc admin admin] The token cache is being invalidate because project f7dea298ef894b2c87d86a8731c9194a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:24:18.188387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-de8b2b7c-6531-42a3-9bf3-dcf7f1960fbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:18.189077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-de8b2b7c-6531-42a3-9bf3-dcf7f1960fbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:18.191438 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4279/8525] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:24:18 2022] DELETE /identity/v3/projects/f7dea298ef894b2c87d86a8731c9194a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:24:18.195569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05c813-1847-44c8-bd41-a2bfd459dd46 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:18.197165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1b05c813-1847-44c8-bd41-a2bfd459dd46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:18.210945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05c813-1847-44c8-bd41-a2bfd459dd46 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:18.280195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8807ae2-431f-4049-a80b-7050abcf4828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:18.280898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8807ae2-431f-4049-a80b-7050abcf4828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:18.281172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8807ae2-431f-4049-a80b-7050abcf4828 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:18.281449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8807ae2-431f-4049-a80b-7050abcf4828 admin admin] PATH_INFO: `/v3/users/4531456cfab1410294b2d434bc0c2119` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:18.282709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8807ae2-431f-4049-a80b-7050abcf4828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4531456cfab1410294b2d434bc0c2119)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:18.284906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8807ae2-431f-4049-a80b-7050abcf4828 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:18.340648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c8807ae2-431f-4049-a80b-7050abcf4828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4531456cfab1410294b2d434bc0c2119'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:18.343902 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:18.352141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c8807ae2-431f-4049-a80b-7050abcf4828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4531456cfab1410294b2d434bc0c2119'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:18.352962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c8807ae2-431f-4049-a80b-7050abcf4828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4531456cfab1410294b2d434bc0c2119'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:18.372168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c8807ae2-431f-4049-a80b-7050abcf4828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4531456cfab1410294b2d434bc0c2119'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:18.380203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c8807ae2-431f-4049-a80b-7050abcf4828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4531456cfab1410294b2d434bc0c2119'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:18.386770 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4247/8526] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:24:18 2022] DELETE /identity/v3/users/4531456cfab1410294b2d434bc0c2119 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:24:18.696000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b2b7c-6531-42a3-9bf3-dcf7f1960fbc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:18.697989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-de8b2b7c-6531-42a3-9bf3-dcf7f1960fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:18.713745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b2b7c-6531-42a3-9bf3-dcf7f1960fbc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:18.794123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d928c27-350f-4b6b-b158-f9031cc3c317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:18.795270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d928c27-350f-4b6b-b158-f9031cc3c317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:18.795676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d928c27-350f-4b6b-b158-f9031cc3c317 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:18.796063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d928c27-350f-4b6b-b158-f9031cc3c317 admin admin] PATH_INFO: `/v3/projects/b24b4c6e3641469e9d1f91975ede4e34` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:18.797279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d928c27-350f-4b6b-b158-f9031cc3c317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b24b4c6e3641469e9d1f91975ede4e34)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:18.799175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d928c27-350f-4b6b-b158-f9031cc3c317 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:18.858580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3d928c27-350f-4b6b-b158-f9031cc3c317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b24b4c6e3641469e9d1f91975ede4e34', 'request_id': 'req-3d928c27-350f-4b6b-b158-f9031cc3c317'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:18.870382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3d928c27-350f-4b6b-b158-f9031cc3c317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b24b4c6e3641469e9d1f91975ede4e34', 'request_id': 'req-3d928c27-350f-4b6b-b158-f9031cc3c317'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:18.879711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3d928c27-350f-4b6b-b158-f9031cc3c317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b24b4c6e3641469e9d1f91975ede4e34', 'request_id': 'req-3d928c27-350f-4b6b-b158-f9031cc3c317'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:18.899409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3d928c27-350f-4b6b-b158-f9031cc3c317 admin admin] The token cache is being invalidate because project b24b4c6e3641469e9d1f91975ede4e34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:24:18.899781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3d928c27-350f-4b6b-b158-f9031cc3c317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:18.900428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3d928c27-350f-4b6b-b158-f9031cc3c317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:18.902341 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4280/8527] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:24:18 2022] DELETE /identity/v3/projects/b24b4c6e3641469e9d1f91975ede4e34 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:24:18.908153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78a63f-cd05-4b9f-85f8-c25890aa2270 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:18.908735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78a63f-cd05-4b9f-85f8-c25890aa2270 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:18.915802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78a63f-cd05-4b9f-85f8-c25890aa2270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:18.947221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ee78a63f-cd05-4b9f-85f8-c25890aa2270 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:18.949083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ee78a63f-cd05-4b9f-85f8-c25890aa2270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:19.030485 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4248/8528] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:24:19.039007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a0c0d-2a45-4318-a49c-be59f8e3c7f9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:19.039499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a0c0d-2a45-4318-a49c-be59f8e3c7f9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:19.039606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a0c0d-2a45-4318-a49c-be59f8e3c7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:19.060660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6b3a0c0d-2a45-4318-a49c-be59f8e3c7f9 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:19.061964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6b3a0c0d-2a45-4318-a49c-be59f8e3c7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:19.070606 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4281/8529] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:24:19.075303 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78a63f-cd05-4b9f-85f8-c25890aa2270 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:19.087034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78a63f-cd05-4b9f-85f8-c25890aa2270 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:19.092098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026a30b-4e69-4195-a6ec-cc65871a79c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:19.092775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026a30b-4e69-4195-a6ec-cc65871a79c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:19.093125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026a30b-4e69-4195-a6ec-cc65871a79c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:19.093558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026a30b-4e69-4195-a6ec-cc65871a79c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:19.094236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026a30b-4e69-4195-a6ec-cc65871a79c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:24:19.094534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026a30b-4e69-4195-a6ec-cc65871a79c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:19.096150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026a30b-4e69-4195-a6ec-cc65871a79c8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:19.114490 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4249/8530] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:24:19.116201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a0c0d-2a45-4318-a49c-be59f8e3c7f9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:19.128006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a0c0d-2a45-4318-a49c-be59f8e3c7f9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:19.133144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42bd8c-ca58-4159-96b1-44f9126fc7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:19.133788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42bd8c-ca58-4159-96b1-44f9126fc7f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:19.134093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42bd8c-ca58-4159-96b1-44f9126fc7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:19.134373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42bd8c-ca58-4159-96b1-44f9126fc7f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:19.135056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42bd8c-ca58-4159-96b1-44f9126fc7f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:19.136974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42bd8c-ca58-4159-96b1-44f9126fc7f3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:19.173661 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4282/8531] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:24:19 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:24:19.175430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026a30b-4e69-4195-a6ec-cc65871a79c8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:19.185755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026a30b-4e69-4195-a6ec-cc65871a79c8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:19.243672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4430d9-6322-4e4a-8811-838b1a686d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:19.244285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4430d9-6322-4e4a-8811-838b1a686d9d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:19.244567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4430d9-6322-4e4a-8811-838b1a686d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:19.244900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4430d9-6322-4e4a-8811-838b1a686d9d admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:19.245547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4430d9-6322-4e4a-8811-838b1a686d9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:19.247450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4430d9-6322-4e4a-8811-838b1a686d9d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:19.276647 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4250/8532] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:24:19 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:24:19.277919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42bd8c-ca58-4159-96b1-44f9126fc7f3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:19.289186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42bd8c-ca58-4159-96b1-44f9126fc7f3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:19.293843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76a9be-4711-4d52-bc05-26d1e7ba2846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:19.294421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76a9be-4711-4d52-bc05-26d1e7ba2846 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:19.294704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76a9be-4711-4d52-bc05-26d1e7ba2846 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:19.294979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76a9be-4711-4d52-bc05-26d1e7ba2846 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:19.295621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76a9be-4711-4d52-bc05-26d1e7ba2846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:19.297253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76a9be-4711-4d52-bc05-26d1e7ba2846 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:19.307960 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4283/8533] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:24:19.312214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4430d9-6322-4e4a-8811-838b1a686d9d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:19.323321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4430d9-6322-4e4a-8811-838b1a686d9d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:19.327941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96d77b-7c67-427f-8d94-943627244fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:19.328530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96d77b-7c67-427f-8d94-943627244fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:19.328841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96d77b-7c67-427f-8d94-943627244fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:19.329108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96d77b-7c67-427f-8d94-943627244fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:19.329735 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96d77b-7c67-427f-8d94-943627244fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:19.331432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96d77b-7c67-427f-8d94-943627244fd7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:19.342394 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4251/8534] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:24:19.347132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76a9be-4711-4d52-bc05-26d1e7ba2846 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:19.357766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76a9be-4711-4d52-bc05-26d1e7ba2846 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:19.363728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2c108-2b1f-4b10-be16-b71bceb4c7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:19.364396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2c108-2b1f-4b10-be16-b71bceb4c7fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:19.364711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2c108-2b1f-4b10-be16-b71bceb4c7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:19.364991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2c108-2b1f-4b10-be16-b71bceb4c7fe admin admin] PATH_INFO: `/v3/projects/8c0359fc055d4b9dbf0d2841409a80dc/users/110eca3227564e579d69f1f2d9ba6116/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:19.374451 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:19.383753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2c108-2b1f-4b10-be16-b71bceb4c7fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0359fc055d4b9dbf0d2841409a80dc, user_id=110eca3227564e579d69f1f2d9ba6116, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:19.386491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2c108-2b1f-4b10-be16-b71bceb4c7fe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:19.400107 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4284/8535] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:24:19 2022] PUT /identity/v3/projects/8c0359fc055d4b9dbf0d2841409a80dc/users/110eca3227564e579d69f1f2d9ba6116/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:24:19.405076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578a7c0-4514-4220-a7bc-aad4850f60e9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:19.405360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578a7c0-4514-4220-a7bc-aad4850f60e9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:19.405630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578a7c0-4514-4220-a7bc-aad4850f60e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:19.426451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2578a7c0-4514-4220-a7bc-aad4850f60e9 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:19.427588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2578a7c0-4514-4220-a7bc-aad4850f60e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:19.460213 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:19.494266 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4252/8536] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:24:19.504216 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2c108-2b1f-4b10-be16-b71bceb4c7fe admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:19.505985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9aa2c108-2b1f-4b10-be16-b71bceb4c7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:19.566907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2c108-2b1f-4b10-be16-b71bceb4c7fe admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:19.570569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf03d4-1ed0-488b-a8ea-8b55f3e5097c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:19.571172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf03d4-1ed0-488b-a8ea-8b55f3e5097c service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:19.571453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf03d4-1ed0-488b-a8ea-8b55f3e5097c service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:19.571729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf03d4-1ed0-488b-a8ea-8b55f3e5097c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:19.582034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf03d4-1ed0-488b-a8ea-8b55f3e5097c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:19.583462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf03d4-1ed0-488b-a8ea-8b55f3e5097c service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:19.593289 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4285/8537] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:24:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:24:20.312724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da27721-8607-440a-9db9-470f03a46018 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:20.313778 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da27721-8607-440a-9db9-470f03a46018 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:20.314284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da27721-8607-440a-9db9-470f03a46018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:20.349979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7da27721-8607-440a-9db9-470f03a46018 None None] MFA Rules not processed for user `110eca3227564e579d69f1f2d9ba6116`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:20.351294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7da27721-8607-440a-9db9-470f03a46018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:20.423736 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4253/8538] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:24:20.435468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf03d4-1ed0-488b-a8ea-8b55f3e5097c service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:20.437107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cbbf03d4-1ed0-488b-a8ea-8b55f3e5097c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:20.507533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf03d4-1ed0-488b-a8ea-8b55f3e5097c service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:20.511187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a86a5-ac87-4fe6-bf34-d6baab386fb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:20.511799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a86a5-ac87-4fe6-bf34-d6baab386fb0 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:20.512085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a86a5-ac87-4fe6-bf34-d6baab386fb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:20.512347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a86a5-ac87-4fe6-bf34-d6baab386fb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:20.521996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a86a5-ac87-4fe6-bf34-d6baab386fb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:20.523509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a86a5-ac87-4fe6-bf34-d6baab386fb0 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:20.533323 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4286/8539] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:24:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:24:21.935610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495bf83-db40-4b3d-8e2a-96dd50106f04 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:21.935610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495bf83-db40-4b3d-8e2a-96dd50106f04 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:21.935610 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495bf83-db40-4b3d-8e2a-96dd50106f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:21.959653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2495bf83-db40-4b3d-8e2a-96dd50106f04 None None] MFA Rules not processed for user `110eca3227564e579d69f1f2d9ba6116`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:21.959653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2495bf83-db40-4b3d-8e2a-96dd50106f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:21.968683 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4254/8540] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:24:27.667219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a86a5-ac87-4fe6-bf34-d6baab386fb0 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:27.668470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9c7a86a5-ac87-4fe6-bf34-d6baab386fb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:27.811105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a86a5-ac87-4fe6-bf34-d6baab386fb0 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:27.823754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d098b-b9ac-4743-abf7-c07408153713 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:27.824847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d098b-b9ac-4743-abf7-c07408153713 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:27.825665 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d098b-b9ac-4743-abf7-c07408153713 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:27.826085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d098b-b9ac-4743-abf7-c07408153713 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:27.829431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c08d098b-b9ac-4743-abf7-c07408153713 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:27.878854 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:27.966581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d098b-b9ac-4743-abf7-c07408153713 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:27.968397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d098b-b9ac-4743-abf7-c07408153713 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:27.999765 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4287/8541] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:24:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:24:31.948546 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=47 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:31.952752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495bf83-db40-4b3d-8e2a-96dd50106f04 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:31.956313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2495bf83-db40-4b3d-8e2a-96dd50106f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:31.985564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495bf83-db40-4b3d-8e2a-96dd50106f04 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:32.000318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bce6a4-7aab-41d9-ab05-a8468034523e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:32.000903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bce6a4-7aab-41d9-ab05-a8468034523e service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:32.001281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bce6a4-7aab-41d9-ab05-a8468034523e service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:32.002345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bce6a4-7aab-41d9-ab05-a8468034523e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:32.009442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-86bce6a4-7aab-41d9-ab05-a8468034523e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:32.027419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bce6a4-7aab-41d9-ab05-a8468034523e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:32.029580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bce6a4-7aab-41d9-ab05-a8468034523e service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:32.049938 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4255/8542] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:24:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:24:32.611778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d098b-b9ac-4743-abf7-c07408153713 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:32.613613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c08d098b-b9ac-4743-abf7-c07408153713 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:32.628503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d098b-b9ac-4743-abf7-c07408153713 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:32.633561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace554a-49d4-4683-ab4f-895b8c8806d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:32.634212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace554a-49d4-4683-ab4f-895b8c8806d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:32.634637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace554a-49d4-4683-ab4f-895b8c8806d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:32.634917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace554a-49d4-4683-ab4f-895b8c8806d9 admin admin] PATH_INFO: `/v3/users/2174e4cf2b644ad7b2dfa3218448d71b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:32.636131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace554a-49d4-4683-ab4f-895b8c8806d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2174e4cf2b644ad7b2dfa3218448d71b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:32.638244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace554a-49d4-4683-ab4f-895b8c8806d9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:32.723235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7ace554a-49d4-4683-ab4f-895b8c8806d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2174e4cf2b644ad7b2dfa3218448d71b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:32.723934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7ace554a-49d4-4683-ab4f-895b8c8806d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2174e4cf2b644ad7b2dfa3218448d71b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:32.736241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7ace554a-49d4-4683-ab4f-895b8c8806d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2174e4cf2b644ad7b2dfa3218448d71b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:32.756064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7ace554a-49d4-4683-ab4f-895b8c8806d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2174e4cf2b644ad7b2dfa3218448d71b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:32.767999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7ace554a-49d4-4683-ab4f-895b8c8806d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2174e4cf2b644ad7b2dfa3218448d71b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:32.790791 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4288/8543] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:24:32 2022] DELETE /identity/v3/users/2174e4cf2b644ad7b2dfa3218448d71b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:24:32.792264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ad680-47de-4820-87e2-23bee428463c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:32.792838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ad680-47de-4820-87e2-23bee428463c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:32.793353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ad680-47de-4820-87e2-23bee428463c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:32.827359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ae9ad680-47de-4820-87e2-23bee428463c None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:32.835128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ae9ad680-47de-4820-87e2-23bee428463c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:32.938199 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4256/8544] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:24:32.945242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace554a-49d4-4683-ab4f-895b8c8806d9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:32.951962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7ace554a-49d4-4683-ab4f-895b8c8806d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:33.052162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace554a-49d4-4683-ab4f-895b8c8806d9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:33.058523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895e6c6-5181-404b-89a4-8a738ba477ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:33.059352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895e6c6-5181-404b-89a4-8a738ba477ad service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:33.060341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895e6c6-5181-404b-89a4-8a738ba477ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:33.060720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895e6c6-5181-404b-89a4-8a738ba477ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:33.079990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895e6c6-5181-404b-89a4-8a738ba477ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:33.082551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895e6c6-5181-404b-89a4-8a738ba477ad service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:33.110649 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4289/8545] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:24:33.567485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ad680-47de-4820-87e2-23bee428463c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:33.568962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ae9ad680-47de-4820-87e2-23bee428463c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:33.594274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ad680-47de-4820-87e2-23bee428463c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:33.601258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea36ffd-475a-4903-bbce-f02c7ddb6950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:33.601914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea36ffd-475a-4903-bbce-f02c7ddb6950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:33.602195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea36ffd-475a-4903-bbce-f02c7ddb6950 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:33.602472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea36ffd-475a-4903-bbce-f02c7ddb6950 admin admin] PATH_INFO: `/v3/projects/7c3f7bc820ac4d648c57ad9b1c4f6e85` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:33.606993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea36ffd-475a-4903-bbce-f02c7ddb6950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c3f7bc820ac4d648c57ad9b1c4f6e85)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:33.619403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea36ffd-475a-4903-bbce-f02c7ddb6950 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:33.696525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3ea36ffd-475a-4903-bbce-f02c7ddb6950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c3f7bc820ac4d648c57ad9b1c4f6e85', 'request_id': 'req-3ea36ffd-475a-4903-bbce-f02c7ddb6950'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:33.707881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3ea36ffd-475a-4903-bbce-f02c7ddb6950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c3f7bc820ac4d648c57ad9b1c4f6e85', 'request_id': 'req-3ea36ffd-475a-4903-bbce-f02c7ddb6950'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:33.716588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3ea36ffd-475a-4903-bbce-f02c7ddb6950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c3f7bc820ac4d648c57ad9b1c4f6e85', 'request_id': 'req-3ea36ffd-475a-4903-bbce-f02c7ddb6950'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:33.732888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3ea36ffd-475a-4903-bbce-f02c7ddb6950 admin admin] The token cache is being invalidate because project 7c3f7bc820ac4d648c57ad9b1c4f6e85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:24:33.733466 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3ea36ffd-475a-4903-bbce-f02c7ddb6950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:33.734726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3ea36ffd-475a-4903-bbce-f02c7ddb6950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:33.736846 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4257/8546] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:24:33 2022] DELETE /identity/v3/projects/7c3f7bc820ac4d648c57ad9b1c4f6e85 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:24:35.285084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d42b9-0496-40d9-86ae-477c7999fcaf None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:35.285551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d42b9-0496-40d9-86ae-477c7999fcaf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:35.285672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d42b9-0496-40d9-86ae-477c7999fcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:35.330506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-997d42b9-0496-40d9-86ae-477c7999fcaf None None] MFA Rules not processed for user `45a25acf184b4bfc9f1b06dcf0e6d81b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:35.331922 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-997d42b9-0496-40d9-86ae-477c7999fcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:35.336975 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:35.421197 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4290/8547] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:24:36.576965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea36ffd-475a-4903-bbce-f02c7ddb6950 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:36.580997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3ea36ffd-475a-4903-bbce-f02c7ddb6950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:36.710298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea36ffd-475a-4903-bbce-f02c7ddb6950 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:36.725106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740389a3-cceb-4ecd-b6db-f8475d72c684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:36.725814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740389a3-cceb-4ecd-b6db-f8475d72c684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:36.725941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740389a3-cceb-4ecd-b6db-f8475d72c684 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:36.726225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740389a3-cceb-4ecd-b6db-f8475d72c684 admin admin] PATH_INFO: `/v3/users/fb9dee808083429a999cadea57b31908` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:36.727387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740389a3-cceb-4ecd-b6db-f8475d72c684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb9dee808083429a999cadea57b31908)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:36.729543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740389a3-cceb-4ecd-b6db-f8475d72c684 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:36.749038 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:36.803163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-740389a3-cceb-4ecd-b6db-f8475d72c684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb9dee808083429a999cadea57b31908'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:36.812532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-740389a3-cceb-4ecd-b6db-f8475d72c684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb9dee808083429a999cadea57b31908'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:36.813545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-740389a3-cceb-4ecd-b6db-f8475d72c684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb9dee808083429a999cadea57b31908'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:36.831051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-740389a3-cceb-4ecd-b6db-f8475d72c684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb9dee808083429a999cadea57b31908'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:36.839054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-740389a3-cceb-4ecd-b6db-f8475d72c684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb9dee808083429a999cadea57b31908'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:36.845737 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4258/8548] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:24:36 2022] DELETE /identity/v3/users/fb9dee808083429a999cadea57b31908 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:24:36.850273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d8c4f-fbe9-4ec7-bb69-a9bdba7b56c7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:36.850807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d8c4f-fbe9-4ec7-bb69-a9bdba7b56c7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:36.850807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d8c4f-fbe9-4ec7-bb69-a9bdba7b56c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:36.872227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b91d8c4f-fbe9-4ec7-bb69-a9bdba7b56c7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:36.873732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b91d8c4f-fbe9-4ec7-bb69-a9bdba7b56c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:36.944016 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4291/8549] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:24:36.952473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740389a3-cceb-4ecd-b6db-f8475d72c684 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:36.953907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-740389a3-cceb-4ecd-b6db-f8475d72c684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:37.019801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740389a3-cceb-4ecd-b6db-f8475d72c684 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:37.023511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525f03f-3184-42ac-8d00-ad58b67f9413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:37.024119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525f03f-3184-42ac-8d00-ad58b67f9413 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:37.024397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525f03f-3184-42ac-8d00-ad58b67f9413 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:37.024696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525f03f-3184-42ac-8d00-ad58b67f9413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:37.034741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525f03f-3184-42ac-8d00-ad58b67f9413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:37.036154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525f03f-3184-42ac-8d00-ad58b67f9413 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:37.046130 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4259/8550] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:24:37.230309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d8c4f-fbe9-4ec7-bb69-a9bdba7b56c7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:37.239115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b91d8c4f-fbe9-4ec7-bb69-a9bdba7b56c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:37.261687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d8c4f-fbe9-4ec7-bb69-a9bdba7b56c7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:37.268532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8984c12-ac21-45b0-9d8d-dec8bc85686e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:37.269260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8984c12-ac21-45b0-9d8d-dec8bc85686e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:37.269573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8984c12-ac21-45b0-9d8d-dec8bc85686e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:37.269850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8984c12-ac21-45b0-9d8d-dec8bc85686e admin admin] PATH_INFO: `/v3/projects/f2ee78188cec44e7a00822f4771ce020` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:37.271036 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8984c12-ac21-45b0-9d8d-dec8bc85686e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ee78188cec44e7a00822f4771ce020)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:37.273064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8984c12-ac21-45b0-9d8d-dec8bc85686e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:37.328498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d8984c12-ac21-45b0-9d8d-dec8bc85686e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ee78188cec44e7a00822f4771ce020', 'request_id': 'req-d8984c12-ac21-45b0-9d8d-dec8bc85686e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:37.338551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d8984c12-ac21-45b0-9d8d-dec8bc85686e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ee78188cec44e7a00822f4771ce020', 'request_id': 'req-d8984c12-ac21-45b0-9d8d-dec8bc85686e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:37.350137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d8984c12-ac21-45b0-9d8d-dec8bc85686e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ee78188cec44e7a00822f4771ce020', 'request_id': 'req-d8984c12-ac21-45b0-9d8d-dec8bc85686e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:37.362213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d8984c12-ac21-45b0-9d8d-dec8bc85686e admin admin] The token cache is being invalidate because project f2ee78188cec44e7a00822f4771ce020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:24:37.362713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d8984c12-ac21-45b0-9d8d-dec8bc85686e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:37.363451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d8984c12-ac21-45b0-9d8d-dec8bc85686e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:37.365211 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4292/8551] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:24:37 2022] DELETE /identity/v3/projects/f2ee78188cec44e7a00822f4771ce020 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:24:37.369311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525f03f-3184-42ac-8d00-ad58b67f9413 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:37.381086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525f03f-3184-42ac-8d00-ad58b67f9413 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:37.457578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8e19e-663e-4ede-9df0-01d064ef91b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:37.458213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8e19e-663e-4ede-9df0-01d064ef91b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:37.458495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8e19e-663e-4ede-9df0-01d064ef91b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:37.458765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8e19e-663e-4ede-9df0-01d064ef91b5 admin admin] PATH_INFO: `/v3/users/831d3697224b4a2f80df344aba1fad54` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:37.459881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8e19e-663e-4ede-9df0-01d064ef91b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=831d3697224b4a2f80df344aba1fad54)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:37.461808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8e19e-663e-4ede-9df0-01d064ef91b5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:37.499185 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:37.512222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f8e8e19e-663e-4ede-9df0-01d064ef91b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '831d3697224b4a2f80df344aba1fad54'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:37.521291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f8e8e19e-663e-4ede-9df0-01d064ef91b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '831d3697224b4a2f80df344aba1fad54'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:37.521942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f8e8e19e-663e-4ede-9df0-01d064ef91b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '831d3697224b4a2f80df344aba1fad54'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:37.535690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f8e8e19e-663e-4ede-9df0-01d064ef91b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '831d3697224b4a2f80df344aba1fad54'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:37.542920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f8e8e19e-663e-4ede-9df0-01d064ef91b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '831d3697224b4a2f80df344aba1fad54'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:37.549227 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4260/8552] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:24:37 2022] DELETE /identity/v3/users/831d3697224b4a2f80df344aba1fad54 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:24:37.899436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8984c12-ac21-45b0-9d8d-dec8bc85686e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:37.902411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d8984c12-ac21-45b0-9d8d-dec8bc85686e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:37.934567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8984c12-ac21-45b0-9d8d-dec8bc85686e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:37.981094 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:38.007567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb495ce-3532-4cc1-a34f-cb68598f6023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:38.008200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb495ce-3532-4cc1-a34f-cb68598f6023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:38.008502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb495ce-3532-4cc1-a34f-cb68598f6023 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:38.008826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb495ce-3532-4cc1-a34f-cb68598f6023 admin admin] PATH_INFO: `/v3/projects/411dc3434f1a4514a4856986eb8826d1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:38.009950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb495ce-3532-4cc1-a34f-cb68598f6023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=411dc3434f1a4514a4856986eb8826d1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:38.011847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb495ce-3532-4cc1-a34f-cb68598f6023 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:38.079453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2bb495ce-3532-4cc1-a34f-cb68598f6023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '411dc3434f1a4514a4856986eb8826d1', 'request_id': 'req-2bb495ce-3532-4cc1-a34f-cb68598f6023'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:38.091160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2bb495ce-3532-4cc1-a34f-cb68598f6023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '411dc3434f1a4514a4856986eb8826d1', 'request_id': 'req-2bb495ce-3532-4cc1-a34f-cb68598f6023'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:38.124643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2bb495ce-3532-4cc1-a34f-cb68598f6023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '411dc3434f1a4514a4856986eb8826d1', 'request_id': 'req-2bb495ce-3532-4cc1-a34f-cb68598f6023'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:38.142193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2bb495ce-3532-4cc1-a34f-cb68598f6023 admin admin] The token cache is being invalidate because project 411dc3434f1a4514a4856986eb8826d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:24:38.142494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2bb495ce-3532-4cc1-a34f-cb68598f6023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:38.143491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2bb495ce-3532-4cc1-a34f-cb68598f6023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:24:38.146915 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4293/8553] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:24:37 2022] DELETE /identity/v3/projects/411dc3434f1a4514a4856986eb8826d1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:24:38.150680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5cf33-3755-4619-a2b3-184d94b8b205 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:38.151130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5cf33-3755-4619-a2b3-184d94b8b205 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:38.151230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5cf33-3755-4619-a2b3-184d94b8b205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:38.173604 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-43f5cf33-3755-4619-a2b3-184d94b8b205 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:38.174978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-43f5cf33-3755-4619-a2b3-184d94b8b205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:38.318356 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4261/8554] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:24:38.327456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7d330-afd9-4a79-bc6e-4fd942c2f751 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:38.327875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7d330-afd9-4a79-bc6e-4fd942c2f751 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:38.328655 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7d330-afd9-4a79-bc6e-4fd942c2f751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:38.365246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fec7d330-afd9-4a79-bc6e-4fd942c2f751 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:38.366499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fec7d330-afd9-4a79-bc6e-4fd942c2f751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:38.377779 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4294/8555] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:24:38.381853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5cf33-3755-4619-a2b3-184d94b8b205 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:38.395473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5cf33-3755-4619-a2b3-184d94b8b205 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:38.402328 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865f3a5-36ff-42c9-8f29-9be3de966da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:38.402940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865f3a5-36ff-42c9-8f29-9be3de966da3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:38.403699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865f3a5-36ff-42c9-8f29-9be3de966da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:38.403699 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865f3a5-36ff-42c9-8f29-9be3de966da3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:38.404106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865f3a5-36ff-42c9-8f29-9be3de966da3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:24:38.404402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865f3a5-36ff-42c9-8f29-9be3de966da3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:38.406954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865f3a5-36ff-42c9-8f29-9be3de966da3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:38.428374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7d330-afd9-4a79-bc6e-4fd942c2f751 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:38.435684 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4262/8556] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:24:38.440101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7d330-afd9-4a79-bc6e-4fd942c2f751 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:38.449666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea2aaf-9ae4-4f6c-ad76-845badb9fe00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:38.450798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea2aaf-9ae4-4f6c-ad76-845badb9fe00 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:38.451358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea2aaf-9ae4-4f6c-ad76-845badb9fe00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:38.452707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea2aaf-9ae4-4f6c-ad76-845badb9fe00 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:38.453472 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea2aaf-9ae4-4f6c-ad76-845badb9fe00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:38.456422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea2aaf-9ae4-4f6c-ad76-845badb9fe00 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:38.503339 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4295/8557] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:24:38 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:24:38.504675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865f3a5-36ff-42c9-8f29-9be3de966da3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:38.516368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865f3a5-36ff-42c9-8f29-9be3de966da3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:38.597952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618480e-11f2-4923-90d5-3fd611d62e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:38.598707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618480e-11f2-4923-90d5-3fd611d62e1a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:38.599089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618480e-11f2-4923-90d5-3fd611d62e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:38.599460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618480e-11f2-4923-90d5-3fd611d62e1a admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:38.600205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618480e-11f2-4923-90d5-3fd611d62e1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:38.603183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618480e-11f2-4923-90d5-3fd611d62e1a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:38.628418 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4263/8558] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:24:38 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:24:38.632481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea2aaf-9ae4-4f6c-ad76-845badb9fe00 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:38.647396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea2aaf-9ae4-4f6c-ad76-845badb9fe00 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:38.652863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7c6a0-15e3-4afd-988f-df965c7941a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:38.653478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7c6a0-15e3-4afd-988f-df965c7941a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:38.653917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7c6a0-15e3-4afd-988f-df965c7941a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:38.654197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7c6a0-15e3-4afd-988f-df965c7941a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:38.654853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7c6a0-15e3-4afd-988f-df965c7941a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:38.656451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7c6a0-15e3-4afd-988f-df965c7941a9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:38.668539 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4296/8559] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:24:38.675607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618480e-11f2-4923-90d5-3fd611d62e1a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:38.689301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618480e-11f2-4923-90d5-3fd611d62e1a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:38.694025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602a323-6ec1-4890-99e9-a931a1af0f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:38.694753 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602a323-6ec1-4890-99e9-a931a1af0f4a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:38.695055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602a323-6ec1-4890-99e9-a931a1af0f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:38.695323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602a323-6ec1-4890-99e9-a931a1af0f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:38.695966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602a323-6ec1-4890-99e9-a931a1af0f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:38.697863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602a323-6ec1-4890-99e9-a931a1af0f4a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:38.713220 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4264/8560] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:24:38.717356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7c6a0-15e3-4afd-988f-df965c7941a9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:38.730405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7c6a0-15e3-4afd-988f-df965c7941a9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:38.733879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670546b5-9275-4ab2-9ab9-dd98bda7cd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:38.734559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670546b5-9275-4ab2-9ab9-dd98bda7cd4d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:38.734924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670546b5-9275-4ab2-9ab9-dd98bda7cd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:38.735273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670546b5-9275-4ab2-9ab9-dd98bda7cd4d admin admin] PATH_INFO: `/v3/projects/b3adf0621b1542549f09feca49de3b50/users/61fa09fe56b64eb69666368a5b423768/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:38.755817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670546b5-9275-4ab2-9ab9-dd98bda7cd4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3adf0621b1542549f09feca49de3b50, user_id=61fa09fe56b64eb69666368a5b423768, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:38.760290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670546b5-9275-4ab2-9ab9-dd98bda7cd4d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:38.780519 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4297/8561] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:24:38 2022] PUT /identity/v3/projects/b3adf0621b1542549f09feca49de3b50/users/61fa09fe56b64eb69666368a5b423768/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:24:38.786351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf20086-82bf-42f6-be75-0638bca6a4f3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:38.786674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf20086-82bf-42f6-be75-0638bca6a4f3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:38.786950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf20086-82bf-42f6-be75-0638bca6a4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:38.816508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bbf20086-82bf-42f6-be75-0638bca6a4f3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:38.817884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bbf20086-82bf-42f6-be75-0638bca6a4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:38.844395 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:38.915882 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4265/8562] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:24:38.930447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670546b5-9275-4ab2-9ab9-dd98bda7cd4d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:38.934815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-670546b5-9275-4ab2-9ab9-dd98bda7cd4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:39.021691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670546b5-9275-4ab2-9ab9-dd98bda7cd4d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:39.055601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8939977-94b5-42d6-b72d-e1c45be21ed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:39.056163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8939977-94b5-42d6-b72d-e1c45be21ed4 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:39.056445 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8939977-94b5-42d6-b72d-e1c45be21ed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:39.057310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8939977-94b5-42d6-b72d-e1c45be21ed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:39.067770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8939977-94b5-42d6-b72d-e1c45be21ed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:39.069265 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8939977-94b5-42d6-b72d-e1c45be21ed4 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:39.084876 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4298/8563] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:24:39.659645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949635-fa6a-4714-a7e7-5e2f22d3da3f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:39.660100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949635-fa6a-4714-a7e7-5e2f22d3da3f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:39.660210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949635-fa6a-4714-a7e7-5e2f22d3da3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:39.681777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fd949635-fa6a-4714-a7e7-5e2f22d3da3f None None] MFA Rules not processed for user `110eca3227564e579d69f1f2d9ba6116`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:39.683232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fd949635-fa6a-4714-a7e7-5e2f22d3da3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:39.773781 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4266/8564] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:24:43.654904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8939977-94b5-42d6-b72d-e1c45be21ed4 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:43.657162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a8939977-94b5-42d6-b72d-e1c45be21ed4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:43.683757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8939977-94b5-42d6-b72d-e1c45be21ed4 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:43.688809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43048b-5acc-43db-8e52-ef9d00157635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:43.690874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43048b-5acc-43db-8e52-ef9d00157635 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:43.691356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43048b-5acc-43db-8e52-ef9d00157635 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:43.691805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43048b-5acc-43db-8e52-ef9d00157635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:43.694287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5f43048b-5acc-43db-8e52-ef9d00157635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:43.703581 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:43.723683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43048b-5acc-43db-8e52-ef9d00157635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:43.725632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43048b-5acc-43db-8e52-ef9d00157635 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:43.740977 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4299/8565] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:24:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:24:46.204737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af47ea-ceb3-45c7-b411-40a19e75677f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:46.205461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af47ea-ceb3-45c7-b411-40a19e75677f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:46.205461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af47ea-ceb3-45c7-b411-40a19e75677f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:46.233141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f3af47ea-ceb3-45c7-b411-40a19e75677f None None] MFA Rules not processed for user `61fa09fe56b64eb69666368a5b423768`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:46.234352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f3af47ea-ceb3-45c7-b411-40a19e75677f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:46.301116 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4267/8566] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:24:46.305664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43048b-5acc-43db-8e52-ef9d00157635 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:46.318107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43048b-5acc-43db-8e52-ef9d00157635 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:46.323004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e5dbd-c3bb-469b-906e-e627efb564ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:46.323569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e5dbd-c3bb-469b-906e-e627efb564ec admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:46.323852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e5dbd-c3bb-469b-906e-e627efb564ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:46.324121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e5dbd-c3bb-469b-906e-e627efb564ec admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:46.324777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e5dbd-c3bb-469b-906e-e627efb564ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:46.326643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e5dbd-c3bb-469b-906e-e627efb564ec admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:46.363829 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4300/8567] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:24:46 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:24:46.365044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af47ea-ceb3-45c7-b411-40a19e75677f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:46.383504 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af47ea-ceb3-45c7-b411-40a19e75677f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:46.440061 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:46.452105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35998f44-7a11-416f-a097-a24393c632bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:46.452853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35998f44-7a11-416f-a097-a24393c632bb admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:46.453210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35998f44-7a11-416f-a097-a24393c632bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:46.453557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35998f44-7a11-416f-a097-a24393c632bb admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:46.454229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35998f44-7a11-416f-a097-a24393c632bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:46.456353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35998f44-7a11-416f-a097-a24393c632bb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:46.482132 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4268/8568] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:24:46 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:24:46.483332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e5dbd-c3bb-469b-906e-e627efb564ec admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:46.496119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e5dbd-c3bb-469b-906e-e627efb564ec admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:46.500974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd1411-7329-4e93-a54f-d7f002ae4257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:46.501670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd1411-7329-4e93-a54f-d7f002ae4257 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:46.502016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd1411-7329-4e93-a54f-d7f002ae4257 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:46.502370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd1411-7329-4e93-a54f-d7f002ae4257 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:46.503023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd1411-7329-4e93-a54f-d7f002ae4257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:46.504700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd1411-7329-4e93-a54f-d7f002ae4257 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:46.517264 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4301/8569] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:24:46.522562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35998f44-7a11-416f-a097-a24393c632bb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:46.535349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35998f44-7a11-416f-a097-a24393c632bb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:46.540434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb50f1-41aa-4b11-8580-8324d4b1a2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:46.541137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb50f1-41aa-4b11-8580-8324d4b1a2a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:46.541416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb50f1-41aa-4b11-8580-8324d4b1a2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:46.541717 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb50f1-41aa-4b11-8580-8324d4b1a2a0 admin admin] PATH_INFO: `/v3/projects/6c31282b66234c97ade76d3eed02186a/users/d3cd91cc9fd64567803fdb391a3d98e0/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:46.558306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb50f1-41aa-4b11-8580-8324d4b1a2a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c31282b66234c97ade76d3eed02186a, user_id=d3cd91cc9fd64567803fdb391a3d98e0, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:46.561143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb50f1-41aa-4b11-8580-8324d4b1a2a0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:46.577055 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4269/8570] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:24:46 2022] PUT /identity/v3/projects/6c31282b66234c97ade76d3eed02186a/users/d3cd91cc9fd64567803fdb391a3d98e0/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:24:46.581605 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd1411-7329-4e93-a54f-d7f002ae4257 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:46.592906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd1411-7329-4e93-a54f-d7f002ae4257 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:46.660175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26c59f-1577-4caf-a4da-441583d199c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:46.660826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26c59f-1577-4caf-a4da-441583d199c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:46.661111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26c59f-1577-4caf-a4da-441583d199c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:46.661387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26c59f-1577-4caf-a4da-441583d199c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:46.662030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26c59f-1577-4caf-a4da-441583d199c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:46.663615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26c59f-1577-4caf-a4da-441583d199c4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:46.674042 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4302/8571] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:24:46.678055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb50f1-41aa-4b11-8580-8324d4b1a2a0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:46.688929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb50f1-41aa-4b11-8580-8324d4b1a2a0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:46.693789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8794a-5e9f-4163-b7fd-54be57f42a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:46.694655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8794a-5e9f-4163-b7fd-54be57f42a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:46.694997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8794a-5e9f-4163-b7fd-54be57f42a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:46.695341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8794a-5e9f-4163-b7fd-54be57f42a11 admin admin] PATH_INFO: `/v3/projects/6c31282b66234c97ade76d3eed02186a/users/d3cd91cc9fd64567803fdb391a3d98e0/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:46.697703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8794a-5e9f-4163-b7fd-54be57f42a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c31282b66234c97ade76d3eed02186a, user_id=d3cd91cc9fd64567803fdb391a3d98e0, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:46.700400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8794a-5e9f-4163-b7fd-54be57f42a11 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:46.712999 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4270/8572] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:24:46 2022] PUT /identity/v3/projects/6c31282b66234c97ade76d3eed02186a/users/d3cd91cc9fd64567803fdb391a3d98e0/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:24:52.303523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275427bc-08e9-48f4-86ee-29ead785f744 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:52.304137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275427bc-08e9-48f4-86ee-29ead785f744 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:52.304137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275427bc-08e9-48f4-86ee-29ead785f744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:52.370196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-275427bc-08e9-48f4-86ee-29ead785f744 None None] MFA Rules not processed for user `d3cd91cc9fd64567803fdb391a3d98e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:52.371433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-275427bc-08e9-48f4-86ee-29ead785f744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:52.596136 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4303/8573] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:24:52.783849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8794a-5e9f-4163-b7fd-54be57f42a11 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:52.785665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-58d8794a-5e9f-4163-b7fd-54be57f42a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:52.883794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8794a-5e9f-4163-b7fd-54be57f42a11 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:52.890397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcff3c-2b4d-4bcc-bf23-3fbe21823901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:52.891008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcff3c-2b4d-4bcc-bf23-3fbe21823901 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:52.891286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcff3c-2b4d-4bcc-bf23-3fbe21823901 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:52.891894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcff3c-2b4d-4bcc-bf23-3fbe21823901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:52.960287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcff3c-2b4d-4bcc-bf23-3fbe21823901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:52.962060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcff3c-2b4d-4bcc-bf23-3fbe21823901 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:52.973207 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4271/8574] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:24:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:24:53.138102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275427bc-08e9-48f4-86ee-29ead785f744 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:53.207600 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:53.247377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275427bc-08e9-48f4-86ee-29ead785f744 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:53.251863 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e508d2-2629-4ae2-b5a9-d774f0f225b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:53.252714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e508d2-2629-4ae2-b5a9-d774f0f225b3 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:53.253069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e508d2-2629-4ae2-b5a9-d774f0f225b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:53.253406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e508d2-2629-4ae2-b5a9-d774f0f225b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:53.255789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-24e508d2-2629-4ae2-b5a9-d774f0f225b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:53.274572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e508d2-2629-4ae2-b5a9-d774f0f225b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:53.277600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e508d2-2629-4ae2-b5a9-d774f0f225b3 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:53.301041 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4304/8575] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:24:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:24:53.328365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcff3c-2b4d-4bcc-bf23-3fbe21823901 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:53.331630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fcfcff3c-2b4d-4bcc-bf23-3fbe21823901 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:53.385076 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:24:53.431827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcff3c-2b4d-4bcc-bf23-3fbe21823901 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:53.438456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac65b1-78da-49a0-94b6-0e2103fac548 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:53.439096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac65b1-78da-49a0-94b6-0e2103fac548 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:53.439401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac65b1-78da-49a0-94b6-0e2103fac548 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:53.439674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac65b1-78da-49a0-94b6-0e2103fac548 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:53.443066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-77ac65b1-78da-49a0-94b6-0e2103fac548 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:53.463046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac65b1-78da-49a0-94b6-0e2103fac548 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:53.464714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac65b1-78da-49a0-94b6-0e2103fac548 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:53.491074 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4272/8576] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:24:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:24:53.724504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e508d2-2629-4ae2-b5a9-d774f0f225b3 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:53.746202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e508d2-2629-4ae2-b5a9-d774f0f225b3 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:53.751204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ad24a-bae4-4394-9bdd-db3839d153e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:53.753041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ad24a-bae4-4394-9bdd-db3839d153e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:53.753598 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ad24a-bae4-4394-9bdd-db3839d153e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:53.754497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ad24a-bae4-4394-9bdd-db3839d153e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:53.756847 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-121ad24a-bae4-4394-9bdd-db3839d153e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:53.776126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ad24a-bae4-4394-9bdd-db3839d153e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:53.777874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ad24a-bae4-4394-9bdd-db3839d153e9 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:53.793069 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4305/8577] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:24:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:24:53.895484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac65b1-78da-49a0-94b6-0e2103fac548 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:53.897628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-77ac65b1-78da-49a0-94b6-0e2103fac548 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:53.914619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac65b1-78da-49a0-94b6-0e2103fac548 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:53.928583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6d38c-8730-4f45-ace1-49656ecbbf63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:53.929018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6d38c-8730-4f45-ace1-49656ecbbf63 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:53.929283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6d38c-8730-4f45-ace1-49656ecbbf63 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:53.929799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6d38c-8730-4f45-ace1-49656ecbbf63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:53.932040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d5c6d38c-8730-4f45-ace1-49656ecbbf63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:53.948988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6d38c-8730-4f45-ace1-49656ecbbf63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:53.950754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6d38c-8730-4f45-ace1-49656ecbbf63 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:53.965461 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4273/8578] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:24:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:24:54.183965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ad24a-bae4-4394-9bdd-db3839d153e9 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:54.199322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ad24a-bae4-4394-9bdd-db3839d153e9 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:54.204386 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dca15-2635-4763-ac0b-78837a6326fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:54.205409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dca15-2635-4763-ac0b-78837a6326fc service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:54.205678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dca15-2635-4763-ac0b-78837a6326fc service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:54.206148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dca15-2635-4763-ac0b-78837a6326fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:54.208220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-810dca15-2635-4763-ac0b-78837a6326fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:54.228273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810dca15-2635-4763-ac0b-78837a6326fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:54.229818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810dca15-2635-4763-ac0b-78837a6326fc service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:54.246369 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4306/8579] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:24:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:24:54.911455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2cfff-9d32-479c-8546-91d50d7237ea None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:54.911919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2cfff-9d32-479c-8546-91d50d7237ea None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:54.912036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2cfff-9d32-479c-8546-91d50d7237ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:54.960493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2ef2cfff-9d32-479c-8546-91d50d7237ea None None] MFA Rules not processed for user `61fa09fe56b64eb69666368a5b423768`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:24:54.962736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2ef2cfff-9d32-479c-8546-91d50d7237ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:54.980899 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4274/8580] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:24:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:24:55.369318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dca15-2635-4763-ac0b-78837a6326fc service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:24:55.390915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dca15-2635-4763-ac0b-78837a6326fc service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:24:55.396272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d6dd3-b6c8-40f4-8725-f698cb3384e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:24:55.398103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d6dd3-b6c8-40f4-8725-f698cb3384e4 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:24:55.398684 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d6dd3-b6c8-40f4-8725-f698cb3384e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:24:55.399315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d6dd3-b6c8-40f4-8725-f698cb3384e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:24:55.401333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2a7d6dd3-b6c8-40f4-8725-f698cb3384e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:24:55.415541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d6dd3-b6c8-40f4-8725-f698cb3384e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:24:55.417327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d6dd3-b6c8-40f4-8725-f698cb3384e4 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:24:55.431531 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4307/8581] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:24:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:25:00.622018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6354ce0-77b3-4537-8f81-8e122d0ccc3b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:00.622543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6354ce0-77b3-4537-8f81-8e122d0ccc3b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:00.622634 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6354ce0-77b3-4537-8f81-8e122d0ccc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:00.643962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c6354ce0-77b3-4537-8f81-8e122d0ccc3b None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:25:00.645236 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c6354ce0-77b3-4537-8f81-8e122d0ccc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:00.720763 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4275/8582] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:25:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:25:00.731454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d6dd3-b6c8-40f4-8725-f698cb3384e4 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:00.733397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2a7d6dd3-b6c8-40f4-8725-f698cb3384e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:00.808500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d6dd3-b6c8-40f4-8725-f698cb3384e4 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:00.814680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c80bdb-667f-4885-b381-6477cd0b3192 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:00.815403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c80bdb-667f-4885-b381-6477cd0b3192 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:00.815724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c80bdb-667f-4885-b381-6477cd0b3192 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:00.816065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c80bdb-667f-4885-b381-6477cd0b3192 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:00.826026 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c80bdb-667f-4885-b381-6477cd0b3192 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:00.827593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c80bdb-667f-4885-b381-6477cd0b3192 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:00.845016 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4308/8583] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:25:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:25:01.183469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6354ce0-77b3-4537-8f81-8e122d0ccc3b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:01.184912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c6354ce0-77b3-4537-8f81-8e122d0ccc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:01.218868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6354ce0-77b3-4537-8f81-8e122d0ccc3b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:01.226862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298bb17-85ea-42a1-8879-7397bcea39e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:01.227850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298bb17-85ea-42a1-8879-7397bcea39e9 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:01.228762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298bb17-85ea-42a1-8879-7397bcea39e9 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:01.229619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298bb17-85ea-42a1-8879-7397bcea39e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:01.233643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d298bb17-85ea-42a1-8879-7397bcea39e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:01.256078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298bb17-85ea-42a1-8879-7397bcea39e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:01.258476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298bb17-85ea-42a1-8879-7397bcea39e9 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:01.292071 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4276/8584] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:25:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:25:09.392982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c80bdb-667f-4885-b381-6477cd0b3192 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:09.406084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c80bdb-667f-4885-b381-6477cd0b3192 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:09.411184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b0260-6a81-4ee6-ae0d-f5885d3dbf26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:09.412049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b0260-6a81-4ee6-ae0d-f5885d3dbf26 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:09.412447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b0260-6a81-4ee6-ae0d-f5885d3dbf26 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:09.412821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b0260-6a81-4ee6-ae0d-f5885d3dbf26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:09.423899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b0260-6a81-4ee6-ae0d-f5885d3dbf26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:09.425757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b0260-6a81-4ee6-ae0d-f5885d3dbf26 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:09.437026 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4309/8585] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:25:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:25:11.269837 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=57 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:25:19.432179 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=63 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:25:20.807595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33963c77-2691-4076-b227-668268d67a9f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:20.808121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33963c77-2691-4076-b227-668268d67a9f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:20.808282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33963c77-2691-4076-b227-668268d67a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:20.833762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-33963c77-2691-4076-b227-668268d67a9f None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:25:20.835054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-33963c77-2691-4076-b227-668268d67a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:20.843192 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4277/8586] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 10:25:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:25:20.857810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b0260-6a81-4ee6-ae0d-f5885d3dbf26 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:20.872457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b0260-6a81-4ee6-ae0d-f5885d3dbf26 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:20.879414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39983d-8e73-4e02-9e60-15536c040e03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:20.880019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39983d-8e73-4e02-9e60-15536c040e03 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:20.880484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39983d-8e73-4e02-9e60-15536c040e03 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:20.880837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39983d-8e73-4e02-9e60-15536c040e03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:20.890717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39983d-8e73-4e02-9e60-15536c040e03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:20.892482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39983d-8e73-4e02-9e60-15536c040e03 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:20.902180 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4310/8587] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:25:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:25:23.996001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33963c77-2691-4076-b227-668268d67a9f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:23.997553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-33963c77-2691-4076-b227-668268d67a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:24.065932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33963c77-2691-4076-b227-668268d67a9f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:24.070488 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8081f-20ce-4745-a1ac-d571ce3019a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:24.071123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8081f-20ce-4745-a1ac-d571ce3019a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:24.071399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8081f-20ce-4745-a1ac-d571ce3019a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:24.071920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8081f-20ce-4745-a1ac-d571ce3019a7 admin admin] PATH_INFO: `/v3/users/110eca3227564e579d69f1f2d9ba6116` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:24.073100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8081f-20ce-4745-a1ac-d571ce3019a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=110eca3227564e579d69f1f2d9ba6116)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:24.075003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8081f-20ce-4745-a1ac-d571ce3019a7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:24.125914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bca8081f-20ce-4745-a1ac-d571ce3019a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '110eca3227564e579d69f1f2d9ba6116'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:25:24.133427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bca8081f-20ce-4745-a1ac-d571ce3019a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '110eca3227564e579d69f1f2d9ba6116'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:25:24.134320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bca8081f-20ce-4745-a1ac-d571ce3019a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '110eca3227564e579d69f1f2d9ba6116'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:25:24.147424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bca8081f-20ce-4745-a1ac-d571ce3019a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '110eca3227564e579d69f1f2d9ba6116'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:25:24.154431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bca8081f-20ce-4745-a1ac-d571ce3019a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '110eca3227564e579d69f1f2d9ba6116'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:25:24.161920 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4278/8588] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:25:23 2022] DELETE /identity/v3/users/110eca3227564e579d69f1f2d9ba6116 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:25:24.346840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39983d-8e73-4e02-9e60-15536c040e03 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:24.357885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39983d-8e73-4e02-9e60-15536c040e03 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:24.418908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e829718-eb36-4764-ba9d-cf5af87feba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:24.419563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e829718-eb36-4764-ba9d-cf5af87feba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:24.419833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e829718-eb36-4764-ba9d-cf5af87feba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:24.420109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e829718-eb36-4764-ba9d-cf5af87feba6 admin admin] PATH_INFO: `/v3/projects/8c0359fc055d4b9dbf0d2841409a80dc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:24.421439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e829718-eb36-4764-ba9d-cf5af87feba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c0359fc055d4b9dbf0d2841409a80dc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:24.423436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e829718-eb36-4764-ba9d-cf5af87feba6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:24.485804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0e829718-eb36-4764-ba9d-cf5af87feba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c0359fc055d4b9dbf0d2841409a80dc', 'request_id': 'req-0e829718-eb36-4764-ba9d-cf5af87feba6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:25:24.493093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0e829718-eb36-4764-ba9d-cf5af87feba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c0359fc055d4b9dbf0d2841409a80dc', 'request_id': 'req-0e829718-eb36-4764-ba9d-cf5af87feba6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:25:24.498662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0e829718-eb36-4764-ba9d-cf5af87feba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c0359fc055d4b9dbf0d2841409a80dc', 'request_id': 'req-0e829718-eb36-4764-ba9d-cf5af87feba6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:25:24.510074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0e829718-eb36-4764-ba9d-cf5af87feba6 admin admin] The token cache is being invalidate because project 8c0359fc055d4b9dbf0d2841409a80dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:25:24.510356 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0e829718-eb36-4764-ba9d-cf5af87feba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:25:24.510978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0e829718-eb36-4764-ba9d-cf5af87feba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:25:24.512486 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4311/8589] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:25:24 2022] DELETE /identity/v3/projects/8c0359fc055d4b9dbf0d2841409a80dc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:25:24.517983 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e1c18-a2f1-44b7-a945-f99f991c6e69 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:24.518268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e1c18-a2f1-44b7-a945-f99f991c6e69 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:24.518537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e1c18-a2f1-44b7-a945-f99f991c6e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:24.537868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-319e1c18-a2f1-44b7-a945-f99f991c6e69 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:25:24.539077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-319e1c18-a2f1-44b7-a945-f99f991c6e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:24.597622 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4279/8590] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:25:24.605220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2d866-0034-4872-bfce-836a422062bc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:24.605504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2d866-0034-4872-bfce-836a422062bc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:24.605775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2d866-0034-4872-bfce-836a422062bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:24.625090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-24e2d866-0034-4872-bfce-836a422062bc None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:25:24.626812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-24e2d866-0034-4872-bfce-836a422062bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:24.634577 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4312/8591] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:25:24.638647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e1c18-a2f1-44b7-a945-f99f991c6e69 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:24.649105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e1c18-a2f1-44b7-a945-f99f991c6e69 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:24.653605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbcb97-01e5-483d-a1bc-85a3e067f942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:24.654198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbcb97-01e5-483d-a1bc-85a3e067f942 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:24.654471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbcb97-01e5-483d-a1bc-85a3e067f942 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:24.654739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbcb97-01e5-483d-a1bc-85a3e067f942 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:24.655373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbcb97-01e5-483d-a1bc-85a3e067f942 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:25:24.655700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbcb97-01e5-483d-a1bc-85a3e067f942 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:24.657476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbcb97-01e5-483d-a1bc-85a3e067f942 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:24.665977 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:25:24.669663 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4280/8592] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:25:24.673907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2d866-0034-4872-bfce-836a422062bc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:24.683183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2d866-0034-4872-bfce-836a422062bc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:24.687805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe716662-5e6c-4f3c-ab67-199f89697809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:24.689188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe716662-5e6c-4f3c-ab67-199f89697809 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:24.689508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe716662-5e6c-4f3c-ab67-199f89697809 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:24.689784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe716662-5e6c-4f3c-ab67-199f89697809 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:24.690418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe716662-5e6c-4f3c-ab67-199f89697809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:24.692322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe716662-5e6c-4f3c-ab67-199f89697809 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:24.719594 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4313/8593] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:25:24 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:25:24.724159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbcb97-01e5-483d-a1bc-85a3e067f942 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:24.734429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbcb97-01e5-483d-a1bc-85a3e067f942 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:24.793846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2cf5c-9a37-4c3d-9941-492fe62f92b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:24.794446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2cf5c-9a37-4c3d-9941-492fe62f92b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:24.794728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2cf5c-9a37-4c3d-9941-492fe62f92b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:24.794999 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2cf5c-9a37-4c3d-9941-492fe62f92b9 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:24.795632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2cf5c-9a37-4c3d-9941-492fe62f92b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:24.797545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2cf5c-9a37-4c3d-9941-492fe62f92b9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:24.818581 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4281/8594] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:25:24 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:25:24.822898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe716662-5e6c-4f3c-ab67-199f89697809 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:24.833803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe716662-5e6c-4f3c-ab67-199f89697809 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:24.838353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d489440-3b9a-4e1c-9779-3c6fa83403a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:24.838943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d489440-3b9a-4e1c-9779-3c6fa83403a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:24.839230 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d489440-3b9a-4e1c-9779-3c6fa83403a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:24.839568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d489440-3b9a-4e1c-9779-3c6fa83403a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:24.840215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d489440-3b9a-4e1c-9779-3c6fa83403a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:24.841841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d489440-3b9a-4e1c-9779-3c6fa83403a5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:24.851928 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4314/8595] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:25:24.855704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2cf5c-9a37-4c3d-9941-492fe62f92b9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:24.867425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2cf5c-9a37-4c3d-9941-492fe62f92b9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:24.872035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6f2e4-5924-4746-b041-ec3fa2938819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:24.872649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6f2e4-5924-4746-b041-ec3fa2938819 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:24.872932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6f2e4-5924-4746-b041-ec3fa2938819 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:24.873207 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6f2e4-5924-4746-b041-ec3fa2938819 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:24.873843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6f2e4-5924-4746-b041-ec3fa2938819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:24.875427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6f2e4-5924-4746-b041-ec3fa2938819 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:24.886931 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4282/8596] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:25:24.890906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d489440-3b9a-4e1c-9779-3c6fa83403a5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:24.901119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d489440-3b9a-4e1c-9779-3c6fa83403a5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:24.905671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d6fdc-55a6-4e55-9959-eebb643e7193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:24.906426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d6fdc-55a6-4e55-9959-eebb643e7193 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:24.906710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d6fdc-55a6-4e55-9959-eebb643e7193 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:24.906988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d6fdc-55a6-4e55-9959-eebb643e7193 admin admin] PATH_INFO: `/v3/projects/dc68cd8efc3341db98daad35ae83eb6d/users/71525b1e001e47cd9008d90f7009fc94/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:24.922126 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d6fdc-55a6-4e55-9959-eebb643e7193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc68cd8efc3341db98daad35ae83eb6d, user_id=71525b1e001e47cd9008d90f7009fc94, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:24.925370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d6fdc-55a6-4e55-9959-eebb643e7193 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:24.938376 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4315/8597] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:25:24 2022] PUT /identity/v3/projects/dc68cd8efc3341db98daad35ae83eb6d/users/71525b1e001e47cd9008d90f7009fc94/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:25:24.949607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965fa0d-5699-495e-951d-a0d9ce908e62 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:24.949897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965fa0d-5699-495e-951d-a0d9ce908e62 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:24.950176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965fa0d-5699-495e-951d-a0d9ce908e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:24.978820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e965fa0d-5699-495e-951d-a0d9ce908e62 None None] MFA Rules not processed for user `71525b1e001e47cd9008d90f7009fc94`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:25:24.980033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e965fa0d-5699-495e-951d-a0d9ce908e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:25.046210 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4283/8598] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:25:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:25:25.058148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d6fdc-55a6-4e55-9959-eebb643e7193 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:25.059866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6a2d6fdc-55a6-4e55-9959-eebb643e7193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:25.074446 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:25:25.130844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d6fdc-55a6-4e55-9959-eebb643e7193 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:25.134453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fec2f-6164-41ec-8ff0-d5d98b581bd6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:25.135055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fec2f-6164-41ec-8ff0-d5d98b581bd6 service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:25.135331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fec2f-6164-41ec-8ff0-d5d98b581bd6 service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:25.135600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fec2f-6164-41ec-8ff0-d5d98b581bd6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:25.144476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fec2f-6164-41ec-8ff0-d5d98b581bd6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:25.145952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fec2f-6164-41ec-8ff0-d5d98b581bd6 service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:25.154730 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4316/8599] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:25:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:25:35.043281 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:25:35.150815 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=24 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:25:47.073103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965fa0d-5699-495e-951d-a0d9ce908e62 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:47.074747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e965fa0d-5699-495e-951d-a0d9ce908e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:47.140313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965fa0d-5699-495e-951d-a0d9ce908e62 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:47.144563 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9c08f-6b04-4b9c-bb99-e124b8980e86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:47.145797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9c08f-6b04-4b9c-bb99-e124b8980e86 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:47.146048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9c08f-6b04-4b9c-bb99-e124b8980e86 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:47.146363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9c08f-6b04-4b9c-bb99-e124b8980e86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:47.148420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cfd9c08f-6b04-4b9c-bb99-e124b8980e86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:47.162774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9c08f-6b04-4b9c-bb99-e124b8980e86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:47.164183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9c08f-6b04-4b9c-bb99-e124b8980e86 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:47.175036 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4284/8600] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:25:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:25:55.746007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fec2f-6164-41ec-8ff0-d5d98b581bd6 service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:55.747622 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b19fec2f-6164-41ec-8ff0-d5d98b581bd6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:55.852495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9c08f-6b04-4b9c-bb99-e124b8980e86 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:55.854181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cfd9c08f-6b04-4b9c-bb99-e124b8980e86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:55.878364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fec2f-6164-41ec-8ff0-d5d98b581bd6 service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:55.885740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d72442-5d3f-486b-9e78-6672177ad38b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:55.886477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d72442-5d3f-486b-9e78-6672177ad38b service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:55.886912 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d72442-5d3f-486b-9e78-6672177ad38b service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:55.887341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d72442-5d3f-486b-9e78-6672177ad38b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:55.889489 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d2d72442-5d3f-486b-9e78-6672177ad38b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:55.892426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9c08f-6b04-4b9c-bb99-e124b8980e86 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:55.907104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d72442-5d3f-486b-9e78-6672177ad38b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:55.908972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d72442-5d3f-486b-9e78-6672177ad38b service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:55.920049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eceba8d-c17f-4812-9b54-fb67a67193be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:55.920952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eceba8d-c17f-4812-9b54-fb67a67193be service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:55.922437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eceba8d-c17f-4812-9b54-fb67a67193be service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:55.922745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eceba8d-c17f-4812-9b54-fb67a67193be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:55.933208 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4317/8601] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:25:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:25:55.947964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eceba8d-c17f-4812-9b54-fb67a67193be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:55.951243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eceba8d-c17f-4812-9b54-fb67a67193be service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:55.970264 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4285/8602] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:25:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:25:57.351598 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d72442-5d3f-486b-9e78-6672177ad38b service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:57.423477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d72442-5d3f-486b-9e78-6672177ad38b service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:57.428503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d9423-c19b-4fbc-abfe-9f78c683d257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:57.428786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d9423-c19b-4fbc-abfe-9f78c683d257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:57.429066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d9423-c19b-4fbc-abfe-9f78c683d257 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:57.429336 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d9423-c19b-4fbc-abfe-9f78c683d257 admin admin] PATH_INFO: `/v3/users/71525b1e001e47cd9008d90f7009fc94` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:57.430459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d9423-c19b-4fbc-abfe-9f78c683d257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71525b1e001e47cd9008d90f7009fc94)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:57.432397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d9423-c19b-4fbc-abfe-9f78c683d257 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:57.492378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9c7d9423-c19b-4fbc-abfe-9f78c683d257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71525b1e001e47cd9008d90f7009fc94'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:25:57.493399 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9c7d9423-c19b-4fbc-abfe-9f78c683d257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71525b1e001e47cd9008d90f7009fc94'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:25:57.501744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9c7d9423-c19b-4fbc-abfe-9f78c683d257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71525b1e001e47cd9008d90f7009fc94'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:25:57.515972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9c7d9423-c19b-4fbc-abfe-9f78c683d257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71525b1e001e47cd9008d90f7009fc94'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:25:57.524480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9c7d9423-c19b-4fbc-abfe-9f78c683d257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71525b1e001e47cd9008d90f7009fc94'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:25:57.527012 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:25:57.535069 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4318/8603] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:25:57 2022] DELETE /identity/v3/users/71525b1e001e47cd9008d90f7009fc94 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:25:57.536803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d903714-7637-4608-a314-aa4075ed3041 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:57.538331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d903714-7637-4608-a314-aa4075ed3041 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:57.538797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d903714-7637-4608-a314-aa4075ed3041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:57.559005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7d903714-7637-4608-a314-aa4075ed3041 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:25:57.560507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7d903714-7637-4608-a314-aa4075ed3041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:57.626184 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4286/8604] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:25:57.637314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d9423-c19b-4fbc-abfe-9f78c683d257 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:57.639987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9c7d9423-c19b-4fbc-abfe-9f78c683d257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:57.705393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d9423-c19b-4fbc-abfe-9f78c683d257 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:57.709659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b67d2-65e1-40ea-a509-81bd008fb55e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:57.710317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b67d2-65e1-40ea-a509-81bd008fb55e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:57.710593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b67d2-65e1-40ea-a509-81bd008fb55e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:57.710857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b67d2-65e1-40ea-a509-81bd008fb55e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:57.720685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b67d2-65e1-40ea-a509-81bd008fb55e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:57.722104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b67d2-65e1-40ea-a509-81bd008fb55e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:57.734929 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4319/8605] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:25:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:25:58.065992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d903714-7637-4608-a314-aa4075ed3041 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:58.067670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7d903714-7637-4608-a314-aa4075ed3041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:58.103213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d903714-7637-4608-a314-aa4075ed3041 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:58.109260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c56764-1cf7-4538-ace3-e9ed85fdf262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:58.110691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c56764-1cf7-4538-ace3-e9ed85fdf262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:58.111152 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c56764-1cf7-4538-ace3-e9ed85fdf262 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:58.111550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c56764-1cf7-4538-ace3-e9ed85fdf262 admin admin] PATH_INFO: `/v3/projects/dc68cd8efc3341db98daad35ae83eb6d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:58.113038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c56764-1cf7-4538-ace3-e9ed85fdf262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc68cd8efc3341db98daad35ae83eb6d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:58.118341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c56764-1cf7-4538-ace3-e9ed85fdf262 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:58.192364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65c56764-1cf7-4538-ace3-e9ed85fdf262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc68cd8efc3341db98daad35ae83eb6d', 'request_id': 'req-65c56764-1cf7-4538-ace3-e9ed85fdf262'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:25:58.205814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65c56764-1cf7-4538-ace3-e9ed85fdf262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc68cd8efc3341db98daad35ae83eb6d', 'request_id': 'req-65c56764-1cf7-4538-ace3-e9ed85fdf262'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:25:58.213613 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65c56764-1cf7-4538-ace3-e9ed85fdf262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc68cd8efc3341db98daad35ae83eb6d', 'request_id': 'req-65c56764-1cf7-4538-ace3-e9ed85fdf262'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:25:58.227031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65c56764-1cf7-4538-ace3-e9ed85fdf262 admin admin] The token cache is being invalidate because project dc68cd8efc3341db98daad35ae83eb6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:25:58.227317 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65c56764-1cf7-4538-ace3-e9ed85fdf262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:25:58.227978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65c56764-1cf7-4538-ace3-e9ed85fdf262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:25:58.229847 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4287/8606] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:25:58 2022] DELETE /identity/v3/projects/dc68cd8efc3341db98daad35ae83eb6d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:25:58.234564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2030ccc-6620-403e-8752-5ef7fcb5dd3a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:58.234854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2030ccc-6620-403e-8752-5ef7fcb5dd3a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:58.235127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2030ccc-6620-403e-8752-5ef7fcb5dd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:58.257732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a2030ccc-6620-403e-8752-5ef7fcb5dd3a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:25:58.259059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a2030ccc-6620-403e-8752-5ef7fcb5dd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:58.338064 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4320/8607] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:25:58.346032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf08bc7-fe5c-42c2-90ae-1ebff0c9639d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:58.346581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf08bc7-fe5c-42c2-90ae-1ebff0c9639d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:58.346845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf08bc7-fe5c-42c2-90ae-1ebff0c9639d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:58.368191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-adf08bc7-fe5c-42c2-90ae-1ebff0c9639d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:25:58.369448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-adf08bc7-fe5c-42c2-90ae-1ebff0c9639d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:58.378282 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4288/8608] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:25:58.383025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2030ccc-6620-403e-8752-5ef7fcb5dd3a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:58.399822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2030ccc-6620-403e-8752-5ef7fcb5dd3a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:58.408761 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a357674-64f9-4a45-9635-3e085bc8a6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:58.410249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a357674-64f9-4a45-9635-3e085bc8a6bd admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:58.410627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a357674-64f9-4a45-9635-3e085bc8a6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:58.410910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a357674-64f9-4a45-9635-3e085bc8a6bd admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:58.411589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a357674-64f9-4a45-9635-3e085bc8a6bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:25:58.411893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a357674-64f9-4a45-9635-3e085bc8a6bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:58.414541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a357674-64f9-4a45-9635-3e085bc8a6bd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:58.440700 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4321/8609] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:25:58.445352 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf08bc7-fe5c-42c2-90ae-1ebff0c9639d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:58.456853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf08bc7-fe5c-42c2-90ae-1ebff0c9639d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:58.465405 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24b88c-4a57-4d7c-9f30-9320c2b44ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:58.466387 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24b88c-4a57-4d7c-9f30-9320c2b44ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:58.466901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24b88c-4a57-4d7c-9f30-9320c2b44ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:58.467402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24b88c-4a57-4d7c-9f30-9320c2b44ea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:58.469355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24b88c-4a57-4d7c-9f30-9320c2b44ea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:58.472056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24b88c-4a57-4d7c-9f30-9320c2b44ea1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:58.489002 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:25:58.526619 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4289/8610] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:25:58 2022] POST /identity/v3/projects => generated 399 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:25:58.530833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a357674-64f9-4a45-9635-3e085bc8a6bd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:58.544109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a357674-64f9-4a45-9635-3e085bc8a6bd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:58.617074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9196d-f18f-4829-bf8e-e2ffb0c26f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:58.617864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9196d-f18f-4829-bf8e-e2ffb0c26f07 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:58.618235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9196d-f18f-4829-bf8e-e2ffb0c26f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:58.618606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9196d-f18f-4829-bf8e-e2ffb0c26f07 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:58.619367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9196d-f18f-4829-bf8e-e2ffb0c26f07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:58.621519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9196d-f18f-4829-bf8e-e2ffb0c26f07 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:58.649269 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4322/8611] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:25:58 2022] POST /identity/v3/users => generated 300 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:25:58.653150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24b88c-4a57-4d7c-9f30-9320c2b44ea1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:58.669833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24b88c-4a57-4d7c-9f30-9320c2b44ea1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:58.675206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d0f8d-4ea1-474f-804c-b53bcf70ac8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:58.676035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d0f8d-4ea1-474f-804c-b53bcf70ac8f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:58.676440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d0f8d-4ea1-474f-804c-b53bcf70ac8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:58.676928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d0f8d-4ea1-474f-804c-b53bcf70ac8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:58.677786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d0f8d-4ea1-474f-804c-b53bcf70ac8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:58.679745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d0f8d-4ea1-474f-804c-b53bcf70ac8f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:58.694379 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4290/8612] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:25:58.698162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9196d-f18f-4829-bf8e-e2ffb0c26f07 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:58.712377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9196d-f18f-4829-bf8e-e2ffb0c26f07 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:58.719850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf572f-6eb9-43f2-9e8a-46ad0992f167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:58.720811 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf572f-6eb9-43f2-9e8a-46ad0992f167 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:58.721107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf572f-6eb9-43f2-9e8a-46ad0992f167 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:58.721513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf572f-6eb9-43f2-9e8a-46ad0992f167 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:58.722490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf572f-6eb9-43f2-9e8a-46ad0992f167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:58.724284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf572f-6eb9-43f2-9e8a-46ad0992f167 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:58.737056 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4323/8613] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:25:58.741763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d0f8d-4ea1-474f-804c-b53bcf70ac8f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:58.752736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d0f8d-4ea1-474f-804c-b53bcf70ac8f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:58.759091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97aae35-1f06-496f-975f-7de9f58c4689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:58.760084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97aae35-1f06-496f-975f-7de9f58c4689 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:58.760587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97aae35-1f06-496f-975f-7de9f58c4689 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:58.760955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97aae35-1f06-496f-975f-7de9f58c4689 admin admin] PATH_INFO: `/v3/projects/526c99dc80684f0a864f01e66bbaaf58/users/5493784916e84f13b631f0c8fa90a71d/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:58.781061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97aae35-1f06-496f-975f-7de9f58c4689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=526c99dc80684f0a864f01e66bbaaf58, user_id=5493784916e84f13b631f0c8fa90a71d, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:58.784015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97aae35-1f06-496f-975f-7de9f58c4689 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:58.803561 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4291/8614] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:25:58 2022] PUT /identity/v3/projects/526c99dc80684f0a864f01e66bbaaf58/users/5493784916e84f13b631f0c8fa90a71d/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:25:58.814000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22722b2a-cde7-4e9d-b2ce-ce74a323aa9b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:58.814569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22722b2a-cde7-4e9d-b2ce-ce74a323aa9b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:58.814934 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22722b2a-cde7-4e9d-b2ce-ce74a323aa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:58.836941 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:25:58.857728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-22722b2a-cde7-4e9d-b2ce-ce74a323aa9b None None] MFA Rules not processed for user `5493784916e84f13b631f0c8fa90a71d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:25:58.858941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-22722b2a-cde7-4e9d-b2ce-ce74a323aa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:58.942855 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4324/8615] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:25:58 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:25:58.955661 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97aae35-1f06-496f-975f-7de9f58c4689 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:25:58.957548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d97aae35-1f06-496f-975f-7de9f58c4689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:25:59.066157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97aae35-1f06-496f-975f-7de9f58c4689 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:25:59.070619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095c707-b019-4383-84d2-b02434c03882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:25:59.071234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095c707-b019-4383-84d2-b02434c03882 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:25:59.072129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095c707-b019-4383-84d2-b02434c03882 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:25:59.072408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095c707-b019-4383-84d2-b02434c03882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:25:59.083975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095c707-b019-4383-84d2-b02434c03882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:25:59.086369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095c707-b019-4383-84d2-b02434c03882 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:25:59.097335 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4292/8616] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:25:58 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:26:02.227523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22722b2a-cde7-4e9d-b2ce-ce74a323aa9b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:02.229650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-22722b2a-cde7-4e9d-b2ce-ce74a323aa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:02.339241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22722b2a-cde7-4e9d-b2ce-ce74a323aa9b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:02.345052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28ab8c-2045-4e95-9de3-aae4b9625a68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:02.345789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28ab8c-2045-4e95-9de3-aae4b9625a68 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:02.346146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28ab8c-2045-4e95-9de3-aae4b9625a68 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:02.346494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28ab8c-2045-4e95-9de3-aae4b9625a68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:02.348432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5f28ab8c-2045-4e95-9de3-aae4b9625a68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:02.366300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28ab8c-2045-4e95-9de3-aae4b9625a68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:02.367906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28ab8c-2045-4e95-9de3-aae4b9625a68 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:02.382312 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4325/8617] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:26:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:26:07.463802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095c707-b019-4383-84d2-b02434c03882 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:07.594901 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095c707-b019-4383-84d2-b02434c03882 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:07.601600 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b1663-c9e1-4974-a262-798c15c805fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:07.602254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b1663-c9e1-4974-a262-798c15c805fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:07.602540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b1663-c9e1-4974-a262-798c15c805fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:07.602816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b1663-c9e1-4974-a262-798c15c805fe admin admin] PATH_INFO: `/v3/users/5493784916e84f13b631f0c8fa90a71d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:07.604237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b1663-c9e1-4974-a262-798c15c805fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=5493784916e84f13b631f0c8fa90a71d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:07.606965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b1663-c9e1-4974-a262-798c15c805fe admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:07.701108 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:26:07.703391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-906b1663-c9e1-4974-a262-798c15c805fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5493784916e84f13b631f0c8fa90a71d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:07.726877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-906b1663-c9e1-4974-a262-798c15c805fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5493784916e84f13b631f0c8fa90a71d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:07.727856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-906b1663-c9e1-4974-a262-798c15c805fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5493784916e84f13b631f0c8fa90a71d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:07.746305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-906b1663-c9e1-4974-a262-798c15c805fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5493784916e84f13b631f0c8fa90a71d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:07.765802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-906b1663-c9e1-4974-a262-798c15c805fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5493784916e84f13b631f0c8fa90a71d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:07.776233 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4293/8618] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:26:07 2022] DELETE /identity/v3/users/5493784916e84f13b631f0c8fa90a71d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:26:07.780690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae277b-b0dc-41e7-ba8f-64d3d321308e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:07.781248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae277b-b0dc-41e7-ba8f-64d3d321308e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:07.781248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae277b-b0dc-41e7-ba8f-64d3d321308e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:07.813828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5dae277b-b0dc-41e7-ba8f-64d3d321308e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:26:07.815046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5dae277b-b0dc-41e7-ba8f-64d3d321308e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:07.891776 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4326/8619] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:26:07.901653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b1663-c9e1-4974-a262-798c15c805fe admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:07.904045 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-906b1663-c9e1-4974-a262-798c15c805fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:07.995168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b1663-c9e1-4974-a262-798c15c805fe admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:08.000789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7e3bb-fb15-46dd-b19a-4e6d0a677b86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:08.002011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7e3bb-fb15-46dd-b19a-4e6d0a677b86 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:08.002292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7e3bb-fb15-46dd-b19a-4e6d0a677b86 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:08.002562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7e3bb-fb15-46dd-b19a-4e6d0a677b86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:08.017424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7e3bb-fb15-46dd-b19a-4e6d0a677b86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:08.018860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7e3bb-fb15-46dd-b19a-4e6d0a677b86 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:08.033987 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4294/8620] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:26:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:26:08.086278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b394c2-dcbc-42a3-b2f7-1d51cd081c26 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:08.086564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b394c2-dcbc-42a3-b2f7-1d51cd081c26 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:08.086839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b394c2-dcbc-42a3-b2f7-1d51cd081c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:08.111095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b3b394c2-dcbc-42a3-b2f7-1d51cd081c26 None None] MFA Rules not processed for user `b50b27cd8feb4fbabc4a562103fa3d65`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:26:08.112337 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b3b394c2-dcbc-42a3-b2f7-1d51cd081c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:08.141123 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:26:08.206732 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4327/8621] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:26:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:26:08.477127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7e3bb-fb15-46dd-b19a-4e6d0a677b86 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:08.482147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-26e7e3bb-fb15-46dd-b19a-4e6d0a677b86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:08.507442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7e3bb-fb15-46dd-b19a-4e6d0a677b86 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:08.519514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1ff17-415a-4230-ae78-a4d9d23fae84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:08.520552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1ff17-415a-4230-ae78-a4d9d23fae84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:08.521111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1ff17-415a-4230-ae78-a4d9d23fae84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:08.521607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1ff17-415a-4230-ae78-a4d9d23fae84 admin admin] PATH_INFO: `/v3/projects/526c99dc80684f0a864f01e66bbaaf58` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:08.538527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1ff17-415a-4230-ae78-a4d9d23fae84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=526c99dc80684f0a864f01e66bbaaf58)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:08.540965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1ff17-415a-4230-ae78-a4d9d23fae84 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:08.653980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2aa1ff17-415a-4230-ae78-a4d9d23fae84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '526c99dc80684f0a864f01e66bbaaf58', 'request_id': 'req-2aa1ff17-415a-4230-ae78-a4d9d23fae84'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:08.669436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2aa1ff17-415a-4230-ae78-a4d9d23fae84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '526c99dc80684f0a864f01e66bbaaf58', 'request_id': 'req-2aa1ff17-415a-4230-ae78-a4d9d23fae84'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:08.679534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2aa1ff17-415a-4230-ae78-a4d9d23fae84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '526c99dc80684f0a864f01e66bbaaf58', 'request_id': 'req-2aa1ff17-415a-4230-ae78-a4d9d23fae84'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:08.704010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2aa1ff17-415a-4230-ae78-a4d9d23fae84 admin admin] The token cache is being invalidate because project 526c99dc80684f0a864f01e66bbaaf58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:26:08.704537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2aa1ff17-415a-4230-ae78-a4d9d23fae84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:08.705536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2aa1ff17-415a-4230-ae78-a4d9d23fae84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:08.707576 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4295/8622] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:26:08 2022] DELETE /identity/v3/projects/526c99dc80684f0a864f01e66bbaaf58 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:26:08.713577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf4ea1-df7b-477c-a94c-b922593abf06 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:08.713987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf4ea1-df7b-477c-a94c-b922593abf06 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:08.714122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf4ea1-df7b-477c-a94c-b922593abf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:08.742637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b8bf4ea1-df7b-477c-a94c-b922593abf06 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:26:08.744475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b8bf4ea1-df7b-477c-a94c-b922593abf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:08.905334 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4328/8623] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:26:08.914588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1f3b4-a133-499f-883d-b8220c0e9c78 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:08.914786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1f3b4-a133-499f-883d-b8220c0e9c78 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:08.915059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1f3b4-a133-499f-883d-b8220c0e9c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:08.947652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b5b1f3b4-a133-499f-883d-b8220c0e9c78 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:26:08.948917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b5b1f3b4-a133-499f-883d-b8220c0e9c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:08.966255 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4296/8624] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:26:08.970721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf4ea1-df7b-477c-a94c-b922593abf06 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:08.983177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf4ea1-df7b-477c-a94c-b922593abf06 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:08.995703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37465b1-f4cb-4a11-ae8f-731ffe20ecee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:08.996345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37465b1-f4cb-4a11-ae8f-731ffe20ecee admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:08.996646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37465b1-f4cb-4a11-ae8f-731ffe20ecee admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:08.996924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37465b1-f4cb-4a11-ae8f-731ffe20ecee admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:08.997594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37465b1-f4cb-4a11-ae8f-731ffe20ecee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:26:08.997895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37465b1-f4cb-4a11-ae8f-731ffe20ecee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:08.999886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37465b1-f4cb-4a11-ae8f-731ffe20ecee admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:09.019813 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4329/8625] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:26:09.020977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1f3b4-a133-499f-883d-b8220c0e9c78 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:09.032376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1f3b4-a133-499f-883d-b8220c0e9c78 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:09.051204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0564820-47c9-4861-9a67-04eb085aa028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:09.052411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0564820-47c9-4861-9a67-04eb085aa028 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:09.052908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0564820-47c9-4861-9a67-04eb085aa028 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:09.053953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0564820-47c9-4861-9a67-04eb085aa028 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:09.054844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0564820-47c9-4861-9a67-04eb085aa028 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:09.058678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0564820-47c9-4861-9a67-04eb085aa028 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:09.099554 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4297/8626] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:26:09 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:26:09.105305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37465b1-f4cb-4a11-ae8f-731ffe20ecee admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:09.120776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37465b1-f4cb-4a11-ae8f-731ffe20ecee admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:09.253737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c49472-a09c-43a8-ad2d-7629e5578fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:09.254508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c49472-a09c-43a8-ad2d-7629e5578fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:09.254853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c49472-a09c-43a8-ad2d-7629e5578fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:09.255191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c49472-a09c-43a8-ad2d-7629e5578fc3 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:09.255935 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c49472-a09c-43a8-ad2d-7629e5578fc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:09.258803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c49472-a09c-43a8-ad2d-7629e5578fc3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:09.302398 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4330/8627] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:26:09 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:26:09.307419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0564820-47c9-4861-9a67-04eb085aa028 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:09.322102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0564820-47c9-4861-9a67-04eb085aa028 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:09.334821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a574d-23dd-4b33-a394-5bf166ef5679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:09.335478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a574d-23dd-4b33-a394-5bf166ef5679 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:09.336349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a574d-23dd-4b33-a394-5bf166ef5679 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:09.336349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a574d-23dd-4b33-a394-5bf166ef5679 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:09.336697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a574d-23dd-4b33-a394-5bf166ef5679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:09.338648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a574d-23dd-4b33-a394-5bf166ef5679 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:09.357943 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4298/8628] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:26:09.362300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c49472-a09c-43a8-ad2d-7629e5578fc3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:09.374137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c49472-a09c-43a8-ad2d-7629e5578fc3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:09.379814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae2f53-4e3b-42d9-ad29-9817b041c62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:09.380574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae2f53-4e3b-42d9-ad29-9817b041c62c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:09.380970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae2f53-4e3b-42d9-ad29-9817b041c62c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:09.382056 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae2f53-4e3b-42d9-ad29-9817b041c62c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:09.383096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae2f53-4e3b-42d9-ad29-9817b041c62c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:09.385303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae2f53-4e3b-42d9-ad29-9817b041c62c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:09.401640 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4331/8629] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:26:09.405933 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a574d-23dd-4b33-a394-5bf166ef5679 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:09.418978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a574d-23dd-4b33-a394-5bf166ef5679 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:09.424984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839afb9-4a19-4fea-a7f6-24f90c169577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:09.425660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839afb9-4a19-4fea-a7f6-24f90c169577 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:09.425932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839afb9-4a19-4fea-a7f6-24f90c169577 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:09.426592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839afb9-4a19-4fea-a7f6-24f90c169577 admin admin] PATH_INFO: `/v3/projects/d84c098b7cc440d7a1f8513a9fa0d363/users/86d87e534d2546bea4a451c65bcd2c61/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:09.430527 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:26:09.461051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839afb9-4a19-4fea-a7f6-24f90c169577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84c098b7cc440d7a1f8513a9fa0d363, user_id=86d87e534d2546bea4a451c65bcd2c61, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:09.471006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae2f53-4e3b-42d9-ad29-9817b041c62c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:09.472594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839afb9-4a19-4fea-a7f6-24f90c169577 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:09.478061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f9ae2f53-4e3b-42d9-ad29-9817b041c62c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:09.504580 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4299/8630] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:26:09 2022] PUT /identity/v3/projects/d84c098b7cc440d7a1f8513a9fa0d363/users/86d87e534d2546bea4a451c65bcd2c61/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:26:09.511701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcf271-3c67-4616-a7c5-db810b82b5db None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:09.512087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcf271-3c67-4616-a7c5-db810b82b5db None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:09.513176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcf271-3c67-4616-a7c5-db810b82b5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:09.557189 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-21fcf271-3c67-4616-a7c5-db810b82b5db None None] MFA Rules not processed for user `86d87e534d2546bea4a451c65bcd2c61`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:26:09.558997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-21fcf271-3c67-4616-a7c5-db810b82b5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:09.561625 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:26:09.598997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae2f53-4e3b-42d9-ad29-9817b041c62c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:09.635954 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4300/8631] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:26:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:26:09.640708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcf271-3c67-4616-a7c5-db810b82b5db None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:09.670846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603a2be-d659-42d4-a2bb-0f3485744c6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:09.671559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603a2be-d659-42d4-a2bb-0f3485744c6f service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:09.671907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603a2be-d659-42d4-a2bb-0f3485744c6f service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:09.672305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603a2be-d659-42d4-a2bb-0f3485744c6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:09.674875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f603a2be-d659-42d4-a2bb-0f3485744c6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:09.691014 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603a2be-d659-42d4-a2bb-0f3485744c6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:09.692477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603a2be-d659-42d4-a2bb-0f3485744c6f service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:09.707217 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4332/8632] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:26:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:26:09.718031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcf271-3c67-4616-a7c5-db810b82b5db None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:09.723089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325046f-2347-4948-9469-b66d3dd3f552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:09.723824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325046f-2347-4948-9469-b66d3dd3f552 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:09.724112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325046f-2347-4948-9469-b66d3dd3f552 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:09.724384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325046f-2347-4948-9469-b66d3dd3f552 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:09.725426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325046f-2347-4948-9469-b66d3dd3f552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:09.727365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325046f-2347-4948-9469-b66d3dd3f552 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:09.760641 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4301/8633] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:26:09 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:26:09.762996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603a2be-d659-42d4-a2bb-0f3485744c6f service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:09.774380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603a2be-d659-42d4-a2bb-0f3485744c6f service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:09.843157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1594d-1b0b-4100-8a1f-5defda00f50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:09.843790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1594d-1b0b-4100-8a1f-5defda00f50a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:09.844034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1594d-1b0b-4100-8a1f-5defda00f50a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:09.844392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1594d-1b0b-4100-8a1f-5defda00f50a admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:09.845042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1594d-1b0b-4100-8a1f-5defda00f50a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:09.847096 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1594d-1b0b-4100-8a1f-5defda00f50a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:09.883884 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4333/8634] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:26:09 2022] POST /identity/v3/users => generated 301 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:26:09.888357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325046f-2347-4948-9469-b66d3dd3f552 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:09.900770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325046f-2347-4948-9469-b66d3dd3f552 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:09.905580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb264750-d1bc-47ab-9270-662614ae47be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:09.906225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb264750-d1bc-47ab-9270-662614ae47be admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:09.906506 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb264750-d1bc-47ab-9270-662614ae47be admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:09.906780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb264750-d1bc-47ab-9270-662614ae47be admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:09.907427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb264750-d1bc-47ab-9270-662614ae47be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:09.909225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb264750-d1bc-47ab-9270-662614ae47be admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:09.922915 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4302/8635] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:26:09.927534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1594d-1b0b-4100-8a1f-5defda00f50a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:09.941681 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1594d-1b0b-4100-8a1f-5defda00f50a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:09.947157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befa2fd-1f69-4b44-be0f-3d7cefa450e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:09.948293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befa2fd-1f69-4b44-be0f-3d7cefa450e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:09.948293 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befa2fd-1f69-4b44-be0f-3d7cefa450e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:09.948519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befa2fd-1f69-4b44-be0f-3d7cefa450e8 admin admin] PATH_INFO: `/v3/projects/0b280a1a8f7649ebb9a353b1dfe69523/users/0ccedcb8c21a47378cdea59e5b27b072/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:09.967968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befa2fd-1f69-4b44-be0f-3d7cefa450e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b280a1a8f7649ebb9a353b1dfe69523, user_id=0ccedcb8c21a47378cdea59e5b27b072, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:09.970985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befa2fd-1f69-4b44-be0f-3d7cefa450e8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:09.988341 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4334/8636] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:26:09 2022] PUT /identity/v3/projects/0b280a1a8f7649ebb9a353b1dfe69523/users/0ccedcb8c21a47378cdea59e5b27b072/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:26:09.999773 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954c03b-02ff-4c4d-a16a-b6a8be2e1bc1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:10.000065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954c03b-02ff-4c4d-a16a-b6a8be2e1bc1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:10.000353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954c03b-02ff-4c4d-a16a-b6a8be2e1bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:10.032343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0954c03b-02ff-4c4d-a16a-b6a8be2e1bc1 None None] MFA Rules not processed for user `0ccedcb8c21a47378cdea59e5b27b072`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:26:10.033679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0954c03b-02ff-4c4d-a16a-b6a8be2e1bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:10.078866 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:26:10.124190 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4303/8637] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:26:09 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:26:10.158207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befa2fd-1f69-4b44-be0f-3d7cefa450e8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:10.160121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8befa2fd-1f69-4b44-be0f-3d7cefa450e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:10.233096 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:26:10.308173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befa2fd-1f69-4b44-be0f-3d7cefa450e8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:10.315638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd28e3-2843-4cb0-9b4e-7a03bfdd8334 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:10.316365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd28e3-2843-4cb0-9b4e-7a03bfdd8334 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:10.316593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd28e3-2843-4cb0-9b4e-7a03bfdd8334 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:10.316894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd28e3-2843-4cb0-9b4e-7a03bfdd8334 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:10.334009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd28e3-2843-4cb0-9b4e-7a03bfdd8334 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:10.335855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd28e3-2843-4cb0-9b4e-7a03bfdd8334 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:10.345869 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4335/8638] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:26:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:26:11.345372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954c03b-02ff-4c4d-a16a-b6a8be2e1bc1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:11.440190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954c03b-02ff-4c4d-a16a-b6a8be2e1bc1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:11.446356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f42e9-ba10-4b48-a1c2-c9841e4fbaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:11.447301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f42e9-ba10-4b48-a1c2-c9841e4fbaa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:11.447786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f42e9-ba10-4b48-a1c2-c9841e4fbaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:11.448226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f42e9-ba10-4b48-a1c2-c9841e4fbaa1 admin admin] PATH_INFO: `/v3/users/86d87e534d2546bea4a451c65bcd2c61` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:11.450203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f42e9-ba10-4b48-a1c2-c9841e4fbaa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86d87e534d2546bea4a451c65bcd2c61)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:11.453240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f42e9-ba10-4b48-a1c2-c9841e4fbaa1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:11.518531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c8f42e9-ba10-4b48-a1c2-c9841e4fbaa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86d87e534d2546bea4a451c65bcd2c61'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:11.530383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c8f42e9-ba10-4b48-a1c2-c9841e4fbaa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86d87e534d2546bea4a451c65bcd2c61'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:11.531681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c8f42e9-ba10-4b48-a1c2-c9841e4fbaa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86d87e534d2546bea4a451c65bcd2c61'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:11.549215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c8f42e9-ba10-4b48-a1c2-c9841e4fbaa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86d87e534d2546bea4a451c65bcd2c61'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:11.559608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c8f42e9-ba10-4b48-a1c2-c9841e4fbaa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86d87e534d2546bea4a451c65bcd2c61'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:11.566957 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4304/8639] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:26:11 2022] DELETE /identity/v3/users/86d87e534d2546bea4a451c65bcd2c61 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:26:11.572082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb448bb-f245-4cd5-bec8-c055bbe81af3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:11.572675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb448bb-f245-4cd5-bec8-c055bbe81af3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:11.572675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb448bb-f245-4cd5-bec8-c055bbe81af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:11.597808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1cb448bb-f245-4cd5-bec8-c055bbe81af3 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:26:11.599045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1cb448bb-f245-4cd5-bec8-c055bbe81af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:11.670881 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4336/8640] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:26:11.681102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f42e9-ba10-4b48-a1c2-c9841e4fbaa1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:11.682929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6c8f42e9-ba10-4b48-a1c2-c9841e4fbaa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:11.762227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f42e9-ba10-4b48-a1c2-c9841e4fbaa1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:11.766131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68a8e9-913f-4444-a0e1-28664e83bce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:11.766749 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68a8e9-913f-4444-a0e1-28664e83bce8 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:11.767027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68a8e9-913f-4444-a0e1-28664e83bce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:11.767322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68a8e9-913f-4444-a0e1-28664e83bce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:11.777840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68a8e9-913f-4444-a0e1-28664e83bce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:11.778978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68a8e9-913f-4444-a0e1-28664e83bce8 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:11.785845 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:26:11.793017 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4305/8641] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:26:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:26:12.252342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb448bb-f245-4cd5-bec8-c055bbe81af3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:12.254341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1cb448bb-f245-4cd5-bec8-c055bbe81af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:12.283743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb448bb-f245-4cd5-bec8-c055bbe81af3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:12.298568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70e888-df77-44cb-ba28-a319f8ec069f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:12.302752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70e888-df77-44cb-ba28-a319f8ec069f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:12.302952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70e888-df77-44cb-ba28-a319f8ec069f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:12.303405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70e888-df77-44cb-ba28-a319f8ec069f admin admin] PATH_INFO: `/v3/projects/d84c098b7cc440d7a1f8513a9fa0d363` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:12.306333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70e888-df77-44cb-ba28-a319f8ec069f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84c098b7cc440d7a1f8513a9fa0d363)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:12.309092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70e888-df77-44cb-ba28-a319f8ec069f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:12.373001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cc70e888-df77-44cb-ba28-a319f8ec069f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84c098b7cc440d7a1f8513a9fa0d363', 'request_id': 'req-cc70e888-df77-44cb-ba28-a319f8ec069f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:12.383913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cc70e888-df77-44cb-ba28-a319f8ec069f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84c098b7cc440d7a1f8513a9fa0d363', 'request_id': 'req-cc70e888-df77-44cb-ba28-a319f8ec069f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:12.404807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cc70e888-df77-44cb-ba28-a319f8ec069f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84c098b7cc440d7a1f8513a9fa0d363', 'request_id': 'req-cc70e888-df77-44cb-ba28-a319f8ec069f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:12.427377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cc70e888-df77-44cb-ba28-a319f8ec069f admin admin] The token cache is being invalidate because project d84c098b7cc440d7a1f8513a9fa0d363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:26:12.427682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cc70e888-df77-44cb-ba28-a319f8ec069f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:12.428992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cc70e888-df77-44cb-ba28-a319f8ec069f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:12.431257 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4337/8642] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:26:12 2022] DELETE /identity/v3/projects/d84c098b7cc440d7a1f8513a9fa0d363 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:26:12.438005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68a8e9-913f-4444-a0e1-28664e83bce8 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:12.451069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68a8e9-913f-4444-a0e1-28664e83bce8 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:12.560986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a2f05-a3b1-4058-a929-402d96ea601f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:12.561635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a2f05-a3b1-4058-a929-402d96ea601f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:12.561946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a2f05-a3b1-4058-a929-402d96ea601f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:12.562162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a2f05-a3b1-4058-a929-402d96ea601f admin admin] PATH_INFO: `/v3/users/0ccedcb8c21a47378cdea59e5b27b072` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:12.563797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a2f05-a3b1-4058-a929-402d96ea601f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ccedcb8c21a47378cdea59e5b27b072)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:12.566397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a2f05-a3b1-4058-a929-402d96ea601f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:12.627117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-560a2f05-a3b1-4058-a929-402d96ea601f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ccedcb8c21a47378cdea59e5b27b072'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:12.638583 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-560a2f05-a3b1-4058-a929-402d96ea601f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ccedcb8c21a47378cdea59e5b27b072'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:12.639509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-560a2f05-a3b1-4058-a929-402d96ea601f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ccedcb8c21a47378cdea59e5b27b072'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:12.654054 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-560a2f05-a3b1-4058-a929-402d96ea601f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ccedcb8c21a47378cdea59e5b27b072'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:12.662263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-560a2f05-a3b1-4058-a929-402d96ea601f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ccedcb8c21a47378cdea59e5b27b072'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:12.670529 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4306/8643] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:26:12 2022] DELETE /identity/v3/users/0ccedcb8c21a47378cdea59e5b27b072 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:26:12.998898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70e888-df77-44cb-ba28-a319f8ec069f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:13.004511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cc70e888-df77-44cb-ba28-a319f8ec069f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:13.024022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70e888-df77-44cb-ba28-a319f8ec069f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:13.076628 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:26:13.099020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de782b-e5d6-4fbe-aa4d-496d195b290c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:13.099779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de782b-e5d6-4fbe-aa4d-496d195b290c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:13.100166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de782b-e5d6-4fbe-aa4d-496d195b290c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:13.100994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de782b-e5d6-4fbe-aa4d-496d195b290c admin admin] PATH_INFO: `/v3/projects/0b280a1a8f7649ebb9a353b1dfe69523` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:13.102243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de782b-e5d6-4fbe-aa4d-496d195b290c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b280a1a8f7649ebb9a353b1dfe69523)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:13.104248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de782b-e5d6-4fbe-aa4d-496d195b290c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:13.157779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d8de782b-e5d6-4fbe-aa4d-496d195b290c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b280a1a8f7649ebb9a353b1dfe69523', 'request_id': 'req-d8de782b-e5d6-4fbe-aa4d-496d195b290c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:13.167223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d8de782b-e5d6-4fbe-aa4d-496d195b290c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b280a1a8f7649ebb9a353b1dfe69523', 'request_id': 'req-d8de782b-e5d6-4fbe-aa4d-496d195b290c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:13.187058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d8de782b-e5d6-4fbe-aa4d-496d195b290c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b280a1a8f7649ebb9a353b1dfe69523', 'request_id': 'req-d8de782b-e5d6-4fbe-aa4d-496d195b290c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:13.200143 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d8de782b-e5d6-4fbe-aa4d-496d195b290c admin admin] The token cache is being invalidate because project 0b280a1a8f7649ebb9a353b1dfe69523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:26:13.200515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d8de782b-e5d6-4fbe-aa4d-496d195b290c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:13.201329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d8de782b-e5d6-4fbe-aa4d-496d195b290c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:26:13.202820 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4338/8644] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:26:12 2022] DELETE /identity/v3/projects/0b280a1a8f7649ebb9a353b1dfe69523 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:26:13.208016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f32c3-d37a-40f6-b791-365067094647 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:13.208257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f32c3-d37a-40f6-b791-365067094647 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:13.208441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f32c3-d37a-40f6-b791-365067094647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:13.229425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9d5f32c3-d37a-40f6-b791-365067094647 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:26:13.230772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9d5f32c3-d37a-40f6-b791-365067094647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:13.294738 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4307/8645] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:26:13.302218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5a9a9-2b26-4ae6-bff1-b0a63ec0030b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:13.302525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5a9a9-2b26-4ae6-bff1-b0a63ec0030b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:13.302796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5a9a9-2b26-4ae6-bff1-b0a63ec0030b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:13.323804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-31f5a9a9-2b26-4ae6-bff1-b0a63ec0030b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:26:13.325318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-31f5a9a9-2b26-4ae6-bff1-b0a63ec0030b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:13.333495 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4339/8646] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:26:13.338295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f32c3-d37a-40f6-b791-365067094647 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:13.348802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f32c3-d37a-40f6-b791-365067094647 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:13.354199 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a5715-5e64-432a-b0a7-a4b3438b14ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:13.354813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a5715-5e64-432a-b0a7-a4b3438b14ef admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:13.355094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a5715-5e64-432a-b0a7-a4b3438b14ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:13.355373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a5715-5e64-432a-b0a7-a4b3438b14ef admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:13.356022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a5715-5e64-432a-b0a7-a4b3438b14ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:26:13.356326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a5715-5e64-432a-b0a7-a4b3438b14ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:13.357975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a5715-5e64-432a-b0a7-a4b3438b14ef admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:13.371178 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4308/8647] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:26:13.375388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5a9a9-2b26-4ae6-bff1-b0a63ec0030b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:13.385978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5a9a9-2b26-4ae6-bff1-b0a63ec0030b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:13.390968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc451b-15db-4359-a8e4-3219a4c82b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:13.391573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc451b-15db-4359-a8e4-3219a4c82b2f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:13.391849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc451b-15db-4359-a8e4-3219a4c82b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:13.392119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc451b-15db-4359-a8e4-3219a4c82b2f admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:13.392803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc451b-15db-4359-a8e4-3219a4c82b2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:13.394710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc451b-15db-4359-a8e4-3219a4c82b2f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:13.422943 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4340/8648] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:26:13 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:26:13.427131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a5715-5e64-432a-b0a7-a4b3438b14ef admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:13.437984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a5715-5e64-432a-b0a7-a4b3438b14ef admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:13.441583 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:26:13.505150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787ecc4-aa2f-47c6-9fe2-c7813b9265aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:13.505775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787ecc4-aa2f-47c6-9fe2-c7813b9265aa admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:13.506048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787ecc4-aa2f-47c6-9fe2-c7813b9265aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:13.506924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787ecc4-aa2f-47c6-9fe2-c7813b9265aa admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:13.507579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787ecc4-aa2f-47c6-9fe2-c7813b9265aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:13.509530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787ecc4-aa2f-47c6-9fe2-c7813b9265aa admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:13.534618 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4309/8649] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:26:13 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:26:13.535822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc451b-15db-4359-a8e4-3219a4c82b2f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:13.546704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc451b-15db-4359-a8e4-3219a4c82b2f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:13.551879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44faa7-0ab3-428c-8199-f7aee91e6319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:13.552297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44faa7-0ab3-428c-8199-f7aee91e6319 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:13.552580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44faa7-0ab3-428c-8199-f7aee91e6319 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:13.552906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44faa7-0ab3-428c-8199-f7aee91e6319 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:13.554137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae44faa7-0ab3-428c-8199-f7aee91e6319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:13.555938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae44faa7-0ab3-428c-8199-f7aee91e6319 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:13.570839 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4341/8650] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:26:13.572536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787ecc4-aa2f-47c6-9fe2-c7813b9265aa admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:13.583836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787ecc4-aa2f-47c6-9fe2-c7813b9265aa admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:13.590975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e298ac1-a7c8-4c9e-8d0f-8174f0d012a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:13.591746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e298ac1-a7c8-4c9e-8d0f-8174f0d012a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:13.592035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e298ac1-a7c8-4c9e-8d0f-8174f0d012a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:13.592306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e298ac1-a7c8-4c9e-8d0f-8174f0d012a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:13.593800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e298ac1-a7c8-4c9e-8d0f-8174f0d012a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:13.594698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44faa7-0ab3-428c-8199-f7aee91e6319 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:13.596376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e298ac1-a7c8-4c9e-8d0f-8174f0d012a2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:13.602763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ae44faa7-0ab3-428c-8199-f7aee91e6319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:13.612882 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4310/8651] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:26:13.629286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e298ac1-a7c8-4c9e-8d0f-8174f0d012a2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:13.642662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e298ac1-a7c8-4c9e-8d0f-8174f0d012a2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:13.653485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fd683-5324-4efa-bca3-c0ea414844b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:13.654362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fd683-5324-4efa-bca3-c0ea414844b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:13.654642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fd683-5324-4efa-bca3-c0ea414844b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:13.654919 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fd683-5324-4efa-bca3-c0ea414844b6 admin admin] PATH_INFO: `/v3/projects/ffc31345341f454599a1fe56005fafb1/users/9a682310b1f94ae0ad5dbcd8ea0fd496/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:13.673430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fd683-5324-4efa-bca3-c0ea414844b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc31345341f454599a1fe56005fafb1, user_id=9a682310b1f94ae0ad5dbcd8ea0fd496, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:13.676283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fd683-5324-4efa-bca3-c0ea414844b6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:13.692899 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4311/8652] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:26:13 2022] PUT /identity/v3/projects/ffc31345341f454599a1fe56005fafb1/users/9a682310b1f94ae0ad5dbcd8ea0fd496/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:26:13.703612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a192e-d750-4d61-b5ae-d25268c1e821 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:13.703895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a192e-d750-4d61-b5ae-d25268c1e821 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:13.704379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a192e-d750-4d61-b5ae-d25268c1e821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:13.710473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44faa7-0ab3-428c-8199-f7aee91e6319 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:13.735406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-608a192e-d750-4d61-b5ae-d25268c1e821 None None] MFA Rules not processed for user `9a682310b1f94ae0ad5dbcd8ea0fd496`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:26:13.736695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-608a192e-d750-4d61-b5ae-d25268c1e821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:13.744911 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:26:13.793220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f1708-02e3-4718-87b7-1cc17c27e798 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:13.793942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f1708-02e3-4718-87b7-1cc17c27e798 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:13.794207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f1708-02e3-4718-87b7-1cc17c27e798 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:13.794582 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f1708-02e3-4718-87b7-1cc17c27e798 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:13.796342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-818f1708-02e3-4718-87b7-1cc17c27e798 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:13.811718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f1708-02e3-4718-87b7-1cc17c27e798 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:13.814259 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f1708-02e3-4718-87b7-1cc17c27e798 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:13.816232 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4312/8653] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:26:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:26:13.823763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a192e-d750-4d61-b5ae-d25268c1e821 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:13.829887 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4342/8654] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:26:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:26:13.884102 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:26:13.902099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a192e-d750-4d61-b5ae-d25268c1e821 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:13.907218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131b9d6-9388-4139-b14a-0a198992298c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:13.907843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131b9d6-9388-4139-b14a-0a198992298c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:13.908124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131b9d6-9388-4139-b14a-0a198992298c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:13.908397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131b9d6-9388-4139-b14a-0a198992298c admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:13.909082 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131b9d6-9388-4139-b14a-0a198992298c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:13.910981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131b9d6-9388-4139-b14a-0a198992298c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:13.941749 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4313/8655] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:26:13 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:26:13.945963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f1708-02e3-4718-87b7-1cc17c27e798 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:13.956936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f1708-02e3-4718-87b7-1cc17c27e798 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:14.016368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a84943-030e-4860-aad8-cb9a5bcd7342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:14.017065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a84943-030e-4860-aad8-cb9a5bcd7342 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:14.017266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a84943-030e-4860-aad8-cb9a5bcd7342 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:14.017540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a84943-030e-4860-aad8-cb9a5bcd7342 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:14.018369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a84943-030e-4860-aad8-cb9a5bcd7342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:14.020842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a84943-030e-4860-aad8-cb9a5bcd7342 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:14.044130 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4343/8656] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:26:13 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:26:14.048214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131b9d6-9388-4139-b14a-0a198992298c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:14.059145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131b9d6-9388-4139-b14a-0a198992298c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:14.063808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a96984-a154-4d69-adbf-0e0622d444ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:14.064408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a96984-a154-4d69-adbf-0e0622d444ca admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:14.064841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a96984-a154-4d69-adbf-0e0622d444ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:14.065116 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a96984-a154-4d69-adbf-0e0622d444ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:14.065865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a96984-a154-4d69-adbf-0e0622d444ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:14.067476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a96984-a154-4d69-adbf-0e0622d444ca admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:14.079102 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4314/8657] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:26:14.083410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a84943-030e-4860-aad8-cb9a5bcd7342 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:14.094689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a84943-030e-4860-aad8-cb9a5bcd7342 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:14.099345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14327d-791d-4052-89ee-3ed22ab3e323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:14.099943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14327d-791d-4052-89ee-3ed22ab3e323 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:14.100794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14327d-791d-4052-89ee-3ed22ab3e323 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:14.101067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14327d-791d-4052-89ee-3ed22ab3e323 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:14.101736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc14327d-791d-4052-89ee-3ed22ab3e323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:14.103321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc14327d-791d-4052-89ee-3ed22ab3e323 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:14.117788 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4344/8658] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:26:14.119224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a96984-a154-4d69-adbf-0e0622d444ca admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:14.129369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a96984-a154-4d69-adbf-0e0622d444ca admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:14.134038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e88b66-c6ce-44e3-b7c6-c26c000833cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:14.134679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e88b66-c6ce-44e3-b7c6-c26c000833cc admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:14.134955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e88b66-c6ce-44e3-b7c6-c26c000833cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:14.135226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e88b66-c6ce-44e3-b7c6-c26c000833cc admin admin] PATH_INFO: `/v3/projects/88d8314972fd437aa5cddb61d4f0412c/users/273a3b2c4c7e4959a27b3d529232104f/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:14.150950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e88b66-c6ce-44e3-b7c6-c26c000833cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=88d8314972fd437aa5cddb61d4f0412c, user_id=273a3b2c4c7e4959a27b3d529232104f, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:14.153683 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e88b66-c6ce-44e3-b7c6-c26c000833cc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:14.166947 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4315/8659] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:26:14 2022] PUT /identity/v3/projects/88d8314972fd437aa5cddb61d4f0412c/users/273a3b2c4c7e4959a27b3d529232104f/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:26:14.178066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c35ea1-5054-4812-9afc-4eefe92bab94 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:14.179004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c35ea1-5054-4812-9afc-4eefe92bab94 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:14.179290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c35ea1-5054-4812-9afc-4eefe92bab94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:14.207210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-56c35ea1-5054-4812-9afc-4eefe92bab94 None None] MFA Rules not processed for user `273a3b2c4c7e4959a27b3d529232104f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:26:14.208413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-56c35ea1-5054-4812-9afc-4eefe92bab94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:14.274941 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4345/8660] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:26:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:26:14.279266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e88b66-c6ce-44e3-b7c6-c26c000833cc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:14.344106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e88b66-c6ce-44e3-b7c6-c26c000833cc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:14.348949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304472cb-4eb3-4428-b0a0-d04805d8ee97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:14.349554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304472cb-4eb3-4428-b0a0-d04805d8ee97 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:14.349831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304472cb-4eb3-4428-b0a0-d04805d8ee97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:14.350118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304472cb-4eb3-4428-b0a0-d04805d8ee97 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:14.350922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304472cb-4eb3-4428-b0a0-d04805d8ee97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:14.352840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304472cb-4eb3-4428-b0a0-d04805d8ee97 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:14.380192 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4316/8661] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:26:14 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:26:14.384883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c35ea1-5054-4812-9afc-4eefe92bab94 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:14.395790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c35ea1-5054-4812-9afc-4eefe92bab94 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:14.416451 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:26:14.469577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa198b-4bec-4994-a96d-f5d8d5d9a88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:14.470180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa198b-4bec-4994-a96d-f5d8d5d9a88f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:14.470456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa198b-4bec-4994-a96d-f5d8d5d9a88f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:14.470728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa198b-4bec-4994-a96d-f5d8d5d9a88f admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:14.471341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa198b-4bec-4994-a96d-f5d8d5d9a88f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:14.473274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa198b-4bec-4994-a96d-f5d8d5d9a88f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:14.494615 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4346/8662] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:26:14 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:26:14.498619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304472cb-4eb3-4428-b0a0-d04805d8ee97 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:14.508958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304472cb-4eb3-4428-b0a0-d04805d8ee97 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:14.513499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914de78c-1ae4-4369-9e4f-7d251ce04721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:14.514093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914de78c-1ae4-4369-9e4f-7d251ce04721 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:14.514369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914de78c-1ae4-4369-9e4f-7d251ce04721 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:14.514636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914de78c-1ae4-4369-9e4f-7d251ce04721 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:14.515264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914de78c-1ae4-4369-9e4f-7d251ce04721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:14.516935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914de78c-1ae4-4369-9e4f-7d251ce04721 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:14.528213 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4317/8663] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:26:14.532285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa198b-4bec-4994-a96d-f5d8d5d9a88f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:14.542309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa198b-4bec-4994-a96d-f5d8d5d9a88f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:14.546785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d92107-5c7d-4e89-9d37-1f39d0b95cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:14.547416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d92107-5c7d-4e89-9d37-1f39d0b95cec admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:14.547692 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d92107-5c7d-4e89-9d37-1f39d0b95cec admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:14.547961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d92107-5c7d-4e89-9d37-1f39d0b95cec admin admin] PATH_INFO: `/v3/projects/fec7fc9d12924360a06f39c9b7d584fe/users/ff86040641e742109ca26f517cd50488/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:14.563013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d92107-5c7d-4e89-9d37-1f39d0b95cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec7fc9d12924360a06f39c9b7d584fe, user_id=ff86040641e742109ca26f517cd50488, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:14.565666 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d92107-5c7d-4e89-9d37-1f39d0b95cec admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:14.578899 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4347/8664] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:26:14 2022] PUT /identity/v3/projects/fec7fc9d12924360a06f39c9b7d584fe/users/ff86040641e742109ca26f517cd50488/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:26:14.582810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914de78c-1ae4-4369-9e4f-7d251ce04721 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:14.593214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914de78c-1ae4-4369-9e4f-7d251ce04721 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:14.649310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d425362-05b0-41e1-afad-52f3d8ae6903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:14.649914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d425362-05b0-41e1-afad-52f3d8ae6903 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:14.650195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d425362-05b0-41e1-afad-52f3d8ae6903 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:14.650464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d425362-05b0-41e1-afad-52f3d8ae6903 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:14.651093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d425362-05b0-41e1-afad-52f3d8ae6903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:14.652738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d425362-05b0-41e1-afad-52f3d8ae6903 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:14.662440 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4318/8665] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:26:14.667152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d92107-5c7d-4e89-9d37-1f39d0b95cec admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:14.677478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d92107-5c7d-4e89-9d37-1f39d0b95cec admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:14.682848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c85bd-3f73-43c2-9475-c9f1396b00d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:14.683488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c85bd-3f73-43c2-9475-c9f1396b00d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:14.683767 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c85bd-3f73-43c2-9475-c9f1396b00d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:14.684040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c85bd-3f73-43c2-9475-c9f1396b00d6 admin admin] PATH_INFO: `/v3/projects/fec7fc9d12924360a06f39c9b7d584fe/users/ff86040641e742109ca26f517cd50488/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:14.685981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c85bd-3f73-43c2-9475-c9f1396b00d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec7fc9d12924360a06f39c9b7d584fe, user_id=ff86040641e742109ca26f517cd50488, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:14.688579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c85bd-3f73-43c2-9475-c9f1396b00d6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:14.698748 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4348/8666] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:26:14 2022] PUT /identity/v3/projects/fec7fc9d12924360a06f39c9b7d584fe/users/ff86040641e742109ca26f517cd50488/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:26:14.709249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490a10b-53ee-4c5c-ba75-a1133c03754d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:14.709617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490a10b-53ee-4c5c-ba75-a1133c03754d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:14.709894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490a10b-53ee-4c5c-ba75-a1133c03754d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:14.731238 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:26:14.739790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e490a10b-53ee-4c5c-ba75-a1133c03754d None None] MFA Rules not processed for user `ff86040641e742109ca26f517cd50488`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:26:14.741126 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e490a10b-53ee-4c5c-ba75-a1133c03754d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:14.810079 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4319/8667] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:26:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:26:14.825573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c85bd-3f73-43c2-9475-c9f1396b00d6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:14.901312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c85bd-3f73-43c2-9475-c9f1396b00d6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:14.906612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b0753-34b4-4d47-b345-02a644022086 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:14.907206 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b0753-34b4-4d47-b345-02a644022086 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:14.907484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b0753-34b4-4d47-b345-02a644022086 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:14.907760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b0753-34b4-4d47-b345-02a644022086 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:14.965835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b0753-34b4-4d47-b345-02a644022086 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:14.967438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b0753-34b4-4d47-b345-02a644022086 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:14.976449 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4349/8668] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:26:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:26:17.642797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490a10b-53ee-4c5c-ba75-a1133c03754d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:26:17.644347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e490a10b-53ee-4c5c-ba75-a1133c03754d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:17.706921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490a10b-53ee-4c5c-ba75-a1133c03754d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:26:17.710924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da960a72-c713-4bb2-bdf7-5dcfd05069e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:26:17.711528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da960a72-c713-4bb2-bdf7-5dcfd05069e0 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:17.711807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da960a72-c713-4bb2-bdf7-5dcfd05069e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:17.712080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da960a72-c713-4bb2-bdf7-5dcfd05069e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:17.723591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da960a72-c713-4bb2-bdf7-5dcfd05069e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:26:17.725093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da960a72-c713-4bb2-bdf7-5dcfd05069e0 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:26:17.736866 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4320/8669] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:26:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:26:21.614821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f9886-a668-4676-8977-4465fbd6eb02 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:21.615320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f9886-a668-4676-8977-4465fbd6eb02 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:21.615426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f9886-a668-4676-8977-4465fbd6eb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:21.637526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fa5f9886-a668-4676-8977-4465fbd6eb02 None None] MFA Rules not processed for user `9a682310b1f94ae0ad5dbcd8ea0fd496`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:26:21.638959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fa5f9886-a668-4676-8977-4465fbd6eb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:21.653138 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4350/8670] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:26:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:26:27.731729 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=55 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:26:31.633173 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:26:51.974774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ea8bc-11a0-4d35-a8c6-004911819a17 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:26:51.975295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ea8bc-11a0-4d35-a8c6-004911819a17 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:26:51.975295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ea8bc-11a0-4d35-a8c6-004911819a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:26:51.995027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1f4ea8bc-11a0-4d35-a8c6-004911819a17 None None] MFA Rules not processed for user `45a25acf184b4bfc9f1b06dcf0e6d81b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:26:51.996237 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1f4ea8bc-11a0-4d35-a8c6-004911819a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:26:52.057547 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4321/8671] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:26:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:27:02.050225 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=25 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:27:17.599862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a960370-6ae8-4ce7-8cbb-a191e247b4dd None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:17.600436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a960370-6ae8-4ce7-8cbb-a191e247b4dd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:17.600436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a960370-6ae8-4ce7-8cbb-a191e247b4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:17.621182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1a960370-6ae8-4ce7-8cbb-a191e247b4dd None None] MFA Rules not processed for user `9a682310b1f94ae0ad5dbcd8ea0fd496`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:27:17.622463 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1a960370-6ae8-4ce7-8cbb-a191e247b4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:17.629708 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4351/8672] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:27:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:27:27.615934 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:27:29.715796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ea8bc-11a0-4d35-a8c6-004911819a17 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:29.728394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ea8bc-11a0-4d35-a8c6-004911819a17 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:29.731926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be473a-1d04-4311-af50-2274864d9451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:29.732533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be473a-1d04-4311-af50-2274864d9451 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:29.732832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be473a-1d04-4311-af50-2274864d9451 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:29.733098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be473a-1d04-4311-af50-2274864d9451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:29.735451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-89be473a-1d04-4311-af50-2274864d9451 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:29.750971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be473a-1d04-4311-af50-2274864d9451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:29.752395 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be473a-1d04-4311-af50-2274864d9451 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:29.765582 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4322/8673] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:27:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:27:37.068687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a960370-6ae8-4ce7-8cbb-a191e247b4dd None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:37.071111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1a960370-6ae8-4ce7-8cbb-a191e247b4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:37.166713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a960370-6ae8-4ce7-8cbb-a191e247b4dd None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:37.171939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0f81a-98bf-4dd3-a275-b77a6a89bca8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:37.172562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0f81a-98bf-4dd3-a275-b77a6a89bca8 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:37.172869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0f81a-98bf-4dd3-a275-b77a6a89bca8 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:37.173179 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0f81a-98bf-4dd3-a275-b77a6a89bca8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:37.174972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-33b0f81a-98bf-4dd3-a275-b77a6a89bca8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:37.191325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0f81a-98bf-4dd3-a275-b77a6a89bca8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:37.192984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0f81a-98bf-4dd3-a275-b77a6a89bca8 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:37.207048 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4352/8674] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:27:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:27:39.758299 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:27:46.888853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be473a-1d04-4311-af50-2274864d9451 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:46.893497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-89be473a-1d04-4311-af50-2274864d9451 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:46.941423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be473a-1d04-4311-af50-2274864d9451 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:46.962994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d92d16-bf91-4aa9-952a-817b5814b6f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:46.964048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d92d16-bf91-4aa9-952a-817b5814b6f4 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:46.964542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d92d16-bf91-4aa9-952a-817b5814b6f4 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:46.965307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d92d16-bf91-4aa9-952a-817b5814b6f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:46.968480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-16d92d16-bf91-4aa9-952a-817b5814b6f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:46.990550 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d92d16-bf91-4aa9-952a-817b5814b6f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:46.992703 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d92d16-bf91-4aa9-952a-817b5814b6f4 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:47.026358 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4323/8675] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:27:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:27:47.056896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0f81a-98bf-4dd3-a275-b77a6a89bca8 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:47.145471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0f81a-98bf-4dd3-a275-b77a6a89bca8 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:47.152780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f2812-5a2e-4925-893a-387f9e92aa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:47.153416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f2812-5a2e-4925-893a-387f9e92aa61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:47.153689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f2812-5a2e-4925-893a-387f9e92aa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:47.153955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f2812-5a2e-4925-893a-387f9e92aa61 admin admin] PATH_INFO: `/v3/users/9a682310b1f94ae0ad5dbcd8ea0fd496` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:47.155161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f2812-5a2e-4925-893a-387f9e92aa61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a682310b1f94ae0ad5dbcd8ea0fd496)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:47.157165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f2812-5a2e-4925-893a-387f9e92aa61 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:47.207809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-663f2812-5a2e-4925-893a-387f9e92aa61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a682310b1f94ae0ad5dbcd8ea0fd496'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:47.208373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-663f2812-5a2e-4925-893a-387f9e92aa61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a682310b1f94ae0ad5dbcd8ea0fd496'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:47.221933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-663f2812-5a2e-4925-893a-387f9e92aa61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a682310b1f94ae0ad5dbcd8ea0fd496'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:47.236722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-663f2812-5a2e-4925-893a-387f9e92aa61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a682310b1f94ae0ad5dbcd8ea0fd496'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:47.244326 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-663f2812-5a2e-4925-893a-387f9e92aa61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a682310b1f94ae0ad5dbcd8ea0fd496'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:47.254126 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4353/8676] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:27:47 2022] DELETE /identity/v3/users/9a682310b1f94ae0ad5dbcd8ea0fd496 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:27:47.256696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767fbd8-5377-4176-898b-0f06a244a330 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:47.257972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767fbd8-5377-4176-898b-0f06a244a330 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:47.258226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767fbd8-5377-4176-898b-0f06a244a330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:47.278354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7767fbd8-5377-4176-898b-0f06a244a330 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:27:47.279570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7767fbd8-5377-4176-898b-0f06a244a330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:47.342248 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4324/8677] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:27:47.353069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f2812-5a2e-4925-893a-387f9e92aa61 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:47.354512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-663f2812-5a2e-4925-893a-387f9e92aa61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:47.365525 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:27:47.416339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f2812-5a2e-4925-893a-387f9e92aa61 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:47.419988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd0356-9c16-4ca2-b472-573896163459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:47.420584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd0356-9c16-4ca2-b472-573896163459 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:47.420887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd0356-9c16-4ca2-b472-573896163459 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:47.421161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd0356-9c16-4ca2-b472-573896163459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:47.429983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd0356-9c16-4ca2-b472-573896163459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:47.431390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd0356-9c16-4ca2-b472-573896163459 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:47.441559 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4354/8678] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:27:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:27:47.617400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767fbd8-5377-4176-898b-0f06a244a330 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:47.618921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7767fbd8-5377-4176-898b-0f06a244a330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:47.632696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767fbd8-5377-4176-898b-0f06a244a330 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:47.637497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ca73d-8693-4c4b-a45d-16f1c1931c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:47.638139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ca73d-8693-4c4b-a45d-16f1c1931c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:47.638418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ca73d-8693-4c4b-a45d-16f1c1931c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:47.638711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ca73d-8693-4c4b-a45d-16f1c1931c70 admin admin] PATH_INFO: `/v3/projects/ffc31345341f454599a1fe56005fafb1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:47.639818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ca73d-8693-4c4b-a45d-16f1c1931c70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc31345341f454599a1fe56005fafb1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:47.641763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ca73d-8693-4c4b-a45d-16f1c1931c70 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:47.689430 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a51ca73d-8693-4c4b-a45d-16f1c1931c70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc31345341f454599a1fe56005fafb1', 'request_id': 'req-a51ca73d-8693-4c4b-a45d-16f1c1931c70'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:47.697883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a51ca73d-8693-4c4b-a45d-16f1c1931c70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc31345341f454599a1fe56005fafb1', 'request_id': 'req-a51ca73d-8693-4c4b-a45d-16f1c1931c70'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:47.703653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a51ca73d-8693-4c4b-a45d-16f1c1931c70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc31345341f454599a1fe56005fafb1', 'request_id': 'req-a51ca73d-8693-4c4b-a45d-16f1c1931c70'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:47.715780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a51ca73d-8693-4c4b-a45d-16f1c1931c70 admin admin] The token cache is being invalidate because project ffc31345341f454599a1fe56005fafb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:27:47.716079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a51ca73d-8693-4c4b-a45d-16f1c1931c70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:47.716783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a51ca73d-8693-4c4b-a45d-16f1c1931c70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:47.718533 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4325/8679] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:27:47 2022] DELETE /identity/v3/projects/ffc31345341f454599a1fe56005fafb1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:27:47.723650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd0356-9c16-4ca2-b472-573896163459 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:47.732779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd0356-9c16-4ca2-b472-573896163459 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:47.795676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec03c5-56f8-4805-914c-6c67fe5f54ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:47.796323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec03c5-56f8-4805-914c-6c67fe5f54ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:47.796618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec03c5-56f8-4805-914c-6c67fe5f54ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:47.796899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec03c5-56f8-4805-914c-6c67fe5f54ba admin admin] PATH_INFO: `/v3/users/273a3b2c4c7e4959a27b3d529232104f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:47.798052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec03c5-56f8-4805-914c-6c67fe5f54ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=273a3b2c4c7e4959a27b3d529232104f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:47.800826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec03c5-56f8-4805-914c-6c67fe5f54ba admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:47.849850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-32ec03c5-56f8-4805-914c-6c67fe5f54ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '273a3b2c4c7e4959a27b3d529232104f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:47.850517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-32ec03c5-56f8-4805-914c-6c67fe5f54ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '273a3b2c4c7e4959a27b3d529232104f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:47.858461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-32ec03c5-56f8-4805-914c-6c67fe5f54ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '273a3b2c4c7e4959a27b3d529232104f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:47.871193 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-32ec03c5-56f8-4805-914c-6c67fe5f54ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '273a3b2c4c7e4959a27b3d529232104f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:47.879514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-32ec03c5-56f8-4805-914c-6c67fe5f54ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '273a3b2c4c7e4959a27b3d529232104f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:47.885601 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4355/8680] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:27:47 2022] DELETE /identity/v3/users/273a3b2c4c7e4959a27b3d529232104f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:27:48.167739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ca73d-8693-4c4b-a45d-16f1c1931c70 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:48.169262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a51ca73d-8693-4c4b-a45d-16f1c1931c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:48.184323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ca73d-8693-4c4b-a45d-16f1c1931c70 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:48.247168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61498a0f-b90c-45d3-8c01-a20e6ba2199e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:48.247799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61498a0f-b90c-45d3-8c01-a20e6ba2199e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:48.248075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61498a0f-b90c-45d3-8c01-a20e6ba2199e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:48.248342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61498a0f-b90c-45d3-8c01-a20e6ba2199e admin admin] PATH_INFO: `/v3/projects/88d8314972fd437aa5cddb61d4f0412c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:48.249476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61498a0f-b90c-45d3-8c01-a20e6ba2199e admin admin] RBAC: Authorizing `identity:delete_project(project_id=88d8314972fd437aa5cddb61d4f0412c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:48.251361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61498a0f-b90c-45d3-8c01-a20e6ba2199e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:48.263921 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:27:48.299537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-61498a0f-b90c-45d3-8c01-a20e6ba2199e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88d8314972fd437aa5cddb61d4f0412c', 'request_id': 'req-61498a0f-b90c-45d3-8c01-a20e6ba2199e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:48.306921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-61498a0f-b90c-45d3-8c01-a20e6ba2199e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88d8314972fd437aa5cddb61d4f0412c', 'request_id': 'req-61498a0f-b90c-45d3-8c01-a20e6ba2199e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:48.312365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-61498a0f-b90c-45d3-8c01-a20e6ba2199e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88d8314972fd437aa5cddb61d4f0412c', 'request_id': 'req-61498a0f-b90c-45d3-8c01-a20e6ba2199e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:48.323552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-61498a0f-b90c-45d3-8c01-a20e6ba2199e admin admin] The token cache is being invalidate because project 88d8314972fd437aa5cddb61d4f0412c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:27:48.323835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-61498a0f-b90c-45d3-8c01-a20e6ba2199e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:48.324462 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-61498a0f-b90c-45d3-8c01-a20e6ba2199e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:48.325963 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4326/8681] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:27:48 2022] DELETE /identity/v3/projects/88d8314972fd437aa5cddb61d4f0412c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:27:48.329925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec03c5-56f8-4805-914c-6c67fe5f54ba admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:48.332657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-32ec03c5-56f8-4805-914c-6c67fe5f54ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:48.345372 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec03c5-56f8-4805-914c-6c67fe5f54ba admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:48.373848 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:27:48.403487 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c99ce-6a1d-4876-b60a-5f398e063836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:48.404115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c99ce-6a1d-4876-b60a-5f398e063836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:48.404390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c99ce-6a1d-4876-b60a-5f398e063836 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:48.404696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c99ce-6a1d-4876-b60a-5f398e063836 admin admin] PATH_INFO: `/v3/users/ff86040641e742109ca26f517cd50488` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:48.405805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c99ce-6a1d-4876-b60a-5f398e063836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff86040641e742109ca26f517cd50488)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:48.407699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c99ce-6a1d-4876-b60a-5f398e063836 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:48.454411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-167c99ce-6a1d-4876-b60a-5f398e063836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff86040641e742109ca26f517cd50488'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:48.455068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-167c99ce-6a1d-4876-b60a-5f398e063836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff86040641e742109ca26f517cd50488'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:48.464283 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-167c99ce-6a1d-4876-b60a-5f398e063836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff86040641e742109ca26f517cd50488'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:48.477956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-167c99ce-6a1d-4876-b60a-5f398e063836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff86040641e742109ca26f517cd50488'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:48.484951 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-167c99ce-6a1d-4876-b60a-5f398e063836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff86040641e742109ca26f517cd50488'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:48.491581 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4356/8682] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:27:48 2022] DELETE /identity/v3/users/ff86040641e742109ca26f517cd50488 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:27:48.672684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61498a0f-b90c-45d3-8c01-a20e6ba2199e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:48.674194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-61498a0f-b90c-45d3-8c01-a20e6ba2199e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:48.688078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61498a0f-b90c-45d3-8c01-a20e6ba2199e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:48.753179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771f470-12d9-4513-9b98-ab230ae2ea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:48.753772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771f470-12d9-4513-9b98-ab230ae2ea6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:48.754050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771f470-12d9-4513-9b98-ab230ae2ea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:48.754388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771f470-12d9-4513-9b98-ab230ae2ea6f admin admin] PATH_INFO: `/v3/projects/fec7fc9d12924360a06f39c9b7d584fe` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:48.755798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771f470-12d9-4513-9b98-ab230ae2ea6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fec7fc9d12924360a06f39c9b7d584fe)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:48.758112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771f470-12d9-4513-9b98-ab230ae2ea6f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:48.808592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e771f470-12d9-4513-9b98-ab230ae2ea6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fec7fc9d12924360a06f39c9b7d584fe', 'request_id': 'req-e771f470-12d9-4513-9b98-ab230ae2ea6f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:48.818508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e771f470-12d9-4513-9b98-ab230ae2ea6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fec7fc9d12924360a06f39c9b7d584fe', 'request_id': 'req-e771f470-12d9-4513-9b98-ab230ae2ea6f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:48.824429 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e771f470-12d9-4513-9b98-ab230ae2ea6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fec7fc9d12924360a06f39c9b7d584fe', 'request_id': 'req-e771f470-12d9-4513-9b98-ab230ae2ea6f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:48.840964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e771f470-12d9-4513-9b98-ab230ae2ea6f admin admin] The token cache is being invalidate because project fec7fc9d12924360a06f39c9b7d584fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:27:48.841278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e771f470-12d9-4513-9b98-ab230ae2ea6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:48.841971 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e771f470-12d9-4513-9b98-ab230ae2ea6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:27:48.843639 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4327/8683] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:27:48 2022] DELETE /identity/v3/projects/fec7fc9d12924360a06f39c9b7d584fe => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:27:48.849522 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a16274-62a7-4697-b799-5b920963ef58 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:48.849808 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a16274-62a7-4697-b799-5b920963ef58 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:48.850076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a16274-62a7-4697-b799-5b920963ef58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:48.871428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-91a16274-62a7-4697-b799-5b920963ef58 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:27:48.872670 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-91a16274-62a7-4697-b799-5b920963ef58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:48.934677 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4357/8684] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:27:48.942553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c79747-8e9b-44d8-8d65-fde7b1131118 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:48.942879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c79747-8e9b-44d8-8d65-fde7b1131118 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:48.943194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c79747-8e9b-44d8-8d65-fde7b1131118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:48.963542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-22c79747-8e9b-44d8-8d65-fde7b1131118 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:27:48.964826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-22c79747-8e9b-44d8-8d65-fde7b1131118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:48.973347 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4328/8685] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:27:48.977512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a16274-62a7-4697-b799-5b920963ef58 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:48.988069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a16274-62a7-4697-b799-5b920963ef58 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:48.992738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e26f1-1841-4631-b6e3-6d2532ef3bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:48.993334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e26f1-1841-4631-b6e3-6d2532ef3bdc admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:48.993615 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e26f1-1841-4631-b6e3-6d2532ef3bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:48.993887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e26f1-1841-4631-b6e3-6d2532ef3bdc admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:48.994530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e26f1-1841-4631-b6e3-6d2532ef3bdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:27:48.994830 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e26f1-1841-4631-b6e3-6d2532ef3bdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:48.996409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e26f1-1841-4631-b6e3-6d2532ef3bdc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:49.008638 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4358/8686] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:27:49.012786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c79747-8e9b-44d8-8d65-fde7b1131118 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:49.022443 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c79747-8e9b-44d8-8d65-fde7b1131118 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:49.027349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa9a59-3661-4914-a879-f2403aad6e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:49.027960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa9a59-3661-4914-a879-f2403aad6e24 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:49.028241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa9a59-3661-4914-a879-f2403aad6e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:49.028518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa9a59-3661-4914-a879-f2403aad6e24 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:49.029197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa9a59-3661-4914-a879-f2403aad6e24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:49.031460 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa9a59-3661-4914-a879-f2403aad6e24 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:49.067468 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4329/8687] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:27:49 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:27:49.068633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e26f1-1841-4631-b6e3-6d2532ef3bdc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:49.079071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e26f1-1841-4631-b6e3-6d2532ef3bdc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:49.120146 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:27:49.153979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc981e89-4ddd-4dc2-a732-1288ddec7a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:49.154957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc981e89-4ddd-4dc2-a732-1288ddec7a52 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:49.155171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc981e89-4ddd-4dc2-a732-1288ddec7a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:49.155508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc981e89-4ddd-4dc2-a732-1288ddec7a52 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:49.156231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc981e89-4ddd-4dc2-a732-1288ddec7a52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:49.158346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc981e89-4ddd-4dc2-a732-1288ddec7a52 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:49.184685 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4359/8688] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:27:49 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:27:49.188545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa9a59-3661-4914-a879-f2403aad6e24 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:49.194231 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:27:49.201353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa9a59-3661-4914-a879-f2403aad6e24 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:49.207814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1519c5-6905-4e05-94f9-ef732248916a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:49.208419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1519c5-6905-4e05-94f9-ef732248916a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:49.208733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1519c5-6905-4e05-94f9-ef732248916a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:49.209009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1519c5-6905-4e05-94f9-ef732248916a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:49.209680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1519c5-6905-4e05-94f9-ef732248916a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:49.211281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1519c5-6905-4e05-94f9-ef732248916a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:49.227330 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4330/8689] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:27:49.232812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc981e89-4ddd-4dc2-a732-1288ddec7a52 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:49.246244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc981e89-4ddd-4dc2-a732-1288ddec7a52 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:49.252321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35ad24-a29f-4443-bd50-48d17633f507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:49.253614 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35ad24-a29f-4443-bd50-48d17633f507 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:49.254028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35ad24-a29f-4443-bd50-48d17633f507 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:49.254435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35ad24-a29f-4443-bd50-48d17633f507 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:49.255341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35ad24-a29f-4443-bd50-48d17633f507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:49.257341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35ad24-a29f-4443-bd50-48d17633f507 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:49.271016 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4360/8690] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:27:49.275783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1519c5-6905-4e05-94f9-ef732248916a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:49.286756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1519c5-6905-4e05-94f9-ef732248916a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:49.291525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2812a6c-7fc2-4f3b-954a-12e1cf22470a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:49.292179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2812a6c-7fc2-4f3b-954a-12e1cf22470a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:49.292690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2812a6c-7fc2-4f3b-954a-12e1cf22470a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:49.292976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2812a6c-7fc2-4f3b-954a-12e1cf22470a admin admin] PATH_INFO: `/v3/projects/861b785641134a6588f1cee9fa2a5764/users/51ec5c532fbc4a38ba31b659500f5431/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:49.308141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2812a6c-7fc2-4f3b-954a-12e1cf22470a admin admin] RBAC: Authorizing `identity:create_grant(project_id=861b785641134a6588f1cee9fa2a5764, user_id=51ec5c532fbc4a38ba31b659500f5431, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:49.310857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2812a6c-7fc2-4f3b-954a-12e1cf22470a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:49.325135 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4331/8691] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:27:49 2022] PUT /identity/v3/projects/861b785641134a6588f1cee9fa2a5764/users/51ec5c532fbc4a38ba31b659500f5431/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:27:49.330188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385fdd9-5252-40c9-80f1-534418852816 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:49.331449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385fdd9-5252-40c9-80f1-534418852816 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:49.331674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385fdd9-5252-40c9-80f1-534418852816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:49.352545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c385fdd9-5252-40c9-80f1-534418852816 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:27:49.353785 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c385fdd9-5252-40c9-80f1-534418852816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:49.414159 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4361/8692] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:27:49.423798 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2812a6c-7fc2-4f3b-954a-12e1cf22470a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:49.425484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c2812a6c-7fc2-4f3b-954a-12e1cf22470a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:49.487706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2812a6c-7fc2-4f3b-954a-12e1cf22470a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:49.491409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c63d8-21a2-481c-a2fd-9008836f4df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:49.492015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c63d8-21a2-481c-a2fd-9008836f4df7 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:49.492659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c63d8-21a2-481c-a2fd-9008836f4df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:49.492659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c63d8-21a2-481c-a2fd-9008836f4df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:49.501922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c63d8-21a2-481c-a2fd-9008836f4df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:49.503413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c63d8-21a2-481c-a2fd-9008836f4df7 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:49.513151 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4332/8693] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:27:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:27:50.194074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5783a-3c38-41c6-b79a-27d03cf35ac5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:50.194664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5783a-3c38-41c6-b79a-27d03cf35ac5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:50.195034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5783a-3c38-41c6-b79a-27d03cf35ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:50.273861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d5a5783a-3c38-41c6-b79a-27d03cf35ac5 None None] MFA Rules not processed for user `51ec5c532fbc4a38ba31b659500f5431`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:27:50.276295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d5a5783a-3c38-41c6-b79a-27d03cf35ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:50.370360 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4362/8694] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:27:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:27:50.374500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c63d8-21a2-481c-a2fd-9008836f4df7 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:50.387275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c63d8-21a2-481c-a2fd-9008836f4df7 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:50.395856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a526b3-94b5-4c62-8a06-dd1697841165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:50.396680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a526b3-94b5-4c62-8a06-dd1697841165 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:50.396977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a526b3-94b5-4c62-8a06-dd1697841165 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:50.397319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a526b3-94b5-4c62-8a06-dd1697841165 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:50.397876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a526b3-94b5-4c62-8a06-dd1697841165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:50.400188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a526b3-94b5-4c62-8a06-dd1697841165 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:50.444052 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4333/8695] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:27:50 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:27:50.447851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5783a-3c38-41c6-b79a-27d03cf35ac5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:50.492592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5783a-3c38-41c6-b79a-27d03cf35ac5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:50.566547 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:27:50.583039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda398f-cd60-4a7f-ad81-3e7a3252e65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:50.583868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda398f-cd60-4a7f-ad81-3e7a3252e65e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:50.584285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda398f-cd60-4a7f-ad81-3e7a3252e65e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:50.584573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda398f-cd60-4a7f-ad81-3e7a3252e65e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:50.585317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda398f-cd60-4a7f-ad81-3e7a3252e65e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:50.587385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda398f-cd60-4a7f-ad81-3e7a3252e65e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:50.613982 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4363/8696] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:27:50 2022] POST /identity/v3/users => generated 295 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:27:50.618433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a526b3-94b5-4c62-8a06-dd1697841165 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:50.630837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a526b3-94b5-4c62-8a06-dd1697841165 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:50.635587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3a388-1171-4e22-ad95-958d1868f460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:50.636187 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3a388-1171-4e22-ad95-958d1868f460 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:50.636457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3a388-1171-4e22-ad95-958d1868f460 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:50.636761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3a388-1171-4e22-ad95-958d1868f460 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:50.637428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3a388-1171-4e22-ad95-958d1868f460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:50.638965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3a388-1171-4e22-ad95-958d1868f460 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:50.654244 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4334/8697] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:27:50.655630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda398f-cd60-4a7f-ad81-3e7a3252e65e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:50.666302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda398f-cd60-4a7f-ad81-3e7a3252e65e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:50.671334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e833b0-af74-4c69-969b-4833847719ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:50.672001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e833b0-af74-4c69-969b-4833847719ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:50.672289 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e833b0-af74-4c69-969b-4833847719ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:50.672575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e833b0-af74-4c69-969b-4833847719ee admin admin] PATH_INFO: `/v3/projects/0633b6d49a114b248785a1ea4249014b/users/fd9cd5487f5843e495ab8696a5fd9036/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:50.691839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e833b0-af74-4c69-969b-4833847719ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0633b6d49a114b248785a1ea4249014b, user_id=fd9cd5487f5843e495ab8696a5fd9036, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:50.694618 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e833b0-af74-4c69-969b-4833847719ee admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:50.708917 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4364/8698] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:27:50 2022] PUT /identity/v3/projects/0633b6d49a114b248785a1ea4249014b/users/fd9cd5487f5843e495ab8696a5fd9036/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:27:50.712908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3a388-1171-4e22-ad95-958d1868f460 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:50.725086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3a388-1171-4e22-ad95-958d1868f460 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:50.787507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1ec43-918e-44fc-b795-fd9f1a01f50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:50.788344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1ec43-918e-44fc-b795-fd9f1a01f50c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:50.788772 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1ec43-918e-44fc-b795-fd9f1a01f50c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:50.789047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1ec43-918e-44fc-b795-fd9f1a01f50c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:50.789745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1ec43-918e-44fc-b795-fd9f1a01f50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:50.791507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1ec43-918e-44fc-b795-fd9f1a01f50c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:50.803503 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4335/8699] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:27:50.807736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e833b0-af74-4c69-969b-4833847719ee admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:50.819717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e833b0-af74-4c69-969b-4833847719ee admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:50.824784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1f373-7b24-459a-8774-7111656fa028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:50.825468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1f373-7b24-459a-8774-7111656fa028 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:50.825763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1f373-7b24-459a-8774-7111656fa028 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:50.826031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1f373-7b24-459a-8774-7111656fa028 admin admin] PATH_INFO: `/v3/projects/0633b6d49a114b248785a1ea4249014b/users/fd9cd5487f5843e495ab8696a5fd9036/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:50.827986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1f373-7b24-459a-8774-7111656fa028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0633b6d49a114b248785a1ea4249014b, user_id=fd9cd5487f5843e495ab8696a5fd9036, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:50.831129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1f373-7b24-459a-8774-7111656fa028 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:50.842710 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4365/8700] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:27:50 2022] PUT /identity/v3/projects/0633b6d49a114b248785a1ea4249014b/users/fd9cd5487f5843e495ab8696a5fd9036/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:27:51.759625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662f915-c82f-4d8d-8319-2797a8ec95b7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:51.760144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662f915-c82f-4d8d-8319-2797a8ec95b7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:51.760263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662f915-c82f-4d8d-8319-2797a8ec95b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:51.793412 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8662f915-c82f-4d8d-8319-2797a8ec95b7 None None] MFA Rules not processed for user `fd9cd5487f5843e495ab8696a5fd9036`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:27:51.794945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8662f915-c82f-4d8d-8319-2797a8ec95b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:51.819989 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:27:51.921375 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4336/8701] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:27:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:27:51.925855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe94d8e-1a27-446a-b002-4bcad9179064 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:51.926374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe94d8e-1a27-446a-b002-4bcad9179064 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:51.926689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe94d8e-1a27-446a-b002-4bcad9179064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:51.952040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fbe94d8e-1a27-446a-b002-4bcad9179064 None None] MFA Rules not processed for user `51ec5c532fbc4a38ba31b659500f5431`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:27:51.955267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fbe94d8e-1a27-446a-b002-4bcad9179064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:52.015187 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4366/8702] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:27:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:27:52.027026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662f915-c82f-4d8d-8319-2797a8ec95b7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:27:52.028728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8662f915-c82f-4d8d-8319-2797a8ec95b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:27:52.113739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662f915-c82f-4d8d-8319-2797a8ec95b7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:27:52.119701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5c6d4-9f7e-49a2-bd9b-e954db627402 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:27:52.120316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5c6d4-9f7e-49a2-bd9b-e954db627402 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:27:52.120594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5c6d4-9f7e-49a2-bd9b-e954db627402 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:27:52.120889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5c6d4-9f7e-49a2-bd9b-e954db627402 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:27:52.130755 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5c6d4-9f7e-49a2-bd9b-e954db627402 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:27:52.132323 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5c6d4-9f7e-49a2-bd9b-e954db627402 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:27:52.141771 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4337/8703] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:27:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:28:02.008444 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=48,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:28:02.137452 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=53 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:28:11.708423 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe94d8e-1a27-446a-b002-4bcad9179064 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:11.766133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe94d8e-1a27-446a-b002-4bcad9179064 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:11.769704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5599d2-753c-409a-92f5-f2aca397b1e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:11.770303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5599d2-753c-409a-92f5-f2aca397b1e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:11.770579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5599d2-753c-409a-92f5-f2aca397b1e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:11.770848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5599d2-753c-409a-92f5-f2aca397b1e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:11.772558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9b5599d2-753c-409a-92f5-f2aca397b1e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:28:11.788819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5599d2-753c-409a-92f5-f2aca397b1e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:11.790223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5599d2-753c-409a-92f5-f2aca397b1e2 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:11.803645 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4367/8704] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:28:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:28:17.088052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5c6d4-9f7e-49a2-bd9b-e954db627402 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:17.149914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5c6d4-9f7e-49a2-bd9b-e954db627402 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:17.154484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef957e19-667a-410e-b78a-8a178171eff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:17.155100 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef957e19-667a-410e-b78a-8a178171eff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:17.155374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef957e19-667a-410e-b78a-8a178171eff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:17.155640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef957e19-667a-410e-b78a-8a178171eff6 admin admin] PATH_INFO: `/v3/users/51ec5c532fbc4a38ba31b659500f5431` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:17.156785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef957e19-667a-410e-b78a-8a178171eff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51ec5c532fbc4a38ba31b659500f5431)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:17.158651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef957e19-667a-410e-b78a-8a178171eff6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:17.205177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ef957e19-667a-410e-b78a-8a178171eff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51ec5c532fbc4a38ba31b659500f5431'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:28:17.212476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ef957e19-667a-410e-b78a-8a178171eff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51ec5c532fbc4a38ba31b659500f5431'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:28:17.213639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ef957e19-667a-410e-b78a-8a178171eff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51ec5c532fbc4a38ba31b659500f5431'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:28:17.225420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ef957e19-667a-410e-b78a-8a178171eff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51ec5c532fbc4a38ba31b659500f5431'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:28:17.232710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ef957e19-667a-410e-b78a-8a178171eff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51ec5c532fbc4a38ba31b659500f5431'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:28:17.238491 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4338/8705] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:28:17 2022] DELETE /identity/v3/users/51ec5c532fbc4a38ba31b659500f5431 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:28:17.416916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5599d2-753c-409a-92f5-f2aca397b1e2 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:17.428693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5599d2-753c-409a-92f5-f2aca397b1e2 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:17.486579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9da005-3b64-4f08-a7bd-54e5db82a3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:17.487214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9da005-3b64-4f08-a7bd-54e5db82a3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:17.487497 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9da005-3b64-4f08-a7bd-54e5db82a3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:17.487772 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9da005-3b64-4f08-a7bd-54e5db82a3aa admin admin] PATH_INFO: `/v3/projects/861b785641134a6588f1cee9fa2a5764` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:17.488993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9da005-3b64-4f08-a7bd-54e5db82a3aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=861b785641134a6588f1cee9fa2a5764)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:17.490945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9da005-3b64-4f08-a7bd-54e5db82a3aa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:17.537693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cf9da005-3b64-4f08-a7bd-54e5db82a3aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '861b785641134a6588f1cee9fa2a5764', 'request_id': 'req-cf9da005-3b64-4f08-a7bd-54e5db82a3aa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:28:17.545196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cf9da005-3b64-4f08-a7bd-54e5db82a3aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '861b785641134a6588f1cee9fa2a5764', 'request_id': 'req-cf9da005-3b64-4f08-a7bd-54e5db82a3aa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:28:17.550763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cf9da005-3b64-4f08-a7bd-54e5db82a3aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '861b785641134a6588f1cee9fa2a5764', 'request_id': 'req-cf9da005-3b64-4f08-a7bd-54e5db82a3aa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:28:17.562018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cf9da005-3b64-4f08-a7bd-54e5db82a3aa admin admin] The token cache is being invalidate because project 861b785641134a6588f1cee9fa2a5764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:28:17.562320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cf9da005-3b64-4f08-a7bd-54e5db82a3aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:28:17.562923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cf9da005-3b64-4f08-a7bd-54e5db82a3aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:28:17.564394 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4368/8706] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:28:17 2022] DELETE /identity/v3/projects/861b785641134a6588f1cee9fa2a5764 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:28:17.568432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef957e19-667a-410e-b78a-8a178171eff6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:17.569847 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ef957e19-667a-410e-b78a-8a178171eff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:28:17.583666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef957e19-667a-410e-b78a-8a178171eff6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:17.640481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3615a-9107-41a5-9744-43abb770400a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:17.641197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3615a-9107-41a5-9744-43abb770400a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:17.641480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3615a-9107-41a5-9744-43abb770400a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:17.641786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3615a-9107-41a5-9744-43abb770400a admin admin] PATH_INFO: `/v3/users/fd9cd5487f5843e495ab8696a5fd9036` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:17.642943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3615a-9107-41a5-9744-43abb770400a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd9cd5487f5843e495ab8696a5fd9036)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:17.644883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3615a-9107-41a5-9744-43abb770400a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:17.668110 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:28:17.694267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bda3615a-9107-41a5-9744-43abb770400a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd9cd5487f5843e495ab8696a5fd9036'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:28:17.702718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bda3615a-9107-41a5-9744-43abb770400a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd9cd5487f5843e495ab8696a5fd9036'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:28:17.703361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bda3615a-9107-41a5-9744-43abb770400a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd9cd5487f5843e495ab8696a5fd9036'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:28:17.716817 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bda3615a-9107-41a5-9744-43abb770400a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd9cd5487f5843e495ab8696a5fd9036'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:28:17.724370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bda3615a-9107-41a5-9744-43abb770400a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd9cd5487f5843e495ab8696a5fd9036'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:28:17.731611 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4339/8707] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:28:17 2022] DELETE /identity/v3/users/fd9cd5487f5843e495ab8696a5fd9036 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:28:17.905446 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9da005-3b64-4f08-a7bd-54e5db82a3aa admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:17.907023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cf9da005-3b64-4f08-a7bd-54e5db82a3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:28:17.922180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9da005-3b64-4f08-a7bd-54e5db82a3aa admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:17.958701 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:28:17.988801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c86c9-60af-4d68-81ce-924b93107bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:17.989431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c86c9-60af-4d68-81ce-924b93107bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:17.989712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c86c9-60af-4d68-81ce-924b93107bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:17.989983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c86c9-60af-4d68-81ce-924b93107bd0 admin admin] PATH_INFO: `/v3/projects/0633b6d49a114b248785a1ea4249014b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:17.991118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c86c9-60af-4d68-81ce-924b93107bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0633b6d49a114b248785a1ea4249014b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:17.993043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c86c9-60af-4d68-81ce-924b93107bd0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:18.040708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-084c86c9-60af-4d68-81ce-924b93107bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0633b6d49a114b248785a1ea4249014b', 'request_id': 'req-084c86c9-60af-4d68-81ce-924b93107bd0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:28:18.048544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-084c86c9-60af-4d68-81ce-924b93107bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0633b6d49a114b248785a1ea4249014b', 'request_id': 'req-084c86c9-60af-4d68-81ce-924b93107bd0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:28:18.054112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-084c86c9-60af-4d68-81ce-924b93107bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0633b6d49a114b248785a1ea4249014b', 'request_id': 'req-084c86c9-60af-4d68-81ce-924b93107bd0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:28:18.065680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-084c86c9-60af-4d68-81ce-924b93107bd0 admin admin] The token cache is being invalidate because project 0633b6d49a114b248785a1ea4249014b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:28:18.065965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-084c86c9-60af-4d68-81ce-924b93107bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:28:18.066613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-084c86c9-60af-4d68-81ce-924b93107bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:28:18.068093 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4369/8708] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:28:17 2022] DELETE /identity/v3/projects/0633b6d49a114b248785a1ea4249014b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:28:18.073425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44b12c-94a0-4315-8ed7-12245425d998 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:18.073737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44b12c-94a0-4315-8ed7-12245425d998 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:18.074011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44b12c-94a0-4315-8ed7-12245425d998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:18.094146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2e44b12c-94a0-4315-8ed7-12245425d998 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:28:18.095335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2e44b12c-94a0-4315-8ed7-12245425d998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:28:18.153628 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4340/8709] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:28:18.162501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585e30b-4356-4a19-9c91-46a2d7885a0b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:18.162786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585e30b-4356-4a19-9c91-46a2d7885a0b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:18.163060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585e30b-4356-4a19-9c91-46a2d7885a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:18.183247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d585e30b-4356-4a19-9c91-46a2d7885a0b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:28:18.184362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d585e30b-4356-4a19-9c91-46a2d7885a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:28:18.192092 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4370/8710] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:28:18.196477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44b12c-94a0-4315-8ed7-12245425d998 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:18.207467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44b12c-94a0-4315-8ed7-12245425d998 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:18.212081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13c2b6-5339-4060-b136-33da4c2fee27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:18.212705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13c2b6-5339-4060-b136-33da4c2fee27 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:18.213097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13c2b6-5339-4060-b136-33da4c2fee27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:18.213369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13c2b6-5339-4060-b136-33da4c2fee27 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:18.214039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13c2b6-5339-4060-b136-33da4c2fee27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:28:18.214335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13c2b6-5339-4060-b136-33da4c2fee27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:18.215906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13c2b6-5339-4060-b136-33da4c2fee27 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:18.227436 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4341/8711] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:28:18.231590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585e30b-4356-4a19-9c91-46a2d7885a0b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:18.240708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585e30b-4356-4a19-9c91-46a2d7885a0b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:18.245868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc1282-561a-4955-8c0a-7731432bca4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:18.246448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc1282-561a-4955-8c0a-7731432bca4d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:18.246721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc1282-561a-4955-8c0a-7731432bca4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:18.246988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc1282-561a-4955-8c0a-7731432bca4d admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:18.247643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc1282-561a-4955-8c0a-7731432bca4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:18.249547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc1282-561a-4955-8c0a-7731432bca4d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:18.283433 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4371/8712] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:28:18 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:28:18.286238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13c2b6-5339-4060-b136-33da4c2fee27 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:18.298517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13c2b6-5339-4060-b136-33da4c2fee27 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:18.356217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ee66b-56b5-4ef4-ac9c-80d5b9fc7e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:18.356857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ee66b-56b5-4ef4-ac9c-80d5b9fc7e2b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:18.357136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ee66b-56b5-4ef4-ac9c-80d5b9fc7e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:18.357407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ee66b-56b5-4ef4-ac9c-80d5b9fc7e2b admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:18.358030 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ee66b-56b5-4ef4-ac9c-80d5b9fc7e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:18.359922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ee66b-56b5-4ef4-ac9c-80d5b9fc7e2b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:18.384507 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4342/8713] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:28:18 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:28:18.386886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc1282-561a-4955-8c0a-7731432bca4d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:18.397844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc1282-561a-4955-8c0a-7731432bca4d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:18.404059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa555c-65c4-498c-a886-033e4d632ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:18.404905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa555c-65c4-498c-a886-033e4d632ffd admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:18.405363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa555c-65c4-498c-a886-033e4d632ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:18.405637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa555c-65c4-498c-a886-033e4d632ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:18.406269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa555c-65c4-498c-a886-033e4d632ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:18.407947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa555c-65c4-498c-a886-033e4d632ffd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:18.418269 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4372/8714] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:28:18.422408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ee66b-56b5-4ef4-ac9c-80d5b9fc7e2b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:18.432511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ee66b-56b5-4ef4-ac9c-80d5b9fc7e2b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:18.437222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4aa516-84aa-479a-b5b8-22291d09c131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:18.437849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4aa516-84aa-479a-b5b8-22291d09c131 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:18.438132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4aa516-84aa-479a-b5b8-22291d09c131 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:18.438400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4aa516-84aa-479a-b5b8-22291d09c131 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:18.439061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4aa516-84aa-479a-b5b8-22291d09c131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:18.440651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4aa516-84aa-479a-b5b8-22291d09c131 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:18.452441 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4343/8715] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:28:18.456763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa555c-65c4-498c-a886-033e4d632ffd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:18.467942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa555c-65c4-498c-a886-033e4d632ffd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:18.472731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f3ea8-ba15-46d2-b91c-df6b578ad07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:18.473450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f3ea8-ba15-46d2-b91c-df6b578ad07f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:18.473796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f3ea8-ba15-46d2-b91c-df6b578ad07f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:18.474130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f3ea8-ba15-46d2-b91c-df6b578ad07f admin admin] PATH_INFO: `/v3/projects/d506fa8867af4fb286f5c1f4561ea796/users/f155ecbf8fc84e9a8665bba3bfae9415/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:18.489121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f3ea8-ba15-46d2-b91c-df6b578ad07f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d506fa8867af4fb286f5c1f4561ea796, user_id=f155ecbf8fc84e9a8665bba3bfae9415, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:18.491792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f3ea8-ba15-46d2-b91c-df6b578ad07f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:18.505292 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4373/8716] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:28:18 2022] PUT /identity/v3/projects/d506fa8867af4fb286f5c1f4561ea796/users/f155ecbf8fc84e9a8665bba3bfae9415/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:28:18.511102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e0fa0-625e-4a0a-bc96-10ceed5abdae None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:18.511456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e0fa0-625e-4a0a-bc96-10ceed5abdae None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:18.511799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e0fa0-625e-4a0a-bc96-10ceed5abdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:18.520691 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:28:18.532568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0b8e0fa0-625e-4a0a-bc96-10ceed5abdae None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:28:18.534416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0b8e0fa0-625e-4a0a-bc96-10ceed5abdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:28:18.594335 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4344/8717] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:28:18.604834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f3ea8-ba15-46d2-b91c-df6b578ad07f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:18.606596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0c8f3ea8-ba15-46d2-b91c-df6b578ad07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:28:18.667937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f3ea8-ba15-46d2-b91c-df6b578ad07f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:18.671568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beec168-097c-4a72-8474-46d101d4fb3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:18.672196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beec168-097c-4a72-8474-46d101d4fb3d service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:18.672473 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beec168-097c-4a72-8474-46d101d4fb3d service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:18.672778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beec168-097c-4a72-8474-46d101d4fb3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:18.682591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beec168-097c-4a72-8474-46d101d4fb3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:18.684180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beec168-097c-4a72-8474-46d101d4fb3d service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:18.693780 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4374/8718] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:28:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:28:22.590424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabb8b1-c450-4876-902a-7593a1ecf233 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:22.591032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabb8b1-c450-4876-902a-7593a1ecf233 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:22.591032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabb8b1-c450-4876-902a-7593a1ecf233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:22.624294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fbabb8b1-c450-4876-902a-7593a1ecf233 None None] MFA Rules not processed for user `f155ecbf8fc84e9a8665bba3bfae9415`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:28:22.626072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fbabb8b1-c450-4876-902a-7593a1ecf233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:28:22.714432 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4345/8719] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:28:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:28:22.717252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beec168-097c-4a72-8474-46d101d4fb3d service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:22.722095 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:28:22.729392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beec168-097c-4a72-8474-46d101d4fb3d service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:22.735115 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cd5bb-21e1-49be-9337-5c45953c3fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:22.735898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cd5bb-21e1-49be-9337-5c45953c3fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:22.736828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cd5bb-21e1-49be-9337-5c45953c3fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:22.736828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cd5bb-21e1-49be-9337-5c45953c3fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:22.737299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cd5bb-21e1-49be-9337-5c45953c3fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:22.739797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cd5bb-21e1-49be-9337-5c45953c3fb1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:22.782004 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4375/8720] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:28:22 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:28:22.786191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabb8b1-c450-4876-902a-7593a1ecf233 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:22.798857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabb8b1-c450-4876-902a-7593a1ecf233 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:22.870184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9957497-3336-4e5b-a42b-203e80ed1b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:22.870814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9957497-3336-4e5b-a42b-203e80ed1b46 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:22.871095 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9957497-3336-4e5b-a42b-203e80ed1b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:22.871365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9957497-3336-4e5b-a42b-203e80ed1b46 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:22.872007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9957497-3336-4e5b-a42b-203e80ed1b46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:22.874072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9957497-3336-4e5b-a42b-203e80ed1b46 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:22.898198 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4346/8721] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:28:22 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:28:22.903198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cd5bb-21e1-49be-9337-5c45953c3fb1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:22.922609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cd5bb-21e1-49be-9337-5c45953c3fb1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:22.929728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723f776-3cdb-4377-8c1f-922eaee871df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:22.933647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723f776-3cdb-4377-8c1f-922eaee871df admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:22.934213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723f776-3cdb-4377-8c1f-922eaee871df admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:22.935060 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723f776-3cdb-4377-8c1f-922eaee871df admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:22.935519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723f776-3cdb-4377-8c1f-922eaee871df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:22.937243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723f776-3cdb-4377-8c1f-922eaee871df admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:22.974379 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4376/8722] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:28:22.978426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9957497-3336-4e5b-a42b-203e80ed1b46 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:22.989751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9957497-3336-4e5b-a42b-203e80ed1b46 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:22.994427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530798b-dfa2-4440-8fe7-c58f9de34be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:22.995086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530798b-dfa2-4440-8fe7-c58f9de34be2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:22.995362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530798b-dfa2-4440-8fe7-c58f9de34be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:22.995632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530798b-dfa2-4440-8fe7-c58f9de34be2 admin admin] PATH_INFO: `/v3/projects/1f0e81a64d904910ab1c2632e65ad6c8/users/a4949c849e7d48bcabad01b65aadda60/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:23.020403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530798b-dfa2-4440-8fe7-c58f9de34be2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0e81a64d904910ab1c2632e65ad6c8, user_id=a4949c849e7d48bcabad01b65aadda60, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:23.022997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530798b-dfa2-4440-8fe7-c58f9de34be2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:23.033255 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:28:23.038876 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4347/8723] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:28:22 2022] PUT /identity/v3/projects/1f0e81a64d904910ab1c2632e65ad6c8/users/a4949c849e7d48bcabad01b65aadda60/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:28:23.043076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723f776-3cdb-4377-8c1f-922eaee871df admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:23.053380 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723f776-3cdb-4377-8c1f-922eaee871df admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:23.115956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca136f9c-6338-4b75-9515-1532c7e9c0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:23.116564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca136f9c-6338-4b75-9515-1532c7e9c0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:23.116888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca136f9c-6338-4b75-9515-1532c7e9c0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:23.117157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca136f9c-6338-4b75-9515-1532c7e9c0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:23.117813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca136f9c-6338-4b75-9515-1532c7e9c0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:23.119470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca136f9c-6338-4b75-9515-1532c7e9c0c8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:23.130221 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4377/8724] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:28:23.134382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530798b-dfa2-4440-8fe7-c58f9de34be2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:23.145756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530798b-dfa2-4440-8fe7-c58f9de34be2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:23.150451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9f0f0-b29a-4921-b0f6-f551a16918c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:23.151685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9f0f0-b29a-4921-b0f6-f551a16918c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:23.151953 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9f0f0-b29a-4921-b0f6-f551a16918c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:23.152250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9f0f0-b29a-4921-b0f6-f551a16918c7 admin admin] PATH_INFO: `/v3/projects/1f0e81a64d904910ab1c2632e65ad6c8/users/a4949c849e7d48bcabad01b65aadda60/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:23.154223 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9f0f0-b29a-4921-b0f6-f551a16918c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0e81a64d904910ab1c2632e65ad6c8, user_id=a4949c849e7d48bcabad01b65aadda60, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:23.156870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9f0f0-b29a-4921-b0f6-f551a16918c7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:23.168522 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4348/8725] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:28:23 2022] PUT /identity/v3/projects/1f0e81a64d904910ab1c2632e65ad6c8/users/a4949c849e7d48bcabad01b65aadda60/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:28:25.603277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca136f9c-6338-4b75-9515-1532c7e9c0c8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:25.605696 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ca136f9c-6338-4b75-9515-1532c7e9c0c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:28:25.789840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca136f9c-6338-4b75-9515-1532c7e9c0c8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:25.941299 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:28:25.953525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e9d86-1dce-4082-bc68-3fc52ced3033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:25.954284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e9d86-1dce-4082-bc68-3fc52ced3033 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:25.954610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e9d86-1dce-4082-bc68-3fc52ced3033 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:25.955028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e9d86-1dce-4082-bc68-3fc52ced3033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:25.956963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2f2e9d86-1dce-4082-bc68-3fc52ced3033 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:28:26.035133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e9d86-1dce-4082-bc68-3fc52ced3033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:26.037851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e9d86-1dce-4082-bc68-3fc52ced3033 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:26.050945 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4378/8726] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:28:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:28:27.901650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f296e4-ada6-4a20-89c7-3ac69e63d9da None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:27.902246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f296e4-ada6-4a20-89c7-3ac69e63d9da None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:27.902246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f296e4-ada6-4a20-89c7-3ac69e63d9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:27.932756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-13f296e4-ada6-4a20-89c7-3ac69e63d9da None None] MFA Rules not processed for user `a4949c849e7d48bcabad01b65aadda60`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:28:27.933993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-13f296e4-ada6-4a20-89c7-3ac69e63d9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:28:28.028509 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4349/8727] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:28:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:28:28.042814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e9d86-1dce-4082-bc68-3fc52ced3033 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:28.044617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2f2e9d86-1dce-4082-bc68-3fc52ced3033 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:28:28.062815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e9d86-1dce-4082-bc68-3fc52ced3033 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:28.068662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a267d8-f515-45d7-9279-e035e9fb58c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:28.069274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a267d8-f515-45d7-9279-e035e9fb58c3 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:28.069551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a267d8-f515-45d7-9279-e035e9fb58c3 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:28.069820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a267d8-f515-45d7-9279-e035e9fb58c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:28.079540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a267d8-f515-45d7-9279-e035e9fb58c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:28.081155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a267d8-f515-45d7-9279-e035e9fb58c3 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:28.092593 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4379/8728] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:28:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:28:28.149174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3850bb-1b40-4554-a752-deab015e2ff9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:28.149463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3850bb-1b40-4554-a752-deab015e2ff9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:28.149733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3850bb-1b40-4554-a752-deab015e2ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:28.172535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ec3850bb-1b40-4554-a752-deab015e2ff9 None None] MFA Rules not processed for user `f155ecbf8fc84e9a8665bba3bfae9415`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:28:28.173811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ec3850bb-1b40-4554-a752-deab015e2ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:28:28.261532 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4350/8729] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:28:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:28:38.086996 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=33 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:28:38.242476 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=64,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:28:39.816408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498cba1-36ed-4712-8cbb-2405de9c633a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:39.816889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498cba1-36ed-4712-8cbb-2405de9c633a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:39.817004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498cba1-36ed-4712-8cbb-2405de9c633a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:39.837020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f498cba1-36ed-4712-8cbb-2405de9c633a None None] MFA Rules not processed for user `f155ecbf8fc84e9a8665bba3bfae9415`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:28:39.838162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f498cba1-36ed-4712-8cbb-2405de9c633a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:28:39.845223 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4380/8730] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:28:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:28:42.448624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3850bb-1b40-4554-a752-deab015e2ff9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:28:42.466118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3850bb-1b40-4554-a752-deab015e2ff9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:28:42.471739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fc7cf-b1aa-4f52-81d3-c0971db9f9ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:28:42.472440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fc7cf-b1aa-4f52-81d3-c0971db9f9ec service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:28:42.472818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fc7cf-b1aa-4f52-81d3-c0971db9f9ec service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:28:42.473088 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fc7cf-b1aa-4f52-81d3-c0971db9f9ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:28:42.474975 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3e0fc7cf-b1aa-4f52-81d3-c0971db9f9ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:28:42.542938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fc7cf-b1aa-4f52-81d3-c0971db9f9ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:28:42.544686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fc7cf-b1aa-4f52-81d3-c0971db9f9ec service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:28:42.554840 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4351/8731] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:28:42 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:28:49.831388 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:28:52.550523 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=30 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:29:00.342957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9600e-678c-4a25-8da8-766f3218dbe7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:29:00.343509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9600e-678c-4a25-8da8-766f3218dbe7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:29:00.344504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9600e-678c-4a25-8da8-766f3218dbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:29:00.367213 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-43e9600e-678c-4a25-8da8-766f3218dbe7 None None] MFA Rules not processed for user `b50b27cd8feb4fbabc4a562103fa3d65`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:29:00.368593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-43e9600e-678c-4a25-8da8-766f3218dbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:29:00.380646 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4381/8732] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:29:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:29:08.032782 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fc7cf-b1aa-4f52-81d3-c0971db9f9ec service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:29:08.111028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fc7cf-b1aa-4f52-81d3-c0971db9f9ec service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:29:08.115998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee333698-16d2-4376-b2e5-60fc3fa2ea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:29:08.116682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee333698-16d2-4376-b2e5-60fc3fa2ea11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:29:08.116967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee333698-16d2-4376-b2e5-60fc3fa2ea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:29:08.117242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee333698-16d2-4376-b2e5-60fc3fa2ea11 admin admin] PATH_INFO: `/v3/users/f155ecbf8fc84e9a8665bba3bfae9415` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:29:08.118413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee333698-16d2-4376-b2e5-60fc3fa2ea11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f155ecbf8fc84e9a8665bba3bfae9415)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:29:08.120505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee333698-16d2-4376-b2e5-60fc3fa2ea11 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:29:08.181716 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ee333698-16d2-4376-b2e5-60fc3fa2ea11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f155ecbf8fc84e9a8665bba3bfae9415'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:08.193025 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ee333698-16d2-4376-b2e5-60fc3fa2ea11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f155ecbf8fc84e9a8665bba3bfae9415'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:08.193780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ee333698-16d2-4376-b2e5-60fc3fa2ea11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f155ecbf8fc84e9a8665bba3bfae9415'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:08.211310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ee333698-16d2-4376-b2e5-60fc3fa2ea11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f155ecbf8fc84e9a8665bba3bfae9415'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:08.221485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ee333698-16d2-4376-b2e5-60fc3fa2ea11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f155ecbf8fc84e9a8665bba3bfae9415'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:08.232248 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4352/8733] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:29:08 2022] DELETE /identity/v3/users/f155ecbf8fc84e9a8665bba3bfae9415 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:29:08.465783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9600e-678c-4a25-8da8-766f3218dbe7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:29:08.481480 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9600e-678c-4a25-8da8-766f3218dbe7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:29:08.557128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d5171-8302-4c0f-add9-df9a91afc791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:29:08.558006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d5171-8302-4c0f-add9-df9a91afc791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:29:08.558277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d5171-8302-4c0f-add9-df9a91afc791 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:29:08.558549 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d5171-8302-4c0f-add9-df9a91afc791 admin admin] PATH_INFO: `/v3/projects/d506fa8867af4fb286f5c1f4561ea796` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:29:08.559841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d5171-8302-4c0f-add9-df9a91afc791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d506fa8867af4fb286f5c1f4561ea796)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:29:08.562430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d5171-8302-4c0f-add9-df9a91afc791 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:29:08.633874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e02d5171-8302-4c0f-add9-df9a91afc791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd506fa8867af4fb286f5c1f4561ea796', 'request_id': 'req-e02d5171-8302-4c0f-add9-df9a91afc791'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:08.652832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e02d5171-8302-4c0f-add9-df9a91afc791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd506fa8867af4fb286f5c1f4561ea796', 'request_id': 'req-e02d5171-8302-4c0f-add9-df9a91afc791'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:08.674486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e02d5171-8302-4c0f-add9-df9a91afc791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd506fa8867af4fb286f5c1f4561ea796', 'request_id': 'req-e02d5171-8302-4c0f-add9-df9a91afc791'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:08.688175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e02d5171-8302-4c0f-add9-df9a91afc791 admin admin] The token cache is being invalidate because project d506fa8867af4fb286f5c1f4561ea796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:29:08.688469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e02d5171-8302-4c0f-add9-df9a91afc791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:08.689165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e02d5171-8302-4c0f-add9-df9a91afc791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:08.690692 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4382/8734] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:29:08 2022] DELETE /identity/v3/projects/d506fa8867af4fb286f5c1f4561ea796 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:29:08.694727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee333698-16d2-4376-b2e5-60fc3fa2ea11 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:29:08.696254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ee333698-16d2-4376-b2e5-60fc3fa2ea11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:29:08.710889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee333698-16d2-4376-b2e5-60fc3fa2ea11 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:29:08.775120 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a143e54-12bf-40b6-b58f-e2bafffb54b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:29:08.775813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a143e54-12bf-40b6-b58f-e2bafffb54b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:29:08.776769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a143e54-12bf-40b6-b58f-e2bafffb54b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:29:08.777435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a143e54-12bf-40b6-b58f-e2bafffb54b4 admin admin] PATH_INFO: `/v3/users/a4949c849e7d48bcabad01b65aadda60` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:29:08.778359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a143e54-12bf-40b6-b58f-e2bafffb54b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4949c849e7d48bcabad01b65aadda60)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:29:08.780313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a143e54-12bf-40b6-b58f-e2bafffb54b4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:29:08.806623 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:29:08.838097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7a143e54-12bf-40b6-b58f-e2bafffb54b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4949c849e7d48bcabad01b65aadda60'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:08.847103 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7a143e54-12bf-40b6-b58f-e2bafffb54b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4949c849e7d48bcabad01b65aadda60'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:08.847819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7a143e54-12bf-40b6-b58f-e2bafffb54b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4949c849e7d48bcabad01b65aadda60'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:08.867114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7a143e54-12bf-40b6-b58f-e2bafffb54b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4949c849e7d48bcabad01b65aadda60'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:08.875288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7a143e54-12bf-40b6-b58f-e2bafffb54b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4949c849e7d48bcabad01b65aadda60'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:08.882249 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4353/8735] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:29:08 2022] DELETE /identity/v3/users/a4949c849e7d48bcabad01b65aadda60 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:29:09.063862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d5171-8302-4c0f-add9-df9a91afc791 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:29:09.065437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e02d5171-8302-4c0f-add9-df9a91afc791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:29:09.081432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d5171-8302-4c0f-add9-df9a91afc791 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:29:09.145933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dedfdf-18a8-4bd7-9beb-5d8977859062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:29:09.146703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dedfdf-18a8-4bd7-9beb-5d8977859062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:29:09.146984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dedfdf-18a8-4bd7-9beb-5d8977859062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:29:09.147253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dedfdf-18a8-4bd7-9beb-5d8977859062 admin admin] PATH_INFO: `/v3/projects/1f0e81a64d904910ab1c2632e65ad6c8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:29:09.148374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dedfdf-18a8-4bd7-9beb-5d8977859062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f0e81a64d904910ab1c2632e65ad6c8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:29:09.150301 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dedfdf-18a8-4bd7-9beb-5d8977859062 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:29:09.184192 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:29:09.202416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a5dedfdf-18a8-4bd7-9beb-5d8977859062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f0e81a64d904910ab1c2632e65ad6c8', 'request_id': 'req-a5dedfdf-18a8-4bd7-9beb-5d8977859062'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:09.210047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a5dedfdf-18a8-4bd7-9beb-5d8977859062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f0e81a64d904910ab1c2632e65ad6c8', 'request_id': 'req-a5dedfdf-18a8-4bd7-9beb-5d8977859062'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:09.217710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a5dedfdf-18a8-4bd7-9beb-5d8977859062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f0e81a64d904910ab1c2632e65ad6c8', 'request_id': 'req-a5dedfdf-18a8-4bd7-9beb-5d8977859062'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:09.229369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a5dedfdf-18a8-4bd7-9beb-5d8977859062 admin admin] The token cache is being invalidate because project 1f0e81a64d904910ab1c2632e65ad6c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:29:09.229826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a5dedfdf-18a8-4bd7-9beb-5d8977859062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:09.230563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a5dedfdf-18a8-4bd7-9beb-5d8977859062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:09.232633 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4383/8736] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:29:09 2022] DELETE /identity/v3/projects/1f0e81a64d904910ab1c2632e65ad6c8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:29:15.995172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a143e54-12bf-40b6-b58f-e2bafffb54b4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:29:15.997106 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7a143e54-12bf-40b6-b58f-e2bafffb54b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:29:16.081212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a143e54-12bf-40b6-b58f-e2bafffb54b4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:29:16.171252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084d757-898f-4fb5-8f8e-98d90183342a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:29:16.172018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084d757-898f-4fb5-8f8e-98d90183342a service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:29:16.172310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084d757-898f-4fb5-8f8e-98d90183342a service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:29:16.173014 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084d757-898f-4fb5-8f8e-98d90183342a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:29:16.174681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a084d757-898f-4fb5-8f8e-98d90183342a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:29:16.268058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084d757-898f-4fb5-8f8e-98d90183342a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:29:16.269538 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084d757-898f-4fb5-8f8e-98d90183342a service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:29:16.290168 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4354/8737] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:29:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:29:16.516515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dedfdf-18a8-4bd7-9beb-5d8977859062 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:29:16.522044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a5dedfdf-18a8-4bd7-9beb-5d8977859062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:29:16.544729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dedfdf-18a8-4bd7-9beb-5d8977859062 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:29:16.552833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4743d-2235-4b72-9a04-1d9fe050fb61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:29:16.553482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4743d-2235-4b72-9a04-1d9fe050fb61 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:29:16.553795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4743d-2235-4b72-9a04-1d9fe050fb61 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:29:16.554946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4743d-2235-4b72-9a04-1d9fe050fb61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:29:16.556893 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9df4743d-2235-4b72-9a04-1d9fe050fb61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:29:16.585599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4743d-2235-4b72-9a04-1d9fe050fb61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:29:16.587796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4743d-2235-4b72-9a04-1d9fe050fb61 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:29:16.607210 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4384/8738] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:29:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:29:24.811342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084d757-898f-4fb5-8f8e-98d90183342a service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:29:24.812860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a084d757-898f-4fb5-8f8e-98d90183342a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:29:24.822476 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:29:24.826861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084d757-898f-4fb5-8f8e-98d90183342a service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:29:24.832652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecf6fe-a9b8-4468-a4d8-bbf09321ad1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:29:24.833282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecf6fe-a9b8-4468-a4d8-bbf09321ad1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:29:24.833836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecf6fe-a9b8-4468-a4d8-bbf09321ad1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:29:24.834166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecf6fe-a9b8-4468-a4d8-bbf09321ad1c admin admin] PATH_INFO: `/v3/users/45a25acf184b4bfc9f1b06dcf0e6d81b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:29:24.835863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ecf6fe-a9b8-4468-a4d8-bbf09321ad1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=45a25acf184b4bfc9f1b06dcf0e6d81b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:29:24.837882 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ecf6fe-a9b8-4468-a4d8-bbf09321ad1c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:29:24.885701 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c3ecf6fe-a9b8-4468-a4d8-bbf09321ad1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45a25acf184b4bfc9f1b06dcf0e6d81b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:24.893058 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c3ecf6fe-a9b8-4468-a4d8-bbf09321ad1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45a25acf184b4bfc9f1b06dcf0e6d81b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:24.893687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c3ecf6fe-a9b8-4468-a4d8-bbf09321ad1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45a25acf184b4bfc9f1b06dcf0e6d81b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:24.907215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c3ecf6fe-a9b8-4468-a4d8-bbf09321ad1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45a25acf184b4bfc9f1b06dcf0e6d81b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:24.924296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c3ecf6fe-a9b8-4468-a4d8-bbf09321ad1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45a25acf184b4bfc9f1b06dcf0e6d81b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:24.930565 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4355/8739] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:29:24 2022] DELETE /identity/v3/users/45a25acf184b4bfc9f1b06dcf0e6d81b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:29:25.106228 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4743d-2235-4b72-9a04-1d9fe050fb61 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:29:25.118438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4743d-2235-4b72-9a04-1d9fe050fb61 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:29:25.180411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400ba9d-897e-468c-a2da-2a35c6e0dd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:29:25.181073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400ba9d-897e-468c-a2da-2a35c6e0dd30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:29:25.181354 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400ba9d-897e-468c-a2da-2a35c6e0dd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:29:25.181629 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400ba9d-897e-468c-a2da-2a35c6e0dd30 admin admin] PATH_INFO: `/v3/projects/7f28caf080c1463fb5b7de2902f9a4b5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:29:25.182906 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400ba9d-897e-468c-a2da-2a35c6e0dd30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f28caf080c1463fb5b7de2902f9a4b5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:29:25.184999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400ba9d-897e-468c-a2da-2a35c6e0dd30 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:29:25.231896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1400ba9d-897e-468c-a2da-2a35c6e0dd30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f28caf080c1463fb5b7de2902f9a4b5', 'request_id': 'req-1400ba9d-897e-468c-a2da-2a35c6e0dd30'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:25.239231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1400ba9d-897e-468c-a2da-2a35c6e0dd30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f28caf080c1463fb5b7de2902f9a4b5', 'request_id': 'req-1400ba9d-897e-468c-a2da-2a35c6e0dd30'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:25.245105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1400ba9d-897e-468c-a2da-2a35c6e0dd30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f28caf080c1463fb5b7de2902f9a4b5', 'request_id': 'req-1400ba9d-897e-468c-a2da-2a35c6e0dd30'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:25.256217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1400ba9d-897e-468c-a2da-2a35c6e0dd30 admin admin] The token cache is being invalidate because project 7f28caf080c1463fb5b7de2902f9a4b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:29:25.256506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1400ba9d-897e-468c-a2da-2a35c6e0dd30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:25.257168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1400ba9d-897e-468c-a2da-2a35c6e0dd30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:25.258642 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4385/8740] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:29:25 2022] DELETE /identity/v3/projects/7f28caf080c1463fb5b7de2902f9a4b5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:29:25.263248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecf6fe-a9b8-4468-a4d8-bbf09321ad1c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:29:25.264687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c3ecf6fe-a9b8-4468-a4d8-bbf09321ad1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:29:25.278821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecf6fe-a9b8-4468-a4d8-bbf09321ad1c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:29:25.335868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a66a2-9aef-4962-9e1a-ed6901b35009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:29:25.336502 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a66a2-9aef-4962-9e1a-ed6901b35009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:29:25.336835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a66a2-9aef-4962-9e1a-ed6901b35009 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:29:25.337113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a66a2-9aef-4962-9e1a-ed6901b35009 admin admin] PATH_INFO: `/v3/users/05df9e9246ef4678a32b0b1a796a448b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:29:25.351010 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a66a2-9aef-4962-9e1a-ed6901b35009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05df9e9246ef4678a32b0b1a796a448b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:29:25.353008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a66a2-9aef-4962-9e1a-ed6901b35009 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:29:25.397686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b88a66a2-9aef-4962-9e1a-ed6901b35009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05df9e9246ef4678a32b0b1a796a448b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:25.405700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b88a66a2-9aef-4962-9e1a-ed6901b35009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05df9e9246ef4678a32b0b1a796a448b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:25.406321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b88a66a2-9aef-4962-9e1a-ed6901b35009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05df9e9246ef4678a32b0b1a796a448b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:25.416500 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:29:25.418852 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b88a66a2-9aef-4962-9e1a-ed6901b35009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05df9e9246ef4678a32b0b1a796a448b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:25.426653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b88a66a2-9aef-4962-9e1a-ed6901b35009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05df9e9246ef4678a32b0b1a796a448b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:25.432886 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4356/8741] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:29:25 2022] DELETE /identity/v3/users/05df9e9246ef4678a32b0b1a796a448b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:29:25.606894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400ba9d-897e-468c-a2da-2a35c6e0dd30 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:29:25.608428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1400ba9d-897e-468c-a2da-2a35c6e0dd30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:29:25.622565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400ba9d-897e-468c-a2da-2a35c6e0dd30 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:29:25.655798 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:29:25.685287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40333197-9c3f-4d31-8c53-9483cad50230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:29:25.686067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40333197-9c3f-4d31-8c53-9483cad50230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:29:25.686341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40333197-9c3f-4d31-8c53-9483cad50230 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:29:25.686611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40333197-9c3f-4d31-8c53-9483cad50230 admin admin] PATH_INFO: `/v3/projects/1e5ffbc47c1f403699795e08c2b17f09` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:29:25.697194 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40333197-9c3f-4d31-8c53-9483cad50230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e5ffbc47c1f403699795e08c2b17f09)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:29:25.699720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40333197-9c3f-4d31-8c53-9483cad50230 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:29:25.746285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-40333197-9c3f-4d31-8c53-9483cad50230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e5ffbc47c1f403699795e08c2b17f09', 'request_id': 'req-40333197-9c3f-4d31-8c53-9483cad50230'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:25.753360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-40333197-9c3f-4d31-8c53-9483cad50230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e5ffbc47c1f403699795e08c2b17f09', 'request_id': 'req-40333197-9c3f-4d31-8c53-9483cad50230'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:25.759094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-40333197-9c3f-4d31-8c53-9483cad50230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e5ffbc47c1f403699795e08c2b17f09', 'request_id': 'req-40333197-9c3f-4d31-8c53-9483cad50230'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:25.771258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-40333197-9c3f-4d31-8c53-9483cad50230 admin admin] The token cache is being invalidate because project 1e5ffbc47c1f403699795e08c2b17f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:29:25.771540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-40333197-9c3f-4d31-8c53-9483cad50230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:25.772159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-40333197-9c3f-4d31-8c53-9483cad50230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:29:25.773666 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4386/8742] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:29:25 2022] DELETE /identity/v3/projects/1e5ffbc47c1f403699795e08c2b17f09 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:29:35.429409 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=1,keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:29:35.768251 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:29:53.043449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a66a2-9aef-4962-9e1a-ed6901b35009 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:29:53.045125 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b88a66a2-9aef-4962-9e1a-ed6901b35009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:29:53.120489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a66a2-9aef-4962-9e1a-ed6901b35009 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:29:53.188546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058ff03-6e47-4a60-88f8-4a7e65984963 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:29:53.189099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058ff03-6e47-4a60-88f8-4a7e65984963 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:29:53.189377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058ff03-6e47-4a60-88f8-4a7e65984963 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:29:53.189660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058ff03-6e47-4a60-88f8-4a7e65984963 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:29:53.191368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1058ff03-6e47-4a60-88f8-4a7e65984963 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:29:53.248384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058ff03-6e47-4a60-88f8-4a7e65984963 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:29:53.250084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058ff03-6e47-4a60-88f8-4a7e65984963 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:29:53.259123 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4357/8743] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:29:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:29:56.319782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40333197-9c3f-4d31-8c53-9483cad50230 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:29:56.321278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-40333197-9c3f-4d31-8c53-9483cad50230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:29:56.380436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40333197-9c3f-4d31-8c53-9483cad50230 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:29:56.384039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c5803-87a7-447a-b50a-dfe37714a95b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:29:56.384659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c5803-87a7-447a-b50a-dfe37714a95b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:29:56.384939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c5803-87a7-447a-b50a-dfe37714a95b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:29:56.385319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c5803-87a7-447a-b50a-dfe37714a95b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:29:56.387030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-008c5803-87a7-447a-b50a-dfe37714a95b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:29:56.453039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c5803-87a7-447a-b50a-dfe37714a95b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:29:56.454494 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c5803-87a7-447a-b50a-dfe37714a95b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:29:56.464271 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4387/8744] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:29:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:30:02.693686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058ff03-6e47-4a60-88f8-4a7e65984963 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:02.695645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1058ff03-6e47-4a60-88f8-4a7e65984963 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:02.709557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058ff03-6e47-4a60-88f8-4a7e65984963 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:02.714413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810febb-1230-40b0-95c3-765e3ce82a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:02.715036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810febb-1230-40b0-95c3-765e3ce82a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:02.715385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810febb-1230-40b0-95c3-765e3ce82a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:02.715666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810febb-1230-40b0-95c3-765e3ce82a9a admin admin] PATH_INFO: `/v3/users/61fa09fe56b64eb69666368a5b423768` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:02.716905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810febb-1230-40b0-95c3-765e3ce82a9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=61fa09fe56b64eb69666368a5b423768)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:02.718814 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810febb-1230-40b0-95c3-765e3ce82a9a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:02.758315 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:30:02.774228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a810febb-1230-40b0-95c3-765e3ce82a9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61fa09fe56b64eb69666368a5b423768'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:30:02.782224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a810febb-1230-40b0-95c3-765e3ce82a9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61fa09fe56b64eb69666368a5b423768'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:30:02.783008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a810febb-1230-40b0-95c3-765e3ce82a9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61fa09fe56b64eb69666368a5b423768'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:30:02.797198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a810febb-1230-40b0-95c3-765e3ce82a9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61fa09fe56b64eb69666368a5b423768'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:30:02.804222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a810febb-1230-40b0-95c3-765e3ce82a9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61fa09fe56b64eb69666368a5b423768'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:30:02.810765 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4358/8745] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:30:02 2022] DELETE /identity/v3/users/61fa09fe56b64eb69666368a5b423768 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:30:02.983517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c5803-87a7-447a-b50a-dfe37714a95b service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:02.995333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c5803-87a7-447a-b50a-dfe37714a95b service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:03.054872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bd322-e91f-47ca-b3cf-257fb652a284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:03.055501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bd322-e91f-47ca-b3cf-257fb652a284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:03.055780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bd322-e91f-47ca-b3cf-257fb652a284 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:03.056051 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bd322-e91f-47ca-b3cf-257fb652a284 admin admin] PATH_INFO: `/v3/projects/b3adf0621b1542549f09feca49de3b50` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:03.057188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bd322-e91f-47ca-b3cf-257fb652a284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3adf0621b1542549f09feca49de3b50)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:03.059075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bd322-e91f-47ca-b3cf-257fb652a284 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:03.105839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d3bd322-e91f-47ca-b3cf-257fb652a284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3adf0621b1542549f09feca49de3b50', 'request_id': 'req-9d3bd322-e91f-47ca-b3cf-257fb652a284'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:30:03.109365 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:30:03.114817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d3bd322-e91f-47ca-b3cf-257fb652a284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3adf0621b1542549f09feca49de3b50', 'request_id': 'req-9d3bd322-e91f-47ca-b3cf-257fb652a284'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:30:03.121596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d3bd322-e91f-47ca-b3cf-257fb652a284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3adf0621b1542549f09feca49de3b50', 'request_id': 'req-9d3bd322-e91f-47ca-b3cf-257fb652a284'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:30:03.133084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d3bd322-e91f-47ca-b3cf-257fb652a284 admin admin] The token cache is being invalidate because project b3adf0621b1542549f09feca49de3b50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:30:03.133374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d3bd322-e91f-47ca-b3cf-257fb652a284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:30:03.134039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d3bd322-e91f-47ca-b3cf-257fb652a284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:30:03.135523 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4388/8746] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:30:02 2022] DELETE /identity/v3/projects/b3adf0621b1542549f09feca49de3b50 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:30:03.143355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810febb-1230-40b0-95c3-765e3ce82a9a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:03.144898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a810febb-1230-40b0-95c3-765e3ce82a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:03.158546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810febb-1230-40b0-95c3-765e3ce82a9a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:03.217985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e434769-8a49-401d-8730-1fb26b99ee02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:03.218536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e434769-8a49-401d-8730-1fb26b99ee02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:03.218815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e434769-8a49-401d-8730-1fb26b99ee02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:03.219087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e434769-8a49-401d-8730-1fb26b99ee02 admin admin] PATH_INFO: `/v3/users/d3cd91cc9fd64567803fdb391a3d98e0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:03.220210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e434769-8a49-401d-8730-1fb26b99ee02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3cd91cc9fd64567803fdb391a3d98e0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:03.222158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e434769-8a49-401d-8730-1fb26b99ee02 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:03.268574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3e434769-8a49-401d-8730-1fb26b99ee02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3cd91cc9fd64567803fdb391a3d98e0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:30:03.276398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3e434769-8a49-401d-8730-1fb26b99ee02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3cd91cc9fd64567803fdb391a3d98e0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:30:03.277145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3e434769-8a49-401d-8730-1fb26b99ee02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3cd91cc9fd64567803fdb391a3d98e0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:30:03.291668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3e434769-8a49-401d-8730-1fb26b99ee02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3cd91cc9fd64567803fdb391a3d98e0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:30:03.299389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3e434769-8a49-401d-8730-1fb26b99ee02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3cd91cc9fd64567803fdb391a3d98e0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:30:03.305231 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4359/8747] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:30:03 2022] DELETE /identity/v3/users/d3cd91cc9fd64567803fdb391a3d98e0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:30:03.478660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bd322-e91f-47ca-b3cf-257fb652a284 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:03.480109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9d3bd322-e91f-47ca-b3cf-257fb652a284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:03.493689 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bd322-e91f-47ca-b3cf-257fb652a284 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:03.552334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45774d-96c4-427e-aa91-bbbe7109b21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:03.553031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45774d-96c4-427e-aa91-bbbe7109b21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:03.553316 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45774d-96c4-427e-aa91-bbbe7109b21b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:03.553594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45774d-96c4-427e-aa91-bbbe7109b21b admin admin] PATH_INFO: `/v3/projects/6c31282b66234c97ade76d3eed02186a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:03.554860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45774d-96c4-427e-aa91-bbbe7109b21b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c31282b66234c97ade76d3eed02186a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:03.556834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45774d-96c4-427e-aa91-bbbe7109b21b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:03.604416 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ef45774d-96c4-427e-aa91-bbbe7109b21b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c31282b66234c97ade76d3eed02186a', 'request_id': 'req-ef45774d-96c4-427e-aa91-bbbe7109b21b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:30:03.612741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ef45774d-96c4-427e-aa91-bbbe7109b21b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c31282b66234c97ade76d3eed02186a', 'request_id': 'req-ef45774d-96c4-427e-aa91-bbbe7109b21b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:30:03.618540 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ef45774d-96c4-427e-aa91-bbbe7109b21b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c31282b66234c97ade76d3eed02186a', 'request_id': 'req-ef45774d-96c4-427e-aa91-bbbe7109b21b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:30:03.630202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ef45774d-96c4-427e-aa91-bbbe7109b21b admin admin] The token cache is being invalidate because project 6c31282b66234c97ade76d3eed02186a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:30:03.630484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ef45774d-96c4-427e-aa91-bbbe7109b21b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:30:03.631184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ef45774d-96c4-427e-aa91-bbbe7109b21b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:30:03.632886 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4389/8748] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:30:03 2022] DELETE /identity/v3/projects/6c31282b66234c97ade76d3eed02186a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:30:03.638016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277f9fc-9e34-4bb4-8417-d6f9e8fb58b1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:03.638327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277f9fc-9e34-4bb4-8417-d6f9e8fb58b1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:03.638602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277f9fc-9e34-4bb4-8417-d6f9e8fb58b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:03.659436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f277f9fc-9e34-4bb4-8417-d6f9e8fb58b1 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:30:03.660670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f277f9fc-9e34-4bb4-8417-d6f9e8fb58b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:03.682095 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:30:03.723861 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4360/8749] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:30:03.850358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65fac6-54ba-49b0-962a-93fd25ed24f9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:03.850641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65fac6-54ba-49b0-962a-93fd25ed24f9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:03.850917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65fac6-54ba-49b0-962a-93fd25ed24f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:03.876538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5c65fac6-54ba-49b0-962a-93fd25ed24f9 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:30:03.877760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5c65fac6-54ba-49b0-962a-93fd25ed24f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:03.885575 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4390/8750] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:30:03.891259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277f9fc-9e34-4bb4-8417-d6f9e8fb58b1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:03.901182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277f9fc-9e34-4bb4-8417-d6f9e8fb58b1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:03.906835 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea72e1-dd33-4739-98a9-a772b11c0e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:03.907432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea72e1-dd33-4739-98a9-a772b11c0e21 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:03.907714 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea72e1-dd33-4739-98a9-a772b11c0e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:03.907990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea72e1-dd33-4739-98a9-a772b11c0e21 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:03.908684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea72e1-dd33-4739-98a9-a772b11c0e21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:30:03.908974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea72e1-dd33-4739-98a9-a772b11c0e21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:03.910565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea72e1-dd33-4739-98a9-a772b11c0e21 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:03.924672 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4361/8751] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:30:03.928466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65fac6-54ba-49b0-962a-93fd25ed24f9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:03.937867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65fac6-54ba-49b0-962a-93fd25ed24f9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:03.942462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc41f1-7eef-42f5-be92-e4e578849a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:03.943074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc41f1-7eef-42f5-be92-e4e578849a6e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:03.943352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc41f1-7eef-42f5-be92-e4e578849a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:03.943624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc41f1-7eef-42f5-be92-e4e578849a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:03.944252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc41f1-7eef-42f5-be92-e4e578849a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:03.946196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc41f1-7eef-42f5-be92-e4e578849a6e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:03.975393 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4391/8752] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:30:03 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:30:03.979402 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea72e1-dd33-4739-98a9-a772b11c0e21 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:03.990333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea72e1-dd33-4739-98a9-a772b11c0e21 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:04.046845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15653f3b-3d02-46b5-b2db-fe08941061ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:04.047448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15653f3b-3d02-46b5-b2db-fe08941061ce admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:04.047724 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15653f3b-3d02-46b5-b2db-fe08941061ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:04.047996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15653f3b-3d02-46b5-b2db-fe08941061ce admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:04.048646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15653f3b-3d02-46b5-b2db-fe08941061ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:04.050534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15653f3b-3d02-46b5-b2db-fe08941061ce admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:04.071510 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4362/8753] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:30:03 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:30:04.076502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc41f1-7eef-42f5-be92-e4e578849a6e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:04.087443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc41f1-7eef-42f5-be92-e4e578849a6e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:04.092971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9d317-c60b-4528-93e3-548861171f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:04.093584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9d317-c60b-4528-93e3-548861171f3b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:04.093862 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9d317-c60b-4528-93e3-548861171f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:04.094125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9d317-c60b-4528-93e3-548861171f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:04.094756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9d317-c60b-4528-93e3-548861171f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:04.096331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9d317-c60b-4528-93e3-548861171f3b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:04.107844 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4392/8754] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 10:30:04.111974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15653f3b-3d02-46b5-b2db-fe08941061ce admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:04.121869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15653f3b-3d02-46b5-b2db-fe08941061ce admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:04.126410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146bca5-b8f3-4e15-a98a-61035944045a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:04.126994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146bca5-b8f3-4e15-a98a-61035944045a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:04.127275 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146bca5-b8f3-4e15-a98a-61035944045a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:04.127541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146bca5-b8f3-4e15-a98a-61035944045a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:04.128167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146bca5-b8f3-4e15-a98a-61035944045a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:04.129754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146bca5-b8f3-4e15-a98a-61035944045a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:04.140684 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4363/8755] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:30:04.144822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9d317-c60b-4528-93e3-548861171f3b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:04.158404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9d317-c60b-4528-93e3-548861171f3b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:04.163077 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d424da5-f461-4e08-9706-760202428d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:04.163721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d424da5-f461-4e08-9706-760202428d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:04.163997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d424da5-f461-4e08-9706-760202428d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:04.164264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d424da5-f461-4e08-9706-760202428d23 admin admin] PATH_INFO: `/v3/projects/12161f59839745f78de94560d7ca63f7/users/9c1a3025bb6e4099932d629436c79b1a/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:04.180029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d424da5-f461-4e08-9706-760202428d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12161f59839745f78de94560d7ca63f7, user_id=9c1a3025bb6e4099932d629436c79b1a, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:04.182709 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d424da5-f461-4e08-9706-760202428d23 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:04.196095 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4393/8756] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:30:04 2022] PUT /identity/v3/projects/12161f59839745f78de94560d7ca63f7/users/9c1a3025bb6e4099932d629436c79b1a/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:30:04.201775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b99d1-1e12-4e7d-a530-693ad37dba80 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:04.202060 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b99d1-1e12-4e7d-a530-693ad37dba80 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:04.202335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b99d1-1e12-4e7d-a530-693ad37dba80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:04.222575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fa8b99d1-1e12-4e7d-a530-693ad37dba80 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:30:04.223777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fa8b99d1-1e12-4e7d-a530-693ad37dba80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:04.282432 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4364/8757] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:30:04.293743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d424da5-f461-4e08-9706-760202428d23 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:04.295379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1d424da5-f461-4e08-9706-760202428d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:04.305345 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:30:04.357698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d424da5-f461-4e08-9706-760202428d23 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:04.361309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9f653-30e6-4367-a885-e0ba6744b777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:04.361902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9f653-30e6-4367-a885-e0ba6744b777 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:04.362178 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9f653-30e6-4367-a885-e0ba6744b777 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:04.362448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9f653-30e6-4367-a885-e0ba6744b777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:04.371242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9f653-30e6-4367-a885-e0ba6744b777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:04.372796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9f653-30e6-4367-a885-e0ba6744b777 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:04.381941 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4394/8758] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:30:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:30:08.592338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75b472-60ad-4e26-b31a-7ea92971049d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:08.592941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75b472-60ad-4e26-b31a-7ea92971049d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:08.592941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75b472-60ad-4e26-b31a-7ea92971049d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:08.633437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fa75b472-60ad-4e26-b31a-7ea92971049d None None] MFA Rules not processed for user `9c1a3025bb6e4099932d629436c79b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:30:08.634702 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fa75b472-60ad-4e26-b31a-7ea92971049d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:08.661767 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:30:08.719185 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4365/8759] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:30:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:30:08.723713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9f653-30e6-4367-a885-e0ba6744b777 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:08.734107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9f653-30e6-4367-a885-e0ba6744b777 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:08.739295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912752b-a312-44c9-9218-7885c109fe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:08.739904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912752b-a312-44c9-9218-7885c109fe0b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:08.740468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912752b-a312-44c9-9218-7885c109fe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:08.740468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912752b-a312-44c9-9218-7885c109fe0b admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:08.741111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912752b-a312-44c9-9218-7885c109fe0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:08.743010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912752b-a312-44c9-9218-7885c109fe0b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:08.777103 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4395/8760] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:30:08 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:30:08.779307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75b472-60ad-4e26-b31a-7ea92971049d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:08.795677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75b472-60ad-4e26-b31a-7ea92971049d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:08.855194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355a757-3ba5-4273-8f9d-a54249aeadcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:08.855806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355a757-3ba5-4273-8f9d-a54249aeadcb admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:08.856150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355a757-3ba5-4273-8f9d-a54249aeadcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:08.856427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355a757-3ba5-4273-8f9d-a54249aeadcb admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:08.857184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355a757-3ba5-4273-8f9d-a54249aeadcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:08.859089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355a757-3ba5-4273-8f9d-a54249aeadcb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:08.886557 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4366/8761] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:30:08 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:30:08.888241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912752b-a312-44c9-9218-7885c109fe0b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:08.898663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912752b-a312-44c9-9218-7885c109fe0b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:08.904013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98073222-8c07-45de-83d7-d111fc268760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:08.904636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98073222-8c07-45de-83d7-d111fc268760 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:08.904920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98073222-8c07-45de-83d7-d111fc268760 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:08.905191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98073222-8c07-45de-83d7-d111fc268760 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:08.905823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98073222-8c07-45de-83d7-d111fc268760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:08.907787 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98073222-8c07-45de-83d7-d111fc268760 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:08.919714 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4396/8762] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:30:08.923719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355a757-3ba5-4273-8f9d-a54249aeadcb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:08.935000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355a757-3ba5-4273-8f9d-a54249aeadcb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:08.939636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f2c42-5bb8-4b7a-a6bc-3229f0ec0004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:08.940314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f2c42-5bb8-4b7a-a6bc-3229f0ec0004 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:08.940590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f2c42-5bb8-4b7a-a6bc-3229f0ec0004 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:08.941464 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f2c42-5bb8-4b7a-a6bc-3229f0ec0004 admin admin] PATH_INFO: `/v3/projects/8592dbb698514719864acd06c03bf9fc/users/23e3d5fd8a404655882b8a2d0e321e1c/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:08.958549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f2c42-5bb8-4b7a-a6bc-3229f0ec0004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8592dbb698514719864acd06c03bf9fc, user_id=23e3d5fd8a404655882b8a2d0e321e1c, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:08.961436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f2c42-5bb8-4b7a-a6bc-3229f0ec0004 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:08.978977 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4367/8763] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:30:08 2022] PUT /identity/v3/projects/8592dbb698514719864acd06c03bf9fc/users/23e3d5fd8a404655882b8a2d0e321e1c/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:30:08.980118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98073222-8c07-45de-83d7-d111fc268760 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:08.990834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98073222-8c07-45de-83d7-d111fc268760 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:09.053938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54916c20-63cb-4c4b-b87a-24a8f950536a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:09.054543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54916c20-63cb-4c4b-b87a-24a8f950536a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:09.054823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54916c20-63cb-4c4b-b87a-24a8f950536a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:09.055094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54916c20-63cb-4c4b-b87a-24a8f950536a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:09.055729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54916c20-63cb-4c4b-b87a-24a8f950536a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:09.057331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54916c20-63cb-4c4b-b87a-24a8f950536a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:09.067906 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4397/8764] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:30:09.072156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f2c42-5bb8-4b7a-a6bc-3229f0ec0004 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:09.082446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f2c42-5bb8-4b7a-a6bc-3229f0ec0004 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:09.086980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f2127-0347-4e9a-9733-2f1d53285f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:09.087865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f2127-0347-4e9a-9733-2f1d53285f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:09.088139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f2127-0347-4e9a-9733-2f1d53285f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:09.088409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f2127-0347-4e9a-9733-2f1d53285f36 admin admin] PATH_INFO: `/v3/projects/8592dbb698514719864acd06c03bf9fc/users/23e3d5fd8a404655882b8a2d0e321e1c/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:09.090313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f2127-0347-4e9a-9733-2f1d53285f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8592dbb698514719864acd06c03bf9fc, user_id=23e3d5fd8a404655882b8a2d0e321e1c, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:09.094483 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f2127-0347-4e9a-9733-2f1d53285f36 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:09.105020 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4368/8765] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:30:09 2022] PUT /identity/v3/projects/8592dbb698514719864acd06c03bf9fc/users/23e3d5fd8a404655882b8a2d0e321e1c/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:30:13.755129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99967703-ffa5-446e-89cb-e409d5fe4b88 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:13.756231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99967703-ffa5-446e-89cb-e409d5fe4b88 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:13.756732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99967703-ffa5-446e-89cb-e409d5fe4b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:13.803964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-99967703-ffa5-446e-89cb-e409d5fe4b88 None None] MFA Rules not processed for user `23e3d5fd8a404655882b8a2d0e321e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:30:13.805726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-99967703-ffa5-446e-89cb-e409d5fe4b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:13.885919 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:30:13.892234 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4398/8766] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:30:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:30:13.905302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f2127-0347-4e9a-9733-2f1d53285f36 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:13.907277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-537f2127-0347-4e9a-9733-2f1d53285f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:14.012965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f2127-0347-4e9a-9733-2f1d53285f36 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:14.016956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b8618-017a-4104-a26a-2dabc91b15a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:14.017698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b8618-017a-4104-a26a-2dabc91b15a9 service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:14.018042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b8618-017a-4104-a26a-2dabc91b15a9 service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:14.018377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b8618-017a-4104-a26a-2dabc91b15a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:14.037372 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:30:14.082154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b8618-017a-4104-a26a-2dabc91b15a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:14.083630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b8618-017a-4104-a26a-2dabc91b15a9 service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:14.094632 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4369/8767] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:30:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:30:17.942025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2df966-8c89-4db4-9daf-53bfd024e0a7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:17.942025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2df966-8c89-4db4-9daf-53bfd024e0a7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:17.942025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2df966-8c89-4db4-9daf-53bfd024e0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:17.990175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3c2df966-8c89-4db4-9daf-53bfd024e0a7 None None] MFA Rules not processed for user `a9b0fd833b134a089433cd2985caba80`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:30:17.991583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3c2df966-8c89-4db4-9daf-53bfd024e0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:18.066293 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4399/8768] 10.222.0.16 () {58 vars in 1061 bytes} [Fri Sep 30 10:30:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:30:18.072355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b8618-017a-4104-a26a-2dabc91b15a9 service glance] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:18.084471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b8618-017a-4104-a26a-2dabc91b15a9 service glance] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:18.090358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb87f65-a4bf-4708-954a-31d82afa29b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:18.091581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb87f65-a4bf-4708-954a-31d82afa29b6 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:18.091860 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb87f65-a4bf-4708-954a-31d82afa29b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:18.092132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb87f65-a4bf-4708-954a-31d82afa29b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:18.093900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dcb87f65-a4bf-4708-954a-31d82afa29b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:18.107554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb87f65-a4bf-4708-954a-31d82afa29b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:18.109423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb87f65-a4bf-4708-954a-31d82afa29b6 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:18.121995 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4370/8769] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:30:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:30:20.424471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2df966-8c89-4db4-9daf-53bfd024e0a7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:20.425956 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3c2df966-8c89-4db4-9daf-53bfd024e0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:20.501248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2df966-8c89-4db4-9daf-53bfd024e0a7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:20.506393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115778d-152d-4610-8ef3-a2a03691b52e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:20.507008 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115778d-152d-4610-8ef3-a2a03691b52e service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:20.507282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115778d-152d-4610-8ef3-a2a03691b52e service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:20.507554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115778d-152d-4610-8ef3-a2a03691b52e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:20.509300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e115778d-152d-4610-8ef3-a2a03691b52e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:20.525351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115778d-152d-4610-8ef3-a2a03691b52e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:20.526961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115778d-152d-4610-8ef3-a2a03691b52e service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:20.541934 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4400/8770] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:30:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:30:20.717820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb87f65-a4bf-4708-954a-31d82afa29b6 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:20.720652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dcb87f65-a4bf-4708-954a-31d82afa29b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:20.734630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb87f65-a4bf-4708-954a-31d82afa29b6 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:20.739677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2ec25-bb8d-4b40-a566-8feadf8b75e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:20.740312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2ec25-bb8d-4b40-a566-8feadf8b75e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:20.740588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2ec25-bb8d-4b40-a566-8feadf8b75e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:20.740869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2ec25-bb8d-4b40-a566-8feadf8b75e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:20.742631 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-64b2ec25-bb8d-4b40-a566-8feadf8b75e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:20.758472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2ec25-bb8d-4b40-a566-8feadf8b75e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:20.759941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2ec25-bb8d-4b40-a566-8feadf8b75e2 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:20.771759 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4371/8771] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:30:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:30:20.864991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115778d-152d-4610-8ef3-a2a03691b52e service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:20.877890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115778d-152d-4610-8ef3-a2a03691b52e service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:20.881650 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367dc72-b977-4de2-a5b4-b39ebaaf9bf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:20.882256 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367dc72-b977-4de2-a5b4-b39ebaaf9bf9 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:20.882535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367dc72-b977-4de2-a5b4-b39ebaaf9bf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:20.882807 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367dc72-b977-4de2-a5b4-b39ebaaf9bf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:20.884543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1367dc72-b977-4de2-a5b4-b39ebaaf9bf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:20.976832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367dc72-b977-4de2-a5b4-b39ebaaf9bf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:20.978191 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367dc72-b977-4de2-a5b4-b39ebaaf9bf9 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:20.994786 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4401/8772] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:30:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:30:23.202726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2ec25-bb8d-4b40-a566-8feadf8b75e2 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:23.204201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-64b2ec25-bb8d-4b40-a566-8feadf8b75e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:23.230494 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2ec25-bb8d-4b40-a566-8feadf8b75e2 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:23.241700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1af585-8b49-4d70-88af-3519eb9733db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:23.242397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1af585-8b49-4d70-88af-3519eb9733db service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:23.242683 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1af585-8b49-4d70-88af-3519eb9733db service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:23.242964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1af585-8b49-4d70-88af-3519eb9733db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:23.245053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ff1af585-8b49-4d70-88af-3519eb9733db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:23.270692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1af585-8b49-4d70-88af-3519eb9733db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:23.274598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1af585-8b49-4d70-88af-3519eb9733db service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:23.307148 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4372/8773] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:30:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:30:30.984779 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:30:33.284947 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=37 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:30:37.399160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367dc72-b977-4de2-a5b4-b39ebaaf9bf9 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:37.400762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1367dc72-b977-4de2-a5b4-b39ebaaf9bf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:37.533531 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367dc72-b977-4de2-a5b4-b39ebaaf9bf9 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:37.538821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f39767-8d91-4b96-ad32-427c937f6e99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:37.539434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f39767-8d91-4b96-ad32-427c937f6e99 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:37.539716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f39767-8d91-4b96-ad32-427c937f6e99 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:37.539988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f39767-8d91-4b96-ad32-427c937f6e99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:37.549175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f39767-8d91-4b96-ad32-427c937f6e99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:37.550795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f39767-8d91-4b96-ad32-427c937f6e99 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:37.559174 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4402/8774] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:30:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:30:45.851765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72f69a-c6ae-4afd-9aaa-aee4bf71cf3f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:45.852738 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72f69a-c6ae-4afd-9aaa-aee4bf71cf3f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:45.853195 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72f69a-c6ae-4afd-9aaa-aee4bf71cf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:45.876419 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5b72f69a-c6ae-4afd-9aaa-aee4bf71cf3f None None] MFA Rules not processed for user `b50b27cd8feb4fbabc4a562103fa3d65`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:30:45.877674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5b72f69a-c6ae-4afd-9aaa-aee4bf71cf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:45.958324 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4373/8775] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:30:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:30:46.389385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc547bea-b8ad-4041-b588-91bc8a4c18fb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:46.389895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc547bea-b8ad-4041-b588-91bc8a4c18fb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:46.390168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc547bea-b8ad-4041-b588-91bc8a4c18fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:46.412885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fc547bea-b8ad-4041-b588-91bc8a4c18fb None None] MFA Rules not processed for user `a9b0fd833b134a089433cd2985caba80`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:30:46.414239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fc547bea-b8ad-4041-b588-91bc8a4c18fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:46.422043 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4403/8776] 10.222.0.16 () {58 vars in 1061 bytes} [Fri Sep 30 10:30:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:30:46.436742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72f69a-c6ae-4afd-9aaa-aee4bf71cf3f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:46.457670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72f69a-c6ae-4afd-9aaa-aee4bf71cf3f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:46.474243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ae020-8607-4385-a250-fc6bdcef2de9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:46.475142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ae020-8607-4385-a250-fc6bdcef2de9 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:46.475569 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ae020-8607-4385-a250-fc6bdcef2de9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:46.476037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ae020-8607-4385-a250-fc6bdcef2de9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:46.480080 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-530ae020-8607-4385-a250-fc6bdcef2de9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:46.501346 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ae020-8607-4385-a250-fc6bdcef2de9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:46.503138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ae020-8607-4385-a250-fc6bdcef2de9 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:46.515448 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4374/8777] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:30:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:30:53.912310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc547bea-b8ad-4041-b588-91bc8a4c18fb None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:30:53.932116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc547bea-b8ad-4041-b588-91bc8a4c18fb None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:30:53.938072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8515bf-8a77-488c-aa37-18725e9f9b4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:30:53.938752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8515bf-8a77-488c-aa37-18725e9f9b4b service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:30:53.939106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8515bf-8a77-488c-aa37-18725e9f9b4b service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:30:53.939454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8515bf-8a77-488c-aa37-18725e9f9b4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:30:53.941410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9b8515bf-8a77-488c-aa37-18725e9f9b4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:30:53.960434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8515bf-8a77-488c-aa37-18725e9f9b4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:30:53.961678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8515bf-8a77-488c-aa37-18725e9f9b4b service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:30:53.977348 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4404/8778] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:30:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:30:56.508054 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=31 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:31:00.748276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ae020-8607-4385-a250-fc6bdcef2de9 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:31:00.763471 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ae020-8607-4385-a250-fc6bdcef2de9 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:31:00.769564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2af99b-2a1e-41f7-83c2-bb0e087630ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:31:00.770495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2af99b-2a1e-41f7-83c2-bb0e087630ae service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:31:00.770774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2af99b-2a1e-41f7-83c2-bb0e087630ae service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:31:00.771047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2af99b-2a1e-41f7-83c2-bb0e087630ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:31:00.772875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0c2af99b-2a1e-41f7-83c2-bb0e087630ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:31:00.804191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2af99b-2a1e-41f7-83c2-bb0e087630ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:31:00.805696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2af99b-2a1e-41f7-83c2-bb0e087630ae service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:31:00.817865 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4375/8779] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:31:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:31:03.969309 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=63 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:31:09.214048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8515bf-8a77-488c-aa37-18725e9f9b4b service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:31:09.215806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9b8515bf-8a77-488c-aa37-18725e9f9b4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:31:09.232990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8515bf-8a77-488c-aa37-18725e9f9b4b service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:31:09.237995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12048ce4-186a-40d6-954d-9fe1f16431f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:31:09.238585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12048ce4-186a-40d6-954d-9fe1f16431f5 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:31:09.238866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12048ce4-186a-40d6-954d-9fe1f16431f5 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:31:09.239142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12048ce4-186a-40d6-954d-9fe1f16431f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:31:09.240839 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-12048ce4-186a-40d6-954d-9fe1f16431f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:31:09.255459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12048ce4-186a-40d6-954d-9fe1f16431f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:31:09.257113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12048ce4-186a-40d6-954d-9fe1f16431f5 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:31:09.270971 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4405/8780] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:31:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:31:10.811365 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=11 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:31:19.263771 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:32:07.145156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d6c5-8c56-41c1-9213-2490a8fb5b2a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:07.145726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d6c5-8c56-41c1-9213-2490a8fb5b2a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:07.145822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d6c5-8c56-41c1-9213-2490a8fb5b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:07.167374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7e84d6c5-8c56-41c1-9213-2490a8fb5b2a None None] MFA Rules not processed for user `9c1a3025bb6e4099932d629436c79b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:32:07.168649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7e84d6c5-8c56-41c1-9213-2490a8fb5b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:32:07.175687 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4376/8781] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:32:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:32:07.941542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde8c70-f09a-4414-94aa-5fb906d74113 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:07.942005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde8c70-f09a-4414-94aa-5fb906d74113 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:07.942118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde8c70-f09a-4414-94aa-5fb906d74113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:08.003880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fbde8c70-f09a-4414-94aa-5fb906d74113 None None] MFA Rules not processed for user `cbb22d0675bc4ca893b0477cebd470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:32:08.003880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fbde8c70-f09a-4414-94aa-5fb906d74113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:32:08.003880 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4406/8782] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 10:32:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:32:08.015548 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84d6c5-8c56-41c1-9213-2490a8fb5b2a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:32:08.030712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84d6c5-8c56-41c1-9213-2490a8fb5b2a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:32:08.035667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911a20e-0292-4d48-af52-7e0c08a6828c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:32:08.036262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911a20e-0292-4d48-af52-7e0c08a6828c service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:08.036541 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911a20e-0292-4d48-af52-7e0c08a6828c service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:08.036845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911a20e-0292-4d48-af52-7e0c08a6828c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:08.045161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911a20e-0292-4d48-af52-7e0c08a6828c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:32:08.047729 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911a20e-0292-4d48-af52-7e0c08a6828c service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:32:08.057369 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4377/8783] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:32:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:32:17.991063 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=13 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:32:18.053292 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=9 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:32:23.635649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde8c70-f09a-4414-94aa-5fb906d74113 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:32:23.661714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde8c70-f09a-4414-94aa-5fb906d74113 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:32:23.667217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3c782-3eea-479b-96ac-7a4ec3131d15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:32:23.667827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3c782-3eea-479b-96ac-7a4ec3131d15 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:23.668109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3c782-3eea-479b-96ac-7a4ec3131d15 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:23.668383 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3c782-3eea-479b-96ac-7a4ec3131d15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:23.670309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d5c3c782-3eea-479b-96ac-7a4ec3131d15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:32:23.699947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3c782-3eea-479b-96ac-7a4ec3131d15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:32:23.701574 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3c782-3eea-479b-96ac-7a4ec3131d15 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:32:23.716251 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4407/8784] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:32:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:32:27.134805 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911a20e-0292-4d48-af52-7e0c08a6828c service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:32:27.144826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911a20e-0292-4d48-af52-7e0c08a6828c service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:32:27.148355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e8073-c97a-44f8-90f9-944ae26689db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:32:27.148985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e8073-c97a-44f8-90f9-944ae26689db service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:27.149262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e8073-c97a-44f8-90f9-944ae26689db service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:27.149534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e8073-c97a-44f8-90f9-944ae26689db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:27.161284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e8073-c97a-44f8-90f9-944ae26689db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:32:27.162687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e8073-c97a-44f8-90f9-944ae26689db service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:32:27.172095 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4378/8785] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:32:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:32:32.388013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3c782-3eea-479b-96ac-7a4ec3131d15 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:32:32.388013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d5c3c782-3eea-479b-96ac-7a4ec3131d15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:32:32.507102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3c782-3eea-479b-96ac-7a4ec3131d15 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:32:32.512149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed856d-b765-42c2-a4b2-9a7f185e7d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:32:32.512815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed856d-b765-42c2-a4b2-9a7f185e7d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:32.513097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed856d-b765-42c2-a4b2-9a7f185e7d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:32.513363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed856d-b765-42c2-a4b2-9a7f185e7d5d admin admin] PATH_INFO: `/v3/users/b50b27cd8feb4fbabc4a562103fa3d65` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:32.514722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed856d-b765-42c2-a4b2-9a7f185e7d5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b50b27cd8feb4fbabc4a562103fa3d65)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:32:32.516845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed856d-b765-42c2-a4b2-9a7f185e7d5d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:32:32.575227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1ed856d-b765-42c2-a4b2-9a7f185e7d5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b50b27cd8feb4fbabc4a562103fa3d65'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:32.576001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1ed856d-b765-42c2-a4b2-9a7f185e7d5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b50b27cd8feb4fbabc4a562103fa3d65'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:32.586930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1ed856d-b765-42c2-a4b2-9a7f185e7d5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b50b27cd8feb4fbabc4a562103fa3d65'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:32.602401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1ed856d-b765-42c2-a4b2-9a7f185e7d5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b50b27cd8feb4fbabc4a562103fa3d65'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:32.616426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1ed856d-b765-42c2-a4b2-9a7f185e7d5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b50b27cd8feb4fbabc4a562103fa3d65'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:32.628952 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4408/8786] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:32:32 2022] DELETE /identity/v3/users/b50b27cd8feb4fbabc4a562103fa3d65 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:32:32.633781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16a7bd-aaf6-4a92-b235-98ec0d97939f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:32.634271 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16a7bd-aaf6-4a92-b235-98ec0d97939f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:32.634367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16a7bd-aaf6-4a92-b235-98ec0d97939f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:32.686831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1d16a7bd-aaf6-4a92-b235-98ec0d97939f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:32:32.688477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1d16a7bd-aaf6-4a92-b235-98ec0d97939f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:32:32.762216 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4379/8787] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:32:32.777208 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed856d-b765-42c2-a4b2-9a7f185e7d5d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:32:32.781150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d1ed856d-b765-42c2-a4b2-9a7f185e7d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:32:32.834859 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:32:32.878886 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed856d-b765-42c2-a4b2-9a7f185e7d5d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:32:32.882881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba4e65-356e-4852-ba65-0dc8e90291c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:32:32.883606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba4e65-356e-4852-ba65-0dc8e90291c3 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:32.883959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba4e65-356e-4852-ba65-0dc8e90291c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:32.884460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba4e65-356e-4852-ba65-0dc8e90291c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:32.896071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba4e65-356e-4852-ba65-0dc8e90291c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:32:32.897679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba4e65-356e-4852-ba65-0dc8e90291c3 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:32:32.910415 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4409/8788] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:32:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:32:33.154620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16a7bd-aaf6-4a92-b235-98ec0d97939f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:32:33.156184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1d16a7bd-aaf6-4a92-b235-98ec0d97939f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:32:33.171196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16a7bd-aaf6-4a92-b235-98ec0d97939f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:32:33.176225 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154dd63-08fc-4f18-affa-7025159561bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:32:33.176908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154dd63-08fc-4f18-affa-7025159561bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:33.177185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154dd63-08fc-4f18-affa-7025159561bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:33.177482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154dd63-08fc-4f18-affa-7025159561bd admin admin] PATH_INFO: `/v3/projects/9b18ef923690468286b022f737f60931` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:33.180044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154dd63-08fc-4f18-affa-7025159561bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b18ef923690468286b022f737f60931)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:32:33.182268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154dd63-08fc-4f18-affa-7025159561bd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:32:33.241047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5154dd63-08fc-4f18-affa-7025159561bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b18ef923690468286b022f737f60931', 'request_id': 'req-5154dd63-08fc-4f18-affa-7025159561bd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:33.250742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5154dd63-08fc-4f18-affa-7025159561bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b18ef923690468286b022f737f60931', 'request_id': 'req-5154dd63-08fc-4f18-affa-7025159561bd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:33.259425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5154dd63-08fc-4f18-affa-7025159561bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b18ef923690468286b022f737f60931', 'request_id': 'req-5154dd63-08fc-4f18-affa-7025159561bd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:33.275473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5154dd63-08fc-4f18-affa-7025159561bd admin admin] The token cache is being invalidate because project 9b18ef923690468286b022f737f60931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:32:33.276687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5154dd63-08fc-4f18-affa-7025159561bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:33.277425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5154dd63-08fc-4f18-affa-7025159561bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:33.280638 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4380/8789] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:32:33 2022] DELETE /identity/v3/projects/9b18ef923690468286b022f737f60931 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:32:33.284740 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba4e65-356e-4852-ba65-0dc8e90291c3 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:32:33.297815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba4e65-356e-4852-ba65-0dc8e90291c3 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:32:33.373182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a162fd0-73a5-4419-bbae-7911b84d66bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:32:33.374652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a162fd0-73a5-4419-bbae-7911b84d66bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:33.374799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a162fd0-73a5-4419-bbae-7911b84d66bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:33.375013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a162fd0-73a5-4419-bbae-7911b84d66bf admin admin] PATH_INFO: `/v3/users/ef440f27b74b41988ec655dfdffa49d3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:33.376148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a162fd0-73a5-4419-bbae-7911b84d66bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef440f27b74b41988ec655dfdffa49d3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:32:33.378073 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a162fd0-73a5-4419-bbae-7911b84d66bf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:32:33.426718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a162fd0-73a5-4419-bbae-7911b84d66bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef440f27b74b41988ec655dfdffa49d3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:33.427369 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a162fd0-73a5-4419-bbae-7911b84d66bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef440f27b74b41988ec655dfdffa49d3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:33.438457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a162fd0-73a5-4419-bbae-7911b84d66bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef440f27b74b41988ec655dfdffa49d3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:33.451009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a162fd0-73a5-4419-bbae-7911b84d66bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef440f27b74b41988ec655dfdffa49d3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:33.457989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a162fd0-73a5-4419-bbae-7911b84d66bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef440f27b74b41988ec655dfdffa49d3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:33.465247 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4410/8790] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:32:33 2022] DELETE /identity/v3/users/ef440f27b74b41988ec655dfdffa49d3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:32:33.997403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154dd63-08fc-4f18-affa-7025159561bd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:32:33.999072 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5154dd63-08fc-4f18-affa-7025159561bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:32:34.013162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154dd63-08fc-4f18-affa-7025159561bd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:32:34.076586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366883f-130a-445e-9330-72ab0cea6e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:32:34.077960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366883f-130a-445e-9330-72ab0cea6e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:32:34.078305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366883f-130a-445e-9330-72ab0cea6e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:32:34.078966 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366883f-130a-445e-9330-72ab0cea6e7b admin admin] PATH_INFO: `/v3/projects/256ea25f0319434faa49eeb6191231f0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:32:34.080160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366883f-130a-445e-9330-72ab0cea6e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=256ea25f0319434faa49eeb6191231f0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:32:34.082158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366883f-130a-445e-9330-72ab0cea6e7b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:32:34.089187 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:32:34.131528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e366883f-130a-445e-9330-72ab0cea6e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '256ea25f0319434faa49eeb6191231f0', 'request_id': 'req-e366883f-130a-445e-9330-72ab0cea6e7b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:34.138924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e366883f-130a-445e-9330-72ab0cea6e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '256ea25f0319434faa49eeb6191231f0', 'request_id': 'req-e366883f-130a-445e-9330-72ab0cea6e7b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:34.145093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e366883f-130a-445e-9330-72ab0cea6e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '256ea25f0319434faa49eeb6191231f0', 'request_id': 'req-e366883f-130a-445e-9330-72ab0cea6e7b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:34.155994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e366883f-130a-445e-9330-72ab0cea6e7b admin admin] The token cache is being invalidate because project 256ea25f0319434faa49eeb6191231f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:32:34.156287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e366883f-130a-445e-9330-72ab0cea6e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:34.156938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e366883f-130a-445e-9330-72ab0cea6e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:32:34.158412 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4381/8791] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:32:33 2022] DELETE /identity/v3/projects/256ea25f0319434faa49eeb6191231f0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:32:43.460436 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:32:44.153032 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:33:05.215920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a162fd0-73a5-4419-bbae-7911b84d66bf admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:05.217919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0a162fd0-73a5-4419-bbae-7911b84d66bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:05.276730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a162fd0-73a5-4419-bbae-7911b84d66bf admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:05.327177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f198e58-db31-490d-a68d-b463c943b35a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:05.327688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f198e58-db31-490d-a68d-b463c943b35a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:05.327962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f198e58-db31-490d-a68d-b463c943b35a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:05.328227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f198e58-db31-490d-a68d-b463c943b35a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:05.329943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3f198e58-db31-490d-a68d-b463c943b35a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:05.402479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f198e58-db31-490d-a68d-b463c943b35a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:05.403911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f198e58-db31-490d-a68d-b463c943b35a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:05.418232 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4411/8792] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:33:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:33:15.410189 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=74 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:33:18.713619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366883f-130a-445e-9330-72ab0cea6e7b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:18.715485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e366883f-130a-445e-9330-72ab0cea6e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:18.898935 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366883f-130a-445e-9330-72ab0cea6e7b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:18.917046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afacdd-ed6a-4fa5-a34f-60864746ac6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:18.917686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afacdd-ed6a-4fa5-a34f-60864746ac6b service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:18.917962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afacdd-ed6a-4fa5-a34f-60864746ac6b service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:18.918228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afacdd-ed6a-4fa5-a34f-60864746ac6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:18.920662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e2afacdd-ed6a-4fa5-a34f-60864746ac6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:18.951863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afacdd-ed6a-4fa5-a34f-60864746ac6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:18.953785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afacdd-ed6a-4fa5-a34f-60864746ac6b service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:18.968095 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4382/8793] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:33:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:33:21.934079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f198e58-db31-490d-a68d-b463c943b35a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:21.948895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f198e58-db31-490d-a68d-b463c943b35a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:21.953966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc4fd6-94bd-4cdc-a633-e7e984f9abb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:21.954676 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc4fd6-94bd-4cdc-a633-e7e984f9abb3 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:21.954959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc4fd6-94bd-4cdc-a633-e7e984f9abb3 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:21.955231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc4fd6-94bd-4cdc-a633-e7e984f9abb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:21.956992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-12bc4fd6-94bd-4cdc-a633-e7e984f9abb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:21.971548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc4fd6-94bd-4cdc-a633-e7e984f9abb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:21.973083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc4fd6-94bd-4cdc-a633-e7e984f9abb3 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:21.987366 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4412/8794] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:33:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:33:22.004635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afacdd-ed6a-4fa5-a34f-60864746ac6b service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:22.006232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e2afacdd-ed6a-4fa5-a34f-60864746ac6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:22.074619 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afacdd-ed6a-4fa5-a34f-60864746ac6b service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:22.079174 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d8b85-0997-49a1-a147-b7381fa34f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:22.079810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d8b85-0997-49a1-a147-b7381fa34f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:22.080075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d8b85-0997-49a1-a147-b7381fa34f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:22.080350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d8b85-0997-49a1-a147-b7381fa34f59 admin admin] PATH_INFO: `/v3/users/9c1a3025bb6e4099932d629436c79b1a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:22.081513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d8b85-0997-49a1-a147-b7381fa34f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1a3025bb6e4099932d629436c79b1a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:22.084036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d8b85-0997-49a1-a147-b7381fa34f59 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:22.132242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f30d8b85-0997-49a1-a147-b7381fa34f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1a3025bb6e4099932d629436c79b1a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:22.139012 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f30d8b85-0997-49a1-a147-b7381fa34f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1a3025bb6e4099932d629436c79b1a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:22.139743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f30d8b85-0997-49a1-a147-b7381fa34f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1a3025bb6e4099932d629436c79b1a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:22.152486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f30d8b85-0997-49a1-a147-b7381fa34f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1a3025bb6e4099932d629436c79b1a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:22.159340 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f30d8b85-0997-49a1-a147-b7381fa34f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1a3025bb6e4099932d629436c79b1a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:22.165229 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4383/8795] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:33:22 2022] DELETE /identity/v3/users/9c1a3025bb6e4099932d629436c79b1a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:33:22.335879 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc4fd6-94bd-4cdc-a633-e7e984f9abb3 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:22.347565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc4fd6-94bd-4cdc-a633-e7e984f9abb3 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:22.404348 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf59f2-dcd4-4b63-8b48-58c9c0801951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:22.405002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf59f2-dcd4-4b63-8b48-58c9c0801951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:22.405281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf59f2-dcd4-4b63-8b48-58c9c0801951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:22.405550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf59f2-dcd4-4b63-8b48-58c9c0801951 admin admin] PATH_INFO: `/v3/projects/12161f59839745f78de94560d7ca63f7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:22.406652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf59f2-dcd4-4b63-8b48-58c9c0801951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12161f59839745f78de94560d7ca63f7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:22.408542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf59f2-dcd4-4b63-8b48-58c9c0801951 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:22.457033 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9baf59f2-dcd4-4b63-8b48-58c9c0801951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12161f59839745f78de94560d7ca63f7', 'request_id': 'req-9baf59f2-dcd4-4b63-8b48-58c9c0801951'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:22.464204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9baf59f2-dcd4-4b63-8b48-58c9c0801951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12161f59839745f78de94560d7ca63f7', 'request_id': 'req-9baf59f2-dcd4-4b63-8b48-58c9c0801951'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:22.470290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9baf59f2-dcd4-4b63-8b48-58c9c0801951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12161f59839745f78de94560d7ca63f7', 'request_id': 'req-9baf59f2-dcd4-4b63-8b48-58c9c0801951'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:22.481478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9baf59f2-dcd4-4b63-8b48-58c9c0801951 admin admin] The token cache is being invalidate because project 12161f59839745f78de94560d7ca63f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:33:22.481802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9baf59f2-dcd4-4b63-8b48-58c9c0801951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:22.482433 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9baf59f2-dcd4-4b63-8b48-58c9c0801951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:22.483912 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4413/8796] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:33:22 2022] DELETE /identity/v3/projects/12161f59839745f78de94560d7ca63f7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:33:22.487914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d8b85-0997-49a1-a147-b7381fa34f59 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:22.489974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f30d8b85-0997-49a1-a147-b7381fa34f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:22.502759 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d8b85-0997-49a1-a147-b7381fa34f59 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:22.507730 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:33:22.560482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0011f5-4d92-4264-9396-11012a45b721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:22.561131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0011f5-4d92-4264-9396-11012a45b721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:22.561407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0011f5-4d92-4264-9396-11012a45b721 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:22.561677 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0011f5-4d92-4264-9396-11012a45b721 admin admin] PATH_INFO: `/v3/users/23e3d5fd8a404655882b8a2d0e321e1c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:22.562780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0011f5-4d92-4264-9396-11012a45b721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23e3d5fd8a404655882b8a2d0e321e1c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:22.564691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0011f5-4d92-4264-9396-11012a45b721 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:22.609679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9f0011f5-4d92-4264-9396-11012a45b721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23e3d5fd8a404655882b8a2d0e321e1c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:22.617686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9f0011f5-4d92-4264-9396-11012a45b721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23e3d5fd8a404655882b8a2d0e321e1c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:22.618335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9f0011f5-4d92-4264-9396-11012a45b721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23e3d5fd8a404655882b8a2d0e321e1c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:22.630818 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9f0011f5-4d92-4264-9396-11012a45b721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23e3d5fd8a404655882b8a2d0e321e1c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:22.639039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9f0011f5-4d92-4264-9396-11012a45b721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23e3d5fd8a404655882b8a2d0e321e1c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:22.645909 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4384/8797] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:33:22 2022] DELETE /identity/v3/users/23e3d5fd8a404655882b8a2d0e321e1c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:33:22.822575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf59f2-dcd4-4b63-8b48-58c9c0801951 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:22.824207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9baf59f2-dcd4-4b63-8b48-58c9c0801951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:22.837180 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf59f2-dcd4-4b63-8b48-58c9c0801951 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:22.898287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cf028-7f4d-409f-b989-2cdcc58162f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:22.898909 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cf028-7f4d-409f-b989-2cdcc58162f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:22.899184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cf028-7f4d-409f-b989-2cdcc58162f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:22.899453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cf028-7f4d-409f-b989-2cdcc58162f8 admin admin] PATH_INFO: `/v3/projects/8592dbb698514719864acd06c03bf9fc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:22.900586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cf028-7f4d-409f-b989-2cdcc58162f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8592dbb698514719864acd06c03bf9fc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:22.902520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cf028-7f4d-409f-b989-2cdcc58162f8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:22.925641 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:33:22.951986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ef3cf028-7f4d-409f-b989-2cdcc58162f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8592dbb698514719864acd06c03bf9fc', 'request_id': 'req-ef3cf028-7f4d-409f-b989-2cdcc58162f8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:22.958677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ef3cf028-7f4d-409f-b989-2cdcc58162f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8592dbb698514719864acd06c03bf9fc', 'request_id': 'req-ef3cf028-7f4d-409f-b989-2cdcc58162f8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:22.964430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ef3cf028-7f4d-409f-b989-2cdcc58162f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8592dbb698514719864acd06c03bf9fc', 'request_id': 'req-ef3cf028-7f4d-409f-b989-2cdcc58162f8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:22.976160 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ef3cf028-7f4d-409f-b989-2cdcc58162f8 admin admin] The token cache is being invalidate because project 8592dbb698514719864acd06c03bf9fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:33:22.976471 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ef3cf028-7f4d-409f-b989-2cdcc58162f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:22.977162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ef3cf028-7f4d-409f-b989-2cdcc58162f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:22.978638 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4414/8798] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:33:22 2022] DELETE /identity/v3/projects/8592dbb698514719864acd06c03bf9fc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:33:32.615640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe05dc-951b-4737-ba0a-73d90e3c7682 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:32.616198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe05dc-951b-4737-ba0a-73d90e3c7682 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:32.616198 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe05dc-951b-4737-ba0a-73d90e3c7682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:32.655259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6bbe05dc-951b-4737-ba0a-73d90e3c7682 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:33:32.656479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6bbe05dc-951b-4737-ba0a-73d90e3c7682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:32.715080 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4385/8799] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:33:32.725219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7f285-b9aa-4bfb-a0fb-da70aa621258 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:32.725677 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7f285-b9aa-4bfb-a0fb-da70aa621258 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:32.725798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7f285-b9aa-4bfb-a0fb-da70aa621258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:32.746103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0bb7f285-b9aa-4bfb-a0fb-da70aa621258 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:33:32.747302 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0bb7f285-b9aa-4bfb-a0fb-da70aa621258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:32.755751 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4415/8800] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:33:32.760581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe05dc-951b-4737-ba0a-73d90e3c7682 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:32.770940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe05dc-951b-4737-ba0a-73d90e3c7682 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:32.775567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284be54d-0214-4ba4-b08d-010dabf7cf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:32.776157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284be54d-0214-4ba4-b08d-010dabf7cf12 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:32.776433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284be54d-0214-4ba4-b08d-010dabf7cf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:32.776745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284be54d-0214-4ba4-b08d-010dabf7cf12 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:32.777383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284be54d-0214-4ba4-b08d-010dabf7cf12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:33:32.777686 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284be54d-0214-4ba4-b08d-010dabf7cf12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:32.779246 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284be54d-0214-4ba4-b08d-010dabf7cf12 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:32.787852 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:33:32.791290 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4386/8801] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:33:32.799571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7f285-b9aa-4bfb-a0fb-da70aa621258 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:32.809968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7f285-b9aa-4bfb-a0fb-da70aa621258 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:32.814558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d5ec5-d409-4b30-8bca-6dbaf5d9369f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:32.815253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d5ec5-d409-4b30-8bca-6dbaf5d9369f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:32.815533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d5ec5-d409-4b30-8bca-6dbaf5d9369f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:32.815800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d5ec5-d409-4b30-8bca-6dbaf5d9369f admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:32.816421 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d5ec5-d409-4b30-8bca-6dbaf5d9369f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:32.819005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d5ec5-d409-4b30-8bca-6dbaf5d9369f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:32.856646 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4416/8802] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:33:32 2022] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:33:32.860765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284be54d-0214-4ba4-b08d-010dabf7cf12 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:32.871037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284be54d-0214-4ba4-b08d-010dabf7cf12 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:32.929163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182e152-cb49-49c9-9080-7dad9a2d921d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:32.929790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182e152-cb49-49c9-9080-7dad9a2d921d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:32.930068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182e152-cb49-49c9-9080-7dad9a2d921d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:32.930335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182e152-cb49-49c9-9080-7dad9a2d921d admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:32.930965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182e152-cb49-49c9-9080-7dad9a2d921d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:32.932864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182e152-cb49-49c9-9080-7dad9a2d921d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:32.957040 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4387/8803] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:33:32 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:33:32.958849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d5ec5-d409-4b30-8bca-6dbaf5d9369f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:32.969797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d5ec5-d409-4b30-8bca-6dbaf5d9369f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:32.975346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca3ab9-a364-4d82-9b53-c1b201d0d7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:32.975994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca3ab9-a364-4d82-9b53-c1b201d0d7ae admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:32.976269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca3ab9-a364-4d82-9b53-c1b201d0d7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:32.976584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca3ab9-a364-4d82-9b53-c1b201d0d7ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:32.977254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca3ab9-a364-4d82-9b53-c1b201d0d7ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:32.978826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca3ab9-a364-4d82-9b53-c1b201d0d7ae admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:32.988813 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4417/8804] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:33:32.992727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182e152-cb49-49c9-9080-7dad9a2d921d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:33.002505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182e152-cb49-49c9-9080-7dad9a2d921d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:33.007009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d56368-c7c8-42b7-b462-2ed2a883ffbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:33.007591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d56368-c7c8-42b7-b462-2ed2a883ffbe admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:33.007895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d56368-c7c8-42b7-b462-2ed2a883ffbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:33.008164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d56368-c7c8-42b7-b462-2ed2a883ffbe admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:33.008855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d56368-c7c8-42b7-b462-2ed2a883ffbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:33.010407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d56368-c7c8-42b7-b462-2ed2a883ffbe admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:33.021431 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4388/8805] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:33:33.025512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca3ab9-a364-4d82-9b53-c1b201d0d7ae admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:33.035338 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca3ab9-a364-4d82-9b53-c1b201d0d7ae admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:33.040290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66256a9d-32c7-43d0-9c82-c7b4bba5d5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:33.040990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66256a9d-32c7-43d0-9c82-c7b4bba5d5af admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:33.041270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66256a9d-32c7-43d0-9c82-c7b4bba5d5af admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:33.041537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66256a9d-32c7-43d0-9c82-c7b4bba5d5af admin admin] PATH_INFO: `/v3/projects/ef71e9e69fb949deb75514b59014f18b/users/6623e2993e0548918936f1c2f85c1136/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:33.058488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66256a9d-32c7-43d0-9c82-c7b4bba5d5af admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef71e9e69fb949deb75514b59014f18b, user_id=6623e2993e0548918936f1c2f85c1136, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:33.061207 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66256a9d-32c7-43d0-9c82-c7b4bba5d5af admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:33.075072 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4418/8806] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:33:33 2022] PUT /identity/v3/projects/ef71e9e69fb949deb75514b59014f18b/users/6623e2993e0548918936f1c2f85c1136/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:33:33.088368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a39a9-235e-414f-92e7-b96574ee43ff None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:33.088689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a39a9-235e-414f-92e7-b96574ee43ff None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:33.088965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a39a9-235e-414f-92e7-b96574ee43ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:33.116938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e46a39a9-235e-414f-92e7-b96574ee43ff None None] MFA Rules not processed for user `6623e2993e0548918936f1c2f85c1136`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:33:33.118145 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e46a39a9-235e-414f-92e7-b96574ee43ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:33.183130 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4389/8807] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:33:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:33:33.187982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66256a9d-32c7-43d0-9c82-c7b4bba5d5af admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:33.248980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66256a9d-32c7-43d0-9c82-c7b4bba5d5af admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:33.253747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c2fb9-ec60-46c0-921a-7f343646d07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:33.254406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c2fb9-ec60-46c0-921a-7f343646d07d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:33.254685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c2fb9-ec60-46c0-921a-7f343646d07d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:33.254950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c2fb9-ec60-46c0-921a-7f343646d07d admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:33.255570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c2fb9-ec60-46c0-921a-7f343646d07d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:33.257458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c2fb9-ec60-46c0-921a-7f343646d07d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:33.284016 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4419/8808] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:33:33 2022] POST /identity/v3/projects => generated 391 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:33:33.288799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a39a9-235e-414f-92e7-b96574ee43ff None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:33.299335 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a39a9-235e-414f-92e7-b96574ee43ff None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:33.355263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84fc1f-2325-4485-8bdd-010756ec43c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:33.355862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84fc1f-2325-4485-8bdd-010756ec43c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:33.356136 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84fc1f-2325-4485-8bdd-010756ec43c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:33.356404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84fc1f-2325-4485-8bdd-010756ec43c9 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:33.357052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84fc1f-2325-4485-8bdd-010756ec43c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:33.358934 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84fc1f-2325-4485-8bdd-010756ec43c9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:33.377020 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:33:33.385412 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4390/8809] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:33:33 2022] POST /identity/v3/users => generated 302 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:33:33.389174 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c2fb9-ec60-46c0-921a-7f343646d07d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:33.400109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c2fb9-ec60-46c0-921a-7f343646d07d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:33.404754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962df376-8925-4e5a-be76-693690535928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:33.405342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962df376-8925-4e5a-be76-693690535928 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:33.405621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962df376-8925-4e5a-be76-693690535928 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:33.405891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962df376-8925-4e5a-be76-693690535928 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:33.406533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962df376-8925-4e5a-be76-693690535928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:33.408145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962df376-8925-4e5a-be76-693690535928 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:33.418758 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4420/8810] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:33:33.422643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84fc1f-2325-4485-8bdd-010756ec43c9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:33.432824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84fc1f-2325-4485-8bdd-010756ec43c9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:33.437551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498867a6-2b48-4f7d-b5e0-8af8e370303e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:33.438130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498867a6-2b48-4f7d-b5e0-8af8e370303e admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:33.438404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498867a6-2b48-4f7d-b5e0-8af8e370303e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:33.438672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498867a6-2b48-4f7d-b5e0-8af8e370303e admin admin] PATH_INFO: `/v3/projects/883543b4804b4b35b64e0da6a577afc7/users/c87522d3390b47c9b45ceb7e1b76ba9f/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:33.453960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498867a6-2b48-4f7d-b5e0-8af8e370303e admin admin] RBAC: Authorizing `identity:create_grant(project_id=883543b4804b4b35b64e0da6a577afc7, user_id=c87522d3390b47c9b45ceb7e1b76ba9f, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:33.456561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498867a6-2b48-4f7d-b5e0-8af8e370303e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:33.469370 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4391/8811] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:33:33 2022] PUT /identity/v3/projects/883543b4804b4b35b64e0da6a577afc7/users/c87522d3390b47c9b45ceb7e1b76ba9f/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:33:33.473644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962df376-8925-4e5a-be76-693690535928 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:33.483418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962df376-8925-4e5a-be76-693690535928 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:33.487958 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:33:33.541010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b2819-0220-4388-a239-0fc7561b6f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:33.541609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b2819-0220-4388-a239-0fc7561b6f0d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:33.541888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b2819-0220-4388-a239-0fc7561b6f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:33.542156 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b2819-0220-4388-a239-0fc7561b6f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:33.542794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b2819-0220-4388-a239-0fc7561b6f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:33.544366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b2819-0220-4388-a239-0fc7561b6f0d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:33.554384 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4421/8812] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:33:33.558869 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498867a6-2b48-4f7d-b5e0-8af8e370303e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:33.570039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498867a6-2b48-4f7d-b5e0-8af8e370303e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:33.574655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8437e6-b361-42f9-ba8a-a2cf293abdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:33.575288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8437e6-b361-42f9-ba8a-a2cf293abdca admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:33.575582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8437e6-b361-42f9-ba8a-a2cf293abdca admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:33.575828 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8437e6-b361-42f9-ba8a-a2cf293abdca admin admin] PATH_INFO: `/v3/projects/883543b4804b4b35b64e0da6a577afc7/users/c87522d3390b47c9b45ceb7e1b76ba9f/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:33.577728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8437e6-b361-42f9-ba8a-a2cf293abdca admin admin] RBAC: Authorizing `identity:create_grant(project_id=883543b4804b4b35b64e0da6a577afc7, user_id=c87522d3390b47c9b45ceb7e1b76ba9f, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:33.580339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8437e6-b361-42f9-ba8a-a2cf293abdca admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:33.590347 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4392/8813] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:33:33 2022] PUT /identity/v3/projects/883543b4804b4b35b64e0da6a577afc7/users/c87522d3390b47c9b45ceb7e1b76ba9f/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:33:33.600931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30411db-ea17-44c3-88f8-d48dfd63f98c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:33.601221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30411db-ea17-44c3-88f8-d48dfd63f98c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:33.601495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30411db-ea17-44c3-88f8-d48dfd63f98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:33.629312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b30411db-ea17-44c3-88f8-d48dfd63f98c None None] MFA Rules not processed for user `c87522d3390b47c9b45ceb7e1b76ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:33:33.631079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b30411db-ea17-44c3-88f8-d48dfd63f98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:33.699734 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4422/8814] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:33:33 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:33:33.712952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddd694-75c6-4b82-b6cb-3bfd19eefb46 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:33.713421 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddd694-75c6-4b82-b6cb-3bfd19eefb46 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:33.713529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddd694-75c6-4b82-b6cb-3bfd19eefb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:33.733037 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-86ddd694-75c6-4b82-b6cb-3bfd19eefb46 None None] MFA Rules not processed for user `6623e2993e0548918936f1c2f85c1136`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:33:33.734220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-86ddd694-75c6-4b82-b6cb-3bfd19eefb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:33.789375 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4393/8815] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:33:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:33:33.804063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30411db-ea17-44c3-88f8-d48dfd63f98c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:33.805604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b30411db-ea17-44c3-88f8-d48dfd63f98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:33.892746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30411db-ea17-44c3-88f8-d48dfd63f98c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:33.898910 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d330d-0dda-49f9-b046-daf8f0a0c8b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:33.899520 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d330d-0dda-49f9-b046-daf8f0a0c8b1 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:33.899797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d330d-0dda-49f9-b046-daf8f0a0c8b1 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:33.900071 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d330d-0dda-49f9-b046-daf8f0a0c8b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:33.907834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d330d-0dda-49f9-b046-daf8f0a0c8b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:33.909449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d330d-0dda-49f9-b046-daf8f0a0c8b1 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:33.919793 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4423/8816] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:33:33 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:33:34.296248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586426d-6bca-47d9-94e9-32c04056e487 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:34.296532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586426d-6bca-47d9-94e9-32c04056e487 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:34.296833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586426d-6bca-47d9-94e9-32c04056e487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:34.313680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d330d-0dda-49f9-b046-daf8f0a0c8b1 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:34.315123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c15d330d-0dda-49f9-b046-daf8f0a0c8b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:34.318180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4586426d-6bca-47d9-94e9-32c04056e487 None None] MFA Rules not processed for user `cbb22d0675bc4ca893b0477cebd470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:33:34.319348 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4586426d-6bca-47d9-94e9-32c04056e487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:34.335477 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:33:34.379360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d330d-0dda-49f9-b046-daf8f0a0c8b1 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:34.383917 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878344d7-9775-4d73-bc35-b1293a8a1449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:34.384537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878344d7-9775-4d73-bc35-b1293a8a1449 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:34.384896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878344d7-9775-4d73-bc35-b1293a8a1449 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:34.385165 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878344d7-9775-4d73-bc35-b1293a8a1449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:34.386913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-878344d7-9775-4d73-bc35-b1293a8a1449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:34.392678 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4394/8817] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 10:33:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:33:34.404735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878344d7-9775-4d73-bc35-b1293a8a1449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:34.404886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586426d-6bca-47d9-94e9-32c04056e487 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:34.406133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4586426d-6bca-47d9-94e9-32c04056e487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:34.406240 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878344d7-9775-4d73-bc35-b1293a8a1449 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:34.421796 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4424/8818] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:33:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:33:34.422508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586426d-6bca-47d9-94e9-32c04056e487 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:34.428367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e59930-844c-43c5-a5ed-387c9327db21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:34.429011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e59930-844c-43c5-a5ed-387c9327db21 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:34.429294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e59930-844c-43c5-a5ed-387c9327db21 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:34.429570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e59930-844c-43c5-a5ed-387c9327db21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:34.438360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e59930-844c-43c5-a5ed-387c9327db21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:34.439929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e59930-844c-43c5-a5ed-387c9327db21 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:34.450598 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4395/8819] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:33:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:33:44.415917 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=19 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:33:44.446367 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=76,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:33:46.046600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878344d7-9775-4d73-bc35-b1293a8a1449 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:46.060464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878344d7-9775-4d73-bc35-b1293a8a1449 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:46.066345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7987b-19a1-459f-8387-b2aee3c48137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:46.066939 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7987b-19a1-459f-8387-b2aee3c48137 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:46.067223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7987b-19a1-459f-8387-b2aee3c48137 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:46.067559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7987b-19a1-459f-8387-b2aee3c48137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:46.075915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7987b-19a1-459f-8387-b2aee3c48137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:46.077589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7987b-19a1-459f-8387-b2aee3c48137 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:46.087439 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4425/8820] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:33:46 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:33:46.103697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94405aa-f5f8-4432-b9e1-b547cac09388 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:46.104163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94405aa-f5f8-4432-b9e1-b547cac09388 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:46.104258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94405aa-f5f8-4432-b9e1-b547cac09388 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:46.105621 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4396/8821] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 10:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 10:33:46.110182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7987b-19a1-459f-8387-b2aee3c48137 service nova] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 10:33:46.123672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7987b-19a1-459f-8387-b2aee3c48137 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:46.131789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7987b-19a1-459f-8387-b2aee3c48137 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:46.136309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb719ab4-0b95-4d02-9e2b-751ca2b91e3b tempest-ServersAdminNegativeTestJSON-106516326 tempest-ServersAdminNegativeTestJSON-106516326-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c87522d3390b47c9b45ceb7e1b76ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883543b4804b4b35b64e0da6a577afc7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:46.136938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb719ab4-0b95-4d02-9e2b-751ca2b91e3b tempest-ServersAdminNegativeTestJSON-106516326 tempest-ServersAdminNegativeTestJSON-106516326-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:46.137220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb719ab4-0b95-4d02-9e2b-751ca2b91e3b tempest-ServersAdminNegativeTestJSON-106516326 tempest-ServersAdminNegativeTestJSON-106516326-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:46.137495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb719ab4-0b95-4d02-9e2b-751ca2b91e3b tempest-ServersAdminNegativeTestJSON-106516326 tempest-ServersAdminNegativeTestJSON-106516326-project-admin] PATH_INFO: `/v3/projects/883543b4804b4b35b64e0da6a577afc7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:46.138610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb719ab4-0b95-4d02-9e2b-751ca2b91e3b tempest-ServersAdminNegativeTestJSON-106516326 tempest-ServersAdminNegativeTestJSON-106516326-project-admin] RBAC: Authorizing `identity:get_project(project_id=883543b4804b4b35b64e0da6a577afc7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:46.140346 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb719ab4-0b95-4d02-9e2b-751ca2b91e3b tempest-ServersAdminNegativeTestJSON-106516326 tempest-ServersAdminNegativeTestJSON-106516326-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:46.142090 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4426/8822] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 10:33:46 2022] GET /identity/v3/projects/883543b4804b4b35b64e0da6a577afc7 => generated 391 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:33:46.445906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4813ae-2d3e-4ac3-a80a-c5f5da5ed77b None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:46.446188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4813ae-2d3e-4ac3-a80a-c5f5da5ed77b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:46.446458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4813ae-2d3e-4ac3-a80a-c5f5da5ed77b None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:46.447804 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4397/8823] 10.222.0.16 () {54 vars in 912 bytes} [Fri Sep 30 10:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 10:33:46.452539 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb719ab4-0b95-4d02-9e2b-751ca2b91e3b tempest-ServersAdminNegativeTestJSON-106516326 tempest-ServersAdminNegativeTestJSON-106516326-project-admin] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 30 10:33:46.454257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fb719ab4-0b95-4d02-9e2b-751ca2b91e3b tempest-ServersAdminNegativeTestJSON-106516326 tempest-ServersAdminNegativeTestJSON-106516326-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:46.475950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb719ab4-0b95-4d02-9e2b-751ca2b91e3b tempest-ServersAdminNegativeTestJSON-106516326 tempest-ServersAdminNegativeTestJSON-106516326-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:46.484987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb719ab4-0b95-4d02-9e2b-751ca2b91e3b tempest-ServersAdminNegativeTestJSON-106516326 tempest-ServersAdminNegativeTestJSON-106516326-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:46.490091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ab310-222e-470f-bd80-32a353ed854b tempest-ServersAdminNegativeTestJSON-106516326 tempest-ServersAdminNegativeTestJSON-106516326-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c87522d3390b47c9b45ceb7e1b76ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883543b4804b4b35b64e0da6a577afc7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:46.490707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ab310-222e-470f-bd80-32a353ed854b tempest-ServersAdminNegativeTestJSON-106516326 tempest-ServersAdminNegativeTestJSON-106516326-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:46.490984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ab310-222e-470f-bd80-32a353ed854b tempest-ServersAdminNegativeTestJSON-106516326 tempest-ServersAdminNegativeTestJSON-106516326-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:46.491254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ab310-222e-470f-bd80-32a353ed854b tempest-ServersAdminNegativeTestJSON-106516326 tempest-ServersAdminNegativeTestJSON-106516326-project-admin] PATH_INFO: `/v3/projects/883543b4804b4b35b64e0da6a577afc7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:46.492370 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ab310-222e-470f-bd80-32a353ed854b tempest-ServersAdminNegativeTestJSON-106516326 tempest-ServersAdminNegativeTestJSON-106516326-project-admin] RBAC: Authorizing `identity:get_project(project_id=883543b4804b4b35b64e0da6a577afc7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:46.494170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ab310-222e-470f-bd80-32a353ed854b tempest-ServersAdminNegativeTestJSON-106516326 tempest-ServersAdminNegativeTestJSON-106516326-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:46.495793 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4427/8824] 10.222.0.16 () {58 vars in 1443 bytes} [Fri Sep 30 10:33:46 2022] GET /identity/v3/projects/883543b4804b4b35b64e0da6a577afc7 => generated 391 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:33:46.650355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4813ae-2d3e-4ac3-a80a-c5f5da5ed77b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:46.661497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4813ae-2d3e-4ac3-a80a-c5f5da5ed77b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:46.664921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2d01e-ccd8-4ea7-b0cb-2b49ffccea6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:46.665507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2d01e-ccd8-4ea7-b0cb-2b49ffccea6c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:46.665779 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2d01e-ccd8-4ea7-b0cb-2b49ffccea6c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:46.666044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2d01e-ccd8-4ea7-b0cb-2b49ffccea6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:46.667720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7bb2d01e-ccd8-4ea7-b0cb-2b49ffccea6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:46.680068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2d01e-ccd8-4ea7-b0cb-2b49ffccea6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:46.681493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2d01e-ccd8-4ea7-b0cb-2b49ffccea6c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:46.691670 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4398/8825] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:33:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:33:49.682654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ab310-222e-470f-bd80-32a353ed854b tempest-ServersAdminNegativeTestJSON-106516326 tempest-ServersAdminNegativeTestJSON-106516326-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:49.752093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ab310-222e-470f-bd80-32a353ed854b tempest-ServersAdminNegativeTestJSON-106516326 tempest-ServersAdminNegativeTestJSON-106516326-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:49.757222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04537a-158c-4d10-a721-a35592cac96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:49.757843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04537a-158c-4d10-a721-a35592cac96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:49.758122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04537a-158c-4d10-a721-a35592cac96b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:49.758390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04537a-158c-4d10-a721-a35592cac96b admin admin] PATH_INFO: `/v3/users/6623e2993e0548918936f1c2f85c1136` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:49.759498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04537a-158c-4d10-a721-a35592cac96b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6623e2993e0548918936f1c2f85c1136)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:49.761432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04537a-158c-4d10-a721-a35592cac96b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:49.808470 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d04537a-158c-4d10-a721-a35592cac96b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6623e2993e0548918936f1c2f85c1136'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:49.809140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d04537a-158c-4d10-a721-a35592cac96b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6623e2993e0548918936f1c2f85c1136'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:49.816361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d04537a-158c-4d10-a721-a35592cac96b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6623e2993e0548918936f1c2f85c1136'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:49.828731 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d04537a-158c-4d10-a721-a35592cac96b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6623e2993e0548918936f1c2f85c1136'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:49.835992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d04537a-158c-4d10-a721-a35592cac96b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6623e2993e0548918936f1c2f85c1136'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:49.841787 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4428/8826] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:33:49 2022] DELETE /identity/v3/users/6623e2993e0548918936f1c2f85c1136 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:33:49.846640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4d5fe-0638-4806-bf5e-4983204098af None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:49.847114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4d5fe-0638-4806-bf5e-4983204098af None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:49.847218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4d5fe-0638-4806-bf5e-4983204098af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:49.865838 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6cf4d5fe-0638-4806-bf5e-4983204098af None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:33:49.867018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6cf4d5fe-0638-4806-bf5e-4983204098af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:49.926974 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4399/8827] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:33:49.936885 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04537a-158c-4d10-a721-a35592cac96b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:49.938300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9d04537a-158c-4d10-a721-a35592cac96b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:49.993955 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:33:49.997961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04537a-158c-4d10-a721-a35592cac96b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:50.002613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8229eb-8e1e-4a56-98bc-15208b5cf832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:50.003299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8229eb-8e1e-4a56-98bc-15208b5cf832 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:50.003745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8229eb-8e1e-4a56-98bc-15208b5cf832 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:50.004171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8229eb-8e1e-4a56-98bc-15208b5cf832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:50.018720 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8229eb-8e1e-4a56-98bc-15208b5cf832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:50.020144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8229eb-8e1e-4a56-98bc-15208b5cf832 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:50.030095 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4429/8828] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:33:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:33:50.196242 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4d5fe-0638-4806-bf5e-4983204098af None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:50.197687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6cf4d5fe-0638-4806-bf5e-4983204098af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:50.210433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4d5fe-0638-4806-bf5e-4983204098af None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:50.215318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43590ce8-77cf-49a6-aadd-924e280926e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:50.216780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43590ce8-77cf-49a6-aadd-924e280926e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:50.217476 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43590ce8-77cf-49a6-aadd-924e280926e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:50.217827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43590ce8-77cf-49a6-aadd-924e280926e9 admin admin] PATH_INFO: `/v3/projects/ef71e9e69fb949deb75514b59014f18b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:50.218962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43590ce8-77cf-49a6-aadd-924e280926e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef71e9e69fb949deb75514b59014f18b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:50.221307 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43590ce8-77cf-49a6-aadd-924e280926e9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:50.268558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-43590ce8-77cf-49a6-aadd-924e280926e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef71e9e69fb949deb75514b59014f18b', 'request_id': 'req-43590ce8-77cf-49a6-aadd-924e280926e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:50.275906 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-43590ce8-77cf-49a6-aadd-924e280926e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef71e9e69fb949deb75514b59014f18b', 'request_id': 'req-43590ce8-77cf-49a6-aadd-924e280926e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:50.281666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-43590ce8-77cf-49a6-aadd-924e280926e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef71e9e69fb949deb75514b59014f18b', 'request_id': 'req-43590ce8-77cf-49a6-aadd-924e280926e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:50.293061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-43590ce8-77cf-49a6-aadd-924e280926e9 admin admin] The token cache is being invalidate because project ef71e9e69fb949deb75514b59014f18b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:33:50.293351 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-43590ce8-77cf-49a6-aadd-924e280926e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:50.293986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-43590ce8-77cf-49a6-aadd-924e280926e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:50.295457 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4400/8829] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:33:50 2022] DELETE /identity/v3/projects/ef71e9e69fb949deb75514b59014f18b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:33:50.299627 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8229eb-8e1e-4a56-98bc-15208b5cf832 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:50.310251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8229eb-8e1e-4a56-98bc-15208b5cf832 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:50.368456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9dd73e-23e3-4909-9bca-b8517e8bf160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:50.369122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dd73e-23e3-4909-9bca-b8517e8bf160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:50.369400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dd73e-23e3-4909-9bca-b8517e8bf160 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:50.369674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dd73e-23e3-4909-9bca-b8517e8bf160 admin admin] PATH_INFO: `/v3/users/c87522d3390b47c9b45ceb7e1b76ba9f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:50.370780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9dd73e-23e3-4909-9bca-b8517e8bf160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c87522d3390b47c9b45ceb7e1b76ba9f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:50.372768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9dd73e-23e3-4909-9bca-b8517e8bf160 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:50.420401 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dd9dd73e-23e3-4909-9bca-b8517e8bf160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c87522d3390b47c9b45ceb7e1b76ba9f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:50.421076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dd9dd73e-23e3-4909-9bca-b8517e8bf160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c87522d3390b47c9b45ceb7e1b76ba9f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:50.428779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dd9dd73e-23e3-4909-9bca-b8517e8bf160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c87522d3390b47c9b45ceb7e1b76ba9f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:50.440878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dd9dd73e-23e3-4909-9bca-b8517e8bf160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c87522d3390b47c9b45ceb7e1b76ba9f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:50.447554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dd9dd73e-23e3-4909-9bca-b8517e8bf160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c87522d3390b47c9b45ceb7e1b76ba9f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:50.453335 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4430/8830] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:33:50 2022] DELETE /identity/v3/users/c87522d3390b47c9b45ceb7e1b76ba9f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:33:50.729697 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43590ce8-77cf-49a6-aadd-924e280926e9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:50.731250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-43590ce8-77cf-49a6-aadd-924e280926e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:50.746979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43590ce8-77cf-49a6-aadd-924e280926e9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:50.808119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf0b43-122b-4b65-b357-f68693277f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:50.808780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf0b43-122b-4b65-b357-f68693277f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:50.809055 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf0b43-122b-4b65-b357-f68693277f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:50.809325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf0b43-122b-4b65-b357-f68693277f4f admin admin] PATH_INFO: `/v3/projects/883543b4804b4b35b64e0da6a577afc7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:50.810424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf0b43-122b-4b65-b357-f68693277f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=883543b4804b4b35b64e0da6a577afc7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:50.812312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf0b43-122b-4b65-b357-f68693277f4f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:50.823879 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:33:50.860184 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36bf0b43-122b-4b65-b357-f68693277f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '883543b4804b4b35b64e0da6a577afc7', 'request_id': 'req-36bf0b43-122b-4b65-b357-f68693277f4f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:50.867707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36bf0b43-122b-4b65-b357-f68693277f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '883543b4804b4b35b64e0da6a577afc7', 'request_id': 'req-36bf0b43-122b-4b65-b357-f68693277f4f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:50.873322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36bf0b43-122b-4b65-b357-f68693277f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '883543b4804b4b35b64e0da6a577afc7', 'request_id': 'req-36bf0b43-122b-4b65-b357-f68693277f4f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:50.885004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36bf0b43-122b-4b65-b357-f68693277f4f admin admin] The token cache is being invalidate because project 883543b4804b4b35b64e0da6a577afc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:33:50.885293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36bf0b43-122b-4b65-b357-f68693277f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:50.885929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36bf0b43-122b-4b65-b357-f68693277f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:33:50.887448 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4401/8831] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:33:50 2022] DELETE /identity/v3/projects/883543b4804b4b35b64e0da6a577afc7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:33:50.893451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3b6b9-5edb-4bcd-8f73-a34e5505a346 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:50.893905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3b6b9-5edb-4bcd-8f73-a34e5505a346 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:50.894000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3b6b9-5edb-4bcd-8f73-a34e5505a346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:50.913646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ddc3b6b9-5edb-4bcd-8f73-a34e5505a346 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:33:50.914848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ddc3b6b9-5edb-4bcd-8f73-a34e5505a346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:50.974899 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4431/8832] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:33:50.983205 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71768253-895a-4634-bac6-34075264e4e7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:50.983509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71768253-895a-4634-bac6-34075264e4e7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:50.983784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71768253-895a-4634-bac6-34075264e4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:51.005364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-71768253-895a-4634-bac6-34075264e4e7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:33:51.007326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-71768253-895a-4634-bac6-34075264e4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:51.015184 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4402/8833] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:33:51.019359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3b6b9-5edb-4bcd-8f73-a34e5505a346 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:51.029324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3b6b9-5edb-4bcd-8f73-a34e5505a346 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:51.033819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e19e7a-20db-488e-961b-f63591249606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:51.034400 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e19e7a-20db-488e-961b-f63591249606 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:51.034673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e19e7a-20db-488e-961b-f63591249606 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:51.034938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e19e7a-20db-488e-961b-f63591249606 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:51.035568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e19e7a-20db-488e-961b-f63591249606 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:33:51.035864 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e19e7a-20db-488e-961b-f63591249606 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:51.037476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e19e7a-20db-488e-961b-f63591249606 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:51.044112 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:33:51.049855 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4432/8834] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:33:51.055182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71768253-895a-4634-bac6-34075264e4e7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:51.064270 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71768253-895a-4634-bac6-34075264e4e7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:51.069512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bd828-22e1-4943-b666-0a184c288599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:51.070128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bd828-22e1-4943-b666-0a184c288599 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:51.070404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bd828-22e1-4943-b666-0a184c288599 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:51.070666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bd828-22e1-4943-b666-0a184c288599 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:51.071285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2bd828-22e1-4943-b666-0a184c288599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:51.073177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2bd828-22e1-4943-b666-0a184c288599 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:51.099920 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4403/8835] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:33:51 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:33:51.104252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e19e7a-20db-488e-961b-f63591249606 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:51.114181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e19e7a-20db-488e-961b-f63591249606 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:51.170226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca7a71-ca03-412e-a617-b08cf1deb357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:51.170828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca7a71-ca03-412e-a617-b08cf1deb357 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:51.171108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca7a71-ca03-412e-a617-b08cf1deb357 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:51.171378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca7a71-ca03-412e-a617-b08cf1deb357 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:51.172047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca7a71-ca03-412e-a617-b08cf1deb357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:51.174016 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca7a71-ca03-412e-a617-b08cf1deb357 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:51.198516 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4433/8836] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:33:51 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:33:51.199783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bd828-22e1-4943-b666-0a184c288599 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:51.210201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bd828-22e1-4943-b666-0a184c288599 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:51.214841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45018bd3-d5ed-47d4-aab4-a87bfdfc04ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:51.215431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45018bd3-d5ed-47d4-aab4-a87bfdfc04ce admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:51.215709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45018bd3-d5ed-47d4-aab4-a87bfdfc04ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:51.215979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45018bd3-d5ed-47d4-aab4-a87bfdfc04ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:51.216683 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45018bd3-d5ed-47d4-aab4-a87bfdfc04ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:51.218213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45018bd3-d5ed-47d4-aab4-a87bfdfc04ce admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:51.228871 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4404/8837] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:33:51.232586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca7a71-ca03-412e-a617-b08cf1deb357 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:51.242945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca7a71-ca03-412e-a617-b08cf1deb357 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:51.247649 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62549a33-d6b5-4680-8add-a276771e3513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:51.248238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62549a33-d6b5-4680-8add-a276771e3513 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:51.248517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62549a33-d6b5-4680-8add-a276771e3513 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:51.248832 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62549a33-d6b5-4680-8add-a276771e3513 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:51.249465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62549a33-d6b5-4680-8add-a276771e3513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:51.251088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62549a33-d6b5-4680-8add-a276771e3513 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:51.261909 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4434/8838] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:33:51.266033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45018bd3-d5ed-47d4-aab4-a87bfdfc04ce admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:51.276272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45018bd3-d5ed-47d4-aab4-a87bfdfc04ce admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:51.280926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee058a-fd8b-4310-b45d-e21c22053ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:51.281567 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee058a-fd8b-4310-b45d-e21c22053ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:51.281844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee058a-fd8b-4310-b45d-e21c22053ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:51.282117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee058a-fd8b-4310-b45d-e21c22053ac5 admin admin] PATH_INFO: `/v3/projects/46ce06519ea243d1a1930bd0bdaeed46/users/cd6b75ff376e4bc99e2f1b7961ab9291/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:51.296964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee058a-fd8b-4310-b45d-e21c22053ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ce06519ea243d1a1930bd0bdaeed46, user_id=cd6b75ff376e4bc99e2f1b7961ab9291, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:51.299579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee058a-fd8b-4310-b45d-e21c22053ac5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:51.313334 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4405/8839] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:33:51 2022] PUT /identity/v3/projects/46ce06519ea243d1a1930bd0bdaeed46/users/cd6b75ff376e4bc99e2f1b7961ab9291/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:33:51.318477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1324d51-004c-4d9d-9441-488cfbf1327d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:51.319358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1324d51-004c-4d9d-9441-488cfbf1327d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:51.319658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1324d51-004c-4d9d-9441-488cfbf1327d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:51.338815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f1324d51-004c-4d9d-9441-488cfbf1327d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:33:51.340017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f1324d51-004c-4d9d-9441-488cfbf1327d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:51.399025 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4435/8840] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:33:51.408734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee058a-fd8b-4310-b45d-e21c22053ac5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:51.410397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4cee058a-fd8b-4310-b45d-e21c22053ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:51.468745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee058a-fd8b-4310-b45d-e21c22053ac5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:51.472636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187aac6-9ef0-4e93-afb3-c16fd7025923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:51.473239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187aac6-9ef0-4e93-afb3-c16fd7025923 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:51.473517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187aac6-9ef0-4e93-afb3-c16fd7025923 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:51.473784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187aac6-9ef0-4e93-afb3-c16fd7025923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:51.483321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187aac6-9ef0-4e93-afb3-c16fd7025923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:51.484691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187aac6-9ef0-4e93-afb3-c16fd7025923 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:51.494658 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4406/8841] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:33:55.495332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dc6ca-d8a1-4b83-9719-c4269684011b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:55.495858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dc6ca-d8a1-4b83-9719-c4269684011b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:55.495953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dc6ca-d8a1-4b83-9719-c4269684011b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:55.526725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-668dc6ca-d8a1-4b83-9719-c4269684011b None None] MFA Rules not processed for user `cd6b75ff376e4bc99e2f1b7961ab9291`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:33:55.527955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-668dc6ca-d8a1-4b83-9719-c4269684011b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:55.602572 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4436/8842] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:33:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:33:55.613708 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cc274-2882-47c4-b895-dabeba0ade94 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:55.614156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cc274-2882-47c4-b895-dabeba0ade94 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:55.614263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cc274-2882-47c4-b895-dabeba0ade94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:55.636481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-033cc274-2882-47c4-b895-dabeba0ade94 None None] MFA Rules not processed for user `cd6b75ff376e4bc99e2f1b7961ab9291`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:33:55.637739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-033cc274-2882-47c4-b895-dabeba0ade94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:55.649039 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4407/8843] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:33:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:33:55.657222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668dc6ca-d8a1-4b83-9719-c4269684011b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:33:55.658635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-668dc6ca-d8a1-4b83-9719-c4269684011b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:33:55.679208 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:33:55.767563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668dc6ca-d8a1-4b83-9719-c4269684011b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:33:55.773158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c83cd-1a0a-4cbb-a0c7-7063b6b8ff12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:33:55.773790 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c83cd-1a0a-4cbb-a0c7-7063b6b8ff12 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:33:55.774072 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c83cd-1a0a-4cbb-a0c7-7063b6b8ff12 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:33:55.774343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c83cd-1a0a-4cbb-a0c7-7063b6b8ff12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:33:55.782869 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c83cd-1a0a-4cbb-a0c7-7063b6b8ff12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:33:55.784468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c83cd-1a0a-4cbb-a0c7-7063b6b8ff12 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:33:55.794824 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4437/8844] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:33:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:34:05.629013 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:34:05.790702 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=31 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:34:07.373831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca11a9c-aa4e-41aa-8fe9-46c047babbee None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:34:07.374396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca11a9c-aa4e-41aa-8fe9-46c047babbee None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:34:07.374396 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca11a9c-aa4e-41aa-8fe9-46c047babbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:34:07.405409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bca11a9c-aa4e-41aa-8fe9-46c047babbee None None] MFA Rules not processed for user `cbb22d0675bc4ca893b0477cebd470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:34:07.406617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bca11a9c-aa4e-41aa-8fe9-46c047babbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:34:07.470935 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4408/8845] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 10:34:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:34:07.482408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c83cd-1a0a-4cbb-a0c7-7063b6b8ff12 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:34:07.483770 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d52c83cd-1a0a-4cbb-a0c7-7063b6b8ff12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:34:07.502776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c83cd-1a0a-4cbb-a0c7-7063b6b8ff12 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:34:07.507815 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1c7f1-cb2e-47c4-bd1c-3fbf83767d1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:34:07.509164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1c7f1-cb2e-47c4-bd1c-3fbf83767d1e service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:34:07.509444 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1c7f1-cb2e-47c4-bd1c-3fbf83767d1e service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:34:07.509712 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1c7f1-cb2e-47c4-bd1c-3fbf83767d1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:34:07.517946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1c7f1-cb2e-47c4-bd1c-3fbf83767d1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:34:07.519519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1c7f1-cb2e-47c4-bd1c-3fbf83767d1e service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:34:07.529371 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4438/8846] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:34:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:34:07.705392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca11a9c-aa4e-41aa-8fe9-46c047babbee None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:34:07.714650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca11a9c-aa4e-41aa-8fe9-46c047babbee None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:34:07.718257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00082b8e-87f8-4612-8791-334f88f8fa46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:34:07.718846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00082b8e-87f8-4612-8791-334f88f8fa46 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:34:07.719124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00082b8e-87f8-4612-8791-334f88f8fa46 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:34:07.719392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00082b8e-87f8-4612-8791-334f88f8fa46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:34:07.721408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-00082b8e-87f8-4612-8791-334f88f8fa46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:34:07.737392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00082b8e-87f8-4612-8791-334f88f8fa46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:34:07.738771 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00082b8e-87f8-4612-8791-334f88f8fa46 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:34:07.752671 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4409/8847] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:34:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:34:17.525357 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:34:17.746145 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=39 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:34:23.522040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1c7f1-cb2e-47c4-bd1c-3fbf83767d1e service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:34:23.540624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1c7f1-cb2e-47c4-bd1c-3fbf83767d1e service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:34:23.545385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ab81f-e014-457a-b34d-54e0a6a1b574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:34:23.546186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ab81f-e014-457a-b34d-54e0a6a1b574 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:34:23.546461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ab81f-e014-457a-b34d-54e0a6a1b574 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:34:23.546875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ab81f-e014-457a-b34d-54e0a6a1b574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:34:23.549075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e19ab81f-e014-457a-b34d-54e0a6a1b574 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:34:23.562529 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ab81f-e014-457a-b34d-54e0a6a1b574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:34:23.563933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ab81f-e014-457a-b34d-54e0a6a1b574 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:34:23.574279 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4439/8848] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:34:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:34:33.568347 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:34:48.550311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00082b8e-87f8-4612-8791-334f88f8fa46 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:34:48.572018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00082b8e-87f8-4612-8791-334f88f8fa46 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:34:48.577673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accabb56-4d58-4fdf-b954-50d8cba65e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:34:48.578344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accabb56-4d58-4fdf-b954-50d8cba65e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:34:48.578596 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accabb56-4d58-4fdf-b954-50d8cba65e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:34:48.578877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accabb56-4d58-4fdf-b954-50d8cba65e62 admin admin] PATH_INFO: `/v3/users/cd6b75ff376e4bc99e2f1b7961ab9291` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:34:48.580751 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accabb56-4d58-4fdf-b954-50d8cba65e62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd6b75ff376e4bc99e2f1b7961ab9291)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:34:48.582942 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accabb56-4d58-4fdf-b954-50d8cba65e62 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:34:48.636728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-accabb56-4d58-4fdf-b954-50d8cba65e62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd6b75ff376e4bc99e2f1b7961ab9291'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:34:48.644143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-accabb56-4d58-4fdf-b954-50d8cba65e62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd6b75ff376e4bc99e2f1b7961ab9291'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:34:48.644797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-accabb56-4d58-4fdf-b954-50d8cba65e62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd6b75ff376e4bc99e2f1b7961ab9291'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:34:48.657552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-accabb56-4d58-4fdf-b954-50d8cba65e62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd6b75ff376e4bc99e2f1b7961ab9291'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:34:48.664434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-accabb56-4d58-4fdf-b954-50d8cba65e62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd6b75ff376e4bc99e2f1b7961ab9291'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:34:48.670446 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4410/8849] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:34:48 2022] DELETE /identity/v3/users/cd6b75ff376e4bc99e2f1b7961ab9291 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:34:48.868351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ab81f-e014-457a-b34d-54e0a6a1b574 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:34:48.888313 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ab81f-e014-457a-b34d-54e0a6a1b574 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:34:48.952968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a489a-4c20-406e-a912-ffc823de9979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:34:48.953613 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a489a-4c20-406e-a912-ffc823de9979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:34:48.953891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a489a-4c20-406e-a912-ffc823de9979 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:34:48.954161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a489a-4c20-406e-a912-ffc823de9979 admin admin] PATH_INFO: `/v3/projects/46ce06519ea243d1a1930bd0bdaeed46` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:34:48.955322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a489a-4c20-406e-a912-ffc823de9979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ce06519ea243d1a1930bd0bdaeed46)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:34:48.957320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a489a-4c20-406e-a912-ffc823de9979 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:34:49.005626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-364a489a-4c20-406e-a912-ffc823de9979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ce06519ea243d1a1930bd0bdaeed46', 'request_id': 'req-364a489a-4c20-406e-a912-ffc823de9979'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:34:49.012915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-364a489a-4c20-406e-a912-ffc823de9979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ce06519ea243d1a1930bd0bdaeed46', 'request_id': 'req-364a489a-4c20-406e-a912-ffc823de9979'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:34:49.018564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-364a489a-4c20-406e-a912-ffc823de9979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ce06519ea243d1a1930bd0bdaeed46', 'request_id': 'req-364a489a-4c20-406e-a912-ffc823de9979'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:34:49.029992 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-364a489a-4c20-406e-a912-ffc823de9979 admin admin] The token cache is being invalidate because project 46ce06519ea243d1a1930bd0bdaeed46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:34:49.030279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-364a489a-4c20-406e-a912-ffc823de9979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:34:49.030942 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-364a489a-4c20-406e-a912-ffc823de9979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:34:49.032418 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4440/8850] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:34:48 2022] DELETE /identity/v3/projects/46ce06519ea243d1a1930bd0bdaeed46 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:34:49.037459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7d7d8-8056-4632-9964-f1d7aaad8a28 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:34:49.037747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7d7d8-8056-4632-9964-f1d7aaad8a28 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:34:49.038018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7d7d8-8056-4632-9964-f1d7aaad8a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:34:49.058784 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-52c7d7d8-8056-4632-9964-f1d7aaad8a28 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:34:49.059987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-52c7d7d8-8056-4632-9964-f1d7aaad8a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:34:49.118404 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4411/8851] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:34:49.126900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649d434-36d0-4a7a-a597-a2f506d60189 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:34:49.127186 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649d434-36d0-4a7a-a597-a2f506d60189 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:34:49.127457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649d434-36d0-4a7a-a597-a2f506d60189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:34:49.149168 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e649d434-36d0-4a7a-a597-a2f506d60189 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:34:49.150352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e649d434-36d0-4a7a-a597-a2f506d60189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:34:49.158601 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4441/8852] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:34:49.162761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7d7d8-8056-4632-9964-f1d7aaad8a28 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:34:49.172839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7d7d8-8056-4632-9964-f1d7aaad8a28 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:34:49.177360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0d207-57ff-44aa-a986-ba28c3523602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:34:49.177952 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0d207-57ff-44aa-a986-ba28c3523602 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:34:49.178258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0d207-57ff-44aa-a986-ba28c3523602 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:34:49.178556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0d207-57ff-44aa-a986-ba28c3523602 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:34:49.179226 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0d207-57ff-44aa-a986-ba28c3523602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:34:49.179527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0d207-57ff-44aa-a986-ba28c3523602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:34:49.181140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0d207-57ff-44aa-a986-ba28c3523602 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:34:49.193296 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4412/8853] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:34:49.198303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649d434-36d0-4a7a-a597-a2f506d60189 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:34:49.207504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649d434-36d0-4a7a-a597-a2f506d60189 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:34:49.212129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fecc72-e744-4309-a55f-114aa3a7f123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:34:49.212754 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fecc72-e744-4309-a55f-114aa3a7f123 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:34:49.213063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fecc72-e744-4309-a55f-114aa3a7f123 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:34:49.213330 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fecc72-e744-4309-a55f-114aa3a7f123 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:34:49.214038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fecc72-e744-4309-a55f-114aa3a7f123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:34:49.215921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fecc72-e744-4309-a55f-114aa3a7f123 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:34:49.242296 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4442/8854] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:34:49 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:34:49.246973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0d207-57ff-44aa-a986-ba28c3523602 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:34:49.256989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0d207-57ff-44aa-a986-ba28c3523602 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:34:49.305156 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:34:49.317266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0306162-1979-45e6-bde7-5589480b2f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:34:49.317872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0306162-1979-45e6-bde7-5589480b2f34 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:34:49.318154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0306162-1979-45e6-bde7-5589480b2f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:34:49.318426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0306162-1979-45e6-bde7-5589480b2f34 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:34:49.319062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0306162-1979-45e6-bde7-5589480b2f34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:34:49.321057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0306162-1979-45e6-bde7-5589480b2f34 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:34:49.341931 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4413/8855] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:34:49 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:34:49.346039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fecc72-e744-4309-a55f-114aa3a7f123 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:34:49.356660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fecc72-e744-4309-a55f-114aa3a7f123 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:34:49.361140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0aede-91b2-46d7-b00a-4d0d34cdbcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:34:49.361727 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0aede-91b2-46d7-b00a-4d0d34cdbcc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:34:49.362005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0aede-91b2-46d7-b00a-4d0d34cdbcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:34:49.362272 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0aede-91b2-46d7-b00a-4d0d34cdbcc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:34:49.362899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0aede-91b2-46d7-b00a-4d0d34cdbcc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:34:49.364456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0aede-91b2-46d7-b00a-4d0d34cdbcc6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:34:49.375463 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4443/8856] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:34:49.379201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0306162-1979-45e6-bde7-5589480b2f34 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:34:49.389806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0306162-1979-45e6-bde7-5589480b2f34 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:34:49.394399 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009adfb-a036-4c99-973e-14c73667b019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:34:49.394987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009adfb-a036-4c99-973e-14c73667b019 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:34:49.395267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009adfb-a036-4c99-973e-14c73667b019 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:34:49.395537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009adfb-a036-4c99-973e-14c73667b019 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:34:49.396172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009adfb-a036-4c99-973e-14c73667b019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:34:49.397845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009adfb-a036-4c99-973e-14c73667b019 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:34:49.408475 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4414/8857] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:34:49.412498 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0aede-91b2-46d7-b00a-4d0d34cdbcc6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:34:49.422382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0aede-91b2-46d7-b00a-4d0d34cdbcc6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:34:49.426904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d9ea7-a80c-4d9a-a8f6-4038d5b7147f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:34:49.427538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d9ea7-a80c-4d9a-a8f6-4038d5b7147f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:34:49.427813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d9ea7-a80c-4d9a-a8f6-4038d5b7147f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:34:49.428087 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d9ea7-a80c-4d9a-a8f6-4038d5b7147f admin admin] PATH_INFO: `/v3/projects/026a857cdba0417ca69223081370de93/users/1c68247bd0ae40a187de874951e7a41d/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:34:49.443756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d9ea7-a80c-4d9a-a8f6-4038d5b7147f admin admin] RBAC: Authorizing `identity:create_grant(project_id=026a857cdba0417ca69223081370de93, user_id=1c68247bd0ae40a187de874951e7a41d, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:34:49.446402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d9ea7-a80c-4d9a-a8f6-4038d5b7147f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:34:49.461946 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4444/8858] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:34:49 2022] PUT /identity/v3/projects/026a857cdba0417ca69223081370de93/users/1c68247bd0ae40a187de874951e7a41d/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:34:49.467175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2fa27-463d-459d-a63e-0022b5fa4745 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:34:49.467468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2fa27-463d-459d-a63e-0022b5fa4745 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:34:49.467736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2fa27-463d-459d-a63e-0022b5fa4745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:34:49.487119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4fa2fa27-463d-459d-a63e-0022b5fa4745 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:34:49.488309 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4fa2fa27-463d-459d-a63e-0022b5fa4745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:34:49.547929 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4415/8859] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:34:49.557998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d9ea7-a80c-4d9a-a8f6-4038d5b7147f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:34:49.559690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-273d9ea7-a80c-4d9a-a8f6-4038d5b7147f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:34:49.591202 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:34:49.619114 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d9ea7-a80c-4d9a-a8f6-4038d5b7147f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:34:49.623853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf45b34-de37-41b0-b144-8d181b5a3e66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:34:49.624616 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf45b34-de37-41b0-b144-8d181b5a3e66 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:34:49.625003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf45b34-de37-41b0-b144-8d181b5a3e66 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:34:49.625314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf45b34-de37-41b0-b144-8d181b5a3e66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:34:49.634478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf45b34-de37-41b0-b144-8d181b5a3e66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:34:49.636377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf45b34-de37-41b0-b144-8d181b5a3e66 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:34:49.645769 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4445/8860] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:34:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:34:53.847573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1637e0-f9c7-4046-b909-ff785251a9e9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:34:53.848065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1637e0-f9c7-4046-b909-ff785251a9e9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:34:53.848232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1637e0-f9c7-4046-b909-ff785251a9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:34:53.878019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bc1637e0-f9c7-4046-b909-ff785251a9e9 None None] MFA Rules not processed for user `1c68247bd0ae40a187de874951e7a41d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:34:53.879278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bc1637e0-f9c7-4046-b909-ff785251a9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:34:53.949797 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4416/8861] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:34:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:34:53.960317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7df54-62e0-4789-9e92-6d560b809888 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:34:53.960898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7df54-62e0-4789-9e92-6d560b809888 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:34:53.960898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7df54-62e0-4789-9e92-6d560b809888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:34:53.981460 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-48a7df54-62e0-4789-9e92-6d560b809888 None None] MFA Rules not processed for user `1c68247bd0ae40a187de874951e7a41d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:34:53.982664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-48a7df54-62e0-4789-9e92-6d560b809888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:34:53.989560 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4446/8862] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:34:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:34:54.001612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1637e0-f9c7-4046-b909-ff785251a9e9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:34:54.002982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bc1637e0-f9c7-4046-b909-ff785251a9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:34:54.061195 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:34:54.090420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1637e0-f9c7-4046-b909-ff785251a9e9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:34:54.095984 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3137a-ec8c-463e-a29c-fc43c87b32fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:34:54.096535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3137a-ec8c-463e-a29c-fc43c87b32fc service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:34:54.097098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3137a-ec8c-463e-a29c-fc43c87b32fc service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:34:54.097369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3137a-ec8c-463e-a29c-fc43c87b32fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:34:54.105982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3137a-ec8c-463e-a29c-fc43c87b32fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:34:54.107592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3137a-ec8c-463e-a29c-fc43c87b32fc service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:34:54.116722 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4417/8863] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:34:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:35:03.975462 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=17 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:35:04.112627 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=11 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:35:23.990062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7df54-62e0-4789-9e92-6d560b809888 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:35:23.991617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-48a7df54-62e0-4789-9e92-6d560b809888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:35:24.004638 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7df54-62e0-4789-9e92-6d560b809888 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:35:24.007989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180f9ea-bf95-44aa-b077-2d3009620cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:35:24.008586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180f9ea-bf95-44aa-b077-2d3009620cfe service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:35:24.008931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180f9ea-bf95-44aa-b077-2d3009620cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:35:24.009204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180f9ea-bf95-44aa-b077-2d3009620cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:35:24.011486 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c180f9ea-bf95-44aa-b077-2d3009620cfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:35:24.024127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180f9ea-bf95-44aa-b077-2d3009620cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:35:24.025583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180f9ea-bf95-44aa-b077-2d3009620cfe service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:35:24.037093 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4447/8864] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:35:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:35:34.030493 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:35:37.651282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3137a-ec8c-463e-a29c-fc43c87b32fc service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:35:37.653238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-10d3137a-ec8c-463e-a29c-fc43c87b32fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:35:37.671385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3137a-ec8c-463e-a29c-fc43c87b32fc service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:35:37.677437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638391b-047b-4516-bafc-557f130e9375 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:35:37.678046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638391b-047b-4516-bafc-557f130e9375 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:35:37.678325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638391b-047b-4516-bafc-557f130e9375 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:35:37.678597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638391b-047b-4516-bafc-557f130e9375 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:35:37.680315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8638391b-047b-4516-bafc-557f130e9375 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:35:37.695321 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638391b-047b-4516-bafc-557f130e9375 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:35:37.696910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638391b-047b-4516-bafc-557f130e9375 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:35:37.711073 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4418/8865] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:35:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:35:43.728318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a85381-4b0e-4e3b-a3d0-bf57dfa9a411 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:35:43.728891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a85381-4b0e-4e3b-a3d0-bf57dfa9a411 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:35:43.728891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a85381-4b0e-4e3b-a3d0-bf57dfa9a411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:35:43.748359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f2a85381-4b0e-4e3b-a3d0-bf57dfa9a411 None None] MFA Rules not processed for user `1c68247bd0ae40a187de874951e7a41d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:35:43.749585 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f2a85381-4b0e-4e3b-a3d0-bf57dfa9a411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:35:43.756349 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4448/8866] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:35:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:35:47.705656 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:35:53.743532 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:35:55.294115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638391b-047b-4516-bafc-557f130e9375 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:35:55.304457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638391b-047b-4516-bafc-557f130e9375 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:35:55.310657 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddea512-6801-456f-b0e0-4ae3d731b4d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:35:55.311448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddea512-6801-456f-b0e0-4ae3d731b4d8 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:35:55.311734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddea512-6801-456f-b0e0-4ae3d731b4d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:35:55.312034 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddea512-6801-456f-b0e0-4ae3d731b4d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:35:55.314020 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fddea512-6801-456f-b0e0-4ae3d731b4d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:35:55.328159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddea512-6801-456f-b0e0-4ae3d731b4d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:35:55.329592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddea512-6801-456f-b0e0-4ae3d731b4d8 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:35:55.340625 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4419/8867] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:35:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:36:05.334125 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:36:06.777545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a85381-4b0e-4e3b-a3d0-bf57dfa9a411 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:36:06.778972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f2a85381-4b0e-4e3b-a3d0-bf57dfa9a411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:06.859944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a85381-4b0e-4e3b-a3d0-bf57dfa9a411 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:36:06.865012 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8085cc-3d06-408a-9956-c31b4e05fb74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:36:06.865607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8085cc-3d06-408a-9956-c31b4e05fb74 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:06.865882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8085cc-3d06-408a-9956-c31b4e05fb74 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:06.866148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8085cc-3d06-408a-9956-c31b4e05fb74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:06.867851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3b8085cc-3d06-408a-9956-c31b4e05fb74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:06.881626 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8085cc-3d06-408a-9956-c31b4e05fb74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:36:06.883206 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8085cc-3d06-408a-9956-c31b4e05fb74 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:36:06.895930 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4449/8868] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:36:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:36:14.267479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddea512-6801-456f-b0e0-4ae3d731b4d8 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:36:14.268917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fddea512-6801-456f-b0e0-4ae3d731b4d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:14.286509 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddea512-6801-456f-b0e0-4ae3d731b4d8 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:36:14.291546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f654c-6209-4584-8f09-040b66e52b01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:36:14.292148 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f654c-6209-4584-8f09-040b66e52b01 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:14.292428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f654c-6209-4584-8f09-040b66e52b01 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:14.292734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f654c-6209-4584-8f09-040b66e52b01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:14.294417 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a75f654c-6209-4584-8f09-040b66e52b01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:14.309294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f654c-6209-4584-8f09-040b66e52b01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:36:14.310873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f654c-6209-4584-8f09-040b66e52b01 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:36:14.324505 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4420/8869] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:36:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:36:16.888712 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=36 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:36:24.317868 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:36:31.666875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8085cc-3d06-408a-9956-c31b4e05fb74 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:36:31.684730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8085cc-3d06-408a-9956-c31b4e05fb74 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:36:31.690570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb81d3-0f69-42d5-b44c-835a0f9e9215 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:36:31.691675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb81d3-0f69-42d5-b44c-835a0f9e9215 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:31.691675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb81d3-0f69-42d5-b44c-835a0f9e9215 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:31.691675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb81d3-0f69-42d5-b44c-835a0f9e9215 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:31.693482 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7bbb81d3-0f69-42d5-b44c-835a0f9e9215 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:31.716506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb81d3-0f69-42d5-b44c-835a0f9e9215 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:36:31.718177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb81d3-0f69-42d5-b44c-835a0f9e9215 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:36:31.734121 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4450/8870] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:36:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:36:38.019958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f654c-6209-4584-8f09-040b66e52b01 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:36:38.035480 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f654c-6209-4584-8f09-040b66e52b01 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:36:38.041811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cad059-92b4-42ea-8808-fdd041651263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:36:38.042683 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cad059-92b4-42ea-8808-fdd041651263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:38.043862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cad059-92b4-42ea-8808-fdd041651263 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:38.044333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cad059-92b4-42ea-8808-fdd041651263 admin admin] PATH_INFO: `/v3/users/1c68247bd0ae40a187de874951e7a41d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:38.045710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cad059-92b4-42ea-8808-fdd041651263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c68247bd0ae40a187de874951e7a41d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:36:38.047994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cad059-92b4-42ea-8808-fdd041651263 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:36:38.104683 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9cad059-92b4-42ea-8808-fdd041651263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c68247bd0ae40a187de874951e7a41d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:36:38.112258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9cad059-92b4-42ea-8808-fdd041651263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c68247bd0ae40a187de874951e7a41d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:36:38.113695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9cad059-92b4-42ea-8808-fdd041651263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c68247bd0ae40a187de874951e7a41d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:36:38.125705 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9cad059-92b4-42ea-8808-fdd041651263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c68247bd0ae40a187de874951e7a41d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:36:38.135810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9cad059-92b4-42ea-8808-fdd041651263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c68247bd0ae40a187de874951e7a41d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:36:38.144264 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4421/8871] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:36:38 2022] DELETE /identity/v3/users/1c68247bd0ae40a187de874951e7a41d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:36:38.323324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb81d3-0f69-42d5-b44c-835a0f9e9215 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:36:38.334874 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb81d3-0f69-42d5-b44c-835a0f9e9215 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:36:38.395368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341d187-3465-49c2-86a0-da58fec6fa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:36:38.395996 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341d187-3465-49c2-86a0-da58fec6fa00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:38.396279 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341d187-3465-49c2-86a0-da58fec6fa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:38.396555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341d187-3465-49c2-86a0-da58fec6fa00 admin admin] PATH_INFO: `/v3/projects/026a857cdba0417ca69223081370de93` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:38.397701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341d187-3465-49c2-86a0-da58fec6fa00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=026a857cdba0417ca69223081370de93)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:36:38.399601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341d187-3465-49c2-86a0-da58fec6fa00 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:36:38.447135 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e341d187-3465-49c2-86a0-da58fec6fa00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '026a857cdba0417ca69223081370de93', 'request_id': 'req-e341d187-3465-49c2-86a0-da58fec6fa00'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:36:38.454541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e341d187-3465-49c2-86a0-da58fec6fa00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '026a857cdba0417ca69223081370de93', 'request_id': 'req-e341d187-3465-49c2-86a0-da58fec6fa00'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:36:38.460592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e341d187-3465-49c2-86a0-da58fec6fa00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '026a857cdba0417ca69223081370de93', 'request_id': 'req-e341d187-3465-49c2-86a0-da58fec6fa00'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:36:38.471412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e341d187-3465-49c2-86a0-da58fec6fa00 admin admin] The token cache is being invalidate because project 026a857cdba0417ca69223081370de93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:36:38.471699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e341d187-3465-49c2-86a0-da58fec6fa00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:36:38.473120 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e341d187-3465-49c2-86a0-da58fec6fa00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:36:38.474887 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4451/8872] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:36:38 2022] DELETE /identity/v3/projects/026a857cdba0417ca69223081370de93 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:36:38.480016 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bd03c-232c-4e06-803e-b354cb000c6e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:38.480300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bd03c-232c-4e06-803e-b354cb000c6e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:38.480574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bd03c-232c-4e06-803e-b354cb000c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:38.500087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-802bd03c-232c-4e06-803e-b354cb000c6e None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:36:38.501330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-802bd03c-232c-4e06-803e-b354cb000c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:38.561003 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4422/8873] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:36:38.570248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88e59d-ab5d-4372-897f-d35bda2dfbfc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:38.570532 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88e59d-ab5d-4372-897f-d35bda2dfbfc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:38.570804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88e59d-ab5d-4372-897f-d35bda2dfbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:38.591226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0b88e59d-ab5d-4372-897f-d35bda2dfbfc None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:36:38.592428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0b88e59d-ab5d-4372-897f-d35bda2dfbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:38.601767 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4452/8874] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:36:38.606062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bd03c-232c-4e06-803e-b354cb000c6e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:36:38.615944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bd03c-232c-4e06-803e-b354cb000c6e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:36:38.620637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361b7e2-c1b6-4e5f-bb5b-cdfadb7808e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:36:38.621239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361b7e2-c1b6-4e5f-bb5b-cdfadb7808e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:38.621518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361b7e2-c1b6-4e5f-bb5b-cdfadb7808e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:38.621791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361b7e2-c1b6-4e5f-bb5b-cdfadb7808e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:38.622441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361b7e2-c1b6-4e5f-bb5b-cdfadb7808e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:36:38.622744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361b7e2-c1b6-4e5f-bb5b-cdfadb7808e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:36:38.624334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361b7e2-c1b6-4e5f-bb5b-cdfadb7808e3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:36:38.637185 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4423/8875] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:36:38.641722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88e59d-ab5d-4372-897f-d35bda2dfbfc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:36:38.651895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88e59d-ab5d-4372-897f-d35bda2dfbfc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:36:38.656610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de7570-5351-486e-949e-03f07749121c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:36:38.657234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de7570-5351-486e-949e-03f07749121c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:38.657509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de7570-5351-486e-949e-03f07749121c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:38.657777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de7570-5351-486e-949e-03f07749121c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:38.658405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de7570-5351-486e-949e-03f07749121c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:36:38.660434 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de7570-5351-486e-949e-03f07749121c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:36:38.686725 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4453/8876] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:36:38 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:36:38.691427 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361b7e2-c1b6-4e5f-bb5b-cdfadb7808e3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:36:38.701300 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361b7e2-c1b6-4e5f-bb5b-cdfadb7808e3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:36:38.760305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abe1f5-8a2d-4129-a7ec-c69a0b5ae7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:36:38.760868 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abe1f5-8a2d-4129-a7ec-c69a0b5ae7b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:38.761158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abe1f5-8a2d-4129-a7ec-c69a0b5ae7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:38.761425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abe1f5-8a2d-4129-a7ec-c69a0b5ae7b8 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:38.762061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abe1f5-8a2d-4129-a7ec-c69a0b5ae7b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:36:38.763943 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abe1f5-8a2d-4129-a7ec-c69a0b5ae7b8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:36:38.772711 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:36:38.792778 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4424/8877] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:36:38 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 10:36:38.793788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de7570-5351-486e-949e-03f07749121c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:36:38.804836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de7570-5351-486e-949e-03f07749121c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:36:38.809601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dbb54-460d-4e7d-93ed-42874fc104b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:36:38.810210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dbb54-460d-4e7d-93ed-42874fc104b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:38.810491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dbb54-460d-4e7d-93ed-42874fc104b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:38.810775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dbb54-460d-4e7d-93ed-42874fc104b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:38.811412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8dbb54-460d-4e7d-93ed-42874fc104b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:36:38.813064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8dbb54-460d-4e7d-93ed-42874fc104b8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:36:38.824642 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4454/8878] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:36:38.828369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abe1f5-8a2d-4129-a7ec-c69a0b5ae7b8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:36:38.839294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abe1f5-8a2d-4129-a7ec-c69a0b5ae7b8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:36:38.844156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5810b-513e-4abd-bc84-50da1129ca4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:36:38.844804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5810b-513e-4abd-bc84-50da1129ca4e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:38.845087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5810b-513e-4abd-bc84-50da1129ca4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:38.845361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5810b-513e-4abd-bc84-50da1129ca4e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:38.846002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5810b-513e-4abd-bc84-50da1129ca4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:36:38.847813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5810b-513e-4abd-bc84-50da1129ca4e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:36:38.860572 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4425/8879] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:36:38.865323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dbb54-460d-4e7d-93ed-42874fc104b8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:36:38.875525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dbb54-460d-4e7d-93ed-42874fc104b8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:36:38.880959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1f4a1-0713-4fe5-b6eb-9fe6567129f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:36:38.881600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1f4a1-0713-4fe5-b6eb-9fe6567129f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:38.881882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1f4a1-0713-4fe5-b6eb-9fe6567129f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:38.882158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1f4a1-0713-4fe5-b6eb-9fe6567129f3 admin admin] PATH_INFO: `/v3/projects/47f6861612b4420fb637d58763a9f9c8/users/9eedded25379498c98feec607e34f67f/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:38.897329 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1f4a1-0713-4fe5-b6eb-9fe6567129f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f6861612b4420fb637d58763a9f9c8, user_id=9eedded25379498c98feec607e34f67f, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:36:38.900560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1f4a1-0713-4fe5-b6eb-9fe6567129f3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:36:38.915280 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4455/8880] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:36:38 2022] PUT /identity/v3/projects/47f6861612b4420fb637d58763a9f9c8/users/9eedded25379498c98feec607e34f67f/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:36:38.921029 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef9ace-4f94-4357-8595-d27c509d8f60 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:38.921314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef9ace-4f94-4357-8595-d27c509d8f60 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:38.921586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef9ace-4f94-4357-8595-d27c509d8f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:38.942593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-63ef9ace-4f94-4357-8595-d27c509d8f60 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:36:38.943774 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-63ef9ace-4f94-4357-8595-d27c509d8f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:39.002703 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4426/8881] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:36:39.013210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1f4a1-0713-4fe5-b6eb-9fe6567129f3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:36:39.014826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8fb1f4a1-0713-4fe5-b6eb-9fe6567129f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:39.030030 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:36:39.076218 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1f4a1-0713-4fe5-b6eb-9fe6567129f3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:36:39.079946 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3d7bc-7fbe-4e7e-9d88-e7d883c7982f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:36:39.080548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3d7bc-7fbe-4e7e-9d88-e7d883c7982f service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:39.080861 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3d7bc-7fbe-4e7e-9d88-e7d883c7982f service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:39.081667 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3d7bc-7fbe-4e7e-9d88-e7d883c7982f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:39.090851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3d7bc-7fbe-4e7e-9d88-e7d883c7982f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:36:39.092269 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3d7bc-7fbe-4e7e-9d88-e7d883c7982f service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:36:39.102062 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4456/8882] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:36:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:36:42.797117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98460f9c-d57c-4dec-a5c1-afc375565d1f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:42.797585 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98460f9c-d57c-4dec-a5c1-afc375565d1f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:42.797811 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98460f9c-d57c-4dec-a5c1-afc375565d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:42.827403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-98460f9c-d57c-4dec-a5c1-afc375565d1f None None] MFA Rules not processed for user `9eedded25379498c98feec607e34f67f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:36:42.828827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-98460f9c-d57c-4dec-a5c1-afc375565d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:42.903541 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4427/8883] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:36:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:36:42.919779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3d7bc-7fbe-4e7e-9d88-e7d883c7982f service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:36:42.921278 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-28e3d7bc-7fbe-4e7e-9d88-e7d883c7982f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:43.007881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3d7bc-7fbe-4e7e-9d88-e7d883c7982f service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:36:43.013594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5ac00-ec72-4a08-bedb-e51d98111005 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:36:43.014353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5ac00-ec72-4a08-bedb-e51d98111005 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:43.014635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5ac00-ec72-4a08-bedb-e51d98111005 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:43.014907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5ac00-ec72-4a08-bedb-e51d98111005 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:43.023968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5ac00-ec72-4a08-bedb-e51d98111005 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:36:43.025603 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5ac00-ec72-4a08-bedb-e51d98111005 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:36:43.037315 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4457/8884] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:36:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:36:44.723432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b8907-3b55-4001-bc8a-d859c58a5650 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:36:44.723936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b8907-3b55-4001-bc8a-d859c58a5650 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:36:44.724041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b8907-3b55-4001-bc8a-d859c58a5650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:36:44.743647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f11b8907-3b55-4001-bc8a-d859c58a5650 None None] MFA Rules not processed for user `9eedded25379498c98feec607e34f67f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:36:44.746281 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f11b8907-3b55-4001-bc8a-d859c58a5650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:36:44.752567 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4428/8885] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:36:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:36:53.031523 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=54 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:36:54.738441 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:38:07.239248 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5ac00-ec72-4a08-bedb-e51d98111005 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:38:07.240686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-85e5ac00-ec72-4a08-bedb-e51d98111005 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:38:07.252510 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5ac00-ec72-4a08-bedb-e51d98111005 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:38:07.256084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124e5cd-2ec8-4d54-bc9c-5ad7ef3915d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:38:07.256703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124e5cd-2ec8-4d54-bc9c-5ad7ef3915d4 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:38:07.256987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124e5cd-2ec8-4d54-bc9c-5ad7ef3915d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:38:07.257867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124e5cd-2ec8-4d54-bc9c-5ad7ef3915d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:38:07.259541 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1124e5cd-2ec8-4d54-bc9c-5ad7ef3915d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:38:07.276195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124e5cd-2ec8-4d54-bc9c-5ad7ef3915d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:38:07.277663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124e5cd-2ec8-4d54-bc9c-5ad7ef3915d4 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:38:07.292573 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4458/8886] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:38:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:38:17.284057 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:38:20.418305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df396d50-02d2-4f1e-aa04-14b977fcef65 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:38:20.418872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df396d50-02d2-4f1e-aa04-14b977fcef65 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:38:20.418872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df396d50-02d2-4f1e-aa04-14b977fcef65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:38:20.437833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-df396d50-02d2-4f1e-aa04-14b977fcef65 None None] MFA Rules not processed for user `cbb22d0675bc4ca893b0477cebd470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:38:20.439009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-df396d50-02d2-4f1e-aa04-14b977fcef65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:38:20.504961 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4429/8887] 10.222.0.17 () {58 vars in 1015 bytes} [Fri Sep 30 10:38:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:38:20.517106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124e5cd-2ec8-4d54-bc9c-5ad7ef3915d4 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:38:20.518484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1124e5cd-2ec8-4d54-bc9c-5ad7ef3915d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:38:20.535366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124e5cd-2ec8-4d54-bc9c-5ad7ef3915d4 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:38:20.540364 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba24a92-9c0f-4e93-8894-8237058be289 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:38:20.541006 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba24a92-9c0f-4e93-8894-8237058be289 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:38:20.541285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba24a92-9c0f-4e93-8894-8237058be289 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:38:20.541554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba24a92-9c0f-4e93-8894-8237058be289 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:38:20.549604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba24a92-9c0f-4e93-8894-8237058be289 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:38:20.551157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba24a92-9c0f-4e93-8894-8237058be289 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:38:20.560942 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4459/8888] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:38:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:38:23.834658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d5d78-3708-4058-90ae-22f0b9779b54 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:38:23.835285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d5d78-3708-4058-90ae-22f0b9779b54 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:38:23.835285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d5d78-3708-4058-90ae-22f0b9779b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:38:23.857536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b39d5d78-3708-4058-90ae-22f0b9779b54 None None] MFA Rules not processed for user `cbb22d0675bc4ca893b0477cebd470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:38:23.858654 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b39d5d78-3708-4058-90ae-22f0b9779b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:38:23.868783 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4430/8889] 10.222.0.45 () {58 vars in 1015 bytes} [Fri Sep 30 10:38:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:38:23.880867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba24a92-9c0f-4e93-8894-8237058be289 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:38:23.882887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7ba24a92-9c0f-4e93-8894-8237058be289 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:38:23.901794 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba24a92-9c0f-4e93-8894-8237058be289 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:38:23.906859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11553955-bda2-4f00-9cad-b9b0f8fe9650 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:38:23.907456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11553955-bda2-4f00-9cad-b9b0f8fe9650 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:38:23.907738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11553955-bda2-4f00-9cad-b9b0f8fe9650 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:38:23.908013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11553955-bda2-4f00-9cad-b9b0f8fe9650 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:38:23.924743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11553955-bda2-4f00-9cad-b9b0f8fe9650 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:38:23.926458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11553955-bda2-4f00-9cad-b9b0f8fe9650 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:38:23.938173 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4460/8890] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:38:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:38:29.536780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c658e-7953-4024-b270-d6ac49339e35 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:38:29.537248 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c658e-7953-4024-b270-d6ac49339e35 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:38:29.537354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c658e-7953-4024-b270-d6ac49339e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:38:29.556949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2e2c658e-7953-4024-b270-d6ac49339e35 None None] MFA Rules not processed for user `9eedded25379498c98feec607e34f67f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:38:29.558127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2e2c658e-7953-4024-b270-d6ac49339e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:38:29.564841 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4431/8891] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:38:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:38:29.868200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11553955-bda2-4f00-9cad-b9b0f8fe9650 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:38:29.877389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11553955-bda2-4f00-9cad-b9b0f8fe9650 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:38:29.880952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbb769-7948-4ac3-858a-84a6887615e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:38:29.881536 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbb769-7948-4ac3-858a-84a6887615e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:38:29.881855 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbb769-7948-4ac3-858a-84a6887615e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:38:29.882373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbb769-7948-4ac3-858a-84a6887615e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:38:29.883829 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c9dbb769-7948-4ac3-858a-84a6887615e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:38:29.895775 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dbb769-7948-4ac3-858a-84a6887615e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:38:29.897212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dbb769-7948-4ac3-858a-84a6887615e8 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:38:29.908110 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4461/8892] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:38:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:38:31.243800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8df075-780b-4e85-9a06-e19a00ed6088 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:38:31.244233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8df075-780b-4e85-9a06-e19a00ed6088 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:38:31.244493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8df075-780b-4e85-9a06-e19a00ed6088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:38:31.264575 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1e8df075-780b-4e85-9a06-e19a00ed6088 None None] MFA Rules not processed for user `cbb22d0675bc4ca893b0477cebd470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:38:31.265822 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1e8df075-780b-4e85-9a06-e19a00ed6088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:38:31.275480 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4432/8893] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Sep 30 10:38:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:38:31.281479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbb769-7948-4ac3-858a-84a6887615e8 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:38:31.293940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbb769-7948-4ac3-858a-84a6887615e8 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:38:31.298875 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6a66e-64f5-455c-9f9b-a06486a92e30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:38:31.299461 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6a66e-64f5-455c-9f9b-a06486a92e30 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:38:31.299736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6a66e-64f5-455c-9f9b-a06486a92e30 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:38:31.300003 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6a66e-64f5-455c-9f9b-a06486a92e30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:38:31.301732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7fb6a66e-64f5-455c-9f9b-a06486a92e30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:38:31.313197 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6a66e-64f5-455c-9f9b-a06486a92e30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:38:31.314747 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6a66e-64f5-455c-9f9b-a06486a92e30 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:38:31.324527 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4462/8894] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:38:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:38:34.647489 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8df075-780b-4e85-9a06-e19a00ed6088 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:38:34.656957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8df075-780b-4e85-9a06-e19a00ed6088 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:38:34.660479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68aecf-e466-4de8-9f4b-2f6eadecb834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:38:34.661114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68aecf-e466-4de8-9f4b-2f6eadecb834 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:38:34.661392 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68aecf-e466-4de8-9f4b-2f6eadecb834 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:38:34.661663 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68aecf-e466-4de8-9f4b-2f6eadecb834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:38:34.663857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ff68aecf-e466-4de8-9f4b-2f6eadecb834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:38:34.680495 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68aecf-e466-4de8-9f4b-2f6eadecb834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:38:34.681938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68aecf-e466-4de8-9f4b-2f6eadecb834 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:38:34.695227 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4433/8895] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:38:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:38:41.320507 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=24 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:38:43.247620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6a66e-64f5-455c-9f9b-a06486a92e30 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:38:43.263796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6a66e-64f5-455c-9f9b-a06486a92e30 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:38:43.269164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36743f-b031-4188-8d7a-9d3f3e94b84d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:38:43.269755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36743f-b031-4188-8d7a-9d3f3e94b84d service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:38:43.270029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36743f-b031-4188-8d7a-9d3f3e94b84d service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:38:43.270499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36743f-b031-4188-8d7a-9d3f3e94b84d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:38:43.272252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4f36743f-b031-4188-8d7a-9d3f3e94b84d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:38:43.289276 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36743f-b031-4188-8d7a-9d3f3e94b84d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:38:43.290955 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36743f-b031-4188-8d7a-9d3f3e94b84d service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:38:43.304689 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4463/8896] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:38:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:38:44.688038 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=44 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:38:53.297109 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:39:27.518745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68aecf-e466-4de8-9f4b-2f6eadecb834 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:39:27.528056 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68aecf-e466-4de8-9f4b-2f6eadecb834 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:39:27.531655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3f58e-e67c-4d5f-b2e6-29cafeb40e7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:39:27.532249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3f58e-e67c-4d5f-b2e6-29cafeb40e7a service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:39:27.532525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3f58e-e67c-4d5f-b2e6-29cafeb40e7a service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:39:27.532823 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3f58e-e67c-4d5f-b2e6-29cafeb40e7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:39:27.534516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5bf3f58e-e67c-4d5f-b2e6-29cafeb40e7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:39:27.547231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3f58e-e67c-4d5f-b2e6-29cafeb40e7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:39:27.548642 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3f58e-e67c-4d5f-b2e6-29cafeb40e7a service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:39:27.559121 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4434/8897] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:39:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:39:35.189968 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36743f-b031-4188-8d7a-9d3f3e94b84d service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:39:35.203846 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36743f-b031-4188-8d7a-9d3f3e94b84d service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:39:35.209299 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c8c43-e026-4cc0-8148-cefbe63c4371 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:39:35.209984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c8c43-e026-4cc0-8148-cefbe63c4371 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:39:35.210260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c8c43-e026-4cc0-8148-cefbe63c4371 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:39:35.210526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c8c43-e026-4cc0-8148-cefbe63c4371 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:39:35.212311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-080c8c43-e026-4cc0-8148-cefbe63c4371 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:39:35.236818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c8c43-e026-4cc0-8148-cefbe63c4371 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:39:35.236818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c8c43-e026-4cc0-8148-cefbe63c4371 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:39:35.240306 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4464/8898] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:39:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:39:35.415255 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3f58e-e67c-4d5f-b2e6-29cafeb40e7a service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:39:35.424011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3f58e-e67c-4d5f-b2e6-29cafeb40e7a service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:39:35.427671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331520b-16cd-4d07-ab8f-12a0fd9c805e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:39:35.428262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331520b-16cd-4d07-ab8f-12a0fd9c805e service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:39:35.428539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331520b-16cd-4d07-ab8f-12a0fd9c805e service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:39:35.428837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331520b-16cd-4d07-ab8f-12a0fd9c805e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:39:35.430540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0331520b-16cd-4d07-ab8f-12a0fd9c805e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:39:35.447011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331520b-16cd-4d07-ab8f-12a0fd9c805e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:39:35.448411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331520b-16cd-4d07-ab8f-12a0fd9c805e service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:39:35.462427 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4435/8899] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:39:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:39:35.521764 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c8c43-e026-4cc0-8148-cefbe63c4371 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:39:35.534700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c8c43-e026-4cc0-8148-cefbe63c4371 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:39:35.541104 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07dd96-fdb5-4712-a516-0dcd46da47e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:39:35.541693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07dd96-fdb5-4712-a516-0dcd46da47e8 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:39:35.541975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07dd96-fdb5-4712-a516-0dcd46da47e8 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:39:35.542246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07dd96-fdb5-4712-a516-0dcd46da47e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:39:35.543931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dd07dd96-fdb5-4712-a516-0dcd46da47e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:39:35.555017 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07dd96-fdb5-4712-a516-0dcd46da47e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:39:35.556628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07dd96-fdb5-4712-a516-0dcd46da47e8 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:39:35.566137 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4465/8900] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:39:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:39:45.454671 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=12 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:39:45.562187 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=12 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:39:51.461158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc67411-952f-41de-973c-0b18c7040416 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:39:51.461671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc67411-952f-41de-973c-0b18c7040416 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:39:51.461671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc67411-952f-41de-973c-0b18c7040416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:39:51.481696 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0cc67411-952f-41de-973c-0b18c7040416 None None] MFA Rules not processed for user `9eedded25379498c98feec607e34f67f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:39:51.482829 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0cc67411-952f-41de-973c-0b18c7040416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:39:51.489773 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4436/8901] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:39:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:40:01.475728 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:40:36.804546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cac7a5-afd0-4789-9c83-524b0fdb2095 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:40:36.805177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cac7a5-afd0-4789-9c83-524b0fdb2095 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:40:36.805177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cac7a5-afd0-4789-9c83-524b0fdb2095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:40:36.847085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-87cac7a5-afd0-4789-9c83-524b0fdb2095 None None] MFA Rules not processed for user `aa607111024540d1a09b01dfd1e5e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:40:36.849236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-87cac7a5-afd0-4789-9c83-524b0fdb2095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:40:36.862284 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4466/8902] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Sep 30 10:40:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:40:36.869625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfa5f5-26a7-4723-8463-268b86391a7e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:40:36.870069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfa5f5-26a7-4723-8463-268b86391a7e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:40:36.870295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfa5f5-26a7-4723-8463-268b86391a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:40:36.891057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1bbfa5f5-26a7-4723-8463-268b86391a7e None None] MFA Rules not processed for user `aa607111024540d1a09b01dfd1e5e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:40:36.892329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1bbfa5f5-26a7-4723-8463-268b86391a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:40:36.902039 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4437/8903] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:40:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:40:36.913990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cac7a5-afd0-4789-9c83-524b0fdb2095 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:40:36.924406 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cac7a5-afd0-4789-9c83-524b0fdb2095 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:40:36.929323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a5711-7cd3-4eb8-a772-83943a6baf6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:40:36.930001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a5711-7cd3-4eb8-a772-83943a6baf6e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:40:36.930286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a5711-7cd3-4eb8-a772-83943a6baf6e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:40:36.930555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a5711-7cd3-4eb8-a772-83943a6baf6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:40:36.941333 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a5711-7cd3-4eb8-a772-83943a6baf6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:40:36.942752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a5711-7cd3-4eb8-a772-83943a6baf6e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:40:36.953601 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4467/8904] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:40:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:40:38.031615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fade06-a72b-4e62-a7e6-e4967cf1e143 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:40:38.032191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fade06-a72b-4e62-a7e6-e4967cf1e143 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:40:38.032191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fade06-a72b-4e62-a7e6-e4967cf1e143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:40:38.079434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-20fade06-a72b-4e62-a7e6-e4967cf1e143 None None] MFA Rules not processed for user `a9b0fd833b134a089433cd2985caba80`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:40:38.080651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-20fade06-a72b-4e62-a7e6-e4967cf1e143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:40:38.107141 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4438/8905] 10.222.0.17 () {58 vars in 1015 bytes} [Fri Sep 30 10:40:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:40:38.120890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a5711-7cd3-4eb8-a772-83943a6baf6e service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:40:38.144853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b36f17-7147-4263-bfc3-9bff7a6fd943 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:40:38.145142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b36f17-7147-4263-bfc3-9bff7a6fd943 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:40:38.145445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b36f17-7147-4263-bfc3-9bff7a6fd943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:40:38.147147 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a5711-7cd3-4eb8-a772-83943a6baf6e service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:40:38.150967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091d2f5-4a35-4716-b86d-b189fe9a3f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:40:38.151572 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091d2f5-4a35-4716-b86d-b189fe9a3f93 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:40:38.151849 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091d2f5-4a35-4716-b86d-b189fe9a3f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:40:38.152118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091d2f5-4a35-4716-b86d-b189fe9a3f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:40:38.160192 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091d2f5-4a35-4716-b86d-b189fe9a3f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:40:38.161715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091d2f5-4a35-4716-b86d-b189fe9a3f93 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:40:38.167794 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-04b36f17-7147-4263-bfc3-9bff7a6fd943 None None] MFA Rules not processed for user `aa607111024540d1a09b01dfd1e5e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:40:38.169179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-04b36f17-7147-4263-bfc3-9bff7a6fd943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:40:38.172442 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4468/8906] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:40:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:40:38.207397 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4439/8907] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Sep 30 10:40:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:40:38.213787 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34a246-e6a9-466e-b953-ebca4e249903 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:40:38.214074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34a246-e6a9-466e-b953-ebca4e249903 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:40:38.214345 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34a246-e6a9-466e-b953-ebca4e249903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:40:38.234600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-de34a246-e6a9-466e-b953-ebca4e249903 None None] MFA Rules not processed for user `aa607111024540d1a09b01dfd1e5e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:40:38.235810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-de34a246-e6a9-466e-b953-ebca4e249903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:40:38.246555 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4469/8908] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:40:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:40:38.258294 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b36f17-7147-4263-bfc3-9bff7a6fd943 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:40:38.267821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b36f17-7147-4263-bfc3-9bff7a6fd943 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:40:38.271568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47e556-53a6-4a37-8d9c-759db2016cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:40:38.272357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47e556-53a6-4a37-8d9c-759db2016cee service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:40:38.273224 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47e556-53a6-4a37-8d9c-759db2016cee service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:40:38.273507 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47e556-53a6-4a37-8d9c-759db2016cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:40:38.284544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47e556-53a6-4a37-8d9c-759db2016cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:40:38.285499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47e556-53a6-4a37-8d9c-759db2016cee service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:40:38.297087 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4440/8909] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:40:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:40:48.229567 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=29 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:40:48.292085 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=43 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:40:55.920082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34a246-e6a9-466e-b953-ebca4e249903 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:40:55.929970 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34a246-e6a9-466e-b953-ebca4e249903 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:40:55.933535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243975a-4d79-4fb2-9461-8cdbc4baac50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:40:55.934152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243975a-4d79-4fb2-9461-8cdbc4baac50 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:40:55.934426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243975a-4d79-4fb2-9461-8cdbc4baac50 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:40:55.934694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243975a-4d79-4fb2-9461-8cdbc4baac50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:40:55.936435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6243975a-4d79-4fb2-9461-8cdbc4baac50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:40:55.948367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243975a-4d79-4fb2-9461-8cdbc4baac50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:40:55.949796 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243975a-4d79-4fb2-9461-8cdbc4baac50 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:40:55.960883 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4470/8910] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:40:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:40:56.370415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dcb5f-2eae-4769-b356-736dbfe79e58 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:40:56.370921 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dcb5f-2eae-4769-b356-736dbfe79e58 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:40:56.371143 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dcb5f-2eae-4769-b356-736dbfe79e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:40:56.403542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-eb4dcb5f-2eae-4769-b356-736dbfe79e58 None None] MFA Rules not processed for user `aa607111024540d1a09b01dfd1e5e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:40:56.404872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eb4dcb5f-2eae-4769-b356-736dbfe79e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:40:56.415448 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4441/8911] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 10:40:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:40:56.453125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243975a-4d79-4fb2-9461-8cdbc4baac50 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:40:56.466538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243975a-4d79-4fb2-9461-8cdbc4baac50 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:40:56.471924 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02020110-a07b-49b4-bdeb-10dce91370aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:40:56.472515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02020110-a07b-49b4-bdeb-10dce91370aa service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:40:56.472819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02020110-a07b-49b4-bdeb-10dce91370aa service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:40:56.473095 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02020110-a07b-49b4-bdeb-10dce91370aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:40:56.482388 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02020110-a07b-49b4-bdeb-10dce91370aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:40:56.484015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02020110-a07b-49b4-bdeb-10dce91370aa service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:40:56.499665 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4471/8912] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:40:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:40:59.985355 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b72201-b048-4a44-ba5e-ed9026bbde5a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:40:59.985877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b72201-b048-4a44-ba5e-ed9026bbde5a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:40:59.986128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b72201-b048-4a44-ba5e-ed9026bbde5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:41:00.007093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a6b72201-b048-4a44-ba5e-ed9026bbde5a None None] MFA Rules not processed for user `a9b0fd833b134a089433cd2985caba80`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:41:00.008322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a6b72201-b048-4a44-ba5e-ed9026bbde5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:41:00.014586 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4442/8913] 10.222.0.45 () {58 vars in 1015 bytes} [Fri Sep 30 10:40:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:41:00.026515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02020110-a07b-49b4-bdeb-10dce91370aa service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:41:00.035957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02020110-a07b-49b4-bdeb-10dce91370aa service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:41:00.039914 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20918d8-901a-43b8-8021-f430702fe6b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:41:00.040496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20918d8-901a-43b8-8021-f430702fe6b1 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:41:00.040797 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20918d8-901a-43b8-8021-f430702fe6b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:41:00.041065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20918d8-901a-43b8-8021-f430702fe6b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:41:00.047865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20918d8-901a-43b8-8021-f430702fe6b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:41:00.049309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20918d8-901a-43b8-8021-f430702fe6b1 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:41:00.057678 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4472/8914] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:41:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:41:02.986603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54adeb-de84-4700-94f8-4c6fbee32284 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:41:02.987111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54adeb-de84-4700-94f8-4c6fbee32284 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:41:02.987221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54adeb-de84-4700-94f8-4c6fbee32284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:41:03.011164 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4b54adeb-de84-4700-94f8-4c6fbee32284 None None] MFA Rules not processed for user `aa607111024540d1a09b01dfd1e5e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:41:03.012367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4b54adeb-de84-4700-94f8-4c6fbee32284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:41:03.021813 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4443/8915] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 10:41:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:41:03.035129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20918d8-901a-43b8-8021-f430702fe6b1 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:41:03.048371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20918d8-901a-43b8-8021-f430702fe6b1 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:41:03.054641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47dbb87-3186-4d22-a436-b8c51796ed4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:41:03.055243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dbb87-3186-4d22-a436-b8c51796ed4b service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:41:03.055517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dbb87-3186-4d22-a436-b8c51796ed4b service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:41:03.055962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dbb87-3186-4d22-a436-b8c51796ed4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:41:03.064952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47dbb87-3186-4d22-a436-b8c51796ed4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:41:03.066500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47dbb87-3186-4d22-a436-b8c51796ed4b service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:41:03.077174 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4473/8916] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:41:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:41:12.681769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af45741-2905-4a09-bc74-3db2a2c4fc0b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:41:12.682190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af45741-2905-4a09-bc74-3db2a2c4fc0b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:41:12.682190 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af45741-2905-4a09-bc74-3db2a2c4fc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:41:12.702382 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6af45741-2905-4a09-bc74-3db2a2c4fc0b None None] MFA Rules not processed for user `9eedded25379498c98feec607e34f67f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:41:12.703577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6af45741-2905-4a09-bc74-3db2a2c4fc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:41:12.710748 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4444/8917] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:41:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:41:13.073003 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=24 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:41:22.696680 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=12 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:41:24.064415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ee1a8-fa8b-46c3-95b5-c91db25abcb3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:41:24.064982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ee1a8-fa8b-46c3-95b5-c91db25abcb3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:41:24.065084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ee1a8-fa8b-46c3-95b5-c91db25abcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:41:24.086945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-556ee1a8-fa8b-46c3-95b5-c91db25abcb3 None None] MFA Rules not processed for user `aa607111024540d1a09b01dfd1e5e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:41:24.088422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-556ee1a8-fa8b-46c3-95b5-c91db25abcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:41:24.097950 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4474/8918] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 10:41:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:41:24.112070 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af45741-2905-4a09-bc74-3db2a2c4fc0b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:41:24.124879 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af45741-2905-4a09-bc74-3db2a2c4fc0b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:41:24.131153 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6bb4e-d20c-4992-8169-44c9d7cc2121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:41:24.131761 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6bb4e-d20c-4992-8169-44c9d7cc2121 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:41:24.132041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6bb4e-d20c-4992-8169-44c9d7cc2121 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:41:24.132310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6bb4e-d20c-4992-8169-44c9d7cc2121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:41:24.141465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6bb4e-d20c-4992-8169-44c9d7cc2121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:41:24.143069 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6bb4e-d20c-4992-8169-44c9d7cc2121 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:41:24.154642 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4445/8919] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:41:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:41:34.081008 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:41:34.150183 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:41:58.934899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc935f0-024b-4807-bf56-bdbf565b14a2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:41:58.935342 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc935f0-024b-4807-bf56-bdbf565b14a2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:41:58.935478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc935f0-024b-4807-bf56-bdbf565b14a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:41:58.985623 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cfc935f0-024b-4807-bf56-bdbf565b14a2 None None] MFA Rules not processed for user `947a48b06bb74f068b70e8c17a8da422`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:41:58.986810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cfc935f0-024b-4807-bf56-bdbf565b14a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:41:59.048116 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4475/8920] 10.222.0.16 () {58 vars in 1060 bytes} [Fri Sep 30 10:41:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:41:59.054073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6bb4e-d20c-4992-8169-44c9d7cc2121 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:41:59.063740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6bb4e-d20c-4992-8169-44c9d7cc2121 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:41:59.067268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b965c65-9efa-484c-a31c-798973ca9717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:41:59.067857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b965c65-9efa-484c-a31c-798973ca9717 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:41:59.068135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b965c65-9efa-484c-a31c-798973ca9717 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:41:59.068410 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b965c65-9efa-484c-a31c-798973ca9717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:41:59.076478 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b965c65-9efa-484c-a31c-798973ca9717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:41:59.078167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b965c65-9efa-484c-a31c-798973ca9717 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:41:59.087370 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4446/8921] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:41:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:42:09.045202 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=38 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:42:09.082882 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:42:12.887244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc935f0-024b-4807-bf56-bdbf565b14a2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:42:12.896944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc935f0-024b-4807-bf56-bdbf565b14a2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:42:12.901151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a62910-a91d-4569-9242-5baad9447310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:42:12.901308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a62910-a91d-4569-9242-5baad9447310 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:42:12.901558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a62910-a91d-4569-9242-5baad9447310 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:42:12.901963 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a62910-a91d-4569-9242-5baad9447310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:42:12.904187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-99a62910-a91d-4569-9242-5baad9447310 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:42:12.918871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a62910-a91d-4569-9242-5baad9447310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:42:12.920496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a62910-a91d-4569-9242-5baad9447310 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:42:12.933896 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4476/8922] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:42:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:42:22.928394 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:43:17.479046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b965c65-9efa-484c-a31c-798973ca9717 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:17.488391 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b965c65-9efa-484c-a31c-798973ca9717 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:17.494036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71bd04-f677-45fd-adf4-147a9db8fd06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:17.494636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71bd04-f677-45fd-adf4-147a9db8fd06 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:17.494912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71bd04-f677-45fd-adf4-147a9db8fd06 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:17.495186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71bd04-f677-45fd-adf4-147a9db8fd06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:17.508085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71bd04-f677-45fd-adf4-147a9db8fd06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:17.510780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71bd04-f677-45fd-adf4-147a9db8fd06 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:17.523804 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4447/8923] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:43:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:43:20.500545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd069f-347e-43ad-bf9e-02990c004ef8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:20.501171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd069f-347e-43ad-bf9e-02990c004ef8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:20.501171 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd069f-347e-43ad-bf9e-02990c004ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:20.572968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71bd04-f677-45fd-adf4-147a9db8fd06 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:20.586586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71bd04-f677-45fd-adf4-147a9db8fd06 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:20.589713 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-33cd069f-347e-43ad-bf9e-02990c004ef8 None None] MFA Rules not processed for user `cbb22d0675bc4ca893b0477cebd470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:43:20.590989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-33cd069f-347e-43ad-bf9e-02990c004ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:20.592763 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70046863-1c9e-43ed-8664-8299ef366f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:20.593481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70046863-1c9e-43ed-8664-8299ef366f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:20.593766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70046863-1c9e-43ed-8664-8299ef366f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:20.594035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70046863-1c9e-43ed-8664-8299ef366f3a admin admin] PATH_INFO: `/v3/users/9eedded25379498c98feec607e34f67f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:20.595400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70046863-1c9e-43ed-8664-8299ef366f3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eedded25379498c98feec607e34f67f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:20.597364 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70046863-1c9e-43ed-8664-8299ef366f3a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:20.601462 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4477/8924] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 10:43:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:43:20.612447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b95d06-e0bf-4e5e-ad03-85f50b37df8f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:20.612757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b95d06-e0bf-4e5e-ad03-85f50b37df8f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:20.613034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b95d06-e0bf-4e5e-ad03-85f50b37df8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:20.633601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-51b95d06-e0bf-4e5e-ad03-85f50b37df8f None None] MFA Rules not processed for user `cbb22d0675bc4ca893b0477cebd470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:43:20.634823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-51b95d06-e0bf-4e5e-ad03-85f50b37df8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:20.650272 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4478/8925] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Sep 30 10:43:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:43:20.656818 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b95d06-e0bf-4e5e-ad03-85f50b37df8f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:20.659917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-70046863-1c9e-43ed-8664-8299ef366f3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eedded25379498c98feec607e34f67f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:20.669518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b95d06-e0bf-4e5e-ad03-85f50b37df8f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:20.669680 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-70046863-1c9e-43ed-8664-8299ef366f3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eedded25379498c98feec607e34f67f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:20.670537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-70046863-1c9e-43ed-8664-8299ef366f3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eedded25379498c98feec607e34f67f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:20.675366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a7572-b144-42ce-91a2-99f2e2ab42b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:20.676214 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a7572-b144-42ce-91a2-99f2e2ab42b4 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:20.676711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a7572-b144-42ce-91a2-99f2e2ab42b4 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:20.677163 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a7572-b144-42ce-91a2-99f2e2ab42b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:20.686357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-70046863-1c9e-43ed-8664-8299ef366f3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eedded25379498c98feec607e34f67f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:20.688094 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a7572-b144-42ce-91a2-99f2e2ab42b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:20.690005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a7572-b144-42ce-91a2-99f2e2ab42b4 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:20.694257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-70046863-1c9e-43ed-8664-8299ef366f3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eedded25379498c98feec607e34f67f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:20.700928 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4448/8926] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:43:20 2022] DELETE /identity/v3/users/9eedded25379498c98feec607e34f67f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:43:20.704669 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4479/8927] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:43:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:43:20.890046 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70046863-1c9e-43ed-8664-8299ef366f3a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:20.891508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-70046863-1c9e-43ed-8664-8299ef366f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:20.992276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70046863-1c9e-43ed-8664-8299ef366f3a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:20.996908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9f165-5bd0-4638-af45-d51ccc8d7095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:20.997503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9f165-5bd0-4638-af45-d51ccc8d7095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:20.997780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9f165-5bd0-4638-af45-d51ccc8d7095 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:20.998049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9f165-5bd0-4638-af45-d51ccc8d7095 admin admin] PATH_INFO: `/v3/projects/47f6861612b4420fb637d58763a9f9c8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:20.999192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9f165-5bd0-4638-af45-d51ccc8d7095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f6861612b4420fb637d58763a9f9c8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:21.001122 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9f165-5bd0-4638-af45-d51ccc8d7095 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:21.044245 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:43:21.053409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c6e9f165-5bd0-4638-af45-d51ccc8d7095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f6861612b4420fb637d58763a9f9c8', 'request_id': 'req-c6e9f165-5bd0-4638-af45-d51ccc8d7095'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:21.062035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c6e9f165-5bd0-4638-af45-d51ccc8d7095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f6861612b4420fb637d58763a9f9c8', 'request_id': 'req-c6e9f165-5bd0-4638-af45-d51ccc8d7095'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:21.068000 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c6e9f165-5bd0-4638-af45-d51ccc8d7095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f6861612b4420fb637d58763a9f9c8', 'request_id': 'req-c6e9f165-5bd0-4638-af45-d51ccc8d7095'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:21.080965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c6e9f165-5bd0-4638-af45-d51ccc8d7095 admin admin] The token cache is being invalidate because project 47f6861612b4420fb637d58763a9f9c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:43:21.081256 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c6e9f165-5bd0-4638-af45-d51ccc8d7095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:21.081937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c6e9f165-5bd0-4638-af45-d51ccc8d7095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:43:21.083465 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4449/8928] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:43:20 2022] DELETE /identity/v3/projects/47f6861612b4420fb637d58763a9f9c8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:43:21.088462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5914cfe-f56c-450a-8aec-3a88855f1df7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:21.088810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5914cfe-f56c-450a-8aec-3a88855f1df7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:21.089085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5914cfe-f56c-450a-8aec-3a88855f1df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:21.119043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b5914cfe-f56c-450a-8aec-3a88855f1df7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:43:21.120258 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b5914cfe-f56c-450a-8aec-3a88855f1df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:21.177703 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4480/8929] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:43:21.186053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cdeb0-bdfd-4e92-a9b1-898152867ae2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:21.186383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cdeb0-bdfd-4e92-a9b1-898152867ae2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:21.186656 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cdeb0-bdfd-4e92-a9b1-898152867ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:21.206414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-df9cdeb0-bdfd-4e92-a9b1-898152867ae2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:43:21.207608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-df9cdeb0-bdfd-4e92-a9b1-898152867ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:21.215647 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4450/8930] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:43:21.219925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5914cfe-f56c-450a-8aec-3a88855f1df7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:21.230344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5914cfe-f56c-450a-8aec-3a88855f1df7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:21.234877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f200a9b-ad08-42a6-8c32-9dee0d4117d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:21.235464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f200a9b-ad08-42a6-8c32-9dee0d4117d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:21.235744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f200a9b-ad08-42a6-8c32-9dee0d4117d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:21.236013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f200a9b-ad08-42a6-8c32-9dee0d4117d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:21.236695 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f200a9b-ad08-42a6-8c32-9dee0d4117d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:43:21.236995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f200a9b-ad08-42a6-8c32-9dee0d4117d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:21.238557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f200a9b-ad08-42a6-8c32-9dee0d4117d1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:21.250561 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4481/8931] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:43:21.254769 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cdeb0-bdfd-4e92-a9b1-898152867ae2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:21.263990 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cdeb0-bdfd-4e92-a9b1-898152867ae2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:21.268623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa6728-b218-489f-9f84-8bcc6ac3e3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:21.269250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa6728-b218-489f-9f84-8bcc6ac3e3fe admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:21.269524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa6728-b218-489f-9f84-8bcc6ac3e3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:21.269793 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa6728-b218-489f-9f84-8bcc6ac3e3fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:21.270414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa6728-b218-489f-9f84-8bcc6ac3e3fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:21.272269 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa6728-b218-489f-9f84-8bcc6ac3e3fe admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:21.299736 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4451/8932] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:43:21 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:43:21.303891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f200a9b-ad08-42a6-8c32-9dee0d4117d1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:21.314281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f200a9b-ad08-42a6-8c32-9dee0d4117d1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:21.373543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63f59c-1c6f-4cea-979a-dae5183df869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:21.374142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63f59c-1c6f-4cea-979a-dae5183df869 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:21.374418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63f59c-1c6f-4cea-979a-dae5183df869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:21.374687 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63f59c-1c6f-4cea-979a-dae5183df869 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:21.375310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63f59c-1c6f-4cea-979a-dae5183df869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:21.377231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63f59c-1c6f-4cea-979a-dae5183df869 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:21.398100 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4482/8933] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:43:21 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:43:21.402780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa6728-b218-489f-9f84-8bcc6ac3e3fe admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:21.412962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa6728-b218-489f-9f84-8bcc6ac3e3fe admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:21.418342 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aee75-ea67-440a-9ede-dee57d317c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:21.418932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aee75-ea67-440a-9ede-dee57d317c04 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:21.419209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aee75-ea67-440a-9ede-dee57d317c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:21.419479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aee75-ea67-440a-9ede-dee57d317c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:21.420109 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aee75-ea67-440a-9ede-dee57d317c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:21.421710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aee75-ea67-440a-9ede-dee57d317c04 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:21.431555 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4452/8934] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:43:21.435468 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63f59c-1c6f-4cea-979a-dae5183df869 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:21.445412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63f59c-1c6f-4cea-979a-dae5183df869 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:21.450340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e097f9f-7d2e-4cd0-900a-5352fe040f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:21.450929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e097f9f-7d2e-4cd0-900a-5352fe040f41 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:21.451206 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e097f9f-7d2e-4cd0-900a-5352fe040f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:21.451477 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e097f9f-7d2e-4cd0-900a-5352fe040f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:21.452139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e097f9f-7d2e-4cd0-900a-5352fe040f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:21.453749 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e097f9f-7d2e-4cd0-900a-5352fe040f41 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:21.459009 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:43:21.465751 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4483/8935] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:43:21.469525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aee75-ea67-440a-9ede-dee57d317c04 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:21.479629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aee75-ea67-440a-9ede-dee57d317c04 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:21.484679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716e3fc-abec-4c76-a7ac-55908a6bb64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:21.485316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716e3fc-abec-4c76-a7ac-55908a6bb64d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:21.485592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716e3fc-abec-4c76-a7ac-55908a6bb64d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:21.485863 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716e3fc-abec-4c76-a7ac-55908a6bb64d admin admin] PATH_INFO: `/v3/projects/a8941c759d1d4192ac0946a71da71bb3/users/2a3578868bd2421396f096dc47a000cb/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:21.501083 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716e3fc-abec-4c76-a7ac-55908a6bb64d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8941c759d1d4192ac0946a71da71bb3, user_id=2a3578868bd2421396f096dc47a000cb, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:21.503644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716e3fc-abec-4c76-a7ac-55908a6bb64d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:21.516438 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4453/8936] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:43:21 2022] PUT /identity/v3/projects/a8941c759d1d4192ac0946a71da71bb3/users/2a3578868bd2421396f096dc47a000cb/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:43:21.521415 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8183813-c504-472b-9030-21d8a81e845a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:21.521901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8183813-c504-472b-9030-21d8a81e845a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:21.522021 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8183813-c504-472b-9030-21d8a81e845a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:21.540533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e8183813-c504-472b-9030-21d8a81e845a None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:43:21.541753 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e8183813-c504-472b-9030-21d8a81e845a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:21.600376 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4484/8937] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:43:21.610349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716e3fc-abec-4c76-a7ac-55908a6bb64d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:21.612129 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e716e3fc-abec-4c76-a7ac-55908a6bb64d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:21.681089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716e3fc-abec-4c76-a7ac-55908a6bb64d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:21.684740 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287a529-4aea-4016-b068-4779d82549a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:21.685338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287a529-4aea-4016-b068-4779d82549a5 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:21.685615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287a529-4aea-4016-b068-4779d82549a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:21.685907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287a529-4aea-4016-b068-4779d82549a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:21.694840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287a529-4aea-4016-b068-4779d82549a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:21.696491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287a529-4aea-4016-b068-4779d82549a5 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:21.705843 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4454/8938] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:43:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:43:24.193069 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8183813-c504-472b-9030-21d8a81e845a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:24.194599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e8183813-c504-472b-9030-21d8a81e845a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:24.339075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8183813-c504-472b-9030-21d8a81e845a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:24.345327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f983f-bd13-46a8-8236-4cb7f9d155fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:24.345851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f983f-bd13-46a8-8236-4cb7f9d155fa service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:24.346128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f983f-bd13-46a8-8236-4cb7f9d155fa service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:24.346394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f983f-bd13-46a8-8236-4cb7f9d155fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:24.349698 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-953f983f-bd13-46a8-8236-4cb7f9d155fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:24.368704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f983f-bd13-46a8-8236-4cb7f9d155fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:24.370307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f983f-bd13-46a8-8236-4cb7f9d155fa service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:24.382823 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4485/8939] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:43:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:43:26.141770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490546a-037b-4e95-a0fd-6ba33fbd6308 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:26.142319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490546a-037b-4e95-a0fd-6ba33fbd6308 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:26.142474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490546a-037b-4e95-a0fd-6ba33fbd6308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:26.175910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f490546a-037b-4e95-a0fd-6ba33fbd6308 None None] MFA Rules not processed for user `2a3578868bd2421396f096dc47a000cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:43:26.177168 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f490546a-037b-4e95-a0fd-6ba33fbd6308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:26.228063 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:43:26.250997 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4455/8940] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:43:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:43:26.264049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67f732-c349-411c-8c2e-613d3f82487a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:26.264651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67f732-c349-411c-8c2e-613d3f82487a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:26.264651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67f732-c349-411c-8c2e-613d3f82487a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:26.288635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cd67f732-c349-411c-8c2e-613d3f82487a None None] MFA Rules not processed for user `2a3578868bd2421396f096dc47a000cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:43:26.290451 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cd67f732-c349-411c-8c2e-613d3f82487a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:26.298093 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4486/8941] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:43:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:43:26.310221 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490546a-037b-4e95-a0fd-6ba33fbd6308 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:26.311599 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f490546a-037b-4e95-a0fd-6ba33fbd6308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:26.410668 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490546a-037b-4e95-a0fd-6ba33fbd6308 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:26.416698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baed179-0beb-4aff-904d-1ad107edde6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:26.417314 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baed179-0beb-4aff-904d-1ad107edde6a service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:26.417581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baed179-0beb-4aff-904d-1ad107edde6a service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:26.417849 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baed179-0beb-4aff-904d-1ad107edde6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:26.425371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baed179-0beb-4aff-904d-1ad107edde6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:26.426922 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baed179-0beb-4aff-904d-1ad107edde6a service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:26.436259 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4456/8942] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:43:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:43:26.687710 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32388bbf-35a7-403d-a39b-3a21c5af9d06 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:26.687998 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32388bbf-35a7-403d-a39b-3a21c5af9d06 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:26.688307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32388bbf-35a7-403d-a39b-3a21c5af9d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:26.708566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-32388bbf-35a7-403d-a39b-3a21c5af9d06 None None] MFA Rules not processed for user `a9b0fd833b134a089433cd2985caba80`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:43:26.709826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-32388bbf-35a7-403d-a39b-3a21c5af9d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:26.716775 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4487/8943] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:43:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:43:26.728872 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baed179-0beb-4aff-904d-1ad107edde6a service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:26.738213 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baed179-0beb-4aff-904d-1ad107edde6a service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:26.741797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f56d67-d5bd-4008-8872-3a7ab9202027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:26.742389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f56d67-d5bd-4008-8872-3a7ab9202027 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:26.743528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f56d67-d5bd-4008-8872-3a7ab9202027 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:26.743824 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f56d67-d5bd-4008-8872-3a7ab9202027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:26.750904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f56d67-d5bd-4008-8872-3a7ab9202027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:26.752289 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f56d67-d5bd-4008-8872-3a7ab9202027 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:26.760828 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4457/8944] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:43:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:43:27.716000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32388bbf-35a7-403d-a39b-3a21c5af9d06 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:27.717500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-32388bbf-35a7-403d-a39b-3a21c5af9d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:27.732755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32388bbf-35a7-403d-a39b-3a21c5af9d06 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:27.737680 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd15a33-e0f3-4b7e-8b69-fa631325ec42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:27.738281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd15a33-e0f3-4b7e-8b69-fa631325ec42 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:27.738561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd15a33-e0f3-4b7e-8b69-fa631325ec42 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:27.738834 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd15a33-e0f3-4b7e-8b69-fa631325ec42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:27.740556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3fd15a33-e0f3-4b7e-8b69-fa631325ec42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:27.752538 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd15a33-e0f3-4b7e-8b69-fa631325ec42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:27.754393 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd15a33-e0f3-4b7e-8b69-fa631325ec42 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:27.764949 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4488/8945] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:43:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:43:36.756646 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=54 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:43:37.760751 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=71 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:43:37.818218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27302ff-a5c5-4eca-8b59-5dec0d6f583f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:37.818692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27302ff-a5c5-4eca-8b59-5dec0d6f583f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:37.818692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27302ff-a5c5-4eca-8b59-5dec0d6f583f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:37.839115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d27302ff-a5c5-4eca-8b59-5dec0d6f583f None None] MFA Rules not processed for user `2a3578868bd2421396f096dc47a000cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:43:37.840338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d27302ff-a5c5-4eca-8b59-5dec0d6f583f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:37.847218 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4458/8946] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:43:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:43:47.833794 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:43:59.870491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5f6d0-5392-4661-af2c-3af9d366c601 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:59.871958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5f6d0-5392-4661-af2c-3af9d366c601 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:59.872290 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5f6d0-5392-4661-af2c-3af9d366c601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:59.894079 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-58b5f6d0-5392-4661-af2c-3af9d366c601 None None] MFA Rules not processed for user `cbb22d0675bc4ca893b0477cebd470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:43:59.895314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-58b5f6d0-5392-4661-af2c-3af9d366c601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:43:59.906948 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4489/8947] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 10:43:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:43:59.924954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27302ff-a5c5-4eca-8b59-5dec0d6f583f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:59.935730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5f6d0-5392-4661-af2c-3af9d366c601 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:43:59.940652 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27302ff-a5c5-4eca-8b59-5dec0d6f583f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:59.947843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab9f7d-0090-4112-916a-ee39a4cbcf24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:59.948055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5f6d0-5392-4661-af2c-3af9d366c601 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:43:59.949291 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab9f7d-0090-4112-916a-ee39a4cbcf24 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:59.949750 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab9f7d-0090-4112-916a-ee39a4cbcf24 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:59.950337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab9f7d-0090-4112-916a-ee39a4cbcf24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:59.954124 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0cadc0-8bf3-471f-a567-387a922e6276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:43:59.954824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cadc0-8bf3-471f-a567-387a922e6276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:43:59.955106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cadc0-8bf3-471f-a567-387a922e6276 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:43:59.955382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cadc0-8bf3-471f-a567-387a922e6276 admin admin] PATH_INFO: `/v3/users/2a3578868bd2421396f096dc47a000cb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:43:59.956877 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0cadc0-8bf3-471f-a567-387a922e6276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a3578868bd2421396f096dc47a000cb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:59.959490 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0cadc0-8bf3-471f-a567-387a922e6276 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:59.960280 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab9f7d-0090-4112-916a-ee39a4cbcf24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:43:59.961875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab9f7d-0090-4112-916a-ee39a4cbcf24 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:43:59.973396 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4459/8948] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:43:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:44:00.010011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d0cadc0-8bf3-471f-a567-387a922e6276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a3578868bd2421396f096dc47a000cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:00.011382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d0cadc0-8bf3-471f-a567-387a922e6276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a3578868bd2421396f096dc47a000cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:00.018742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d0cadc0-8bf3-471f-a567-387a922e6276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a3578868bd2421396f096dc47a000cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:00.030763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d0cadc0-8bf3-471f-a567-387a922e6276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a3578868bd2421396f096dc47a000cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:00.037543 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d0cadc0-8bf3-471f-a567-387a922e6276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a3578868bd2421396f096dc47a000cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:00.043537 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4490/8949] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:43:59 2022] DELETE /identity/v3/users/2a3578868bd2421396f096dc47a000cb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:44:00.218459 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab9f7d-0090-4112-916a-ee39a4cbcf24 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:00.231265 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab9f7d-0090-4112-916a-ee39a4cbcf24 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:00.291334 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe8851-b36c-4f08-bac7-813c2ca0aed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:00.292499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe8851-b36c-4f08-bac7-813c2ca0aed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:00.292788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe8851-b36c-4f08-bac7-813c2ca0aed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:00.293094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe8851-b36c-4f08-bac7-813c2ca0aed5 admin admin] PATH_INFO: `/v3/projects/a8941c759d1d4192ac0946a71da71bb3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:00.294197 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe8851-b36c-4f08-bac7-813c2ca0aed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8941c759d1d4192ac0946a71da71bb3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:00.296057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe8851-b36c-4f08-bac7-813c2ca0aed5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:00.342293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-18fe8851-b36c-4f08-bac7-813c2ca0aed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8941c759d1d4192ac0946a71da71bb3', 'request_id': 'req-18fe8851-b36c-4f08-bac7-813c2ca0aed5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:00.349580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-18fe8851-b36c-4f08-bac7-813c2ca0aed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8941c759d1d4192ac0946a71da71bb3', 'request_id': 'req-18fe8851-b36c-4f08-bac7-813c2ca0aed5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:00.356337 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-18fe8851-b36c-4f08-bac7-813c2ca0aed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8941c759d1d4192ac0946a71da71bb3', 'request_id': 'req-18fe8851-b36c-4f08-bac7-813c2ca0aed5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:00.367140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-18fe8851-b36c-4f08-bac7-813c2ca0aed5 admin admin] The token cache is being invalidate because project a8941c759d1d4192ac0946a71da71bb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:44:00.367424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-18fe8851-b36c-4f08-bac7-813c2ca0aed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:00.368057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-18fe8851-b36c-4f08-bac7-813c2ca0aed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:00.369545 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4460/8950] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:44:00 2022] DELETE /identity/v3/projects/a8941c759d1d4192ac0946a71da71bb3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:44:00.375083 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab0b05-03c0-4d39-be48-ae0652c542a7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:00.375368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab0b05-03c0-4d39-be48-ae0652c542a7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:00.375659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab0b05-03c0-4d39-be48-ae0652c542a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:00.413840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-82ab0b05-03c0-4d39-be48-ae0652c542a7 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:44:00.415048 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-82ab0b05-03c0-4d39-be48-ae0652c542a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:00.475493 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4491/8951] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:44:00.484493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b492415-72d9-47c7-9d37-674d481121cc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:00.484819 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b492415-72d9-47c7-9d37-674d481121cc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:00.485092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b492415-72d9-47c7-9d37-674d481121cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:00.504950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7b492415-72d9-47c7-9d37-674d481121cc None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:44:00.506149 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7b492415-72d9-47c7-9d37-674d481121cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:00.515256 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4461/8952] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:44:00.519505 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab0b05-03c0-4d39-be48-ae0652c542a7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:00.530224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab0b05-03c0-4d39-be48-ae0652c542a7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:00.534782 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cff79c-80c2-4348-a604-1c3fd5a8b2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:00.535373 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cff79c-80c2-4348-a604-1c3fd5a8b2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:00.535651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cff79c-80c2-4348-a604-1c3fd5a8b2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:00.535923 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cff79c-80c2-4348-a604-1c3fd5a8b2c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:00.536559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cff79c-80c2-4348-a604-1c3fd5a8b2c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:44:00.536899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cff79c-80c2-4348-a604-1c3fd5a8b2c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:00.538466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cff79c-80c2-4348-a604-1c3fd5a8b2c5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:00.550016 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4492/8953] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:44:00.554206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b492415-72d9-47c7-9d37-674d481121cc None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:00.563561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b492415-72d9-47c7-9d37-674d481121cc None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:00.568098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04b82a-f470-47c4-8a11-dfcb581ecb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:00.568727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04b82a-f470-47c4-8a11-dfcb581ecb5b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:00.569006 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04b82a-f470-47c4-8a11-dfcb581ecb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:00.569277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04b82a-f470-47c4-8a11-dfcb581ecb5b admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:00.569894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04b82a-f470-47c4-8a11-dfcb581ecb5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:00.571746 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04b82a-f470-47c4-8a11-dfcb581ecb5b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:00.608817 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4462/8954] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:44:00 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:44:00.612850 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cff79c-80c2-4348-a604-1c3fd5a8b2c5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:00.623275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cff79c-80c2-4348-a604-1c3fd5a8b2c5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:00.656808 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:44:00.682170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc3858-66e1-4761-9641-09e3272889c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:00.683335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc3858-66e1-4761-9641-09e3272889c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:00.683636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc3858-66e1-4761-9641-09e3272889c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:00.683904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc3858-66e1-4761-9641-09e3272889c9 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:00.684581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc3858-66e1-4761-9641-09e3272889c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:00.687226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc3858-66e1-4761-9641-09e3272889c9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:00.708048 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4493/8955] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:44:00 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:44:00.712138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04b82a-f470-47c4-8a11-dfcb581ecb5b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:00.723009 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04b82a-f470-47c4-8a11-dfcb581ecb5b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:00.727482 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fd706-f454-4990-927f-d1dea404822e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:00.728068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fd706-f454-4990-927f-d1dea404822e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:00.728345 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fd706-f454-4990-927f-d1dea404822e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:00.728638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fd706-f454-4990-927f-d1dea404822e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:00.729371 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fd706-f454-4990-927f-d1dea404822e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:00.731386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fd706-f454-4990-927f-d1dea404822e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:00.741142 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4463/8956] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:44:00.745724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc3858-66e1-4761-9641-09e3272889c9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:00.755688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc3858-66e1-4761-9641-09e3272889c9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:00.760252 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f218124-b318-467f-9c56-869e66fa3fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:00.760948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f218124-b318-467f-9c56-869e66fa3fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:00.761227 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f218124-b318-467f-9c56-869e66fa3fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:00.761499 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f218124-b318-467f-9c56-869e66fa3fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:00.762133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f218124-b318-467f-9c56-869e66fa3fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:00.763707 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f218124-b318-467f-9c56-869e66fa3fd2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:00.773828 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4494/8957] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:44:00.778800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fd706-f454-4990-927f-d1dea404822e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:00.788785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fd706-f454-4990-927f-d1dea404822e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:00.793503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e53ae-14db-4676-8842-2d941a2e10d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:00.794135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e53ae-14db-4676-8842-2d941a2e10d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:00.794407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e53ae-14db-4676-8842-2d941a2e10d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:00.794727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e53ae-14db-4676-8842-2d941a2e10d4 admin admin] PATH_INFO: `/v3/projects/3dc2867159434615b586578a72617150/users/cfe119b3dd9145e6896bb98c454a34c9/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:00.809762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e53ae-14db-4676-8842-2d941a2e10d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc2867159434615b586578a72617150, user_id=cfe119b3dd9145e6896bb98c454a34c9, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:00.812363 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e53ae-14db-4676-8842-2d941a2e10d4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:00.824698 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4464/8958] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:44:00 2022] PUT /identity/v3/projects/3dc2867159434615b586578a72617150/users/cfe119b3dd9145e6896bb98c454a34c9/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:44:00.834632 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f98759-b581-4bf0-af29-deb479defab3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:00.834916 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f98759-b581-4bf0-af29-deb479defab3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:00.835184 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f98759-b581-4bf0-af29-deb479defab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:00.863675 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c7f98759-b581-4bf0-af29-deb479defab3 None None] MFA Rules not processed for user `cfe119b3dd9145e6896bb98c454a34c9`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:44:00.864819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c7f98759-b581-4bf0-af29-deb479defab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:00.929008 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4495/8959] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:44:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:44:00.939284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e53ae-14db-4676-8842-2d941a2e10d4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:00.941038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-426e53ae-14db-4676-8842-2d941a2e10d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:00.947582 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:44:01.001403 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e53ae-14db-4676-8842-2d941a2e10d4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:01.005086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e96c5-adff-4112-8ba0-b0a696f6915c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:01.005688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e96c5-adff-4112-8ba0-b0a696f6915c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:01.005974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e96c5-adff-4112-8ba0-b0a696f6915c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:01.006250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e96c5-adff-4112-8ba0-b0a696f6915c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:01.015160 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e96c5-adff-4112-8ba0-b0a696f6915c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:01.016565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e96c5-adff-4112-8ba0-b0a696f6915c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:01.025340 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4465/8960] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:44:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:44:10.926995 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=49,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:44:11.021342 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=24 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:44:11.401545 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f98759-b581-4bf0-af29-deb479defab3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:11.468082 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f98759-b581-4bf0-af29-deb479defab3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:11.472586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10ebf7-e4da-4e8a-b91c-b22856d7ad19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:11.473238 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10ebf7-e4da-4e8a-b91c-b22856d7ad19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:11.473534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10ebf7-e4da-4e8a-b91c-b22856d7ad19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:11.473787 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10ebf7-e4da-4e8a-b91c-b22856d7ad19 admin admin] PATH_INFO: `/v3/users/cfe119b3dd9145e6896bb98c454a34c9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:11.474905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10ebf7-e4da-4e8a-b91c-b22856d7ad19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe119b3dd9145e6896bb98c454a34c9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:11.476819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10ebf7-e4da-4e8a-b91c-b22856d7ad19 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:11.523516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a10ebf7-e4da-4e8a-b91c-b22856d7ad19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe119b3dd9145e6896bb98c454a34c9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:11.524065 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a10ebf7-e4da-4e8a-b91c-b22856d7ad19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe119b3dd9145e6896bb98c454a34c9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:11.532741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a10ebf7-e4da-4e8a-b91c-b22856d7ad19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe119b3dd9145e6896bb98c454a34c9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:11.544915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a10ebf7-e4da-4e8a-b91c-b22856d7ad19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe119b3dd9145e6896bb98c454a34c9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:11.551887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a10ebf7-e4da-4e8a-b91c-b22856d7ad19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe119b3dd9145e6896bb98c454a34c9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:11.558048 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4496/8961] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:44:11 2022] DELETE /identity/v3/users/cfe119b3dd9145e6896bb98c454a34c9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:44:11.562568 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165653bc-f491-4555-86cd-4df6a6966a5d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:11.562850 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165653bc-f491-4555-86cd-4df6a6966a5d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:11.563123 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165653bc-f491-4555-86cd-4df6a6966a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:11.582649 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-165653bc-f491-4555-86cd-4df6a6966a5d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:44:11.583848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-165653bc-f491-4555-86cd-4df6a6966a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:11.642345 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4466/8962] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:44:11.652658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10ebf7-e4da-4e8a-b91c-b22856d7ad19 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:11.654093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4a10ebf7-e4da-4e8a-b91c-b22856d7ad19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:11.710127 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10ebf7-e4da-4e8a-b91c-b22856d7ad19 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:11.714286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58225a-3601-43e8-910b-251065a88926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:11.714975 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58225a-3601-43e8-910b-251065a88926 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:11.715255 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58225a-3601-43e8-910b-251065a88926 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:11.715526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58225a-3601-43e8-910b-251065a88926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:11.724413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58225a-3601-43e8-910b-251065a88926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:11.725872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58225a-3601-43e8-910b-251065a88926 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:11.738069 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4497/8963] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:44:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:44:11.911718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165653bc-f491-4555-86cd-4df6a6966a5d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:11.913257 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-165653bc-f491-4555-86cd-4df6a6966a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:11.929598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165653bc-f491-4555-86cd-4df6a6966a5d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:11.935005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59e046-3cbc-45d9-a09d-0c30f32cd459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:11.935646 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59e046-3cbc-45d9-a09d-0c30f32cd459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:11.935920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59e046-3cbc-45d9-a09d-0c30f32cd459 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:11.936186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59e046-3cbc-45d9-a09d-0c30f32cd459 admin admin] PATH_INFO: `/v3/projects/3dc2867159434615b586578a72617150` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:11.937561 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59e046-3cbc-45d9-a09d-0c30f32cd459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dc2867159434615b586578a72617150)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:11.940053 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59e046-3cbc-45d9-a09d-0c30f32cd459 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:11.990086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cc59e046-3cbc-45d9-a09d-0c30f32cd459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc2867159434615b586578a72617150', 'request_id': 'req-cc59e046-3cbc-45d9-a09d-0c30f32cd459'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:11.998407 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cc59e046-3cbc-45d9-a09d-0c30f32cd459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc2867159434615b586578a72617150', 'request_id': 'req-cc59e046-3cbc-45d9-a09d-0c30f32cd459'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:12.004040 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cc59e046-3cbc-45d9-a09d-0c30f32cd459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc2867159434615b586578a72617150', 'request_id': 'req-cc59e046-3cbc-45d9-a09d-0c30f32cd459'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:12.016007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cc59e046-3cbc-45d9-a09d-0c30f32cd459 admin admin] The token cache is being invalidate because project 3dc2867159434615b586578a72617150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:44:12.016293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cc59e046-3cbc-45d9-a09d-0c30f32cd459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:12.016941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cc59e046-3cbc-45d9-a09d-0c30f32cd459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:12.018422 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4467/8964] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:44:11 2022] DELETE /identity/v3/projects/3dc2867159434615b586578a72617150 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:44:12.023562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ca624-c203-47b2-a8ce-12ffb0a7e555 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:12.024034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ca624-c203-47b2-a8ce-12ffb0a7e555 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:12.024136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ca624-c203-47b2-a8ce-12ffb0a7e555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:12.043130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e07ca624-c203-47b2-a8ce-12ffb0a7e555 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:44:12.044241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e07ca624-c203-47b2-a8ce-12ffb0a7e555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:12.061515 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:44:12.105791 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4498/8965] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:44:12.113679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644df2d7-6816-41c6-9d14-17ff3ef96eac None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:12.114140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644df2d7-6816-41c6-9d14-17ff3ef96eac None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:12.114235 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644df2d7-6816-41c6-9d14-17ff3ef96eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:12.134210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-644df2d7-6816-41c6-9d14-17ff3ef96eac None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:44:12.135468 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-644df2d7-6816-41c6-9d14-17ff3ef96eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:12.143589 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4468/8966] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:44:12.147962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ca624-c203-47b2-a8ce-12ffb0a7e555 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:12.158637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ca624-c203-47b2-a8ce-12ffb0a7e555 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:12.163241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd38bc-1070-42e8-896a-cbb171e444a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:12.163828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd38bc-1070-42e8-896a-cbb171e444a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:12.164106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd38bc-1070-42e8-896a-cbb171e444a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:12.164376 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd38bc-1070-42e8-896a-cbb171e444a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:12.165049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd38bc-1070-42e8-896a-cbb171e444a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:44:12.165352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd38bc-1070-42e8-896a-cbb171e444a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:12.167568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd38bc-1070-42e8-896a-cbb171e444a3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:12.179081 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4499/8967] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:44:12.183477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644df2d7-6816-41c6-9d14-17ff3ef96eac None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:12.192900 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644df2d7-6816-41c6-9d14-17ff3ef96eac None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:12.197586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b59e1-2738-4480-884f-f2b7fbf999c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:12.198369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b59e1-2738-4480-884f-f2b7fbf999c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:12.198655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b59e1-2738-4480-884f-f2b7fbf999c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:12.198925 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b59e1-2738-4480-884f-f2b7fbf999c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:12.199555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b59e1-2738-4480-884f-f2b7fbf999c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:12.201486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b59e1-2738-4480-884f-f2b7fbf999c4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:12.230518 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4469/8968] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:44:12 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:44:12.234803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd38bc-1070-42e8-896a-cbb171e444a3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:12.244805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd38bc-1070-42e8-896a-cbb171e444a3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:12.301848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afab5f-1d47-473c-abfe-64bd721482c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:12.302361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afab5f-1d47-473c-abfe-64bd721482c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:12.302639 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afab5f-1d47-473c-abfe-64bd721482c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:12.302908 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afab5f-1d47-473c-abfe-64bd721482c8 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:12.303569 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afab5f-1d47-473c-abfe-64bd721482c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:12.305927 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afab5f-1d47-473c-abfe-64bd721482c8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:12.333177 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4500/8969] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:44:12 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:44:12.335159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b59e1-2738-4480-884f-f2b7fbf999c4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:12.346733 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b59e1-2738-4480-884f-f2b7fbf999c4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:12.351614 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a7916-d6b8-4246-bb24-83e82361f9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:12.352438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a7916-d6b8-4246-bb24-83e82361f9bf admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:12.352831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a7916-d6b8-4246-bb24-83e82361f9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:12.353107 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a7916-d6b8-4246-bb24-83e82361f9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:12.353970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a7916-d6b8-4246-bb24-83e82361f9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:12.356192 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a7916-d6b8-4246-bb24-83e82361f9bf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:12.366264 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4470/8970] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:44:12.370462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afab5f-1d47-473c-abfe-64bd721482c8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:12.380244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afab5f-1d47-473c-abfe-64bd721482c8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:12.384817 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb89d15-b13c-4ea6-b1bd-773f1d19de92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:12.386119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb89d15-b13c-4ea6-b1bd-773f1d19de92 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:12.386242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb89d15-b13c-4ea6-b1bd-773f1d19de92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:12.386493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb89d15-b13c-4ea6-b1bd-773f1d19de92 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:12.387150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb89d15-b13c-4ea6-b1bd-773f1d19de92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:12.388743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb89d15-b13c-4ea6-b1bd-773f1d19de92 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:12.398649 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4501/8971] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:44:12.403513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a7916-d6b8-4246-bb24-83e82361f9bf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:12.413398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a7916-d6b8-4246-bb24-83e82361f9bf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:12.418301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fb7c9-9a80-476b-a842-de1a57b15242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:12.418939 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fb7c9-9a80-476b-a842-de1a57b15242 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:12.419216 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fb7c9-9a80-476b-a842-de1a57b15242 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:12.419487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fb7c9-9a80-476b-a842-de1a57b15242 admin admin] PATH_INFO: `/v3/projects/5e7e74d644084b74acc967d18197ffe8/users/ccc34eaa93ae43fa85f411259584e4f2/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:12.433848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fb7c9-9a80-476b-a842-de1a57b15242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e7e74d644084b74acc967d18197ffe8, user_id=ccc34eaa93ae43fa85f411259584e4f2, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:12.436450 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fb7c9-9a80-476b-a842-de1a57b15242 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:12.449958 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4471/8972] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:44:12 2022] PUT /identity/v3/projects/5e7e74d644084b74acc967d18197ffe8/users/ccc34eaa93ae43fa85f411259584e4f2/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:44:12.460851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ccac1-4ec7-41d8-9206-88addb3a7f60 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:12.461138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ccac1-4ec7-41d8-9206-88addb3a7f60 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:12.461408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ccac1-4ec7-41d8-9206-88addb3a7f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:12.491419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2d9ccac1-4ec7-41d8-9206-88addb3a7f60 None None] MFA Rules not processed for user `ccc34eaa93ae43fa85f411259584e4f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:44:12.492663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2d9ccac1-4ec7-41d8-9206-88addb3a7f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:12.559850 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4502/8973] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:44:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:44:12.569704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fb7c9-9a80-476b-a842-de1a57b15242 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:12.571426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6e2fb7c9-9a80-476b-a842-de1a57b15242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:12.595515 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:44:12.639486 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fb7c9-9a80-476b-a842-de1a57b15242 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:12.643141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d149ab-d39f-4c88-a2d9-b25c94aa6fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:12.643747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d149ab-d39f-4c88-a2d9-b25c94aa6fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:12.644022 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d149ab-d39f-4c88-a2d9-b25c94aa6fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:12.644292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d149ab-d39f-4c88-a2d9-b25c94aa6fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:12.652432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d149ab-d39f-4c88-a2d9-b25c94aa6fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:12.653865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d149ab-d39f-4c88-a2d9-b25c94aa6fd6 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:12.662581 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4472/8974] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:44:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:44:17.202837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ccac1-4ec7-41d8-9206-88addb3a7f60 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:17.222988 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:44:17.272750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ccac1-4ec7-41d8-9206-88addb3a7f60 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:17.278321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a7921-d4cd-4c8c-ae3a-671286549946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:17.278981 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a7921-d4cd-4c8c-ae3a-671286549946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:17.279285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a7921-d4cd-4c8c-ae3a-671286549946 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:17.279558 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a7921-d4cd-4c8c-ae3a-671286549946 admin admin] PATH_INFO: `/v3/users/ccc34eaa93ae43fa85f411259584e4f2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:17.280741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a7921-d4cd-4c8c-ae3a-671286549946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccc34eaa93ae43fa85f411259584e4f2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:17.282641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a7921-d4cd-4c8c-ae3a-671286549946 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:17.334205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-945a7921-d4cd-4c8c-ae3a-671286549946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccc34eaa93ae43fa85f411259584e4f2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:17.334858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-945a7921-d4cd-4c8c-ae3a-671286549946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccc34eaa93ae43fa85f411259584e4f2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:17.343442 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-945a7921-d4cd-4c8c-ae3a-671286549946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccc34eaa93ae43fa85f411259584e4f2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:17.357542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-945a7921-d4cd-4c8c-ae3a-671286549946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccc34eaa93ae43fa85f411259584e4f2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:17.365113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-945a7921-d4cd-4c8c-ae3a-671286549946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccc34eaa93ae43fa85f411259584e4f2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:17.376634 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4503/8975] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:44:17 2022] DELETE /identity/v3/users/ccc34eaa93ae43fa85f411259584e4f2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:44:17.376821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c002ed-3ccc-4cfd-bf18-be9f49c188d2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:17.376821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c002ed-3ccc-4cfd-bf18-be9f49c188d2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:17.376821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c002ed-3ccc-4cfd-bf18-be9f49c188d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:17.395756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-22c002ed-3ccc-4cfd-bf18-be9f49c188d2 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:44:17.396929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-22c002ed-3ccc-4cfd-bf18-be9f49c188d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:17.460109 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4473/8976] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:44:17.470467 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a7921-d4cd-4c8c-ae3a-671286549946 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:17.471925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-945a7921-d4cd-4c8c-ae3a-671286549946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:17.530464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a7921-d4cd-4c8c-ae3a-671286549946 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:17.534084 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030f78f-3246-461b-93cc-d18c73d27024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:17.534683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030f78f-3246-461b-93cc-d18c73d27024 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:17.534960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030f78f-3246-461b-93cc-d18c73d27024 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:17.535231 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030f78f-3246-461b-93cc-d18c73d27024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:17.544158 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030f78f-3246-461b-93cc-d18c73d27024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:17.545599 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030f78f-3246-461b-93cc-d18c73d27024 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:17.554907 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4504/8977] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:44:17.724159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c002ed-3ccc-4cfd-bf18-be9f49c188d2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:17.725582 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-22c002ed-3ccc-4cfd-bf18-be9f49c188d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:17.738503 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c002ed-3ccc-4cfd-bf18-be9f49c188d2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:17.743141 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e4b01-863f-474a-9482-d55e80ffd9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:17.743762 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e4b01-863f-474a-9482-d55e80ffd9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:17.744042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e4b01-863f-474a-9482-d55e80ffd9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:17.745241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e4b01-863f-474a-9482-d55e80ffd9e9 admin admin] PATH_INFO: `/v3/projects/5e7e74d644084b74acc967d18197ffe8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:17.746283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e4b01-863f-474a-9482-d55e80ffd9e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e7e74d644084b74acc967d18197ffe8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:17.749645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e4b01-863f-474a-9482-d55e80ffd9e9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:17.799162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-820e4b01-863f-474a-9482-d55e80ffd9e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e7e74d644084b74acc967d18197ffe8', 'request_id': 'req-820e4b01-863f-474a-9482-d55e80ffd9e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:17.806438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-820e4b01-863f-474a-9482-d55e80ffd9e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e7e74d644084b74acc967d18197ffe8', 'request_id': 'req-820e4b01-863f-474a-9482-d55e80ffd9e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:17.812674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-820e4b01-863f-474a-9482-d55e80ffd9e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e7e74d644084b74acc967d18197ffe8', 'request_id': 'req-820e4b01-863f-474a-9482-d55e80ffd9e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:17.823518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-820e4b01-863f-474a-9482-d55e80ffd9e9 admin admin] The token cache is being invalidate because project 5e7e74d644084b74acc967d18197ffe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:44:17.823802 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-820e4b01-863f-474a-9482-d55e80ffd9e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:17.824434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-820e4b01-863f-474a-9482-d55e80ffd9e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:44:17.826018 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4474/8978] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:44:17 2022] DELETE /identity/v3/projects/5e7e74d644084b74acc967d18197ffe8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:44:17.831092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dc59c-1d01-4a9d-a320-a0b8e3bb8545 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:17.831438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dc59c-1d01-4a9d-a320-a0b8e3bb8545 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:17.831718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dc59c-1d01-4a9d-a320-a0b8e3bb8545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:17.851982 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-463dc59c-1d01-4a9d-a320-a0b8e3bb8545 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:44:17.853235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-463dc59c-1d01-4a9d-a320-a0b8e3bb8545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:17.887391 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:44:17.914403 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4505/8979] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:44:17.922660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f245ae8-426b-45d5-a84b-6059bfb2dcdb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:17.922944 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f245ae8-426b-45d5-a84b-6059bfb2dcdb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:17.923210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f245ae8-426b-45d5-a84b-6059bfb2dcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:17.943105 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5f245ae8-426b-45d5-a84b-6059bfb2dcdb None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:44:17.944296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5f245ae8-426b-45d5-a84b-6059bfb2dcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:17.952436 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4475/8980] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:44:17.956823 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463dc59c-1d01-4a9d-a320-a0b8e3bb8545 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:17.966983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463dc59c-1d01-4a9d-a320-a0b8e3bb8545 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:17.971478 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39963026-890a-42ba-b289-cccb2e8522ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:17.972068 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39963026-890a-42ba-b289-cccb2e8522ed admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:17.972344 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39963026-890a-42ba-b289-cccb2e8522ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:17.972634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39963026-890a-42ba-b289-cccb2e8522ed admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:17.973298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39963026-890a-42ba-b289-cccb2e8522ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:44:17.973597 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39963026-890a-42ba-b289-cccb2e8522ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:17.975164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39963026-890a-42ba-b289-cccb2e8522ed admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:17.987427 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4506/8981] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:44:17.991674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f245ae8-426b-45d5-a84b-6059bfb2dcdb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:18.001310 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f245ae8-426b-45d5-a84b-6059bfb2dcdb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:18.006297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9e897-d8a2-4c07-904f-0d9f24c5a7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:18.006917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9e897-d8a2-4c07-904f-0d9f24c5a7bf admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:18.007193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9e897-d8a2-4c07-904f-0d9f24c5a7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:18.007458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9e897-d8a2-4c07-904f-0d9f24c5a7bf admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:18.008092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9e897-d8a2-4c07-904f-0d9f24c5a7bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:18.010077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9e897-d8a2-4c07-904f-0d9f24c5a7bf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:18.037680 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4476/8982] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:44:17 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:44:18.042757 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39963026-890a-42ba-b289-cccb2e8522ed admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:18.052706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39963026-890a-42ba-b289-cccb2e8522ed admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:18.109836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19a4fb-5b18-4a37-a444-3063e99942c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:18.110437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19a4fb-5b18-4a37-a444-3063e99942c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:18.110717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19a4fb-5b18-4a37-a444-3063e99942c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:18.110989 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19a4fb-5b18-4a37-a444-3063e99942c3 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:18.111605 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19a4fb-5b18-4a37-a444-3063e99942c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:18.113547 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19a4fb-5b18-4a37-a444-3063e99942c3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:18.134870 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4507/8983] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:44:18 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:44:18.139159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9e897-d8a2-4c07-904f-0d9f24c5a7bf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:18.149388 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9e897-d8a2-4c07-904f-0d9f24c5a7bf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:18.154826 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ed432-4d5d-418e-9ed2-eb147b76a9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:18.155428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ed432-4d5d-418e-9ed2-eb147b76a9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:18.155704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ed432-4d5d-418e-9ed2-eb147b76a9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:18.155973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ed432-4d5d-418e-9ed2-eb147b76a9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:18.156641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ed432-4d5d-418e-9ed2-eb147b76a9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:18.158240 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ed432-4d5d-418e-9ed2-eb147b76a9e0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:18.169103 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4477/8984] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:44:18.173035 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19a4fb-5b18-4a37-a444-3063e99942c3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:18.183239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19a4fb-5b18-4a37-a444-3063e99942c3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:18.187871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53269c9-809f-4794-9243-84f7451ff8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:18.188458 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53269c9-809f-4794-9243-84f7451ff8be admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:18.188778 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53269c9-809f-4794-9243-84f7451ff8be admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:18.189062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53269c9-809f-4794-9243-84f7451ff8be admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:18.189686 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53269c9-809f-4794-9243-84f7451ff8be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:18.191277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53269c9-809f-4794-9243-84f7451ff8be admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:18.202113 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4508/8985] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:44:18.206626 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ed432-4d5d-418e-9ed2-eb147b76a9e0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:18.217233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ed432-4d5d-418e-9ed2-eb147b76a9e0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:18.221760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2d2b5-44cb-4814-9b5e-b3a303a18c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:18.222401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2d2b5-44cb-4814-9b5e-b3a303a18c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:18.222685 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2d2b5-44cb-4814-9b5e-b3a303a18c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:18.222945 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2d2b5-44cb-4814-9b5e-b3a303a18c04 admin admin] PATH_INFO: `/v3/projects/40af59a7320b4e118ffc48d4f51017f4/users/5c1b8d5dcf234637b533a980a2af464b/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:18.225224 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:44:18.240920 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2d2b5-44cb-4814-9b5e-b3a303a18c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40af59a7320b4e118ffc48d4f51017f4, user_id=5c1b8d5dcf234637b533a980a2af464b, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:18.243536 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2d2b5-44cb-4814-9b5e-b3a303a18c04 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:18.256620 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4478/8986] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:44:18 2022] PUT /identity/v3/projects/40af59a7320b4e118ffc48d4f51017f4/users/5c1b8d5dcf234637b533a980a2af464b/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:44:18.262679 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7c539-9e53-4da9-833b-1acf398b448b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:18.263140 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7c539-9e53-4da9-833b-1acf398b448b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:18.263234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7c539-9e53-4da9-833b-1acf398b448b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:18.283719 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ded7c539-9e53-4da9-833b-1acf398b448b None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:44:18.285308 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ded7c539-9e53-4da9-833b-1acf398b448b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:18.351406 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4509/8987] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:44:18.362605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2d2b5-44cb-4814-9b5e-b3a303a18c04 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:18.364325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2ea2d2b5-44cb-4814-9b5e-b3a303a18c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:18.423319 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2d2b5-44cb-4814-9b5e-b3a303a18c04 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:18.427112 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91be34c-7fbe-4124-80cb-6f7a98dc96de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:18.427719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91be34c-7fbe-4124-80cb-6f7a98dc96de service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:18.428003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91be34c-7fbe-4124-80cb-6f7a98dc96de service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:18.428276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91be34c-7fbe-4124-80cb-6f7a98dc96de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:18.438243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91be34c-7fbe-4124-80cb-6f7a98dc96de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:18.439658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91be34c-7fbe-4124-80cb-6f7a98dc96de service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:18.449506 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4479/8988] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:44:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:44:22.573967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e81c6e-d23a-4215-a6ea-d6c337cc28a9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:22.574519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e81c6e-d23a-4215-a6ea-d6c337cc28a9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:22.574519 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e81c6e-d23a-4215-a6ea-d6c337cc28a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:22.603142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d8e81c6e-d23a-4215-a6ea-d6c337cc28a9 None None] MFA Rules not processed for user `5c1b8d5dcf234637b533a980a2af464b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:44:22.604502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d8e81c6e-d23a-4215-a6ea-d6c337cc28a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:22.641658 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:44:22.674963 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4510/8989] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:44:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:44:22.679343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91be34c-7fbe-4124-80cb-6f7a98dc96de service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:22.690092 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91be34c-7fbe-4124-80cb-6f7a98dc96de service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:22.694601 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773205a4-3d58-4c98-adfa-8aec383b6fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:22.695252 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773205a4-3d58-4c98-adfa-8aec383b6fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:22.695457 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773205a4-3d58-4c98-adfa-8aec383b6fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:22.695726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773205a4-3d58-4c98-adfa-8aec383b6fc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:22.696347 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773205a4-3d58-4c98-adfa-8aec383b6fc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:22.698994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773205a4-3d58-4c98-adfa-8aec383b6fc5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:22.727172 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4480/8990] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:44:22 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:44:22.732138 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e81c6e-d23a-4215-a6ea-d6c337cc28a9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:22.745067 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e81c6e-d23a-4215-a6ea-d6c337cc28a9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:22.803295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef672ac-37dd-47a8-8913-7e2717ac8f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:22.803913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef672ac-37dd-47a8-8913-7e2717ac8f1e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:22.804202 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef672ac-37dd-47a8-8913-7e2717ac8f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:22.804476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef672ac-37dd-47a8-8913-7e2717ac8f1e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:22.805154 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef672ac-37dd-47a8-8913-7e2717ac8f1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:22.807654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef672ac-37dd-47a8-8913-7e2717ac8f1e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:22.833705 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4511/8991] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:44:22 2022] POST /identity/v3/users => generated 301 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:44:22.837821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773205a4-3d58-4c98-adfa-8aec383b6fc5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:22.850177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773205a4-3d58-4c98-adfa-8aec383b6fc5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:22.859667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b630e-511b-4559-bb4e-eff2c15170df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:22.860381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b630e-511b-4559-bb4e-eff2c15170df admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:22.860831 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b630e-511b-4559-bb4e-eff2c15170df admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:22.861330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b630e-511b-4559-bb4e-eff2c15170df admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:22.862360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b630e-511b-4559-bb4e-eff2c15170df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:22.863941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b630e-511b-4559-bb4e-eff2c15170df admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:22.876378 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4481/8992] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:44:22.880587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef672ac-37dd-47a8-8913-7e2717ac8f1e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:22.896378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef672ac-37dd-47a8-8913-7e2717ac8f1e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:22.901602 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21c31a-7e8a-4430-bbef-1c474d54d26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:22.902361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21c31a-7e8a-4430-bbef-1c474d54d26c admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:22.902723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21c31a-7e8a-4430-bbef-1c474d54d26c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:22.903091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21c31a-7e8a-4430-bbef-1c474d54d26c admin admin] PATH_INFO: `/v3/projects/cbf064bdaab342818727115fcd9c13cc/users/ac6c3ebb194647e78c250ebb1b23f034/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:22.925972 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21c31a-7e8a-4430-bbef-1c474d54d26c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf064bdaab342818727115fcd9c13cc, user_id=ac6c3ebb194647e78c250ebb1b23f034, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:22.928786 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21c31a-7e8a-4430-bbef-1c474d54d26c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:22.943875 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4512/8993] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:44:22 2022] PUT /identity/v3/projects/cbf064bdaab342818727115fcd9c13cc/users/ac6c3ebb194647e78c250ebb1b23f034/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:44:22.948542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b630e-511b-4559-bb4e-eff2c15170df admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:22.959078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b630e-511b-4559-bb4e-eff2c15170df admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:23.027628 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46eebf-39f5-412e-a43c-6cfb9fae09bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:23.028254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46eebf-39f5-412e-a43c-6cfb9fae09bd admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:23.028537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46eebf-39f5-412e-a43c-6cfb9fae09bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:23.028864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46eebf-39f5-412e-a43c-6cfb9fae09bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:23.029580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46eebf-39f5-412e-a43c-6cfb9fae09bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:23.031111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46eebf-39f5-412e-a43c-6cfb9fae09bd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:23.047363 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4482/8994] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:44:23.048371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21c31a-7e8a-4430-bbef-1c474d54d26c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:23.059514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21c31a-7e8a-4430-bbef-1c474d54d26c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:23.064332 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721751e2-0284-4a97-8a2a-e94ff3cc3b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:23.065323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721751e2-0284-4a97-8a2a-e94ff3cc3b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:23.065798 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721751e2-0284-4a97-8a2a-e94ff3cc3b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:23.066275 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721751e2-0284-4a97-8a2a-e94ff3cc3b91 admin admin] PATH_INFO: `/v3/projects/cbf064bdaab342818727115fcd9c13cc/users/ac6c3ebb194647e78c250ebb1b23f034/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:23.068514 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721751e2-0284-4a97-8a2a-e94ff3cc3b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf064bdaab342818727115fcd9c13cc, user_id=ac6c3ebb194647e78c250ebb1b23f034, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:23.071820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721751e2-0284-4a97-8a2a-e94ff3cc3b91 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:23.084751 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4513/8995] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:44:23 2022] PUT /identity/v3/projects/cbf064bdaab342818727115fcd9c13cc/users/ac6c3ebb194647e78c250ebb1b23f034/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 10:44:27.505063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f3874-493c-4099-83c4-e71e4017cf2c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:27.505571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f3874-493c-4099-83c4-e71e4017cf2c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:27.505571 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f3874-493c-4099-83c4-e71e4017cf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:27.537754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4b7f3874-493c-4099-83c4-e71e4017cf2c None None] MFA Rules not processed for user `ac6c3ebb194647e78c250ebb1b23f034`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:44:27.538996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4b7f3874-493c-4099-83c4-e71e4017cf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:27.579818 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:44:27.612953 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4483/8996] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:44:27 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:44:27.633359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721751e2-0284-4a97-8a2a-e94ff3cc3b91 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:27.635396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-721751e2-0284-4a97-8a2a-e94ff3cc3b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:27.710286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721751e2-0284-4a97-8a2a-e94ff3cc3b91 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:27.718254 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a918259-f1e0-4d53-8396-ba8c036b9402 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:27.719220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a918259-f1e0-4d53-8396-ba8c036b9402 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:27.719500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a918259-f1e0-4d53-8396-ba8c036b9402 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:27.719769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a918259-f1e0-4d53-8396-ba8c036b9402 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:27.753627 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:44:27.801098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a918259-f1e0-4d53-8396-ba8c036b9402 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:27.803019 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a918259-f1e0-4d53-8396-ba8c036b9402 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:27.814684 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4514/8997] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:44:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:44:27.885666 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c7dd3-a27a-4e45-af17-ea93d2bebc12 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:27.886097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c7dd3-a27a-4e45-af17-ea93d2bebc12 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:27.886389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c7dd3-a27a-4e45-af17-ea93d2bebc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:27.909167 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-015c7dd3-a27a-4e45-af17-ea93d2bebc12 None None] MFA Rules not processed for user `5c1b8d5dcf234637b533a980a2af464b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:44:27.910543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-015c7dd3-a27a-4e45-af17-ea93d2bebc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:27.920080 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4484/8998] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:44:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:44:28.553601 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a918259-f1e0-4d53-8396-ba8c036b9402 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:28.554983 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3a918259-f1e0-4d53-8396-ba8c036b9402 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:28.624760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a918259-f1e0-4d53-8396-ba8c036b9402 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:28.629799 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814d691-cc81-471f-b4c2-c4ba0aea1fd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:28.630398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814d691-cc81-471f-b4c2-c4ba0aea1fd0 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:28.630678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814d691-cc81-471f-b4c2-c4ba0aea1fd0 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:28.630953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814d691-cc81-471f-b4c2-c4ba0aea1fd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:28.632702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6814d691-cc81-471f-b4c2-c4ba0aea1fd0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:28.649130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814d691-cc81-471f-b4c2-c4ba0aea1fd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:28.651431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814d691-cc81-471f-b4c2-c4ba0aea1fd0 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:28.661632 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4515/8999] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:44:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:44:37.901909 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=15 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:44:38.228296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c7dd3-a27a-4e45-af17-ea93d2bebc12 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:44:38.229710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-015c7dd3-a27a-4e45-af17-ea93d2bebc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:44:38.285428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c7dd3-a27a-4e45-af17-ea93d2bebc12 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:44:38.289121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb00eda-a099-4c27-ae53-24d6d8668479 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:44:38.289728 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb00eda-a099-4c27-ae53-24d6d8668479 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:44:38.290008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb00eda-a099-4c27-ae53-24d6d8668479 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:44:38.290282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb00eda-a099-4c27-ae53-24d6d8668479 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:44:38.299220 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb00eda-a099-4c27-ae53-24d6d8668479 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:44:38.300640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb00eda-a099-4c27-ae53-24d6d8668479 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:44:38.310372 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4485/9000] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:44:38 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:44:38.657248 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=48 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:44:48.305752 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=26 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:45:03.532694 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38d6e7-a403-4fdc-9e0f-f0cfe715292b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:45:03.533224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38d6e7-a403-4fdc-9e0f-f0cfe715292b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:45:03.533224 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38d6e7-a403-4fdc-9e0f-f0cfe715292b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:45:03.552310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bd38d6e7-a403-4fdc-9e0f-f0cfe715292b None None] MFA Rules not processed for user `5c1b8d5dcf234637b533a980a2af464b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:45:03.553534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bd38d6e7-a403-4fdc-9e0f-f0cfe715292b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:45:03.560999 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4516/9001] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:45:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:45:04.144104 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb00eda-a099-4c27-ae53-24d6d8668479 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:45:04.146613 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0eb00eda-a099-4c27-ae53-24d6d8668479 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:45:04.160821 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb00eda-a099-4c27-ae53-24d6d8668479 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:45:04.166377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9956522-acca-491f-9f72-9e3b36a2822e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:45:04.167013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9956522-acca-491f-9f72-9e3b36a2822e service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:45:04.167290 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9956522-acca-491f-9f72-9e3b36a2822e service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:45:04.167562 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9956522-acca-491f-9f72-9e3b36a2822e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:45:04.169311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c9956522-acca-491f-9f72-9e3b36a2822e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:45:04.182079 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9956522-acca-491f-9f72-9e3b36a2822e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:45:04.183636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9956522-acca-491f-9f72-9e3b36a2822e service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:45:04.193812 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4486/9002] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:45:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:45:13.547012 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:45:14.189570 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:45:36.571101 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38d6e7-a403-4fdc-9e0f-f0cfe715292b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:45:36.635804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38d6e7-a403-4fdc-9e0f-f0cfe715292b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:45:36.639426 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d9b29-7678-4366-b4e6-721906ba97fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:45:36.640022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d9b29-7678-4366-b4e6-721906ba97fc service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:45:36.640300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d9b29-7678-4366-b4e6-721906ba97fc service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:45:36.640567 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d9b29-7678-4366-b4e6-721906ba97fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:45:36.642303 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-622d9b29-7678-4366-b4e6-721906ba97fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:45:36.655559 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d9b29-7678-4366-b4e6-721906ba97fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:45:36.657047 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d9b29-7678-4366-b4e6-721906ba97fc service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:45:36.678564 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4517/9003] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:45:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:45:39.059066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb13f6-11e2-4185-9836-2f342198c308 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:45:39.059573 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb13f6-11e2-4185-9836-2f342198c308 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:45:39.059687 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb13f6-11e2-4185-9836-2f342198c308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:45:39.078264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c4cb13f6-11e2-4185-9836-2f342198c308 None None] MFA Rules not processed for user `5c1b8d5dcf234637b533a980a2af464b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:45:39.079449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c4cb13f6-11e2-4185-9836-2f342198c308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:45:39.086158 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4487/9004] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:45:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:45:39.659443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d9b29-7678-4366-b4e6-721906ba97fc service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:45:39.668295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d9b29-7678-4366-b4e6-721906ba97fc service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:45:39.671966 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622c3e6-ee0b-43ef-9428-4172efb427be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:45:39.672552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622c3e6-ee0b-43ef-9428-4172efb427be service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:45:39.672858 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622c3e6-ee0b-43ef-9428-4172efb427be service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:45:39.673133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622c3e6-ee0b-43ef-9428-4172efb427be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:45:39.674837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6622c3e6-ee0b-43ef-9428-4172efb427be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:45:39.688973 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622c3e6-ee0b-43ef-9428-4172efb427be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:45:39.690508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622c3e6-ee0b-43ef-9428-4172efb427be service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:45:39.702204 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4518/9005] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:45:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:45:41.350981 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb13f6-11e2-4185-9836-2f342198c308 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:45:41.352440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c4cb13f6-11e2-4185-9836-2f342198c308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:45:41.366547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb13f6-11e2-4185-9836-2f342198c308 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:45:41.370385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00079e3-d3d3-490d-8055-237888807e45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:45:41.371101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00079e3-d3d3-490d-8055-237888807e45 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:45:41.371439 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00079e3-d3d3-490d-8055-237888807e45 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:45:41.371715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00079e3-d3d3-490d-8055-237888807e45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:45:41.373463 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d00079e3-d3d3-490d-8055-237888807e45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:45:41.383679 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00079e3-d3d3-490d-8055-237888807e45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:45:41.385162 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00079e3-d3d3-490d-8055-237888807e45 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:45:41.393924 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4488/9006] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:45:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:45:49.696694 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=40 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:45:51.390086 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=9 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:46:11.836098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622c3e6-ee0b-43ef-9428-4172efb427be service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:11.838672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6622c3e6-ee0b-43ef-9428-4172efb427be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:11.854921 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622c3e6-ee0b-43ef-9428-4172efb427be service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:11.862157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c38f8a-477c-4926-8715-ecdd414faa82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:11.863018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c38f8a-477c-4926-8715-ecdd414faa82 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:11.863617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c38f8a-477c-4926-8715-ecdd414faa82 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:11.863824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c38f8a-477c-4926-8715-ecdd414faa82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:11.866660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-51c38f8a-477c-4926-8715-ecdd414faa82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:11.881758 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c38f8a-477c-4926-8715-ecdd414faa82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:11.890474 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c38f8a-477c-4926-8715-ecdd414faa82 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:11.903027 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4519/9007] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:46:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:46:19.617836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00079e3-d3d3-490d-8055-237888807e45 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:19.691477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00079e3-d3d3-490d-8055-237888807e45 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:19.695951 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56101a74-f4a5-407c-96e5-fd8082b2e356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:19.696780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56101a74-f4a5-407c-96e5-fd8082b2e356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:19.697193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56101a74-f4a5-407c-96e5-fd8082b2e356 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:19.697473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56101a74-f4a5-407c-96e5-fd8082b2e356 admin admin] PATH_INFO: `/v3/users/5c1b8d5dcf234637b533a980a2af464b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:19.698623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56101a74-f4a5-407c-96e5-fd8082b2e356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c1b8d5dcf234637b533a980a2af464b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:19.700533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56101a74-f4a5-407c-96e5-fd8082b2e356 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:19.746954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-56101a74-f4a5-407c-96e5-fd8082b2e356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c1b8d5dcf234637b533a980a2af464b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:46:19.754078 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-56101a74-f4a5-407c-96e5-fd8082b2e356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c1b8d5dcf234637b533a980a2af464b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:46:19.754698 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-56101a74-f4a5-407c-96e5-fd8082b2e356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c1b8d5dcf234637b533a980a2af464b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:46:19.767370 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-56101a74-f4a5-407c-96e5-fd8082b2e356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c1b8d5dcf234637b533a980a2af464b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:46:19.774231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-56101a74-f4a5-407c-96e5-fd8082b2e356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c1b8d5dcf234637b533a980a2af464b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:46:19.780293 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4489/9008] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:46:19 2022] DELETE /identity/v3/users/5c1b8d5dcf234637b533a980a2af464b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:46:19.952958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c38f8a-477c-4926-8715-ecdd414faa82 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:19.964027 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c38f8a-477c-4926-8715-ecdd414faa82 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:20.030835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f3a97-747f-4085-afdd-1a55e492ce3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:20.031466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f3a97-747f-4085-afdd-1a55e492ce3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:20.031774 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f3a97-747f-4085-afdd-1a55e492ce3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:20.032046 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f3a97-747f-4085-afdd-1a55e492ce3b admin admin] PATH_INFO: `/v3/projects/40af59a7320b4e118ffc48d4f51017f4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:20.033204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f3a97-747f-4085-afdd-1a55e492ce3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=40af59a7320b4e118ffc48d4f51017f4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:20.035091 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f3a97-747f-4085-afdd-1a55e492ce3b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:20.081565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-452f3a97-747f-4085-afdd-1a55e492ce3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40af59a7320b4e118ffc48d4f51017f4', 'request_id': 'req-452f3a97-747f-4085-afdd-1a55e492ce3b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:46:20.089571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-452f3a97-747f-4085-afdd-1a55e492ce3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40af59a7320b4e118ffc48d4f51017f4', 'request_id': 'req-452f3a97-747f-4085-afdd-1a55e492ce3b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:46:20.095074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-452f3a97-747f-4085-afdd-1a55e492ce3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40af59a7320b4e118ffc48d4f51017f4', 'request_id': 'req-452f3a97-747f-4085-afdd-1a55e492ce3b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:46:20.106704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-452f3a97-747f-4085-afdd-1a55e492ce3b admin admin] The token cache is being invalidate because project 40af59a7320b4e118ffc48d4f51017f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:46:20.106985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-452f3a97-747f-4085-afdd-1a55e492ce3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:46:20.107605 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-452f3a97-747f-4085-afdd-1a55e492ce3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:46:20.109166 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4520/9009] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:46:19 2022] DELETE /identity/v3/projects/40af59a7320b4e118ffc48d4f51017f4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:46:20.113181 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56101a74-f4a5-407c-96e5-fd8082b2e356 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:20.114587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-56101a74-f4a5-407c-96e5-fd8082b2e356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:20.127648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56101a74-f4a5-407c-96e5-fd8082b2e356 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:20.183379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36e5e2-985f-456b-9e40-4830fa517382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:20.184005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36e5e2-985f-456b-9e40-4830fa517382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:20.184282 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36e5e2-985f-456b-9e40-4830fa517382 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:20.184552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36e5e2-985f-456b-9e40-4830fa517382 admin admin] PATH_INFO: `/v3/users/ac6c3ebb194647e78c250ebb1b23f034` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:20.185707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36e5e2-985f-456b-9e40-4830fa517382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac6c3ebb194647e78c250ebb1b23f034)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:20.187639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36e5e2-985f-456b-9e40-4830fa517382 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:20.199943 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:46:20.243615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1c36e5e2-985f-456b-9e40-4830fa517382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac6c3ebb194647e78c250ebb1b23f034'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:46:20.250897 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1c36e5e2-985f-456b-9e40-4830fa517382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac6c3ebb194647e78c250ebb1b23f034'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:46:20.251560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1c36e5e2-985f-456b-9e40-4830fa517382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac6c3ebb194647e78c250ebb1b23f034'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:46:20.263586 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1c36e5e2-985f-456b-9e40-4830fa517382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac6c3ebb194647e78c250ebb1b23f034'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:46:20.270418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1c36e5e2-985f-456b-9e40-4830fa517382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac6c3ebb194647e78c250ebb1b23f034'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:46:20.276937 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4490/9010] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:46:20 2022] DELETE /identity/v3/users/ac6c3ebb194647e78c250ebb1b23f034 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:46:20.456991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f3a97-747f-4085-afdd-1a55e492ce3b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:20.458439 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-452f3a97-747f-4085-afdd-1a55e492ce3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:20.474953 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f3a97-747f-4085-afdd-1a55e492ce3b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:20.533141 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc631fa0-0748-49cf-a081-ae2080bf4a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:20.533771 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc631fa0-0748-49cf-a081-ae2080bf4a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:20.534049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc631fa0-0748-49cf-a081-ae2080bf4a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:20.534320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc631fa0-0748-49cf-a081-ae2080bf4a06 admin admin] PATH_INFO: `/v3/projects/cbf064bdaab342818727115fcd9c13cc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:20.535456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc631fa0-0748-49cf-a081-ae2080bf4a06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf064bdaab342818727115fcd9c13cc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:20.537392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc631fa0-0748-49cf-a081-ae2080bf4a06 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:20.561254 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:46:20.586110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fc631fa0-0748-49cf-a081-ae2080bf4a06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf064bdaab342818727115fcd9c13cc', 'request_id': 'req-fc631fa0-0748-49cf-a081-ae2080bf4a06'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:46:20.593206 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fc631fa0-0748-49cf-a081-ae2080bf4a06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf064bdaab342818727115fcd9c13cc', 'request_id': 'req-fc631fa0-0748-49cf-a081-ae2080bf4a06'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:46:20.598657 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fc631fa0-0748-49cf-a081-ae2080bf4a06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf064bdaab342818727115fcd9c13cc', 'request_id': 'req-fc631fa0-0748-49cf-a081-ae2080bf4a06'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:46:20.610155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fc631fa0-0748-49cf-a081-ae2080bf4a06 admin admin] The token cache is being invalidate because project cbf064bdaab342818727115fcd9c13cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:46:20.610438 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fc631fa0-0748-49cf-a081-ae2080bf4a06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:46:20.611085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fc631fa0-0748-49cf-a081-ae2080bf4a06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:46:20.612538 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4521/9011] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:46:20 2022] DELETE /identity/v3/projects/cbf064bdaab342818727115fcd9c13cc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:46:20.617493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472032c-3558-4f7a-8398-bd697cf61be8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:20.617806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472032c-3558-4f7a-8398-bd697cf61be8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:20.618099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472032c-3558-4f7a-8398-bd697cf61be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:20.637976 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d472032c-3558-4f7a-8398-bd697cf61be8 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:46:20.639159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d472032c-3558-4f7a-8398-bd697cf61be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:20.698620 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4491/9012] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:46:20.707382 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875b1cb-9cc4-4037-85ec-98477e58e486 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:20.707600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875b1cb-9cc4-4037-85ec-98477e58e486 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:20.707873 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875b1cb-9cc4-4037-85ec-98477e58e486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:20.727310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1875b1cb-9cc4-4037-85ec-98477e58e486 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:46:20.729249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1875b1cb-9cc4-4037-85ec-98477e58e486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:20.737289 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4522/9013] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:46:20.741455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472032c-3558-4f7a-8398-bd697cf61be8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:20.751535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472032c-3558-4f7a-8398-bd697cf61be8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:20.757780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ea093-80a2-4433-94da-a4f918a0df7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:20.758375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ea093-80a2-4433-94da-a4f918a0df7e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:20.758667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ea093-80a2-4433-94da-a4f918a0df7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:20.759553 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ea093-80a2-4433-94da-a4f918a0df7e admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:20.760203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ea093-80a2-4433-94da-a4f918a0df7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:46:20.760498 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ea093-80a2-4433-94da-a4f918a0df7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:20.762102 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ea093-80a2-4433-94da-a4f918a0df7e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:20.774091 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4492/9014] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 10:46:20.778396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875b1cb-9cc4-4037-85ec-98477e58e486 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:20.787462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875b1cb-9cc4-4037-85ec-98477e58e486 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:20.792102 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf27d5e-d4b5-49d5-83b8-2b565260a1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:20.792717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf27d5e-d4b5-49d5-83b8-2b565260a1b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:20.792994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf27d5e-d4b5-49d5-83b8-2b565260a1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:20.793262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf27d5e-d4b5-49d5-83b8-2b565260a1b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:20.793872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf27d5e-d4b5-49d5-83b8-2b565260a1b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:20.795728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf27d5e-d4b5-49d5-83b8-2b565260a1b7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:20.824303 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4523/9015] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:46:20 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:46:20.828579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ea093-80a2-4433-94da-a4f918a0df7e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:20.838741 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ea093-80a2-4433-94da-a4f918a0df7e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:20.895286 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6d1c4-8d25-4ce4-8504-169f61fc63f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:20.895891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6d1c4-8d25-4ce4-8504-169f61fc63f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:20.896169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6d1c4-8d25-4ce4-8504-169f61fc63f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:20.896448 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6d1c4-8d25-4ce4-8504-169f61fc63f3 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:20.897097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6d1c4-8d25-4ce4-8504-169f61fc63f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:20.898978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6d1c4-8d25-4ce4-8504-169f61fc63f3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:20.923322 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4493/9016] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:46:20 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:46:20.924575 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf27d5e-d4b5-49d5-83b8-2b565260a1b7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:20.935752 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf27d5e-d4b5-49d5-83b8-2b565260a1b7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:20.940321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ca717-f1f1-4404-a7e2-a3c842c4a67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:20.940947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ca717-f1f1-4404-a7e2-a3c842c4a67e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:20.941253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ca717-f1f1-4404-a7e2-a3c842c4a67e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:20.941524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ca717-f1f1-4404-a7e2-a3c842c4a67e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:20.942159 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ca717-f1f1-4404-a7e2-a3c842c4a67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:20.943819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ca717-f1f1-4404-a7e2-a3c842c4a67e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:20.954479 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4524/9017] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:46:20.958660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6d1c4-8d25-4ce4-8504-169f61fc63f3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:20.968368 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6d1c4-8d25-4ce4-8504-169f61fc63f3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:20.972845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1549e-99bc-4239-af22-4e8bc8a2f656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:20.973433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1549e-99bc-4239-af22-4e8bc8a2f656 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:20.973709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1549e-99bc-4239-af22-4e8bc8a2f656 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:20.973977 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1549e-99bc-4239-af22-4e8bc8a2f656 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:20.974607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1549e-99bc-4239-af22-4e8bc8a2f656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:20.976158 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1549e-99bc-4239-af22-4e8bc8a2f656 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:20.977383 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:46:20.988943 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4494/9018] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:46:20.992932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ca717-f1f1-4404-a7e2-a3c842c4a67e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:21.003368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ca717-f1f1-4404-a7e2-a3c842c4a67e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:21.007995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd7d9c-ef4d-4cdf-9012-9662cf0673a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:21.008661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd7d9c-ef4d-4cdf-9012-9662cf0673a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:21.009513 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd7d9c-ef4d-4cdf-9012-9662cf0673a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:21.009780 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd7d9c-ef4d-4cdf-9012-9662cf0673a3 admin admin] PATH_INFO: `/v3/projects/a41286f8ef2b44c2a662ddfa08f79116/users/6b4dcec2d4424d2a9d410fbf317ed9b3/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:21.024107 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd7d9c-ef4d-4cdf-9012-9662cf0673a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41286f8ef2b44c2a662ddfa08f79116, user_id=6b4dcec2d4424d2a9d410fbf317ed9b3, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:21.026813 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd7d9c-ef4d-4cdf-9012-9662cf0673a3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:21.040259 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4525/9019] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:46:20 2022] PUT /identity/v3/projects/a41286f8ef2b44c2a662ddfa08f79116/users/6b4dcec2d4424d2a9d410fbf317ed9b3/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:46:21.045886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe36ba-0ce7-426d-9798-ea5a171404e6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:21.046171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe36ba-0ce7-426d-9798-ea5a171404e6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:21.046444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe36ba-0ce7-426d-9798-ea5a171404e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:21.066075 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-debe36ba-0ce7-426d-9798-ea5a171404e6 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:46:21.067260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-debe36ba-0ce7-426d-9798-ea5a171404e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:21.127024 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4495/9020] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:46:21.137062 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd7d9c-ef4d-4cdf-9012-9662cf0673a3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:21.138750 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-67fd7d9c-ef4d-4cdf-9012-9662cf0673a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:21.197285 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd7d9c-ef4d-4cdf-9012-9662cf0673a3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:21.201001 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d343f8e-840a-4119-b112-e735e09f201b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:21.201600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d343f8e-840a-4119-b112-e735e09f201b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:21.201883 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d343f8e-840a-4119-b112-e735e09f201b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:21.202152 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d343f8e-840a-4119-b112-e735e09f201b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:21.211121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d343f8e-840a-4119-b112-e735e09f201b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:21.213553 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d343f8e-840a-4119-b112-e735e09f201b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:21.223146 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4526/9021] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:46:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:46:25.500739 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698797c-4ee2-4d39-9137-1b0173978b02 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:25.501260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698797c-4ee2-4d39-9137-1b0173978b02 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:25.501485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698797c-4ee2-4d39-9137-1b0173978b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:25.534723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b698797c-4ee2-4d39-9137-1b0173978b02 None None] MFA Rules not processed for user `6b4dcec2d4424d2a9d410fbf317ed9b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:46:25.535973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b698797c-4ee2-4d39-9137-1b0173978b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:25.608180 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4496/9022] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:46:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:46:25.612878 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d343f8e-840a-4119-b112-e735e09f201b service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:25.623589 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d343f8e-840a-4119-b112-e735e09f201b service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:25.628483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa031a-7180-4586-bbcc-adc04b4b2dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:25.629111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa031a-7180-4586-bbcc-adc04b4b2dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:25.629591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa031a-7180-4586-bbcc-adc04b4b2dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:25.629867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa031a-7180-4586-bbcc-adc04b4b2dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:25.630515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa031a-7180-4586-bbcc-adc04b4b2dc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:25.632413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa031a-7180-4586-bbcc-adc04b4b2dc0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:25.664533 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4527/9023] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:46:25 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:46:25.666367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698797c-4ee2-4d39-9137-1b0173978b02 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:25.677557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698797c-4ee2-4d39-9137-1b0173978b02 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:25.738547 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdd88e-a100-4671-a785-9bb9a49de58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:25.739165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdd88e-a100-4671-a785-9bb9a49de58e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:25.739442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdd88e-a100-4671-a785-9bb9a49de58e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:25.739718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdd88e-a100-4671-a785-9bb9a49de58e admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:25.740505 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdd88e-a100-4671-a785-9bb9a49de58e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:25.742449 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdd88e-a100-4671-a785-9bb9a49de58e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:25.769141 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4497/9024] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:46:25 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:46:25.770390 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa031a-7180-4586-bbcc-adc04b4b2dc0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:25.782007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa031a-7180-4586-bbcc-adc04b4b2dc0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:25.792947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ad572-1f87-49a1-aa20-41abe32f3f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:25.793573 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ad572-1f87-49a1-aa20-41abe32f3f0c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:25.793853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ad572-1f87-49a1-aa20-41abe32f3f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:25.794123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ad572-1f87-49a1-aa20-41abe32f3f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:25.794768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ad572-1f87-49a1-aa20-41abe32f3f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:25.796392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ad572-1f87-49a1-aa20-41abe32f3f0c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:25.809634 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4528/9025] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:46:25.813917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdd88e-a100-4671-a785-9bb9a49de58e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:25.825194 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdd88e-a100-4671-a785-9bb9a49de58e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:25.830050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df0f97-4484-449c-b6cd-e58c5cefc961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:25.830731 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df0f97-4484-449c-b6cd-e58c5cefc961 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:25.831108 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df0f97-4484-449c-b6cd-e58c5cefc961 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:25.831389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df0f97-4484-449c-b6cd-e58c5cefc961 admin admin] PATH_INFO: `/v3/projects/7d7581bfeb3f400597a90c1bad13b4ec/users/cb9de240f33a483c9f219a4bbdfdeaab/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:25.857368 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:46:25.870061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df0f97-4484-449c-b6cd-e58c5cefc961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d7581bfeb3f400597a90c1bad13b4ec, user_id=cb9de240f33a483c9f219a4bbdfdeaab, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:25.878961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df0f97-4484-449c-b6cd-e58c5cefc961 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:25.894512 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4498/9026] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:46:25 2022] PUT /identity/v3/projects/7d7581bfeb3f400597a90c1bad13b4ec/users/cb9de240f33a483c9f219a4bbdfdeaab/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:46:25.898570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ad572-1f87-49a1-aa20-41abe32f3f0c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:25.911959 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ad572-1f87-49a1-aa20-41abe32f3f0c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:25.925428 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:46:25.980183 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a36f8-eff0-4312-8d2b-c4db33e1fbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:25.980891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a36f8-eff0-4312-8d2b-c4db33e1fbde admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:25.981172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a36f8-eff0-4312-8d2b-c4db33e1fbde admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:25.981693 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a36f8-eff0-4312-8d2b-c4db33e1fbde admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:25.982352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a36f8-eff0-4312-8d2b-c4db33e1fbde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:25.983957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a36f8-eff0-4312-8d2b-c4db33e1fbde admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:25.997474 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4529/9027] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:46:26.000555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df0f97-4484-449c-b6cd-e58c5cefc961 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:26.012530 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df0f97-4484-449c-b6cd-e58c5cefc961 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:26.017330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd287494-c37f-4b16-9a69-eccb4ae26283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:26.018031 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd287494-c37f-4b16-9a69-eccb4ae26283 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:26.018315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd287494-c37f-4b16-9a69-eccb4ae26283 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:26.018590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd287494-c37f-4b16-9a69-eccb4ae26283 admin admin] PATH_INFO: `/v3/projects/7d7581bfeb3f400597a90c1bad13b4ec/users/cb9de240f33a483c9f219a4bbdfdeaab/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:26.020532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd287494-c37f-4b16-9a69-eccb4ae26283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d7581bfeb3f400597a90c1bad13b4ec, user_id=cb9de240f33a483c9f219a4bbdfdeaab, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:26.023210 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd287494-c37f-4b16-9a69-eccb4ae26283 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:26.035999 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4499/9028] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:46:25 2022] PUT /identity/v3/projects/7d7581bfeb3f400597a90c1bad13b4ec/users/cb9de240f33a483c9f219a4bbdfdeaab/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:46:30.539366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ff232-fc0a-4f36-b9f0-fce545db92dd None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:30.540462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ff232-fc0a-4f36-b9f0-fce545db92dd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:30.540788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ff232-fc0a-4f36-b9f0-fce545db92dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:30.569457 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9b4ff232-fc0a-4f36-b9f0-fce545db92dd None None] MFA Rules not processed for user `cb9de240f33a483c9f219a4bbdfdeaab`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:46:30.570563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9b4ff232-fc0a-4f36-b9f0-fce545db92dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:30.642652 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4530/9029] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:46:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:46:30.679884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccd33d-4f6d-43d5-96af-b2b52cf9d10f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:30.680357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccd33d-4f6d-43d5-96af-b2b52cf9d10f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:30.681047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccd33d-4f6d-43d5-96af-b2b52cf9d10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:30.743721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-adccd33d-4f6d-43d5-96af-b2b52cf9d10f None None] MFA Rules not processed for user `ebc6604430ba4e2283994e5cb8ef18d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:46:30.744960 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-adccd33d-4f6d-43d5-96af-b2b52cf9d10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:30.812352 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4500/9030] 10.222.0.16 () {58 vars in 1059 bytes} [Fri Sep 30 10:46:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:46:30.818309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ff232-fc0a-4f36-b9f0-fce545db92dd None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:30.828852 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ff232-fc0a-4f36-b9f0-fce545db92dd None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:30.832379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f592529-1327-4cf9-ad4e-6b4f8bd72637 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:30.833766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f592529-1327-4cf9-ad4e-6b4f8bd72637 service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:30.833766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f592529-1327-4cf9-ad4e-6b4f8bd72637 service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:30.833766 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f592529-1327-4cf9-ad4e-6b4f8bd72637 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:30.902628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f592529-1327-4cf9-ad4e-6b4f8bd72637 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:30.904075 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f592529-1327-4cf9-ad4e-6b4f8bd72637 service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:30.914668 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4531/9031] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:46:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:46:31.104135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab1cdb-6f30-4803-b20c-374bd29d23ba None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:31.104414 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab1cdb-6f30-4803-b20c-374bd29d23ba None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:31.104707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab1cdb-6f30-4803-b20c-374bd29d23ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:31.174298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4bab1cdb-6f30-4803-b20c-374bd29d23ba None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:46:31.175544 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4bab1cdb-6f30-4803-b20c-374bd29d23ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:31.255943 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4501/9032] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:46:31.313343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1a8ad-93a5-4470-b758-914cab14f0c0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:31.313633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1a8ad-93a5-4470-b758-914cab14f0c0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:31.313936 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1a8ad-93a5-4470-b758-914cab14f0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:31.377098 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-24b1a8ad-93a5-4470-b758-914cab14f0c0 None None] MFA Rules not processed for user `963c491a2d2e409b8b45e4fb6aff41c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:46:31.378606 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-24b1a8ad-93a5-4470-b758-914cab14f0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:31.383468 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:46:31.497069 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4532/9033] 10.222.0.16 () {58 vars in 1040 bytes} [Fri Sep 30 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:46:31.503134 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab1cdb-6f30-4803-b20c-374bd29d23ba None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:31.519886 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab1cdb-6f30-4803-b20c-374bd29d23ba None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:31.526760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed5b5d-c4c1-453a-b6f9-0d8771d14cd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:31.527637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed5b5d-c4c1-453a-b6f9-0d8771d14cd8 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:31.527855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed5b5d-c4c1-453a-b6f9-0d8771d14cd8 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:31.528128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed5b5d-c4c1-453a-b6f9-0d8771d14cd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:31.537745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed5b5d-c4c1-453a-b6f9-0d8771d14cd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:31.538878 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed5b5d-c4c1-453a-b6f9-0d8771d14cd8 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:31.549283 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4502/9034] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:46:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:46:40.568628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d8876-055c-4d73-bef1-d4d82acc93f0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:40.569117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d8876-055c-4d73-bef1-d4d82acc93f0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:40.569211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d8876-055c-4d73-bef1-d4d82acc93f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:40.589128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1d3d8876-055c-4d73-bef1-d4d82acc93f0 None None] MFA Rules not processed for user `6b4dcec2d4424d2a9d410fbf317ed9b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:46:40.590323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1d3d8876-055c-4d73-bef1-d4d82acc93f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:40.597131 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4533/9035] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:46:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:46:40.854385 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf09325-3867-40cd-b36c-434ad3e68900 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:40.854889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf09325-3867-40cd-b36c-434ad3e68900 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:40.855008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf09325-3867-40cd-b36c-434ad3e68900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:40.863619 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:46:40.876418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-caf09325-3867-40cd-b36c-434ad3e68900 None None] MFA Rules not processed for user `a9b0fd833b134a089433cd2985caba80`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:46:40.877643 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-caf09325-3867-40cd-b36c-434ad3e68900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:40.930935 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4503/9036] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:46:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:46:40.942913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d8876-055c-4d73-bef1-d4d82acc93f0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:40.953023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d8876-055c-4d73-bef1-d4d82acc93f0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:40.956523 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609f2a0-b9c1-4030-9a9d-6731aaefd821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:40.957267 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609f2a0-b9c1-4030-9a9d-6731aaefd821 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:40.957542 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609f2a0-b9c1-4030-9a9d-6731aaefd821 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:40.957810 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609f2a0-b9c1-4030-9a9d-6731aaefd821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:40.965260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2609f2a0-b9c1-4030-9a9d-6731aaefd821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:40.966671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2609f2a0-b9c1-4030-9a9d-6731aaefd821 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:40.974303 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4534/9037] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:46:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:46:43.618285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5b411-f829-4cfd-ad40-2be692e83436 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:43.618792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5b411-f829-4cfd-ad40-2be692e83436 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:43.618890 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5b411-f829-4cfd-ad40-2be692e83436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:43.638695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ebc5b411-f829-4cfd-ad40-2be692e83436 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:46:43.640169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ebc5b411-f829-4cfd-ad40-2be692e83436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:43.649501 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4504/9038] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:46:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:46:43.661443 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609f2a0-b9c1-4030-9a9d-6731aaefd821 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:43.674745 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609f2a0-b9c1-4030-9a9d-6731aaefd821 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:43.680020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d829f-8a7b-47d2-aff1-24b5ae0082e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:43.680965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d829f-8a7b-47d2-aff1-24b5ae0082e2 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:43.681241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d829f-8a7b-47d2-aff1-24b5ae0082e2 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:43.681509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d829f-8a7b-47d2-aff1-24b5ae0082e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:43.690941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d829f-8a7b-47d2-aff1-24b5ae0082e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:43.692663 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d829f-8a7b-47d2-aff1-24b5ae0082e2 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:43.701817 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4535/9039] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:46:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:46:53.632315 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=24 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:46:53.698095 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=44 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:46:56.332993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5b411-f829-4cfd-ad40-2be692e83436 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:46:56.334409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ebc5b411-f829-4cfd-ad40-2be692e83436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:56.411889 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5b411-f829-4cfd-ad40-2be692e83436 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:46:56.417962 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28286ce-4814-4f3d-a001-dd3953123822 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:46:56.418570 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28286ce-4814-4f3d-a001-dd3953123822 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:46:56.418846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28286ce-4814-4f3d-a001-dd3953123822 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:46:56.419118 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28286ce-4814-4f3d-a001-dd3953123822 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:46:56.420986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d28286ce-4814-4f3d-a001-dd3953123822 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:46:56.433535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28286ce-4814-4f3d-a001-dd3953123822 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:46:56.435089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28286ce-4814-4f3d-a001-dd3953123822 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:46:56.445347 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4505/9040] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:46:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:47:06.441020 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=34 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:47:13.428673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d829f-8a7b-47d2-aff1-24b5ae0082e2 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:47:13.438501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d829f-8a7b-47d2-aff1-24b5ae0082e2 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:47:13.442103 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a4603-319d-478f-9d78-c81f902f58d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:47:13.442644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a4603-319d-478f-9d78-c81f902f58d8 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:47:13.442920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a4603-319d-478f-9d78-c81f902f58d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:47:13.443190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a4603-319d-478f-9d78-c81f902f58d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:47:13.452086 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a4603-319d-478f-9d78-c81f902f58d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:47:13.453524 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a4603-319d-478f-9d78-c81f902f58d8 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:47:13.463503 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4536/9041] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:47:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:47:15.274964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28286ce-4814-4f3d-a001-dd3953123822 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:47:15.291437 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28286ce-4814-4f3d-a001-dd3953123822 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:47:15.299007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0274ea-3864-47d4-ac2f-88a70874766b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:47:15.299692 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0274ea-3864-47d4-ac2f-88a70874766b service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:47:15.299974 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0274ea-3864-47d4-ac2f-88a70874766b service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:47:15.300263 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0274ea-3864-47d4-ac2f-88a70874766b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:47:15.302097 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6e0274ea-3864-47d4-ac2f-88a70874766b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:47:15.315757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0274ea-3864-47d4-ac2f-88a70874766b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:47:15.317384 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0274ea-3864-47d4-ac2f-88a70874766b service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:47:15.329541 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4506/9042] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:47:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:47:23.458642 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:47:25.324421 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:48:27.163967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a4603-319d-478f-9d78-c81f902f58d8 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:48:27.165428 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2f9a4603-319d-478f-9d78-c81f902f58d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:48:27.242414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a4603-319d-478f-9d78-c81f902f58d8 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:48:27.247343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5d44f-100a-4df8-bcfa-f8b230abfc40 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:48:27.247938 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5d44f-100a-4df8-bcfa-f8b230abfc40 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:48:27.248212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5d44f-100a-4df8-bcfa-f8b230abfc40 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:48:27.248484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5d44f-100a-4df8-bcfa-f8b230abfc40 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:48:27.250377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cfc5d44f-100a-4df8-bcfa-f8b230abfc40 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:48:27.261555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5d44f-100a-4df8-bcfa-f8b230abfc40 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:48:27.263109 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5d44f-100a-4df8-bcfa-f8b230abfc40 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:48:27.272814 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4537/9043] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:48:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:48:37.268623 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=36 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:49:21.763493 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0274ea-3864-47d4-ac2f-88a70874766b service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:49:21.774690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0274ea-3864-47d4-ac2f-88a70874766b service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:49:21.779621 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c3e14-7236-4842-8ea4-a1000f4346b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:49:21.780239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c3e14-7236-4842-8ea4-a1000f4346b8 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:49:21.780514 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c3e14-7236-4842-8ea4-a1000f4346b8 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:49:21.780812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c3e14-7236-4842-8ea4-a1000f4346b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:49:21.782500 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ed0c3e14-7236-4842-8ea4-a1000f4346b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:49:21.794098 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c3e14-7236-4842-8ea4-a1000f4346b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:49:21.795629 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c3e14-7236-4842-8ea4-a1000f4346b8 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:49:21.805773 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4507/9044] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:49:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:49:31.801222 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:50:27.034944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e900d8-8ea8-48c7-91c1-5a258979b806 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:50:27.035481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e900d8-8ea8-48c7-91c1-5a258979b806 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:50:27.035481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e900d8-8ea8-48c7-91c1-5a258979b806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:50:27.055212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-72e900d8-8ea8-48c7-91c1-5a258979b806 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:50:27.056395 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-72e900d8-8ea8-48c7-91c1-5a258979b806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:50:27.064485 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4538/9045] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 10:50:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:50:27.105712 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c3e14-7236-4842-8ea4-a1000f4346b8 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:50:27.116861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c3e14-7236-4842-8ea4-a1000f4346b8 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:50:27.121956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386da6c-da6c-4fc2-9674-65c39669791f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:50:27.122633 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386da6c-da6c-4fc2-9674-65c39669791f service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:50:27.122914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386da6c-da6c-4fc2-9674-65c39669791f service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:50:27.123188 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386da6c-da6c-4fc2-9674-65c39669791f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:50:27.131115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386da6c-da6c-4fc2-9674-65c39669791f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:50:27.132689 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386da6c-da6c-4fc2-9674-65c39669791f service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:50:27.140845 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4508/9046] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:50:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:50:27.621699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9445e-7f5b-4e78-97c3-5a5d29142f45 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:50:27.621985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9445e-7f5b-4e78-97c3-5a5d29142f45 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:50:27.622261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9445e-7f5b-4e78-97c3-5a5d29142f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:50:27.641907 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-01f9445e-7f5b-4e78-97c3-5a5d29142f45 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:50:27.643108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-01f9445e-7f5b-4e78-97c3-5a5d29142f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:50:27.651480 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4539/9047] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:50:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:50:27.663028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386da6c-da6c-4fc2-9674-65c39669791f service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:50:27.673949 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386da6c-da6c-4fc2-9674-65c39669791f service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:50:27.681612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1cf19-0381-40ee-9c5f-af64b76a85c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:50:27.682343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1cf19-0381-40ee-9c5f-af64b76a85c7 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:50:27.682596 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1cf19-0381-40ee-9c5f-af64b76a85c7 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:50:27.682871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1cf19-0381-40ee-9c5f-af64b76a85c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:50:27.691791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1cf19-0381-40ee-9c5f-af64b76a85c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:50:27.693413 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1cf19-0381-40ee-9c5f-af64b76a85c7 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:50:27.703116 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4509/9048] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:50:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 10:50:36.211654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d68681-36c5-4ada-b66f-4ba496760633 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:50:36.212219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d68681-36c5-4ada-b66f-4ba496760633 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:50:36.212219 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d68681-36c5-4ada-b66f-4ba496760633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:50:36.236928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-30d68681-36c5-4ada-b66f-4ba496760633 None None] MFA Rules not processed for user `6b4dcec2d4424d2a9d410fbf317ed9b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:50:36.238733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-30d68681-36c5-4ada-b66f-4ba496760633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:50:36.246482 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4540/9049] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:50:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:50:36.505398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1cf19-0381-40ee-9c5f-af64b76a85c7 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:50:36.517833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1cf19-0381-40ee-9c5f-af64b76a85c7 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:50:36.521867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110dad7-5c11-48d8-a9df-8d6bff78ba4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:50:36.522461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110dad7-5c11-48d8-a9df-8d6bff78ba4a service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:50:36.522737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110dad7-5c11-48d8-a9df-8d6bff78ba4a service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:50:36.523650 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110dad7-5c11-48d8-a9df-8d6bff78ba4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:50:36.526765 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b110dad7-5c11-48d8-a9df-8d6bff78ba4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:50:36.537051 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110dad7-5c11-48d8-a9df-8d6bff78ba4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:50:36.538436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110dad7-5c11-48d8-a9df-8d6bff78ba4a service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:50:36.546480 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4510/9050] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:50:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:50:37.910322 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d68681-36c5-4ada-b66f-4ba496760633 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:50:37.911762 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-30d68681-36c5-4ada-b66f-4ba496760633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:50:37.926597 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d68681-36c5-4ada-b66f-4ba496760633 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:50:37.932226 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b42891-b0af-4267-859e-c62b3768f372 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:50:37.932866 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b42891-b0af-4267-859e-c62b3768f372 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:50:37.933146 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b42891-b0af-4267-859e-c62b3768f372 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:50:37.933420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b42891-b0af-4267-859e-c62b3768f372 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:50:37.935123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d5b42891-b0af-4267-859e-c62b3768f372 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:50:37.946343 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b42891-b0af-4267-859e-c62b3768f372 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:50:37.948725 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b42891-b0af-4267-859e-c62b3768f372 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:50:37.958510 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4541/9051] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:50:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:50:37.989130 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110dad7-5c11-48d8-a9df-8d6bff78ba4a service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:50:37.998367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110dad7-5c11-48d8-a9df-8d6bff78ba4a service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:50:38.002068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea808ca-d8ff-4801-bd7a-198d3bb08799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:50:38.002744 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea808ca-d8ff-4801-bd7a-198d3bb08799 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:50:38.003084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea808ca-d8ff-4801-bd7a-198d3bb08799 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:50:38.003426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea808ca-d8ff-4801-bd7a-198d3bb08799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:50:38.005185 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1ea808ca-d8ff-4801-bd7a-198d3bb08799 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:50:38.018988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea808ca-d8ff-4801-bd7a-198d3bb08799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:50:38.020383 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea808ca-d8ff-4801-bd7a-198d3bb08799 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:50:38.031510 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4511/9052] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:50:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:50:41.323805 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b42891-b0af-4267-859e-c62b3768f372 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:50:41.343136 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b42891-b0af-4267-859e-c62b3768f372 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:50:41.347153 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80da628-fcbc-4796-8bb1-9e7ada342621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:50:41.347860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80da628-fcbc-4796-8bb1-9e7ada342621 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:50:41.348142 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80da628-fcbc-4796-8bb1-9e7ada342621 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:50:41.348413 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80da628-fcbc-4796-8bb1-9e7ada342621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:50:41.351005 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b80da628-fcbc-4796-8bb1-9e7ada342621 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:50:41.410429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80da628-fcbc-4796-8bb1-9e7ada342621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:50:41.412064 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80da628-fcbc-4796-8bb1-9e7ada342621 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:50:41.423097 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4542/9053] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:50:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:50:42.270534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c066cc-0fd0-4068-94cd-bc10da90bbc7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:50:42.270973 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c066cc-0fd0-4068-94cd-bc10da90bbc7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:50:42.271066 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c066cc-0fd0-4068-94cd-bc10da90bbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:50:42.290499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-05c066cc-0fd0-4068-94cd-bc10da90bbc7 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:50:42.291725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-05c066cc-0fd0-4068-94cd-bc10da90bbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:50:42.302848 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4512/9054] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 10:50:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:50:42.316714 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80da628-fcbc-4796-8bb1-9e7ada342621 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:50:42.329396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80da628-fcbc-4796-8bb1-9e7ada342621 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:50:42.334744 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5e3a1-7e92-44cf-a14d-d7f2aa6a62cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:50:42.335374 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5e3a1-7e92-44cf-a14d-d7f2aa6a62cb service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:50:42.335652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5e3a1-7e92-44cf-a14d-d7f2aa6a62cb service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:50:42.335925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5e3a1-7e92-44cf-a14d-d7f2aa6a62cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:50:42.344281 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5e3a1-7e92-44cf-a14d-d7f2aa6a62cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:50:42.345892 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5e3a1-7e92-44cf-a14d-d7f2aa6a62cb service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:50:42.354394 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4543/9055] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:50:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:50:52.285243 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=27 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:50:52.350670 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=49 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:50:53.473274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c066cc-0fd0-4068-94cd-bc10da90bbc7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:50:53.474678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-05c066cc-0fd0-4068-94cd-bc10da90bbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:50:53.486227 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c066cc-0fd0-4068-94cd-bc10da90bbc7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:50:53.489706 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a6162-98d0-4cfe-8c17-8696dda1c035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:50:53.490301 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a6162-98d0-4cfe-8c17-8696dda1c035 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:50:53.490577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a6162-98d0-4cfe-8c17-8696dda1c035 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:50:53.490844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a6162-98d0-4cfe-8c17-8696dda1c035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:50:53.492491 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-641a6162-98d0-4cfe-8c17-8696dda1c035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:50:53.502161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a6162-98d0-4cfe-8c17-8696dda1c035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:50:53.503556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a6162-98d0-4cfe-8c17-8696dda1c035 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:50:53.512009 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4513/9056] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:50:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:51:03.507762 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:52:06.180703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5e3a1-7e92-44cf-a14d-d7f2aa6a62cb service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:52:06.182394 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4bc5e3a1-7e92-44cf-a14d-d7f2aa6a62cb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:52:06.197986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5e3a1-7e92-44cf-a14d-d7f2aa6a62cb service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:52:06.204137 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36224615-b67c-4148-a5a2-192c4a1402d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:52:06.204760 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36224615-b67c-4148-a5a2-192c4a1402d6 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:52:06.205039 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36224615-b67c-4148-a5a2-192c4a1402d6 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:52:06.205311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36224615-b67c-4148-a5a2-192c4a1402d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:52:06.213029 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36224615-b67c-4148-a5a2-192c4a1402d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:52:06.214580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36224615-b67c-4148-a5a2-192c4a1402d6 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:52:06.223570 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4544/9057] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:52:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:52:16.219631 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:53:07.784512 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a6162-98d0-4cfe-8c17-8696dda1c035 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:07.808581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a6162-98d0-4cfe-8c17-8696dda1c035 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:07.816994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68a84a-1bb8-45c2-a49e-b0c5bbb05400 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:07.818325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68a84a-1bb8-45c2-a49e-b0c5bbb05400 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:07.818836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68a84a-1bb8-45c2-a49e-b0c5bbb05400 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:07.819325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68a84a-1bb8-45c2-a49e-b0c5bbb05400 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:07.832891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68a84a-1bb8-45c2-a49e-b0c5bbb05400 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:07.834857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68a84a-1bb8-45c2-a49e-b0c5bbb05400 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:07.850358 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4514/9058] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:53:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:53:17.843750 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:53:20.239363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36224615-b67c-4148-a5a2-192c4a1402d6 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:20.251381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36224615-b67c-4148-a5a2-192c4a1402d6 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:20.258182 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cc5ab-36a1-4584-bdbf-62bc4d6988e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:20.258779 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cc5ab-36a1-4584-bdbf-62bc4d6988e5 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:20.259058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cc5ab-36a1-4584-bdbf-62bc4d6988e5 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:20.259325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cc5ab-36a1-4584-bdbf-62bc4d6988e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:20.261564 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-668cc5ab-36a1-4584-bdbf-62bc4d6988e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:53:20.275856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668cc5ab-36a1-4584-bdbf-62bc4d6988e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:20.277557 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668cc5ab-36a1-4584-bdbf-62bc4d6988e5 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:20.289774 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4545/9059] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:53:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:53:21.450081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46287386-7f1a-45a3-8f63-f1a509d6d6f1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:21.451041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46287386-7f1a-45a3-8f63-f1a509d6d6f1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:21.451360 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46287386-7f1a-45a3-8f63-f1a509d6d6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:21.472089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-46287386-7f1a-45a3-8f63-f1a509d6d6f1 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:53:21.473338 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-46287386-7f1a-45a3-8f63-f1a509d6d6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:53:21.480531 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4515/9060] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 10:53:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:53:21.521173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cc5ab-36a1-4584-bdbf-62bc4d6988e5 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:21.532243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cc5ab-36a1-4584-bdbf-62bc4d6988e5 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:21.537157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3d663-b137-43af-b3cf-231edead6fec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:21.537743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3d663-b137-43af-b3cf-231edead6fec service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:21.538038 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3d663-b137-43af-b3cf-231edead6fec service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:21.538294 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3d663-b137-43af-b3cf-231edead6fec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:21.546723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3d663-b137-43af-b3cf-231edead6fec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:21.548305 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3d663-b137-43af-b3cf-231edead6fec service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:21.556165 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4546/9061] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 10:53:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 10:53:21.910036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46287386-7f1a-45a3-8f63-f1a509d6d6f1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:21.920411 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46287386-7f1a-45a3-8f63-f1a509d6d6f1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:21.923995 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483584e-8cb9-4768-b982-e2f417ae7bf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:21.924617 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483584e-8cb9-4768-b982-e2f417ae7bf6 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:21.924907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483584e-8cb9-4768-b982-e2f417ae7bf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:21.925176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483584e-8cb9-4768-b982-e2f417ae7bf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:21.994873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483584e-8cb9-4768-b982-e2f417ae7bf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:21.996276 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483584e-8cb9-4768-b982-e2f417ae7bf6 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:22.005843 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4516/9062] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:53:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:53:25.093872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3d663-b137-43af-b3cf-231edead6fec service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:25.109826 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3d663-b137-43af-b3cf-231edead6fec service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:25.115578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8e255-277a-4b78-9175-3f7357a7ff42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:25.116196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8e255-277a-4b78-9175-3f7357a7ff42 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:25.116476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8e255-277a-4b78-9175-3f7357a7ff42 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:25.116845 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8e255-277a-4b78-9175-3f7357a7ff42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:25.118630 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8fc8e255-277a-4b78-9175-3f7357a7ff42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:53:25.150351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8e255-277a-4b78-9175-3f7357a7ff42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:25.152215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8e255-277a-4b78-9175-3f7357a7ff42 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:25.172805 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4547/9063] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:53:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:53:28.341992 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483584e-8cb9-4768-b982-e2f417ae7bf6 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:28.353050 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483584e-8cb9-4768-b982-e2f417ae7bf6 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:28.358989 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27c934-9082-4736-bf39-e2f7edec8b5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:28.359806 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27c934-9082-4736-bf39-e2f7edec8b5c service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:28.360093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27c934-9082-4736-bf39-e2f7edec8b5c service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:28.360367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27c934-9082-4736-bf39-e2f7edec8b5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:28.362137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2d27c934-9082-4736-bf39-e2f7edec8b5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:53:28.374322 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27c934-9082-4736-bf39-e2f7edec8b5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:28.376011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27c934-9082-4736-bf39-e2f7edec8b5c service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:28.386903 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4517/9064] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:53:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:53:28.398827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8e255-277a-4b78-9175-3f7357a7ff42 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:28.412662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8e255-277a-4b78-9175-3f7357a7ff42 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:28.417611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172d243-aa06-45ed-b6b1-ef807e90db7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:28.418385 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172d243-aa06-45ed-b6b1-ef807e90db7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:28.418669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172d243-aa06-45ed-b6b1-ef807e90db7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:28.418944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172d243-aa06-45ed-b6b1-ef807e90db7a admin admin] PATH_INFO: `/v3/users/6b4dcec2d4424d2a9d410fbf317ed9b3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:28.421081 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172d243-aa06-45ed-b6b1-ef807e90db7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b4dcec2d4424d2a9d410fbf317ed9b3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:28.422854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172d243-aa06-45ed-b6b1-ef807e90db7a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:28.470031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2172d243-aa06-45ed-b6b1-ef807e90db7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b4dcec2d4424d2a9d410fbf317ed9b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:53:28.470717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2172d243-aa06-45ed-b6b1-ef807e90db7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b4dcec2d4424d2a9d410fbf317ed9b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:53:28.478404 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2172d243-aa06-45ed-b6b1-ef807e90db7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b4dcec2d4424d2a9d410fbf317ed9b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:53:28.491928 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2172d243-aa06-45ed-b6b1-ef807e90db7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b4dcec2d4424d2a9d410fbf317ed9b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:53:28.498788 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2172d243-aa06-45ed-b6b1-ef807e90db7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b4dcec2d4424d2a9d410fbf317ed9b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:53:28.504618 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4548/9065] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:53:28 2022] DELETE /identity/v3/users/6b4dcec2d4424d2a9d410fbf317ed9b3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:53:28.681361 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27c934-9082-4736-bf39-e2f7edec8b5c service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:28.693622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27c934-9082-4736-bf39-e2f7edec8b5c service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:28.752425 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ede0a7-74a0-4281-bed8-0ee627d1cc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:28.753085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ede0a7-74a0-4281-bed8-0ee627d1cc51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:28.753367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ede0a7-74a0-4281-bed8-0ee627d1cc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:28.753637 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ede0a7-74a0-4281-bed8-0ee627d1cc51 admin admin] PATH_INFO: `/v3/projects/a41286f8ef2b44c2a662ddfa08f79116` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:28.754727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ede0a7-74a0-4281-bed8-0ee627d1cc51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41286f8ef2b44c2a662ddfa08f79116)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:28.756593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ede0a7-74a0-4281-bed8-0ee627d1cc51 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:28.801993 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50ede0a7-74a0-4281-bed8-0ee627d1cc51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41286f8ef2b44c2a662ddfa08f79116', 'request_id': 'req-50ede0a7-74a0-4281-bed8-0ee627d1cc51'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:53:28.809444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50ede0a7-74a0-4281-bed8-0ee627d1cc51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41286f8ef2b44c2a662ddfa08f79116', 'request_id': 'req-50ede0a7-74a0-4281-bed8-0ee627d1cc51'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:53:28.815669 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50ede0a7-74a0-4281-bed8-0ee627d1cc51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41286f8ef2b44c2a662ddfa08f79116', 'request_id': 'req-50ede0a7-74a0-4281-bed8-0ee627d1cc51'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:53:28.817490 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:53:28.842315 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50ede0a7-74a0-4281-bed8-0ee627d1cc51 admin admin] The token cache is being invalidate because project a41286f8ef2b44c2a662ddfa08f79116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:53:28.842602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50ede0a7-74a0-4281-bed8-0ee627d1cc51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:53:28.843268 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50ede0a7-74a0-4281-bed8-0ee627d1cc51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:53:28.844804 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4518/9066] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:53:28 2022] DELETE /identity/v3/projects/a41286f8ef2b44c2a662ddfa08f79116 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:53:28.848865 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172d243-aa06-45ed-b6b1-ef807e90db7a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:28.850264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2172d243-aa06-45ed-b6b1-ef807e90db7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:53:28.864085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172d243-aa06-45ed-b6b1-ef807e90db7a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:28.921368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ba043-21a5-4be4-bdc3-70cfbb600262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:28.922000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ba043-21a5-4be4-bdc3-70cfbb600262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:28.922273 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ba043-21a5-4be4-bdc3-70cfbb600262 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:28.922537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ba043-21a5-4be4-bdc3-70cfbb600262 admin admin] PATH_INFO: `/v3/users/cb9de240f33a483c9f219a4bbdfdeaab` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:28.923730 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ba043-21a5-4be4-bdc3-70cfbb600262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb9de240f33a483c9f219a4bbdfdeaab)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:28.925746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ba043-21a5-4be4-bdc3-70cfbb600262 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:28.948682 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:53:28.973658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1c4ba043-21a5-4be4-bdc3-70cfbb600262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb9de240f33a483c9f219a4bbdfdeaab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:53:28.974318 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1c4ba043-21a5-4be4-bdc3-70cfbb600262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb9de240f33a483c9f219a4bbdfdeaab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:53:28.981199 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1c4ba043-21a5-4be4-bdc3-70cfbb600262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb9de240f33a483c9f219a4bbdfdeaab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:53:28.994099 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1c4ba043-21a5-4be4-bdc3-70cfbb600262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb9de240f33a483c9f219a4bbdfdeaab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:53:29.001063 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1c4ba043-21a5-4be4-bdc3-70cfbb600262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb9de240f33a483c9f219a4bbdfdeaab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:53:29.006881 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4549/9067] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 10:53:28 2022] DELETE /identity/v3/users/cb9de240f33a483c9f219a4bbdfdeaab => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:53:29.176591 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ede0a7-74a0-4281-bed8-0ee627d1cc51 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:29.178062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-50ede0a7-74a0-4281-bed8-0ee627d1cc51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:53:29.191797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ede0a7-74a0-4281-bed8-0ee627d1cc51 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:29.250241 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff12c0-5239-4f32-9cd2-8c198e477b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:29.250867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff12c0-5239-4f32-9cd2-8c198e477b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:29.251150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff12c0-5239-4f32-9cd2-8c198e477b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:29.251418 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff12c0-5239-4f32-9cd2-8c198e477b42 admin admin] PATH_INFO: `/v3/projects/7d7581bfeb3f400597a90c1bad13b4ec` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:29.252527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff12c0-5239-4f32-9cd2-8c198e477b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d7581bfeb3f400597a90c1bad13b4ec)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:29.254433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff12c0-5239-4f32-9cd2-8c198e477b42 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:29.306874 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dbff12c0-5239-4f32-9cd2-8c198e477b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d7581bfeb3f400597a90c1bad13b4ec', 'request_id': 'req-dbff12c0-5239-4f32-9cd2-8c198e477b42'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:53:29.314409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dbff12c0-5239-4f32-9cd2-8c198e477b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d7581bfeb3f400597a90c1bad13b4ec', 'request_id': 'req-dbff12c0-5239-4f32-9cd2-8c198e477b42'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:53:29.321249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dbff12c0-5239-4f32-9cd2-8c198e477b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d7581bfeb3f400597a90c1bad13b4ec', 'request_id': 'req-dbff12c0-5239-4f32-9cd2-8c198e477b42'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:53:29.334196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dbff12c0-5239-4f32-9cd2-8c198e477b42 admin admin] The token cache is being invalidate because project 7d7581bfeb3f400597a90c1bad13b4ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 10:53:29.334474 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dbff12c0-5239-4f32-9cd2-8c198e477b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:53:29.335132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dbff12c0-5239-4f32-9cd2-8c198e477b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 10:53:29.336846 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4519/9068] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 10:53:29 2022] DELETE /identity/v3/projects/7d7581bfeb3f400597a90c1bad13b4ec => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:53:29.341792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4c002-a2b8-4c05-a6c5-9aebf003fdab None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:29.342149 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4c002-a2b8-4c05-a6c5-9aebf003fdab None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:29.342507 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4c002-a2b8-4c05-a6c5-9aebf003fdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:29.384534 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9ee4c002-a2b8-4c05-a6c5-9aebf003fdab None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:53:29.385816 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9ee4c002-a2b8-4c05-a6c5-9aebf003fdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:53:29.444533 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4550/9069] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:53:29.453234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72f0a7-6280-40e7-89a6-57c9a63e640f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:29.453641 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72f0a7-6280-40e7-89a6-57c9a63e640f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:29.453786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72f0a7-6280-40e7-89a6-57c9a63e640f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:29.473611 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0a72f0a7-6280-40e7-89a6-57c9a63e640f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:53:29.474799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0a72f0a7-6280-40e7-89a6-57c9a63e640f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:53:29.483759 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4520/9070] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:53:29.487999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4c002-a2b8-4c05-a6c5-9aebf003fdab None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:29.498884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4c002-a2b8-4c05-a6c5-9aebf003fdab None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:29.503465 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdad561-5dd1-4677-aed7-4c07e5be3a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:29.504059 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdad561-5dd1-4677-aed7-4c07e5be3a17 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:29.504339 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdad561-5dd1-4677-aed7-4c07e5be3a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:29.504634 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdad561-5dd1-4677-aed7-4c07e5be3a17 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:29.505277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdad561-5dd1-4677-aed7-4c07e5be3a17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 10:53:29.505580 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdad561-5dd1-4677-aed7-4c07e5be3a17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:29.507166 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdad561-5dd1-4677-aed7-4c07e5be3a17 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:29.519345 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4551/9071] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 10:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 10:53:29.523558 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72f0a7-6280-40e7-89a6-57c9a63e640f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:29.532800 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72f0a7-6280-40e7-89a6-57c9a63e640f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:29.537372 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c636e-f7bc-4caa-b17d-99c17eb59fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:29.537954 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c636e-f7bc-4caa-b17d-99c17eb59fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:29.538229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c636e-f7bc-4caa-b17d-99c17eb59fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:29.538497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c636e-f7bc-4caa-b17d-99c17eb59fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:29.539111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c636e-f7bc-4caa-b17d-99c17eb59fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:29.541008 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c636e-f7bc-4caa-b17d-99c17eb59fb1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:29.570091 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4521/9072] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:53:29 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:53:29.574381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdad561-5dd1-4677-aed7-4c07e5be3a17 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:29.584554 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdad561-5dd1-4677-aed7-4c07e5be3a17 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:29.640533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18228dc-6e26-4466-bb63-8d4b9595f484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:29.641085 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18228dc-6e26-4466-bb63-8d4b9595f484 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:29.641365 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18228dc-6e26-4466-bb63-8d4b9595f484 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:29.641636 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18228dc-6e26-4466-bb63-8d4b9595f484 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:29.642266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18228dc-6e26-4466-bb63-8d4b9595f484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:29.644157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18228dc-6e26-4466-bb63-8d4b9595f484 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:29.664895 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4552/9073] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:53:29 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:53:29.669871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c636e-f7bc-4caa-b17d-99c17eb59fb1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:29.680115 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c636e-f7bc-4caa-b17d-99c17eb59fb1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:29.685398 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1630f-7f66-4b76-b844-ddaf3fc5318d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:29.686138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1630f-7f66-4b76-b844-ddaf3fc5318d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:29.686420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1630f-7f66-4b76-b844-ddaf3fc5318d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:29.686816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1630f-7f66-4b76-b844-ddaf3fc5318d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:29.687470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1630f-7f66-4b76-b844-ddaf3fc5318d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:29.689081 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1630f-7f66-4b76-b844-ddaf3fc5318d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:29.699268 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4522/9074] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:53:29.703515 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18228dc-6e26-4466-bb63-8d4b9595f484 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:29.708628 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:53:29.715350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18228dc-6e26-4466-bb63-8d4b9595f484 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:29.721239 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cde64-c52e-4e9e-81e9-c74e4b335ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:29.721841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cde64-c52e-4e9e-81e9-c74e4b335ecf admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:29.722148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cde64-c52e-4e9e-81e9-c74e4b335ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:29.722424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cde64-c52e-4e9e-81e9-c74e4b335ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:29.723092 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cde64-c52e-4e9e-81e9-c74e4b335ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:29.724715 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cde64-c52e-4e9e-81e9-c74e4b335ecf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:29.736130 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4553/9075] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:53:29.740386 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1630f-7f66-4b76-b844-ddaf3fc5318d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:29.751087 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1630f-7f66-4b76-b844-ddaf3fc5318d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:29.755721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c47d8-1991-4a8a-9e50-08f725d9f3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:29.756357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c47d8-1991-4a8a-9e50-08f725d9f3a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:29.756672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c47d8-1991-4a8a-9e50-08f725d9f3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:29.756950 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c47d8-1991-4a8a-9e50-08f725d9f3a2 admin admin] PATH_INFO: `/v3/projects/f39098e17c454aeb9afd7c35c7fdfac7/users/e822fce636d74e3b9ce616002eeadfa8/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:29.773564 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c47d8-1991-4a8a-9e50-08f725d9f3a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f39098e17c454aeb9afd7c35c7fdfac7, user_id=e822fce636d74e3b9ce616002eeadfa8, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:29.776201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c47d8-1991-4a8a-9e50-08f725d9f3a2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:29.789436 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4523/9076] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:53:29 2022] PUT /identity/v3/projects/f39098e17c454aeb9afd7c35c7fdfac7/users/e822fce636d74e3b9ce616002eeadfa8/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:53:29.801843 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145f784-b9b4-4992-930f-6d3d17d978e3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:29.802212 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145f784-b9b4-4992-930f-6d3d17d978e3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:29.802555 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145f784-b9b4-4992-930f-6d3d17d978e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:29.830833 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8145f784-b9b4-4992-930f-6d3d17d978e3 None None] MFA Rules not processed for user `e822fce636d74e3b9ce616002eeadfa8`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:53:29.832028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8145f784-b9b4-4992-930f-6d3d17d978e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:53:29.896707 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4554/9077] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:53:29.901057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c47d8-1991-4a8a-9e50-08f725d9f3a2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:29.913979 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:53:29.963752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c47d8-1991-4a8a-9e50-08f725d9f3a2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:29.968972 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded612b-ece3-4af1-b596-2afca42a2dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:29.969566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded612b-ece3-4af1-b596-2afca42a2dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:29.969843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded612b-ece3-4af1-b596-2afca42a2dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:29.970113 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded612b-ece3-4af1-b596-2afca42a2dc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:29.970742 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded612b-ece3-4af1-b596-2afca42a2dc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:29.972636 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded612b-ece3-4af1-b596-2afca42a2dc9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:29.998928 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4524/9078] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 10:53:29 2022] POST /identity/v3/projects => generated 391 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:53:30.002902 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145f784-b9b4-4992-930f-6d3d17d978e3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:30.013841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145f784-b9b4-4992-930f-6d3d17d978e3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:30.071518 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd92d7-fb0a-460e-a475-f81bc4d853d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:30.072131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd92d7-fb0a-460e-a475-f81bc4d853d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:30.072410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd92d7-fb0a-460e-a475-f81bc4d853d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:30.072716 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd92d7-fb0a-460e-a475-f81bc4d853d2 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:30.073340 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd92d7-fb0a-460e-a475-f81bc4d853d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:30.075321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd92d7-fb0a-460e-a475-f81bc4d853d2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:30.098100 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4555/9079] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 10:53:30 2022] POST /identity/v3/users => generated 302 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 10:53:30.102183 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded612b-ece3-4af1-b596-2afca42a2dc9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:30.114062 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded612b-ece3-4af1-b596-2afca42a2dc9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:30.118691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26e7ea-b908-45b3-be51-98c79e8e7581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:30.119293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26e7ea-b908-45b3-be51-98c79e8e7581 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:30.119574 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26e7ea-b908-45b3-be51-98c79e8e7581 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:30.119846 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26e7ea-b908-45b3-be51-98c79e8e7581 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:30.120510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26e7ea-b908-45b3-be51-98c79e8e7581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:30.122121 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26e7ea-b908-45b3-be51-98c79e8e7581 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:30.133222 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4525/9080] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:53:30.137312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd92d7-fb0a-460e-a475-f81bc4d853d2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:30.147456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd92d7-fb0a-460e-a475-f81bc4d853d2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:30.152000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57346db7-7daf-4542-bf38-57c0c638b22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:30.152662 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57346db7-7daf-4542-bf38-57c0c638b22d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:30.152940 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57346db7-7daf-4542-bf38-57c0c638b22d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:30.153211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57346db7-7daf-4542-bf38-57c0c638b22d admin admin] PATH_INFO: `/v3/projects/52b8b2606aaf494eae1aa5c18ce6beb3/users/cc9bc5400235416a91b5d8d8c8dfa979/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:30.168119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57346db7-7daf-4542-bf38-57c0c638b22d admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b8b2606aaf494eae1aa5c18ce6beb3, user_id=cc9bc5400235416a91b5d8d8c8dfa979, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:30.171504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57346db7-7daf-4542-bf38-57c0c638b22d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:30.184243 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4556/9081] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:53:30 2022] PUT /identity/v3/projects/52b8b2606aaf494eae1aa5c18ce6beb3/users/cc9bc5400235416a91b5d8d8c8dfa979/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:53:30.188202 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26e7ea-b908-45b3-be51-98c79e8e7581 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:30.198467 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26e7ea-b908-45b3-be51-98c79e8e7581 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:30.256110 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a4bdd-1deb-448d-8bd3-65cb85d26aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:30.256813 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a4bdd-1deb-448d-8bd3-65cb85d26aed admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:30.257091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a4bdd-1deb-448d-8bd3-65cb85d26aed admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:30.257359 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a4bdd-1deb-448d-8bd3-65cb85d26aed admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:30.257985 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a4bdd-1deb-448d-8bd3-65cb85d26aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:30.259543 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a4bdd-1deb-448d-8bd3-65cb85d26aed admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:30.269592 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4526/9082] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 10:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 10:53:30.273986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57346db7-7daf-4542-bf38-57c0c638b22d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:30.284691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57346db7-7daf-4542-bf38-57c0c638b22d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:30.289315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb28e32-b8fa-45b6-b5d5-03424d59cb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:30.289947 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb28e32-b8fa-45b6-b5d5-03424d59cb6a admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:30.290223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb28e32-b8fa-45b6-b5d5-03424d59cb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:30.290496 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb28e32-b8fa-45b6-b5d5-03424d59cb6a admin admin] PATH_INFO: `/v3/projects/52b8b2606aaf494eae1aa5c18ce6beb3/users/cc9bc5400235416a91b5d8d8c8dfa979/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:30.292391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb28e32-b8fa-45b6-b5d5-03424d59cb6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b8b2606aaf494eae1aa5c18ce6beb3, user_id=cc9bc5400235416a91b5d8d8c8dfa979, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:30.295013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb28e32-b8fa-45b6-b5d5-03424d59cb6a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:30.304923 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4557/9083] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 10:53:30 2022] PUT /identity/v3/projects/52b8b2606aaf494eae1aa5c18ce6beb3/users/cc9bc5400235416a91b5d8d8c8dfa979/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 10:53:30.315958 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ed2f8-c36a-4286-80b5-a132b7d69b36 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:30.316245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ed2f8-c36a-4286-80b5-a132b7d69b36 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:30.316518 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ed2f8-c36a-4286-80b5-a132b7d69b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:30.345905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-887ed2f8-c36a-4286-80b5-a132b7d69b36 None None] MFA Rules not processed for user `cc9bc5400235416a91b5d8d8c8dfa979`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:53:30.347111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-887ed2f8-c36a-4286-80b5-a132b7d69b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:53:30.417095 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4527/9084] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:53:30 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:53:30.431117 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb28e32-b8fa-45b6-b5d5-03424d59cb6a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:30.432950 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cbb28e32-b8fa-45b6-b5d5-03424d59cb6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:53:30.471797 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:53:30.525976 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb28e32-b8fa-45b6-b5d5-03424d59cb6a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:30.532130 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5ae9f-99b2-47ae-afef-4870bfb6aa4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:30.532765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5ae9f-99b2-47ae-afef-4870bfb6aa4e service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:30.533045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5ae9f-99b2-47ae-afef-4870bfb6aa4e service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:30.533315 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5ae9f-99b2-47ae-afef-4870bfb6aa4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:30.587360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5ae9f-99b2-47ae-afef-4870bfb6aa4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:30.588967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5ae9f-99b2-47ae-afef-4870bfb6aa4e service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:30.598287 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4558/9085] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:53:30 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:53:33.147101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ed2f8-c36a-4286-80b5-a132b7d69b36 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:33.148519 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-887ed2f8-c36a-4286-80b5-a132b7d69b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:53:33.158922 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:53:33.224415 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ed2f8-c36a-4286-80b5-a132b7d69b36 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:33.229602 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2dafb-f0cc-4fb3-902b-44e60148858b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:33.230208 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2dafb-f0cc-4fb3-902b-44e60148858b service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:33.230481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2dafb-f0cc-4fb3-902b-44e60148858b service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:33.230747 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2dafb-f0cc-4fb3-902b-44e60148858b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:33.232986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7fa2dafb-f0cc-4fb3-902b-44e60148858b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:53:33.244871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2dafb-f0cc-4fb3-902b-44e60148858b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:33.246435 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2dafb-f0cc-4fb3-902b-44e60148858b service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:33.256681 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4528/9086] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:53:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:53:34.355492 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5ae9f-99b2-47ae-afef-4870bfb6aa4e service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:34.356990 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f0a5ae9f-99b2-47ae-afef-4870bfb6aa4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:53:34.432198 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5ae9f-99b2-47ae-afef-4870bfb6aa4e service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:34.436856 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdf5ee-082a-43a0-87bc-f6bbfba79ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:34.437459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdf5ee-082a-43a0-87bc-f6bbfba79ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:34.437735 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdf5ee-082a-43a0-87bc-f6bbfba79ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:34.438007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdf5ee-082a-43a0-87bc-f6bbfba79ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:34.447479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdf5ee-082a-43a0-87bc-f6bbfba79ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:34.449011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdf5ee-082a-43a0-87bc-f6bbfba79ef2 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:34.458673 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4559/9087] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:53:34 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:53:37.378298 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e703f9-7c6d-4816-893b-9b7bffa9993b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:37.379339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e703f9-7c6d-4816-893b-9b7bffa9993b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:37.379916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e703f9-7c6d-4816-893b-9b7bffa9993b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:37.410484 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-88e703f9-7c6d-4816-893b-9b7bffa9993b None None] MFA Rules not processed for user `e822fce636d74e3b9ce616002eeadfa8`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:53:37.412067 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-88e703f9-7c6d-4816-893b-9b7bffa9993b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:53:37.419628 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4529/9088] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:53:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:53:39.297023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdf5ee-082a-43a0-87bc-f6bbfba79ef2 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:39.317593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdf5ee-082a-43a0-87bc-f6bbfba79ef2 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:39.337550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f361f-8726-4445-be13-a7fa1864c903 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:39.338961 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f361f-8726-4445-be13-a7fa1864c903 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:39.341729 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f361f-8726-4445-be13-a7fa1864c903 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:39.342015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f361f-8726-4445-be13-a7fa1864c903 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:39.346593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-923f361f-8726-4445-be13-a7fa1864c903 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:53:39.381895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f361f-8726-4445-be13-a7fa1864c903 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:39.383253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f361f-8726-4445-be13-a7fa1864c903 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:39.402732 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4560/9089] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:53:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:53:41.437681 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e703f9-7c6d-4816-893b-9b7bffa9993b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:41.440365 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-88e703f9-7c6d-4816-893b-9b7bffa9993b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:53:41.454720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e703f9-7c6d-4816-893b-9b7bffa9993b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:41.458559 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250959d6-cb87-4dfb-9cc8-a76b1165d68e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:41.459201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250959d6-cb87-4dfb-9cc8-a76b1165d68e service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:41.459667 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250959d6-cb87-4dfb-9cc8-a76b1165d68e service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:41.460139 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250959d6-cb87-4dfb-9cc8-a76b1165d68e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:41.462222 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-250959d6-cb87-4dfb-9cc8-a76b1165d68e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:53:41.476918 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250959d6-cb87-4dfb-9cc8-a76b1165d68e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:41.477722 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250959d6-cb87-4dfb-9cc8-a76b1165d68e service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:41.490636 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4530/9090] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:53:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:53:48.374253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f361f-8726-4445-be13-a7fa1864c903 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:53:48.376113 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-923f361f-8726-4445-be13-a7fa1864c903 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:53:48.393132 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f361f-8726-4445-be13-a7fa1864c903 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:53:48.398965 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d52c3-10c0-4920-88c4-8eb8b51d3954 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:53:48.399604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d52c3-10c0-4920-88c4-8eb8b51d3954 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:53:48.399884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d52c3-10c0-4920-88c4-8eb8b51d3954 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:53:48.400151 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d52c3-10c0-4920-88c4-8eb8b51d3954 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:53:48.402244 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-778d52c3-10c0-4920-88c4-8eb8b51d3954 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:53:48.415025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d52c3-10c0-4920-88c4-8eb8b51d3954 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:53:48.416803 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d52c3-10c0-4920-88c4-8eb8b51d3954 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:53:48.427800 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4561/9091] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:53:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:53:51.487440 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=38 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:53:58.423186 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:54:25.837047 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250959d6-cb87-4dfb-9cc8-a76b1165d68e service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:54:25.849843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250959d6-cb87-4dfb-9cc8-a76b1165d68e service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:54:25.856555 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b93106-75cb-493b-a17d-49fde65beb10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:54:25.857428 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b93106-75cb-493b-a17d-49fde65beb10 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:54:25.857711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b93106-75cb-493b-a17d-49fde65beb10 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:54:25.857987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b93106-75cb-493b-a17d-49fde65beb10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:54:25.860003 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-80b93106-75cb-493b-a17d-49fde65beb10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:54:25.872373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b93106-75cb-493b-a17d-49fde65beb10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:54:25.874038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b93106-75cb-493b-a17d-49fde65beb10 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:54:25.884132 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4531/9092] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:54:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:54:35.879796 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:54:39.953106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5497d-1a1f-440f-babd-97ff51ef397e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:54:39.953669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5497d-1a1f-440f-babd-97ff51ef397e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:54:39.953669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5497d-1a1f-440f-babd-97ff51ef397e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:54:39.975590 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2af5497d-1a1f-440f-babd-97ff51ef397e None None] MFA Rules not processed for user `e822fce636d74e3b9ce616002eeadfa8`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:54:39.978535 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2af5497d-1a1f-440f-babd-97ff51ef397e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:54:39.993043 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4562/9093] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:54:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:54:49.968952 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:56:00.974101 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b93106-75cb-493b-a17d-49fde65beb10 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:56:00.994212 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b93106-75cb-493b-a17d-49fde65beb10 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:56:00.997836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b513c02-8cb7-479b-8331-49367caa90b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:56:00.998584 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b513c02-8cb7-479b-8331-49367caa90b9 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:56:00.998888 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b513c02-8cb7-479b-8331-49367caa90b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:56:00.999161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b513c02-8cb7-479b-8331-49367caa90b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:56:01.001038 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7b513c02-8cb7-479b-8331-49367caa90b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:56:01.005243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5497d-1a1f-440f-babd-97ff51ef397e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:56:01.015361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5497d-1a1f-440f-babd-97ff51ef397e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:56:01.015719 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b513c02-8cb7-479b-8331-49367caa90b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:56:01.017173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b513c02-8cb7-479b-8331-49367caa90b9 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:56:01.019323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192236c7-5a6a-4626-8cd8-bbfce5e991e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:56:01.019993 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192236c7-5a6a-4626-8cd8-bbfce5e991e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:56:01.020282 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192236c7-5a6a-4626-8cd8-bbfce5e991e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:56:01.020563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192236c7-5a6a-4626-8cd8-bbfce5e991e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:56:01.022351 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-192236c7-5a6a-4626-8cd8-bbfce5e991e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:56:01.032995 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192236c7-5a6a-4626-8cd8-bbfce5e991e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:56:01.034464 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192236c7-5a6a-4626-8cd8-bbfce5e991e9 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:56:01.039553 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4532/9094] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:56:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:56:01.042750 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4563/9095] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:56:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:56:02.226470 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b513c02-8cb7-479b-8331-49367caa90b9 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:56:02.236856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b513c02-8cb7-479b-8331-49367caa90b9 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:56:02.242049 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdaf77-5c13-4381-8c77-3b71e3332b5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:56:02.243041 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdaf77-5c13-4381-8c77-3b71e3332b5b service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:56:02.243546 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdaf77-5c13-4381-8c77-3b71e3332b5b service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:56:02.243894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdaf77-5c13-4381-8c77-3b71e3332b5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:56:02.245662 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-76bdaf77-5c13-4381-8c77-3b71e3332b5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:56:02.260531 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdaf77-5c13-4381-8c77-3b71e3332b5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:56:02.261964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdaf77-5c13-4381-8c77-3b71e3332b5b service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:56:02.273335 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4533/9096] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:56:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:56:11.039030 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:56:12.268585 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=20 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:57:12.962350 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66928d79-1f0e-47f4-9605-140d6aa0be83 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:57:12.962889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66928d79-1f0e-47f4-9605-140d6aa0be83 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:57:12.962889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66928d79-1f0e-47f4-9605-140d6aa0be83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:57:12.983533 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-66928d79-1f0e-47f4-9605-140d6aa0be83 None None] MFA Rules not processed for user `e822fce636d74e3b9ce616002eeadfa8`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:57:12.984809 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-66928d79-1f0e-47f4-9605-140d6aa0be83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:57:12.992687 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4564/9097] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:57:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:57:13.335454 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdaf77-5c13-4381-8c77-3b71e3332b5b service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:57:13.346440 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdaf77-5c13-4381-8c77-3b71e3332b5b service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:57:13.352499 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f9414-c985-415f-b4eb-4c2c6b55ce1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:57:13.353404 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f9414-c985-415f-b4eb-4c2c6b55ce1c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:57:13.353832 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f9414-c985-415f-b4eb-4c2c6b55ce1c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:57:13.354297 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f9414-c985-415f-b4eb-4c2c6b55ce1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:57:13.357064 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-df7f9414-c985-415f-b4eb-4c2c6b55ce1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:57:13.368377 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f9414-c985-415f-b4eb-4c2c6b55ce1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:57:13.371730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f9414-c985-415f-b4eb-4c2c6b55ce1c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:57:13.382165 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4534/9098] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:57:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:57:22.977889 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:57:23.378738 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:58:01.638659 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db15788-c3ac-4236-97cd-9c9dcbff831e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:58:01.639325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db15788-c3ac-4236-97cd-9c9dcbff831e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:58:01.639325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db15788-c3ac-4236-97cd-9c9dcbff831e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:58:01.690988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5db15788-c3ac-4236-97cd-9c9dcbff831e None None] MFA Rules not processed for user `a9b0fd833b134a089433cd2985caba80`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:58:01.692097 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5db15788-c3ac-4236-97cd-9c9dcbff831e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:58:01.701327 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4565/9099] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 10:58:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:58:01.714065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f9414-c985-415f-b4eb-4c2c6b55ce1c service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:58:01.723588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f9414-c985-415f-b4eb-4c2c6b55ce1c service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:58:01.727420 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c342b-fd6b-4075-92fc-5d4fcb1185d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:58:01.727970 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c342b-fd6b-4075-92fc-5d4fcb1185d0 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:58:01.728243 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c342b-fd6b-4075-92fc-5d4fcb1185d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:58:01.728511 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c342b-fd6b-4075-92fc-5d4fcb1185d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:58:01.736730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c342b-fd6b-4075-92fc-5d4fcb1185d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:58:01.738142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c342b-fd6b-4075-92fc-5d4fcb1185d0 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:58:01.746668 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4535/9100] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:58:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:58:01.839041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e937e8-575d-44cc-be2d-17ecb0eec588 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:58:01.839436 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e937e8-575d-44cc-be2d-17ecb0eec588 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:58:01.839756 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e937e8-575d-44cc-be2d-17ecb0eec588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:58:01.879057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b3e937e8-575d-44cc-be2d-17ecb0eec588 None None] MFA Rules not processed for user `cbb22d0675bc4ca893b0477cebd470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:58:01.880274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b3e937e8-575d-44cc-be2d-17ecb0eec588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:58:01.889061 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4566/9101] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 10:58:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:58:01.900624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c342b-fd6b-4075-92fc-5d4fcb1185d0 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:58:01.912283 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c342b-fd6b-4075-92fc-5d4fcb1185d0 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:58:01.917175 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d39636-c5bf-4d4c-ba77-4623c8b31617 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:58:01.917767 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d39636-c5bf-4d4c-ba77-4623c8b31617 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:58:01.918044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d39636-c5bf-4d4c-ba77-4623c8b31617 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:58:01.918311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d39636-c5bf-4d4c-ba77-4623c8b31617 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:58:01.927713 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d39636-c5bf-4d4c-ba77-4623c8b31617 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:58:01.929306 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d39636-c5bf-4d4c-ba77-4623c8b31617 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:58:01.939551 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4536/9102] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:58:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:58:02.120548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb3686-269e-4187-83e3-43a942bb2c19 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:58:02.120882 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb3686-269e-4187-83e3-43a942bb2c19 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:58:02.121176 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb3686-269e-4187-83e3-43a942bb2c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:58:02.160353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-83fb3686-269e-4187-83e3-43a942bb2c19 None None] MFA Rules not processed for user `aa607111024540d1a09b01dfd1e5e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:58:02.161588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-83fb3686-269e-4187-83e3-43a942bb2c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:58:02.171351 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4567/9103] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 10:58:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 10:58:02.182007 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d39636-c5bf-4d4c-ba77-4623c8b31617 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:58:02.191274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d39636-c5bf-4d4c-ba77-4623c8b31617 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:58:02.194941 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfb74c-25dd-425b-80a5-323308357227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:58:02.195529 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfb74c-25dd-425b-80a5-323308357227 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:58:02.195807 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfb74c-25dd-425b-80a5-323308357227 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:58:02.196077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfb74c-25dd-425b-80a5-323308357227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:58:02.206191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfb74c-25dd-425b-80a5-323308357227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:58:02.207517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfb74c-25dd-425b-80a5-323308357227 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:58:02.218786 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4537/9104] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:58:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:58:02.279738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb3686-269e-4187-83e3-43a942bb2c19 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:58:02.290854 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb3686-269e-4187-83e3-43a942bb2c19 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:58:02.296011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f95072-f711-4c31-8bd0-9578ef97e382 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:58:02.296621 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f95072-f711-4c31-8bd0-9578ef97e382 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:58:02.296913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f95072-f711-4c31-8bd0-9578ef97e382 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:58:02.297181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f95072-f711-4c31-8bd0-9578ef97e382 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:58:02.298899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a3f95072-f711-4c31-8bd0-9578ef97e382 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:58:02.310462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f95072-f711-4c31-8bd0-9578ef97e382 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:58:02.312020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f95072-f711-4c31-8bd0-9578ef97e382 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:58:02.323526 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4568/9105] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:58:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:58:12.213528 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=18 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:58:12.317534 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=37 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:58:21.343803 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfb74c-25dd-425b-80a5-323308357227 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:58:21.355114 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfb74c-25dd-425b-80a5-323308357227 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:58:21.362173 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4aa6c-9eb7-4e54-ac47-606629b01fcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:58:21.362791 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4aa6c-9eb7-4e54-ac47-606629b01fcc service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:58:21.363077 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4aa6c-9eb7-4e54-ac47-606629b01fcc service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:58:21.363350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4aa6c-9eb7-4e54-ac47-606629b01fcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:58:21.365374 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6fe4aa6c-9eb7-4e54-ac47-606629b01fcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:58:21.378856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4aa6c-9eb7-4e54-ac47-606629b01fcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:58:21.380469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4aa6c-9eb7-4e54-ac47-606629b01fcc service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:58:21.395162 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4538/9106] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:58:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:58:31.386769 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:58:39.207235 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f95072-f711-4c31-8bd0-9578ef97e382 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:58:39.208683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a3f95072-f711-4c31-8bd0-9578ef97e382 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:58:39.230920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f95072-f711-4c31-8bd0-9578ef97e382 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:58:39.236405 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8398d0f-8c58-4aaa-aa5f-1293b29a0327 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:58:39.237030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8398d0f-8c58-4aaa-aa5f-1293b29a0327 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:58:39.237311 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8398d0f-8c58-4aaa-aa5f-1293b29a0327 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:58:39.237577 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8398d0f-8c58-4aaa-aa5f-1293b29a0327 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:58:39.246300 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8398d0f-8c58-4aaa-aa5f-1293b29a0327 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:58:39.247857 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8398d0f-8c58-4aaa-aa5f-1293b29a0327 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:58:39.258467 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4569/9107] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:58:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:58:49.254354 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:58:56.971655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4aa6c-9eb7-4e54-ac47-606629b01fcc service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:58:56.982624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4aa6c-9eb7-4e54-ac47-606629b01fcc service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:58:56.988533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394bfbf-62f9-4ecb-adff-0d52b4649b93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:58:56.989156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394bfbf-62f9-4ecb-adff-0d52b4649b93 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:58:56.989436 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394bfbf-62f9-4ecb-adff-0d52b4649b93 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:58:56.989704 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394bfbf-62f9-4ecb-adff-0d52b4649b93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:58:56.998032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394bfbf-62f9-4ecb-adff-0d52b4649b93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:58:56.999590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394bfbf-62f9-4ecb-adff-0d52b4649b93 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:58:57.008428 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4539/9108] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:58:56 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:59:07.004379 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:59:16.283459 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8398d0f-8c58-4aaa-aa5f-1293b29a0327 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:59:16.296402 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8398d0f-8c58-4aaa-aa5f-1293b29a0327 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:59:16.302205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf77dc-37a1-4153-8885-484eea0d0d52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:59:16.302777 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf77dc-37a1-4153-8885-484eea0d0d52 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:59:16.303055 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf77dc-37a1-4153-8885-484eea0d0d52 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:59:16.303327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf77dc-37a1-4153-8885-484eea0d0d52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:59:16.305548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7abf77dc-37a1-4153-8885-484eea0d0d52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:59:16.319441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf77dc-37a1-4153-8885-484eea0d0d52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:59:16.321612 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf77dc-37a1-4153-8885-484eea0d0d52 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:59:16.332439 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4570/9109] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:59:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:59:20.972356 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394bfbf-62f9-4ecb-adff-0d52b4649b93 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:59:20.984917 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394bfbf-62f9-4ecb-adff-0d52b4649b93 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:59:20.991376 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34750d7b-d870-424f-8e65-f86c078ec21b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:59:20.992200 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34750d7b-d870-424f-8e65-f86c078ec21b service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:59:20.992588 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34750d7b-d870-424f-8e65-f86c078ec21b service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:59:20.993019 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34750d7b-d870-424f-8e65-f86c078ec21b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:59:20.994936 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-34750d7b-d870-424f-8e65-f86c078ec21b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:59:21.009186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34750d7b-d870-424f-8e65-f86c078ec21b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:59:21.010786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34750d7b-d870-424f-8e65-f86c078ec21b service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:59:21.022485 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4540/9110] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:59:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:59:23.903717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf77dc-37a1-4153-8885-484eea0d0d52 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:59:23.913718 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf77dc-37a1-4153-8885-484eea0d0d52 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:59:23.917872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb891eb-fff3-4c9a-98af-5ab66bbd0e54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:59:23.918691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb891eb-fff3-4c9a-98af-5ab66bbd0e54 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:59:23.919550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb891eb-fff3-4c9a-98af-5ab66bbd0e54 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:59:23.919550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb891eb-fff3-4c9a-98af-5ab66bbd0e54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:59:23.929994 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb891eb-fff3-4c9a-98af-5ab66bbd0e54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:59:23.931586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb891eb-fff3-4c9a-98af-5ab66bbd0e54 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:59:23.941749 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4571/9111] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:59:23 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 10:59:26.949013 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2005ea6-e076-46dc-a444-4aeb4fb0f737 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:59:26.949534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2005ea6-e076-46dc-a444-4aeb4fb0f737 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:59:26.949632 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2005ea6-e076-46dc-a444-4aeb4fb0f737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:59:26.972292 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b2005ea6-e076-46dc-a444-4aeb4fb0f737 None None] MFA Rules not processed for user `e822fce636d74e3b9ce616002eeadfa8`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 10:59:26.974065 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b2005ea6-e076-46dc-a444-4aeb4fb0f737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:59:26.985504 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4541/9112] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 10:59:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 10:59:27.323911 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb891eb-fff3-4c9a-98af-5ab66bbd0e54 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:59:27.332537 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb891eb-fff3-4c9a-98af-5ab66bbd0e54 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:59:27.336217 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c947a6-80d4-4622-a261-b7cf40d94db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:59:27.336831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c947a6-80d4-4622-a261-b7cf40d94db7 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:59:27.337112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c947a6-80d4-4622-a261-b7cf40d94db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:59:27.337381 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c947a6-80d4-4622-a261-b7cf40d94db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:59:27.339155 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-40c947a6-80d4-4622-a261-b7cf40d94db7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 10:59:27.349164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c947a6-80d4-4622-a261-b7cf40d94db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:59:27.350588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c947a6-80d4-4622-a261-b7cf40d94db7 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:59:27.358579 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4572/9113] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:59:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:59:27.745522 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2005ea6-e076-46dc-a444-4aeb4fb0f737 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:59:27.762777 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2005ea6-e076-46dc-a444-4aeb4fb0f737 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:59:27.768635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e95b5-d98e-4593-aa1b-398955535d1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:59:27.769578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e95b5-d98e-4593-aa1b-398955535d1d service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:59:27.770015 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e95b5-d98e-4593-aa1b-398955535d1d service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:59:27.770905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e95b5-d98e-4593-aa1b-398955535d1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:59:27.772800 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c947a6-80d4-4622-a261-b7cf40d94db7 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:59:27.784625 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e95b5-d98e-4593-aa1b-398955535d1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:59:27.787455 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e95b5-d98e-4593-aa1b-398955535d1d service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:59:27.793820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c947a6-80d4-4622-a261-b7cf40d94db7 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:59:27.799664 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4542/9114] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:59:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:59:27.799941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b4892-ecff-4c4e-a158-26151f204dac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:59:27.800700 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b4892-ecff-4c4e-a158-26151f204dac service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:59:27.802560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b4892-ecff-4c4e-a158-26151f204dac service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:59:27.802931 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b4892-ecff-4c4e-a158-26151f204dac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:59:27.815004 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b4892-ecff-4c4e-a158-26151f204dac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:59:27.819500 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b4892-ecff-4c4e-a158-26151f204dac service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:59:27.832693 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4573/9115] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:59:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:59:30.034287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e95b5-d98e-4593-aa1b-398955535d1d service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:59:30.050734 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e95b5-d98e-4593-aa1b-398955535d1d service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:59:30.054910 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45ccfe-fe11-4ea5-a525-bd6f24ed8bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:59:30.055539 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45ccfe-fe11-4ea5-a525-bd6f24ed8bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:59:30.055815 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45ccfe-fe11-4ea5-a525-bd6f24ed8bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:59:30.056093 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45ccfe-fe11-4ea5-a525-bd6f24ed8bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:59:30.064458 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45ccfe-fe11-4ea5-a525-bd6f24ed8bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:59:30.066076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45ccfe-fe11-4ea5-a525-bd6f24ed8bb3 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:59:30.075797 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4543/9116] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:59:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:59:35.931579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b4892-ecff-4c4e-a158-26151f204dac service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 10:59:35.945122 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b4892-ecff-4c4e-a158-26151f204dac service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 10:59:35.950660 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047123b9-cb10-4b03-8b7f-a74a1f6442e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 10:59:35.951263 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047123b9-cb10-4b03-8b7f-a74a1f6442e0 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 10:59:35.951661 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047123b9-cb10-4b03-8b7f-a74a1f6442e0 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 10:59:35.951944 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047123b9-cb10-4b03-8b7f-a74a1f6442e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 10:59:35.962320 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047123b9-cb10-4b03-8b7f-a74a1f6442e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 10:59:35.963889 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047123b9-cb10-4b03-8b7f-a74a1f6442e0 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 10:59:35.974685 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4574/9117] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 10:59:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 10:59:40.071798 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=21 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 10:59:45.969958 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=30 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:01:07.193808 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d640915-2c18-4aff-9b0a-971befa5ff56 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:01:07.194400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d640915-2c18-4aff-9b0a-971befa5ff56 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:01:07.194400 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d640915-2c18-4aff-9b0a-971befa5ff56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:01:07.230775 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4d640915-2c18-4aff-9b0a-971befa5ff56 None None] MFA Rules not processed for user `e822fce636d74e3b9ce616002eeadfa8`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:01:07.232688 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4d640915-2c18-4aff-9b0a-971befa5ff56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:01:07.268643 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4544/9118] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 11:01:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 11:01:07.315419 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047123b9-cb10-4b03-8b7f-a74a1f6442e0 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:01:07.317045 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-047123b9-cb10-4b03-8b7f-a74a1f6442e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:01:07.426641 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047123b9-cb10-4b03-8b7f-a74a1f6442e0 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:01:07.431215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e507b3-37cc-4473-99a8-c2c48f17271b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:01:07.431979 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e507b3-37cc-4473-99a8-c2c48f17271b service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:01:07.432260 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e507b3-37cc-4473-99a8-c2c48f17271b service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:01:07.432528 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e507b3-37cc-4473-99a8-c2c48f17271b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:01:07.452763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e507b3-37cc-4473-99a8-c2c48f17271b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:01:07.454196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e507b3-37cc-4473-99a8-c2c48f17271b service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:01:07.466837 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4575/9119] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:01:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:01:09.245390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d640915-2c18-4aff-9b0a-971befa5ff56 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:01:09.255840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d640915-2c18-4aff-9b0a-971befa5ff56 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:01:09.259961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f045ae-94e9-4686-8c22-13015b25b3ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:01:09.260998 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f045ae-94e9-4686-8c22-13015b25b3ae service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:01:09.261473 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f045ae-94e9-4686-8c22-13015b25b3ae service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:01:09.261932 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f045ae-94e9-4686-8c22-13015b25b3ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:01:09.275329 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f045ae-94e9-4686-8c22-13015b25b3ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:01:09.277042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f045ae-94e9-4686-8c22-13015b25b3ae service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:01:09.290570 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4545/9120] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:01:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:01:11.114895 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e507b3-37cc-4473-99a8-c2c48f17271b service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:01:11.125579 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e507b3-37cc-4473-99a8-c2c48f17271b service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:01:11.130032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789fe4f-4634-4194-9101-1e9a85f69664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:01:11.130647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789fe4f-4634-4194-9101-1e9a85f69664 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:01:11.130930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789fe4f-4634-4194-9101-1e9a85f69664 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:01:11.131205 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789fe4f-4634-4194-9101-1e9a85f69664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:01:11.140296 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789fe4f-4634-4194-9101-1e9a85f69664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:01:11.141768 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789fe4f-4634-4194-9101-1e9a85f69664 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:01:11.150542 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4576/9121] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:01:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:01:19.283822 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=21 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:01:21.146517 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=53 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:02:39.584788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f045ae-94e9-4686-8c22-13015b25b3ae service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:02:39.596820 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f045ae-94e9-4686-8c22-13015b25b3ae service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:02:39.601891 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342b63d-fb4d-4ef5-a814-ff58346738e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:02:39.602485 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342b63d-fb4d-4ef5-a814-ff58346738e1 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:39.602789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342b63d-fb4d-4ef5-a814-ff58346738e1 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:39.603193 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342b63d-fb4d-4ef5-a814-ff58346738e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:39.604965 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9342b63d-fb4d-4ef5-a814-ff58346738e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:02:39.616580 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342b63d-fb4d-4ef5-a814-ff58346738e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:02:39.618171 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342b63d-fb4d-4ef5-a814-ff58346738e1 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:02:39.628711 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4546/9122] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:02:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:02:39.851188 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789fe4f-4634-4194-9101-1e9a85f69664 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:02:39.943177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789fe4f-4634-4194-9101-1e9a85f69664 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:02:39.948157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8da481-8cc4-423c-8d28-522f0de0eafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:02:39.948831 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8da481-8cc4-423c-8d28-522f0de0eafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:39.949717 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8da481-8cc4-423c-8d28-522f0de0eafa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:39.950652 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8da481-8cc4-423c-8d28-522f0de0eafa admin admin] PATH_INFO: `/v3/users/e822fce636d74e3b9ce616002eeadfa8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:39.951814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8da481-8cc4-423c-8d28-522f0de0eafa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e822fce636d74e3b9ce616002eeadfa8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:02:39.953812 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8da481-8cc4-423c-8d28-522f0de0eafa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:02:40.015023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc8da481-8cc4-423c-8d28-522f0de0eafa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e822fce636d74e3b9ce616002eeadfa8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:02:40.015733 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc8da481-8cc4-423c-8d28-522f0de0eafa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e822fce636d74e3b9ce616002eeadfa8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:02:40.024967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc8da481-8cc4-423c-8d28-522f0de0eafa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e822fce636d74e3b9ce616002eeadfa8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:02:40.042706 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc8da481-8cc4-423c-8d28-522f0de0eafa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e822fce636d74e3b9ce616002eeadfa8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:02:40.049884 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc8da481-8cc4-423c-8d28-522f0de0eafa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e822fce636d74e3b9ce616002eeadfa8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:02:40.055780 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4577/9123] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 11:02:39 2022] DELETE /identity/v3/users/e822fce636d74e3b9ce616002eeadfa8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 11:02:40.061026 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4a23a-f921-4404-be41-47b5b7020b56 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:40.061316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4a23a-f921-4404-be41-47b5b7020b56 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:40.061594 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4a23a-f921-4404-be41-47b5b7020b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:40.082409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-46e4a23a-f921-4404-be41-47b5b7020b56 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:02:40.083620 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-46e4a23a-f921-4404-be41-47b5b7020b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:02:40.153769 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4547/9124] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 11:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 11:02:40.160297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8da481-8cc4-423c-8d28-522f0de0eafa admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:02:40.161804 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bc8da481-8cc4-423c-8d28-522f0de0eafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:02:40.225043 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8da481-8cc4-423c-8d28-522f0de0eafa admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:02:40.228656 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b70a33-0b29-44f3-8057-efda173b792c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:02:40.229251 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b70a33-0b29-44f3-8057-efda173b792c service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:40.229530 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b70a33-0b29-44f3-8057-efda173b792c service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:40.229792 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b70a33-0b29-44f3-8057-efda173b792c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:40.239452 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b70a33-0b29-44f3-8057-efda173b792c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:02:40.240899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b70a33-0b29-44f3-8057-efda173b792c service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:02:40.251117 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4578/9125] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:02:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:02:40.424318 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4a23a-f921-4404-be41-47b5b7020b56 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:02:40.425957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-46e4a23a-f921-4404-be41-47b5b7020b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:02:40.440592 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4a23a-f921-4404-be41-47b5b7020b56 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:02:40.447089 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05e43a-5ff1-444d-9597-f5f3da92a012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:02:40.448277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05e43a-5ff1-444d-9597-f5f3da92a012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:40.448640 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05e43a-5ff1-444d-9597-f5f3da92a012 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:40.449032 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05e43a-5ff1-444d-9597-f5f3da92a012 admin admin] PATH_INFO: `/v3/projects/f39098e17c454aeb9afd7c35c7fdfac7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:40.450245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05e43a-5ff1-444d-9597-f5f3da92a012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f39098e17c454aeb9afd7c35c7fdfac7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:02:40.452132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05e43a-5ff1-444d-9597-f5f3da92a012 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:02:40.498938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7f05e43a-5ff1-444d-9597-f5f3da92a012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f39098e17c454aeb9afd7c35c7fdfac7', 'request_id': 'req-7f05e43a-5ff1-444d-9597-f5f3da92a012'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:02:40.506147 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7f05e43a-5ff1-444d-9597-f5f3da92a012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f39098e17c454aeb9afd7c35c7fdfac7', 'request_id': 'req-7f05e43a-5ff1-444d-9597-f5f3da92a012'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:02:40.511903 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7f05e43a-5ff1-444d-9597-f5f3da92a012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f39098e17c454aeb9afd7c35c7fdfac7', 'request_id': 'req-7f05e43a-5ff1-444d-9597-f5f3da92a012'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:02:40.522675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7f05e43a-5ff1-444d-9597-f5f3da92a012 admin admin] The token cache is being invalidate because project f39098e17c454aeb9afd7c35c7fdfac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 11:02:40.523027 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7f05e43a-5ff1-444d-9597-f5f3da92a012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:02:40.523670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7f05e43a-5ff1-444d-9597-f5f3da92a012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:02:40.525178 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4548/9126] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 11:02:40 2022] DELETE /identity/v3/projects/f39098e17c454aeb9afd7c35c7fdfac7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 11:02:40.531697 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b70a33-0b29-44f3-8057-efda173b792c service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:02:40.541445 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b70a33-0b29-44f3-8057-efda173b792c service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:02:40.550817 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:02:40.599417 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732401cf-57d8-4539-9b8c-498c6a235a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:02:40.600034 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732401cf-57d8-4539-9b8c-498c6a235a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:40.600310 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732401cf-57d8-4539-9b8c-498c6a235a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:40.600578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732401cf-57d8-4539-9b8c-498c6a235a8b admin admin] PATH_INFO: `/v3/users/cc9bc5400235416a91b5d8d8c8dfa979` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:40.601704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732401cf-57d8-4539-9b8c-498c6a235a8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc9bc5400235416a91b5d8d8c8dfa979)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:02:40.603584 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732401cf-57d8-4539-9b8c-498c6a235a8b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:02:40.647108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-732401cf-57d8-4539-9b8c-498c6a235a8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc9bc5400235416a91b5d8d8c8dfa979'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:02:40.647741 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-732401cf-57d8-4539-9b8c-498c6a235a8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc9bc5400235416a91b5d8d8c8dfa979'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:02:40.655412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-732401cf-57d8-4539-9b8c-498c6a235a8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc9bc5400235416a91b5d8d8c8dfa979'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:02:40.667488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-732401cf-57d8-4539-9b8c-498c6a235a8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc9bc5400235416a91b5d8d8c8dfa979'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:02:40.675139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-732401cf-57d8-4539-9b8c-498c6a235a8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc9bc5400235416a91b5d8d8c8dfa979'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:02:40.681180 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4579/9127] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 11:02:40 2022] DELETE /identity/v3/users/cc9bc5400235416a91b5d8d8c8dfa979 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 11:02:40.956313 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05e43a-5ff1-444d-9597-f5f3da92a012 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:02:40.957810 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7f05e43a-5ff1-444d-9597-f5f3da92a012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:02:40.972827 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05e43a-5ff1-444d-9597-f5f3da92a012 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:02:41.031146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1c20b-a920-4ed0-8d79-7d32167a73b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:02:41.031766 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1c20b-a920-4ed0-8d79-7d32167a73b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:41.032042 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1c20b-a920-4ed0-8d79-7d32167a73b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:41.032308 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1c20b-a920-4ed0-8d79-7d32167a73b2 admin admin] PATH_INFO: `/v3/projects/52b8b2606aaf494eae1aa5c18ce6beb3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:41.033472 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1c20b-a920-4ed0-8d79-7d32167a73b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b8b2606aaf494eae1aa5c18ce6beb3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:02:41.035465 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1c20b-a920-4ed0-8d79-7d32167a73b2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:02:41.046542 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:02:41.083177 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-60a1c20b-a920-4ed0-8d79-7d32167a73b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b8b2606aaf494eae1aa5c18ce6beb3', 'request_id': 'req-60a1c20b-a920-4ed0-8d79-7d32167a73b2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:02:41.090996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-60a1c20b-a920-4ed0-8d79-7d32167a73b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b8b2606aaf494eae1aa5c18ce6beb3', 'request_id': 'req-60a1c20b-a920-4ed0-8d79-7d32167a73b2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:02:41.096513 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-60a1c20b-a920-4ed0-8d79-7d32167a73b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b8b2606aaf494eae1aa5c18ce6beb3', 'request_id': 'req-60a1c20b-a920-4ed0-8d79-7d32167a73b2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:02:41.107809 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-60a1c20b-a920-4ed0-8d79-7d32167a73b2 admin admin] The token cache is being invalidate because project 52b8b2606aaf494eae1aa5c18ce6beb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 11:02:41.108099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-60a1c20b-a920-4ed0-8d79-7d32167a73b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:02:41.108786 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-60a1c20b-a920-4ed0-8d79-7d32167a73b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:02:41.110279 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4549/9128] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 11:02:40 2022] DELETE /identity/v3/projects/52b8b2606aaf494eae1aa5c18ce6beb3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 11:02:41.115736 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3977d2-881b-4714-bc4b-0d668ca2542d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:41.116261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3977d2-881b-4714-bc4b-0d668ca2542d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:41.116261 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3977d2-881b-4714-bc4b-0d668ca2542d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:41.155669 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8b3977d2-881b-4714-bc4b-0d668ca2542d None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:02:41.156898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8b3977d2-881b-4714-bc4b-0d668ca2542d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:02:41.215579 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4580/9129] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 11:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 11:02:41.223855 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cdb65-9496-4b9d-9661-0101c8afec12 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:41.224137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cdb65-9496-4b9d-9661-0101c8afec12 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:41.224408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cdb65-9496-4b9d-9661-0101c8afec12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:41.244615 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-782cdb65-9496-4b9d-9661-0101c8afec12 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:02:41.245825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-782cdb65-9496-4b9d-9661-0101c8afec12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:02:41.253827 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4550/9130] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 11:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 11:02:41.258253 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3977d2-881b-4714-bc4b-0d668ca2542d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:02:41.268576 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3977d2-881b-4714-bc4b-0d668ca2542d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:02:41.273196 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1509a0-fb21-4f02-a23d-76d95cda18c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:02:41.273787 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1509a0-fb21-4f02-a23d-76d95cda18c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:41.274074 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1509a0-fb21-4f02-a23d-76d95cda18c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:41.274347 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1509a0-fb21-4f02-a23d-76d95cda18c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:41.274984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1509a0-fb21-4f02-a23d-76d95cda18c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 11:02:41.275286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1509a0-fb21-4f02-a23d-76d95cda18c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:02:41.276904 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1509a0-fb21-4f02-a23d-76d95cda18c4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:02:41.289302 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4581/9131] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 11:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 11:02:41.293605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cdb65-9496-4b9d-9661-0101c8afec12 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:02:41.303035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cdb65-9496-4b9d-9661-0101c8afec12 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:02:41.307644 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8fe85-987c-4041-afeb-29d0ad1f95a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:02:41.308230 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8fe85-987c-4041-afeb-29d0ad1f95a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:41.309253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8fe85-987c-4041-afeb-29d0ad1f95a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:41.309606 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8fe85-987c-4041-afeb-29d0ad1f95a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:41.310397 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8fe85-987c-4041-afeb-29d0ad1f95a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:02:41.312250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8fe85-987c-4041-afeb-29d0ad1f95a2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:02:41.349609 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4551/9132] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 11:02:41 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 11:02:41.353643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1509a0-fb21-4f02-a23d-76d95cda18c4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:02:41.361524 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:02:41.365848 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1509a0-fb21-4f02-a23d-76d95cda18c4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:02:41.427414 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146351b7-de06-44f5-b64b-8a10dc67fa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:02:41.428013 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146351b7-de06-44f5-b64b-8a10dc67fa44 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:41.428292 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146351b7-de06-44f5-b64b-8a10dc67fa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:41.428563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146351b7-de06-44f5-b64b-8a10dc67fa44 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:41.429220 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146351b7-de06-44f5-b64b-8a10dc67fa44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:02:41.431123 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146351b7-de06-44f5-b64b-8a10dc67fa44 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:02:41.453890 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4582/9133] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 11:02:41 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 11:02:41.458163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8fe85-987c-4041-afeb-29d0ad1f95a2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:02:41.468864 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8fe85-987c-4041-afeb-29d0ad1f95a2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:02:41.473389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36ae64-3f78-41ce-86cd-5b130f593b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:02:41.473980 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36ae64-3f78-41ce-86cd-5b130f593b68 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:41.474254 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36ae64-3f78-41ce-86cd-5b130f593b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:41.474523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36ae64-3f78-41ce-86cd-5b130f593b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:41.475159 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36ae64-3f78-41ce-86cd-5b130f593b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:02:41.476770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36ae64-3f78-41ce-86cd-5b130f593b68 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:02:41.486765 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4552/9134] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 11:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 11:02:41.490671 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146351b7-de06-44f5-b64b-8a10dc67fa44 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:02:41.501837 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146351b7-de06-44f5-b64b-8a10dc67fa44 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:02:41.506484 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e0c53-3142-4051-9604-27fbbc0532de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:02:41.507187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e0c53-3142-4051-9604-27fbbc0532de admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:41.507609 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e0c53-3142-4051-9604-27fbbc0532de admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:41.507728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e0c53-3142-4051-9604-27fbbc0532de admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:41.508377 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e0c53-3142-4051-9604-27fbbc0532de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:02:41.510000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e0c53-3142-4051-9604-27fbbc0532de admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:02:41.522024 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4583/9135] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 11:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 11:02:41.526068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36ae64-3f78-41ce-86cd-5b130f593b68 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:02:41.536004 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36ae64-3f78-41ce-86cd-5b130f593b68 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:02:41.540833 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6214d-b554-4322-a11c-685ce09dff31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:02:41.541508 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6214d-b554-4322-a11c-685ce09dff31 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:41.541792 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6214d-b554-4322-a11c-685ce09dff31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:41.542068 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6214d-b554-4322-a11c-685ce09dff31 admin admin] PATH_INFO: `/v3/projects/812dc7c26fcb453e9692ab2026f49dc7/users/20b45eeddc48467183e12c6ce2f7399e/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:41.557528 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6214d-b554-4322-a11c-685ce09dff31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=812dc7c26fcb453e9692ab2026f49dc7, user_id=20b45eeddc48467183e12c6ce2f7399e, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:02:41.561138 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6214d-b554-4322-a11c-685ce09dff31 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:02:41.575520 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4553/9136] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 11:02:41 2022] PUT /identity/v3/projects/812dc7c26fcb453e9692ab2026f49dc7/users/20b45eeddc48467183e12c6ce2f7399e/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 11:02:41.580654 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531c498-af55-400a-b2f4-a0c39bf373a5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:41.580943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531c498-af55-400a-b2f4-a0c39bf373a5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:41.581215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531c498-af55-400a-b2f4-a0c39bf373a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:41.601089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c531c498-af55-400a-b2f4-a0c39bf373a5 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:02:41.602204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c531c498-af55-400a-b2f4-a0c39bf373a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:02:41.660396 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4584/9137] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 11:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 11:02:41.670593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6214d-b554-4322-a11c-685ce09dff31 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:02:41.672253 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f4c6214d-b554-4322-a11c-685ce09dff31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:02:41.750527 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6214d-b554-4322-a11c-685ce09dff31 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:02:41.754154 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeec051-978e-4f7c-8bc1-d68070e11e37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:02:41.754752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeec051-978e-4f7c-8bc1-d68070e11e37 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:41.755028 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeec051-978e-4f7c-8bc1-d68070e11e37 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:41.755296 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeec051-978e-4f7c-8bc1-d68070e11e37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:41.764350 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeec051-978e-4f7c-8bc1-d68070e11e37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:02:41.765783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeec051-978e-4f7c-8bc1-d68070e11e37 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:02:41.775081 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4554/9138] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:02:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:02:46.113162 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d1c2e-717f-41d1-9e42-1d5d16456556 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:46.113728 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d1c2e-717f-41d1-9e42-1d5d16456556 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:46.114028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d1c2e-717f-41d1-9e42-1d5d16456556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:46.145221 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b76d1c2e-717f-41d1-9e42-1d5d16456556 None None] MFA Rules not processed for user `20b45eeddc48467183e12c6ce2f7399e`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:02:46.146429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b76d1c2e-717f-41d1-9e42-1d5d16456556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:02:46.214369 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4585/9139] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 11:02:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 11:02:46.220261 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeec051-978e-4f7c-8bc1-d68070e11e37 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:02:46.234379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeec051-978e-4f7c-8bc1-d68070e11e37 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:02:46.238964 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728124f-b26f-40fe-b2d5-03af0011010a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:02:46.239595 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728124f-b26f-40fe-b2d5-03af0011010a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:46.239870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728124f-b26f-40fe-b2d5-03af0011010a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:46.240137 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728124f-b26f-40fe-b2d5-03af0011010a admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:46.240801 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728124f-b26f-40fe-b2d5-03af0011010a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:02:46.242754 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728124f-b26f-40fe-b2d5-03af0011010a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:02:46.272513 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4555/9140] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 11:02:46 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 11:02:46.276690 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d1c2e-717f-41d1-9e42-1d5d16456556 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:02:46.288456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d1c2e-717f-41d1-9e42-1d5d16456556 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:02:46.297760 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:02:46.351367 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238812fa-8dbb-4d1f-bd0c-06a7eb88308c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:02:46.352128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238812fa-8dbb-4d1f-bd0c-06a7eb88308c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:46.352410 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238812fa-8dbb-4d1f-bd0c-06a7eb88308c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:46.352971 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238812fa-8dbb-4d1f-bd0c-06a7eb88308c admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:46.353647 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238812fa-8dbb-4d1f-bd0c-06a7eb88308c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:02:46.356106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238812fa-8dbb-4d1f-bd0c-06a7eb88308c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:02:46.381796 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4586/9141] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 11:02:46 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 11:02:46.387393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728124f-b26f-40fe-b2d5-03af0011010a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:02:46.398816 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728124f-b26f-40fe-b2d5-03af0011010a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:02:46.404219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36513bf8-c86d-4799-b991-9ac7dd60632e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:02:46.404857 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36513bf8-c86d-4799-b991-9ac7dd60632e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:46.405165 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36513bf8-c86d-4799-b991-9ac7dd60632e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:46.405434 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36513bf8-c86d-4799-b991-9ac7dd60632e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:46.406071 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36513bf8-c86d-4799-b991-9ac7dd60632e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:02:46.407645 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36513bf8-c86d-4799-b991-9ac7dd60632e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:02:46.410253 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:02:46.421516 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4556/9142] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 11:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 11:02:46.425506 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238812fa-8dbb-4d1f-bd0c-06a7eb88308c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:02:46.437145 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238812fa-8dbb-4d1f-bd0c-06a7eb88308c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:02:46.442105 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1b16c-a716-4123-a828-1a8a06a730c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:02:46.442783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1b16c-a716-4123-a828-1a8a06a730c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:46.443089 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1b16c-a716-4123-a828-1a8a06a730c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:46.443502 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1b16c-a716-4123-a828-1a8a06a730c1 admin admin] PATH_INFO: `/v3/projects/42b9eac48b57413593fa0380165f7c30/users/3f9b28b63683465999b01bb52dd77fb0/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:46.461323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1b16c-a716-4123-a828-1a8a06a730c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b9eac48b57413593fa0380165f7c30, user_id=3f9b28b63683465999b01bb52dd77fb0, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:02:46.464002 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1b16c-a716-4123-a828-1a8a06a730c1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:02:46.478266 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4587/9143] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 11:02:46 2022] PUT /identity/v3/projects/42b9eac48b57413593fa0380165f7c30/users/3f9b28b63683465999b01bb52dd77fb0/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 11:02:46.482344 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36513bf8-c86d-4799-b991-9ac7dd60632e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:02:46.492375 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36513bf8-c86d-4799-b991-9ac7dd60632e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:02:46.555117 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043d2fe-239f-4311-9b19-14b040820929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:02:46.555720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043d2fe-239f-4311-9b19-14b040820929 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:46.555996 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043d2fe-239f-4311-9b19-14b040820929 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:46.556264 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043d2fe-239f-4311-9b19-14b040820929 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:46.556947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043d2fe-239f-4311-9b19-14b040820929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:02:46.559204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043d2fe-239f-4311-9b19-14b040820929 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:02:46.568964 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4557/9144] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 11:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 11:02:46.573462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1b16c-a716-4123-a828-1a8a06a730c1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:02:46.589049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1b16c-a716-4123-a828-1a8a06a730c1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:02:46.594561 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60930204-c7e7-404b-b5e4-c1e073ec55f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:02:46.595241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60930204-c7e7-404b-b5e4-c1e073ec55f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:46.595617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60930204-c7e7-404b-b5e4-c1e073ec55f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:46.595929 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60930204-c7e7-404b-b5e4-c1e073ec55f0 admin admin] PATH_INFO: `/v3/projects/42b9eac48b57413593fa0380165f7c30/users/3f9b28b63683465999b01bb52dd77fb0/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:46.597930 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60930204-c7e7-404b-b5e4-c1e073ec55f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b9eac48b57413593fa0380165f7c30, user_id=3f9b28b63683465999b01bb52dd77fb0, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:02:46.600591 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60930204-c7e7-404b-b5e4-c1e073ec55f0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:02:46.611239 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4588/9145] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 11:02:46 2022] PUT /identity/v3/projects/42b9eac48b57413593fa0380165f7c30/users/3f9b28b63683465999b01bb52dd77fb0/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 11:02:51.245757 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518a299-8eaf-420e-a15b-ca981426fc45 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:51.246691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518a299-8eaf-420e-a15b-ca981426fc45 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:51.246997 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518a299-8eaf-420e-a15b-ca981426fc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:51.319785 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2518a299-8eaf-420e-a15b-ca981426fc45 None None] MFA Rules not processed for user `3f9b28b63683465999b01bb52dd77fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:02:51.321422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2518a299-8eaf-420e-a15b-ca981426fc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:02:51.438065 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4558/9146] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 11:02:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 11:02:51.456587 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60930204-c7e7-404b-b5e4-c1e073ec55f0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:02:51.458546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-60930204-c7e7-404b-b5e4-c1e073ec55f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:02:51.546880 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60930204-c7e7-404b-b5e4-c1e073ec55f0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:02:51.553763 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be36795-e8cf-447c-b9d2-32b3efc73f13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:02:51.554298 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be36795-e8cf-447c-b9d2-32b3efc73f13 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:51.554699 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be36795-e8cf-447c-b9d2-32b3efc73f13 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:51.554980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be36795-e8cf-447c-b9d2-32b3efc73f13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:51.629827 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be36795-e8cf-447c-b9d2-32b3efc73f13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:02:51.633341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be36795-e8cf-447c-b9d2-32b3efc73f13 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:02:51.650072 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4589/9147] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:02:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:02:52.725781 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f51665-f34b-4e29-b394-3d655e8eb0c5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:52.726288 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f51665-f34b-4e29-b394-3d655e8eb0c5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:52.726389 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f51665-f34b-4e29-b394-3d655e8eb0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:52.748325 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-95f51665-f34b-4e29-b394-3d655e8eb0c5 None None] MFA Rules not processed for user `20b45eeddc48467183e12c6ce2f7399e`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:02:52.749581 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-95f51665-f34b-4e29-b394-3d655e8eb0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:02:52.756410 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4559/9148] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 11:02:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 11:02:53.080668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be36795-e8cf-447c-b9d2-32b3efc73f13 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:02:53.082061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0be36795-e8cf-447c-b9d2-32b3efc73f13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:02:53.087310 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:02:53.146526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be36795-e8cf-447c-b9d2-32b3efc73f13 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:02:53.150177 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9dc89-620a-452c-b2c2-47f95d7f5c3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:02:53.150793 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9dc89-620a-452c-b2c2-47f95d7f5c3e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:02:53.151061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9dc89-620a-452c-b2c2-47f95d7f5c3e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:02:53.151325 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9dc89-620a-452c-b2c2-47f95d7f5c3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:02:53.153685 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d5d9dc89-620a-452c-b2c2-47f95d7f5c3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:02:53.163765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9dc89-620a-452c-b2c2-47f95d7f5c3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:02:53.165215 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9dc89-620a-452c-b2c2-47f95d7f5c3e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:02:53.173142 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4590/9149] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:02:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:03:02.740733 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=67 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:03:03.154096 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f51665-f34b-4e29-b394-3d655e8eb0c5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:03:03.163477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f51665-f34b-4e29-b394-3d655e8eb0c5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:03:03.167005 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63053d48-0490-4edc-8d57-e1aef5c4f0f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:03:03.168229 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63053d48-0490-4edc-8d57-e1aef5c4f0f1 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:03:03.168501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63053d48-0490-4edc-8d57-e1aef5c4f0f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:03:03.168799 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63053d48-0490-4edc-8d57-e1aef5c4f0f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:03:03.169552 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=25 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:03:03.178238 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63053d48-0490-4edc-8d57-e1aef5c4f0f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:03:03.179630 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63053d48-0490-4edc-8d57-e1aef5c4f0f1 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:03:03.189070 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4560/9150] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:03:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:03:13.184847 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:03:44.179619 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9dc89-620a-452c-b2c2-47f95d7f5c3e service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:03:44.181111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d5d9dc89-620a-452c-b2c2-47f95d7f5c3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:03:44.265481 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9dc89-620a-452c-b2c2-47f95d7f5c3e service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:03:44.270583 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a543dc-bf5f-44bd-abec-2bb2e40dce5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:03:44.271187 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a543dc-bf5f-44bd-abec-2bb2e40dce5d service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:03:44.271466 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a543dc-bf5f-44bd-abec-2bb2e40dce5d service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:03:44.271737 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a543dc-bf5f-44bd-abec-2bb2e40dce5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:03:44.273491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-82a543dc-bf5f-44bd-abec-2bb2e40dce5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:03:44.286450 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a543dc-bf5f-44bd-abec-2bb2e40dce5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:03:44.288018 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a543dc-bf5f-44bd-abec-2bb2e40dce5d service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:03:44.298434 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4591/9151] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:03:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:03:54.293840 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=37 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:04:34.746718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63053d48-0490-4edc-8d57-e1aef5c4f0f1 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:04:34.758390 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63053d48-0490-4edc-8d57-e1aef5c4f0f1 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:04:34.763929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe9065-871a-4363-9b01-905a1aadc526 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:04:34.764556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe9065-871a-4363-9b01-905a1aadc526 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:04:34.764876 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe9065-871a-4363-9b01-905a1aadc526 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:04:34.765166 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe9065-871a-4363-9b01-905a1aadc526 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:04:34.767057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-91fe9065-871a-4363-9b01-905a1aadc526 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:04:34.779172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe9065-871a-4363-9b01-905a1aadc526 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:04:34.780764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe9065-871a-4363-9b01-905a1aadc526 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:04:34.790481 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4561/9152] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:04:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:04:44.786379 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:04:57.444825 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a543dc-bf5f-44bd-abec-2bb2e40dce5d service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:04:57.454266 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a543dc-bf5f-44bd-abec-2bb2e40dce5d service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:04:57.458371 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ab247-5b99-43b4-bec8-a0e6dcc3854a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:04:57.458957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ab247-5b99-43b4-bec8-a0e6dcc3854a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:04:57.459234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ab247-5b99-43b4-bec8-a0e6dcc3854a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:04:57.459501 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ab247-5b99-43b4-bec8-a0e6dcc3854a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:04:57.461223 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8a9ab247-5b99-43b4-bec8-a0e6dcc3854a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:04:57.487088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ab247-5b99-43b4-bec8-a0e6dcc3854a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:04:57.488504 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ab247-5b99-43b4-bec8-a0e6dcc3854a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:04:57.496558 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4592/9153] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:04:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:05:07.492862 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=11 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:05:11.489700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc535d-2aeb-4935-927c-d8dae626fc19 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:05:11.490948 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc535d-2aeb-4935-927c-d8dae626fc19 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:05:11.491277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc535d-2aeb-4935-927c-d8dae626fc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:05:11.504411 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ab247-5b99-43b4-bec8-a0e6dcc3854a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:05:11.527485 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ab247-5b99-43b4-bec8-a0e6dcc3854a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:05:11.535664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c035b-e2a0-437b-905e-d9a7dfca5bfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:05:11.537286 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c035b-e2a0-437b-905e-d9a7dfca5bfe service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:05:11.537633 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c035b-e2a0-437b-905e-d9a7dfca5bfe service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:05:11.537978 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c035b-e2a0-437b-905e-d9a7dfca5bfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:05:11.540389 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-129c035b-e2a0-437b-905e-d9a7dfca5bfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:05:11.555736 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2bcc535d-2aeb-4935-927c-d8dae626fc19 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:05:11.557367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2bcc535d-2aeb-4935-927c-d8dae626fc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:05:11.572358 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c035b-e2a0-437b-905e-d9a7dfca5bfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:05:11.574057 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c035b-e2a0-437b-905e-d9a7dfca5bfe service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:05:11.585223 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4593/9154] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:05:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 11:05:11.626816 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4562/9155] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 11:05:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 11:05:11.673447 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c035b-e2a0-437b-905e-d9a7dfca5bfe service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:05:11.674842 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-129c035b-e2a0-437b-905e-d9a7dfca5bfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:05:11.767331 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c035b-e2a0-437b-905e-d9a7dfca5bfe service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:05:11.772475 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d53961-c0e2-43c2-8be4-e2a879faa99c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:05:11.773108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d53961-c0e2-43c2-8be4-e2a879faa99c service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:05:11.773391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d53961-c0e2-43c2-8be4-e2a879faa99c service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:05:11.773664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d53961-c0e2-43c2-8be4-e2a879faa99c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:05:11.782236 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d53961-c0e2-43c2-8be4-e2a879faa99c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:05:11.783899 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d53961-c0e2-43c2-8be4-e2a879faa99c service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:05:11.791894 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4594/9156] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 11:05:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 11:05:21.623152 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=40 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:05:21.788817 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=55 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:05:25.718618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890de64-c868-482f-96e9-fb0c04a6575a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:05:25.719176 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890de64-c868-482f-96e9-fb0c04a6575a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:05:25.719305 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890de64-c868-482f-96e9-fb0c04a6575a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:05:25.749695 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3890de64-c868-482f-96e9-fb0c04a6575a None None] MFA Rules not processed for user `aa607111024540d1a09b01dfd1e5e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:05:25.751660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3890de64-c868-482f-96e9-fb0c04a6575a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:05:25.761429 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4563/9157] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Sep 30 11:05:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 11:05:25.773604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d53961-c0e2-43c2-8be4-e2a879faa99c service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:05:25.775112 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-42d53961-c0e2-43c2-8be4-e2a879faa99c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:05:25.834119 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d53961-c0e2-43c2-8be4-e2a879faa99c service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:05:25.837724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26bdf6-c1c4-42a2-94a0-44b4bc723bcc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:05:25.838334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26bdf6-c1c4-42a2-94a0-44b4bc723bcc service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:05:25.838592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26bdf6-c1c4-42a2-94a0-44b4bc723bcc service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:05:25.838860 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26bdf6-c1c4-42a2-94a0-44b4bc723bcc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:05:25.850204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26bdf6-c1c4-42a2-94a0-44b4bc723bcc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:05:25.851620 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26bdf6-c1c4-42a2-94a0-44b4bc723bcc service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:05:25.862352 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4595/9158] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:05:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:05:25.927870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890de64-c868-482f-96e9-fb0c04a6575a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:05:25.937161 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890de64-c868-482f-96e9-fb0c04a6575a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:05:25.941406 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8942a4-ecc9-41ad-bba3-993983312733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:05:25.942001 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8942a4-ecc9-41ad-bba3-993983312733 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:05:25.942279 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8942a4-ecc9-41ad-bba3-993983312733 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:05:25.942549 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8942a4-ecc9-41ad-bba3-993983312733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:05:25.944234 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5d8942a4-ecc9-41ad-bba3-993983312733 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:05:25.953490 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8942a4-ecc9-41ad-bba3-993983312733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:05:25.955496 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8942a4-ecc9-41ad-bba3-993983312733 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:05:25.963306 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4564/9159] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:05:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:05:26.043871 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26bdf6-c1c4-42a2-94a0-44b4bc723bcc service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:05:26.053453 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26bdf6-c1c4-42a2-94a0-44b4bc723bcc service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:05:26.056962 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080269c-22a5-48b9-bdb0-5929154eaa1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:05:26.057546 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080269c-22a5-48b9-bdb0-5929154eaa1a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:05:26.057821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080269c-22a5-48b9-bdb0-5929154eaa1a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:05:26.058088 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080269c-22a5-48b9-bdb0-5929154eaa1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:05:26.059795 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5080269c-22a5-48b9-bdb0-5929154eaa1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:05:26.073287 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080269c-22a5-48b9-bdb0-5929154eaa1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:05:26.074683 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080269c-22a5-48b9-bdb0-5929154eaa1a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:05:26.086069 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4596/9160] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:05:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:05:26.146967 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8942a4-ecc9-41ad-bba3-993983312733 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:05:26.148349 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5d8942a4-ecc9-41ad-bba3-993983312733 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:05:26.162727 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8942a4-ecc9-41ad-bba3-993983312733 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:05:26.167673 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87aee1-abd3-49f1-ab56-cf2330c28791 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:05:26.168259 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87aee1-abd3-49f1-ab56-cf2330c28791 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:05:26.168533 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87aee1-abd3-49f1-ab56-cf2330c28791 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:05:26.168848 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87aee1-abd3-49f1-ab56-cf2330c28791 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:05:26.170477 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3e87aee1-abd3-49f1-ab56-cf2330c28791 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:05:26.181994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87aee1-abd3-49f1-ab56-cf2330c28791 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:05:26.183469 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87aee1-abd3-49f1-ab56-cf2330c28791 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:05:26.193978 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4565/9161] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:05:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:05:27.873007 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080269c-22a5-48b9-bdb0-5929154eaa1a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:05:27.885840 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080269c-22a5-48b9-bdb0-5929154eaa1a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:05:27.892872 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523849e-73e6-491c-a4a7-542066d038fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:05:27.893479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523849e-73e6-491c-a4a7-542066d038fd service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:05:27.894277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523849e-73e6-491c-a4a7-542066d038fd service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:05:27.894552 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523849e-73e6-491c-a4a7-542066d038fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:05:27.896324 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0523849e-73e6-491c-a4a7-542066d038fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:05:27.908586 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523849e-73e6-491c-a4a7-542066d038fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:05:27.910181 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523849e-73e6-491c-a4a7-542066d038fd service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:05:27.926284 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4597/9162] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:05:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:05:28.589133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2771d5-9aa1-4a70-98f5-ad81a10e4505 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:05:28.589638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2771d5-9aa1-4a70-98f5-ad81a10e4505 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:05:28.589745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2771d5-9aa1-4a70-98f5-ad81a10e4505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:05:28.609851 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5e2771d5-9aa1-4a70-98f5-ad81a10e4505 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:05:28.611231 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5e2771d5-9aa1-4a70-98f5-ad81a10e4505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:05:28.618764 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4566/9163] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 11:05:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 11:05:28.631050 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523849e-73e6-491c-a4a7-542066d038fd service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:05:28.642674 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523849e-73e6-491c-a4a7-542066d038fd service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:05:28.647651 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64438b-804d-418c-9dfd-76fe440fd715 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:05:28.648243 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64438b-804d-418c-9dfd-76fe440fd715 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:05:28.648521 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64438b-804d-418c-9dfd-76fe440fd715 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:05:28.648820 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64438b-804d-418c-9dfd-76fe440fd715 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:05:28.658044 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64438b-804d-418c-9dfd-76fe440fd715 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:05:28.659901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64438b-804d-418c-9dfd-76fe440fd715 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:05:28.669494 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4598/9164] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 11:05:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 11:05:38.604717 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=22 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:05:38.666391 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=44 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:05:47.213770 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81994075-ba80-4aed-a96a-a95bcce3973a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:05:47.214204 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81994075-ba80-4aed-a96a-a95bcce3973a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:05:47.214339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81994075-ba80-4aed-a96a-a95bcce3973a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:05:47.235140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-81994075-ba80-4aed-a96a-a95bcce3973a None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:05:47.236333 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-81994075-ba80-4aed-a96a-a95bcce3973a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:05:47.243692 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4567/9165] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 11:05:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 11:05:47.257125 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64438b-804d-418c-9dfd-76fe440fd715 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:05:47.267360 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64438b-804d-418c-9dfd-76fe440fd715 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:05:47.273431 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44abc72d-d75d-4efa-aa5e-6e45269a94e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:05:47.274106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abc72d-d75d-4efa-aa5e-6e45269a94e4 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:05:47.274462 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abc72d-d75d-4efa-aa5e-6e45269a94e4 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:05:47.274746 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abc72d-d75d-4efa-aa5e-6e45269a94e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:05:47.283225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44abc72d-d75d-4efa-aa5e-6e45269a94e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:05:47.286090 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44abc72d-d75d-4efa-aa5e-6e45269a94e4 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:05:47.295764 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4599/9166] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 11:05:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 11:05:57.229621 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:05:57.292342 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:06:53.870908 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81994075-ba80-4aed-a96a-a95bcce3973a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:06:53.892343 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81994075-ba80-4aed-a96a-a95bcce3973a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:06:53.897424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fa870-e191-4b2c-9c31-a0babcf9462f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:06:53.898035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fa870-e191-4b2c-9c31-a0babcf9462f service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:06:53.898312 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fa870-e191-4b2c-9c31-a0babcf9462f service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:06:53.898579 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fa870-e191-4b2c-9c31-a0babcf9462f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:06:53.900341 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cf9fa870-e191-4b2c-9c31-a0babcf9462f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:06:53.910797 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fa870-e191-4b2c-9c31-a0babcf9462f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:06:53.913326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fa870-e191-4b2c-9c31-a0babcf9462f service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:06:53.922690 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4568/9167] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:06:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:07:03.918705 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:07:33.851544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44abc72d-d75d-4efa-aa5e-6e45269a94e4 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:07:33.854010 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-44abc72d-d75d-4efa-aa5e-6e45269a94e4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:07:33.883454 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44abc72d-d75d-4efa-aa5e-6e45269a94e4 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:07:33.891672 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279bd03-259d-4e37-a684-bbf41adb7ca2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:07:33.892408 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279bd03-259d-4e37-a684-bbf41adb7ca2 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:07:33.892781 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279bd03-259d-4e37-a684-bbf41adb7ca2 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:07:33.893118 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279bd03-259d-4e37-a684-bbf41adb7ca2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:07:33.894933 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8279bd03-259d-4e37-a684-bbf41adb7ca2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:07:33.909600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279bd03-259d-4e37-a684-bbf41adb7ca2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:07:33.911449 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279bd03-259d-4e37-a684-bbf41adb7ca2 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:07:33.925145 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4600/9168] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:07:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 11:07:34.060690 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fa870-e191-4b2c-9c31-a0babcf9462f service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:07:34.070196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fa870-e191-4b2c-9c31-a0babcf9462f service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:07:34.074033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de465519-4319-4ac6-839b-4309347bffd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:07:34.074907 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de465519-4319-4ac6-839b-4309347bffd6 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:07:34.075182 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de465519-4319-4ac6-839b-4309347bffd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:07:34.075445 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de465519-4319-4ac6-839b-4309347bffd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:07:34.077638 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-de465519-4319-4ac6-839b-4309347bffd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:07:34.091986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de465519-4319-4ac6-839b-4309347bffd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:07:34.093658 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de465519-4319-4ac6-839b-4309347bffd6 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:07:34.105064 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4569/9169] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:07:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:07:35.300189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279bd03-259d-4e37-a684-bbf41adb7ca2 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:07:35.310195 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279bd03-259d-4e37-a684-bbf41adb7ca2 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:07:35.313925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed03ab-3f60-41b0-95bb-a0a29fd83769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:07:35.314517 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed03ab-3f60-41b0-95bb-a0a29fd83769 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:07:35.314828 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed03ab-3f60-41b0-95bb-a0a29fd83769 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:07:35.315128 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed03ab-3f60-41b0-95bb-a0a29fd83769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:07:35.316915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-45ed03ab-3f60-41b0-95bb-a0a29fd83769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:07:35.331321 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed03ab-3f60-41b0-95bb-a0a29fd83769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:07:35.332783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed03ab-3f60-41b0-95bb-a0a29fd83769 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:07:35.345782 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4601/9170] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:07:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:07:38.815909 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6fe2e-efc8-464c-960c-646cd109f41b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:07:38.816401 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6fe2e-efc8-464c-960c-646cd109f41b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:07:38.816937 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6fe2e-efc8-464c-960c-646cd109f41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:07:38.840330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f4e6fe2e-efc8-464c-960c-646cd109f41b None None] MFA Rules not processed for user `20b45eeddc48467183e12c6ce2f7399e`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:07:38.841577 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f4e6fe2e-efc8-464c-960c-646cd109f41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:07:38.848657 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4570/9171] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 11:07:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 11:07:45.339809 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=16 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:07:48.834878 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=9 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:07:51.943783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed03ab-3f60-41b0-95bb-a0a29fd83769 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:07:51.945284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-45ed03ab-3f60-41b0-95bb-a0a29fd83769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:07:52.024610 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed03ab-3f60-41b0-95bb-a0a29fd83769 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:07:52.028241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f1888-dbaa-4543-9d45-25a7f1e6875e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947a48b06bb74f068b70e8c17a8da422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:07:52.028891 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f1888-dbaa-4543-9d45-25a7f1e6875e service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:07:52.029173 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f1888-dbaa-4543-9d45-25a7f1e6875e service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:07:52.029448 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f1888-dbaa-4543-9d45-25a7f1e6875e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:07:52.038631 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f1888-dbaa-4543-9d45-25a7f1e6875e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:07:52.040052 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f1888-dbaa-4543-9d45-25a7f1e6875e service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:07:52.049082 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4602/9172] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:07:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:07:54.542674 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6fe2e-efc8-464c-960c-646cd109f41b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:07:54.552726 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6fe2e-efc8-464c-960c-646cd109f41b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:07:54.556277 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebdeff-3ff3-4f32-8611-2ad20c8c73f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:07:54.556898 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebdeff-3ff3-4f32-8611-2ad20c8c73f0 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:07:54.557178 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebdeff-3ff3-4f32-8611-2ad20c8c73f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:07:54.557446 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebdeff-3ff3-4f32-8611-2ad20c8c73f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:07:54.559170 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3cebdeff-3ff3-4f32-8611-2ad20c8c73f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:07:54.568752 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cebdeff-3ff3-4f32-8611-2ad20c8c73f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:07:54.570150 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cebdeff-3ff3-4f32-8611-2ad20c8c73f0 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:07:54.579648 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4571/9173] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:07:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:07:55.048819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f1888-dbaa-4543-9d45-25a7f1e6875e service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:07:55.061362 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f1888-dbaa-4543-9d45-25a7f1e6875e service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:07:55.066352 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59087499-2400-40ba-a256-3aa5207fc57f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:07:55.066948 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59087499-2400-40ba-a256-3aa5207fc57f service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:07:55.067232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59087499-2400-40ba-a256-3aa5207fc57f service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:07:55.068249 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59087499-2400-40ba-a256-3aa5207fc57f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:07:55.070061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-59087499-2400-40ba-a256-3aa5207fc57f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:07:55.081566 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59087499-2400-40ba-a256-3aa5207fc57f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:07:55.083157 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59087499-2400-40ba-a256-3aa5207fc57f service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:07:55.093189 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4603/9174] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:07:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 11:08:04.574788 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:08:05.088893 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=41 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:08:12.930790 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebdeff-3ff3-4f32-8611-2ad20c8c73f0 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:08:12.939551 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebdeff-3ff3-4f32-8611-2ad20c8c73f0 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:08:12.943191 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b173e-0931-429b-a45a-d9552cd4520e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:08:12.943783 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b173e-0931-429b-a45a-d9552cd4520e service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:08:12.944061 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b173e-0931-429b-a45a-d9552cd4520e service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:08:12.944331 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b173e-0931-429b-a45a-d9552cd4520e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:08:12.953293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b173e-0931-429b-a45a-d9552cd4520e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:08:12.954715 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b173e-0931-429b-a45a-d9552cd4520e service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:08:12.964623 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4572/9175] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:08:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:08:22.960388 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:08:47.120646 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59087499-2400-40ba-a256-3aa5207fc57f service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:08:47.141297 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59087499-2400-40ba-a256-3aa5207fc57f service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:08:47.146274 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf82d5-5368-4de0-b6d3-b644f3e48e97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:08:47.146887 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf82d5-5368-4de0-b6d3-b644f3e48e97 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:08:47.147161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf82d5-5368-4de0-b6d3-b644f3e48e97 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:08:47.147429 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf82d5-5368-4de0-b6d3-b644f3e48e97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:08:47.156190 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf82d5-5368-4de0-b6d3-b644f3e48e97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:08:47.157742 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf82d5-5368-4de0-b6d3-b644f3e48e97 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:08:47.167394 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4604/9176] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:08:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:08:57.163324 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:09:40.754135 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b173e-0931-429b-a45a-d9552cd4520e service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:09:40.765131 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b173e-0931-429b-a45a-d9552cd4520e service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:09:40.770017 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa9663-8112-47a9-8ae2-10b4cda7dd93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:09:40.770603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa9663-8112-47a9-8ae2-10b4cda7dd93 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:09:40.770875 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa9663-8112-47a9-8ae2-10b4cda7dd93 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:09:40.771142 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa9663-8112-47a9-8ae2-10b4cda7dd93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:09:40.779409 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa9663-8112-47a9-8ae2-10b4cda7dd93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:09:40.780994 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa9663-8112-47a9-8ae2-10b4cda7dd93 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:09:40.791074 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4573/9177] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:09:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:09:50.787054 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:10:01.459814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf82d5-5368-4de0-b6d3-b644f3e48e97 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:10:01.469509 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf82d5-5368-4de0-b6d3-b644f3e48e97 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:10:01.473133 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63d3f8-9280-458a-bbf7-172c1243e60a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:10:01.473721 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63d3f8-9280-458a-bbf7-172c1243e60a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:10:01.474000 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63d3f8-9280-458a-bbf7-172c1243e60a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:10:01.474268 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63d3f8-9280-458a-bbf7-172c1243e60a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:10:01.482353 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63d3f8-9280-458a-bbf7-172c1243e60a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:10:01.483784 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63d3f8-9280-458a-bbf7-172c1243e60a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:10:01.492955 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4605/9178] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:10:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:10:11.488318 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:10:24.506441 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa9663-8112-47a9-8ae2-10b4cda7dd93 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:10:24.519111 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa9663-8112-47a9-8ae2-10b4cda7dd93 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:10:24.523926 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff30c0c-2ff2-45a5-b693-6e2eef32c1ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:10:24.524612 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff30c0c-2ff2-45a5-b693-6e2eef32c1ec service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:10:24.524914 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff30c0c-2ff2-45a5-b693-6e2eef32c1ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:10:24.525285 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff30c0c-2ff2-45a5-b693-6e2eef32c1ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:10:24.533978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff30c0c-2ff2-45a5-b693-6e2eef32c1ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:10:24.536157 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff30c0c-2ff2-45a5-b693-6e2eef32c1ec service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:10:24.546043 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4574/9179] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:10:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:10:25.668977 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63d3f8-9280-458a-bbf7-172c1243e60a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:10:25.677596 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63d3f8-9280-458a-bbf7-172c1243e60a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:10:25.681378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9faaf-4f70-4423-a129-c072c63806ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:10:25.681964 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9faaf-4f70-4423-a129-c072c63806ce service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:10:25.682242 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9faaf-4f70-4423-a129-c072c63806ce service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:10:25.682511 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9faaf-4f70-4423-a129-c072c63806ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:10:25.692544 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f9faaf-4f70-4423-a129-c072c63806ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:10:25.694032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f9faaf-4f70-4423-a129-c072c63806ce service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:10:25.706062 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4606/9180] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:10:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:10:25.777362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff30c0c-2ff2-45a5-b693-6e2eef32c1ec service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:10:25.789957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff30c0c-2ff2-45a5-b693-6e2eef32c1ec service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:10:25.794986 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a03b8-7268-4877-9e01-f01756759055 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:10:25.795589 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a03b8-7268-4877-9e01-f01756759055 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:10:25.795873 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a03b8-7268-4877-9e01-f01756759055 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:10:25.796146 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a03b8-7268-4877-9e01-f01756759055 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:10:25.805510 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a03b8-7268-4877-9e01-f01756759055 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:10:25.807085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a03b8-7268-4877-9e01-f01756759055 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:10:25.817171 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4575/9181] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:10:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:10:26.860422 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9faaf-4f70-4423-a129-c072c63806ce service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:10:26.873011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9faaf-4f70-4423-a129-c072c63806ce service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:10:26.878819 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c1d99-5ae2-41dc-b55c-ca947a2b42fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:10:26.879412 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c1d99-5ae2-41dc-b55c-ca947a2b42fe service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:10:26.879688 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c1d99-5ae2-41dc-b55c-ca947a2b42fe service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:10:26.879957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c1d99-5ae2-41dc-b55c-ca947a2b42fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:10:26.892479 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c1d99-5ae2-41dc-b55c-ca947a2b42fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:10:26.894776 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c1d99-5ae2-41dc-b55c-ca947a2b42fe service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:10:26.906547 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4607/9182] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:10:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:10:35.812892 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=12 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:10:36.901789 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=12 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:12:05.792711 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a03b8-7268-4877-9e01-f01756759055 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:05.847438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a03b8-7268-4877-9e01-f01756759055 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:05.854881 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebf69f-700a-4df5-b957-79eca61b8756 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:05.855684 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebf69f-700a-4df5-b957-79eca61b8756 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:05.855968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebf69f-700a-4df5-b957-79eca61b8756 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:05.856244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebf69f-700a-4df5-b957-79eca61b8756 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:05.867927 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebf69f-700a-4df5-b957-79eca61b8756 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:05.869525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebf69f-700a-4df5-b957-79eca61b8756 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:05.882926 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4576/9183] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:12:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:12:10.724368 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c1d99-5ae2-41dc-b55c-ca947a2b42fe service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:10.744551 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c1d99-5ae2-41dc-b55c-ca947a2b42fe service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:10.748418 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57bac5-d959-4c35-ba4f-3bde044e3339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:10.749222 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57bac5-d959-4c35-ba4f-3bde044e3339 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:10.749957 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57bac5-d959-4c35-ba4f-3bde044e3339 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:10.750512 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57bac5-d959-4c35-ba4f-3bde044e3339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:10.824581 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57bac5-d959-4c35-ba4f-3bde044e3339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:10.826144 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57bac5-d959-4c35-ba4f-3bde044e3339 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:10.836543 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4608/9184] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:12:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:12:13.870379 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebf69f-700a-4df5-b957-79eca61b8756 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:13.883422 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebf69f-700a-4df5-b957-79eca61b8756 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:13.893217 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8c419-4815-4029-9582-8047c63099f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:13.893834 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8c419-4815-4029-9582-8047c63099f8 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:13.894169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8c419-4815-4029-9582-8047c63099f8 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:13.894378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8c419-4815-4029-9582-8047c63099f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:13.896293 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-45c8c419-4815-4029-9582-8047c63099f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:12:13.989691 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8c419-4815-4029-9582-8047c63099f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:13.991659 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8c419-4815-4029-9582-8047c63099f8 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:14.006154 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4577/9185] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:12:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:12:17.173023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57bac5-d959-4c35-ba4f-3bde044e3339 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:17.186309 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57bac5-d959-4c35-ba4f-3bde044e3339 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:17.201726 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22554fe8-1f8d-4876-b7dd-d28256800294 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:17.204111 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22554fe8-1f8d-4876-b7dd-d28256800294 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:17.204673 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22554fe8-1f8d-4876-b7dd-d28256800294 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:17.206560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22554fe8-1f8d-4876-b7dd-d28256800294 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:17.207516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-22554fe8-1f8d-4876-b7dd-d28256800294 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:12:17.213423 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8c419-4815-4029-9582-8047c63099f8 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:17.225124 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8c419-4815-4029-9582-8047c63099f8 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:17.225997 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22554fe8-1f8d-4876-b7dd-d28256800294 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:17.227604 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22554fe8-1f8d-4876-b7dd-d28256800294 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:17.230497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54feebc0-b209-443d-88ae-ea05d11998ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:17.231723 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54feebc0-b209-443d-88ae-ea05d11998ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:17.235665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54feebc0-b209-443d-88ae-ea05d11998ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:17.235665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54feebc0-b209-443d-88ae-ea05d11998ac admin admin] PATH_INFO: `/v3/users/20b45eeddc48467183e12c6ce2f7399e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:17.235665 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54feebc0-b209-443d-88ae-ea05d11998ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=20b45eeddc48467183e12c6ce2f7399e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:17.236274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54feebc0-b209-443d-88ae-ea05d11998ac admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:17.244299 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4609/9186] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:12:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:12:17.288073 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-54feebc0-b209-443d-88ae-ea05d11998ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20b45eeddc48467183e12c6ce2f7399e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:12:17.296894 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-54feebc0-b209-443d-88ae-ea05d11998ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20b45eeddc48467183e12c6ce2f7399e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:12:17.297700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-54feebc0-b209-443d-88ae-ea05d11998ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20b45eeddc48467183e12c6ce2f7399e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:12:17.311393 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-54feebc0-b209-443d-88ae-ea05d11998ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20b45eeddc48467183e12c6ce2f7399e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:12:17.318249 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-54feebc0-b209-443d-88ae-ea05d11998ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20b45eeddc48467183e12c6ce2f7399e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:12:17.324133 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4578/9187] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 11:12:17 2022] DELETE /identity/v3/users/20b45eeddc48467183e12c6ce2f7399e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 11:12:17.498441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22554fe8-1f8d-4876-b7dd-d28256800294 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:17.509592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22554fe8-1f8d-4876-b7dd-d28256800294 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:17.575658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38042b-f23d-4b5b-a214-2dc19b6e20f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:17.576284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38042b-f23d-4b5b-a214-2dc19b6e20f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:17.576563 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38042b-f23d-4b5b-a214-2dc19b6e20f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:17.577359 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38042b-f23d-4b5b-a214-2dc19b6e20f8 admin admin] PATH_INFO: `/v3/projects/812dc7c26fcb453e9692ab2026f49dc7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:17.578503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38042b-f23d-4b5b-a214-2dc19b6e20f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=812dc7c26fcb453e9692ab2026f49dc7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:17.580387 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38042b-f23d-4b5b-a214-2dc19b6e20f8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:17.625664 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4e38042b-f23d-4b5b-a214-2dc19b6e20f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '812dc7c26fcb453e9692ab2026f49dc7', 'request_id': 'req-4e38042b-f23d-4b5b-a214-2dc19b6e20f8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:12:17.632918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4e38042b-f23d-4b5b-a214-2dc19b6e20f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '812dc7c26fcb453e9692ab2026f49dc7', 'request_id': 'req-4e38042b-f23d-4b5b-a214-2dc19b6e20f8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:12:17.637527 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:12:17.638703 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4e38042b-f23d-4b5b-a214-2dc19b6e20f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '812dc7c26fcb453e9692ab2026f49dc7', 'request_id': 'req-4e38042b-f23d-4b5b-a214-2dc19b6e20f8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:12:17.665391 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4e38042b-f23d-4b5b-a214-2dc19b6e20f8 admin admin] The token cache is being invalidate because project 812dc7c26fcb453e9692ab2026f49dc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 11:12:17.665678 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4e38042b-f23d-4b5b-a214-2dc19b6e20f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:12:17.666312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4e38042b-f23d-4b5b-a214-2dc19b6e20f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:12:17.667800 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4610/9188] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 11:12:17 2022] DELETE /identity/v3/projects/812dc7c26fcb453e9692ab2026f49dc7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 11:12:17.671979 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54feebc0-b209-443d-88ae-ea05d11998ac admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:17.673456 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-54feebc0-b209-443d-88ae-ea05d11998ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:12:17.686804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54feebc0-b209-443d-88ae-ea05d11998ac admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:17.739085 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:12:17.745789 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653613df-1e66-4c2f-8d52-f65bc9cd6435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:17.746837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653613df-1e66-4c2f-8d52-f65bc9cd6435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:17.747367 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653613df-1e66-4c2f-8d52-f65bc9cd6435 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:17.747861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653613df-1e66-4c2f-8d52-f65bc9cd6435 admin admin] PATH_INFO: `/v3/users/3f9b28b63683465999b01bb52dd77fb0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:17.749295 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653613df-1e66-4c2f-8d52-f65bc9cd6435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f9b28b63683465999b01bb52dd77fb0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:17.751664 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653613df-1e66-4c2f-8d52-f65bc9cd6435 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:17.798597 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-653613df-1e66-4c2f-8d52-f65bc9cd6435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f9b28b63683465999b01bb52dd77fb0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:12:17.806132 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-653613df-1e66-4c2f-8d52-f65bc9cd6435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f9b28b63683465999b01bb52dd77fb0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:12:17.806870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-653613df-1e66-4c2f-8d52-f65bc9cd6435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f9b28b63683465999b01bb52dd77fb0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:12:17.819432 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-653613df-1e66-4c2f-8d52-f65bc9cd6435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f9b28b63683465999b01bb52dd77fb0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:12:17.826316 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-653613df-1e66-4c2f-8d52-f65bc9cd6435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f9b28b63683465999b01bb52dd77fb0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:12:17.832944 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4579/9189] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 11:12:17 2022] DELETE /identity/v3/users/3f9b28b63683465999b01bb52dd77fb0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 11:12:18.034441 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38042b-f23d-4b5b-a214-2dc19b6e20f8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:18.036241 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4e38042b-f23d-4b5b-a214-2dc19b6e20f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:12:18.056131 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38042b-f23d-4b5b-a214-2dc19b6e20f8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:18.112625 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad25b17-133d-4e05-bda1-ba04a8fcac54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:18.113284 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad25b17-133d-4e05-bda1-ba04a8fcac54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:18.113570 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad25b17-133d-4e05-bda1-ba04a8fcac54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:18.113841 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad25b17-133d-4e05-bda1-ba04a8fcac54 admin admin] PATH_INFO: `/v3/projects/42b9eac48b57413593fa0380165f7c30` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:18.114958 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad25b17-133d-4e05-bda1-ba04a8fcac54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42b9eac48b57413593fa0380165f7c30)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:18.116890 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad25b17-133d-4e05-bda1-ba04a8fcac54 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:18.174701 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bad25b17-133d-4e05-bda1-ba04a8fcac54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b9eac48b57413593fa0380165f7c30', 'request_id': 'req-bad25b17-133d-4e05-bda1-ba04a8fcac54'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:12:18.182022 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bad25b17-133d-4e05-bda1-ba04a8fcac54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b9eac48b57413593fa0380165f7c30', 'request_id': 'req-bad25b17-133d-4e05-bda1-ba04a8fcac54'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:12:18.188526 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bad25b17-133d-4e05-bda1-ba04a8fcac54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b9eac48b57413593fa0380165f7c30', 'request_id': 'req-bad25b17-133d-4e05-bda1-ba04a8fcac54'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:12:18.199578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bad25b17-133d-4e05-bda1-ba04a8fcac54 admin admin] The token cache is being invalidate because project 42b9eac48b57413593fa0380165f7c30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 11:12:18.199868 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bad25b17-133d-4e05-bda1-ba04a8fcac54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:12:18.200508 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bad25b17-133d-4e05-bda1-ba04a8fcac54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:12:18.202212 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4611/9190] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 11:12:18 2022] DELETE /identity/v3/projects/42b9eac48b57413593fa0380165f7c30 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 11:12:18.207416 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96d6d2-e2dd-478b-892f-5f434f125604 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:18.207707 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96d6d2-e2dd-478b-892f-5f434f125604 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:18.207988 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96d6d2-e2dd-478b-892f-5f434f125604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:18.238018 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-df96d6d2-e2dd-478b-892f-5f434f125604 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:12:18.239233 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-df96d6d2-e2dd-478b-892f-5f434f125604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:12:18.300513 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4580/9191] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 11:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 11:12:18.309755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd29edf-618c-4a2a-a036-379c5e4a7b51 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:18.310058 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd29edf-618c-4a2a-a036-379c5e4a7b51 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:18.310334 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd29edf-618c-4a2a-a036-379c5e4a7b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:18.331139 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3fd29edf-618c-4a2a-a036-379c5e4a7b51 None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:12:18.332355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3fd29edf-618c-4a2a-a036-379c5e4a7b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:12:18.340618 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4612/9192] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 11:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 11:12:18.345002 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96d6d2-e2dd-478b-892f-5f434f125604 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:18.354928 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96d6d2-e2dd-478b-892f-5f434f125604 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:18.360133 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b3400-76f5-4a75-ab87-93dae8878001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:18.360760 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b3400-76f5-4a75-ab87-93dae8878001 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:18.361039 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b3400-76f5-4a75-ab87-93dae8878001 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:18.361304 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b3400-76f5-4a75-ab87-93dae8878001 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:18.361946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b3400-76f5-4a75-ab87-93dae8878001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 11:12:18.362245 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b3400-76f5-4a75-ab87-93dae8878001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:18.363845 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b3400-76f5-4a75-ab87-93dae8878001 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:18.376887 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4581/9193] 10.222.0.16 () {58 vars in 1153 bytes} [Fri Sep 30 11:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 11:12:18.381210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd29edf-618c-4a2a-a036-379c5e4a7b51 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:18.390802 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd29edf-618c-4a2a-a036-379c5e4a7b51 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:18.395456 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42ea1a-6c4d-4b7f-8787-9d51041e29a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:18.396049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42ea1a-6c4d-4b7f-8787-9d51041e29a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:18.396327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42ea1a-6c4d-4b7f-8787-9d51041e29a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:18.396624 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42ea1a-6c4d-4b7f-8787-9d51041e29a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:18.397437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a42ea1a-6c4d-4b7f-8787-9d51041e29a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:18.399319 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a42ea1a-6c4d-4b7f-8787-9d51041e29a7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:18.432180 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4613/9194] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 11:12:18 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 11:12:18.433431 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b3400-76f5-4a75-ab87-93dae8878001 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:18.444250 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b3400-76f5-4a75-ab87-93dae8878001 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:18.500407 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:12:18.507339 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f20c06-bacd-4b79-8c87-8369897a476f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:18.508099 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f20c06-bacd-4b79-8c87-8369897a476f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:18.508905 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f20c06-bacd-4b79-8c87-8369897a476f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:18.509354 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f20c06-bacd-4b79-8c87-8369897a476f admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:18.510127 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f20c06-bacd-4b79-8c87-8369897a476f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:18.512532 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f20c06-bacd-4b79-8c87-8369897a476f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:18.538618 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4582/9195] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 11:12:18 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 11:12:18.539836 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42ea1a-6c4d-4b7f-8787-9d51041e29a7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:18.550967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42ea1a-6c4d-4b7f-8787-9d51041e29a7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:18.555644 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e3943-2632-434a-84e0-59c3032d855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:18.556323 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e3943-2632-434a-84e0-59c3032d855c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:18.556704 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e3943-2632-434a-84e0-59c3032d855c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:18.557037 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e3943-2632-434a-84e0-59c3032d855c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:18.557738 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e3943-2632-434a-84e0-59c3032d855c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:18.559366 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e3943-2632-434a-84e0-59c3032d855c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:18.569714 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4614/9196] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 11:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 11:12:18.573565 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f20c06-bacd-4b79-8c87-8369897a476f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:18.584094 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f20c06-bacd-4b79-8c87-8369897a476f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:18.588956 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435eac2-aa2a-4cfa-b78b-f1af3308b5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:18.589593 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435eac2-aa2a-4cfa-b78b-f1af3308b5eb admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:18.589904 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435eac2-aa2a-4cfa-b78b-f1af3308b5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:18.590196 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435eac2-aa2a-4cfa-b78b-f1af3308b5eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:18.590839 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435eac2-aa2a-4cfa-b78b-f1af3308b5eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:18.592961 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435eac2-aa2a-4cfa-b78b-f1af3308b5eb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:18.604632 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4583/9197] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 11:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 11:12:18.608789 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e3943-2632-434a-84e0-59c3032d855c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:18.618814 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e3943-2632-434a-84e0-59c3032d855c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:18.623469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c60f2-608f-49d6-8b14-d8cbc8113c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:18.624592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c60f2-608f-49d6-8b14-d8cbc8113c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:18.624900 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c60f2-608f-49d6-8b14-d8cbc8113c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:18.625437 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c60f2-608f-49d6-8b14-d8cbc8113c97 admin admin] PATH_INFO: `/v3/projects/1e1049b3da8d432fabb927101a8cdad0/users/cedfec7364d142a7be1be6c78f2837ca/roles/f642af7fc1fd472d8f4a4d6f34548ba2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:18.640568 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c60f2-608f-49d6-8b14-d8cbc8113c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1049b3da8d432fabb927101a8cdad0, user_id=cedfec7364d142a7be1be6c78f2837ca, role_id=f642af7fc1fd472d8f4a4d6f34548ba2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:18.643245 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c60f2-608f-49d6-8b14-d8cbc8113c97 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:18.657514 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4615/9198] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 11:12:18 2022] PUT /identity/v3/projects/1e1049b3da8d432fabb927101a8cdad0/users/cedfec7364d142a7be1be6c78f2837ca/roles/f642af7fc1fd472d8f4a4d6f34548ba2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 11:12:18.662682 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23fcc5-5502-4ec3-8643-141a9970333f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:18.662968 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23fcc5-5502-4ec3-8643-141a9970333f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:18.663394 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23fcc5-5502-4ec3-8643-141a9970333f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:18.682566 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bd23fcc5-5502-4ec3-8643-141a9970333f None None] MFA Rules not processed for user `f35bc6b4a2c94914bd986ad019ecb5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:12:18.683743 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bd23fcc5-5502-4ec3-8643-141a9970333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:12:18.743398 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4584/9199] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 11:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 11:12:18.754121 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c60f2-608f-49d6-8b14-d8cbc8113c97 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:18.755844 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-849c60f2-608f-49d6-8b14-d8cbc8113c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:12:18.766141 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:12:18.815307 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c60f2-608f-49d6-8b14-d8cbc8113c97 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:18.819032 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902862ff-045d-4c98-96c7-589de8eef53f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:18.819637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902862ff-045d-4c98-96c7-589de8eef53f service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:18.819915 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902862ff-045d-4c98-96c7-589de8eef53f service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:18.820185 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902862ff-045d-4c98-96c7-589de8eef53f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:18.830011 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902862ff-045d-4c98-96c7-589de8eef53f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:18.831430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902862ff-045d-4c98-96c7-589de8eef53f service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:18.840980 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4616/9200] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:12:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:12:22.700299 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfeab0-31bc-4904-956f-26cf6e0bcdba None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:22.700841 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfeab0-31bc-4904-956f-26cf6e0bcdba None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:22.701128 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfeab0-31bc-4904-956f-26cf6e0bcdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:22.732369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0bdfeab0-31bc-4904-956f-26cf6e0bcdba None None] MFA Rules not processed for user `cedfec7364d142a7be1be6c78f2837ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:12:22.733865 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0bdfeab0-31bc-4904-956f-26cf6e0bcdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:12:22.805915 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4585/9201] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 11:12:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 11:12:22.810682 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902862ff-045d-4c98-96c7-589de8eef53f service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:22.822645 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902862ff-045d-4c98-96c7-589de8eef53f service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:22.828093 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53a557-529e-46b9-b88f-117ab705d677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:22.828821 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53a557-529e-46b9-b88f-117ab705d677 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:22.829110 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53a557-529e-46b9-b88f-117ab705d677 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:22.829384 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53a557-529e-46b9-b88f-117ab705d677 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:22.830023 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53a557-529e-46b9-b88f-117ab705d677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:22.831925 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53a557-529e-46b9-b88f-117ab705d677 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:22.872846 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4617/9202] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Sep 30 11:12:22 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 11:12:22.874676 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfeab0-31bc-4904-956f-26cf6e0bcdba None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:22.886862 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfeab0-31bc-4904-956f-26cf6e0bcdba None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:22.961552 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cea94a-f2c3-49c9-bd65-6758f1933283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:22.962258 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cea94a-f2c3-49c9-bd65-6758f1933283 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:22.962603 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cea94a-f2c3-49c9-bd65-6758f1933283 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:22.962940 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cea94a-f2c3-49c9-bd65-6758f1933283 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:22.963670 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cea94a-f2c3-49c9-bd65-6758f1933283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:22.965622 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cea94a-f2c3-49c9-bd65-6758f1933283 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:22.978089 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:12:22.991204 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4586/9203] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Sep 30 11:12:22 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 11:12:22.995042 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53a557-529e-46b9-b88f-117ab705d677 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:23.007397 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53a557-529e-46b9-b88f-117ab705d677 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:23.012049 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7423fa-3e9d-4d05-9ada-cd6b25badc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:23.012702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7423fa-3e9d-4d05-9ada-cd6b25badc8d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:23.012985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7423fa-3e9d-4d05-9ada-cd6b25badc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:23.013262 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7423fa-3e9d-4d05-9ada-cd6b25badc8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:23.013918 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7423fa-3e9d-4d05-9ada-cd6b25badc8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:23.016164 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7423fa-3e9d-4d05-9ada-cd6b25badc8d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:23.027933 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4618/9204] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 11:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 11:12:23.032525 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cea94a-f2c3-49c9-bd65-6758f1933283 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:23.042912 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cea94a-f2c3-49c9-bd65-6758f1933283 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:23.048369 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c7a6e-1591-4500-b642-cc2846c97f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:23.049085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c7a6e-1591-4500-b642-cc2846c97f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:23.049366 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c7a6e-1591-4500-b642-cc2846c97f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:23.049635 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c7a6e-1591-4500-b642-cc2846c97f9a admin admin] PATH_INFO: `/v3/projects/479ef5a842f746db8c648003a654824a/users/173f7cb15ae7493cbf5e15627739020e/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:23.066776 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c7a6e-1591-4500-b642-cc2846c97f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=479ef5a842f746db8c648003a654824a, user_id=173f7cb15ae7493cbf5e15627739020e, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:23.069517 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c7a6e-1591-4500-b642-cc2846c97f9a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:23.083994 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4587/9205] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 11:12:23 2022] PUT /identity/v3/projects/479ef5a842f746db8c648003a654824a/users/173f7cb15ae7493cbf5e15627739020e/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 11:12:23.088108 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7423fa-3e9d-4d05-9ada-cd6b25badc8d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:23.099668 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7423fa-3e9d-4d05-9ada-cd6b25badc8d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:23.164076 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d074d-a57b-4a46-9106-6268e1e58e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:23.164708 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d074d-a57b-4a46-9106-6268e1e58e42 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:23.164987 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d074d-a57b-4a46-9106-6268e1e58e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:23.165257 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d074d-a57b-4a46-9106-6268e1e58e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:23.165905 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d074d-a57b-4a46-9106-6268e1e58e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:23.167491 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d074d-a57b-4a46-9106-6268e1e58e42 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:23.178044 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4619/9206] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Sep 30 11:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 11:12:23.182497 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c7a6e-1591-4500-b642-cc2846c97f9a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:23.193554 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c7a6e-1591-4500-b642-cc2846c97f9a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:23.206358 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9147009-b106-497b-aa27-0fe852a8034b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:23.207048 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9147009-b106-497b-aa27-0fe852a8034b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:23.207330 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9147009-b106-497b-aa27-0fe852a8034b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:23.207607 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9147009-b106-497b-aa27-0fe852a8034b admin admin] PATH_INFO: `/v3/projects/479ef5a842f746db8c648003a654824a/users/173f7cb15ae7493cbf5e15627739020e/roles/f06b5fed717d4b03a5083dd847274296` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:23.209590 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9147009-b106-497b-aa27-0fe852a8034b admin admin] RBAC: Authorizing `identity:create_grant(project_id=479ef5a842f746db8c648003a654824a, user_id=173f7cb15ae7493cbf5e15627739020e, role_id=f06b5fed717d4b03a5083dd847274296)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:23.212272 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9147009-b106-497b-aa27-0fe852a8034b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:23.224127 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4588/9207] 10.222.0.16 () {60 vars in 1483 bytes} [Fri Sep 30 11:12:23 2022] PUT /identity/v3/projects/479ef5a842f746db8c648003a654824a/users/173f7cb15ae7493cbf5e15627739020e/roles/f06b5fed717d4b03a5083dd847274296 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 11:12:27.870403 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561bf14-07b7-45fc-bc4c-4e0c8f3b022a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:27.870999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561bf14-07b7-45fc-bc4c-4e0c8f3b022a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:27.870999 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561bf14-07b7-45fc-bc4c-4e0c8f3b022a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:27.946335 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f561bf14-07b7-45fc-bc4c-4e0c8f3b022a None None] MFA Rules not processed for user `173f7cb15ae7493cbf5e15627739020e`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:12:27.948009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f561bf14-07b7-45fc-bc4c-4e0c8f3b022a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:12:28.053780 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:12:28.076282 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4620/9208] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 11:12:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 11:12:28.091274 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9147009-b106-497b-aa27-0fe852a8034b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:28.093756 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e9147009-b106-497b-aa27-0fe852a8034b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:12:28.197244 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9147009-b106-497b-aa27-0fe852a8034b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:28.206796 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10dba56-03f6-4ce3-aa46-dbe0eaa8665d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:28.207033 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dba56-03f6-4ce3-aa46-dbe0eaa8665d service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:28.207320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dba56-03f6-4ce3-aa46-dbe0eaa8665d service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:28.207608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dba56-03f6-4ce3-aa46-dbe0eaa8665d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:28.281209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10dba56-03f6-4ce3-aa46-dbe0eaa8665d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:28.282556 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10dba56-03f6-4ce3-aa46-dbe0eaa8665d service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:28.296837 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4589/9209] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:12:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:12:29.355952 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dcfa9-5a69-4881-968b-c25f755c9de5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:29.356503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dcfa9-5a69-4881-968b-c25f755c9de5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:29.356503 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dcfa9-5a69-4881-968b-c25f755c9de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:29.376396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8c6dcfa9-5a69-4881-968b-c25f755c9de5 None None] MFA Rules not processed for user `cedfec7364d142a7be1be6c78f2837ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:12:29.377783 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8c6dcfa9-5a69-4881-968b-c25f755c9de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:12:29.384809 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4621/9210] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 11:12:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 11:12:34.849284 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10dba56-03f6-4ce3-aa46-dbe0eaa8665d service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:34.850745 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f10dba56-03f6-4ce3-aa46-dbe0eaa8665d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:12:34.912327 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10dba56-03f6-4ce3-aa46-dbe0eaa8665d service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:34.921219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67647bf-033c-4fc0-b4b3-13cc187bd439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:34.921219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67647bf-033c-4fc0-b4b3-13cc187bd439 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:34.921219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67647bf-033c-4fc0-b4b3-13cc187bd439 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:34.921219 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67647bf-033c-4fc0-b4b3-13cc187bd439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:34.921877 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c67647bf-033c-4fc0-b4b3-13cc187bd439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:12:34.934534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67647bf-033c-4fc0-b4b3-13cc187bd439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:34.935982 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67647bf-033c-4fc0-b4b3-13cc187bd439 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:34.940795 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:12:34.950224 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4590/9211] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:12:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:12:36.090913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6dcfa9-5a69-4881-968b-c25f755c9de5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:36.101420 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6dcfa9-5a69-4881-968b-c25f755c9de5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:36.105106 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844c630-af84-42d0-a9b2-9cfdf37621a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:36.105723 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844c630-af84-42d0-a9b2-9cfdf37621a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:36.106009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844c630-af84-42d0-a9b2-9cfdf37621a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:36.106280 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844c630-af84-42d0-a9b2-9cfdf37621a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:36.109061 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5844c630-af84-42d0-a9b2-9cfdf37621a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:12:36.122378 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844c630-af84-42d0-a9b2-9cfdf37621a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:36.123932 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844c630-af84-42d0-a9b2-9cfdf37621a7 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:36.134926 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4622/9212] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:12:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 11:12:41.165856 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67647bf-033c-4fc0-b4b3-13cc187bd439 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:12:41.174524 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67647bf-033c-4fc0-b4b3-13cc187bd439 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:12:41.178085 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a9c1a-9357-417f-b33f-057512b8dd70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:12:41.178671 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a9c1a-9357-417f-b33f-057512b8dd70 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:12:41.178946 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a9c1a-9357-417f-b33f-057512b8dd70 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:12:41.179214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a9c1a-9357-417f-b33f-057512b8dd70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:12:41.188795 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a9c1a-9357-417f-b33f-057512b8dd70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:12:41.190186 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a9c1a-9357-417f-b33f-057512b8dd70 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:12:41.199397 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4591/9213] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:12:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:12:46.130253 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:12:51.195321 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:13:53.160488 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844c630-af84-42d0-a9b2-9cfdf37621a7 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:13:53.161969 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5844c630-af84-42d0-a9b2-9cfdf37621a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:13:53.240984 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844c630-af84-42d0-a9b2-9cfdf37621a7 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:13:53.245986 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cebc1-1a32-4812-95fd-8632840bcd63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:13:53.246578 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cebc1-1a32-4812-95fd-8632840bcd63 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:13:53.246859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cebc1-1a32-4812-95fd-8632840bcd63 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:13:53.247129 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cebc1-1a32-4812-95fd-8632840bcd63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:13:53.248859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dc4cebc1-1a32-4812-95fd-8632840bcd63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:13:53.260867 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cebc1-1a32-4812-95fd-8632840bcd63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:13:53.262424 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cebc1-1a32-4812-95fd-8632840bcd63 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:13:53.272424 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4623/9214] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:13:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:14:03.268326 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=37 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:14:40.435710 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ef257-7bf2-4fe3-adaf-081ed5f0bf4b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:14:40.436239 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ef257-7bf2-4fe3-adaf-081ed5f0bf4b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:14:40.436424 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ef257-7bf2-4fe3-adaf-081ed5f0bf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:14:40.467044 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b72ef257-7bf2-4fe3-adaf-081ed5f0bf4b None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:14:40.468266 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b72ef257-7bf2-4fe3-adaf-081ed5f0bf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:14:40.528580 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4592/9215] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 11:14:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 11:14:40.574894 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cebc1-1a32-4812-95fd-8632840bcd63 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:14:40.576314 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dc4cebc1-1a32-4812-95fd-8632840bcd63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:14:40.646070 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cebc1-1a32-4812-95fd-8632840bcd63 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:14:40.650898 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba3970-87db-4d8e-9134-008e76904b01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:14:40.651493 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba3970-87db-4d8e-9134-008e76904b01 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:14:40.651769 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba3970-87db-4d8e-9134-008e76904b01 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:14:40.652040 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba3970-87db-4d8e-9134-008e76904b01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:14:40.660562 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba3970-87db-4d8e-9134-008e76904b01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:14:40.662170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba3970-87db-4d8e-9134-008e76904b01 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:14:40.670176 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4624/9216] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 11:14:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 11:14:42.714560 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ef257-7bf2-4fe3-adaf-081ed5f0bf4b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:14:42.730209 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ef257-7bf2-4fe3-adaf-081ed5f0bf4b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:14:42.738438 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769d266-1769-457a-9a5e-5e689ffa91f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:14:42.739059 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769d266-1769-457a-9a5e-5e689ffa91f1 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:14:42.739336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769d266-1769-457a-9a5e-5e689ffa91f1 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:14:42.739605 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769d266-1769-457a-9a5e-5e689ffa91f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:14:42.741378 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6769d266-1769-457a-9a5e-5e689ffa91f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:14:42.755916 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769d266-1769-457a-9a5e-5e689ffa91f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:14:42.757587 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769d266-1769-457a-9a5e-5e689ffa91f1 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:14:42.770870 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4593/9217] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:14:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:14:50.307469 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1eb457-74c0-416c-a086-71ff24c18ab6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:14:50.308015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1eb457-74c0-416c-a086-71ff24c18ab6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:14:50.308015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1eb457-74c0-416c-a086-71ff24c18ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:14:50.328571 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1d1eb457-74c0-416c-a086-71ff24c18ab6 None None] MFA Rules not processed for user `cedfec7364d142a7be1be6c78f2837ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:14:50.331009 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1d1eb457-74c0-416c-a086-71ff24c18ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:14:50.337971 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4625/9218] 10.222.0.16 () {58 vars in 958 bytes} [Fri Sep 30 11:14:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 11:14:50.674987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769d266-1769-457a-9a5e-5e689ffa91f1 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:14:50.684278 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769d266-1769-457a-9a5e-5e689ffa91f1 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:14:50.687987 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa513b-d1e8-4032-9079-23db70b669e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:14:50.688672 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa513b-d1e8-4032-9079-23db70b669e4 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:14:50.688957 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa513b-d1e8-4032-9079-23db70b669e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:14:50.689228 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa513b-d1e8-4032-9079-23db70b669e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:14:50.690947 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-78aa513b-d1e8-4032-9079-23db70b669e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:14:50.700203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa513b-d1e8-4032-9079-23db70b669e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:14:50.701648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa513b-d1e8-4032-9079-23db70b669e4 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:14:50.709524 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4594/9219] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:14:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:14:54.439724 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44603f-1d17-4124-852b-8cddca19b985 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:14:54.440203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44603f-1d17-4124-852b-8cddca19b985 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:14:54.440396 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44603f-1d17-4124-852b-8cddca19b985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:14:54.466028 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5f44603f-1d17-4124-852b-8cddca19b985 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:14:54.467232 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5f44603f-1d17-4124-852b-8cddca19b985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:14:54.475210 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4626/9220] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 11:14:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 11:14:54.487678 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa513b-d1e8-4032-9079-23db70b669e4 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:14:54.499557 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa513b-d1e8-4032-9079-23db70b669e4 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:14:54.507163 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032aa53-d3e5-466d-91b1-44d934f7eeea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:14:54.507978 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032aa53-d3e5-466d-91b1-44d934f7eeea service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:14:54.508311 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032aa53-d3e5-466d-91b1-44d934f7eeea service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:14:54.508730 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032aa53-d3e5-466d-91b1-44d934f7eeea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:14:54.518287 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032aa53-d3e5-466d-91b1-44d934f7eeea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:14:54.520578 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032aa53-d3e5-466d-91b1-44d934f7eeea service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:14:54.531476 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4595/9221] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 11:14:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 11:15:04.181203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44603f-1d17-4124-852b-8cddca19b985 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:15:04.185568 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=39 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:15:04.192593 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44603f-1d17-4124-852b-8cddca19b985 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:15:04.196328 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a6a9e-cd60-4f78-89c6-da26f231f0d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:15:04.196967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a6a9e-cd60-4f78-89c6-da26f231f0d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:15:04.197246 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a6a9e-cd60-4f78-89c6-da26f231f0d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:15:04.197516 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a6a9e-cd60-4f78-89c6-da26f231f0d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:15:04.199392 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c89a6a9e-cd60-4f78-89c6-da26f231f0d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:15:04.223835 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a6a9e-cd60-4f78-89c6-da26f231f0d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:15:04.225295 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a6a9e-cd60-4f78-89c6-da26f231f0d3 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:15:04.233307 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4627/9222] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:15:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:15:04.528423 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=47 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:15:06.417326 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032aa53-d3e5-466d-91b1-44d934f7eeea service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:15:06.426675 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032aa53-d3e5-466d-91b1-44d934f7eeea service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:15:06.430201 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22571fd0-3345-425b-ba28-1e7631bfdb67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:15:06.430788 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22571fd0-3345-425b-ba28-1e7631bfdb67 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:15:06.431063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22571fd0-3345-425b-ba28-1e7631bfdb67 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:15:06.431336 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22571fd0-3345-425b-ba28-1e7631bfdb67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:15:06.433086 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-22571fd0-3345-425b-ba28-1e7631bfdb67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:15:06.442780 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22571fd0-3345-425b-ba28-1e7631bfdb67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:15:06.444169 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22571fd0-3345-425b-ba28-1e7631bfdb67 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:15:06.452156 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4596/9223] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:15:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:15:14.229760 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:15:14.338066 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a6a9e-cd60-4f78-89c6-da26f231f0d3 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:15:14.358592 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a6a9e-cd60-4f78-89c6-da26f231f0d3 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:15:14.364312 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca85ddc-9204-4d8a-993c-c38689eb98bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:15:14.364945 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca85ddc-9204-4d8a-993c-c38689eb98bc service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:15:14.365225 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca85ddc-9204-4d8a-993c-c38689eb98bc service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:15:14.365495 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca85ddc-9204-4d8a-993c-c38689eb98bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:15:14.367203 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5ca85ddc-9204-4d8a-993c-c38689eb98bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:15:14.392743 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca85ddc-9204-4d8a-993c-c38689eb98bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:15:14.394327 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca85ddc-9204-4d8a-993c-c38689eb98bc service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:15:14.404964 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4628/9224] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:15:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:15:16.448438 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:15:24.400443 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=14 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:17:18.945461 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22571fd0-3345-425b-ba28-1e7631bfdb67 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:17:18.963694 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22571fd0-3345-425b-ba28-1e7631bfdb67 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:17:18.972353 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a237c5-812c-4c5f-baba-9b411c4ff4a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:17:18.973320 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a237c5-812c-4c5f-baba-9b411c4ff4a4 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:17:18.973647 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a237c5-812c-4c5f-baba-9b411c4ff4a4 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:17:18.973836 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a237c5-812c-4c5f-baba-9b411c4ff4a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:17:18.975837 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-20a237c5-812c-4c5f-baba-9b411c4ff4a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:17:18.991955 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a237c5-812c-4c5f-baba-9b411c4ff4a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:17:18.993718 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a237c5-812c-4c5f-baba-9b411c4ff4a4 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:17:19.007032 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4597/9225] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:17:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:17:21.398363 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388322a9-8971-4ed1-a236-bf0f6c08ef85 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:17:21.398853 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388322a9-8971-4ed1-a236-bf0f6c08ef85 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:17:21.398967 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388322a9-8971-4ed1-a236-bf0f6c08ef85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:17:21.448361 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-388322a9-8971-4ed1-a236-bf0f6c08ef85 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:17:21.449600 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-388322a9-8971-4ed1-a236-bf0f6c08ef85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:17:21.467427 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4629/9226] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Sep 30 11:17:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 11:17:21.507608 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a237c5-812c-4c5f-baba-9b411c4ff4a4 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:17:21.530764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a237c5-812c-4c5f-baba-9b411c4ff4a4 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:17:21.536479 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde82d9-3f95-46b7-95ae-1b1f4b3aad4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:17:21.537104 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde82d9-3f95-46b7-95ae-1b1f4b3aad4f service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:17:21.537381 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde82d9-3f95-46b7-95ae-1b1f4b3aad4f service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:17:21.537653 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde82d9-3f95-46b7-95ae-1b1f4b3aad4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:17:21.545598 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde82d9-3f95-46b7-95ae-1b1f4b3aad4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:17:21.547144 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde82d9-3f95-46b7-95ae-1b1f4b3aad4f service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:17:21.555261 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4598/9227] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 11:17:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 11:17:28.913943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388322a9-8971-4ed1-a236-bf0f6c08ef85 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:17:28.915355 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-388322a9-8971-4ed1-a236-bf0f6c08ef85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:17:29.015200 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388322a9-8971-4ed1-a236-bf0f6c08ef85 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:17:29.021859 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79dc0a-854f-47ca-9cf5-5c91da956b67 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc6604430ba4e2283994e5cb8ef18d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:17:29.022483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79dc0a-854f-47ca-9cf5-5c91da956b67 service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:17:29.022759 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79dc0a-854f-47ca-9cf5-5c91da956b67 service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:17:29.023031 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79dc0a-854f-47ca-9cf5-5c91da956b67 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:17:29.033306 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79dc0a-854f-47ca-9cf5-5c91da956b67 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:17:29.034943 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79dc0a-854f-47ca-9cf5-5c91da956b67 service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:17:29.044923 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4630/9228] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:17:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:17:31.174542 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05287b-cfed-400e-93e7-d2e212241a55 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:17:31.175063 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05287b-cfed-400e-93e7-d2e212241a55 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:17:31.175180 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05287b-cfed-400e-93e7-d2e212241a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:17:31.196267 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0a05287b-cfed-400e-93e7-d2e212241a55 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:17:31.197521 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0a05287b-cfed-400e-93e7-d2e212241a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:17:31.206324 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4599/9229] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 11:17:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 11:17:31.218611 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79dc0a-854f-47ca-9cf5-5c91da956b67 service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:17:31.230024 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79dc0a-854f-47ca-9cf5-5c91da956b67 service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:17:31.234937 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99c0d1-58b0-4724-b2fd-0ce6079fa981 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:17:31.235550 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99c0d1-58b0-4724-b2fd-0ce6079fa981 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:17:31.235851 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99c0d1-58b0-4724-b2fd-0ce6079fa981 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:17:31.236172 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99c0d1-58b0-4724-b2fd-0ce6079fa981 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:17:31.244041 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99c0d1-58b0-4724-b2fd-0ce6079fa981 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:17:31.245628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99c0d1-58b0-4724-b2fd-0ce6079fa981 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:17:31.254532 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4631/9230] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 11:17:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 11:17:35.006840 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05287b-cfed-400e-93e7-d2e212241a55 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:17:35.026618 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05287b-cfed-400e-93e7-d2e212241a55 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:17:35.030214 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8989acc-9062-4cf6-9462-813223c561e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:17:35.030812 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8989acc-9062-4cf6-9462-813223c561e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:17:35.031091 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8989acc-9062-4cf6-9462-813223c561e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:17:35.031362 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8989acc-9062-4cf6-9462-813223c561e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:17:35.042232 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8989acc-9062-4cf6-9462-813223c561e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:17:35.043655 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8989acc-9062-4cf6-9462-813223c561e9 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:17:35.066579 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4600/9231] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:17:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:17:36.198430 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd704bd-3a3b-43ed-b342-dc93c67d7974 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:17:36.198913 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd704bd-3a3b-43ed-b342-dc93c67d7974 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:17:36.199025 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd704bd-3a3b-43ed-b342-dc93c67d7974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:17:36.218233 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5fd704bd-3a3b-43ed-b342-dc93c67d7974 None None] MFA Rules not processed for user `9bdab836a64d43ea842629d29b6f8d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 11:17:36.219409 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5fd704bd-3a3b-43ed-b342-dc93c67d7974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:17:36.226418 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4632/9232] 10.222.0.16 () {58 vars in 967 bytes} [Fri Sep 30 11:17:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 11:17:36.238535 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8989acc-9062-4cf6-9462-813223c561e9 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:17:36.249660 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8989acc-9062-4cf6-9462-813223c561e9 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:17:36.255537 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f52d3-2de0-4934-816f-3739ea060d44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963c491a2d2e409b8b45e4fb6aff41c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:17:36.256156 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f52d3-2de0-4934-816f-3739ea060d44 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:17:36.256433 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f52d3-2de0-4934-816f-3739ea060d44 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:17:36.256737 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f52d3-2de0-4934-816f-3739ea060d44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:17:36.264709 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f52d3-2de0-4934-816f-3739ea060d44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:17:36.266260 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f52d3-2de0-4934-816f-3739ea060d44 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:17:36.274976 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4601/9233] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Sep 30 11:17:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 11:17:37.510341 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd704bd-3a3b-43ed-b342-dc93c67d7974 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:17:37.524635 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd704bd-3a3b-43ed-b342-dc93c67d7974 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:17:37.530211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0ea01-d86e-4e82-ae85-89dcf01150fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa607111024540d1a09b01dfd1e5e8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:17:37.530806 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0ea01-d86e-4e82-ae85-89dcf01150fe service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:17:37.531556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0ea01-d86e-4e82-ae85-89dcf01150fe service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:17:37.531556 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0ea01-d86e-4e82-ae85-89dcf01150fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:17:37.534210 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-05c0ea01-d86e-4e82-ae85-89dcf01150fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:17:37.548722 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c0ea01-d86e-4e82-ae85-89dcf01150fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:17:37.550432 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c0ea01-d86e-4e82-ae85-89dcf01150fe service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:17:37.562076 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4633/9234] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:17:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:17:37.692426 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f52d3-2de0-4934-816f-3739ea060d44 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:17:37.702487 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f52d3-2de0-4934-816f-3739ea060d44 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:17:37.706262 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcf1a8-28a7-4431-99fc-52e01a3899e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:17:37.706861 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcf1a8-28a7-4431-99fc-52e01a3899e5 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:17:37.707140 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcf1a8-28a7-4431-99fc-52e01a3899e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:17:37.707408 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcf1a8-28a7-4431-99fc-52e01a3899e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:17:37.718623 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcf1a8-28a7-4431-99fc-52e01a3899e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:17:37.720035 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcf1a8-28a7-4431-99fc-52e01a3899e5 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:17:37.732269 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4602/9235] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:17:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:17:40.390597 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0ea01-d86e-4e82-ae85-89dcf01150fe service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:17:40.400548 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0ea01-d86e-4e82-ae85-89dcf01150fe service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:17:40.404030 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aca6ca-7ae6-4034-b8dc-cda2fbe82551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0fd833b134a089433cd2985caba80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:17:40.404595 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aca6ca-7ae6-4034-b8dc-cda2fbe82551 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:17:40.404901 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aca6ca-7ae6-4034-b8dc-cda2fbe82551 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:17:40.405170 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aca6ca-7ae6-4034-b8dc-cda2fbe82551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:17:40.465565 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aca6ca-7ae6-4034-b8dc-cda2fbe82551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:17:40.466985 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aca6ca-7ae6-4034-b8dc-cda2fbe82551 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:17:40.477905 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:17:40.486330 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4634/9236] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:17:43.628218 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcf1a8-28a7-4431-99fc-52e01a3899e5 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:17:43.640884 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcf1a8-28a7-4431-99fc-52e01a3899e5 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:17:43.646825 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6e92c-f3c7-485f-b556-69aaa1e4e419 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:17:43.647442 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6e92c-f3c7-485f-b556-69aaa1e4e419 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:17:43.647720 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6e92c-f3c7-485f-b556-69aaa1e4e419 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:17:43.647991 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6e92c-f3c7-485f-b556-69aaa1e4e419 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:17:43.649764 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-63c6e92c-f3c7-485f-b556-69aaa1e4e419 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:17:43.662883 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6e92c-f3c7-485f-b556-69aaa1e4e419 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:17:43.664844 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6e92c-f3c7-485f-b556-69aaa1e4e419 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:17:43.676065 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4603/9237] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:17:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:17:46.881637 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aca6ca-7ae6-4034-b8dc-cda2fbe82551 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:17:46.896201 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aca6ca-7ae6-4034-b8dc-cda2fbe82551 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:17:46.903116 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afbb07-c995-44b3-8a16-865a86b05f29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:17:46.903658 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afbb07-c995-44b3-8a16-865a86b05f29 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:17:46.903941 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afbb07-c995-44b3-8a16-865a86b05f29 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:17:46.904211 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afbb07-c995-44b3-8a16-865a86b05f29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:17:46.906234 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-47afbb07-c995-44b3-8a16-865a86b05f29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:17:46.926476 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afbb07-c995-44b3-8a16-865a86b05f29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:17:46.928150 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afbb07-c995-44b3-8a16-865a86b05f29 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:17:46.940403 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4635/9238] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:17:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:17:46.958842 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6e92c-f3c7-485f-b556-69aaa1e4e419 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:17:46.964444 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=52 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:17:46.972444 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6e92c-f3c7-485f-b556-69aaa1e4e419 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:17:46.978516 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99c94b-ecd8-42de-9a27-f74af7b319bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:17:46.980481 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99c94b-ecd8-42de-9a27-f74af7b319bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:17:46.980867 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99c94b-ecd8-42de-9a27-f74af7b319bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:17:46.981206 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99c94b-ecd8-42de-9a27-f74af7b319bf admin admin] PATH_INFO: `/v3/users/cedfec7364d142a7be1be6c78f2837ca` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:17:46.982545 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99c94b-ecd8-42de-9a27-f74af7b319bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=cedfec7364d142a7be1be6c78f2837ca)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:17:46.984540 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99c94b-ecd8-42de-9a27-f74af7b319bf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:17:47.034011 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fb99c94b-ecd8-42de-9a27-f74af7b319bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cedfec7364d142a7be1be6c78f2837ca'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:17:47.054076 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fb99c94b-ecd8-42de-9a27-f74af7b319bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cedfec7364d142a7be1be6c78f2837ca'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:17:47.054725 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fb99c94b-ecd8-42de-9a27-f74af7b319bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cedfec7364d142a7be1be6c78f2837ca'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:17:47.067523 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fb99c94b-ecd8-42de-9a27-f74af7b319bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cedfec7364d142a7be1be6c78f2837ca'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:17:47.074451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fb99c94b-ecd8-42de-9a27-f74af7b319bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cedfec7364d142a7be1be6c78f2837ca'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:17:47.080897 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4604/9239] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 11:17:46 2022] DELETE /identity/v3/users/cedfec7364d142a7be1be6c78f2837ca => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 11:17:47.255435 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afbb07-c995-44b3-8a16-865a86b05f29 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:17:47.266732 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afbb07-c995-44b3-8a16-865a86b05f29 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:17:47.329974 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854514d-59e8-4d12-b473-8a3413ee54d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:17:47.330594 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854514d-59e8-4d12-b473-8a3413ee54d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:17:47.330876 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854514d-59e8-4d12-b473-8a3413ee54d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:17:47.331148 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854514d-59e8-4d12-b473-8a3413ee54d1 admin admin] PATH_INFO: `/v3/projects/1e1049b3da8d432fabb927101a8cdad0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:17:47.332264 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854514d-59e8-4d12-b473-8a3413ee54d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e1049b3da8d432fabb927101a8cdad0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:17:47.334204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854514d-59e8-4d12-b473-8a3413ee54d1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:17:47.380822 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4854514d-59e8-4d12-b473-8a3413ee54d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1049b3da8d432fabb927101a8cdad0', 'request_id': 'req-4854514d-59e8-4d12-b473-8a3413ee54d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:17:47.388020 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4854514d-59e8-4d12-b473-8a3413ee54d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1049b3da8d432fabb927101a8cdad0', 'request_id': 'req-4854514d-59e8-4d12-b473-8a3413ee54d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:17:47.393588 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4854514d-59e8-4d12-b473-8a3413ee54d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1049b3da8d432fabb927101a8cdad0', 'request_id': 'req-4854514d-59e8-4d12-b473-8a3413ee54d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:17:47.404628 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4854514d-59e8-4d12-b473-8a3413ee54d1 admin admin] The token cache is being invalidate because project 1e1049b3da8d432fabb927101a8cdad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 11:17:47.404920 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4854514d-59e8-4d12-b473-8a3413ee54d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:17:47.405560 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4854514d-59e8-4d12-b473-8a3413ee54d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:17:47.407051 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4636/9240] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 11:17:47 2022] DELETE /identity/v3/projects/1e1049b3da8d432fabb927101a8cdad0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 11:17:47.411938 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99c94b-ecd8-42de-9a27-f74af7b319bf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:17:47.413373 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fb99c94b-ecd8-42de-9a27-f74af7b319bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:17:47.426648 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99c94b-ecd8-42de-9a27-f74af7b319bf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:17:47.482639 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7635d-4459-4d18-81c2-d8b3713d74e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:17:47.483172 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7635d-4459-4d18-81c2-d8b3713d74e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:17:47.483451 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7635d-4459-4d18-81c2-d8b3713d74e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:17:47.483721 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7635d-4459-4d18-81c2-d8b3713d74e9 admin admin] PATH_INFO: `/v3/users/173f7cb15ae7493cbf5e15627739020e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:17:47.484895 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7635d-4459-4d18-81c2-d8b3713d74e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=173f7cb15ae7493cbf5e15627739020e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:17:47.487504 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7635d-4459-4d18-81c2-d8b3713d74e9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:17:47.532179 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-68b7635d-4459-4d18-81c2-d8b3713d74e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '173f7cb15ae7493cbf5e15627739020e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:17:47.540871 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-68b7635d-4459-4d18-81c2-d8b3713d74e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '173f7cb15ae7493cbf5e15627739020e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:17:47.541534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-68b7635d-4459-4d18-81c2-d8b3713d74e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '173f7cb15ae7493cbf5e15627739020e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:17:47.554302 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-68b7635d-4459-4d18-81c2-d8b3713d74e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '173f7cb15ae7493cbf5e15627739020e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:17:47.558740 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:17:47.562215 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-68b7635d-4459-4d18-81c2-d8b3713d74e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '173f7cb15ae7493cbf5e15627739020e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:17:47.569122 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4605/9241] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Sep 30 11:17:47 2022] DELETE /identity/v3/users/173f7cb15ae7493cbf5e15627739020e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 11:17:47.746161 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854514d-59e8-4d12-b473-8a3413ee54d1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:17:47.747617 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4854514d-59e8-4d12-b473-8a3413ee54d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:17:47.762824 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854514d-59e8-4d12-b473-8a3413ee54d1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:17:47.821988 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5fa05-8c53-468d-94f4-ff5bbc19abbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35bc6b4a2c94914bd986ad019ecb5c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ffba943875a42809c70ac5c9bd54394', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:17:47.822643 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5fa05-8c53-468d-94f4-ff5bbc19abbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:17:47.822919 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5fa05-8c53-468d-94f4-ff5bbc19abbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:17:47.823189 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5fa05-8c53-468d-94f4-ff5bbc19abbc admin admin] PATH_INFO: `/v3/projects/479ef5a842f746db8c648003a654824a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:17:47.824317 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e5fa05-8c53-468d-94f4-ff5bbc19abbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=479ef5a842f746db8c648003a654824a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:17:47.826247 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e5fa05-8c53-468d-94f4-ff5bbc19abbc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:17:47.843178 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:17:47.874991 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3e5fa05-8c53-468d-94f4-ff5bbc19abbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '479ef5a842f746db8c648003a654824a', 'request_id': 'req-e3e5fa05-8c53-468d-94f4-ff5bbc19abbc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:17:47.884691 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3e5fa05-8c53-468d-94f4-ff5bbc19abbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '479ef5a842f746db8c648003a654824a', 'request_id': 'req-e3e5fa05-8c53-468d-94f4-ff5bbc19abbc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:17:47.891379 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3e5fa05-8c53-468d-94f4-ff5bbc19abbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '479ef5a842f746db8c648003a654824a', 'request_id': 'req-e3e5fa05-8c53-468d-94f4-ff5bbc19abbc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:17:47.903881 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3e5fa05-8c53-468d-94f4-ff5bbc19abbc admin admin] The token cache is being invalidate because project 479ef5a842f746db8c648003a654824a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 11:17:47.904169 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3e5fa05-8c53-468d-94f4-ff5bbc19abbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:17:47.904888 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3e5fa05-8c53-468d-94f4-ff5bbc19abbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 11:17:47.906634 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4637/9242] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Sep 30 11:17:47 2022] DELETE /identity/v3/projects/479ef5a842f746db8c648003a654824a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 11:17:57.568415 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:17:57.900759 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:18:58.118651 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7635d-4459-4d18-81c2-d8b3713d74e9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:18:58.120052 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-68b7635d-4459-4d18-81c2-d8b3713d74e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:18:58.201624 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7635d-4459-4d18-81c2-d8b3713d74e9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:18:58.263929 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517e963-a56e-4193-a138-a803324f9fa6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:18:58.264534 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517e963-a56e-4193-a138-a803324f9fa6 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:18:58.264843 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517e963-a56e-4193-a138-a803324f9fa6 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:18:58.265119 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517e963-a56e-4193-a138-a803324f9fa6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:18:58.266853 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7517e963-a56e-4193-a138-a803324f9fa6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:18:58.278501 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517e963-a56e-4193-a138-a803324f9fa6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:18:58.280057 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517e963-a56e-4193-a138-a803324f9fa6 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:18:58.291188 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4606/9243] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:18:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:19:08.286116 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=62 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:19:47.732015 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5fa05-8c53-468d-94f4-ff5bbc19abbc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:19:47.733483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e3e5fa05-8c53-468d-94f4-ff5bbc19abbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:19:47.752277 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5fa05-8c53-468d-94f4-ff5bbc19abbc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:19:47.757607 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cebcf-74e6-4028-9fcd-f61dd765226b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:19:47.758204 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cebcf-74e6-4028-9fcd-f61dd765226b service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:19:47.758483 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cebcf-74e6-4028-9fcd-f61dd765226b service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:19:47.758765 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cebcf-74e6-4028-9fcd-f61dd765226b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:19:47.760896 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-732cebcf-74e6-4028-9fcd-f61dd765226b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 11:19:47.772960 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732cebcf-74e6-4028-9fcd-f61dd765226b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:19:47.774525 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732cebcf-74e6-4028-9fcd-f61dd765226b service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:19:47.784470 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4638/9244] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:19:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:19:57.780023 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:24:00.108870 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517e963-a56e-4193-a138-a803324f9fa6 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:24:00.152036 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517e963-a56e-4193-a138-a803324f9fa6 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:24:00.157203 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21359e-09a2-45ab-b0ec-ef75e9805a11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:24:00.157804 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21359e-09a2-45ab-b0ec-ef75e9805a11 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:24:00.158084 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21359e-09a2-45ab-b0ec-ef75e9805a11 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:24:00.158357 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21359e-09a2-45ab-b0ec-ef75e9805a11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:24:00.166924 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21359e-09a2-45ab-b0ec-ef75e9805a11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:24:00.168700 n-d-master-1 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21359e-09a2-45ab-b0ec-ef75e9805a11 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:24:00.178378 n-d-master-1 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4607/9245] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:24:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:24:10.174347 n-d-master-1 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=20 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 11:24:52.676270 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cebcf-74e6-4028-9fcd-f61dd765226b service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 11:24:52.718702 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cebcf-74e6-4028-9fcd-f61dd765226b service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 11:24:52.723801 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3078e9c-97df-4e3b-ab12-d492f80b4aba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb22d0675bc4ca893b0477cebd470c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fbc72b5e3b84c8fb74d8d4952a26e76', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 11:24:52.724398 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3078e9c-97df-4e3b-ab12-d492f80b4aba service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 11:24:52.724711 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3078e9c-97df-4e3b-ab12-d492f80b4aba service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 11:24:52.724980 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3078e9c-97df-4e3b-ab12-d492f80b4aba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 11:24:52.734175 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3078e9c-97df-4e3b-ab12-d492f80b4aba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 11:24:52.735755 n-d-master-1 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3078e9c-97df-4e3b-ab12-d492f80b4aba service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 11:24:52.746346 n-d-master-1 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4639/9246] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Sep 30 11:24:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 11:25:02.741582 n-d-master-1 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=20 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}